2024-09-11T23:50:49.440 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T23:50:49.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:50:49.556 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901823 branch: wip-cls-rgw-busy-resharding description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7901823' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f rgw: compression type: random ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi067.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKHq3fo4HPSTxga0nZLkfJBk7D2ScsgkXBbOCxCqZ0Spd/82qDbbwuKqX+mJZ5Shkqrqgw6lUtw7z5iMwxIldOU= smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBInzHIdKeC10aXC4CTgrejOXs2kiGfLM91KZNVEQmcbOL9ryoUCISn9nImjrVq7daQgvAlFLibPSzrvgNjPr12U= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: force-branch: wip-67986 rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T23:50:49.556 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-11T23:50:49.557 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-11T23:50:49.557 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T23:50:49.558 INFO:teuthology.task.internal:Checking packages... 2024-09-11T23:50:49.579 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-11T23:50:49.579 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T23:50:49.580 INFO:teuthology.packaging:ref: None 2024-09-11T23:50:49.580 INFO:teuthology.packaging:tag: None 2024-09-11T23:50:49.580 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-11T23:50:49.580 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-11T23:50:49.580 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-11T23:50:49.729 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753.gd011c522 2024-09-11T23:50:49.730 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T23:50:49.741 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T23:50:49.742 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T23:50:49.759 INFO:teuthology.task.internal:Saving configuration 2024-09-11T23:50:49.775 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T23:50:49.784 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T23:50:49.816 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901823', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:45:36.120777', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKHq3fo4HPSTxga0nZLkfJBk7D2ScsgkXBbOCxCqZ0Spd/82qDbbwuKqX+mJZ5Shkqrqgw6lUtw7z5iMwxIldOU='} 2024-09-11T23:50:49.849 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901823', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:45:36.122262', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBInzHIdKeC10aXC4CTgrejOXs2kiGfLM91KZNVEQmcbOL9ryoUCISn9nImjrVq7daQgvAlFLibPSzrvgNjPr12U='} 2024-09-11T23:50:49.849 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T23:50:49.861 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-11T23:50:49.861 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-11T23:50:49.861 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T23:50:49.941 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f96b2b73490>, signals=[15]) 2024-09-11T23:50:49.944 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T23:50:49.954 INFO:teuthology.task.internal:Opening connections... 2024-09-11T23:50:49.954 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2024-09-11T23:50:49.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:50:50.044 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2024-09-11T23:50:50.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:50:50.129 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T23:50:50.136 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-09-11T23:50:50.154 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-09-11T23:50:50.154 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-09-11T23:50:50.212 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2024-09-11T23:50:50.212 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9" 2024-09-11T23:50:50.212 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2024-09-11T23:50:50.212 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2024-09-11T23:50:50.212 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9" 2024-09-11T23:50:50.213 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9" 2024-09-11T23:50:50.213 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T23:50:50.213 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-09-11T23:50:50.213 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon" 2024-09-11T23:50:50.213 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T23:50:50.213 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2024-09-11T23:50:50.213 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T23:50:50.213 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T23:50:50.213 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T23:50:50.214 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-09-11T23:50:50.247 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-09-11T23:50:50.267 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-09-11T23:50:50.267 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-09-11T23:50:50.325 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-09-11T23:50:50.325 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-09-11T23:50:50.325 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-09-11T23:50:50.325 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-09-11T23:50:50.325 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-09-11T23:50:50.325 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-09-11T23:50:50.325 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T23:50:50.326 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-09-11T23:50:50.326 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-09-11T23:50:50.326 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T23:50:50.326 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-09-11T23:50:50.326 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T23:50:50.326 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T23:50:50.326 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T23:50:50.326 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-09-11T23:50:50.355 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T23:50:50.367 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T23:50:50.398 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T23:50:50.398 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:50:50.400 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:50:50.418 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T23:50:50.425 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T23:50:50.425 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:50:50.457 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:50:50.784 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T23:50:50.856 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T23:50:50.876 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T23:50:50.876 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T23:50:50.877 DEBUG:teuthology.orchestra.run.smithi067:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:50:50.877 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:50:50.894 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:50:50.894 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-09-11T23:50:50.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:50:50.896 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-09-11T23:50:50.953 INFO:teuthology.orchestra.run.smithi067.stdout:5.14.0-503.el9.x86_64 2024-09-11T23:50:50.953 INFO:teuthology.task.kernel:Running kernel on smithi067: 5.14.0-503.el9.x86_64 2024-09-11T23:50:50.953 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum install -y kernel 2024-09-11T23:50:50.954 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-503.el9.x86_64 2024-09-11T23:50:50.955 INFO:teuthology.task.kernel:Running kernel on smithi170: 5.14.0-503.el9.x86_64 2024-09-11T23:50:50.955 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum install -y kernel 2024-09-11T23:50:53.224 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-11T23:50:53.635 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.2 MB 00:00 2024-09-11T23:50:57.250 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - AppStream 7.1 MB/s | 20 MB 00:02 2024-09-11T23:51:01.643 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-11T23:51:02.893 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 20 MB 00:08 2024-09-11T23:51:03.269 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 19 kB 00:00 2024-09-11T23:51:04.048 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-11T23:51:07.810 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 5.7 MB/s | 6.5 MB 00:01 2024-09-11T23:51:09.428 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-11T23:51:09.703 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-11T23:51:10.599 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-11T23:51:11.852 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T23:51:11.852 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T23:51:11.941 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-09-11T23:51:11.947 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-09-11T23:51:11.947 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2024-09-11T23:51:11.947 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-09-11T23:51:11.947 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-09-11T23:51:11.947 INFO:teuthology.orchestra.run.smithi067.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T23:51:11.947 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-09-11T23:51:11.947 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T23:51:11.947 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T23:51:11.947 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T23:51:11.947 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-11T23:51:11.947 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-09-11T23:51:11.948 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-09-11T23:51:11.948 INFO:teuthology.orchestra.run.smithi067.stdout:Install 4 Packages 2024-09-11T23:51:11.948 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-11T23:51:11.948 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 79 M 2024-09-11T23:51:11.948 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 126 M 2024-09-11T23:51:11.948 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-09-11T23:51:12.305 INFO:teuthology.orchestra.run.smithi067.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 296 kB/s | 23 kB 00:00 2024-09-11T23:51:14.138 INFO:teuthology.orchestra.run.smithi067.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 16 MB/s | 29 MB 00:01 2024-09-11T23:51:14.730 INFO:teuthology.orchestra.run.smithi067.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 14 MB/s | 35 MB 00:02 2024-09-11T23:51:14.922 INFO:teuthology.orchestra.run.smithi067.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.8 MB/s | 16 MB 00:02 2024-09-11T23:51:14.922 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:51:14.922 INFO:teuthology.orchestra.run.smithi067.stdout:Total 26 MB/s | 79 MB 00:02 2024-09-11T23:51:15.629 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-09-11T23:51:15.996 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-09-11T23:51:15.997 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-09-11T23:51:16.038 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-11T23:51:17.003 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-09-11T23:51:17.004 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-09-11T23:51:18.044 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-11T23:51:18.045 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-11T23:51:18.135 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-11T23:51:18.146 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-11T23:51:18.146 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-09-11T23:51:18.147 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-11T23:51:18.147 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-11T23:51:18.147 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-11T23:51:18.147 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-11T23:51:18.147 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-11T23:51:18.147 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-11T23:51:18.147 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-11T23:51:18.147 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:51:18.148 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-11T23:51:18.148 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-09-11T23:51:18.148 INFO:teuthology.orchestra.run.smithi170.stdout:Install 4 Packages 2024-09-11T23:51:18.148 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:51:18.148 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 79 M 2024-09-11T23:51:18.148 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 126 M 2024-09-11T23:51:18.149 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-11T23:51:18.272 INFO:teuthology.orchestra.run.smithi170.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 218 kB/s | 23 kB 00:00 2024-09-11T23:51:18.656 INFO:teuthology.orchestra.run.smithi170.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-11T23:51:19.090 INFO:teuthology.orchestra.run.smithi170.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-11T23:51:19.357 INFO:teuthology.orchestra.run.smithi170.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-11T23:51:19.357 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:51:19.357 INFO:teuthology.orchestra.run.smithi170.stdout:Total 65 MB/s | 79 MB 00:01 2024-09-11T23:51:19.582 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-09-11T23:51:20.043 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-11T23:51:20.248 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:51:20.322 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:51:20.389 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-11T23:51:20.390 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-11T23:51:21.327 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-11T23:51:21.327 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-11T23:51:23.102 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:51:23.226 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:51:23.782 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-11T23:51:24.489 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:51:24.566 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:51:27.380 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:51:27.512 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:51:28.351 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:51:28.394 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:51:32.413 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:51:32.512 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:51:33.533 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:51:37.329 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:52:12.571 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:52:12.611 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:52:12.926 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:52:12.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:52:12.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:52:12.926 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:52:13.787 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:52:13.787 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-11T23:52:13.787 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-09-11T23:52:13.787 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T23:52:13.787 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T23:52:13.787 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T23:52:13.788 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T23:52:13.788 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-11T23:52:13.788 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-09-11T23:52:14.131 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:52:14.219 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:52:14.219 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:52:14.219 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T23:52:14.220 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:52:14.220 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:52:14.220 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T23:52:14.220 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi067.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:52:14.220 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:52:14.278 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:52:14.279 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:52:14.279 DEBUG:teuthology.orchestra.run.smithi067:> sudo rpm -qi grub2-tools 2024-09-11T23:52:14.310 INFO:teuthology.orchestra.run.smithi067.stdout:Name : grub2-tools 2024-09-11T23:52:14.310 INFO:teuthology.orchestra.run.smithi067.stdout:Epoch : 1 2024-09-11T23:52:14.310 INFO:teuthology.orchestra.run.smithi067.stdout:Version : 2.06 2024-09-11T23:52:14.310 INFO:teuthology.orchestra.run.smithi067.stdout:Release : 82.el9 2024-09-11T23:52:14.310 INFO:teuthology.orchestra.run.smithi067.stdout:Architecture: x86_64 2024-09-11T23:52:14.311 INFO:teuthology.orchestra.run.smithi067.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T23:52:14.311 INFO:teuthology.orchestra.run.smithi067.stdout:Group : Unspecified 2024-09-11T23:52:14.311 INFO:teuthology.orchestra.run.smithi067.stdout:Size : 8274670 2024-09-11T23:52:14.311 INFO:teuthology.orchestra.run.smithi067.stdout:License : GPLv3+ 2024-09-11T23:52:14.311 INFO:teuthology.orchestra.run.smithi067.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T23:52:14.311 INFO:teuthology.orchestra.run.smithi067.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T23:52:14.311 INFO:teuthology.orchestra.run.smithi067.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T23:52:14.311 INFO:teuthology.orchestra.run.smithi067.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T23:52:14.311 INFO:teuthology.orchestra.run.smithi067.stdout:Packager : builder@centos.org 2024-09-11T23:52:14.311 INFO:teuthology.orchestra.run.smithi067.stdout:Vendor : CentOS 2024-09-11T23:52:14.311 INFO:teuthology.orchestra.run.smithi067.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T23:52:14.312 INFO:teuthology.orchestra.run.smithi067.stdout:Summary : Support tools for GRUB. 2024-09-11T23:52:14.312 INFO:teuthology.orchestra.run.smithi067.stdout:Description : 2024-09-11T23:52:14.312 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-11T23:52:14.312 INFO:teuthology.orchestra.run.smithi067.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T23:52:14.312 INFO:teuthology.orchestra.run.smithi067.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T23:52:14.312 INFO:teuthology.orchestra.run.smithi067.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T23:52:14.312 INFO:teuthology.orchestra.run.smithi067.stdout:hardware devices. 2024-09-11T23:52:14.312 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-11T23:52:14.312 INFO:teuthology.orchestra.run.smithi067.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T23:52:14.313 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T23:52:14.313 INFO:teuthology.task.kernel:Updating grub on smithi067 to boot 5.14.0-505.el9.x86_64 2024-09-11T23:52:14.314 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T23:52:14.970 INFO:teuthology.orchestra.run.smithi067.stderr:Generating grub configuration file ... 2024-09-11T23:52:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:52:15.220 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:52:15.647 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:52:15.647 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-11T23:52:15.647 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-11T23:52:15.647 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-11T23:52:16.304 INFO:teuthology.orchestra.run.smithi067.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T23:52:16.339 INFO:teuthology.orchestra.run.smithi067.stderr:done 2024-09-11T23:52:16.341 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-09-11T23:52:16.356 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.cEYdsBgYJe 2024-09-11T23:52:16.356 DEBUG:teuthology.orchestra.run.smithi067:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.cEYdsBgYJe 2024-09-11T23:52:16.426 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.cEYdsBgYJe 2024-09-11T23:52:16.529 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-11T23:52:16.530 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:52:16.530 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-11T23:52:16.530 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-11T23:52:16.530 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-11T23:52:16.530 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-11T23:52:16.530 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-11T23:52:16.530 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:52:16.530 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-11T23:52:16.568 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.cEYdsBgYJe is 6KB 2024-09-11T23:52:16.616 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.cEYdsBgYJe 2024-09-11T23:52:16.634 DEBUG:teuthology.orchestra.run.smithi067:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T23:52:16.696 INFO:teuthology.orchestra.run.smithi067.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T23:52:16.697 INFO:teuthology.orchestra.run.smithi067.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T23:52:16.697 INFO:teuthology.orchestra.run.smithi067.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T23:52:16.697 INFO:teuthology.orchestra.run.smithi067.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T23:52:16.698 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T23:52:16.845 DEBUG:teuthology.orchestra.run.smithi067:> sudo shutdown -r now 2024-09-11T23:52:16.902 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:52:16.989 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:52:16.989 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:52:16.990 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-11T23:52:16.990 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:52:16.990 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:52:16.990 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-11T23:52:16.990 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi170.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:52:16.990 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-09-11T23:52:17.049 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-11T23:52:17.049 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-11T23:52:17.050 DEBUG:teuthology.orchestra.run.smithi170:> sudo rpm -qi grub2-tools 2024-09-11T23:52:17.086 INFO:teuthology.orchestra.run.smithi170.stdout:Name : grub2-tools 2024-09-11T23:52:17.087 INFO:teuthology.orchestra.run.smithi170.stdout:Epoch : 1 2024-09-11T23:52:17.087 INFO:teuthology.orchestra.run.smithi170.stdout:Version : 2.06 2024-09-11T23:52:17.087 INFO:teuthology.orchestra.run.smithi170.stdout:Release : 82.el9 2024-09-11T23:52:17.087 INFO:teuthology.orchestra.run.smithi170.stdout:Architecture: x86_64 2024-09-11T23:52:17.087 INFO:teuthology.orchestra.run.smithi170.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T23:52:17.087 INFO:teuthology.orchestra.run.smithi170.stdout:Group : Unspecified 2024-09-11T23:52:17.087 INFO:teuthology.orchestra.run.smithi170.stdout:Size : 8274670 2024-09-11T23:52:17.087 INFO:teuthology.orchestra.run.smithi170.stdout:License : GPLv3+ 2024-09-11T23:52:17.087 INFO:teuthology.orchestra.run.smithi170.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T23:52:17.087 INFO:teuthology.orchestra.run.smithi170.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T23:52:17.088 INFO:teuthology.orchestra.run.smithi170.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T23:52:17.088 INFO:teuthology.orchestra.run.smithi170.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T23:52:17.088 INFO:teuthology.orchestra.run.smithi170.stdout:Packager : builder@centos.org 2024-09-11T23:52:17.088 INFO:teuthology.orchestra.run.smithi170.stdout:Vendor : CentOS 2024-09-11T23:52:17.088 INFO:teuthology.orchestra.run.smithi170.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T23:52:17.088 INFO:teuthology.orchestra.run.smithi170.stdout:Summary : Support tools for GRUB. 2024-09-11T23:52:17.088 INFO:teuthology.orchestra.run.smithi170.stdout:Description : 2024-09-11T23:52:17.088 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:52:17.088 INFO:teuthology.orchestra.run.smithi170.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T23:52:17.089 INFO:teuthology.orchestra.run.smithi170.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T23:52:17.089 INFO:teuthology.orchestra.run.smithi170.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T23:52:17.089 INFO:teuthology.orchestra.run.smithi170.stdout:hardware devices. 2024-09-11T23:52:17.089 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:52:17.089 INFO:teuthology.orchestra.run.smithi170.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T23:52:17.090 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T23:52:17.090 INFO:teuthology.task.kernel:Updating grub on smithi170 to boot 5.14.0-505.el9.x86_64 2024-09-11T23:52:17.091 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T23:52:17.703 INFO:teuthology.orchestra.run.smithi170.stderr:Generating grub configuration file ... 2024-09-11T23:52:18.972 INFO:teuthology.orchestra.run.smithi170.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T23:52:19.006 INFO:teuthology.orchestra.run.smithi170.stderr:done 2024-09-11T23:52:19.008 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2024-09-11T23:52:19.024 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.mZkjtVTIer 2024-09-11T23:52:19.024 DEBUG:teuthology.orchestra.run.smithi170:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mZkjtVTIer 2024-09-11T23:52:19.090 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.mZkjtVTIer 2024-09-11T23:52:19.228 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.mZkjtVTIer is 6KB 2024-09-11T23:52:19.276 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.mZkjtVTIer 2024-09-11T23:52:19.294 DEBUG:teuthology.orchestra.run.smithi170:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T23:52:19.356 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T23:52:19.357 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T23:52:19.357 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T23:52:19.357 INFO:teuthology.orchestra.run.smithi170.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-11T23:52:19.358 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-11T23:52:19.520 DEBUG:teuthology.orchestra.run.smithi170:> sudo shutdown -r now 2024-09-11T23:52:46.873 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T23:52:46.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-11T23:52:46.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:52:49.525 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T23:52:49.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-11T23:52:49.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:53:05.341 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-09-11T23:53:07.901 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.170 2024-09-11T23:53:14.349 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-11T23:53:14.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:53:16.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-11T23:53:17.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:53:17.437 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-09-11T23:53:29.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-11T23:53:29.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:53:47.837 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-09-11T23:54:02.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-11T23:54:02.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:54:03.393 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-09-11T23:54:03.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-11T23:54:03.752 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-11T23:54:03.752 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2024-09-11T23:54:03.767 INFO:teuthology.orchestra.run.smithi067.stdout:5.14.0-505.el9.x86_64 2024-09-11T23:54:03.768 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T23:54:03.768 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:54:03.768 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T23:54:04.769 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T23:54:04.770 DEBUG:teuthology.orchestra.run.smithi067:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:54:04.861 INFO:teuthology.orchestra.run.smithi067.stdout:ttyS1 2024-09-11T23:54:04.884 DEBUG:teuthology.parallel:result is None 2024-09-11T23:54:17.416 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T23:54:29.417 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-11T23:54:29.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:54:29.816 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-09-11T23:54:30.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-11T23:54:30.163 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-11T23:54:30.163 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-09-11T23:54:30.180 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-505.el9.x86_64 2024-09-11T23:54:30.180 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-11T23:54:30.180 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:54:30.180 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T23:54:31.181 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-11T23:54:31.278 DEBUG:teuthology.orchestra.run.smithi170:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:54:31.357 INFO:teuthology.orchestra.run.smithi170.stdout:ttyS1 2024-09-11T23:54:31.380 DEBUG:teuthology.parallel:result is None 2024-09-11T23:54:31.381 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T23:54:31.419 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T23:54:31.420 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:54:31.423 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T23:54:31.442 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T23:54:31.474 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T23:54:31.551 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T23:54:31.552 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:54:31.554 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T23:54:31.601 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T23:54:31.613 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T23:54:31.613 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:54:31.630 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T23:54:31.661 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:54:31.664 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:54:31.673 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:54:31.676 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T23:54:31.678 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T23:54:31.685 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T23:54:31.685 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:54:31.717 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T23:54:31.745 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T23:54:31.754 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T23:54:31.755 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:54:31.787 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T23:54:31.804 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:54:31.893 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:54:31.936 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:54:32.031 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:54:32.064 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-11T23:54:32.064 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:54:32.132 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:54:32.183 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T23:54:32.233 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:54:32.327 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T23:54:32.360 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-11T23:54:32.360 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T23:54:32.427 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2024-09-11T23:54:32.430 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2024-09-11T23:54:32.479 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:54:32.514 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T23:54:32.946 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T23:54:32.953 INFO:teuthology.task.internal:Starting timer... 2024-09-11T23:54:32.953 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T23:54:33.041 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T23:54:33.065 DEBUG:teuthology.orchestra.run.smithi067:> sudo service auditd rotate 2024-09-11T23:54:33.136 INFO:teuthology.orchestra.run.smithi067.stdout:Rotating logs: 2024-09-11T23:54:33.139 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2024-09-11T23:54:33.192 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2024-09-11T23:54:33.194 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T23:54:33.194 DEBUG:teuthology.orchestra.run.smithi067:> /usr/sbin/getenforce 2024-09-11T23:54:33.218 INFO:teuthology.orchestra.run.smithi067.stdout:Permissive 2024-09-11T23:54:33.218 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2024-09-11T23:54:33.243 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2024-09-11T23:54:33.244 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi067.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi170.front.sepia.ceph.com': 'permissive'} 2024-09-11T23:54:33.244 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T23:54:33.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:54:33.290 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-11T23:54:33.319 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:54:33.320 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T23:54:33.320 DEBUG:teuthology.orchestra.run.smithi067:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:54:33.363 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2024-09-11T23:54:33.394 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T23:54:33.403 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T23:54:33.407 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T23:54:33.532 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T23:54:33.542 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T23:54:33.543 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi067.front.sepia.ceph.com,smithi170.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T23:58:23.346 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi067.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com')] 2024-09-11T23:58:23.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-11T23:58:23.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:58:23.436 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-09-11T23:58:23.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-09-11T23:58:23.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-11T23:58:23.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:58:23.599 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-09-11T23:58:23.686 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-09-11T23:58:23.687 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T23:58:23.698 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T23:58:23.699 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:58:23.699 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:58:23.702 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T23:58:23.703 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T23:58:23.730 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:58:23.746 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:58:23.761 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T23:58:23.771 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: ntpd: command not found 2024-09-11T23:58:23.777 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T23:58:23.783 INFO:teuthology.orchestra.run.smithi067.stdout:506 Cannot talk to daemon 2024-09-11T23:58:23.797 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:58:23.803 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2024-09-11T23:58:23.812 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:58:23.815 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2024-09-11T23:58:23.829 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T23:58:23.844 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T23:58:23.870 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:58:23.873 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:58:23.873 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-09-11T23:58:23.873 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:58:23.873 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:58:23.874 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:58:23.874 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:58:23.900 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-09-11T23:58:23.904 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T23:58:23.904 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-09-11T23:58:23.904 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:58:23.904 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:58:23.904 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:58:23.904 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T23:58:23.904 INFO:teuthology.run_tasks:Running task install... 2024-09-11T23:58:23.912 DEBUG:teuthology.task.install:project ceph 2024-09-11T23:58:23.913 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-11T23:58:23.913 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-11T23:58:23.913 INFO:teuthology.task.install:Using flavor: default 2024-09-11T23:58:23.919 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T23:58:23.920 INFO:teuthology.task.install:extra packages: [] 2024-09-11T23:58:23.920 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'tag': None, 'wait_for_package': False} 2024-09-11T23:58:23.921 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-11T23:58:23.923 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'tag': None, 'wait_for_package': False} 2024-09-11T23:58:23.923 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-11T23:58:24.074 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/ 2024-09-11T23:58:24.074 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4753.gd011c522 2024-09-11T23:58:24.089 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/ 2024-09-11T23:58:24.089 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4753.gd011c522 2024-09-11T23:58:24.196 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:58:24.197 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-11T23:58:24.197 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:58:24.207 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T23:58:24.207 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-11T23:58:24.207 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T23:58:24.225 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-11T23:58:24.225 DEBUG:teuthology.orchestra.run.smithi067:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d011c522bb171e70fc5782f1e7a71ce5f37e573f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:58:24.234 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-11T23:58:24.234 DEBUG:teuthology.orchestra.run.smithi170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d011c522bb171e70fc5782f1e7a71ce5f37e573f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T23:58:24.292 DEBUG:teuthology.orchestra.run.smithi067:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:58:24.300 DEBUG:teuthology.orchestra.run.smithi170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T23:58:24.369 DEBUG:teuthology.orchestra.run.smithi067:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:58:24.375 DEBUG:teuthology.orchestra.run.smithi170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T23:58:24.434 INFO:teuthology.orchestra.run.smithi067.stdout:check_obsoletes = 1 2024-09-11T23:58:24.436 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum clean all 2024-09-11T23:58:24.439 INFO:teuthology.orchestra.run.smithi170.stdout:check_obsoletes = 1 2024-09-11T23:58:24.441 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum clean all 2024-09-11T23:58:24.671 INFO:teuthology.orchestra.run.smithi067.stdout:45 files removed 2024-09-11T23:58:24.671 INFO:teuthology.orchestra.run.smithi170.stdout:45 files removed 2024-09-11T23:58:24.698 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-11T23:58:24.699 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-11T23:58:25.267 INFO:teuthology.orchestra.run.smithi170.stdout:ceph packages for x86_64 300 kB/s | 84 kB 00:00 2024-09-11T23:58:25.268 INFO:teuthology.orchestra.run.smithi067.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-11T23:58:25.551 INFO:teuthology.orchestra.run.smithi170.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-11T23:58:25.552 INFO:teuthology.orchestra.run.smithi067.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-11T23:58:25.819 INFO:teuthology.orchestra.run.smithi067.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-11T23:58:25.830 INFO:teuthology.orchestra.run.smithi170.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-11T23:58:26.344 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.2 MB 00:00 2024-09-11T23:58:27.443 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.2 MB 00:01 2024-09-11T23:58:30.128 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 13 MB/s | 20 MB 00:01 2024-09-11T23:58:30.204 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - AppStream 7.5 MB/s | 20 MB 00:02 2024-09-11T23:58:34.539 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-11T23:58:36.298 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-11T23:58:37.171 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.5 MB 00:02 2024-09-11T23:58:37.219 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-11T23:58:38.688 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS Stream 9 - Extras packages 88 kB/s | 19 kB 00:00 2024-09-11T23:58:39.859 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-11T23:58:42.741 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-11T23:58:45.087 INFO:teuthology.orchestra.run.smithi170.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:58:45.088 INFO:teuthology.orchestra.run.smithi170.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:58:45.181 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-09-11T23:58:45.205 INFO:teuthology.orchestra.run.smithi170.stdout:====================================================================================================== 2024-09-11T23:58:45.205 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-09-11T23:58:45.205 INFO:teuthology.orchestra.run.smithi170.stdout:====================================================================================================== 2024-09-11T23:58:45.205 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-09-11T23:58:45.205 INFO:teuthology.orchestra.run.smithi170.stdout: ceph x86_64 2:19.3.0-4753.gd011c522.el9 ceph 6.6 k 2024-09-11T23:58:45.205 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-11T23:58:45.205 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 899 k 2024-09-11T23:58:45.205 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4753.gd011c522.el9 ceph 145 k 2024-09-11T23:58:45.205 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr x86_64 2:19.3.0-4753.gd011c522.el9 ceph 1.5 M 2024-09-11T23:58:45.205 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 154 k 2024-09-11T23:58:45.205 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 14 M 2024-09-11T23:58:45.206 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 7.4 M 2024-09-11T23:58:45.206 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 49 k 2024-09-11T23:58:45.206 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 11 M 2024-09-11T23:58:45.206 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test x86_64 2:19.3.0-4753.gd011c522.el9 ceph 50 M 2024-09-11T23:58:45.206 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 285 k 2024-09-11T23:58:45.206 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 782 k 2024-09-11T23:58:45.206 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 32 k 2024-09-11T23:58:45.206 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 755 k 2024-09-11T23:58:45.206 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 126 k 2024-09-11T23:58:45.206 INFO:teuthology.orchestra.run.smithi170.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-11T23:58:45.206 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-11T23:58:45.206 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados x86_64 2:19.3.0-4753.gd011c522.el9 ceph 322 k 2024-09-11T23:58:45.206 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 306 k 2024-09-11T23:58:45.207 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 99 k 2024-09-11T23:58:45.207 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 85 k 2024-09-11T23:58:45.207 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-11T23:58:45.207 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 170 k 2024-09-11T23:58:45.207 INFO:teuthology.orchestra.run.smithi170.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-11T23:58:45.207 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrading: 2024-09-11T23:58:45.207 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.5 M 2024-09-11T23:58:45.207 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-11T23:58:45.207 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-09-11T23:58:45.207 INFO:teuthology.orchestra.run.smithi170.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-11T23:58:45.207 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:58:45.207 INFO:teuthology.orchestra.run.smithi170.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-11T23:58:45.207 INFO:teuthology.orchestra.run.smithi170.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-11T23:58:45.208 INFO:teuthology.orchestra.run.smithi170.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-11T23:58:45.208 INFO:teuthology.orchestra.run.smithi170.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-11T23:58:45.208 INFO:teuthology.orchestra.run.smithi170.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-11T23:58:45.208 INFO:teuthology.orchestra.run.smithi170.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-11T23:58:45.208 INFO:teuthology.orchestra.run.smithi170.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-11T23:58:45.208 INFO:teuthology.orchestra.run.smithi170.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-11T23:58:45.208 INFO:teuthology.orchestra.run.smithi170.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-11T23:58:45.208 INFO:teuthology.orchestra.run.smithi170.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-11T23:58:45.208 INFO:teuthology.orchestra.run.smithi170.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-11T23:58:45.208 INFO:teuthology.orchestra.run.smithi170.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-11T23:58:45.208 INFO:teuthology.orchestra.run.smithi170.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-11T23:58:45.208 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:58:45.209 INFO:teuthology.orchestra.run.smithi170.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-11T23:58:45.209 INFO:teuthology.orchestra.run.smithi170.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-11T23:58:45.209 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 22 M 2024-09-11T23:58:45.209 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 34 k 2024-09-11T23:58:45.209 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds x86_64 2:19.3.0-4753.gd011c522.el9 ceph 2.4 M 2024-09-11T23:58:45.209 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 291 k 2024-09-11T23:58:45.209 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon x86_64 2:19.3.0-4753.gd011c522.el9 ceph 4.8 M 2024-09-11T23:58:45.209 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 17 M 2024-09-11T23:58:45.209 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 16 k 2024-09-11T23:58:45.209 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux x86_64 2:19.3.0-4753.gd011c522.el9 ceph 25 k 2024-09-11T23:58:45.209 INFO:teuthology.orchestra.run.smithi170.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-11T23:58:45.209 INFO:teuthology.orchestra.run.smithi170.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-11T23:58:45.209 INFO:teuthology.orchestra.run.smithi170.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-11T23:58:45.210 INFO:teuthology.orchestra.run.smithi170.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-11T23:58:45.210 INFO:teuthology.orchestra.run.smithi170.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-11T23:58:45.210 INFO:teuthology.orchestra.run.smithi170.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-11T23:58:45.210 INFO:teuthology.orchestra.run.smithi170.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-11T23:58:45.210 INFO:teuthology.orchestra.run.smithi170.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-11T23:58:45.210 INFO:teuthology.orchestra.run.smithi170.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-11T23:58:45.210 INFO:teuthology.orchestra.run.smithi170.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-11T23:58:45.210 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:58:45.210 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:58:45.210 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:58:45.210 INFO:teuthology.orchestra.run.smithi170.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:58:45.210 INFO:teuthology.orchestra.run.smithi170.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-11T23:58:45.210 INFO:teuthology.orchestra.run.smithi170.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-11T23:58:45.211 INFO:teuthology.orchestra.run.smithi170.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-11T23:58:45.211 INFO:teuthology.orchestra.run.smithi170.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-11T23:58:45.211 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:58:45.211 INFO:teuthology.orchestra.run.smithi170.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-11T23:58:45.211 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:58:45.211 INFO:teuthology.orchestra.run.smithi170.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-11T23:58:45.211 INFO:teuthology.orchestra.run.smithi170.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-11T23:58:45.211 INFO:teuthology.orchestra.run.smithi170.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-11T23:58:45.211 INFO:teuthology.orchestra.run.smithi170.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-11T23:58:45.211 INFO:teuthology.orchestra.run.smithi170.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-11T23:58:45.211 INFO:teuthology.orchestra.run.smithi170.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-11T23:58:45.211 INFO:teuthology.orchestra.run.smithi170.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-11T23:58:45.211 INFO:teuthology.orchestra.run.smithi170.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-11T23:58:45.212 INFO:teuthology.orchestra.run.smithi170.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-11T23:58:45.212 INFO:teuthology.orchestra.run.smithi170.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-11T23:58:45.212 INFO:teuthology.orchestra.run.smithi170.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-11T23:58:45.212 INFO:teuthology.orchestra.run.smithi170.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-11T23:58:45.212 INFO:teuthology.orchestra.run.smithi170.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-11T23:58:45.212 INFO:teuthology.orchestra.run.smithi170.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-11T23:58:45.212 INFO:teuthology.orchestra.run.smithi170.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-11T23:58:45.212 INFO:teuthology.orchestra.run.smithi170.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-11T23:58:45.212 INFO:teuthology.orchestra.run.smithi170.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-11T23:58:45.212 INFO:teuthology.orchestra.run.smithi170.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-11T23:58:45.212 INFO:teuthology.orchestra.run.smithi170.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-11T23:58:45.212 INFO:teuthology.orchestra.run.smithi170.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-11T23:58:45.212 INFO:teuthology.orchestra.run.smithi170.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-11T23:58:45.213 INFO:teuthology.orchestra.run.smithi170.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-11T23:58:45.213 INFO:teuthology.orchestra.run.smithi170.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-11T23:58:45.213 INFO:teuthology.orchestra.run.smithi170.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-11T23:58:45.213 INFO:teuthology.orchestra.run.smithi170.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-11T23:58:45.213 INFO:teuthology.orchestra.run.smithi170.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-11T23:58:45.213 INFO:teuthology.orchestra.run.smithi170.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-11T23:58:45.213 INFO:teuthology.orchestra.run.smithi170.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-11T23:58:45.213 INFO:teuthology.orchestra.run.smithi170.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-11T23:58:45.213 INFO:teuthology.orchestra.run.smithi170.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-11T23:58:45.213 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:58:45.213 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:58:45.213 INFO:teuthology.orchestra.run.smithi170.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-11T23:58:45.213 INFO:teuthology.orchestra.run.smithi170.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-11T23:58:45.214 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-11T23:58:45.214 INFO:teuthology.orchestra.run.smithi170.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-11T23:58:45.214 INFO:teuthology.orchestra.run.smithi170.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-11T23:58:45.214 INFO:teuthology.orchestra.run.smithi170.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-11T23:58:45.214 INFO:teuthology.orchestra.run.smithi170.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-11T23:58:45.214 INFO:teuthology.orchestra.run.smithi170.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-11T23:58:45.214 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:58:45.214 INFO:teuthology.orchestra.run.smithi170.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-11T23:58:45.214 INFO:teuthology.orchestra.run.smithi170.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-11T23:58:45.214 INFO:teuthology.orchestra.run.smithi170.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-11T23:58:45.214 INFO:teuthology.orchestra.run.smithi170.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-11T23:58:45.214 INFO:teuthology.orchestra.run.smithi170.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-11T23:58:45.214 INFO:teuthology.orchestra.run.smithi170.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-11T23:58:45.215 INFO:teuthology.orchestra.run.smithi170.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-11T23:58:45.215 INFO:teuthology.orchestra.run.smithi170.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-11T23:58:45.215 INFO:teuthology.orchestra.run.smithi170.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:58:45.215 INFO:teuthology.orchestra.run.smithi170.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-11T23:58:45.215 INFO:teuthology.orchestra.run.smithi170.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-11T23:58:45.215 INFO:teuthology.orchestra.run.smithi170.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-11T23:58:45.215 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:58:45.215 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:58:45.215 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:58:45.215 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 508 k 2024-09-11T23:58:45.215 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:58:45.215 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-11T23:58:45.216 INFO:teuthology.orchestra.run.smithi170.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-11T23:58:45.216 INFO:teuthology.orchestra.run.smithi170.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-11T23:58:45.216 INFO:teuthology.orchestra.run.smithi170.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-11T23:58:45.216 INFO:teuthology.orchestra.run.smithi170.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-11T23:58:45.216 INFO:teuthology.orchestra.run.smithi170.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-11T23:58:45.216 INFO:teuthology.orchestra.run.smithi170.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-11T23:58:45.216 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:58:45.216 INFO:teuthology.orchestra.run.smithi170.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-11T23:58:45.216 INFO:teuthology.orchestra.run.smithi170.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-11T23:58:45.216 INFO:teuthology.orchestra.run.smithi170.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-11T23:58:45.216 INFO:teuthology.orchestra.run.smithi170.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-11T23:58:45.216 INFO:teuthology.orchestra.run.smithi170.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-11T23:58:45.216 INFO:teuthology.orchestra.run.smithi170.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-11T23:58:45.217 INFO:teuthology.orchestra.run.smithi170.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-11T23:58:45.217 INFO:teuthology.orchestra.run.smithi170.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-11T23:58:45.217 INFO:teuthology.orchestra.run.smithi170.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-11T23:58:45.217 INFO:teuthology.orchestra.run.smithi170.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-11T23:58:45.217 INFO:teuthology.orchestra.run.smithi170.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-11T23:58:45.217 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:58:45.217 INFO:teuthology.orchestra.run.smithi170.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:58:45.217 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:58:45.217 INFO:teuthology.orchestra.run.smithi170.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-11T23:58:45.217 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:58:45.217 INFO:teuthology.orchestra.run.smithi170.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-11T23:58:45.217 INFO:teuthology.orchestra.run.smithi170.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-11T23:58:45.218 INFO:teuthology.orchestra.run.smithi170.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-11T23:58:45.218 INFO:teuthology.orchestra.run.smithi170.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-11T23:58:45.218 INFO:teuthology.orchestra.run.smithi170.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-11T23:58:45.218 INFO:teuthology.orchestra.run.smithi170.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-11T23:58:45.218 INFO:teuthology.orchestra.run.smithi170.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-11T23:58:45.218 INFO:teuthology.orchestra.run.smithi170.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-11T23:58:45.218 INFO:teuthology.orchestra.run.smithi170.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-11T23:58:45.218 INFO:teuthology.orchestra.run.smithi170.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-11T23:58:45.218 INFO:teuthology.orchestra.run.smithi170.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-11T23:58:45.218 INFO:teuthology.orchestra.run.smithi170.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:58:45.218 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:58:45.219 INFO:teuthology.orchestra.run.smithi170.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-11T23:58:45.219 INFO:teuthology.orchestra.run.smithi170.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-11T23:58:45.219 INFO:teuthology.orchestra.run.smithi170.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-11T23:58:45.219 INFO:teuthology.orchestra.run.smithi170.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-11T23:58:45.219 INFO:teuthology.orchestra.run.smithi170.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-11T23:58:45.219 INFO:teuthology.orchestra.run.smithi170.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-11T23:58:45.219 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:58:45.219 INFO:teuthology.orchestra.run.smithi170.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-11T23:58:45.219 INFO:teuthology.orchestra.run.smithi170.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-11T23:58:45.220 INFO:teuthology.orchestra.run.smithi170.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-11T23:58:45.220 INFO:teuthology.orchestra.run.smithi170.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-11T23:58:45.220 INFO:teuthology.orchestra.run.smithi170.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-11T23:58:45.220 INFO:teuthology.orchestra.run.smithi170.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-11T23:58:45.220 INFO:teuthology.orchestra.run.smithi170.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-11T23:58:45.220 INFO:teuthology.orchestra.run.smithi170.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-11T23:58:45.220 INFO:teuthology.orchestra.run.smithi170.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-11T23:58:45.220 INFO:teuthology.orchestra.run.smithi170.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-11T23:58:45.220 INFO:teuthology.orchestra.run.smithi170.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-11T23:58:45.220 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:58:45.220 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:58:45.220 INFO:teuthology.orchestra.run.smithi170.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-11T23:58:45.221 INFO:teuthology.orchestra.run.smithi170.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-11T23:58:45.221 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:58:45.221 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:58:45.221 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:58:45.221 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:58:45.221 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 45 k 2024-09-11T23:58:45.222 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 143 k 2024-09-11T23:58:45.222 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:58:45.222 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:58:45.222 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:58:45.222 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:58:45.222 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:58:45.222 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:58:45.222 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:58:45.222 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:58:45.223 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:58:45.223 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:58:45.223 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:58:45.223 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:58:45.223 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:58:45.223 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:58:45.223 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:58:45.223 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:58:45.223 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:58:45.223 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:58:45.223 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:58:45.223 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:58:45.223 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:58:45.224 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:58:45.224 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:58:45.224 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:58:45.224 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:58:45.224 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:58:45.224 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:58:45.224 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:58:45.224 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:58:45.224 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:58:45.224 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:58:45.224 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:58:45.224 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:58:45.225 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:58:45.225 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:58:45.225 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:58:45.225 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:58:45.225 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:58:45.225 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:58:45.225 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:58:45.225 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:58:45.225 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:58:45.225 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:58:45.225 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:58:45.225 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:58:45.225 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:58:45.226 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:58:45.226 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:58:45.226 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:58:45.226 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:58:45.226 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:58:45.226 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:58:45.226 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:58:45.226 INFO:teuthology.orchestra.run.smithi170.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:58:45.226 INFO:teuthology.orchestra.run.smithi170.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-11T23:58:45.226 INFO:teuthology.orchestra.run.smithi170.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-11T23:58:45.226 INFO:teuthology.orchestra.run.smithi170.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-11T23:58:45.226 INFO:teuthology.orchestra.run.smithi170.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:58:45.227 INFO:teuthology.orchestra.run.smithi170.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-11T23:58:45.227 INFO:teuthology.orchestra.run.smithi170.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:58:45.227 INFO:teuthology.orchestra.run.smithi170.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-11T23:58:45.227 INFO:teuthology.orchestra.run.smithi170.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-11T23:58:45.227 INFO:teuthology.orchestra.run.smithi170.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-11T23:58:45.227 INFO:teuthology.orchestra.run.smithi170.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-11T23:58:45.227 INFO:teuthology.orchestra.run.smithi170.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-11T23:58:45.227 INFO:teuthology.orchestra.run.smithi170.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-11T23:58:45.227 INFO:teuthology.orchestra.run.smithi170.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-11T23:58:45.227 INFO:teuthology.orchestra.run.smithi170.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-11T23:58:45.227 INFO:teuthology.orchestra.run.smithi170.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-11T23:58:45.227 INFO:teuthology.orchestra.run.smithi170.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-11T23:58:45.227 INFO:teuthology.orchestra.run.smithi170.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-11T23:58:45.227 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:58:45.228 INFO:teuthology.orchestra.run.smithi170.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-11T23:58:45.228 INFO:teuthology.orchestra.run.smithi170.stdout:Installing weak dependencies: 2024-09-11T23:58:45.228 INFO:teuthology.orchestra.run.smithi170.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-11T23:58:45.228 INFO:teuthology.orchestra.run.smithi170.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-11T23:58:45.228 INFO:teuthology.orchestra.run.smithi170.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-11T23:58:45.228 INFO:teuthology.orchestra.run.smithi170.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-11T23:58:45.228 INFO:teuthology.orchestra.run.smithi170.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-11T23:58:45.228 INFO:teuthology.orchestra.run.smithi170.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-11T23:58:45.228 INFO:teuthology.orchestra.run.smithi170.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-11T23:58:45.228 INFO:teuthology.orchestra.run.smithi170.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-11T23:58:45.228 INFO:teuthology.orchestra.run.smithi170.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-11T23:58:45.228 INFO:teuthology.orchestra.run.smithi170.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-11T23:58:45.228 INFO:teuthology.orchestra.run.smithi170.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-11T23:58:45.229 INFO:teuthology.orchestra.run.smithi170.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-11T23:58:45.229 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:58:45.229 INFO:teuthology.orchestra.run.smithi170.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-11T23:58:45.229 INFO:teuthology.orchestra.run.smithi170.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-11T23:58:45.229 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:58:45.229 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-09-11T23:58:45.229 INFO:teuthology.orchestra.run.smithi170.stdout:====================================================================================================== 2024-09-11T23:58:45.229 INFO:teuthology.orchestra.run.smithi170.stdout:Install 283 Packages 2024-09-11T23:58:45.229 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrade 2 Packages 2024-09-11T23:58:45.229 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:58:45.230 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 327 M 2024-09-11T23:58:45.230 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-09-11T23:58:45.590 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-11T23:58:45.626 INFO:teuthology.orchestra.run.smithi170.stdout:(1/285): ceph-19.3.0-4753.gd011c522.el9.x86_64. 54 kB/s | 6.6 kB 00:00 2024-09-11T23:58:45.868 INFO:teuthology.orchestra.run.smithi170.stdout:(2/285): ceph-fuse-19.3.0-4753.gd011c522.el9.x8 3.6 MB/s | 899 kB 00:00 2024-09-11T23:58:46.001 INFO:teuthology.orchestra.run.smithi170.stdout:(3/285): ceph-base-19.3.0-4753.gd011c522.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-11T23:58:46.026 INFO:teuthology.orchestra.run.smithi170.stdout:(4/285): ceph-immutable-object-cache-19.3.0-475 916 kB/s | 145 kB 00:00 2024-09-11T23:58:46.119 INFO:teuthology.orchestra.run.smithi170.stdout:(5/285): ceph-mds-19.3.0-4753.gd011c522.el9.x86 20 MB/s | 2.4 MB 00:00 2024-09-11T23:58:46.327 INFO:teuthology.orchestra.run.smithi170.stdout:(6/285): ceph-mgr-19.3.0-4753.gd011c522.el9.x86 5.1 MB/s | 1.5 MB 00:00 2024-09-11T23:58:46.394 INFO:teuthology.orchestra.run.smithi170.stdout:(7/285): ceph-mon-19.3.0-4753.gd011c522.el9.x86 17 MB/s | 4.8 MB 00:00 2024-09-11T23:58:46.628 INFO:teuthology.orchestra.run.smithi170.stdout:(8/285): ceph-common-19.3.0-4753.gd011c522.el9. 19 MB/s | 22 MB 00:01 2024-09-11T23:58:46.670 INFO:teuthology.orchestra.run.smithi170.stdout:(9/285): ceph-selinux-19.3.0-4753.gd011c522.el9 607 kB/s | 25 kB 00:00 2024-09-11T23:58:47.012 INFO:teuthology.orchestra.run.smithi170.stdout:(10/285): ceph-radosgw-19.3.0-4753.gd011c522.el 18 MB/s | 11 MB 00:00 2024-09-11T23:58:47.045 INFO:teuthology.orchestra.run.smithi170.stdout:(11/285): libcephfs-devel-19.3.0-4753.gd011c522 955 kB/s | 32 kB 00:00 2024-09-11T23:58:47.146 INFO:teuthology.orchestra.run.smithi170.stdout:(12/285): libcephfs2-19.3.0-4753.gd011c522.el9. 7.4 MB/s | 755 kB 00:00 2024-09-11T23:58:47.204 INFO:teuthology.orchestra.run.smithi170.stdout:(13/285): libcephsqlite-19.3.0-4753.gd011c522.e 2.7 MB/s | 161 kB 00:00 2024-09-11T23:58:47.271 INFO:teuthology.orchestra.run.smithi170.stdout:(14/285): librados-devel-19.3.0-4753.gd011c522. 1.9 MB/s | 126 kB 00:00 2024-09-11T23:58:47.347 INFO:teuthology.orchestra.run.smithi170.stdout:(15/285): libradosstriper1-19.3.0-4753.gd011c52 6.6 MB/s | 508 kB 00:00 2024-09-11T23:58:47.772 INFO:teuthology.orchestra.run.smithi170.stdout:(16/285): librgw2-19.3.0-4753.gd011c522.el9.x86 13 MB/s | 5.5 MB 00:00 2024-09-11T23:58:47.814 INFO:teuthology.orchestra.run.smithi170.stdout:(17/285): python3-ceph-argparse-19.3.0-4753.gd0 1.1 MB/s | 45 kB 00:00 2024-09-11T23:58:47.889 INFO:teuthology.orchestra.run.smithi170.stdout:(18/285): python3-ceph-common-19.3.0-4753.gd011 1.9 MB/s | 143 kB 00:00 2024-09-11T23:58:47.997 INFO:teuthology.orchestra.run.smithi067.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:58:47.998 INFO:teuthology.orchestra.run.smithi067.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T23:58:48.089 INFO:teuthology.orchestra.run.smithi170.stdout:(19/285): ceph-osd-19.3.0-4753.gd011c522.el9.x8 9.7 MB/s | 17 MB 00:01 2024-09-11T23:58:48.096 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-09-11T23:58:48.115 INFO:teuthology.orchestra.run.smithi170.stdout:(20/285): python3-cephfs-19.3.0-4753.gd011c522. 716 kB/s | 161 kB 00:00 2024-09-11T23:58:48.124 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================================== 2024-09-11T23:58:48.124 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-09-11T23:58:48.124 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================================== 2024-09-11T23:58:48.124 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-09-11T23:58:48.124 INFO:teuthology.orchestra.run.smithi067.stdout: ceph x86_64 2:19.3.0-4753.gd011c522.el9 ceph 6.6 k 2024-09-11T23:58:48.124 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-11T23:58:48.124 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 899 k 2024-09-11T23:58:48.124 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4753.gd011c522.el9 ceph 145 k 2024-09-11T23:58:48.124 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr x86_64 2:19.3.0-4753.gd011c522.el9 ceph 1.5 M 2024-09-11T23:58:48.124 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 154 k 2024-09-11T23:58:48.125 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 14 M 2024-09-11T23:58:48.125 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 7.4 M 2024-09-11T23:58:48.125 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 49 k 2024-09-11T23:58:48.125 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 11 M 2024-09-11T23:58:48.125 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test x86_64 2:19.3.0-4753.gd011c522.el9 ceph 50 M 2024-09-11T23:58:48.125 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 285 k 2024-09-11T23:58:48.125 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 782 k 2024-09-11T23:58:48.125 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 32 k 2024-09-11T23:58:48.125 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 755 k 2024-09-11T23:58:48.125 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 126 k 2024-09-11T23:58:48.125 INFO:teuthology.orchestra.run.smithi067.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-11T23:58:48.126 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-11T23:58:48.126 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados x86_64 2:19.3.0-4753.gd011c522.el9 ceph 322 k 2024-09-11T23:58:48.126 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 306 k 2024-09-11T23:58:48.126 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 99 k 2024-09-11T23:58:48.126 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 85 k 2024-09-11T23:58:48.126 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-11T23:58:48.126 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 170 k 2024-09-11T23:58:48.126 INFO:teuthology.orchestra.run.smithi067.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-11T23:58:48.126 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2024-09-11T23:58:48.126 INFO:teuthology.orchestra.run.smithi067.stdout: librados2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.5 M 2024-09-11T23:58:48.126 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-11T23:58:48.127 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-09-11T23:58:48.127 INFO:teuthology.orchestra.run.smithi067.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-11T23:58:48.127 INFO:teuthology.orchestra.run.smithi067.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T23:58:48.127 INFO:teuthology.orchestra.run.smithi067.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-11T23:58:48.127 INFO:teuthology.orchestra.run.smithi067.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-11T23:58:48.127 INFO:teuthology.orchestra.run.smithi067.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-11T23:58:48.127 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-11T23:58:48.127 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-11T23:58:48.127 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-11T23:58:48.127 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-11T23:58:48.127 INFO:teuthology.orchestra.run.smithi067.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-11T23:58:48.127 INFO:teuthology.orchestra.run.smithi067.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-11T23:58:48.127 INFO:teuthology.orchestra.run.smithi067.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-11T23:58:48.128 INFO:teuthology.orchestra.run.smithi067.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-11T23:58:48.128 INFO:teuthology.orchestra.run.smithi067.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-11T23:58:48.128 INFO:teuthology.orchestra.run.smithi067.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-11T23:58:48.128 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T23:58:48.128 INFO:teuthology.orchestra.run.smithi067.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-11T23:58:48.128 INFO:teuthology.orchestra.run.smithi067.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-11T23:58:48.128 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 22 M 2024-09-11T23:58:48.128 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 34 k 2024-09-11T23:58:48.129 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds x86_64 2:19.3.0-4753.gd011c522.el9 ceph 2.4 M 2024-09-11T23:58:48.129 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 291 k 2024-09-11T23:58:48.129 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon x86_64 2:19.3.0-4753.gd011c522.el9 ceph 4.8 M 2024-09-11T23:58:48.129 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 17 M 2024-09-11T23:58:48.129 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 16 k 2024-09-11T23:58:48.129 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux x86_64 2:19.3.0-4753.gd011c522.el9 ceph 25 k 2024-09-11T23:58:48.129 INFO:teuthology.orchestra.run.smithi067.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-11T23:58:48.129 INFO:teuthology.orchestra.run.smithi067.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-11T23:58:48.129 INFO:teuthology.orchestra.run.smithi067.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-11T23:58:48.129 INFO:teuthology.orchestra.run.smithi067.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-11T23:58:48.129 INFO:teuthology.orchestra.run.smithi067.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-11T23:58:48.129 INFO:teuthology.orchestra.run.smithi067.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-11T23:58:48.129 INFO:teuthology.orchestra.run.smithi067.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-11T23:58:48.130 INFO:teuthology.orchestra.run.smithi067.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-11T23:58:48.130 INFO:teuthology.orchestra.run.smithi067.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-11T23:58:48.130 INFO:teuthology.orchestra.run.smithi067.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-11T23:58:48.130 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T23:58:48.130 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T23:58:48.130 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T23:58:48.130 INFO:teuthology.orchestra.run.smithi067.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T23:58:48.130 INFO:teuthology.orchestra.run.smithi067.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-11T23:58:48.130 INFO:teuthology.orchestra.run.smithi067.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-11T23:58:48.130 INFO:teuthology.orchestra.run.smithi067.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-11T23:58:48.130 INFO:teuthology.orchestra.run.smithi067.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-11T23:58:48.130 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T23:58:48.130 INFO:teuthology.orchestra.run.smithi067.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-11T23:58:48.130 INFO:teuthology.orchestra.run.smithi067.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T23:58:48.131 INFO:teuthology.orchestra.run.smithi067.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-11T23:58:48.131 INFO:teuthology.orchestra.run.smithi067.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-11T23:58:48.131 INFO:teuthology.orchestra.run.smithi067.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-11T23:58:48.131 INFO:teuthology.orchestra.run.smithi067.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-11T23:58:48.131 INFO:teuthology.orchestra.run.smithi067.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-11T23:58:48.131 INFO:teuthology.orchestra.run.smithi067.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-11T23:58:48.131 INFO:teuthology.orchestra.run.smithi067.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-11T23:58:48.131 INFO:teuthology.orchestra.run.smithi067.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-11T23:58:48.131 INFO:teuthology.orchestra.run.smithi067.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-11T23:58:48.131 INFO:teuthology.orchestra.run.smithi067.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-11T23:58:48.132 INFO:teuthology.orchestra.run.smithi067.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-11T23:58:48.132 INFO:teuthology.orchestra.run.smithi067.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-11T23:58:48.132 INFO:teuthology.orchestra.run.smithi067.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-11T23:58:48.132 INFO:teuthology.orchestra.run.smithi067.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-11T23:58:48.132 INFO:teuthology.orchestra.run.smithi067.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-11T23:58:48.132 INFO:teuthology.orchestra.run.smithi067.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-11T23:58:48.132 INFO:teuthology.orchestra.run.smithi067.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-11T23:58:48.132 INFO:teuthology.orchestra.run.smithi067.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-11T23:58:48.132 INFO:teuthology.orchestra.run.smithi067.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-11T23:58:48.132 INFO:teuthology.orchestra.run.smithi067.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-11T23:58:48.133 INFO:teuthology.orchestra.run.smithi067.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-11T23:58:48.133 INFO:teuthology.orchestra.run.smithi067.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-11T23:58:48.133 INFO:teuthology.orchestra.run.smithi067.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-11T23:58:48.133 INFO:teuthology.orchestra.run.smithi067.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-11T23:58:48.133 INFO:teuthology.orchestra.run.smithi067.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-11T23:58:48.133 INFO:teuthology.orchestra.run.smithi067.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-11T23:58:48.133 INFO:teuthology.orchestra.run.smithi067.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-11T23:58:48.133 INFO:teuthology.orchestra.run.smithi067.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-11T23:58:48.133 INFO:teuthology.orchestra.run.smithi067.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-11T23:58:48.133 INFO:teuthology.orchestra.run.smithi067.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-11T23:58:48.133 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T23:58:48.134 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T23:58:48.134 INFO:teuthology.orchestra.run.smithi067.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-11T23:58:48.134 INFO:teuthology.orchestra.run.smithi067.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-11T23:58:48.134 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-11T23:58:48.134 INFO:teuthology.orchestra.run.smithi067.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-11T23:58:48.134 INFO:teuthology.orchestra.run.smithi067.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-11T23:58:48.134 INFO:teuthology.orchestra.run.smithi067.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-11T23:58:48.134 INFO:teuthology.orchestra.run.smithi067.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-11T23:58:48.134 INFO:teuthology.orchestra.run.smithi067.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-11T23:58:48.134 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T23:58:48.134 INFO:teuthology.orchestra.run.smithi067.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-11T23:58:48.135 INFO:teuthology.orchestra.run.smithi067.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-11T23:58:48.135 INFO:teuthology.orchestra.run.smithi067.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-11T23:58:48.135 INFO:teuthology.orchestra.run.smithi067.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-11T23:58:48.135 INFO:teuthology.orchestra.run.smithi067.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-11T23:58:48.135 INFO:teuthology.orchestra.run.smithi067.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-11T23:58:48.135 INFO:teuthology.orchestra.run.smithi067.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-11T23:58:48.135 INFO:teuthology.orchestra.run.smithi067.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-11T23:58:48.135 INFO:teuthology.orchestra.run.smithi067.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T23:58:48.135 INFO:teuthology.orchestra.run.smithi067.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-11T23:58:48.135 INFO:teuthology.orchestra.run.smithi067.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-11T23:58:48.135 INFO:teuthology.orchestra.run.smithi067.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-11T23:58:48.135 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T23:58:48.135 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T23:58:48.136 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T23:58:48.136 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 508 k 2024-09-11T23:58:48.136 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T23:58:48.136 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-11T23:58:48.136 INFO:teuthology.orchestra.run.smithi067.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-11T23:58:48.136 INFO:teuthology.orchestra.run.smithi067.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-11T23:58:48.136 INFO:teuthology.orchestra.run.smithi067.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-11T23:58:48.136 INFO:teuthology.orchestra.run.smithi067.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-11T23:58:48.136 INFO:teuthology.orchestra.run.smithi067.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-11T23:58:48.136 INFO:teuthology.orchestra.run.smithi067.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-11T23:58:48.136 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T23:58:48.136 INFO:teuthology.orchestra.run.smithi067.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-11T23:58:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-11T23:58:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-11T23:58:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-11T23:58:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-11T23:58:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-11T23:58:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-11T23:58:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-11T23:58:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-11T23:58:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-11T23:58:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-11T23:58:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T23:58:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T23:58:48.137 INFO:teuthology.orchestra.run.smithi067.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T23:58:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-11T23:58:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T23:58:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-11T23:58:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-11T23:58:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-11T23:58:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-11T23:58:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-11T23:58:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-11T23:58:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-11T23:58:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-11T23:58:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-11T23:58:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-11T23:58:48.138 INFO:teuthology.orchestra.run.smithi067.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-11T23:58:48.139 INFO:teuthology.orchestra.run.smithi067.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T23:58:48.139 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T23:58:48.139 INFO:teuthology.orchestra.run.smithi067.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-11T23:58:48.139 INFO:teuthology.orchestra.run.smithi067.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-11T23:58:48.139 INFO:teuthology.orchestra.run.smithi067.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-11T23:58:48.139 INFO:teuthology.orchestra.run.smithi067.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-11T23:58:48.139 INFO:teuthology.orchestra.run.smithi067.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-11T23:58:48.139 INFO:teuthology.orchestra.run.smithi067.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-11T23:58:48.139 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T23:58:48.139 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-11T23:58:48.139 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-11T23:58:48.139 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-11T23:58:48.139 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-11T23:58:48.140 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-11T23:58:48.140 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-11T23:58:48.140 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-11T23:58:48.140 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-11T23:58:48.140 INFO:teuthology.orchestra.run.smithi067.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-11T23:58:48.140 INFO:teuthology.orchestra.run.smithi067.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-11T23:58:48.140 INFO:teuthology.orchestra.run.smithi067.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-11T23:58:48.140 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T23:58:48.140 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T23:58:48.140 INFO:teuthology.orchestra.run.smithi067.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-11T23:58:48.140 INFO:teuthology.orchestra.run.smithi067.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-11T23:58:48.140 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T23:58:48.141 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T23:58:48.141 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T23:58:48.141 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T23:58:48.141 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 45 k 2024-09-11T23:58:48.141 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 143 k 2024-09-11T23:58:48.141 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T23:58:48.141 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T23:58:48.141 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T23:58:48.141 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T23:58:48.141 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T23:58:48.141 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T23:58:48.141 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T23:58:48.141 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T23:58:48.141 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T23:58:48.142 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T23:58:48.142 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T23:58:48.142 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T23:58:48.142 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T23:58:48.142 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T23:58:48.142 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T23:58:48.142 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T23:58:48.142 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T23:58:48.142 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T23:58:48.142 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T23:58:48.142 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T23:58:48.142 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T23:58:48.142 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T23:58:48.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T23:58:48.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T23:58:48.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T23:58:48.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T23:58:48.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T23:58:48.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T23:58:48.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T23:58:48.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T23:58:48.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T23:58:48.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T23:58:48.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T23:58:48.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T23:58:48.143 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T23:58:48.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T23:58:48.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T23:58:48.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T23:58:48.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T23:58:48.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T23:58:48.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T23:58:48.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T23:58:48.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T23:58:48.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T23:58:48.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T23:58:48.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T23:58:48.144 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T23:58:48.145 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T23:58:48.145 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T23:58:48.145 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T23:58:48.145 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T23:58:48.145 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T23:58:48.145 INFO:teuthology.orchestra.run.smithi067.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T23:58:48.145 INFO:teuthology.orchestra.run.smithi067.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T23:58:48.145 INFO:teuthology.orchestra.run.smithi067.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-11T23:58:48.145 INFO:teuthology.orchestra.run.smithi067.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-11T23:58:48.145 INFO:teuthology.orchestra.run.smithi067.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-11T23:58:48.145 INFO:teuthology.orchestra.run.smithi067.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T23:58:48.145 INFO:teuthology.orchestra.run.smithi067.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-11T23:58:48.146 INFO:teuthology.orchestra.run.smithi067.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T23:58:48.146 INFO:teuthology.orchestra.run.smithi067.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-11T23:58:48.146 INFO:teuthology.orchestra.run.smithi067.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-11T23:58:48.146 INFO:teuthology.orchestra.run.smithi067.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-11T23:58:48.146 INFO:teuthology.orchestra.run.smithi067.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-11T23:58:48.146 INFO:teuthology.orchestra.run.smithi067.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-11T23:58:48.146 INFO:teuthology.orchestra.run.smithi067.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-11T23:58:48.146 INFO:teuthology.orchestra.run.smithi067.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-11T23:58:48.146 INFO:teuthology.orchestra.run.smithi067.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-11T23:58:48.147 INFO:teuthology.orchestra.run.smithi067.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-11T23:58:48.147 INFO:teuthology.orchestra.run.smithi067.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-11T23:58:48.147 INFO:teuthology.orchestra.run.smithi067.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-11T23:58:48.147 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T23:58:48.147 INFO:teuthology.orchestra.run.smithi067.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-11T23:58:48.147 INFO:teuthology.orchestra.run.smithi067.stdout:Installing weak dependencies: 2024-09-11T23:58:48.147 INFO:teuthology.orchestra.run.smithi067.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-11T23:58:48.147 INFO:teuthology.orchestra.run.smithi067.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-11T23:58:48.147 INFO:teuthology.orchestra.run.smithi067.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-11T23:58:48.147 INFO:teuthology.orchestra.run.smithi067.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-11T23:58:48.147 INFO:teuthology.orchestra.run.smithi067.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-11T23:58:48.147 INFO:teuthology.orchestra.run.smithi067.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-11T23:58:48.148 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-11T23:58:48.148 INFO:teuthology.orchestra.run.smithi067.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-11T23:58:48.148 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-11T23:58:48.148 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-11T23:58:48.148 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-11T23:58:48.148 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-11T23:58:48.148 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T23:58:48.148 INFO:teuthology.orchestra.run.smithi067.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-11T23:58:48.148 INFO:teuthology.orchestra.run.smithi067.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-11T23:58:48.148 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-11T23:58:48.148 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-09-11T23:58:48.149 INFO:teuthology.orchestra.run.smithi067.stdout:====================================================================================================== 2024-09-11T23:58:48.149 INFO:teuthology.orchestra.run.smithi067.stdout:Install 283 Packages 2024-09-11T23:58:48.149 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 2 Packages 2024-09-11T23:58:48.149 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-11T23:58:48.150 INFO:teuthology.orchestra.run.smithi170.stdout:(21/285): python3-rados-19.3.0-4753.gd011c522.e 6.3 MB/s | 322 kB 00:00 2024-09-11T23:58:48.150 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 327 M 2024-09-11T23:58:48.150 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-09-11T23:58:48.165 INFO:teuthology.orchestra.run.smithi170.stdout:(22/285): python3-rbd-19.3.0-4753.gd011c522.el9 6.0 MB/s | 306 kB 00:00 2024-09-11T23:58:48.190 INFO:teuthology.orchestra.run.smithi170.stdout:(23/285): python3-rgw-19.3.0-4753.gd011c522.el9 1.9 MB/s | 99 kB 00:00 2024-09-11T23:58:48.216 INFO:teuthology.orchestra.run.smithi170.stdout:(24/285): rbd-fuse-19.3.0-4753.gd011c522.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-11T23:58:48.266 INFO:teuthology.orchestra.run.smithi170.stdout:(25/285): rbd-nbd-19.3.0-4753.gd011c522.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-11T23:58:48.333 INFO:teuthology.orchestra.run.smithi170.stdout:(26/285): ceph-grafana-dashboards-19.3.0-4753.g 515 kB/s | 34 kB 00:00 2024-09-11T23:58:48.775 INFO:teuthology.orchestra.run.smithi170.stdout:(27/285): ceph-test-19.3.0-4753.gd011c522.el9.x 24 MB/s | 50 MB 00:02 2024-09-11T23:58:48.800 INFO:teuthology.orchestra.run.smithi170.stdout:(28/285): ceph-mgr-cephadm-19.3.0-4753.gd011c52 330 kB/s | 154 kB 00:00 2024-09-11T23:58:48.810 INFO:teuthology.orchestra.run.smithi067.stdout:(1/285): ceph-19.3.0-4753.gd011c522.el9.x86_64. 54 kB/s | 6.6 kB 00:00 2024-09-11T23:58:48.867 INFO:teuthology.orchestra.run.smithi170.stdout:(29/285): rbd-mirror-19.3.0-4753.gd011c522.el9. 4.7 MB/s | 3.2 MB 00:00 2024-09-11T23:58:49.026 INFO:teuthology.orchestra.run.smithi170.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4753.gd0 1.8 MB/s | 291 kB 00:00 2024-09-11T23:58:49.118 INFO:teuthology.orchestra.run.smithi170.stdout:(31/285): ceph-mgr-rook-19.3.0-4753.gd011c522.e 539 kB/s | 49 kB 00:00 2024-09-11T23:58:49.210 INFO:teuthology.orchestra.run.smithi170.stdout:(32/285): ceph-prometheus-alerts-19.3.0-4753.gd 179 kB/s | 16 kB 00:00 2024-09-11T23:58:49.319 INFO:teuthology.orchestra.run.smithi067.stdout:(2/285): ceph-fuse-19.3.0-4753.gd011c522.el9.x8 1.7 MB/s | 899 kB 00:00 2024-09-11T23:58:49.335 INFO:teuthology.orchestra.run.smithi170.stdout:(33/285): ceph-mgr-diskprediction-local-19.3.0- 14 MB/s | 7.4 MB 00:00 2024-09-11T23:58:49.360 INFO:teuthology.orchestra.run.smithi170.stdout:(34/285): ceph-volume-19.3.0-4753.gd011c522.el9 1.9 MB/s | 285 kB 00:00 2024-09-11T23:58:49.369 INFO:teuthology.orchestra.run.smithi067.stdout:(3/285): ceph-immutable-object-cache-19.3.0-475 2.8 MB/s | 145 kB 00:00 2024-09-11T23:58:49.402 INFO:teuthology.orchestra.run.smithi170.stdout:(35/285): cephadm-19.3.0-4753.gd011c522.el9.noa 11 MB/s | 782 kB 00:00 2024-09-11T23:58:49.486 INFO:teuthology.orchestra.run.smithi067.stdout:(4/285): ceph-base-19.3.0-4753.gd011c522.el9.x8 6.9 MB/s | 5.5 MB 00:00 2024-09-11T23:58:49.544 INFO:teuthology.orchestra.run.smithi170.stdout:(36/285): ceph-mgr-dashboard-19.3.0-4753.gd011c 18 MB/s | 14 MB 00:00 2024-09-11T23:58:49.595 INFO:teuthology.orchestra.run.smithi067.stdout:(5/285): ceph-mgr-19.3.0-4753.gd011c522.el9.x86 14 MB/s | 1.5 MB 00:00 2024-09-11T23:58:49.678 INFO:teuthology.orchestra.run.smithi170.stdout:(37/285): bluez-libs-5.56-6.el9.x86_64.rpm 308 kB/s | 85 kB 00:00 2024-09-11T23:58:49.703 INFO:teuthology.orchestra.run.smithi170.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 312 kB/s | 49 kB 00:00 2024-09-11T23:58:49.729 INFO:teuthology.orchestra.run.smithi067.stdout:(6/285): ceph-mds-19.3.0-4753.gd011c522.el9.x86 6.6 MB/s | 2.4 MB 00:00 2024-09-11T23:58:49.736 INFO:teuthology.orchestra.run.smithi170.stdout:(39/285): ModemManager-glib-1.20.2-1.el9.x86_64 891 kB/s | 335 kB 00:00 2024-09-11T23:58:49.779 INFO:teuthology.orchestra.run.smithi170.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 1.0 MB/s | 80 kB 00:00 2024-09-11T23:58:49.813 INFO:teuthology.orchestra.run.smithi170.stdout:(41/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 1.9 MB/s | 262 kB 00:00 2024-09-11T23:58:49.829 INFO:teuthology.orchestra.run.smithi170.stdout:(42/285): libpciaccess-0.16-7.el9.x86_64.rpm 537 kB/s | 27 kB 00:00 2024-09-11T23:58:49.837 INFO:teuthology.orchestra.run.smithi067.stdout:(7/285): ceph-mon-19.3.0-4753.gd011c522.el9.x86 20 MB/s | 4.8 MB 00:00 2024-09-11T23:58:49.888 INFO:teuthology.orchestra.run.smithi170.stdout:(43/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-09-11T23:58:49.922 INFO:teuthology.orchestra.run.smithi170.stdout:(44/285): libquadmath-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-11T23:58:49.972 INFO:teuthology.orchestra.run.smithi170.stdout:(45/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-11T23:58:50.022 INFO:teuthology.orchestra.run.smithi170.stdout:(46/285): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-11T23:58:50.073 INFO:teuthology.orchestra.run.smithi170.stdout:(47/285): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-11T23:58:50.098 INFO:teuthology.orchestra.run.smithi170.stdout:(48/285): libgfortran-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 801 kB 00:00 2024-09-11T23:58:50.215 INFO:teuthology.orchestra.run.smithi170.stdout:(49/285): python3-urllib3-1.26.5-6.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-09-11T23:58:50.248 INFO:teuthology.orchestra.run.smithi170.stdout:(50/285): python3-cryptography-36.0.1-4.el9.x86 3.8 MB/s | 1.2 MB 00:00 2024-09-11T23:58:50.274 INFO:teuthology.orchestra.run.smithi170.stdout:(51/285): python3-requests-2.25.1-8.el9.noarch. 622 kB/s | 125 kB 00:00 2024-09-11T23:58:50.287 INFO:teuthology.orchestra.run.smithi067.stdout:(8/285): ceph-radosgw-19.3.0-4753.gd011c522.el9 24 MB/s | 11 MB 00:00 2024-09-11T23:58:50.329 INFO:teuthology.orchestra.run.smithi067.stdout:(9/285): ceph-selinux-19.3.0-4753.gd011c522.el9 611 kB/s | 25 kB 00:00 2024-09-11T23:58:50.491 INFO:teuthology.orchestra.run.smithi170.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 2.3 MB/s | 650 kB 00:00 2024-09-11T23:58:50.516 INFO:teuthology.orchestra.run.smithi170.stdout:(53/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.1 MB/s | 523 kB 00:00 2024-09-11T23:58:50.549 INFO:teuthology.orchestra.run.smithi170.stdout:(54/285): apache-commons-cli-1.4-17.el9.noarch. 1.2 MB/s | 71 kB 00:00 2024-09-11T23:58:50.583 INFO:teuthology.orchestra.run.smithi170.stdout:(55/285): apache-commons-codec-1.15-7.el9.noarc 4.4 MB/s | 302 kB 00:00 2024-09-11T23:58:50.609 INFO:teuthology.orchestra.run.smithi170.stdout:(56/285): apache-commons-io-2.8.0-8.el9.noarch. 4.7 MB/s | 283 kB 00:00 2024-09-11T23:58:50.667 INFO:teuthology.orchestra.run.smithi170.stdout:(57/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2024-09-11T23:58:50.692 INFO:teuthology.orchestra.run.smithi170.stdout:(58/285): apache-commons-lang3-3.12.0-6.el9.noa 5.0 MB/s | 559 kB 00:00 2024-09-11T23:58:50.726 INFO:teuthology.orchestra.run.smithi170.stdout:(59/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-09-11T23:58:50.751 INFO:teuthology.orchestra.run.smithi170.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 396 kB/s | 23 kB 00:00 2024-09-11T23:58:50.785 INFO:teuthology.orchestra.run.smithi170.stdout:(61/285): atk-2.36.0-5.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-11T23:58:50.813 INFO:teuthology.orchestra.run.smithi170.stdout:(62/285): avahi-glib-0.8-21.el9.x86_64.rpm 255 kB/s | 15 kB 00:00 2024-09-11T23:58:50.852 INFO:teuthology.orchestra.run.smithi170.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-11T23:58:50.877 INFO:teuthology.orchestra.run.smithi170.stdout:(64/285): cdi-api-2.0.2-6.el9.noarch.rpm 797 kB/s | 53 kB 00:00 2024-09-11T23:58:50.911 INFO:teuthology.orchestra.run.smithi170.stdout:(65/285): colord-libs-1.4.5-4.el9.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2024-09-11T23:58:50.936 INFO:teuthology.orchestra.run.smithi170.stdout:(66/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.0 MB/s | 61 kB 00:00 2024-09-11T23:58:50.970 INFO:teuthology.orchestra.run.smithi170.stdout:(67/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 482 kB/s | 28 kB 00:00 2024-09-11T23:58:51.004 INFO:teuthology.orchestra.run.smithi170.stdout:(68/285): dconf-0.40.0-6.el9.x86_64.rpm 1.6 MB/s | 113 kB 00:00 2024-09-11T23:58:51.037 INFO:teuthology.orchestra.run.smithi170.stdout:(69/285): exempi-2.6.0-0.2.20211007gite23c213.e 7.6 MB/s | 525 kB 00:00 2024-09-11T23:58:51.171 INFO:teuthology.orchestra.run.smithi067.stdout:(10/285): ceph-common-19.3.0-4753.gd011c522.el9 8.7 MB/s | 22 MB 00:02 2024-09-11T23:58:51.205 INFO:teuthology.orchestra.run.smithi170.stdout:(70/285): adwaita-icon-theme-40.1.1-3.el9.noarc 12 MB/s | 12 MB 00:00 2024-09-11T23:58:51.246 INFO:teuthology.orchestra.run.smithi170.stdout:(71/285): exiv2-0.27.5-2.el9.x86_64.rpm 4.0 MB/s | 980 kB 00:00 2024-09-11T23:58:51.272 INFO:teuthology.orchestra.run.smithi170.stdout:(72/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 4.8 MB/s | 325 kB 00:00 2024-09-11T23:58:51.297 INFO:teuthology.orchestra.run.smithi170.stdout:(73/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 2.9 MB/s | 781 kB 00:00 2024-09-11T23:58:51.322 INFO:teuthology.orchestra.run.smithi170.stdout:(74/285): flac-libs-1.3.3-12.el9.x86_64.rpm 2.8 MB/s | 218 kB 00:00 2024-09-11T23:58:51.339 INFO:teuthology.orchestra.run.smithi170.stdout:(75/285): flatpak-selinux-1.12.9-1.el9.noarch.r 516 kB/s | 22 kB 00:00 2024-09-11T23:58:51.354 INFO:teuthology.orchestra.run.smithi067.stdout:(11/285): ceph-osd-19.3.0-4753.gd011c522.el9.x8 11 MB/s | 17 MB 00:01 2024-09-11T23:58:51.371 INFO:teuthology.orchestra.run.smithi067.stdout:(12/285): libcephfs-devel-19.3.0-4753.gd011c522 158 kB/s | 32 kB 00:00 2024-09-11T23:58:51.390 INFO:teuthology.orchestra.run.smithi170.stdout:(76/285): flatpak-session-helper-1.12.9-1.el9.x 1.1 MB/s | 73 kB 00:00 2024-09-11T23:58:51.406 INFO:teuthology.orchestra.run.smithi170.stdout:(77/285): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-09-11T23:58:51.433 INFO:teuthology.orchestra.run.smithi067.stdout:(13/285): libcephfs2-19.3.0-4753.gd011c522.el9. 13 MB/s | 755 kB 00:00 2024-09-11T23:58:51.440 INFO:teuthology.orchestra.run.smithi170.stdout:(78/285): flatpak-1.12.9-1.el9.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2024-09-11T23:58:51.457 INFO:teuthology.orchestra.run.smithi170.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-11T23:58:51.464 INFO:teuthology.orchestra.run.smithi067.stdout:(14/285): libcephsqlite-19.3.0-4753.gd011c522.e 1.7 MB/s | 161 kB 00:00 2024-09-11T23:58:51.489 INFO:teuthology.orchestra.run.smithi067.stdout:(15/285): librados-devel-19.3.0-4753.gd011c522. 2.1 MB/s | 126 kB 00:00 2024-09-11T23:58:51.499 INFO:teuthology.orchestra.run.smithi170.stdout:(80/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.5 MB/s | 89 kB 00:00 2024-09-11T23:58:51.525 INFO:teuthology.orchestra.run.smithi170.stdout:(81/285): geoclue2-2.6.0-7.el9.x86_64.rpm 1.8 MB/s | 124 kB 00:00 2024-09-11T23:58:51.537 INFO:teuthology.orchestra.run.smithi067.stdout:(16/285): libradosstriper1-19.3.0-4753.gd011c52 6.7 MB/s | 508 kB 00:00 2024-09-11T23:58:51.550 INFO:teuthology.orchestra.run.smithi170.stdout:(82/285): giflib-5.2.1-9.el9.x86_64.rpm 971 kB/s | 49 kB 00:00 2024-09-11T23:58:51.583 INFO:teuthology.orchestra.run.smithi170.stdout:(83/285): google-guice-4.2.3-9.el9.noarch.rpm 7.9 MB/s | 473 kB 00:00 2024-09-11T23:58:51.598 INFO:teuthology.orchestra.run.smithi067.stdout:(17/285): python3-ceph-argparse-19.3.0-4753.gd0 756 kB/s | 45 kB 00:00 2024-09-11T23:58:51.608 INFO:teuthology.orchestra.run.smithi170.stdout:(84/285): graphene-1.10.6-2.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-11T23:58:51.676 INFO:teuthology.orchestra.run.smithi170.stdout:(85/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-09-11T23:58:51.693 INFO:teuthology.orchestra.run.smithi170.stdout:(86/285): gsm-1.0.19-6.el9.x86_64.rpm 313 kB/s | 34 kB 00:00 2024-09-11T23:58:51.743 INFO:teuthology.orchestra.run.smithi170.stdout:(87/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-11T23:58:51.760 INFO:teuthology.orchestra.run.smithi170.stdout:(88/285): gtk-update-icon-cache-3.24.31-5.el9.x 495 kB/s | 33 kB 00:00 2024-09-11T23:58:51.806 INFO:teuthology.orchestra.run.smithi067.stdout:(18/285): python3-ceph-common-19.3.0-4753.gd011 687 kB/s | 143 kB 00:00 2024-09-11T23:58:51.860 INFO:teuthology.orchestra.run.smithi170.stdout:(89/285): gstreamer1-plugins-base-1.22.1-2.el9. 12 MB/s | 2.2 MB 00:00 2024-09-11T23:58:51.898 INFO:teuthology.orchestra.run.smithi067.stdout:(19/285): librgw2-19.3.0-4753.gd011c522.el9.x86 13 MB/s | 5.5 MB 00:00 2024-09-11T23:58:51.918 INFO:teuthology.orchestra.run.smithi170.stdout:(90/285): hicolor-icon-theme-0.17-13.el9.noarch 3.7 MB/s | 219 kB 00:00 2024-09-11T23:58:51.923 INFO:teuthology.orchestra.run.smithi067.stdout:(20/285): python3-cephfs-19.3.0-4753.gd011c522. 1.4 MB/s | 161 kB 00:00 2024-09-11T23:58:51.949 INFO:teuthology.orchestra.run.smithi067.stdout:(21/285): python3-rados-19.3.0-4753.gd011c522.e 6.3 MB/s | 322 kB 00:00 2024-09-11T23:58:51.961 INFO:teuthology.orchestra.run.smithi170.stdout:(91/285): guava-30.1-6.el9.noarch.rpm 12 MB/s | 2.3 MB 00:00 2024-09-11T23:58:51.974 INFO:teuthology.orchestra.run.smithi067.stdout:(22/285): python3-rbd-19.3.0-4753.gd011c522.el9 6.0 MB/s | 306 kB 00:00 2024-09-11T23:58:51.999 INFO:teuthology.orchestra.run.smithi067.stdout:(23/285): python3-rgw-19.3.0-4753.gd011c522.el9 1.9 MB/s | 99 kB 00:00 2024-09-11T23:58:52.024 INFO:teuthology.orchestra.run.smithi067.stdout:(24/285): rbd-fuse-19.3.0-4753.gd011c522.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-11T23:58:52.036 INFO:teuthology.orchestra.run.smithi170.stdout:(92/285): gtk3-3.24.31-5.el9.x86_64.rpm 17 MB/s | 4.9 MB 00:00 2024-09-11T23:58:52.070 INFO:teuthology.orchestra.run.smithi170.stdout:(93/285): httpcomponents-client-4.5.13-3.el9.no 4.3 MB/s | 657 kB 00:00 2024-09-11T23:58:52.075 INFO:teuthology.orchestra.run.smithi067.stdout:(25/285): rbd-nbd-19.3.0-4753.gd011c522.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-11T23:58:52.103 INFO:teuthology.orchestra.run.smithi170.stdout:(94/285): httpcomponents-core-4.4.13-7.el9.noar 4.3 MB/s | 632 kB 00:00 2024-09-11T23:58:52.128 INFO:teuthology.orchestra.run.smithi170.stdout:(95/285): jakarta-annotations-1.3.5-13.el9.noar 768 kB/s | 45 kB 00:00 2024-09-11T23:58:52.167 INFO:teuthology.orchestra.run.smithi067.stdout:(26/285): rbd-mirror-19.3.0-4753.gd011c522.el9. 19 MB/s | 3.2 MB 00:00 2024-09-11T23:58:52.170 INFO:teuthology.orchestra.run.smithi170.stdout:(96/285): jansi-2.3.3-6.el9.x86_64.rpm 1.6 MB/s | 110 kB 00:00 2024-09-11T23:58:52.200 INFO:teuthology.orchestra.run.smithi067.stdout:(27/285): ceph-grafana-dashboards-19.3.0-4753.g 273 kB/s | 34 kB 00:00 2024-09-11T23:58:52.226 INFO:teuthology.orchestra.run.smithi067.stdout:(28/285): ceph-mgr-cephadm-19.3.0-4753.gd011c52 2.6 MB/s | 154 kB 00:00 2024-09-11T23:58:52.249 INFO:teuthology.orchestra.run.smithi170.stdout:(97/285): iso-codes-4.6.0-3.el9.noarch.rpm 17 MB/s | 3.5 MB 00:00 2024-09-11T23:58:52.271 INFO:teuthology.orchestra.run.smithi170.stdout:(98/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 2.8 MB/s | 413 kB 00:00 2024-09-11T23:58:52.330 INFO:teuthology.orchestra.run.smithi170.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 223 kB/s | 13 kB 00:00 2024-09-11T23:58:52.397 INFO:teuthology.orchestra.run.smithi170.stdout:(100/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 795 kB/s | 53 kB 00:00 2024-09-11T23:58:52.480 INFO:teuthology.orchestra.run.smithi170.stdout:(101/285): java-11-openjdk-devel-11.0.20.1.1-2. 11 MB/s | 3.3 MB 00:00 2024-09-11T23:58:52.506 INFO:teuthology.orchestra.run.smithi170.stdout:(102/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 221 kB/s | 24 kB 00:00 2024-09-11T23:58:52.548 INFO:teuthology.orchestra.run.smithi170.stdout:(103/285): jsoup-1.13.1-10.el9.noarch.rpm 5.5 MB/s | 377 kB 00:00 2024-09-11T23:58:52.573 INFO:teuthology.orchestra.run.smithi170.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 531 kB/s | 35 kB 00:00 2024-09-11T23:58:52.615 INFO:teuthology.orchestra.run.smithi170.stdout:(105/285): lcms2-2.12-3.el9.x86_64.rpm 2.4 MB/s | 168 kB 00:00 2024-09-11T23:58:52.640 INFO:teuthology.orchestra.run.smithi170.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 166 kB/s | 11 kB 00:00 2024-09-11T23:58:52.682 INFO:teuthology.orchestra.run.smithi170.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 361 kB/s | 24 kB 00:00 2024-09-11T23:58:52.707 INFO:teuthology.orchestra.run.smithi170.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 459 kB/s | 31 kB 00:00 2024-09-11T23:58:52.741 INFO:teuthology.orchestra.run.smithi170.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 390 kB/s | 23 kB 00:00 2024-09-11T23:58:52.758 INFO:teuthology.orchestra.run.smithi170.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 393 kB/s | 20 kB 00:00 2024-09-11T23:58:52.759 INFO:teuthology.orchestra.run.smithi067.stdout:(29/285): ceph-test-19.3.0-4753.gd011c522.el9.x 21 MB/s | 50 MB 00:02 2024-09-11T23:58:52.791 INFO:teuthology.orchestra.run.smithi170.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 789 kB/s | 40 kB 00:00 2024-09-11T23:58:52.808 INFO:teuthology.orchestra.run.smithi170.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 299 kB/s | 15 kB 00:00 2024-09-11T23:58:52.810 INFO:teuthology.orchestra.run.smithi067.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4753.gd0 5.7 MB/s | 291 kB 00:00 2024-09-11T23:58:52.842 INFO:teuthology.orchestra.run.smithi170.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 565 kB/s | 28 kB 00:00 2024-09-11T23:58:52.867 INFO:teuthology.orchestra.run.smithi170.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 366 kB/s | 21 kB 00:00 2024-09-11T23:58:52.893 INFO:teuthology.orchestra.run.smithi170.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 380 kB/s | 19 kB 00:00 2024-09-11T23:58:52.918 INFO:teuthology.orchestra.run.smithi170.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 373 kB/s | 19 kB 00:00 2024-09-11T23:58:52.935 INFO:teuthology.orchestra.run.smithi067.stdout:(31/285): ceph-mgr-diskprediction-local-19.3.0- 10 MB/s | 7.4 MB 00:00 2024-09-11T23:58:52.943 INFO:teuthology.orchestra.run.smithi170.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 608 kB/s | 30 kB 00:00 2024-09-11T23:58:52.960 INFO:teuthology.orchestra.run.smithi067.stdout:(32/285): ceph-mgr-rook-19.3.0-4753.gd011c522.e 329 kB/s | 49 kB 00:00 2024-09-11T23:58:52.977 INFO:teuthology.orchestra.run.smithi170.stdout:(118/285): libcanberra-0.30-27.el9.x86_64.rpm 1.4 MB/s | 86 kB 00:00 2024-09-11T23:58:52.985 INFO:teuthology.orchestra.run.smithi067.stdout:(33/285): ceph-prometheus-alerts-19.3.0-4753.gd 330 kB/s | 16 kB 00:00 2024-09-11T23:58:52.993 INFO:teuthology.orchestra.run.smithi170.stdout:(119/285): libcanberra-gtk3-0.30-27.el9.x86_64. 632 kB/s | 32 kB 00:00 2024-09-11T23:58:53.011 INFO:teuthology.orchestra.run.smithi067.stdout:(34/285): ceph-volume-19.3.0-4753.gd011c522.el9 5.5 MB/s | 285 kB 00:00 2024-09-11T23:58:53.036 INFO:teuthology.orchestra.run.smithi170.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 2.7 MB/s | 161 kB 00:00 2024-09-11T23:58:53.044 INFO:teuthology.orchestra.run.smithi067.stdout:(35/285): cephadm-19.3.0-4753.gd011c522.el9.noa 13 MB/s | 782 kB 00:00 2024-09-11T23:58:53.070 INFO:teuthology.orchestra.run.smithi170.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-09-11T23:58:53.095 INFO:teuthology.orchestra.run.smithi170.stdout:(122/285): libexif-0.6.22-6.el9.x86_64.rpm 7.3 MB/s | 435 kB 00:00 2024-09-11T23:58:53.211 INFO:teuthology.orchestra.run.smithi067.stdout:(36/285): ceph-mgr-dashboard-19.3.0-4753.gd011c 14 MB/s | 14 MB 00:01 2024-09-11T23:58:53.245 INFO:teuthology.orchestra.run.smithi067.stdout:(37/285): bluez-libs-5.56-6.el9.x86_64.rpm 423 kB/s | 85 kB 00:00 2024-09-11T23:58:53.287 INFO:teuthology.orchestra.run.smithi067.stdout:(38/285): ModemManager-glib-1.20.2-1.el9.x86_64 1.2 MB/s | 335 kB 00:00 2024-09-11T23:58:53.320 INFO:teuthology.orchestra.run.smithi067.stdout:(39/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 455 kB/s | 49 kB 00:00 2024-09-11T23:58:53.362 INFO:teuthology.orchestra.run.smithi067.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 1.0 MB/s | 80 kB 00:00 2024-09-11T23:58:53.412 INFO:teuthology.orchestra.run.smithi067.stdout:(41/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 1.5 MB/s | 262 kB 00:00 2024-09-11T23:58:53.438 INFO:teuthology.orchestra.run.smithi067.stdout:(42/285): libpciaccess-0.16-7.el9.x86_64.rpm 357 kB/s | 27 kB 00:00 2024-09-11T23:58:53.445 INFO:teuthology.orchestra.run.smithi170.stdout:(123/285): java-11-openjdk-headless-11.0.20.1.1 33 MB/s | 39 MB 00:01 2024-09-11T23:58:53.462 INFO:teuthology.orchestra.run.smithi170.stdout:(124/285): libfontenc-1.1.3-17.el9.x86_64.rpm 79 kB/s | 31 kB 00:00 2024-09-11T23:58:53.463 INFO:teuthology.orchestra.run.smithi067.stdout:(43/285): libgfortran-11.5.0-2.el9.x86_64.rpm 5.5 MB/s | 801 kB 00:00 2024-09-11T23:58:53.488 INFO:teuthology.orchestra.run.smithi170.stdout:(125/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 210 kB/s | 83 kB 00:00 2024-09-11T23:58:53.505 INFO:teuthology.orchestra.run.smithi067.stdout:(44/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-09-11T23:58:53.513 INFO:teuthology.orchestra.run.smithi170.stdout:(126/285): libglvnd-1.3.4-1.el9.x86_64.rpm 2.0 MB/s | 135 kB 00:00 2024-09-11T23:58:53.538 INFO:teuthology.orchestra.run.smithi170.stdout:(127/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 485 kB/s | 37 kB 00:00 2024-09-11T23:58:53.539 INFO:teuthology.orchestra.run.smithi067.stdout:(45/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-11T23:58:53.564 INFO:teuthology.orchestra.run.smithi067.stdout:(46/285): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-11T23:58:53.572 INFO:teuthology.orchestra.run.smithi170.stdout:(128/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.7 MB/s | 142 kB 00:00 2024-09-11T23:58:53.597 INFO:teuthology.orchestra.run.smithi067.stdout:(47/285): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-11T23:58:53.597 INFO:teuthology.orchestra.run.smithi170.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-09-11T23:58:53.622 INFO:teuthology.orchestra.run.smithi170.stdout:(130/285): libgsf-1.14.47-5.el9.x86_64.rpm 2.3 MB/s | 256 kB 00:00 2024-09-11T23:58:53.639 INFO:teuthology.orchestra.run.smithi067.stdout:(48/285): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.2 MB 00:00 2024-09-11T23:58:53.648 INFO:teuthology.orchestra.run.smithi170.stdout:(131/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 813 kB/s | 61 kB 00:00 2024-09-11T23:58:53.664 INFO:teuthology.orchestra.run.smithi067.stdout:(49/285): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-11T23:58:53.673 INFO:teuthology.orchestra.run.smithi170.stdout:(132/285): libldac-2.0.2.3-10.el9.x86_64.rpm 548 kB/s | 41 kB 00:00 2024-09-11T23:58:53.689 INFO:teuthology.orchestra.run.smithi067.stdout:(50/285): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-09-11T23:58:53.698 INFO:teuthology.orchestra.run.smithi170.stdout:(133/285): libnotify-0.7.9-8.el9.x86_64.rpm 578 kB/s | 44 kB 00:00 2024-09-11T23:58:53.715 INFO:teuthology.orchestra.run.smithi067.stdout:(51/285): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-11T23:58:53.723 INFO:teuthology.orchestra.run.smithi170.stdout:(134/285): libogg-1.3.4-6.el9.x86_64.rpm 444 kB/s | 34 kB 00:00 2024-09-11T23:58:53.749 INFO:teuthology.orchestra.run.smithi170.stdout:(135/285): libosinfo-1.10.0-1.el9.x86_64.rpm 4.1 MB/s | 319 kB 00:00 2024-09-11T23:58:53.774 INFO:teuthology.orchestra.run.smithi170.stdout:(136/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-11T23:58:53.799 INFO:teuthology.orchestra.run.smithi170.stdout:(137/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 599 kB/s | 45 kB 00:00 2024-09-11T23:58:53.824 INFO:teuthology.orchestra.run.smithi170.stdout:(138/285): libsbc-1.4-9.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-11T23:58:53.867 INFO:teuthology.orchestra.run.smithi170.stdout:(139/285): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-11T23:58:53.892 INFO:teuthology.orchestra.run.smithi170.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 2.4 MB/s | 164 kB 00:00 2024-09-11T23:58:53.917 INFO:teuthology.orchestra.run.smithi170.stdout:(141/285): libsndfile-1.0.31-8.el9.x86_64.rpm 1.7 MB/s | 206 kB 00:00 2024-09-11T23:58:53.943 INFO:teuthology.orchestra.run.smithi170.stdout:(142/285): libtiff-4.4.0-13.el9.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2024-09-11T23:58:53.948 INFO:teuthology.orchestra.run.smithi067.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 2.2 MB/s | 650 kB 00:00 2024-09-11T23:58:53.968 INFO:teuthology.orchestra.run.smithi170.stdout:(143/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 472 kB/s | 36 kB 00:00 2024-09-11T23:58:53.982 INFO:teuthology.orchestra.run.smithi067.stdout:(53/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 1.9 MB/s | 523 kB 00:00 2024-09-11T23:58:53.993 INFO:teuthology.orchestra.run.smithi170.stdout:(144/285): libtracker-sparql-3.1.2-3.el9.x86_64 4.2 MB/s | 324 kB 00:00 2024-09-11T23:58:54.007 INFO:teuthology.orchestra.run.smithi067.stdout:(54/285): apache-commons-cli-1.4-17.el9.noarch. 1.2 MB/s | 71 kB 00:00 2024-09-11T23:58:54.018 INFO:teuthology.orchestra.run.smithi170.stdout:(145/285): libvisual-0.4.0-34.el9.x86_64.rpm 1.9 MB/s | 144 kB 00:00 2024-09-11T23:58:54.044 INFO:teuthology.orchestra.run.smithi170.stdout:(146/285): libvorbis-1.3.7-5.el9.x86_64.rpm 2.5 MB/s | 193 kB 00:00 2024-09-11T23:58:54.066 INFO:teuthology.orchestra.run.smithi067.stdout:(55/285): apache-commons-codec-1.15-7.el9.noarc 3.5 MB/s | 302 kB 00:00 2024-09-11T23:58:54.069 INFO:teuthology.orchestra.run.smithi170.stdout:(147/285): libwayland-client-1.21.0-1.el9.x86_6 441 kB/s | 33 kB 00:00 2024-09-11T23:58:54.091 INFO:teuthology.orchestra.run.smithi067.stdout:(56/285): apache-commons-io-2.8.0-8.el9.noarch. 3.3 MB/s | 283 kB 00:00 2024-09-11T23:58:54.094 INFO:teuthology.orchestra.run.smithi170.stdout:(148/285): libwayland-cursor-1.21.0-1.el9.x86_6 257 kB/s | 19 kB 00:00 2024-09-11T23:58:54.111 INFO:teuthology.orchestra.run.smithi170.stdout:(149/285): libwayland-egl-1.21.0-1.el9.x86_64.r 191 kB/s | 13 kB 00:00 2024-09-11T23:58:54.137 INFO:teuthology.orchestra.run.smithi170.stdout:(150/285): libwayland-server-1.21.0-1.el9.x86_6 620 kB/s | 42 kB 00:00 2024-09-11T23:58:54.141 INFO:teuthology.orchestra.run.smithi067.stdout:(57/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-09-11T23:58:54.162 INFO:teuthology.orchestra.run.smithi170.stdout:(151/285): libwebp-1.2.0-8.el9.x86_64.rpm 4.0 MB/s | 277 kB 00:00 2024-09-11T23:58:54.198 INFO:teuthology.orchestra.run.smithi170.stdout:(152/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.5 MB/s | 133 kB 00:00 2024-09-11T23:58:54.223 INFO:teuthology.orchestra.run.smithi170.stdout:(153/285): libxshmfence-1.3-10.el9.x86_64.rpm 146 kB/s | 13 kB 00:00 2024-09-11T23:58:54.225 INFO:teuthology.orchestra.run.smithi067.stdout:(58/285): apache-commons-lang3-3.12.0-6.el9.noa 3.4 MB/s | 559 kB 00:00 2024-09-11T23:58:54.249 INFO:teuthology.orchestra.run.smithi170.stdout:(154/285): low-memory-monitor-2.1-4.el9.x86_64. 415 kB/s | 36 kB 00:00 2024-09-11T23:58:54.250 INFO:teuthology.orchestra.run.smithi067.stdout:(59/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-09-11T23:58:54.274 INFO:teuthology.orchestra.run.smithi170.stdout:(155/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-11T23:58:54.276 INFO:teuthology.orchestra.run.smithi067.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 463 kB/s | 23 kB 00:00 2024-09-11T23:58:54.307 INFO:teuthology.orchestra.run.smithi170.stdout:(156/285): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-11T23:58:54.324 INFO:teuthology.orchestra.run.smithi170.stdout:(157/285): maven-3.6.3-15.el9.noarch.rpm 352 kB/s | 18 kB 00:00 2024-09-11T23:58:54.326 INFO:teuthology.orchestra.run.smithi067.stdout:(61/285): avahi-glib-0.8-21.el9.x86_64.rpm 298 kB/s | 15 kB 00:00 2024-09-11T23:58:54.350 INFO:teuthology.orchestra.run.smithi170.stdout:(158/285): lua-posix-35.0-8.el9.x86_64.rpm 1.5 MB/s | 151 kB 00:00 2024-09-11T23:58:54.351 INFO:teuthology.orchestra.run.smithi067.stdout:(62/285): atk-2.36.0-5.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-11T23:58:54.375 INFO:teuthology.orchestra.run.smithi170.stdout:(159/285): maven-openjdk11-3.6.3-15.el9.noarch. 179 kB/s | 9.0 kB 00:00 2024-09-11T23:58:54.376 INFO:teuthology.orchestra.run.smithi067.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-11T23:58:54.402 INFO:teuthology.orchestra.run.smithi067.stdout:(64/285): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 53 kB 00:00 2024-09-11T23:58:54.417 INFO:teuthology.orchestra.run.smithi170.stdout:(160/285): maven-resolver-1.6.1-10.el9.noarch.r 7.5 MB/s | 517 kB 00:00 2024-09-11T23:58:54.442 INFO:teuthology.orchestra.run.smithi170.stdout:(161/285): maven-shared-utils-3.3.4-3.el9.noarc 2.2 MB/s | 151 kB 00:00 2024-09-11T23:58:54.452 INFO:teuthology.orchestra.run.smithi067.stdout:(65/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-11T23:58:54.477 INFO:teuthology.orchestra.run.smithi067.stdout:(66/285): colord-libs-1.4.5-4.el9.x86_64.rpm 2.2 MB/s | 229 kB 00:00 2024-09-11T23:58:54.485 INFO:teuthology.orchestra.run.smithi170.stdout:(162/285): maven-lib-3.6.3-15.el9.noarch.rpm 8.4 MB/s | 1.5 MB 00:00 2024-09-11T23:58:54.509 INFO:teuthology.orchestra.run.smithi170.stdout:(163/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.2 MB/s | 112 kB 00:00 2024-09-11T23:58:54.511 INFO:teuthology.orchestra.run.smithi067.stdout:(67/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 482 kB/s | 28 kB 00:00 2024-09-11T23:58:54.543 INFO:teuthology.orchestra.run.smithi170.stdout:(164/285): mesa-filesystem-24.1.2-3.el9.x86_64. 192 kB/s | 11 kB 00:00 2024-09-11T23:58:54.553 INFO:teuthology.orchestra.run.smithi067.stdout:(68/285): dconf-0.40.0-6.el9.x86_64.rpm 1.5 MB/s | 113 kB 00:00 2024-09-11T23:58:54.568 INFO:teuthology.orchestra.run.smithi170.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.3 MB/s | 139 kB 00:00 2024-09-11T23:58:54.602 INFO:teuthology.orchestra.run.smithi170.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-09-11T23:58:54.627 INFO:teuthology.orchestra.run.smithi170.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 620 kB/s | 36 kB 00:00 2024-09-11T23:58:54.661 INFO:teuthology.orchestra.run.smithi170.stdout:(168/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 786 kB/s | 46 kB 00:00 2024-09-11T23:58:54.678 INFO:teuthology.orchestra.run.smithi067.stdout:(69/285): exempi-2.6.0-0.2.20211007gite23c213.e 3.1 MB/s | 525 kB 00:00 2024-09-11T23:58:54.686 INFO:teuthology.orchestra.run.smithi170.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 550 kB/s | 32 kB 00:00 2024-09-11T23:58:54.778 INFO:teuthology.orchestra.run.smithi170.stdout:(170/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 26 MB/s | 8.8 MB 00:00 2024-09-11T23:58:54.795 INFO:teuthology.orchestra.run.smithi067.stdout:(70/285): exiv2-0.27.5-2.el9.x86_64.rpm 4.0 MB/s | 980 kB 00:00 2024-09-11T23:58:54.803 INFO:teuthology.orchestra.run.smithi170.stdout:(171/285): openblas-0.3.26-2.el9.x86_64.rpm 271 kB/s | 38 kB 00:00 2024-09-11T23:58:54.837 INFO:teuthology.orchestra.run.smithi170.stdout:(172/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2024-09-11T23:58:54.862 INFO:teuthology.orchestra.run.smithi170.stdout:(173/285): opus-1.3.1-10.el9.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2024-09-11T23:58:54.878 INFO:teuthology.orchestra.run.smithi067.stdout:(71/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 3.8 MB/s | 781 kB 00:00 2024-09-11T23:58:54.904 INFO:teuthology.orchestra.run.smithi067.stdout:(72/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.9 MB/s | 325 kB 00:00 2024-09-11T23:58:54.904 INFO:teuthology.orchestra.run.smithi170.stdout:(174/285): orc-0.4.31-8.el9.x86_64.rpm 2.7 MB/s | 183 kB 00:00 2024-09-11T23:58:54.930 INFO:teuthology.orchestra.run.smithi170.stdout:(175/285): osinfo-db-20240701-2.el9.noarch.rpm 7.8 MB/s | 531 kB 00:00 2024-09-11T23:58:54.962 INFO:teuthology.orchestra.run.smithi067.stdout:(73/285): flac-libs-1.3.3-12.el9.x86_64.rpm 2.5 MB/s | 218 kB 00:00 2024-09-11T23:58:54.963 INFO:teuthology.orchestra.run.smithi170.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.2 MB/s | 74 kB 00:00 2024-09-11T23:58:54.997 INFO:teuthology.orchestra.run.smithi170.stdout:(177/285): ostree-libs-2024.7-2.el9.x86_64.rpm 6.8 MB/s | 468 kB 00:00 2024-09-11T23:58:55.004 INFO:teuthology.orchestra.run.smithi067.stdout:(74/285): flatpak-selinux-1.12.9-1.el9.noarch.r 519 kB/s | 22 kB 00:00 2024-09-11T23:58:55.022 INFO:teuthology.orchestra.run.smithi170.stdout:(178/285): p11-kit-server-0.25.3-2.el9.x86_64.r 4.1 MB/s | 246 kB 00:00 2024-09-11T23:58:55.063 INFO:teuthology.orchestra.run.smithi067.stdout:(75/285): flatpak-session-helper-1.12.9-1.el9.x 1.2 MB/s | 73 kB 00:00 2024-09-11T23:58:55.098 INFO:teuthology.orchestra.run.smithi170.stdout:(179/285): openblas-openmp-0.3.26-2.el9.x86_64. 12 MB/s | 4.9 MB 00:00 2024-09-11T23:58:55.122 INFO:teuthology.orchestra.run.smithi067.stdout:(76/285): flexiblas-3.0.4-8.el9.x86_64.rpm 562 kB/s | 33 kB 00:00 2024-09-11T23:58:55.123 INFO:teuthology.orchestra.run.smithi170.stdout:(180/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 572 kB/s | 57 kB 00:00 2024-09-11T23:58:55.148 INFO:teuthology.orchestra.run.smithi170.stdout:(181/285): pipewire-1.0.1-1.el9.x86_64.rpm 707 kB/s | 107 kB 00:00 2024-09-11T23:58:55.174 INFO:teuthology.orchestra.run.smithi170.stdout:(182/285): pipewire-jack-audio-connection-kit-1 121 kB/s | 9.1 kB 00:00 2024-09-11T23:58:55.224 INFO:teuthology.orchestra.run.smithi170.stdout:(183/285): pipewire-jack-audio-connection-kit-l 1.3 MB/s | 135 kB 00:00 2024-09-11T23:58:55.239 INFO:teuthology.orchestra.run.smithi067.stdout:(77/285): flatpak-1.12.9-1.el9.x86_64.rpm 5.1 MB/s | 1.7 MB 00:00 2024-09-11T23:58:55.249 INFO:teuthology.orchestra.run.smithi170.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.5 MB/s | 192 kB 00:00 2024-09-11T23:58:55.280 INFO:teuthology.orchestra.run.smithi067.stdout:(78/285): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-09-11T23:58:55.291 INFO:teuthology.orchestra.run.smithi170.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 386 kB/s | 26 kB 00:00 2024-09-11T23:58:55.316 INFO:teuthology.orchestra.run.smithi170.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 895 kB/s | 60 kB 00:00 2024-09-11T23:58:55.331 INFO:teuthology.orchestra.run.smithi067.stdout:(79/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.7 MB/s | 89 kB 00:00 2024-09-11T23:58:55.358 INFO:teuthology.orchestra.run.smithi170.stdout:(187/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 9.2 MB/s | 1.9 MB 00:00 2024-09-11T23:58:55.381 INFO:teuthology.orchestra.run.smithi067.stdout:(80/285): geoclue2-2.6.0-7.el9.x86_64.rpm 2.4 MB/s | 124 kB 00:00 2024-09-11T23:58:55.384 INFO:teuthology.orchestra.run.smithi170.stdout:(188/285): plexus-containers-component-annotati 199 kB/s | 18 kB 00:00 2024-09-11T23:58:55.409 INFO:teuthology.orchestra.run.smithi170.stdout:(189/285): plexus-interpolation-1.26-11.el9.noa 863 kB/s | 80 kB 00:00 2024-09-11T23:58:55.426 INFO:teuthology.orchestra.run.smithi170.stdout:(190/285): plexus-sec-dispatcher-1.4-37.el9.noa 501 kB/s | 34 kB 00:00 2024-09-11T23:58:55.431 INFO:teuthology.orchestra.run.smithi067.stdout:(81/285): giflib-5.2.1-9.el9.x86_64.rpm 972 kB/s | 49 kB 00:00 2024-09-11T23:58:55.459 INFO:teuthology.orchestra.run.smithi170.stdout:(191/285): plexus-utils-3.3.0-10.el9.noarch.rpm 3.3 MB/s | 254 kB 00:00 2024-09-11T23:58:55.518 INFO:teuthology.orchestra.run.smithi170.stdout:(192/285): poppler-glib-21.01.0-21.el9.x86_64.r 2.5 MB/s | 152 kB 00:00 2024-09-11T23:58:55.552 INFO:teuthology.orchestra.run.smithi170.stdout:(193/285): poppler-21.01.0-21.el9.x86_64.rpm 7.5 MB/s | 1.1 MB 00:00 2024-09-11T23:58:55.557 INFO:teuthology.orchestra.run.smithi067.stdout:(82/285): google-guice-4.2.3-9.el9.noarch.rpm 3.7 MB/s | 473 kB 00:00 2024-09-11T23:58:55.594 INFO:teuthology.orchestra.run.smithi170.stdout:(194/285): poppler-data-0.4.9-9.el9.noarch.rpm 11 MB/s | 1.9 MB 00:00 2024-09-11T23:58:55.607 INFO:teuthology.orchestra.run.smithi067.stdout:(83/285): graphene-1.10.6-2.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-09-11T23:58:55.627 INFO:teuthology.orchestra.run.smithi170.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 1.1 MB/s | 83 kB 00:00 2024-09-11T23:58:55.657 INFO:teuthology.orchestra.run.smithi067.stdout:(84/285): gsm-1.0.19-6.el9.x86_64.rpm 682 kB/s | 34 kB 00:00 2024-09-11T23:58:55.661 INFO:teuthology.orchestra.run.smithi170.stdout:(196/285): protobuf-3.14.0-13.el9.x86_64.rpm 7.1 MB/s | 1.0 MB 00:00 2024-09-11T23:58:55.686 INFO:teuthology.orchestra.run.smithi170.stdout:(197/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 7.2 MB/s | 679 kB 00:00 2024-09-11T23:58:55.716 INFO:teuthology.orchestra.run.smithi067.stdout:(85/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.0 MB/s | 3.0 MB 00:00 2024-09-11T23:58:55.720 INFO:teuthology.orchestra.run.smithi170.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-11T23:58:55.745 INFO:teuthology.orchestra.run.smithi170.stdout:(199/285): python3-jinja2-2.11.3-6.el9.noarch.r 4.1 MB/s | 248 kB 00:00 2024-09-11T23:58:55.779 INFO:teuthology.orchestra.run.smithi170.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 437 kB/s | 26 kB 00:00 2024-09-11T23:58:55.804 INFO:teuthology.orchestra.run.smithi170.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 327 kB/s | 19 kB 00:00 2024-09-11T23:58:55.838 INFO:teuthology.orchestra.run.smithi170.stdout:(202/285): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T23:58:55.863 INFO:teuthology.orchestra.run.smithi170.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 594 kB/s | 35 kB 00:00 2024-09-11T23:58:55.938 INFO:teuthology.orchestra.run.smithi170.stdout:(204/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 3.3 MB/s | 250 kB 00:00 2024-09-11T23:58:55.974 INFO:teuthology.orchestra.run.smithi067.stdout:(86/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 4.5 MB/s | 1.4 MB 00:00 2024-09-11T23:58:56.023 INFO:teuthology.orchestra.run.smithi170.stdout:(205/285): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-11T23:58:56.047 INFO:teuthology.orchestra.run.smithi170.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 2.0 MB/s | 222 kB 00:00 2024-09-11T23:58:56.108 INFO:teuthology.orchestra.run.smithi067.stdout:(87/285): adwaita-icon-theme-40.1.1-3.el9.noarc 4.9 MB/s | 12 MB 00:02 2024-09-11T23:58:56.123 INFO:teuthology.orchestra.run.smithi170.stdout:(207/285): python3-numpy-1.20.1-5.el9.x86_64.rp 18 MB/s | 5.1 MB 00:00 2024-09-11T23:58:56.148 INFO:teuthology.orchestra.run.smithi170.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 421 kB/s | 42 kB 00:00 2024-09-11T23:58:56.150 INFO:teuthology.orchestra.run.smithi067.stdout:(88/285): gtk-update-icon-cache-3.24.31-5.el9.x 189 kB/s | 33 kB 00:00 2024-09-11T23:58:56.173 INFO:teuthology.orchestra.run.smithi170.stdout:(209/285): python3-packaging-20.9-5.el9.noarch. 512 kB/s | 77 kB 00:00 2024-09-11T23:58:56.207 INFO:teuthology.orchestra.run.smithi170.stdout:(210/285): python3-protobuf-3.14.0-13.el9.noarc 3.1 MB/s | 269 kB 00:00 2024-09-11T23:58:56.217 INFO:teuthology.orchestra.run.smithi067.stdout:(89/285): gstreamer1-plugins-base-1.22.1-2.el9. 4.5 MB/s | 2.2 MB 00:00 2024-09-11T23:58:56.232 INFO:teuthology.orchestra.run.smithi170.stdout:(211/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.8 MB/s | 159 kB 00:00 2024-09-11T23:58:56.258 INFO:teuthology.orchestra.run.smithi170.stdout:(212/285): python3-pyasn1-modules-0.4.8-6.el9.n 3.3 MB/s | 279 kB 00:00 2024-09-11T23:58:56.275 INFO:teuthology.orchestra.run.smithi067.stdout:(90/285): hicolor-icon-theme-0.17-13.el9.noarch 3.7 MB/s | 219 kB 00:00 2024-09-11T23:58:56.283 INFO:teuthology.orchestra.run.smithi170.stdout:(213/285): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-11T23:58:56.308 INFO:teuthology.orchestra.run.smithi170.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 710 kB/s | 54 kB 00:00 2024-09-11T23:58:56.333 INFO:teuthology.orchestra.run.smithi170.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-09-11T23:58:56.367 INFO:teuthology.orchestra.run.smithi170.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-11T23:58:56.392 INFO:teuthology.orchestra.run.smithi170.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 613 kB/s | 36 kB 00:00 2024-09-11T23:58:56.393 INFO:teuthology.orchestra.run.smithi067.stdout:(91/285): httpcomponents-client-4.5.13-3.el9.no 5.5 MB/s | 657 kB 00:00 2024-09-11T23:58:56.426 INFO:teuthology.orchestra.run.smithi170.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 810 kB/s | 47 kB 00:00 2024-09-11T23:58:56.459 INFO:teuthology.orchestra.run.smithi170.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 837 kB/s | 56 kB 00:00 2024-09-11T23:58:56.493 INFO:teuthology.orchestra.run.smithi170.stdout:(220/285): sisu-0.3.4-10.el9.noarch.rpm 7.5 MB/s | 510 kB 00:00 2024-09-11T23:58:56.518 INFO:teuthology.orchestra.run.smithi067.stdout:(92/285): guava-30.1-6.el9.noarch.rpm 6.3 MB/s | 2.3 MB 00:00 2024-09-11T23:58:56.518 INFO:teuthology.orchestra.run.smithi170.stdout:(221/285): slf4j-1.7.30-13.el9.noarch.rpm 1.1 MB/s | 69 kB 00:00 2024-09-11T23:58:56.552 INFO:teuthology.orchestra.run.smithi067.stdout:(93/285): httpcomponents-core-4.4.13-7.el9.noar 3.9 MB/s | 632 kB 00:00 2024-09-11T23:58:56.560 INFO:teuthology.orchestra.run.smithi170.stdout:(222/285): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-11T23:58:56.594 INFO:teuthology.orchestra.run.smithi170.stdout:(223/285): sound-theme-freedesktop-0.8-17.el9.n 5.0 MB/s | 383 kB 00:00 2024-09-11T23:58:56.610 INFO:teuthology.orchestra.run.smithi067.stdout:(94/285): jakarta-annotations-1.3.5-13.el9.noar 776 kB/s | 45 kB 00:00 2024-09-11T23:58:56.619 INFO:teuthology.orchestra.run.smithi170.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 2.5 MB/s | 152 kB 00:00 2024-09-11T23:58:56.661 INFO:teuthology.orchestra.run.smithi170.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 8.1 MB/s | 555 kB 00:00 2024-09-11T23:58:56.695 INFO:teuthology.orchestra.run.smithi170.stdout:(226/285): tracker-miners-3.1.2-4.el9.x86_64.rp 12 MB/s | 944 kB 00:00 2024-09-11T23:58:56.712 INFO:teuthology.orchestra.run.smithi170.stdout:(227/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-11T23:58:56.735 INFO:teuthology.orchestra.run.smithi067.stdout:(95/285): gtk3-3.24.31-5.el9.x86_64.rpm 7.8 MB/s | 4.9 MB 00:00 2024-09-11T23:58:56.752 INFO:teuthology.orchestra.run.smithi067.stdout:(96/285): jansi-2.3.3-6.el9.x86_64.rpm 774 kB/s | 110 kB 00:00 2024-09-11T23:58:56.762 INFO:teuthology.orchestra.run.smithi170.stdout:(228/285): tzdata-java-2024a-2.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-09-11T23:58:56.788 INFO:teuthology.orchestra.run.smithi170.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 2.2 MB/s | 173 kB 00:00 2024-09-11T23:58:56.836 INFO:teuthology.orchestra.run.smithi067.stdout:(97/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 4.0 MB/s | 413 kB 00:00 2024-09-11T23:58:56.838 INFO:teuthology.orchestra.run.smithi170.stdout:(230/285): webrtc-audio-processing-0.3.1-8.el9. 4.0 MB/s | 306 kB 00:00 2024-09-11T23:58:56.863 INFO:teuthology.orchestra.run.smithi170.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.3 MB/s | 96 kB 00:00 2024-09-11T23:58:56.969 INFO:teuthology.orchestra.run.smithi067.stdout:(98/285): iso-codes-4.6.0-3.el9.noarch.rpm 7.8 MB/s | 3.5 MB 00:00 2024-09-11T23:58:57.301 INFO:teuthology.orchestra.run.smithi067.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 261 kB/s | 13 kB 00:00 2024-09-11T23:58:57.301 INFO:teuthology.orchestra.run.smithi067.stdout:(100/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 912 kB/s | 53 kB 00:00 2024-09-11T23:58:57.301 INFO:teuthology.orchestra.run.smithi067.stdout:(101/285): java-11-openjdk-devel-11.0.20.1.1-2. 8.6 MB/s | 3.3 MB 00:00 2024-09-11T23:58:57.302 INFO:teuthology.orchestra.run.smithi067.stdout:(102/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 287 kB/s | 24 kB 00:00 2024-09-11T23:58:57.302 INFO:teuthology.orchestra.run.smithi067.stdout:(103/285): jsr-305-3.0.2-6.el9.noarch.rpm 710 kB/s | 35 kB 00:00 2024-09-11T23:58:57.302 INFO:teuthology.orchestra.run.smithi067.stdout:(104/285): jsoup-1.13.1-10.el9.noarch.rpm 3.4 MB/s | 377 kB 00:00 2024-09-11T23:58:57.302 INFO:teuthology.orchestra.run.smithi067.stdout:(105/285): lcms2-2.12-3.el9.x86_64.rpm 2.2 MB/s | 168 kB 00:00 2024-09-11T23:58:57.302 INFO:teuthology.orchestra.run.smithi170.stdout:(232/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-11T23:58:57.302 INFO:teuthology.orchestra.run.smithi170.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 221 kB/s | 42 kB 00:00 2024-09-11T23:58:57.302 INFO:teuthology.orchestra.run.smithi170.stdout:(234/285): wireplumber-libs-0.4.14-1.el9.x86_64 1.4 MB/s | 358 kB 00:00 2024-09-11T23:58:57.302 INFO:teuthology.orchestra.run.smithi170.stdout:(235/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 5.0 MB/s | 385 kB 00:00 2024-09-11T23:58:57.302 INFO:teuthology.orchestra.run.smithi170.stdout:(236/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.6 MB/s | 134 kB 00:00 2024-09-11T23:58:57.302 INFO:teuthology.orchestra.run.smithi170.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-11T23:58:57.302 INFO:teuthology.orchestra.run.smithi170.stdout:(238/285): xkeyboard-config-2.33-2.el9.noarch.r 7.2 MB/s | 859 kB 00:00 2024-09-11T23:58:57.303 INFO:teuthology.orchestra.run.smithi170.stdout:(239/285): lua-devel-5.4.4-4.el9.x86_64.rpm 380 kB/s | 22 kB 00:00 2024-09-11T23:58:57.303 INFO:teuthology.orchestra.run.smithi170.stdout:(240/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 4.2 MB/s | 505 kB 00:00 2024-09-11T23:58:57.308 INFO:teuthology.orchestra.run.smithi170.stdout:(241/285): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-11T23:58:57.313 INFO:teuthology.orchestra.run.smithi067.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 166 kB/s | 11 kB 00:00 2024-09-11T23:58:57.338 INFO:teuthology.orchestra.run.smithi067.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 481 kB/s | 24 kB 00:00 2024-09-11T23:58:57.358 INFO:teuthology.orchestra.run.smithi170.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 403 kB/s | 19 kB 00:00 2024-09-11T23:58:57.363 INFO:teuthology.orchestra.run.smithi067.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 611 kB/s | 31 kB 00:00 2024-09-11T23:58:57.389 INFO:teuthology.orchestra.run.smithi067.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 454 kB/s | 23 kB 00:00 2024-09-11T23:58:57.392 INFO:teuthology.orchestra.run.smithi170.stdout:(243/285): gperftools-libs-2.9.1-2.el9.x86_64.r 2.3 MB/s | 309 kB 00:00 2024-09-11T23:58:57.414 INFO:teuthology.orchestra.run.smithi067.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 394 kB/s | 20 kB 00:00 2024-09-11T23:58:57.417 INFO:teuthology.orchestra.run.smithi170.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T23:58:57.439 INFO:teuthology.orchestra.run.smithi067.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 788 kB/s | 40 kB 00:00 2024-09-11T23:58:57.442 INFO:teuthology.orchestra.run.smithi170.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T23:58:57.464 INFO:teuthology.orchestra.run.smithi067.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 300 kB/s | 15 kB 00:00 2024-09-11T23:58:57.467 INFO:teuthology.orchestra.run.smithi170.stdout:(246/285): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-11T23:58:57.490 INFO:teuthology.orchestra.run.smithi067.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 568 kB/s | 28 kB 00:00 2024-09-11T23:58:57.501 INFO:teuthology.orchestra.run.smithi170.stdout:(247/285): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-11T23:58:57.515 INFO:teuthology.orchestra.run.smithi067.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 428 kB/s | 21 kB 00:00 2024-09-11T23:58:57.540 INFO:teuthology.orchestra.run.smithi067.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 380 kB/s | 19 kB 00:00 2024-09-11T23:58:57.543 INFO:teuthology.orchestra.run.smithi170.stdout:(248/285): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-09-11T23:58:57.566 INFO:teuthology.orchestra.run.smithi067.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 373 kB/s | 19 kB 00:00 2024-09-11T23:58:57.591 INFO:teuthology.orchestra.run.smithi067.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 605 kB/s | 30 kB 00:00 2024-09-11T23:58:57.593 INFO:teuthology.orchestra.run.smithi170.stdout:(249/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-11T23:58:57.616 INFO:teuthology.orchestra.run.smithi067.stdout:(118/285): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-09-11T23:58:57.619 INFO:teuthology.orchestra.run.smithi170.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.8 MB/s | 43 kB 00:00 2024-09-11T23:58:57.641 INFO:teuthology.orchestra.run.smithi067.stdout:(119/285): libcanberra-gtk3-0.30-27.el9.x86_64. 634 kB/s | 32 kB 00:00 2024-09-11T23:58:57.644 INFO:teuthology.orchestra.run.smithi170.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T23:58:57.669 INFO:teuthology.orchestra.run.smithi170.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-11T23:58:57.675 INFO:teuthology.orchestra.run.smithi067.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 2.7 MB/s | 161 kB 00:00 2024-09-11T23:58:57.695 INFO:teuthology.orchestra.run.smithi170.stdout:(253/285): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-11T23:58:57.709 INFO:teuthology.orchestra.run.smithi067.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-09-11T23:58:57.728 INFO:teuthology.orchestra.run.smithi170.stdout:(254/285): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-09-11T23:58:57.754 INFO:teuthology.orchestra.run.smithi170.stdout:(255/285): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-11T23:58:57.767 INFO:teuthology.orchestra.run.smithi067.stdout:(122/285): libexif-0.6.22-6.el9.x86_64.rpm 4.6 MB/s | 435 kB 00:00 2024-09-11T23:58:57.779 INFO:teuthology.orchestra.run.smithi170.stdout:(256/285): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-11T23:58:57.784 INFO:teuthology.orchestra.run.smithi067.stdout:(123/285): libfontenc-1.1.3-17.el9.x86_64.rpm 412 kB/s | 31 kB 00:00 2024-09-11T23:58:57.813 INFO:teuthology.orchestra.run.smithi170.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-11T23:58:57.826 INFO:teuthology.orchestra.run.smithi067.stdout:(124/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2024-09-11T23:58:57.843 INFO:teuthology.orchestra.run.smithi067.stdout:(125/285): libglvnd-1.3.4-1.el9.x86_64.rpm 2.3 MB/s | 135 kB 00:00 2024-09-11T23:58:57.857 INFO:teuthology.orchestra.run.smithi170.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 242 kB/s | 11 kB 00:00 2024-09-11T23:58:57.869 INFO:teuthology.orchestra.run.smithi067.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 876 kB/s | 37 kB 00:00 2024-09-11T23:58:57.894 INFO:teuthology.orchestra.run.smithi067.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.8 MB/s | 142 kB 00:00 2024-09-11T23:58:57.928 INFO:teuthology.orchestra.run.smithi067.stdout:(128/285): libgsf-1.14.47-5.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-09-11T23:58:57.953 INFO:teuthology.orchestra.run.smithi067.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-09-11T23:58:57.961 INFO:teuthology.orchestra.run.smithi170.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 170 kB/s | 18 kB 00:00 2024-09-11T23:58:57.986 INFO:teuthology.orchestra.run.smithi067.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.0 MB/s | 61 kB 00:00 2024-09-11T23:58:58.011 INFO:teuthology.orchestra.run.smithi067.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 705 kB/s | 41 kB 00:00 2024-09-11T23:58:58.045 INFO:teuthology.orchestra.run.smithi067.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 746 kB/s | 44 kB 00:00 2024-09-11T23:58:58.055 INFO:teuthology.orchestra.run.smithi170.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 248 kB/s | 23 kB 00:00 2024-09-11T23:58:58.070 INFO:teuthology.orchestra.run.smithi067.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 572 kB/s | 34 kB 00:00 2024-09-11T23:58:58.105 INFO:teuthology.orchestra.run.smithi067.stdout:(134/285): libosinfo-1.10.0-1.el9.x86_64.rpm 5.3 MB/s | 319 kB 00:00 2024-09-11T23:58:58.114 INFO:teuthology.orchestra.run.smithi170.stdout:(261/285): libarrow-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 4.4 MB 00:00 2024-09-11T23:58:58.130 INFO:teuthology.orchestra.run.smithi067.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-11T23:58:58.131 INFO:teuthology.orchestra.run.smithi170.stdout:(262/285): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-09-11T23:58:58.148 INFO:teuthology.orchestra.run.smithi170.stdout:(263/285): python3-jaraco-text-3.2.0-6.el9.noar 587 kB/s | 20 kB 00:00 2024-09-11T23:58:58.155 INFO:teuthology.orchestra.run.smithi067.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-11T23:58:58.165 INFO:teuthology.orchestra.run.smithi170.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-11T23:58:58.199 INFO:teuthology.orchestra.run.smithi170.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-11T23:58:58.205 INFO:teuthology.orchestra.run.smithi067.stdout:(137/285): libsbc-1.4-9.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-09-11T23:58:58.224 INFO:teuthology.orchestra.run.smithi170.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T23:58:58.230 INFO:teuthology.orchestra.run.smithi067.stdout:(138/285): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-11T23:58:58.264 INFO:teuthology.orchestra.run.smithi067.stdout:(139/285): libsndfile-1.0.31-8.el9.x86_64.rpm 3.5 MB/s | 206 kB 00:00 2024-09-11T23:58:58.266 INFO:teuthology.orchestra.run.smithi170.stdout:(267/285): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2024-09-11T23:58:58.289 INFO:teuthology.orchestra.run.smithi067.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 2.7 MB/s | 164 kB 00:00 2024-09-11T23:58:58.291 INFO:teuthology.orchestra.run.smithi170.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-11T23:58:58.323 INFO:teuthology.orchestra.run.smithi067.stdout:(141/285): libtiff-4.4.0-13.el9.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2024-09-11T23:58:58.324 INFO:teuthology.orchestra.run.smithi170.stdout:(269/285): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-11T23:58:58.348 INFO:teuthology.orchestra.run.smithi067.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 608 kB/s | 36 kB 00:00 2024-09-11T23:58:58.350 INFO:teuthology.orchestra.run.smithi170.stdout:(270/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-11T23:58:58.385 INFO:teuthology.orchestra.run.smithi067.stdout:(143/285): libtracker-sparql-3.1.2-3.el9.x86_64 5.4 MB/s | 324 kB 00:00 2024-09-11T23:58:58.392 INFO:teuthology.orchestra.run.smithi170.stdout:(271/285): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-09-11T23:58:58.407 INFO:teuthology.orchestra.run.smithi067.stdout:(144/285): libvisual-0.4.0-34.el9.x86_64.rpm 2.4 MB/s | 144 kB 00:00 2024-09-11T23:58:58.417 INFO:teuthology.orchestra.run.smithi170.stdout:(272/285): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-09-11T23:58:58.441 INFO:teuthology.orchestra.run.smithi067.stdout:(145/285): libvorbis-1.3.7-5.el9.x86_64.rpm 3.2 MB/s | 193 kB 00:00 2024-09-11T23:58:58.442 INFO:teuthology.orchestra.run.smithi170.stdout:(273/285): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-11T23:58:58.466 INFO:teuthology.orchestra.run.smithi067.stdout:(146/285): libwayland-client-1.21.0-1.el9.x86_6 569 kB/s | 33 kB 00:00 2024-09-11T23:58:58.468 INFO:teuthology.orchestra.run.smithi170.stdout:(274/285): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-11T23:58:58.491 INFO:teuthology.orchestra.run.smithi067.stdout:(147/285): libwayland-cursor-1.21.0-1.el9.x86_6 387 kB/s | 19 kB 00:00 2024-09-11T23:58:58.493 INFO:teuthology.orchestra.run.smithi170.stdout:(275/285): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-11T23:58:58.516 INFO:teuthology.orchestra.run.smithi067.stdout:(148/285): libwayland-egl-1.21.0-1.el9.x86_64.r 255 kB/s | 13 kB 00:00 2024-09-11T23:58:58.518 INFO:teuthology.orchestra.run.smithi170.stdout:(276/285): python3-typing-extensions-4.12.2-2.e 985 kB/s | 74 kB 00:00 2024-09-11T23:58:58.544 INFO:teuthology.orchestra.run.smithi170.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T23:58:58.550 INFO:teuthology.orchestra.run.smithi067.stdout:(149/285): libwayland-server-1.21.0-1.el9.x86_6 715 kB/s | 42 kB 00:00 2024-09-11T23:58:58.569 INFO:teuthology.orchestra.run.smithi170.stdout:(278/285): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-11T23:58:58.575 INFO:teuthology.orchestra.run.smithi067.stdout:(150/285): libwebp-1.2.0-8.el9.x86_64.rpm 4.6 MB/s | 277 kB 00:00 2024-09-11T23:58:58.594 INFO:teuthology.orchestra.run.smithi170.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-11T23:58:58.609 INFO:teuthology.orchestra.run.smithi067.stdout:(151/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.2 MB/s | 133 kB 00:00 2024-09-11T23:58:58.620 INFO:teuthology.orchestra.run.smithi170.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T23:58:58.634 INFO:teuthology.orchestra.run.smithi067.stdout:(152/285): libxshmfence-1.3-10.el9.x86_64.rpm 214 kB/s | 13 kB 00:00 2024-09-11T23:58:58.645 INFO:teuthology.orchestra.run.smithi170.stdout:(281/285): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-11T23:58:58.668 INFO:teuthology.orchestra.run.smithi067.stdout:(153/285): low-memory-monitor-2.1-4.el9.x86_64. 613 kB/s | 36 kB 00:00 2024-09-11T23:58:58.670 INFO:teuthology.orchestra.run.smithi170.stdout:(282/285): s3cmd-2.4.0-1.el9.noarch.rpm 2.7 MB/s | 206 kB 00:00 2024-09-11T23:58:58.693 INFO:teuthology.orchestra.run.smithi067.stdout:(154/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-11T23:58:58.720 INFO:teuthology.orchestra.run.smithi170.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T23:58:58.727 INFO:teuthology.orchestra.run.smithi067.stdout:(155/285): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-11T23:58:58.752 INFO:teuthology.orchestra.run.smithi067.stdout:(156/285): lua-posix-35.0-8.el9.x86_64.rpm 2.5 MB/s | 151 kB 00:00 2024-09-11T23:58:58.785 INFO:teuthology.orchestra.run.smithi067.stdout:(157/285): maven-3.6.3-15.el9.noarch.rpm 302 kB/s | 18 kB 00:00 2024-09-11T23:58:58.844 INFO:teuthology.orchestra.run.smithi067.stdout:(158/285): maven-openjdk11-3.6.3-15.el9.noarch. 155 kB/s | 9.0 kB 00:00 2024-09-11T23:58:58.921 INFO:teuthology.orchestra.run.smithi170.stdout:(284/285): librbd1-19.3.0-4753.gd011c522.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-11T23:58:58.971 INFO:teuthology.orchestra.run.smithi170.stdout:(285/285): librados2-19.3.0-4753.gd011c522.el9. 11 MB/s | 3.5 MB 00:00 2024-09-11T23:58:58.978 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:58:58.978 INFO:teuthology.orchestra.run.smithi170.stdout:Total 24 MB/s | 327 MB 00:13 2024-09-11T23:58:59.195 INFO:teuthology.orchestra.run.smithi067.stdout:(159/285): java-11-openjdk-headless-11.0.20.1.1 17 MB/s | 39 MB 00:02 2024-09-11T23:58:59.228 INFO:teuthology.orchestra.run.smithi067.stdout:(160/285): maven-resolver-1.6.1-10.el9.noarch.r 1.3 MB/s | 517 kB 00:00 2024-09-11T23:58:59.270 INFO:teuthology.orchestra.run.smithi067.stdout:(161/285): maven-lib-3.6.3-15.el9.noarch.rpm 2.9 MB/s | 1.5 MB 00:00 2024-09-11T23:58:59.295 INFO:teuthology.orchestra.run.smithi067.stdout:(162/285): maven-shared-utils-3.3.4-3.el9.noarc 1.5 MB/s | 151 kB 00:00 2024-09-11T23:58:59.320 INFO:teuthology.orchestra.run.smithi067.stdout:(163/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.2 MB/s | 112 kB 00:00 2024-09-11T23:58:59.337 INFO:teuthology.orchestra.run.smithi067.stdout:(164/285): mesa-filesystem-24.1.2-3.el9.x86_64. 269 kB/s | 11 kB 00:00 2024-09-11T23:58:59.371 INFO:teuthology.orchestra.run.smithi067.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.7 MB/s | 139 kB 00:00 2024-09-11T23:58:59.397 INFO:teuthology.orchestra.run.smithi067.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-09-11T23:58:59.413 INFO:teuthology.orchestra.run.smithi067.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 868 kB/s | 36 kB 00:00 2024-09-11T23:58:59.439 INFO:teuthology.orchestra.run.smithi067.stdout:(168/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 1.1 MB/s | 46 kB 00:00 2024-09-11T23:58:59.455 INFO:teuthology.orchestra.run.smithi067.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 768 kB/s | 32 kB 00:00 2024-09-11T23:58:59.480 INFO:teuthology.orchestra.run.smithi067.stdout:(170/285): openblas-0.3.26-2.el9.x86_64.rpm 920 kB/s | 38 kB 00:00 2024-09-11T23:58:59.539 INFO:teuthology.orchestra.run.smithi067.stdout:(171/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2024-09-11T23:58:59.598 INFO:teuthology.orchestra.run.smithi067.stdout:(172/285): opus-1.3.1-10.el9.x86_64.rpm 3.4 MB/s | 200 kB 00:00 2024-09-11T23:58:59.656 INFO:teuthology.orchestra.run.smithi067.stdout:(173/285): orc-0.4.31-8.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-11T23:58:59.723 INFO:teuthology.orchestra.run.smithi067.stdout:(174/285): osinfo-db-20240701-2.el9.noarch.rpm 7.8 MB/s | 531 kB 00:00 2024-09-11T23:58:59.782 INFO:teuthology.orchestra.run.smithi067.stdout:(175/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.2 MB/s | 74 kB 00:00 2024-09-11T23:58:59.882 INFO:teuthology.orchestra.run.smithi067.stdout:(176/285): openblas-openmp-0.3.26-2.el9.x86_64. 12 MB/s | 4.9 MB 00:00 2024-09-11T23:58:59.923 INFO:teuthology.orchestra.run.smithi067.stdout:(177/285): ostree-libs-2024.7-2.el9.x86_64.rpm 3.2 MB/s | 468 kB 00:00 2024-09-11T23:58:59.949 INFO:teuthology.orchestra.run.smithi067.stdout:(178/285): p11-kit-server-0.25.3-2.el9.x86_64.r 3.6 MB/s | 246 kB 00:00 2024-09-11T23:58:59.974 INFO:teuthology.orchestra.run.smithi067.stdout:(179/285): pipewire-1.0.1-1.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-09-11T23:59:00.074 INFO:teuthology.orchestra.run.smithi067.stdout:(180/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 11 MB/s | 8.8 MB 00:00 2024-09-11T23:59:00.099 INFO:teuthology.orchestra.run.smithi067.stdout:(181/285): pipewire-jack-audio-connection-kit-1 73 kB/s | 9.1 kB 00:00 2024-09-11T23:59:00.129 INFO:teuthology.orchestra.run.smithi067.stdout:(182/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 326 kB/s | 57 kB 00:00 2024-09-11T23:59:00.150 INFO:teuthology.orchestra.run.smithi067.stdout:(183/285): pipewire-jack-audio-connection-kit-l 1.8 MB/s | 135 kB 00:00 2024-09-11T23:59:00.176 INFO:teuthology.orchestra.run.smithi067.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.7 MB/s | 192 kB 00:00 2024-09-11T23:59:00.202 INFO:teuthology.orchestra.run.smithi067.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 516 kB/s | 26 kB 00:00 2024-09-11T23:59:00.278 INFO:teuthology.orchestra.run.smithi067.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 590 kB/s | 60 kB 00:00 2024-09-11T23:59:00.311 INFO:teuthology.orchestra.run.smithi067.stdout:(187/285): plexus-containers-component-annotati 183 kB/s | 18 kB 00:00 2024-09-11T23:59:00.346 INFO:teuthology.orchestra.run.smithi067.stdout:(188/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 7.9 MB/s | 1.9 MB 00:00 2024-09-11T23:59:00.369 INFO:teuthology.orchestra.run.smithi067.stdout:(189/285): plexus-sec-dispatcher-1.4-37.el9.noa 502 kB/s | 34 kB 00:00 2024-09-11T23:59:00.398 INFO:teuthology.orchestra.run.smithi067.stdout:(190/285): plexus-interpolation-1.26-11.el9.noa 686 kB/s | 80 kB 00:00 2024-09-11T23:59:00.419 INFO:teuthology.orchestra.run.smithi067.stdout:(191/285): plexus-utils-3.3.0-10.el9.noarch.rpm 3.3 MB/s | 254 kB 00:00 2024-09-11T23:59:00.526 INFO:teuthology.orchestra.run.smithi067.stdout:(192/285): poppler-21.01.0-21.el9.x86_64.rpm 9.1 MB/s | 1.1 MB 00:00 2024-09-11T23:59:00.526 INFO:teuthology.orchestra.run.smithi067.stdout:(193/285): poppler-glib-21.01.0-21.el9.x86_64.r 1.5 MB/s | 152 kB 00:00 2024-09-11T23:59:00.587 INFO:teuthology.orchestra.run.smithi067.stdout:(194/285): poppler-data-0.4.9-9.el9.noarch.rpm 9.8 MB/s | 1.9 MB 00:00 2024-09-11T23:59:00.620 INFO:teuthology.orchestra.run.smithi067.stdout:(195/285): protobuf-3.14.0-13.el9.x86_64.rpm 7.5 MB/s | 1.0 MB 00:00 2024-09-11T23:59:00.646 INFO:teuthology.orchestra.run.smithi067.stdout:(196/285): publicsuffix-list-20210518-3.el9.noa 660 kB/s | 83 kB 00:00 2024-09-11T23:59:00.704 INFO:teuthology.orchestra.run.smithi067.stdout:(197/285): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-11T23:59:00.758 INFO:teuthology.orchestra.run.smithi067.stdout:(198/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 3.9 MB/s | 679 kB 00:00 2024-09-11T23:59:00.788 INFO:teuthology.orchestra.run.smithi067.stdout:(199/285): python3-jinja2-2.11.3-6.el9.noarch.r 2.9 MB/s | 248 kB 00:00 2024-09-11T23:59:00.813 INFO:teuthology.orchestra.run.smithi067.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 466 kB/s | 26 kB 00:00 2024-09-11T23:59:00.839 INFO:teuthology.orchestra.run.smithi067.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 382 kB/s | 19 kB 00:00 2024-09-11T23:59:00.872 INFO:teuthology.orchestra.run.smithi067.stdout:(202/285): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T23:59:00.897 INFO:teuthology.orchestra.run.smithi067.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 592 kB/s | 35 kB 00:00 2024-09-11T23:59:00.989 INFO:teuthology.orchestra.run.smithi067.stdout:(204/285): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-11T23:59:01.014 INFO:teuthology.orchestra.run.smithi067.stdout:(205/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 2.1 MB/s | 250 kB 00:00 2024-09-11T23:59:01.048 INFO:teuthology.orchestra.run.smithi067.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 3.7 MB/s | 222 kB 00:00 2024-09-11T23:59:01.073 INFO:teuthology.orchestra.run.smithi067.stdout:(207/285): python3-packaging-20.9-5.el9.noarch. 1.3 MB/s | 77 kB 00:00 2024-09-11T23:59:01.098 INFO:teuthology.orchestra.run.smithi067.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 841 kB/s | 42 kB 00:00 2024-09-11T23:59:01.132 INFO:teuthology.orchestra.run.smithi067.stdout:(209/285): python3-protobuf-3.14.0-13.el9.noarc 4.5 MB/s | 269 kB 00:00 2024-09-11T23:59:01.157 INFO:teuthology.orchestra.run.smithi067.stdout:(210/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.7 MB/s | 159 kB 00:00 2024-09-11T23:59:01.232 INFO:teuthology.orchestra.run.smithi067.stdout:(211/285): python3-numpy-1.20.1-5.el9.x86_64.rp 14 MB/s | 5.1 MB 00:00 2024-09-11T23:59:01.258 INFO:teuthology.orchestra.run.smithi067.stdout:(212/285): python3-pytz-2021.1-5.el9.noarch.rpm 509 kB/s | 51 kB 00:00 2024-09-11T23:59:01.283 INFO:teuthology.orchestra.run.smithi067.stdout:(213/285): python3-pyasn1-modules-0.4.8-6.el9.n 1.8 MB/s | 279 kB 00:00 2024-09-11T23:59:01.308 INFO:teuthology.orchestra.run.smithi067.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 712 kB/s | 54 kB 00:00 2024-09-11T23:59:01.333 INFO:teuthology.orchestra.run.smithi067.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 828 kB/s | 42 kB 00:00 2024-09-11T23:59:01.367 INFO:teuthology.orchestra.run.smithi067.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-11T23:59:01.392 INFO:teuthology.orchestra.run.smithi067.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 613 kB/s | 36 kB 00:00 2024-09-11T23:59:01.425 INFO:teuthology.orchestra.run.smithi067.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 813 kB/s | 47 kB 00:00 2024-09-11T23:59:01.451 INFO:teuthology.orchestra.run.smithi067.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 958 kB/s | 56 kB 00:00 2024-09-11T23:59:01.501 INFO:teuthology.orchestra.run.smithi067.stdout:(220/285): sisu-0.3.4-10.el9.noarch.rpm 6.6 MB/s | 510 kB 00:00 2024-09-11T23:59:01.518 INFO:teuthology.orchestra.run.smithi067.stdout:(221/285): slf4j-1.7.30-13.el9.noarch.rpm 1.0 MB/s | 69 kB 00:00 2024-09-11T23:59:01.563 INFO:teuthology.orchestra.run.smithi067.stdout:(222/285): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-11T23:59:01.602 INFO:teuthology.orchestra.run.smithi067.stdout:(223/285): sound-theme-freedesktop-0.8-17.el9.n 4.5 MB/s | 383 kB 00:00 2024-09-11T23:59:01.628 INFO:teuthology.orchestra.run.smithi067.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 2.2 MB/s | 152 kB 00:00 2024-09-11T23:59:01.678 INFO:teuthology.orchestra.run.smithi067.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 7.2 MB/s | 555 kB 00:00 2024-09-11T23:59:01.728 INFO:teuthology.orchestra.run.smithi067.stdout:(226/285): tracker-miners-3.1.2-4.el9.x86_64.rp 9.2 MB/s | 944 kB 00:00 2024-09-11T23:59:01.792 INFO:teuthology.orchestra.run.smithi067.stdout:(227/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 467 kB/s | 53 kB 00:00 2024-09-11T23:59:01.820 INFO:teuthology.orchestra.run.smithi067.stdout:(228/285): tzdata-java-2024a-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-11T23:59:01.846 INFO:teuthology.orchestra.run.smithi067.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 3.2 MB/s | 173 kB 00:00 2024-09-11T23:59:01.879 INFO:teuthology.orchestra.run.smithi067.stdout:(230/285): webrtc-audio-processing-0.3.1-8.el9. 5.1 MB/s | 306 kB 00:00 2024-09-11T23:59:01.904 INFO:teuthology.orchestra.run.smithi067.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-11T23:59:02.063 INFO:teuthology.orchestra.run.smithi067.stdout:(232/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-11T23:59:02.080 INFO:teuthology.orchestra.run.smithi067.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 242 kB/s | 42 kB 00:00 2024-09-11T23:59:02.105 INFO:teuthology.orchestra.run.smithi067.stdout:(234/285): wireplumber-libs-0.4.14-1.el9.x86_64 1.5 MB/s | 358 kB 00:00 2024-09-11T23:59:02.130 INFO:teuthology.orchestra.run.smithi067.stdout:(235/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.6 MB/s | 134 kB 00:00 2024-09-11T23:59:02.172 INFO:teuthology.orchestra.run.smithi067.stdout:(236/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 3.5 MB/s | 385 kB 00:00 2024-09-11T23:59:02.173 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-09-11T23:59:02.198 INFO:teuthology.orchestra.run.smithi067.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-09-11T23:59:02.231 INFO:teuthology.orchestra.run.smithi067.stdout:(238/285): xkeyboard-config-2.33-2.el9.noarch.r 6.7 MB/s | 859 kB 00:00 2024-09-11T23:59:02.256 INFO:teuthology.orchestra.run.smithi067.stdout:(239/285): lua-devel-5.4.4-4.el9.x86_64.rpm 381 kB/s | 22 kB 00:00 2024-09-11T23:59:02.298 INFO:teuthology.orchestra.run.smithi067.stdout:(240/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 3.9 MB/s | 505 kB 00:00 2024-09-11T23:59:02.349 INFO:teuthology.orchestra.run.smithi067.stdout:(241/285): protobuf-compiler-3.14.0-13.el9.x86_ 7.2 MB/s | 863 kB 00:00 2024-09-11T23:59:02.357 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-09-11T23:59:02.357 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-09-11T23:59:02.391 INFO:teuthology.orchestra.run.smithi067.stdout:(242/285): abseil-cpp-20211102.0-3.el9.x86_64.r 4.0 MB/s | 548 kB 00:00 2024-09-11T23:59:02.424 INFO:teuthology.orchestra.run.smithi067.stdout:(243/285): gperftools-libs-2.9.1-2.el9.x86_64.r 2.4 MB/s | 309 kB 00:00 2024-09-11T23:59:02.449 INFO:teuthology.orchestra.run.smithi067.stdout:(244/285): grpc-data-1.46.7-10.el9.noarch.rpm 198 kB/s | 19 kB 00:00 2024-09-11T23:59:02.475 INFO:teuthology.orchestra.run.smithi067.stdout:(245/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-09-11T23:59:02.500 INFO:teuthology.orchestra.run.smithi067.stdout:(246/285): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-09-11T23:59:02.525 INFO:teuthology.orchestra.run.smithi067.stdout:(247/285): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-11T23:59:02.550 INFO:teuthology.orchestra.run.smithi067.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-11T23:59:02.592 INFO:teuthology.orchestra.run.smithi067.stdout:(249/285): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-11T23:59:02.617 INFO:teuthology.orchestra.run.smithi067.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T23:59:02.643 INFO:teuthology.orchestra.run.smithi067.stdout:(251/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-11T23:59:02.669 INFO:teuthology.orchestra.run.smithi067.stdout:(252/285): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-11T23:59:02.693 INFO:teuthology.orchestra.run.smithi067.stdout:(253/285): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-11T23:59:02.727 INFO:teuthology.orchestra.run.smithi067.stdout:(254/285): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-11T23:59:02.761 INFO:teuthology.orchestra.run.smithi067.stdout:(255/285): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-11T23:59:02.786 INFO:teuthology.orchestra.run.smithi067.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-11T23:59:02.820 INFO:teuthology.orchestra.run.smithi067.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-11T23:59:02.845 INFO:teuthology.orchestra.run.smithi067.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-11T23:59:02.870 INFO:teuthology.orchestra.run.smithi067.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 714 kB/s | 18 kB 00:00 2024-09-11T23:59:02.895 INFO:teuthology.orchestra.run.smithi067.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-11T23:59:02.921 INFO:teuthology.orchestra.run.smithi067.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 787 kB/s | 19 kB 00:00 2024-09-11T23:59:02.946 INFO:teuthology.orchestra.run.smithi067.stdout:(262/285): python3-jaraco-text-3.2.0-6.el9.noar 787 kB/s | 20 kB 00:00 2024-09-11T23:59:03.013 INFO:teuthology.orchestra.run.smithi067.stdout:(263/285): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-09-11T23:59:03.038 INFO:teuthology.orchestra.run.smithi067.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T23:59:03.063 INFO:teuthology.orchestra.run.smithi067.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T23:59:03.089 INFO:teuthology.orchestra.run.smithi067.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T23:59:03.139 INFO:teuthology.orchestra.run.smithi067.stdout:(267/285): python3-grpcio-1.46.7-10.el9.x86_64. 5.4 MB/s | 2.0 MB 00:00 2024-09-11T23:59:03.164 INFO:teuthology.orchestra.run.smithi067.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 655 kB/s | 16 kB 00:00 2024-09-11T23:59:03.189 INFO:teuthology.orchestra.run.smithi067.stdout:(269/285): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-11T23:59:03.215 INFO:teuthology.orchestra.run.smithi067.stdout:(270/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-11T23:59:03.240 INFO:teuthology.orchestra.run.smithi067.stdout:(271/285): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-11T23:59:03.265 INFO:teuthology.orchestra.run.smithi067.stdout:(272/285): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T23:59:03.291 INFO:teuthology.orchestra.run.smithi067.stdout:(273/285): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-11T23:59:03.316 INFO:teuthology.orchestra.run.smithi067.stdout:(274/285): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-11T23:59:03.333 INFO:teuthology.orchestra.run.smithi067.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-11T23:59:03.358 INFO:teuthology.orchestra.run.smithi067.stdout:(276/285): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-11T23:59:03.383 INFO:teuthology.orchestra.run.smithi067.stdout:(277/285): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-11T23:59:03.400 INFO:teuthology.orchestra.run.smithi067.stdout:(278/285): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-11T23:59:03.459 INFO:teuthology.orchestra.run.smithi067.stdout:(279/285): libarrow-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 4.4 MB 00:01 2024-09-11T23:59:03.485 INFO:teuthology.orchestra.run.smithi067.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-11T23:59:03.510 INFO:teuthology.orchestra.run.smithi067.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-11T23:59:03.535 INFO:teuthology.orchestra.run.smithi067.stdout:(282/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2024-09-11T23:59:03.585 INFO:teuthology.orchestra.run.smithi067.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T23:59:03.777 INFO:teuthology.orchestra.run.smithi067.stdout:(284/285): librbd1-19.3.0-4753.gd011c522.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-11T23:59:03.835 INFO:teuthology.orchestra.run.smithi067.stdout:(285/285): librados2-19.3.0-4753.gd011c522.el9. 11 MB/s | 3.5 MB 00:00 2024-09-11T23:59:03.842 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-09-11T23:59:03.843 INFO:teuthology.orchestra.run.smithi067.stdout:Total 21 MB/s | 327 MB 00:15 2024-09-11T23:59:05.806 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-09-11T23:59:05.806 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-09-11T23:59:07.148 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-09-11T23:59:07.352 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-09-11T23:59:07.352 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-09-11T23:59:10.777 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-09-11T23:59:10.777 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-09-11T23:59:15.884 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-11T23:59:16.047 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-11T23:59:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-09-11T23:59:16.278 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-11T23:59:16.308 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-11T23:59:16.486 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-11T23:59:16.540 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-11T23:59:16.594 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-11T23:59:16.626 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-11T23:59:16.660 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-11T23:59:16.712 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-11T23:59:17.044 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-11T23:59:17.145 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-11T23:59:17.268 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-11T23:59:17.304 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-11T23:59:17.403 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-11T23:59:17.433 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-11T23:59:17.487 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-11T23:59:17.518 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-11T23:59:17.543 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-11T23:59:17.574 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-11T23:59:17.610 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-11T23:59:17.635 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-11T23:59:17.663 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-11T23:59:17.811 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-11T23:59:17.964 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-11T23:59:18.003 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-11T23:59:18.043 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-11T23:59:18.071 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-11T23:59:18.176 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-11T23:59:18.206 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-11T23:59:18.268 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-11T23:59:18.293 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-11T23:59:18.316 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-11T23:59:18.352 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-11T23:59:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-11T23:59:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-11T23:59:18.694 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-11T23:59:18.730 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-11T23:59:18.765 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-11T23:59:18.830 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-11T23:59:18.894 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-11T23:59:18.932 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-11T23:59:18.975 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-11T23:59:19.000 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-11T23:59:19.027 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-11T23:59:19.052 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-11T23:59:19.078 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-11T23:59:19.107 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-11T23:59:19.147 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-11T23:59:19.180 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-11T23:59:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-11T23:59:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-11T23:59:19.323 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-11T23:59:19.380 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-11T23:59:19.410 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-11T23:59:19.454 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-11T23:59:19.489 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-11T23:59:19.522 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-11T23:59:19.603 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-11T23:59:19.634 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 51/287 2024-09-11T23:59:19.678 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 52/287 2024-09-11T23:59:19.720 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 53/287 2024-09-11T23:59:19.804 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-11T23:59:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-11T23:59:20.007 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-11T23:59:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-11T23:59:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-11T23:59:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-11T23:59:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-11T23:59:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-11T23:59:20.805 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-11T23:59:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-11T23:59:20.906 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-11T23:59:20.937 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-11T23:59:20.978 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-11T23:59:21.030 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-11T23:59:21.068 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 68/287 2024-09-11T23:59:21.101 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-11T23:59:21.134 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-11T23:59:21.176 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-11T23:59:21.234 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-11T23:59:21.268 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-11T23:59:21.278 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-11T23:59:21.305 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-11T23:59:21.399 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-11T23:59:21.466 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-11T23:59:21.471 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-11T23:59:21.544 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-11T23:59:21.582 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-11T23:59:21.619 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-11T23:59:21.648 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-09-11T23:59:21.666 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-11T23:59:21.710 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-11T23:59:21.715 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-11T23:59:21.753 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-11T23:59:21.757 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-11T23:59:21.836 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-11T23:59:21.876 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-11T23:59:21.900 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-11T23:59:21.934 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-11T23:59:21.946 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-11T23:59:21.984 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-11T23:59:21.987 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-11T23:59:22.009 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-11T23:59:22.065 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-11T23:59:22.093 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-11T23:59:22.130 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-11T23:59:22.171 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-11T23:59:22.211 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/287 2024-09-11T23:59:22.236 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-11T23:59:22.335 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-11T23:59:22.421 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-11T23:59:22.474 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-11T23:59:22.522 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-11T23:59:22.535 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-11T23:59:22.652 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-11T23:59:22.686 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-11T23:59:22.737 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-11T23:59:22.765 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-11T23:59:22.773 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-11T23:59:22.798 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-11T23:59:22.804 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-11T23:59:22.834 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-11T23:59:22.837 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-11T23:59:22.866 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-11T23:59:22.884 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-11T23:59:22.892 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-11T23:59:22.918 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-11T23:59:22.921 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-11T23:59:22.936 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-11T23:59:22.936 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-11T23:59:22.936 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:59:22.950 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-11T23:59:22.983 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-11T23:59:23.011 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-11T23:59:23.126 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-11T23:59:23.152 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-11T23:59:23.210 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-11T23:59:23.263 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-11T23:59:23.288 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-11T23:59:23.314 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-11T23:59:23.339 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-11T23:59:23.343 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-11T23:59:23.534 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-11T23:59:23.580 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-11T23:59:23.607 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-11T23:59:23.743 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-11T23:59:23.930 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-11T23:59:23.930 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-11T23:59:23.930 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-11T23:59:23.931 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-11T23:59:23.931 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-11T23:59:23.931 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-11T23:59:23.931 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-11T23:59:23.931 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-11T23:59:23.931 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-11T23:59:23.931 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:59:23.931 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-11T23:59:23.932 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-11T23:59:23.934 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-11T23:59:24.073 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-11T23:59:24.121 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-11T23:59:24.168 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-11T23:59:24.283 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-11T23:59:24.297 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-11T23:59:24.332 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-11T23:59:24.372 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-11T23:59:24.448 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-11T23:59:24.449 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-11T23:59:24.507 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-11T23:59:24.546 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-11T23:59:24.558 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-11T23:59:24.589 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-11T23:59:24.589 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-11T23:59:24.613 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-11T23:59:24.640 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-11T23:59:24.665 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-11T23:59:24.691 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-11T23:59:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-11T23:59:24.720 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-11T23:59:24.751 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-11T23:59:24.765 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-11T23:59:24.776 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-11T23:59:24.824 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-11T23:59:24.858 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-11T23:59:24.927 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-11T23:59:24.986 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-11T23:59:25.014 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-11T23:59:25.058 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-11T23:59:25.094 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-11T23:59:25.126 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-11T23:59:25.207 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-11T23:59:25.261 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 51/287 2024-09-11T23:59:25.305 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 52/287 2024-09-11T23:59:25.349 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 53/287 2024-09-11T23:59:25.435 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-11T23:59:25.509 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-11T23:59:25.554 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-11T23:59:25.588 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-11T23:59:25.592 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-11T23:59:25.651 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-11T23:59:25.690 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-11T23:59:25.737 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-11T23:59:25.928 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-11T23:59:25.977 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-11T23:59:26.024 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-11T23:59:26.226 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-11T23:59:26.316 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-11T23:59:26.356 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-11T23:59:26.428 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-11T23:59:26.470 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-11T23:59:26.506 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-11T23:59:26.529 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-11T23:59:26.535 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-11T23:59:26.594 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-11T23:59:26.609 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-11T23:59:26.631 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-11T23:59:26.645 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-11T23:59:26.665 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-11T23:59:26.687 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-11T23:59:26.698 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-11T23:59:26.731 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-11T23:59:26.770 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 68/287 2024-09-11T23:59:26.802 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-11T23:59:26.833 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-11T23:59:26.882 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-11T23:59:26.887 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-11T23:59:26.929 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-11T23:59:26.944 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-11T23:59:26.977 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-11T23:59:27.014 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-11T23:59:27.015 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-11T23:59:27.112 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-11T23:59:27.181 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-11T23:59:27.265 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-11T23:59:27.299 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-11T23:59:27.335 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-11T23:59:27.384 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-11T23:59:27.428 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-11T23:59:27.479 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-11T23:59:27.635 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-11T23:59:27.688 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-11T23:59:27.709 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-11T23:59:27.730 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-11T23:59:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-11T23:59:27.839 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-11T23:59:27.871 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-11T23:59:27.912 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-11T23:59:27.944 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/287 2024-09-11T23:59:27.969 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-11T23:59:28.068 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-11T23:59:28.213 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-11T23:59:28.263 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-11T23:59:28.480 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-11T23:59:28.531 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-11T23:59:28.562 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-11T23:59:28.600 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-11T23:59:28.645 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-11T23:59:28.670 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-11T23:59:28.684 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-11T23:59:28.684 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-11T23:59:28.684 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-11T23:59:28.883 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-11T23:59:28.960 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-11T23:59:29.010 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-11T23:59:29.034 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-11T23:59:29.069 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-11T23:59:29.102 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-11T23:59:29.112 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-11T23:59:29.216 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-11T23:59:29.267 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-11T23:59:29.301 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-11T23:59:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-11T23:59:29.358 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-11T23:59:29.370 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-11T23:59:29.371 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-11T23:59:29.371 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:59:29.417 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-11T23:59:29.445 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-11T23:59:29.474 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-11T23:59:29.530 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-11T23:59:29.566 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-11T23:59:29.581 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-11T23:59:29.581 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-11T23:59:29.582 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-11T23:59:29.622 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-11T23:59:29.658 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-11T23:59:29.691 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-11T23:59:29.734 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-11T23:59:29.767 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-11T23:59:29.806 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-11T23:59:29.860 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-11T23:59:29.906 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-11T23:59:29.920 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-11T23:59:29.953 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-11T23:59:30.021 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-11T23:59:30.065 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 145/287 2024-09-11T23:59:30.066 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-11T23:59:30.110 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-11T23:59:30.123 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-11T23:59:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-11T23:59:30.200 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-11T23:59:30.238 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-11T23:59:30.263 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-11T23:59:30.303 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-11T23:59:30.328 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-11T23:59:30.616 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-11T23:59:30.655 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-11T23:59:30.684 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-11T23:59:30.708 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-11T23:59:30.740 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-11T23:59:30.776 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-11T23:59:30.809 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-11T23:59:30.838 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-11T23:59:30.873 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-11T23:59:30.916 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-11T23:59:30.918 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-11T23:59:30.968 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-11T23:59:30.969 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-11T23:59:31.002 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-11T23:59:31.015 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-11T23:59:31.049 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-11T23:59:31.118 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-11T23:59:31.166 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-11T23:59:31.371 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-11T23:59:31.416 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-11T23:59:31.465 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-11T23:59:31.509 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-11T23:59:31.652 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-11T23:59:31.715 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-11T23:59:31.740 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-11T23:59:31.769 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-11T23:59:31.851 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-11T23:59:31.892 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-11T23:59:31.917 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-11T23:59:31.937 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-11T23:59:31.971 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-11T23:59:31.997 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-11T23:59:32.016 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-11T23:59:32.044 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-11T23:59:32.069 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-11T23:59:32.083 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-11T23:59:32.128 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-11T23:59:32.169 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-11T23:59:32.203 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-11T23:59:32.394 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-11T23:59:32.426 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-11T23:59:32.506 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-11T23:59:33.233 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-11T23:59:33.365 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-11T23:59:34.737 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-11T23:59:34.811 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-11T23:59:34.870 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-11T23:59:34.904 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-11T23:59:34.931 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-11T23:59:34.969 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-11T23:59:34.982 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-11T23:59:34.983 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-11T23:59:34.983 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-11T23:59:35.047 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-11T23:59:35.073 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-11T23:59:35.102 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-11T23:59:35.439 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-11T23:59:35.490 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-11T23:59:35.590 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-11T23:59:35.622 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 145/287 2024-09-11T23:59:35.654 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-11T23:59:35.683 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-11T23:59:35.745 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-11T23:59:35.774 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-11T23:59:35.799 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-11T23:59:35.841 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-11T23:59:35.863 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-11T23:59:36.138 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-11T23:59:36.182 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-11T23:59:36.219 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-11T23:59:36.244 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-11T23:59:36.270 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-11T23:59:36.295 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-11T23:59:36.320 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-11T23:59:36.349 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-11T23:59:36.384 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-11T23:59:36.433 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-11T23:59:36.469 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-11T23:59:36.517 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-11T23:59:36.559 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-11T23:59:37.044 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-11T23:59:37.198 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-11T23:59:37.257 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-11T23:59:37.291 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-11T23:59:37.320 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-11T23:59:37.401 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-11T23:59:37.457 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-11T23:59:37.483 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-11T23:59:37.504 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-11T23:59:37.538 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-11T23:59:37.564 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-11T23:59:37.629 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-11T23:59:37.652 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-11T23:59:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-11T23:59:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-11T23:59:43.790 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-11T23:59:43.839 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-11T23:59:43.873 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-11T23:59:43.917 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-11T23:59:44.421 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-11T23:59:44.449 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-11T23:59:44.509 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-11T23:59:44.531 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 184/287 2024-09-11T23:59:46.897 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-11T23:59:46.932 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-11T23:59:47.500 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-11T23:59:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-11T23:59:47.641 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-11T23:59:47.641 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:59:47.641 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:59:47.641 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:59:47.670 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-11T23:59:49.915 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-11T23:59:49.960 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-11T23:59:49.988 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-11T23:59:50.034 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-11T23:59:50.062 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-11T23:59:50.098 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-11T23:59:50.621 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-11T23:59:50.651 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-11T23:59:50.732 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-11T23:59:50.761 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 184/287 2024-09-11T23:59:53.284 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-11T23:59:53.320 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-11T23:59:53.918 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-11T23:59:53.965 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-11T23:59:54.057 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-11T23:59:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T23:59:54.057 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T23:59:54.058 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-11T23:59:54.091 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-11T23:59:56.962 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-11T23:59:56.963 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /sys 2024-09-11T23:59:56.963 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /proc 2024-09-11T23:59:56.963 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /mnt 2024-09-11T23:59:56.963 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /var/tmp 2024-09-11T23:59:56.963 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /home 2024-09-11T23:59:56.964 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /root 2024-09-11T23:59:56.964 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /tmp 2024-09-11T23:59:56.964 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:59:57.136 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-11T23:59:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-11T23:59:57.152 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:59:57.153 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T23:59:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:59:58.612 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-11T23:59:58.640 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-11T23:59:58.640 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:59:58.640 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T23:59:58.640 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:59:58.640 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T23:59:58.641 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:59:58.871 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-11T23:59:58.927 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-11T23:59:58.927 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:59:58.927 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T23:59:58.927 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:59:58.927 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T23:59:58.927 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:59:59.338 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-11T23:59:59.362 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-11T23:59:59.362 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T23:59:59.362 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T23:59:59.362 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:59:59.362 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T23:59:59.362 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-11T23:59:59.465 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T00:00:02.378 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T00:00:02.482 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T00:00:02.542 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T00:00:02.596 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T00:00:02.789 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T00:00:02.852 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T00:00:02.929 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T00:00:03.018 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T00:00:03.166 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T00:00:03.211 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T00:00:03.245 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T00:00:03.905 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:00:03.905 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /sys 2024-09-12T00:00:03.905 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /proc 2024-09-12T00:00:03.905 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /mnt 2024-09-12T00:00:03.905 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /var/tmp 2024-09-12T00:00:03.905 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /home 2024-09-12T00:00:03.905 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /root 2024-09-12T00:00:03.905 INFO:teuthology.orchestra.run.smithi067.stdout:skipping the directory /tmp 2024-09-12T00:00:03.905 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:04.107 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T00:00:04.107 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:00:04.125 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:00:04.125 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:04.125 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:00:04.125 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:04.159 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:00:04.511 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:00:04.549 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T00:00:04.580 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T00:00:04.608 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T00:00:04.651 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T00:00:04.696 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T00:00:04.723 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T00:00:04.749 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T00:00:04.775 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T00:00:04.800 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T00:00:04.826 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T00:00:04.851 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T00:00:04.878 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T00:00:04.909 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T00:00:04.937 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T00:00:04.971 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T00:00:05.007 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T00:00:05.047 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T00:00:05.081 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T00:00:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T00:00:05.152 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T00:00:05.191 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T00:00:05.233 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T00:00:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T00:00:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T00:00:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T00:00:05.385 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T00:00:05.426 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T00:00:05.456 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T00:00:05.485 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T00:00:05.511 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T00:00:05.675 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:00:05.680 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T00:00:05.704 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:00:05.704 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:05.704 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:00:05.705 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:00:05.705 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:00:05.705 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T00:00:05.738 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T00:00:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T00:00:05.798 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T00:00:05.924 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T00:00:05.950 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:00:05.975 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:00:05.976 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:05.976 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:00:05.976 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:00:05.976 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:00:05.976 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:05.989 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T00:00:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T00:00:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:00:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:00:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:00:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:00:06.297 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T00:00:06.320 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T00:00:06.443 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:00:06.468 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:00:06.468 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:06.469 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:00:06.469 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:00:06.469 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:00:06.469 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:06.574 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T00:00:06.750 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:00:06.774 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:00:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:00:06.791 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T00:00:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:07.025 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T00:00:07.095 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T00:00:07.132 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T00:00:07.169 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T00:00:07.194 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T00:00:07.619 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:00:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:00:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:00:08.213 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:00:08.303 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:00:08.340 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:00:08.369 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:00:08.567 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T00:00:08.630 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T00:00:08.665 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:00:08.687 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:00:08.716 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:00:08.785 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:00:08.819 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:00:08.830 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:00:08.852 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:00:08.876 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:00:08.903 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T00:00:09.379 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:00:09.409 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:00:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 265/287 2024-09-12T00:00:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 266/287 2024-09-12T00:00:09.534 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:00:09.637 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T00:00:09.735 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T00:00:09.792 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T00:00:09.858 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T00:00:10.060 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T00:00:10.113 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T00:00:10.195 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T00:00:10.292 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T00:00:10.437 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T00:00:10.480 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T00:00:10.513 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T00:00:11.439 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T00:00:11.494 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:00:11.858 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:00:11.917 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T00:00:11.948 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T00:00:11.976 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T00:00:12.011 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T00:00:12.048 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T00:00:12.075 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T00:00:12.101 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T00:00:12.126 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T00:00:12.151 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T00:00:12.177 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T00:00:12.203 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T00:00:12.230 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T00:00:12.260 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T00:00:12.288 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T00:00:12.323 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T00:00:12.359 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T00:00:12.390 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T00:00:12.424 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T00:00:12.459 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T00:00:12.504 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T00:00:12.543 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T00:00:12.585 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T00:00:12.629 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T00:00:12.660 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T00:00:12.692 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T00:00:12.726 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:00:12.748 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T00:00:12.777 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T00:00:12.789 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:00:12.808 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T00:00:12.837 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T00:00:12.862 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T00:00:13.038 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T00:00:13.071 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T00:00:13.097 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T00:00:13.124 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T00:00:13.157 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T00:00:13.302 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T00:00:13.358 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T00:00:13.427 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T00:00:13.469 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:00:13.595 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:00:13.632 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:00:13.649 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:00:13.678 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T00:00:13.701 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T00:00:13.754 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:00:13.789 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:00:13.905 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:00:14.068 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 270/287 2024-09-12T00:00:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:00:14.116 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:00:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:00:14.124 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:14.124 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:00:14.125 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:00:14.125 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:00:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:14.146 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:00:14.163 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:00:14.163 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T00:00:14.163 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:00:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:00:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 273/287 2024-09-12T00:00:14.239 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T00:00:14.288 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T00:00:14.319 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:00:14.336 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:00:14.336 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T00:00:14.336 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:14.398 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T00:00:14.469 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T00:00:14.512 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T00:00:14.549 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T00:00:14.574 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T00:00:14.964 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:00:14.997 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:00:15.015 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:00:15.316 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:00:15.328 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:00:15.328 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:15.328 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:00:15.328 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:00:15.328 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:00:15.328 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:15.372 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:00:15.398 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:00:15.398 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:15.398 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:00:15.398 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:15.560 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:00:15.645 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:00:15.671 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:00:15.701 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:00:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:00:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:00:15.729 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:15.729 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:00:15.729 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:00:15.729 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:00:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:15.914 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T00:00:15.971 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T00:00:15.996 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:00:16.018 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:00:16.047 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:00:16.112 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:00:16.141 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:00:16.152 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:00:16.183 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:00:16.197 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:00:16.226 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T00:00:16.662 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:00:16.690 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:00:16.724 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 265/287 2024-09-12T00:00:16.793 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 266/287 2024-09-12T00:00:16.825 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:00:20.206 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:00:20.270 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:00:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 280/287 2024-09-12T00:00:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 281/287 2024-09-12T00:00:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 282/287 2024-09-12T00:00:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 283/287 2024-09-12T00:00:20.642 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:00:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T00:00:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:00:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:00:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:00:21.182 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:00:21.203 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T00:00:21.211 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T00:00:21.220 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T00:00:21.231 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T00:00:21.231 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:00:21.231 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:00:21.231 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:21.284 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:00:21.312 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:00:21.417 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:00:21.437 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:00:21.485 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:00:21.607 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 270/287 2024-09-12T00:00:21.639 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:00:21.665 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:00:21.665 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:21.665 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:00:21.665 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:00:21.665 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:00:21.665 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:21.715 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:00:21.728 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:00:21.749 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 273/287 2024-09-12T00:00:21.778 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T00:00:21.828 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T00:00:21.858 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:00:21.875 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:00:21.875 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T00:00:21.875 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:22.884 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:00:22.909 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:00:22.909 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:22.909 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:00:22.910 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:00:22.910 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:00:22.910 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:22.952 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:00:22.976 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:00:22.976 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:22.976 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:00:22.977 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:23.302 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:00:23.328 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:00:23.328 INFO:teuthology.orchestra.run.smithi067.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:00:23.328 INFO:teuthology.orchestra.run.smithi067.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:00:23.328 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:00:23.328 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:00:23.328 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:28.310 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 280/287 2024-09-12T00:00:28.356 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 281/287 2024-09-12T00:00:28.387 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 282/287 2024-09-12T00:00:28.496 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 283/287 2024-09-12T00:00:28.558 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:00:28.587 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T00:00:28.587 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:00:28.679 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:00:28.680 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:00:28.779 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:00:28.795 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T00:00:28.801 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T00:00:28.811 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T00:00:28.822 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T00:00:28.822 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:00:28.822 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:00:28.822 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:28.870 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:00:28.943 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:00:31.292 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:00:31.292 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 1/287 2024-09-12T00:00:31.292 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2/287 2024-09-12T00:00:31.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 3/287 2024-09-12T00:00:31.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 4/287 2024-09-12T00:00:31.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 5/287 2024-09-12T00:00:31.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 6/287 2024-09-12T00:00:31.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 7/287 2024-09-12T00:00:31.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 8/287 2024-09-12T00:00:31.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 9/287 2024-09-12T00:00:31.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:00:31.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:00:31.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:00:31.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 13/287 2024-09-12T00:00:31.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 14/287 2024-09-12T00:00:31.293 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 15/287 2024-09-12T00:00:31.294 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 16/287 2024-09-12T00:00:31.294 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 17/287 2024-09-12T00:00:31.294 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 18/287 2024-09-12T00:00:31.294 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 19/287 2024-09-12T00:00:31.294 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 20/287 2024-09-12T00:00:31.294 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 21/287 2024-09-12T00:00:31.294 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 22/287 2024-09-12T00:00:31.294 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 23/287 2024-09-12T00:00:31.294 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:00:31.294 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 25/287 2024-09-12T00:00:31.294 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 26/287 2024-09-12T00:00:31.294 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 27/287 2024-09-12T00:00:31.294 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 28/287 2024-09-12T00:00:31.294 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 29/287 2024-09-12T00:00:31.295 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 30/287 2024-09-12T00:00:31.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 31/287 2024-09-12T00:00:31.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 32/287 2024-09-12T00:00:31.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 33/287 2024-09-12T00:00:31.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 34/287 2024-09-12T00:00:31.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 35/287 2024-09-12T00:00:31.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 36/287 2024-09-12T00:00:31.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T00:00:31.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T00:00:31.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T00:00:31.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T00:00:31.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T00:00:31.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T00:00:31.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T00:00:31.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T00:00:31.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T00:00:31.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T00:00:31.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T00:00:31.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T00:00:31.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T00:00:31.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T00:00:31.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T00:00:31.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T00:00:31.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T00:00:31.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T00:00:31.319 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T00:00:31.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T00:00:31.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T00:00:31.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T00:00:31.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T00:00:31.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T00:00:31.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T00:00:31.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T00:00:31.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T00:00:31.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T00:00:31.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T00:00:31.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T00:00:31.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T00:00:31.320 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T00:00:31.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T00:00:31.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T00:00:31.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T00:00:31.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:00:31.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T00:00:31.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T00:00:31.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T00:00:31.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T00:00:31.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T00:00:31.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T00:00:31.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T00:00:31.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T00:00:31.321 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T00:00:31.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T00:00:31.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T00:00:31.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T00:00:31.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T00:00:31.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T00:00:31.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T00:00:31.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T00:00:31.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T00:00:31.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T00:00:31.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T00:00:31.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T00:00:31.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T00:00:31.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T00:00:31.322 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T00:00:31.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T00:00:31.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T00:00:31.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T00:00:31.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T00:00:31.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T00:00:31.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T00:00:31.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T00:00:31.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T00:00:31.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T00:00:31.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T00:00:31.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T00:00:31.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T00:00:31.323 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T00:00:31.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T00:00:31.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T00:00:31.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T00:00:31.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T00:00:31.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T00:00:31.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T00:00:31.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T00:00:31.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T00:00:31.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T00:00:31.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T00:00:31.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T00:00:31.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T00:00:31.324 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T00:00:31.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T00:00:31.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T00:00:31.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T00:00:31.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T00:00:31.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T00:00:31.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T00:00:31.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T00:00:31.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T00:00:31.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T00:00:31.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T00:00:31.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T00:00:31.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T00:00:31.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T00:00:31.325 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T00:00:31.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T00:00:31.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T00:00:31.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T00:00:31.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T00:00:31.326 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T00:00:31.327 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T00:00:31.327 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T00:00:31.327 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T00:00:31.327 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T00:00:31.327 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T00:00:31.327 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T00:00:31.327 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T00:00:31.327 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T00:00:31.327 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T00:00:31.328 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T00:00:31.328 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T00:00:31.328 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T00:00:31.328 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T00:00:31.328 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T00:00:31.328 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T00:00:31.328 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T00:00:31.328 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T00:00:31.328 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T00:00:31.328 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T00:00:31.328 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T00:00:31.328 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T00:00:31.328 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T00:00:31.329 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T00:00:31.329 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T00:00:31.329 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T00:00:31.329 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T00:00:31.329 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T00:00:31.329 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T00:00:31.329 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T00:00:31.329 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T00:00:31.329 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T00:00:31.329 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T00:00:31.329 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T00:00:31.329 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T00:00:31.329 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T00:00:31.330 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T00:00:31.330 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T00:00:31.330 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T00:00:31.330 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T00:00:31.330 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T00:00:31.330 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T00:00:31.330 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T00:00:31.330 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T00:00:31.330 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T00:00:31.330 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T00:00:31.330 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T00:00:31.330 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T00:00:31.330 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T00:00:31.330 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T00:00:31.331 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T00:00:31.331 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T00:00:31.331 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T00:00:31.331 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T00:00:31.331 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T00:00:31.331 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T00:00:31.331 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T00:00:31.331 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T00:00:31.331 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T00:00:31.331 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T00:00:31.332 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T00:00:31.332 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T00:00:31.332 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T00:00:31.332 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T00:00:31.332 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T00:00:31.332 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T00:00:31.332 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T00:00:31.332 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T00:00:31.332 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T00:00:31.332 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T00:00:31.332 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T00:00:31.332 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T00:00:31.332 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T00:00:31.333 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T00:00:31.333 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T00:00:31.333 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T00:00:31.333 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T00:00:31.333 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T00:00:31.333 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T00:00:31.333 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T00:00:31.333 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T00:00:31.333 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T00:00:31.333 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T00:00:31.333 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T00:00:31.333 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T00:00:31.333 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T00:00:31.334 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T00:00:31.334 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T00:00:31.334 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T00:00:31.334 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T00:00:31.334 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T00:00:31.334 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T00:00:31.334 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T00:00:31.334 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T00:00:31.334 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T00:00:31.335 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T00:00:31.335 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T00:00:31.335 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T00:00:31.335 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T00:00:31.335 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T00:00:31.335 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T00:00:31.335 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T00:00:31.335 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T00:00:31.335 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 243/287 2024-09-12T00:00:31.335 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T00:00:31.335 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T00:00:31.335 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T00:00:31.335 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T00:00:31.335 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T00:00:31.336 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T00:00:31.336 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T00:00:31.336 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T00:00:31.336 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T00:00:31.336 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T00:00:31.336 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T00:00:31.336 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T00:00:31.336 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T00:00:31.336 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T00:00:31.336 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T00:00:31.336 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T00:00:31.336 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T00:00:31.336 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T00:00:31.337 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T00:00:31.337 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T00:00:31.337 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T00:00:31.337 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T00:00:31.337 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T00:00:31.337 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T00:00:31.337 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T00:00:31.337 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T00:00:31.337 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T00:00:31.337 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T00:00:31.337 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T00:00:31.337 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T00:00:31.337 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T00:00:31.337 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T00:00:31.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T00:00:31.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T00:00:31.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T00:00:31.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T00:00:31.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T00:00:31.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T00:00:31.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T00:00:31.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T00:00:31.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:00:31.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T00:00:31.338 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 286/287 2024-09-12T00:00:34.643 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:00:34.643 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:34.643 INFO:teuthology.orchestra.run.smithi170.stdout:Upgraded: 2024-09-12T00:00:34.643 INFO:teuthology.orchestra.run.smithi170.stdout: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.643 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.643 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-09-12T00:00:34.643 INFO:teuthology.orchestra.run.smithi170.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T00:00:34.644 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:00:34.644 INFO:teuthology.orchestra.run.smithi170.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T00:00:34.644 INFO:teuthology.orchestra.run.smithi170.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T00:00:34.644 INFO:teuthology.orchestra.run.smithi170.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T00:00:34.644 INFO:teuthology.orchestra.run.smithi170.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T00:00:34.644 INFO:teuthology.orchestra.run.smithi170.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T00:00:34.644 INFO:teuthology.orchestra.run.smithi170.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T00:00:34.644 INFO:teuthology.orchestra.run.smithi170.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T00:00:34.644 INFO:teuthology.orchestra.run.smithi170.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T00:00:34.644 INFO:teuthology.orchestra.run.smithi170.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T00:00:34.644 INFO:teuthology.orchestra.run.smithi170.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T00:00:34.644 INFO:teuthology.orchestra.run.smithi170.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T00:00:34.645 INFO:teuthology.orchestra.run.smithi170.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T00:00:34.645 INFO:teuthology.orchestra.run.smithi170.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T00:00:34.645 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:00:34.645 INFO:teuthology.orchestra.run.smithi170.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T00:00:34.645 INFO:teuthology.orchestra.run.smithi170.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T00:00:34.645 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.645 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.645 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.645 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.645 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:34.645 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.645 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.645 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.646 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:34.646 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:34.646 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:34.646 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:34.646 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:34.646 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.646 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.646 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:34.646 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.646 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.647 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.647 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:34.647 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:34.647 INFO:teuthology.orchestra.run.smithi170.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T00:00:34.647 INFO:teuthology.orchestra.run.smithi170.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T00:00:34.647 INFO:teuthology.orchestra.run.smithi170.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T00:00:34.647 INFO:teuthology.orchestra.run.smithi170.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T00:00:34.647 INFO:teuthology.orchestra.run.smithi170.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T00:00:34.647 INFO:teuthology.orchestra.run.smithi170.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T00:00:34.647 INFO:teuthology.orchestra.run.smithi170.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T00:00:34.647 INFO:teuthology.orchestra.run.smithi170.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T00:00:34.647 INFO:teuthology.orchestra.run.smithi170.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T00:00:34.648 INFO:teuthology.orchestra.run.smithi170.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T00:00:34.648 INFO:teuthology.orchestra.run.smithi170.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T00:00:34.648 INFO:teuthology.orchestra.run.smithi170.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T00:00:34.648 INFO:teuthology.orchestra.run.smithi170.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T00:00:34.648 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:00:34.648 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:00:34.648 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:00:34.648 INFO:teuthology.orchestra.run.smithi170.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:00:34.648 INFO:teuthology.orchestra.run.smithi170.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T00:00:34.648 INFO:teuthology.orchestra.run.smithi170.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T00:00:34.648 INFO:teuthology.orchestra.run.smithi170.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T00:00:34.648 INFO:teuthology.orchestra.run.smithi170.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T00:00:34.648 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:00:34.649 INFO:teuthology.orchestra.run.smithi170.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T00:00:34.649 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:00:34.649 INFO:teuthology.orchestra.run.smithi170.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T00:00:34.649 INFO:teuthology.orchestra.run.smithi170.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T00:00:34.649 INFO:teuthology.orchestra.run.smithi170.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T00:00:34.649 INFO:teuthology.orchestra.run.smithi170.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T00:00:34.649 INFO:teuthology.orchestra.run.smithi170.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T00:00:34.649 INFO:teuthology.orchestra.run.smithi170.stdout: guava-30.1-6.el9.noarch 2024-09-12T00:00:34.649 INFO:teuthology.orchestra.run.smithi170.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T00:00:34.649 INFO:teuthology.orchestra.run.smithi170.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T00:00:34.649 INFO:teuthology.orchestra.run.smithi170.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T00:00:34.649 INFO:teuthology.orchestra.run.smithi170.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T00:00:34.649 INFO:teuthology.orchestra.run.smithi170.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T00:00:34.649 INFO:teuthology.orchestra.run.smithi170.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T00:00:34.650 INFO:teuthology.orchestra.run.smithi170.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:00:34.650 INFO:teuthology.orchestra.run.smithi170.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:00:34.650 INFO:teuthology.orchestra.run.smithi170.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:00:34.650 INFO:teuthology.orchestra.run.smithi170.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T00:00:34.650 INFO:teuthology.orchestra.run.smithi170.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T00:00:34.650 INFO:teuthology.orchestra.run.smithi170.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T00:00:34.650 INFO:teuthology.orchestra.run.smithi170.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T00:00:34.650 INFO:teuthology.orchestra.run.smithi170.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T00:00:34.650 INFO:teuthology.orchestra.run.smithi170.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T00:00:34.650 INFO:teuthology.orchestra.run.smithi170.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T00:00:34.651 INFO:teuthology.orchestra.run.smithi170.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T00:00:34.651 INFO:teuthology.orchestra.run.smithi170.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T00:00:34.651 INFO:teuthology.orchestra.run.smithi170.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T00:00:34.651 INFO:teuthology.orchestra.run.smithi170.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T00:00:34.651 INFO:teuthology.orchestra.run.smithi170.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T00:00:34.651 INFO:teuthology.orchestra.run.smithi170.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T00:00:34.651 INFO:teuthology.orchestra.run.smithi170.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T00:00:34.651 INFO:teuthology.orchestra.run.smithi170.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T00:00:34.651 INFO:teuthology.orchestra.run.smithi170.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T00:00:34.651 INFO:teuthology.orchestra.run.smithi170.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T00:00:34.651 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:00:34.651 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:00:34.651 INFO:teuthology.orchestra.run.smithi170.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T00:00:34.651 INFO:teuthology.orchestra.run.smithi170.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T00:00:34.652 INFO:teuthology.orchestra.run.smithi170.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T00:00:34.652 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.652 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.652 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.652 INFO:teuthology.orchestra.run.smithi170.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T00:00:34.652 INFO:teuthology.orchestra.run.smithi170.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T00:00:34.652 INFO:teuthology.orchestra.run.smithi170.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T00:00:34.652 INFO:teuthology.orchestra.run.smithi170.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T00:00:34.652 INFO:teuthology.orchestra.run.smithi170.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T00:00:34.652 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:00:34.652 INFO:teuthology.orchestra.run.smithi170.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T00:00:34.654 INFO:teuthology.orchestra.run.smithi170.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T00:00:34.654 INFO:teuthology.orchestra.run.smithi170.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T00:00:34.654 INFO:teuthology.orchestra.run.smithi170.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T00:00:34.654 INFO:teuthology.orchestra.run.smithi170.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T00:00:34.654 INFO:teuthology.orchestra.run.smithi170.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T00:00:34.654 INFO:teuthology.orchestra.run.smithi170.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T00:00:34.654 INFO:teuthology.orchestra.run.smithi170.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T00:00:34.655 INFO:teuthology.orchestra.run.smithi170.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:00:34.655 INFO:teuthology.orchestra.run.smithi170.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T00:00:34.655 INFO:teuthology.orchestra.run.smithi170.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T00:00:34.655 INFO:teuthology.orchestra.run.smithi170.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T00:00:34.655 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:00:34.655 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:00:34.655 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:00:34.655 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.655 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.655 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:00:34.655 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.655 INFO:teuthology.orchestra.run.smithi170.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T00:00:34.655 INFO:teuthology.orchestra.run.smithi170.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T00:00:34.655 INFO:teuthology.orchestra.run.smithi170.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T00:00:34.656 INFO:teuthology.orchestra.run.smithi170.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T00:00:34.656 INFO:teuthology.orchestra.run.smithi170.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T00:00:34.656 INFO:teuthology.orchestra.run.smithi170.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T00:00:34.656 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:00:34.656 INFO:teuthology.orchestra.run.smithi170.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T00:00:34.656 INFO:teuthology.orchestra.run.smithi170.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T00:00:34.656 INFO:teuthology.orchestra.run.smithi170.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T00:00:34.656 INFO:teuthology.orchestra.run.smithi170.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T00:00:34.656 INFO:teuthology.orchestra.run.smithi170.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T00:00:34.656 INFO:teuthology.orchestra.run.smithi170.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T00:00:34.656 INFO:teuthology.orchestra.run.smithi170.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T00:00:34.656 INFO:teuthology.orchestra.run.smithi170.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T00:00:34.656 INFO:teuthology.orchestra.run.smithi170.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T00:00:34.657 INFO:teuthology.orchestra.run.smithi170.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T00:00:34.657 INFO:teuthology.orchestra.run.smithi170.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T00:00:34.657 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:00:34.657 INFO:teuthology.orchestra.run.smithi170.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:00:34.657 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:00:34.657 INFO:teuthology.orchestra.run.smithi170.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T00:00:34.657 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:00:34.657 INFO:teuthology.orchestra.run.smithi170.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T00:00:34.657 INFO:teuthology.orchestra.run.smithi170.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T00:00:34.658 INFO:teuthology.orchestra.run.smithi170.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T00:00:34.658 INFO:teuthology.orchestra.run.smithi170.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T00:00:34.658 INFO:teuthology.orchestra.run.smithi170.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T00:00:34.658 INFO:teuthology.orchestra.run.smithi170.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T00:00:34.658 INFO:teuthology.orchestra.run.smithi170.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T00:00:34.658 INFO:teuthology.orchestra.run.smithi170.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T00:00:34.658 INFO:teuthology.orchestra.run.smithi170.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T00:00:34.658 INFO:teuthology.orchestra.run.smithi170.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T00:00:34.658 INFO:teuthology.orchestra.run.smithi170.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T00:00:34.658 INFO:teuthology.orchestra.run.smithi170.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T00:00:34.658 INFO:teuthology.orchestra.run.smithi170.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T00:00:34.658 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:00:34.658 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:00:34.658 INFO:teuthology.orchestra.run.smithi170.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T00:00:34.659 INFO:teuthology.orchestra.run.smithi170.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T00:00:34.659 INFO:teuthology.orchestra.run.smithi170.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T00:00:34.659 INFO:teuthology.orchestra.run.smithi170.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T00:00:34.659 INFO:teuthology.orchestra.run.smithi170.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T00:00:34.659 INFO:teuthology.orchestra.run.smithi170.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T00:00:34.659 INFO:teuthology.orchestra.run.smithi170.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T00:00:34.659 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:00:34.659 INFO:teuthology.orchestra.run.smithi170.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T00:00:34.659 INFO:teuthology.orchestra.run.smithi170.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T00:00:34.659 INFO:teuthology.orchestra.run.smithi170.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T00:00:34.659 INFO:teuthology.orchestra.run.smithi170.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T00:00:34.659 INFO:teuthology.orchestra.run.smithi170.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T00:00:34.659 INFO:teuthology.orchestra.run.smithi170.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T00:00:34.660 INFO:teuthology.orchestra.run.smithi170.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T00:00:34.660 INFO:teuthology.orchestra.run.smithi170.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T00:00:34.660 INFO:teuthology.orchestra.run.smithi170.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T00:00:34.660 INFO:teuthology.orchestra.run.smithi170.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T00:00:34.660 INFO:teuthology.orchestra.run.smithi170.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T00:00:34.660 INFO:teuthology.orchestra.run.smithi170.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T00:00:34.660 INFO:teuthology.orchestra.run.smithi170.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T00:00:34.660 INFO:teuthology.orchestra.run.smithi170.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T00:00:34.660 INFO:teuthology.orchestra.run.smithi170.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T00:00:34.660 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:00:34.660 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:00:34.660 INFO:teuthology.orchestra.run.smithi170.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T00:00:34.660 INFO:teuthology.orchestra.run.smithi170.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T00:00:34.660 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:00:34.661 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:00:34.661 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:00:34.661 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:00:34.661 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.661 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.661 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.661 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:00:34.661 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:00:34.661 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:00:34.661 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:00:34.661 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:00:34.661 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:00:34.661 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:00:34.662 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:00:34.662 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:00:34.662 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:00:34.662 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:00:34.662 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:00:34.662 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:00:34.662 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:00:34.662 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:00:34.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:00:34.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:00:34.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:00:34.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:00:34.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:00:34.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:00:34.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:00:34.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:00:34.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:00:34.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:00:34.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:00:34.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:00:34.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:00:34.663 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:00:34.664 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:00:34.664 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:00:34.664 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:00:34.664 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:00:34.664 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:00:34.664 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:00:34.664 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:00:34.664 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:00:34.664 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.664 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.664 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:00:34.664 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:00:34.664 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:00:34.665 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.665 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:00:34.665 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:00:34.665 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:00:34.665 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:00:34.665 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:00:34.665 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:00:34.665 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:00:34.665 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:00:34.665 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:00:34.665 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:00:34.665 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:00:34.665 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:00:34.665 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:00:34.666 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:00:34.666 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.666 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.666 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:34.666 INFO:teuthology.orchestra.run.smithi170.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:00:34.666 INFO:teuthology.orchestra.run.smithi170.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T00:00:34.666 INFO:teuthology.orchestra.run.smithi170.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T00:00:34.666 INFO:teuthology.orchestra.run.smithi170.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T00:00:34.666 INFO:teuthology.orchestra.run.smithi170.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T00:00:34.666 INFO:teuthology.orchestra.run.smithi170.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:00:34.666 INFO:teuthology.orchestra.run.smithi170.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T00:00:34.666 INFO:teuthology.orchestra.run.smithi170.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:00:34.666 INFO:teuthology.orchestra.run.smithi170.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T00:00:34.666 INFO:teuthology.orchestra.run.smithi170.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T00:00:34.667 INFO:teuthology.orchestra.run.smithi170.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T00:00:34.667 INFO:teuthology.orchestra.run.smithi170.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T00:00:34.667 INFO:teuthology.orchestra.run.smithi170.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T00:00:34.667 INFO:teuthology.orchestra.run.smithi170.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T00:00:34.667 INFO:teuthology.orchestra.run.smithi170.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T00:00:34.667 INFO:teuthology.orchestra.run.smithi170.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T00:00:34.667 INFO:teuthology.orchestra.run.smithi170.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T00:00:34.667 INFO:teuthology.orchestra.run.smithi170.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T00:00:34.667 INFO:teuthology.orchestra.run.smithi170.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T00:00:34.667 INFO:teuthology.orchestra.run.smithi170.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T00:00:34.667 INFO:teuthology.orchestra.run.smithi170.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T00:00:34.667 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:00:34.668 INFO:teuthology.orchestra.run.smithi170.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T00:00:34.668 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:34.668 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-09-12T00:00:35.069 DEBUG:teuthology.parallel:result is None 2024-09-12T00:00:38.463 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:00:38.464 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 1/287 2024-09-12T00:00:38.464 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2/287 2024-09-12T00:00:38.464 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 3/287 2024-09-12T00:00:38.464 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 4/287 2024-09-12T00:00:38.464 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 5/287 2024-09-12T00:00:38.464 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 6/287 2024-09-12T00:00:38.464 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 7/287 2024-09-12T00:00:38.464 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 8/287 2024-09-12T00:00:38.464 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 9/287 2024-09-12T00:00:38.464 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:00:38.464 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:00:38.464 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:00:38.464 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 13/287 2024-09-12T00:00:38.465 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 14/287 2024-09-12T00:00:38.465 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 15/287 2024-09-12T00:00:38.465 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 16/287 2024-09-12T00:00:38.465 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 17/287 2024-09-12T00:00:38.465 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 18/287 2024-09-12T00:00:38.465 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 19/287 2024-09-12T00:00:38.465 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 20/287 2024-09-12T00:00:38.465 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 21/287 2024-09-12T00:00:38.465 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 22/287 2024-09-12T00:00:38.465 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 23/287 2024-09-12T00:00:38.465 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:00:38.465 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 25/287 2024-09-12T00:00:38.465 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 26/287 2024-09-12T00:00:38.466 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 27/287 2024-09-12T00:00:38.466 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 28/287 2024-09-12T00:00:38.466 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 29/287 2024-09-12T00:00:38.488 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 30/287 2024-09-12T00:00:38.488 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 31/287 2024-09-12T00:00:38.488 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 32/287 2024-09-12T00:00:38.488 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 33/287 2024-09-12T00:00:38.488 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 34/287 2024-09-12T00:00:38.488 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 35/287 2024-09-12T00:00:38.488 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 36/287 2024-09-12T00:00:38.489 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T00:00:38.489 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T00:00:38.489 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T00:00:38.489 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T00:00:38.489 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T00:00:38.489 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T00:00:38.489 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T00:00:38.489 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T00:00:38.489 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T00:00:38.489 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T00:00:38.489 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T00:00:38.489 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T00:00:38.489 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T00:00:38.490 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T00:00:38.490 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T00:00:38.490 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T00:00:38.490 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T00:00:38.490 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T00:00:38.490 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T00:00:38.490 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T00:00:38.490 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T00:00:38.490 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T00:00:38.490 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T00:00:38.490 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T00:00:38.490 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T00:00:38.490 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T00:00:38.491 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T00:00:38.491 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T00:00:38.491 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T00:00:38.491 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T00:00:38.491 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T00:00:38.491 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T00:00:38.491 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T00:00:38.491 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T00:00:38.491 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T00:00:38.491 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:00:38.491 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T00:00:38.491 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T00:00:38.491 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T00:00:38.491 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T00:00:38.492 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T00:00:38.492 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T00:00:38.492 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T00:00:38.492 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T00:00:38.492 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T00:00:38.492 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T00:00:38.492 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T00:00:38.492 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T00:00:38.492 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T00:00:38.492 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T00:00:38.492 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T00:00:38.492 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T00:00:38.492 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T00:00:38.493 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T00:00:38.493 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T00:00:38.493 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T00:00:38.493 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T00:00:38.493 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T00:00:38.493 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T00:00:38.493 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T00:00:38.493 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T00:00:38.493 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T00:00:38.493 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T00:00:38.493 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T00:00:38.493 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T00:00:38.493 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T00:00:38.493 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T00:00:38.494 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T00:00:38.494 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T00:00:38.494 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T00:00:38.494 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T00:00:38.494 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T00:00:38.494 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T00:00:38.494 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T00:00:38.494 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T00:00:38.494 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T00:00:38.494 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T00:00:38.494 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T00:00:38.494 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T00:00:38.494 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T00:00:38.495 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T00:00:38.495 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T00:00:38.495 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T00:00:38.495 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T00:00:38.495 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T00:00:38.495 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T00:00:38.495 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T00:00:38.495 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T00:00:38.495 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T00:00:38.495 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T00:00:38.495 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T00:00:38.495 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T00:00:38.495 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T00:00:38.496 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T00:00:38.496 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T00:00:38.496 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T00:00:38.496 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T00:00:38.496 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T00:00:38.496 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T00:00:38.496 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T00:00:38.496 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T00:00:38.496 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T00:00:38.496 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T00:00:38.496 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T00:00:38.496 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T00:00:38.496 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T00:00:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T00:00:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T00:00:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T00:00:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T00:00:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T00:00:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T00:00:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T00:00:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T00:00:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T00:00:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T00:00:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T00:00:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T00:00:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T00:00:38.497 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T00:00:38.498 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T00:00:38.498 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T00:00:38.498 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T00:00:38.498 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T00:00:38.498 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T00:00:38.498 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T00:00:38.498 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T00:00:38.498 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T00:00:38.498 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T00:00:38.498 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T00:00:38.498 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T00:00:38.498 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T00:00:38.498 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T00:00:38.499 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T00:00:38.499 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T00:00:38.499 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T00:00:38.499 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T00:00:38.499 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T00:00:38.499 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T00:00:38.499 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T00:00:38.499 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T00:00:38.499 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T00:00:38.499 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T00:00:38.499 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T00:00:38.499 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T00:00:38.499 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T00:00:38.499 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T00:00:38.500 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T00:00:38.500 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T00:00:38.500 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T00:00:38.500 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T00:00:38.500 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T00:00:38.500 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T00:00:38.500 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T00:00:38.500 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T00:00:38.500 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T00:00:38.500 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T00:00:38.500 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T00:00:38.500 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T00:00:38.500 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T00:00:38.501 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T00:00:38.501 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T00:00:38.501 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T00:00:38.501 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T00:00:38.501 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T00:00:38.501 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T00:00:38.501 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T00:00:38.501 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T00:00:38.501 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T00:00:38.501 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T00:00:38.501 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T00:00:38.501 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T00:00:38.501 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T00:00:38.501 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T00:00:38.502 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T00:00:38.502 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T00:00:38.502 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T00:00:38.502 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T00:00:38.502 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T00:00:38.502 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T00:00:38.502 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T00:00:38.502 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T00:00:38.502 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T00:00:38.502 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T00:00:38.502 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T00:00:38.502 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T00:00:38.502 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T00:00:38.503 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T00:00:38.503 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T00:00:38.503 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T00:00:38.503 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T00:00:38.503 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T00:00:38.503 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T00:00:38.503 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T00:00:38.503 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T00:00:38.503 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T00:00:38.503 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T00:00:38.503 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T00:00:38.503 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T00:00:38.503 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T00:00:38.503 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T00:00:38.504 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T00:00:38.504 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T00:00:38.504 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T00:00:38.504 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T00:00:38.504 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T00:00:38.504 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 243/287 2024-09-12T00:00:38.504 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T00:00:38.504 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T00:00:38.504 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T00:00:38.504 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T00:00:38.504 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T00:00:38.504 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T00:00:38.504 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T00:00:38.505 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T00:00:38.505 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T00:00:38.505 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T00:00:38.505 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T00:00:38.505 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T00:00:38.505 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T00:00:38.505 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T00:00:38.505 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T00:00:38.505 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T00:00:38.505 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T00:00:38.505 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T00:00:38.505 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T00:00:38.505 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T00:00:38.506 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T00:00:38.506 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T00:00:38.506 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T00:00:38.506 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T00:00:38.506 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T00:00:38.506 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T00:00:38.506 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T00:00:38.506 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T00:00:38.506 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T00:00:38.506 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T00:00:38.506 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T00:00:38.506 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T00:00:38.506 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T00:00:38.506 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T00:00:38.507 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T00:00:38.507 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T00:00:38.507 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T00:00:38.507 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T00:00:38.507 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T00:00:38.507 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T00:00:38.507 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:00:38.507 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T00:00:38.507 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 286/287 2024-09-12T00:00:42.027 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:00:42.027 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:42.027 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2024-09-12T00:00:42.027 INFO:teuthology.orchestra.run.smithi067.stdout: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.027 INFO:teuthology.orchestra.run.smithi067.stdout: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.027 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-09-12T00:00:42.028 INFO:teuthology.orchestra.run.smithi067.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T00:00:42.028 INFO:teuthology.orchestra.run.smithi067.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:00:42.028 INFO:teuthology.orchestra.run.smithi067.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T00:00:42.028 INFO:teuthology.orchestra.run.smithi067.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T00:00:42.028 INFO:teuthology.orchestra.run.smithi067.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T00:00:42.028 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T00:00:42.028 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T00:00:42.028 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T00:00:42.028 INFO:teuthology.orchestra.run.smithi067.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T00:00:42.028 INFO:teuthology.orchestra.run.smithi067.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T00:00:42.028 INFO:teuthology.orchestra.run.smithi067.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T00:00:42.028 INFO:teuthology.orchestra.run.smithi067.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T00:00:42.028 INFO:teuthology.orchestra.run.smithi067.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T00:00:42.029 INFO:teuthology.orchestra.run.smithi067.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T00:00:42.029 INFO:teuthology.orchestra.run.smithi067.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T00:00:42.029 INFO:teuthology.orchestra.run.smithi067.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:00:42.029 INFO:teuthology.orchestra.run.smithi067.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T00:00:42.029 INFO:teuthology.orchestra.run.smithi067.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T00:00:42.029 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.029 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.029 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.029 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.029 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-grafana-dashboards-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:42.029 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-immutable-object-cache-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.029 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.030 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.030 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:42.030 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:42.030 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:42.030 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:42.030 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:42.030 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.030 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.030 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:42.030 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.030 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.030 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.030 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:42.031 INFO:teuthology.orchestra.run.smithi067.stdout: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:00:42.031 INFO:teuthology.orchestra.run.smithi067.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T00:00:42.031 INFO:teuthology.orchestra.run.smithi067.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T00:00:42.031 INFO:teuthology.orchestra.run.smithi067.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T00:00:42.031 INFO:teuthology.orchestra.run.smithi067.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T00:00:42.031 INFO:teuthology.orchestra.run.smithi067.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T00:00:42.031 INFO:teuthology.orchestra.run.smithi067.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T00:00:42.031 INFO:teuthology.orchestra.run.smithi067.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T00:00:42.031 INFO:teuthology.orchestra.run.smithi067.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T00:00:42.031 INFO:teuthology.orchestra.run.smithi067.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T00:00:42.031 INFO:teuthology.orchestra.run.smithi067.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T00:00:42.031 INFO:teuthology.orchestra.run.smithi067.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T00:00:42.031 INFO:teuthology.orchestra.run.smithi067.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T00:00:42.031 INFO:teuthology.orchestra.run.smithi067.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T00:00:42.032 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:00:42.032 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:00:42.032 INFO:teuthology.orchestra.run.smithi067.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:00:42.032 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:00:42.032 INFO:teuthology.orchestra.run.smithi067.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T00:00:42.032 INFO:teuthology.orchestra.run.smithi067.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T00:00:42.032 INFO:teuthology.orchestra.run.smithi067.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T00:00:42.032 INFO:teuthology.orchestra.run.smithi067.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T00:00:42.032 INFO:teuthology.orchestra.run.smithi067.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:00:42.032 INFO:teuthology.orchestra.run.smithi067.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T00:00:42.032 INFO:teuthology.orchestra.run.smithi067.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:00:42.032 INFO:teuthology.orchestra.run.smithi067.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T00:00:42.032 INFO:teuthology.orchestra.run.smithi067.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T00:00:42.033 INFO:teuthology.orchestra.run.smithi067.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T00:00:42.033 INFO:teuthology.orchestra.run.smithi067.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T00:00:42.033 INFO:teuthology.orchestra.run.smithi067.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T00:00:42.033 INFO:teuthology.orchestra.run.smithi067.stdout: guava-30.1-6.el9.noarch 2024-09-12T00:00:42.033 INFO:teuthology.orchestra.run.smithi067.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T00:00:42.033 INFO:teuthology.orchestra.run.smithi067.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T00:00:42.033 INFO:teuthology.orchestra.run.smithi067.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T00:00:42.033 INFO:teuthology.orchestra.run.smithi067.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T00:00:42.033 INFO:teuthology.orchestra.run.smithi067.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T00:00:42.033 INFO:teuthology.orchestra.run.smithi067.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T00:00:42.033 INFO:teuthology.orchestra.run.smithi067.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:00:42.033 INFO:teuthology.orchestra.run.smithi067.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:00:42.033 INFO:teuthology.orchestra.run.smithi067.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:00:42.034 INFO:teuthology.orchestra.run.smithi067.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T00:00:42.034 INFO:teuthology.orchestra.run.smithi067.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T00:00:42.034 INFO:teuthology.orchestra.run.smithi067.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T00:00:42.034 INFO:teuthology.orchestra.run.smithi067.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T00:00:42.034 INFO:teuthology.orchestra.run.smithi067.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T00:00:42.034 INFO:teuthology.orchestra.run.smithi067.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T00:00:42.034 INFO:teuthology.orchestra.run.smithi067.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T00:00:42.034 INFO:teuthology.orchestra.run.smithi067.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T00:00:42.034 INFO:teuthology.orchestra.run.smithi067.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T00:00:42.034 INFO:teuthology.orchestra.run.smithi067.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T00:00:42.034 INFO:teuthology.orchestra.run.smithi067.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T00:00:42.034 INFO:teuthology.orchestra.run.smithi067.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T00:00:42.034 INFO:teuthology.orchestra.run.smithi067.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T00:00:42.035 INFO:teuthology.orchestra.run.smithi067.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T00:00:42.035 INFO:teuthology.orchestra.run.smithi067.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T00:00:42.035 INFO:teuthology.orchestra.run.smithi067.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T00:00:42.035 INFO:teuthology.orchestra.run.smithi067.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T00:00:42.035 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:00:42.035 INFO:teuthology.orchestra.run.smithi067.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:00:42.035 INFO:teuthology.orchestra.run.smithi067.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T00:00:42.035 INFO:teuthology.orchestra.run.smithi067.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T00:00:42.035 INFO:teuthology.orchestra.run.smithi067.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T00:00:42.036 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.036 INFO:teuthology.orchestra.run.smithi067.stdout: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.036 INFO:teuthology.orchestra.run.smithi067.stdout: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.036 INFO:teuthology.orchestra.run.smithi067.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T00:00:42.036 INFO:teuthology.orchestra.run.smithi067.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T00:00:42.036 INFO:teuthology.orchestra.run.smithi067.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T00:00:42.036 INFO:teuthology.orchestra.run.smithi067.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T00:00:42.036 INFO:teuthology.orchestra.run.smithi067.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T00:00:42.036 INFO:teuthology.orchestra.run.smithi067.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:00:42.036 INFO:teuthology.orchestra.run.smithi067.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T00:00:42.036 INFO:teuthology.orchestra.run.smithi067.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T00:00:42.036 INFO:teuthology.orchestra.run.smithi067.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T00:00:42.036 INFO:teuthology.orchestra.run.smithi067.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T00:00:42.037 INFO:teuthology.orchestra.run.smithi067.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T00:00:42.037 INFO:teuthology.orchestra.run.smithi067.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T00:00:42.037 INFO:teuthology.orchestra.run.smithi067.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T00:00:42.037 INFO:teuthology.orchestra.run.smithi067.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T00:00:42.037 INFO:teuthology.orchestra.run.smithi067.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:00:42.037 INFO:teuthology.orchestra.run.smithi067.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T00:00:42.037 INFO:teuthology.orchestra.run.smithi067.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T00:00:42.037 INFO:teuthology.orchestra.run.smithi067.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T00:00:42.037 INFO:teuthology.orchestra.run.smithi067.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:00:42.037 INFO:teuthology.orchestra.run.smithi067.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:00:42.037 INFO:teuthology.orchestra.run.smithi067.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:00:42.037 INFO:teuthology.orchestra.run.smithi067.stdout: librados-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.037 INFO:teuthology.orchestra.run.smithi067.stdout: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.037 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:00:42.038 INFO:teuthology.orchestra.run.smithi067.stdout: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.038 INFO:teuthology.orchestra.run.smithi067.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T00:00:42.038 INFO:teuthology.orchestra.run.smithi067.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T00:00:42.038 INFO:teuthology.orchestra.run.smithi067.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T00:00:42.038 INFO:teuthology.orchestra.run.smithi067.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T00:00:42.038 INFO:teuthology.orchestra.run.smithi067.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T00:00:42.038 INFO:teuthology.orchestra.run.smithi067.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T00:00:42.038 INFO:teuthology.orchestra.run.smithi067.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:00:42.038 INFO:teuthology.orchestra.run.smithi067.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T00:00:42.038 INFO:teuthology.orchestra.run.smithi067.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T00:00:42.039 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T00:00:42.039 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T00:00:42.039 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T00:00:42.039 INFO:teuthology.orchestra.run.smithi067.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T00:00:42.039 INFO:teuthology.orchestra.run.smithi067.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T00:00:42.039 INFO:teuthology.orchestra.run.smithi067.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T00:00:42.039 INFO:teuthology.orchestra.run.smithi067.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T00:00:42.039 INFO:teuthology.orchestra.run.smithi067.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T00:00:42.039 INFO:teuthology.orchestra.run.smithi067.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T00:00:42.039 INFO:teuthology.orchestra.run.smithi067.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:00:42.040 INFO:teuthology.orchestra.run.smithi067.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:00:42.040 INFO:teuthology.orchestra.run.smithi067.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:00:42.040 INFO:teuthology.orchestra.run.smithi067.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T00:00:42.040 INFO:teuthology.orchestra.run.smithi067.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:00:42.040 INFO:teuthology.orchestra.run.smithi067.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T00:00:42.040 INFO:teuthology.orchestra.run.smithi067.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T00:00:42.040 INFO:teuthology.orchestra.run.smithi067.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T00:00:42.040 INFO:teuthology.orchestra.run.smithi067.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T00:00:42.040 INFO:teuthology.orchestra.run.smithi067.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T00:00:42.040 INFO:teuthology.orchestra.run.smithi067.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T00:00:42.040 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T00:00:42.041 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T00:00:42.041 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T00:00:42.041 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T00:00:42.041 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T00:00:42.041 INFO:teuthology.orchestra.run.smithi067.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T00:00:42.041 INFO:teuthology.orchestra.run.smithi067.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T00:00:42.041 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:00:42.041 INFO:teuthology.orchestra.run.smithi067.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:00:42.041 INFO:teuthology.orchestra.run.smithi067.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T00:00:42.041 INFO:teuthology.orchestra.run.smithi067.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T00:00:42.041 INFO:teuthology.orchestra.run.smithi067.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T00:00:42.041 INFO:teuthology.orchestra.run.smithi067.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T00:00:42.041 INFO:teuthology.orchestra.run.smithi067.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T00:00:42.041 INFO:teuthology.orchestra.run.smithi067.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T00:00:42.042 INFO:teuthology.orchestra.run.smithi067.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T00:00:42.042 INFO:teuthology.orchestra.run.smithi067.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:00:42.042 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T00:00:42.042 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T00:00:42.042 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T00:00:42.042 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T00:00:42.042 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T00:00:42.042 INFO:teuthology.orchestra.run.smithi067.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T00:00:42.043 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T00:00:42.043 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T00:00:42.043 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T00:00:42.043 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T00:00:42.043 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T00:00:42.043 INFO:teuthology.orchestra.run.smithi067.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T00:00:42.043 INFO:teuthology.orchestra.run.smithi067.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T00:00:42.043 INFO:teuthology.orchestra.run.smithi067.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T00:00:42.043 INFO:teuthology.orchestra.run.smithi067.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T00:00:42.043 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:00:42.043 INFO:teuthology.orchestra.run.smithi067.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:00:42.044 INFO:teuthology.orchestra.run.smithi067.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T00:00:42.044 INFO:teuthology.orchestra.run.smithi067.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T00:00:42.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:00:42.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:00:42.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:00:42.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:00:42.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:00:42.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:00:42.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:00:42.044 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:00:42.045 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:00:42.045 INFO:teuthology.orchestra.run.smithi067.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:00:42.045 INFO:teuthology.orchestra.run.smithi067.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:00:42.045 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:00:42.045 INFO:teuthology.orchestra.run.smithi067.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:00:42.045 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:00:42.045 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:00:42.045 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:00:42.045 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:00:42.045 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:00:42.045 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:00:42.045 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:00:42.045 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:00:42.046 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:00:42.046 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:00:42.046 INFO:teuthology.orchestra.run.smithi067.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:00:42.046 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:00:42.046 INFO:teuthology.orchestra.run.smithi067.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:00:42.046 INFO:teuthology.orchestra.run.smithi067.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:00:42.046 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:00:42.046 INFO:teuthology.orchestra.run.smithi067.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:00:42.046 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:00:42.046 INFO:teuthology.orchestra.run.smithi067.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:00:42.046 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:00:42.046 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:00:42.046 INFO:teuthology.orchestra.run.smithi067.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:00:42.046 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:00:42.047 INFO:teuthology.orchestra.run.smithi067.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:00:42.047 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:00:42.047 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:00:42.047 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:00:42.047 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:00:42.047 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:00:42.047 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.047 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.047 INFO:teuthology.orchestra.run.smithi067.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:00:42.047 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:00:42.047 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:00:42.047 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.047 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:00:42.048 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:00:42.048 INFO:teuthology.orchestra.run.smithi067.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:00:42.048 INFO:teuthology.orchestra.run.smithi067.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:00:42.048 INFO:teuthology.orchestra.run.smithi067.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:00:42.048 INFO:teuthology.orchestra.run.smithi067.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:00:42.048 INFO:teuthology.orchestra.run.smithi067.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:00:42.048 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:00:42.048 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:00:42.048 INFO:teuthology.orchestra.run.smithi067.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:00:42.048 INFO:teuthology.orchestra.run.smithi067.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:00:42.048 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:00:42.048 INFO:teuthology.orchestra.run.smithi067.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:00:42.048 INFO:teuthology.orchestra.run.smithi067.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:00:42.048 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.049 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.049 INFO:teuthology.orchestra.run.smithi067.stdout: rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:00:42.049 INFO:teuthology.orchestra.run.smithi067.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:00:42.049 INFO:teuthology.orchestra.run.smithi067.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T00:00:42.049 INFO:teuthology.orchestra.run.smithi067.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T00:00:42.049 INFO:teuthology.orchestra.run.smithi067.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T00:00:42.049 INFO:teuthology.orchestra.run.smithi067.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T00:00:42.049 INFO:teuthology.orchestra.run.smithi067.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:00:42.049 INFO:teuthology.orchestra.run.smithi067.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T00:00:42.049 INFO:teuthology.orchestra.run.smithi067.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:00:42.049 INFO:teuthology.orchestra.run.smithi067.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T00:00:42.049 INFO:teuthology.orchestra.run.smithi067.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T00:00:42.049 INFO:teuthology.orchestra.run.smithi067.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T00:00:42.049 INFO:teuthology.orchestra.run.smithi067.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T00:00:42.050 INFO:teuthology.orchestra.run.smithi067.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T00:00:42.050 INFO:teuthology.orchestra.run.smithi067.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T00:00:42.050 INFO:teuthology.orchestra.run.smithi067.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T00:00:42.050 INFO:teuthology.orchestra.run.smithi067.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T00:00:42.050 INFO:teuthology.orchestra.run.smithi067.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T00:00:42.050 INFO:teuthology.orchestra.run.smithi067.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T00:00:42.050 INFO:teuthology.orchestra.run.smithi067.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T00:00:42.050 INFO:teuthology.orchestra.run.smithi067.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T00:00:42.050 INFO:teuthology.orchestra.run.smithi067.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T00:00:42.050 INFO:teuthology.orchestra.run.smithi067.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:00:42.051 INFO:teuthology.orchestra.run.smithi067.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T00:00:42.051 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:42.051 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-09-12T00:00:42.595 DEBUG:teuthology.parallel:result is None 2024-09-12T00:00:42.596 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:00:42.766 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:00:42.840 INFO:teuthology.orchestra.run.smithi067.stdout:19.3.0-4753.gd011c522.el9 2024-09-12T00:00:42.841 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753.gd011c522.el9 2024-09-12T00:00:42.841 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753.gd011c522 is installed. 2024-09-12T00:00:42.843 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:00:42.996 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:00:43.090 INFO:teuthology.orchestra.run.smithi170.stdout:19.3.0-4753.gd011c522.el9 2024-09-12T00:00:43.090 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753.gd011c522.el9 2024-09-12T00:00:43.090 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753.gd011c522 is installed. 2024-09-12T00:00:43.092 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:00:43.092 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:00:43.092 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:00:43.139 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:00:43.139 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:00:43.184 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:00:43.184 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:00:43.184 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:00:43.228 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:00:43.312 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:00:43.312 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:00:43.352 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:00:43.431 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:00:43.431 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:00:43.431 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:00:43.474 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:00:43.554 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:00:43.554 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:00:43.593 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:00:43.673 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:00:43.673 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:00:43.673 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:00:43.712 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:00:43.792 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:00:43.792 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:00:43.830 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:00:43.908 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:00:44.016 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:00:44.017 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /var/log/ceph 2024-09-12T00:00:44.020 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /var/log/ceph 2024-09-12T00:00:44.059 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:00:44.059 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:00:44.102 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:00:44.141 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:00:44.141 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:00:44.182 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:00:44.232 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:00:44.232 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:00:44.232 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901823', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7901823', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'rgw': {'compression type': 'random', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi067.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKHq3fo4HPSTxga0nZLkfJBk7D2ScsgkXBbOCxCqZ0Spd/82qDbbwuKqX+mJZ5Shkqrqgw6lUtw7z5iMwxIldOU=', 'smithi170.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBInzHIdKeC10aXC4CTgrejOXs2kiGfLM91KZNVEQmcbOL9ryoUCISn9nImjrVq7daQgvAlFLibPSzrvgNjPr12U='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:00:44.237 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:00:44.262 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:00:44.292 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:00:44.335 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:00:44.374 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:00:44.375 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:00:44.447 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:00:44.448 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 2024-09-12T00:00:44.518 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:00:44.518 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:00:44.518 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-12T00:00:44.518 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:00:44.518 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:00:44.518 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-12 00:00:29.916997760 +0000 2024-09-12T00:00:44.518 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-11 23:58:03.478465346 +0000 2024-09-12T00:00:44.519 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-11 23:58:03.478465346 +0000 2024-09-12T00:00:44.519 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-11 23:58:03.478465346 +0000 2024-09-12T00:00:44.519 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:00:44.596 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-12T00:00:44.596 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-12T00:00:44.597 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000257028 s, 2.0 MB/s 2024-09-12T00:00:44.598 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:00:44.668 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 2024-09-12T00:00:44.738 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:00:44.738 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:00:44.738 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T00:00:44.738 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:00:44.738 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:00:44.738 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-12 00:00:29.917997737 +0000 2024-09-12T00:00:44.739 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-11 23:58:03.808457815 +0000 2024-09-12T00:00:44.739 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-11 23:58:03.808457815 +0000 2024-09-12T00:00:44.739 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-11 23:58:03.808457815 +0000 2024-09-12T00:00:44.739 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:00:44.817 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-12T00:00:44.818 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-12T00:00:44.818 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000225627 s, 2.3 MB/s 2024-09-12T00:00:44.819 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:00:44.889 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 2024-09-12T00:00:44.959 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:00:44.959 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:00:44.959 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T00:00:44.959 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:00:44.959 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:00:44.959 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-12 00:00:29.917997737 +0000 2024-09-12T00:00:44.959 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-11 23:58:04.203448801 +0000 2024-09-12T00:00:44.959 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-11 23:58:04.203448801 +0000 2024-09-12T00:00:44.959 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-11 23:58:04.203448801 +0000 2024-09-12T00:00:44.960 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:00:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-12T00:00:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-12T00:00:45.038 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000225713 s, 2.3 MB/s 2024-09-12T00:00:45.039 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:00:45.110 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 2024-09-12T00:00:45.180 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:00:45.180 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:00:45.180 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T00:00:45.180 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:00:45.180 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:00:45.181 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2024-09-12 00:00:29.918997714 +0000 2024-09-12T00:00:45.181 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2024-09-11 23:58:04.538441156 +0000 2024-09-12T00:00:45.181 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2024-09-11 23:58:04.538441156 +0000 2024-09-12T00:00:45.181 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: 2024-09-11 23:58:04.538441156 +0000 2024-09-12T00:00:45.181 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:00:45.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2024-09-12T00:00:45.262 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2024-09-12T00:00:45.262 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000227012 s, 2.3 MB/s 2024-09-12T00:00:45.262 DEBUG:teuthology.orchestra.run.smithi067:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:00:45.333 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:00:45.333 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:00:45.333 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:00:45.366 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:00:45.367 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2024-09-12T00:00:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:00:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:00:45.439 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 669 Links: 1 2024-09-12T00:00:45.439 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:00:45.439 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:00:45.439 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-12 00:00:22.565539297 +0000 2024-09-12T00:00:45.439 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-11 23:57:58.049460068 +0000 2024-09-12T00:00:45.439 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-11 23:57:58.049460068 +0000 2024-09-12T00:00:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-11 23:57:58.049460068 +0000 2024-09-12T00:00:45.439 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:00:45.519 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-12T00:00:45.519 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-12T00:00:45.520 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000108944 s, 4.7 MB/s 2024-09-12T00:00:45.521 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:00:45.592 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2024-09-12T00:00:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:00:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:00:45.662 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-09-12T00:00:45.662 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:00:45.662 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:00:45.662 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-12 00:00:22.566539275 +0000 2024-09-12T00:00:45.662 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-11 23:57:58.366453044 +0000 2024-09-12T00:00:45.662 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-11 23:57:58.366453044 +0000 2024-09-12T00:00:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-11 23:57:58.366453044 +0000 2024-09-12T00:00:45.663 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:00:45.739 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-12T00:00:45.739 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-12T00:00:45.739 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000101337 s, 5.1 MB/s 2024-09-12T00:00:45.741 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:00:45.811 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2024-09-12T00:00:45.880 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:00:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:00:45.881 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-12T00:00:45.881 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:00:45.881 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:00:45.881 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-12 00:00:22.566539275 +0000 2024-09-12T00:00:45.881 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-11 23:57:58.688445910 +0000 2024-09-12T00:00:45.881 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-11 23:57:58.688445910 +0000 2024-09-12T00:00:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-11 23:57:58.688445910 +0000 2024-09-12T00:00:45.882 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:00:45.961 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-12T00:00:46.014 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-12T00:00:46.015 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000102888 s, 5.0 MB/s 2024-09-12T00:00:46.016 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:00:46.096 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2024-09-12T00:00:46.164 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:00:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:00:46.165 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 726 Links: 1 2024-09-12T00:00:46.165 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:00:46.165 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:00:46.165 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-09-12 00:00:22.566539275 +0000 2024-09-12T00:00:46.165 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-09-11 23:57:59.021438532 +0000 2024-09-12T00:00:46.165 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-09-11 23:57:59.021438532 +0000 2024-09-12T00:00:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-09-11 23:57:59.021438532 +0000 2024-09-12T00:00:46.165 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:00:46.242 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-09-12T00:00:46.242 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-09-12T00:00:46.242 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 8.221e-05 s, 6.2 MB/s 2024-09-12T00:00:46.243 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:00:46.312 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:00:46.313 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:00:46.313 INFO:tasks.ceph:Generating config... 2024-09-12T00:00:46.314 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T00:00:46.314 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T00:00:46.314 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T00:00:46.314 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T00:00:46.314 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T00:00:46.314 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:00:46.314 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-12T00:00:46.315 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-12T00:00:46.315 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T00:00:46.315 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T00:00:46.315 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T00:00:46.315 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T00:00:46.315 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T00:00:46.315 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T00:00:46.315 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T00:00:46.315 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T00:00:46.315 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T00:00:46.315 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T00:00:46.316 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T00:00:46.316 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-09-12T00:00:46.316 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:00:46.316 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:00:46.316 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:00:46.316 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:00:46.316 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:00:46.316 INFO:tasks.ceph:[mon] lockdep = True 2024-09-12T00:00:46.316 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:00:46.316 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:00:46.316 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:00:46.316 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:00:46.316 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:00:46.317 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:00:46.317 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:00:46.317 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:00:46.317 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T00:00:46.317 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:00:46.317 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:00:46.317 INFO:tasks.ceph:[osd] lockdep = True 2024-09-12T00:00:46.317 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:00:46.317 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:00:46.317 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:00:46.317 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:00:46.317 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:00:46.317 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T00:00:46.318 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:00:46.318 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:00:46.389 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:00:46.392 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:00:46.455 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:00:46.498 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.67'), ('mon.c', '[v2:172.21.15.67:3301,v1:172.21.15.67:6790]'), ('mon.b', '172.21.15.170')] 2024-09-12T00:00:46.499 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790],172.21.15.170', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T00:00:46.500 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:00:46.500 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:00:46.574 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.67 --addv c '[v2:172.21.15.67:3301,v1:172.21.15.67:6790]' --add b 172.21.15.170 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:00:46.677 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:00:46.678 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:00:46.679 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:00:46.679 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: generated fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:00:46.679 INFO:teuthology.orchestra.run.smithi067.stdout:setting min_mon_release = quincy 2024-09-12T00:00:46.680 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 0 2024-09-12T00:00:46.680 INFO:teuthology.orchestra.run.smithi067.stdout:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:00:46.680 INFO:teuthology.orchestra.run.smithi067.stdout:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:00:46.680 INFO:teuthology.orchestra.run.smithi067.stdout:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:00:46.680 INFO:teuthology.orchestra.run.smithi067.stdout:min_mon_release 17 (quincy) 2024-09-12T00:00:46.680 INFO:teuthology.orchestra.run.smithi067.stdout:election_strategy: 1 2024-09-12T00:00:46.680 INFO:teuthology.orchestra.run.smithi067.stdout:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:00:46.680 INFO:teuthology.orchestra.run.smithi067.stdout:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:00:46.680 INFO:teuthology.orchestra.run.smithi067.stdout:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:00:46.680 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T00:00:46.681 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:00:46.711 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e5cff671-9fc3-4411-a3b0-24fb92477a76... 2024-09-12T00:00:46.712 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:00:46.754 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:00:46.810 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2024-09-12T00:00:46.810 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2024-09-12T00:00:46.811 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:00:46.811 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2024-09-12T00:00:46.811 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.811 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2024-09-12T00:00:46.811 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.811 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2024-09-12T00:00:46.811 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.811 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2024-09-12T00:00:46.811 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2024-09-12T00:00:46.811 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.811 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2024-09-12T00:00:46.811 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2024-09-12T00:00:46.811 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.811 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:00:46.812 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2024-09-12T00:00:46.812 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.812 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:00:46.812 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:00:46.812 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.812 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2024-09-12T00:00:46.812 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.812 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2024-09-12T00:00:46.812 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2024-09-12T00:00:46.812 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:00:46.812 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:00:46.813 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2024-09-12T00:00:46.813 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:00:46.813 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2024-09-12T00:00:46.813 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:00:46.813 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:00:46.813 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2024-09-12T00:00:46.813 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.813 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:00:46.813 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.813 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2024-09-12T00:00:46.813 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.813 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2024-09-12T00:00:46.813 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.814 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2024-09-12T00:00:46.814 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2024-09-12T00:00:46.814 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2024-09-12T00:00:46.814 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = "172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790],172.21.15.170" 2024-09-12T00:00:46.814 INFO:teuthology.orchestra.run.smithi067.stdout: mon client directed command retry = 5 2024-09-12T00:00:46.814 INFO:teuthology.orchestra.run.smithi067.stdout: ms inject socket failures = 5000 2024-09-12T00:00:46.814 INFO:teuthology.orchestra.run.smithi067.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:00:46.814 INFO:teuthology.orchestra.run.smithi067.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:00:46.814 INFO:teuthology.orchestra.run.smithi067.stdout: rgw override bucket index max shards = 1 2024-09-12T00:00:46.814 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:00:46.814 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.814 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2024-09-12T00:00:46.814 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2024-09-12T00:00:46.815 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.815 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2024-09-12T00:00:46.815 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2024-09-12T00:00:46.815 INFO:teuthology.orchestra.run.smithi067.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:00:46.815 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.815 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2024-09-12T00:00:46.815 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2024-09-12T00:00:46.815 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.815 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2024-09-12T00:00:46.815 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2024-09-12T00:00:46.815 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2024-09-12T00:00:46.815 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug trim objects = true 2024-09-12T00:00:46.815 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.816 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2024-09-12T00:00:46.816 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2024-09-12T00:00:46.816 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.816 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:00:46.816 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.816 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2024-09-12T00:00:46.816 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.816 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2024-09-12T00:00:46.816 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.816 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:00:46.816 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2024-09-12T00:00:46.816 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.816 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2024-09-12T00:00:46.817 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2024-09-12T00:00:46.817 INFO:teuthology.orchestra.run.smithi067.stdout: bdev async discard = True 2024-09-12T00:00:46.817 INFO:teuthology.orchestra.run.smithi067.stdout: bdev enable discard = True 2024-09-12T00:00:46.817 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore allocator = bitmap 2024-09-12T00:00:46.817 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore block size = 96636764160 2024-09-12T00:00:46.817 INFO:teuthology.orchestra.run.smithi067.stdout: bluestore fsck on mount = True 2024-09-12T00:00:46.817 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluefs = 1/20 2024-09-12T00:00:46.817 INFO:teuthology.orchestra.run.smithi067.stdout: debug bluestore = 1/20 2024-09-12T00:00:46.817 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-12T00:00:46.817 INFO:teuthology.orchestra.run.smithi067.stdout: debug objclass = 20 2024-09-12T00:00:46.817 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 20 2024-09-12T00:00:46.817 INFO:teuthology.orchestra.run.smithi067.stdout: debug rocksdb = 4/10 2024-09-12T00:00:46.817 INFO:teuthology.orchestra.run.smithi067.stdout: lockdep = True 2024-09-12T00:00:46.817 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:00:46.818 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd full ratio = 0.9 2024-09-12T00:00:46.818 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:00:46.818 INFO:teuthology.orchestra.run.smithi067.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:00:46.818 INFO:teuthology.orchestra.run.smithi067.stdout: osd objectstore = bluestore 2024-09-12T00:00:46.818 INFO:teuthology.orchestra.run.smithi067.stdout: osd shutdown pgref assert = True 2024-09-12T00:00:46.818 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.818 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2024-09-12T00:00:46.818 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-12T00:00:46.818 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2024-09-12T00:00:46.818 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-09-12T00:00:46.818 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-09-12T00:00:46.818 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:00:46.818 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:00:46.818 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2024-09-12T00:00:46.819 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.819 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2024-09-12T00:00:46.819 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2024-09-12T00:00:46.819 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2024-09-12T00:00:46.819 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2024-09-12T00:00:46.819 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2024-09-12T00:00:46.819 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2024-09-12T00:00:46.819 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2024-09-12T00:00:46.819 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:00:46.819 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2024-09-12T00:00:46.819 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2024-09-12T00:00:46.819 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:00:46.819 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.820 INFO:teuthology.orchestra.run.smithi067.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:00:46.820 INFO:teuthology.orchestra.run.smithi067.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:00:46.820 INFO:teuthology.orchestra.run.smithi067.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:00:46.820 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.820 INFO:teuthology.orchestra.run.smithi067.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:00:46.820 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:00:46.820 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:00:46.820 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.820 INFO:teuthology.orchestra.run.smithi067.stdout: # 1m isn't quite enough 2024-09-12T00:00:46.820 INFO:teuthology.orchestra.run.smithi067.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:00:46.820 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.820 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:00:46.820 INFO:teuthology.orchestra.run.smithi067.stdout: lockdep = True 2024-09-12T00:00:46.821 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:00:46.821 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2024-09-12T00:00:46.821 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2024-09-12T00:00:46.821 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = true 2024-09-12T00:00:46.821 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2024-09-12T00:00:46.821 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:00:46.821 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:00:46.821 INFO:teuthology.orchestra.run.smithi067.stdout: debug rgw = 20 2024-09-12T00:00:46.821 INFO:teuthology.orchestra.run.smithi067.stdout: debug rgw notification = 20 2024-09-12T00:00:46.821 INFO:teuthology.orchestra.run.smithi067.stdout: rgw bucket counters cache = True 2024-09-12T00:00:46.821 INFO:teuthology.orchestra.run.smithi067.stdout: rgw crypt require ssl = False 2024-09-12T00:00:46.821 INFO:teuthology.orchestra.run.smithi067.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:00:46.821 INFO:teuthology.orchestra.run.smithi067.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:00:46.822 INFO:teuthology.orchestra.run.smithi067.stdout: rgw max chunk size = 4194304 2024-09-12T00:00:46.822 INFO:teuthology.orchestra.run.smithi067.stdout: rgw obj stripe size = 6291456 2024-09-12T00:00:46.822 INFO:teuthology.orchestra.run.smithi067.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:00:46.822 INFO:teuthology.orchestra.run.smithi067.stdout: rgw s3 auth use sts = True 2024-09-12T00:00:46.822 INFO:teuthology.orchestra.run.smithi067.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:00:46.822 INFO:teuthology.orchestra.run.smithi067.stdout: rgw torrent flag = True 2024-09-12T00:00:46.822 INFO:teuthology.orchestra.run.smithi067.stdout: rgw user counters cache = True 2024-09-12T00:00:46.822 INFO:teuthology.orchestra.run.smithi067.stdout: setgroup = ceph 2024-09-12T00:00:46.822 INFO:teuthology.orchestra.run.smithi067.stdout: setuser = ceph 2024-09-12T00:00:46.823 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2024-09-12T00:00:46.823 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.c] 2024-09-12T00:00:46.823 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.b] 2024-09-12T00:00:46.823 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-09-12T00:00:46.824 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2024-09-12T00:00:46.824 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:00:46.824 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2024-09-12T00:00:46.824 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.824 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2024-09-12T00:00:46.824 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.824 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2024-09-12T00:00:46.824 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.825 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2024-09-12T00:00:46.825 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2024-09-12T00:00:46.825 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.825 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2024-09-12T00:00:46.825 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2024-09-12T00:00:46.825 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.825 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:00:46.825 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2024-09-12T00:00:46.826 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.826 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:00:46.826 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:00:46.826 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.826 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2024-09-12T00:00:46.826 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.826 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2024-09-12T00:00:46.826 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2024-09-12T00:00:46.826 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:00:46.826 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:00:46.827 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2024-09-12T00:00:46.827 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:00:46.827 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2024-09-12T00:00:46.827 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:00:46.827 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:00:46.827 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2024-09-12T00:00:46.827 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.827 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:00:46.827 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.827 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2024-09-12T00:00:46.827 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.827 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2024-09-12T00:00:46.828 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.828 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2024-09-12T00:00:46.828 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2024-09-12T00:00:46.828 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2024-09-12T00:00:46.828 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.67,[v2:172.21.15.67:3301,v1:172.21.15.67:6790],172.21.15.170" 2024-09-12T00:00:46.828 INFO:teuthology.orchestra.run.smithi170.stdout: mon client directed command retry = 5 2024-09-12T00:00:46.828 INFO:teuthology.orchestra.run.smithi170.stdout: ms inject socket failures = 5000 2024-09-12T00:00:46.828 INFO:teuthology.orchestra.run.smithi170.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:00:46.828 INFO:teuthology.orchestra.run.smithi170.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:00:46.828 INFO:teuthology.orchestra.run.smithi170.stdout: rgw override bucket index max shards = 1 2024-09-12T00:00:46.829 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:00:46.829 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.829 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2024-09-12T00:00:46.829 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2024-09-12T00:00:46.829 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.829 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2024-09-12T00:00:46.829 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2024-09-12T00:00:46.829 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:00:46.830 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.830 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2024-09-12T00:00:46.830 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2024-09-12T00:00:46.830 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.830 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2024-09-12T00:00:46.830 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2024-09-12T00:00:46.830 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2024-09-12T00:00:46.831 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2024-09-12T00:00:46.831 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.831 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2024-09-12T00:00:46.831 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2024-09-12T00:00:46.831 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.831 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:00:46.831 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.831 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2024-09-12T00:00:46.832 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.832 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2024-09-12T00:00:46.832 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.832 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:00:46.832 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2024-09-12T00:00:46.832 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.832 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2024-09-12T00:00:46.833 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2024-09-12T00:00:46.833 INFO:teuthology.orchestra.run.smithi170.stdout: bdev async discard = True 2024-09-12T00:00:46.833 INFO:teuthology.orchestra.run.smithi170.stdout: bdev enable discard = True 2024-09-12T00:00:46.833 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore allocator = bitmap 2024-09-12T00:00:46.833 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2024-09-12T00:00:46.833 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2024-09-12T00:00:46.833 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 1/20 2024-09-12T00:00:46.833 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 1/20 2024-09-12T00:00:46.834 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-09-12T00:00:46.835 INFO:teuthology.orchestra.run.smithi170.stdout: debug objclass = 20 2024-09-12T00:00:46.835 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2024-09-12T00:00:46.835 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 4/10 2024-09-12T00:00:46.835 INFO:teuthology.orchestra.run.smithi170.stdout: lockdep = True 2024-09-12T00:00:46.835 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:00:46.835 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2024-09-12T00:00:46.835 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:00:46.835 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:00:46.835 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2024-09-12T00:00:46.835 INFO:teuthology.orchestra.run.smithi170.stdout: osd shutdown pgref assert = True 2024-09-12T00:00:46.836 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.836 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2024-09-12T00:00:46.836 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-09-12T00:00:46.836 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2024-09-12T00:00:46.836 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-09-12T00:00:46.836 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-09-12T00:00:46.836 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:00:46.836 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:00:46.836 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2024-09-12T00:00:46.836 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.836 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2024-09-12T00:00:46.836 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-09-12T00:00:46.836 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-09-12T00:00:46.836 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2024-09-12T00:00:46.837 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-09-12T00:00:46.837 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2024-09-12T00:00:46.837 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2024-09-12T00:00:46.837 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:00:46.837 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2024-09-12T00:00:46.837 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2024-09-12T00:00:46.837 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:00:46.837 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.837 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:00:46.837 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:00:46.837 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:00:46.837 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.837 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:00:46.837 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:00:46.838 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:00:46.838 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.838 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2024-09-12T00:00:46.838 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:00:46.838 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.838 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:00:46.838 INFO:teuthology.orchestra.run.smithi170.stdout: lockdep = True 2024-09-12T00:00:46.838 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-09-12T00:00:46.838 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2024-09-12T00:00:46.838 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2024-09-12T00:00:46.838 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2024-09-12T00:00:46.838 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2024-09-12T00:00:46.838 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:00:46.838 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:00:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: debug rgw = 20 2024-09-12T00:00:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: debug rgw notification = 20 2024-09-12T00:00:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: rgw bucket counters cache = True 2024-09-12T00:00:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: rgw crypt require ssl = False 2024-09-12T00:00:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:00:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:00:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: rgw max chunk size = 4194304 2024-09-12T00:00:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: rgw obj stripe size = 6291456 2024-09-12T00:00:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:00:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: rgw s3 auth use sts = True 2024-09-12T00:00:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:00:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: rgw torrent flag = True 2024-09-12T00:00:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: rgw user counters cache = True 2024-09-12T00:00:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: setgroup = ceph 2024-09-12T00:00:46.839 INFO:teuthology.orchestra.run.smithi170.stdout: setuser = ceph 2024-09-12T00:00:46.840 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2024-09-12T00:00:46.840 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2024-09-12T00:00:46.840 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2024-09-12T00:00:46.841 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:00:46.841 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:00:46.912 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:00:46.912 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:00:46.912 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:00:46.943 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:00:46.943 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:00:47.014 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T00:00:47.014 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:00:47.014 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:00:47.014 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:00:47.106 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:00:47.106 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:00:47.175 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T00:00:47.175 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:00:47.175 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:00:47.175 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:00:47.224 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:00:47.224 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:00:47.292 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:00:47.293 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:00:47.293 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:00:47.360 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:00:47.362 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:00:47.456 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:00:47.458 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:00:47.458 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:00:47.459 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:00:47.517 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:00:47.528 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T00:00:47.582 INFO:teuthology.orchestra.run.smithi170.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T00:00:47.595 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:00:47.595 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:00:47.596 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:00:47.635 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:00:47.636 INFO:tasks.ceph:role: osd.0 2024-09-12T00:00:47.636 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T00:00:47.636 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:00:47.723 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:00:47.724 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:00:47.724 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:00:47.724 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:00:47.724 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:00:47.724 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:00:47.724 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:00:47.724 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:00:47.724 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:00:47.724 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:00:48.240 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-09-12T00:00:48.242 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-09-12T00:00:48.243 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:00:48.334 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:00:48.382 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:00:48.422 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:00:48.422 INFO:tasks.ceph:role: osd.1 2024-09-12T00:00:48.422 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T00:00:48.422 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:00:48.511 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:00:48.512 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:00:48.512 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:00:48.512 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:00:48.512 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:00:48.512 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:00:48.512 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:00:48.512 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:00:48.512 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:00:48.512 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:00:48.981 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-09-12T00:00:48.983 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-09-12T00:00:48.983 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T00:00:49.054 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:00:49.099 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:00:49.138 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:00:49.139 INFO:tasks.ceph:role: osd.2 2024-09-12T00:00:49.139 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T00:00:49.139 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:00:49.229 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:00:49.229 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:00:49.229 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:00:49.229 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:00:49.229 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:00:49.229 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:00:49.229 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:00:49.229 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:00:49.230 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:00:49.230 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:00:49.717 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-09-12T00:00:49.719 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-09-12T00:00:49.719 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T00:00:49.831 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:00:49.876 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:00:49.916 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:00:49.916 INFO:tasks.ceph:role: osd.3 2024-09-12T00:00:49.916 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T00:00:49.916 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:00:50.002 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:00:50.002 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:00:50.002 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:00:50.003 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:00:50.003 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:00:50.003 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:00:50.003 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:00:50.003 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:00:50.003 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:00:50.003 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:00:50.515 INFO:teuthology.orchestra.run.smithi067.stdout:Discarding blocks...Done. 2024-09-12T00:00:50.517 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2024-09-12T00:00:50.517 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T00:00:50.622 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:00:50.670 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:00:50.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:00:50.747+0000 7f5e7f543640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:00:50.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:00:50.747+0000 7f5e7f543640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:00:50.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:00:50.747+0000 7f5e7f543640 -1 bdev(0x563c1d17f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:00:50.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:00:50.748+0000 7f5e7f543640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:00:53.908 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:00:53.955 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:00:54.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:00:54.021+0000 7f0c52628640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:00:54.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:00:54.021+0000 7f0c52628640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:00:54.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:00:54.021+0000 7f0c52628640 -1 bdev(0x562d0b201800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:00:54.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:00:54.021+0000 7f0c52628640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:00:57.440 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:00:57.486 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:00:57.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:00:57.552+0000 7f8396262640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:00:57.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:00:57.553+0000 7f8396262640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:00:57.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:00:57.553+0000 7f8396262640 -1 bdev(0x560c03e07800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:00:57.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:00:57.553+0000 7f8396262640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:01:00.471 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:01:00.516 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:00.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:01:00.582+0000 7f9ddd729640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:01:00.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:01:00.582+0000 7f9ddd729640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:01:00.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:01:00.582+0000 7f9ddd729640 -1 bdev(0x558620bdb800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:01:00.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:01:00.582+0000 7f9ddd729640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:01:04.242 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:01:04.290 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T00:01:04.339 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:01:04.339 INFO:tasks.ceph:role: osd.4 2024-09-12T00:01:04.339 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T00:01:04.339 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:01:04.381 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:01:04.381 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:01:04.381 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:01:04.381 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:01:04.381 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:01:04.381 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:01:04.381 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:01:04.381 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:01:04.382 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:01:04.382 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:01:04.414 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-09-12T00:01:04.415 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-09-12T00:01:04.415 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T00:01:04.499 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T00:01:04.582 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T00:01:04.662 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:01:04.662 INFO:tasks.ceph:role: osd.5 2024-09-12T00:01:04.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T00:01:04.663 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:01:04.742 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:01:04.742 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:01:04.742 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:01:04.742 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:01:04.743 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:01:04.743 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:01:04.743 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:01:04.743 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:01:04.743 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:01:04.743 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:01:04.776 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-09-12T00:01:04.778 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-09-12T00:01:04.779 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T00:01:04.861 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T00:01:04.946 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T00:01:05.027 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:01:05.027 INFO:tasks.ceph:role: osd.6 2024-09-12T00:01:05.027 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T00:01:05.027 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:01:05.109 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:01:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:01:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:01:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:01:05.109 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:01:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:01:05.109 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:01:05.109 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:01:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:01:05.110 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:01:05.142 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-09-12T00:01:05.145 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-09-12T00:01:05.145 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T00:01:05.228 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T00:01:05.314 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T00:01:05.353 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:01:05.353 INFO:tasks.ceph:role: osd.7 2024-09-12T00:01:05.353 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T00:01:05.353 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:01:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:01:05.431 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:01:05.431 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:01:05.431 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:01:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:01:05.431 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:01:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:01:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:01:05.431 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:01:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:01:05.463 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-09-12T00:01:05.465 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-09-12T00:01:05.465 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T00:01:05.550 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T00:01:05.632 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:05.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:05.743+0000 7f540de0b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T00:01:05.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:05.743+0000 7f540de0b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T00:01:05.742 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:05.743+0000 7f540de0b640 -1 bdev(0x5624eb23f800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T00:01:05.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:05.743+0000 7f540de0b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T00:01:08.654 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T00:01:08.700 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:08.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:08.763+0000 7f73e6e64640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T00:01:08.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:08.763+0000 7f73e6e64640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T00:01:08.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:08.763+0000 7f73e6e64640 -1 bdev(0x557f61cc5800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T00:01:08.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:08.763+0000 7f73e6e64640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T00:01:11.692 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T00:01:11.737 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:11.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:11.840+0000 7fdeeec0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T00:01:11.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:11.841+0000 7fdeeec0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T00:01:11.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:11.841+0000 7fdeeec0f640 -1 bdev(0x5634ebd6b800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T00:01:11.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:11.841+0000 7fdeeec0f640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T00:01:15.244 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T00:01:15.289 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:15.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:15.358+0000 7f2cef8f1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T00:01:15.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:15.358+0000 7f2cef8f1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T00:01:15.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:15.358+0000 7f2cef8f1640 -1 bdev(0x558f64f67800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T00:01:15.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-09-12T00:01:15.358+0000 7f2cef8f1640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T00:01:18.512 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T00:01:18.557 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:01:18.558 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:01:18.558 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T00:01:18.605 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:01:18.606 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:01:18.691 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:01:18.691 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:01:18.774 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:01:18.774 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:01:18.856 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:01:18.856 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:01:18.938 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:01:18.938 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:01:18.985 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:01:18.985 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T00:01:19.067 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:01:19.068 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T00:01:19.148 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:01:19.148 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T00:01:19.227 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:01:19.227 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T00:01:19.306 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:01:19.306 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:01:19.337 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:01:19.338 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T00:01:19.375 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:01:19.376 DEBUG:teuthology.orchestra.run.smithi067:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:01:19.380 DEBUG:teuthology.orchestra.run.smithi170:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:01:19.419 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.y] 2024-09-12T00:01:19.419 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAvL+JmuLaRFRAA1Nmb6u4NIdgHiWqNKx/juQ== 2024-09-12T00:01:19.419 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.0] 2024-09-12T00:01:19.420 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAyL+JmljemLBAAIa+OuX5V93dWxLMM7rFsYQ== 2024-09-12T00:01:19.420 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.1] 2024-09-12T00:01:19.420 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQA2L+JmpaVQARAAX7WrGz9Wqoxc9opqYcIxqA== 2024-09-12T00:01:19.420 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.2] 2024-09-12T00:01:19.420 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQA5L+JmDjr8IBAAqEL67MbYs4PgjL0fHxmeyw== 2024-09-12T00:01:19.420 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.3] 2024-09-12T00:01:19.420 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQA8L+JmK8m9IhAA/TSE1EqJJfvVGkBCFQJRaQ== 2024-09-12T00:01:19.420 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.x] 2024-09-12T00:01:19.421 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAvL+JmKvVLGxAAbdqu1Q2ev1wlV4YkbXWfZg== 2024-09-12T00:01:19.421 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.4] 2024-09-12T00:01:19.421 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBBL+JmPTJcLBAAYuTyLh7PzmVmnjLLODdKPg== 2024-09-12T00:01:19.421 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.5] 2024-09-12T00:01:19.421 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBEL+JmiCKMLRAAyBnN4G07UlEy+C2DZRLx+A== 2024-09-12T00:01:19.421 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.6] 2024-09-12T00:01:19.421 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBHL+Jmw4wwMhAAX/jNm5Mi91cDFw6sJG+bww== 2024-09-12T00:01:19.421 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.7] 2024-09-12T00:01:19.421 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQBLL+JmzQRuFRAAOkg9nAhPFbN0cfj7FIUd1g== 2024-09-12T00:01:19.421 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2024-09-12T00:01:19.422 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAvL+JmqbnSHhAAvTqBsLP2h3Tx65x79EJHIQ== 2024-09-12T00:01:19.422 INFO:teuthology.orchestra.run.smithi067.stdout:[client.1] 2024-09-12T00:01:19.422 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQAvL+JmclrYIhAAZu/JGFJgzTcdcZwpgWc2/Q== 2024-09-12T00:01:19.453 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.y] 2024-09-12T00:01:19.454 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAvL+JmuLaRFRAA1Nmb6u4NIdgHiWqNKx/juQ== 2024-09-12T00:01:19.454 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.0] 2024-09-12T00:01:19.454 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAyL+JmljemLBAAIa+OuX5V93dWxLMM7rFsYQ== 2024-09-12T00:01:19.454 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.1] 2024-09-12T00:01:19.454 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQA2L+JmpaVQARAAX7WrGz9Wqoxc9opqYcIxqA== 2024-09-12T00:01:19.454 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.2] 2024-09-12T00:01:19.454 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQA5L+JmDjr8IBAAqEL67MbYs4PgjL0fHxmeyw== 2024-09-12T00:01:19.454 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.3] 2024-09-12T00:01:19.454 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQA8L+JmK8m9IhAA/TSE1EqJJfvVGkBCFQJRaQ== 2024-09-12T00:01:19.454 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.x] 2024-09-12T00:01:19.454 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAvL+JmKvVLGxAAbdqu1Q2ev1wlV4YkbXWfZg== 2024-09-12T00:01:19.454 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.4] 2024-09-12T00:01:19.454 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBBL+JmPTJcLBAAYuTyLh7PzmVmnjLLODdKPg== 2024-09-12T00:01:19.455 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.5] 2024-09-12T00:01:19.455 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBEL+JmiCKMLRAAyBnN4G07UlEy+C2DZRLx+A== 2024-09-12T00:01:19.455 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.6] 2024-09-12T00:01:19.455 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBHL+Jmw4wwMhAAX/jNm5Mi91cDFw6sJG+bww== 2024-09-12T00:01:19.455 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.7] 2024-09-12T00:01:19.455 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBLL+JmzQRuFRAAOkg9nAhPFbN0cfj7FIUd1g== 2024-09-12T00:01:19.455 INFO:teuthology.orchestra.run.smithi170.stdout:[client.0] 2024-09-12T00:01:19.455 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAvL+JmqbnSHhAAvTqBsLP2h3Tx65x79EJHIQ== 2024-09-12T00:01:19.455 INFO:teuthology.orchestra.run.smithi170.stdout:[client.1] 2024-09-12T00:01:19.455 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAvL+JmclrYIhAAZu/JGFJgzTcdcZwpgWc2/Q== 2024-09-12T00:01:19.456 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:01:19.465 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:01:19.560 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:19.563 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:19.630 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:19.633 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:19.698 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:19.700 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:19.764 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:19.767 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:19.831 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:01:19.834 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:01:19.899 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:19.901 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:19.966 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:19.969 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:20.036 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:20.040 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:20.105 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:20.107 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:01:20.172 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:01:20.175 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:01:20.243 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:01:20.246 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:01:20.313 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:01:20.314 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:01:20.353 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:01:20.465 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:01:20.505 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T00:01:20.585 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:01:20.700 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T00:01:20.740 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T00:01:20.783 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:01:20.892 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T00:01:20.931 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:20.933 DEBUG:teuthology.orchestra.run.smithi170:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:01:21.001 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:01:21.002 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:01:21.002 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:01:21.005 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:01:21.005 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T00:01:21.005 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T00:01:21.007 INFO:tasks.ceph.mon.c:Started 2024-09-12T00:01:21.008 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T00:01:21.008 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T00:01:21.045 INFO:tasks.ceph.mon.b:Started 2024-09-12T00:01:21.045 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:01:21.045 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T00:01:21.046 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T00:01:21.048 INFO:tasks.ceph.mgr.y:Started 2024-09-12T00:01:21.048 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:01:21.049 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:01:21.050 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:01:21.051 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:01:21.051 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:01:21.051 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:01:26.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:01:26.537+0000 7f484ffff640 0 --2- 172.21.15.67:0/3622226003 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x7f4838005410 0x7f483800ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:01:26.615 INFO:teuthology.orchestra.run.smithi067.stderr:adjusted tunables profile to default 2024-09-12T00:01:26.627 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:01:26.628 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:01:26.628 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:01:26.628 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:01:26.670 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:01:26.670 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:01:26.751 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:01:26.751 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:01:26.831 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:01:26.831 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:01:26.912 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:01:26.912 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T00:01:26.959 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:01:26.959 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T00:01:27.044 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:01:27.045 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T00:01:27.129 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-09-12T00:01:27.130 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T00:01:27.210 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new c1087d14-61a5-42e3-bc42-7339a6e0a250 0 2024-09-12T00:01:27.442 INFO:teuthology.orchestra.run.smithi170.stdout:0 2024-09-12T00:01:27.453 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new ec8ef004-2562-4cf2-9f8c-240a040ec8f8 1 2024-09-12T00:01:27.645 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-09-12T00:01:27.656 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 3fe6450f-2a9c-4c28-a6df-d554afe1e0a9 2 2024-09-12T00:01:27.849 INFO:teuthology.orchestra.run.smithi170.stdout:2 2024-09-12T00:01:27.861 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 3a811d0a-3bec-472e-a10c-b944882030e4 3 2024-09-12T00:01:28.052 INFO:teuthology.orchestra.run.smithi170.stdout:3 2024-09-12T00:01:28.063 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new c1039f7c-d131-421c-97cf-070ebb75dc7b 4 2024-09-12T00:01:28.253 INFO:teuthology.orchestra.run.smithi170.stdout:4 2024-09-12T00:01:28.264 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new df8e4b1b-7090-42aa-a9d2-826af1c1934e 5 2024-09-12T00:01:28.457 INFO:teuthology.orchestra.run.smithi170.stdout:5 2024-09-12T00:01:28.469 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 69672dbb-ef65-46b8-9524-088a02d756e4 6 2024-09-12T00:01:28.662 INFO:teuthology.orchestra.run.smithi170.stdout:6 2024-09-12T00:01:28.674 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 61f72d21-51cf-4404-8086-77526b31ed44 7 2024-09-12T00:01:28.868 INFO:teuthology.orchestra.run.smithi170.stdout:7 2024-09-12T00:01:28.880 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:01:28.880 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:01:28.883 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:01:28.883 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:01:28.883 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:01:28.885 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:01:28.885 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:01:28.885 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:01:28.887 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:01:28.887 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:01:28.887 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:01:28.889 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:01:28.889 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T00:01:28.890 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T00:01:28.892 INFO:tasks.ceph.osd.4:Started 2024-09-12T00:01:28.892 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T00:01:28.892 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T00:01:28.894 INFO:tasks.ceph.osd.5:Started 2024-09-12T00:01:28.894 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T00:01:28.895 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T00:01:28.897 INFO:tasks.ceph.osd.6:Started 2024-09-12T00:01:28.897 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T00:01:28.897 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T00:01:28.899 INFO:tasks.ceph.osd.7:Started 2024-09-12T00:01:28.900 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:01:29.114 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:01:29.114 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":10,"fsid":"e5cff671-9fc3-4411-a3b0-24fb92477a76","created":"2024-09-12T00:01:26.321068+0000","modified":"2024-09-12T00:01:28.868474+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:01:28.868474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c1087d14-61a5-42e3-bc42-7339a6e0a250","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ec8ef004-2562-4cf2-9f8c-240a040ec8f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3fe6450f-2a9c-4c28-a6df-d554afe1e0a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3a811d0a-3bec-472e-a10c-b944882030e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c1039f7c-d131-421c-97cf-070ebb75dc7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"df8e4b1b-7090-42aa-a9d2-826af1c1934e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"69672dbb-ef65-46b8-9524-088a02d756e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"61f72d21-51cf-4404-8086-77526b31ed44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:01:29.125 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:01:29.125 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:01:29.933 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:01:30.113 INFO:teuthology.misc.health.smithi067.stdout: 2024-09-12T00:01:30.113 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":10,"fsid":"e5cff671-9fc3-4411-a3b0-24fb92477a76","created":"2024-09-12T00:01:26.321068+0000","modified":"2024-09-12T00:01:28.868474+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:01:28.868474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c1087d14-61a5-42e3-bc42-7339a6e0a250","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ec8ef004-2562-4cf2-9f8c-240a040ec8f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3fe6450f-2a9c-4c28-a6df-d554afe1e0a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3a811d0a-3bec-472e-a10c-b944882030e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c1039f7c-d131-421c-97cf-070ebb75dc7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"df8e4b1b-7090-42aa-a9d2-826af1c1934e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"69672dbb-ef65-46b8-9524-088a02d756e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"61f72d21-51cf-4404-8086-77526b31ed44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:01:30.123 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:01:30.369 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-09-12T00:01:30.370+0000 7f4c1b61a640 -1 Falling back to public interface 2024-09-12T00:01:30.373 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-09-12T00:01:30.373+0000 7f4f2f11e640 -1 Falling back to public interface 2024-09-12T00:01:30.606 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-09-12T00:01:30.607+0000 7f6341e3b640 -1 Falling back to public interface 2024-09-12T00:01:30.625 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-09-12T00:01:30.625+0000 7fd9288eb640 -1 Falling back to public interface 2024-09-12T00:01:30.625 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-09-12T00:01:30.627+0000 7f2bee60b640 -1 Falling back to public interface 2024-09-12T00:01:30.626 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-09-12T00:01:30.628+0000 7f6b9360f640 -1 Falling back to public interface 2024-09-12T00:01:30.634 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-09-12T00:01:30.634+0000 7f1832f1e640 -1 Falling back to public interface 2024-09-12T00:01:30.899 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-09-12T00:01:30.901+0000 7fc595660640 -1 Falling back to public interface 2024-09-12T00:01:31.765 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-12T00:01:31.766+0000 7f4352d06640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T00:01:31.766 INFO:tasks.ceph.mgr.y.smithi067.stderr:2024-09-12T00:01:31.766+0000 7f4352d06640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T00:01:34.169 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-09-12T00:01:34.170+0000 7f2bee60b640 -1 osd.4 0 log_to_monitors true 2024-09-12T00:01:34.221 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-09-12T00:01:34.221+0000 7f4f2f11e640 -1 osd.1 0 log_to_monitors true 2024-09-12T00:01:34.369 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-09-12T00:01:34.370+0000 7f6341e3b640 -1 osd.0 0 log_to_monitors true 2024-09-12T00:01:34.413 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-09-12T00:01:34.414+0000 7f4c1b61a640 -1 osd.5 0 log_to_monitors true 2024-09-12T00:01:34.696 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-09-12T00:01:34.698+0000 7f1832f1e640 -1 osd.2 0 log_to_monitors true 2024-09-12T00:01:34.738 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-09-12T00:01:34.738+0000 7fc595660640 -1 osd.7 0 log_to_monitors true 2024-09-12T00:01:34.906 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-09-12T00:01:34.907+0000 7fd9288eb640 -1 osd.3 0 log_to_monitors true 2024-09-12T00:01:35.181 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-09-12T00:01:35.181+0000 7f6b9360f640 -1 osd.6 0 log_to_monitors true 2024-09-12T00:01:36.003 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-09-12T00:01:36.004+0000 7f2bea036640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:01:36.018 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-09-12T00:01:36.019+0000 7f2be1e55640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:01:36.274 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-09-12T00:01:36.275+0000 7f4f2b0b2640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:01:36.289 INFO:tasks.ceph.osd.1.smithi067.stderr:2024-09-12T00:01:36.290+0000 7f4f22ed1640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:01:36.930 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:01:37.292 INFO:teuthology.misc.health.smithi067.stdout: 2024-09-12T00:01:37.293 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":13,"fsid":"e5cff671-9fc3-4411-a3b0-24fb92477a76","created":"2024-09-12T00:01:26.321068+0000","modified":"2024-09-12T00:01:36.342831+0000","last_up_change":"2024-09-12T00:01:36.342831+0000","last_in_change":"2024-09-12T00:01:28.868474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c1087d14-61a5-42e3-bc42-7339a6e0a250","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ec8ef004-2562-4cf2-9f8c-240a040ec8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6801","nonce":2522402523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6803","nonce":2522402523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6807","nonce":2522402523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6805","nonce":2522402523}]},"public_addr":"172.21.15.67:6801/2522402523","cluster_addr":"172.21.15.67:6803/2522402523","heartbeat_back_addr":"172.21.15.67:6807/2522402523","heartbeat_front_addr":"172.21.15.67:6805/2522402523","state":["exists","up"]},{"osd":2,"uuid":"3fe6450f-2a9c-4c28-a6df-d554afe1e0a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3a811d0a-3bec-472e-a10c-b944882030e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c1039f7c-d131-421c-97cf-070ebb75dc7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6809","nonce":2113328631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6811","nonce":2113328631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6818","nonce":2113328631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6814","nonce":2113328631}]},"public_addr":"172.21.15.170:6809/2113328631","cluster_addr":"172.21.15.170:6811/2113328631","heartbeat_back_addr":"172.21.15.170:6818/2113328631","heartbeat_front_addr":"172.21.15.170:6814/2113328631","state":["exists","up"]},{"osd":5,"uuid":"df8e4b1b-7090-42aa-a9d2-826af1c1934e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"69672dbb-ef65-46b8-9524-088a02d756e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"61f72d21-51cf-4404-8086-77526b31ed44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:01:37.305 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-09-12T00:01:37.458 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-09-12T00:01:37.459+0000 7f4c1705a640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:01:37.467 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-09-12T00:01:37.468+0000 7f4c0ee79640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:01:37.504 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-09-12T00:01:37.505+0000 7f6b8eef2640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:01:37.513 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-09-12T00:01:37.514+0000 7fc5915f4640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:01:37.514 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-09-12T00:01:37.515+0000 7f6b86d11640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:01:37.526 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-09-12T00:01:37.527+0000 7fc589413640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:01:38.060 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-09-12T00:01:38.061+0000 7f182f6c6640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:01:38.070 INFO:tasks.ceph.osd.2.smithi067.stderr:2024-09-12T00:01:38.072+0000 7f1826cd1640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:01:38.094 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-09-12T00:01:38.095+0000 7f633ddcf640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:01:38.107 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-09-12T00:01:38.109+0000 7fd92487f640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:01:38.110 INFO:tasks.ceph.osd.0.smithi067.stderr:2024-09-12T00:01:38.112+0000 7f6335bee640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:01:38.123 INFO:tasks.ceph.osd.3.smithi067.stderr:2024-09-12T00:01:38.125+0000 7fd91c69e640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:01:44.113 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:01:44.434 INFO:teuthology.misc.health.smithi067.stdout: 2024-09-12T00:01:44.435 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":17,"fsid":"e5cff671-9fc3-4411-a3b0-24fb92477a76","created":"2024-09-12T00:01:26.321068+0000","modified":"2024-09-12T00:01:40.470410+0000","last_up_change":"2024-09-12T00:01:38.454848+0000","last_in_change":"2024-09-12T00:01:28.868474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:01:36.775566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1087d14-61a5-42e3-bc42-7339a6e0a250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6809","nonce":758855525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6811","nonce":758855525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6815","nonce":758855525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6813","nonce":758855525}]},"public_addr":"172.21.15.67:6809/758855525","cluster_addr":"172.21.15.67:6811/758855525","heartbeat_back_addr":"172.21.15.67:6815/758855525","heartbeat_front_addr":"172.21.15.67:6813/758855525","state":["exists","up"]},{"osd":1,"uuid":"ec8ef004-2562-4cf2-9f8c-240a040ec8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6801","nonce":2522402523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6803","nonce":2522402523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6807","nonce":2522402523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6805","nonce":2522402523}]},"public_addr":"172.21.15.67:6801/2522402523","cluster_addr":"172.21.15.67:6803/2522402523","heartbeat_back_addr":"172.21.15.67:6807/2522402523","heartbeat_front_addr":"172.21.15.67:6805/2522402523","state":["exists","up"]},{"osd":2,"uuid":"3fe6450f-2a9c-4c28-a6df-d554afe1e0a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6825","nonce":2280959600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6827","nonce":2280959600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6831","nonce":2280959600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6829","nonce":2280959600}]},"public_addr":"172.21.15.67:6825/2280959600","cluster_addr":"172.21.15.67:6827/2280959600","heartbeat_back_addr":"172.21.15.67:6831/2280959600","heartbeat_front_addr":"172.21.15.67:6829/2280959600","state":["exists","up"]},{"osd":3,"uuid":"3a811d0a-3bec-472e-a10c-b944882030e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6817","nonce":1829992128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6819","nonce":1829992128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6823","nonce":1829992128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6821","nonce":1829992128}]},"public_addr":"172.21.15.67:6817/1829992128","cluster_addr":"172.21.15.67:6819/1829992128","heartbeat_back_addr":"172.21.15.67:6823/1829992128","heartbeat_front_addr":"172.21.15.67:6821/1829992128","state":["exists","up"]},{"osd":4,"uuid":"c1039f7c-d131-421c-97cf-070ebb75dc7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6809","nonce":2113328631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6811","nonce":2113328631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6818","nonce":2113328631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6814","nonce":2113328631}]},"public_addr":"172.21.15.170:6809/2113328631","cluster_addr":"172.21.15.170:6811/2113328631","heartbeat_back_addr":"172.21.15.170:6818/2113328631","heartbeat_front_addr":"172.21.15.170:6814/2113328631","state":["exists","up"]},{"osd":5,"uuid":"df8e4b1b-7090-42aa-a9d2-826af1c1934e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6801","nonce":3337629604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6803","nonce":3337629604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6807","nonce":3337629604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6805","nonce":3337629604}]},"public_addr":"172.21.15.170:6801/3337629604","cluster_addr":"172.21.15.170:6803/3337629604","heartbeat_back_addr":"172.21.15.170:6807/3337629604","heartbeat_front_addr":"172.21.15.170:6805/3337629604","state":["exists","up"]},{"osd":6,"uuid":"69672dbb-ef65-46b8-9524-088a02d756e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6813","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6815","nonce":3583292503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6817","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6819","nonce":3583292503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6823","nonce":3583292503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6821","nonce":3583292503}]},"public_addr":"172.21.15.170:6815/3583292503","cluster_addr":"172.21.15.170:6819/3583292503","heartbeat_back_addr":"172.21.15.170:6823/3583292503","heartbeat_front_addr":"172.21.15.170:6821/3583292503","state":["exists","up"]},{"osd":7,"uuid":"61f72d21-51cf-4404-8086-77526b31ed44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6825","nonce":783534599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6827","nonce":783534599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6831","nonce":783534599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6829","nonce":783534599}]},"public_addr":"172.21.15.170:6825/783534599","cluster_addr":"172.21.15.170:6827/783534599","heartbeat_back_addr":"172.21.15.170:6831/783534599","heartbeat_front_addr":"172.21.15.170:6829/783534599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.395612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.272627+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.707039+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.919876+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.158924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.398876+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:36.176508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.718470+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:01:44.446 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T00:01:44.446 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:01:44.447 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:01:45.498 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'rbd' created 2024-09-12T00:01:45.513 DEBUG:teuthology.orchestra.run.smithi067:> rbd --cluster ceph pool init rbd 2024-09-12T00:01:45.574 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:01:45.575 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:01:48.520 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:01:48.521 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:01:48.522 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:01:48.849 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:01:48.862 INFO:teuthology.orchestra.run.smithi067.stdout:[{"version":9,"timestamp":"2024-09-12T00:01:38.110409+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"5164.620141"}]}] 2024-09-12T00:01:48.862 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T00:01:48.863 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:01:48.863 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:01:48.863 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:01:49.230 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:01:49.239 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6832","nonce":593991103},{"type":"v1","addr":"172.21.15.67:6833","nonce":593991103}]},"active_addr":"172.21.15.67:6833/593991103","active_change":"2024-09-12T00:01:30.752884+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":551970926}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":3127357772}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":1248193074}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":3124259759}]}]} 2024-09-12T00:01:49.244 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:01:49.245 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:01:49.245 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:01:49.560 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:01:49.560 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"e5cff671-9fc3-4411-a3b0-24fb92477a76","created":"2024-09-12T00:01:26.321068+0000","modified":"2024-09-12T00:01:48.507225+0000","last_up_change":"2024-09-12T00:01:38.454848+0000","last_in_change":"2024-09-12T00:01:28.868474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:01:36.775566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:01:44.766611+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1087d14-61a5-42e3-bc42-7339a6e0a250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6809","nonce":758855525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6811","nonce":758855525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6815","nonce":758855525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6813","nonce":758855525}]},"public_addr":"172.21.15.67:6809/758855525","cluster_addr":"172.21.15.67:6811/758855525","heartbeat_back_addr":"172.21.15.67:6815/758855525","heartbeat_front_addr":"172.21.15.67:6813/758855525","state":["exists","up"]},{"osd":1,"uuid":"ec8ef004-2562-4cf2-9f8c-240a040ec8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6801","nonce":2522402523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6803","nonce":2522402523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6807","nonce":2522402523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6805","nonce":2522402523}]},"public_addr":"172.21.15.67:6801/2522402523","cluster_addr":"172.21.15.67:6803/2522402523","heartbeat_back_addr":"172.21.15.67:6807/2522402523","heartbeat_front_addr":"172.21.15.67:6805/2522402523","state":["exists","up"]},{"osd":2,"uuid":"3fe6450f-2a9c-4c28-a6df-d554afe1e0a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6825","nonce":2280959600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6827","nonce":2280959600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6831","nonce":2280959600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6829","nonce":2280959600}]},"public_addr":"172.21.15.67:6825/2280959600","cluster_addr":"172.21.15.67:6827/2280959600","heartbeat_back_addr":"172.21.15.67:6831/2280959600","heartbeat_front_addr":"172.21.15.67:6829/2280959600","state":["exists","up"]},{"osd":3,"uuid":"3a811d0a-3bec-472e-a10c-b944882030e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6817","nonce":1829992128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6819","nonce":1829992128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6823","nonce":1829992128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6821","nonce":1829992128}]},"public_addr":"172.21.15.67:6817/1829992128","cluster_addr":"172.21.15.67:6819/1829992128","heartbeat_back_addr":"172.21.15.67:6823/1829992128","heartbeat_front_addr":"172.21.15.67:6821/1829992128","state":["exists","up"]},{"osd":4,"uuid":"c1039f7c-d131-421c-97cf-070ebb75dc7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6809","nonce":2113328631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6811","nonce":2113328631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6818","nonce":2113328631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6814","nonce":2113328631}]},"public_addr":"172.21.15.170:6809/2113328631","cluster_addr":"172.21.15.170:6811/2113328631","heartbeat_back_addr":"172.21.15.170:6818/2113328631","heartbeat_front_addr":"172.21.15.170:6814/2113328631","state":["exists","up"]},{"osd":5,"uuid":"df8e4b1b-7090-42aa-a9d2-826af1c1934e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6801","nonce":3337629604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6803","nonce":3337629604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6807","nonce":3337629604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6805","nonce":3337629604}]},"public_addr":"172.21.15.170:6801/3337629604","cluster_addr":"172.21.15.170:6803/3337629604","heartbeat_back_addr":"172.21.15.170:6807/3337629604","heartbeat_front_addr":"172.21.15.170:6805/3337629604","state":["exists","up"]},{"osd":6,"uuid":"69672dbb-ef65-46b8-9524-088a02d756e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6813","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6815","nonce":3583292503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6817","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6819","nonce":3583292503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6823","nonce":3583292503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6821","nonce":3583292503}]},"public_addr":"172.21.15.170:6815/3583292503","cluster_addr":"172.21.15.170:6819/3583292503","heartbeat_back_addr":"172.21.15.170:6823/3583292503","heartbeat_front_addr":"172.21.15.170:6821/3583292503","state":["exists","up"]},{"osd":7,"uuid":"61f72d21-51cf-4404-8086-77526b31ed44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6825","nonce":783534599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6827","nonce":783534599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6831","nonce":783534599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6829","nonce":783534599}]},"public_addr":"172.21.15.170:6825/783534599","cluster_addr":"172.21.15.170:6827/783534599","heartbeat_back_addr":"172.21.15.170:6831/783534599","heartbeat_front_addr":"172.21.15.170:6829/783534599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.395612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.272627+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.707039+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.919876+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.158924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.398876+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:36.176508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.718470+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:01:49.574 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:01:49.574 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:01:49.887 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:01:49.887 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":21,"fsid":"e5cff671-9fc3-4411-a3b0-24fb92477a76","created":"2024-09-12T00:01:26.321068+0000","modified":"2024-09-12T00:01:48.507225+0000","last_up_change":"2024-09-12T00:01:38.454848+0000","last_in_change":"2024-09-12T00:01:28.868474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:01:36.775566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:01:44.766611+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1087d14-61a5-42e3-bc42-7339a6e0a250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6809","nonce":758855525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6811","nonce":758855525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6815","nonce":758855525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6813","nonce":758855525}]},"public_addr":"172.21.15.67:6809/758855525","cluster_addr":"172.21.15.67:6811/758855525","heartbeat_back_addr":"172.21.15.67:6815/758855525","heartbeat_front_addr":"172.21.15.67:6813/758855525","state":["exists","up"]},{"osd":1,"uuid":"ec8ef004-2562-4cf2-9f8c-240a040ec8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6801","nonce":2522402523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6803","nonce":2522402523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6807","nonce":2522402523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6805","nonce":2522402523}]},"public_addr":"172.21.15.67:6801/2522402523","cluster_addr":"172.21.15.67:6803/2522402523","heartbeat_back_addr":"172.21.15.67:6807/2522402523","heartbeat_front_addr":"172.21.15.67:6805/2522402523","state":["exists","up"]},{"osd":2,"uuid":"3fe6450f-2a9c-4c28-a6df-d554afe1e0a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6825","nonce":2280959600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6827","nonce":2280959600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6831","nonce":2280959600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6829","nonce":2280959600}]},"public_addr":"172.21.15.67:6825/2280959600","cluster_addr":"172.21.15.67:6827/2280959600","heartbeat_back_addr":"172.21.15.67:6831/2280959600","heartbeat_front_addr":"172.21.15.67:6829/2280959600","state":["exists","up"]},{"osd":3,"uuid":"3a811d0a-3bec-472e-a10c-b944882030e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6817","nonce":1829992128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6819","nonce":1829992128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6823","nonce":1829992128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6821","nonce":1829992128}]},"public_addr":"172.21.15.67:6817/1829992128","cluster_addr":"172.21.15.67:6819/1829992128","heartbeat_back_addr":"172.21.15.67:6823/1829992128","heartbeat_front_addr":"172.21.15.67:6821/1829992128","state":["exists","up"]},{"osd":4,"uuid":"c1039f7c-d131-421c-97cf-070ebb75dc7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6809","nonce":2113328631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6811","nonce":2113328631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6818","nonce":2113328631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6814","nonce":2113328631}]},"public_addr":"172.21.15.170:6809/2113328631","cluster_addr":"172.21.15.170:6811/2113328631","heartbeat_back_addr":"172.21.15.170:6818/2113328631","heartbeat_front_addr":"172.21.15.170:6814/2113328631","state":["exists","up"]},{"osd":5,"uuid":"df8e4b1b-7090-42aa-a9d2-826af1c1934e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6801","nonce":3337629604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6803","nonce":3337629604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6807","nonce":3337629604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6805","nonce":3337629604}]},"public_addr":"172.21.15.170:6801/3337629604","cluster_addr":"172.21.15.170:6803/3337629604","heartbeat_back_addr":"172.21.15.170:6807/3337629604","heartbeat_front_addr":"172.21.15.170:6805/3337629604","state":["exists","up"]},{"osd":6,"uuid":"69672dbb-ef65-46b8-9524-088a02d756e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6813","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6815","nonce":3583292503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6817","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6819","nonce":3583292503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6823","nonce":3583292503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6821","nonce":3583292503}]},"public_addr":"172.21.15.170:6815/3583292503","cluster_addr":"172.21.15.170:6819/3583292503","heartbeat_back_addr":"172.21.15.170:6823/3583292503","heartbeat_front_addr":"172.21.15.170:6821/3583292503","state":["exists","up"]},{"osd":7,"uuid":"61f72d21-51cf-4404-8086-77526b31ed44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6825","nonce":783534599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6827","nonce":783534599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6831","nonce":783534599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6829","nonce":783534599}]},"public_addr":"172.21.15.170:6825/783534599","cluster_addr":"172.21.15.170:6827/783534599","heartbeat_back_addr":"172.21.15.170:6831/783534599","heartbeat_front_addr":"172.21.15.170:6829/783534599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.395612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.272627+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.707039+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.919876+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.158924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.398876+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:36.176508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.718470+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:01:49.901 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:01:49.901 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:01:49.901 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:01:49.902 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:01:49.902 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:01:49.903 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:01:49.903 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:01:49.903 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:01:50.176 INFO:teuthology.orchestra.run.smithi067.stdout:55834574852 2024-09-12T00:01:50.177 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:01:50.181 INFO:teuthology.orchestra.run.smithi067.stdout:64424509446 2024-09-12T00:01:50.181 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:01:50.183 INFO:teuthology.orchestra.run.smithi067.stdout:64424509446 2024-09-12T00:01:50.183 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:01:50.184 INFO:teuthology.orchestra.run.smithi067.stdout:64424509445 2024-09-12T00:01:50.184 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:01:50.185 INFO:teuthology.orchestra.run.smithi067.stdout:64424509445 2024-09-12T00:01:50.185 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:01:50.186 INFO:teuthology.orchestra.run.smithi067.stdout:55834574852 2024-09-12T00:01:50.187 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:01:50.187 INFO:teuthology.orchestra.run.smithi067.stdout:64424509445 2024-09-12T00:01:50.188 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:01:50.188 INFO:teuthology.orchestra.run.smithi067.stdout:64424509445 2024-09-12T00:01:50.189 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:01:50.793 INFO:teuthology.orchestra.run.smithi067.stdout:55834574851 2024-09-12T00:01:50.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2024-09-12T00:01:50.835 INFO:teuthology.orchestra.run.smithi067.stdout:64424509443 2024-09-12T00:01:50.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.2 2024-09-12T00:01:50.849 INFO:teuthology.orchestra.run.smithi067.stdout:64424509443 2024-09-12T00:01:50.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.6 2024-09-12T00:01:50.875 INFO:teuthology.orchestra.run.smithi067.stdout:64424509444 2024-09-12T00:01:50.878 INFO:teuthology.orchestra.run.smithi067.stdout:64424509444 2024-09-12T00:01:50.881 INFO:teuthology.orchestra.run.smithi067.stdout:64424509443 2024-09-12T00:01:50.882 INFO:teuthology.orchestra.run.smithi067.stdout:55834574851 2024-09-12T00:01:50.887 INFO:teuthology.orchestra.run.smithi067.stdout:64424509443 2024-09-12T00:01:50.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.0 2024-09-12T00:01:50.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.3 2024-09-12T00:01:50.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2024-09-12T00:01:50.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.5 2024-09-12T00:01:50.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.7 2024-09-12T00:01:51.814 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:01:51.850 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:01:51.867 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:01:51.892 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:01:51.900 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:01:51.902 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:01:51.903 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:01:51.907 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:01:52.379 INFO:teuthology.orchestra.run.smithi067.stdout:55834574852 2024-09-12T00:01:52.397 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2024-09-12T00:01:52.397 DEBUG:teuthology.parallel:result is None 2024-09-12T00:01:52.481 INFO:teuthology.orchestra.run.smithi067.stdout:64424509445 2024-09-12T00:01:52.482 INFO:teuthology.orchestra.run.smithi067.stdout:64424509446 2024-09-12T00:01:52.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.5 2024-09-12T00:01:52.497 DEBUG:teuthology.parallel:result is None 2024-09-12T00:01:52.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.2 2024-09-12T00:01:52.502 DEBUG:teuthology.parallel:result is None 2024-09-12T00:01:52.526 INFO:teuthology.orchestra.run.smithi067.stdout:64424509445 2024-09-12T00:01:52.541 INFO:teuthology.orchestra.run.smithi067.stdout:64424509446 2024-09-12T00:01:52.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.6 2024-09-12T00:01:52.545 INFO:teuthology.orchestra.run.smithi067.stdout:64424509445 2024-09-12T00:01:52.545 DEBUG:teuthology.parallel:result is None 2024-09-12T00:01:52.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-09-12T00:01:52.556 DEBUG:teuthology.parallel:result is None 2024-09-12T00:01:52.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.3 2024-09-12T00:01:52.560 DEBUG:teuthology.parallel:result is None 2024-09-12T00:01:52.561 INFO:teuthology.orchestra.run.smithi067.stdout:64424509445 2024-09-12T00:01:52.566 INFO:teuthology.orchestra.run.smithi067.stdout:55834574852 2024-09-12T00:01:52.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.7 2024-09-12T00:01:52.575 DEBUG:teuthology.parallel:result is None 2024-09-12T00:01:52.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2024-09-12T00:01:52.581 DEBUG:teuthology.parallel:result is None 2024-09-12T00:01:52.581 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:01:52.581 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:01:52.934 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:01:52.934 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T00:01:52.946 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-12T00:01:52.762005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243980,"kb_used_data":2764,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754730740,"statfs":{"total":773094113280,"available":772844277760,"internally_reserved":0,"allocated":2830336,"data_stored":1732122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.263583"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:48.515417+0000","last_change":"2024-09-12T00:01:48.515417+0000","last_active":"2024-09-12T00:01:48.515417+0000","last_peered":"2024-09-12T00:01:48.515417+0000","last_clean":"2024-09-12T00:01:48.515417+0000","last_became_active":"2024-09-12T00:01:46.502847+0000","last_became_peered":"2024-09-12T00:01:46.502847+0000","last_unstale":"2024-09-12T00:01:48.515417+0000","last_undegraded":"2024-09-12T00:01:48.515417+0000","last_fullsized":"2024-09-12T00:01:48.515417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:49.727360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:48.511291+0000","last_change":"2024-09-12T00:01:48.511519+0000","last_active":"2024-09-12T00:01:48.511291+0000","last_peered":"2024-09-12T00:01:48.511291+0000","last_clean":"2024-09-12T00:01:48.511291+0000","last_became_active":"2024-09-12T00:01:46.508144+0000","last_became_peered":"2024-09-12T00:01:46.508144+0000","last_unstale":"2024-09-12T00:01:48.511291+0000","last_undegraded":"2024-09-12T00:01:48.511291+0000","last_fullsized":"2024-09-12T00:01:48.511291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:13.771631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045024799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:48.515165+0000","last_change":"2024-09-12T00:01:48.515165+0000","last_active":"2024-09-12T00:01:48.515165+0000","last_peered":"2024-09-12T00:01:48.515165+0000","last_clean":"2024-09-12T00:01:48.515165+0000","last_became_active":"2024-09-12T00:01:46.505315+0000","last_became_peered":"2024-09-12T00:01:46.505315+0000","last_unstale":"2024-09-12T00:01:48.515165+0000","last_undegraded":"2024-09-12T00:01:48.515165+0000","last_fullsized":"2024-09-12T00:01:48.515165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:31.136294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079890600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:49.473220+0000","last_change":"2024-09-12T00:01:49.473468+0000","last_active":"2024-09-12T00:01:49.473220+0000","last_peered":"2024-09-12T00:01:49.473220+0000","last_clean":"2024-09-12T00:01:49.473220+0000","last_became_active":"2024-09-12T00:01:46.505954+0000","last_became_peered":"2024-09-12T00:01:46.505954+0000","last_unstale":"2024-09-12T00:01:49.473220+0000","last_undegraded":"2024-09-12T00:01:49.473220+0000","last_fullsized":"2024-09-12T00:01:49.473220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:03.543109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050498000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:48.516482+0000","last_change":"2024-09-12T00:01:48.515810+0000","last_active":"2024-09-12T00:01:48.516482+0000","last_peered":"2024-09-12T00:01:48.516482+0000","last_clean":"2024-09-12T00:01:48.516482+0000","last_became_active":"2024-09-12T00:01:46.502428+0000","last_became_peered":"2024-09-12T00:01:46.502428+0000","last_unstale":"2024-09-12T00:01:48.516482+0000","last_undegraded":"2024-09-12T00:01:48.516482+0000","last_fullsized":"2024-09-12T00:01:48.516482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:13.947790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001414925,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:50.044712+0000","last_change":"2024-09-12T00:01:50.044924+0000","last_active":"2024-09-12T00:01:50.044712+0000","last_peered":"2024-09-12T00:01:50.044712+0000","last_clean":"2024-09-12T00:01:50.044712+0000","last_became_active":"2024-09-12T00:01:46.505857+0000","last_became_peered":"2024-09-12T00:01:46.505857+0000","last_unstale":"2024-09-12T00:01:50.044712+0000","last_undegraded":"2024-09-12T00:01:50.044712+0000","last_fullsized":"2024-09-12T00:01:50.044712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:18.728534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039331300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:48.515091+0000","last_change":"2024-09-12T00:01:48.515091+0000","last_active":"2024-09-12T00:01:48.515091+0000","last_peered":"2024-09-12T00:01:48.515091+0000","last_clean":"2024-09-12T00:01:48.515091+0000","last_became_active":"2024-09-12T00:01:46.505677+0000","last_became_peered":"2024-09-12T00:01:46.505677+0000","last_unstale":"2024-09-12T00:01:48.515091+0000","last_undegraded":"2024-09-12T00:01:48.515091+0000","last_fullsized":"2024-09-12T00:01:48.515091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:07.430053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075102999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:48.515868+0000","last_change":"2024-09-12T00:01:48.515868+0000","last_active":"2024-09-12T00:01:48.515868+0000","last_peered":"2024-09-12T00:01:48.515868+0000","last_clean":"2024-09-12T00:01:48.515868+0000","last_became_active":"2024-09-12T00:01:46.613916+0000","last_became_peered":"2024-09-12T00:01:46.613916+0000","last_unstale":"2024-09-12T00:01:48.515868+0000","last_undegraded":"2024-09-12T00:01:48.515868+0000","last_fullsized":"2024-09-12T00:01:48.515868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:23.127685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014566500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":112,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:48.511083+0000","last_change":"2024-09-12T00:01:39.721517+0000","last_active":"2024-09-12T00:01:48.511083+0000","last_peered":"2024-09-12T00:01:48.511083+0000","last_clean":"2024-09-12T00:01:48.511083+0000","last_became_active":"2024-09-12T00:01:39.720425+0000","last_became_peered":"2024-09-12T00:01:39.720425+0000","last_unstale":"2024-09-12T00:01:48.511083+0000","last_undegraded":"2024-09-12T00:01:48.511083+0000","last_fullsized":"2024-09-12T00:01:48.511083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:37.438834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:37.438834+0000","last_clean_scrub_stamp":"2024-09-12T00:01:37.438834+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:26.565085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":59515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":71114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":790528,"data_stored":655631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":208896,"data_stored":71095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":661463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:01:52.947 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:01:53.257 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:01:53.257 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T00:01:53.269 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-12T00:01:52.762005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243980,"kb_used_data":2764,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754730740,"statfs":{"total":773094113280,"available":772844277760,"internally_reserved":0,"allocated":2830336,"data_stored":1732122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.263583"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:48.515417+0000","last_change":"2024-09-12T00:01:48.515417+0000","last_active":"2024-09-12T00:01:48.515417+0000","last_peered":"2024-09-12T00:01:48.515417+0000","last_clean":"2024-09-12T00:01:48.515417+0000","last_became_active":"2024-09-12T00:01:46.502847+0000","last_became_peered":"2024-09-12T00:01:46.502847+0000","last_unstale":"2024-09-12T00:01:48.515417+0000","last_undegraded":"2024-09-12T00:01:48.515417+0000","last_fullsized":"2024-09-12T00:01:48.515417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:49.727360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:48.511291+0000","last_change":"2024-09-12T00:01:48.511519+0000","last_active":"2024-09-12T00:01:48.511291+0000","last_peered":"2024-09-12T00:01:48.511291+0000","last_clean":"2024-09-12T00:01:48.511291+0000","last_became_active":"2024-09-12T00:01:46.508144+0000","last_became_peered":"2024-09-12T00:01:46.508144+0000","last_unstale":"2024-09-12T00:01:48.511291+0000","last_undegraded":"2024-09-12T00:01:48.511291+0000","last_fullsized":"2024-09-12T00:01:48.511291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:13.771631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045024799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:48.515165+0000","last_change":"2024-09-12T00:01:48.515165+0000","last_active":"2024-09-12T00:01:48.515165+0000","last_peered":"2024-09-12T00:01:48.515165+0000","last_clean":"2024-09-12T00:01:48.515165+0000","last_became_active":"2024-09-12T00:01:46.505315+0000","last_became_peered":"2024-09-12T00:01:46.505315+0000","last_unstale":"2024-09-12T00:01:48.515165+0000","last_undegraded":"2024-09-12T00:01:48.515165+0000","last_fullsized":"2024-09-12T00:01:48.515165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:31.136294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079890600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:49.473220+0000","last_change":"2024-09-12T00:01:49.473468+0000","last_active":"2024-09-12T00:01:49.473220+0000","last_peered":"2024-09-12T00:01:49.473220+0000","last_clean":"2024-09-12T00:01:49.473220+0000","last_became_active":"2024-09-12T00:01:46.505954+0000","last_became_peered":"2024-09-12T00:01:46.505954+0000","last_unstale":"2024-09-12T00:01:49.473220+0000","last_undegraded":"2024-09-12T00:01:49.473220+0000","last_fullsized":"2024-09-12T00:01:49.473220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:03.543109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050498000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:48.516482+0000","last_change":"2024-09-12T00:01:48.515810+0000","last_active":"2024-09-12T00:01:48.516482+0000","last_peered":"2024-09-12T00:01:48.516482+0000","last_clean":"2024-09-12T00:01:48.516482+0000","last_became_active":"2024-09-12T00:01:46.502428+0000","last_became_peered":"2024-09-12T00:01:46.502428+0000","last_unstale":"2024-09-12T00:01:48.516482+0000","last_undegraded":"2024-09-12T00:01:48.516482+0000","last_fullsized":"2024-09-12T00:01:48.516482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:13.947790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001414925,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:50.044712+0000","last_change":"2024-09-12T00:01:50.044924+0000","last_active":"2024-09-12T00:01:50.044712+0000","last_peered":"2024-09-12T00:01:50.044712+0000","last_clean":"2024-09-12T00:01:50.044712+0000","last_became_active":"2024-09-12T00:01:46.505857+0000","last_became_peered":"2024-09-12T00:01:46.505857+0000","last_unstale":"2024-09-12T00:01:50.044712+0000","last_undegraded":"2024-09-12T00:01:50.044712+0000","last_fullsized":"2024-09-12T00:01:50.044712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:18.728534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039331300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:48.515091+0000","last_change":"2024-09-12T00:01:48.515091+0000","last_active":"2024-09-12T00:01:48.515091+0000","last_peered":"2024-09-12T00:01:48.515091+0000","last_clean":"2024-09-12T00:01:48.515091+0000","last_became_active":"2024-09-12T00:01:46.505677+0000","last_became_peered":"2024-09-12T00:01:46.505677+0000","last_unstale":"2024-09-12T00:01:48.515091+0000","last_undegraded":"2024-09-12T00:01:48.515091+0000","last_fullsized":"2024-09-12T00:01:48.515091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:07.430053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075102999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:48.515868+0000","last_change":"2024-09-12T00:01:48.515868+0000","last_active":"2024-09-12T00:01:48.515868+0000","last_peered":"2024-09-12T00:01:48.515868+0000","last_clean":"2024-09-12T00:01:48.515868+0000","last_became_active":"2024-09-12T00:01:46.613916+0000","last_became_peered":"2024-09-12T00:01:46.613916+0000","last_unstale":"2024-09-12T00:01:48.515868+0000","last_undegraded":"2024-09-12T00:01:48.515868+0000","last_fullsized":"2024-09-12T00:01:48.515868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:23.127685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014566500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":112,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:01:48.511083+0000","last_change":"2024-09-12T00:01:39.721517+0000","last_active":"2024-09-12T00:01:48.511083+0000","last_peered":"2024-09-12T00:01:48.511083+0000","last_clean":"2024-09-12T00:01:48.511083+0000","last_became_active":"2024-09-12T00:01:39.720425+0000","last_became_peered":"2024-09-12T00:01:39.720425+0000","last_unstale":"2024-09-12T00:01:48.511083+0000","last_undegraded":"2024-09-12T00:01:48.511083+0000","last_fullsized":"2024-09-12T00:01:48.511083+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:37.438834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:37.438834+0000","last_clean_scrub_stamp":"2024-09-12T00:01:37.438834+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:26.565085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31368,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340472,"statfs":{"total":96636764160,"available":96604643328,"internally_reserved":0,"allocated":184320,"data_stored":59515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":212992,"data_stored":71114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":790528,"data_stored":655631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":208896,"data_stored":71095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":661463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:01:53.270 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:01:53.270 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:01:53.270 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:01:53.270 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:01:53.623 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:01:53.624 INFO:teuthology.orchestra.run.smithi067.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:01:53.637 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:01:53.637 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T00:01:53.676 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:01:53.771 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-12T00:01:53.771 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:01:53.771 INFO:tasks.rgw:Creating data pools 2024-09-12T00:01:53.771 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:01:53.772 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-12T00:01:54.546 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T00:01:56.122 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:01:56.141 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:01:57.118 INFO:teuthology.orchestra.run.smithi067.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:01:57.164 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:01:58.130 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:01:58.152 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:01:59.128 INFO:teuthology.orchestra.run.smithi067.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:01:59.165 DEBUG:tasks.rgw:Pools created 2024-09-12T00:01:59.165 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T00:01:59.165 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:01:59.165 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:01:59.165 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:01:59.287 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:01:59.288 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:02:01.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.182+0000 7f2434e30640 0 -- 172.21.15.67:0/1210188357 >> [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] conn(0x7f2310076380 msgr2=0x7f2310078840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:02:01.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.187+0000 7f2437346800 20 rados->read ofs=0 len=0 2024-09-12T00:02:01.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.189+0000 7f2435631640 0 -- 172.21.15.67:0/1168010933 >> [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] conn(0x7f22fc076470 msgr2=0x7f22fc078930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:02:01.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.190+0000 7f2437346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:01.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.190+0000 7f2437346800 20 realm 2024-09-12T00:02:01.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.190+0000 7f2437346800 20 rados->read ofs=0 len=0 2024-09-12T00:02:01.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.190+0000 7f2437346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:01.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.190+0000 7f2437346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:02:01.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.190+0000 7f2437346800 20 rados->read ofs=0 len=0 2024-09-12T00:02:01.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.190+0000 7f2437346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:01.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.190+0000 7f2437346800 20 rados->read ofs=0 len=0 2024-09-12T00:02:01.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.191+0000 7f2437346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:02:01.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.191+0000 7f2437346800 20 rados->read ofs=0 len=0 2024-09-12T00:02:01.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.192+0000 7f2437346800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:02:01.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.192+0000 7f2437346800 20 searching for the correct realm 2024-09-12T00:02:01.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.203+0000 7f2437346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:02:01.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.203+0000 7f2437346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:02:01.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.203+0000 7f2437346800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:02:01.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.203+0000 7f2437346800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:02:01.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.203+0000 7f2437346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:02:01.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.203+0000 7f2437346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:02:01.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.203+0000 7f2437346800 20 rados->read ofs=0 len=0 2024-09-12T00:02:01.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.203+0000 7f2437346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:01.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.203+0000 7f2437346800 20 rados->read ofs=0 len=0 2024-09-12T00:02:01.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.204+0000 7f2437346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:02:01.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.204+0000 7f2437346800 20 rados->read ofs=0 len=0 2024-09-12T00:02:01.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.204+0000 7f2437346800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:02:01.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.204+0000 7f2437346800 20 zone default found 2024-09-12T00:02:01.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.204+0000 7f2437346800 4 Realm: () 2024-09-12T00:02:01.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.204+0000 7f2437346800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:02:01.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.204+0000 7f2437346800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:02:01.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.204+0000 7f2437346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:02:01.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.204+0000 7f2437346800 20 zonegroup default 2024-09-12T00:02:01.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.204+0000 7f2437346800 20 rados->read ofs=0 len=0 2024-09-12T00:02:01.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.204+0000 7f2437346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:01.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:01.204+0000 7f2437346800 20 rados->read ofs=0 len=0 2024-09-12T00:02:03.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:03.150+0000 7f2437346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:03.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:03.150+0000 7f2437346800 20 rados->read ofs=0 len=0 2024-09-12T00:02:03.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:03.154+0000 7f2437346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:03.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:03.154+0000 7f2437346800 20 started sync module instance, tier type = 2024-09-12T00:02:03.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:03.154+0000 7f2437346800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:02:05.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.186+0000 7f2437346800 20 add_watcher() i=0 2024-09-12T00:02:05.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.186+0000 7f2437346800 20 add_watcher() i=1 2024-09-12T00:02:05.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.186+0000 7f2437346800 20 add_watcher() i=2 2024-09-12T00:02:05.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.186+0000 7f2437346800 20 add_watcher() i=3 2024-09-12T00:02:05.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.186+0000 7f2437346800 20 add_watcher() i=4 2024-09-12T00:02:05.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.186+0000 7f2437346800 20 add_watcher() i=5 2024-09-12T00:02:05.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.186+0000 7f2437346800 20 add_watcher() i=6 2024-09-12T00:02:05.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.187+0000 7f2437346800 20 add_watcher() i=7 2024-09-12T00:02:05.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.187+0000 7f2437346800 2 all 8 watchers are set, enabling cache 2024-09-12T00:02:05.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.188+0000 7f2437346800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T00:02:05.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.188+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T00:02:05.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.188+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.188+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T00:02:05.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.188+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T00:02:05.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.188+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.188+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T00:02:05.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.188+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T00:02:05.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.188+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.189+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T00:02:05.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.189+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T00:02:05.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.189+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.189+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T00:02:05.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.189+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T00:02:05.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.189+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.190+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T00:02:05.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.190+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T00:02:05.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.190+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.190+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T00:02:05.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.190+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T00:02:05.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.190+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.190+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T00:02:05.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.190+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T00:02:05.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.190+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.190+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T00:02:05.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.190+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T00:02:05.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.190+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.191+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T00:02:05.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.191+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T00:02:05.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.191+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.191+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T00:02:05.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.191+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T00:02:05.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.191+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.191+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T00:02:05.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.191+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T00:02:05.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.191+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.191+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T00:02:05.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.191+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T00:02:05.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.191+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.192+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T00:02:05.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.192+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T00:02:05.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.192+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.192+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T00:02:05.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.192+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T00:02:05.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.192+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.192+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T00:02:05.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.192+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T00:02:05.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.192+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.192+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T00:02:05.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.192+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T00:02:05.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.192+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.193+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T00:02:05.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.193+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T00:02:05.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.193+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.193+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T00:02:05.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.193+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T00:02:05.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.193+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.193+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T00:02:05.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.193+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T00:02:05.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.193+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.193+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T00:02:05.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.193+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T00:02:05.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.193+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.194+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T00:02:05.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.194+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T00:02:05.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.194+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.194+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T00:02:05.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.194+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T00:02:05.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.194+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.194+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T00:02:05.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.194+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T00:02:05.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.194+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.195+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T00:02:05.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.195+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T00:02:05.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.195+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.195+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T00:02:05.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.195+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T00:02:05.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.195+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.195+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T00:02:05.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.195+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T00:02:05.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.195+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.195+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T00:02:05.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.195+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T00:02:05.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.195+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.196+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T00:02:05.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.196+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T00:02:05.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.196+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.196+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T00:02:05.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.196+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T00:02:05.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.196+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.196+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T00:02:05.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.196+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T00:02:05.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.196+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.197+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T00:02:05.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.197+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T00:02:05.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.197+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.197+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T00:02:05.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.197+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T00:02:05.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.197+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.197+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T00:02:05.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.197+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T00:02:05.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.197+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.197+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T00:02:05.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.197+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T00:02:05.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.197+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.198+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T00:02:05.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.198+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T00:02:05.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.198+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.198+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T00:02:05.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.198+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T00:02:05.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.198+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.198+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T00:02:05.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.198+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T00:02:05.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.198+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.199+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T00:02:05.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.199+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T00:02:05.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.199+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.199+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T00:02:05.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.199+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T00:02:05.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.199+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.199+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T00:02:05.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.199+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T00:02:05.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.199+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.199+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T00:02:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.199+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T00:02:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.199+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.200+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T00:02:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.200+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T00:02:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.200+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.200+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T00:02:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.200+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T00:02:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.200+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.200+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T00:02:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.200+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T00:02:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.200+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.200+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T00:02:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.200+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T00:02:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.200+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.201+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T00:02:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.201+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T00:02:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.201+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.201+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T00:02:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.201+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T00:02:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.201+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.201+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T00:02:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.201+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T00:02:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.201+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.202+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T00:02:05.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.202+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T00:02:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.202+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.202+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T00:02:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.202+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T00:02:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.202+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.202+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T00:02:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.202+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T00:02:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.202+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.202+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T00:02:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.202+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T00:02:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.202+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.203+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T00:02:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.203+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T00:02:05.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.203+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.203+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T00:02:05.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.203+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T00:02:05.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.203+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.203+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T00:02:05.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.203+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T00:02:05.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.203+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.203+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T00:02:05.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.203+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T00:02:05.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.203+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.204+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T00:02:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.204+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T00:02:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.204+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.204+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T00:02:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.204+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T00:02:05.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.204+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.204+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T00:02:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.204+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T00:02:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.204+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.205+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T00:02:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.205+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T00:02:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.205+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.205+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T00:02:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.205+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T00:02:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.205+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.205+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T00:02:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.205+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T00:02:05.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.205+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.205+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T00:02:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.205+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T00:02:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.205+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.206+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T00:02:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.206+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T00:02:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.206+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.206+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T00:02:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.206+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T00:02:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.206+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.206+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T00:02:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.206+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T00:02:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.206+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.207+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T00:02:05.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.207+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T00:02:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.207+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.207+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T00:02:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.207+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T00:02:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.207+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.207+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T00:02:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.207+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T00:02:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.207+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.207+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T00:02:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.207+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T00:02:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.207+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.208+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T00:02:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.208+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T00:02:05.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.208+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.208+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T00:02:05.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.208+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T00:02:05.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.208+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.208+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T00:02:05.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.208+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T00:02:05.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.208+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.208+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T00:02:05.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.208+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T00:02:05.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.208+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.209+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T00:02:05.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.209+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T00:02:05.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.209+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.209+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T00:02:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.209+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T00:02:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.209+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.209+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T00:02:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.209+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T00:02:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.209+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.209+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T00:02:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.209+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T00:02:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.209+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.210+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T00:02:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.210+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T00:02:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.210+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.210+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T00:02:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.210+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T00:02:05.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.210+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.210+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T00:02:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.210+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T00:02:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.210+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.211+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T00:02:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.211+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T00:02:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.211+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.211+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T00:02:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.211+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T00:02:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.211+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.211+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T00:02:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.211+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T00:02:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.211+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.211+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T00:02:05.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.211+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T00:02:05.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.211+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.212+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T00:02:05.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.212+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T00:02:05.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.212+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.212+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T00:02:05.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.212+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T00:02:05.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.212+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.212+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T00:02:05.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.212+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T00:02:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.212+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.213+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T00:02:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.213+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T00:02:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.213+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.213+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T00:02:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.213+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T00:02:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.213+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.213+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T00:02:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.213+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T00:02:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.213+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.214+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T00:02:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.214+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T00:02:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.214+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.214+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T00:02:05.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.214+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T00:02:05.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.214+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.215+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T00:02:05.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.215+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T00:02:05.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.215+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.215+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T00:02:05.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.215+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T00:02:05.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.215+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.215+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T00:02:05.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.215+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T00:02:05.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.215+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.215+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T00:02:05.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.215+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T00:02:05.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.215+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.216+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T00:02:05.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.216+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T00:02:05.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.216+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.216+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T00:02:05.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.216+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T00:02:05.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.216+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.216+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T00:02:05.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.216+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T00:02:05.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.216+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.216+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T00:02:05.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.216+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T00:02:05.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.216+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.217+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T00:02:05.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.217+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T00:02:05.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.217+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.217+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T00:02:05.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.217+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T00:02:05.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.217+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.217+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T00:02:05.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.217+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T00:02:05.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.217+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.217+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T00:02:05.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.217+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T00:02:05.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.217+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.218+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T00:02:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.218+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T00:02:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.218+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.218+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T00:02:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.218+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T00:02:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.218+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.218+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T00:02:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.218+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T00:02:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.218+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.219+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T00:02:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.219+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T00:02:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.219+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.219+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T00:02:05.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.219+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T00:02:05.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.219+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.219+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T00:02:05.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.219+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T00:02:05.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.219+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.220+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T00:02:05.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.220+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T00:02:05.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.220+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.220+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T00:02:05.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.220+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T00:02:05.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.220+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.220+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T00:02:05.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.220+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T00:02:05.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.220+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.220+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T00:02:05.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.220+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T00:02:05.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.220+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.221+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T00:02:05.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.221+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T00:02:05.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.221+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.221+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T00:02:05.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.221+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T00:02:05.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.221+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.221+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T00:02:05.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.221+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T00:02:05.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.221+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.221+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T00:02:05.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.221+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T00:02:05.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.221+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.222+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T00:02:05.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.222+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T00:02:05.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.222+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.222+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T00:02:05.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.222+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T00:02:05.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.222+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.222+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T00:02:05.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.222+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T00:02:05.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.222+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.222+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T00:02:05.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.222+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T00:02:05.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.222+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.223+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T00:02:05.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.223+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T00:02:05.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.223+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.223+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T00:02:05.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.223+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T00:02:05.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.223+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.223+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T00:02:05.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.223+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T00:02:05.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.223+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.223+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T00:02:05.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.223+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T00:02:05.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.223+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.224+0000 7f2437346800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T00:02:05.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.224+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T00:02:05.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.225+0000 7f2437346800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:02:05.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.232+0000 7f22e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:02:05.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.232+0000 7f2437346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:02:05.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:05.232+0000 7f2437346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:02:08.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.157+0000 7f2437346800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T00:02:08.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.157+0000 7f2437346800 5 note: GC not initialized 2024-09-12T00:02:08.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.158+0000 7f2437346800 20 init_complete bucket index max shards: 1 2024-09-12T00:02:08.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.158+0000 7f22e5fe3640 20 reqs_thread_entry: start 2024-09-12T00:02:08.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.158+0000 7f2437346800 20 Filter name: none 2024-09-12T00:02:08.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.158+0000 7f22477fe640 20 reqs_thread_entry: start 2024-09-12T00:02:08.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.187+0000 7f22e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:02:08.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.190+0000 7f2437346800 20 remove_watcher() i=0 2024-09-12T00:02:08.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.190+0000 7f2437346800 2 removed watcher, disabling cache 2024-09-12T00:02:08.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.191+0000 7f2437346800 20 remove_watcher() i=1 2024-09-12T00:02:08.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.193+0000 7f2437346800 20 remove_watcher() i=2 2024-09-12T00:02:08.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.194+0000 7f2437346800 20 remove_watcher() i=3 2024-09-12T00:02:08.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.196+0000 7f2437346800 20 remove_watcher() i=4 2024-09-12T00:02:08.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.197+0000 7f2437346800 20 remove_watcher() i=5 2024-09-12T00:02:08.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.198+0000 7f2437346800 20 remove_watcher() i=6 2024-09-12T00:02:08.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.200+0000 7f2437346800 20 remove_watcher() i=7 2024-09-12T00:02:08.213 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-12T00:02:08.213 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:02:08.213 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:02:08.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:02:08.214 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T00:02:08.281 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:02:08.281 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:02:08.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.309+0000 7f5913814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:02:08.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.309+0000 7f5913814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:02:08.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.313+0000 7f57bcff9640 20 reqs_thread_entry: start 2024-09-12T00:02:08.330 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"ac196c0a-dca9-437f-ae63-d6980c8d425b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:02:08.330 DEBUG:tasks.util.rgw: json result: {'id': 'ac196c0a-dca9-437f-ae63-d6980c8d425b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:02:08.330 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:02:08.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:02:08.331 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:02:08.388 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:02:08.389 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:02:08.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.424+0000 7f5ae3c11800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.426+0000 7f5ae3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:08.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.426+0000 7f5ae3c11800 20 realm 2024-09-12T00:02:08.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.426+0000 7f5ae3c11800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.426+0000 7f5ae3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:08.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.426+0000 7f5ae3c11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:02:08.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.426+0000 7f5ae3c11800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.427+0000 7f5ae3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:08.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.427+0000 7f5ae3c11800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.427+0000 7f5ae3c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:02:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.427+0000 7f5ae3c11800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.428+0000 7f5ae3c11800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:02:08.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.428+0000 7f5ae3c11800 20 searching for the correct realm 2024-09-12T00:02:08.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.431+0000 7f5adeb21640 0 -- 172.21.15.67:0/3704051314 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f5ad4063880 msgr2=0x7f5ad40987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:02:08.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.637+0000 7f5adfb23640 0 -- 172.21.15.67:0/3704051314 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x561c9d1d4000 msgr2=0x561c9d1d64c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:02:08.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.642+0000 7f5ae3c11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:02:08.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.642+0000 7f5ae3c11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:02:08.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.642+0000 7f5ae3c11800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:02:08.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.642+0000 7f5ae3c11800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:02:08.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.642+0000 7f5ae3c11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:02:08.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.642+0000 7f5ae3c11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:02:08.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.642+0000 7f5ae3c11800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.642+0000 7f5ae3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:08.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.642+0000 7f5ae3c11800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.643+0000 7f5ae3c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:02:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.643+0000 7f5ae3c11800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.643+0000 7f5ae3c11800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:02:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.643+0000 7f5ae3c11800 20 zone default found 2024-09-12T00:02:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.643+0000 7f5ae3c11800 4 Realm: () 2024-09-12T00:02:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.643+0000 7f5ae3c11800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:02:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.643+0000 7f5ae3c11800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:02:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.643+0000 7f5ae3c11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:02:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.643+0000 7f5ae3c11800 20 zonegroup default 2024-09-12T00:02:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.643+0000 7f5ae3c11800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.643+0000 7f5ae3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.643+0000 7f5ae3c11800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.643+0000 7f5ae3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:08.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.643+0000 7f5ae3c11800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.644+0000 7f5ae3c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:08.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.644+0000 7f5ae3c11800 20 started sync module instance, tier type = 2024-09-12T00:02:08.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.644+0000 7f5ae3c11800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:02:08.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.658+0000 7f5ae3c11800 20 add_watcher() i=0 2024-09-12T00:02:08.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.658+0000 7f5ae3c11800 20 add_watcher() i=1 2024-09-12T00:02:08.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.658+0000 7f5ae3c11800 20 add_watcher() i=2 2024-09-12T00:02:08.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.658+0000 7f5ae3c11800 20 add_watcher() i=3 2024-09-12T00:02:08.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.659+0000 7f5ae3c11800 20 add_watcher() i=4 2024-09-12T00:02:08.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.659+0000 7f5ae3c11800 20 add_watcher() i=5 2024-09-12T00:02:08.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.659+0000 7f5ae3c11800 20 add_watcher() i=6 2024-09-12T00:02:08.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.660+0000 7f5ae3c11800 20 add_watcher() i=7 2024-09-12T00:02:08.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.660+0000 7f5ae3c11800 2 all 8 watchers are set, enabling cache 2024-09-12T00:02:08.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.662+0000 7f5995fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:02:08.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.662+0000 7f5ae3c11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:02:08.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.662+0000 7f5ae3c11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:02:08.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.662+0000 7f5ae3c11800 5 note: GC not initialized 2024-09-12T00:02:08.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.662+0000 7f5994fe1640 20 reqs_thread_entry: start 2024-09-12T00:02:08.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.662+0000 7f5ae3c11800 20 init_complete bucket index max shards: 1 2024-09-12T00:02:08.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.662+0000 7f5ae3c11800 20 Filter name: none 2024-09-12T00:02:08.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.663+0000 7f590e7fc640 20 reqs_thread_entry: start 2024-09-12T00:02:08.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.673+0000 7f5995fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:02:08.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.675+0000 7f5ae3c11800 20 remove_watcher() i=0 2024-09-12T00:02:08.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.675+0000 7f5ae3c11800 2 removed watcher, disabling cache 2024-09-12T00:02:08.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.677+0000 7f5ae3c11800 20 remove_watcher() i=1 2024-09-12T00:02:08.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.678+0000 7f5ae3c11800 20 remove_watcher() i=2 2024-09-12T00:02:08.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.680+0000 7f5ae3c11800 20 remove_watcher() i=3 2024-09-12T00:02:08.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.681+0000 7f5ae3c11800 20 remove_watcher() i=4 2024-09-12T00:02:08.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.682+0000 7f5ae3c11800 20 remove_watcher() i=5 2024-09-12T00:02:08.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.684+0000 7f5ae3c11800 20 remove_watcher() i=6 2024-09-12T00:02:08.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.685+0000 7f5ae3c11800 20 remove_watcher() i=7 2024-09-12T00:02:08.695 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-12T00:02:08.695 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:02:08.695 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:02:08.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:02:08.696 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T00:02:08.759 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:02:08.759 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:02:08.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.787+0000 7f43c92b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:02:08.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.787+0000 7f43c92b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:02:08.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.791+0000 7f42897e2640 20 reqs_thread_entry: start 2024-09-12T00:02:08.807 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"ac196c0a-dca9-437f-ae63-d6980c8d425b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:02:08.808 DEBUG:tasks.util.rgw: json result: {'id': 'ac196c0a-dca9-437f-ae63-d6980c8d425b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:02:08.808 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:02:08.808 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:02:08.808 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:02:08.865 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:02:08.866 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:02:08.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.902+0000 7f9a5ba96800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.904+0000 7f9a5ba96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:08.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.904+0000 7f9a5ba96800 20 realm 2024-09-12T00:02:08.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.904+0000 7f9a5ba96800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.904+0000 7f9a5ba96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:08.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.904+0000 7f9a5ba96800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:02:08.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.904+0000 7f9a5ba96800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.904+0000 7f9a5ba96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:08.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.904+0000 7f9a5ba96800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.905+0000 7f9a5ba96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:02:08.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.905+0000 7f9a5ba96800 20 rados->read ofs=0 len=0 2024-09-12T00:02:08.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.906+0000 7f9a5ba96800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:02:08.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.906+0000 7f9a5ba96800 20 searching for the correct realm 2024-09-12T00:02:08.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.907+0000 7f9a59d81640 0 -- 172.21.15.67:0/1755975994 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55c98eb64770 msgr2=0x55c98eb66c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:02:08.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:08.911+0000 7f9a59d81640 0 -- 172.21.15.67:0/1755975994 >> [v2:172.21.15.170:6824/783534599,v1:172.21.15.170:6825/783534599] conn(0x7f9a4c08c920 msgr2=0x7f9a4c02d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:02:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.119+0000 7f9a5ba96800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:02:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.119+0000 7f9a5ba96800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:02:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.119+0000 7f9a5ba96800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:02:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.119+0000 7f9a5ba96800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:02:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.119+0000 7f9a5ba96800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:02:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.119+0000 7f9a5ba96800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:02:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.119+0000 7f9a5ba96800 20 rados->read ofs=0 len=0 2024-09-12T00:02:09.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.119+0000 7f9a5ba96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:09.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.119+0000 7f9a5ba96800 20 rados->read ofs=0 len=0 2024-09-12T00:02:09.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.120+0000 7f9a5ba96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:02:09.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.120+0000 7f9a5ba96800 20 rados->read ofs=0 len=0 2024-09-12T00:02:09.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.120+0000 7f9a5ba96800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:02:09.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.120+0000 7f9a5ba96800 20 zone default found 2024-09-12T00:02:09.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.120+0000 7f9a5ba96800 4 Realm: () 2024-09-12T00:02:09.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.120+0000 7f9a5ba96800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:02:09.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.120+0000 7f9a5ba96800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:02:09.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.120+0000 7f9a5ba96800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:02:09.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.120+0000 7f9a5ba96800 20 zonegroup default 2024-09-12T00:02:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.120+0000 7f9a5ba96800 20 rados->read ofs=0 len=0 2024-09-12T00:02:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.120+0000 7f9a5ba96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.120+0000 7f9a5ba96800 20 rados->read ofs=0 len=0 2024-09-12T00:02:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.121+0000 7f9a5ba96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.121+0000 7f9a5ba96800 20 rados->read ofs=0 len=0 2024-09-12T00:02:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.121+0000 7f9a5ba96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:02:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.121+0000 7f9a5ba96800 20 started sync module instance, tier type = 2024-09-12T00:02:09.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.121+0000 7f9a5ba96800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:02:09.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.131+0000 7f9a5ba96800 20 add_watcher() i=0 2024-09-12T00:02:09.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.131+0000 7f9a5ba96800 20 add_watcher() i=1 2024-09-12T00:02:09.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.131+0000 7f9a5ba96800 20 add_watcher() i=2 2024-09-12T00:02:09.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.131+0000 7f9a5ba96800 20 add_watcher() i=3 2024-09-12T00:02:09.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.131+0000 7f9a5ba96800 20 add_watcher() i=4 2024-09-12T00:02:09.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.131+0000 7f9a5ba96800 20 add_watcher() i=5 2024-09-12T00:02:09.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.131+0000 7f9a5ba96800 20 add_watcher() i=6 2024-09-12T00:02:09.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.132+0000 7f9a5ba96800 20 add_watcher() i=7 2024-09-12T00:02:09.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.132+0000 7f9a5ba96800 2 all 8 watchers are set, enabling cache 2024-09-12T00:02:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.134+0000 7f990f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:02:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.135+0000 7f9a5ba96800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:02:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.135+0000 7f9a5ba96800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:02:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.135+0000 7f9a5ba96800 5 note: GC not initialized 2024-09-12T00:02:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.135+0000 7f990e7e4640 20 reqs_thread_entry: start 2024-09-12T00:02:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.135+0000 7f9a5ba96800 20 init_complete bucket index max shards: 1 2024-09-12T00:02:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.135+0000 7f9a5ba96800 20 Filter name: none 2024-09-12T00:02:09.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.135+0000 7f987ffff640 20 reqs_thread_entry: start 2024-09-12T00:02:09.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.145+0000 7f990f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:02:09.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.148+0000 7f9a5ba96800 20 remove_watcher() i=0 2024-09-12T00:02:09.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.148+0000 7f9a5ba96800 2 removed watcher, disabling cache 2024-09-12T00:02:09.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.149+0000 7f9a5ba96800 20 remove_watcher() i=1 2024-09-12T00:02:09.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.150+0000 7f9a5ba96800 20 remove_watcher() i=2 2024-09-12T00:02:09.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.151+0000 7f9a5ba96800 20 remove_watcher() i=3 2024-09-12T00:02:09.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.152+0000 7f9a5ba96800 20 remove_watcher() i=4 2024-09-12T00:02:09.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.153+0000 7f9a5ba96800 20 remove_watcher() i=5 2024-09-12T00:02:09.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.155+0000 7f9a5ba96800 20 remove_watcher() i=6 2024-09-12T00:02:09.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.156+0000 7f9a5ba96800 20 remove_watcher() i=7 2024-09-12T00:02:09.167 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2024-09-12T00:02:09.168 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:02:09.168 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T00:02:09.168 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:02:09.168 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:02:09.168 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T00:02:09.232 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:02:09.233 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:02:09.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.260+0000 7ff1db336800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:02:09.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.260+0000 7ff1db336800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:02:09.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.264+0000 7ff05dffb640 20 reqs_thread_entry: start 2024-09-12T00:02:09.278 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T00:02:09.279 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T00:02:09.279 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:02:09.279 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:02:09.279 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T00:02:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:02:09.345 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:02:09.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.374+0000 7f7669210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:02:09.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.374+0000 7f7669210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:02:09.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.379+0000 7f74aaffd640 20 reqs_thread_entry: start 2024-09-12T00:02:09.395 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"ac196c0a-dca9-437f-ae63-d6980c8d425b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:02:09.395 DEBUG:tasks.util.rgw: json result: {'id': 'ac196c0a-dca9-437f-ae63-d6980c8d425b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:02:09.396 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T00:02:09.396 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:02:09.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:02:09.396 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T00:02:09.460 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:02:09.460 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:02:09.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.488+0000 7f2334420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:02:09.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.488+0000 7f2334420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:02:09.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.492+0000 7f2167fff640 20 reqs_thread_entry: start 2024-09-12T00:02:09.506 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T00:02:09.506 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T00:02:09.506 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:02:09.506 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:02:09.507 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T00:02:09.573 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:02:09.573 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:02:09.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.600+0000 7feae9f3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:02:09.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.600+0000 7feae9f3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:02:09.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:02:09.605+0000 7fe9a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:02:09.620 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"ac196c0a-dca9-437f-ae63-d6980c8d425b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:02:09.621 DEBUG:tasks.util.rgw: json result: {'id': 'ac196c0a-dca9-437f-ae63-d6980c8d425b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:02:09.621 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:02:09.621 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-12T00:02:09.621 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:02:09.622 DEBUG:teuthology.orchestra.run.smithi067:> sudo echo -n http://smithi067.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:02:09.662 INFO:teuthology.orchestra.run.smithi067.stdout:http://smithi067.front.sepia.ceph.com:80 2024-09-12T00:02:09.663 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:02:09.743 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:02:09.743 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:02:09.786 INFO:tasks.rgw.client.0:Started 2024-09-12T00:02:09.786 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi067.front.sepia.ceph.com:80/ 2024-09-12T00:02:09.787 DEBUG:teuthology.orchestra.run.smithi067:> curl http://smithi067.front.sepia.ceph.com:80/ 2024-09-12T00:02:09.825 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:02:09.825 INFO:teuthology.orchestra.run.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:02:09.826 INFO:teuthology.orchestra.run.smithi067.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:02:09.826 INFO:teuthology.orchestra.run.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:02:09.826 INFO:teuthology.orchestra.run.smithi067.stderr:curl: (7) Failed to connect to smithi067.front.sepia.ceph.com port 80: Connection refused 2024-09-12T00:02:10.827 DEBUG:teuthology.orchestra.run.smithi067:> curl http://smithi067.front.sepia.ceph.com:80/ 2024-09-12T00:02:10.862 INFO:teuthology.orchestra.run.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:02:10.862 INFO:teuthology.orchestra.run.smithi067.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:02:10.864 INFO:teuthology.orchestra.run.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-09-12T00:02:10.864 INFO:teuthology.orchestra.run.smithi067.stdout:anonymous 2024-09-12T00:02:10.864 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T00:02:10.875 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T00:02:10.875 DEBUG:teuthology.orchestra.run.smithi067:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T00:02:13.284 DEBUG:teuthology.orchestra.run.smithi067:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T00:02:13.820 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting tox==3.15.0 2024-09-12T00:02:13.884 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T00:02:14.037 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting packaging>=14 2024-09-12T00:02:14.052 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T00:02:14.134 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting six<2,>=1.14.0 2024-09-12T00:02:14.148 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:02:14.276 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T00:02:14.276 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T00:02:14.390 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T00:02:14.415 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T00:02:14.679 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T00:02:14.696 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T00:02:14.958 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting py<2,>=1.4.17 2024-09-12T00:02:14.973 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T00:02:15.056 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting toml>=0.9.4 2024-09-12T00:02:15.070 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T00:02:15.214 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T00:02:15.229 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T00:02:15.318 INFO:teuthology.orchestra.run.smithi067.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T00:02:15.338 INFO:teuthology.orchestra.run.smithi067.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T00:02:15.475 INFO:teuthology.orchestra.run.smithi067.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-12T00:02:16.316 INFO:teuthology.orchestra.run.smithi067.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T00:02:16.522 INFO:teuthology.orchestra.run.smithi067.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-12T00:02:16.522 INFO:teuthology.orchestra.run.smithi067.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-12T00:02:16.585 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:02:16.649 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:02:16.650 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:02:16.650 DEBUG:teuthology.orchestra.run.smithi067:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:02:16.680 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:02:16.680 INFO:teuthology.orchestra.run.smithi067.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:02:16.680 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:02:16.751 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:02:16.751 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:02:16.820 INFO:tasks.workunit:timeout=3h 2024-09-12T00:02:16.820 INFO:tasks.workunit:cleanup=True 2024-09-12T00:02:16.821 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:02:16.891 INFO:tasks.workunit.client.0.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:03:03.845 INFO:tasks.workunit.client.0.smithi067.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:03:03.846 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:03.846 INFO:tasks.workunit.client.0.smithi067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:03:03.846 INFO:tasks.workunit.client.0.smithi067.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:03:03.846 INFO:tasks.workunit.client.0.smithi067.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:03:03.846 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:03.847 INFO:tasks.workunit.client.0.smithi067.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:03:03.847 INFO:tasks.workunit.client.0.smithi067.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:03:03.847 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:03.847 INFO:tasks.workunit.client.0.smithi067.stderr: git switch -c 2024-09-12T00:03:03.847 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:03.847 INFO:tasks.workunit.client.0.smithi067.stderr:Or undo this operation with: 2024-09-12T00:03:03.847 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:03.847 INFO:tasks.workunit.client.0.smithi067.stderr: git switch - 2024-09-12T00:03:03.847 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:03.847 INFO:tasks.workunit.client.0.smithi067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:03:03.847 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:03.848 INFO:tasks.workunit.client.0.smithi067.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:03:03.849 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:03:03.932 INFO:tasks.workunit.client.0.smithi067.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:03:03.934 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:03:03.934 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:03:04.515 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:03:04.582 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:03:04.623 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:03:04.624 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:03:04.624 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:03:04.664 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:03:04.667 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:03:04.667 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:03:04.738 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T00:03:04.739 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T00:03:04.739 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:03:04.812 INFO:tasks.workunit.client.0.smithi067.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:03:04.813 INFO:tasks.workunit.client.0.smithi067.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:03:04.813 INFO:tasks.workunit.client.0.smithi067.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:03:07.178 INFO:tasks.workunit.client.0.smithi067.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:03:07.178 INFO:tasks.workunit.client.0.smithi067.stderr:++ deactivate nondestructive 2024-09-12T00:03:07.178 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T00:03:07.178 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T00:03:07.178 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:03:07.178 INFO:tasks.workunit.client.0.smithi067.stderr:++ hash -r 2024-09-12T00:03:07.178 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T00:03:07.179 INFO:tasks.workunit.client.0.smithi067.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:03:07.179 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:03:07.179 INFO:tasks.workunit.client.0.smithi067.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:03:07.180 INFO:tasks.workunit.client.0.smithi067.stderr:++ export VIRTUAL_ENV 2024-09-12T00:03:07.180 INFO:tasks.workunit.client.0.smithi067.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:03:07.180 INFO:tasks.workunit.client.0.smithi067.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:03:07.180 INFO:tasks.workunit.client.0.smithi067.stderr:++ export PATH 2024-09-12T00:03:07.180 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T00:03:07.180 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -z '' ']' 2024-09-12T00:03:07.180 INFO:tasks.workunit.client.0.smithi067.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:03:07.180 INFO:tasks.workunit.client.0.smithi067.stderr:++ PS1='(rgw) ' 2024-09-12T00:03:07.181 INFO:tasks.workunit.client.0.smithi067.stderr:++ export PS1 2024-09-12T00:03:07.181 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:03:07.181 INFO:tasks.workunit.client.0.smithi067.stderr:++ hash -r 2024-09-12T00:03:07.181 INFO:tasks.workunit.client.0.smithi067.stderr:+ pip install pip --upgrade 2024-09-12T00:03:07.418 INFO:tasks.workunit.client.0.smithi067.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:03:07.600 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting pip 2024-09-12T00:03:07.653 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:03:07.812 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: pip 2024-09-12T00:03:07.812 INFO:tasks.workunit.client.0.smithi067.stdout: Attempting uninstall: pip 2024-09-12T00:03:07.812 INFO:tasks.workunit.client.0.smithi067.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:03:07.979 INFO:tasks.workunit.client.0.smithi067.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:03:07.984 INFO:tasks.workunit.client.0.smithi067.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:03:08.756 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed pip-24.2 2024-09-12T00:03:08.977 INFO:tasks.workunit.client.0.smithi067.stderr:+ pip install boto3 2024-09-12T00:03:09.903 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting boto3 2024-09-12T00:03:09.947 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:03:10.581 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:03:10.596 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:03:10.743 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:03:10.758 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:03:10.882 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:03:10.897 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:03:11.026 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:03:11.041 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:03:11.189 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:03:11.204 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:03:11.482 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:03:11.496 INFO:tasks.workunit.client.0.smithi067.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:03:11.543 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:03:11.625 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:03:11.847 INFO:tasks.workunit.client.0.smithi067.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 59.2 MB/s eta 0:00:00 2024-09-12T00:03:11.863 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:03:11.926 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:03:11.994 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:03:12.061 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:03:12.128 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:03:12.260 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:03:13.411 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:03:13.526 INFO:tasks.workunit.client.0.smithi067.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T00:03:13.664 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T00:03:13.700 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:13.700 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:13.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.741+0000 7f9965d19800 20 rados->read ofs=0 len=0 2024-09-12T00:03:13.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.743+0000 7f9965d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:13.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.743+0000 7f9965d19800 20 realm 2024-09-12T00:03:13.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.743+0000 7f9965d19800 20 rados->read ofs=0 len=0 2024-09-12T00:03:13.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.743+0000 7f9965d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:13.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.743+0000 7f9965d19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:13.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.743+0000 7f9965d19800 20 rados->read ofs=0 len=0 2024-09-12T00:03:13.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.743+0000 7f9965d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:13.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.743+0000 7f9965d19800 20 rados->read ofs=0 len=0 2024-09-12T00:03:13.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.744+0000 7f9965d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:13.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.744+0000 7f9965d19800 20 rados->read ofs=0 len=0 2024-09-12T00:03:13.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.745+0000 7f9965d19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:13.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.745+0000 7f9965d19800 20 searching for the correct realm 2024-09-12T00:03:13.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.749+0000 7f9964004640 0 -- 172.21.15.67:0/3279689178 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7f9958040020 msgr2=0x7f995806a850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:13.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.752+0000 7f9963803640 0 -- 172.21.15.67:0/3279689178 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f995c069ee0 msgr2=0x7f995c05fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:13.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:13.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 20 rados->read ofs=0 len=0 2024-09-12T00:03:13.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:13.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 20 rados->read ofs=0 len=0 2024-09-12T00:03:13.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:13.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 20 rados->read ofs=0 len=0 2024-09-12T00:03:13.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:13.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 20 zone default found 2024-09-12T00:03:13.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 4 Realm: () 2024-09-12T00:03:13.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:13.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:13.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:13.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 20 zonegroup default 2024-09-12T00:03:13.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.757+0000 7f9965d19800 20 rados->read ofs=0 len=0 2024-09-12T00:03:13.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.758+0000 7f9965d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:13.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.758+0000 7f9965d19800 20 rados->read ofs=0 len=0 2024-09-12T00:03:13.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.758+0000 7f9965d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:13.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.758+0000 7f9965d19800 20 rados->read ofs=0 len=0 2024-09-12T00:03:13.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.758+0000 7f9965d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:13.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.758+0000 7f9965d19800 20 started sync module instance, tier type = 2024-09-12T00:03:13.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.758+0000 7f9965d19800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.770+0000 7f9965d19800 20 add_watcher() i=0 2024-09-12T00:03:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.770+0000 7f9965d19800 20 add_watcher() i=1 2024-09-12T00:03:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.770+0000 7f9965d19800 20 add_watcher() i=2 2024-09-12T00:03:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.770+0000 7f9965d19800 20 add_watcher() i=3 2024-09-12T00:03:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.770+0000 7f9965d19800 20 add_watcher() i=4 2024-09-12T00:03:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.770+0000 7f9965d19800 20 add_watcher() i=5 2024-09-12T00:03:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.770+0000 7f9965d19800 20 add_watcher() i=6 2024-09-12T00:03:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.771+0000 7f9965d19800 20 add_watcher() i=7 2024-09-12T00:03:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.771+0000 7f9965d19800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:13.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.773+0000 7f9819fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.774+0000 7f9965d19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.774+0000 7f9965d19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.774+0000 7f9965d19800 5 note: GC not initialized 2024-09-12T00:03:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.774+0000 7f9818fe1640 20 reqs_thread_entry: start 2024-09-12T00:03:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.774+0000 7f9965d19800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.774+0000 7f9965d19800 20 Filter name: none 2024-09-12T00:03:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.774+0000 7f97927fc640 20 reqs_thread_entry: start 2024-09-12T00:03:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.774+0000 7f9965d19800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T00:03:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.774+0000 7f9965d19800 20 rados->read ofs=0 len=0 2024-09-12T00:03:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.775+0000 7f9965d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.775+0000 7f9965d19800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T00:03:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.775+0000 7f9965d19800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:03:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.775+0000 7f9965d19800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T00:03:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.775+0000 7f9965d19800 20 rados->read ofs=0 len=0 2024-09-12T00:03:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.775+0000 7f9965d19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.775+0000 7f9965d19800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T00:03:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.775+0000 7f9965d19800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:03:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.775+0000 7f9965d19800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:03:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.775+0000 7f9965d19800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:03:13.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.776+0000 7f9965d19800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:03:13.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.776+0000 7f9965d19800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:03:13.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.776+0000 7f9965d19800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T00:03:13.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.777+0000 7f9846ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 94296471102352 notifier 4547 bl.length()=593 2024-09-12T00:03:13.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.777+0000 7f9846ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:03:13.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.777+0000 7f9846ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:03:13.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.779+0000 7f9965d19800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:03:13.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.779+0000 7f9965d19800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:03:13.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.779+0000 7f9965d19800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T00:03:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.779+0000 7f9846ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 94296471095328 notifier 4547 bl.length()=186 2024-09-12T00:03:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.779+0000 7f9846ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:03:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.779+0000 7f9846ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:03:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.780+0000 7f9819fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:13.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.783+0000 7f9965d19800 20 remove_watcher() i=0 2024-09-12T00:03:13.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.783+0000 7f9965d19800 2 removed watcher, disabling cache 2024-09-12T00:03:13.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.784+0000 7f9965d19800 20 remove_watcher() i=1 2024-09-12T00:03:13.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.785+0000 7f9965d19800 20 remove_watcher() i=2 2024-09-12T00:03:13.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.786+0000 7f9965d19800 20 remove_watcher() i=3 2024-09-12T00:03:13.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.787+0000 7f9965d19800 20 remove_watcher() i=4 2024-09-12T00:03:13.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.788+0000 7f9965d19800 20 remove_watcher() i=5 2024-09-12T00:03:13.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.789+0000 7f9965d19800 20 remove_watcher() i=6 2024-09-12T00:03:13.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:13.790+0000 7f9965d19800 20 remove_watcher() i=7 2024-09-12T00:03:14.117 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T00:03:14.118 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:14.119 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:03:14.148 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:14.149 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:14.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.188+0000 7f12a2213800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.190+0000 7f12a2213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.190+0000 7f12a2213800 20 realm 2024-09-12T00:03:14.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.190+0000 7f12a2213800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.190+0000 7f12a2213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.190+0000 7f12a2213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:14.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.190+0000 7f12a2213800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.190+0000 7f12a2213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.190+0000 7f12a2213800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.191+0000 7f12a2213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:14.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.191+0000 7f12a2213800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.192+0000 7f12a2213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:14.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.192+0000 7f12a2213800 20 searching for the correct realm 2024-09-12T00:03:14.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.195+0000 7f129d147640 0 -- 172.21.15.67:0/3623548220 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f1294048b40 msgr2=0x7f1294061450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:14.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.199+0000 7f129d948640 0 -- 172.21.15.67:0/3623548220 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f1298061040 msgr2=0x7f1298055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:14.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.203+0000 7f12a2213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:14.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.203+0000 7f12a2213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:14.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.203+0000 7f12a2213800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:14.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.203+0000 7f12a2213800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:14.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.203+0000 7f12a2213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:14.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.203+0000 7f12a2213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:14.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.203+0000 7f12a2213800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.203+0000 7f12a2213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.203+0000 7f12a2213800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.203+0000 7f12a2213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:14.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.203+0000 7f12a2213800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.204+0000 7f12a2213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:14.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.204+0000 7f12a2213800 20 zone default found 2024-09-12T00:03:14.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.204+0000 7f12a2213800 4 Realm: () 2024-09-12T00:03:14.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.204+0000 7f12a2213800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:14.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.204+0000 7f12a2213800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:14.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.204+0000 7f12a2213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:14.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.204+0000 7f12a2213800 20 zonegroup default 2024-09-12T00:03:14.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.204+0000 7f12a2213800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.204+0000 7f12a2213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.204+0000 7f12a2213800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.204+0000 7f12a2213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.204+0000 7f12a2213800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.205+0000 7f12a2213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.205+0000 7f12a2213800 20 started sync module instance, tier type = 2024-09-12T00:03:14.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.205+0000 7f12a2213800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:14.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.213+0000 7f12a2213800 20 add_watcher() i=0 2024-09-12T00:03:14.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.213+0000 7f12a2213800 20 add_watcher() i=1 2024-09-12T00:03:14.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.213+0000 7f12a2213800 20 add_watcher() i=2 2024-09-12T00:03:14.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.213+0000 7f12a2213800 20 add_watcher() i=3 2024-09-12T00:03:14.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.213+0000 7f12a2213800 20 add_watcher() i=4 2024-09-12T00:03:14.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.213+0000 7f12a2213800 20 add_watcher() i=5 2024-09-12T00:03:14.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.213+0000 7f12a2213800 20 add_watcher() i=6 2024-09-12T00:03:14.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.214+0000 7f12a2213800 20 add_watcher() i=7 2024-09-12T00:03:14.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.214+0000 7f12a2213800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:14.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.216+0000 7f1153fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:14.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.216+0000 7f12a2213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:14.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.216+0000 7f12a2213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:14.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.216+0000 7f12a2213800 5 note: GC not initialized 2024-09-12T00:03:14.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.216+0000 7f1152fe5640 20 reqs_thread_entry: start 2024-09-12T00:03:14.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.216+0000 7f12a2213800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:14.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.216+0000 7f12a2213800 20 Filter name: none 2024-09-12T00:03:14.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.216+0000 7f1150fe1640 20 reqs_thread_entry: start 2024-09-12T00:03:14.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.216+0000 7f12a2213800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:03:14.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.216+0000 7f12a2213800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.217+0000 7f12a2213800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:14.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.217+0000 7f12a2213800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:03:14.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.217+0000 7f12a2213800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:03:14.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.217+0000 7f12a2213800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 : miss 2024-09-12T00:03:14.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.217+0000 7f12a2213800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.217+0000 7f12a2213800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:14.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.217+0000 7f12a2213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 info.flags=0x17 2024-09-12T00:03:14.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.217+0000 7f12a2213800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 to cache LRU end 2024-09-12T00:03:14.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.217+0000 7f12a2213800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:03:14.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.217+0000 7f12a2213800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:03:14.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.217+0000 7f12a2213800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 2024-09-12T00:03:14.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.218+0000 7f12a2213800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:14.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.221+0000 7f1153fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:14.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.223+0000 7f12a2213800 20 remove_watcher() i=0 2024-09-12T00:03:14.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.223+0000 7f12a2213800 2 removed watcher, disabling cache 2024-09-12T00:03:14.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.224+0000 7f12a2213800 20 remove_watcher() i=1 2024-09-12T00:03:14.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.225+0000 7f12a2213800 20 remove_watcher() i=2 2024-09-12T00:03:14.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.226+0000 7f12a2213800 20 remove_watcher() i=3 2024-09-12T00:03:14.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.227+0000 7f12a2213800 20 remove_watcher() i=4 2024-09-12T00:03:14.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.229+0000 7f12a2213800 20 remove_watcher() i=5 2024-09-12T00:03:14.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.229+0000 7f12a2213800 20 remove_watcher() i=6 2024-09-12T00:03:14.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.230+0000 7f12a2213800 20 remove_watcher() i=7 2024-09-12T00:03:14.241 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:03:14.270 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:14.271 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:14.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.310+0000 7f7401c98800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.312+0000 7f7401c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.312+0000 7f7401c98800 20 realm 2024-09-12T00:03:14.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.312+0000 7f7401c98800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.312+0000 7f7401c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.312+0000 7f7401c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:14.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.312+0000 7f7401c98800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.313+0000 7f7401c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.313+0000 7f7401c98800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.313+0000 7f7401c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:14.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.313+0000 7f7401c98800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.314+0000 7f7401c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:14.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.314+0000 7f7401c98800 20 searching for the correct realm 2024-09-12T00:03:14.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.317+0000 7f73fef81640 0 -- 172.21.15.67:0/785773901 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f73f409a1a0 msgr2=0x7f73f4083200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:14.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.321+0000 7f73fff83640 0 -- 172.21.15.67:0/785773901 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55be510d1ed0 msgr2=0x55be510d4300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:14.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.325+0000 7f7401c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:14.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.325+0000 7f7401c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:14.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.325+0000 7f7401c98800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:14.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.325+0000 7f7401c98800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:14.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.325+0000 7f7401c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:14.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.325+0000 7f7401c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:14.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.325+0000 7f7401c98800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.325+0000 7f7401c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.325+0000 7f7401c98800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.326+0000 7f7401c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:14.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.326+0000 7f7401c98800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.326+0000 7f7401c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:14.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.326+0000 7f7401c98800 20 zone default found 2024-09-12T00:03:14.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.326+0000 7f7401c98800 4 Realm: () 2024-09-12T00:03:14.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.326+0000 7f7401c98800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:14.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.326+0000 7f7401c98800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:14.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.326+0000 7f7401c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:14.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.326+0000 7f7401c98800 20 zonegroup default 2024-09-12T00:03:14.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.326+0000 7f7401c98800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.326+0000 7f7401c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.326+0000 7f7401c98800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.327+0000 7f7401c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.327+0000 7f7401c98800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.327+0000 7f7401c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.327+0000 7f7401c98800 20 started sync module instance, tier type = 2024-09-12T00:03:14.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.327+0000 7f7401c98800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:14.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.336+0000 7f7401c98800 20 add_watcher() i=0 2024-09-12T00:03:14.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.336+0000 7f7401c98800 20 add_watcher() i=1 2024-09-12T00:03:14.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.336+0000 7f7401c98800 20 add_watcher() i=2 2024-09-12T00:03:14.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.336+0000 7f7401c98800 20 add_watcher() i=3 2024-09-12T00:03:14.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.336+0000 7f7401c98800 20 add_watcher() i=4 2024-09-12T00:03:14.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.336+0000 7f7401c98800 20 add_watcher() i=5 2024-09-12T00:03:14.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.336+0000 7f7401c98800 20 add_watcher() i=6 2024-09-12T00:03:14.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.337+0000 7f7401c98800 20 add_watcher() i=7 2024-09-12T00:03:14.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.337+0000 7f7401c98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:14.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.338+0000 7f72b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:14.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.339+0000 7f7401c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:14.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.339+0000 7f7401c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:14.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.339+0000 7f7401c98800 5 note: GC not initialized 2024-09-12T00:03:14.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.339+0000 7f72b4fe1640 20 reqs_thread_entry: start 2024-09-12T00:03:14.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.339+0000 7f7401c98800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:14.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.339+0000 7f7401c98800 20 Filter name: none 2024-09-12T00:03:14.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.339+0000 7f722e7fc640 20 reqs_thread_entry: start 2024-09-12T00:03:14.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.339+0000 7f7401c98800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.340+0000 7f7401c98800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:14.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.340+0000 7f7401c98800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.340+0000 7f7401c98800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:14.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.340+0000 7f7401c98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:14.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.340+0000 7f7401c98800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.341+0000 7f7401c98800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:14.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.341+0000 7f7401c98800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.341+0000 7f7401c98800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:14.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.341+0000 7f7401c98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:14.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.342+0000 7f72b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:14.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.344+0000 7f7401c98800 20 remove_watcher() i=0 2024-09-12T00:03:14.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.344+0000 7f7401c98800 2 removed watcher, disabling cache 2024-09-12T00:03:14.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.345+0000 7f7401c98800 20 remove_watcher() i=1 2024-09-12T00:03:14.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.346+0000 7f7401c98800 20 remove_watcher() i=2 2024-09-12T00:03:14.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.348+0000 7f7401c98800 20 remove_watcher() i=3 2024-09-12T00:03:14.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.348+0000 7f7401c98800 20 remove_watcher() i=4 2024-09-12T00:03:14.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.349+0000 7f7401c98800 20 remove_watcher() i=5 2024-09-12T00:03:14.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.350+0000 7f7401c98800 20 remove_watcher() i=6 2024-09-12T00:03:14.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.351+0000 7f7401c98800 20 remove_watcher() i=7 2024-09-12T00:03:14.361 INFO:tasks.workunit.client.0.smithi067.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 74, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T00:03:14.361 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T00:03:14.361 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:14.363 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:03:14.397 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:14.397 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:14.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.437+0000 7f2c37f3e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.439+0000 7f2c37f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.439+0000 7f2c37f3e800 20 realm 2024-09-12T00:03:14.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.439+0000 7f2c37f3e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.439+0000 7f2c37f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.439+0000 7f2c37f3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:14.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.439+0000 7f2c37f3e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.439+0000 7f2c37f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.439+0000 7f2c37f3e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.440+0000 7f2c37f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:14.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.440+0000 7f2c37f3e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.441+0000 7f2c37f3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:14.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.441+0000 7f2c37f3e800 20 searching for the correct realm 2024-09-12T00:03:14.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.443+0000 7f2c334bf640 0 -- 172.21.15.67:0/2098318014 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f2c280720d0 msgr2=0x7f2c2802b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:14.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.648+0000 7f2c344c1640 0 -- 172.21.15.67:0/2098318014 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x557478681fa0 msgr2=0x5574786843f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:14.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.652+0000 7f2c37f3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:14.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.652+0000 7f2c37f3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:14.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.652+0000 7f2c37f3e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:14.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.652+0000 7f2c37f3e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:14.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.652+0000 7f2c37f3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:14.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.652+0000 7f2c37f3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:14.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.652+0000 7f2c37f3e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.653+0000 7f2c37f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.653+0000 7f2c37f3e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.653+0000 7f2c37f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:14.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.653+0000 7f2c37f3e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.653+0000 7f2c37f3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:14.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.653+0000 7f2c37f3e800 20 zone default found 2024-09-12T00:03:14.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.653+0000 7f2c37f3e800 4 Realm: () 2024-09-12T00:03:14.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.653+0000 7f2c37f3e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:14.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.653+0000 7f2c37f3e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:14.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.653+0000 7f2c37f3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:14.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.653+0000 7f2c37f3e800 20 zonegroup default 2024-09-12T00:03:14.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.653+0000 7f2c37f3e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.654+0000 7f2c37f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.654+0000 7f2c37f3e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.654+0000 7f2c37f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.654+0000 7f2c37f3e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.655+0000 7f2c37f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:14.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.655+0000 7f2c37f3e800 20 started sync module instance, tier type = 2024-09-12T00:03:14.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.655+0000 7f2c37f3e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:14.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.664+0000 7f2c37f3e800 20 add_watcher() i=0 2024-09-12T00:03:14.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.664+0000 7f2c37f3e800 20 add_watcher() i=1 2024-09-12T00:03:14.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.664+0000 7f2c37f3e800 20 add_watcher() i=2 2024-09-12T00:03:14.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.664+0000 7f2c37f3e800 20 add_watcher() i=3 2024-09-12T00:03:14.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.664+0000 7f2c37f3e800 20 add_watcher() i=4 2024-09-12T00:03:14.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.664+0000 7f2c37f3e800 20 add_watcher() i=5 2024-09-12T00:03:14.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.664+0000 7f2c37f3e800 20 add_watcher() i=6 2024-09-12T00:03:14.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.664+0000 7f2c37f3e800 20 add_watcher() i=7 2024-09-12T00:03:14.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.664+0000 7f2c37f3e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:14.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.666+0000 7f2ae9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.667+0000 7f2c37f3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.667+0000 7f2c37f3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.667+0000 7f2c37f3e800 5 note: GC not initialized 2024-09-12T00:03:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.667+0000 7f2ae8fe1640 20 reqs_thread_entry: start 2024-09-12T00:03:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.667+0000 7f2c37f3e800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.667+0000 7f2c37f3e800 20 Filter name: none 2024-09-12T00:03:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.667+0000 7f2a627fc640 20 reqs_thread_entry: start 2024-09-12T00:03:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.667+0000 7f2c37f3e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:03:14.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.667+0000 7f2c37f3e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.668+0000 7f2c37f3e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:14.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.668+0000 7f2c37f3e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:03:14.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.668+0000 7f2c37f3e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:03:14.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.668+0000 7f2c37f3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 : miss 2024-09-12T00:03:14.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.668+0000 7f2c37f3e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:14.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.669+0000 7f2c37f3e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:14.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.669+0000 7f2c37f3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 info.flags=0x17 2024-09-12T00:03:14.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.669+0000 7f2c37f3e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 to cache LRU end 2024-09-12T00:03:14.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.669+0000 7f2c37f3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:03:14.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.669+0000 7f2c37f3e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:03:14.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.669+0000 7f2c37f3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 2024-09-12T00:03:14.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.669+0000 7f2c37f3e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:14.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.669+0000 7f2c37f3e800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:03:14.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.669+0000 7f2c37f3e800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:03:14.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.670+0000 7f2ae9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:14.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.673+0000 7f2c37f3e800 20 remove_watcher() i=0 2024-09-12T00:03:14.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.673+0000 7f2c37f3e800 2 removed watcher, disabling cache 2024-09-12T00:03:14.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.674+0000 7f2c37f3e800 20 remove_watcher() i=1 2024-09-12T00:03:14.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.675+0000 7f2c37f3e800 20 remove_watcher() i=2 2024-09-12T00:03:14.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.676+0000 7f2c37f3e800 20 remove_watcher() i=3 2024-09-12T00:03:14.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.677+0000 7f2c37f3e800 20 remove_watcher() i=4 2024-09-12T00:03:14.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.678+0000 7f2c37f3e800 20 remove_watcher() i=5 2024-09-12T00:03:14.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.679+0000 7f2c37f3e800 20 remove_watcher() i=6 2024-09-12T00:03:14.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:14.679+0000 7f2c37f3e800 20 remove_watcher() i=7 2024-09-12T00:03:14.690 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:03:15.102 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:03:16.575 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:03:16.581 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:03:16.613 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:16.614 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:16.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.660+0000 7fa636898800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.662+0000 7fa636898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:16.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.662+0000 7fa636898800 20 realm 2024-09-12T00:03:16.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.662+0000 7fa636898800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.662+0000 7fa636898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:16.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.662+0000 7fa636898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:16.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.662+0000 7fa636898800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.662+0000 7fa636898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:16.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.662+0000 7fa636898800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.663+0000 7fa636898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:16.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.663+0000 7fa636898800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.664+0000 7fa636898800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:16.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.664+0000 7fa636898800 20 searching for the correct realm 2024-09-12T00:03:16.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.668+0000 7fa634b83640 0 -- 172.21.15.67:0/3773153422 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7fa62801c040 msgr2=0x7fa628037950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:16.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.672+0000 7fa634382640 0 -- 172.21.15.67:0/3773153422 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fa62c020040 msgr2=0x7fa62c03e8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:16.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.677+0000 7fa636898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:16.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.677+0000 7fa636898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:16.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.677+0000 7fa636898800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:16.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.677+0000 7fa636898800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:16.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.677+0000 7fa636898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:16.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.677+0000 7fa636898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:16.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.677+0000 7fa636898800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.677+0000 7fa636898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:16.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.677+0000 7fa636898800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.678+0000 7fa636898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:16.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.678+0000 7fa636898800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.678+0000 7fa636898800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:16.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.678+0000 7fa636898800 20 zone default found 2024-09-12T00:03:16.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.678+0000 7fa636898800 4 Realm: () 2024-09-12T00:03:16.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.678+0000 7fa636898800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:16.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.678+0000 7fa636898800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:16.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.678+0000 7fa636898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:16.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.678+0000 7fa636898800 20 zonegroup default 2024-09-12T00:03:16.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.678+0000 7fa636898800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.678+0000 7fa636898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:16.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.678+0000 7fa636898800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.679+0000 7fa636898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:16.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.679+0000 7fa636898800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.679+0000 7fa636898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:16.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.679+0000 7fa636898800 20 started sync module instance, tier type = 2024-09-12T00:03:16.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.679+0000 7fa636898800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:16.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.689+0000 7fa636898800 20 add_watcher() i=0 2024-09-12T00:03:16.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.689+0000 7fa636898800 20 add_watcher() i=1 2024-09-12T00:03:16.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.689+0000 7fa636898800 20 add_watcher() i=2 2024-09-12T00:03:16.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.689+0000 7fa636898800 20 add_watcher() i=3 2024-09-12T00:03:16.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.689+0000 7fa636898800 20 add_watcher() i=4 2024-09-12T00:03:16.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.689+0000 7fa636898800 20 add_watcher() i=5 2024-09-12T00:03:16.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.689+0000 7fa636898800 20 add_watcher() i=6 2024-09-12T00:03:16.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.690+0000 7fa636898800 20 add_watcher() i=7 2024-09-12T00:03:16.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.690+0000 7fa636898800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:16.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.693+0000 7fa4eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:16.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.693+0000 7fa636898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:16.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.693+0000 7fa636898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:16.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.693+0000 7fa636898800 5 note: GC not initialized 2024-09-12T00:03:16.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.693+0000 7fa4e9fdb640 20 reqs_thread_entry: start 2024-09-12T00:03:16.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.693+0000 7fa636898800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:16.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.693+0000 7fa636898800 20 Filter name: none 2024-09-12T00:03:16.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.694+0000 7fa45b7fe640 20 reqs_thread_entry: start 2024-09-12T00:03:16.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.694+0000 7fa636898800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.694+0000 7fa636898800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:16.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.694+0000 7fa636898800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.694+0000 7fa636898800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:16.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.694+0000 7fa636898800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:16.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.694+0000 7fa636898800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:03:16.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.694+0000 7fa636898800 20 INFO: main: starting shard=0 2024-09-12T00:03:16.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.694+0000 7fa636898800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:16.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.695+0000 7fa636898800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:03:16.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.695+0000 7fa636898800 20 INFO: main: done 2024-09-12T00:03:16.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.696+0000 7fa4eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:16.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.698+0000 7fa636898800 20 remove_watcher() i=0 2024-09-12T00:03:16.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.698+0000 7fa636898800 2 removed watcher, disabling cache 2024-09-12T00:03:16.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.700+0000 7fa636898800 20 remove_watcher() i=1 2024-09-12T00:03:16.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.701+0000 7fa636898800 20 remove_watcher() i=2 2024-09-12T00:03:16.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.702+0000 7fa636898800 20 remove_watcher() i=3 2024-09-12T00:03:16.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.703+0000 7fa636898800 20 remove_watcher() i=4 2024-09-12T00:03:16.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.704+0000 7fa636898800 20 remove_watcher() i=5 2024-09-12T00:03:16.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.705+0000 7fa636898800 20 remove_watcher() i=6 2024-09-12T00:03:16.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.707+0000 7fa636898800 20 remove_watcher() i=7 2024-09-12T00:03:16.777 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:03:16.778 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:03:16.810 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:16.810 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:16.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.851+0000 7f8c0fa13800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.853+0000 7f8c0fa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:16.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.853+0000 7f8c0fa13800 20 realm 2024-09-12T00:03:16.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.853+0000 7f8c0fa13800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.853+0000 7f8c0fa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:16.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.853+0000 7f8c0fa13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:16.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.853+0000 7f8c0fa13800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.854+0000 7f8c0fa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:16.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.854+0000 7f8c0fa13800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.854+0000 7f8c0fa13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:16.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.854+0000 7f8c0fa13800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.855+0000 7f8c0fa13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:16.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.855+0000 7f8c0fa13800 20 searching for the correct realm 2024-09-12T00:03:16.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.859+0000 7f8c0b192640 0 -- 172.21.15.67:0/2583180074 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f8bfc018070 msgr2=0x7f8bfc08bd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:03:16.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.862+0000 7f8c0b192640 0 -- 172.21.15.67:0/2583180074 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f8c0402c3f0 msgr2=0x7f8c0402c870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:16.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.866+0000 7f8c0fa13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:16.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.866+0000 7f8c0fa13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:16.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.866+0000 7f8c0fa13800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:16.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.866+0000 7f8c0fa13800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:16.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.866+0000 7f8c0fa13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:16.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.866+0000 7f8c0fa13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:16.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.866+0000 7f8c0fa13800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.867+0000 7f8c0fa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:16.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.867+0000 7f8c0fa13800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.867+0000 7f8c0fa13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:16.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.867+0000 7f8c0fa13800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.867+0000 7f8c0fa13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:16.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.867+0000 7f8c0fa13800 20 zone default found 2024-09-12T00:03:16.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.867+0000 7f8c0fa13800 4 Realm: () 2024-09-12T00:03:16.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.867+0000 7f8c0fa13800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:16.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.867+0000 7f8c0fa13800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:16.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.867+0000 7f8c0fa13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:16.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.867+0000 7f8c0fa13800 20 zonegroup default 2024-09-12T00:03:16.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.867+0000 7f8c0fa13800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.868+0000 7f8c0fa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:16.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.868+0000 7f8c0fa13800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.868+0000 7f8c0fa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:16.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.868+0000 7f8c0fa13800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.869+0000 7f8c0fa13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:16.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.869+0000 7f8c0fa13800 20 started sync module instance, tier type = 2024-09-12T00:03:16.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.869+0000 7f8c0fa13800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:16.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.877+0000 7f8c0fa13800 20 add_watcher() i=0 2024-09-12T00:03:16.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.877+0000 7f8c0fa13800 20 add_watcher() i=1 2024-09-12T00:03:16.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.877+0000 7f8c0fa13800 20 add_watcher() i=2 2024-09-12T00:03:16.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.877+0000 7f8c0fa13800 20 add_watcher() i=3 2024-09-12T00:03:16.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.877+0000 7f8c0fa13800 20 add_watcher() i=4 2024-09-12T00:03:16.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.877+0000 7f8c0fa13800 20 add_watcher() i=5 2024-09-12T00:03:16.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.877+0000 7f8c0fa13800 20 add_watcher() i=6 2024-09-12T00:03:16.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.878+0000 7f8c0fa13800 20 add_watcher() i=7 2024-09-12T00:03:16.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.879+0000 7f8c0fa13800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:16.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.880+0000 7f8ac1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:16.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.881+0000 7f8c0fa13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:16.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.881+0000 7f8c0fa13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:16.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.881+0000 7f8c0fa13800 5 note: GC not initialized 2024-09-12T00:03:16.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.881+0000 7f8ac0fe1640 20 reqs_thread_entry: start 2024-09-12T00:03:16.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.881+0000 7f8c0fa13800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:16.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.881+0000 7f8c0fa13800 20 Filter name: none 2024-09-12T00:03:16.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.881+0000 7f8a3a7fc640 20 reqs_thread_entry: start 2024-09-12T00:03:16.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.881+0000 7f8c0fa13800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.882+0000 7f8c0fa13800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:16.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.882+0000 7f8c0fa13800 20 rados->read ofs=0 len=0 2024-09-12T00:03:16.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.882+0000 7f8c0fa13800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:16.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.882+0000 7f8c0fa13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:16.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.882+0000 7f8c0fa13800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:03:16.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.882+0000 7f8c0fa13800 20 INFO: main: starting shard=0 2024-09-12T00:03:16.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.882+0000 7f8c0fa13800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:16.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.883+0000 7f8c0fa13800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:03:16.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.883+0000 7f8c0fa13800 20 INFO: main: done 2024-09-12T00:03:16.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.884+0000 7f8ac1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:16.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.886+0000 7f8c0fa13800 20 remove_watcher() i=0 2024-09-12T00:03:16.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.886+0000 7f8c0fa13800 2 removed watcher, disabling cache 2024-09-12T00:03:16.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.887+0000 7f8c0fa13800 20 remove_watcher() i=1 2024-09-12T00:03:16.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.888+0000 7f8c0fa13800 20 remove_watcher() i=2 2024-09-12T00:03:16.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.890+0000 7f8c0fa13800 20 remove_watcher() i=3 2024-09-12T00:03:16.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.890+0000 7f8c0fa13800 20 remove_watcher() i=4 2024-09-12T00:03:16.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.891+0000 7f8c0fa13800 20 remove_watcher() i=5 2024-09-12T00:03:16.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.893+0000 7f8c0fa13800 20 remove_watcher() i=6 2024-09-12T00:03:16.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:16.894+0000 7f8c0fa13800 20 remove_watcher() i=7 2024-09-12T00:03:16.964 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:03:16.965 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:03:16.997 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:16.998 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:17.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.039+0000 7f9fe712a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.041+0000 7f9fe712a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:17.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.041+0000 7f9fe712a800 20 realm 2024-09-12T00:03:17.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.041+0000 7f9fe712a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.041+0000 7f9fe712a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:17.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.041+0000 7f9fe712a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:17.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.041+0000 7f9fe712a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.041+0000 7f9fe712a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:17.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.041+0000 7f9fe712a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.042+0000 7f9fe712a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:17.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.042+0000 7f9fe712a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.043+0000 7f9fe712a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:17.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.043+0000 7f9fe712a800 20 searching for the correct realm 2024-09-12T00:03:17.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.044+0000 7f9fe2eda640 0 -- 172.21.15.67:0/551545655 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f9fd4078550 msgr2=0x7f9fd409e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:17.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.249+0000 7f9fe2eda640 0 -- 172.21.15.67:0/551545655 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x560f1a9b2f70 msgr2=0x7f9fdc0636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:03:17.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.456+0000 7f9fe712a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:17.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.456+0000 7f9fe712a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:17.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.456+0000 7f9fe712a800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:17.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.456+0000 7f9fe712a800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:17.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.456+0000 7f9fe712a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:17.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.456+0000 7f9fe712a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:17.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.456+0000 7f9fe712a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.457+0000 7f9fe712a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:17.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.457+0000 7f9fe712a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.457+0000 7f9fe712a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:17.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.457+0000 7f9fe712a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.457+0000 7f9fe712a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:17.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.457+0000 7f9fe712a800 20 zone default found 2024-09-12T00:03:17.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.457+0000 7f9fe712a800 4 Realm: () 2024-09-12T00:03:17.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.457+0000 7f9fe712a800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:17.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.457+0000 7f9fe712a800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:17.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.457+0000 7f9fe712a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:17.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.457+0000 7f9fe712a800 20 zonegroup default 2024-09-12T00:03:17.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.457+0000 7f9fe712a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.457+0000 7f9fe712a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:17.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.457+0000 7f9fe712a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.458+0000 7f9fe712a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:17.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.458+0000 7f9fe712a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.458+0000 7f9fe712a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:17.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.458+0000 7f9fe712a800 20 started sync module instance, tier type = 2024-09-12T00:03:17.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.458+0000 7f9fe712a800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:17.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.468+0000 7f9fe712a800 20 add_watcher() i=0 2024-09-12T00:03:17.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.468+0000 7f9fe712a800 20 add_watcher() i=1 2024-09-12T00:03:17.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.468+0000 7f9fe712a800 20 add_watcher() i=2 2024-09-12T00:03:17.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.468+0000 7f9fe712a800 20 add_watcher() i=3 2024-09-12T00:03:17.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.468+0000 7f9fe712a800 20 add_watcher() i=4 2024-09-12T00:03:17.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.468+0000 7f9fe712a800 20 add_watcher() i=5 2024-09-12T00:03:17.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.468+0000 7f9fe712a800 20 add_watcher() i=6 2024-09-12T00:03:17.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.469+0000 7f9fe712a800 20 add_watcher() i=7 2024-09-12T00:03:17.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.469+0000 7f9fe712a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:17.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.471+0000 7f9e997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:17.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.471+0000 7f9fe712a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:17.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.471+0000 7f9fe712a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:17.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.471+0000 7f9fe712a800 5 note: GC not initialized 2024-09-12T00:03:17.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.472+0000 7f9e13fff640 20 reqs_thread_entry: start 2024-09-12T00:03:17.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.472+0000 7f9fe712a800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:17.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.472+0000 7f9fe712a800 20 Filter name: none 2024-09-12T00:03:17.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.472+0000 7f9e11ffb640 20 reqs_thread_entry: start 2024-09-12T00:03:17.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.472+0000 7f9fe712a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.472+0000 7f9fe712a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:17.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.472+0000 7f9fe712a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.473+0000 7f9fe712a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:17.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.473+0000 7f9fe712a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:17.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.473+0000 7f9fe712a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:03:17.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.473+0000 7f9fe712a800 20 INFO: main: starting shard=0 2024-09-12T00:03:17.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.473+0000 7f9fe712a800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:17.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.474+0000 7f9fe712a800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:03:17.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.474+0000 7f9fe712a800 20 INFO: main: done 2024-09-12T00:03:17.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.474+0000 7f9e997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:17.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.477+0000 7f9fe712a800 20 remove_watcher() i=0 2024-09-12T00:03:17.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.477+0000 7f9fe712a800 2 removed watcher, disabling cache 2024-09-12T00:03:17.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.478+0000 7f9fe712a800 20 remove_watcher() i=1 2024-09-12T00:03:17.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.479+0000 7f9fe712a800 20 remove_watcher() i=2 2024-09-12T00:03:17.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.480+0000 7f9fe712a800 20 remove_watcher() i=3 2024-09-12T00:03:17.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.481+0000 7f9fe712a800 20 remove_watcher() i=4 2024-09-12T00:03:17.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.482+0000 7f9fe712a800 20 remove_watcher() i=5 2024-09-12T00:03:17.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.483+0000 7f9fe712a800 20 remove_watcher() i=6 2024-09-12T00:03:17.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.484+0000 7f9fe712a800 20 remove_watcher() i=7 2024-09-12T00:03:17.554 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:03:17.555 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:03:17.586 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:17.586 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:17.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.627+0000 7fbd3f719800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.630+0000 7fbd3f719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:17.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.630+0000 7fbd3f719800 20 realm 2024-09-12T00:03:17.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.630+0000 7fbd3f719800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.630+0000 7fbd3f719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:17.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.630+0000 7fbd3f719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:17.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.630+0000 7fbd3f719800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.630+0000 7fbd3f719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:17.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.630+0000 7fbd3f719800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.631+0000 7fbd3f719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:17.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.631+0000 7fbd3f719800 20 rados->read ofs=0 len=0 2024-09-12T00:03:17.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.632+0000 7fbd3f719800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:17.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.632+0000 7fbd3f719800 20 searching for the correct realm 2024-09-12T00:03:17.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.634+0000 7fbd3d20a640 0 -- 172.21.15.67:0/722955706 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7fbd30078480 msgr2=0x7fbd300a57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:17.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:17.840+0000 7fbd3d20a640 0 -- 172.21.15.67:0/722955706 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x55b7a92c9620 msgr2=0x7fbd380c13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:18.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.048+0000 7fbd3f719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:18.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.048+0000 7fbd3f719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:18.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.048+0000 7fbd3f719800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:18.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.048+0000 7fbd3f719800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:18.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.048+0000 7fbd3f719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:18.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.048+0000 7fbd3f719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:18.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.048+0000 7fbd3f719800 20 rados->read ofs=0 len=0 2024-09-12T00:03:18.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.048+0000 7fbd3f719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:18.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.048+0000 7fbd3f719800 20 rados->read ofs=0 len=0 2024-09-12T00:03:18.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.049+0000 7fbd3f719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:18.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.049+0000 7fbd3f719800 20 rados->read ofs=0 len=0 2024-09-12T00:03:18.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.049+0000 7fbd3f719800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:18.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.049+0000 7fbd3f719800 20 zone default found 2024-09-12T00:03:18.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.049+0000 7fbd3f719800 4 Realm: () 2024-09-12T00:03:18.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.049+0000 7fbd3f719800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:18.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.049+0000 7fbd3f719800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:18.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.049+0000 7fbd3f719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:18.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.049+0000 7fbd3f719800 20 zonegroup default 2024-09-12T00:03:18.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.049+0000 7fbd3f719800 20 rados->read ofs=0 len=0 2024-09-12T00:03:18.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.049+0000 7fbd3f719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:18.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.049+0000 7fbd3f719800 20 rados->read ofs=0 len=0 2024-09-12T00:03:18.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.050+0000 7fbd3f719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:18.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.050+0000 7fbd3f719800 20 rados->read ofs=0 len=0 2024-09-12T00:03:18.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.050+0000 7fbd3f719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:18.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.050+0000 7fbd3f719800 20 started sync module instance, tier type = 2024-09-12T00:03:18.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.050+0000 7fbd3f719800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:18.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.062+0000 7fbd3f719800 20 add_watcher() i=0 2024-09-12T00:03:18.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.062+0000 7fbd3f719800 20 add_watcher() i=1 2024-09-12T00:03:18.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.062+0000 7fbd3f719800 20 add_watcher() i=2 2024-09-12T00:03:18.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.062+0000 7fbd3f719800 20 add_watcher() i=3 2024-09-12T00:03:18.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.062+0000 7fbd3f719800 20 add_watcher() i=4 2024-09-12T00:03:18.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.062+0000 7fbd3f719800 20 add_watcher() i=5 2024-09-12T00:03:18.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.062+0000 7fbd3f719800 20 add_watcher() i=6 2024-09-12T00:03:18.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.063+0000 7fbd3f719800 20 add_watcher() i=7 2024-09-12T00:03:18.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.063+0000 7fbd3f719800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:18.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.065+0000 7fbbf3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:18.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.065+0000 7fbd3f719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:18.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.065+0000 7fbd3f719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:18.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.065+0000 7fbd3f719800 5 note: GC not initialized 2024-09-12T00:03:18.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.066+0000 7fbbf2fe5640 20 reqs_thread_entry: start 2024-09-12T00:03:18.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.066+0000 7fbd3f719800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:18.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.066+0000 7fbd3f719800 20 Filter name: none 2024-09-12T00:03:18.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.066+0000 7fbbf0fe1640 20 reqs_thread_entry: start 2024-09-12T00:03:18.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.066+0000 7fbd3f719800 20 rados->read ofs=0 len=0 2024-09-12T00:03:18.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.067+0000 7fbd3f719800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:18.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.067+0000 7fbd3f719800 20 rados->read ofs=0 len=0 2024-09-12T00:03:18.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.067+0000 7fbd3f719800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:18.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.067+0000 7fbd3f719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:18.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.067+0000 7fbd3f719800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:03:18.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.067+0000 7fbd3f719800 20 INFO: main: starting shard=0 2024-09-12T00:03:18.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.067+0000 7fbd3f719800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:18.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.068+0000 7fbd3f719800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:03:18.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.068+0000 7fbd3f719800 20 INFO: main: done 2024-09-12T00:03:18.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.069+0000 7fbbf3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:18.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.071+0000 7fbd3f719800 20 remove_watcher() i=0 2024-09-12T00:03:18.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.071+0000 7fbd3f719800 2 removed watcher, disabling cache 2024-09-12T00:03:18.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.072+0000 7fbd3f719800 20 remove_watcher() i=1 2024-09-12T00:03:18.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.074+0000 7fbd3f719800 20 remove_watcher() i=2 2024-09-12T00:03:18.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.076+0000 7fbd3f719800 20 remove_watcher() i=3 2024-09-12T00:03:18.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.077+0000 7fbd3f719800 20 remove_watcher() i=4 2024-09-12T00:03:18.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.078+0000 7fbd3f719800 20 remove_watcher() i=5 2024-09-12T00:03:18.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.079+0000 7fbd3f719800 20 remove_watcher() i=6 2024-09-12T00:03:18.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.080+0000 7fbd3f719800 20 remove_watcher() i=7 2024-09-12T00:03:18.096 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:03:18.506 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:03:18.920 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T00:03:18.921 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:18.922 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:03:18.955 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:18.955 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:18.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.997+0000 7fdb12335800 20 rados->read ofs=0 len=0 2024-09-12T00:03:18.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.998+0000 7fdb12335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:18.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.998+0000 7fdb12335800 20 realm 2024-09-12T00:03:18.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.998+0000 7fdb12335800 20 rados->read ofs=0 len=0 2024-09-12T00:03:18.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.998+0000 7fdb12335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:18.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.998+0000 7fdb12335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:18.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.998+0000 7fdb12335800 20 rados->read ofs=0 len=0 2024-09-12T00:03:18.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.999+0000 7fdb12335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:18.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.999+0000 7fdb12335800 20 rados->read ofs=0 len=0 2024-09-12T00:03:18.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.999+0000 7fdb12335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:18.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:18.999+0000 7fdb12335800 20 rados->read ofs=0 len=0 2024-09-12T00:03:18.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.000+0000 7fdb12335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:18.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.000+0000 7fdb12335800 20 searching for the correct realm 2024-09-12T00:03:19.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.004+0000 7fdb0e0e4640 0 -- 172.21.15.67:0/2861583871 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7fdb0009b5e0 msgr2=0x7fdb0008c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:19.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.007+0000 7fdb0e0e4640 0 -- 172.21.15.67:0/2861583871 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fdb0806fb60 msgr2=0x7fdb0807a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:19.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.011+0000 7fdb12335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:19.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.011+0000 7fdb12335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:19.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.011+0000 7fdb12335800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:19.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.011+0000 7fdb12335800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:19.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.011+0000 7fdb12335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:19.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.011+0000 7fdb12335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:19.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.011+0000 7fdb12335800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.012+0000 7fdb12335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.012+0000 7fdb12335800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.012+0000 7fdb12335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:19.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.012+0000 7fdb12335800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.012+0000 7fdb12335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:19.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.012+0000 7fdb12335800 20 zone default found 2024-09-12T00:03:19.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.012+0000 7fdb12335800 4 Realm: () 2024-09-12T00:03:19.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.012+0000 7fdb12335800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:19.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.012+0000 7fdb12335800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:19.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.012+0000 7fdb12335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:19.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.012+0000 7fdb12335800 20 zonegroup default 2024-09-12T00:03:19.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.012+0000 7fdb12335800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.013+0000 7fdb12335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.013+0000 7fdb12335800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.013+0000 7fdb12335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.013+0000 7fdb12335800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.013+0000 7fdb12335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.013+0000 7fdb12335800 20 started sync module instance, tier type = 2024-09-12T00:03:19.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.013+0000 7fdb12335800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:19.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.026+0000 7fdb12335800 20 add_watcher() i=0 2024-09-12T00:03:19.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.026+0000 7fdb12335800 20 add_watcher() i=1 2024-09-12T00:03:19.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.026+0000 7fdb12335800 20 add_watcher() i=2 2024-09-12T00:03:19.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.026+0000 7fdb12335800 20 add_watcher() i=3 2024-09-12T00:03:19.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.026+0000 7fdb12335800 20 add_watcher() i=4 2024-09-12T00:03:19.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.026+0000 7fdb12335800 20 add_watcher() i=5 2024-09-12T00:03:19.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.026+0000 7fdb12335800 20 add_watcher() i=6 2024-09-12T00:03:19.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.027+0000 7fdb12335800 20 add_watcher() i=7 2024-09-12T00:03:19.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.027+0000 7fdb12335800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:19.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.029+0000 7fd9c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:19.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.029+0000 7fdb12335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:19.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.029+0000 7fdb12335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:19.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.029+0000 7fdb12335800 5 note: GC not initialized 2024-09-12T00:03:19.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.029+0000 7fd93f7fe640 20 reqs_thread_entry: start 2024-09-12T00:03:19.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.030+0000 7fdb12335800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:19.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.030+0000 7fdb12335800 20 Filter name: none 2024-09-12T00:03:19.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.030+0000 7fd93d7fa640 20 reqs_thread_entry: start 2024-09-12T00:03:19.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.030+0000 7fdb12335800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:03:19.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.030+0000 7fdb12335800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.030+0000 7fdb12335800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:19.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.030+0000 7fdb12335800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:03:19.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.030+0000 7fdb12335800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:03:19.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.030+0000 7fdb12335800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 : miss 2024-09-12T00:03:19.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.030+0000 7fdb12335800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.031+0000 7fdb12335800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:19.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.031+0000 7fdb12335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 info.flags=0x17 2024-09-12T00:03:19.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.031+0000 7fdb12335800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 to cache LRU end 2024-09-12T00:03:19.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.031+0000 7fdb12335800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:03:19.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.031+0000 7fdb12335800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:03:19.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.031+0000 7fdb12335800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 2024-09-12T00:03:19.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.031+0000 7fdb12335800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.033+0000 7fdb12335800 1 NOTICE: finished shard 0 (4 entries found) 2024-09-12T00:03:19.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.033+0000 7fdb12335800 1 NOTICE: finished all shards (4 entries found) 2024-09-12T00:03:19.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.034+0000 7fd9c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:19.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.037+0000 7fdb12335800 20 remove_watcher() i=0 2024-09-12T00:03:19.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.037+0000 7fdb12335800 2 removed watcher, disabling cache 2024-09-12T00:03:19.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.038+0000 7fdb12335800 20 remove_watcher() i=1 2024-09-12T00:03:19.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.039+0000 7fdb12335800 20 remove_watcher() i=2 2024-09-12T00:03:19.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.041+0000 7fdb12335800 20 remove_watcher() i=3 2024-09-12T00:03:19.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.042+0000 7fdb12335800 20 remove_watcher() i=4 2024-09-12T00:03:19.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.043+0000 7fdb12335800 20 remove_watcher() i=5 2024-09-12T00:03:19.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.044+0000 7fdb12335800 20 remove_watcher() i=6 2024-09-12T00:03:19.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.045+0000 7fdb12335800 20 remove_watcher() i=7 2024-09-12T00:03:19.056 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: unlinked entries are not listable 2024-09-12T00:03:19.056 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:19.063 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T00:03:19.063 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:19.151 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T00:03:19.152 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:19.153 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:03:19.191 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:19.191 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:19.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.231+0000 7f49bb124800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.233+0000 7f49bb124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.233+0000 7f49bb124800 20 realm 2024-09-12T00:03:19.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.233+0000 7f49bb124800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.233+0000 7f49bb124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.233+0000 7f49bb124800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:19.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.233+0000 7f49bb124800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.233+0000 7f49bb124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.233+0000 7f49bb124800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.234+0000 7f49bb124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:19.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.234+0000 7f49bb124800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.235+0000 7f49bb124800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:19.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.235+0000 7f49bb124800 20 searching for the correct realm 2024-09-12T00:03:19.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.238+0000 7f49b6555640 0 -- 172.21.15.67:0/1039352261 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f49ac083270 msgr2=0x7f49ac05f5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:19.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.445+0000 7f49b7557640 0 -- 172.21.15.67:0/1039352261 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x555f8815fbe0 msgr2=0x555f88161fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:19.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.449+0000 7f49bb124800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:19.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.449+0000 7f49bb124800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:19.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.449+0000 7f49bb124800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:19.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.449+0000 7f49bb124800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:19.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.449+0000 7f49bb124800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:19.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.449+0000 7f49bb124800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:19.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.449+0000 7f49bb124800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.450+0000 7f49bb124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.450+0000 7f49bb124800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.450+0000 7f49bb124800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:19.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.450+0000 7f49bb124800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.450+0000 7f49bb124800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:19.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.450+0000 7f49bb124800 20 zone default found 2024-09-12T00:03:19.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.450+0000 7f49bb124800 4 Realm: () 2024-09-12T00:03:19.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.450+0000 7f49bb124800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:19.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.450+0000 7f49bb124800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:19.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.450+0000 7f49bb124800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:19.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.450+0000 7f49bb124800 20 zonegroup default 2024-09-12T00:03:19.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.450+0000 7f49bb124800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.451+0000 7f49bb124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.451+0000 7f49bb124800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.451+0000 7f49bb124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.451+0000 7f49bb124800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.451+0000 7f49bb124800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.451+0000 7f49bb124800 20 started sync module instance, tier type = 2024-09-12T00:03:19.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.451+0000 7f49bb124800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:19.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.463+0000 7f49bb124800 20 add_watcher() i=0 2024-09-12T00:03:19.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.463+0000 7f49bb124800 20 add_watcher() i=1 2024-09-12T00:03:19.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.463+0000 7f49bb124800 20 add_watcher() i=2 2024-09-12T00:03:19.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.463+0000 7f49bb124800 20 add_watcher() i=3 2024-09-12T00:03:19.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.463+0000 7f49bb124800 20 add_watcher() i=4 2024-09-12T00:03:19.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.463+0000 7f49bb124800 20 add_watcher() i=5 2024-09-12T00:03:19.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.463+0000 7f49bb124800 20 add_watcher() i=6 2024-09-12T00:03:19.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.464+0000 7f49bb124800 20 add_watcher() i=7 2024-09-12T00:03:19.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.464+0000 7f49bb124800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:19.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.466+0000 7f486d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:19.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.466+0000 7f49bb124800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:19.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.466+0000 7f49bb124800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:19.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.466+0000 7f49bb124800 5 note: GC not initialized 2024-09-12T00:03:19.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.466+0000 7f47e7fff640 20 reqs_thread_entry: start 2024-09-12T00:03:19.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.467+0000 7f49bb124800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:19.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.467+0000 7f49bb124800 20 Filter name: none 2024-09-12T00:03:19.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.467+0000 7f47e5ffb640 20 reqs_thread_entry: start 2024-09-12T00:03:19.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.467+0000 7f49bb124800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:03:19.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.467+0000 7f49bb124800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.467+0000 7f49bb124800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:19.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.467+0000 7f49bb124800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:03:19.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.467+0000 7f49bb124800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:03:19.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.467+0000 7f49bb124800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 : miss 2024-09-12T00:03:19.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.467+0000 7f49bb124800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.468+0000 7f49bb124800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:19.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.468+0000 7f49bb124800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 info.flags=0x17 2024-09-12T00:03:19.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.468+0000 7f49bb124800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 to cache LRU end 2024-09-12T00:03:19.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.468+0000 7f49bb124800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:03:19.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.468+0000 7f49bb124800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:03:19.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.468+0000 7f49bb124800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 2024-09-12T00:03:19.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.468+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.469+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.469+0000 7f49bb124800 20 get_obj_state: octx=0x555f87eecd80 obj=check-bucket:c state=0x555f881a05b8 s->prefetch_data=0 2024-09-12T00:03:19.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.470+0000 7f49bb124800 20 get_obj_state: setting s->obj_tag to sbrmo6z3n0du7jc1hxx01davii9b02b2 2024-09-12T00:03:19.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.470+0000 7f49bb124800 20 get_obj_state_impl: setting s->olh_tag to sbko0obwwz6diwb0ndg30ddillml64c1 2024-09-12T00:03:19.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.470+0000 7f49bb124800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=sbko0obwwz6diwb0ndg30ddillml64c1 2024-09-12T00:03:19.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.471+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.473+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.473+0000 7f49bb124800 20 olh_log_entry: epoch=3 op=3 key=c[YMJjVCPIzzRDLT4iwFDXJWVapbnO8qL] 2024-09-12T00:03:19.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.473+0000 7f49bb124800 20 get_obj_state: octx=0x555f87eecd80 obj=check-bucket:_:YMJjVCPIzzRDLT4iwFDXJWVapbnO8qL_c state=0x555f881d6718 s->prefetch_data=0 2024-09-12T00:03:19.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.473+0000 7f49bb124800 10 manifest: total_size = 12 2024-09-12T00:03:19.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.473+0000 7f49bb124800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11796591813722490945 2024-09-12T00:03:19.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.473+0000 7f49bb124800 20 get_obj_state: octx=0x555f87eecd80 obj=check-bucket:_:YMJjVCPIzzRDLT4iwFDXJWVapbnO8qL_c state=0x555f881d6718 s->prefetch_data=0 2024-09-12T00:03:19.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.473+0000 7f49bb124800 20 prepare_atomic_modification: state is not atomic. state=0x555f881d6718 2024-09-12T00:03:19.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.473+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.476+0000 7f49bb124800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:03:19.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.476+0000 7f49bb124800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:03:19.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.476+0000 7f49bb124800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:03:19.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.476+0000 7f49bb124800 5 delete_objs_inline: removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1__shadow:YMJjVCPIzzRDLT4iwFDXJWVapbnO8qL_.hDEDaPEjZT6HOoxtfyl-jlqrUbk-RAq_0 2024-09-12T00:03:19.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.478+0000 7f489a7fc640 20 handle_completion(): completion ok for obj=c[YMJjVCPIzzRDLT4iwFDXJWVapbnO8qL] 2024-09-12T00:03:19.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.478+0000 7f49bb124800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:03:19.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.480+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.480+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.481+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.481+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.482+0000 7f49bb124800 20 get_obj_state: octx=0x555f87eecd80 obj=check-bucket:d state=0x555f88199578 s->prefetch_data=0 2024-09-12T00:03:19.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.482+0000 7f49bb124800 20 get_obj_state: setting s->obj_tag to zovtfczlx0d9ejb55kpmb05k9zokehtv 2024-09-12T00:03:19.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.482+0000 7f49bb124800 20 get_obj_state_impl: setting s->olh_tag to 63x9rbg9d62k30h3fw3a6y50avlrh931 2024-09-12T00:03:19.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.482+0000 7f49bb124800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=63x9rbg9d62k30h3fw3a6y50avlrh931 2024-09-12T00:03:19.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.485+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.486+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.487+0000 7f49bb124800 20 olh_log_entry: epoch=3 op=3 key=d[f.qevOD7DLL0LQkFmKbcSIVqLzvL4Qy] 2024-09-12T00:03:19.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.487+0000 7f49bb124800 20 get_obj_state: octx=0x555f87eecd80 obj=check-bucket:_:f.qevOD7DLL0LQkFmKbcSIVqLzvL4Qy_d state=0x555f881d6718 s->prefetch_data=0 2024-09-12T00:03:19.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.487+0000 7f49bb124800 10 manifest: total_size = 9 2024-09-12T00:03:19.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.487+0000 7f49bb124800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4705100490680806813 2024-09-12T00:03:19.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.487+0000 7f49bb124800 20 get_obj_state: octx=0x555f87eecd80 obj=check-bucket:_:f.qevOD7DLL0LQkFmKbcSIVqLzvL4Qy_d state=0x555f881d6718 s->prefetch_data=0 2024-09-12T00:03:19.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.487+0000 7f49bb124800 20 prepare_atomic_modification: state is not atomic. state=0x555f881d6718 2024-09-12T00:03:19.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.487+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.490+0000 7f49bb124800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:03:19.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.490+0000 7f49bb124800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:03:19.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.490+0000 7f49bb124800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:03:19.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.490+0000 7f49bb124800 5 delete_objs_inline: removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1__shadow:f.qevOD7DLL0LQkFmKbcSIVqLzvL4Qy_.YgECuHbrnhC8eyaw0uElJRGhMpzZPde_0 2024-09-12T00:03:19.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.491+0000 7f489a7fc640 20 handle_completion(): completion ok for obj=d[f.qevOD7DLL0LQkFmKbcSIVqLzvL4Qy] 2024-09-12T00:03:19.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.491+0000 7f49bb124800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:03:19.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.493+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.493+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.495+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.495+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.495+0000 7f49bb124800 20 get_obj_state: octx=0x555f87eecd80 obj=check-bucket:e state=0x555f88199578 s->prefetch_data=0 2024-09-12T00:03:19.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.496+0000 7f49bb124800 20 get_obj_state: setting s->obj_tag to waruurblski8y406nm97npqmdo2uht27 2024-09-12T00:03:19.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.496+0000 7f49bb124800 20 get_obj_state_impl: setting s->olh_tag to ozqv1pgomjlt9pvu63ey7vo9rlqyy5l7 2024-09-12T00:03:19.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.496+0000 7f49bb124800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ozqv1pgomjlt9pvu63ey7vo9rlqyy5l7 2024-09-12T00:03:19.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.499+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.500+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.501+0000 7f49bb124800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:03:19.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.501+0000 7f49bb124800 20 olh_log_entry: epoch=2 op=3 key=e[DctBaodMXBLhea4LI8JlMvxOBts2FKS] 2024-09-12T00:03:19.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.501+0000 7f49bb124800 20 get_obj_state: octx=0x555f87eecd80 obj=check-bucket:_:DctBaodMXBLhea4LI8JlMvxOBts2FKS_e state=0x555f881d6718 s->prefetch_data=0 2024-09-12T00:03:19.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.501+0000 7f49bb124800 10 manifest: total_size = 12 2024-09-12T00:03:19.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.501+0000 7f49bb124800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16935734306947968978 2024-09-12T00:03:19.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.501+0000 7f49bb124800 20 get_obj_state: octx=0x555f87eecd80 obj=check-bucket:_:DctBaodMXBLhea4LI8JlMvxOBts2FKS_e state=0x555f881d6718 s->prefetch_data=0 2024-09-12T00:03:19.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.501+0000 7f49bb124800 20 prepare_atomic_modification: state is not atomic. state=0x555f881d6718 2024-09-12T00:03:19.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.501+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.504+0000 7f49bb124800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:03:19.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.504+0000 7f49bb124800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:03:19.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.504+0000 7f49bb124800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:03:19.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.504+0000 7f49bb124800 5 delete_objs_inline: removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1__shadow:DctBaodMXBLhea4LI8JlMvxOBts2FKS_.GbF6ZdXy3vka_Uc7FNjiE7Ls5pVQukf_0 2024-09-12T00:03:19.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.505+0000 7f489a7fc640 20 handle_completion(): completion ok for obj=e[DctBaodMXBLhea4LI8JlMvxOBts2FKS] 2024-09-12T00:03:19.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.506+0000 7f49bb124800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:03:19.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.507+0000 7f49bb124800 20 get_obj_state: octx=0x555f87eecd80 obj=check-bucket:e state=0x555f88199578 s->prefetch_data=0 2024-09-12T00:03:19.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.507+0000 7f49bb124800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ozqv1pgomjlt9pvu63ey7vo9rlqyy5l7 2024-09-12T00:03:19.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.514+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.515+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.515+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.516+0000 7f49bb124800 20 get_obj_state: octx=0x555f87eecd80 obj=check-bucket:f state=0x555f88199578 s->prefetch_data=0 2024-09-12T00:03:19.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.516+0000 7f49bb124800 20 get_obj_state: setting s->obj_tag to yunicxwqct2sr8o43781uqkrqvu7arry 2024-09-12T00:03:19.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.516+0000 7f49bb124800 20 get_obj_state_impl: setting s->olh_tag to mwo0k8hu34qq600ctluybjjeq50ol368 2024-09-12T00:03:19.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.516+0000 7f49bb124800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mwo0k8hu34qq600ctluybjjeq50ol368 2024-09-12T00:03:19.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.519+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.521+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.521+0000 7f49bb124800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:03:19.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.521+0000 7f49bb124800 20 olh_log_entry: epoch=2 op=3 key=f[V2HO97gTzijuWYefPA1b7Wq8xv1SI7W] 2024-09-12T00:03:19.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.521+0000 7f49bb124800 20 get_obj_state: octx=0x555f87eecd80 obj=check-bucket:_:V2HO97gTzijuWYefPA1b7Wq8xv1SI7W_f state=0x555f881d6718 s->prefetch_data=0 2024-09-12T00:03:19.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.521+0000 7f49bb124800 10 manifest: total_size = 22 2024-09-12T00:03:19.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.521+0000 7f49bb124800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9042182473635647324 2024-09-12T00:03:19.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.521+0000 7f49bb124800 20 get_obj_state: octx=0x555f87eecd80 obj=check-bucket:_:V2HO97gTzijuWYefPA1b7Wq8xv1SI7W_f state=0x555f881d6718 s->prefetch_data=0 2024-09-12T00:03:19.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.521+0000 7f49bb124800 20 prepare_atomic_modification: state is not atomic. state=0x555f881d6718 2024-09-12T00:03:19.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.521+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.524+0000 7f49bb124800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:03:19.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.524+0000 7f49bb124800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:03:19.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.524+0000 7f49bb124800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:03:19.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.524+0000 7f49bb124800 5 delete_objs_inline: removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1__shadow:V2HO97gTzijuWYefPA1b7Wq8xv1SI7W_.s4yogBW6Et4kNEUh2HcXFpRy8uORXf5_0 2024-09-12T00:03:19.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.525+0000 7f489a7fc640 20 handle_completion(): completion ok for obj=f[V2HO97gTzijuWYefPA1b7Wq8xv1SI7W] 2024-09-12T00:03:19.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.528+0000 7f49bb124800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:03:19.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.530+0000 7f49bb124800 20 get_obj_state: octx=0x555f87eecd80 obj=check-bucket:f state=0x555f88199578 s->prefetch_data=0 2024-09-12T00:03:19.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.530+0000 7f49bb124800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mwo0k8hu34qq600ctluybjjeq50ol368 2024-09-12T00:03:19.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.539+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.541+0000 7f49bb124800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.541+0000 7f49bb124800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T00:03:19.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.541+0000 7f49bb124800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:03:19.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.542+0000 7f486d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:19.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.544+0000 7f49bb124800 20 remove_watcher() i=0 2024-09-12T00:03:19.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.544+0000 7f49bb124800 2 removed watcher, disabling cache 2024-09-12T00:03:19.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.545+0000 7f49bb124800 20 remove_watcher() i=1 2024-09-12T00:03:19.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.546+0000 7f49bb124800 20 remove_watcher() i=2 2024-09-12T00:03:19.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.547+0000 7f49bb124800 20 remove_watcher() i=3 2024-09-12T00:03:19.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.548+0000 7f49bb124800 20 remove_watcher() i=4 2024-09-12T00:03:19.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.550+0000 7f49bb124800 20 remove_watcher() i=5 2024-09-12T00:03:19.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.551+0000 7f49bb124800 20 remove_watcher() i=6 2024-09-12T00:03:19.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.552+0000 7f49bb124800 20 remove_watcher() i=7 2024-09-12T00:03:19.574 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T00:03:19.574 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:19.629 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T00:03:19.630 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:19.631 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:03:19.664 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:19.665 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:19.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.705+0000 7fc0dcf36800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.707+0000 7fc0dcf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.707+0000 7fc0dcf36800 20 realm 2024-09-12T00:03:19.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.707+0000 7fc0dcf36800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.707+0000 7fc0dcf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.707+0000 7fc0dcf36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:19.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.707+0000 7fc0dcf36800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.707+0000 7fc0dcf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.707+0000 7fc0dcf36800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.708+0000 7fc0dcf36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:19.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.708+0000 7fc0dcf36800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.709+0000 7fc0dcf36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:19.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.709+0000 7fc0dcf36800 20 searching for the correct realm 2024-09-12T00:03:19.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.712+0000 7fc0d84b6640 0 -- 172.21.15.67:0/3358516161 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fc0cc01ebe0 msgr2=0x7fc0cc050100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:03:19.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.918+0000 7fc0d94b8640 0 -- 172.21.15.67:0/3358516161 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x560a314b5d20 msgr2=0x560a314b8150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:19.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.922+0000 7fc0dcf36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:19.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.922+0000 7fc0dcf36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:19.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.922+0000 7fc0dcf36800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:19.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.922+0000 7fc0dcf36800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:19.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.922+0000 7fc0dcf36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:19.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.922+0000 7fc0dcf36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:19.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.922+0000 7fc0dcf36800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.922+0000 7fc0dcf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.922+0000 7fc0dcf36800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.922+0000 7fc0dcf36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:19.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.922+0000 7fc0dcf36800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.923+0000 7fc0dcf36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:19.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.923+0000 7fc0dcf36800 20 zone default found 2024-09-12T00:03:19.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.923+0000 7fc0dcf36800 4 Realm: () 2024-09-12T00:03:19.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.923+0000 7fc0dcf36800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:19.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.923+0000 7fc0dcf36800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:19.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.923+0000 7fc0dcf36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:19.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.923+0000 7fc0dcf36800 20 zonegroup default 2024-09-12T00:03:19.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.923+0000 7fc0dcf36800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.923+0000 7fc0dcf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.923+0000 7fc0dcf36800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.923+0000 7fc0dcf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.923+0000 7fc0dcf36800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.924+0000 7fc0dcf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:19.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.924+0000 7fc0dcf36800 20 started sync module instance, tier type = 2024-09-12T00:03:19.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.924+0000 7fc0dcf36800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:19.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.933+0000 7fc0dcf36800 20 add_watcher() i=0 2024-09-12T00:03:19.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.933+0000 7fc0dcf36800 20 add_watcher() i=1 2024-09-12T00:03:19.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.933+0000 7fc0dcf36800 20 add_watcher() i=2 2024-09-12T00:03:19.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.933+0000 7fc0dcf36800 20 add_watcher() i=3 2024-09-12T00:03:19.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.933+0000 7fc0dcf36800 20 add_watcher() i=4 2024-09-12T00:03:19.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.933+0000 7fc0dcf36800 20 add_watcher() i=5 2024-09-12T00:03:19.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.933+0000 7fc0dcf36800 20 add_watcher() i=6 2024-09-12T00:03:19.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.935+0000 7fc0dcf36800 20 add_watcher() i=7 2024-09-12T00:03:19.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.935+0000 7fc0dcf36800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:19.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.936+0000 7fbf8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.937+0000 7fc0dcf36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.937+0000 7fc0dcf36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.937+0000 7fc0dcf36800 5 note: GC not initialized 2024-09-12T00:03:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.937+0000 7fbf8dfe3640 20 reqs_thread_entry: start 2024-09-12T00:03:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.937+0000 7fc0dcf36800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.937+0000 7fc0dcf36800 20 Filter name: none 2024-09-12T00:03:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.937+0000 7fbeff7fe640 20 reqs_thread_entry: start 2024-09-12T00:03:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.937+0000 7fc0dcf36800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:03:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.937+0000 7fc0dcf36800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.938+0000 7fc0dcf36800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:19.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.938+0000 7fc0dcf36800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:03:19.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.938+0000 7fc0dcf36800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:03:19.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.938+0000 7fc0dcf36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 : miss 2024-09-12T00:03:19.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.938+0000 7fc0dcf36800 20 rados->read ofs=0 len=0 2024-09-12T00:03:19.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.938+0000 7fc0dcf36800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:19.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.938+0000 7fc0dcf36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 info.flags=0x17 2024-09-12T00:03:19.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.938+0000 7fc0dcf36800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 to cache LRU end 2024-09-12T00:03:19.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.938+0000 7fc0dcf36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:03:19.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.938+0000 7fc0dcf36800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:03:19.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.939+0000 7fc0dcf36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 2024-09-12T00:03:19.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.939+0000 7fc0dcf36800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:19.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.939+0000 7fc0dcf36800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:03:19.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.939+0000 7fc0dcf36800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:03:19.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.940+0000 7fbf8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:19.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.943+0000 7fc0dcf36800 20 remove_watcher() i=0 2024-09-12T00:03:19.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.943+0000 7fc0dcf36800 2 removed watcher, disabling cache 2024-09-12T00:03:19.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.944+0000 7fc0dcf36800 20 remove_watcher() i=1 2024-09-12T00:03:19.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.945+0000 7fc0dcf36800 20 remove_watcher() i=2 2024-09-12T00:03:19.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.946+0000 7fc0dcf36800 20 remove_watcher() i=3 2024-09-12T00:03:19.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.947+0000 7fc0dcf36800 20 remove_watcher() i=4 2024-09-12T00:03:19.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.948+0000 7fc0dcf36800 20 remove_watcher() i=5 2024-09-12T00:03:19.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.949+0000 7fc0dcf36800 20 remove_watcher() i=6 2024-09-12T00:03:19.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:19.950+0000 7fc0dcf36800 20 remove_watcher() i=7 2024-09-12T00:03:19.995 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:03:20.027 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:20.027 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:20.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.067+0000 7f2b6bb40800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.069+0000 7f2b6bb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.069+0000 7f2b6bb40800 20 realm 2024-09-12T00:03:20.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.069+0000 7f2b6bb40800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.069+0000 7f2b6bb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.069+0000 7f2b6bb40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:20.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.069+0000 7f2b6bb40800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.069+0000 7f2b6bb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.069+0000 7f2b6bb40800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.070+0000 7f2b6bb40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:20.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.070+0000 7f2b6bb40800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.071+0000 7f2b6bb40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:20.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.071+0000 7f2b6bb40800 20 searching for the correct realm 2024-09-12T00:03:20.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.073+0000 7f2b670bf640 0 -- 172.21.15.67:0/2960600964 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f2b50075060 msgr2=0x7f2b500cf370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:03:20.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.278+0000 7f2b680c1640 0 -- 172.21.15.67:0/2960600964 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x56489bbf2fe0 msgr2=0x56489bbf5400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:20.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.282+0000 7f2b6bb40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:20.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.282+0000 7f2b6bb40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:20.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.282+0000 7f2b6bb40800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:20.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.282+0000 7f2b6bb40800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:20.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.282+0000 7f2b6bb40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:20.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.282+0000 7f2b6bb40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:20.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.282+0000 7f2b6bb40800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.283+0000 7f2b6bb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.283+0000 7f2b6bb40800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.283+0000 7f2b6bb40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:20.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.283+0000 7f2b6bb40800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.283+0000 7f2b6bb40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:20.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.283+0000 7f2b6bb40800 20 zone default found 2024-09-12T00:03:20.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.283+0000 7f2b6bb40800 4 Realm: () 2024-09-12T00:03:20.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.283+0000 7f2b6bb40800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:20.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.283+0000 7f2b6bb40800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:20.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.283+0000 7f2b6bb40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:20.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.283+0000 7f2b6bb40800 20 zonegroup default 2024-09-12T00:03:20.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.283+0000 7f2b6bb40800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.284+0000 7f2b6bb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.284+0000 7f2b6bb40800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.284+0000 7f2b6bb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.284+0000 7f2b6bb40800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.284+0000 7f2b6bb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.284+0000 7f2b6bb40800 20 started sync module instance, tier type = 2024-09-12T00:03:20.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.284+0000 7f2b6bb40800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:20.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.293+0000 7f2b6bb40800 20 add_watcher() i=0 2024-09-12T00:03:20.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.293+0000 7f2b6bb40800 20 add_watcher() i=1 2024-09-12T00:03:20.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.293+0000 7f2b6bb40800 20 add_watcher() i=2 2024-09-12T00:03:20.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.293+0000 7f2b6bb40800 20 add_watcher() i=3 2024-09-12T00:03:20.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.293+0000 7f2b6bb40800 20 add_watcher() i=4 2024-09-12T00:03:20.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.293+0000 7f2b6bb40800 20 add_watcher() i=5 2024-09-12T00:03:20.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.293+0000 7f2b6bb40800 20 add_watcher() i=6 2024-09-12T00:03:20.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.294+0000 7f2b6bb40800 20 add_watcher() i=7 2024-09-12T00:03:20.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.294+0000 7f2b6bb40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:20.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.296+0000 7f2a1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:20.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.296+0000 7f2b6bb40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:20.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.296+0000 7f2b6bb40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:20.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.296+0000 7f2b6bb40800 5 note: GC not initialized 2024-09-12T00:03:20.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.297+0000 7f2a1cfe1640 20 reqs_thread_entry: start 2024-09-12T00:03:20.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.297+0000 7f2b6bb40800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:20.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.297+0000 7f2b6bb40800 20 Filter name: none 2024-09-12T00:03:20.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.297+0000 7f29967fc640 20 reqs_thread_entry: start 2024-09-12T00:03:20.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.297+0000 7f2b6bb40800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.297+0000 7f2b6bb40800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:20.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.297+0000 7f2b6bb40800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.298+0000 7f2b6bb40800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:20.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.298+0000 7f2b6bb40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:20.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.298+0000 7f2b6bb40800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:03:20.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.298+0000 7f2b6bb40800 20 INFO: main: starting shard=0 2024-09-12T00:03:20.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.298+0000 7f2b6bb40800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:20.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.298+0000 7f2b6bb40800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:03:20.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.298+0000 7f2b6bb40800 20 INFO: main: done 2024-09-12T00:03:20.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.299+0000 7f2a1dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:20.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.301+0000 7f2b6bb40800 20 remove_watcher() i=0 2024-09-12T00:03:20.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.302+0000 7f2b6bb40800 2 removed watcher, disabling cache 2024-09-12T00:03:20.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.303+0000 7f2b6bb40800 20 remove_watcher() i=1 2024-09-12T00:03:20.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.304+0000 7f2b6bb40800 20 remove_watcher() i=2 2024-09-12T00:03:20.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.305+0000 7f2b6bb40800 20 remove_watcher() i=3 2024-09-12T00:03:20.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.306+0000 7f2b6bb40800 20 remove_watcher() i=4 2024-09-12T00:03:20.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.307+0000 7f2b6bb40800 20 remove_watcher() i=5 2024-09-12T00:03:20.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.308+0000 7f2b6bb40800 20 remove_watcher() i=6 2024-09-12T00:03:20.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.309+0000 7f2b6bb40800 20 remove_watcher() i=7 2024-09-12T00:03:20.320 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:03:20.352 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:20.352 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:20.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.392+0000 7fd4492bb800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.394+0000 7fd4492bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.394+0000 7fd4492bb800 20 realm 2024-09-12T00:03:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.394+0000 7fd4492bb800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.394+0000 7fd4492bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.394+0000 7fd4492bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.394+0000 7fd4492bb800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.395+0000 7fd4492bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.395+0000 7fd4492bb800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.395+0000 7fd4492bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:20.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.395+0000 7fd4492bb800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.396+0000 7fd4492bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:20.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.396+0000 7fd4492bb800 20 searching for the correct realm 2024-09-12T00:03:20.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.399+0000 7fd43e5a4640 0 -- 172.21.15.67:0/1443619222 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fd430017040 msgr2=0x7fd4300628b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:20.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.604+0000 7fd4475a6640 0 -- 172.21.15.67:0/1443619222 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x564db75b1ac0 msgr2=0x564db75b3f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:20.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.608+0000 7fd4492bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:20.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.608+0000 7fd4492bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:20.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.608+0000 7fd4492bb800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:20.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.608+0000 7fd4492bb800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:20.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.608+0000 7fd4492bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:20.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.608+0000 7fd4492bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:20.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.608+0000 7fd4492bb800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.608+0000 7fd4492bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.608+0000 7fd4492bb800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.609+0000 7fd4492bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.609+0000 7fd4492bb800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.609+0000 7fd4492bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.609+0000 7fd4492bb800 20 zone default found 2024-09-12T00:03:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.609+0000 7fd4492bb800 4 Realm: () 2024-09-12T00:03:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.609+0000 7fd4492bb800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.609+0000 7fd4492bb800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.609+0000 7fd4492bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.609+0000 7fd4492bb800 20 zonegroup default 2024-09-12T00:03:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.609+0000 7fd4492bb800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.609+0000 7fd4492bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.609+0000 7fd4492bb800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.610+0000 7fd4492bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.610+0000 7fd4492bb800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.610+0000 7fd4492bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.610+0000 7fd4492bb800 20 started sync module instance, tier type = 2024-09-12T00:03:20.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.610+0000 7fd4492bb800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:20.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.619+0000 7fd4492bb800 20 add_watcher() i=0 2024-09-12T00:03:20.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.619+0000 7fd4492bb800 20 add_watcher() i=1 2024-09-12T00:03:20.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.619+0000 7fd4492bb800 20 add_watcher() i=2 2024-09-12T00:03:20.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.619+0000 7fd4492bb800 20 add_watcher() i=3 2024-09-12T00:03:20.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.619+0000 7fd4492bb800 20 add_watcher() i=4 2024-09-12T00:03:20.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.619+0000 7fd4492bb800 20 add_watcher() i=5 2024-09-12T00:03:20.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.619+0000 7fd4492bb800 20 add_watcher() i=6 2024-09-12T00:03:20.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.620+0000 7fd4492bb800 20 add_watcher() i=7 2024-09-12T00:03:20.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.620+0000 7fd4492bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:20.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.621+0000 7fd2fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:20.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.622+0000 7fd4492bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:20.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.622+0000 7fd4492bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:20.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.622+0000 7fd4492bb800 5 note: GC not initialized 2024-09-12T00:03:20.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.622+0000 7fd277fff640 20 reqs_thread_entry: start 2024-09-12T00:03:20.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.622+0000 7fd4492bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:20.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.622+0000 7fd4492bb800 20 Filter name: none 2024-09-12T00:03:20.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.622+0000 7fd275ffb640 20 reqs_thread_entry: start 2024-09-12T00:03:20.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.623+0000 7fd4492bb800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.623+0000 7fd4492bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:20.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.623+0000 7fd4492bb800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.623+0000 7fd4492bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:20.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.623+0000 7fd4492bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:20.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.623+0000 7fd4492bb800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:03:20.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.623+0000 7fd4492bb800 20 INFO: main: starting shard=0 2024-09-12T00:03:20.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.623+0000 7fd4492bb800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:20.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.624+0000 7fd4492bb800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:03:20.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.624+0000 7fd4492bb800 20 INFO: main: done 2024-09-12T00:03:20.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.625+0000 7fd2fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:20.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.627+0000 7fd4492bb800 20 remove_watcher() i=0 2024-09-12T00:03:20.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.627+0000 7fd4492bb800 2 removed watcher, disabling cache 2024-09-12T00:03:20.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.628+0000 7fd4492bb800 20 remove_watcher() i=1 2024-09-12T00:03:20.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.629+0000 7fd4492bb800 20 remove_watcher() i=2 2024-09-12T00:03:20.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.631+0000 7fd4492bb800 20 remove_watcher() i=3 2024-09-12T00:03:20.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.633+0000 7fd4492bb800 20 remove_watcher() i=4 2024-09-12T00:03:20.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.635+0000 7fd4492bb800 20 remove_watcher() i=5 2024-09-12T00:03:20.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.636+0000 7fd4492bb800 20 remove_watcher() i=6 2024-09-12T00:03:20.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.637+0000 7fd4492bb800 20 remove_watcher() i=7 2024-09-12T00:03:20.647 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T00:03:20.647 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:20.648 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:03:20.680 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:20.680 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:20.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.720+0000 7f9fbfd25800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.722+0000 7f9fbfd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.722+0000 7f9fbfd25800 20 realm 2024-09-12T00:03:20.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.722+0000 7f9fbfd25800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.722+0000 7f9fbfd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.722+0000 7f9fbfd25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:20.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.722+0000 7f9fbfd25800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.722+0000 7f9fbfd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.722+0000 7f9fbfd25800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.723+0000 7f9fbfd25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:20.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.723+0000 7f9fbfd25800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.724+0000 7f9fbfd25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:20.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.724+0000 7f9fbfd25800 20 searching for the correct realm 2024-09-12T00:03:20.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.727+0000 7f9fbb132640 0 -- 172.21.15.67:0/2683800652 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f9fb00abbf0 msgr2=0x7f9fb00b4040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:20.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.730+0000 7f9fbb933640 0 -- 172.21.15.67:0/2683800652 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f9fb4081e50 msgr2=0x7f9fb4060a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:03:20.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.734+0000 7f9fbfd25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:20.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.734+0000 7f9fbfd25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:20.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.734+0000 7f9fbfd25800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:20.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.734+0000 7f9fbfd25800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:20.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.734+0000 7f9fbfd25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:20.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.734+0000 7f9fbfd25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:20.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.734+0000 7f9fbfd25800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.735+0000 7f9fbfd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.735+0000 7f9fbfd25800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.735+0000 7f9fbfd25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:20.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.735+0000 7f9fbfd25800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.735+0000 7f9fbfd25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:20.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.735+0000 7f9fbfd25800 20 zone default found 2024-09-12T00:03:20.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.735+0000 7f9fbfd25800 4 Realm: () 2024-09-12T00:03:20.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.735+0000 7f9fbfd25800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:20.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.735+0000 7f9fbfd25800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:20.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.735+0000 7f9fbfd25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:20.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.735+0000 7f9fbfd25800 20 zonegroup default 2024-09-12T00:03:20.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.735+0000 7f9fbfd25800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.735+0000 7f9fbfd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.735+0000 7f9fbfd25800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.736+0000 7f9fbfd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.736+0000 7f9fbfd25800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.736+0000 7f9fbfd25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.736+0000 7f9fbfd25800 20 started sync module instance, tier type = 2024-09-12T00:03:20.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.736+0000 7f9fbfd25800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:20.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.745+0000 7f9fbfd25800 20 add_watcher() i=0 2024-09-12T00:03:20.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.745+0000 7f9fbfd25800 20 add_watcher() i=1 2024-09-12T00:03:20.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.745+0000 7f9fbfd25800 20 add_watcher() i=2 2024-09-12T00:03:20.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.745+0000 7f9fbfd25800 20 add_watcher() i=3 2024-09-12T00:03:20.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.745+0000 7f9fbfd25800 20 add_watcher() i=4 2024-09-12T00:03:20.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.745+0000 7f9fbfd25800 20 add_watcher() i=5 2024-09-12T00:03:20.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.745+0000 7f9fbfd25800 20 add_watcher() i=6 2024-09-12T00:03:20.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.746+0000 7f9fbfd25800 20 add_watcher() i=7 2024-09-12T00:03:20.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.746+0000 7f9fbfd25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:20.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.748+0000 7f9e71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:20.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.748+0000 7f9fbfd25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:20.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.748+0000 7f9fbfd25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:20.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.748+0000 7f9fbfd25800 5 note: GC not initialized 2024-09-12T00:03:20.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.748+0000 7f9e70fe1640 20 reqs_thread_entry: start 2024-09-12T00:03:20.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.748+0000 7f9fbfd25800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:20.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.748+0000 7f9fbfd25800 20 Filter name: none 2024-09-12T00:03:20.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.749+0000 7f9dea7fc640 20 reqs_thread_entry: start 2024-09-12T00:03:20.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.749+0000 7f9fbfd25800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:03:20.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.749+0000 7f9fbfd25800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.749+0000 7f9fbfd25800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:20.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.749+0000 7f9fbfd25800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:03:20.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.749+0000 7f9fbfd25800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:03:20.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.749+0000 7f9fbfd25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 : miss 2024-09-12T00:03:20.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.749+0000 7f9fbfd25800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.749+0000 7f9fbfd25800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:20.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.750+0000 7f9fbfd25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 info.flags=0x17 2024-09-12T00:03:20.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.750+0000 7f9fbfd25800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 to cache LRU end 2024-09-12T00:03:20.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.750+0000 7f9fbfd25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:03:20.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.750+0000 7f9fbfd25800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:03:20.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.750+0000 7f9fbfd25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 2024-09-12T00:03:20.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.750+0000 7f9fbfd25800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:20.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.750+0000 7f9fbfd25800 1 NOTICE: finished shard 0 (2 entries found) 2024-09-12T00:03:20.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.750+0000 7f9fbfd25800 1 NOTICE: finished all shards (2 entries found) 2024-09-12T00:03:20.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.751+0000 7f9e71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:20.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.754+0000 7f9fbfd25800 20 remove_watcher() i=0 2024-09-12T00:03:20.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.754+0000 7f9fbfd25800 2 removed watcher, disabling cache 2024-09-12T00:03:20.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.755+0000 7f9fbfd25800 20 remove_watcher() i=1 2024-09-12T00:03:20.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.756+0000 7f9fbfd25800 20 remove_watcher() i=2 2024-09-12T00:03:20.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.757+0000 7f9fbfd25800 20 remove_watcher() i=3 2024-09-12T00:03:20.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.758+0000 7f9fbfd25800 20 remove_watcher() i=4 2024-09-12T00:03:20.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.759+0000 7f9fbfd25800 20 remove_watcher() i=5 2024-09-12T00:03:20.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.760+0000 7f9fbfd25800 20 remove_watcher() i=6 2024-09-12T00:03:20.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.761+0000 7f9fbfd25800 20 remove_watcher() i=7 2024-09-12T00:03:20.771 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T00:03:20.771 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:20.772 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:03:20.805 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:20.805 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:20.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.847+0000 7f68d250a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.848+0000 7f68d250a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.848+0000 7f68d250a800 20 realm 2024-09-12T00:03:20.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.848+0000 7f68d250a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.848+0000 7f68d250a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.848+0000 7f68d250a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:20.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.848+0000 7f68d250a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.849+0000 7f68d250a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.849+0000 7f68d250a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.849+0000 7f68d250a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:20.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.849+0000 7f68d250a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.850+0000 7f68d250a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:20.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.850+0000 7f68d250a800 20 searching for the correct realm 2024-09-12T00:03:20.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.854+0000 7f68cfff4640 0 -- 172.21.15.67:0/2542789278 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f68c000b040 msgr2=0x7f68c0067070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:20.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.857+0000 7f68cfff4640 0 -- 172.21.15.67:0/2542789278 >> [v2:172.21.15.67:6800/2522402523,v1:172.21.15.67:6801/2522402523] conn(0x55d2b15bf970 msgr2=0x55d2b15c1da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:20.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.860+0000 7f68d250a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:20.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.860+0000 7f68d250a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:20.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.860+0000 7f68d250a800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:20.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.860+0000 7f68d250a800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:20.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.860+0000 7f68d250a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:20.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.860+0000 7f68d250a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:20.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.860+0000 7f68d250a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.861+0000 7f68d250a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.861+0000 7f68d250a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.861+0000 7f68d250a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:20.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.861+0000 7f68d250a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.861+0000 7f68d250a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:20.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.861+0000 7f68d250a800 20 zone default found 2024-09-12T00:03:20.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.861+0000 7f68d250a800 4 Realm: () 2024-09-12T00:03:20.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.861+0000 7f68d250a800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:20.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.861+0000 7f68d250a800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:20.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.861+0000 7f68d250a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:20.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.861+0000 7f68d250a800 20 zonegroup default 2024-09-12T00:03:20.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.861+0000 7f68d250a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.862+0000 7f68d250a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.862+0000 7f68d250a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.862+0000 7f68d250a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.862+0000 7f68d250a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.862+0000 7f68d250a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:20.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.862+0000 7f68d250a800 20 started sync module instance, tier type = 2024-09-12T00:03:20.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.862+0000 7f68d250a800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:20.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.872+0000 7f68d250a800 20 add_watcher() i=0 2024-09-12T00:03:20.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.872+0000 7f68d250a800 20 add_watcher() i=1 2024-09-12T00:03:20.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.872+0000 7f68d250a800 20 add_watcher() i=2 2024-09-12T00:03:20.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.872+0000 7f68d250a800 20 add_watcher() i=3 2024-09-12T00:03:20.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.872+0000 7f68d250a800 20 add_watcher() i=4 2024-09-12T00:03:20.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.872+0000 7f68d250a800 20 add_watcher() i=5 2024-09-12T00:03:20.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.872+0000 7f68d250a800 20 add_watcher() i=6 2024-09-12T00:03:20.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.873+0000 7f68d250a800 20 add_watcher() i=7 2024-09-12T00:03:20.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.873+0000 7f68d250a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:20.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.875+0000 7f6785fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:20.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.875+0000 7f68d250a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:20.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.875+0000 7f68d250a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:20.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.875+0000 7f68d250a800 5 note: GC not initialized 2024-09-12T00:03:20.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.875+0000 7f6784fe1640 20 reqs_thread_entry: start 2024-09-12T00:03:20.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.875+0000 7f68d250a800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:20.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.875+0000 7f68d250a800 20 Filter name: none 2024-09-12T00:03:20.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.875+0000 7f66fe7fc640 20 reqs_thread_entry: start 2024-09-12T00:03:20.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.876+0000 7f68d250a800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:03:20.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.876+0000 7f68d250a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.876+0000 7f68d250a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:20.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.876+0000 7f68d250a800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:03:20.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.876+0000 7f68d250a800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:03:20.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.876+0000 7f68d250a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 : miss 2024-09-12T00:03:20.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.876+0000 7f68d250a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:20.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.876+0000 7f68d250a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:20.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.876+0000 7f68d250a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 info.flags=0x17 2024-09-12T00:03:20.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.876+0000 7f68d250a800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 to cache LRU end 2024-09-12T00:03:20.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.876+0000 7f68d250a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:03:20.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.876+0000 7f68d250a800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:03:20.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.876+0000 7f68d250a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 2024-09-12T00:03:20.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.877+0000 7f68d250a800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:20.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.877+0000 7f68d250a800 20 get_obj_state: octx=0x55d2b1348d70 obj=check-bucket:c state=0x55d2b15f6d18 s->prefetch_data=0 2024-09-12T00:03:20.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.878+0000 7f68d250a800 20 get_obj_state: setting s->obj_tag to sbrmo6z3n0du7jc1hxx01davii9b02b2 2024-09-12T00:03:20.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.878+0000 7f68d250a800 20 get_obj_state_impl: setting s->olh_tag to sbko0obwwz6diwb0ndg30ddillml64c1 2024-09-12T00:03:20.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.878+0000 7f68d250a800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:20.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.878+0000 7f68d250a800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T00:03:20.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.878+0000 7f68d250a800 20 olh_log_entry: epoch=4 op=3 key=c[dPPVpqoar.hnlwVITBUewJrNPjM-CMl] 2024-09-12T00:03:20.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.878+0000 7f68d250a800 20 get_obj_state: octx=0x55d2b1630db0 obj=check-bucket:_:dPPVpqoar.hnlwVITBUewJrNPjM-CMl_c state=0x55d2b15f6048 s->prefetch_data=0 2024-09-12T00:03:20.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.880+0000 7f68d250a800 20 get_obj_state: octx=0x55d2b1630db0 obj=check-bucket:c state=0x55d2b16317c8 s->prefetch_data=0 2024-09-12T00:03:20.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.880+0000 7f68d250a800 20 get_obj_state: setting s->obj_tag to sbrmo6z3n0du7jc1hxx01davii9b02b2 2024-09-12T00:03:20.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.880+0000 7f68d250a800 20 get_obj_state_impl: setting s->olh_tag to sbko0obwwz6diwb0ndg30ddillml64c1 2024-09-12T00:03:20.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.880+0000 7f68d250a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=sbko0obwwz6diwb0ndg30ddillml64c1 2024-09-12T00:03:20.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.888+0000 7f68d250a800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:20.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.889+0000 7f68d250a800 20 get_obj_state: octx=0x55d2b1348d70 obj=check-bucket:d state=0x55d2b15f6d18 s->prefetch_data=0 2024-09-12T00:03:20.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.889+0000 7f68d250a800 20 get_obj_state: setting s->obj_tag to zovtfczlx0d9ejb55kpmb05k9zokehtv 2024-09-12T00:03:20.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.889+0000 7f68d250a800 20 get_obj_state_impl: setting s->olh_tag to 63x9rbg9d62k30h3fw3a6y50avlrh931 2024-09-12T00:03:20.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.889+0000 7f68d250a800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:20.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.890+0000 7f68d250a800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T00:03:20.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.890+0000 7f68d250a800 20 olh_log_entry: epoch=4 op=3 key=d[A037hiRfLXh67OXbl.aiIlegH.NrCiY] 2024-09-12T00:03:20.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.890+0000 7f68d250a800 20 get_obj_state: octx=0x55d2b1630db0 obj=check-bucket:_:A037hiRfLXh67OXbl.aiIlegH.NrCiY_d state=0x55d2b1633b58 s->prefetch_data=0 2024-09-12T00:03:20.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.893+0000 7f68d250a800 20 get_obj_state: octx=0x55d2b1630db0 obj=check-bucket:d state=0x55d2b15f2008 s->prefetch_data=0 2024-09-12T00:03:20.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.894+0000 7f68d250a800 20 get_obj_state: setting s->obj_tag to zovtfczlx0d9ejb55kpmb05k9zokehtv 2024-09-12T00:03:20.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.894+0000 7f68d250a800 20 get_obj_state_impl: setting s->olh_tag to 63x9rbg9d62k30h3fw3a6y50avlrh931 2024-09-12T00:03:20.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.894+0000 7f68d250a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=63x9rbg9d62k30h3fw3a6y50avlrh931 2024-09-12T00:03:20.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.904+0000 7f68d250a800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:20.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.905+0000 7f68d250a800 1 NOTICE: finished shard 0 (2 entries removed) 2024-09-12T00:03:20.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.905+0000 7f68d250a800 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T00:03:20.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.906+0000 7f6785fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:20.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.909+0000 7f68d250a800 20 remove_watcher() i=0 2024-09-12T00:03:20.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.909+0000 7f68d250a800 2 removed watcher, disabling cache 2024-09-12T00:03:20.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.910+0000 7f68d250a800 20 remove_watcher() i=1 2024-09-12T00:03:20.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.911+0000 7f68d250a800 20 remove_watcher() i=2 2024-09-12T00:03:20.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.912+0000 7f68d250a800 20 remove_watcher() i=3 2024-09-12T00:03:20.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.913+0000 7f68d250a800 20 remove_watcher() i=4 2024-09-12T00:03:20.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.914+0000 7f68d250a800 20 remove_watcher() i=5 2024-09-12T00:03:20.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.915+0000 7f68d250a800 20 remove_watcher() i=6 2024-09-12T00:03:20.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:20.916+0000 7f68d250a800 20 remove_watcher() i=7 2024-09-12T00:03:20.928 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:03:20.959 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:20.959 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:21.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.001+0000 7fa91622f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.003+0000 7fa91622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.003+0000 7fa91622f800 20 realm 2024-09-12T00:03:21.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.003+0000 7fa91622f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.003+0000 7fa91622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.003+0000 7fa91622f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:21.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.003+0000 7fa91622f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.004+0000 7fa91622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.004+0000 7fa91622f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.004+0000 7fa91622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:21.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.004+0000 7fa91622f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.005+0000 7fa91622f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:21.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.005+0000 7fa91622f800 20 searching for the correct realm 2024-09-12T00:03:21.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.008+0000 7fa908d8a640 0 -- 172.21.15.67:0/1160166633 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fa8fc042c00 msgr2=0x7fa8fc02a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:21.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.213+0000 7fa908d8a640 0 -- 172.21.15.67:0/1160166633 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55eb0f1aa470 msgr2=0x55eb0f1ac880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:21.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.217+0000 7fa91622f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:21.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.217+0000 7fa91622f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:21.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.217+0000 7fa91622f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:21.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.217+0000 7fa91622f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:21.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.217+0000 7fa91622f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:21.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.217+0000 7fa91622f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:21.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.217+0000 7fa91622f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.217+0000 7fa91622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.217+0000 7fa91622f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.218+0000 7fa91622f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:21.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.218+0000 7fa91622f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.218+0000 7fa91622f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:21.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.218+0000 7fa91622f800 20 zone default found 2024-09-12T00:03:21.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.218+0000 7fa91622f800 4 Realm: () 2024-09-12T00:03:21.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.218+0000 7fa91622f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:21.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.218+0000 7fa91622f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:21.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.218+0000 7fa91622f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:21.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.218+0000 7fa91622f800 20 zonegroup default 2024-09-12T00:03:21.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.218+0000 7fa91622f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.218+0000 7fa91622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.218+0000 7fa91622f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.218+0000 7fa91622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.218+0000 7fa91622f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.219+0000 7fa91622f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.219+0000 7fa91622f800 20 started sync module instance, tier type = 2024-09-12T00:03:21.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.219+0000 7fa91622f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:21.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.228+0000 7fa91622f800 20 add_watcher() i=0 2024-09-12T00:03:21.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.228+0000 7fa91622f800 20 add_watcher() i=1 2024-09-12T00:03:21.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.228+0000 7fa91622f800 20 add_watcher() i=2 2024-09-12T00:03:21.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.228+0000 7fa91622f800 20 add_watcher() i=3 2024-09-12T00:03:21.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.228+0000 7fa91622f800 20 add_watcher() i=4 2024-09-12T00:03:21.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.228+0000 7fa91622f800 20 add_watcher() i=5 2024-09-12T00:03:21.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.228+0000 7fa91622f800 20 add_watcher() i=6 2024-09-12T00:03:21.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.229+0000 7fa91622f800 20 add_watcher() i=7 2024-09-12T00:03:21.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.229+0000 7fa91622f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:21.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.231+0000 7fa7c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:21.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.231+0000 7fa91622f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:21.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.231+0000 7fa91622f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:21.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.231+0000 7fa91622f800 5 note: GC not initialized 2024-09-12T00:03:21.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.231+0000 7fa7c67e4640 20 reqs_thread_entry: start 2024-09-12T00:03:21.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.232+0000 7fa91622f800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:21.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.232+0000 7fa91622f800 20 Filter name: none 2024-09-12T00:03:21.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.232+0000 7fa737fff640 20 reqs_thread_entry: start 2024-09-12T00:03:21.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.232+0000 7fa91622f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.232+0000 7fa91622f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:21.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.232+0000 7fa91622f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.233+0000 7fa91622f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:21.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.233+0000 7fa91622f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:21.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.233+0000 7fa91622f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:03:21.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.233+0000 7fa91622f800 20 INFO: main: starting shard=0 2024-09-12T00:03:21.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.233+0000 7fa91622f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:21.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.233+0000 7fa91622f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:03:21.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.233+0000 7fa91622f800 20 INFO: main: done 2024-09-12T00:03:21.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.234+0000 7fa7c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:21.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.236+0000 7fa91622f800 20 remove_watcher() i=0 2024-09-12T00:03:21.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.236+0000 7fa91622f800 2 removed watcher, disabling cache 2024-09-12T00:03:21.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.237+0000 7fa91622f800 20 remove_watcher() i=1 2024-09-12T00:03:21.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.238+0000 7fa91622f800 20 remove_watcher() i=2 2024-09-12T00:03:21.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.239+0000 7fa91622f800 20 remove_watcher() i=3 2024-09-12T00:03:21.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.240+0000 7fa91622f800 20 remove_watcher() i=4 2024-09-12T00:03:21.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.241+0000 7fa91622f800 20 remove_watcher() i=5 2024-09-12T00:03:21.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.242+0000 7fa91622f800 20 remove_watcher() i=6 2024-09-12T00:03:21.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.243+0000 7fa91622f800 20 remove_watcher() i=7 2024-09-12T00:03:21.255 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:03:21.289 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:21.289 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:21.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.327+0000 7f70a9f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.328+0000 7f70a9f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.328+0000 7f70a9f0c800 20 realm 2024-09-12T00:03:21.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.328+0000 7f70a9f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.329+0000 7f70a9f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.329+0000 7f70a9f0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:21.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.329+0000 7f70a9f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.329+0000 7f70a9f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.329+0000 7f70a9f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.330+0000 7f70a9f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:21.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.330+0000 7f70a9f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.330+0000 7f70a9f0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:21.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.330+0000 7f70a9f0c800 20 searching for the correct realm 2024-09-12T00:03:21.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.334+0000 7f70a79f6640 0 -- 172.21.15.67:0/2420408702 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f7098023450 msgr2=0x7f7098023890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:21.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.337+0000 7f70a79f6640 0 -- 172.21.15.67:0/2420408702 >> [v2:172.21.15.67:6800/2522402523,v1:172.21.15.67:6801/2522402523] conn(0x56359319a7a0 msgr2=0x56359319cb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.341+0000 7f70a9f0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.341+0000 7f70a9f0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.341+0000 7f70a9f0c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.341+0000 7f70a9f0c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.341+0000 7f70a9f0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.341+0000 7f70a9f0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.341+0000 7f70a9f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.341+0000 7f70a9f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.341+0000 7f70a9f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.341+0000 7f70a9f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.341+0000 7f70a9f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.342+0000 7f70a9f0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.342+0000 7f70a9f0c800 20 zone default found 2024-09-12T00:03:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.342+0000 7f70a9f0c800 4 Realm: () 2024-09-12T00:03:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.342+0000 7f70a9f0c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.342+0000 7f70a9f0c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.342+0000 7f70a9f0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.342+0000 7f70a9f0c800 20 zonegroup default 2024-09-12T00:03:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.342+0000 7f70a9f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.342+0000 7f70a9f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.342+0000 7f70a9f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.342+0000 7f70a9f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.342+0000 7f70a9f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.343+0000 7f70a9f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.343+0000 7f70a9f0c800 20 started sync module instance, tier type = 2024-09-12T00:03:21.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.343+0000 7f70a9f0c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:21.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.352+0000 7f70a9f0c800 20 add_watcher() i=0 2024-09-12T00:03:21.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.352+0000 7f70a9f0c800 20 add_watcher() i=1 2024-09-12T00:03:21.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.352+0000 7f70a9f0c800 20 add_watcher() i=2 2024-09-12T00:03:21.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.352+0000 7f70a9f0c800 20 add_watcher() i=3 2024-09-12T00:03:21.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.352+0000 7f70a9f0c800 20 add_watcher() i=4 2024-09-12T00:03:21.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.352+0000 7f70a9f0c800 20 add_watcher() i=5 2024-09-12T00:03:21.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.352+0000 7f70a9f0c800 20 add_watcher() i=6 2024-09-12T00:03:21.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.353+0000 7f70a9f0c800 20 add_watcher() i=7 2024-09-12T00:03:21.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.353+0000 7f70a9f0c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:21.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.355+0000 7f6f5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:21.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.355+0000 7f70a9f0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:21.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.355+0000 7f70a9f0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:21.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.355+0000 7f70a9f0c800 5 note: GC not initialized 2024-09-12T00:03:21.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.355+0000 7f6f5cfe1640 20 reqs_thread_entry: start 2024-09-12T00:03:21.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.355+0000 7f70a9f0c800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:21.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.355+0000 7f70a9f0c800 20 Filter name: none 2024-09-12T00:03:21.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.356+0000 7f6ed67fc640 20 reqs_thread_entry: start 2024-09-12T00:03:21.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.356+0000 7f70a9f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.356+0000 7f70a9f0c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:21.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.356+0000 7f70a9f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.356+0000 7f70a9f0c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:21.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.356+0000 7f70a9f0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:21.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.356+0000 7f70a9f0c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:03:21.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.356+0000 7f70a9f0c800 20 INFO: main: starting shard=0 2024-09-12T00:03:21.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.356+0000 7f70a9f0c800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:21.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.357+0000 7f70a9f0c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:03:21.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.357+0000 7f70a9f0c800 20 INFO: main: done 2024-09-12T00:03:21.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.358+0000 7f6f5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:21.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.360+0000 7f70a9f0c800 20 remove_watcher() i=0 2024-09-12T00:03:21.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.360+0000 7f70a9f0c800 2 removed watcher, disabling cache 2024-09-12T00:03:21.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.361+0000 7f70a9f0c800 20 remove_watcher() i=1 2024-09-12T00:03:21.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.362+0000 7f70a9f0c800 20 remove_watcher() i=2 2024-09-12T00:03:21.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.363+0000 7f70a9f0c800 20 remove_watcher() i=3 2024-09-12T00:03:21.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.364+0000 7f70a9f0c800 20 remove_watcher() i=4 2024-09-12T00:03:21.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.365+0000 7f70a9f0c800 20 remove_watcher() i=5 2024-09-12T00:03:21.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.366+0000 7f70a9f0c800 20 remove_watcher() i=6 2024-09-12T00:03:21.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.367+0000 7f70a9f0c800 20 remove_watcher() i=7 2024-09-12T00:03:21.377 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T00:03:21.377 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:21.378 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:03:21.410 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:21.410 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:21.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.451+0000 7f8a71725800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.453+0000 7f8a71725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.453+0000 7f8a71725800 20 realm 2024-09-12T00:03:21.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.453+0000 7f8a71725800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.453+0000 7f8a71725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.453+0000 7f8a71725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:21.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.453+0000 7f8a71725800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.453+0000 7f8a71725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.453+0000 7f8a71725800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.454+0000 7f8a71725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:21.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.454+0000 7f8a71725800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.455+0000 7f8a71725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:21.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.455+0000 7f8a71725800 20 searching for the correct realm 2024-09-12T00:03:21.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.458+0000 7f8a6d333640 0 -- 172.21.15.67:0/2778195247 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f8a6006b020 msgr2=0x7f8a600093c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:21.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.461+0000 7f8a6d333640 0 -- 172.21.15.67:0/2778195247 >> [v2:172.21.15.67:6800/2522402523,v1:172.21.15.67:6801/2522402523] conn(0x560841055e10 msgr2=0x560841058260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:21.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:21.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:21.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:21.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:21.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:21.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:21.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:21.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:21.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 20 zone default found 2024-09-12T00:03:21.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 4 Realm: () 2024-09-12T00:03:21.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:21.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:21.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:21.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 20 zonegroup default 2024-09-12T00:03:21.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.465+0000 7f8a71725800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.466+0000 7f8a71725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.466+0000 7f8a71725800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.466+0000 7f8a71725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.466+0000 7f8a71725800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.466+0000 7f8a71725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:21.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.466+0000 7f8a71725800 20 started sync module instance, tier type = 2024-09-12T00:03:21.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.466+0000 7f8a71725800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:21.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.474+0000 7f8a71725800 20 add_watcher() i=0 2024-09-12T00:03:21.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.474+0000 7f8a71725800 20 add_watcher() i=1 2024-09-12T00:03:21.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.474+0000 7f8a71725800 20 add_watcher() i=2 2024-09-12T00:03:21.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.474+0000 7f8a71725800 20 add_watcher() i=3 2024-09-12T00:03:21.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.474+0000 7f8a71725800 20 add_watcher() i=4 2024-09-12T00:03:21.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.474+0000 7f8a71725800 20 add_watcher() i=5 2024-09-12T00:03:21.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.475+0000 7f8a71725800 20 add_watcher() i=6 2024-09-12T00:03:21.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.475+0000 7f8a71725800 20 add_watcher() i=7 2024-09-12T00:03:21.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.475+0000 7f8a71725800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:21.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.477+0000 7f89237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:21.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.478+0000 7f8a71725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:21.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.478+0000 7f8a71725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:21.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.478+0000 7f8a71725800 5 note: GC not initialized 2024-09-12T00:03:21.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.478+0000 7f89227e4640 20 reqs_thread_entry: start 2024-09-12T00:03:21.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.478+0000 7f8a71725800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:21.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.478+0000 7f8a71725800 20 Filter name: none 2024-09-12T00:03:21.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.478+0000 7f8893fff640 20 reqs_thread_entry: start 2024-09-12T00:03:21.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.478+0000 7f8a71725800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:03:21.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.478+0000 7f8a71725800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.479+0000 7f8a71725800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:21.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.479+0000 7f8a71725800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:03:21.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.479+0000 7f8a71725800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:03:21.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.479+0000 7f8a71725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 : miss 2024-09-12T00:03:21.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.479+0000 7f8a71725800 20 rados->read ofs=0 len=0 2024-09-12T00:03:21.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.479+0000 7f8a71725800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:21.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.479+0000 7f8a71725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 info.flags=0x17 2024-09-12T00:03:21.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.479+0000 7f8a71725800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 to cache LRU end 2024-09-12T00:03:21.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.479+0000 7f8a71725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:03:21.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.479+0000 7f8a71725800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:03:21.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.479+0000 7f8a71725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 2024-09-12T00:03:21.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.479+0000 7f8a71725800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:21.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.480+0000 7f8a71725800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:03:21.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.480+0000 7f8a71725800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:03:21.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.480+0000 7f89237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:21.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.483+0000 7f8a71725800 20 remove_watcher() i=0 2024-09-12T00:03:21.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.483+0000 7f8a71725800 2 removed watcher, disabling cache 2024-09-12T00:03:21.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.484+0000 7f8a71725800 20 remove_watcher() i=1 2024-09-12T00:03:21.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.485+0000 7f8a71725800 20 remove_watcher() i=2 2024-09-12T00:03:21.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.486+0000 7f8a71725800 20 remove_watcher() i=3 2024-09-12T00:03:21.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.487+0000 7f8a71725800 20 remove_watcher() i=4 2024-09-12T00:03:21.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.488+0000 7f8a71725800 20 remove_watcher() i=5 2024-09-12T00:03:21.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.489+0000 7f8a71725800 20 remove_watcher() i=6 2024-09-12T00:03:21.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:21.490+0000 7f8a71725800 20 remove_watcher() i=7 2024-09-12T00:03:21.500 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T00:03:21.500 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:21.553 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T00:03:21.553 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:03:21.761 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:03:22.173 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:03:23.635 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:03:23.636 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:03:23.671 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:23.671 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:23.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.717+0000 7fad65d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:23.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.719+0000 7fad65d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:23.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.719+0000 7fad65d2a800 20 realm 2024-09-12T00:03:23.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.719+0000 7fad65d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:23.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.719+0000 7fad65d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:23.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.719+0000 7fad65d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:23.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.719+0000 7fad65d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:23.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.719+0000 7fad65d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:23.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.719+0000 7fad65d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:23.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.720+0000 7fad65d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:23.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.720+0000 7fad65d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:23.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.721+0000 7fad65d2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:23.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.721+0000 7fad65d2a800 20 searching for the correct realm 2024-09-12T00:03:23.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.723+0000 7fad61aad640 0 -- 172.21.15.67:0/61005227 >> [v2:172.21.15.67:6800/2522402523,v1:172.21.15.67:6801/2522402523] conn(0x55c33cef57e0 msgr2=0x55c33cef7ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:23.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.727+0000 7fad622ae640 0 -- 172.21.15.67:0/61005227 >> [v2:172.21.15.170:6824/783534599,v1:172.21.15.170:6825/783534599] conn(0x7fad54099b90 msgr2=0x7fad54068120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:03:23.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.935+0000 7fad65d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:23.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.935+0000 7fad65d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:23.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.935+0000 7fad65d2a800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:23.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.935+0000 7fad65d2a800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:23.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.935+0000 7fad65d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:23.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.935+0000 7fad65d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:23.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.935+0000 7fad65d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:23.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.935+0000 7fad65d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:23.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.935+0000 7fad65d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:23.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.936+0000 7fad65d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:23.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.936+0000 7fad65d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:23.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.936+0000 7fad65d2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:23.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.936+0000 7fad65d2a800 20 zone default found 2024-09-12T00:03:23.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.936+0000 7fad65d2a800 4 Realm: () 2024-09-12T00:03:23.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.936+0000 7fad65d2a800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:23.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.936+0000 7fad65d2a800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:23.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.936+0000 7fad65d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:23.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.936+0000 7fad65d2a800 20 zonegroup default 2024-09-12T00:03:23.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.936+0000 7fad65d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:23.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.936+0000 7fad65d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:23.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.937+0000 7fad65d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:23.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.937+0000 7fad65d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:23.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.937+0000 7fad65d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:23.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.937+0000 7fad65d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:23.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.937+0000 7fad65d2a800 20 started sync module instance, tier type = 2024-09-12T00:03:23.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.937+0000 7fad65d2a800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:23.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.948+0000 7fad65d2a800 20 add_watcher() i=0 2024-09-12T00:03:23.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.948+0000 7fad65d2a800 20 add_watcher() i=1 2024-09-12T00:03:23.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.948+0000 7fad65d2a800 20 add_watcher() i=2 2024-09-12T00:03:23.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.948+0000 7fad65d2a800 20 add_watcher() i=3 2024-09-12T00:03:23.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.948+0000 7fad65d2a800 20 add_watcher() i=4 2024-09-12T00:03:23.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.948+0000 7fad65d2a800 20 add_watcher() i=5 2024-09-12T00:03:23.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.948+0000 7fad65d2a800 20 add_watcher() i=6 2024-09-12T00:03:23.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.949+0000 7fad65d2a800 20 add_watcher() i=7 2024-09-12T00:03:23.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.949+0000 7fad65d2a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:23.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.951+0000 7fac137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:23.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.951+0000 7fad65d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:23.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.951+0000 7fad65d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:23.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.952+0000 7fad65d2a800 5 note: GC not initialized 2024-09-12T00:03:23.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.952+0000 7fac127fc640 20 reqs_thread_entry: start 2024-09-12T00:03:23.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.952+0000 7fad65d2a800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:23.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.952+0000 7fad65d2a800 20 Filter name: none 2024-09-12T00:03:23.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.952+0000 7fab83fff640 20 reqs_thread_entry: start 2024-09-12T00:03:23.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.952+0000 7fad65d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:23.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.953+0000 7fad65d2a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:23.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.953+0000 7fad65d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:03:23.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.953+0000 7fad65d2a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:23.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.953+0000 7fad65d2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:23.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.953+0000 7fad65d2a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:03:23.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.953+0000 7fad65d2a800 20 INFO: main: starting shard=0 2024-09-12T00:03:23.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.953+0000 7fad65d2a800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:23.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.954+0000 7fad65d2a800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:03:23.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.954+0000 7fad65d2a800 20 INFO: main: done 2024-09-12T00:03:23.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.955+0000 7fac137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:23.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.957+0000 7fad65d2a800 20 remove_watcher() i=0 2024-09-12T00:03:23.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.957+0000 7fad65d2a800 2 removed watcher, disabling cache 2024-09-12T00:03:23.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.958+0000 7fad65d2a800 20 remove_watcher() i=1 2024-09-12T00:03:23.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.959+0000 7fad65d2a800 20 remove_watcher() i=2 2024-09-12T00:03:23.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.961+0000 7fad65d2a800 20 remove_watcher() i=3 2024-09-12T00:03:23.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.962+0000 7fad65d2a800 20 remove_watcher() i=4 2024-09-12T00:03:23.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.963+0000 7fad65d2a800 20 remove_watcher() i=5 2024-09-12T00:03:23.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.964+0000 7fad65d2a800 20 remove_watcher() i=6 2024-09-12T00:03:23.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:23.965+0000 7fad65d2a800 20 remove_watcher() i=7 2024-09-12T00:03:24.034 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:03:24.035 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:03:24.067 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:24.068 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:24.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.108+0000 7fe330613800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.110+0000 7fe330613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.110+0000 7fe330613800 20 realm 2024-09-12T00:03:24.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.110+0000 7fe330613800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.110+0000 7fe330613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.110+0000 7fe330613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:24.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.110+0000 7fe330613800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.111+0000 7fe330613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.111+0000 7fe330613800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.111+0000 7fe330613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:24.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.111+0000 7fe330613800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.112+0000 7fe330613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:24.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.112+0000 7fe330613800 20 searching for the correct realm 2024-09-12T00:03:24.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.116+0000 7fe32c549640 0 -- 172.21.15.67:0/2049985772 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7fe320014c20 msgr2=0x7fe32004e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:24.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.120+0000 7fe32bd48640 0 -- 172.21.15.67:0/2049985772 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fe32401eb00 msgr2=0x7fe32403c950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:24.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.124+0000 7fe330613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:24.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.124+0000 7fe330613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:24.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.124+0000 7fe330613800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:24.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.124+0000 7fe330613800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:24.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.124+0000 7fe330613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:24.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.124+0000 7fe330613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:24.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.124+0000 7fe330613800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.124+0000 7fe330613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.124+0000 7fe330613800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.125+0000 7fe330613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:24.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.125+0000 7fe330613800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.125+0000 7fe330613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:24.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.125+0000 7fe330613800 20 zone default found 2024-09-12T00:03:24.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.125+0000 7fe330613800 4 Realm: () 2024-09-12T00:03:24.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.125+0000 7fe330613800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:24.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.125+0000 7fe330613800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:24.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.125+0000 7fe330613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:24.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.125+0000 7fe330613800 20 zonegroup default 2024-09-12T00:03:24.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.125+0000 7fe330613800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.125+0000 7fe330613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.125+0000 7fe330613800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.125+0000 7fe330613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.125+0000 7fe330613800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.126+0000 7fe330613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.126+0000 7fe330613800 20 started sync module instance, tier type = 2024-09-12T00:03:24.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.126+0000 7fe330613800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:24.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.136+0000 7fe330613800 20 add_watcher() i=0 2024-09-12T00:03:24.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.136+0000 7fe330613800 20 add_watcher() i=1 2024-09-12T00:03:24.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.136+0000 7fe330613800 20 add_watcher() i=2 2024-09-12T00:03:24.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.136+0000 7fe330613800 20 add_watcher() i=3 2024-09-12T00:03:24.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.136+0000 7fe330613800 20 add_watcher() i=4 2024-09-12T00:03:24.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.136+0000 7fe330613800 20 add_watcher() i=5 2024-09-12T00:03:24.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.136+0000 7fe330613800 20 add_watcher() i=6 2024-09-12T00:03:24.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.137+0000 7fe330613800 20 add_watcher() i=7 2024-09-12T00:03:24.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.137+0000 7fe330613800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:24.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.139+0000 7fe1e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:24.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.139+0000 7fe330613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:24.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.139+0000 7fe330613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:24.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.139+0000 7fe330613800 5 note: GC not initialized 2024-09-12T00:03:24.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.139+0000 7fe1e0fe1640 20 reqs_thread_entry: start 2024-09-12T00:03:24.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.139+0000 7fe330613800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:24.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.139+0000 7fe330613800 20 Filter name: none 2024-09-12T00:03:24.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.139+0000 7fe15a7fc640 20 reqs_thread_entry: start 2024-09-12T00:03:24.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.139+0000 7fe330613800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.140+0000 7fe330613800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:24.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.140+0000 7fe330613800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.141+0000 7fe330613800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:24.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.141+0000 7fe330613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:24.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.141+0000 7fe330613800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:03:24.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.141+0000 7fe330613800 20 INFO: main: starting shard=0 2024-09-12T00:03:24.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.141+0000 7fe330613800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:24.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.141+0000 7fe330613800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:03:24.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.142+0000 7fe330613800 20 INFO: main: done 2024-09-12T00:03:24.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.142+0000 7fe1e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:24.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.145+0000 7fe330613800 20 remove_watcher() i=0 2024-09-12T00:03:24.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.145+0000 7fe330613800 2 removed watcher, disabling cache 2024-09-12T00:03:24.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.146+0000 7fe330613800 20 remove_watcher() i=1 2024-09-12T00:03:24.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.147+0000 7fe330613800 20 remove_watcher() i=2 2024-09-12T00:03:24.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.148+0000 7fe330613800 20 remove_watcher() i=3 2024-09-12T00:03:24.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.149+0000 7fe330613800 20 remove_watcher() i=4 2024-09-12T00:03:24.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.150+0000 7fe330613800 20 remove_watcher() i=5 2024-09-12T00:03:24.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.151+0000 7fe330613800 20 remove_watcher() i=6 2024-09-12T00:03:24.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.152+0000 7fe330613800 20 remove_watcher() i=7 2024-09-12T00:03:24.222 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:03:24.223 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:03:24.254 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:24.254 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:24.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.295+0000 7f9df980f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.297+0000 7f9df980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.297+0000 7f9df980f800 20 realm 2024-09-12T00:03:24.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.297+0000 7f9df980f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.297+0000 7f9df980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.297+0000 7f9df980f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:24.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.297+0000 7f9df980f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.297+0000 7f9df980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.297+0000 7f9df980f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.298+0000 7f9df980f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:24.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.298+0000 7f9df980f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.299+0000 7f9df980f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:24.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.299+0000 7f9df980f800 20 searching for the correct realm 2024-09-12T00:03:24.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.302+0000 7f9df4747640 0 -- 172.21.15.67:0/1398365927 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f9de8047910 msgr2=0x7f9de802d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:24.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.508+0000 7f9df4747640 0 -- 172.21.15.67:0/1398365927 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5622d5ffccf0 msgr2=0x5622d5fff0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:24.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.512+0000 7f9df980f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:24.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.512+0000 7f9df980f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:24.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.512+0000 7f9df980f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:24.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.512+0000 7f9df980f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:24.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.512+0000 7f9df980f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:24.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.512+0000 7f9df980f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:24.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.512+0000 7f9df980f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.512+0000 7f9df980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.512+0000 7f9df980f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.512+0000 7f9df980f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:24.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.512+0000 7f9df980f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.512+0000 7f9df980f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:24.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.513+0000 7f9df980f800 20 zone default found 2024-09-12T00:03:24.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.513+0000 7f9df980f800 4 Realm: () 2024-09-12T00:03:24.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.513+0000 7f9df980f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:24.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.513+0000 7f9df980f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:24.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.513+0000 7f9df980f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:24.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.513+0000 7f9df980f800 20 zonegroup default 2024-09-12T00:03:24.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.513+0000 7f9df980f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.513+0000 7f9df980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.513+0000 7f9df980f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.513+0000 7f9df980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.513+0000 7f9df980f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.514+0000 7f9df980f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.514+0000 7f9df980f800 20 started sync module instance, tier type = 2024-09-12T00:03:24.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.514+0000 7f9df980f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:24.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.526+0000 7f9df980f800 20 add_watcher() i=0 2024-09-12T00:03:24.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.526+0000 7f9df980f800 20 add_watcher() i=1 2024-09-12T00:03:24.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.526+0000 7f9df980f800 20 add_watcher() i=2 2024-09-12T00:03:24.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.526+0000 7f9df980f800 20 add_watcher() i=3 2024-09-12T00:03:24.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.526+0000 7f9df980f800 20 add_watcher() i=4 2024-09-12T00:03:24.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.526+0000 7f9df980f800 20 add_watcher() i=5 2024-09-12T00:03:24.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.526+0000 7f9df980f800 20 add_watcher() i=6 2024-09-12T00:03:24.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.527+0000 7f9df980f800 20 add_watcher() i=7 2024-09-12T00:03:24.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.527+0000 7f9df980f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:24.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.529+0000 7f9cab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:24.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.529+0000 7f9df980f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:24.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.529+0000 7f9df980f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:24.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.529+0000 7f9df980f800 5 note: GC not initialized 2024-09-12T00:03:24.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.530+0000 7f9caa7e4640 20 reqs_thread_entry: start 2024-09-12T00:03:24.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.530+0000 7f9df980f800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:24.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.530+0000 7f9df980f800 20 Filter name: none 2024-09-12T00:03:24.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.530+0000 7f9ca3fff640 20 reqs_thread_entry: start 2024-09-12T00:03:24.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.530+0000 7f9df980f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.531+0000 7f9df980f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:24.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.531+0000 7f9df980f800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.531+0000 7f9df980f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:24.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.531+0000 7f9df980f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:24.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.531+0000 7f9df980f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:03:24.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.531+0000 7f9df980f800 20 INFO: main: starting shard=0 2024-09-12T00:03:24.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.531+0000 7f9df980f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:24.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.532+0000 7f9df980f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:03:24.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.532+0000 7f9df980f800 20 INFO: main: done 2024-09-12T00:03:24.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.532+0000 7f9cab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:24.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.535+0000 7f9df980f800 20 remove_watcher() i=0 2024-09-12T00:03:24.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.535+0000 7f9df980f800 2 removed watcher, disabling cache 2024-09-12T00:03:24.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.536+0000 7f9df980f800 20 remove_watcher() i=1 2024-09-12T00:03:24.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.537+0000 7f9df980f800 20 remove_watcher() i=2 2024-09-12T00:03:24.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.539+0000 7f9df980f800 20 remove_watcher() i=3 2024-09-12T00:03:24.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.540+0000 7f9df980f800 20 remove_watcher() i=4 2024-09-12T00:03:24.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.541+0000 7f9df980f800 20 remove_watcher() i=5 2024-09-12T00:03:24.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.542+0000 7f9df980f800 20 remove_watcher() i=6 2024-09-12T00:03:24.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.543+0000 7f9df980f800 20 remove_watcher() i=7 2024-09-12T00:03:24.611 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:03:24.612 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:03:24.643 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:24.643 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:24.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.683+0000 7f0a2fd46800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.685+0000 7f0a2fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.685+0000 7f0a2fd46800 20 realm 2024-09-12T00:03:24.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.685+0000 7f0a2fd46800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.685+0000 7f0a2fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.685+0000 7f0a2fd46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:24.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.685+0000 7f0a2fd46800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.685+0000 7f0a2fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.685+0000 7f0a2fd46800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.686+0000 7f0a2fd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:24.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.686+0000 7f0a2fd46800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.687+0000 7f0a2fd46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:24.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.687+0000 7f0a2fd46800 20 searching for the correct realm 2024-09-12T00:03:24.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.690+0000 7f0a2e038640 0 -- 172.21.15.67:0/3859725212 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7f0a2404c060 msgr2=0x7f0a240742d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:24.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.693+0000 7f0a2d837640 0 -- 172.21.15.67:0/3859725212 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f0a2801f040 msgr2=0x7f0a2803b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:24.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.697+0000 7f0a2fd46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:24.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.697+0000 7f0a2fd46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:24.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.697+0000 7f0a2fd46800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:24.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.697+0000 7f0a2fd46800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:24.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.697+0000 7f0a2fd46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:24.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.697+0000 7f0a2fd46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:24.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.697+0000 7f0a2fd46800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.697+0000 7f0a2fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.697+0000 7f0a2fd46800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.697+0000 7f0a2fd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:24.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.697+0000 7f0a2fd46800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.698+0000 7f0a2fd46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:24.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.698+0000 7f0a2fd46800 20 zone default found 2024-09-12T00:03:24.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.698+0000 7f0a2fd46800 4 Realm: () 2024-09-12T00:03:24.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.698+0000 7f0a2fd46800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:24.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.698+0000 7f0a2fd46800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:24.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.698+0000 7f0a2fd46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:24.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.698+0000 7f0a2fd46800 20 zonegroup default 2024-09-12T00:03:24.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.698+0000 7f0a2fd46800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.698+0000 7f0a2fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.698+0000 7f0a2fd46800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.698+0000 7f0a2fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.698+0000 7f0a2fd46800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.698+0000 7f0a2fd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:24.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.698+0000 7f0a2fd46800 20 started sync module instance, tier type = 2024-09-12T00:03:24.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.698+0000 7f0a2fd46800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:24.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.709+0000 7f0a2fd46800 20 add_watcher() i=0 2024-09-12T00:03:24.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.709+0000 7f0a2fd46800 20 add_watcher() i=1 2024-09-12T00:03:24.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.709+0000 7f0a2fd46800 20 add_watcher() i=2 2024-09-12T00:03:24.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.709+0000 7f0a2fd46800 20 add_watcher() i=3 2024-09-12T00:03:24.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.709+0000 7f0a2fd46800 20 add_watcher() i=4 2024-09-12T00:03:24.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.709+0000 7f0a2fd46800 20 add_watcher() i=5 2024-09-12T00:03:24.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.709+0000 7f0a2fd46800 20 add_watcher() i=6 2024-09-12T00:03:24.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.709+0000 7f0a2fd46800 20 add_watcher() i=7 2024-09-12T00:03:24.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.709+0000 7f0a2fd46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:24.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.711+0000 7f08df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:24.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.712+0000 7f0a2fd46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:24.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.712+0000 7f0a2fd46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:24.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.712+0000 7f0a2fd46800 5 note: GC not initialized 2024-09-12T00:03:24.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.712+0000 7f08de7fc640 20 reqs_thread_entry: start 2024-09-12T00:03:24.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.712+0000 7f0a2fd46800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:24.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.712+0000 7f0a2fd46800 20 Filter name: none 2024-09-12T00:03:24.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.712+0000 7f084ffff640 20 reqs_thread_entry: start 2024-09-12T00:03:24.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.712+0000 7f0a2fd46800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.713+0000 7f0a2fd46800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:24.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.713+0000 7f0a2fd46800 20 rados->read ofs=0 len=0 2024-09-12T00:03:24.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.713+0000 7f0a2fd46800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:24.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.713+0000 7f0a2fd46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:24.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.713+0000 7f0a2fd46800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:03:24.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.713+0000 7f0a2fd46800 20 INFO: main: starting shard=0 2024-09-12T00:03:24.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.713+0000 7f0a2fd46800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:24.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.714+0000 7f0a2fd46800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:03:24.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.714+0000 7f0a2fd46800 20 INFO: main: done 2024-09-12T00:03:24.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.715+0000 7f08df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:24.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.717+0000 7f0a2fd46800 20 remove_watcher() i=0 2024-09-12T00:03:24.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.717+0000 7f0a2fd46800 2 removed watcher, disabling cache 2024-09-12T00:03:24.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.719+0000 7f0a2fd46800 20 remove_watcher() i=1 2024-09-12T00:03:24.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.719+0000 7f0a2fd46800 20 remove_watcher() i=2 2024-09-12T00:03:24.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.720+0000 7f0a2fd46800 20 remove_watcher() i=3 2024-09-12T00:03:24.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.723+0000 7f0a2fd46800 20 remove_watcher() i=4 2024-09-12T00:03:24.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.724+0000 7f0a2fd46800 20 remove_watcher() i=5 2024-09-12T00:03:24.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.725+0000 7f0a2fd46800 20 remove_watcher() i=6 2024-09-12T00:03:24.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:24.726+0000 7f0a2fd46800 20 remove_watcher() i=7 2024-09-12T00:03:24.743 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:03:25.156 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:03:25.566 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:03:25.596 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:25.596 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:25.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.635+0000 7fd2de322800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.637+0000 7fd2de322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:25.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.637+0000 7fd2de322800 20 realm 2024-09-12T00:03:25.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.637+0000 7fd2de322800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.638+0000 7fd2de322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:25.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.638+0000 7fd2de322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:25.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.638+0000 7fd2de322800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.638+0000 7fd2de322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:25.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.638+0000 7fd2de322800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.638+0000 7fd2de322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:25.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.638+0000 7fd2de322800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.639+0000 7fd2de322800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:25.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.639+0000 7fd2de322800 20 searching for the correct realm 2024-09-12T00:03:25.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.642+0000 7fd2d9867640 0 -- 172.21.15.67:0/2048014283 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fd2d006f820 msgr2=0x7fd2d00a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:03:25.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.847+0000 7fd2d9867640 0 -- 172.21.15.67:0/2048014283 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x557f6b37ae30 msgr2=0x557f6b37d2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:25.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:25.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:25.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:25.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:25.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:25.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:25.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:25.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:25.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:25.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 20 zone default found 2024-09-12T00:03:25.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 4 Realm: () 2024-09-12T00:03:25.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:25.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:25.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:25.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 20 zonegroup default 2024-09-12T00:03:25.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.852+0000 7fd2de322800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.853+0000 7fd2de322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:25.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.853+0000 7fd2de322800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.853+0000 7fd2de322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:25.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.853+0000 7fd2de322800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.854+0000 7fd2de322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:25.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.854+0000 7fd2de322800 20 started sync module instance, tier type = 2024-09-12T00:03:25.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.854+0000 7fd2de322800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:25.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.865+0000 7fd2de322800 20 add_watcher() i=0 2024-09-12T00:03:25.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.865+0000 7fd2de322800 20 add_watcher() i=1 2024-09-12T00:03:25.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.865+0000 7fd2de322800 20 add_watcher() i=2 2024-09-12T00:03:25.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.865+0000 7fd2de322800 20 add_watcher() i=3 2024-09-12T00:03:25.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.865+0000 7fd2de322800 20 add_watcher() i=4 2024-09-12T00:03:25.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.865+0000 7fd2de322800 20 add_watcher() i=5 2024-09-12T00:03:25.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.865+0000 7fd2de322800 20 add_watcher() i=6 2024-09-12T00:03:25.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.866+0000 7fd2de322800 20 add_watcher() i=7 2024-09-12T00:03:25.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.866+0000 7fd2de322800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:25.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.868+0000 7fd190fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:25.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.869+0000 7fd2de322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:25.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.869+0000 7fd2de322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:25.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.869+0000 7fd2de322800 5 note: GC not initialized 2024-09-12T00:03:25.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.869+0000 7fd10b7fe640 20 reqs_thread_entry: start 2024-09-12T00:03:25.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.869+0000 7fd2de322800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:25.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.869+0000 7fd2de322800 20 Filter name: none 2024-09-12T00:03:25.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.869+0000 7fd1097fa640 20 reqs_thread_entry: start 2024-09-12T00:03:25.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.869+0000 7fd2de322800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:03:25.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.869+0000 7fd2de322800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.870+0000 7fd2de322800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:25.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.870+0000 7fd2de322800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:03:25.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.870+0000 7fd2de322800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:03:25.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.870+0000 7fd2de322800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 : miss 2024-09-12T00:03:25.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.870+0000 7fd2de322800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.870+0000 7fd2de322800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:25.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.870+0000 7fd2de322800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 info.flags=0x17 2024-09-12T00:03:25.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.870+0000 7fd2de322800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 to cache LRU end 2024-09-12T00:03:25.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.870+0000 7fd2de322800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:03:25.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.870+0000 7fd2de322800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:03:25.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.870+0000 7fd2de322800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 2024-09-12T00:03:25.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.870+0000 7fd2de322800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:25.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.876+0000 7fd190fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:25.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.878+0000 7fd2de322800 20 remove_watcher() i=0 2024-09-12T00:03:25.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.878+0000 7fd2de322800 2 removed watcher, disabling cache 2024-09-12T00:03:25.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.880+0000 7fd2de322800 20 remove_watcher() i=1 2024-09-12T00:03:25.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.881+0000 7fd2de322800 20 remove_watcher() i=2 2024-09-12T00:03:25.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.882+0000 7fd2de322800 20 remove_watcher() i=3 2024-09-12T00:03:25.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.884+0000 7fd2de322800 20 remove_watcher() i=4 2024-09-12T00:03:25.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.886+0000 7fd2de322800 20 remove_watcher() i=5 2024-09-12T00:03:25.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.887+0000 7fd2de322800 20 remove_watcher() i=6 2024-09-12T00:03:25.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.888+0000 7fd2de322800 20 remove_watcher() i=7 2024-09-12T00:03:25.900 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:03:25.935 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:25.935 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:25.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.975+0000 7f63d1126800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.976+0000 7f63d1126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:25.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.976+0000 7f63d1126800 20 realm 2024-09-12T00:03:25.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.976+0000 7f63d1126800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.977+0000 7f63d1126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:25.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.977+0000 7f63d1126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:25.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.977+0000 7f63d1126800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.977+0000 7f63d1126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:25.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.977+0000 7f63d1126800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.978+0000 7f63d1126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:25.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.978+0000 7f63d1126800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.978+0000 7f63d1126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:25.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.979+0000 7f63d1126800 20 searching for the correct realm 2024-09-12T00:03:25.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.982+0000 7f63cc5d8640 0 -- 172.21.15.67:0/2819220401 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f63c0047940 msgr2=0x7f63c0008440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:25.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.985+0000 7f63ccdd9640 0 -- 172.21.15.67:0/2819220401 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f63c4079040 msgr2=0x7f63c4055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:25.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.989+0000 7f63d1126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:25.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.989+0000 7f63d1126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:25.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.989+0000 7f63d1126800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:25.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.989+0000 7f63d1126800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:25.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.989+0000 7f63d1126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:25.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.989+0000 7f63d1126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:25.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.989+0000 7f63d1126800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.990+0000 7f63d1126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:25.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.990+0000 7f63d1126800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.990+0000 7f63d1126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:25.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.990+0000 7f63d1126800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.990+0000 7f63d1126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:25.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.990+0000 7f63d1126800 20 zone default found 2024-09-12T00:03:25.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.990+0000 7f63d1126800 4 Realm: () 2024-09-12T00:03:25.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.990+0000 7f63d1126800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:25.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.990+0000 7f63d1126800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:25.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.990+0000 7f63d1126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:25.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.990+0000 7f63d1126800 20 zonegroup default 2024-09-12T00:03:25.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.990+0000 7f63d1126800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.991+0000 7f63d1126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:25.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.991+0000 7f63d1126800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.991+0000 7f63d1126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:25.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.991+0000 7f63d1126800 20 rados->read ofs=0 len=0 2024-09-12T00:03:25.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.991+0000 7f63d1126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:25.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.991+0000 7f63d1126800 20 started sync module instance, tier type = 2024-09-12T00:03:25.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:25.991+0000 7f63d1126800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:26.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.002+0000 7f63d1126800 20 add_watcher() i=0 2024-09-12T00:03:26.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.002+0000 7f63d1126800 20 add_watcher() i=1 2024-09-12T00:03:26.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.002+0000 7f63d1126800 20 add_watcher() i=2 2024-09-12T00:03:26.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.002+0000 7f63d1126800 20 add_watcher() i=3 2024-09-12T00:03:26.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.004+0000 7f63d1126800 20 add_watcher() i=4 2024-09-12T00:03:26.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.004+0000 7f63d1126800 20 add_watcher() i=5 2024-09-12T00:03:26.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.004+0000 7f63d1126800 20 add_watcher() i=6 2024-09-12T00:03:26.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.004+0000 7f63d1126800 20 add_watcher() i=7 2024-09-12T00:03:26.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.004+0000 7f63d1126800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:26.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.006+0000 7f62837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:26.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.006+0000 7f63d1126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:26.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.006+0000 7f63d1126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:26.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.006+0000 7f63d1126800 5 note: GC not initialized 2024-09-12T00:03:26.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.006+0000 7f62827e4640 20 reqs_thread_entry: start 2024-09-12T00:03:26.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.006+0000 7f63d1126800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:26.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.006+0000 7f63d1126800 20 Filter name: none 2024-09-12T00:03:26.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.006+0000 7f627bfff640 20 reqs_thread_entry: start 2024-09-12T00:03:26.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.007+0000 7f63d1126800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:03:26.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.007+0000 7f63d1126800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.007+0000 7f63d1126800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:26.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.007+0000 7f63d1126800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:03:26.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.007+0000 7f63d1126800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:03:26.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.007+0000 7f63d1126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 : miss 2024-09-12T00:03:26.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.007+0000 7f63d1126800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.008+0000 7f63d1126800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:26.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.008+0000 7f63d1126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 info.flags=0x17 2024-09-12T00:03:26.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.008+0000 7f63d1126800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 to cache LRU end 2024-09-12T00:03:26.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.008+0000 7f63d1126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:03:26.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.008+0000 7f63d1126800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:03:26.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.008+0000 7f63d1126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1 2024-09-12T00:03:26.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.008+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.009+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.010+0000 7f63d1126800 20 get_obj_state: octx=0x56381087fd80 obj=check-bucket:c state=0x563810b35ac8 s->prefetch_data=0 2024-09-12T00:03:26.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.010+0000 7f63d1126800 20 get_obj_state: setting s->obj_tag to 09fyvju0xxuh1bci56nz3gtofdahccd1 2024-09-12T00:03:26.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.010+0000 7f63d1126800 20 get_obj_state_impl: setting s->olh_tag to 2h3ypt4ytibposzhgegpj61rwcjwbw9j 2024-09-12T00:03:26.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.010+0000 7f63d1126800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2h3ypt4ytibposzhgegpj61rwcjwbw9j 2024-09-12T00:03:26.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.011+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.013+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.013+0000 7f63d1126800 20 olh_log_entry: epoch=3 op=3 key=c[UQlYBxWCpeEZdvdKLKPWHPcgH7b.Mbp] 2024-09-12T00:03:26.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.013+0000 7f63d1126800 20 get_obj_state: octx=0x56381087fd80 obj=check-bucket:_:UQlYBxWCpeEZdvdKLKPWHPcgH7b.Mbp_c state=0x563810b30cc8 s->prefetch_data=0 2024-09-12T00:03:26.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.014+0000 7f63d1126800 10 manifest: total_size = 22 2024-09-12T00:03:26.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.014+0000 7f63d1126800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15768922259915761616 2024-09-12T00:03:26.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.014+0000 7f63d1126800 20 get_obj_state: octx=0x56381087fd80 obj=check-bucket:_:UQlYBxWCpeEZdvdKLKPWHPcgH7b.Mbp_c state=0x563810b30cc8 s->prefetch_data=0 2024-09-12T00:03:26.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.014+0000 7f63d1126800 20 prepare_atomic_modification: state is not atomic. state=0x563810b30cc8 2024-09-12T00:03:26.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.014+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.017+0000 7f63d1126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:03:26.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.017+0000 7f63d1126800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:03:26.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.017+0000 7f63d1126800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:03:26.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.017+0000 7f63d1126800 5 delete_objs_inline: removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1__shadow:UQlYBxWCpeEZdvdKLKPWHPcgH7b.Mbp_.kojvjQ2GwYrIX5kMNnRquL-352239Is_0 2024-09-12T00:03:26.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.018+0000 7f63d1126800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:03:26.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.018+0000 7f62a37fe640 20 handle_completion(): completion ok for obj=c[UQlYBxWCpeEZdvdKLKPWHPcgH7b.Mbp] 2024-09-12T00:03:26.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.019+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.019+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.021+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.021+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.021+0000 7f63d1126800 20 get_obj_state: octx=0x56381087fd80 obj=check-bucket:d state=0x563810b35ac8 s->prefetch_data=0 2024-09-12T00:03:26.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.022+0000 7f63d1126800 20 get_obj_state: setting s->obj_tag to jl3vgfh55dpvalckm6q501w0s4cqbn2l 2024-09-12T00:03:26.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.022+0000 7f63d1126800 20 get_obj_state_impl: setting s->olh_tag to 1fu1iuzypqz8uovyblkfy2ynl5v5jsl2 2024-09-12T00:03:26.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.022+0000 7f63d1126800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1fu1iuzypqz8uovyblkfy2ynl5v5jsl2 2024-09-12T00:03:26.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.024+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.025+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.025+0000 7f63d1126800 20 olh_log_entry: epoch=3 op=3 key=d[R-bb7LHxtAVcb0S5cyb8MVhXzHdyBTI] 2024-09-12T00:03:26.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.025+0000 7f63d1126800 20 get_obj_state: octx=0x56381087fd80 obj=check-bucket:_:R-bb7LHxtAVcb0S5cyb8MVhXzHdyBTI_d state=0x563810b30cc8 s->prefetch_data=0 2024-09-12T00:03:26.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.026+0000 7f63d1126800 10 manifest: total_size = 12 2024-09-12T00:03:26.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.026+0000 7f63d1126800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16821029111472196067 2024-09-12T00:03:26.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.026+0000 7f63d1126800 20 get_obj_state: octx=0x56381087fd80 obj=check-bucket:_:R-bb7LHxtAVcb0S5cyb8MVhXzHdyBTI_d state=0x563810b30cc8 s->prefetch_data=0 2024-09-12T00:03:26.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.026+0000 7f63d1126800 20 prepare_atomic_modification: state is not atomic. state=0x563810b30cc8 2024-09-12T00:03:26.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.026+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.028+0000 7f63d1126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:03:26.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.028+0000 7f63d1126800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:03:26.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.028+0000 7f63d1126800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:03:26.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.028+0000 7f63d1126800 5 delete_objs_inline: removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1__shadow:R-bb7LHxtAVcb0S5cyb8MVhXzHdyBTI_.Zm26F787zotzusST5_b5G-x_g0Apa8r_0 2024-09-12T00:03:26.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.030+0000 7f62a3fff640 20 handle_completion(): completion ok for obj=d[R-bb7LHxtAVcb0S5cyb8MVhXzHdyBTI] 2024-09-12T00:03:26.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.030+0000 7f63d1126800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:03:26.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.032+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.032+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.034+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.035+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.035+0000 7f63d1126800 20 get_obj_state: octx=0x56381087fd80 obj=check-bucket:e state=0x563810b30cc8 s->prefetch_data=0 2024-09-12T00:03:26.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.036+0000 7f63d1126800 20 get_obj_state: setting s->obj_tag to rsgqa358dyxim13n4su2xm900xrivixr 2024-09-12T00:03:26.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.036+0000 7f63d1126800 20 get_obj_state_impl: setting s->olh_tag to u4klhaijxgdbbr63pti3r3z2hmgm6370 2024-09-12T00:03:26.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.036+0000 7f63d1126800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=u4klhaijxgdbbr63pti3r3z2hmgm6370 2024-09-12T00:03:26.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.037+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.038+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.039+0000 7f63d1126800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:03:26.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.039+0000 7f63d1126800 20 olh_log_entry: epoch=2 op=3 key=e[pxUHm-tir9BrhRZJL7NBq2Eb-ikD.k-] 2024-09-12T00:03:26.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.039+0000 7f63d1126800 20 get_obj_state: octx=0x56381087fd80 obj=check-bucket:_:pxUHm-tir9BrhRZJL7NBq2Eb-ikD.k-_e state=0x563810b35ac8 s->prefetch_data=0 2024-09-12T00:03:26.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.039+0000 7f63d1126800 10 manifest: total_size = 9 2024-09-12T00:03:26.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.039+0000 7f63d1126800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15957170296344379593 2024-09-12T00:03:26.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.039+0000 7f63d1126800 20 get_obj_state: octx=0x56381087fd80 obj=check-bucket:_:pxUHm-tir9BrhRZJL7NBq2Eb-ikD.k-_e state=0x563810b35ac8 s->prefetch_data=0 2024-09-12T00:03:26.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.039+0000 7f63d1126800 20 prepare_atomic_modification: state is not atomic. state=0x563810b35ac8 2024-09-12T00:03:26.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.039+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.042+0000 7f63d1126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:03:26.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.042+0000 7f63d1126800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:03:26.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.042+0000 7f63d1126800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:03:26.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.042+0000 7f63d1126800 5 delete_objs_inline: removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1__shadow:pxUHm-tir9BrhRZJL7NBq2Eb-ikD.k-_.x9rRp44xWArGKdJl_SnBgUcYrQkmMh7_0 2024-09-12T00:03:26.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.044+0000 7f62a3fff640 20 handle_completion(): completion ok for obj=e[pxUHm-tir9BrhRZJL7NBq2Eb-ikD.k-] 2024-09-12T00:03:26.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.044+0000 7f63d1126800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:03:26.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.045+0000 7f63d1126800 20 get_obj_state: octx=0x56381087fd80 obj=check-bucket:e state=0x563810b30cc8 s->prefetch_data=0 2024-09-12T00:03:26.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.045+0000 7f63d1126800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=u4klhaijxgdbbr63pti3r3z2hmgm6370 2024-09-12T00:03:26.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.048+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.049+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.050+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.050+0000 7f63d1126800 20 get_obj_state: octx=0x56381087fd80 obj=check-bucket:f state=0x563810b30cc8 s->prefetch_data=0 2024-09-12T00:03:26.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.050+0000 7f63d1126800 20 get_obj_state: setting s->obj_tag to 1k75m6x8eg7pbm556w05qv9hkn9nppxy 2024-09-12T00:03:26.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.050+0000 7f63d1126800 20 get_obj_state_impl: setting s->olh_tag to cgjmvtmgvv2149yu6l4yzi2r1ji0pd0v 2024-09-12T00:03:26.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.050+0000 7f63d1126800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cgjmvtmgvv2149yu6l4yzi2r1ji0pd0v 2024-09-12T00:03:26.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.052+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.053+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.053+0000 7f63d1126800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:03:26.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.053+0000 7f63d1126800 20 olh_log_entry: epoch=2 op=3 key=f[zIdffco0dkcN9Zyui6gF4r.Y3zEBQKn] 2024-09-12T00:03:26.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.053+0000 7f63d1126800 20 get_obj_state: octx=0x56381087fd80 obj=check-bucket:_:zIdffco0dkcN9Zyui6gF4r.Y3zEBQKn_f state=0x563810b35ac8 s->prefetch_data=0 2024-09-12T00:03:26.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.054+0000 7f63d1126800 10 manifest: total_size = 9 2024-09-12T00:03:26.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.054+0000 7f63d1126800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16316195976270301203 2024-09-12T00:03:26.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.054+0000 7f63d1126800 20 get_obj_state: octx=0x56381087fd80 obj=check-bucket:_:zIdffco0dkcN9Zyui6gF4r.Y3zEBQKn_f state=0x563810b35ac8 s->prefetch_data=0 2024-09-12T00:03:26.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.054+0000 7f63d1126800 20 prepare_atomic_modification: state is not atomic. state=0x563810b35ac8 2024-09-12T00:03:26.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.054+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.057+0000 7f63d1126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:03:26.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.057+0000 7f63d1126800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:03:26.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.057+0000 7f63d1126800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:03:26.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.057+0000 7f63d1126800 5 delete_objs_inline: removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1__shadow:zIdffco0dkcN9Zyui6gF4r.Y3zEBQKn_.WQ1QffO1rdT17U2sWVindG73HBfNH-P_0 2024-09-12T00:03:26.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.058+0000 7f63d1126800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:03:26.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.058+0000 7f62a37fe640 20 handle_completion(): completion ok for obj=f[zIdffco0dkcN9Zyui6gF4r.Y3zEBQKn] 2024-09-12T00:03:26.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.060+0000 7f63d1126800 20 get_obj_state: octx=0x56381087fd80 obj=check-bucket:f state=0x563810b30cc8 s->prefetch_data=0 2024-09-12T00:03:26.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.060+0000 7f63d1126800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cgjmvtmgvv2149yu6l4yzi2r1ji0pd0v 2024-09-12T00:03:26.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.062+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.064+0000 7f63d1126800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1.0 2024-09-12T00:03:26.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.064+0000 7f63d1126800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T00:03:26.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.064+0000 7f63d1126800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:03:26.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.065+0000 7f62837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:26.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.067+0000 7f63d1126800 20 remove_watcher() i=0 2024-09-12T00:03:26.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.067+0000 7f63d1126800 2 removed watcher, disabling cache 2024-09-12T00:03:26.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.068+0000 7f63d1126800 20 remove_watcher() i=1 2024-09-12T00:03:26.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.069+0000 7f63d1126800 20 remove_watcher() i=2 2024-09-12T00:03:26.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.070+0000 7f63d1126800 20 remove_watcher() i=3 2024-09-12T00:03:26.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.071+0000 7f63d1126800 20 remove_watcher() i=4 2024-09-12T00:03:26.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.072+0000 7f63d1126800 20 remove_watcher() i=5 2024-09-12T00:03:26.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.073+0000 7f63d1126800 20 remove_watcher() i=6 2024-09-12T00:03:26.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.074+0000 7f63d1126800 20 remove_watcher() i=7 2024-09-12T00:03:26.135 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:03:26.165 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:03:26.165 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:03:26.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.204+0000 7f6a16f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.206+0000 7f6a16f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:26.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.206+0000 7f6a16f2e800 20 realm 2024-09-12T00:03:26.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.206+0000 7f6a16f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.206+0000 7f6a16f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:26.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.206+0000 7f6a16f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:03:26.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.206+0000 7f6a16f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.206+0000 7f6a16f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:26.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.206+0000 7f6a16f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.207+0000 7f6a16f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:26.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.207+0000 7f6a16f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.208+0000 7f6a16f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:03:26.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.208+0000 7f6a16f2e800 20 searching for the correct realm 2024-09-12T00:03:26.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.211+0000 7f6a124dc640 0 -- 172.21.15.67:0/4083740957 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f6a0806c380 msgr2=0x7f6a0806d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:26.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.214+0000 7f6a124dc640 0 -- 172.21.15.67:0/4083740957 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55dc6aa7b720 msgr2=0x55dc6aa7db10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:03:26.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.218+0000 7f6a16f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:03:26.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.218+0000 7f6a16f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:03:26.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.218+0000 7f6a16f2e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:03:26.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.218+0000 7f6a16f2e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:03:26.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.218+0000 7f6a16f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:03:26.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.218+0000 7f6a16f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:03:26.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.218+0000 7f6a16f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.219+0000 7f6a16f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:26.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.219+0000 7f6a16f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.219+0000 7f6a16f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:03:26.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.219+0000 7f6a16f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.219+0000 7f6a16f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:03:26.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.219+0000 7f6a16f2e800 20 zone default found 2024-09-12T00:03:26.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.219+0000 7f6a16f2e800 4 Realm: () 2024-09-12T00:03:26.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.219+0000 7f6a16f2e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:03:26.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.219+0000 7f6a16f2e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:03:26.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.219+0000 7f6a16f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:03:26.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.219+0000 7f6a16f2e800 20 zonegroup default 2024-09-12T00:03:26.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.219+0000 7f6a16f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.219+0000 7f6a16f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:26.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.219+0000 7f6a16f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.220+0000 7f6a16f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:26.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.220+0000 7f6a16f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.220+0000 7f6a16f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:03:26.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.220+0000 7f6a16f2e800 20 started sync module instance, tier type = 2024-09-12T00:03:26.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.220+0000 7f6a16f2e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:03:26.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.229+0000 7f6a16f2e800 20 add_watcher() i=0 2024-09-12T00:03:26.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.229+0000 7f6a16f2e800 20 add_watcher() i=1 2024-09-12T00:03:26.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.229+0000 7f6a16f2e800 20 add_watcher() i=2 2024-09-12T00:03:26.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.229+0000 7f6a16f2e800 20 add_watcher() i=3 2024-09-12T00:03:26.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.229+0000 7f6a16f2e800 20 add_watcher() i=4 2024-09-12T00:03:26.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.229+0000 7f6a16f2e800 20 add_watcher() i=5 2024-09-12T00:03:26.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.229+0000 7f6a16f2e800 20 add_watcher() i=6 2024-09-12T00:03:26.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.230+0000 7f6a16f2e800 20 add_watcher() i=7 2024-09-12T00:03:26.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.230+0000 7f6a16f2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:03:26.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.231+0000 7f68c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:26.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.232+0000 7f6a16f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:03:26.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.232+0000 7f6a16f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:03:26.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.232+0000 7f6a16f2e800 5 note: GC not initialized 2024-09-12T00:03:26.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.232+0000 7f6843fff640 20 reqs_thread_entry: start 2024-09-12T00:03:26.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.232+0000 7f6a16f2e800 20 init_complete bucket index max shards: 1 2024-09-12T00:03:26.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.232+0000 7f6a16f2e800 20 Filter name: none 2024-09-12T00:03:26.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.232+0000 7f6841ffb640 20 reqs_thread_entry: start 2024-09-12T00:03:26.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.232+0000 7f6a16f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.233+0000 7f6a16f2e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:26.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.233+0000 7f6a16f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.233+0000 7f6a16f2e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:26.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.233+0000 7f6a16f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:26.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.233+0000 7f6a16f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.233+0000 7f6a16f2e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:03:26.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.233+0000 7f6a16f2e800 20 rados->read ofs=0 len=0 2024-09-12T00:03:26.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.234+0000 7f6a16f2e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:03:26.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.234+0000 7f6a16f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:03:26.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.235+0000 7f68c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:03:26.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.237+0000 7f6a16f2e800 20 remove_watcher() i=0 2024-09-12T00:03:26.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.237+0000 7f6a16f2e800 2 removed watcher, disabling cache 2024-09-12T00:03:26.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.238+0000 7f6a16f2e800 20 remove_watcher() i=1 2024-09-12T00:03:26.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.239+0000 7f6a16f2e800 20 remove_watcher() i=2 2024-09-12T00:03:26.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.240+0000 7f6a16f2e800 20 remove_watcher() i=3 2024-09-12T00:03:26.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.241+0000 7f6a16f2e800 20 remove_watcher() i=4 2024-09-12T00:03:26.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.242+0000 7f6a16f2e800 20 remove_watcher() i=5 2024-09-12T00:03:26.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.243+0000 7f6a16f2e800 20 remove_watcher() i=6 2024-09-12T00:03:26.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:03:26.244+0000 7f6a16f2e800 20 remove_watcher() i=7 2024-09-12T00:03:26.255 INFO:tasks.workunit.client.0.smithi067.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:03:26.255 INFO:tasks.workunit.client.0.smithi067.stderr:Deleting bucket check-bucket 2024-09-12T00:03:26.275 INFO:tasks.workunit.client.0.smithi067.stderr:Completed bucket check tests 2024-09-12T00:03:26.275 INFO:tasks.workunit.client.0.smithi067.stdout:connected to http://localhost:80 2024-09-12T00:03:26.337 INFO:tasks.workunit.client.0.smithi067.stderr:+ deactivate 2024-09-12T00:03:26.337 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:03:26.337 INFO:tasks.workunit.client.0.smithi067.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:03:26.337 INFO:tasks.workunit.client.0.smithi067.stderr:+ export PATH 2024-09-12T00:03:26.337 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:03:26.337 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n '' ']' 2024-09-12T00:03:26.338 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:03:26.338 INFO:tasks.workunit.client.0.smithi067.stderr:+ hash -r 2024-09-12T00:03:26.338 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n '' ']' 2024-09-12T00:03:26.338 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:03:26.338 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:03:26.338 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset -f deactivate 2024-09-12T00:03:26.338 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo OK. 2024-09-12T00:03:26.339 INFO:tasks.workunit.client.0.smithi067.stdout:OK. 2024-09-12T00:03:26.339 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:03:26.339 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:03:26.420 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T00:03:26.420 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:03:26.828 DEBUG:teuthology.parallel:result is None 2024-09-12T00:03:26.829 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:03:26.869 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:03:26.869 DEBUG:teuthology.orchestra.run.smithi067:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:03:26.947 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:03:26.947 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:03:26.957 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:03:26.957 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:03:26.957 DEBUG:teuthology.orchestra.run.smithi067:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:03:27.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:03:27.019 INFO:teuthology.orchestra.run.smithi067.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:03:27.019 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:03:27.089 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:03:27.090 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:03:27.162 INFO:tasks.workunit:timeout=3h 2024-09-12T00:03:27.162 INFO:tasks.workunit:cleanup=True 2024-09-12T00:03:27.162 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:03:27.232 INFO:tasks.workunit.client.0.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:04:13.446 INFO:tasks.workunit.client.0.smithi067.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:04:13.447 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:04:13.447 INFO:tasks.workunit.client.0.smithi067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:04:13.447 INFO:tasks.workunit.client.0.smithi067.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:04:13.447 INFO:tasks.workunit.client.0.smithi067.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:04:13.447 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:04:13.447 INFO:tasks.workunit.client.0.smithi067.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:04:13.447 INFO:tasks.workunit.client.0.smithi067.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:04:13.447 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:04:13.447 INFO:tasks.workunit.client.0.smithi067.stderr: git switch -c 2024-09-12T00:04:13.448 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:04:13.448 INFO:tasks.workunit.client.0.smithi067.stderr:Or undo this operation with: 2024-09-12T00:04:13.448 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:04:13.448 INFO:tasks.workunit.client.0.smithi067.stderr: git switch - 2024-09-12T00:04:13.448 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:04:13.448 INFO:tasks.workunit.client.0.smithi067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:04:13.448 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:04:13.448 INFO:tasks.workunit.client.0.smithi067.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:04:13.450 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:04:13.520 INFO:tasks.workunit.client.0.smithi067.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:04:13.522 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:04:13.522 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:04:13.572 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:04:13.622 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:04:13.662 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:04:13.664 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:04:13.664 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:04:13.703 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:04:13.707 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:04:13.707 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:04:13.778 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T00:04:13.780 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T00:04:13.780 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T00:04:13.862 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T00:04:13.862 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:04:13.862 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:04:13.862 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 11 tests from ClsLock 2024-09-12T00:04:13.862 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T00:04:15.170 INFO:tasks.workunit.client.0.smithi067.stdout:lock: mylock 2024-09-12T00:04:15.171 INFO:tasks.workunit.client.0.smithi067.stdout: lock_type: exclusive 2024-09-12T00:04:15.171 INFO:tasks.workunit.client.0.smithi067.stdout: tag: 2024-09-12T00:04:15.171 INFO:tasks.workunit.client.0.smithi067.stdout: lockers: 2024-09-12T00:04:15.171 INFO:tasks.workunit.client.0.smithi067.stdout: client.5175 expiration=2024-09-12T00:06:15.168405+0000 addr=v1:172.21.15.67:0/907045592 cookie= 2024-09-12T00:04:15.175 INFO:tasks.workunit.client.0.smithi067.stdout:lock: mylock 2024-09-12T00:04:15.175 INFO:tasks.workunit.client.0.smithi067.stdout: lock_type: shared 2024-09-12T00:04:15.175 INFO:tasks.workunit.client.0.smithi067.stdout: tag: 2024-09-12T00:04:15.175 INFO:tasks.workunit.client.0.smithi067.stdout: lockers: 2024-09-12T00:04:15.175 INFO:tasks.workunit.client.0.smithi067.stdout: client.5175 expiration=2024-09-12T00:06:15.175434+0000 addr=v1:172.21.15.67:0/907045592 cookie= 2024-09-12T00:04:15.175 INFO:tasks.workunit.client.0.smithi067.stdout: client.5181 expiration=0.000000 addr=v1:172.21.15.67:0/2019346724 cookie= 2024-09-12T00:04:15.176 INFO:tasks.workunit.client.0.smithi067.stdout:lock: mylock 2024-09-12T00:04:15.176 INFO:tasks.workunit.client.0.smithi067.stdout: lock_type: shared 2024-09-12T00:04:15.176 INFO:tasks.workunit.client.0.smithi067.stdout: tag: 2024-09-12T00:04:15.176 INFO:tasks.workunit.client.0.smithi067.stdout: lockers: 2024-09-12T00:04:15.176 INFO:tasks.workunit.client.0.smithi067.stdout: client.5181 expiration=0.000000 addr=v1:172.21.15.67:0/2019346724 cookie= 2024-09-12T00:04:16.133 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestMultiLocking (2271 ms) 2024-09-12T00:04:16.134 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T00:04:18.199 INFO:tasks.workunit.client.0.smithi067.stdout:lock: mylock 2024-09-12T00:04:18.199 INFO:tasks.workunit.client.0.smithi067.stdout: lock_type: shared 2024-09-12T00:04:18.199 INFO:tasks.workunit.client.0.smithi067.stdout: tag: 2024-09-12T00:04:18.199 INFO:tasks.workunit.client.0.smithi067.stdout: lockers: 2024-09-12T00:04:18.199 INFO:tasks.workunit.client.0.smithi067.stdout: client.5196 expiration=0.000000 addr=v1:172.21.15.67:0/3799199310 cookie= 2024-09-12T00:04:18.201 INFO:tasks.workunit.client.0.smithi067.stdout:lock: mylock 2024-09-12T00:04:18.201 INFO:tasks.workunit.client.0.smithi067.stdout: lock_type: exclusive 2024-09-12T00:04:18.201 INFO:tasks.workunit.client.0.smithi067.stdout: tag: new_tag 2024-09-12T00:04:18.201 INFO:tasks.workunit.client.0.smithi067.stdout: lockers: 2024-09-12T00:04:18.201 INFO:tasks.workunit.client.0.smithi067.stdout: client.5190 expiration=0.000000 addr=v1:172.21.15.67:0/4175690213 cookie= 2024-09-12T00:04:19.167 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestMeta (3033 ms) 2024-09-12T00:04:19.167 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T00:04:21.193 INFO:tasks.workunit.client.0.smithi067.stdout:lock: mylock 2024-09-12T00:04:21.193 INFO:tasks.workunit.client.0.smithi067.stdout: lock_type: exclusive 2024-09-12T00:04:21.193 INFO:tasks.workunit.client.0.smithi067.stdout: tag: 2024-09-12T00:04:21.193 INFO:tasks.workunit.client.0.smithi067.stdout: lockers: 2024-09-12T00:04:21.195 INFO:tasks.workunit.client.0.smithi067.stdout:lock: mylock 2024-09-12T00:04:21.195 INFO:tasks.workunit.client.0.smithi067.stdout: lock_type: shared 2024-09-12T00:04:21.195 INFO:tasks.workunit.client.0.smithi067.stdout: tag: 2024-09-12T00:04:21.195 INFO:tasks.workunit.client.0.smithi067.stdout: lockers: 2024-09-12T00:04:21.196 INFO:tasks.workunit.client.0.smithi067.stdout: client.5015 expiration=0.000000 addr=v1:172.21.15.67:0/178515991 cookie= 2024-09-12T00:04:21.196 INFO:tasks.workunit.client.0.smithi067.stdout: client.5015 expiration=0.000000 addr=v1:172.21.15.67:0/178515991 cookie=new cookie 2024-09-12T00:04:22.188 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestCookie (3021 ms) 2024-09-12T00:04:22.188 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T00:04:25.194 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestMultipleLocks (3006 ms) 2024-09-12T00:04:25.194 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T00:04:33.242 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestLockDuration (8048 ms) 2024-09-12T00:04:33.242 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T00:04:36.262 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestAssertLocked (3021 ms) 2024-09-12T00:04:36.263 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T00:04:39.285 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestSetCookie (3022 ms) 2024-09-12T00:04:39.285 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T00:05:00.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestRenew (21048 ms) 2024-09-12T00:05:00.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T00:05:07.385 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7052 ms) 2024-09-12T00:05:07.385 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T00:05:14.473 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7088 ms) 2024-09-12T00:05:14.473 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T00:05:21.887 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (7415 ms) 2024-09-12T00:05:21.888 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 11 tests from ClsLock (68025 ms total) 2024-09-12T00:05:21.888 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:05:21.888 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:05:21.888 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 11 tests from 1 test suite ran. (68025 ms total) 2024-09-12T00:05:21.888 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 11 tests. 2024-09-12T00:05:21.891 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:05:21.891 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:05:21.936 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T00:05:21.937 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T00:05:21.937 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T00:05:22.024 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T00:05:22.024 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:05:22.024 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:05:22.024 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 4 tests from cls_log 2024-09-12T00:05:22.024 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T00:05:24.921 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_log.test_log_add_same_time (2896 ms) 2024-09-12T00:05:24.921 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T00:05:27.944 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_log.test_log_add_different_time (3024 ms) 2024-09-12T00:05:27.945 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T00:05:30.970 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_log.trim_by_time (3025 ms) 2024-09-12T00:05:30.970 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T00:05:33.982 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_log.trim_by_marker (3012 ms) 2024-09-12T00:05:33.982 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 4 tests from cls_log (11957 ms total) 2024-09-12T00:05:33.982 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:05:33.982 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:05:33.982 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 4 tests from 1 test suite ran. (11957 ms total) 2024-09-12T00:05:33.982 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 4 tests. 2024-09-12T00:05:33.984 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:05:33.984 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:05:34.029 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T00:05:34.030 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T00:05:34.030 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T00:05:34.077 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T00:05:34.077 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:05:34.077 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:05:34.077 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 10 tests from cls_refcount 2024-09-12T00:05:34.077 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T00:05:37.005 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_implicit (2928 ms) 2024-09-12T00:05:37.005 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T00:05:40.013 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3007 ms) 2024-09-12T00:05:40.014 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T00:05:49.072 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_put_snap (9058 ms) 2024-09-12T00:05:49.073 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T00:05:52.101 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_explicit (3030 ms) 2024-09-12T00:05:52.101 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.set 2024-09-12T00:05:55.121 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.set (3021 ms) 2024-09-12T00:05:55.121 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T00:06:02.153 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_implicit_ec (7031 ms) 2024-09-12T00:06:02.153 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T00:06:09.182 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7030 ms) 2024-09-12T00:06:09.183 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T00:06:21.277 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_put_snap_ec (12095 ms) 2024-09-12T00:06:21.278 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T00:06:28.315 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.test_explicit_ec (7037 ms) 2024-09-12T00:06:28.315 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T00:06:35.369 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_refcount.set_ec (7054 ms) 2024-09-12T00:06:35.370 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 10 tests from cls_refcount (61292 ms total) 2024-09-12T00:06:35.370 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:06:35.370 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:06:35.370 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 10 tests from 1 test suite ran. (61292 ms total) 2024-09-12T00:06:35.371 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 10 tests. 2024-09-12T00:06:35.372 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:06:35.372 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:06:35.421 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T00:06:35.422 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T00:06:35.422 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T00:06:35.471 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T00:06:35.471 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:06:35.471 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:06:35.471 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 19 tests from cls_rgw 2024-09-12T00:06:37.382 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T00:06:37.426 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_basic (45 ms) 2024-09-12T00:06:37.426 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T00:06:37.457 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (31 ms) 2024-09-12T00:06:37.458 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T00:06:37.498 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_remove_object (40 ms) 2024-09-12T00:06:37.498 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T00:06:38.967 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_suggest (1470 ms) 2024-09-12T00:06:38.968 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T00:06:38.978 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_suggest_complete (11 ms) 2024-09-12T00:06:38.978 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T00:06:39.008 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_list (30 ms) 2024-09-12T00:06:39.008 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T00:07:01.358 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_list_delimited (22349 ms) 2024-09-12T00:07:01.358 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T00:07:01.442 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.bi_list (85 ms) 2024-09-12T00:07:01.442 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T00:07:01.455 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.gc_set (13 ms) 2024-09-12T00:07:01.455 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T00:07:01.466 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.gc_list (11 ms) 2024-09-12T00:07:01.467 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T00:07:08.970 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.gc_defer (7503 ms) 2024-09-12T00:07:08.970 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T00:07:09.047 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.usage_basic (78 ms) 2024-09-12T00:07:09.047 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T00:07:09.048 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-09-12T00:07:09.048 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T00:07:09.144 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.usage_clear (96 ms) 2024-09-12T00:07:09.144 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T00:07:09.196 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.bi_log_trim (52 ms) 2024-09-12T00:07:09.196 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T00:07:09.215 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.index_racing_removes (18 ms) 2024-09-12T00:07:09.216 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T00:07:09.228 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.reshardlog_list (14 ms) 2024-09-12T00:07:09.228 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T00:07:09.247 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.reshardlog_num (19 ms) 2024-09-12T00:07:09.247 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-12T00:07:09.268 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw.bi_put_entries (21 ms) 2024-09-12T00:07:09.971 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 19 tests from cls_rgw (31887 ms total) 2024-09-12T00:07:09.971 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:07:09.971 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:07:09.972 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 19 tests from 1 test suite ran. (34499 ms total) 2024-09-12T00:07:09.972 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 19 tests. 2024-09-12T00:07:09.974 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:07:09.974 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:07:10.019 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T00:07:10.020 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T00:07:10.020 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T00:07:10.111 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T00:07:10.111 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:07:10.111 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:07:10.111 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T00:07:10.111 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T00:07:11.989 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.init (1878 ms) 2024-09-12T00:07:11.990 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T00:07:12.015 INFO:tasks.workunit.client.0.smithi067.stderr:[ ] list info tag = chain-0 2024-09-12T00:07:12.016 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (26 ms) 2024-09-12T00:07:12.016 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T00:07:12.022 INFO:tasks.workunit.client.0.smithi067.stderr:[ ] next_marker is: = 0/4263 2024-09-12T00:07:12.023 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (8 ms) 2024-09-12T00:07:12.023 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T00:07:12.032 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (9 ms) 2024-09-12T00:07:12.032 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T00:07:12.041 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (10 ms) 2024-09-12T00:07:12.042 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T00:07:12.253 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (211 ms) 2024-09-12T00:07:12.253 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T00:07:12.262 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (9 ms) 2024-09-12T00:07:12.262 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T00:07:12.270 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (8 ms) 2024-09-12T00:07:12.270 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T00:07:12.997 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_gc.finalize (727 ms) 2024-09-12T00:07:12.997 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 9 tests from cls_rgw_gc (2886 ms total) 2024-09-12T00:07:12.997 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:07:12.997 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:07:12.997 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 9 tests from 1 test suite ran. (2886 ms total) 2024-09-12T00:07:12.997 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 9 tests. 2024-09-12T00:07:13.000 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:07:13.000 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:07:13.045 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T00:07:13.046 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T00:07:13.046 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T00:07:13.141 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:07:13.141 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:07:13.142 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T00:07:13.142 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:07:15.003 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T00:07:15.003 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T00:07:15.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.015+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=YA1MN3X8P7XO type=write size=337903 2024-09-12T00:07:15.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.017+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=YFJOPRPOKY0P type=write size=759958 2024-09-12T00:07:15.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.019+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=N65M0MFDHQOS type=del size=1077049 2024-09-12T00:07:15.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.020+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=4VMM22OI4Y9K type=del size=3567992 2024-09-12T00:07:15.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.022+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=M0MPCEP7XSWX type=del size=1166962 2024-09-12T00:07:15.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.023+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=GJHD0KHJMU8T type=del size=1095398 2024-09-12T00:07:15.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.025+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=TXG23TDAWS1F type=del size=2789681 2024-09-12T00:07:15.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.027+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~SRLCTJ0WUDAD.0 size=1048576 2024-09-12T00:07:15.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.029+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~SRLCTJ0WUDAD.1 size=1048576 2024-09-12T00:07:15.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.030+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~SRLCTJ0WUDAD.2 size=512175 2024-09-12T00:07:15.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.030+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=SRLCTJ0WUDAD tag=6LYFW37TC6RR type=write size=3657903 2024-09-12T00:07:15.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.033+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~MRBJ3QB6GQZU.0 size=642413 2024-09-12T00:07:15.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.033+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=MRBJ3QB6GQZU tag=Z7QL1VWOJUAZ type=write size=1690989 2024-09-12T00:07:15.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.037+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=0UBQ51D5PBTQ type=del size=2755329 2024-09-12T00:07:15.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.039+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=AMW7489QRRDO type=write size=649026 2024-09-12T00:07:15.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.040+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=U418O08SHWF3 type=del size=115107 2024-09-12T00:07:15.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.043+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~YXTX4YJBE1KO.0 size=1048576 2024-09-12T00:07:15.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.044+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~YXTX4YJBE1KO.1 size=135935 2024-09-12T00:07:15.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.044+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=YXTX4YJBE1KO tag=M6B0QMBZT49Z type=write size=2233087 2024-09-12T00:07:15.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.047+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~YY6S0WEM4AZT.0 size=1048576 2024-09-12T00:07:15.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.048+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~YY6S0WEM4AZT.1 size=1048576 2024-09-12T00:07:15.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.049+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~YY6S0WEM4AZT.2 size=356853 2024-09-12T00:07:15.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.049+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=YY6S0WEM4AZT tag=2I0BXIADO8O3 type=write size=3502581 2024-09-12T00:07:15.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.052+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~D42YMBDBDQ27.0 size=1048576 2024-09-12T00:07:15.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.053+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~D42YMBDBDQ27.1 size=1048576 2024-09-12T00:07:15.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.054+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~D42YMBDBDQ27.2 size=1028067 2024-09-12T00:07:15.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.054+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=D42YMBDBDQ27 tag=SS843TJN8PBQ type=write size=4173795 2024-09-12T00:07:15.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.056+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~QZ8HEMDQA1OT.0 size=1048576 2024-09-12T00:07:15.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.058+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~QZ8HEMDQA1OT.1 size=1048576 2024-09-12T00:07:15.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.059+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~QZ8HEMDQA1OT.2 size=264844 2024-09-12T00:07:15.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.059+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=QZ8HEMDQA1OT tag=XVB5ARBMETE6 type=write size=3410572 2024-09-12T00:07:15.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.060+0000 7f82f8930780 1 < completed write operation key=N2TYUAJITFNL tag=YA1MN3X8P7XO type=write size=337903 2024-09-12T00:07:15.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.062+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=1XEA0HTBRN2F type=del size=3026872 2024-09-12T00:07:15.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.065+0000 7f82f8930780 1 < suggested remove operation key=77SDZHCSP0E3 tag=YFJOPRPOKY0P type=write 2024-09-12T00:07:15.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.066+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=UKEP4DS9V3BL type=del size=1823540 2024-09-12T00:07:15.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.068+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=N65M0MFDHQOS type=del 2024-09-12T00:07:15.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.071+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~QRV9ZV0MVDWS.0 size=236434 2024-09-12T00:07:15.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.071+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=QRV9ZV0MVDWS tag=EBMJJRH252YT type=write size=1285010 2024-09-12T00:07:15.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.073+0000 7f82f8930780 1 < suggested update operation key=YWC5JUV5B2N6 tag=4VMM22OI4Y9K type=del size=3567992 2024-09-12T00:07:15.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.076+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~SD3FGEQ2AVS0.0 size=1048576 2024-09-12T00:07:15.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.077+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~SD3FGEQ2AVS0.1 size=850114 2024-09-12T00:07:15.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.077+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=SD3FGEQ2AVS0 tag=HIL71K92Y0G8 type=write size=2947266 2024-09-12T00:07:15.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.079+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=M0MPCEP7XSWX type=del 2024-09-12T00:07:15.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.081+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=NOJ3Z5LE3Q4Y type=del size=142593 2024-09-12T00:07:15.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.084+0000 7f82f8930780 1 < suggested remove operation key=LAKJS79KNBY7 tag=GJHD0KHJMU8T type=del 2024-09-12T00:07:15.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.086+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=7LPQ0AOP0KZZ type=write size=209605 2024-09-12T00:07:15.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.089+0000 7f82f8930780 1 < suggested remove operation key=OVJOP07M9KB8 tag=TXG23TDAWS1F type=del 2024-09-12T00:07:15.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.090+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=6BHY7OGDPA30 type=del size=753915 2024-09-12T00:07:15.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.092+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~SRLCTJ0WUDAD.0 size=1048576 2024-09-12T00:07:15.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.093+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~SRLCTJ0WUDAD.1 size=1048576 2024-09-12T00:07:15.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.094+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~SRLCTJ0WUDAD.2 size=512175 2024-09-12T00:07:15.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.096+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=SRLCTJ0WUDAD tag=6LYFW37TC6RR type=write size=3657903 2024-09-12T00:07:15.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.099+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~DZR40TSW1FOZ.0 size=1048576 2024-09-12T00:07:15.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.100+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~DZR40TSW1FOZ.1 size=1048576 2024-09-12T00:07:15.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.101+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~DZR40TSW1FOZ.2 size=1007639 2024-09-12T00:07:15.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.102+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=DZR40TSW1FOZ tag=T308DD1VZ51S type=write size=4153367 2024-09-12T00:07:15.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.103+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~MRBJ3QB6GQZU.0 size=642413 2024-09-12T00:07:15.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.105+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=MRBJ3QB6GQZU tag=Z7QL1VWOJUAZ type=write size=1690989 2024-09-12T00:07:15.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.107+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=QJFXOPINSUU7 type=del size=3420990 2024-09-12T00:07:15.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.108+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=0UBQ51D5PBTQ type=del 2024-09-12T00:07:15.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.110+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=C5BXNKTOEEEA type=del size=2963404 2024-09-12T00:07:15.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.111+0000 7f82f8930780 1 < completed write operation key=9576W9WYJUJV tag=AMW7489QRRDO type=write size=649026 2024-09-12T00:07:15.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.112+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=Y96PNNAD59F8 type=del size=197175 2024-09-12T00:07:15.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.115+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=U418O08SHWF3 type=del 2024-09-12T00:07:15.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.116+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=JGPZ6I37F0JD type=del size=3481649 2024-09-12T00:07:15.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.116+0000 7f82f8930780 1 < canceled part key=_multipart_9576W9WYJUJV.2~YXTX4YJBE1KO.0 size=1048576 2024-09-12T00:07:15.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.117+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~YXTX4YJBE1KO.1 size=135935 2024-09-12T00:07:15.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.120+0000 7f82f8930780 1 < canceled multipart upload key=9576W9WYJUJV upload=YXTX4YJBE1KO tag=M6B0QMBZT49Z type=write size=2233087 2024-09-12T00:07:15.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.123+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~6IVO0AEB2ZPN.0 size=1048576 2024-09-12T00:07:15.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.124+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~6IVO0AEB2ZPN.1 size=1048576 2024-09-12T00:07:15.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.125+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~6IVO0AEB2ZPN.2 size=115838 2024-09-12T00:07:15.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.125+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=6IVO0AEB2ZPN tag=3C4UXWG3IKF7 type=write size=3261566 2024-09-12T00:07:15.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.126+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~YY6S0WEM4AZT.0 size=1048576 2024-09-12T00:07:15.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.127+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~YY6S0WEM4AZT.1 size=1048576 2024-09-12T00:07:15.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.129+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~YY6S0WEM4AZT.2 size=356853 2024-09-12T00:07:15.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.131+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=YY6S0WEM4AZT tag=2I0BXIADO8O3 type=write size=3502581 2024-09-12T00:07:15.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.132+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=VQQ3PQN90OMI type=del size=2040636 2024-09-12T00:07:15.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.133+0000 7f82f8930780 1 < canceled part key=_multipart_OVJOP07M9KB8.2~D42YMBDBDQ27.0 size=1048576 2024-09-12T00:07:15.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.133+0000 7f82f8930780 1 < canceled part key=_multipart_OVJOP07M9KB8.2~D42YMBDBDQ27.1 size=1048576 2024-09-12T00:07:15.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.134+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~D42YMBDBDQ27.2 size=1028067 2024-09-12T00:07:15.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.136+0000 7f82f8930780 1 < canceled multipart upload key=OVJOP07M9KB8 upload=D42YMBDBDQ27 tag=SS843TJN8PBQ type=write size=4173795 2024-09-12T00:07:15.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.139+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~HFNAP8BMFL1E.0 size=1048576 2024-09-12T00:07:15.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.140+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~HFNAP8BMFL1E.1 size=721798 2024-09-12T00:07:15.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.140+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=HFNAP8BMFL1E tag=LDC5W8OGKDRI type=write size=2818950 2024-09-12T00:07:15.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.142+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~QZ8HEMDQA1OT.0 size=1048576 2024-09-12T00:07:15.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.143+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~QZ8HEMDQA1OT.1 size=1048576 2024-09-12T00:07:15.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.144+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~QZ8HEMDQA1OT.2 size=264844 2024-09-12T00:07:15.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.147+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=QZ8HEMDQA1OT tag=XVB5ARBMETE6 type=write size=3410572 2024-09-12T00:07:15.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.148+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=HMO3QJZX6X0S type=write size=128896 2024-09-12T00:07:15.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.150+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=1XEA0HTBRN2F type=del 2024-09-12T00:07:15.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.153+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~U84YHJQDBCIX.0 size=1048576 2024-09-12T00:07:15.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.154+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~U84YHJQDBCIX.1 size=1048576 2024-09-12T00:07:15.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.155+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~U84YHJQDBCIX.2 size=143765 2024-09-12T00:07:15.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.155+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=U84YHJQDBCIX tag=C0RIS5H7KL94 type=write size=3289493 2024-09-12T00:07:15.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.156+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=UKEP4DS9V3BL type=del 2024-09-12T00:07:15.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.158+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=V5V39N6CCW74 type=del size=1898552 2024-09-12T00:07:15.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.159+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~QRV9ZV0MVDWS.0 size=236434 2024-09-12T00:07:15.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.161+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=QRV9ZV0MVDWS tag=EBMJJRH252YT type=write size=1285010 2024-09-12T00:07:15.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.163+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=103AOZ9V8Z7C type=write size=575941 2024-09-12T00:07:15.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.164+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~SD3FGEQ2AVS0.0 size=1048576 2024-09-12T00:07:15.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.165+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~SD3FGEQ2AVS0.1 size=850114 2024-09-12T00:07:15.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.168+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=SD3FGEQ2AVS0 tag=HIL71K92Y0G8 type=write size=2947266 2024-09-12T00:07:15.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.170+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~4A6T1U0F61TP.0 size=1048576 2024-09-12T00:07:15.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.171+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~4A6T1U0F61TP.1 size=1048576 2024-09-12T00:07:15.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.172+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~4A6T1U0F61TP.2 size=60934 2024-09-12T00:07:15.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.172+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=4A6T1U0F61TP tag=2V93V7Y1SCEB type=write size=3206662 2024-09-12T00:07:15.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.173+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=NOJ3Z5LE3Q4Y type=del 2024-09-12T00:07:15.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.175+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=5L3B61V8L1EY type=del size=4093981 2024-09-12T00:07:15.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.176+0000 7f82f8930780 1 < completed write operation key=75GYP042UUC2 tag=7LPQ0AOP0KZZ type=write size=209605 2024-09-12T00:07:15.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.179+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~L4E8PE3U7VPQ.0 size=1048576 2024-09-12T00:07:15.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.179+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~L4E8PE3U7VPQ.1 size=242006 2024-09-12T00:07:15.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.180+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=L4E8PE3U7VPQ tag=4BM2931QALJH type=write size=2339158 2024-09-12T00:07:15.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.181+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=6BHY7OGDPA30 type=del 2024-09-12T00:07:15.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.182+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=C0YAJOO3JMV3 type=del size=1137685 2024-09-12T00:07:15.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.184+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~DZR40TSW1FOZ.0 size=1048576 2024-09-12T00:07:15.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.185+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~DZR40TSW1FOZ.1 size=1048576 2024-09-12T00:07:15.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.186+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~DZR40TSW1FOZ.2 size=1007639 2024-09-12T00:07:15.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.189+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=DZR40TSW1FOZ tag=T308DD1VZ51S type=write size=4153367 2024-09-12T00:07:15.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.191+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~O0EC0DCGCJML.0 size=1048576 2024-09-12T00:07:15.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.192+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~O0EC0DCGCJML.1 size=572198 2024-09-12T00:07:15.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.192+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=O0EC0DCGCJML tag=MWHV2YKT67HG type=write size=2669350 2024-09-12T00:07:15.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.193+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=QJFXOPINSUU7 type=del 2024-09-12T00:07:15.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.195+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=0V31W0RQNWP2 type=del size=2400322 2024-09-12T00:07:15.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.196+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=C5BXNKTOEEEA type=del 2024-09-12T00:07:15.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.199+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~HZ4YJZ7APB0I.0 size=1048576 2024-09-12T00:07:15.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.200+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~HZ4YJZ7APB0I.1 size=1048576 2024-09-12T00:07:15.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.201+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~HZ4YJZ7APB0I.2 size=523376 2024-09-12T00:07:15.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.201+0000 7f82f8930780 1 > prepared multipart upload key=IN8Y7I0HKP6D upload=HZ4YJZ7APB0I tag=NKA4HVQXCGBW type=write size=3669104 2024-09-12T00:07:15.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.202+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=Y96PNNAD59F8 type=del 2024-09-12T00:07:15.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.204+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=WCZYSN2E4WYX type=del size=1747266 2024-09-12T00:07:15.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.205+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=JGPZ6I37F0JD type=del 2024-09-12T00:07:15.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.206+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=GZ8LGCUD9916 type=del size=3522063 2024-09-12T00:07:15.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.208+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~6IVO0AEB2ZPN.0 size=1048576 2024-09-12T00:07:15.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.209+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~6IVO0AEB2ZPN.1 size=1048576 2024-09-12T00:07:15.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.210+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~6IVO0AEB2ZPN.2 size=115838 2024-09-12T00:07:15.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.212+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=6IVO0AEB2ZPN tag=3C4UXWG3IKF7 type=write size=3261566 2024-09-12T00:07:15.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.214+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=5MZ1E3WI73WP type=del size=735537 2024-09-12T00:07:15.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.215+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=VQQ3PQN90OMI type=del 2024-09-12T00:07:15.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.216+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=2ST99VULZXYJ type=write size=897637 2024-09-12T00:07:15.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.218+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~HFNAP8BMFL1E.0 size=1048576 2024-09-12T00:07:15.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.219+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~HFNAP8BMFL1E.1 size=721798 2024-09-12T00:07:15.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.221+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=HFNAP8BMFL1E tag=LDC5W8OGKDRI type=write size=2818950 2024-09-12T00:07:15.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.223+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~5DBECZLYZS6L.0 size=146794 2024-09-12T00:07:15.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.223+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=5DBECZLYZS6L tag=H7GPTRAEXQYN type=write size=1195370 2024-09-12T00:07:15.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.224+0000 7f82f8930780 1 < completed write operation key=80OUXNDPLGAG tag=HMO3QJZX6X0S type=write size=128896 2024-09-12T00:07:15.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.227+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~QJRPU2Z3M6ZI.0 size=337076 2024-09-12T00:07:15.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.227+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=QJRPU2Z3M6ZI tag=QBYMVXJHBCWJ type=write size=1385652 2024-09-12T00:07:15.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.229+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~U84YHJQDBCIX.0 size=1048576 2024-09-12T00:07:15.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.230+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~U84YHJQDBCIX.1 size=1048576 2024-09-12T00:07:15.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.230+0000 7f82f8930780 1 < canceled part key=_multipart_62X93NOS23AF.2~U84YHJQDBCIX.2 size=143765 2024-09-12T00:07:15.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.232+0000 7f82f8930780 1 < canceled multipart upload key=62X93NOS23AF upload=U84YHJQDBCIX tag=C0RIS5H7KL94 type=write size=3289493 2024-09-12T00:07:15.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.235+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~REZ7C259Z59Q.0 size=1048576 2024-09-12T00:07:15.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.235+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~REZ7C259Z59Q.1 size=335154 2024-09-12T00:07:15.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.235+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=REZ7C259Z59Q tag=IQIB8CVYKQ5Z type=write size=2432306 2024-09-12T00:07:15.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.237+0000 7f82f8930780 1 < completed delete operation key=HCK59C6MAW0B tag=V5V39N6CCW74 type=del 2024-09-12T00:07:15.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.239+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~4M8SX9T32586.0 size=419430 2024-09-12T00:07:15.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.239+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=4M8SX9T32586 tag=VLDR78N6EKU0 type=write size=1468006 2024-09-12T00:07:15.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.240+0000 7f82f8930780 1 < completed write operation key=OC61OW2M7ZEI tag=103AOZ9V8Z7C type=write size=575941 2024-09-12T00:07:15.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.241+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=3H1WHG4QFEDF type=del size=1611311 2024-09-12T00:07:15.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.242+0000 7f82f8930780 1 < canceled part key=_multipart_YWC5JUV5B2N6.2~4A6T1U0F61TP.0 size=1048576 2024-09-12T00:07:15.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.242+0000 7f82f8930780 1 < canceled part key=_multipart_YWC5JUV5B2N6.2~4A6T1U0F61TP.1 size=1048576 2024-09-12T00:07:15.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.242+0000 7f82f8930780 1 < canceled part key=_multipart_YWC5JUV5B2N6.2~4A6T1U0F61TP.2 size=60934 2024-09-12T00:07:15.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.244+0000 7f82f8930780 1 < canceled multipart upload key=YWC5JUV5B2N6 upload=4A6T1U0F61TP tag=2V93V7Y1SCEB type=write size=3206662 2024-09-12T00:07:15.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.246+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=0GXW3WUCN9D6 type=del size=1145769 2024-09-12T00:07:15.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.248+0000 7f82f8930780 1 < suggested remove operation key=AMWMQXO10EXK tag=5L3B61V8L1EY type=del 2024-09-12T00:07:15.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.251+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~971PFVF5FX01.0 size=1048576 2024-09-12T00:07:15.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.252+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~971PFVF5FX01.1 size=281660 2024-09-12T00:07:15.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.252+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=971PFVF5FX01 tag=RGFLW6WBP3MI type=write size=2378812 2024-09-12T00:07:15.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.254+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~L4E8PE3U7VPQ.0 size=1048576 2024-09-12T00:07:15.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.255+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~L4E8PE3U7VPQ.1 size=242006 2024-09-12T00:07:15.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.257+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=L4E8PE3U7VPQ tag=4BM2931QALJH type=write size=2339158 2024-09-12T00:07:15.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.258+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=J0NXAU3RTCYA type=del size=566785 2024-09-12T00:07:15.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.260+0000 7f82f8930780 1 < completed delete operation key=OVJOP07M9KB8 tag=C0YAJOO3JMV3 type=del 2024-09-12T00:07:15.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.262+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~MW5IR3LYPZ0D.0 size=1002888 2024-09-12T00:07:15.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.262+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=MW5IR3LYPZ0D tag=WM52ACKQEVZZ type=write size=2051464 2024-09-12T00:07:15.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.264+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~O0EC0DCGCJML.0 size=1048576 2024-09-12T00:07:15.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.265+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~O0EC0DCGCJML.1 size=572198 2024-09-12T00:07:15.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.268+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=O0EC0DCGCJML tag=MWHV2YKT67HG type=write size=2669350 2024-09-12T00:07:15.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.269+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=PA6SOJZW7CD2 type=del size=2715242 2024-09-12T00:07:15.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.270+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=0V31W0RQNWP2 type=del 2024-09-12T00:07:15.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.272+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~MD24TX2KC86Z.0 size=1048576 2024-09-12T00:07:15.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.274+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~MD24TX2KC86Z.1 size=1048576 2024-09-12T00:07:15.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.275+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~MD24TX2KC86Z.2 size=944007 2024-09-12T00:07:15.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.275+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=MD24TX2KC86Z tag=GW11223SYPA0 type=write size=4089735 2024-09-12T00:07:15.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.276+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~HZ4YJZ7APB0I.0 size=1048576 2024-09-12T00:07:15.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.277+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~HZ4YJZ7APB0I.1 size=1048576 2024-09-12T00:07:15.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.279+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~HZ4YJZ7APB0I.2 size=523376 2024-09-12T00:07:15.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.281+0000 7f82f8930780 1 < completed multipart upload key=IN8Y7I0HKP6D upload=HZ4YJZ7APB0I tag=NKA4HVQXCGBW type=write size=3669104 2024-09-12T00:07:15.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.283+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~69STR2DG5IGA.0 size=506508 2024-09-12T00:07:15.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.283+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=69STR2DG5IGA tag=0G3CSXNRG07Z type=write size=1555084 2024-09-12T00:07:15.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.286+0000 7f82f8930780 1 < suggested remove operation key=A8EFUP30RS65 tag=WCZYSN2E4WYX type=del 2024-09-12T00:07:15.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.289+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~B26DV0UDEH5R.0 size=1048576 2024-09-12T00:07:15.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.290+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~B26DV0UDEH5R.1 size=433307 2024-09-12T00:07:15.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.290+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=B26DV0UDEH5R tag=WC3NJH0TTEXF type=write size=2530459 2024-09-12T00:07:15.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.292+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=GZ8LGCUD9916 type=del 2024-09-12T00:07:15.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.294+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~HBSLQ8FG9UX8.0 size=1048576 2024-09-12T00:07:15.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.295+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~HBSLQ8FG9UX8.1 size=328065 2024-09-12T00:07:15.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.295+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=HBSLQ8FG9UX8 tag=K6Y2F6ZCNEYB type=write size=2425217 2024-09-12T00:07:15.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.299+0000 7f82f8930780 1 < suggested update operation key=4IA4918NXXJW tag=5MZ1E3WI73WP type=del size=735537 2024-09-12T00:07:15.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.300+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=6N64ZA7BC019 type=write size=688052 2024-09-12T00:07:15.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.301+0000 7f82f8930780 1 < completed write operation key=3X2PLA3ODHJ1 tag=2ST99VULZXYJ type=write size=897637 2024-09-12T00:07:15.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.303+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=RBSFMOQ6B98T type=del size=1278783 2024-09-12T00:07:15.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.304+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~5DBECZLYZS6L.0 size=146794 2024-09-12T00:07:15.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.306+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=5DBECZLYZS6L tag=H7GPTRAEXQYN type=write size=1195370 2024-09-12T00:07:15.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.308+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~DPOXKXK7TMZQ.0 size=42288 2024-09-12T00:07:15.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.308+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=DPOXKXK7TMZQ tag=DXHU7EJSCDZZ type=write size=1090864 2024-09-12T00:07:15.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.310+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~QJRPU2Z3M6ZI.0 size=337076 2024-09-12T00:07:15.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.313+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=QJRPU2Z3M6ZI tag=QBYMVXJHBCWJ type=write size=1385652 2024-09-12T00:07:15.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.315+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=PTDETRQ4A36W type=del size=1318213 2024-09-12T00:07:15.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.315+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~REZ7C259Z59Q.0 size=1048576 2024-09-12T00:07:15.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.317+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~REZ7C259Z59Q.1 size=335154 2024-09-12T00:07:15.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.319+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=REZ7C259Z59Q tag=IQIB8CVYKQ5Z type=write size=2432306 2024-09-12T00:07:15.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.321+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=2861U8SMIYGY type=del size=3375817 2024-09-12T00:07:15.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.322+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~4M8SX9T32586.0 size=419430 2024-09-12T00:07:15.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.325+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=4M8SX9T32586 tag=VLDR78N6EKU0 type=write size=1468006 2024-09-12T00:07:15.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.328+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~53F6NKGTT0FD.0 size=1048576 2024-09-12T00:07:15.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.328+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~53F6NKGTT0FD.1 size=1048576 2024-09-12T00:07:15.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.329+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~53F6NKGTT0FD.2 size=682925 2024-09-12T00:07:15.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.329+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=53F6NKGTT0FD tag=IS0ID7D1R9JG type=write size=3828653 2024-09-12T00:07:15.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.332+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=3H1WHG4QFEDF type=del 2024-09-12T00:07:15.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.332+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=QI10FW6BIM8P type=write size=381241 2024-09-12T00:07:15.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.335+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=0GXW3WUCN9D6 type=del 2024-09-12T00:07:15.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.335+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=GJ2REHXGUBBK type=del size=2321618 2024-09-12T00:07:15.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.337+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~971PFVF5FX01.0 size=1048576 2024-09-12T00:07:15.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.338+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~971PFVF5FX01.1 size=281660 2024-09-12T00:07:15.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.340+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=971PFVF5FX01 tag=RGFLW6WBP3MI type=write size=2378812 2024-09-12T00:07:15.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.341+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=MATGFJHEJTNY type=write size=346423 2024-09-12T00:07:15.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.343+0000 7f82f8930780 1 < completed delete operation key=N2TYUAJITFNL tag=J0NXAU3RTCYA type=del 2024-09-12T00:07:15.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.345+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~DELEM82ARXPD.0 size=1048576 2024-09-12T00:07:15.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.347+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~DELEM82ARXPD.1 size=1048576 2024-09-12T00:07:15.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.348+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~DELEM82ARXPD.2 size=734563 2024-09-12T00:07:15.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.348+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=DELEM82ARXPD tag=CKFY1AVXAEBG type=write size=3880291 2024-09-12T00:07:15.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.349+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~MW5IR3LYPZ0D.0 size=1002888 2024-09-12T00:07:15.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.352+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=MW5IR3LYPZ0D tag=WM52ACKQEVZZ type=write size=2051464 2024-09-12T00:07:15.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.353+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=2FGJ6OMVP4Y2 type=del size=573728 2024-09-12T00:07:15.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.355+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=PA6SOJZW7CD2 type=del 2024-09-12T00:07:15.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.357+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=DBRLC8TPLNZT type=write size=558678 2024-09-12T00:07:15.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.357+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~MD24TX2KC86Z.0 size=1048576 2024-09-12T00:07:15.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.359+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~MD24TX2KC86Z.1 size=1048576 2024-09-12T00:07:15.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.360+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~MD24TX2KC86Z.2 size=944007 2024-09-12T00:07:15.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.362+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=MD24TX2KC86Z tag=GW11223SYPA0 type=write size=4089735 2024-09-12T00:07:15.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.365+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~WHLTIYTMH62C.0 size=1048576 2024-09-12T00:07:15.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.366+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~WHLTIYTMH62C.1 size=1048576 2024-09-12T00:07:15.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.368+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~WHLTIYTMH62C.2 size=131528 2024-09-12T00:07:15.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.368+0000 7f82f8930780 1 > prepared multipart upload key=IN8Y7I0HKP6D upload=WHLTIYTMH62C tag=MJJAAM9PUHL2 type=write size=3277256 2024-09-12T00:07:15.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.368+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~69STR2DG5IGA.0 size=506508 2024-09-12T00:07:15.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.371+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=69STR2DG5IGA tag=0G3CSXNRG07Z type=write size=1555084 2024-09-12T00:07:15.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.372+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=ACCA02CL4QYJ type=del size=3080178 2024-09-12T00:07:15.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.374+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~B26DV0UDEH5R.0 size=1048576 2024-09-12T00:07:15.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.374+0000 7f82f8930780 1 < canceled part key=_multipart_HCK59C6MAW0B.2~B26DV0UDEH5R.1 size=433307 2024-09-12T00:07:15.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.376+0000 7f82f8930780 1 < canceled multipart upload key=HCK59C6MAW0B upload=B26DV0UDEH5R tag=WC3NJH0TTEXF type=write size=2530459 2024-09-12T00:07:15.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.377+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=JTHLMYHW9WZH type=del size=2095821 2024-09-12T00:07:15.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.379+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~HBSLQ8FG9UX8.0 size=1048576 2024-09-12T00:07:15.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.380+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~HBSLQ8FG9UX8.1 size=328065 2024-09-12T00:07:15.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.382+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=HBSLQ8FG9UX8 tag=K6Y2F6ZCNEYB type=write size=2425217 2024-09-12T00:07:15.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.383+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=H6ICYFFBE9TJ type=del size=3957056 2024-09-12T00:07:15.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.385+0000 7f82f8930780 1 < completed write operation key=IMAT4ZCLGFRN tag=6N64ZA7BC019 type=write size=688052 2024-09-12T00:07:15.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.387+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~ZWJP967S1CWZ.0 size=1048576 2024-09-12T00:07:15.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.388+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~ZWJP967S1CWZ.1 size=135012 2024-09-12T00:07:15.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.388+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=ZWJP967S1CWZ tag=2YWHFJ1JZ970 type=write size=2232164 2024-09-12T00:07:15.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.391+0000 7f82f8930780 1 < canceled operation key=NCIZ4HNPCZ94 tag=RBSFMOQ6B98T type=del size=1278783 2024-09-12T00:07:15.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.391+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=DCUSKEZ8K0GF type=del size=426378 2024-09-12T00:07:15.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.393+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~DPOXKXK7TMZQ.0 size=42288 2024-09-12T00:07:15.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.395+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=DPOXKXK7TMZQ tag=DXHU7EJSCDZZ type=write size=1090864 2024-09-12T00:07:15.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.396+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=L547Q3HEVP3K type=del size=3989683 2024-09-12T00:07:15.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.397+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=PTDETRQ4A36W type=del 2024-09-12T00:07:15.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.399+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=KSQKOULJ1EF7 type=del size=1568584 2024-09-12T00:07:15.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.402+0000 7f82f8930780 1 < suggested update operation key=FOWSB9RQ5TV5 tag=2861U8SMIYGY type=del size=3375817 2024-09-12T00:07:15.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.404+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~4HREXAMIWLM5.0 size=1048576 2024-09-12T00:07:15.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.405+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~4HREXAMIWLM5.1 size=1048576 2024-09-12T00:07:15.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.406+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~4HREXAMIWLM5.2 size=881564 2024-09-12T00:07:15.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.406+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=4HREXAMIWLM5 tag=WE2V7IQLNOC7 type=write size=4027292 2024-09-12T00:07:15.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.408+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~53F6NKGTT0FD.0 size=1048576 2024-09-12T00:07:15.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.409+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~53F6NKGTT0FD.1 size=1048576 2024-09-12T00:07:15.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.410+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~53F6NKGTT0FD.2 size=682925 2024-09-12T00:07:15.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.412+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=53F6NKGTT0FD tag=IS0ID7D1R9JG type=write size=3828653 2024-09-12T00:07:15.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.413+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=RXV8V0ZF76PY type=del size=2634910 2024-09-12T00:07:15.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.415+0000 7f82f8930780 1 < completed write operation key=3X2PLA3ODHJ1 tag=QI10FW6BIM8P type=write size=381241 2024-09-12T00:07:15.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.416+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=JW3PTO19LKZ3 type=del size=4071421 2024-09-12T00:07:15.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.418+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=GJ2REHXGUBBK type=del 2024-09-12T00:07:15.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.419+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=6UDPK3RDKZWN type=del size=3923894 2024-09-12T00:07:15.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.421+0000 7f82f8930780 1 < completed write operation key=4SPRDO097JYQ tag=MATGFJHEJTNY type=write size=346423 2024-09-12T00:07:15.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.423+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=0FNQRUGEO1FV type=del size=178331 2024-09-12T00:07:15.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.424+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~DELEM82ARXPD.0 size=1048576 2024-09-12T00:07:15.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.425+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~DELEM82ARXPD.1 size=1048576 2024-09-12T00:07:15.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.425+0000 7f82f8930780 1 < canceled part key=_multipart_Y8GDXNDCOHCW.2~DELEM82ARXPD.2 size=734563 2024-09-12T00:07:15.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.428+0000 7f82f8930780 1 < canceled multipart upload key=Y8GDXNDCOHCW upload=DELEM82ARXPD tag=CKFY1AVXAEBG type=write size=3880291 2024-09-12T00:07:15.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.430+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~NXHX0MAD4Z26.0 size=1048576 2024-09-12T00:07:15.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.431+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~NXHX0MAD4Z26.1 size=1048576 2024-09-12T00:07:15.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.432+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~NXHX0MAD4Z26.2 size=785033 2024-09-12T00:07:15.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.432+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=NXHX0MAD4Z26 tag=2F2GBYZJ2EIG type=write size=3930761 2024-09-12T00:07:15.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.435+0000 7f82f8930780 1 < suggested update operation key=HCK59C6MAW0B tag=2FGJ6OMVP4Y2 type=del size=573728 2024-09-12T00:07:15.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.436+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=OZ21270DGV6O type=write size=986070 2024-09-12T00:07:15.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.438+0000 7f82f8930780 1 < completed write operation key=75GYP042UUC2 tag=DBRLC8TPLNZT type=write size=558678 2024-09-12T00:07:15.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.440+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~EXVUYRZL3WW3.0 size=1048576 2024-09-12T00:07:15.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.441+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~EXVUYRZL3WW3.1 size=577861 2024-09-12T00:07:15.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.441+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=EXVUYRZL3WW3 tag=WSBLP73P6JPM type=write size=2675013 2024-09-12T00:07:15.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.443+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~WHLTIYTMH62C.0 size=1048576 2024-09-12T00:07:15.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.443+0000 7f82f8930780 1 < canceled part key=_multipart_IN8Y7I0HKP6D.2~WHLTIYTMH62C.1 size=1048576 2024-09-12T00:07:15.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.444+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~WHLTIYTMH62C.2 size=131528 2024-09-12T00:07:15.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.447+0000 7f82f8930780 1 < canceled multipart upload key=IN8Y7I0HKP6D upload=WHLTIYTMH62C tag=MJJAAM9PUHL2 type=write size=3277256 2024-09-12T00:07:15.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.448+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=6LNYG9R52PAY type=del size=2903810 2024-09-12T00:07:15.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.451+0000 7f82f8930780 1 < suggested update operation key=X3PCR8TCWDTK tag=ACCA02CL4QYJ type=del size=3080178 2024-09-12T00:07:15.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.453+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~4EJJ692VH300.0 size=1048576 2024-09-12T00:07:15.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.455+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~4EJJ692VH300.1 size=691450 2024-09-12T00:07:15.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.455+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=4EJJ692VH300 tag=9MXSF9LC1399 type=write size=2788602 2024-09-12T00:07:15.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.456+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=JTHLMYHW9WZH type=del 2024-09-12T00:07:15.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.457+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=UDB9I8IEHVD4 type=del size=483164 2024-09-12T00:07:15.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.459+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=H6ICYFFBE9TJ type=del 2024-09-12T00:07:15.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.460+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=WI3DTXXM22XS type=del size=3458874 2024-09-12T00:07:15.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.462+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~ZWJP967S1CWZ.0 size=1048576 2024-09-12T00:07:15.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.463+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~ZWJP967S1CWZ.1 size=135012 2024-09-12T00:07:15.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.465+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=ZWJP967S1CWZ tag=2YWHFJ1JZ970 type=write size=2232164 2024-09-12T00:07:15.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.466+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=BLXIT78D3YV9 type=del size=523370 2024-09-12T00:07:15.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.468+0000 7f82f8930780 1 < canceled operation key=NCIZ4HNPCZ94 tag=DCUSKEZ8K0GF type=del size=426378 2024-09-12T00:07:15.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.469+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=Y5RA2CFWH2J1 type=del size=1586536 2024-09-12T00:07:15.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.471+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=L547Q3HEVP3K type=del 2024-09-12T00:07:15.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.473+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~NI9G0ZJPL5KZ.0 size=138109 2024-09-12T00:07:15.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.473+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=NI9G0ZJPL5KZ tag=O0CE44TGFR12 type=write size=1186685 2024-09-12T00:07:15.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.475+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=KSQKOULJ1EF7 type=del 2024-09-12T00:07:15.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.478+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~YB3FVTIZ07UM.0 size=1048576 2024-09-12T00:07:15.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.479+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~YB3FVTIZ07UM.1 size=1048576 2024-09-12T00:07:15.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.480+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~YB3FVTIZ07UM.2 size=895172 2024-09-12T00:07:15.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.480+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=YB3FVTIZ07UM tag=YSUZZQZ42ZRT type=write size=4040900 2024-09-12T00:07:15.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.481+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~4HREXAMIWLM5.0 size=1048576 2024-09-12T00:07:15.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.483+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~4HREXAMIWLM5.1 size=1048576 2024-09-12T00:07:15.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.484+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~4HREXAMIWLM5.2 size=881564 2024-09-12T00:07:15.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.486+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=4HREXAMIWLM5 tag=WE2V7IQLNOC7 type=write size=4027292 2024-09-12T00:07:15.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.489+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~R8BKZEDH0CQ2.0 size=531462 2024-09-12T00:07:15.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.489+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=R8BKZEDH0CQ2 tag=N75RZ0V9TFTH type=write size=1580038 2024-09-12T00:07:15.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.490+0000 7f82f8930780 1 < canceled operation key=9576W9WYJUJV tag=RXV8V0ZF76PY type=del size=2634910 2024-09-12T00:07:15.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.491+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=X3QL5A1D4EJU type=del size=1647132 2024-09-12T00:07:15.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.493+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=JW3PTO19LKZ3 type=del 2024-09-12T00:07:15.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.495+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~B8G2592GL0AD.0 size=1048576 2024-09-12T00:07:15.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.496+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~B8G2592GL0AD.1 size=1048576 2024-09-12T00:07:15.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.497+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~B8G2592GL0AD.2 size=419715 2024-09-12T00:07:15.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.497+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=B8G2592GL0AD tag=PTS3QNW1I2BL type=write size=3565443 2024-09-12T00:07:15.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.500+0000 7f82f8930780 1 < suggested update operation key=G55HN1VD6X47 tag=6UDPK3RDKZWN type=del size=3923894 2024-09-12T00:07:15.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.502+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=DJE5G45UZ6HF type=write size=439782 2024-09-12T00:07:15.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.503+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=0FNQRUGEO1FV type=del 2024-09-12T00:07:15.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.506+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~JZR72IVYW09H.0 size=395235 2024-09-12T00:07:15.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.506+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=JZR72IVYW09H tag=8ZR30Z4S7SMI type=write size=1443811 2024-09-12T00:07:15.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.507+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~NXHX0MAD4Z26.0 size=1048576 2024-09-12T00:07:15.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.508+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~NXHX0MAD4Z26.1 size=1048576 2024-09-12T00:07:15.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.509+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~NXHX0MAD4Z26.2 size=785033 2024-09-12T00:07:15.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.511+0000 7f82f8930780 1 < completed multipart upload key=Y5U8MO9TOJQQ upload=NXHX0MAD4Z26 tag=2F2GBYZJ2EIG type=write size=3930761 2024-09-12T00:07:15.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.513+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=0D2U2P4X6VZ1 type=del size=911234 2024-09-12T00:07:15.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.516+0000 7f82f8930780 1 < suggested remove operation key=O2ZGU2KOTUOT tag=OZ21270DGV6O type=write 2024-09-12T00:07:15.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.516+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=NCMBNFUZGFLE type=del size=1840031 2024-09-12T00:07:15.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.518+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~EXVUYRZL3WW3.0 size=1048576 2024-09-12T00:07:15.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.519+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~EXVUYRZL3WW3.1 size=577861 2024-09-12T00:07:15.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.521+0000 7f82f8930780 1 < completed multipart upload key=Y5U8MO9TOJQQ upload=EXVUYRZL3WW3 tag=WSBLP73P6JPM type=write size=2675013 2024-09-12T00:07:15.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.522+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=75IVNWDXV4T1 type=del size=3177687 2024-09-12T00:07:15.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.524+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=6LNYG9R52PAY type=del 2024-09-12T00:07:15.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.526+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~0NZMYO8551PS.0 size=52917 2024-09-12T00:07:15.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.526+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=0NZMYO8551PS tag=7ETZO71WW7NY type=write size=1101493 2024-09-12T00:07:15.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.527+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~4EJJ692VH300.0 size=1048576 2024-09-12T00:07:15.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.529+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~4EJJ692VH300.1 size=691450 2024-09-12T00:07:15.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.531+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=4EJJ692VH300 tag=9MXSF9LC1399 type=write size=2788602 2024-09-12T00:07:15.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.534+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~I68QKGAFML56.0 size=1048576 2024-09-12T00:07:15.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.535+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~I68QKGAFML56.1 size=776070 2024-09-12T00:07:15.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.535+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=I68QKGAFML56 tag=MESCOX16QHWF type=write size=2873222 2024-09-12T00:07:15.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.536+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=UDB9I8IEHVD4 type=del 2024-09-12T00:07:15.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.537+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=E3DLOQLHBNAI type=del size=1212000 2024-09-12T00:07:15.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.540+0000 7f82f8930780 1 < suggested update operation key=AMWMQXO10EXK tag=WI3DTXXM22XS type=del size=3458874 2024-09-12T00:07:15.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.543+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=QTCY7NJ4CA9J type=del size=3723834 2024-09-12T00:07:15.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.543+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=BLXIT78D3YV9 type=del 2024-09-12T00:07:15.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.545+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=11PCIFOG33L1 type=write size=3395 2024-09-12T00:07:15.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.546+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=Y5RA2CFWH2J1 type=del 2024-09-12T00:07:15.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.547+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=AMREIH9Y1AH8 type=del size=1009959 2024-09-12T00:07:15.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.549+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~NI9G0ZJPL5KZ.0 size=138109 2024-09-12T00:07:15.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.552+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=NI9G0ZJPL5KZ tag=O0CE44TGFR12 type=write size=1186685 2024-09-12T00:07:15.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.554+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~116JCAZG3F03.0 size=1048576 2024-09-12T00:07:15.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.555+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~116JCAZG3F03.1 size=592688 2024-09-12T00:07:15.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.555+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=116JCAZG3F03 tag=ZVYFLVV0CTA6 type=write size=2689840 2024-09-12T00:07:15.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.557+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~YB3FVTIZ07UM.0 size=1048576 2024-09-12T00:07:15.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.558+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~YB3FVTIZ07UM.1 size=1048576 2024-09-12T00:07:15.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.559+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~YB3FVTIZ07UM.2 size=895172 2024-09-12T00:07:15.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.561+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=YB3FVTIZ07UM tag=YSUZZQZ42ZRT type=write size=4040900 2024-09-12T00:07:15.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.562+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=VVEK3WON1001 type=del size=2821697 2024-09-12T00:07:15.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.565+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~R8BKZEDH0CQ2.0 size=531462 2024-09-12T00:07:15.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.567+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=R8BKZEDH0CQ2 tag=N75RZ0V9TFTH type=write size=1580038 2024-09-12T00:07:15.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.569+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~3NBILTEV2YPF.0 size=1048576 2024-09-12T00:07:15.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.570+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~3NBILTEV2YPF.1 size=344361 2024-09-12T00:07:15.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.570+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=3NBILTEV2YPF tag=OE5ROCHC00DT type=write size=2441513 2024-09-12T00:07:15.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.573+0000 7f82f8930780 1 < suggested remove operation key=4SPRDO097JYQ tag=X3QL5A1D4EJU type=del 2024-09-12T00:07:15.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.575+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=CQ1P04GVU1UQ type=del size=577074 2024-09-12T00:07:15.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.576+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~B8G2592GL0AD.0 size=1048576 2024-09-12T00:07:15.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.577+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~B8G2592GL0AD.1 size=1048576 2024-09-12T00:07:15.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.578+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~B8G2592GL0AD.2 size=419715 2024-09-12T00:07:15.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.581+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=B8G2592GL0AD tag=PTS3QNW1I2BL type=write size=3565443 2024-09-12T00:07:15.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.583+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~N3F5ZL1PZ6A3.0 size=1048576 2024-09-12T00:07:15.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.584+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~N3F5ZL1PZ6A3.1 size=1048576 2024-09-12T00:07:15.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.586+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~N3F5ZL1PZ6A3.2 size=969780 2024-09-12T00:07:15.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.586+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=N3F5ZL1PZ6A3 tag=013299GWUKM7 type=write size=4115508 2024-09-12T00:07:15.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.587+0000 7f82f8930780 1 < canceled operation key=9576W9WYJUJV tag=DJE5G45UZ6HF type=write size=439782 2024-09-12T00:07:15.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.589+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=KE4W694F7HRD type=del size=511929 2024-09-12T00:07:15.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.590+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~JZR72IVYW09H.0 size=395235 2024-09-12T00:07:15.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.592+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=JZR72IVYW09H tag=8ZR30Z4S7SMI type=write size=1443811 2024-09-12T00:07:15.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.595+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~RXD9TFZNDN8V.0 size=1048576 2024-09-12T00:07:15.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.596+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~RXD9TFZNDN8V.1 size=203996 2024-09-12T00:07:15.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.596+0000 7f82f8930780 1 > prepared multipart upload key=IN8Y7I0HKP6D upload=RXD9TFZNDN8V tag=RSOG09D3GKMO type=write size=2301148 2024-09-12T00:07:15.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.598+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=0D2U2P4X6VZ1 type=del 2024-09-12T00:07:15.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.600+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~VIPSXWE6PVO0.0 size=1048576 2024-09-12T00:07:15.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.602+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~VIPSXWE6PVO0.1 size=330893 2024-09-12T00:07:15.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.602+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=VIPSXWE6PVO0 tag=0TYP0AIT1TN4 type=write size=2428045 2024-09-12T00:07:15.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.603+0000 7f82f8930780 1 < completed delete operation key=HCK59C6MAW0B tag=NCMBNFUZGFLE type=del 2024-09-12T00:07:15.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.605+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=3571HRKT9UST type=del size=963796 2024-09-12T00:07:15.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.606+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=75IVNWDXV4T1 type=del 2024-09-12T00:07:15.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.608+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=G7OQ14HETXPY type=del size=1519567 2024-09-12T00:07:15.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.610+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~0NZMYO8551PS.0 size=52917 2024-09-12T00:07:15.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.612+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=0NZMYO8551PS tag=7ETZO71WW7NY type=write size=1101493 2024-09-12T00:07:15.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.614+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=OKC8K9AUQNED type=del size=2200933 2024-09-12T00:07:15.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.616+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~I68QKGAFML56.0 size=1048576 2024-09-12T00:07:15.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.616+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~I68QKGAFML56.1 size=776070 2024-09-12T00:07:15.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.619+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=I68QKGAFML56 tag=MESCOX16QHWF type=write size=2873222 2024-09-12T00:07:15.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.621+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~V6E2TGLQF8UM.0 size=69329 2024-09-12T00:07:15.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.621+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=V6E2TGLQF8UM tag=NOEFQTFCQR2S type=write size=1117905 2024-09-12T00:07:15.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.623+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=E3DLOQLHBNAI type=del 2024-09-12T00:07:15.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.626+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~XH75KNJG56OM.0 size=1048576 2024-09-12T00:07:15.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.627+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~XH75KNJG56OM.1 size=1048576 2024-09-12T00:07:15.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.629+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~XH75KNJG56OM.2 size=364160 2024-09-12T00:07:15.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.629+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=XH75KNJG56OM tag=XKYE9ADE0BAO type=write size=3509888 2024-09-12T00:07:15.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.630+0000 7f82f8930780 1 < canceled operation key=LAKJS79KNBY7 tag=QTCY7NJ4CA9J type=del size=3723834 2024-09-12T00:07:15.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.631+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=CCS9WBEBYDPA type=del size=2562340 2024-09-12T00:07:15.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.633+0000 7f82f8930780 1 < completed write operation key=X3PCR8TCWDTK tag=11PCIFOG33L1 type=write size=3395 2024-09-12T00:07:15.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.635+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~W95WZAJHEB23.0 size=1048576 2024-09-12T00:07:15.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.637+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~W95WZAJHEB23.1 size=294909 2024-09-12T00:07:15.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.637+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=W95WZAJHEB23 tag=A8DTDSYSQK8M type=write size=2392061 2024-09-12T00:07:15.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.638+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=AMREIH9Y1AH8 type=del 2024-09-12T00:07:15.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.640+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=RPP24FILYJ7I type=write size=644740 2024-09-12T00:07:15.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.641+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~116JCAZG3F03.0 size=1048576 2024-09-12T00:07:15.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.642+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~116JCAZG3F03.1 size=592688 2024-09-12T00:07:15.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.645+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=116JCAZG3F03 tag=ZVYFLVV0CTA6 type=write size=2689840 2024-09-12T00:07:15.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.647+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=AKBANRM1CTKG type=write size=716906 2024-09-12T00:07:15.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.649+0000 7f82f8930780 1 < suggested update operation key=75GYP042UUC2 tag=VVEK3WON1001 type=del size=2821697 2024-09-12T00:07:15.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.651+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~02E3T5YNHWM6.0 size=1042725 2024-09-12T00:07:15.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.651+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=02E3T5YNHWM6 tag=NSVV6KQG6ZLU type=write size=2091301 2024-09-12T00:07:15.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.653+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~3NBILTEV2YPF.0 size=1048576 2024-09-12T00:07:15.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.654+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~3NBILTEV2YPF.1 size=344361 2024-09-12T00:07:15.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.656+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=3NBILTEV2YPF tag=OE5ROCHC00DT type=write size=2441513 2024-09-12T00:07:15.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.659+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~NYZ4SZGJ18UU.0 size=1048576 2024-09-12T00:07:15.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.660+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~NYZ4SZGJ18UU.1 size=1048576 2024-09-12T00:07:15.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.661+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~NYZ4SZGJ18UU.2 size=141960 2024-09-12T00:07:15.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.661+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=NYZ4SZGJ18UU tag=A5IXEMCJR673 type=write size=3287688 2024-09-12T00:07:15.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.663+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=CQ1P04GVU1UQ type=del 2024-09-12T00:07:15.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.665+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~8AXZV1MEJOWC.0 size=1048576 2024-09-12T00:07:15.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.666+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~8AXZV1MEJOWC.1 size=1048576 2024-09-12T00:07:15.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.667+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~8AXZV1MEJOWC.2 size=420489 2024-09-12T00:07:15.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.667+0000 7f82f8930780 1 > prepared multipart upload key=IN8Y7I0HKP6D upload=8AXZV1MEJOWC tag=N9WRGCK0KJBC type=write size=3566217 2024-09-12T00:07:15.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.668+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~N3F5ZL1PZ6A3.0 size=1048576 2024-09-12T00:07:15.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.669+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~N3F5ZL1PZ6A3.1 size=1048576 2024-09-12T00:07:15.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.671+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~N3F5ZL1PZ6A3.2 size=969780 2024-09-12T00:07:15.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.673+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=N3F5ZL1PZ6A3 tag=013299GWUKM7 type=write size=4115508 2024-09-12T00:07:15.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.675+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=17W7TXX8XFB9 type=write size=913321 2024-09-12T00:07:15.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.676+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=KE4W694F7HRD type=del 2024-09-12T00:07:15.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.677+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=NYKIG4RXLWYB type=write size=498680 2024-09-12T00:07:15.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.678+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~RXD9TFZNDN8V.0 size=1048576 2024-09-12T00:07:15.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.679+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~RXD9TFZNDN8V.1 size=203996 2024-09-12T00:07:15.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.683+0000 7f82f8930780 1 < completed multipart upload key=IN8Y7I0HKP6D upload=RXD9TFZNDN8V tag=RSOG09D3GKMO type=write size=2301148 2024-09-12T00:07:15.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.685+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=Q1K8UG881315 type=del size=4143441 2024-09-12T00:07:15.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.686+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~VIPSXWE6PVO0.0 size=1048576 2024-09-12T00:07:15.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.686+0000 7f82f8930780 1 < canceled part key=_multipart_AMWMQXO10EXK.2~VIPSXWE6PVO0.1 size=330893 2024-09-12T00:07:15.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.689+0000 7f82f8930780 1 < canceled multipart upload key=AMWMQXO10EXK upload=VIPSXWE6PVO0 tag=0TYP0AIT1TN4 type=write size=2428045 2024-09-12T00:07:15.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.690+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=KD6TJQAJIHR4 type=del size=3327375 2024-09-12T00:07:15.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.691+0000 7f82f8930780 1 < canceled operation key=HCK59C6MAW0B tag=3571HRKT9UST type=del size=963796 2024-09-12T00:07:15.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.694+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~EY6P64W7ORLS.0 size=398469 2024-09-12T00:07:15.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.694+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=EY6P64W7ORLS tag=VHBY7SB1B03W type=write size=1447045 2024-09-12T00:07:15.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.697+0000 7f82f8930780 1 < suggested update operation key=W8SAQZWQHY36 tag=G7OQ14HETXPY type=del size=1519567 2024-09-12T00:07:15.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.699+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=NABXL79VE4WT type=del size=2463045 2024-09-12T00:07:15.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.700+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=OKC8K9AUQNED type=del 2024-09-12T00:07:15.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.702+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=LVXO8WY0S2JB type=del size=3521091 2024-09-12T00:07:15.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.704+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~V6E2TGLQF8UM.0 size=69329 2024-09-12T00:07:15.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.707+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=V6E2TGLQF8UM tag=NOEFQTFCQR2S type=write size=1117905 2024-09-12T00:07:15.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.708+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=4G7ZAEIB09JD type=write size=1028610 2024-09-12T00:07:15.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.710+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~XH75KNJG56OM.0 size=1048576 2024-09-12T00:07:15.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.711+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~XH75KNJG56OM.1 size=1048576 2024-09-12T00:07:15.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.712+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~XH75KNJG56OM.2 size=364160 2024-09-12T00:07:15.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.714+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=XH75KNJG56OM tag=XKYE9ADE0BAO type=write size=3509888 2024-09-12T00:07:15.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.717+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~1ZRZMUUW6ETR.0 size=1048576 2024-09-12T00:07:15.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.718+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~1ZRZMUUW6ETR.1 size=694060 2024-09-12T00:07:15.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.718+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=1ZRZMUUW6ETR tag=CHOGLI9L2PIR type=write size=2791212 2024-09-12T00:07:15.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.719+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=CCS9WBEBYDPA type=del 2024-09-12T00:07:15.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.722+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~4D8M96CYE8ER.0 size=1048576 2024-09-12T00:07:15.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.723+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~4D8M96CYE8ER.1 size=1048576 2024-09-12T00:07:15.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.724+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~4D8M96CYE8ER.2 size=293013 2024-09-12T00:07:15.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.724+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=4D8M96CYE8ER tag=3URN2282VB9X type=write size=3438741 2024-09-12T00:07:15.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.726+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~W95WZAJHEB23.0 size=1048576 2024-09-12T00:07:15.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.726+0000 7f82f8930780 1 < canceled part key=_multipart_HCK59C6MAW0B.2~W95WZAJHEB23.1 size=294909 2024-09-12T00:07:15.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.728+0000 7f82f8930780 1 < canceled multipart upload key=HCK59C6MAW0B upload=W95WZAJHEB23 tag=A8DTDSYSQK8M type=write size=2392061 2024-09-12T00:07:15.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.729+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=AHCUO0G3I514 type=write size=687385 2024-09-12T00:07:15.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.732+0000 7f82f8930780 1 < canceled operation key=Y5U8MO9TOJQQ tag=RPP24FILYJ7I type=write size=644740 2024-09-12T00:07:15.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.733+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=H51YX8H556Q5 type=del size=3856903 2024-09-12T00:07:15.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.734+0000 7f82f8930780 1 < completed write operation key=N2TYUAJITFNL tag=AKBANRM1CTKG type=write size=716906 2024-09-12T00:07:15.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.735+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=GG5DYO3JY2Y8 type=del size=1558931 2024-09-12T00:07:15.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.737+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~02E3T5YNHWM6.0 size=1042725 2024-09-12T00:07:15.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.739+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=02E3T5YNHWM6 tag=NSVV6KQG6ZLU type=write size=2091301 2024-09-12T00:07:15.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.741+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=J7IWSK01OAY0 type=del size=3613594 2024-09-12T00:07:15.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.742+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~NYZ4SZGJ18UU.0 size=1048576 2024-09-12T00:07:15.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.743+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~NYZ4SZGJ18UU.1 size=1048576 2024-09-12T00:07:15.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.744+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~NYZ4SZGJ18UU.2 size=141960 2024-09-12T00:07:15.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.746+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=NYZ4SZGJ18UU tag=A5IXEMCJR673 type=write size=3287688 2024-09-12T00:07:15.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.748+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=2PIVYDM397YF type=write size=597111 2024-09-12T00:07:15.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.748+0000 7f82f8930780 1 < canceled part key=_multipart_IN8Y7I0HKP6D.2~8AXZV1MEJOWC.0 size=1048576 2024-09-12T00:07:15.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.749+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~8AXZV1MEJOWC.1 size=1048576 2024-09-12T00:07:15.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.751+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~8AXZV1MEJOWC.2 size=420489 2024-09-12T00:07:15.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.753+0000 7f82f8930780 1 < canceled multipart upload key=IN8Y7I0HKP6D upload=8AXZV1MEJOWC tag=N9WRGCK0KJBC type=write size=3566217 2024-09-12T00:07:15.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.756+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~Q7FEI0NIUML8.0 size=1048576 2024-09-12T00:07:15.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.756+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~Q7FEI0NIUML8.1 size=847639 2024-09-12T00:07:15.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.756+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=Q7FEI0NIUML8 tag=MYQCD6R291C4 type=write size=2944791 2024-09-12T00:07:15.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.758+0000 7f82f8930780 1 < canceled operation key=YWC5JUV5B2N6 tag=17W7TXX8XFB9 type=write size=913321 2024-09-12T00:07:15.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.759+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=ZQ65T648MFKU type=write size=266004 2024-09-12T00:07:15.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.761+0000 7f82f8930780 1 < completed write operation key=G55HN1VD6X47 tag=NYKIG4RXLWYB type=write size=498680 2024-09-12T00:07:15.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.762+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=LZW0VMBFBMRQ type=write size=43875 2024-09-12T00:07:15.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.763+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=Q1K8UG881315 type=del 2024-09-12T00:07:15.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.765+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=9LAMITHBJ8KC type=del size=2313171 2024-09-12T00:07:15.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.766+0000 7f82f8930780 1 < canceled operation key=IMAT4ZCLGFRN tag=KD6TJQAJIHR4 type=del size=3327375 2024-09-12T00:07:15.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.767+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=GK079BAP5SVO type=write size=699996 2024-09-12T00:07:15.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.769+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~EY6P64W7ORLS.0 size=398469 2024-09-12T00:07:15.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.771+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=EY6P64W7ORLS tag=VHBY7SB1B03W type=write size=1447045 2024-09-12T00:07:15.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.772+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=93FJO8ZYPE2R type=del size=1995302 2024-09-12T00:07:15.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.774+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=NABXL79VE4WT type=del 2024-09-12T00:07:15.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.776+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~I9UUWUJ0S033.0 size=1048576 2024-09-12T00:07:15.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.778+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~I9UUWUJ0S033.1 size=1048576 2024-09-12T00:07:15.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.779+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~I9UUWUJ0S033.2 size=1031585 2024-09-12T00:07:15.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.779+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=I9UUWUJ0S033 tag=0CKKZOY5OJNK type=write size=4177313 2024-09-12T00:07:15.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.781+0000 7f82f8930780 1 < suggested remove operation key=BJHGNT3HBS25 tag=LVXO8WY0S2JB type=del 2024-09-12T00:07:15.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.783+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=ZVQK71V5A76W type=del size=2385974 2024-09-12T00:07:15.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.786+0000 7f82f8930780 1 < suggested update operation key=X3PCR8TCWDTK tag=4G7ZAEIB09JD type=write size=1028610 2024-09-12T00:07:15.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.788+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~6Y8Y9KN0EWH9.0 size=1048576 2024-09-12T00:07:15.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.789+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~6Y8Y9KN0EWH9.1 size=434766 2024-09-12T00:07:15.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.790+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=6Y8Y9KN0EWH9 tag=W5GF6YOSA5LG type=write size=2531918 2024-09-12T00:07:15.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.791+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~1ZRZMUUW6ETR.0 size=1048576 2024-09-12T00:07:15.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.792+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~1ZRZMUUW6ETR.1 size=694060 2024-09-12T00:07:15.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.794+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=1ZRZMUUW6ETR tag=CHOGLI9L2PIR type=write size=2791212 2024-09-12T00:07:15.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.797+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~7DEXNO3SUZXK.0 size=1048576 2024-09-12T00:07:15.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.798+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~7DEXNO3SUZXK.1 size=1016211 2024-09-12T00:07:15.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.798+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=7DEXNO3SUZXK tag=YZJ3BGVAHJS4 type=write size=3113363 2024-09-12T00:07:15.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.799+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~4D8M96CYE8ER.0 size=1048576 2024-09-12T00:07:15.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.800+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~4D8M96CYE8ER.1 size=1048576 2024-09-12T00:07:15.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.801+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~4D8M96CYE8ER.2 size=293013 2024-09-12T00:07:15.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.804+0000 7f82f8930780 1 < completed multipart upload key=Y5U8MO9TOJQQ upload=4D8M96CYE8ER tag=3URN2282VB9X type=write size=3438741 2024-09-12T00:07:15.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.805+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=HBSHGPNKXA1M type=write size=767026 2024-09-12T00:07:15.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.807+0000 7f82f8930780 1 < completed write operation key=YWC5JUV5B2N6 tag=AHCUO0G3I514 type=write size=687385 2024-09-12T00:07:15.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.809+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~5MX3GRFMKWZY.0 size=863684 2024-09-12T00:07:15.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.809+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=5MX3GRFMKWZY tag=35RMJPWBA427 type=write size=1912260 2024-09-12T00:07:15.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.811+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=H51YX8H556Q5 type=del 2024-09-12T00:07:15.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.812+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=57DXR0SECV87 type=del size=1741278 2024-09-12T00:07:15.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.814+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=GG5DYO3JY2Y8 type=del 2024-09-12T00:07:15.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.816+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=JHSBLQBSGANZ type=del size=3501362 2024-09-12T00:07:15.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.817+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=J7IWSK01OAY0 type=del 2024-09-12T00:07:15.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.818+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=UOO2RIWU16NG type=write size=627814 2024-09-12T00:07:15.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.820+0000 7f82f8930780 1 < completed write operation key=4SPRDO097JYQ tag=2PIVYDM397YF type=write size=597111 2024-09-12T00:07:15.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.822+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~5IKGLSEFNS5J.0 size=1048576 2024-09-12T00:07:15.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.823+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~5IKGLSEFNS5J.1 size=862800 2024-09-12T00:07:15.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.823+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=5IKGLSEFNS5J tag=4QJ9QCZR5KQC type=write size=2959952 2024-09-12T00:07:15.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.824+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~Q7FEI0NIUML8.0 size=1048576 2024-09-12T00:07:15.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.825+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~Q7FEI0NIUML8.1 size=847639 2024-09-12T00:07:15.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.828+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=Q7FEI0NIUML8 tag=MYQCD6R291C4 type=write size=2944791 2024-09-12T00:07:15.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.829+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=XLHPBHBKF73I type=del size=494373 2024-09-12T00:07:15.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.832+0000 7f82f8930780 1 < suggested update operation key=75GYP042UUC2 tag=ZQ65T648MFKU type=write size=266004 2024-09-12T00:07:15.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.833+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=RHJ73GFK2NFL type=write size=394329 2024-09-12T00:07:15.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.834+0000 7f82f8930780 1 < canceled operation key=O2ZGU2KOTUOT tag=LZW0VMBFBMRQ type=write size=43875 2024-09-12T00:07:15.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.836+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=QR4LXAPN25KU type=del size=1620932 2024-09-12T00:07:15.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.837+0000 7f82f8930780 -1 < failed to complete operation key=X3PCR8TCWDTK tag=9LAMITHBJ8KC type=del size=2313171: (22) Invalid argument 2024-09-12T00:07:15.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.839+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~KTHD4NGC7GU4.0 size=1048576 2024-09-12T00:07:15.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.841+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~KTHD4NGC7GU4.1 size=1041124 2024-09-12T00:07:15.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.841+0000 7f82f8930780 1 > prepared multipart upload key=77SDZHCSP0E3 upload=KTHD4NGC7GU4 tag=458Y3FGAGW3Q type=write size=3138276 2024-09-12T00:07:15.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.842+0000 7f82f8930780 1 < completed write operation key=QB46N36A27QH tag=GK079BAP5SVO type=write size=699996 2024-09-12T00:07:15.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.844+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~2IQIJSK3XZXE.0 size=1048576 2024-09-12T00:07:15.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.846+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~2IQIJSK3XZXE.1 size=1048576 2024-09-12T00:07:15.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.847+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~2IQIJSK3XZXE.2 size=521714 2024-09-12T00:07:15.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.847+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=2IQIJSK3XZXE tag=39WYF2D39EU5 type=write size=3667442 2024-09-12T00:07:15.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.850+0000 7f82f8930780 1 < suggested update operation key=62X93NOS23AF tag=93FJO8ZYPE2R type=del size=1995302 2024-09-12T00:07:15.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.851+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=GISJSUM6X0UZ type=del size=3419050 2024-09-12T00:07:15.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.852+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~I9UUWUJ0S033.0 size=1048576 2024-09-12T00:07:15.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.854+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~I9UUWUJ0S033.1 size=1048576 2024-09-12T00:07:15.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.854+0000 7f82f8930780 1 < canceled part key=_multipart_A8EFUP30RS65.2~I9UUWUJ0S033.2 size=1031585 2024-09-12T00:07:15.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.856+0000 7f82f8930780 1 < canceled multipart upload key=A8EFUP30RS65 upload=I9UUWUJ0S033 tag=0CKKZOY5OJNK type=write size=4177313 2024-09-12T00:07:15.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.857+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=B695REGTP1CT type=del size=2713965 2024-09-12T00:07:15.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.859+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=ZVQK71V5A76W type=del 2024-09-12T00:07:15.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.860+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=6WYU516N85LX type=del size=2947049 2024-09-12T00:07:15.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.861+0000 7f82f8930780 1 < canceled part key=_multipart_AMWMQXO10EXK.2~6Y8Y9KN0EWH9.0 size=1048576 2024-09-12T00:07:15.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.862+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~6Y8Y9KN0EWH9.1 size=434766 2024-09-12T00:07:15.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.864+0000 7f82f8930780 1 < canceled multipart upload key=AMWMQXO10EXK upload=6Y8Y9KN0EWH9 tag=W5GF6YOSA5LG type=write size=2531918 2024-09-12T00:07:15.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.866+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~JAMDSF57OA3U.0 size=1048576 2024-09-12T00:07:15.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.868+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~JAMDSF57OA3U.1 size=1048576 2024-09-12T00:07:15.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.869+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~JAMDSF57OA3U.2 size=64303 2024-09-12T00:07:15.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.869+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=JAMDSF57OA3U tag=KPUIDR8U8LGM type=write size=3210031 2024-09-12T00:07:15.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.870+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~7DEXNO3SUZXK.0 size=1048576 2024-09-12T00:07:15.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.871+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~7DEXNO3SUZXK.1 size=1016211 2024-09-12T00:07:15.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.873+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=7DEXNO3SUZXK tag=YZJ3BGVAHJS4 type=write size=3113363 2024-09-12T00:07:15.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.875+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=E6RZV5KYOSOQ type=del size=2782759 2024-09-12T00:07:15.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.877+0000 7f82f8930780 1 < canceled operation key=9576W9WYJUJV tag=HBSHGPNKXA1M type=write size=767026 2024-09-12T00:07:15.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.879+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=QGX6QGNNSFB1 type=del size=136720 2024-09-12T00:07:15.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.881+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~5MX3GRFMKWZY.0 size=863684 2024-09-12T00:07:15.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.883+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=5MX3GRFMKWZY tag=35RMJPWBA427 type=write size=1912260 2024-09-12T00:07:15.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.884+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=6QY7YJWX1U29 type=del size=456174 2024-09-12T00:07:15.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.886+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=57DXR0SECV87 type=del 2024-09-12T00:07:15.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.887+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=V9VYL2ERYTND type=del size=447945 2024-09-12T00:07:15.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.890+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=JHSBLQBSGANZ type=del 2024-09-12T00:07:15.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.892+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~H1TA0LL2JQ0P.0 size=1048576 2024-09-12T00:07:15.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.893+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~H1TA0LL2JQ0P.1 size=1048576 2024-09-12T00:07:15.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.894+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~H1TA0LL2JQ0P.2 size=82243 2024-09-12T00:07:15.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.894+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=H1TA0LL2JQ0P tag=9OIWO0B5WS6F type=write size=3227971 2024-09-12T00:07:15.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.896+0000 7f82f8930780 1 < completed write operation key=N2TYUAJITFNL tag=UOO2RIWU16NG type=write size=627814 2024-09-12T00:07:15.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.897+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=ZBDK3VHB80ZB type=del size=2543746 2024-09-12T00:07:15.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.899+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~5IKGLSEFNS5J.0 size=1048576 2024-09-12T00:07:15.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.899+0000 7f82f8930780 1 < canceled part key=_multipart_Y8GDXNDCOHCW.2~5IKGLSEFNS5J.1 size=862800 2024-09-12T00:07:15.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.902+0000 7f82f8930780 1 < canceled multipart upload key=Y8GDXNDCOHCW upload=5IKGLSEFNS5J tag=4QJ9QCZR5KQC type=write size=2959952 2024-09-12T00:07:15.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.903+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=R1YCEXLO8IT5 type=del size=2647778 2024-09-12T00:07:15.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.905+0000 7f82f8930780 1 < suggested update operation key=HCK59C6MAW0B tag=XLHPBHBKF73I type=del size=494373 2024-09-12T00:07:15.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.907+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=FQC8NTMFL1YX type=del size=1045317 2024-09-12T00:07:15.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.909+0000 7f82f8930780 1 < completed write operation key=4SPRDO097JYQ tag=RHJ73GFK2NFL type=write size=394329 2024-09-12T00:07:15.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.910+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=FANMK4EQGU2C type=del size=686230 2024-09-12T00:07:15.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.911+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=QR4LXAPN25KU type=del 2024-09-12T00:07:15.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.913+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=2F0BPUT0VTW5 type=del size=2281435 2024-09-12T00:07:15.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.913+0000 7f82f8930780 1 < canceled part key=_multipart_77SDZHCSP0E3.2~KTHD4NGC7GU4.0 size=1048576 2024-09-12T00:07:15.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.914+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~KTHD4NGC7GU4.1 size=1041124 2024-09-12T00:07:15.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.916+0000 7f82f8930780 1 < canceled multipart upload key=77SDZHCSP0E3 upload=KTHD4NGC7GU4 tag=458Y3FGAGW3Q type=write size=3138276 2024-09-12T00:07:15.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.917+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=UTO064C1VYUU type=del size=692485 2024-09-12T00:07:15.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.919+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~2IQIJSK3XZXE.0 size=1048576 2024-09-12T00:07:15.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.920+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~2IQIJSK3XZXE.1 size=1048576 2024-09-12T00:07:15.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.921+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~2IQIJSK3XZXE.2 size=521714 2024-09-12T00:07:15.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.923+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=2IQIJSK3XZXE tag=39WYF2D39EU5 type=write size=3667442 2024-09-12T00:07:15.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.925+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=4UO9YUVTRWY3 type=del size=979680 2024-09-12T00:07:15.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.926+0000 7f82f8930780 1 < canceled operation key=BJHGNT3HBS25 tag=GISJSUM6X0UZ type=del size=3419050 2024-09-12T00:07:15.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.929+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~KLNWLLWUKJEE.0 size=28037 2024-09-12T00:07:15.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.929+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=KLNWLLWUKJEE tag=KN1R4W7F0DIQ type=write size=1076613 2024-09-12T00:07:15.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.930+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=B695REGTP1CT type=del 2024-09-12T00:07:15.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.933+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~70ZFYCLEXMRJ.0 size=1048576 2024-09-12T00:07:15.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.935+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~70ZFYCLEXMRJ.1 size=1048576 2024-09-12T00:07:15.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.936+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~70ZFYCLEXMRJ.2 size=232973 2024-09-12T00:07:15.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.936+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=70ZFYCLEXMRJ tag=CE13NI12UEYZ type=write size=3378701 2024-09-12T00:07:15.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.936+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=6WYU516N85LX type=del 2024-09-12T00:07:15.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.938+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=M5ICY7C8Q586 type=del size=1874280 2024-09-12T00:07:15.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.939+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~JAMDSF57OA3U.0 size=1048576 2024-09-12T00:07:15.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.940+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~JAMDSF57OA3U.1 size=1048576 2024-09-12T00:07:15.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.941+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~JAMDSF57OA3U.2 size=64303 2024-09-12T00:07:15.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.944+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=JAMDSF57OA3U tag=KPUIDR8U8LGM type=write size=3210031 2024-09-12T00:07:15.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.947+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~5N08VTU1YO64.0 size=1048576 2024-09-12T00:07:15.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.948+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~5N08VTU1YO64.1 size=997492 2024-09-12T00:07:15.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.948+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=5N08VTU1YO64 tag=1CQ8WBUV6OUO type=write size=3094644 2024-09-12T00:07:15.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.949+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=E6RZV5KYOSOQ type=del 2024-09-12T00:07:15.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.950+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=786EVKYXONNV type=del size=2071124 2024-09-12T00:07:15.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.952+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=QGX6QGNNSFB1 type=del 2024-09-12T00:07:15.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.954+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~WUH0GEGTNGMQ.0 size=352977 2024-09-12T00:07:15.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.954+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=WUH0GEGTNGMQ tag=PH55EXAT5KBK type=write size=1401553 2024-09-12T00:07:15.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.957+0000 7f82f8930780 1 < suggested update operation key=X3PCR8TCWDTK tag=6QY7YJWX1U29 type=del size=456174 2024-09-12T00:07:15.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.959+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=NYIBQ5R03VAA type=del size=3036599 2024-09-12T00:07:15.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.962+0000 7f82f8930780 1 < suggested update operation key=9576W9WYJUJV tag=V9VYL2ERYTND type=del size=447945 2024-09-12T00:07:15.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.963+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=RHTJ85IIY7YO type=del size=2962882 2024-09-12T00:07:15.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.965+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~H1TA0LL2JQ0P.0 size=1048576 2024-09-12T00:07:15.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.966+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~H1TA0LL2JQ0P.1 size=1048576 2024-09-12T00:07:15.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.967+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~H1TA0LL2JQ0P.2 size=82243 2024-09-12T00:07:15.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.970+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=H1TA0LL2JQ0P tag=9OIWO0B5WS6F type=write size=3227971 2024-09-12T00:07:15.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.972+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=MBGWWG3C55H9 type=del size=3828826 2024-09-12T00:07:15.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.972+0000 7f82f8930780 -1 < failed to complete operation key=HCK59C6MAW0B tag=ZBDK3VHB80ZB type=del size=2543746: (22) Invalid argument 2024-09-12T00:07:15.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.974+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=IJF9XP2WAY3O type=write size=197904 2024-09-12T00:07:15.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.975+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=R1YCEXLO8IT5 type=del 2024-09-12T00:07:15.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.979+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~1Q8I3Q0UB2FB.0 size=1048576 2024-09-12T00:07:15.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.979+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~1Q8I3Q0UB2FB.1 size=915892 2024-09-12T00:07:15.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.979+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=1Q8I3Q0UB2FB tag=NNORNY3NIF4Y type=write size=3013044 2024-09-12T00:07:15.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.980+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=FQC8NTMFL1YX type=del 2024-09-12T00:07:15.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.983+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~8FFZM4S2Z40C.0 size=627377 2024-09-12T00:07:15.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.983+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=8FFZM4S2Z40C tag=6UH7TKCYG5US type=write size=1675953 2024-09-12T00:07:15.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.984+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=FANMK4EQGU2C type=del 2024-09-12T00:07:15.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.987+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=8CGL4ABLMCZ1 type=del size=3181640 2024-09-12T00:07:15.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.989+0000 7f82f8930780 1 < suggested remove operation key=3H3D067Z8O0R tag=2F0BPUT0VTW5 type=del 2024-09-12T00:07:15.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.990+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=VVLHL8OCZHQM type=del size=1875819 2024-09-12T00:07:15.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.992+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=UTO064C1VYUU type=del 2024-09-12T00:07:15.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.993+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=EM0JNS6YR2IV type=del size=1986643 2024-09-12T00:07:15.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.996+0000 7f82f8930780 1 < suggested update operation key=FOWSB9RQ5TV5 tag=4UO9YUVTRWY3 type=del size=979680 2024-09-12T00:07:15.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.997+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=EP7LDFUVNSGZ type=del size=3933081 2024-09-12T00:07:15.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:15.999+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~KLNWLLWUKJEE.0 size=28037 2024-09-12T00:07:16.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.002+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=KLNWLLWUKJEE tag=KN1R4W7F0DIQ type=write size=1076613 2024-09-12T00:07:16.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.002+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=WJXRZVXUIC70 type=del size=3047115 2024-09-12T00:07:16.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.004+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~70ZFYCLEXMRJ.0 size=1048576 2024-09-12T00:07:16.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.004+0000 7f82f8930780 1 < canceled part key=_multipart_2XM2CF1T4VGW.2~70ZFYCLEXMRJ.1 size=1048576 2024-09-12T00:07:16.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.005+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~70ZFYCLEXMRJ.2 size=232973 2024-09-12T00:07:16.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.008+0000 7f82f8930780 1 < canceled multipart upload key=2XM2CF1T4VGW upload=70ZFYCLEXMRJ tag=CE13NI12UEYZ type=write size=3378701 2024-09-12T00:07:16.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.014+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=1FSAW1NF3PDS type=write size=706864 2024-09-12T00:07:16.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.015+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=M5ICY7C8Q586 type=del 2024-09-12T00:07:16.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.017+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=QVJUL9ZNZTVO type=del size=1542628 2024-09-12T00:07:16.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.018+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~5N08VTU1YO64.0 size=1048576 2024-09-12T00:07:16.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.019+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~5N08VTU1YO64.1 size=997492 2024-09-12T00:07:16.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.021+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=5N08VTU1YO64 tag=1CQ8WBUV6OUO type=write size=3094644 2024-09-12T00:07:16.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.023+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=NKUMHFCW2ZD8 type=write size=612893 2024-09-12T00:07:16.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.026+0000 7f82f8930780 1 < suggested update operation key=OC61OW2M7ZEI tag=786EVKYXONNV type=del size=2071124 2024-09-12T00:07:16.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.028+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~8P4A3CC7TB9F.0 size=839814 2024-09-12T00:07:16.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.028+0000 7f82f8930780 1 > prepared multipart upload key=77SDZHCSP0E3 upload=8P4A3CC7TB9F tag=JMXX3MSO2NC4 type=write size=1888390 2024-09-12T00:07:16.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.030+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~WUH0GEGTNGMQ.0 size=352977 2024-09-12T00:07:16.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.032+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=WUH0GEGTNGMQ tag=PH55EXAT5KBK type=write size=1401553 2024-09-12T00:07:16.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.033+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=L934W0EXRUXE type=del size=3739358 2024-09-12T00:07:16.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.035+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=NYIBQ5R03VAA type=del 2024-09-12T00:07:16.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.036+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=GAB8FQ8PTO5L type=del size=2967130 2024-09-12T00:07:16.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.038+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=RHTJ85IIY7YO type=del 2024-09-12T00:07:16.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.040+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~GO3UMQCBTEBV.0 size=1048576 2024-09-12T00:07:16.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.041+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~GO3UMQCBTEBV.1 size=572547 2024-09-12T00:07:16.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.041+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=GO3UMQCBTEBV tag=F2TDPP37DOKK type=write size=2669699 2024-09-12T00:07:16.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.042+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=MBGWWG3C55H9 type=del 2024-09-12T00:07:16.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.044+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=NSH3FL5S158Z type=del size=109581 2024-09-12T00:07:16.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.047+0000 7f82f8930780 1 < suggested remove operation key=HCK59C6MAW0B tag=IJF9XP2WAY3O type=write 2024-09-12T00:07:16.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.050+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~UZ4JT59TF07L.0 size=769607 2024-09-12T00:07:16.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.050+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=UZ4JT59TF07L tag=F6B5FHD3RCGB type=write size=1818183 2024-09-12T00:07:16.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.051+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~1Q8I3Q0UB2FB.0 size=1048576 2024-09-12T00:07:16.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.052+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~1Q8I3Q0UB2FB.1 size=915892 2024-09-12T00:07:16.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.054+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=1Q8I3Q0UB2FB tag=NNORNY3NIF4Y type=write size=3013044 2024-09-12T00:07:16.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.055+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=HB9AR64I3I6M type=del size=1569273 2024-09-12T00:07:16.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.057+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~8FFZM4S2Z40C.0 size=627377 2024-09-12T00:07:16.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.060+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=8FFZM4S2Z40C tag=6UH7TKCYG5US type=write size=1675953 2024-09-12T00:07:16.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.061+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=ID6Q5D38E60W type=del size=1270604 2024-09-12T00:07:16.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.063+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=8CGL4ABLMCZ1 type=del 2024-09-12T00:07:16.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.066+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~WROYIKSMA7YV.0 size=764777 2024-09-12T00:07:16.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.066+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=WROYIKSMA7YV tag=GMZNIM5N4R9Y type=write size=1813353 2024-09-12T00:07:16.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.067+0000 7f82f8930780 1 < canceled operation key=IN8Y7I0HKP6D tag=VVLHL8OCZHQM type=del size=1875819 2024-09-12T00:07:16.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.069+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=M4FLYDVW6EYK type=del size=3594694 2024-09-12T00:07:16.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.072+0000 7f82f8930780 1 < suggested update operation key=2XM2CF1T4VGW tag=EM0JNS6YR2IV type=del size=1986643 2024-09-12T00:07:16.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.074+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=92BWT3R8I9L4 type=del size=4058972 2024-09-12T00:07:16.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.075+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=EP7LDFUVNSGZ type=del 2024-09-12T00:07:16.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.078+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~GQKSQCD192G0.0 size=1048576 2024-09-12T00:07:16.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.079+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~GQKSQCD192G0.1 size=871670 2024-09-12T00:07:16.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.079+0000 7f82f8930780 1 > prepared multipart upload key=IN8Y7I0HKP6D upload=GQKSQCD192G0 tag=5RS159N2Z97F type=write size=2968822 2024-09-12T00:07:16.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.082+0000 7f82f8930780 1 < suggested update operation key=Y5U8MO9TOJQQ tag=WJXRZVXUIC70 type=del size=3047115 2024-09-12T00:07:16.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.083+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=ZTMOBSOF7UZK type=del size=940233 2024-09-12T00:07:16.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.088+0000 7f82f8930780 1 < suggested remove operation key=3H3D067Z8O0R tag=1FSAW1NF3PDS type=write 2024-09-12T00:07:16.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.090+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~11435KEGLAVH.0 size=954777 2024-09-12T00:07:16.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.090+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=11435KEGLAVH tag=5Q7VX9EJODC4 type=write size=2003353 2024-09-12T00:07:16.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.092+0000 7f82f8930780 1 < completed delete operation key=9576W9WYJUJV tag=QVJUL9ZNZTVO type=del 2024-09-12T00:07:16.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.093+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=QSP2359ESHJE type=del size=3846344 2024-09-12T00:07:16.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.094+0000 7f82f8930780 1 < completed write operation key=G55HN1VD6X47 tag=NKUMHFCW2ZD8 type=write size=612893 2024-09-12T00:07:16.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.095+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=WP2SUGU1NP0J type=del size=465514 2024-09-12T00:07:16.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.097+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~8P4A3CC7TB9F.0 size=839814 2024-09-12T00:07:16.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.099+0000 7f82f8930780 1 < completed multipart upload key=77SDZHCSP0E3 upload=8P4A3CC7TB9F tag=JMXX3MSO2NC4 type=write size=1888390 2024-09-12T00:07:16.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.102+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~DCML757EGDGL.0 size=231670 2024-09-12T00:07:16.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.102+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=DCML757EGDGL tag=D4UCGL8O3L5T type=write size=1280246 2024-09-12T00:07:16.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.104+0000 7f82f8930780 1 < canceled operation key=IMAT4ZCLGFRN tag=L934W0EXRUXE type=del size=3739358 2024-09-12T00:07:16.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.105+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~J1WRQDKK84RZ.0 size=1048576 2024-09-12T00:07:16.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.106+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~J1WRQDKK84RZ.1 size=940077 2024-09-12T00:07:16.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.106+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=J1WRQDKK84RZ tag=H7BYRXLY5TW9 type=write size=3037229 2024-09-12T00:07:16.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.108+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=GAB8FQ8PTO5L type=del 2024-09-12T00:07:16.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.110+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~O58YWERA4D1I.0 size=1048576 2024-09-12T00:07:16.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.111+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~O58YWERA4D1I.1 size=1048576 2024-09-12T00:07:16.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.112+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~O58YWERA4D1I.2 size=335703 2024-09-12T00:07:16.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.113+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=O58YWERA4D1I tag=6GVAXA7GCQTX type=write size=3481431 2024-09-12T00:07:16.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.114+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~GO3UMQCBTEBV.0 size=1048576 2024-09-12T00:07:16.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.115+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~GO3UMQCBTEBV.1 size=572547 2024-09-12T00:07:16.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.117+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=GO3UMQCBTEBV tag=F2TDPP37DOKK type=write size=2669699 2024-09-12T00:07:16.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.120+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~RCNCEKXQOQQB.0 size=1048576 2024-09-12T00:07:16.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.121+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~RCNCEKXQOQQB.1 size=94601 2024-09-12T00:07:16.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.121+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=RCNCEKXQOQQB tag=AB5UPBKZLK10 type=write size=2191753 2024-09-12T00:07:16.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.122+0000 7f82f8930780 1 < completed delete operation key=N2TYUAJITFNL tag=NSH3FL5S158Z type=del 2024-09-12T00:07:16.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.125+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~3D4EH97F6WRC.0 size=800509 2024-09-12T00:07:16.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.125+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=3D4EH97F6WRC tag=IOMOW0VRD3TR type=write size=1849085 2024-09-12T00:07:16.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.127+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~UZ4JT59TF07L.0 size=769607 2024-09-12T00:07:16.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.128+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=UZ4JT59TF07L tag=F6B5FHD3RCGB type=write size=1818183 2024-09-12T00:07:16.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.131+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~JYYWP5YAR5EZ.0 size=1048576 2024-09-12T00:07:16.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.132+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~JYYWP5YAR5EZ.1 size=1048576 2024-09-12T00:07:16.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.133+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~JYYWP5YAR5EZ.2 size=545754 2024-09-12T00:07:16.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.133+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=JYYWP5YAR5EZ tag=CG5NOK5LR98S type=write size=3691482 2024-09-12T00:07:16.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.135+0000 7f82f8930780 1 < suggested remove operation key=OVJOP07M9KB8 tag=HB9AR64I3I6M type=del 2024-09-12T00:07:16.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.138+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~LEJNYY3O9W41.0 size=1048576 2024-09-12T00:07:16.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.139+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~LEJNYY3O9W41.1 size=1048576 2024-09-12T00:07:16.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.140+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~LEJNYY3O9W41.2 size=726785 2024-09-12T00:07:16.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.140+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=LEJNYY3O9W41 tag=9NR88D69RXNH type=write size=3872513 2024-09-12T00:07:16.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.142+0000 7f82f8930780 1 < suggested remove operation key=NCIZ4HNPCZ94 tag=ID6Q5D38E60W type=del 2024-09-12T00:07:16.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.143+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=KTGW4HUSR713 type=del size=942503 2024-09-12T00:07:16.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.145+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~WROYIKSMA7YV.0 size=764777 2024-09-12T00:07:16.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.147+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=WROYIKSMA7YV tag=GMZNIM5N4R9Y type=write size=1813353 2024-09-12T00:07:16.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.148+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=U588NZ0KOOLL type=write size=846795 2024-09-12T00:07:16.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.150+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=M4FLYDVW6EYK type=del 2024-09-12T00:07:16.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.151+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=GETG1AIOFQKZ type=del size=2012853 2024-09-12T00:07:16.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.153+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=92BWT3R8I9L4 type=del 2024-09-12T00:07:16.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.154+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=AOR05RD3DSH3 type=del size=1878206 2024-09-12T00:07:16.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.155+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~GQKSQCD192G0.0 size=1048576 2024-09-12T00:07:16.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.156+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~GQKSQCD192G0.1 size=871670 2024-09-12T00:07:16.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.159+0000 7f82f8930780 1 < completed multipart upload key=IN8Y7I0HKP6D upload=GQKSQCD192G0 tag=5RS159N2Z97F type=write size=2968822 2024-09-12T00:07:16.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.160+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=N7D8IRQIBCCV type=del size=419393 2024-09-12T00:07:16.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.161+0000 7f82f8930780 -1 < no bi entry to suggest for operation key=3H3D067Z8O0R tag=ZTMOBSOF7UZK type=del size=940233: (2) No such file or directory 2024-09-12T00:07:16.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.162+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=0WJOIKBTLWCZ type=write size=428282 2024-09-12T00:07:16.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.163+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~11435KEGLAVH.0 size=954777 2024-09-12T00:07:16.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.165+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=11435KEGLAVH tag=5Q7VX9EJODC4 type=write size=2003353 2024-09-12T00:07:16.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.167+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=64NBPS23PJLU type=del size=731698 2024-09-12T00:07:16.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.169+0000 7f82f8930780 1 < suggested remove operation key=W8SAQZWQHY36 tag=QSP2359ESHJE type=del 2024-09-12T00:07:16.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.172+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~WNWKZ03YLCYW.0 size=192930 2024-09-12T00:07:16.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.172+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=WNWKZ03YLCYW tag=G5BROQB1CI5Z type=write size=1241506 2024-09-12T00:07:16.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.175+0000 7f82f8930780 1 < suggested update operation key=9576W9WYJUJV tag=WP2SUGU1NP0J type=del size=465514 2024-09-12T00:07:16.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.178+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~QFJVQPPHN0TM.0 size=1048576 2024-09-12T00:07:16.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.178+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~QFJVQPPHN0TM.1 size=1048576 2024-09-12T00:07:16.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.180+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~QFJVQPPHN0TM.2 size=408253 2024-09-12T00:07:16.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.180+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=QFJVQPPHN0TM tag=GXI72T9GBDM4 type=write size=3553981 2024-09-12T00:07:16.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.181+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~DCML757EGDGL.0 size=231670 2024-09-12T00:07:16.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.183+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=DCML757EGDGL tag=D4UCGL8O3L5T type=write size=1280246 2024-09-12T00:07:16.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.186+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~HVUW3H4X507N.0 size=1048576 2024-09-12T00:07:16.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.187+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~HVUW3H4X507N.1 size=919463 2024-09-12T00:07:16.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.187+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=HVUW3H4X507N tag=WPRENL5ZP8SZ type=write size=3016615 2024-09-12T00:07:16.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.188+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~J1WRQDKK84RZ.0 size=1048576 2024-09-12T00:07:16.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.189+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~J1WRQDKK84RZ.1 size=940077 2024-09-12T00:07:16.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.192+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=J1WRQDKK84RZ tag=H7BYRXLY5TW9 type=write size=3037229 2024-09-12T00:07:16.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.195+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~M0YM0LOXTSJZ.0 size=1048576 2024-09-12T00:07:16.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.195+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~M0YM0LOXTSJZ.1 size=1048576 2024-09-12T00:07:16.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.196+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~M0YM0LOXTSJZ.2 size=699436 2024-09-12T00:07:16.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.197+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=M0YM0LOXTSJZ tag=ZLB6DU1AZPHR type=write size=3845164 2024-09-12T00:07:16.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.198+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~O58YWERA4D1I.0 size=1048576 2024-09-12T00:07:16.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.199+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~O58YWERA4D1I.1 size=1048576 2024-09-12T00:07:16.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.200+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~O58YWERA4D1I.2 size=335703 2024-09-12T00:07:16.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.203+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=O58YWERA4D1I tag=6GVAXA7GCQTX type=write size=3481431 2024-09-12T00:07:16.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.204+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=OVJFZ0UO0IGN type=del size=2864688 2024-09-12T00:07:16.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.205+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~RCNCEKXQOQQB.0 size=1048576 2024-09-12T00:07:16.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.206+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~RCNCEKXQOQQB.1 size=94601 2024-09-12T00:07:16.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.209+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=RCNCEKXQOQQB tag=AB5UPBKZLK10 type=write size=2191753 2024-09-12T00:07:16.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.212+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~LOZDKUG3VX76.0 size=676987 2024-09-12T00:07:16.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.212+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=LOZDKUG3VX76 tag=GU4CZMNOM8B2 type=write size=1725563 2024-09-12T00:07:16.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.213+0000 7f82f8930780 1 < canceled part key=_multipart_HCK59C6MAW0B.2~3D4EH97F6WRC.0 size=800509 2024-09-12T00:07:16.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.215+0000 7f82f8930780 1 < canceled multipart upload key=HCK59C6MAW0B upload=3D4EH97F6WRC tag=IOMOW0VRD3TR type=write size=1849085 2024-09-12T00:07:16.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.218+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=VLS02SWI4V61 type=del size=3489640 2024-09-12T00:07:16.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.218+0000 7f82f8930780 1 < canceled part key=_multipart_80OUXNDPLGAG.2~JYYWP5YAR5EZ.0 size=1048576 2024-09-12T00:07:16.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.218+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~JYYWP5YAR5EZ.1 size=1048576 2024-09-12T00:07:16.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.220+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~JYYWP5YAR5EZ.2 size=545754 2024-09-12T00:07:16.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.222+0000 7f82f8930780 1 < canceled multipart upload key=80OUXNDPLGAG upload=JYYWP5YAR5EZ tag=CG5NOK5LR98S type=write size=3691482 2024-09-12T00:07:16.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.223+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=1OU55Y7DOAXM type=del size=4167096 2024-09-12T00:07:16.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.226+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~LEJNYY3O9W41.0 size=1048576 2024-09-12T00:07:16.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.226+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~LEJNYY3O9W41.1 size=1048576 2024-09-12T00:07:16.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.227+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~LEJNYY3O9W41.2 size=726785 2024-09-12T00:07:16.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.230+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=LEJNYY3O9W41 tag=9NR88D69RXNH type=write size=3872513 2024-09-12T00:07:16.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.231+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=UHCNP8825PSQ type=del size=509870 2024-09-12T00:07:16.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.235+0000 7f82f8930780 1 < suggested update operation key=4SPRDO097JYQ tag=KTGW4HUSR713 type=del size=942503 2024-09-12T00:07:16.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.236+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~0LC7MWGM90IT.0 size=433278 2024-09-12T00:07:16.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.236+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=0LC7MWGM90IT tag=92UBROGZWNTD type=write size=1481854 2024-09-12T00:07:16.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.238+0000 7f82f8930780 1 < completed write operation key=BJHGNT3HBS25 tag=U588NZ0KOOLL type=write size=846795 2024-09-12T00:07:16.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.241+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~GE5EULUTT1XY.0 size=577976 2024-09-12T00:07:16.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.241+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=GE5EULUTT1XY tag=T1GLOGQ8VXKP type=write size=1626552 2024-09-12T00:07:16.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.242+0000 7f82f8930780 1 < canceled operation key=3X2PLA3ODHJ1 tag=GETG1AIOFQKZ type=del size=2012853 2024-09-12T00:07:16.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.243+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=DO4YNLTY6SSK type=del size=3252956 2024-09-12T00:07:16.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.245+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=AOR05RD3DSH3 type=del 2024-09-12T00:07:16.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.247+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~W55BMZELV0O0.0 size=1048576 2024-09-12T00:07:16.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.248+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~W55BMZELV0O0.1 size=1048576 2024-09-12T00:07:16.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.249+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~W55BMZELV0O0.2 size=104779 2024-09-12T00:07:16.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.249+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=W55BMZELV0O0 tag=4DJFM6NGNHPO type=write size=3250507 2024-09-12T00:07:16.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.251+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=N7D8IRQIBCCV type=del 2024-09-12T00:07:16.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.252+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=DD2CJQOX8R29 type=del size=1667015 2024-09-12T00:07:16.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.254+0000 7f82f8930780 1 < completed write operation key=3H3D067Z8O0R tag=0WJOIKBTLWCZ type=write size=428282 2024-09-12T00:07:16.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.256+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~ISJCOW8FFDHN.0 size=1048576 2024-09-12T00:07:16.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.257+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~ISJCOW8FFDHN.1 size=911125 2024-09-12T00:07:16.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.257+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=ISJCOW8FFDHN tag=20I36LU2ZVBI type=write size=3008277 2024-09-12T00:07:16.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.258+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=64NBPS23PJLU type=del 2024-09-12T00:07:16.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.260+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=6AR3B2A36LS0 type=del size=3957392 2024-09-12T00:07:16.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.261+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~WNWKZ03YLCYW.0 size=192930 2024-09-12T00:07:16.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.264+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=WNWKZ03YLCYW tag=G5BROQB1CI5Z type=write size=1241506 2024-09-12T00:07:16.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.265+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=8Q0ZG30X4369 type=del size=1668911 2024-09-12T00:07:16.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.266+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~QFJVQPPHN0TM.0 size=1048576 2024-09-12T00:07:16.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.267+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~QFJVQPPHN0TM.1 size=1048576 2024-09-12T00:07:16.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.267+0000 7f82f8930780 1 < canceled part key=_multipart_N2TYUAJITFNL.2~QFJVQPPHN0TM.2 size=408253 2024-09-12T00:07:16.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.269+0000 7f82f8930780 1 < canceled multipart upload key=N2TYUAJITFNL upload=QFJVQPPHN0TM tag=GXI72T9GBDM4 type=write size=3553981 2024-09-12T00:07:16.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.272+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~0YYC19DK09NP.0 size=881396 2024-09-12T00:07:16.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.272+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=0YYC19DK09NP tag=M4J15SLMOX9S type=write size=1929972 2024-09-12T00:07:16.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.273+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~HVUW3H4X507N.0 size=1048576 2024-09-12T00:07:16.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.275+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~HVUW3H4X507N.1 size=919463 2024-09-12T00:07:16.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.276+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=HVUW3H4X507N tag=WPRENL5ZP8SZ type=write size=3016615 2024-09-12T00:07:16.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.279+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~8U0EACFZI8P5.0 size=163853 2024-09-12T00:07:16.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.279+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=8U0EACFZI8P5 tag=IICCCED6381L type=write size=1212429 2024-09-12T00:07:16.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.281+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~M0YM0LOXTSJZ.0 size=1048576 2024-09-12T00:07:16.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.282+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~M0YM0LOXTSJZ.1 size=1048576 2024-09-12T00:07:16.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.282+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~M0YM0LOXTSJZ.2 size=699436 2024-09-12T00:07:16.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.285+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=M0YM0LOXTSJZ tag=ZLB6DU1AZPHR type=write size=3845164 2024-09-12T00:07:16.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.287+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=1AX6DZR6AJTN type=del size=1349945 2024-09-12T00:07:16.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.288+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=OVJFZ0UO0IGN type=del 2024-09-12T00:07:16.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.289+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=HONF6FZYBSQO type=del size=3044014 2024-09-12T00:07:16.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.291+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~LOZDKUG3VX76.0 size=676987 2024-09-12T00:07:16.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.294+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=LOZDKUG3VX76 tag=GU4CZMNOM8B2 type=write size=1725563 2024-09-12T00:07:16.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.295+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=W8ATDTPA4BIS type=del size=3927820 2024-09-12T00:07:16.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.297+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=VLS02SWI4V61 type=del 2024-09-12T00:07:16.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.298+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~V7PD97SKW8M3.0 size=1048576 2024-09-12T00:07:16.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.300+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~V7PD97SKW8M3.1 size=1048576 2024-09-12T00:07:16.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.301+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~V7PD97SKW8M3.2 size=225159 2024-09-12T00:07:16.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.301+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=V7PD97SKW8M3 tag=X9CDS191QIBZ type=write size=3370887 2024-09-12T00:07:16.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.303+0000 7f82f8930780 1 < suggested update operation key=W8SAQZWQHY36 tag=1OU55Y7DOAXM type=del size=4167096 2024-09-12T00:07:16.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.305+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=2WONBIJ2J761 type=del size=3078448 2024-09-12T00:07:16.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.306+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=UHCNP8825PSQ type=del 2024-09-12T00:07:16.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.307+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=B9NUBL86Z9AS type=write size=64310 2024-09-12T00:07:16.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.309+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~0LC7MWGM90IT.0 size=433278 2024-09-12T00:07:16.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.312+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=0LC7MWGM90IT tag=92UBROGZWNTD type=write size=1481854 2024-09-12T00:07:16.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.313+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=0ZZWU7WJMJGF type=del size=3967983 2024-09-12T00:07:16.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.313+0000 7f82f8930780 1 < canceled part key=_multipart_YWC5JUV5B2N6.2~GE5EULUTT1XY.0 size=577976 2024-09-12T00:07:16.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.315+0000 7f82f8930780 1 < canceled multipart upload key=YWC5JUV5B2N6 upload=GE5EULUTT1XY tag=T1GLOGQ8VXKP type=write size=1626552 2024-09-12T00:07:16.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.316+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=32PWL60E0DJ0 type=del size=2498663 2024-09-12T00:07:16.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.317+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=DO4YNLTY6SSK type=del 2024-09-12T00:07:16.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.319+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=7VYH3MD4K2KY type=del size=1808519 2024-09-12T00:07:16.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.320+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~W55BMZELV0O0.0 size=1048576 2024-09-12T00:07:16.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.321+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~W55BMZELV0O0.1 size=1048576 2024-09-12T00:07:16.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.322+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~W55BMZELV0O0.2 size=104779 2024-09-12T00:07:16.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.325+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=W55BMZELV0O0 tag=4DJFM6NGNHPO type=write size=3250507 2024-09-12T00:07:16.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.326+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=SYKJDE8BK6J2 type=del size=954531 2024-09-12T00:07:16.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.328+0000 7f82f8930780 1 < completed delete operation key=HCK59C6MAW0B tag=DD2CJQOX8R29 type=del 2024-09-12T00:07:16.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.329+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=35EN5JCXKGDG type=del size=2577465 2024-09-12T00:07:16.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.330+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~ISJCOW8FFDHN.0 size=1048576 2024-09-12T00:07:16.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.331+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~ISJCOW8FFDHN.1 size=911125 2024-09-12T00:07:16.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.334+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=ISJCOW8FFDHN tag=20I36LU2ZVBI type=write size=3008277 2024-09-12T00:07:16.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.336+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~OM08XX97Z3RN.0 size=403580 2024-09-12T00:07:16.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.336+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=OM08XX97Z3RN tag=DYMWH4MLN1J7 type=write size=1452156 2024-09-12T00:07:16.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.338+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=6AR3B2A36LS0 type=del 2024-09-12T00:07:16.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.339+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=A3KUQ82RIVUY type=del size=1896282 2024-09-12T00:07:16.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.341+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=8Q0ZG30X4369 type=del 2024-09-12T00:07:16.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.342+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=B443R7M7HI3D type=del size=3372410 2024-09-12T00:07:16.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.343+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~0YYC19DK09NP.0 size=881396 2024-09-12T00:07:16.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.345+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=0YYC19DK09NP tag=M4J15SLMOX9S type=write size=1929972 2024-09-12T00:07:16.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.348+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~3YJXWSOLDGEA.0 size=1048576 2024-09-12T00:07:16.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.349+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~3YJXWSOLDGEA.1 size=1048576 2024-09-12T00:07:16.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.351+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~3YJXWSOLDGEA.2 size=621293 2024-09-12T00:07:16.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.351+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=3YJXWSOLDGEA tag=17PBIMZWW43P type=write size=3767021 2024-09-12T00:07:16.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.352+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~8U0EACFZI8P5.0 size=163853 2024-09-12T00:07:16.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.354+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=8U0EACFZI8P5 tag=IICCCED6381L type=write size=1212429 2024-09-12T00:07:16.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.357+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~8V46TCKT8C4K.0 size=1048576 2024-09-12T00:07:16.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.358+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~8V46TCKT8C4K.1 size=25627 2024-09-12T00:07:16.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.358+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=8V46TCKT8C4K tag=L3482JMMOZPT type=write size=2122779 2024-09-12T00:07:16.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.359+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=1AX6DZR6AJTN type=del 2024-09-12T00:07:16.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.362+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~RIHHN6QZDTBI.0 size=1048576 2024-09-12T00:07:16.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.363+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~RIHHN6QZDTBI.1 size=383602 2024-09-12T00:07:16.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.363+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=RIHHN6QZDTBI tag=XAD3IXFBJVD1 type=write size=2480754 2024-09-12T00:07:16.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.367+0000 7f82f8930780 1 < suggested remove operation key=Y5U8MO9TOJQQ tag=HONF6FZYBSQO type=del 2024-09-12T00:07:16.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.367+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=N35EGPQ8VARP type=del size=4028511 2024-09-12T00:07:16.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.371+0000 7f82f8930780 1 < suggested update operation key=NCIZ4HNPCZ94 tag=W8ATDTPA4BIS type=del size=3927820 2024-09-12T00:07:16.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.372+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=F1RB172IA6JQ type=del size=2409085 2024-09-12T00:07:16.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.373+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~V7PD97SKW8M3.0 size=1048576 2024-09-12T00:07:16.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.374+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~V7PD97SKW8M3.1 size=1048576 2024-09-12T00:07:16.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.376+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~V7PD97SKW8M3.2 size=225159 2024-09-12T00:07:16.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.378+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=V7PD97SKW8M3 tag=X9CDS191QIBZ type=write size=3370887 2024-09-12T00:07:16.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.379+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=Y64CFMV4X4MV type=write size=780944 2024-09-12T00:07:16.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.382+0000 7f82f8930780 1 < suggested remove operation key=9576W9WYJUJV tag=2WONBIJ2J761 type=del 2024-09-12T00:07:16.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.384+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=Q0BNLBSVER3W type=del size=2523884 2024-09-12T00:07:16.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.385+0000 7f82f8930780 1 < completed write operation key=HCK59C6MAW0B tag=B9NUBL86Z9AS type=write size=64310 2024-09-12T00:07:16.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.386+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=IK3P68P0WJ72 type=write size=278758 2024-09-12T00:07:16.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.387+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=0ZZWU7WJMJGF type=del 2024-09-12T00:07:16.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.389+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=92LQYC41OC0Y type=del size=2766439 2024-09-12T00:07:16.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.390+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=32PWL60E0DJ0 type=del 2024-09-12T00:07:16.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.393+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~ODXSASY6V5ON.0 size=64924 2024-09-12T00:07:16.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.393+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=ODXSASY6V5ON tag=J1IM825RFUNK type=write size=1113500 2024-09-12T00:07:16.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.395+0000 7f82f8930780 1 < suggested update operation key=OVJOP07M9KB8 tag=7VYH3MD4K2KY type=del size=1808519 2024-09-12T00:07:16.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.397+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=L2IKPCHZOQZW type=write size=399146 2024-09-12T00:07:16.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.399+0000 7f82f8930780 1 < suggested remove operation key=4IA4918NXXJW tag=SYKJDE8BK6J2 type=del 2024-09-12T00:07:16.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.402+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~HBUP4DOKZZ82.0 size=1048576 2024-09-12T00:07:16.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.403+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~HBUP4DOKZZ82.1 size=1003134 2024-09-12T00:07:16.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.403+0000 7f82f8930780 1 > prepared multipart upload key=77SDZHCSP0E3 upload=HBUP4DOKZZ82 tag=97GBM93B2W3Q type=write size=3100286 2024-09-12T00:07:16.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.404+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=35EN5JCXKGDG type=del 2024-09-12T00:07:16.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.407+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~MDL12MCZQ41G.0 size=1048576 2024-09-12T00:07:16.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.408+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~MDL12MCZQ41G.1 size=922736 2024-09-12T00:07:16.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.408+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=MDL12MCZQ41G tag=50NU1QSVHGPF type=write size=3019888 2024-09-12T00:07:16.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.410+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~OM08XX97Z3RN.0 size=403580 2024-09-12T00:07:16.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.412+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=OM08XX97Z3RN tag=DYMWH4MLN1J7 type=write size=1452156 2024-09-12T00:07:16.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.413+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=1JOEZ4449C1G type=del size=1553750 2024-09-12T00:07:16.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.415+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=A3KUQ82RIVUY type=del 2024-09-12T00:07:16.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.418+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~OTQNK1WSFYW9.0 size=1048576 2024-09-12T00:07:16.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.419+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~OTQNK1WSFYW9.1 size=1048576 2024-09-12T00:07:16.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.420+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~OTQNK1WSFYW9.2 size=757769 2024-09-12T00:07:16.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.420+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=OTQNK1WSFYW9 tag=7P9GMKFZT70F type=write size=3903497 2024-09-12T00:07:16.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.423+0000 7f82f8930780 1 < suggested update operation key=A8EFUP30RS65 tag=B443R7M7HI3D type=del size=3372410 2024-09-12T00:07:16.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.424+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=H1GI66SKQR8Z type=write size=771790 2024-09-12T00:07:16.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.426+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~3YJXWSOLDGEA.0 size=1048576 2024-09-12T00:07:16.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.428+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~3YJXWSOLDGEA.1 size=1048576 2024-09-12T00:07:16.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.429+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~3YJXWSOLDGEA.2 size=621293 2024-09-12T00:07:16.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.430+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=3YJXWSOLDGEA tag=17PBIMZWW43P type=write size=3767021 2024-09-12T00:07:16.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.432+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=2P76N1XIUW0R type=del size=1043346 2024-09-12T00:07:16.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.433+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~8V46TCKT8C4K.0 size=1048576 2024-09-12T00:07:16.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.433+0000 7f82f8930780 1 < canceled part key=_multipart_OVJOP07M9KB8.2~8V46TCKT8C4K.1 size=25627 2024-09-12T00:07:16.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.436+0000 7f82f8930780 1 < canceled multipart upload key=OVJOP07M9KB8 upload=8V46TCKT8C4K tag=L3482JMMOZPT type=write size=2122779 2024-09-12T00:07:16.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.437+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=A66SHQHYAUHI type=del size=1162605 2024-09-12T00:07:16.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.439+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~RIHHN6QZDTBI.0 size=1048576 2024-09-12T00:07:16.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.440+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~RIHHN6QZDTBI.1 size=383602 2024-09-12T00:07:16.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.442+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=RIHHN6QZDTBI tag=XAD3IXFBJVD1 type=write size=2480754 2024-09-12T00:07:16.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.444+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=4XNC3URX42MY type=write size=179996 2024-09-12T00:07:16.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.445+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=N35EGPQ8VARP type=del 2024-09-12T00:07:16.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.447+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=G7J3H9VAZYFT type=del size=1543727 2024-09-12T00:07:16.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.449+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=F1RB172IA6JQ type=del 2024-09-12T00:07:16.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.451+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~K0EPY4YYCUNV.0 size=1048576 2024-09-12T00:07:16.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.452+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~K0EPY4YYCUNV.1 size=707979 2024-09-12T00:07:16.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.452+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=K0EPY4YYCUNV tag=MW5RAXCWJMPI type=write size=2805131 2024-09-12T00:07:16.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.453+0000 7f82f8930780 1 < completed write operation key=MJZ56OX8PLSH tag=Y64CFMV4X4MV type=write size=780944 2024-09-12T00:07:16.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.455+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=2H53D5O94Y53 type=write size=9580 2024-09-12T00:07:16.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.457+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=Q0BNLBSVER3W type=del 2024-09-12T00:07:16.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.458+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=YS3AB9O4VT0S type=del size=2899528 2024-09-12T00:07:16.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.459+0000 7f82f8930780 1 < canceled operation key=HCK59C6MAW0B tag=IK3P68P0WJ72 type=write size=278758 2024-09-12T00:07:16.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.463+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~E8FEL7SNXQBG.0 size=1048576 2024-09-12T00:07:16.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.463+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~E8FEL7SNXQBG.1 size=1048576 2024-09-12T00:07:16.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.464+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~E8FEL7SNXQBG.2 size=54102 2024-09-12T00:07:16.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.464+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=E8FEL7SNXQBG tag=VXLWMC0D8E09 type=write size=3199830 2024-09-12T00:07:16.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.466+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=92LQYC41OC0Y type=del 2024-09-12T00:07:16.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.467+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=XAIOSM4QZUIX type=del size=3795329 2024-09-12T00:07:16.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.469+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~ODXSASY6V5ON.0 size=64924 2024-09-12T00:07:16.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.472+0000 7f82f8930780 1 < completed multipart upload key=W8SAQZWQHY36 upload=ODXSASY6V5ON tag=J1IM825RFUNK type=write size=1113500 2024-09-12T00:07:16.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.475+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~JD3CYPF050SR.0 size=1048576 2024-09-12T00:07:16.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.475+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~JD3CYPF050SR.1 size=1048576 2024-09-12T00:07:16.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.477+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~JD3CYPF050SR.2 size=1036310 2024-09-12T00:07:16.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.477+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=JD3CYPF050SR tag=GMZO235VUZ33 type=write size=4182038 2024-09-12T00:07:16.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.479+0000 7f82f8930780 1 < suggested update operation key=9576W9WYJUJV tag=L2IKPCHZOQZW type=write size=399146 2024-09-12T00:07:16.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.481+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=VIOUG34625L5 type=del size=3643157 2024-09-12T00:07:16.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.482+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~HBUP4DOKZZ82.0 size=1048576 2024-09-12T00:07:16.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.483+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~HBUP4DOKZZ82.1 size=1003134 2024-09-12T00:07:16.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.486+0000 7f82f8930780 1 < completed multipart upload key=77SDZHCSP0E3 upload=HBUP4DOKZZ82 tag=97GBM93B2W3Q type=write size=3100286 2024-09-12T00:07:16.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.487+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=U8OTQ81G6NX9 type=del size=1009725 2024-09-12T00:07:16.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.488+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~MDL12MCZQ41G.0 size=1048576 2024-09-12T00:07:16.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.488+0000 7f82f8930780 1 < canceled part key=_multipart_N2TYUAJITFNL.2~MDL12MCZQ41G.1 size=922736 2024-09-12T00:07:16.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.492+0000 7f82f8930780 1 < canceled multipart upload key=N2TYUAJITFNL upload=MDL12MCZQ41G tag=50NU1QSVHGPF type=write size=3019888 2024-09-12T00:07:16.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.492+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=GUBDX2A7204N type=del size=4128790 2024-09-12T00:07:16.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.495+0000 7f82f8930780 1 < suggested update operation key=2XM2CF1T4VGW tag=1JOEZ4449C1G type=del size=1553750 2024-09-12T00:07:16.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.496+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=UYB0T13CGCM4 type=del size=2763077 2024-09-12T00:07:16.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.499+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~OTQNK1WSFYW9.0 size=1048576 2024-09-12T00:07:16.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.499+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~OTQNK1WSFYW9.1 size=1048576 2024-09-12T00:07:16.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.500+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~OTQNK1WSFYW9.2 size=757769 2024-09-12T00:07:16.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.502+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=OTQNK1WSFYW9 tag=7P9GMKFZT70F type=write size=3903497 2024-09-12T00:07:16.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.504+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=3JJA1M9D5ZAD type=del size=3361933 2024-09-12T00:07:16.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.507+0000 7f82f8930780 1 < suggested remove operation key=HCK59C6MAW0B tag=H1GI66SKQR8Z type=write 2024-09-12T00:07:16.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.508+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=XONFH3W71HE5 type=del size=4083487 2024-09-12T00:07:16.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.509+0000 7f82f8930780 -1 < failed to complete operation key=2XM2CF1T4VGW tag=2P76N1XIUW0R type=del size=1043346: (22) Invalid argument 2024-09-12T00:07:16.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.511+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=IZRXJP09TUF3 type=write size=630413 2024-09-12T00:07:16.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.514+0000 7f82f8930780 1 < suggested update operation key=W8SAQZWQHY36 tag=A66SHQHYAUHI type=del size=1162605 2024-09-12T00:07:16.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.515+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=M5Q7WQ7X2AA7 type=del size=1912170 2024-09-12T00:07:16.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.518+0000 7f82f8930780 1 < suggested remove operation key=BJHGNT3HBS25 tag=4XNC3URX42MY type=write 2024-09-12T00:07:16.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.521+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~P283SG1YYPK0.0 size=1048576 2024-09-12T00:07:16.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.522+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~P283SG1YYPK0.1 size=1048576 2024-09-12T00:07:16.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.523+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~P283SG1YYPK0.2 size=508294 2024-09-12T00:07:16.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.523+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=P283SG1YYPK0 tag=Y5D1759KTLBT type=write size=3654022 2024-09-12T00:07:16.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.524+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=G7J3H9VAZYFT type=del 2024-09-12T00:07:16.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.527+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~EEU1DY94CNBA.0 size=1048576 2024-09-12T00:07:16.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.528+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~EEU1DY94CNBA.1 size=1048576 2024-09-12T00:07:16.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.529+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~EEU1DY94CNBA.2 size=200641 2024-09-12T00:07:16.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.529+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=EEU1DY94CNBA tag=4HVN7USNOWE6 type=write size=3346369 2024-09-12T00:07:16.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.529+0000 7f82f8930780 1 < canceled part key=_multipart_Y5U8MO9TOJQQ.2~K0EPY4YYCUNV.0 size=1048576 2024-09-12T00:07:16.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.530+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~K0EPY4YYCUNV.1 size=707979 2024-09-12T00:07:16.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.532+0000 7f82f8930780 1 < canceled multipart upload key=Y5U8MO9TOJQQ upload=K0EPY4YYCUNV tag=MW5RAXCWJMPI type=write size=2805131 2024-09-12T00:07:16.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.534+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=W71X6OYM3UKL type=del size=2178331 2024-09-12T00:07:16.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.535+0000 7f82f8930780 1 < completed write operation key=G55HN1VD6X47 tag=2H53D5O94Y53 type=write size=9580 2024-09-12T00:07:16.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.538+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~F74R77EI0RZJ.0 size=1048576 2024-09-12T00:07:16.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.539+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~F74R77EI0RZJ.1 size=1048576 2024-09-12T00:07:16.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.540+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~F74R77EI0RZJ.2 size=416596 2024-09-12T00:07:16.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.540+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=F74R77EI0RZJ tag=DSSERABX2X60 type=write size=3562324 2024-09-12T00:07:16.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.542+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=YS3AB9O4VT0S type=del 2024-09-12T00:07:16.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.543+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=32RZQN70YAWC type=del size=2107888 2024-09-12T00:07:16.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.544+0000 7f82f8930780 1 < canceled part key=_multipart_AMWMQXO10EXK.2~E8FEL7SNXQBG.0 size=1048576 2024-09-12T00:07:16.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.544+0000 7f82f8930780 1 < canceled part key=_multipart_AMWMQXO10EXK.2~E8FEL7SNXQBG.1 size=1048576 2024-09-12T00:07:16.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.545+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~E8FEL7SNXQBG.2 size=54102 2024-09-12T00:07:16.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.547+0000 7f82f8930780 1 < canceled multipart upload key=AMWMQXO10EXK upload=E8FEL7SNXQBG tag=VXLWMC0D8E09 type=write size=3199830 2024-09-12T00:07:16.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.548+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=9B3FD3VWYSP2 type=del size=2873517 2024-09-12T00:07:16.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.549+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=XAIOSM4QZUIX type=del 2024-09-12T00:07:16.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.553+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~7ZM1NIBBP60C.0 size=1048576 2024-09-12T00:07:16.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.554+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~7ZM1NIBBP60C.1 size=835698 2024-09-12T00:07:16.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.554+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=7ZM1NIBBP60C tag=HUJBY49A33RB type=write size=2932850 2024-09-12T00:07:16.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.555+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~JD3CYPF050SR.0 size=1048576 2024-09-12T00:07:16.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.555+0000 7f82f8930780 1 < canceled part key=_multipart_3X2PLA3ODHJ1.2~JD3CYPF050SR.1 size=1048576 2024-09-12T00:07:16.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.556+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~JD3CYPF050SR.2 size=1036310 2024-09-12T00:07:16.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.559+0000 7f82f8930780 1 < canceled multipart upload key=3X2PLA3ODHJ1 upload=JD3CYPF050SR tag=GMZO235VUZ33 type=write size=4182038 2024-09-12T00:07:16.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.560+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=J7GTBZ43JLQE type=write size=717578 2024-09-12T00:07:16.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.561+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=VIOUG34625L5 type=del 2024-09-12T00:07:16.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.564+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~V46PXDBMXF8V.0 size=1048576 2024-09-12T00:07:16.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.565+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~V46PXDBMXF8V.1 size=1048576 2024-09-12T00:07:16.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.566+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~V46PXDBMXF8V.2 size=66072 2024-09-12T00:07:16.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.566+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=V46PXDBMXF8V tag=0DS0SI1W3ACE type=write size=3211800 2024-09-12T00:07:16.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.568+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=U8OTQ81G6NX9 type=del 2024-09-12T00:07:16.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.570+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=FT2DBMX7Q2BO type=del size=192193 2024-09-12T00:07:16.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.571+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=GUBDX2A7204N type=del 2024-09-12T00:07:16.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.573+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~44YBO9FJ0FP2.0 size=1048576 2024-09-12T00:07:16.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.574+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~44YBO9FJ0FP2.1 size=297364 2024-09-12T00:07:16.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.574+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=44YBO9FJ0FP2 tag=YNO7E1SFIKF1 type=write size=2394516 2024-09-12T00:07:16.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.577+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=UYB0T13CGCM4 type=del 2024-09-12T00:07:16.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.579+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~KJM2W7I1MG55.0 size=1048576 2024-09-12T00:07:16.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.580+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~KJM2W7I1MG55.1 size=1048576 2024-09-12T00:07:16.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.581+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~KJM2W7I1MG55.2 size=829548 2024-09-12T00:07:16.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.581+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=KJM2W7I1MG55 tag=KPUPBFXPZB90 type=write size=3975276 2024-09-12T00:07:16.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.584+0000 7f82f8930780 1 < suggested remove operation key=9576W9WYJUJV tag=3JJA1M9D5ZAD type=del 2024-09-12T00:07:16.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.586+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~2JEH0YO4AT7E.0 size=1048576 2024-09-12T00:07:16.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.587+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~2JEH0YO4AT7E.1 size=1048576 2024-09-12T00:07:16.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.588+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~2JEH0YO4AT7E.2 size=251206 2024-09-12T00:07:16.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.588+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=2JEH0YO4AT7E tag=WYK8UIYSXJL6 type=write size=3396934 2024-09-12T00:07:16.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.592+0000 7f82f8930780 1 < suggested remove operation key=N2TYUAJITFNL tag=XONFH3W71HE5 type=del 2024-09-12T00:07:16.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.593+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=T657Q51HV2JT type=write size=964016 2024-09-12T00:07:16.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.594+0000 7f82f8930780 1 < completed write operation key=A8EFUP30RS65 tag=IZRXJP09TUF3 type=write size=630413 2024-09-12T00:07:16.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.597+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~7X7UY0VFEE4G.0 size=295748 2024-09-12T00:07:16.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.597+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=7X7UY0VFEE4G tag=AB33RSPGTU7P type=write size=1344324 2024-09-12T00:07:16.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.598+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=M5Q7WQ7X2AA7 type=del 2024-09-12T00:07:16.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.600+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=219TDSKI7VN7 type=del size=1497371 2024-09-12T00:07:16.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.602+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~P283SG1YYPK0.0 size=1048576 2024-09-12T00:07:16.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.602+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~P283SG1YYPK0.1 size=1048576 2024-09-12T00:07:16.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.605+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~P283SG1YYPK0.2 size=508294 2024-09-12T00:07:16.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.607+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=P283SG1YYPK0 tag=Y5D1759KTLBT type=write size=3654022 2024-09-12T00:07:16.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.610+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~NRF1QTAZ4PU8.0 size=845369 2024-09-12T00:07:16.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.610+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=NRF1QTAZ4PU8 tag=YRXEQQXWGKNA type=write size=1893945 2024-09-12T00:07:16.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.611+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~EEU1DY94CNBA.0 size=1048576 2024-09-12T00:07:16.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.613+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~EEU1DY94CNBA.1 size=1048576 2024-09-12T00:07:16.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.613+0000 7f82f8930780 1 < canceled part key=_multipart_OVJOP07M9KB8.2~EEU1DY94CNBA.2 size=200641 2024-09-12T00:07:16.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.616+0000 7f82f8930780 1 < canceled multipart upload key=OVJOP07M9KB8 upload=EEU1DY94CNBA tag=4HVN7USNOWE6 type=write size=3346369 2024-09-12T00:07:16.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.617+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=ASBEUW47311K type=del size=3603244 2024-09-12T00:07:16.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.618+0000 7f82f8930780 1 < completed delete operation key=FOWSB9RQ5TV5 tag=W71X6OYM3UKL type=del 2024-09-12T00:07:16.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.620+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=L75YNXHV67ED type=del size=3294106 2024-09-12T00:07:16.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.620+0000 7f82f8930780 1 < canceled part key=_multipart_2XM2CF1T4VGW.2~F74R77EI0RZJ.0 size=1048576 2024-09-12T00:07:16.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.621+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~F74R77EI0RZJ.1 size=1048576 2024-09-12T00:07:16.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.621+0000 7f82f8930780 1 < canceled part key=_multipart_2XM2CF1T4VGW.2~F74R77EI0RZJ.2 size=416596 2024-09-12T00:07:16.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.624+0000 7f82f8930780 1 < canceled multipart upload key=2XM2CF1T4VGW upload=F74R77EI0RZJ tag=DSSERABX2X60 type=write size=3562324 2024-09-12T00:07:16.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.626+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=2CIRF02T3LCS type=write size=269311 2024-09-12T00:07:16.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.627+0000 7f82f8930780 -1 < failed to complete operation key=N2TYUAJITFNL tag=32RZQN70YAWC type=del size=2107888: (22) Invalid argument 2024-09-12T00:07:16.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.630+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=YCNNTGZD62T7 type=del size=900946 2024-09-12T00:07:16.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.633+0000 7f82f8930780 1 < suggested update operation key=75GYP042UUC2 tag=9B3FD3VWYSP2 type=del size=2873517 2024-09-12T00:07:16.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.634+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=9LDRA15VQIYB type=write size=798688 2024-09-12T00:07:16.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.635+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~7ZM1NIBBP60C.0 size=1048576 2024-09-12T00:07:16.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.636+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~7ZM1NIBBP60C.1 size=835698 2024-09-12T00:07:16.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.639+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=7ZM1NIBBP60C tag=HUJBY49A33RB type=write size=2932850 2024-09-12T00:07:16.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.640+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=LEPTZIZD19GE type=del size=221380 2024-09-12T00:07:16.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.642+0000 7f82f8930780 1 < completed write operation key=G55HN1VD6X47 tag=J7GTBZ43JLQE type=write size=717578 2024-09-12T00:07:16.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.645+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~CHRNJLWZAJ3X.0 size=1048576 2024-09-12T00:07:16.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.646+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~CHRNJLWZAJ3X.1 size=1048576 2024-09-12T00:07:16.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.647+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~CHRNJLWZAJ3X.2 size=836638 2024-09-12T00:07:16.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.647+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=CHRNJLWZAJ3X tag=BU7UZXXLIA87 type=write size=3982366 2024-09-12T00:07:16.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.649+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~V46PXDBMXF8V.0 size=1048576 2024-09-12T00:07:16.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.650+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~V46PXDBMXF8V.1 size=1048576 2024-09-12T00:07:16.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.651+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~V46PXDBMXF8V.2 size=66072 2024-09-12T00:07:16.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.654+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=V46PXDBMXF8V tag=0DS0SI1W3ACE type=write size=3211800 2024-09-12T00:07:16.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.655+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=JZLA10CSQVE5 type=write size=550705 2024-09-12T00:07:16.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.657+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=FT2DBMX7Q2BO type=del 2024-09-12T00:07:16.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.658+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=FIOPDAJ6JRD2 type=del size=2117488 2024-09-12T00:07:16.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.659+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~44YBO9FJ0FP2.0 size=1048576 2024-09-12T00:07:16.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.660+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~44YBO9FJ0FP2.1 size=297364 2024-09-12T00:07:16.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.663+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=44YBO9FJ0FP2 tag=YNO7E1SFIKF1 type=write size=2394516 2024-09-12T00:07:16.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.665+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=XK3TQBP688Y9 type=del size=1720951 2024-09-12T00:07:16.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.667+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~KJM2W7I1MG55.0 size=1048576 2024-09-12T00:07:16.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.668+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~KJM2W7I1MG55.1 size=1048576 2024-09-12T00:07:16.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.669+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~KJM2W7I1MG55.2 size=829548 2024-09-12T00:07:16.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.671+0000 7f82f8930780 1 < completed multipart upload key=W8SAQZWQHY36 upload=KJM2W7I1MG55 tag=KPUPBFXPZB90 type=write size=3975276 2024-09-12T00:07:16.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.672+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=06SBBMKS9P4T type=del size=1720538 2024-09-12T00:07:16.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.674+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~2JEH0YO4AT7E.0 size=1048576 2024-09-12T00:07:16.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.675+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~2JEH0YO4AT7E.1 size=1048576 2024-09-12T00:07:16.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.676+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~2JEH0YO4AT7E.2 size=251206 2024-09-12T00:07:16.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.678+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=2JEH0YO4AT7E tag=WYK8UIYSXJL6 type=write size=3396934 2024-09-12T00:07:16.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.681+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~J4I2GQ4M2FBK.0 size=1048576 2024-09-12T00:07:16.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.682+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~J4I2GQ4M2FBK.1 size=1048576 2024-09-12T00:07:16.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.684+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~J4I2GQ4M2FBK.2 size=253375 2024-09-12T00:07:16.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.684+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=J4I2GQ4M2FBK tag=IIM3V9N11MFV type=write size=3399103 2024-09-12T00:07:16.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.685+0000 7f82f8930780 1 < completed write operation key=3H3D067Z8O0R tag=T657Q51HV2JT type=write size=964016 2024-09-12T00:07:16.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.687+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~IF20DY2GY05V.0 size=1048576 2024-09-12T00:07:16.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.689+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~IF20DY2GY05V.1 size=1048576 2024-09-12T00:07:16.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.690+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~IF20DY2GY05V.2 size=259671 2024-09-12T00:07:16.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.690+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=IF20DY2GY05V tag=6Y3OYU4JGJDK type=write size=3405399 2024-09-12T00:07:16.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.692+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~7X7UY0VFEE4G.0 size=295748 2024-09-12T00:07:16.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.694+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=7X7UY0VFEE4G tag=AB33RSPGTU7P type=write size=1344324 2024-09-12T00:07:16.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.697+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~LFAD51GV36AY.0 size=1048576 2024-09-12T00:07:16.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.698+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~LFAD51GV36AY.1 size=1048576 2024-09-12T00:07:16.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.699+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~LFAD51GV36AY.2 size=735337 2024-09-12T00:07:16.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.699+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=LFAD51GV36AY tag=TDOYXMLOYQD6 type=write size=3881065 2024-09-12T00:07:16.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.700+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=219TDSKI7VN7 type=del 2024-09-12T00:07:16.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.703+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~9VHIOTWF1M9Q.0 size=1048576 2024-09-12T00:07:16.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.704+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~9VHIOTWF1M9Q.1 size=1048576 2024-09-12T00:07:16.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.705+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~9VHIOTWF1M9Q.2 size=962568 2024-09-12T00:07:16.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.705+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=9VHIOTWF1M9Q tag=9V2XH2KNHQR4 type=write size=4108296 2024-09-12T00:07:16.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.706+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~NRF1QTAZ4PU8.0 size=845369 2024-09-12T00:07:16.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.708+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=NRF1QTAZ4PU8 tag=YRXEQQXWGKNA type=write size=1893945 2024-09-12T00:07:16.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.710+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=UHTLT340BAYD type=del size=3100962 2024-09-12T00:07:16.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.711+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=ASBEUW47311K type=del 2024-09-12T00:07:16.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.715+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~UIMGS9MYLDT7.0 size=1048576 2024-09-12T00:07:16.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.715+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~UIMGS9MYLDT7.1 size=618617 2024-09-12T00:07:16.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.715+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=UIMGS9MYLDT7 tag=T58HHER2EEU3 type=write size=2715769 2024-09-12T00:07:16.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.718+0000 7f82f8930780 1 < suggested update operation key=G55HN1VD6X47 tag=L75YNXHV67ED type=del size=3294106 2024-09-12T00:07:16.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.719+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=11ZHRJLYPE43 type=del size=1017871 2024-09-12T00:07:16.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.720+0000 7f82f8930780 1 < completed write operation key=62X93NOS23AF tag=2CIRF02T3LCS type=write size=269311 2024-09-12T00:07:16.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.722+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=89V712TKAMBE type=del size=2384225 2024-09-12T00:07:16.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.724+0000 7f82f8930780 1 < suggested update operation key=N2TYUAJITFNL tag=YCNNTGZD62T7 type=del size=900946 2024-09-12T00:07:16.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.726+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=BUALPCQWGOQ5 type=del size=1362370 2024-09-12T00:07:16.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.728+0000 7f82f8930780 1 < completed write operation key=FOWSB9RQ5TV5 tag=9LDRA15VQIYB type=write size=798688 2024-09-12T00:07:16.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.728+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=8L9QE9HX4537 type=del size=1447432 2024-09-12T00:07:16.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.730+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=LEPTZIZD19GE type=del 2024-09-12T00:07:16.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.733+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~LMQ13XSFJNXM.0 size=1048576 2024-09-12T00:07:16.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.734+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~LMQ13XSFJNXM.1 size=1048576 2024-09-12T00:07:16.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.735+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~LMQ13XSFJNXM.2 size=910827 2024-09-12T00:07:16.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.735+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=LMQ13XSFJNXM tag=25EJAQ4SOHCO type=write size=4056555 2024-09-12T00:07:16.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.736+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~CHRNJLWZAJ3X.0 size=1048576 2024-09-12T00:07:16.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.738+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~CHRNJLWZAJ3X.1 size=1048576 2024-09-12T00:07:16.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.739+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~CHRNJLWZAJ3X.2 size=836638 2024-09-12T00:07:16.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.742+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=CHRNJLWZAJ3X tag=BU7UZXXLIA87 type=write size=3982366 2024-09-12T00:07:16.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.743+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=JNPMAJK6DMHT type=del size=1565595 2024-09-12T00:07:16.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.747+0000 7f82f8930780 1 < suggested remove operation key=2XM2CF1T4VGW tag=JZLA10CSQVE5 type=write 2024-09-12T00:07:16.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.748+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=HLJHKQ1JIMIH type=del size=1939989 2024-09-12T00:07:16.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.749+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=FIOPDAJ6JRD2 type=del 2024-09-12T00:07:16.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.751+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=P7V312KUP6WO type=del size=2308868 2024-09-12T00:07:16.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.752+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=XK3TQBP688Y9 type=del 2024-09-12T00:07:16.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.753+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=5K6I1FMBN1F4 type=del size=2785660 2024-09-12T00:07:16.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.755+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=06SBBMKS9P4T type=del 2024-09-12T00:07:16.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.757+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=TNHR48ZE9V4O type=del size=3962737 2024-09-12T00:07:16.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.757+0000 7f82f8930780 1 < canceled part key=_multipart_QB46N36A27QH.2~J4I2GQ4M2FBK.0 size=1048576 2024-09-12T00:07:16.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.758+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~J4I2GQ4M2FBK.1 size=1048576 2024-09-12T00:07:16.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.759+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~J4I2GQ4M2FBK.2 size=253375 2024-09-12T00:07:16.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.763+0000 7f82f8930780 1 < canceled multipart upload key=QB46N36A27QH upload=J4I2GQ4M2FBK tag=IIM3V9N11MFV type=write size=3399103 2024-09-12T00:07:16.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.763+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=RJL8VX5HZWJ2 type=del size=3324301 2024-09-12T00:07:16.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.765+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~IF20DY2GY05V.0 size=1048576 2024-09-12T00:07:16.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.766+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~IF20DY2GY05V.1 size=1048576 2024-09-12T00:07:16.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.768+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~IF20DY2GY05V.2 size=259671 2024-09-12T00:07:16.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.771+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=IF20DY2GY05V tag=6Y3OYU4JGJDK type=write size=3405399 2024-09-12T00:07:16.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.771+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=RENJUULCUI72 type=del size=2134889 2024-09-12T00:07:16.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.772+0000 7f82f8930780 1 < canceled part key=_multipart_QB46N36A27QH.2~LFAD51GV36AY.0 size=1048576 2024-09-12T00:07:16.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.772+0000 7f82f8930780 1 < canceled part key=_multipart_QB46N36A27QH.2~LFAD51GV36AY.1 size=1048576 2024-09-12T00:07:16.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.773+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~LFAD51GV36AY.2 size=735337 2024-09-12T00:07:16.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.776+0000 7f82f8930780 1 < canceled multipart upload key=QB46N36A27QH upload=LFAD51GV36AY tag=TDOYXMLOYQD6 type=write size=3881065 2024-09-12T00:07:16.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.776+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=AMN9THWA5V27 type=del size=1524141 2024-09-12T00:07:16.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.778+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~9VHIOTWF1M9Q.0 size=1048576 2024-09-12T00:07:16.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.779+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~9VHIOTWF1M9Q.1 size=1048576 2024-09-12T00:07:16.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.780+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~9VHIOTWF1M9Q.2 size=962568 2024-09-12T00:07:16.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.782+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=9VHIOTWF1M9Q tag=9V2XH2KNHQR4 type=write size=4108296 2024-09-12T00:07:16.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.783+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=GDQJ1093ZTWZ type=del size=4002006 2024-09-12T00:07:16.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.786+0000 7f82f8930780 1 < suggested update operation key=HCK59C6MAW0B tag=UHTLT340BAYD type=del size=3100962 2024-09-12T00:07:16.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.789+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~G1LYX3XXIG4N.0 size=1048576 2024-09-12T00:07:16.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.790+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~G1LYX3XXIG4N.1 size=961552 2024-09-12T00:07:16.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.790+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=G1LYX3XXIG4N tag=E7R8ASEQKH3T type=write size=3058704 2024-09-12T00:07:16.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.791+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~UIMGS9MYLDT7.0 size=1048576 2024-09-12T00:07:16.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.792+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~UIMGS9MYLDT7.1 size=618617 2024-09-12T00:07:16.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.795+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=UIMGS9MYLDT7 tag=T58HHER2EEU3 type=write size=2715769 2024-09-12T00:07:16.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.797+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~GFHQ1AIQEWRY.0 size=1048576 2024-09-12T00:07:16.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.799+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~GFHQ1AIQEWRY.1 size=1048576 2024-09-12T00:07:16.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.800+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~GFHQ1AIQEWRY.2 size=1043699 2024-09-12T00:07:16.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.800+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=GFHQ1AIQEWRY tag=9UA4BUJHMKOR type=write size=4189427 2024-09-12T00:07:16.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.801+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=11ZHRJLYPE43 type=del 2024-09-12T00:07:16.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.802+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=WNQIV4H0FH31 type=del size=1571261 2024-09-12T00:07:16.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.804+0000 7f82f8930780 -1 < failed to complete operation key=2XM2CF1T4VGW tag=89V712TKAMBE type=del size=2384225: (22) Invalid argument 2024-09-12T00:07:16.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.806+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~FI74MWNOP73E.0 size=375139 2024-09-12T00:07:16.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.806+0000 7f82f8930780 1 > prepared multipart upload key=4IA4918NXXJW upload=FI74MWNOP73E tag=2227F45SDNYL type=write size=1423715 2024-09-12T00:07:16.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.807+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=BUALPCQWGOQ5 type=del 2024-09-12T00:07:16.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.810+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~AMF64LCCB8AY.0 size=57464 2024-09-12T00:07:16.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.810+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=AMF64LCCB8AY tag=9ZPPD21UYLCA type=write size=1106040 2024-09-12T00:07:16.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.812+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=8L9QE9HX4537 type=del 2024-09-12T00:07:16.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.813+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=MML4FMLK6YXQ type=del size=3678261 2024-09-12T00:07:16.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.815+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~LMQ13XSFJNXM.0 size=1048576 2024-09-12T00:07:16.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.816+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~LMQ13XSFJNXM.1 size=1048576 2024-09-12T00:07:16.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.817+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~LMQ13XSFJNXM.2 size=910827 2024-09-12T00:07:16.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.820+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=LMQ13XSFJNXM tag=25EJAQ4SOHCO type=write size=4056555 2024-09-12T00:07:16.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.822+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=WVDZ2NMG9WZX type=del size=220375 2024-09-12T00:07:16.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.823+0000 7f82f8930780 1 < completed delete operation key=9576W9WYJUJV tag=JNPMAJK6DMHT type=del 2024-09-12T00:07:16.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.825+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=P6BMPCUG49XM type=write size=474647 2024-09-12T00:07:16.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.829+0000 7f82f8930780 1 < suggested remove operation key=MJZ56OX8PLSH tag=HLJHKQ1JIMIH type=del 2024-09-12T00:07:16.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.830+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=O6NW6YE6SWH3 type=write size=79052 2024-09-12T00:07:16.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.830+0000 7f82f8930780 -1 < no bi entry to suggest for operation key=MJZ56OX8PLSH tag=P7V312KUP6WO type=del size=2308868: (2) No such file or directory 2024-09-12T00:07:16.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.833+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~UCHJL1DDBTPJ.0 size=1048576 2024-09-12T00:07:16.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.835+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~UCHJL1DDBTPJ.1 size=765696 2024-09-12T00:07:16.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.835+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=UCHJL1DDBTPJ tag=F3NPAOEWNF93 type=write size=2862848 2024-09-12T00:07:16.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.836+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=5K6I1FMBN1F4 type=del 2024-09-12T00:07:16.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.839+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~TKWONY5FOAIH.0 size=1048576 2024-09-12T00:07:16.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.841+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~TKWONY5FOAIH.1 size=1048576 2024-09-12T00:07:16.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.842+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~TKWONY5FOAIH.2 size=640974 2024-09-12T00:07:16.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.842+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=TKWONY5FOAIH tag=UUM0JLBWOG31 type=write size=3786702 2024-09-12T00:07:16.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.843+0000 7f82f8930780 1 < canceled operation key=OVJOP07M9KB8 tag=TNHR48ZE9V4O type=del size=3962737 2024-09-12T00:07:16.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.845+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=728M1KY3PFKR type=del size=2345894 2024-09-12T00:07:16.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.847+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=RJL8VX5HZWJ2 type=del 2024-09-12T00:07:16.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.848+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=D9E6LA565IAT type=del size=2027758 2024-09-12T00:07:16.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.850+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=RENJUULCUI72 type=del 2024-09-12T00:07:16.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.853+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~S00J2SJ2MSZZ.0 size=1048576 2024-09-12T00:07:16.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.854+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~S00J2SJ2MSZZ.1 size=1048576 2024-09-12T00:07:16.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.855+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~S00J2SJ2MSZZ.2 size=852667 2024-09-12T00:07:16.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.855+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=S00J2SJ2MSZZ tag=SNGRAOMYKXTT type=write size=3998395 2024-09-12T00:07:16.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.856+0000 7f82f8930780 1 < completed delete operation key=OVJOP07M9KB8 tag=AMN9THWA5V27 type=del 2024-09-12T00:07:16.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.858+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=6IJUO52BULB3 type=del size=3857490 2024-09-12T00:07:16.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.861+0000 7f82f8930780 1 < suggested update operation key=IMAT4ZCLGFRN tag=GDQJ1093ZTWZ type=del size=4002006 2024-09-12T00:07:16.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.863+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~3BM7ECN9W8Y2.0 size=550833 2024-09-12T00:07:16.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.863+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=3BM7ECN9W8Y2 tag=X7Z8WTQBNHXI type=write size=1599409 2024-09-12T00:07:16.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.865+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~G1LYX3XXIG4N.0 size=1048576 2024-09-12T00:07:16.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.866+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~G1LYX3XXIG4N.1 size=961552 2024-09-12T00:07:16.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.868+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=G1LYX3XXIG4N tag=E7R8ASEQKH3T type=write size=3058704 2024-09-12T00:07:16.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.871+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~EDQ1WS75S588.0 size=1048576 2024-09-12T00:07:16.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.872+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~EDQ1WS75S588.1 size=1048576 2024-09-12T00:07:16.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.874+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~EDQ1WS75S588.2 size=248162 2024-09-12T00:07:16.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.874+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=EDQ1WS75S588 tag=XU3J9DULZ3S3 type=write size=3393890 2024-09-12T00:07:16.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.874+0000 7f82f8930780 1 < canceled part key=_multipart_G55HN1VD6X47.2~GFHQ1AIQEWRY.0 size=1048576 2024-09-12T00:07:16.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.877+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~GFHQ1AIQEWRY.1 size=1048576 2024-09-12T00:07:16.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.877+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~GFHQ1AIQEWRY.2 size=1043699 2024-09-12T00:07:16.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.880+0000 7f82f8930780 1 < canceled multipart upload key=G55HN1VD6X47 upload=GFHQ1AIQEWRY tag=9UA4BUJHMKOR type=write size=4189427 2024-09-12T00:07:16.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.883+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~KT42A0NRIR0A.0 size=955134 2024-09-12T00:07:16.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.883+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=KT42A0NRIR0A tag=L2NWSGWNJ108 type=write size=2003710 2024-09-12T00:07:16.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.884+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=WNQIV4H0FH31 type=del 2024-09-12T00:07:16.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.887+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~AGT4IGTVKE74.0 size=1048576 2024-09-12T00:07:16.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.887+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~AGT4IGTVKE74.1 size=1048576 2024-09-12T00:07:16.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.888+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~AGT4IGTVKE74.2 size=709933 2024-09-12T00:07:16.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.888+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=AGT4IGTVKE74 tag=SVSHIJK0DST8 type=write size=3855661 2024-09-12T00:07:16.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.891+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~FI74MWNOP73E.0 size=375139 2024-09-12T00:07:16.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.893+0000 7f82f8930780 1 < completed multipart upload key=4IA4918NXXJW upload=FI74MWNOP73E tag=2227F45SDNYL type=write size=1423715 2024-09-12T00:07:16.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.894+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=CAC8S143JY7I type=write size=335921 2024-09-12T00:07:16.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.895+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~AMF64LCCB8AY.0 size=57464 2024-09-12T00:07:16.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.897+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=AMF64LCCB8AY tag=9ZPPD21UYLCA type=write size=1106040 2024-09-12T00:07:16.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.900+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~KB0WFYII0C3U.0 size=1048576 2024-09-12T00:07:16.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.901+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~KB0WFYII0C3U.1 size=1048576 2024-09-12T00:07:16.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.903+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~KB0WFYII0C3U.2 size=858472 2024-09-12T00:07:16.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.903+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=KB0WFYII0C3U tag=RQGJV3RU1BFE type=write size=4004200 2024-09-12T00:07:16.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.904+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=MML4FMLK6YXQ type=del 2024-09-12T00:07:16.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.906+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~32ORHF1RSKJ7.0 size=879065 2024-09-12T00:07:16.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.906+0000 7f82f8930780 1 > prepared multipart upload key=IN8Y7I0HKP6D upload=32ORHF1RSKJ7 tag=6WJ961ZUVBZU type=write size=1927641 2024-09-12T00:07:16.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.909+0000 7f82f8930780 1 < suggested update operation key=77SDZHCSP0E3 tag=WVDZ2NMG9WZX type=del size=220375 2024-09-12T00:07:16.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.912+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~OZNVWUX1QC0E.0 size=1048576 2024-09-12T00:07:16.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.913+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~OZNVWUX1QC0E.1 size=1048576 2024-09-12T00:07:16.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.914+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~OZNVWUX1QC0E.2 size=740122 2024-09-12T00:07:16.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.914+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=OZNVWUX1QC0E tag=BPHPUGTSR41E type=write size=3885850 2024-09-12T00:07:16.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.915+0000 7f82f8930780 1 < completed write operation key=AMWMQXO10EXK tag=P6BMPCUG49XM type=write size=474647 2024-09-12T00:07:16.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.917+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=N0YIETD57ZC9 type=del size=2030267 2024-09-12T00:07:16.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.918+0000 7f82f8930780 -1 < failed to complete operation key=IMAT4ZCLGFRN tag=O6NW6YE6SWH3 type=write size=79052: (22) Invalid argument 2024-09-12T00:07:16.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.920+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=G5T18QYDLDBR type=del size=852560 2024-09-12T00:07:16.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.921+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~UCHJL1DDBTPJ.0 size=1048576 2024-09-12T00:07:16.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.923+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~UCHJL1DDBTPJ.1 size=765696 2024-09-12T00:07:16.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.925+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=UCHJL1DDBTPJ tag=F3NPAOEWNF93 type=write size=2862848 2024-09-12T00:07:16.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.927+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=KW7X0M7H0SF3 type=del size=1851147 2024-09-12T00:07:16.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.929+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~TKWONY5FOAIH.0 size=1048576 2024-09-12T00:07:16.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.930+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~TKWONY5FOAIH.1 size=1048576 2024-09-12T00:07:16.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.931+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~TKWONY5FOAIH.2 size=640974 2024-09-12T00:07:16.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.934+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=TKWONY5FOAIH tag=UUM0JLBWOG31 type=write size=3786702 2024-09-12T00:07:16.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.935+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=OCJJZJ0PMUB4 type=del size=370335 2024-09-12T00:07:16.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.937+0000 7f82f8930780 1 < canceled operation key=QB46N36A27QH tag=728M1KY3PFKR type=del size=2345894 2024-09-12T00:07:16.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.938+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=MMTMVEUQV05T type=del size=1227679 2024-09-12T00:07:16.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.940+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=D9E6LA565IAT type=del 2024-09-12T00:07:16.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.941+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=6O5PY3LUIMLZ type=del size=2557433 2024-09-12T00:07:16.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.942+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~S00J2SJ2MSZZ.0 size=1048576 2024-09-12T00:07:16.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.944+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~S00J2SJ2MSZZ.1 size=1048576 2024-09-12T00:07:16.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.945+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~S00J2SJ2MSZZ.2 size=852667 2024-09-12T00:07:16.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.948+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=S00J2SJ2MSZZ tag=SNGRAOMYKXTT type=write size=3998395 2024-09-12T00:07:16.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.949+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=2AN45PG37XUD type=del size=3675664 2024-09-12T00:07:16.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.950+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=6IJUO52BULB3 type=del 2024-09-12T00:07:16.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.953+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~MVMXC4W1SH0O.0 size=1048576 2024-09-12T00:07:16.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.954+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~MVMXC4W1SH0O.1 size=857743 2024-09-12T00:07:16.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.954+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=MVMXC4W1SH0O tag=ILCLBAC5YMQU type=write size=2954895 2024-09-12T00:07:16.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.956+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~3BM7ECN9W8Y2.0 size=550833 2024-09-12T00:07:16.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.957+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=3BM7ECN9W8Y2 tag=X7Z8WTQBNHXI type=write size=1599409 2024-09-12T00:07:16.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.959+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=7VQIO5MJ03UG type=del size=3515567 2024-09-12T00:07:16.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.960+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~EDQ1WS75S588.0 size=1048576 2024-09-12T00:07:16.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.961+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~EDQ1WS75S588.1 size=1048576 2024-09-12T00:07:16.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.962+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~EDQ1WS75S588.2 size=248162 2024-09-12T00:07:16.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.965+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=EDQ1WS75S588 tag=XU3J9DULZ3S3 type=write size=3393890 2024-09-12T00:07:16.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.966+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=XN5S1JJ7GP7G type=del size=1133857 2024-09-12T00:07:16.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.967+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~KT42A0NRIR0A.0 size=955134 2024-09-12T00:07:16.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.969+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=KT42A0NRIR0A tag=L2NWSGWNJ108 type=write size=2003710 2024-09-12T00:07:16.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.972+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~IK09YBUFZ192.0 size=1048576 2024-09-12T00:07:16.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.973+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~IK09YBUFZ192.1 size=501913 2024-09-12T00:07:16.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.973+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=IK09YBUFZ192 tag=RX8DRN02D98K type=write size=2599065 2024-09-12T00:07:16.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.976+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~AGT4IGTVKE74.0 size=1048576 2024-09-12T00:07:16.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.976+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~AGT4IGTVKE74.1 size=1048576 2024-09-12T00:07:16.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.978+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~AGT4IGTVKE74.2 size=709933 2024-09-12T00:07:16.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.980+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=AGT4IGTVKE74 tag=SVSHIJK0DST8 type=write size=3855661 2024-09-12T00:07:16.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.983+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~CYJA6I55HLL7.0 size=1048576 2024-09-12T00:07:16.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.984+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~CYJA6I55HLL7.1 size=1048576 2024-09-12T00:07:16.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.985+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~CYJA6I55HLL7.2 size=960414 2024-09-12T00:07:16.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.985+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=CYJA6I55HLL7 tag=IARDQYLRLJYS type=write size=4106142 2024-09-12T00:07:16.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.986+0000 7f82f8930780 1 < completed write operation key=4IA4918NXXJW tag=CAC8S143JY7I type=write size=335921 2024-09-12T00:07:16.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.987+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=PR64C0XANS6Q type=del size=651626 2024-09-12T00:07:16.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.988+0000 7f82f8930780 1 < canceled part key=_multipart_X3PCR8TCWDTK.2~KB0WFYII0C3U.0 size=1048576 2024-09-12T00:07:16.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.989+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~KB0WFYII0C3U.1 size=1048576 2024-09-12T00:07:16.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.990+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~KB0WFYII0C3U.2 size=858472 2024-09-12T00:07:16.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.993+0000 7f82f8930780 1 < canceled multipart upload key=X3PCR8TCWDTK upload=KB0WFYII0C3U tag=RQGJV3RU1BFE type=write size=4004200 2024-09-12T00:07:16.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.994+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=WV0E76UJK362 type=del size=123410 2024-09-12T00:07:16.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.997+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~32ORHF1RSKJ7.0 size=879065 2024-09-12T00:07:16.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:16.999+0000 7f82f8930780 1 < completed multipart upload key=IN8Y7I0HKP6D upload=32ORHF1RSKJ7 tag=6WJ961ZUVBZU type=write size=1927641 2024-09-12T00:07:16.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.000+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=UYU8WC4X3IRB type=del size=960978 2024-09-12T00:07:17.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.001+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~OZNVWUX1QC0E.0 size=1048576 2024-09-12T00:07:17.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.003+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~OZNVWUX1QC0E.1 size=1048576 2024-09-12T00:07:17.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.004+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~OZNVWUX1QC0E.2 size=740122 2024-09-12T00:07:17.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.007+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=OZNVWUX1QC0E tag=BPHPUGTSR41E type=write size=3885850 2024-09-12T00:07:17.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.008+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=LI8KR77XPG7D type=del size=204402 2024-09-12T00:07:17.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.009+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=N0YIETD57ZC9 type=del 2024-09-12T00:07:17.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.011+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=AZ53B6344CWU type=del size=1130459 2024-09-12T00:07:17.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.012+0000 7f82f8930780 1 < canceled operation key=62X93NOS23AF tag=G5T18QYDLDBR type=del size=852560 2024-09-12T00:07:17.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.015+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~MKZVPYF0SJP7.0 size=1048576 2024-09-12T00:07:17.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.016+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~MKZVPYF0SJP7.1 size=634896 2024-09-12T00:07:17.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.016+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=MKZVPYF0SJP7 tag=DS5E1V35JFYH type=write size=2732048 2024-09-12T00:07:17.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.019+0000 7f82f8930780 1 < suggested remove operation key=LAKJS79KNBY7 tag=KW7X0M7H0SF3 type=del 2024-09-12T00:07:17.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.020+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=J32ITCX1A502 type=del size=429665 2024-09-12T00:07:17.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.022+0000 7f82f8930780 1 < completed delete operation key=OVJOP07M9KB8 tag=OCJJZJ0PMUB4 type=del 2024-09-12T00:07:17.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.023+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=A737NPQAM2J2 type=del size=3279216 2024-09-12T00:07:17.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.025+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=MMTMVEUQV05T type=del 2024-09-12T00:07:17.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.026+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=6P1B0S5J2UYN type=del size=3212798 2024-09-12T00:07:17.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.028+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=6O5PY3LUIMLZ type=del 2024-09-12T00:07:17.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.029+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=L2JSJY37O6G7 type=write size=233334 2024-09-12T00:07:17.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.032+0000 7f82f8930780 1 < suggested update operation key=HCK59C6MAW0B tag=2AN45PG37XUD type=del size=3675664 2024-09-12T00:07:17.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.033+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=H2YZQ1WKQ32B type=write size=381288 2024-09-12T00:07:17.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.034+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~MVMXC4W1SH0O.0 size=1048576 2024-09-12T00:07:17.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.035+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~MVMXC4W1SH0O.1 size=857743 2024-09-12T00:07:17.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.038+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=MVMXC4W1SH0O tag=ILCLBAC5YMQU type=write size=2954895 2024-09-12T00:07:17.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.039+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=W67BYMI8OU3A type=del size=1898955 2024-09-12T00:07:17.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.041+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=7VQIO5MJ03UG type=del 2024-09-12T00:07:17.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.043+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~WYS14L0DD5P7.0 size=577591 2024-09-12T00:07:17.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.043+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=WYS14L0DD5P7 tag=2934NJWFXWO0 type=write size=1626167 2024-09-12T00:07:17.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.045+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=XN5S1JJ7GP7G type=del 2024-09-12T00:07:17.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.046+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=YZ6PBHC1CETL type=del size=2248343 2024-09-12T00:07:17.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.047+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~IK09YBUFZ192.0 size=1048576 2024-09-12T00:07:17.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.048+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~IK09YBUFZ192.1 size=501913 2024-09-12T00:07:17.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.051+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=IK09YBUFZ192 tag=RX8DRN02D98K type=write size=2599065 2024-09-12T00:07:17.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.052+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=FFYIG7I4EV6G type=del size=3051829 2024-09-12T00:07:17.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.054+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~CYJA6I55HLL7.0 size=1048576 2024-09-12T00:07:17.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.055+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~CYJA6I55HLL7.1 size=1048576 2024-09-12T00:07:17.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.056+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~CYJA6I55HLL7.2 size=960414 2024-09-12T00:07:17.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.058+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=CYJA6I55HLL7 tag=IARDQYLRLJYS type=write size=4106142 2024-09-12T00:07:17.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.059+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=11RIUE7L0PXF type=write size=669159 2024-09-12T00:07:17.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.062+0000 7f82f8930780 1 < suggested update operation key=FOWSB9RQ5TV5 tag=PR64C0XANS6Q type=del size=651626 2024-09-12T00:07:17.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.063+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=JLOZ7GZJI32X type=del size=901349 2024-09-12T00:07:17.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.065+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=WV0E76UJK362 type=del 2024-09-12T00:07:17.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.066+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=1ORII2DV9L37 type=del size=960142 2024-09-12T00:07:17.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.067+0000 7f82f8930780 1 < completed delete operation key=OVJOP07M9KB8 tag=UYU8WC4X3IRB type=del 2024-09-12T00:07:17.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.070+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~CYNKZZCXITXL.0 size=881670 2024-09-12T00:07:17.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.070+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=CYNKZZCXITXL tag=MHWSWUH4PYD0 type=write size=1930246 2024-09-12T00:07:17.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.071+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=LI8KR77XPG7D type=del 2024-09-12T00:07:17.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.074+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~FB2U38PK6DSX.0 size=160855 2024-09-12T00:07:17.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.074+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=FB2U38PK6DSX tag=ZB6K7UNPII0J type=write size=1209431 2024-09-12T00:07:17.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.075+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=AZ53B6344CWU type=del 2024-09-12T00:07:17.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.078+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~NFPLLWJEIRMF.0 size=1048576 2024-09-12T00:07:17.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.079+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~NFPLLWJEIRMF.1 size=407622 2024-09-12T00:07:17.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.079+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=NFPLLWJEIRMF tag=NGXIBOTHC0BE type=write size=2504774 2024-09-12T00:07:17.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.081+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~MKZVPYF0SJP7.0 size=1048576 2024-09-12T00:07:17.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.081+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~MKZVPYF0SJP7.1 size=634896 2024-09-12T00:07:17.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.084+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=MKZVPYF0SJP7 tag=DS5E1V35JFYH type=write size=2732048 2024-09-12T00:07:17.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.085+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=ADPFDTAFMZR0 type=del size=2907260 2024-09-12T00:07:17.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.086+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=J32ITCX1A502 type=del 2024-09-12T00:07:17.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.088+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=ZX30R798EZJX type=del size=2293524 2024-09-12T00:07:17.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.089+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=A737NPQAM2J2 type=del 2024-09-12T00:07:17.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.091+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=5UM43UKLEXMK type=write size=894041 2024-09-12T00:07:17.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.092+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=6P1B0S5J2UYN type=del 2024-09-12T00:07:17.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.093+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=JWFG00M4UZ0P type=del size=3808769 2024-09-12T00:07:17.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.095+0000 7f82f8930780 1 < completed write operation key=4IA4918NXXJW tag=L2JSJY37O6G7 type=write size=233334 2024-09-12T00:07:17.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.096+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=7C20UAGN3QQM type=write size=515166 2024-09-12T00:07:17.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.100+0000 7f82f8930780 1 < suggested remove operation key=IN8Y7I0HKP6D tag=H2YZQ1WKQ32B type=write 2024-09-12T00:07:17.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.101+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=VPPVWP3FDC96 type=del size=3166967 2024-09-12T00:07:17.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.103+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=W67BYMI8OU3A type=del 2024-09-12T00:07:17.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.105+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~S8SVKYXSW7WF.0 size=1048576 2024-09-12T00:07:17.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.107+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~S8SVKYXSW7WF.1 size=357922 2024-09-12T00:07:17.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.107+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=S8SVKYXSW7WF tag=WYJXNOPEZZ2O type=write size=2455074 2024-09-12T00:07:17.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.108+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~WYS14L0DD5P7.0 size=577591 2024-09-12T00:07:17.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.110+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=WYS14L0DD5P7 tag=2934NJWFXWO0 type=write size=1626167 2024-09-12T00:07:17.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.113+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=TNOGZJWRDOOT type=write size=1043713 2024-09-12T00:07:17.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.114+0000 7f82f8930780 1 < canceled operation key=HCK59C6MAW0B tag=YZ6PBHC1CETL type=del size=2248343 2024-09-12T00:07:17.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.116+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~B0HPBIR38IXH.0 size=1048576 2024-09-12T00:07:17.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.117+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~B0HPBIR38IXH.1 size=381469 2024-09-12T00:07:17.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.118+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=B0HPBIR38IXH tag=HA4M2LIFRQK8 type=write size=2478621 2024-09-12T00:07:17.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.119+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=FFYIG7I4EV6G type=del 2024-09-12T00:07:17.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.120+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=BBV4OGW7VGVU type=write size=342248 2024-09-12T00:07:17.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.122+0000 7f82f8930780 1 < completed write operation key=62X93NOS23AF tag=11RIUE7L0PXF type=write size=669159 2024-09-12T00:07:17.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.124+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~TI2BZXKSPPY4.0 size=638941 2024-09-12T00:07:17.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.124+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=TI2BZXKSPPY4 tag=PMMKN6XXSG61 type=write size=1687517 2024-09-12T00:07:17.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.126+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=JLOZ7GZJI32X type=del 2024-09-12T00:07:17.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.129+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~BT6OYSZ85ZQ8.0 size=1048576 2024-09-12T00:07:17.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.130+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~BT6OYSZ85ZQ8.1 size=1048576 2024-09-12T00:07:17.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.131+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~BT6OYSZ85ZQ8.2 size=508266 2024-09-12T00:07:17.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.131+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=BT6OYSZ85ZQ8 tag=OK979ZP4KMWS type=write size=3653994 2024-09-12T00:07:17.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.132+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=1ORII2DV9L37 type=del 2024-09-12T00:07:17.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.133+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=HVEG27AM2HPJ type=del size=2027619 2024-09-12T00:07:17.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.134+0000 7f82f8930780 1 < canceled part key=_multipart_BJHGNT3HBS25.2~CYNKZZCXITXL.0 size=881670 2024-09-12T00:07:17.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.136+0000 7f82f8930780 1 < canceled multipart upload key=BJHGNT3HBS25 upload=CYNKZZCXITXL tag=MHWSWUH4PYD0 type=write size=1930246 2024-09-12T00:07:17.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.139+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~O5ERL0JJ4VB3.0 size=1048576 2024-09-12T00:07:17.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.141+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~O5ERL0JJ4VB3.1 size=1048576 2024-09-12T00:07:17.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.142+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~O5ERL0JJ4VB3.2 size=971913 2024-09-12T00:07:17.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.142+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=O5ERL0JJ4VB3 tag=REASZGUXIZ5E type=write size=4117641 2024-09-12T00:07:17.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.143+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~FB2U38PK6DSX.0 size=160855 2024-09-12T00:07:17.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.146+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=FB2U38PK6DSX tag=ZB6K7UNPII0J type=write size=1209431 2024-09-12T00:07:17.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.148+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=S9JAVJ0VFV3H type=del size=1667543 2024-09-12T00:07:17.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.149+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~NFPLLWJEIRMF.0 size=1048576 2024-09-12T00:07:17.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.150+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~NFPLLWJEIRMF.1 size=407622 2024-09-12T00:07:17.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.153+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=NFPLLWJEIRMF tag=NGXIBOTHC0BE type=write size=2504774 2024-09-12T00:07:17.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.155+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~CDKLUUGSDR4K.0 size=1048576 2024-09-12T00:07:17.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.156+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~CDKLUUGSDR4K.1 size=1048576 2024-09-12T00:07:17.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.157+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~CDKLUUGSDR4K.2 size=735507 2024-09-12T00:07:17.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.157+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=CDKLUUGSDR4K tag=6XS4KIH2H198 type=write size=3881235 2024-09-12T00:07:17.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.160+0000 7f82f8930780 1 < suggested update operation key=3H3D067Z8O0R tag=ADPFDTAFMZR0 type=del size=2907260 2024-09-12T00:07:17.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.162+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~G39P43H121I7.0 size=1048576 2024-09-12T00:07:17.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.163+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~G39P43H121I7.1 size=326044 2024-09-12T00:07:17.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.163+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=G39P43H121I7 tag=4OHWFKHNITUM type=write size=2423196 2024-09-12T00:07:17.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.165+0000 7f82f8930780 1 < canceled operation key=MJZ56OX8PLSH tag=ZX30R798EZJX type=del size=2293524 2024-09-12T00:07:17.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.166+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=ETT092NEDBIP type=write size=600997 2024-09-12T00:07:17.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.168+0000 7f82f8930780 1 < completed write operation key=77SDZHCSP0E3 tag=5UM43UKLEXMK type=write size=894041 2024-09-12T00:07:17.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.169+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=8SZZXFNNOPRN type=del size=496662 2024-09-12T00:07:17.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.172+0000 7f82f8930780 1 < suggested remove operation key=9576W9WYJUJV tag=JWFG00M4UZ0P type=del 2024-09-12T00:07:17.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.175+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~FB22UN5AVKZ4.0 size=98386 2024-09-12T00:07:17.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.175+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=FB22UN5AVKZ4 tag=6TKMJ3TKAQ6C type=write size=1146962 2024-09-12T00:07:17.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.176+0000 7f82f8930780 1 < canceled operation key=77SDZHCSP0E3 tag=7C20UAGN3QQM type=write size=515166 2024-09-12T00:07:17.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.177+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=E60AVKWXIRCH type=del size=4089247 2024-09-12T00:07:17.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.178+0000 7f82f8930780 1 < canceled operation key=OVJOP07M9KB8 tag=VPPVWP3FDC96 type=del size=3166967 2024-09-12T00:07:17.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.180+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=UX48V1Q5JDX0 type=del size=855408 2024-09-12T00:07:17.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.180+0000 7f82f8930780 1 < canceled part key=_multipart_OC61OW2M7ZEI.2~S8SVKYXSW7WF.0 size=1048576 2024-09-12T00:07:17.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.181+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~S8SVKYXSW7WF.1 size=357922 2024-09-12T00:07:17.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.183+0000 7f82f8930780 1 < canceled multipart upload key=OC61OW2M7ZEI upload=S8SVKYXSW7WF tag=WYJXNOPEZZ2O type=write size=2455074 2024-09-12T00:07:17.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.185+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=M0KZZ7MD89UB type=del size=889178 2024-09-12T00:07:17.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.186+0000 7f82f8930780 1 < canceled operation key=A8EFUP30RS65 tag=TNOGZJWRDOOT type=write size=1043713 2024-09-12T00:07:17.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.189+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~32QZ4LVXEOT6.0 size=106224 2024-09-12T00:07:17.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.189+0000 7f82f8930780 1 > prepared multipart upload key=77SDZHCSP0E3 upload=32QZ4LVXEOT6 tag=JGWICQ9YU842 type=write size=1154800 2024-09-12T00:07:17.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.190+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~B0HPBIR38IXH.0 size=1048576 2024-09-12T00:07:17.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.191+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~B0HPBIR38IXH.1 size=381469 2024-09-12T00:07:17.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.194+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=B0HPBIR38IXH tag=HA4M2LIFRQK8 type=write size=2478621 2024-09-12T00:07:17.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.196+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=F115QZHYJUYC type=del size=1056845 2024-09-12T00:07:17.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.196+0000 7f82f8930780 1 < completed write operation key=FOWSB9RQ5TV5 tag=BBV4OGW7VGVU type=write size=342248 2024-09-12T00:07:17.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.198+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=EINFUSZ2DBK7 type=del size=2367581 2024-09-12T00:07:17.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.199+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~TI2BZXKSPPY4.0 size=638941 2024-09-12T00:07:17.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.201+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=TI2BZXKSPPY4 tag=PMMKN6XXSG61 type=write size=1687517 2024-09-12T00:07:17.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.205+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~7D32E3DURI53.0 size=112586 2024-09-12T00:07:17.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.205+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=7D32E3DURI53 tag=P8O4TOEJ0OQY type=write size=1161162 2024-09-12T00:07:17.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.206+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~BT6OYSZ85ZQ8.0 size=1048576 2024-09-12T00:07:17.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.207+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~BT6OYSZ85ZQ8.1 size=1048576 2024-09-12T00:07:17.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.208+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~BT6OYSZ85ZQ8.2 size=508266 2024-09-12T00:07:17.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.210+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=BT6OYSZ85ZQ8 tag=OK979ZP4KMWS type=write size=3653994 2024-09-12T00:07:17.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.211+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=9GR9AHFBK2IM type=del size=988389 2024-09-12T00:07:17.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.213+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=HVEG27AM2HPJ type=del 2024-09-12T00:07:17.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.215+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~9Z55INULIF76.0 size=1048576 2024-09-12T00:07:17.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.216+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~9Z55INULIF76.1 size=1048576 2024-09-12T00:07:17.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.217+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~9Z55INULIF76.2 size=451832 2024-09-12T00:07:17.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.218+0000 7f82f8930780 1 > prepared multipart upload key=4IA4918NXXJW upload=9Z55INULIF76 tag=L89CSDDAJ7W0 type=write size=3597560 2024-09-12T00:07:17.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.219+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~O5ERL0JJ4VB3.0 size=1048576 2024-09-12T00:07:17.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.220+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~O5ERL0JJ4VB3.1 size=1048576 2024-09-12T00:07:17.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.221+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~O5ERL0JJ4VB3.2 size=971913 2024-09-12T00:07:17.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.224+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=O5ERL0JJ4VB3 tag=REASZGUXIZ5E type=write size=4117641 2024-09-12T00:07:17.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.225+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=6SDP2S37X46X type=del size=655627 2024-09-12T00:07:17.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.226+0000 7f82f8930780 1 < canceled operation key=AMWMQXO10EXK tag=S9JAVJ0VFV3H type=del size=1667543 2024-09-12T00:07:17.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.228+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=SWB4H3Q34XXP type=write size=243324 2024-09-12T00:07:17.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.229+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~CDKLUUGSDR4K.0 size=1048576 2024-09-12T00:07:17.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.231+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~CDKLUUGSDR4K.1 size=1048576 2024-09-12T00:07:17.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.232+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~CDKLUUGSDR4K.2 size=735507 2024-09-12T00:07:17.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.234+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=CDKLUUGSDR4K tag=6XS4KIH2H198 type=write size=3881235 2024-09-12T00:07:17.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.236+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=KNTIHY6LJTC3 type=del size=3091804 2024-09-12T00:07:17.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.237+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~G39P43H121I7.0 size=1048576 2024-09-12T00:07:17.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.238+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~G39P43H121I7.1 size=326044 2024-09-12T00:07:17.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.241+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=G39P43H121I7 tag=4OHWFKHNITUM type=write size=2423196 2024-09-12T00:07:17.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.244+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~UF9D4NIW9E78.0 size=1048576 2024-09-12T00:07:17.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.245+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~UF9D4NIW9E78.1 size=1048576 2024-09-12T00:07:17.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.246+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~UF9D4NIW9E78.2 size=575349 2024-09-12T00:07:17.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.246+0000 7f82f8930780 1 > prepared multipart upload key=4IA4918NXXJW upload=UF9D4NIW9E78 tag=7VLKSB1KWTAK type=write size=3721077 2024-09-12T00:07:17.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.247+0000 7f82f8930780 1 < completed write operation key=75GYP042UUC2 tag=ETT092NEDBIP type=write size=600997 2024-09-12T00:07:17.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.249+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=3WS2TFOOUJGQ type=del size=3457849 2024-09-12T00:07:17.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.251+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=8SZZXFNNOPRN type=del 2024-09-12T00:07:17.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.252+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=M1EGC0Q2TQH4 type=del size=3097172 2024-09-12T00:07:17.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.253+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~FB22UN5AVKZ4.0 size=98386 2024-09-12T00:07:17.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.256+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=FB22UN5AVKZ4 tag=6TKMJ3TKAQ6C type=write size=1146962 2024-09-12T00:07:17.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.258+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~D3KIDFMRV8E3.0 size=1048576 2024-09-12T00:07:17.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.259+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~D3KIDFMRV8E3.1 size=129479 2024-09-12T00:07:17.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.259+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=D3KIDFMRV8E3 tag=20V0S2MWYUAP type=write size=2226631 2024-09-12T00:07:17.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.261+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=E60AVKWXIRCH type=del 2024-09-12T00:07:17.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.262+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=O82TFZD3GJ99 type=del size=111143 2024-09-12T00:07:17.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.264+0000 7f82f8930780 1 < completed delete operation key=HCK59C6MAW0B tag=UX48V1Q5JDX0 type=del 2024-09-12T00:07:17.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.266+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~8ZVZDKCMQUJV.0 size=1048576 2024-09-12T00:07:17.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.267+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~8ZVZDKCMQUJV.1 size=170968 2024-09-12T00:07:17.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.267+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=8ZVZDKCMQUJV tag=E6E1WW8A9T3L type=write size=2268120 2024-09-12T00:07:17.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.269+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=M0KZZ7MD89UB type=del 2024-09-12T00:07:17.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.272+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~634HG5LCC0A8.0 size=1048576 2024-09-12T00:07:17.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.273+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~634HG5LCC0A8.1 size=1048576 2024-09-12T00:07:17.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.274+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~634HG5LCC0A8.2 size=928836 2024-09-12T00:07:17.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.274+0000 7f82f8930780 1 > prepared multipart upload key=77SDZHCSP0E3 upload=634HG5LCC0A8 tag=EV8HOTWWTI1E type=write size=4074564 2024-09-12T00:07:17.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.275+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~32QZ4LVXEOT6.0 size=106224 2024-09-12T00:07:17.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.278+0000 7f82f8930780 1 < completed multipart upload key=77SDZHCSP0E3 upload=32QZ4LVXEOT6 tag=JGWICQ9YU842 type=write size=1154800 2024-09-12T00:07:17.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.280+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=7K54MTM25VLH type=del size=1074391 2024-09-12T00:07:17.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.280+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=F115QZHYJUYC type=del 2024-09-12T00:07:17.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.282+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=HBKUGQUI3QMH type=write size=1011841 2024-09-12T00:07:17.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.283+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=EINFUSZ2DBK7 type=del 2024-09-12T00:07:17.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.286+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~UDXVZAEP362R.0 size=1048576 2024-09-12T00:07:17.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.287+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~UDXVZAEP362R.1 size=836836 2024-09-12T00:07:17.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.287+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=UDXVZAEP362R tag=0S9THAA9MCEY type=write size=2933988 2024-09-12T00:07:17.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.288+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~7D32E3DURI53.0 size=112586 2024-09-12T00:07:17.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.294+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=7D32E3DURI53 tag=P8O4TOEJ0OQY type=write size=1161162 2024-09-12T00:07:17.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.295+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=OXJJRZ6ZAPUZ type=del size=3010237 2024-09-12T00:07:17.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.296+0000 7f82f8930780 1 < completed delete operation key=OVJOP07M9KB8 tag=9GR9AHFBK2IM type=del 2024-09-12T00:07:17.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.298+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=DZHBDA7IHXTV type=del size=2763730 2024-09-12T00:07:17.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.299+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~9Z55INULIF76.0 size=1048576 2024-09-12T00:07:17.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.299+0000 7f82f8930780 1 < canceled part key=_multipart_4IA4918NXXJW.2~9Z55INULIF76.1 size=1048576 2024-09-12T00:07:17.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.300+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~9Z55INULIF76.2 size=451832 2024-09-12T00:07:17.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.303+0000 7f82f8930780 1 < canceled multipart upload key=4IA4918NXXJW upload=9Z55INULIF76 tag=L89CSDDAJ7W0 type=write size=3597560 2024-09-12T00:07:17.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.305+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~UYLG2MRZ0HVP.0 size=1048576 2024-09-12T00:07:17.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.306+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~UYLG2MRZ0HVP.1 size=1048576 2024-09-12T00:07:17.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.307+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~UYLG2MRZ0HVP.2 size=763679 2024-09-12T00:07:17.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.307+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=UYLG2MRZ0HVP tag=BPZYTOAS4DRK type=write size=3909407 2024-09-12T00:07:17.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.308+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=6SDP2S37X46X type=del 2024-09-12T00:07:17.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.309+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=ZT4XE7F0CZX8 type=del size=2793654 2024-09-12T00:07:17.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.310+0000 7f82f8930780 1 < completed write operation key=80OUXNDPLGAG tag=SWB4H3Q34XXP type=write size=243324 2024-09-12T00:07:17.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.312+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=RXE3YQLNC0O9 type=del size=2378559 2024-09-12T00:07:17.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.313+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=KNTIHY6LJTC3 type=del 2024-09-12T00:07:17.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.316+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~57JUYG1MI2XZ.0 size=1019818 2024-09-12T00:07:17.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.316+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=57JUYG1MI2XZ tag=O2WMFIGQXYFO type=write size=2068394 2024-09-12T00:07:17.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.316+0000 7f82f8930780 1 < canceled part key=_multipart_4IA4918NXXJW.2~UF9D4NIW9E78.0 size=1048576 2024-09-12T00:07:17.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.317+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~UF9D4NIW9E78.1 size=1048576 2024-09-12T00:07:17.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.318+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~UF9D4NIW9E78.2 size=575349 2024-09-12T00:07:17.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.320+0000 7f82f8930780 1 < canceled multipart upload key=4IA4918NXXJW upload=UF9D4NIW9E78 tag=7VLKSB1KWTAK type=write size=3721077 2024-09-12T00:07:17.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.321+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=HLJR2X6GDXZC type=del size=592824 2024-09-12T00:07:17.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.322+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=3WS2TFOOUJGQ type=del 2024-09-12T00:07:17.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.323+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=THIQVTH1EXQY type=del size=473392 2024-09-12T00:07:17.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.326+0000 7f82f8930780 1 < suggested remove operation key=75GYP042UUC2 tag=M1EGC0Q2TQH4 type=del 2024-09-12T00:07:17.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.328+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~OS3NL5LHTRWI.0 size=207918 2024-09-12T00:07:17.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.328+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=OS3NL5LHTRWI tag=J4CON1ATI02N type=write size=1256494 2024-09-12T00:07:17.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.329+0000 7f82f8930780 1 < canceled part key=_multipart_O2ZGU2KOTUOT.2~D3KIDFMRV8E3.0 size=1048576 2024-09-12T00:07:17.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.330+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~D3KIDFMRV8E3.1 size=129479 2024-09-12T00:07:17.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.332+0000 7f82f8930780 1 < canceled multipart upload key=O2ZGU2KOTUOT upload=D3KIDFMRV8E3 tag=20V0S2MWYUAP type=write size=2226631 2024-09-12T00:07:17.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.333+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=OH74FZXD2ZKO type=del size=2426830 2024-09-12T00:07:17.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.334+0000 7f82f8930780 1 < completed delete operation key=HCK59C6MAW0B tag=O82TFZD3GJ99 type=del 2024-09-12T00:07:17.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.335+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=C9NBEW0KVBS1 type=del size=2691588 2024-09-12T00:07:17.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.337+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~8ZVZDKCMQUJV.0 size=1048576 2024-09-12T00:07:17.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.338+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~8ZVZDKCMQUJV.1 size=170968 2024-09-12T00:07:17.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.340+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=8ZVZDKCMQUJV tag=E6E1WW8A9T3L type=write size=2268120 2024-09-12T00:07:17.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.342+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~90IZ0QY270UV.0 size=1048576 2024-09-12T00:07:17.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.343+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~90IZ0QY270UV.1 size=1048576 2024-09-12T00:07:17.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.344+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~90IZ0QY270UV.2 size=284879 2024-09-12T00:07:17.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.344+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=90IZ0QY270UV tag=KDA403TM25R1 type=write size=3430607 2024-09-12T00:07:17.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.346+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~634HG5LCC0A8.0 size=1048576 2024-09-12T00:07:17.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.347+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~634HG5LCC0A8.1 size=1048576 2024-09-12T00:07:17.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.349+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~634HG5LCC0A8.2 size=928836 2024-09-12T00:07:17.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.350+0000 7f82f8930780 1 < completed multipart upload key=77SDZHCSP0E3 upload=634HG5LCC0A8 tag=EV8HOTWWTI1E type=write size=4074564 2024-09-12T00:07:17.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.352+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=MTG16WILKXDI type=write size=299249 2024-09-12T00:07:17.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.353+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=7K54MTM25VLH type=del 2024-09-12T00:07:17.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.354+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=C15K5UU6XH6J type=del size=1176517 2024-09-12T00:07:17.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.357+0000 7f82f8930780 1 < suggested remove operation key=80OUXNDPLGAG tag=HBKUGQUI3QMH type=write 2024-09-12T00:07:17.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.359+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~PQ5HXZBC3NK6.0 size=1048576 2024-09-12T00:07:17.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.361+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~PQ5HXZBC3NK6.1 size=635794 2024-09-12T00:07:17.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.361+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=PQ5HXZBC3NK6 tag=LJQGIOEDR6DW type=write size=2732946 2024-09-12T00:07:17.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.362+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~UDXVZAEP362R.0 size=1048576 2024-09-12T00:07:17.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.363+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~UDXVZAEP362R.1 size=836836 2024-09-12T00:07:17.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.365+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=UDXVZAEP362R tag=0S9THAA9MCEY type=write size=2933988 2024-09-12T00:07:17.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.367+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~P3VQQ48O0UJH.0 size=1048576 2024-09-12T00:07:17.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.368+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~P3VQQ48O0UJH.1 size=892061 2024-09-12T00:07:17.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.368+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=P3VQQ48O0UJH tag=6IBTLE6VELIC type=write size=2989213 2024-09-12T00:07:17.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.370+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=OXJJRZ6ZAPUZ type=del 2024-09-12T00:07:17.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.372+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~DG5Y36YXY3MU.0 size=1048576 2024-09-12T00:07:17.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.373+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~DG5Y36YXY3MU.1 size=1048576 2024-09-12T00:07:17.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.374+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~DG5Y36YXY3MU.2 size=467629 2024-09-12T00:07:17.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.374+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=DG5Y36YXY3MU tag=FDM4ZB1UB7BC type=write size=3613357 2024-09-12T00:07:17.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.375+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=DZHBDA7IHXTV type=del 2024-09-12T00:07:17.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.376+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=DKM4UQJUDUVV type=write size=768052 2024-09-12T00:07:17.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.378+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~UYLG2MRZ0HVP.0 size=1048576 2024-09-12T00:07:17.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.379+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~UYLG2MRZ0HVP.1 size=1048576 2024-09-12T00:07:17.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.380+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~UYLG2MRZ0HVP.2 size=763679 2024-09-12T00:07:17.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.382+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=UYLG2MRZ0HVP tag=BPZYTOAS4DRK type=write size=3909407 2024-09-12T00:07:17.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.384+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~66XUZ8NOROJF.0 size=1048576 2024-09-12T00:07:17.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.385+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~66XUZ8NOROJF.1 size=1048576 2024-09-12T00:07:17.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.386+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~66XUZ8NOROJF.2 size=112306 2024-09-12T00:07:17.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.386+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=66XUZ8NOROJF tag=BUQYXXHE9QRE type=write size=3258034 2024-09-12T00:07:17.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.387+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=ZT4XE7F0CZX8 type=del 2024-09-12T00:07:17.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.390+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~80OC0PI14KY6.0 size=1048576 2024-09-12T00:07:17.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.391+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~80OC0PI14KY6.1 size=271184 2024-09-12T00:07:17.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.391+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=80OC0PI14KY6 tag=OSRJDASSXH3K type=write size=2368336 2024-09-12T00:07:17.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.393+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=RXE3YQLNC0O9 type=del 2024-09-12T00:07:17.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.395+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~C1XI18MRC9X5.0 size=1048576 2024-09-12T00:07:17.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.396+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~C1XI18MRC9X5.1 size=1048576 2024-09-12T00:07:17.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.397+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~C1XI18MRC9X5.2 size=144189 2024-09-12T00:07:17.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.397+0000 7f82f8930780 1 > prepared multipart upload key=IN8Y7I0HKP6D upload=C1XI18MRC9X5 tag=BE60FLBNCR2Y type=write size=3289917 2024-09-12T00:07:17.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.399+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~57JUYG1MI2XZ.0 size=1019818 2024-09-12T00:07:17.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.402+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=57JUYG1MI2XZ tag=O2WMFIGQXYFO type=write size=2068394 2024-09-12T00:07:17.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.405+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~ILI8AXXG8O5O.0 size=1048576 2024-09-12T00:07:17.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.406+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~ILI8AXXG8O5O.1 size=1048576 2024-09-12T00:07:17.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.407+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~ILI8AXXG8O5O.2 size=599288 2024-09-12T00:07:17.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.407+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=ILI8AXXG8O5O tag=9A0MFAYUQ14R type=write size=3745016 2024-09-12T00:07:17.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.408+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=HLJR2X6GDXZC type=del 2024-09-12T00:07:17.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.410+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=JV9SAXQ99D1X type=del size=973701 2024-09-12T00:07:17.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.411+0000 7f82f8930780 1 < canceled operation key=Y5U8MO9TOJQQ tag=THIQVTH1EXQY type=del size=473392 2024-09-12T00:07:17.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.414+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~L504YY4AS25I.0 size=611438 2024-09-12T00:07:17.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.414+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=L504YY4AS25I tag=YWF4YPJXV2RO type=write size=1660014 2024-09-12T00:07:17.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.416+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~OS3NL5LHTRWI.0 size=207918 2024-09-12T00:07:17.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.418+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=OS3NL5LHTRWI tag=J4CON1ATI02N type=write size=1256494 2024-09-12T00:07:17.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.420+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~86Z6MUGRRNCZ.0 size=1048576 2024-09-12T00:07:17.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.421+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~86Z6MUGRRNCZ.1 size=513619 2024-09-12T00:07:17.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.421+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=86Z6MUGRRNCZ tag=OWIZ67Q0XYW0 type=write size=2610771 2024-09-12T00:07:17.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.424+0000 7f82f8930780 1 < suggested update operation key=OC61OW2M7ZEI tag=OH74FZXD2ZKO type=del size=2426830 2024-09-12T00:07:17.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.426+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~AIU4UDMO0RWZ.0 size=1048576 2024-09-12T00:07:17.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.427+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~AIU4UDMO0RWZ.1 size=1048576 2024-09-12T00:07:17.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.428+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~AIU4UDMO0RWZ.2 size=129173 2024-09-12T00:07:17.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.428+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=AIU4UDMO0RWZ tag=073793QKMS5A type=write size=3274901 2024-09-12T00:07:17.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.432+0000 7f82f8930780 1 < suggested remove operation key=3H3D067Z8O0R tag=C9NBEW0KVBS1 type=del 2024-09-12T00:07:17.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.433+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~HRSFMECPZGQZ.0 size=1048576 2024-09-12T00:07:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.435+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~HRSFMECPZGQZ.1 size=108851 2024-09-12T00:07:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.435+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=HRSFMECPZGQZ tag=DZMGQ580FJPV type=write size=2206003 2024-09-12T00:07:17.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.436+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~90IZ0QY270UV.0 size=1048576 2024-09-12T00:07:17.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.437+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~90IZ0QY270UV.1 size=1048576 2024-09-12T00:07:17.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.438+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~90IZ0QY270UV.2 size=284879 2024-09-12T00:07:17.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.441+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=90IZ0QY270UV tag=KDA403TM25R1 type=write size=3430607 2024-09-12T00:07:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.442+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=1CXEHRMO1M0Z type=del size=1126778 2024-09-12T00:07:17.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.445+0000 7f82f8930780 1 < suggested remove operation key=Y8GDXNDCOHCW tag=MTG16WILKXDI type=write 2024-09-12T00:07:17.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.447+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=EQ6E65ORIS5H type=del size=1294539 2024-09-12T00:07:17.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.449+0000 7f82f8930780 1 < suggested remove operation key=NCIZ4HNPCZ94 tag=C15K5UU6XH6J type=del 2024-09-12T00:07:17.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.451+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=IGSFQURTWUAF type=del size=787741 2024-09-12T00:07:17.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.452+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~PQ5HXZBC3NK6.0 size=1048576 2024-09-12T00:07:17.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.454+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~PQ5HXZBC3NK6.1 size=635794 2024-09-12T00:07:17.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.456+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=PQ5HXZBC3NK6 tag=LJQGIOEDR6DW type=write size=2732946 2024-09-12T00:07:17.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.457+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=4KY8YOA10MSW type=del size=853182 2024-09-12T00:07:17.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.458+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~P3VQQ48O0UJH.0 size=1048576 2024-09-12T00:07:17.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.460+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~P3VQQ48O0UJH.1 size=892061 2024-09-12T00:07:17.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.462+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=P3VQQ48O0UJH tag=6IBTLE6VELIC type=write size=2989213 2024-09-12T00:07:17.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.465+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~KNIN2TJ330UB.0 size=332274 2024-09-12T00:07:17.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.465+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=KNIN2TJ330UB tag=3QKLN4UAXX6O type=write size=1380850 2024-09-12T00:07:17.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.466+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~DG5Y36YXY3MU.0 size=1048576 2024-09-12T00:07:17.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.466+0000 7f82f8930780 1 < canceled part key=_multipart_A8EFUP30RS65.2~DG5Y36YXY3MU.1 size=1048576 2024-09-12T00:07:17.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.468+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~DG5Y36YXY3MU.2 size=467629 2024-09-12T00:07:17.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.470+0000 7f82f8930780 1 < canceled multipart upload key=A8EFUP30RS65 upload=DG5Y36YXY3MU tag=FDM4ZB1UB7BC type=write size=3613357 2024-09-12T00:07:17.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.471+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=G61O5768D036 type=del size=111816 2024-09-12T00:07:17.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.474+0000 7f82f8930780 1 < suggested update operation key=MJZ56OX8PLSH tag=DKM4UQJUDUVV type=write size=768052 2024-09-12T00:07:17.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.475+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=0AX5JSYJ6YW5 type=del size=3837918 2024-09-12T00:07:17.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.477+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~66XUZ8NOROJF.0 size=1048576 2024-09-12T00:07:17.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.478+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~66XUZ8NOROJF.1 size=1048576 2024-09-12T00:07:17.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.478+0000 7f82f8930780 1 < canceled part key=_multipart_LAKJS79KNBY7.2~66XUZ8NOROJF.2 size=112306 2024-09-12T00:07:17.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.480+0000 7f82f8930780 1 < canceled multipart upload key=LAKJS79KNBY7 upload=66XUZ8NOROJF tag=BUQYXXHE9QRE type=write size=3258034 2024-09-12T00:07:17.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.481+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=QAY6AU38X018 type=del size=2756740 2024-09-12T00:07:17.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.483+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~80OC0PI14KY6.0 size=1048576 2024-09-12T00:07:17.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.483+0000 7f82f8930780 1 < canceled part key=_multipart_62X93NOS23AF.2~80OC0PI14KY6.1 size=271184 2024-09-12T00:07:17.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.485+0000 7f82f8930780 1 < canceled multipart upload key=62X93NOS23AF upload=80OC0PI14KY6 tag=OSRJDASSXH3K type=write size=2368336 2024-09-12T00:07:17.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.486+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=KAW1GUF8MF2W type=del size=1188278 2024-09-12T00:07:17.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.488+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~C1XI18MRC9X5.0 size=1048576 2024-09-12T00:07:17.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.489+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~C1XI18MRC9X5.1 size=1048576 2024-09-12T00:07:17.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.490+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~C1XI18MRC9X5.2 size=144189 2024-09-12T00:07:17.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.492+0000 7f82f8930780 1 < completed multipart upload key=IN8Y7I0HKP6D upload=C1XI18MRC9X5 tag=BE60FLBNCR2Y type=write size=3289917 2024-09-12T00:07:17.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.495+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~SFWBVFORUK8P.0 size=595521 2024-09-12T00:07:17.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.495+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=SFWBVFORUK8P tag=MQXF44CPVETP type=write size=1644097 2024-09-12T00:07:17.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.496+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~ILI8AXXG8O5O.0 size=1048576 2024-09-12T00:07:17.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.497+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~ILI8AXXG8O5O.1 size=1048576 2024-09-12T00:07:17.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.498+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~ILI8AXXG8O5O.2 size=599288 2024-09-12T00:07:17.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.501+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=ILI8AXXG8O5O tag=9A0MFAYUQ14R type=write size=3745016 2024-09-12T00:07:17.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.503+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=DAUX0LQHHVZ6 type=write size=743805 2024-09-12T00:07:17.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.504+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=JV9SAXQ99D1X type=del 2024-09-12T00:07:17.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.506+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=509VXX7UWVCL type=del size=2205367 2024-09-12T00:07:17.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.507+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~L504YY4AS25I.0 size=611438 2024-09-12T00:07:17.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.509+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=L504YY4AS25I tag=YWF4YPJXV2RO type=write size=1660014 2024-09-12T00:07:17.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.512+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=UOZJ23UH0QY9 type=del size=2434880 2024-09-12T00:07:17.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.513+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~86Z6MUGRRNCZ.0 size=1048576 2024-09-12T00:07:17.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.514+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~86Z6MUGRRNCZ.1 size=513619 2024-09-12T00:07:17.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.516+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=86Z6MUGRRNCZ tag=OWIZ67Q0XYW0 type=write size=2610771 2024-09-12T00:07:17.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.519+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~MEEZSCIPLKNZ.0 size=1048576 2024-09-12T00:07:17.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.520+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~MEEZSCIPLKNZ.1 size=1048576 2024-09-12T00:07:17.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.523+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~MEEZSCIPLKNZ.2 size=588745 2024-09-12T00:07:17.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.523+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=MEEZSCIPLKNZ tag=MVA2IQZITBAD type=write size=3734473 2024-09-12T00:07:17.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.524+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~AIU4UDMO0RWZ.0 size=1048576 2024-09-12T00:07:17.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.525+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~AIU4UDMO0RWZ.1 size=1048576 2024-09-12T00:07:17.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.526+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~AIU4UDMO0RWZ.2 size=129173 2024-09-12T00:07:17.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.529+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=AIU4UDMO0RWZ tag=073793QKMS5A type=write size=3274901 2024-09-12T00:07:17.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.531+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~630NEW5UDTRM.0 size=229835 2024-09-12T00:07:17.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.531+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=630NEW5UDTRM tag=MHHZ737940KQ type=write size=1278411 2024-09-12T00:07:17.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.532+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~HRSFMECPZGQZ.0 size=1048576 2024-09-12T00:07:17.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.533+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~HRSFMECPZGQZ.1 size=108851 2024-09-12T00:07:17.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.536+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=HRSFMECPZGQZ tag=DZMGQ580FJPV type=write size=2206003 2024-09-12T00:07:17.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.538+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=MYS2WO4WNE4J type=del size=1322556 2024-09-12T00:07:17.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.540+0000 7f82f8930780 1 < suggested remove operation key=9576W9WYJUJV tag=1CXEHRMO1M0Z type=del 2024-09-12T00:07:17.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.542+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~PEA1496U1GDJ.0 size=1048576 2024-09-12T00:07:17.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.543+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~PEA1496U1GDJ.1 size=161085 2024-09-12T00:07:17.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.543+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=PEA1496U1GDJ tag=1CRYR3K8WWX3 type=write size=2258237 2024-09-12T00:07:17.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.545+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=EQ6E65ORIS5H type=del 2024-09-12T00:07:17.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.547+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~X3Q72YILQ4TB.0 size=1048576 2024-09-12T00:07:17.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.549+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~X3Q72YILQ4TB.1 size=1048576 2024-09-12T00:07:17.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.550+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~X3Q72YILQ4TB.2 size=352237 2024-09-12T00:07:17.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.550+0000 7f82f8930780 1 > prepared multipart upload key=IN8Y7I0HKP6D upload=X3Q72YILQ4TB tag=XZ2CKJA4E8TO type=write size=3497965 2024-09-12T00:07:17.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.552+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=IGSFQURTWUAF type=del 2024-09-12T00:07:17.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.553+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=1XFSD0PT3JI8 type=del size=3107591 2024-09-12T00:07:17.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.555+0000 7f82f8930780 1 < suggested update operation key=Y5U8MO9TOJQQ tag=4KY8YOA10MSW type=del size=853182 2024-09-12T00:07:17.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.557+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=T3LS8C5W3QD6 type=del size=750849 2024-09-12T00:07:17.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.558+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~KNIN2TJ330UB.0 size=332274 2024-09-12T00:07:17.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.560+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=KNIN2TJ330UB tag=3QKLN4UAXX6O type=write size=1380850 2024-09-12T00:07:17.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.562+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=0DPXF2Q8A3W2 type=del size=935689 2024-09-12T00:07:17.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.563+0000 7f82f8930780 1 < canceled operation key=4SPRDO097JYQ tag=G61O5768D036 type=del size=111816 2024-09-12T00:07:17.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.565+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=8AKGTHW597EW type=del size=687649 2024-09-12T00:07:17.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.566+0000 7f82f8930780 1 < canceled operation key=3X2PLA3ODHJ1 tag=0AX5JSYJ6YW5 type=del size=3837918 2024-09-12T00:07:17.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.568+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~37VU9M20873Q.0 size=787939 2024-09-12T00:07:17.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.568+0000 7f82f8930780 1 > prepared multipart upload key=4IA4918NXXJW upload=37VU9M20873Q tag=TSJ0K2SIAAJ6 type=write size=1836515 2024-09-12T00:07:17.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.570+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=QAY6AU38X018 type=del 2024-09-12T00:07:17.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.571+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=IS7CEJC8DAP4 type=del size=3748264 2024-09-12T00:07:17.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.573+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=KAW1GUF8MF2W type=del 2024-09-12T00:07:17.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.574+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=4YDV2XDJAB0D type=del size=437965 2024-09-12T00:07:17.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.575+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~SFWBVFORUK8P.0 size=595521 2024-09-12T00:07:17.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.578+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=SFWBVFORUK8P tag=MQXF44CPVETP type=write size=1644097 2024-09-12T00:07:17.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.580+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~7NGIYUZDKVVF.0 size=554306 2024-09-12T00:07:17.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.580+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=7NGIYUZDKVVF tag=F2EF27TQA579 type=write size=1602882 2024-09-12T00:07:17.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.583+0000 7f82f8930780 1 < completed write operation key=80OUXNDPLGAG tag=DAUX0LQHHVZ6 type=write size=743805 2024-09-12T00:07:17.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.584+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~0VMY6K1921GX.0 size=1048576 2024-09-12T00:07:17.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.586+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~0VMY6K1921GX.1 size=1048576 2024-09-12T00:07:17.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.587+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~0VMY6K1921GX.2 size=803965 2024-09-12T00:07:17.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.587+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=0VMY6K1921GX tag=5TH1RFZQPG5Y type=write size=3949693 2024-09-12T00:07:17.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.588+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=509VXX7UWVCL type=del 2024-09-12T00:07:17.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.591+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~XNEYL4QYIXV8.0 size=893300 2024-09-12T00:07:17.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.591+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=XNEYL4QYIXV8 tag=IQFLHLYXYJLB type=write size=1941876 2024-09-12T00:07:17.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.592+0000 7f82f8930780 1 < canceled operation key=3H3D067Z8O0R tag=UOZJ23UH0QY9 type=del size=2434880 2024-09-12T00:07:17.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.595+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=EC4PTY775W6K type=del size=317283 2024-09-12T00:07:17.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.596+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~MEEZSCIPLKNZ.0 size=1048576 2024-09-12T00:07:17.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.597+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~MEEZSCIPLKNZ.1 size=1048576 2024-09-12T00:07:17.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.598+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~MEEZSCIPLKNZ.2 size=588745 2024-09-12T00:07:17.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.600+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=MEEZSCIPLKNZ tag=MVA2IQZITBAD type=write size=3734473 2024-09-12T00:07:17.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.603+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~7EH31SY29WRW.0 size=1048576 2024-09-12T00:07:17.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.603+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~7EH31SY29WRW.1 size=1048576 2024-09-12T00:07:17.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.604+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~7EH31SY29WRW.2 size=553468 2024-09-12T00:07:17.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.605+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=7EH31SY29WRW tag=B29UVMLHHH8F type=write size=3699196 2024-09-12T00:07:17.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.605+0000 7f82f8930780 1 < canceled part key=_multipart_X3PCR8TCWDTK.2~630NEW5UDTRM.0 size=229835 2024-09-12T00:07:17.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.607+0000 7f82f8930780 1 < canceled multipart upload key=X3PCR8TCWDTK upload=630NEW5UDTRM tag=MHHZ737940KQ type=write size=1278411 2024-09-12T00:07:17.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.608+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=SBJ15PTS6EX0 type=del size=1634124 2024-09-12T00:07:17.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.610+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=MYS2WO4WNE4J type=del 2024-09-12T00:07:17.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.611+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=MPYQPMC2JMXY type=write size=289297 2024-09-12T00:07:17.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.613+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~PEA1496U1GDJ.0 size=1048576 2024-09-12T00:07:17.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.614+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~PEA1496U1GDJ.1 size=161085 2024-09-12T00:07:17.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.616+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=PEA1496U1GDJ tag=1CRYR3K8WWX3 type=write size=2258237 2024-09-12T00:07:17.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.618+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~Z37V96KG634J.0 size=1048576 2024-09-12T00:07:17.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.619+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~Z37V96KG634J.1 size=1048576 2024-09-12T00:07:17.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.621+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~Z37V96KG634J.2 size=273167 2024-09-12T00:07:17.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.621+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=Z37V96KG634J tag=PMQL0KN2KNG4 type=write size=3418895 2024-09-12T00:07:17.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.621+0000 7f82f8930780 1 < canceled part key=_multipart_IN8Y7I0HKP6D.2~X3Q72YILQ4TB.0 size=1048576 2024-09-12T00:07:17.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.622+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~X3Q72YILQ4TB.1 size=1048576 2024-09-12T00:07:17.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.624+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~X3Q72YILQ4TB.2 size=352237 2024-09-12T00:07:17.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.626+0000 7f82f8930780 1 < canceled multipart upload key=IN8Y7I0HKP6D upload=X3Q72YILQ4TB tag=XZ2CKJA4E8TO type=write size=3497965 2024-09-12T00:07:17.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.627+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=63H4NXR9572I type=del size=2169156 2024-09-12T00:07:17.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.628+0000 7f82f8930780 1 < canceled operation key=W8SAQZWQHY36 tag=1XFSD0PT3JI8 type=del size=3107591 2024-09-12T00:07:17.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.630+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=T0PT4ZBDK3DA type=del size=3754046 2024-09-12T00:07:17.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.632+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=T3LS8C5W3QD6 type=del 2024-09-12T00:07:17.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.633+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=BTCAMEIYB1PS type=del size=72941 2024-09-12T00:07:17.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.634+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=0DPXF2Q8A3W2 type=del 2024-09-12T00:07:17.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.635+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=7G9E0SP0N6EW type=del size=2959335 2024-09-12T00:07:17.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.639+0000 7f82f8930780 1 < suggested update operation key=X3PCR8TCWDTK tag=8AKGTHW597EW type=del size=687649 2024-09-12T00:07:17.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.640+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=D927G9S292WF type=del size=2465389 2024-09-12T00:07:17.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.641+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~37VU9M20873Q.0 size=787939 2024-09-12T00:07:17.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.643+0000 7f82f8930780 1 < completed multipart upload key=4IA4918NXXJW upload=37VU9M20873Q tag=TSJ0K2SIAAJ6 type=write size=1836515 2024-09-12T00:07:17.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.646+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~LK7NTZ0L2MR5.0 size=1048576 2024-09-12T00:07:17.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.648+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~LK7NTZ0L2MR5.1 size=2501 2024-09-12T00:07:17.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.648+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=LK7NTZ0L2MR5 tag=96H2H83MVOLW type=write size=2099653 2024-09-12T00:07:17.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.649+0000 7f82f8930780 1 < canceled operation key=FOWSB9RQ5TV5 tag=IS7CEJC8DAP4 type=del size=3748264 2024-09-12T00:07:17.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.653+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~TNQVMF9CEL15.0 size=762739 2024-09-12T00:07:17.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.653+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=TNQVMF9CEL15 tag=UJ8DWSAC8XE1 type=write size=1811315 2024-09-12T00:07:17.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.654+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=4YDV2XDJAB0D type=del 2024-09-12T00:07:17.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.655+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=NTG7H6OWXJ44 type=del size=497798 2024-09-12T00:07:17.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.656+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~7NGIYUZDKVVF.0 size=554306 2024-09-12T00:07:17.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.659+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=7NGIYUZDKVVF tag=F2EF27TQA579 type=write size=1602882 2024-09-12T00:07:17.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.660+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=O39Y6OBTYJNC type=del size=465692 2024-09-12T00:07:17.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.661+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~0VMY6K1921GX.0 size=1048576 2024-09-12T00:07:17.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.663+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~0VMY6K1921GX.1 size=1048576 2024-09-12T00:07:17.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.664+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~0VMY6K1921GX.2 size=803965 2024-09-12T00:07:17.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.666+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=0VMY6K1921GX tag=5TH1RFZQPG5Y type=write size=3949693 2024-09-12T00:07:17.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.668+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=MKOFMNF5B3U9 type=del size=1978275 2024-09-12T00:07:17.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.669+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~XNEYL4QYIXV8.0 size=893300 2024-09-12T00:07:17.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.672+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=XNEYL4QYIXV8 tag=IQFLHLYXYJLB type=write size=1941876 2024-09-12T00:07:17.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.673+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=X9KOL1O18LYC type=del size=2691780 2024-09-12T00:07:17.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.676+0000 7f82f8930780 1 < suggested update operation key=77SDZHCSP0E3 tag=EC4PTY775W6K type=del size=317283 2024-09-12T00:07:17.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.679+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~G1SUQ1X5D6PR.0 size=370408 2024-09-12T00:07:17.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.679+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=G1SUQ1X5D6PR tag=MZKUPRAHQS49 type=write size=1418984 2024-09-12T00:07:17.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.680+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~7EH31SY29WRW.0 size=1048576 2024-09-12T00:07:17.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.681+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~7EH31SY29WRW.1 size=1048576 2024-09-12T00:07:17.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.683+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~7EH31SY29WRW.2 size=553468 2024-09-12T00:07:17.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.685+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=7EH31SY29WRW tag=B29UVMLHHH8F type=write size=3699196 2024-09-12T00:07:17.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.688+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~EOZTFSC6FAP8.0 size=1048576 2024-09-12T00:07:17.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.689+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~EOZTFSC6FAP8.1 size=12807 2024-09-12T00:07:17.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.689+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=EOZTFSC6FAP8 tag=ZBSD4O26P75J type=write size=2109959 2024-09-12T00:07:17.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.690+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=SBJ15PTS6EX0 type=del 2024-09-12T00:07:17.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.692+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=P87GTUH5RLNM type=del size=4036768 2024-09-12T00:07:17.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.695+0000 7f82f8930780 1 < suggested update operation key=2XM2CF1T4VGW tag=MPYQPMC2JMXY type=write size=289297 2024-09-12T00:07:17.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.696+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=1UI38KDB37L7 type=write size=444431 2024-09-12T00:07:17.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.698+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~Z37V96KG634J.0 size=1048576 2024-09-12T00:07:17.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.699+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~Z37V96KG634J.1 size=1048576 2024-09-12T00:07:17.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.700+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~Z37V96KG634J.2 size=273167 2024-09-12T00:07:17.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.702+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=Z37V96KG634J tag=PMQL0KN2KNG4 type=write size=3418895 2024-09-12T00:07:17.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.705+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~JXY7X4NKCITI.0 size=1048576 2024-09-12T00:07:17.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.706+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~JXY7X4NKCITI.1 size=1048576 2024-09-12T00:07:17.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.708+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~JXY7X4NKCITI.2 size=915345 2024-09-12T00:07:17.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.708+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=JXY7X4NKCITI tag=CIDMNV8MMRGL type=write size=4061073 2024-09-12T00:07:17.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.708+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=63H4NXR9572I type=del 2024-09-12T00:07:17.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.711+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~6UKZ1WNZN8KB.0 size=1048576 2024-09-12T00:07:17.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.712+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~6UKZ1WNZN8KB.1 size=523229 2024-09-12T00:07:17.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.712+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=6UKZ1WNZN8KB tag=MSBJOODUG3ZR type=write size=2620381 2024-09-12T00:07:17.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.713+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=T0PT4ZBDK3DA type=del 2024-09-12T00:07:17.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.715+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=R9B33V0XW36I type=del size=3304421 2024-09-12T00:07:17.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.718+0000 7f82f8930780 1 < suggested remove operation key=N2TYUAJITFNL tag=BTCAMEIYB1PS type=del 2024-09-12T00:07:17.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.719+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=FGTK7R7IVNC0 type=del size=144970 2024-09-12T00:07:17.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.720+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=7G9E0SP0N6EW type=del 2024-09-12T00:07:17.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.722+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=BFTS2GSLLNLP type=del size=2197577 2024-09-12T00:07:17.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.724+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=D927G9S292WF type=del 2024-09-12T00:07:17.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.725+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=MKGGFGA5H8VJ type=write size=599968 2024-09-12T00:07:17.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.726+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~LK7NTZ0L2MR5.0 size=1048576 2024-09-12T00:07:17.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.726+0000 7f82f8930780 1 < canceled part key=_multipart_9576W9WYJUJV.2~LK7NTZ0L2MR5.1 size=2501 2024-09-12T00:07:17.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.728+0000 7f82f8930780 1 < canceled multipart upload key=9576W9WYJUJV upload=LK7NTZ0L2MR5 tag=96H2H83MVOLW type=write size=2099653 2024-09-12T00:07:17.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.730+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=XSBT06EK1A07 type=del size=3161264 2024-09-12T00:07:17.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.731+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~TNQVMF9CEL15.0 size=762739 2024-09-12T00:07:17.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.733+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=TNQVMF9CEL15 tag=UJ8DWSAC8XE1 type=write size=1811315 2024-09-12T00:07:17.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.735+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=C28T7HH0XBWT type=del size=1461912 2024-09-12T00:07:17.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.736+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=NTG7H6OWXJ44 type=del 2024-09-12T00:07:17.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.737+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=TBYKF7XK50SW type=del size=1639870 2024-09-12T00:07:17.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.740+0000 7f82f8930780 1 < suggested remove operation key=4IA4918NXXJW tag=O39Y6OBTYJNC type=del 2024-09-12T00:07:17.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.741+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=IEAQM2LTZTU3 type=write size=693796 2024-09-12T00:07:17.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.743+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=MKOFMNF5B3U9 type=del 2024-09-12T00:07:17.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.744+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=FPJTY9XMMWYI type=del size=2268764 2024-09-12T00:07:17.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.745+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=X9KOL1O18LYC type=del 2024-09-12T00:07:17.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.747+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=ZC4HDUZVFJ19 type=del size=3027352 2024-09-12T00:07:17.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.749+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~G1SUQ1X5D6PR.0 size=370408 2024-09-12T00:07:17.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.751+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=G1SUQ1X5D6PR tag=MZKUPRAHQS49 type=write size=1418984 2024-09-12T00:07:17.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.753+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=F22V39DZSWD6 type=del size=1433992 2024-09-12T00:07:17.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.753+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~EOZTFSC6FAP8.0 size=1048576 2024-09-12T00:07:17.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.755+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~EOZTFSC6FAP8.1 size=12807 2024-09-12T00:07:17.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.757+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=EOZTFSC6FAP8 tag=ZBSD4O26P75J type=write size=2109959 2024-09-12T00:07:17.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.758+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=O44DQGTSIYLW type=del size=1602384 2024-09-12T00:07:17.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.759+0000 7f82f8930780 1 < completed delete operation key=FOWSB9RQ5TV5 tag=P87GTUH5RLNM type=del 2024-09-12T00:07:17.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.762+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~D34K1303JAWU.0 size=1048576 2024-09-12T00:07:17.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.763+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~D34K1303JAWU.1 size=1048576 2024-09-12T00:07:17.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.764+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~D34K1303JAWU.2 size=956186 2024-09-12T00:07:17.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.764+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=D34K1303JAWU tag=O2Y05IDXN71A type=write size=4101914 2024-09-12T00:07:17.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.765+0000 7f82f8930780 1 < completed write operation key=FHQADENLR6GP tag=1UI38KDB37L7 type=write size=444431 2024-09-12T00:07:17.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.767+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=RZ4218371KKI type=del size=1589531 2024-09-12T00:07:17.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.768+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~JXY7X4NKCITI.0 size=1048576 2024-09-12T00:07:17.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.769+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~JXY7X4NKCITI.1 size=1048576 2024-09-12T00:07:17.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.771+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~JXY7X4NKCITI.2 size=915345 2024-09-12T00:07:17.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.773+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=JXY7X4NKCITI tag=CIDMNV8MMRGL type=write size=4061073 2024-09-12T00:07:17.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.774+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=GI4MYI05FOW5 type=del size=3462835 2024-09-12T00:07:17.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.775+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~6UKZ1WNZN8KB.0 size=1048576 2024-09-12T00:07:17.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.776+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~6UKZ1WNZN8KB.1 size=523229 2024-09-12T00:07:17.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.779+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=6UKZ1WNZN8KB tag=MSBJOODUG3ZR type=write size=2620381 2024-09-12T00:07:17.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.780+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=7LCKJ6D3KKRW type=del size=978094 2024-09-12T00:07:17.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.782+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=R9B33V0XW36I type=del 2024-09-12T00:07:17.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.785+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~N6D38B832AET.0 size=1048576 2024-09-12T00:07:17.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.786+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~N6D38B832AET.1 size=779618 2024-09-12T00:07:17.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.786+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=N6D38B832AET tag=LHV02FIKU497 type=write size=2876770 2024-09-12T00:07:17.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.787+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=FGTK7R7IVNC0 type=del 2024-09-12T00:07:17.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.789+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=7ESV9KB5BDG3 type=write size=475012 2024-09-12T00:07:17.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.790+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=BFTS2GSLLNLP type=del 2024-09-12T00:07:17.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.792+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=5TWMRO4NQZ45 type=write size=85374 2024-09-12T00:07:17.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.793+0000 7f82f8930780 1 < completed write operation key=77SDZHCSP0E3 tag=MKGGFGA5H8VJ type=write size=599968 2024-09-12T00:07:17.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.794+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=IF7206WJQMA3 type=write size=101311 2024-09-12T00:07:17.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.797+0000 7f82f8930780 1 < suggested update operation key=FHQADENLR6GP tag=XSBT06EK1A07 type=del size=3161264 2024-09-12T00:07:17.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.798+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=P9L50MH11X5G type=del size=718401 2024-09-12T00:07:17.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.801+0000 7f82f8930780 1 < canceled operation key=OVJOP07M9KB8 tag=C28T7HH0XBWT type=del size=1461912 2024-09-12T00:07:17.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.802+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=3QAI4XI6LEGN type=del size=3456442 2024-09-12T00:07:17.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.805+0000 7f82f8930780 1 < suggested remove operation key=MJZ56OX8PLSH tag=TBYKF7XK50SW type=del 2024-09-12T00:07:17.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.806+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~RJ37EQHIZK66.0 size=1048576 2024-09-12T00:07:17.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.808+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~RJ37EQHIZK66.1 size=1048576 2024-09-12T00:07:17.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.809+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~RJ37EQHIZK66.2 size=892304 2024-09-12T00:07:17.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.809+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=RJ37EQHIZK66 tag=6ZCK5B8C8GEX type=write size=4038032 2024-09-12T00:07:17.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.811+0000 7f82f8930780 1 < suggested update operation key=75GYP042UUC2 tag=IEAQM2LTZTU3 type=write size=693796 2024-09-12T00:07:17.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.814+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~L5PFW3VTD7QA.0 size=1048576 2024-09-12T00:07:17.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.815+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~L5PFW3VTD7QA.1 size=1048576 2024-09-12T00:07:17.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.816+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~L5PFW3VTD7QA.2 size=805959 2024-09-12T00:07:17.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.816+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=L5PFW3VTD7QA tag=F4EBD3WON7X2 type=write size=3951687 2024-09-12T00:07:17.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.817+0000 7f82f8930780 -1 < failed to complete operation key=MJZ56OX8PLSH tag=FPJTY9XMMWYI type=del size=2268764: (22) Invalid argument 2024-09-12T00:07:17.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.819+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=PW07ELIEI8JT type=del size=3058939 2024-09-12T00:07:17.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.820+0000 7f82f8930780 1 < completed delete operation key=HCK59C6MAW0B tag=ZC4HDUZVFJ19 type=del 2024-09-12T00:07:17.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.821+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=4NMMLNZJZPDK type=del size=3732561 2024-09-12T00:07:17.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.823+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=F22V39DZSWD6 type=del 2024-09-12T00:07:17.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.824+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=E08Q20MFX92D type=del size=191209 2024-09-12T00:07:17.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.825+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=O44DQGTSIYLW type=del 2024-09-12T00:07:17.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.827+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=PASU8PA2N2DF type=del size=468090 2024-09-12T00:07:17.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.827+0000 7f82f8930780 1 < canceled part key=_multipart_LAKJS79KNBY7.2~D34K1303JAWU.0 size=1048576 2024-09-12T00:07:17.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.828+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~D34K1303JAWU.1 size=1048576 2024-09-12T00:07:17.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.829+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~D34K1303JAWU.2 size=956186 2024-09-12T00:07:17.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.832+0000 7f82f8930780 1 < canceled multipart upload key=LAKJS79KNBY7 upload=D34K1303JAWU tag=O2Y05IDXN71A type=write size=4101914 2024-09-12T00:07:17.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.834+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~BKP05ZBEVR9Y.0 size=1048576 2024-09-12T00:07:17.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.836+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~BKP05ZBEVR9Y.1 size=1048576 2024-09-12T00:07:17.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.837+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~BKP05ZBEVR9Y.2 size=350802 2024-09-12T00:07:17.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.837+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=BKP05ZBEVR9Y tag=AM55QYBZ2E9N type=write size=3496530 2024-09-12T00:07:17.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.838+0000 7f82f8930780 -1 < failed to complete operation key=MJZ56OX8PLSH tag=RZ4218371KKI type=del size=1589531: (22) Invalid argument 2024-09-12T00:07:17.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.841+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~0AYO5F1BJ03G.0 size=928022 2024-09-12T00:07:17.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.841+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=0AYO5F1BJ03G tag=TLX7SMZZXVGA type=write size=1976598 2024-09-12T00:07:17.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.842+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=GI4MYI05FOW5 type=del 2024-09-12T00:07:17.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.844+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=5HFQT9CHQ5D5 type=del size=3618413 2024-09-12T00:07:17.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.845+0000 7f82f8930780 1 < canceled operation key=N2TYUAJITFNL tag=7LCKJ6D3KKRW type=del size=978094 2024-09-12T00:07:17.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.848+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~XIYMB04YAF2E.0 size=1048576 2024-09-12T00:07:17.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.849+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~XIYMB04YAF2E.1 size=443865 2024-09-12T00:07:17.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.849+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=XIYMB04YAF2E tag=0UKNPRPA022V type=write size=2541017 2024-09-12T00:07:17.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.850+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~N6D38B832AET.0 size=1048576 2024-09-12T00:07:17.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.852+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~N6D38B832AET.1 size=779618 2024-09-12T00:07:17.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.854+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=N6D38B832AET tag=LHV02FIKU497 type=write size=2876770 2024-09-12T00:07:17.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.855+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=M3QLQOOGJTI9 type=del size=1990396 2024-09-12T00:07:17.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.858+0000 7f82f8930780 1 < suggested update operation key=A8EFUP30RS65 tag=7ESV9KB5BDG3 type=write size=475012 2024-09-12T00:07:17.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.859+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=R70A7LGP50ID type=write size=128480 2024-09-12T00:07:17.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.861+0000 7f82f8930780 1 < completed write operation key=X3PCR8TCWDTK tag=5TWMRO4NQZ45 type=write size=85374 2024-09-12T00:07:17.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.863+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=Y3XLT9MTT10P type=write size=337420 2024-09-12T00:07:17.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.863+0000 7f82f8930780 1 < completed write operation key=4IA4918NXXJW tag=IF7206WJQMA3 type=write size=101311 2024-09-12T00:07:17.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.866+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~LAWPRAQ7AEWN.0 size=1048576 2024-09-12T00:07:17.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.867+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~LAWPRAQ7AEWN.1 size=1048576 2024-09-12T00:07:17.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.868+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~LAWPRAQ7AEWN.2 size=201723 2024-09-12T00:07:17.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.868+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=LAWPRAQ7AEWN tag=7K4X6O4N68KV type=write size=3347451 2024-09-12T00:07:17.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.870+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=P9L50MH11X5G type=del 2024-09-12T00:07:17.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.871+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=ICR60DFL9MQ6 type=write size=542243 2024-09-12T00:07:17.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.873+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=3QAI4XI6LEGN type=del 2024-09-12T00:07:17.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.875+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~YILXR18GX04E.0 size=1017754 2024-09-12T00:07:17.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.875+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=YILXR18GX04E tag=R1YQYP30TFQW type=write size=2066330 2024-09-12T00:07:17.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.877+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~RJ37EQHIZK66.0 size=1048576 2024-09-12T00:07:17.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.878+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~RJ37EQHIZK66.1 size=1048576 2024-09-12T00:07:17.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.879+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~RJ37EQHIZK66.2 size=892304 2024-09-12T00:07:17.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.881+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=RJ37EQHIZK66 tag=6ZCK5B8C8GEX type=write size=4038032 2024-09-12T00:07:17.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.884+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~FTUJVB1DSUQW.0 size=1048576 2024-09-12T00:07:17.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.885+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~FTUJVB1DSUQW.1 size=481731 2024-09-12T00:07:17.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.885+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=FTUJVB1DSUQW tag=QP4QGWIK63W3 type=write size=2578883 2024-09-12T00:07:17.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.886+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~L5PFW3VTD7QA.0 size=1048576 2024-09-12T00:07:17.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.888+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~L5PFW3VTD7QA.1 size=1048576 2024-09-12T00:07:17.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.888+0000 7f82f8930780 1 < canceled part key=_multipart_N2TYUAJITFNL.2~L5PFW3VTD7QA.2 size=805959 2024-09-12T00:07:17.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.890+0000 7f82f8930780 1 < canceled multipart upload key=N2TYUAJITFNL upload=L5PFW3VTD7QA tag=F4EBD3WON7X2 type=write size=3951687 2024-09-12T00:07:17.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.891+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=Q3O32RUIE1L6 type=del size=3716552 2024-09-12T00:07:17.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.893+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=PW07ELIEI8JT type=del 2024-09-12T00:07:17.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.895+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~PXI8VZNATJRW.0 size=448019 2024-09-12T00:07:17.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.895+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=PXI8VZNATJRW tag=0MDPLFSP2IZ0 type=write size=1496595 2024-09-12T00:07:17.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.898+0000 7f82f8930780 1 < suggested remove operation key=3X2PLA3ODHJ1 tag=4NMMLNZJZPDK type=del 2024-09-12T00:07:17.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.900+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~TEW444XSWWLS.0 size=979048 2024-09-12T00:07:17.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.901+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=TEW444XSWWLS tag=Y7YP57R2K88C type=write size=2027624 2024-09-12T00:07:17.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.902+0000 7f82f8930780 1 < canceled operation key=YWC5JUV5B2N6 tag=E08Q20MFX92D type=del size=191209 2024-09-12T00:07:17.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.903+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=JAJ8ER8BPLPI type=del size=363913 2024-09-12T00:07:17.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.905+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=PASU8PA2N2DF type=del 2024-09-12T00:07:17.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.907+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=WQ2Q0UMQSS41 type=del size=486286 2024-09-12T00:07:17.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.908+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~BKP05ZBEVR9Y.0 size=1048576 2024-09-12T00:07:17.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.909+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~BKP05ZBEVR9Y.1 size=1048576 2024-09-12T00:07:17.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.911+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~BKP05ZBEVR9Y.2 size=350802 2024-09-12T00:07:17.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.915+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=BKP05ZBEVR9Y tag=AM55QYBZ2E9N type=write size=3496530 2024-09-12T00:07:17.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.916+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=JMP53PJ6LXVH type=del size=323590 2024-09-12T00:07:17.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.917+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~0AYO5F1BJ03G.0 size=928022 2024-09-12T00:07:17.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.919+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=0AYO5F1BJ03G tag=TLX7SMZZXVGA type=write size=1976598 2024-09-12T00:07:17.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.922+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~WGEF64JVLUEO.0 size=1048576 2024-09-12T00:07:17.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.924+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~WGEF64JVLUEO.1 size=1048576 2024-09-12T00:07:17.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.925+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~WGEF64JVLUEO.2 size=354011 2024-09-12T00:07:17.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.925+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=WGEF64JVLUEO tag=JJP7RH5UF8JC type=write size=3499739 2024-09-12T00:07:17.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.926+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=5HFQT9CHQ5D5 type=del 2024-09-12T00:07:17.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.929+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~XUWFKU9OM0QK.0 size=1048576 2024-09-12T00:07:17.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.930+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~XUWFKU9OM0QK.1 size=499141 2024-09-12T00:07:17.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.930+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=XUWFKU9OM0QK tag=782D3CDZO0B6 type=write size=2596293 2024-09-12T00:07:17.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.932+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~XIYMB04YAF2E.0 size=1048576 2024-09-12T00:07:17.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.933+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~XIYMB04YAF2E.1 size=443865 2024-09-12T00:07:17.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.935+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=XIYMB04YAF2E tag=0UKNPRPA022V type=write size=2541017 2024-09-12T00:07:17.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.936+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=6ARGTD641Z79 type=write size=244452 2024-09-12T00:07:17.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.938+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=M3QLQOOGJTI9 type=del 2024-09-12T00:07:17.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.941+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~VEK4O65Q9L2S.0 size=571961 2024-09-12T00:07:17.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.941+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=VEK4O65Q9L2S tag=T5IR30324PBX type=write size=1620537 2024-09-12T00:07:17.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.942+0000 7f82f8930780 1 < completed write operation key=4SPRDO097JYQ tag=R70A7LGP50ID type=write size=128480 2024-09-12T00:07:17.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.943+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=7JQ5G2JRKA48 type=write size=976546 2024-09-12T00:07:17.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.945+0000 7f82f8930780 1 < completed write operation key=HCK59C6MAW0B tag=Y3XLT9MTT10P type=write size=337420 2024-09-12T00:07:17.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.948+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~CKB7R9UI0RHU.0 size=321770 2024-09-12T00:07:17.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.948+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=CKB7R9UI0RHU tag=7FQH756EC3C6 type=write size=1370346 2024-09-12T00:07:17.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.949+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~LAWPRAQ7AEWN.0 size=1048576 2024-09-12T00:07:17.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.950+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~LAWPRAQ7AEWN.1 size=1048576 2024-09-12T00:07:17.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.951+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~LAWPRAQ7AEWN.2 size=201723 2024-09-12T00:07:17.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.954+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=LAWPRAQ7AEWN tag=7K4X6O4N68KV type=write size=3347451 2024-09-12T00:07:17.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.956+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=WL9M29ZZGRTB type=del size=2704065 2024-09-12T00:07:17.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.959+0000 7f82f8930780 1 < suggested remove operation key=BJHGNT3HBS25 tag=ICR60DFL9MQ6 type=write 2024-09-12T00:07:17.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.960+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=QRIXSKBPEXN1 type=write size=473049 2024-09-12T00:07:17.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.962+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~YILXR18GX04E.0 size=1017754 2024-09-12T00:07:17.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.964+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=YILXR18GX04E tag=R1YQYP30TFQW type=write size=2066330 2024-09-12T00:07:17.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.966+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=9ZQZXY79A7J0 type=del size=1065709 2024-09-12T00:07:17.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.966+0000 7f82f8930780 1 < canceled part key=_multipart_A8EFUP30RS65.2~FTUJVB1DSUQW.0 size=1048576 2024-09-12T00:07:17.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.967+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~FTUJVB1DSUQW.1 size=481731 2024-09-12T00:07:17.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.969+0000 7f82f8930780 1 < canceled multipart upload key=A8EFUP30RS65 upload=FTUJVB1DSUQW tag=QP4QGWIK63W3 type=write size=2578883 2024-09-12T00:07:17.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.971+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=1X726S5VV0GT type=del size=3503303 2024-09-12T00:07:17.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.973+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=Q3O32RUIE1L6 type=del 2024-09-12T00:07:17.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.975+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~LTP1CYYKA2NI.0 size=237458 2024-09-12T00:07:17.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.975+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=LTP1CYYKA2NI tag=8OTLXKRJSHJ7 type=write size=1286034 2024-09-12T00:07:17.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.977+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~PXI8VZNATJRW.0 size=448019 2024-09-12T00:07:17.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.979+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=PXI8VZNATJRW tag=0MDPLFSP2IZ0 type=write size=1496595 2024-09-12T00:07:17.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.981+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=JEUSY4O23S7H type=del size=3534405 2024-09-12T00:07:17.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.981+0000 7f82f8930780 1 < canceled part key=_multipart_3X2PLA3ODHJ1.2~TEW444XSWWLS.0 size=979048 2024-09-12T00:07:17.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.984+0000 7f82f8930780 1 < canceled multipart upload key=3X2PLA3ODHJ1 upload=TEW444XSWWLS tag=Y7YP57R2K88C type=write size=2027624 2024-09-12T00:07:17.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.986+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~2IN2KP98SV8Q.0 size=577330 2024-09-12T00:07:17.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.986+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=2IN2KP98SV8Q tag=RJN4V1LB9ULS type=write size=1625906 2024-09-12T00:07:17.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.988+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=JAJ8ER8BPLPI type=del 2024-09-12T00:07:17.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.989+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=05U3ZXO15RJQ type=write size=435378 2024-09-12T00:07:17.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.993+0000 7f82f8930780 1 < suggested update operation key=N2TYUAJITFNL tag=WQ2Q0UMQSS41 type=del size=486286 2024-09-12T00:07:17.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.995+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~46IQIMXFL552.0 size=1048576 2024-09-12T00:07:17.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.996+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~46IQIMXFL552.1 size=1048576 2024-09-12T00:07:17.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.997+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~46IQIMXFL552.2 size=574056 2024-09-12T00:07:17.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.997+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=46IQIMXFL552 tag=DD7IHETU2F2Y type=write size=3719784 2024-09-12T00:07:17.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:17.999+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=JMP53PJ6LXVH type=del 2024-09-12T00:07:18.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.000+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=BA1E2WMWJSOF type=del size=2033580 2024-09-12T00:07:18.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.001+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~WGEF64JVLUEO.0 size=1048576 2024-09-12T00:07:18.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.003+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~WGEF64JVLUEO.1 size=1048576 2024-09-12T00:07:18.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.004+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~WGEF64JVLUEO.2 size=354011 2024-09-12T00:07:18.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.006+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=WGEF64JVLUEO tag=JJP7RH5UF8JC type=write size=3499739 2024-09-12T00:07:18.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.008+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~W3GBARL17XFW.0 size=1048576 2024-09-12T00:07:18.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.009+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~W3GBARL17XFW.1 size=1022406 2024-09-12T00:07:18.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.009+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=W3GBARL17XFW tag=XZJZ8T3OGPR1 type=write size=3119558 2024-09-12T00:07:18.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.011+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~XUWFKU9OM0QK.0 size=1048576 2024-09-12T00:07:18.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.013+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~XUWFKU9OM0QK.1 size=499141 2024-09-12T00:07:18.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.015+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=XUWFKU9OM0QK tag=782D3CDZO0B6 type=write size=2596293 2024-09-12T00:07:18.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.017+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~NAYE723582SL.0 size=1048576 2024-09-12T00:07:18.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.018+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~NAYE723582SL.1 size=746233 2024-09-12T00:07:18.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.018+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=NAYE723582SL tag=UHS6ARL2P6B5 type=write size=2843385 2024-09-12T00:07:18.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.019+0000 7f82f8930780 1 < completed write operation key=HCK59C6MAW0B tag=6ARGTD641Z79 type=write size=244452 2024-09-12T00:07:18.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.020+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=8JJDP8G008HL type=del size=1005669 2024-09-12T00:07:18.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.022+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~VEK4O65Q9L2S.0 size=571961 2024-09-12T00:07:18.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.024+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=VEK4O65Q9L2S tag=T5IR30324PBX type=write size=1620537 2024-09-12T00:07:18.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.026+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=O4PFNP91TTNS type=del size=2375051 2024-09-12T00:07:18.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.027+0000 7f82f8930780 1 < completed write operation key=4IA4918NXXJW tag=7JQ5G2JRKA48 type=write size=976546 2024-09-12T00:07:18.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.030+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~FGTGFPIML2UK.0 size=798983 2024-09-12T00:07:18.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.030+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=FGTGFPIML2UK tag=CMPYQ6U9A02F type=write size=1847559 2024-09-12T00:07:18.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.031+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~CKB7R9UI0RHU.0 size=321770 2024-09-12T00:07:18.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.034+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=CKB7R9UI0RHU tag=7FQH756EC3C6 type=write size=1370346 2024-09-12T00:07:18.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.035+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=1AMLAJ5FXGET type=del size=1521309 2024-09-12T00:07:18.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.038+0000 7f82f8930780 1 < suggested update operation key=Y5U8MO9TOJQQ tag=WL9M29ZZGRTB type=del size=2704065 2024-09-12T00:07:18.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.040+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=2942JHK8VLNE type=del size=970636 2024-09-12T00:07:18.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.041+0000 7f82f8930780 1 < completed write operation key=AMWMQXO10EXK tag=QRIXSKBPEXN1 type=write size=473049 2024-09-12T00:07:18.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.043+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~IXEH3T7C2CAO.0 size=1048576 2024-09-12T00:07:18.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.044+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~IXEH3T7C2CAO.1 size=627009 2024-09-12T00:07:18.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.044+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=IXEH3T7C2CAO tag=HJXKUGZXS7H5 type=write size=2724161 2024-09-12T00:07:18.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.046+0000 7f82f8930780 -1 < failed to complete operation key=Y5U8MO9TOJQQ tag=9ZQZXY79A7J0 type=del size=1065709: (22) Invalid argument 2024-09-12T00:07:18.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.049+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=3B4COHVAEA7S type=del size=1461204 2024-09-12T00:07:18.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.051+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=1X726S5VV0GT type=del 2024-09-12T00:07:18.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.052+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=W1524HD45VK1 type=write size=849421 2024-09-12T00:07:18.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.052+0000 7f82f8930780 1 < canceled part key=_multipart_BJHGNT3HBS25.2~LTP1CYYKA2NI.0 size=237458 2024-09-12T00:07:18.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.054+0000 7f82f8930780 1 < canceled multipart upload key=BJHGNT3HBS25 upload=LTP1CYYKA2NI tag=8OTLXKRJSHJ7 type=write size=1286034 2024-09-12T00:07:18.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.056+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=AJ93ZKT2M18G type=del size=1199404 2024-09-12T00:07:18.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.057+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=JEUSY4O23S7H type=del 2024-09-12T00:07:18.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.060+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~HZZD8Q3LPBAD.0 size=1048576 2024-09-12T00:07:18.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.061+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~HZZD8Q3LPBAD.1 size=420245 2024-09-12T00:07:18.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.061+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=HZZD8Q3LPBAD tag=1H0OT3I5MZG3 type=write size=2517397 2024-09-12T00:07:18.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.062+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~2IN2KP98SV8Q.0 size=577330 2024-09-12T00:07:18.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.065+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=2IN2KP98SV8Q tag=RJN4V1LB9ULS type=write size=1625906 2024-09-12T00:07:18.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.067+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=PCCWML3D87WB type=del size=921515 2024-09-12T00:07:18.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.069+0000 7f82f8930780 1 < completed write operation key=62X93NOS23AF tag=05U3ZXO15RJQ type=write size=435378 2024-09-12T00:07:18.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.069+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=1KSVWJSIFT30 type=del size=587211 2024-09-12T00:07:18.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.071+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~46IQIMXFL552.0 size=1048576 2024-09-12T00:07:18.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.072+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~46IQIMXFL552.1 size=1048576 2024-09-12T00:07:18.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.073+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~46IQIMXFL552.2 size=574056 2024-09-12T00:07:18.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.075+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=46IQIMXFL552 tag=DD7IHETU2F2Y type=write size=3719784 2024-09-12T00:07:18.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.078+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~0RR9WJFI2DCO.0 size=1048576 2024-09-12T00:07:18.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.079+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~0RR9WJFI2DCO.1 size=948413 2024-09-12T00:07:18.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.079+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=0RR9WJFI2DCO tag=KXC1KFVNP44Q type=write size=3045565 2024-09-12T00:07:18.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.080+0000 7f82f8930780 1 < canceled operation key=3X2PLA3ODHJ1 tag=BA1E2WMWJSOF type=del size=2033580 2024-09-12T00:07:18.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.082+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=FI6EBI1TSJUJ type=del size=344410 2024-09-12T00:07:18.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.083+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~W3GBARL17XFW.0 size=1048576 2024-09-12T00:07:18.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.084+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~W3GBARL17XFW.1 size=1022406 2024-09-12T00:07:18.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.087+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=W3GBARL17XFW tag=XZJZ8T3OGPR1 type=write size=3119558 2024-09-12T00:07:18.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.088+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=4EKWQZ5M684A type=del size=872813 2024-09-12T00:07:18.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.090+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~NAYE723582SL.0 size=1048576 2024-09-12T00:07:18.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.091+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~NAYE723582SL.1 size=746233 2024-09-12T00:07:18.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.095+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=NAYE723582SL tag=UHS6ARL2P6B5 type=write size=2843385 2024-09-12T00:07:18.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.095+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=MJ69PHEQPCR1 type=del size=1501516 2024-09-12T00:07:18.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.097+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=8JJDP8G008HL type=del 2024-09-12T00:07:18.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.098+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=O7RK392CEL0D type=del size=469912 2024-09-12T00:07:18.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.100+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=O4PFNP91TTNS type=del 2024-09-12T00:07:18.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.102+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~NA0CIEUE8JGS.0 size=1048576 2024-09-12T00:07:18.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.103+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~NA0CIEUE8JGS.1 size=409160 2024-09-12T00:07:18.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.103+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=NA0CIEUE8JGS tag=0ZI465VZ25HT type=write size=2506312 2024-09-12T00:07:18.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.105+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~FGTGFPIML2UK.0 size=798983 2024-09-12T00:07:18.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.108+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=FGTGFPIML2UK tag=CMPYQ6U9A02F type=write size=1847559 2024-09-12T00:07:18.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.110+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~UMKJ5UNCLFKJ.0 size=1048576 2024-09-12T00:07:18.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.112+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~UMKJ5UNCLFKJ.1 size=1048576 2024-09-12T00:07:18.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.113+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~UMKJ5UNCLFKJ.2 size=1018576 2024-09-12T00:07:18.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.113+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=UMKJ5UNCLFKJ tag=HDYAGY3R8FDA type=write size=4164304 2024-09-12T00:07:18.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.115+0000 7f82f8930780 1 < suggested update operation key=FOWSB9RQ5TV5 tag=1AMLAJ5FXGET type=del size=1521309 2024-09-12T00:07:18.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.117+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~4ZK1DGOC7BQ5.0 size=352515 2024-09-12T00:07:18.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.117+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=4ZK1DGOC7BQ5 tag=12TWMFTOSCO1 type=write size=1401091 2024-09-12T00:07:18.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.119+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=2942JHK8VLNE type=del 2024-09-12T00:07:18.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.121+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~DUDFH0RAGQOZ.0 size=52298 2024-09-12T00:07:18.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.121+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=DUDFH0RAGQOZ tag=AI47BASMUVFB type=write size=1100874 2024-09-12T00:07:18.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.123+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~IXEH3T7C2CAO.0 size=1048576 2024-09-12T00:07:18.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.124+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~IXEH3T7C2CAO.1 size=627009 2024-09-12T00:07:18.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.126+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=IXEH3T7C2CAO tag=HJXKUGZXS7H5 type=write size=2724161 2024-09-12T00:07:18.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.129+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~QNL3VVN1HA1V.0 size=1048576 2024-09-12T00:07:18.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.130+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~QNL3VVN1HA1V.1 size=1048576 2024-09-12T00:07:18.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.131+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~QNL3VVN1HA1V.2 size=658804 2024-09-12T00:07:18.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.131+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=QNL3VVN1HA1V tag=PF9R2J4AIMP7 type=write size=3804532 2024-09-12T00:07:18.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.132+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=3B4COHVAEA7S type=del 2024-09-12T00:07:18.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.136+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~UMSXBUBDEF6O.0 size=95825 2024-09-12T00:07:18.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.136+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=UMSXBUBDEF6O tag=TQTW60T9R37I type=write size=1144401 2024-09-12T00:07:18.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.137+0000 7f82f8930780 1 < completed write operation key=77SDZHCSP0E3 tag=W1524HD45VK1 type=write size=849421 2024-09-12T00:07:18.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.139+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=PZZ336IX43Q6 type=write size=991826 2024-09-12T00:07:18.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.140+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=AJ93ZKT2M18G type=del 2024-09-12T00:07:18.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.142+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=K26HY1T199EG type=del size=1642075 2024-09-12T00:07:18.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.143+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~HZZD8Q3LPBAD.0 size=1048576 2024-09-12T00:07:18.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.144+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~HZZD8Q3LPBAD.1 size=420245 2024-09-12T00:07:18.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.147+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=HZZD8Q3LPBAD tag=1H0OT3I5MZG3 type=write size=2517397 2024-09-12T00:07:18.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.148+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=Y19BVGU60PJV type=del size=3299727 2024-09-12T00:07:18.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.150+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=PCCWML3D87WB type=del 2024-09-12T00:07:18.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.151+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=LHU44YU5XHHP type=del size=4115069 2024-09-12T00:07:18.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.155+0000 7f82f8930780 1 < suggested remove operation key=O2ZGU2KOTUOT tag=1KSVWJSIFT30 type=del 2024-09-12T00:07:18.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.156+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=3NXUDJX621XI type=del size=3740609 2024-09-12T00:07:18.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.157+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~0RR9WJFI2DCO.0 size=1048576 2024-09-12T00:07:18.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.159+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~0RR9WJFI2DCO.1 size=948413 2024-09-12T00:07:18.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.161+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=0RR9WJFI2DCO tag=KXC1KFVNP44Q type=write size=3045565 2024-09-12T00:07:18.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.163+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~XZE5XHE26N2P.0 size=1048576 2024-09-12T00:07:18.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.164+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~XZE5XHE26N2P.1 size=1048576 2024-09-12T00:07:18.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.165+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~XZE5XHE26N2P.2 size=140073 2024-09-12T00:07:18.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.165+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=XZE5XHE26N2P tag=ZCJ06H7434EJ type=write size=3285801 2024-09-12T00:07:18.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.168+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=FI6EBI1TSJUJ type=del 2024-09-12T00:07:18.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.170+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~XJQ8AV19EILB.0 size=907914 2024-09-12T00:07:18.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.170+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=XJQ8AV19EILB tag=CH3CLO0S3SK7 type=write size=1956490 2024-09-12T00:07:18.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.171+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=4EKWQZ5M684A type=del 2024-09-12T00:07:18.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.173+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~NJJU3PKGC8GU.0 size=1048576 2024-09-12T00:07:18.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.174+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~NJJU3PKGC8GU.1 size=1048576 2024-09-12T00:07:18.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.176+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~NJJU3PKGC8GU.2 size=348788 2024-09-12T00:07:18.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.176+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=NJJU3PKGC8GU tag=ZMVBQZ1F6TZP type=write size=3494516 2024-09-12T00:07:18.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.178+0000 7f82f8930780 1 < completed delete operation key=9576W9WYJUJV tag=MJ69PHEQPCR1 type=del 2024-09-12T00:07:18.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.178+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=I1OGG9RN2MLF type=del size=2380104 2024-09-12T00:07:18.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.181+0000 7f82f8930780 1 < completed delete operation key=N2TYUAJITFNL tag=O7RK392CEL0D type=del 2024-09-12T00:07:18.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.183+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=PGYRZ3QSKXS4 type=write size=553094 2024-09-12T00:07:18.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.184+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~NA0CIEUE8JGS.0 size=1048576 2024-09-12T00:07:18.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.185+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~NA0CIEUE8JGS.1 size=409160 2024-09-12T00:07:18.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.187+0000 7f82f8930780 1 < completed multipart upload key=Y5U8MO9TOJQQ upload=NA0CIEUE8JGS tag=0ZI465VZ25HT type=write size=2506312 2024-09-12T00:07:18.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.188+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=6OFMM4I0IRD8 type=del size=777593 2024-09-12T00:07:18.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.190+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~UMKJ5UNCLFKJ.0 size=1048576 2024-09-12T00:07:18.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.191+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~UMKJ5UNCLFKJ.1 size=1048576 2024-09-12T00:07:18.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.192+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~UMKJ5UNCLFKJ.2 size=1018576 2024-09-12T00:07:18.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.194+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=UMKJ5UNCLFKJ tag=HDYAGY3R8FDA type=write size=4164304 2024-09-12T00:07:18.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.196+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=CSR07X0BYL2Y type=del size=2804693 2024-09-12T00:07:18.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.198+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~4ZK1DGOC7BQ5.0 size=352515 2024-09-12T00:07:18.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.199+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=4ZK1DGOC7BQ5 tag=12TWMFTOSCO1 type=write size=1401091 2024-09-12T00:07:18.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.201+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=ZV7GG3CDSCLK type=del size=1981778 2024-09-12T00:07:18.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.202+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~DUDFH0RAGQOZ.0 size=52298 2024-09-12T00:07:18.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.205+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=DUDFH0RAGQOZ tag=AI47BASMUVFB type=write size=1100874 2024-09-12T00:07:18.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.207+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=OE7V6KG6E9KU type=del size=3358498 2024-09-12T00:07:18.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.208+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~QNL3VVN1HA1V.0 size=1048576 2024-09-12T00:07:18.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.209+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~QNL3VVN1HA1V.1 size=1048576 2024-09-12T00:07:18.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.210+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~QNL3VVN1HA1V.2 size=658804 2024-09-12T00:07:18.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.213+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=QNL3VVN1HA1V tag=PF9R2J4AIMP7 type=write size=3804532 2024-09-12T00:07:18.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.215+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~L9NPTKXNZWOC.0 size=1048576 2024-09-12T00:07:18.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.217+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~L9NPTKXNZWOC.1 size=681320 2024-09-12T00:07:18.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.217+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=L9NPTKXNZWOC tag=GACOF0X68T0T type=write size=2778472 2024-09-12T00:07:18.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.219+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~UMSXBUBDEF6O.0 size=95825 2024-09-12T00:07:18.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.221+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=UMSXBUBDEF6O tag=TQTW60T9R37I type=write size=1144401 2024-09-12T00:07:18.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.224+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~LEEGIHGWOG8N.0 size=1048576 2024-09-12T00:07:18.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.225+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~LEEGIHGWOG8N.1 size=1048576 2024-09-12T00:07:18.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.226+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~LEEGIHGWOG8N.2 size=460854 2024-09-12T00:07:18.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.226+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=LEEGIHGWOG8N tag=W5R7D54DKW0C type=write size=3606582 2024-09-12T00:07:18.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.228+0000 7f82f8930780 1 < completed write operation key=IN8Y7I0HKP6D tag=PZZ336IX43Q6 type=write size=991826 2024-09-12T00:07:18.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.229+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=0VVPZDLN0VV2 type=del size=3753808 2024-09-12T00:07:18.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.232+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=K26HY1T199EG type=del 2024-09-12T00:07:18.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.232+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=8GTWL4SQQ6LT type=del size=3773894 2024-09-12T00:07:18.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.234+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=Y19BVGU60PJV type=del 2024-09-12T00:07:18.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.236+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=L6Z2NQSQ0F0C type=write size=1018239 2024-09-12T00:07:18.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.239+0000 7f82f8930780 1 < suggested remove operation key=QB46N36A27QH tag=LHU44YU5XHHP type=del 2024-09-12T00:07:18.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.242+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~F33SXTT5FS2O.0 size=1048576 2024-09-12T00:07:18.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.243+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~F33SXTT5FS2O.1 size=1014032 2024-09-12T00:07:18.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.243+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=F33SXTT5FS2O tag=WTURF06U71O2 type=write size=3111184 2024-09-12T00:07:18.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.244+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=3NXUDJX621XI type=del 2024-09-12T00:07:18.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.245+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=TEEY3FJDL61E type=del size=2978324 2024-09-12T00:07:18.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.247+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~XZE5XHE26N2P.0 size=1048576 2024-09-12T00:07:18.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.249+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~XZE5XHE26N2P.1 size=1048576 2024-09-12T00:07:18.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.249+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~XZE5XHE26N2P.2 size=140073 2024-09-12T00:07:18.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.252+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=XZE5XHE26N2P tag=ZCJ06H7434EJ type=write size=3285801 2024-09-12T00:07:18.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.253+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=55DK2L0NCHX0 type=write size=588209 2024-09-12T00:07:18.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.255+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~XJQ8AV19EILB.0 size=907914 2024-09-12T00:07:18.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.257+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=XJQ8AV19EILB tag=CH3CLO0S3SK7 type=write size=1956490 2024-09-12T00:07:18.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.260+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~CH7YAAJ1KJMP.0 size=1048576 2024-09-12T00:07:18.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.261+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~CH7YAAJ1KJMP.1 size=439068 2024-09-12T00:07:18.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.261+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=CH7YAAJ1KJMP tag=4CHHJ31FKSTD type=write size=2536220 2024-09-12T00:07:18.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.261+0000 7f82f8930780 1 < canceled part key=_multipart_FOWSB9RQ5TV5.2~NJJU3PKGC8GU.0 size=1048576 2024-09-12T00:07:18.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.262+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~NJJU3PKGC8GU.1 size=1048576 2024-09-12T00:07:18.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.264+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~NJJU3PKGC8GU.2 size=348788 2024-09-12T00:07:18.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.267+0000 7f82f8930780 1 < canceled multipart upload key=FOWSB9RQ5TV5 upload=NJJU3PKGC8GU tag=ZMVBQZ1F6TZP type=write size=3494516 2024-09-12T00:07:18.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.268+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=ISWN0BW8OH8A type=del size=3096660 2024-09-12T00:07:18.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.269+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=I1OGG9RN2MLF type=del 2024-09-12T00:07:18.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.272+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~M9EG61QBMUEO.0 size=1048576 2024-09-12T00:07:18.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.273+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~M9EG61QBMUEO.1 size=187386 2024-09-12T00:07:18.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.273+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=M9EG61QBMUEO tag=QHLYH6MDRAY0 type=write size=2284538 2024-09-12T00:07:18.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.274+0000 7f82f8930780 1 < completed write operation key=IMAT4ZCLGFRN tag=PGYRZ3QSKXS4 type=write size=553094 2024-09-12T00:07:18.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.276+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=7R771VXFSOA5 type=write size=295238 2024-09-12T00:07:18.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.278+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=6OFMM4I0IRD8 type=del 2024-09-12T00:07:18.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.281+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~O9QH7106OFOX.0 size=1048576 2024-09-12T00:07:18.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.281+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~O9QH7106OFOX.1 size=587271 2024-09-12T00:07:18.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.281+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=O9QH7106OFOX tag=C7QHMITTM0MY type=write size=2684423 2024-09-12T00:07:18.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.284+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=CSR07X0BYL2Y type=del 2024-09-12T00:07:18.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.286+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~GU4428WY181K.0 size=1048576 2024-09-12T00:07:18.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.287+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~GU4428WY181K.1 size=1048576 2024-09-12T00:07:18.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.288+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~GU4428WY181K.2 size=878332 2024-09-12T00:07:18.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.288+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=GU4428WY181K tag=KQ77AJCJ2Z7U type=write size=4024060 2024-09-12T00:07:18.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.289+0000 7f82f8930780 1 < completed delete operation key=FOWSB9RQ5TV5 tag=ZV7GG3CDSCLK type=del 2024-09-12T00:07:18.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.291+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=93R7SRMPU0LC type=del size=2997240 2024-09-12T00:07:18.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.292+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=OE7V6KG6E9KU type=del 2024-09-12T00:07:18.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.294+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=YMRVH5MSQSG4 type=del size=3517001 2024-09-12T00:07:18.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.295+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~L9NPTKXNZWOC.0 size=1048576 2024-09-12T00:07:18.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.297+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~L9NPTKXNZWOC.1 size=681320 2024-09-12T00:07:18.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.300+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=L9NPTKXNZWOC tag=GACOF0X68T0T type=write size=2778472 2024-09-12T00:07:18.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.300+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=YK2AH3M22UWA type=del size=1132154 2024-09-12T00:07:18.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.303+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~LEEGIHGWOG8N.0 size=1048576 2024-09-12T00:07:18.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.303+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~LEEGIHGWOG8N.1 size=1048576 2024-09-12T00:07:18.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.305+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~LEEGIHGWOG8N.2 size=460854 2024-09-12T00:07:18.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.307+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=LEEGIHGWOG8N tag=W5R7D54DKW0C type=write size=3606582 2024-09-12T00:07:18.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.310+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~YGFWR9F3OOO8.0 size=89805 2024-09-12T00:07:18.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.310+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=YGFWR9F3OOO8 tag=E8J4LXN1G52V type=write size=1138381 2024-09-12T00:07:18.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.311+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=0VVPZDLN0VV2 type=del 2024-09-12T00:07:18.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.313+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=WHQSSBKQ7E3R type=del size=1142863 2024-09-12T00:07:18.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.314+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=8GTWL4SQQ6LT type=del 2024-09-12T00:07:18.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.317+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=FCOHJU4FGDCG type=write size=1012193 2024-09-12T00:07:18.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.318+0000 7f82f8930780 1 < canceled operation key=O2ZGU2KOTUOT tag=L6Z2NQSQ0F0C type=write size=1018239 2024-09-12T00:07:18.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.321+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~BJAXCWP12BM7.0 size=1048576 2024-09-12T00:07:18.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.322+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~BJAXCWP12BM7.1 size=399333 2024-09-12T00:07:18.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.322+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=BJAXCWP12BM7 tag=DSGVO9VC64GN type=write size=2496485 2024-09-12T00:07:18.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.324+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~F33SXTT5FS2O.0 size=1048576 2024-09-12T00:07:18.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.324+0000 7f82f8930780 1 < canceled part key=_multipart_LAKJS79KNBY7.2~F33SXTT5FS2O.1 size=1014032 2024-09-12T00:07:18.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.327+0000 7f82f8930780 1 < canceled multipart upload key=LAKJS79KNBY7 upload=F33SXTT5FS2O tag=WTURF06U71O2 type=write size=3111184 2024-09-12T00:07:18.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.328+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=8GH7OUIFJK11 type=write size=12968 2024-09-12T00:07:18.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.329+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=TEEY3FJDL61E type=del 2024-09-12T00:07:18.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.331+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=3M90GJY0VVKC type=del size=826337 2024-09-12T00:07:18.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.332+0000 7f82f8930780 1 < completed write operation key=IMAT4ZCLGFRN tag=55DK2L0NCHX0 type=write size=588209 2024-09-12T00:07:18.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.336+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~6MZ5Q8S6RZGN.0 size=1048576 2024-09-12T00:07:18.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.336+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~6MZ5Q8S6RZGN.1 size=1048576 2024-09-12T00:07:18.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.338+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~6MZ5Q8S6RZGN.2 size=994157 2024-09-12T00:07:18.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.338+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=6MZ5Q8S6RZGN tag=LB4Z5OTS1GWQ type=write size=4139885 2024-09-12T00:07:18.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.339+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~CH7YAAJ1KJMP.0 size=1048576 2024-09-12T00:07:18.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.340+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~CH7YAAJ1KJMP.1 size=439068 2024-09-12T00:07:18.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.342+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=CH7YAAJ1KJMP tag=4CHHJ31FKSTD type=write size=2536220 2024-09-12T00:07:18.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.345+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~JWYN0YWGH8HR.0 size=1048576 2024-09-12T00:07:18.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.346+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~JWYN0YWGH8HR.1 size=306805 2024-09-12T00:07:18.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.346+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=JWYN0YWGH8HR tag=OFAJFE2KLWKR type=write size=2403957 2024-09-12T00:07:18.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.347+0000 7f82f8930780 1 < canceled operation key=HCK59C6MAW0B tag=ISWN0BW8OH8A type=del size=3096660 2024-09-12T00:07:18.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.349+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=A0HD2WDXP3EJ type=write size=15094 2024-09-12T00:07:18.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.350+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~M9EG61QBMUEO.0 size=1048576 2024-09-12T00:07:18.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.351+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~M9EG61QBMUEO.1 size=187386 2024-09-12T00:07:18.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.355+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=M9EG61QBMUEO tag=QHLYH6MDRAY0 type=write size=2284538 2024-09-12T00:07:18.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.357+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~36D3QC4MIDFV.0 size=1048576 2024-09-12T00:07:18.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.358+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~36D3QC4MIDFV.1 size=547199 2024-09-12T00:07:18.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.358+0000 7f82f8930780 1 > prepared multipart upload key=4IA4918NXXJW upload=36D3QC4MIDFV tag=HQRUPY7NM2D4 type=write size=2644351 2024-09-12T00:07:18.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.359+0000 7f82f8930780 1 < completed write operation key=77SDZHCSP0E3 tag=7R771VXFSOA5 type=write size=295238 2024-09-12T00:07:18.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.363+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~V2REB1JKOHPL.0 size=1048576 2024-09-12T00:07:18.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.364+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~V2REB1JKOHPL.1 size=852470 2024-09-12T00:07:18.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.364+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=V2REB1JKOHPL tag=VK9BXZMVRQG5 type=write size=2949622 2024-09-12T00:07:18.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.365+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~O9QH7106OFOX.0 size=1048576 2024-09-12T00:07:18.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.366+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~O9QH7106OFOX.1 size=587271 2024-09-12T00:07:18.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.368+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=O9QH7106OFOX tag=C7QHMITTM0MY type=write size=2684423 2024-09-12T00:07:18.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.372+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~3KFNT96NTZBD.0 size=1048576 2024-09-12T00:07:18.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.373+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~3KFNT96NTZBD.1 size=1048576 2024-09-12T00:07:18.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.373+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~3KFNT96NTZBD.2 size=154621 2024-09-12T00:07:18.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.373+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=3KFNT96NTZBD tag=DYMQFGB0EDY9 type=write size=3300349 2024-09-12T00:07:18.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.375+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~GU4428WY181K.0 size=1048576 2024-09-12T00:07:18.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.376+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~GU4428WY181K.1 size=1048576 2024-09-12T00:07:18.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.377+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~GU4428WY181K.2 size=878332 2024-09-12T00:07:18.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.379+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=GU4428WY181K tag=KQ77AJCJ2Z7U type=write size=4024060 2024-09-12T00:07:18.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.380+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=OZEFHC5MDHR1 type=del size=1809398 2024-09-12T00:07:18.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.383+0000 7f82f8930780 1 < suggested remove operation key=A8EFUP30RS65 tag=93R7SRMPU0LC type=del 2024-09-12T00:07:18.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.386+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=7S49GOH3SFX0 type=del size=2870518 2024-09-12T00:07:18.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.386+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=YMRVH5MSQSG4 type=del 2024-09-12T00:07:18.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.388+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=89O0UDUNYY2Y type=del size=645037 2024-09-12T00:07:18.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.389+0000 7f82f8930780 1 < completed delete operation key=FOWSB9RQ5TV5 tag=YK2AH3M22UWA type=del 2024-09-12T00:07:18.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.391+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=CDQ5U9GQUMQL type=del size=3651966 2024-09-12T00:07:18.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.392+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~YGFWR9F3OOO8.0 size=89805 2024-09-12T00:07:18.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.395+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=YGFWR9F3OOO8 tag=E8J4LXN1G52V type=write size=1138381 2024-09-12T00:07:18.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.396+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=YW13QG3FKVU4 type=del size=2514772 2024-09-12T00:07:18.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.399+0000 7f82f8930780 1 < suggested remove operation key=IMAT4ZCLGFRN tag=WHQSSBKQ7E3R type=del 2024-09-12T00:07:18.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.400+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=MJY90PQ5JJSH type=write size=468657 2024-09-12T00:07:18.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.404+0000 7f82f8930780 1 < suggested remove operation key=A8EFUP30RS65 tag=FCOHJU4FGDCG type=write 2024-09-12T00:07:18.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.405+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=0OM04PMCCFDQ type=write size=48526 2024-09-12T00:07:18.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.405+0000 7f82f8930780 1 < canceled part key=_multipart_4SPRDO097JYQ.2~BJAXCWP12BM7.0 size=1048576 2024-09-12T00:07:18.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.406+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~BJAXCWP12BM7.1 size=399333 2024-09-12T00:07:18.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.409+0000 7f82f8930780 1 < canceled multipart upload key=4SPRDO097JYQ upload=BJAXCWP12BM7 tag=DSGVO9VC64GN type=write size=2496485 2024-09-12T00:07:18.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.411+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~21FFLA5ZZ3DQ.0 size=1048576 2024-09-12T00:07:18.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.413+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~21FFLA5ZZ3DQ.1 size=117856 2024-09-12T00:07:18.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.413+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=21FFLA5ZZ3DQ tag=9RDNZVC9FUKI type=write size=2215008 2024-09-12T00:07:18.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.414+0000 7f82f8930780 1 < completed write operation key=Y5U8MO9TOJQQ tag=8GH7OUIFJK11 type=write size=12968 2024-09-12T00:07:18.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.417+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~X8DZC2Q6GWPA.0 size=1048576 2024-09-12T00:07:18.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.418+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~X8DZC2Q6GWPA.1 size=1048576 2024-09-12T00:07:18.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.419+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~X8DZC2Q6GWPA.2 size=345406 2024-09-12T00:07:18.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.419+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=X8DZC2Q6GWPA tag=4C8FFYIPN8AV type=write size=3491134 2024-09-12T00:07:18.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.421+0000 7f82f8930780 1 < canceled operation key=OC61OW2M7ZEI tag=3M90GJY0VVKC type=del size=826337 2024-09-12T00:07:18.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.424+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~Y3WXBEMETZIX.0 size=1048576 2024-09-12T00:07:18.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.425+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~Y3WXBEMETZIX.1 size=1048576 2024-09-12T00:07:18.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.426+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~Y3WXBEMETZIX.2 size=120369 2024-09-12T00:07:18.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.426+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=Y3WXBEMETZIX tag=RKUR1OD6GJ05 type=write size=3266097 2024-09-12T00:07:18.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.426+0000 7f82f8930780 1 < canceled part key=_multipart_LAKJS79KNBY7.2~6MZ5Q8S6RZGN.0 size=1048576 2024-09-12T00:07:18.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.427+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~6MZ5Q8S6RZGN.1 size=1048576 2024-09-12T00:07:18.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.429+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~6MZ5Q8S6RZGN.2 size=994157 2024-09-12T00:07:18.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.432+0000 7f82f8930780 1 < canceled multipart upload key=LAKJS79KNBY7 upload=6MZ5Q8S6RZGN tag=LB4Z5OTS1GWQ type=write size=4139885 2024-09-12T00:07:18.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.433+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~OEUXVZ5XBRN5.0 size=721826 2024-09-12T00:07:18.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.433+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=OEUXVZ5XBRN5 tag=7LWD8XKE6JBG type=write size=1770402 2024-09-12T00:07:18.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.435+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~JWYN0YWGH8HR.0 size=1048576 2024-09-12T00:07:18.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.436+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~JWYN0YWGH8HR.1 size=306805 2024-09-12T00:07:18.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.439+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=JWYN0YWGH8HR tag=OFAJFE2KLWKR type=write size=2403957 2024-09-12T00:07:18.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.440+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=4ZJC69K38180 type=write size=340734 2024-09-12T00:07:18.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.441+0000 7f82f8930780 1 < completed write operation key=3X2PLA3ODHJ1 tag=A0HD2WDXP3EJ type=write size=15094 2024-09-12T00:07:18.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.444+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~PJ1IGK09A1JL.0 size=1048576 2024-09-12T00:07:18.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.445+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~PJ1IGK09A1JL.1 size=770235 2024-09-12T00:07:18.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.445+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=PJ1IGK09A1JL tag=TUP04DH1VPDK type=write size=2867387 2024-09-12T00:07:18.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.446+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~36D3QC4MIDFV.0 size=1048576 2024-09-12T00:07:18.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.448+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~36D3QC4MIDFV.1 size=547199 2024-09-12T00:07:18.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.451+0000 7f82f8930780 1 < completed multipart upload key=4IA4918NXXJW upload=36D3QC4MIDFV tag=HQRUPY7NM2D4 type=write size=2644351 2024-09-12T00:07:18.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.454+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~GXKMIIG0PGEK.0 size=1048576 2024-09-12T00:07:18.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.455+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~GXKMIIG0PGEK.1 size=143187 2024-09-12T00:07:18.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.455+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=GXKMIIG0PGEK tag=OXCXV7XVY5MX type=write size=2240339 2024-09-12T00:07:18.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.456+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~V2REB1JKOHPL.0 size=1048576 2024-09-12T00:07:18.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.457+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~V2REB1JKOHPL.1 size=852470 2024-09-12T00:07:18.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.459+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=V2REB1JKOHPL tag=VK9BXZMVRQG5 type=write size=2949622 2024-09-12T00:07:18.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.461+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~3I5G3PJGXT3A.0 size=943106 2024-09-12T00:07:18.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.461+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=3I5G3PJGXT3A tag=R8XD5E3W3G4S type=write size=1991682 2024-09-12T00:07:18.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.463+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~3KFNT96NTZBD.0 size=1048576 2024-09-12T00:07:18.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.463+0000 7f82f8930780 1 < canceled part key=_multipart_AMWMQXO10EXK.2~3KFNT96NTZBD.1 size=1048576 2024-09-12T00:07:18.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.465+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~3KFNT96NTZBD.2 size=154621 2024-09-12T00:07:18.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.467+0000 7f82f8930780 1 < canceled multipart upload key=AMWMQXO10EXK upload=3KFNT96NTZBD tag=DYMQFGB0EDY9 type=write size=3300349 2024-09-12T00:07:18.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.468+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=ZPT5RPVMK8AI type=write size=229010 2024-09-12T00:07:18.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.469+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=OZEFHC5MDHR1 type=del 2024-09-12T00:07:18.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.471+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=6C054W4A9VD3 type=del size=1576822 2024-09-12T00:07:18.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.473+0000 7f82f8930780 1 < suggested update operation key=Y8GDXNDCOHCW tag=7S49GOH3SFX0 type=del size=2870518 2024-09-12T00:07:18.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.476+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~JFFS1L1LC3NH.0 size=1048576 2024-09-12T00:07:18.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.477+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~JFFS1L1LC3NH.1 size=515179 2024-09-12T00:07:18.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.477+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=JFFS1L1LC3NH tag=6MKPITS1L9IV type=write size=2612331 2024-09-12T00:07:18.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.479+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=89O0UDUNYY2Y type=del 2024-09-12T00:07:18.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.481+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~QAD9Q8K62QWJ.0 size=1048576 2024-09-12T00:07:18.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.483+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~QAD9Q8K62QWJ.1 size=375648 2024-09-12T00:07:18.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.483+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=QAD9Q8K62QWJ tag=EVQXJQXEC64G type=write size=2472800 2024-09-12T00:07:18.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.484+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=CDQ5U9GQUMQL type=del 2024-09-12T00:07:18.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.486+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=3G0H599XYBQR type=del size=2310037 2024-09-12T00:07:18.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.487+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=YW13QG3FKVU4 type=del 2024-09-12T00:07:18.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.490+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~KKQQEABF4FMN.0 size=644176 2024-09-12T00:07:18.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.490+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=KKQQEABF4FMN tag=QYWZRT2KC59I type=write size=1692752 2024-09-12T00:07:18.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.491+0000 7f82f8930780 1 < completed write operation key=4SPRDO097JYQ tag=MJY90PQ5JJSH type=write size=468657 2024-09-12T00:07:18.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.492+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=7DVW1SW5FG7L type=write size=7780 2024-09-12T00:07:18.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.495+0000 7f82f8930780 1 < suggested update operation key=W8SAQZWQHY36 tag=0OM04PMCCFDQ type=write size=48526 2024-09-12T00:07:18.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.497+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=8OQ2RVR2TC6U type=write size=811500 2024-09-12T00:07:18.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.498+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~21FFLA5ZZ3DQ.0 size=1048576 2024-09-12T00:07:18.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.499+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~21FFLA5ZZ3DQ.1 size=117856 2024-09-12T00:07:18.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.502+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=21FFLA5ZZ3DQ tag=9RDNZVC9FUKI type=write size=2215008 2024-09-12T00:07:18.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.505+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~WCD49CUUGZXX.0 size=1048576 2024-09-12T00:07:18.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.505+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~WCD49CUUGZXX.1 size=470832 2024-09-12T00:07:18.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.505+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=WCD49CUUGZXX tag=66HFG392BVOQ type=write size=2567984 2024-09-12T00:07:18.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.506+0000 7f82f8930780 1 < canceled part key=_multipart_BJHGNT3HBS25.2~X8DZC2Q6GWPA.0 size=1048576 2024-09-12T00:07:18.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.507+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~X8DZC2Q6GWPA.1 size=1048576 2024-09-12T00:07:18.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.508+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~X8DZC2Q6GWPA.2 size=345406 2024-09-12T00:07:18.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.510+0000 7f82f8930780 1 < canceled multipart upload key=BJHGNT3HBS25 upload=X8DZC2Q6GWPA tag=4C8FFYIPN8AV type=write size=3491134 2024-09-12T00:07:18.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.514+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~KZRCU5OTYVZC.0 size=789677 2024-09-12T00:07:18.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.514+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=KZRCU5OTYVZC tag=76IGGIK502V8 type=write size=1838253 2024-09-12T00:07:18.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.516+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~Y3WXBEMETZIX.0 size=1048576 2024-09-12T00:07:18.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.517+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~Y3WXBEMETZIX.1 size=1048576 2024-09-12T00:07:18.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.517+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~Y3WXBEMETZIX.2 size=120369 2024-09-12T00:07:18.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.519+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=Y3WXBEMETZIX tag=RKUR1OD6GJ05 type=write size=3266097 2024-09-12T00:07:18.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.521+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=C3F14PMJJS8O type=del size=673855 2024-09-12T00:07:18.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.523+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~OEUXVZ5XBRN5.0 size=721826 2024-09-12T00:07:18.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.525+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=OEUXVZ5XBRN5 tag=7LWD8XKE6JBG type=write size=1770402 2024-09-12T00:07:18.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.527+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~GPCN6FMPHESM.0 size=1048576 2024-09-12T00:07:18.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.528+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~GPCN6FMPHESM.1 size=855931 2024-09-12T00:07:18.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.528+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=GPCN6FMPHESM tag=0JOY6FCNOM5Y type=write size=2953083 2024-09-12T00:07:18.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.532+0000 7f82f8930780 1 < suggested update operation key=O2ZGU2KOTUOT tag=4ZJC69K38180 type=write size=340734 2024-09-12T00:07:18.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.535+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~HCEGM3YUDJD0.0 size=40820 2024-09-12T00:07:18.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.535+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=HCEGM3YUDJD0 tag=80MTB7A2TLE7 type=write size=1089396 2024-09-12T00:07:18.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.537+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~PJ1IGK09A1JL.0 size=1048576 2024-09-12T00:07:18.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.537+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~PJ1IGK09A1JL.1 size=770235 2024-09-12T00:07:18.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.540+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=PJ1IGK09A1JL tag=TUP04DH1VPDK type=write size=2867387 2024-09-12T00:07:18.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.542+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=II4ZOYOI9PC8 type=del size=1997278 2024-09-12T00:07:18.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.543+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~GXKMIIG0PGEK.0 size=1048576 2024-09-12T00:07:18.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.544+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~GXKMIIG0PGEK.1 size=143187 2024-09-12T00:07:18.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.546+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=GXKMIIG0PGEK tag=OXCXV7XVY5MX type=write size=2240339 2024-09-12T00:07:18.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.548+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=KBY77SYTQMDY type=write size=56690 2024-09-12T00:07:18.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.549+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~3I5G3PJGXT3A.0 size=943106 2024-09-12T00:07:18.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.552+0000 7f82f8930780 1 < completed multipart upload key=W8SAQZWQHY36 upload=3I5G3PJGXT3A tag=R8XD5E3W3G4S type=write size=1991682 2024-09-12T00:07:18.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.555+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~2NBLZP795A53.0 size=1048576 2024-09-12T00:07:18.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.556+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~2NBLZP795A53.1 size=1048576 2024-09-12T00:07:18.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.557+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~2NBLZP795A53.2 size=552078 2024-09-12T00:07:18.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.557+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=2NBLZP795A53 tag=SRFPSU44GQ3H type=write size=3697806 2024-09-12T00:07:18.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.559+0000 7f82f8930780 1 < completed write operation key=OVJOP07M9KB8 tag=ZPT5RPVMK8AI type=write size=229010 2024-09-12T00:07:18.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.560+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=V7JQY7LX141H type=del size=1218622 2024-09-12T00:07:18.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.562+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=6C054W4A9VD3 type=del 2024-09-12T00:07:18.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.563+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=TNGCOX3S8YAG type=write size=447416 2024-09-12T00:07:18.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.565+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~JFFS1L1LC3NH.0 size=1048576 2024-09-12T00:07:18.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.566+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~JFFS1L1LC3NH.1 size=515179 2024-09-12T00:07:18.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.569+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=JFFS1L1LC3NH tag=6MKPITS1L9IV type=write size=2612331 2024-09-12T00:07:18.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.571+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~VKWGVDJQVH3X.0 size=1048576 2024-09-12T00:07:18.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.572+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~VKWGVDJQVH3X.1 size=1048576 2024-09-12T00:07:18.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.574+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~VKWGVDJQVH3X.2 size=598874 2024-09-12T00:07:18.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.574+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=VKWGVDJQVH3X tag=65HIV4U99BTO type=write size=3744602 2024-09-12T00:07:18.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.575+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~QAD9Q8K62QWJ.0 size=1048576 2024-09-12T00:07:18.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.576+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~QAD9Q8K62QWJ.1 size=375648 2024-09-12T00:07:18.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.579+0000 7f82f8930780 1 < completed multipart upload key=Y5U8MO9TOJQQ upload=QAD9Q8K62QWJ tag=EVQXJQXEC64G type=write size=2472800 2024-09-12T00:07:18.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.581+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~6234R3UIG48N.0 size=1048576 2024-09-12T00:07:18.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.584+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~6234R3UIG48N.1 size=1048576 2024-09-12T00:07:18.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.584+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~6234R3UIG48N.2 size=249593 2024-09-12T00:07:18.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.584+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=6234R3UIG48N tag=Z9W07QFIBEA4 type=write size=3395321 2024-09-12T00:07:18.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.586+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=3G0H599XYBQR type=del 2024-09-12T00:07:18.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.587+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=MYD0S1YH2BP4 type=del size=162882 2024-09-12T00:07:18.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.589+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~KKQQEABF4FMN.0 size=644176 2024-09-12T00:07:18.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.591+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=KKQQEABF4FMN tag=QYWZRT2KC59I type=write size=1692752 2024-09-12T00:07:18.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.592+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=3R3W2VE2M82A type=del size=3980009 2024-09-12T00:07:18.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.595+0000 7f82f8930780 1 < suggested update operation key=3X2PLA3ODHJ1 tag=7DVW1SW5FG7L type=write size=7780 2024-09-12T00:07:18.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.598+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~8M8U65X36LUX.0 size=69070 2024-09-12T00:07:18.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.598+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=8M8U65X36LUX tag=82LCUC9TSWHH type=write size=1117646 2024-09-12T00:07:18.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.599+0000 7f82f8930780 1 < completed write operation key=Y5U8MO9TOJQQ tag=8OQ2RVR2TC6U type=write size=811500 2024-09-12T00:07:18.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.602+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~Y2QR8N0K0BH2.0 size=1048576 2024-09-12T00:07:18.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.603+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~Y2QR8N0K0BH2.1 size=632073 2024-09-12T00:07:18.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.603+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=Y2QR8N0K0BH2 tag=NRH41R99PVAI type=write size=2729225 2024-09-12T00:07:18.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.605+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~WCD49CUUGZXX.0 size=1048576 2024-09-12T00:07:18.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.605+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~WCD49CUUGZXX.1 size=470832 2024-09-12T00:07:18.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.607+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=WCD49CUUGZXX tag=66HFG392BVOQ type=write size=2567984 2024-09-12T00:07:18.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.609+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=4EORMXWIS2I3 type=del size=2687607 2024-09-12T00:07:18.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.610+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~KZRCU5OTYVZC.0 size=789677 2024-09-12T00:07:18.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.613+0000 7f82f8930780 1 < completed multipart upload key=Y5U8MO9TOJQQ upload=KZRCU5OTYVZC tag=76IGGIK502V8 type=write size=1838253 2024-09-12T00:07:18.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.614+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=885T2XOS9VGJ type=del size=2240074 2024-09-12T00:07:18.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.616+0000 7f82f8930780 -1 < failed to complete operation key=O2ZGU2KOTUOT tag=C3F14PMJJS8O type=del size=673855: (22) Invalid argument 2024-09-12T00:07:18.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.617+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=VUQM5073NE9U type=del size=3642449 2024-09-12T00:07:18.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.619+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~GPCN6FMPHESM.0 size=1048576 2024-09-12T00:07:18.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.620+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~GPCN6FMPHESM.1 size=855931 2024-09-12T00:07:18.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.622+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=GPCN6FMPHESM tag=0JOY6FCNOM5Y type=write size=2953083 2024-09-12T00:07:18.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.624+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=OU4D9XO7WJDE type=del size=2215137 2024-09-12T00:07:18.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.625+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~HCEGM3YUDJD0.0 size=40820 2024-09-12T00:07:18.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.628+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=HCEGM3YUDJD0 tag=80MTB7A2TLE7 type=write size=1089396 2024-09-12T00:07:18.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.629+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=2XZHAHBLSBLI type=write size=644660 2024-09-12T00:07:18.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.633+0000 7f82f8930780 1 < suggested update operation key=3X2PLA3ODHJ1 tag=II4ZOYOI9PC8 type=del size=1997278 2024-09-12T00:07:18.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.635+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~3KY8LSWQ1FXX.0 size=417473 2024-09-12T00:07:18.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.635+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=3KY8LSWQ1FXX tag=HB5NJ7LIIHHP type=write size=1466049 2024-09-12T00:07:18.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.639+0000 7f82f8930780 1 < suggested update operation key=LAKJS79KNBY7 tag=KBY77SYTQMDY type=write size=56690 2024-09-12T00:07:18.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.641+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~D0ZGQ1SQR4UJ.0 size=1048576 2024-09-12T00:07:18.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.642+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~D0ZGQ1SQR4UJ.1 size=128234 2024-09-12T00:07:18.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.642+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=D0ZGQ1SQR4UJ tag=X41F8OU6YOZ0 type=write size=2225386 2024-09-12T00:07:18.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.644+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~2NBLZP795A53.0 size=1048576 2024-09-12T00:07:18.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.645+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~2NBLZP795A53.1 size=1048576 2024-09-12T00:07:18.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.646+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~2NBLZP795A53.2 size=552078 2024-09-12T00:07:18.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.648+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=2NBLZP795A53 tag=SRFPSU44GQ3H type=write size=3697806 2024-09-12T00:07:18.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.650+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=J8KVLAR4U9SP type=write size=777060 2024-09-12T00:07:18.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.652+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=V7JQY7LX141H type=del 2024-09-12T00:07:18.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.654+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~6PD5GNHHJB1U.0 size=1048576 2024-09-12T00:07:18.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.655+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~6PD5GNHHJB1U.1 size=1048576 2024-09-12T00:07:18.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.657+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~6PD5GNHHJB1U.2 size=926157 2024-09-12T00:07:18.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.657+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=6PD5GNHHJB1U tag=YTXXAD5K60AP type=write size=4071885 2024-09-12T00:07:18.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.659+0000 7f82f8930780 1 < completed write operation key=2XM2CF1T4VGW tag=TNGCOX3S8YAG type=write size=447416 2024-09-12T00:07:18.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.659+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=ZDA9735455JG type=del size=316557 2024-09-12T00:07:18.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.661+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~VKWGVDJQVH3X.0 size=1048576 2024-09-12T00:07:18.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.662+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~VKWGVDJQVH3X.1 size=1048576 2024-09-12T00:07:18.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.663+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~VKWGVDJQVH3X.2 size=598874 2024-09-12T00:07:18.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.666+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=VKWGVDJQVH3X tag=65HIV4U99BTO type=write size=3744602 2024-09-12T00:07:18.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.667+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=TH57XWJS3CD7 type=del size=3622071 2024-09-12T00:07:18.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.668+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~6234R3UIG48N.0 size=1048576 2024-09-12T00:07:18.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.669+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~6234R3UIG48N.1 size=1048576 2024-09-12T00:07:18.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.671+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~6234R3UIG48N.2 size=249593 2024-09-12T00:07:18.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.672+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=6234R3UIG48N tag=Z9W07QFIBEA4 type=write size=3395321 2024-09-12T00:07:18.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.674+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=6VK0LA0JIESS type=del size=614217 2024-09-12T00:07:18.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.675+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=MYD0S1YH2BP4 type=del 2024-09-12T00:07:18.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.677+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=Q45UGEBZM3KT type=del size=1213 2024-09-12T00:07:18.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.678+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=3R3W2VE2M82A type=del 2024-09-12T00:07:18.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.681+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~0PKSXT6LZDLV.0 size=457749 2024-09-12T00:07:18.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.681+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=0PKSXT6LZDLV tag=WE5NCYE1G3WA type=write size=1506325 2024-09-12T00:07:18.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.682+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~8M8U65X36LUX.0 size=69070 2024-09-12T00:07:18.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.685+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=8M8U65X36LUX tag=82LCUC9TSWHH type=write size=1117646 2024-09-12T00:07:18.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.686+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=E5NLUCTC03SM type=del size=278432 2024-09-12T00:07:18.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.687+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~Y2QR8N0K0BH2.0 size=1048576 2024-09-12T00:07:18.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.689+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~Y2QR8N0K0BH2.1 size=632073 2024-09-12T00:07:18.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.691+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=Y2QR8N0K0BH2 tag=NRH41R99PVAI type=write size=2729225 2024-09-12T00:07:18.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.692+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=Q3YVBL9L8VUR type=del size=957781 2024-09-12T00:07:18.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.694+0000 7f82f8930780 1 < completed delete operation key=N2TYUAJITFNL tag=4EORMXWIS2I3 type=del 2024-09-12T00:07:18.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.695+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=1M7O2T4N0ES0 type=del size=4076858 2024-09-12T00:07:18.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.696+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=885T2XOS9VGJ type=del 2024-09-12T00:07:18.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.698+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=WI1185RKIQMK type=del size=3258473 2024-09-12T00:07:18.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.699+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=VUQM5073NE9U type=del 2024-09-12T00:07:18.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.702+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~6PN0HJQDIX76.0 size=911265 2024-09-12T00:07:18.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.702+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=6PN0HJQDIX76 tag=A6S7VAUGN11S type=write size=1959841 2024-09-12T00:07:18.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.703+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=OU4D9XO7WJDE type=del 2024-09-12T00:07:18.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.704+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=NPYSSGOQITWW type=del size=3065867 2024-09-12T00:07:18.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.708+0000 7f82f8930780 1 < suggested remove operation key=HCK59C6MAW0B tag=2XZHAHBLSBLI type=write 2024-09-12T00:07:18.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.710+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=21XSF2T8UCDU type=del size=3579904 2024-09-12T00:07:18.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.710+0000 7f82f8930780 1 < canceled part key=_multipart_NCIZ4HNPCZ94.2~3KY8LSWQ1FXX.0 size=417473 2024-09-12T00:07:18.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.712+0000 7f82f8930780 1 < canceled multipart upload key=NCIZ4HNPCZ94 upload=3KY8LSWQ1FXX tag=HB5NJ7LIIHHP type=write size=1466049 2024-09-12T00:07:18.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.714+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~65O6HLWDCLCJ.0 size=152684 2024-09-12T00:07:18.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.714+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=65O6HLWDCLCJ tag=9SWLAQOC72SY type=write size=1201260 2024-09-12T00:07:18.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.717+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~D0ZGQ1SQR4UJ.0 size=1048576 2024-09-12T00:07:18.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.718+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~D0ZGQ1SQR4UJ.1 size=128234 2024-09-12T00:07:18.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.720+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=D0ZGQ1SQR4UJ tag=X41F8OU6YOZ0 type=write size=2225386 2024-09-12T00:07:18.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.721+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=KQBX9U2IL351 type=del size=3741187 2024-09-12T00:07:18.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.723+0000 7f82f8930780 1 < canceled operation key=A8EFUP30RS65 tag=J8KVLAR4U9SP type=write size=777060 2024-09-12T00:07:18.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.724+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=JA25YWGPUUXG type=del size=505428 2024-09-12T00:07:18.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.726+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~6PD5GNHHJB1U.0 size=1048576 2024-09-12T00:07:18.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.727+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~6PD5GNHHJB1U.1 size=1048576 2024-09-12T00:07:18.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.728+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~6PD5GNHHJB1U.2 size=926157 2024-09-12T00:07:18.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.731+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=6PD5GNHHJB1U tag=YTXXAD5K60AP type=write size=4071885 2024-09-12T00:07:18.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.732+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=F4MRPTALYRX3 type=del size=2256173 2024-09-12T00:07:18.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.733+0000 7f82f8930780 1 < canceled operation key=MJZ56OX8PLSH tag=ZDA9735455JG type=del size=316557 2024-09-12T00:07:18.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.736+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~NDLPRQZKFP2W.0 size=1048576 2024-09-12T00:07:18.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.737+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~NDLPRQZKFP2W.1 size=1048576 2024-09-12T00:07:18.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.738+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~NDLPRQZKFP2W.2 size=502368 2024-09-12T00:07:18.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.738+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=NDLPRQZKFP2W tag=BT5LSQYT8L6N type=write size=3648096 2024-09-12T00:07:18.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.740+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=TH57XWJS3CD7 type=del 2024-09-12T00:07:18.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.741+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=T7TILH394YVF type=write size=477602 2024-09-12T00:07:18.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.742+0000 7f82f8930780 1 < canceled operation key=62X93NOS23AF tag=6VK0LA0JIESS type=del size=614217 2024-09-12T00:07:18.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.744+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=DBP91ZDAV1CV type=del size=1727067 2024-09-12T00:07:18.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.745+0000 7f82f8930780 1 < canceled operation key=FHQADENLR6GP tag=Q45UGEBZM3KT type=del size=1213 2024-09-12T00:07:18.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.747+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=3SZM62LCDT62 type=del size=1222453 2024-09-12T00:07:18.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.748+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~0PKSXT6LZDLV.0 size=457749 2024-09-12T00:07:18.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.750+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=0PKSXT6LZDLV tag=WE5NCYE1G3WA type=write size=1506325 2024-09-12T00:07:18.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.754+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~OFGORPZA1SB6.0 size=384246 2024-09-12T00:07:18.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.754+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=OFGORPZA1SB6 tag=8REDGN2QJ2IG type=write size=1432822 2024-09-12T00:07:18.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.756+0000 7f82f8930780 1 < suggested remove operation key=N2TYUAJITFNL tag=E5NLUCTC03SM type=del 2024-09-12T00:07:18.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.758+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=DYYRBTAQAJGW type=write size=531261 2024-09-12T00:07:18.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.760+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=Q3YVBL9L8VUR type=del 2024-09-12T00:07:18.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.762+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~MY5FHT87ZB51.0 size=584428 2024-09-12T00:07:18.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.762+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=MY5FHT87ZB51 tag=B3IPDD6BXRWF type=write size=1633004 2024-09-12T00:07:18.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.763+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=1M7O2T4N0ES0 type=del 2024-09-12T00:07:18.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.765+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=A9GY4YBWK0RZ type=del size=4158369 2024-09-12T00:07:18.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.766+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=WI1185RKIQMK type=del 2024-09-12T00:07:18.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.767+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=5VK713ZT0Y3Z type=del size=3391147 2024-09-12T00:07:18.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.769+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~6PN0HJQDIX76.0 size=911265 2024-09-12T00:07:18.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.771+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=6PN0HJQDIX76 tag=A6S7VAUGN11S type=write size=1959841 2024-09-12T00:07:18.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.773+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=VUEX1ANX1IK3 type=del size=592684 2024-09-12T00:07:18.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.774+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=NPYSSGOQITWW type=del 2024-09-12T00:07:18.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.777+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~KXT00G9C4WS7.0 size=1048576 2024-09-12T00:07:18.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.778+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~KXT00G9C4WS7.1 size=606823 2024-09-12T00:07:18.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.778+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=KXT00G9C4WS7 tag=DK9Z86045928 type=write size=2703975 2024-09-12T00:07:18.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.779+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=21XSF2T8UCDU type=del 2024-09-12T00:07:18.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.781+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=6XTPW1LXMUJI type=del size=240538 2024-09-12T00:07:18.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.783+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~65O6HLWDCLCJ.0 size=152684 2024-09-12T00:07:18.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.785+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=65O6HLWDCLCJ tag=9SWLAQOC72SY type=write size=1201260 2024-09-12T00:07:18.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.786+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=1Z3V1BOMZ351 type=del size=1494382 2024-09-12T00:07:18.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.787+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=KQBX9U2IL351 type=del 2024-09-12T00:07:18.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.789+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=7NTRGGCQTJA2 type=del size=3017216 2024-09-12T00:07:18.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.791+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=JA25YWGPUUXG type=del 2024-09-12T00:07:18.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.793+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~SR5TNWJMKEZ2.0 size=1048576 2024-09-12T00:07:18.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.795+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~SR5TNWJMKEZ2.1 size=837096 2024-09-12T00:07:18.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.795+0000 7f82f8930780 1 > prepared multipart upload key=77SDZHCSP0E3 upload=SR5TNWJMKEZ2 tag=13Y53TYV0U4Z type=write size=2934248 2024-09-12T00:07:18.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.796+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=F4MRPTALYRX3 type=del 2024-09-12T00:07:18.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.799+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~CCTQA7R82YKH.0 size=541024 2024-09-12T00:07:18.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.799+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=CCTQA7R82YKH tag=CT77SJFLB20Y type=write size=1589600 2024-09-12T00:07:18.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.800+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~NDLPRQZKFP2W.0 size=1048576 2024-09-12T00:07:18.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.801+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~NDLPRQZKFP2W.1 size=1048576 2024-09-12T00:07:18.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.802+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~NDLPRQZKFP2W.2 size=502368 2024-09-12T00:07:18.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.806+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=NDLPRQZKFP2W tag=BT5LSQYT8L6N type=write size=3648096 2024-09-12T00:07:18.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.806+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=5L1QA8OYHJN8 type=del size=1192073 2024-09-12T00:07:18.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.808+0000 7f82f8930780 1 < completed write operation key=4SPRDO097JYQ tag=T7TILH394YVF type=write size=477602 2024-09-12T00:07:18.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.811+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~F15UWY59R4IB.0 size=663179 2024-09-12T00:07:18.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.811+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=F15UWY59R4IB tag=VRRQGQMMSR27 type=write size=1711755 2024-09-12T00:07:18.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.812+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=DBP91ZDAV1CV type=del 2024-09-12T00:07:18.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.815+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=7AP3CMT8Y5HL type=del size=673163 2024-09-12T00:07:18.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.817+0000 7f82f8930780 1 < suggested update operation key=X3PCR8TCWDTK tag=3SZM62LCDT62 type=del size=1222453 2024-09-12T00:07:18.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.820+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~1FYG8MD4R1E4.0 size=1042200 2024-09-12T00:07:18.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.820+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=1FYG8MD4R1E4 tag=5N1I29VUKL5K type=write size=2090776 2024-09-12T00:07:18.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.822+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~OFGORPZA1SB6.0 size=384246 2024-09-12T00:07:18.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.824+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=OFGORPZA1SB6 tag=8REDGN2QJ2IG type=write size=1432822 2024-09-12T00:07:18.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.825+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=FATPT7L4675K type=del size=1060985 2024-09-12T00:07:18.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.828+0000 7f82f8930780 1 < suggested update operation key=N2TYUAJITFNL tag=DYYRBTAQAJGW type=write size=531261 2024-09-12T00:07:18.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.829+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=L0LNE5UCVFI3 type=del size=763586 2024-09-12T00:07:18.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.831+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~MY5FHT87ZB51.0 size=584428 2024-09-12T00:07:18.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.833+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=MY5FHT87ZB51 tag=B3IPDD6BXRWF type=write size=1633004 2024-09-12T00:07:18.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.835+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=KEREY7DTRDI5 type=del size=2837408 2024-09-12T00:07:18.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.836+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=A9GY4YBWK0RZ type=del 2024-09-12T00:07:18.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.838+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=REX07H6SQBXW type=del size=408281 2024-09-12T00:07:18.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.840+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=5VK713ZT0Y3Z type=del 2024-09-12T00:07:18.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.841+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=SWKP20TQNK7L type=write size=718303 2024-09-12T00:07:18.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.842+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=VUEX1ANX1IK3 type=del 2024-09-12T00:07:18.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.844+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=KKRTAVZGNT6A type=del size=1956689 2024-09-12T00:07:18.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.845+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~KXT00G9C4WS7.0 size=1048576 2024-09-12T00:07:18.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.847+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~KXT00G9C4WS7.1 size=606823 2024-09-12T00:07:18.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.849+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=KXT00G9C4WS7 tag=DK9Z86045928 type=write size=2703975 2024-09-12T00:07:18.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.851+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~XOAEAPGQHTMX.0 size=1048576 2024-09-12T00:07:18.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.853+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~XOAEAPGQHTMX.1 size=879731 2024-09-12T00:07:18.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.853+0000 7f82f8930780 1 > prepared multipart upload key=77SDZHCSP0E3 upload=XOAEAPGQHTMX tag=HQEP2PC0Z5IC type=write size=2976883 2024-09-12T00:07:18.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.855+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=6XTPW1LXMUJI type=del 2024-09-12T00:07:18.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.857+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~C32PT2ROJABL.0 size=1048576 2024-09-12T00:07:18.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.858+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~C32PT2ROJABL.1 size=1048576 2024-09-12T00:07:18.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.860+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~C32PT2ROJABL.2 size=570263 2024-09-12T00:07:18.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.860+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=C32PT2ROJABL tag=D9PQGQX1O1AM type=write size=3715991 2024-09-12T00:07:18.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.863+0000 7f82f8930780 1 < suggested remove operation key=O2ZGU2KOTUOT tag=1Z3V1BOMZ351 type=del 2024-09-12T00:07:18.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.864+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=G420A4ATJU33 type=del size=3799823 2024-09-12T00:07:18.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.865+0000 7f82f8930780 1 < completed delete operation key=HCK59C6MAW0B tag=7NTRGGCQTJA2 type=del 2024-09-12T00:07:18.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.867+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=XBRD397W5PV5 type=write size=1180 2024-09-12T00:07:18.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.868+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~SR5TNWJMKEZ2.0 size=1048576 2024-09-12T00:07:18.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.870+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~SR5TNWJMKEZ2.1 size=837096 2024-09-12T00:07:18.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.872+0000 7f82f8930780 1 < completed multipart upload key=77SDZHCSP0E3 upload=SR5TNWJMKEZ2 tag=13Y53TYV0U4Z type=write size=2934248 2024-09-12T00:07:18.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.873+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=79VEGCFX1I9U type=del size=1136077 2024-09-12T00:07:18.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.875+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~CCTQA7R82YKH.0 size=541024 2024-09-12T00:07:18.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.877+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=CCTQA7R82YKH tag=CT77SJFLB20Y type=write size=1589600 2024-09-12T00:07:18.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.879+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~BAIWTFODE92E.0 size=330306 2024-09-12T00:07:18.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.879+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=BAIWTFODE92E tag=2PESA4E6F9R8 type=write size=1378882 2024-09-12T00:07:18.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.881+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=5L1QA8OYHJN8 type=del 2024-09-12T00:07:18.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.882+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=DH7TR4AOIVL7 type=del size=3468708 2024-09-12T00:07:18.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.884+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~F15UWY59R4IB.0 size=663179 2024-09-12T00:07:18.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.887+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=F15UWY59R4IB tag=VRRQGQMMSR27 type=write size=1711755 2024-09-12T00:07:18.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.887+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=9HP2P4GAAJC7 type=write size=42444 2024-09-12T00:07:18.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.890+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=7AP3CMT8Y5HL type=del 2024-09-12T00:07:18.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.891+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=OO9ZI3GKLERP type=del size=2416017 2024-09-12T00:07:18.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.892+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~1FYG8MD4R1E4.0 size=1042200 2024-09-12T00:07:18.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.895+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=1FYG8MD4R1E4 tag=5N1I29VUKL5K type=write size=2090776 2024-09-12T00:07:18.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.896+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=SD9VOE10KB62 type=del size=3629318 2024-09-12T00:07:18.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.898+0000 7f82f8930780 1 < completed delete operation key=9576W9WYJUJV tag=FATPT7L4675K type=del 2024-09-12T00:07:18.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.899+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=JF8JPF1MJQIP type=del size=1631780 2024-09-12T00:07:18.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.901+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=L0LNE5UCVFI3 type=del 2024-09-12T00:07:18.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.903+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=V2134IGSYOIJ type=write size=474416 2024-09-12T00:07:18.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.904+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=KEREY7DTRDI5 type=del 2024-09-12T00:07:18.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.906+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~BZJ08V3TJ4X7.0 size=227774 2024-09-12T00:07:18.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.907+0000 7f82f8930780 1 > prepared multipart upload key=IN8Y7I0HKP6D upload=BZJ08V3TJ4X7 tag=KIXGMMKTRX4P type=write size=1276350 2024-09-12T00:07:18.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.909+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=REX07H6SQBXW type=del 2024-09-12T00:07:18.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.911+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~LEKK3UIUQ4WV.0 size=1048576 2024-09-12T00:07:18.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.913+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~LEKK3UIUQ4WV.1 size=1048576 2024-09-12T00:07:18.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.914+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~LEKK3UIUQ4WV.2 size=777905 2024-09-12T00:07:18.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.914+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=LEKK3UIUQ4WV tag=7FHR51EXOPWL type=write size=3923633 2024-09-12T00:07:18.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.914+0000 7f82f8930780 1 < completed write operation key=FHQADENLR6GP tag=SWKP20TQNK7L type=write size=718303 2024-09-12T00:07:18.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.917+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~9POG0G9K83GU.0 size=1048576 2024-09-12T00:07:18.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.918+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~9POG0G9K83GU.1 size=1048576 2024-09-12T00:07:18.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.919+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~9POG0G9K83GU.2 size=432838 2024-09-12T00:07:18.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.919+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=9POG0G9K83GU tag=MTTV98DUGB1T type=write size=3578566 2024-09-12T00:07:18.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.921+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=KKRTAVZGNT6A type=del 2024-09-12T00:07:18.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.924+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~WNYQ2282V78O.0 size=571595 2024-09-12T00:07:18.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.924+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=WNYQ2282V78O tag=PLQ2SB6HOUN3 type=write size=1620171 2024-09-12T00:07:18.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.925+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~XOAEAPGQHTMX.0 size=1048576 2024-09-12T00:07:18.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.926+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~XOAEAPGQHTMX.1 size=879731 2024-09-12T00:07:18.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.928+0000 7f82f8930780 1 < completed multipart upload key=77SDZHCSP0E3 upload=XOAEAPGQHTMX tag=HQEP2PC0Z5IC type=write size=2976883 2024-09-12T00:07:18.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.930+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=AAOX2LKQL7RC type=del size=3109780 2024-09-12T00:07:18.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.931+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~C32PT2ROJABL.0 size=1048576 2024-09-12T00:07:18.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.933+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~C32PT2ROJABL.1 size=1048576 2024-09-12T00:07:18.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.934+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~C32PT2ROJABL.2 size=570263 2024-09-12T00:07:18.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.937+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=C32PT2ROJABL tag=D9PQGQX1O1AM type=write size=3715991 2024-09-12T00:07:18.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.939+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~XX427CROTAH1.0 size=451559 2024-09-12T00:07:18.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.939+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=XX427CROTAH1 tag=MKDILPL98BWH type=write size=1500135 2024-09-12T00:07:18.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.940+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=G420A4ATJU33 type=del 2024-09-12T00:07:18.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.943+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~17YH2NEPBW9X.0 size=1048576 2024-09-12T00:07:18.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.944+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~17YH2NEPBW9X.1 size=181108 2024-09-12T00:07:18.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.944+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=17YH2NEPBW9X tag=8AM3TZ0TRO03 type=write size=2278260 2024-09-12T00:07:18.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.945+0000 7f82f8930780 1 < completed write operation key=N2TYUAJITFNL tag=XBRD397W5PV5 type=write size=1180 2024-09-12T00:07:18.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.947+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=RUGJFV5GZT11 type=write size=232895 2024-09-12T00:07:18.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.948+0000 7f82f8930780 1 < completed delete operation key=FOWSB9RQ5TV5 tag=79VEGCFX1I9U type=del 2024-09-12T00:07:18.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.952+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~QO7I3CEOL8DL.0 size=1048576 2024-09-12T00:07:18.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.952+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~QO7I3CEOL8DL.1 size=911615 2024-09-12T00:07:18.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.952+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=QO7I3CEOL8DL tag=CWIR06T9JFDR type=write size=3008767 2024-09-12T00:07:18.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.953+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~BAIWTFODE92E.0 size=330306 2024-09-12T00:07:18.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.956+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=BAIWTFODE92E tag=2PESA4E6F9R8 type=write size=1378882 2024-09-12T00:07:18.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.957+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=9FOSU3X1B162 type=del size=2787654 2024-09-12T00:07:18.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.959+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=DH7TR4AOIVL7 type=del 2024-09-12T00:07:18.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.960+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=8QJXPOPZ4TJO type=write size=118289 2024-09-12T00:07:18.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.962+0000 7f82f8930780 1 < canceled operation key=IMAT4ZCLGFRN tag=9HP2P4GAAJC7 type=write size=42444 2024-09-12T00:07:18.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.963+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=XF1X1JWJWTXB type=del size=2689395 2024-09-12T00:07:18.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.964+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=OO9ZI3GKLERP type=del 2024-09-12T00:07:18.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.966+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=M9HM9SMO4Z0L type=del size=1964654 2024-09-12T00:07:18.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.970+0000 7f82f8930780 1 < suggested update operation key=9576W9WYJUJV tag=SD9VOE10KB62 type=del size=3629318 2024-09-12T00:07:18.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.973+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~FZRH0N9ZI4XA.0 size=1048576 2024-09-12T00:07:18.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.974+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~FZRH0N9ZI4XA.1 size=1048576 2024-09-12T00:07:18.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.975+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~FZRH0N9ZI4XA.2 size=331310 2024-09-12T00:07:18.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.975+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=FZRH0N9ZI4XA tag=XC90O98D432L type=write size=3477038 2024-09-12T00:07:18.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.976+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=JF8JPF1MJQIP type=del 2024-09-12T00:07:18.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.978+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=8EL0ATP7GQ2L type=del size=587388 2024-09-12T00:07:18.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.981+0000 7f82f8930780 1 < suggested update operation key=FHQADENLR6GP tag=V2134IGSYOIJ type=write size=474416 2024-09-12T00:07:18.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.984+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~FMXVWFYTTEUY.0 size=1048576 2024-09-12T00:07:18.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.986+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~FMXVWFYTTEUY.1 size=1048576 2024-09-12T00:07:18.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.986+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~FMXVWFYTTEUY.2 size=335949 2024-09-12T00:07:18.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.986+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=FMXVWFYTTEUY tag=ZL01RH09CCQE type=write size=3481677 2024-09-12T00:07:18.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.989+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~BZJ08V3TJ4X7.0 size=227774 2024-09-12T00:07:18.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.992+0000 7f82f8930780 1 < completed multipart upload key=IN8Y7I0HKP6D upload=BZJ08V3TJ4X7 tag=KIXGMMKTRX4P type=write size=1276350 2024-09-12T00:07:18.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.993+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=VD79JFQH8G0S type=del size=1511759 2024-09-12T00:07:18.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.994+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~LEKK3UIUQ4WV.0 size=1048576 2024-09-12T00:07:18.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.994+0000 7f82f8930780 1 < canceled part key=_multipart_Y8GDXNDCOHCW.2~LEKK3UIUQ4WV.1 size=1048576 2024-09-12T00:07:18.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.994+0000 7f82f8930780 1 < canceled part key=_multipart_Y8GDXNDCOHCW.2~LEKK3UIUQ4WV.2 size=777905 2024-09-12T00:07:18.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.996+0000 7f82f8930780 1 < canceled multipart upload key=Y8GDXNDCOHCW upload=LEKK3UIUQ4WV tag=7FHR51EXOPWL type=write size=3923633 2024-09-12T00:07:18.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.998+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=H44V8TLAFN7R type=del size=3198295 2024-09-12T00:07:18.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:18.999+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~9POG0G9K83GU.0 size=1048576 2024-09-12T00:07:19.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.001+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~9POG0G9K83GU.1 size=1048576 2024-09-12T00:07:19.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.002+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~9POG0G9K83GU.2 size=432838 2024-09-12T00:07:19.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.004+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=9POG0G9K83GU tag=MTTV98DUGB1T type=write size=3578566 2024-09-12T00:07:19.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.006+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=KJPI7S5EQ2UH type=del size=3327757 2024-09-12T00:07:19.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.007+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~WNYQ2282V78O.0 size=571595 2024-09-12T00:07:19.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.010+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=WNYQ2282V78O tag=PLQ2SB6HOUN3 type=write size=1620171 2024-09-12T00:07:19.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.011+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=EX5C4TFXP5CE type=del size=1045753 2024-09-12T00:07:19.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.014+0000 7f82f8930780 1 < suggested remove operation key=N2TYUAJITFNL tag=AAOX2LKQL7RC type=del 2024-09-12T00:07:19.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.017+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~A1PY13ZZIG6P.0 size=1048576 2024-09-12T00:07:19.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.018+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~A1PY13ZZIG6P.1 size=1048576 2024-09-12T00:07:19.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.019+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~A1PY13ZZIG6P.2 size=609952 2024-09-12T00:07:19.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.019+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=A1PY13ZZIG6P tag=999QNA8KVL8K type=write size=3755680 2024-09-12T00:07:19.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.020+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~XX427CROTAH1.0 size=451559 2024-09-12T00:07:19.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.022+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=XX427CROTAH1 tag=MKDILPL98BWH type=write size=1500135 2024-09-12T00:07:19.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.025+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~N67KE37KEVH6.0 size=1048576 2024-09-12T00:07:19.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.026+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~N67KE37KEVH6.1 size=1048576 2024-09-12T00:07:19.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.027+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~N67KE37KEVH6.2 size=510077 2024-09-12T00:07:19.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.027+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=N67KE37KEVH6 tag=4I0TWH80F0BY type=write size=3655805 2024-09-12T00:07:19.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.030+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~17YH2NEPBW9X.0 size=1048576 2024-09-12T00:07:19.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.031+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~17YH2NEPBW9X.1 size=181108 2024-09-12T00:07:19.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.033+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=17YH2NEPBW9X tag=8AM3TZ0TRO03 type=write size=2278260 2024-09-12T00:07:19.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.035+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~NAB9MD2YADZD.0 size=573475 2024-09-12T00:07:19.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.035+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=NAB9MD2YADZD tag=QWWZ438FZWRW type=write size=1622051 2024-09-12T00:07:19.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.036+0000 7f82f8930780 -1 < failed to complete operation key=N2TYUAJITFNL tag=RUGJFV5GZT11 type=write size=232895: (22) Invalid argument 2024-09-12T00:07:19.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.038+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=57EG1WV6FZV9 type=del size=3719476 2024-09-12T00:07:19.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.040+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~QO7I3CEOL8DL.0 size=1048576 2024-09-12T00:07:19.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.041+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~QO7I3CEOL8DL.1 size=911615 2024-09-12T00:07:19.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.043+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=QO7I3CEOL8DL tag=CWIR06T9JFDR type=write size=3008767 2024-09-12T00:07:19.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.045+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=H6YCZ7AJSB8R type=del size=3510365 2024-09-12T00:07:19.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.046+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=9FOSU3X1B162 type=del 2024-09-12T00:07:19.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.049+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=KU000DA3EUIP type=del size=1170479 2024-09-12T00:07:19.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.049+0000 7f82f8930780 1 < canceled operation key=YWC5JUV5B2N6 tag=8QJXPOPZ4TJO type=write size=118289 2024-09-12T00:07:19.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.051+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=9KWRVJDUWYK2 type=del size=659197 2024-09-12T00:07:19.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.054+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=XF1X1JWJWTXB type=del 2024-09-12T00:07:19.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.055+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=LFEWKU5PK294 type=del size=3492433 2024-09-12T00:07:19.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.057+0000 7f82f8930780 1 < suggested update operation key=YWC5JUV5B2N6 tag=M9HM9SMO4Z0L type=del size=1964654 2024-09-12T00:07:19.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.059+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=15MNDW96TNJE type=del size=842746 2024-09-12T00:07:19.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.060+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~FZRH0N9ZI4XA.0 size=1048576 2024-09-12T00:07:19.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.061+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~FZRH0N9ZI4XA.1 size=1048576 2024-09-12T00:07:19.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.063+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~FZRH0N9ZI4XA.2 size=331310 2024-09-12T00:07:19.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.065+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=FZRH0N9ZI4XA tag=XC90O98D432L type=write size=3477038 2024-09-12T00:07:19.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.067+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=6I07QEWE1NV0 type=del size=2600367 2024-09-12T00:07:19.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.068+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=8EL0ATP7GQ2L type=del 2024-09-12T00:07:19.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.070+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=1GT5FTHEM5S4 type=del size=1642834 2024-09-12T00:07:19.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.071+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~FMXVWFYTTEUY.0 size=1048576 2024-09-12T00:07:19.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.072+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~FMXVWFYTTEUY.1 size=1048576 2024-09-12T00:07:19.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.073+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~FMXVWFYTTEUY.2 size=335949 2024-09-12T00:07:19.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.077+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=FMXVWFYTTEUY tag=ZL01RH09CCQE type=write size=3481677 2024-09-12T00:07:19.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.078+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=YHDNHUW6RWJK type=del size=530766 2024-09-12T00:07:19.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.079+0000 7f82f8930780 -1 < failed to complete operation key=YWC5JUV5B2N6 tag=VD79JFQH8G0S type=del size=1511759: (22) Invalid argument 2024-09-12T00:07:19.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.082+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~04KIE6QVTJH6.0 size=1048576 2024-09-12T00:07:19.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.083+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~04KIE6QVTJH6.1 size=1048576 2024-09-12T00:07:19.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.085+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~04KIE6QVTJH6.2 size=179106 2024-09-12T00:07:19.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.085+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=04KIE6QVTJH6 tag=EO7NUSLK9CY4 type=write size=3324834 2024-09-12T00:07:19.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.086+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=H44V8TLAFN7R type=del 2024-09-12T00:07:19.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.088+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=Y2MW8OS47IT1 type=del size=3466359 2024-09-12T00:07:19.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.090+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=KJPI7S5EQ2UH type=del 2024-09-12T00:07:19.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.091+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=H91IABCX6E62 type=del size=1995799 2024-09-12T00:07:19.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.093+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=EX5C4TFXP5CE type=del 2024-09-12T00:07:19.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.094+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=2MEESHTIZU0T type=del size=1260953 2024-09-12T00:07:19.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.096+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~A1PY13ZZIG6P.0 size=1048576 2024-09-12T00:07:19.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.097+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~A1PY13ZZIG6P.1 size=1048576 2024-09-12T00:07:19.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.098+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~A1PY13ZZIG6P.2 size=609952 2024-09-12T00:07:19.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.101+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=A1PY13ZZIG6P tag=999QNA8KVL8K type=write size=3755680 2024-09-12T00:07:19.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.103+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=G7E32CSEWH9N type=del size=3842584 2024-09-12T00:07:19.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.105+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~N67KE37KEVH6.0 size=1048576 2024-09-12T00:07:19.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.105+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~N67KE37KEVH6.1 size=1048576 2024-09-12T00:07:19.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.106+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~N67KE37KEVH6.2 size=510077 2024-09-12T00:07:19.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.109+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=N67KE37KEVH6 tag=4I0TWH80F0BY type=write size=3655805 2024-09-12T00:07:19.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.112+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~ZBUGAKVBFOCW.0 size=831226 2024-09-12T00:07:19.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.112+0000 7f82f8930780 1 > prepared multipart upload key=4IA4918NXXJW upload=ZBUGAKVBFOCW tag=GCWGZC80UB25 type=write size=1879802 2024-09-12T00:07:19.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.113+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~NAB9MD2YADZD.0 size=573475 2024-09-12T00:07:19.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.116+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=NAB9MD2YADZD tag=QWWZ438FZWRW type=write size=1622051 2024-09-12T00:07:19.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.117+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=OL586UVD0CKQ type=write size=935566 2024-09-12T00:07:19.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.119+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=57EG1WV6FZV9 type=del 2024-09-12T00:07:19.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.120+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=WQWLU8KFWSRC type=del size=1154348 2024-09-12T00:07:19.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.121+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=H6YCZ7AJSB8R type=del 2024-09-12T00:07:19.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.123+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=GC93YRB3SIEE type=write size=725501 2024-09-12T00:07:19.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.125+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=KU000DA3EUIP type=del 2024-09-12T00:07:19.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.126+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=5K1FT630U1V6 type=write size=80526 2024-09-12T00:07:19.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.130+0000 7f82f8930780 1 < canceled operation key=4IA4918NXXJW tag=9KWRVJDUWYK2 type=del size=659197 2024-09-12T00:07:19.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.133+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~G61EMRMX5QJV.0 size=243815 2024-09-12T00:07:19.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.133+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=G61EMRMX5QJV tag=PX34FA52UBUW type=write size=1292391 2024-09-12T00:07:19.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.134+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=LFEWKU5PK294 type=del 2024-09-12T00:07:19.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.136+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=QDKBRM52A4T0 type=del size=2262655 2024-09-12T00:07:19.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.137+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=15MNDW96TNJE type=del 2024-09-12T00:07:19.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.139+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=868CSFYOPHVD type=del size=3828756 2024-09-12T00:07:19.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.142+0000 7f82f8930780 1 < suggested remove operation key=80OUXNDPLGAG tag=6I07QEWE1NV0 type=del 2024-09-12T00:07:19.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.144+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=AS09ID9Y9BR2 type=del size=3178739 2024-09-12T00:07:19.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.145+0000 7f82f8930780 -1 < failed to complete operation key=80OUXNDPLGAG tag=1GT5FTHEM5S4 type=del size=1642834: (22) Invalid argument 2024-09-12T00:07:19.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.148+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~AZ67QCO45OKN.0 size=1048576 2024-09-12T00:07:19.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.149+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~AZ67QCO45OKN.1 size=1048576 2024-09-12T00:07:19.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.150+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~AZ67QCO45OKN.2 size=966234 2024-09-12T00:07:19.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.150+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=AZ67QCO45OKN tag=L0MC0JXSDV7E type=write size=4111962 2024-09-12T00:07:19.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.151+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=YHDNHUW6RWJK type=del 2024-09-12T00:07:19.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.154+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~QX8ER4MGELPO.0 size=629476 2024-09-12T00:07:19.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.154+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=QX8ER4MGELPO tag=HEK73OFEU3AV type=write size=1678052 2024-09-12T00:07:19.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.156+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~04KIE6QVTJH6.0 size=1048576 2024-09-12T00:07:19.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.157+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~04KIE6QVTJH6.1 size=1048576 2024-09-12T00:07:19.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.158+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~04KIE6QVTJH6.2 size=179106 2024-09-12T00:07:19.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.160+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=04KIE6QVTJH6 tag=EO7NUSLK9CY4 type=write size=3324834 2024-09-12T00:07:19.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.162+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~1K124FTMH28B.0 size=254417 2024-09-12T00:07:19.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.162+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=1K124FTMH28B tag=GKUJHJ0HMSFO type=write size=1302993 2024-09-12T00:07:19.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.164+0000 7f82f8930780 1 < canceled operation key=IMAT4ZCLGFRN tag=Y2MW8OS47IT1 type=del size=3466359 2024-09-12T00:07:19.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.165+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=JH2LWULPQ8ZD type=del size=3752040 2024-09-12T00:07:19.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.166+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=H91IABCX6E62 type=del 2024-09-12T00:07:19.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.168+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=LPG9IXE555PA type=del size=3757205 2024-09-12T00:07:19.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.169+0000 7f82f8930780 1 < canceled operation key=3H3D067Z8O0R tag=2MEESHTIZU0T type=del size=1260953 2024-09-12T00:07:19.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.171+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=QFBNJ0WCJHKB type=write size=61728 2024-09-12T00:07:19.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.172+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=G7E32CSEWH9N type=del 2024-09-12T00:07:19.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.175+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~UK6EKALNI2L3.0 size=521617 2024-09-12T00:07:19.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.175+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=UK6EKALNI2L3 tag=9R034OIYU2ZL type=write size=1570193 2024-09-12T00:07:19.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.176+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~ZBUGAKVBFOCW.0 size=831226 2024-09-12T00:07:19.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.179+0000 7f82f8930780 1 < completed multipart upload key=4IA4918NXXJW upload=ZBUGAKVBFOCW tag=GCWGZC80UB25 type=write size=1879802 2024-09-12T00:07:19.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.180+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=BI2DSZ21FNVA type=del size=2935374 2024-09-12T00:07:19.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.181+0000 7f82f8930780 1 < completed write operation key=IN8Y7I0HKP6D tag=OL586UVD0CKQ type=write size=935566 2024-09-12T00:07:19.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.184+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~P2FSTJEWSQE3.0 size=106578 2024-09-12T00:07:19.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.184+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=P2FSTJEWSQE3 tag=IN36NASZ0KPC type=write size=1155154 2024-09-12T00:07:19.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.185+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=WQWLU8KFWSRC type=del 2024-09-12T00:07:19.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.188+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~JF706DQ4PVDZ.0 size=1048576 2024-09-12T00:07:19.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.189+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~JF706DQ4PVDZ.1 size=195435 2024-09-12T00:07:19.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.189+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=JF706DQ4PVDZ tag=20N3IGZH23RW type=write size=2292587 2024-09-12T00:07:19.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.190+0000 7f82f8930780 1 < completed write operation key=77SDZHCSP0E3 tag=GC93YRB3SIEE type=write size=725501 2024-09-12T00:07:19.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.192+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=BXBDJWHOZ656 type=del size=3048447 2024-09-12T00:07:19.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.193+0000 7f82f8930780 1 < completed write operation key=O2ZGU2KOTUOT tag=5K1FT630U1V6 type=write size=80526 2024-09-12T00:07:19.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.196+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~K8OPYMMN5CH3.0 size=1048576 2024-09-12T00:07:19.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.197+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~K8OPYMMN5CH3.1 size=1048576 2024-09-12T00:07:19.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.198+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~K8OPYMMN5CH3.2 size=785407 2024-09-12T00:07:19.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.198+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=K8OPYMMN5CH3 tag=80DVF3G71MP9 type=write size=3931135 2024-09-12T00:07:19.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.199+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~G61EMRMX5QJV.0 size=243815 2024-09-12T00:07:19.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.202+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=G61EMRMX5QJV tag=PX34FA52UBUW type=write size=1292391 2024-09-12T00:07:19.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.203+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=J0CIYZ8A2H69 type=del size=1470649 2024-09-12T00:07:19.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.205+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=QDKBRM52A4T0 type=del 2024-09-12T00:07:19.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.206+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=CRW8W93O6OFJ type=write size=140523 2024-09-12T00:07:19.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.208+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=868CSFYOPHVD type=del 2024-09-12T00:07:19.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.211+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~504IYYUIEP0H.0 size=1048576 2024-09-12T00:07:19.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.212+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~504IYYUIEP0H.1 size=720018 2024-09-12T00:07:19.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.212+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=504IYYUIEP0H tag=EXBL3L4LJ8C7 type=write size=2817170 2024-09-12T00:07:19.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.213+0000 7f82f8930780 1 < completed delete operation key=HCK59C6MAW0B tag=AS09ID9Y9BR2 type=del 2024-09-12T00:07:19.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.216+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~6K3IGMH33KDK.0 size=1048576 2024-09-12T00:07:19.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.217+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~6K3IGMH33KDK.1 size=1048576 2024-09-12T00:07:19.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.218+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~6K3IGMH33KDK.2 size=446732 2024-09-12T00:07:19.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.218+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=6K3IGMH33KDK tag=8NFDKAGPX55W type=write size=3592460 2024-09-12T00:07:19.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.219+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~AZ67QCO45OKN.0 size=1048576 2024-09-12T00:07:19.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.220+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~AZ67QCO45OKN.1 size=1048576 2024-09-12T00:07:19.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.221+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~AZ67QCO45OKN.2 size=966234 2024-09-12T00:07:19.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.224+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=AZ67QCO45OKN tag=L0MC0JXSDV7E type=write size=4111962 2024-09-12T00:07:19.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.226+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~E0RVYN2H21NR.0 size=1048576 2024-09-12T00:07:19.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.227+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~E0RVYN2H21NR.1 size=105855 2024-09-12T00:07:19.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.227+0000 7f82f8930780 1 > prepared multipart upload key=77SDZHCSP0E3 upload=E0RVYN2H21NR tag=PYL1Q5IK1QBO type=write size=2203007 2024-09-12T00:07:19.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.229+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~QX8ER4MGELPO.0 size=629476 2024-09-12T00:07:19.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.231+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=QX8ER4MGELPO tag=HEK73OFEU3AV type=write size=1678052 2024-09-12T00:07:19.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.233+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=V7MD96MJHALV type=write size=892183 2024-09-12T00:07:19.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.233+0000 7f82f8930780 1 < canceled part key=_multipart_80OUXNDPLGAG.2~1K124FTMH28B.0 size=254417 2024-09-12T00:07:19.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.236+0000 7f82f8930780 1 < canceled multipart upload key=80OUXNDPLGAG upload=1K124FTMH28B tag=GKUJHJ0HMSFO type=write size=1302993 2024-09-12T00:07:19.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.236+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=A6PZMPMLF2E0 type=del size=3717366 2024-09-12T00:07:19.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.239+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=JH2LWULPQ8ZD type=del 2024-09-12T00:07:19.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.239+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=7WXPM1K50IL1 type=del size=721753 2024-09-12T00:07:19.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.241+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=LPG9IXE555PA type=del 2024-09-12T00:07:19.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.242+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=UC3ZRKQ0TBGM type=del size=2755940 2024-09-12T00:07:19.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.245+0000 7f82f8930780 1 < completed write operation key=4IA4918NXXJW tag=QFBNJ0WCJHKB type=write size=61728 2024-09-12T00:07:19.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.246+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~E2NIGR9TDF3S.0 size=1048576 2024-09-12T00:07:19.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.247+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~E2NIGR9TDF3S.1 size=1048576 2024-09-12T00:07:19.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.249+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~E2NIGR9TDF3S.2 size=735870 2024-09-12T00:07:19.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.249+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=E2NIGR9TDF3S tag=ZG4BPZSDY9QB type=write size=3881598 2024-09-12T00:07:19.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.250+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~UK6EKALNI2L3.0 size=521617 2024-09-12T00:07:19.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.252+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=UK6EKALNI2L3 tag=9R034OIYU2ZL type=write size=1570193 2024-09-12T00:07:19.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.255+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~1A6B3EL6KOVK.0 size=1048576 2024-09-12T00:07:19.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.256+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~1A6B3EL6KOVK.1 size=254708 2024-09-12T00:07:19.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.256+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=1A6B3EL6KOVK tag=QYYTQL8W3L1Z type=write size=2351860 2024-09-12T00:07:19.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.258+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=BI2DSZ21FNVA type=del 2024-09-12T00:07:19.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.261+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~SKC8WOG1NVQQ.0 size=1048576 2024-09-12T00:07:19.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.264+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~SKC8WOG1NVQQ.1 size=1048576 2024-09-12T00:07:19.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.264+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~SKC8WOG1NVQQ.2 size=541285 2024-09-12T00:07:19.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.264+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=SKC8WOG1NVQQ tag=KYR3J4VY1UOH type=write size=3687013 2024-09-12T00:07:19.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.265+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~P2FSTJEWSQE3.0 size=106578 2024-09-12T00:07:19.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.268+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=P2FSTJEWSQE3 tag=IN36NASZ0KPC type=write size=1155154 2024-09-12T00:07:19.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.270+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=4QEA98M6Q3DW type=del size=3695869 2024-09-12T00:07:19.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.271+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~JF706DQ4PVDZ.0 size=1048576 2024-09-12T00:07:19.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.272+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~JF706DQ4PVDZ.1 size=195435 2024-09-12T00:07:19.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.274+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=JF706DQ4PVDZ tag=20N3IGZH23RW type=write size=2292587 2024-09-12T00:07:19.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.275+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=JYRHE1CFFTLF type=del size=1457853 2024-09-12T00:07:19.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.277+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=BXBDJWHOZ656 type=del 2024-09-12T00:07:19.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.279+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~W4BB7MFZ3FKK.0 size=1048576 2024-09-12T00:07:19.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.281+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~W4BB7MFZ3FKK.1 size=1048576 2024-09-12T00:07:19.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.282+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~W4BB7MFZ3FKK.2 size=807033 2024-09-12T00:07:19.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.282+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=W4BB7MFZ3FKK tag=RIBWB84M9BP4 type=write size=3952761 2024-09-12T00:07:19.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.283+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~K8OPYMMN5CH3.0 size=1048576 2024-09-12T00:07:19.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.285+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~K8OPYMMN5CH3.1 size=1048576 2024-09-12T00:07:19.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.285+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~K8OPYMMN5CH3.2 size=785407 2024-09-12T00:07:19.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.288+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=K8OPYMMN5CH3 tag=80DVF3G71MP9 type=write size=3931135 2024-09-12T00:07:19.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.290+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=ATN312CR7MRK type=del size=1434365 2024-09-12T00:07:19.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.290+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=J0CIYZ8A2H69 type=del 2024-09-12T00:07:19.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.292+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=UWD95RUHFSMQ type=del size=1846486 2024-09-12T00:07:19.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.293+0000 7f82f8930780 1 < completed write operation key=3X2PLA3ODHJ1 tag=CRW8W93O6OFJ type=write size=140523 2024-09-12T00:07:19.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.296+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~9NPH1FS5Y47X.0 size=1048576 2024-09-12T00:07:19.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.297+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~9NPH1FS5Y47X.1 size=1048576 2024-09-12T00:07:19.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.298+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~9NPH1FS5Y47X.2 size=826678 2024-09-12T00:07:19.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.298+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=9NPH1FS5Y47X tag=IKPL6R4HBOXX type=write size=3972406 2024-09-12T00:07:19.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.299+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~504IYYUIEP0H.0 size=1048576 2024-09-12T00:07:19.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.301+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~504IYYUIEP0H.1 size=720018 2024-09-12T00:07:19.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.304+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=504IYYUIEP0H tag=EXBL3L4LJ8C7 type=write size=2817170 2024-09-12T00:07:19.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.305+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=2XGUA489654B type=del size=2721271 2024-09-12T00:07:19.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.307+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~6K3IGMH33KDK.0 size=1048576 2024-09-12T00:07:19.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.308+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~6K3IGMH33KDK.1 size=1048576 2024-09-12T00:07:19.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.309+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~6K3IGMH33KDK.2 size=446732 2024-09-12T00:07:19.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.311+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=6K3IGMH33KDK tag=8NFDKAGPX55W type=write size=3592460 2024-09-12T00:07:19.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.313+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~BFBAOHO4OM0V.0 size=927057 2024-09-12T00:07:19.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.313+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=BFBAOHO4OM0V tag=TG3S2WKE47NU type=write size=1975633 2024-09-12T00:07:19.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.313+0000 7f82f8930780 1 < canceled part key=_multipart_77SDZHCSP0E3.2~E0RVYN2H21NR.0 size=1048576 2024-09-12T00:07:19.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.314+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~E0RVYN2H21NR.1 size=105855 2024-09-12T00:07:19.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.317+0000 7f82f8930780 1 < canceled multipart upload key=77SDZHCSP0E3 upload=E0RVYN2H21NR tag=PYL1Q5IK1QBO type=write size=2203007 2024-09-12T00:07:19.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.318+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=0FL1RLI7A81S type=del size=739229 2024-09-12T00:07:19.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.320+0000 7f82f8930780 1 < completed write operation key=OVJOP07M9KB8 tag=V7MD96MJHALV type=write size=892183 2024-09-12T00:07:19.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.321+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=2K06D1KWY3MP type=del size=3392475 2024-09-12T00:07:19.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.323+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=A6PZMPMLF2E0 type=del 2024-09-12T00:07:19.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.324+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=FGSIX4K573XQ type=del size=3448730 2024-09-12T00:07:19.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.326+0000 7f82f8930780 1 < completed delete operation key=9576W9WYJUJV tag=7WXPM1K50IL1 type=del 2024-09-12T00:07:19.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.327+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=IP51CK7WVJPR type=del size=551469 2024-09-12T00:07:19.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.329+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=UC3ZRKQ0TBGM type=del 2024-09-12T00:07:19.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.331+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=92IVIOYNKN1V type=write size=458083 2024-09-12T00:07:19.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.332+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~E2NIGR9TDF3S.0 size=1048576 2024-09-12T00:07:19.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.334+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~E2NIGR9TDF3S.1 size=1048576 2024-09-12T00:07:19.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.335+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~E2NIGR9TDF3S.2 size=735870 2024-09-12T00:07:19.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.336+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=E2NIGR9TDF3S tag=ZG4BPZSDY9QB type=write size=3881598 2024-09-12T00:07:19.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.339+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=8IW5E4EADUSY type=write size=525000 2024-09-12T00:07:19.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.340+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~1A6B3EL6KOVK.0 size=1048576 2024-09-12T00:07:19.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.341+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~1A6B3EL6KOVK.1 size=254708 2024-09-12T00:07:19.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.343+0000 7f82f8930780 1 < completed multipart upload key=W8SAQZWQHY36 upload=1A6B3EL6KOVK tag=QYYTQL8W3L1Z type=write size=2351860 2024-09-12T00:07:19.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.345+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~WAZRH4FOLB5V.0 size=1048576 2024-09-12T00:07:19.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.346+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~WAZRH4FOLB5V.1 size=168113 2024-09-12T00:07:19.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.346+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=WAZRH4FOLB5V tag=7QAJZLRU9W45 type=write size=2265265 2024-09-12T00:07:19.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.349+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~SKC8WOG1NVQQ.0 size=1048576 2024-09-12T00:07:19.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.349+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~SKC8WOG1NVQQ.1 size=1048576 2024-09-12T00:07:19.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.350+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~SKC8WOG1NVQQ.2 size=541285 2024-09-12T00:07:19.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.352+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=SKC8WOG1NVQQ tag=KYR3J4VY1UOH type=write size=3687013 2024-09-12T00:07:19.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.355+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=B6RDZDO4PCJW type=del size=9008 2024-09-12T00:07:19.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.355+0000 7f82f8930780 1 < canceled operation key=IMAT4ZCLGFRN tag=4QEA98M6Q3DW type=del size=3695869 2024-09-12T00:07:19.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.358+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~TXQM4B8SZN3S.0 size=1048576 2024-09-12T00:07:19.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.359+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~TXQM4B8SZN3S.1 size=398539 2024-09-12T00:07:19.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.359+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=TXQM4B8SZN3S tag=1U1RO24KA6E2 type=write size=2495691 2024-09-12T00:07:19.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.360+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=JYRHE1CFFTLF type=del 2024-09-12T00:07:19.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.363+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~WOHUBQ7FATQ7.0 size=1048576 2024-09-12T00:07:19.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.364+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~WOHUBQ7FATQ7.1 size=1048576 2024-09-12T00:07:19.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.365+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~WOHUBQ7FATQ7.2 size=588158 2024-09-12T00:07:19.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.365+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=WOHUBQ7FATQ7 tag=0VFVE6JR053N type=write size=3733886 2024-09-12T00:07:19.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.367+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~W4BB7MFZ3FKK.0 size=1048576 2024-09-12T00:07:19.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.368+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~W4BB7MFZ3FKK.1 size=1048576 2024-09-12T00:07:19.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.368+0000 7f82f8930780 1 < canceled part key=_multipart_OVJOP07M9KB8.2~W4BB7MFZ3FKK.2 size=807033 2024-09-12T00:07:19.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.371+0000 7f82f8930780 1 < canceled multipart upload key=OVJOP07M9KB8 upload=W4BB7MFZ3FKK tag=RIBWB84M9BP4 type=write size=3952761 2024-09-12T00:07:19.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.373+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=PXG6K3JY7AFK type=del size=3274342 2024-09-12T00:07:19.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.374+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=ATN312CR7MRK type=del 2024-09-12T00:07:19.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.376+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~G6M24CJ1DG7C.0 size=1048576 2024-09-12T00:07:19.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.378+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~G6M24CJ1DG7C.1 size=438375 2024-09-12T00:07:19.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.378+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=G6M24CJ1DG7C tag=G237KNKB7IV6 type=write size=2535527 2024-09-12T00:07:19.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.380+0000 7f82f8930780 1 < suggested remove operation key=9576W9WYJUJV tag=UWD95RUHFSMQ type=del 2024-09-12T00:07:19.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.382+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=1KBJO8ZWGNTN type=write size=779182 2024-09-12T00:07:19.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.384+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~9NPH1FS5Y47X.0 size=1048576 2024-09-12T00:07:19.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.385+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~9NPH1FS5Y47X.1 size=1048576 2024-09-12T00:07:19.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.385+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~9NPH1FS5Y47X.2 size=826678 2024-09-12T00:07:19.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.388+0000 7f82f8930780 1 < completed multipart upload key=W8SAQZWQHY36 upload=9NPH1FS5Y47X tag=IKPL6R4HBOXX type=write size=3972406 2024-09-12T00:07:19.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.390+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=Y0MHB441CTDQ type=del size=2269656 2024-09-12T00:07:19.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.391+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=2XGUA489654B type=del 2024-09-12T00:07:19.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.394+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=YTYFD659Y8O2 type=del size=3880681 2024-09-12T00:07:19.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.395+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~BFBAOHO4OM0V.0 size=927057 2024-09-12T00:07:19.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.397+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=BFBAOHO4OM0V tag=TG3S2WKE47NU type=write size=1975633 2024-09-12T00:07:19.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.400+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=17BIQH14VTSS type=del size=2376637 2024-09-12T00:07:19.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.400+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=0FL1RLI7A81S type=del 2024-09-12T00:07:19.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.402+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=SYG43RAR4B4C type=del size=4084258 2024-09-12T00:07:19.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.403+0000 7f82f8930780 1 < canceled operation key=YWC5JUV5B2N6 tag=2K06D1KWY3MP type=del size=3392475 2024-09-12T00:07:19.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.406+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~XD77IN103E0M.0 size=1048576 2024-09-12T00:07:19.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.407+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~XD77IN103E0M.1 size=937705 2024-09-12T00:07:19.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.407+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=XD77IN103E0M tag=409X1EUGCIL6 type=write size=3034857 2024-09-12T00:07:19.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.409+0000 7f82f8930780 1 < suggested remove operation key=MJZ56OX8PLSH tag=FGSIX4K573XQ type=del 2024-09-12T00:07:19.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.411+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=K9MNQP8WMZO6 type=write size=334284 2024-09-12T00:07:19.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.412+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=IP51CK7WVJPR type=del 2024-09-12T00:07:19.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.414+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=YT3PEMG1SYBO type=del size=114116 2024-09-12T00:07:19.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.415+0000 7f82f8930780 1 < completed write operation key=NCIZ4HNPCZ94 tag=92IVIOYNKN1V type=write size=458083 2024-09-12T00:07:19.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.417+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=8LDECUPTQD3Y type=write size=790088 2024-09-12T00:07:19.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.418+0000 7f82f8930780 1 < completed write operation key=Y5U8MO9TOJQQ tag=8IW5E4EADUSY type=write size=525000 2024-09-12T00:07:19.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.420+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~D0L61B2G9IJV.0 size=1048576 2024-09-12T00:07:19.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.422+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~D0L61B2G9IJV.1 size=854080 2024-09-12T00:07:19.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.422+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=D0L61B2G9IJV tag=53RXH9BRVQG0 type=write size=2951232 2024-09-12T00:07:19.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.423+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~WAZRH4FOLB5V.0 size=1048576 2024-09-12T00:07:19.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.424+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~WAZRH4FOLB5V.1 size=168113 2024-09-12T00:07:19.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.426+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=WAZRH4FOLB5V tag=7QAJZLRU9W45 type=write size=2265265 2024-09-12T00:07:19.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.428+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=5GH2ZJFR99FP type=del size=1548497 2024-09-12T00:07:19.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.429+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=B6RDZDO4PCJW type=del 2024-09-12T00:07:19.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.432+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~6PVN322MDHTS.0 size=701096 2024-09-12T00:07:19.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.432+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=6PVN322MDHTS tag=BUQYXPNIICI5 type=write size=1749672 2024-09-12T00:07:19.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.433+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~TXQM4B8SZN3S.0 size=1048576 2024-09-12T00:07:19.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.433+0000 7f82f8930780 1 < canceled part key=_multipart_MJZ56OX8PLSH.2~TXQM4B8SZN3S.1 size=398539 2024-09-12T00:07:19.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.435+0000 7f82f8930780 1 < canceled multipart upload key=MJZ56OX8PLSH upload=TXQM4B8SZN3S tag=1U1RO24KA6E2 type=write size=2495691 2024-09-12T00:07:19.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.439+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~8GM5FDZ21XS3.0 size=1048576 2024-09-12T00:07:19.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.439+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~8GM5FDZ21XS3.1 size=972268 2024-09-12T00:07:19.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.439+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=8GM5FDZ21XS3 tag=UFIJXGDAA183 type=write size=3069420 2024-09-12T00:07:19.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.441+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~WOHUBQ7FATQ7.0 size=1048576 2024-09-12T00:07:19.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.442+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~WOHUBQ7FATQ7.1 size=1048576 2024-09-12T00:07:19.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.443+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~WOHUBQ7FATQ7.2 size=588158 2024-09-12T00:07:19.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.445+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=WOHUBQ7FATQ7 tag=0VFVE6JR053N type=write size=3733886 2024-09-12T00:07:19.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.447+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=RN4VZK8IEN3F type=del size=2696507 2024-09-12T00:07:19.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.448+0000 7f82f8930780 1 < canceled operation key=BJHGNT3HBS25 tag=PXG6K3JY7AFK type=del size=3274342 2024-09-12T00:07:19.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.450+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=YYB9KJTOKXZ5 type=del size=2825589 2024-09-12T00:07:19.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.451+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~G6M24CJ1DG7C.0 size=1048576 2024-09-12T00:07:19.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.453+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~G6M24CJ1DG7C.1 size=438375 2024-09-12T00:07:19.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.456+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=G6M24CJ1DG7C tag=G237KNKB7IV6 type=write size=2535527 2024-09-12T00:07:19.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.459+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~5K3X4GJQ5976.0 size=1048576 2024-09-12T00:07:19.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.459+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~5K3X4GJQ5976.1 size=1048576 2024-09-12T00:07:19.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.460+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~5K3X4GJQ5976.2 size=82855 2024-09-12T00:07:19.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.460+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=5K3X4GJQ5976 tag=GX4HEA3RGYRD type=write size=3228583 2024-09-12T00:07:19.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.461+0000 7f82f8930780 1 < completed write operation key=FHQADENLR6GP tag=1KBJO8ZWGNTN type=write size=779182 2024-09-12T00:07:19.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.463+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=V03YHJERT831 type=del size=1065106 2024-09-12T00:07:19.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.464+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=Y0MHB441CTDQ type=del 2024-09-12T00:07:19.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.467+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~4SSDSC624Q6V.0 size=1048576 2024-09-12T00:07:19.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.468+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~4SSDSC624Q6V.1 size=1048576 2024-09-12T00:07:19.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.469+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~4SSDSC624Q6V.2 size=284818 2024-09-12T00:07:19.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.469+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=4SSDSC624Q6V tag=Z7DIJKRPD0NA type=write size=3430546 2024-09-12T00:07:19.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.470+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=YTYFD659Y8O2 type=del 2024-09-12T00:07:19.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.472+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=1QZQED0RHV2T type=del size=1225997 2024-09-12T00:07:19.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.473+0000 7f82f8930780 1 < canceled operation key=N2TYUAJITFNL tag=17BIQH14VTSS type=del size=2376637 2024-09-12T00:07:19.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.475+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=O65N67XNH7AL type=del size=700278 2024-09-12T00:07:19.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.477+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=SYG43RAR4B4C type=del 2024-09-12T00:07:19.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.478+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~Q39FT2RMGO1H.0 size=1048576 2024-09-12T00:07:19.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.480+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~Q39FT2RMGO1H.1 size=34713 2024-09-12T00:07:19.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.480+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=Q39FT2RMGO1H tag=5PBE0663ZFDO type=write size=2131865 2024-09-12T00:07:19.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.481+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~XD77IN103E0M.0 size=1048576 2024-09-12T00:07:19.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.481+0000 7f82f8930780 1 < canceled part key=_multipart_3H3D067Z8O0R.2~XD77IN103E0M.1 size=937705 2024-09-12T00:07:19.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.483+0000 7f82f8930780 1 < canceled multipart upload key=3H3D067Z8O0R upload=XD77IN103E0M tag=409X1EUGCIL6 type=write size=3034857 2024-09-12T00:07:19.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.485+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=2WX1A9M70SCA type=del size=466324 2024-09-12T00:07:19.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.486+0000 7f82f8930780 1 < completed write operation key=3H3D067Z8O0R tag=K9MNQP8WMZO6 type=write size=334284 2024-09-12T00:07:19.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.490+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~V2ZHO9JP207W.0 size=1048576 2024-09-12T00:07:19.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.491+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~V2ZHO9JP207W.1 size=1048576 2024-09-12T00:07:19.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.491+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~V2ZHO9JP207W.2 size=490076 2024-09-12T00:07:19.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.491+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=V2ZHO9JP207W tag=W52II0S6IHOG type=write size=3635804 2024-09-12T00:07:19.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.493+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=YT3PEMG1SYBO type=del 2024-09-12T00:07:19.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.496+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~YZLSR62JKZSK.0 size=1048576 2024-09-12T00:07:19.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.496+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~YZLSR62JKZSK.1 size=567663 2024-09-12T00:07:19.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.496+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=YZLSR62JKZSK tag=QXC6UX8ZPNVH type=write size=2664815 2024-09-12T00:07:19.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.498+0000 7f82f8930780 1 < completed write operation key=2XM2CF1T4VGW tag=8LDECUPTQD3Y type=write size=790088 2024-09-12T00:07:19.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.500+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~A7WP8U8K6P3L.0 size=1048576 2024-09-12T00:07:19.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.501+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~A7WP8U8K6P3L.1 size=198664 2024-09-12T00:07:19.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.501+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=A7WP8U8K6P3L tag=RL3N4L4M0VBI type=write size=2295816 2024-09-12T00:07:19.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.504+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~D0L61B2G9IJV.0 size=1048576 2024-09-12T00:07:19.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.504+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~D0L61B2G9IJV.1 size=854080 2024-09-12T00:07:19.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.506+0000 7f82f8930780 1 < completed multipart upload key=Y5U8MO9TOJQQ upload=D0L61B2G9IJV tag=53RXH9BRVQG0 type=write size=2951232 2024-09-12T00:07:19.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.508+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=BV5IMS54EC8G type=del size=2300719 2024-09-12T00:07:19.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.512+0000 7f82f8930780 1 < suggested remove operation key=3X2PLA3ODHJ1 tag=5GH2ZJFR99FP type=del 2024-09-12T00:07:19.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.512+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=T84U2RX3Y3DL type=del size=1844473 2024-09-12T00:07:19.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.514+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~6PVN322MDHTS.0 size=701096 2024-09-12T00:07:19.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.516+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=6PVN322MDHTS tag=BUQYXPNIICI5 type=write size=1749672 2024-09-12T00:07:19.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.517+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=15I2FU2WPZ2V type=write size=846365 2024-09-12T00:07:19.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.519+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~8GM5FDZ21XS3.0 size=1048576 2024-09-12T00:07:19.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.520+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~8GM5FDZ21XS3.1 size=972268 2024-09-12T00:07:19.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.522+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=8GM5FDZ21XS3 tag=UFIJXGDAA183 type=write size=3069420 2024-09-12T00:07:19.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.524+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=JY1VC7W2DJ49 type=del size=1287239 2024-09-12T00:07:19.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.527+0000 7f82f8930780 1 < canceled operation key=IMAT4ZCLGFRN tag=RN4VZK8IEN3F type=del size=2696507 2024-09-12T00:07:19.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.527+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=Q3Y9P5TLZ60B type=del size=86143 2024-09-12T00:07:19.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.529+0000 7f82f8930780 -1 < failed to complete operation key=3X2PLA3ODHJ1 tag=YYB9KJTOKXZ5 type=del size=2825589: (22) Invalid argument 2024-09-12T00:07:19.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.532+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~0K1UK0ONKHN1.0 size=1048576 2024-09-12T00:07:19.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.533+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~0K1UK0ONKHN1.1 size=1048576 2024-09-12T00:07:19.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.535+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~0K1UK0ONKHN1.2 size=163282 2024-09-12T00:07:19.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.535+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=0K1UK0ONKHN1 tag=GE31Q8Q9DGW3 type=write size=3309010 2024-09-12T00:07:19.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.535+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~5K3X4GJQ5976.0 size=1048576 2024-09-12T00:07:19.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.537+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~5K3X4GJQ5976.1 size=1048576 2024-09-12T00:07:19.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.538+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~5K3X4GJQ5976.2 size=82855 2024-09-12T00:07:19.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.540+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=5K3X4GJQ5976 tag=GX4HEA3RGYRD type=write size=3228583 2024-09-12T00:07:19.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.542+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=HNG8S96PSSJM type=del size=1145204 2024-09-12T00:07:19.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.544+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=V03YHJERT831 type=del 2024-09-12T00:07:19.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.546+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~T975KECSLCZ0.0 size=1048576 2024-09-12T00:07:19.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.547+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~T975KECSLCZ0.1 size=697731 2024-09-12T00:07:19.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.547+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=T975KECSLCZ0 tag=8HDWNUO8FZKD type=write size=2794883 2024-09-12T00:07:19.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.549+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~4SSDSC624Q6V.0 size=1048576 2024-09-12T00:07:19.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.550+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~4SSDSC624Q6V.1 size=1048576 2024-09-12T00:07:19.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.550+0000 7f82f8930780 1 < canceled part key=_multipart_75GYP042UUC2.2~4SSDSC624Q6V.2 size=284818 2024-09-12T00:07:19.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.552+0000 7f82f8930780 1 < canceled multipart upload key=75GYP042UUC2 upload=4SSDSC624Q6V tag=Z7DIJKRPD0NA type=write size=3430546 2024-09-12T00:07:19.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.553+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=VZRV5LYFU6VM type=del size=785718 2024-09-12T00:07:19.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.556+0000 7f82f8930780 1 < suggested remove operation key=4IA4918NXXJW tag=1QZQED0RHV2T type=del 2024-09-12T00:07:19.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.559+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~V6SOL3UJNVPY.0 size=449322 2024-09-12T00:07:19.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.559+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=V6SOL3UJNVPY tag=R281T96BIPIG type=write size=1497898 2024-09-12T00:07:19.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.560+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=O65N67XNH7AL type=del 2024-09-12T00:07:19.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.562+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=B3GVRD9ENOR9 type=del size=2605833 2024-09-12T00:07:19.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.563+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~Q39FT2RMGO1H.0 size=1048576 2024-09-12T00:07:19.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.564+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~Q39FT2RMGO1H.1 size=34713 2024-09-12T00:07:19.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.566+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=Q39FT2RMGO1H tag=5PBE0663ZFDO type=write size=2131865 2024-09-12T00:07:19.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.568+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=0L333MJNCT92 type=write size=507964 2024-09-12T00:07:19.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.569+0000 7f82f8930780 1 < completed delete operation key=HCK59C6MAW0B tag=2WX1A9M70SCA type=del 2024-09-12T00:07:19.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.572+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~2LG1DRG18TXJ.0 size=1048576 2024-09-12T00:07:19.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.573+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~2LG1DRG18TXJ.1 size=1048576 2024-09-12T00:07:19.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.574+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~2LG1DRG18TXJ.2 size=983086 2024-09-12T00:07:19.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.574+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=2LG1DRG18TXJ tag=BRRSDQW3XFWE type=write size=4128814 2024-09-12T00:07:19.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.576+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~V2ZHO9JP207W.0 size=1048576 2024-09-12T00:07:19.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.576+0000 7f82f8930780 1 < canceled part key=_multipart_YWC5JUV5B2N6.2~V2ZHO9JP207W.1 size=1048576 2024-09-12T00:07:19.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.577+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~V2ZHO9JP207W.2 size=490076 2024-09-12T00:07:19.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.581+0000 7f82f8930780 1 < canceled multipart upload key=YWC5JUV5B2N6 upload=V2ZHO9JP207W tag=W52II0S6IHOG type=write size=3635804 2024-09-12T00:07:19.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.582+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=M6W6QPPIRO8X type=del size=67696 2024-09-12T00:07:19.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.583+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~YZLSR62JKZSK.0 size=1048576 2024-09-12T00:07:19.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.585+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~YZLSR62JKZSK.1 size=567663 2024-09-12T00:07:19.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.588+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=YZLSR62JKZSK tag=QXC6UX8ZPNVH type=write size=2664815 2024-09-12T00:07:19.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.589+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=KV2WEVJPD1G8 type=del size=2830249 2024-09-12T00:07:19.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.590+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~A7WP8U8K6P3L.0 size=1048576 2024-09-12T00:07:19.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.592+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~A7WP8U8K6P3L.1 size=198664 2024-09-12T00:07:19.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.595+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=A7WP8U8K6P3L tag=RL3N4L4M0VBI type=write size=2295816 2024-09-12T00:07:19.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.596+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=MGSKU2SOUEEH type=del size=3855272 2024-09-12T00:07:19.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.600+0000 7f82f8930780 1 < suggested remove operation key=W8SAQZWQHY36 tag=BV5IMS54EC8G type=del 2024-09-12T00:07:19.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.601+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=XEEODR36U7MA type=del size=3274785 2024-09-12T00:07:19.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.602+0000 7f82f8930780 1 < completed delete operation key=9576W9WYJUJV tag=T84U2RX3Y3DL type=del 2024-09-12T00:07:19.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.605+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~BYC4BVGME2B8.0 size=1048576 2024-09-12T00:07:19.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.606+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~BYC4BVGME2B8.1 size=57388 2024-09-12T00:07:19.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.606+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=BYC4BVGME2B8 tag=E0SG2D0TG5NP type=write size=2154540 2024-09-12T00:07:19.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.608+0000 7f82f8930780 1 < completed write operation key=AMWMQXO10EXK tag=15I2FU2WPZ2V type=write size=846365 2024-09-12T00:07:19.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.610+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=OZLY5V9N391O type=write size=748880 2024-09-12T00:07:19.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.610+0000 7f82f8930780 -1 < failed to complete operation key=4IA4918NXXJW tag=JY1VC7W2DJ49 type=del size=1287239: (22) Invalid argument 2024-09-12T00:07:19.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.613+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~NL0M0D5UTIH8.0 size=61292 2024-09-12T00:07:19.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.613+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=NL0M0D5UTIH8 tag=YNQ84QL72WY9 type=write size=1109868 2024-09-12T00:07:19.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.614+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=Q3Y9P5TLZ60B type=del 2024-09-12T00:07:19.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.616+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=R1ZSTAA10R1D type=write size=125912 2024-09-12T00:07:19.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.618+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~0K1UK0ONKHN1.0 size=1048576 2024-09-12T00:07:19.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.619+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~0K1UK0ONKHN1.1 size=1048576 2024-09-12T00:07:19.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.620+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~0K1UK0ONKHN1.2 size=163282 2024-09-12T00:07:19.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.622+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=0K1UK0ONKHN1 tag=GE31Q8Q9DGW3 type=write size=3309010 2024-09-12T00:07:19.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.623+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=U6SAL5ZG9TU1 type=del size=1911049 2024-09-12T00:07:19.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.625+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=HNG8S96PSSJM type=del 2024-09-12T00:07:19.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.627+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~BPC9EDZDLGS8.0 size=398604 2024-09-12T00:07:19.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.627+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=BPC9EDZDLGS8 tag=ZYU96KV7SSA9 type=write size=1447180 2024-09-12T00:07:19.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.629+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~T975KECSLCZ0.0 size=1048576 2024-09-12T00:07:19.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.630+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~T975KECSLCZ0.1 size=697731 2024-09-12T00:07:19.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.633+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=T975KECSLCZ0 tag=8HDWNUO8FZKD type=write size=2794883 2024-09-12T00:07:19.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.633+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=54BJ1XNRVRH3 type=del size=2327568 2024-09-12T00:07:19.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.635+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=VZRV5LYFU6VM type=del 2024-09-12T00:07:19.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.637+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~B8IHCH0RHT4S.0 size=1048576 2024-09-12T00:07:19.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.639+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~B8IHCH0RHT4S.1 size=1048576 2024-09-12T00:07:19.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.640+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~B8IHCH0RHT4S.2 size=608833 2024-09-12T00:07:19.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.640+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=B8IHCH0RHT4S tag=659ZKW10I2EH type=write size=3754561 2024-09-12T00:07:19.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.641+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~V6SOL3UJNVPY.0 size=449322 2024-09-12T00:07:19.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.643+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=V6SOL3UJNVPY tag=R281T96BIPIG type=write size=1497898 2024-09-12T00:07:19.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.646+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~V461APRSXFCI.0 size=1048576 2024-09-12T00:07:19.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.647+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~V461APRSXFCI.1 size=60658 2024-09-12T00:07:19.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.647+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=V461APRSXFCI tag=KWEUIO9BCFI2 type=write size=2157810 2024-09-12T00:07:19.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.648+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=B3GVRD9ENOR9 type=del 2024-09-12T00:07:19.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.651+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~G1UHI4W4UH7R.0 size=1048576 2024-09-12T00:07:19.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.652+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~G1UHI4W4UH7R.1 size=272428 2024-09-12T00:07:19.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.652+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=G1UHI4W4UH7R tag=VLLMLU2L8OA2 type=write size=2369580 2024-09-12T00:07:19.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.654+0000 7f82f8930780 1 < completed write operation key=AMWMQXO10EXK tag=0L333MJNCT92 type=write size=507964 2024-09-12T00:07:19.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.656+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=XT2J13H2LT53 type=del size=3326245 2024-09-12T00:07:19.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.657+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~2LG1DRG18TXJ.0 size=1048576 2024-09-12T00:07:19.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.657+0000 7f82f8930780 1 < canceled part key=_multipart_80OUXNDPLGAG.2~2LG1DRG18TXJ.1 size=1048576 2024-09-12T00:07:19.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.660+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~2LG1DRG18TXJ.2 size=983086 2024-09-12T00:07:19.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.663+0000 7f82f8930780 1 < canceled multipart upload key=80OUXNDPLGAG upload=2LG1DRG18TXJ tag=BRRSDQW3XFWE type=write size=4128814 2024-09-12T00:07:19.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.664+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=CRYOBC464ZVS type=del size=3928004 2024-09-12T00:07:19.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.668+0000 7f82f8930780 1 < suggested update operation key=9576W9WYJUJV tag=M6W6QPPIRO8X type=del size=67696 2024-09-12T00:07:19.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.669+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=0HSBGX0IPP5I type=del size=2073567 2024-09-12T00:07:19.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.671+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=KV2WEVJPD1G8 type=del 2024-09-12T00:07:19.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.674+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~O3EJPQKYEH8G.0 size=1048576 2024-09-12T00:07:19.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.676+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~O3EJPQKYEH8G.1 size=53716 2024-09-12T00:07:19.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.676+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=O3EJPQKYEH8G tag=VMONHS23WLJB type=write size=2150868 2024-09-12T00:07:19.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.678+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=MGSKU2SOUEEH type=del 2024-09-12T00:07:19.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.681+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~0WYUBS1K88W5.0 size=1048576 2024-09-12T00:07:19.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.682+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~0WYUBS1K88W5.1 size=1048576 2024-09-12T00:07:19.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.683+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~0WYUBS1K88W5.2 size=562770 2024-09-12T00:07:19.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.683+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=0WYUBS1K88W5 tag=GUIH0DRC2E7F type=write size=3708498 2024-09-12T00:07:19.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.684+0000 7f82f8930780 -1 < failed to complete operation key=9576W9WYJUJV tag=XEEODR36U7MA type=del size=3274785: (22) Invalid argument 2024-09-12T00:07:19.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.687+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~1E2LD8I47O0A.0 size=407863 2024-09-12T00:07:19.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.687+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=1E2LD8I47O0A tag=AYTLKQXGI46M type=write size=1456439 2024-09-12T00:07:19.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.689+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~BYC4BVGME2B8.0 size=1048576 2024-09-12T00:07:19.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.689+0000 7f82f8930780 1 < canceled part key=_multipart_MJZ56OX8PLSH.2~BYC4BVGME2B8.1 size=57388 2024-09-12T00:07:19.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.691+0000 7f82f8930780 1 < canceled multipart upload key=MJZ56OX8PLSH upload=BYC4BVGME2B8 tag=E0SG2D0TG5NP type=write size=2154540 2024-09-12T00:07:19.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.692+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=BX9RWJNBHLZJ type=del size=2834719 2024-09-12T00:07:19.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.694+0000 7f82f8930780 1 < completed write operation key=OVJOP07M9KB8 tag=OZLY5V9N391O type=write size=748880 2024-09-12T00:07:19.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.697+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~6B3FFF97PRVC.0 size=1048576 2024-09-12T00:07:19.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.697+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~6B3FFF97PRVC.1 size=444823 2024-09-12T00:07:19.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.697+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=6B3FFF97PRVC tag=JYYXHUINMHDS type=write size=2541975 2024-09-12T00:07:19.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.698+0000 7f82f8930780 1 < canceled part key=_multipart_Y5U8MO9TOJQQ.2~NL0M0D5UTIH8.0 size=61292 2024-09-12T00:07:19.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.701+0000 7f82f8930780 1 < canceled multipart upload key=Y5U8MO9TOJQQ upload=NL0M0D5UTIH8 tag=YNQ84QL72WY9 type=write size=1109868 2024-09-12T00:07:19.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.702+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=0VWLD44PD6PX type=del size=37339 2024-09-12T00:07:19.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.703+0000 7f82f8930780 -1 < failed to complete operation key=9576W9WYJUJV tag=R1ZSTAA10R1D type=write size=125912: (22) Invalid argument 2024-09-12T00:07:19.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.705+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=6544RZZNH58L type=del size=2740401 2024-09-12T00:07:19.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.706+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=U6SAL5ZG9TU1 type=del 2024-09-12T00:07:19.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.707+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=5JU8EDC1N3Y0 type=del size=3830068 2024-09-12T00:07:19.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.709+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~BPC9EDZDLGS8.0 size=398604 2024-09-12T00:07:19.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.711+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=BPC9EDZDLGS8 tag=ZYU96KV7SSA9 type=write size=1447180 2024-09-12T00:07:19.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.715+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~A1F6ZDOI4MRT.0 size=789685 2024-09-12T00:07:19.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.715+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=A1F6ZDOI4MRT tag=5JTLRPU4F2SM type=write size=1838261 2024-09-12T00:07:19.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.716+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=54BJ1XNRVRH3 type=del 2024-09-12T00:07:19.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.717+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=AY1DQ6TQQMJW type=del size=3020832 2024-09-12T00:07:19.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.718+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~B8IHCH0RHT4S.0 size=1048576 2024-09-12T00:07:19.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.719+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~B8IHCH0RHT4S.1 size=1048576 2024-09-12T00:07:19.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.721+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~B8IHCH0RHT4S.2 size=608833 2024-09-12T00:07:19.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.723+0000 7f82f8930780 1 < completed multipart upload key=W8SAQZWQHY36 upload=B8IHCH0RHT4S tag=659ZKW10I2EH type=write size=3754561 2024-09-12T00:07:19.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.724+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=G9KNBR0F0DFA type=del size=2834877 2024-09-12T00:07:19.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.726+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~V461APRSXFCI.0 size=1048576 2024-09-12T00:07:19.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.728+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~V461APRSXFCI.1 size=60658 2024-09-12T00:07:19.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.729+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=V461APRSXFCI tag=KWEUIO9BCFI2 type=write size=2157810 2024-09-12T00:07:19.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.732+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~C0SUZHGRL4D1.0 size=1048576 2024-09-12T00:07:19.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.733+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~C0SUZHGRL4D1.1 size=1048576 2024-09-12T00:07:19.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.734+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~C0SUZHGRL4D1.2 size=717075 2024-09-12T00:07:19.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.735+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=C0SUZHGRL4D1 tag=3KNG1N0927IW type=write size=3862803 2024-09-12T00:07:19.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.736+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~G1UHI4W4UH7R.0 size=1048576 2024-09-12T00:07:19.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.737+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~G1UHI4W4UH7R.1 size=272428 2024-09-12T00:07:19.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.740+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=G1UHI4W4UH7R tag=VLLMLU2L8OA2 type=write size=2369580 2024-09-12T00:07:19.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.743+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~DD148GDCG2II.0 size=537431 2024-09-12T00:07:19.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.743+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=DD148GDCG2II tag=MB16QDKEFWB6 type=write size=1586007 2024-09-12T00:07:19.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.744+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=XT2J13H2LT53 type=del 2024-09-12T00:07:19.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.745+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=H9PQHBQAEB57 type=del size=887314 2024-09-12T00:07:19.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.746+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=CRYOBC464ZVS type=del 2024-09-12T00:07:19.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.749+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~4VEA1NT50LHB.0 size=227214 2024-09-12T00:07:19.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.749+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=4VEA1NT50LHB tag=N7V3ZALSE83E type=write size=1275790 2024-09-12T00:07:19.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.752+0000 7f82f8930780 1 < suggested remove operation key=77SDZHCSP0E3 tag=0HSBGX0IPP5I type=del 2024-09-12T00:07:19.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.754+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~1NV7UOX26HX4.0 size=1048576 2024-09-12T00:07:19.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.755+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~1NV7UOX26HX4.1 size=1048576 2024-09-12T00:07:19.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.756+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~1NV7UOX26HX4.2 size=1039595 2024-09-12T00:07:19.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.756+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=1NV7UOX26HX4 tag=HC9BIKOE2R03 type=write size=4185323 2024-09-12T00:07:19.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.757+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~O3EJPQKYEH8G.0 size=1048576 2024-09-12T00:07:19.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.758+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~O3EJPQKYEH8G.1 size=53716 2024-09-12T00:07:19.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.761+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=O3EJPQKYEH8G tag=VMONHS23WLJB type=write size=2150868 2024-09-12T00:07:19.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.762+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=025N3C3N31SN type=del size=3760677 2024-09-12T00:07:19.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.764+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~0WYUBS1K88W5.0 size=1048576 2024-09-12T00:07:19.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.765+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~0WYUBS1K88W5.1 size=1048576 2024-09-12T00:07:19.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.767+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~0WYUBS1K88W5.2 size=562770 2024-09-12T00:07:19.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.769+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=0WYUBS1K88W5 tag=GUIH0DRC2E7F type=write size=3708498 2024-09-12T00:07:19.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.771+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~VB0TX8ZWZ2A2.0 size=1048576 2024-09-12T00:07:19.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.772+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~VB0TX8ZWZ2A2.1 size=1048576 2024-09-12T00:07:19.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.773+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~VB0TX8ZWZ2A2.2 size=546875 2024-09-12T00:07:19.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.773+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=VB0TX8ZWZ2A2 tag=JJBGT6PE0F7V type=write size=3692603 2024-09-12T00:07:19.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.774+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~1E2LD8I47O0A.0 size=407863 2024-09-12T00:07:19.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.776+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=1E2LD8I47O0A tag=AYTLKQXGI46M type=write size=1456439 2024-09-12T00:07:19.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.780+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~R838FSGMXY4H.0 size=1048576 2024-09-12T00:07:19.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.780+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~R838FSGMXY4H.1 size=670429 2024-09-12T00:07:19.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.780+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=R838FSGMXY4H tag=2SSF4WTT1WVI type=write size=2767581 2024-09-12T00:07:19.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.781+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=BX9RWJNBHLZJ type=del 2024-09-12T00:07:19.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.783+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=W7MASW9BGCGI type=write size=155932 2024-09-12T00:07:19.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.784+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~6B3FFF97PRVC.0 size=1048576 2024-09-12T00:07:19.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.785+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~6B3FFF97PRVC.1 size=444823 2024-09-12T00:07:19.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.788+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=6B3FFF97PRVC tag=JYYXHUINMHDS type=write size=2541975 2024-09-12T00:07:19.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.789+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=VTUFO2Q6NEU2 type=del size=2357706 2024-09-12T00:07:19.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.793+0000 7f82f8930780 1 < suggested update operation key=IMAT4ZCLGFRN tag=0VWLD44PD6PX type=del size=37339 2024-09-12T00:07:19.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.796+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~2FTF9TZ3LXQ3.0 size=1048576 2024-09-12T00:07:19.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.797+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~2FTF9TZ3LXQ3.1 size=1048576 2024-09-12T00:07:19.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.798+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~2FTF9TZ3LXQ3.2 size=90370 2024-09-12T00:07:19.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.798+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=2FTF9TZ3LXQ3 tag=H1G9QFQ88TCW type=write size=3236098 2024-09-12T00:07:19.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.800+0000 7f82f8930780 1 < canceled operation key=3X2PLA3ODHJ1 tag=6544RZZNH58L type=del size=2740401 2024-09-12T00:07:19.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.802+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~AB0H1EWBVIOR.0 size=1048576 2024-09-12T00:07:19.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.802+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~AB0H1EWBVIOR.1 size=1048576 2024-09-12T00:07:19.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.804+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~AB0H1EWBVIOR.2 size=617560 2024-09-12T00:07:19.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.804+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=AB0H1EWBVIOR tag=N1LEUQ3ZBYHN type=write size=3763288 2024-09-12T00:07:19.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.805+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=5JU8EDC1N3Y0 type=del 2024-09-12T00:07:19.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.806+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=KCZ14GGOKCQM type=del size=3074635 2024-09-12T00:07:19.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.808+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~A1F6ZDOI4MRT.0 size=789685 2024-09-12T00:07:19.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.810+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=A1F6ZDOI4MRT tag=5JTLRPU4F2SM type=write size=1838261 2024-09-12T00:07:19.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.812+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~OER3DWJASSG2.0 size=217266 2024-09-12T00:07:19.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.812+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=OER3DWJASSG2 tag=7T2EEE5C662R type=write size=1265842 2024-09-12T00:07:19.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.814+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=AY1DQ6TQQMJW type=del 2024-09-12T00:07:19.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.817+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~QGC1W69N3ACX.0 size=586817 2024-09-12T00:07:19.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.817+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=QGC1W69N3ACX tag=OAYDW2ICLTYW type=write size=1635393 2024-09-12T00:07:19.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.818+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=G9KNBR0F0DFA type=del 2024-09-12T00:07:19.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.819+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=LWJA0OW81E9E type=del size=3803898 2024-09-12T00:07:19.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.821+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~C0SUZHGRL4D1.0 size=1048576 2024-09-12T00:07:19.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.821+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~C0SUZHGRL4D1.1 size=1048576 2024-09-12T00:07:19.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.821+0000 7f82f8930780 1 < canceled part key=_multipart_BJHGNT3HBS25.2~C0SUZHGRL4D1.2 size=717075 2024-09-12T00:07:19.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.824+0000 7f82f8930780 1 < canceled multipart upload key=BJHGNT3HBS25 upload=C0SUZHGRL4D1 tag=3KNG1N0927IW type=write size=3862803 2024-09-12T00:07:19.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.825+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=QURZ0TEALQ98 type=del size=3570804 2024-09-12T00:07:19.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.826+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~DD148GDCG2II.0 size=537431 2024-09-12T00:07:19.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.830+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=DD148GDCG2II tag=MB16QDKEFWB6 type=write size=1586007 2024-09-12T00:07:19.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.831+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~ZUFNGQRO8MMK.0 size=1048576 2024-09-12T00:07:19.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.832+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~ZUFNGQRO8MMK.1 size=421137 2024-09-12T00:07:19.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.832+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=ZUFNGQRO8MMK tag=AK0V3YNRIRP1 type=write size=2518289 2024-09-12T00:07:19.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.835+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=H9PQHBQAEB57 type=del 2024-09-12T00:07:19.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.836+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=CXN4QDHWCE8C type=del size=2627735 2024-09-12T00:07:19.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.836+0000 7f82f8930780 1 < canceled part key=_multipart_YWC5JUV5B2N6.2~4VEA1NT50LHB.0 size=227214 2024-09-12T00:07:19.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.838+0000 7f82f8930780 1 < canceled multipart upload key=YWC5JUV5B2N6 upload=4VEA1NT50LHB tag=N7V3ZALSE83E type=write size=1275790 2024-09-12T00:07:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.839+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=CS2U2R0E5L86 type=del size=3460069 2024-09-12T00:07:19.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.840+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~1NV7UOX26HX4.0 size=1048576 2024-09-12T00:07:19.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.841+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~1NV7UOX26HX4.1 size=1048576 2024-09-12T00:07:19.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.843+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~1NV7UOX26HX4.2 size=1039595 2024-09-12T00:07:19.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.845+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=1NV7UOX26HX4 tag=HC9BIKOE2R03 type=write size=4185323 2024-09-12T00:07:19.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.846+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=1S0TA4K9XB20 type=del size=2533298 2024-09-12T00:07:19.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.848+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=025N3C3N31SN type=del 2024-09-12T00:07:19.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.850+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=LUBC01W8KELZ type=del size=478468 2024-09-12T00:07:19.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.851+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~VB0TX8ZWZ2A2.0 size=1048576 2024-09-12T00:07:19.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.852+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~VB0TX8ZWZ2A2.1 size=1048576 2024-09-12T00:07:19.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.852+0000 7f82f8930780 1 < canceled part key=_multipart_YWC5JUV5B2N6.2~VB0TX8ZWZ2A2.2 size=546875 2024-09-12T00:07:19.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.855+0000 7f82f8930780 1 < canceled multipart upload key=YWC5JUV5B2N6 upload=VB0TX8ZWZ2A2 tag=JJBGT6PE0F7V type=write size=3692603 2024-09-12T00:07:19.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.855+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=ESJQU500XQKN type=del size=3571819 2024-09-12T00:07:19.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.857+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~R838FSGMXY4H.0 size=1048576 2024-09-12T00:07:19.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.859+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~R838FSGMXY4H.1 size=670429 2024-09-12T00:07:19.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.861+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=R838FSGMXY4H tag=2SSF4WTT1WVI type=write size=2767581 2024-09-12T00:07:19.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.862+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=RYTONTI3BR6H type=del size=565984 2024-09-12T00:07:19.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.863+0000 7f82f8930780 1 < completed write operation key=AMWMQXO10EXK tag=W7MASW9BGCGI type=write size=155932 2024-09-12T00:07:19.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.865+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=MLMD51TT3WQ3 type=del size=4057151 2024-09-12T00:07:19.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.867+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=VTUFO2Q6NEU2 type=del 2024-09-12T00:07:19.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.869+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=7ZCGPURXFNZR type=del size=216296 2024-09-12T00:07:19.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.869+0000 7f82f8930780 1 < canceled part key=_multipart_LAKJS79KNBY7.2~2FTF9TZ3LXQ3.0 size=1048576 2024-09-12T00:07:19.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.870+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~2FTF9TZ3LXQ3.1 size=1048576 2024-09-12T00:07:19.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.872+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~2FTF9TZ3LXQ3.2 size=90370 2024-09-12T00:07:19.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.874+0000 7f82f8930780 1 < canceled multipart upload key=LAKJS79KNBY7 upload=2FTF9TZ3LXQ3 tag=H1G9QFQ88TCW type=write size=3236098 2024-09-12T00:07:19.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.876+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=ROJ1ATA66Q2R type=del size=3874112 2024-09-12T00:07:19.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.878+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~AB0H1EWBVIOR.0 size=1048576 2024-09-12T00:07:19.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.878+0000 7f82f8930780 1 < canceled part key=_multipart_YWC5JUV5B2N6.2~AB0H1EWBVIOR.1 size=1048576 2024-09-12T00:07:19.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.879+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~AB0H1EWBVIOR.2 size=617560 2024-09-12T00:07:19.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.882+0000 7f82f8930780 1 < canceled multipart upload key=YWC5JUV5B2N6 upload=AB0H1EWBVIOR tag=N1LEUQ3ZBYHN type=write size=3763288 2024-09-12T00:07:19.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.883+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=ZO4OSRJM90EH type=del size=351858 2024-09-12T00:07:19.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.887+0000 7f82f8930780 1 < suggested update operation key=W8SAQZWQHY36 tag=KCZ14GGOKCQM type=del size=3074635 2024-09-12T00:07:19.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.890+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~13WXF9479QV5.0 size=1048576 2024-09-12T00:07:19.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.891+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~13WXF9479QV5.1 size=1048576 2024-09-12T00:07:19.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.892+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~13WXF9479QV5.2 size=438817 2024-09-12T00:07:19.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.892+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=13WXF9479QV5 tag=V5XPYOUNOR3G type=write size=3584545 2024-09-12T00:07:19.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.894+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~OER3DWJASSG2.0 size=217266 2024-09-12T00:07:19.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.897+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=OER3DWJASSG2 tag=7T2EEE5C662R type=write size=1265842 2024-09-12T00:07:19.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.899+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=2B1M87E4BF9T type=write size=211902 2024-09-12T00:07:19.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.901+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~QGC1W69N3ACX.0 size=586817 2024-09-12T00:07:19.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.902+0000 7f82f8930780 1 < completed multipart upload key=Y5U8MO9TOJQQ upload=QGC1W69N3ACX tag=OAYDW2ICLTYW type=write size=1635393 2024-09-12T00:07:19.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.905+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~WJN1TJ3DMAUK.0 size=744515 2024-09-12T00:07:19.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.905+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=WJN1TJ3DMAUK tag=V4AG8HYYSDYO type=write size=1793091 2024-09-12T00:07:19.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.907+0000 7f82f8930780 1 < canceled operation key=LAKJS79KNBY7 tag=LWJA0OW81E9E type=del size=3803898 2024-09-12T00:07:19.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.910+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~MDAPYCFMWEEN.0 size=1048576 2024-09-12T00:07:19.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.910+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~MDAPYCFMWEEN.1 size=1048576 2024-09-12T00:07:19.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.911+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~MDAPYCFMWEEN.2 size=1019550 2024-09-12T00:07:19.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.911+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=MDAPYCFMWEEN tag=NHBDU8SXAWBJ type=write size=4165278 2024-09-12T00:07:19.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.913+0000 7f82f8930780 1 < canceled operation key=62X93NOS23AF tag=QURZ0TEALQ98 type=del size=3570804 2024-09-12T00:07:19.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.914+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=GJ9CHO509EG7 type=del size=258636 2024-09-12T00:07:19.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.916+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~ZUFNGQRO8MMK.0 size=1048576 2024-09-12T00:07:19.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.917+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~ZUFNGQRO8MMK.1 size=421137 2024-09-12T00:07:19.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.919+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=ZUFNGQRO8MMK tag=AK0V3YNRIRP1 type=write size=2518289 2024-09-12T00:07:19.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.921+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=U0AAS7JJMEA4 type=del size=571402 2024-09-12T00:07:19.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.923+0000 7f82f8930780 1 < suggested update operation key=NCIZ4HNPCZ94 tag=CXN4QDHWCE8C type=del size=2627735 2024-09-12T00:07:19.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.927+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~4BRX5WF3NI0N.0 size=843450 2024-09-12T00:07:19.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.927+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=4BRX5WF3NI0N tag=JGDYD2KHV9D8 type=write size=1892026 2024-09-12T00:07:19.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.929+0000 7f82f8930780 1 < completed delete operation key=9576W9WYJUJV tag=CS2U2R0E5L86 type=del 2024-09-12T00:07:19.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.930+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=MZY4IHV05BMR type=del size=1641190 2024-09-12T00:07:19.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.933+0000 7f82f8930780 1 < completed delete operation key=FOWSB9RQ5TV5 tag=1S0TA4K9XB20 type=del 2024-09-12T00:07:19.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.935+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~9ONGHJPJRGO6.0 size=1048576 2024-09-12T00:07:19.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.936+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~9ONGHJPJRGO6.1 size=754696 2024-09-12T00:07:19.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.936+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=9ONGHJPJRGO6 tag=VWCL63CFER3W type=write size=2851848 2024-09-12T00:07:19.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.938+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=LUBC01W8KELZ type=del 2024-09-12T00:07:19.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.940+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~IVE4B8M5BNGM.0 size=1048576 2024-09-12T00:07:19.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.941+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~IVE4B8M5BNGM.1 size=14104 2024-09-12T00:07:19.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.941+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=IVE4B8M5BNGM tag=ECI8295XLQMD type=write size=2111256 2024-09-12T00:07:19.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.943+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=ESJQU500XQKN type=del 2024-09-12T00:07:19.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.946+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~TQJ4EVCRGDEM.0 size=1048576 2024-09-12T00:07:19.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.947+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~TQJ4EVCRGDEM.1 size=1048576 2024-09-12T00:07:19.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.948+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~TQJ4EVCRGDEM.2 size=976724 2024-09-12T00:07:19.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.948+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=TQJ4EVCRGDEM tag=ZT5J0KMQ8AFN type=write size=4122452 2024-09-12T00:07:19.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.949+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=RYTONTI3BR6H type=del 2024-09-12T00:07:19.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.950+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=HT3GBFNV296G type=del size=2821993 2024-09-12T00:07:19.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.952+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=MLMD51TT3WQ3 type=del 2024-09-12T00:07:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.954+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~8Y91ZSFEK11T.0 size=1048576 2024-09-12T00:07:19.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.956+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~8Y91ZSFEK11T.1 size=1048576 2024-09-12T00:07:19.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.957+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~8Y91ZSFEK11T.2 size=644996 2024-09-12T00:07:19.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.957+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=8Y91ZSFEK11T tag=M8K1XITSJD1P type=write size=3790724 2024-09-12T00:07:19.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.960+0000 7f82f8930780 1 < suggested update operation key=N2TYUAJITFNL tag=7ZCGPURXFNZR type=del size=216296 2024-09-12T00:07:19.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.962+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~BEOPR90ZJ56A.0 size=1048576 2024-09-12T00:07:19.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.963+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~BEOPR90ZJ56A.1 size=1048576 2024-09-12T00:07:19.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.964+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~BEOPR90ZJ56A.2 size=1000525 2024-09-12T00:07:19.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.964+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=BEOPR90ZJ56A tag=BI3LU100AYU2 type=write size=4146253 2024-09-12T00:07:19.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.965+0000 7f82f8930780 1 < canceled operation key=OC61OW2M7ZEI tag=ROJ1ATA66Q2R type=del size=3874112 2024-09-12T00:07:19.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.966+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=SPTBM5ZY8MST type=del size=1098104 2024-09-12T00:07:19.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.968+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=ZO4OSRJM90EH type=del 2024-09-12T00:07:19.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.970+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=ZKO3MDBF6M6W type=write size=769082 2024-09-12T00:07:19.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.971+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~13WXF9479QV5.0 size=1048576 2024-09-12T00:07:19.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.972+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~13WXF9479QV5.1 size=1048576 2024-09-12T00:07:19.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.974+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~13WXF9479QV5.2 size=438817 2024-09-12T00:07:19.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.976+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=13WXF9479QV5 tag=V5XPYOUNOR3G type=write size=3584545 2024-09-12T00:07:19.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.977+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=Y25F29I1KA08 type=write size=825759 2024-09-12T00:07:19.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.979+0000 7f82f8930780 1 < completed write operation key=9576W9WYJUJV tag=2B1M87E4BF9T type=write size=211902 2024-09-12T00:07:19.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.980+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=55LYZKQ9E4DR type=del size=2462396 2024-09-12T00:07:19.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.982+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~WJN1TJ3DMAUK.0 size=744515 2024-09-12T00:07:19.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.984+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=WJN1TJ3DMAUK tag=V4AG8HYYSDYO type=write size=1793091 2024-09-12T00:07:19.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.985+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=WF14BQQYOA5R type=del size=268483 2024-09-12T00:07:19.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.988+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~MDAPYCFMWEEN.0 size=1048576 2024-09-12T00:07:19.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.988+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~MDAPYCFMWEEN.1 size=1048576 2024-09-12T00:07:19.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.989+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~MDAPYCFMWEEN.2 size=1019550 2024-09-12T00:07:19.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.992+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=MDAPYCFMWEEN tag=NHBDU8SXAWBJ type=write size=4165278 2024-09-12T00:07:19.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.994+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~7F6M353LQIQ4.0 size=1048576 2024-09-12T00:07:19.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.995+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~7F6M353LQIQ4.1 size=245690 2024-09-12T00:07:19.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.995+0000 7f82f8930780 1 > prepared multipart upload key=IN8Y7I0HKP6D upload=7F6M353LQIQ4 tag=BAFCXAY69KS1 type=write size=2342842 2024-09-12T00:07:19.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.996+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=GJ9CHO509EG7 type=del 2024-09-12T00:07:19.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.998+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=KVRWWFU8QMQ4 type=del size=4140861 2024-09-12T00:07:19.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:19.999+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=U0AAS7JJMEA4 type=del 2024-09-12T00:07:20.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.001+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=M7L0I52W7RZJ type=del size=3172144 2024-09-12T00:07:20.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.002+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~4BRX5WF3NI0N.0 size=843450 2024-09-12T00:07:20.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.004+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=4BRX5WF3NI0N tag=JGDYD2KHV9D8 type=write size=1892026 2024-09-12T00:07:20.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.006+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=6YIRN8W2J6C6 type=del size=461869 2024-09-12T00:07:20.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.009+0000 7f82f8930780 1 < suggested update operation key=LAKJS79KNBY7 tag=MZY4IHV05BMR type=del size=1641190 2024-09-12T00:07:20.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.010+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=JZGJOCDU8V4P type=write size=970710 2024-09-12T00:07:20.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.012+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~9ONGHJPJRGO6.0 size=1048576 2024-09-12T00:07:20.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.013+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~9ONGHJPJRGO6.1 size=754696 2024-09-12T00:07:20.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.015+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=9ONGHJPJRGO6 tag=VWCL63CFER3W type=write size=2851848 2024-09-12T00:07:20.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.018+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=9MJ12G7QOVO4 type=del size=2952435 2024-09-12T00:07:20.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.018+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~IVE4B8M5BNGM.0 size=1048576 2024-09-12T00:07:20.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.020+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~IVE4B8M5BNGM.1 size=14104 2024-09-12T00:07:20.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.022+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=IVE4B8M5BNGM tag=ECI8295XLQMD type=write size=2111256 2024-09-12T00:07:20.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.024+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~YK79LAI110GO.0 size=1048576 2024-09-12T00:07:20.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.025+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~YK79LAI110GO.1 size=1048576 2024-09-12T00:07:20.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.026+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~YK79LAI110GO.2 size=438351 2024-09-12T00:07:20.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.026+0000 7f82f8930780 1 > prepared multipart upload key=IN8Y7I0HKP6D upload=YK79LAI110GO tag=UJPB289WM9EU type=write size=3584079 2024-09-12T00:07:20.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.028+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~TQJ4EVCRGDEM.0 size=1048576 2024-09-12T00:07:20.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.029+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~TQJ4EVCRGDEM.1 size=1048576 2024-09-12T00:07:20.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.030+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~TQJ4EVCRGDEM.2 size=976724 2024-09-12T00:07:20.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.032+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=TQJ4EVCRGDEM tag=ZT5J0KMQ8AFN type=write size=4122452 2024-09-12T00:07:20.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.034+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~JJ6ARZU64BWM.0 size=1048576 2024-09-12T00:07:20.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.035+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~JJ6ARZU64BWM.1 size=347019 2024-09-12T00:07:20.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.035+0000 7f82f8930780 1 > prepared multipart upload key=IN8Y7I0HKP6D upload=JJ6ARZU64BWM tag=1AHZGFS3Y8IG type=write size=2444171 2024-09-12T00:07:20.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.037+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=HT3GBFNV296G type=del 2024-09-12T00:07:20.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.038+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=6D0OJ1ZKU54Y type=write size=103127 2024-09-12T00:07:20.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.040+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~8Y91ZSFEK11T.0 size=1048576 2024-09-12T00:07:20.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.041+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~8Y91ZSFEK11T.1 size=1048576 2024-09-12T00:07:20.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.042+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~8Y91ZSFEK11T.2 size=644996 2024-09-12T00:07:20.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.044+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=8Y91ZSFEK11T tag=M8K1XITSJD1P type=write size=3790724 2024-09-12T00:07:20.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.047+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~WSCL7QCU84SM.0 size=1048576 2024-09-12T00:07:20.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.049+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~WSCL7QCU84SM.1 size=755385 2024-09-12T00:07:20.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.049+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=WSCL7QCU84SM tag=I55RNZL9W6TR type=write size=2852537 2024-09-12T00:07:20.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.049+0000 7f82f8930780 1 < canceled part key=_multipart_80OUXNDPLGAG.2~BEOPR90ZJ56A.0 size=1048576 2024-09-12T00:07:20.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.049+0000 7f82f8930780 1 < canceled part key=_multipart_80OUXNDPLGAG.2~BEOPR90ZJ56A.1 size=1048576 2024-09-12T00:07:20.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.049+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~BEOPR90ZJ56A.2 size=1000525 2024-09-12T00:07:20.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.052+0000 7f82f8930780 1 < canceled multipart upload key=80OUXNDPLGAG upload=BEOPR90ZJ56A tag=BI3LU100AYU2 type=write size=4146253 2024-09-12T00:07:20.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.053+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=7GLCDIC3D7M7 type=del size=2938189 2024-09-12T00:07:20.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.055+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=SPTBM5ZY8MST type=del 2024-09-12T00:07:20.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.057+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=SWYXXKBP6UBE type=del size=3382052 2024-09-12T00:07:20.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.059+0000 7f82f8930780 1 < completed write operation key=NCIZ4HNPCZ94 tag=ZKO3MDBF6M6W type=write size=769082 2024-09-12T00:07:20.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.060+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=QYLVCYC9J9OZ type=write size=568648 2024-09-12T00:07:20.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.063+0000 7f82f8930780 1 < suggested update operation key=4SPRDO097JYQ tag=Y25F29I1KA08 type=write size=825759 2024-09-12T00:07:20.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.064+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=FLPZ74F1ZFD1 type=write size=29049 2024-09-12T00:07:20.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.067+0000 7f82f8930780 1 < suggested update operation key=62X93NOS23AF tag=55LYZKQ9E4DR type=del size=2462396 2024-09-12T00:07:20.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.068+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=F23X3VJIL7RP type=del size=2312227 2024-09-12T00:07:20.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.071+0000 7f82f8930780 1 < suggested remove operation key=LAKJS79KNBY7 tag=WF14BQQYOA5R type=del 2024-09-12T00:07:20.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.072+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=YGWX7QTET649 type=del size=1157510 2024-09-12T00:07:20.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.074+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~7F6M353LQIQ4.0 size=1048576 2024-09-12T00:07:20.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.075+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~7F6M353LQIQ4.1 size=245690 2024-09-12T00:07:20.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.077+0000 7f82f8930780 1 < completed multipart upload key=IN8Y7I0HKP6D upload=7F6M353LQIQ4 tag=BAFCXAY69KS1 type=write size=2342842 2024-09-12T00:07:20.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.079+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=ZRMUWJXC0D14 type=write size=572099 2024-09-12T00:07:20.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.080+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=KVRWWFU8QMQ4 type=del 2024-09-12T00:07:20.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.081+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=591NHFT5QYLX type=del size=364734 2024-09-12T00:07:20.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.083+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=M7L0I52W7RZJ type=del 2024-09-12T00:07:20.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.084+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=MJ1TGCQ27U1N type=del size=1090778 2024-09-12T00:07:20.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.086+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=6YIRN8W2J6C6 type=del 2024-09-12T00:07:20.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.089+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~Z5E8RT2QEP81.0 size=945548 2024-09-12T00:07:20.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.089+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=Z5E8RT2QEP81 tag=EGQWFIV7E5W3 type=write size=1994124 2024-09-12T00:07:20.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.090+0000 7f82f8930780 1 < canceled operation key=9576W9WYJUJV tag=JZGJOCDU8V4P type=write size=970710 2024-09-12T00:07:20.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.091+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=XVEHN4N37ZC6 type=write size=593382 2024-09-12T00:07:20.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.093+0000 7f82f8930780 1 < canceled operation key=Y5U8MO9TOJQQ tag=9MJ12G7QOVO4 type=del size=2952435 2024-09-12T00:07:20.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.094+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=W5K0BBPW668P type=write size=137973 2024-09-12T00:07:20.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.095+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~YK79LAI110GO.0 size=1048576 2024-09-12T00:07:20.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.096+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~YK79LAI110GO.1 size=1048576 2024-09-12T00:07:20.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.098+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~YK79LAI110GO.2 size=438351 2024-09-12T00:07:20.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.100+0000 7f82f8930780 1 < completed multipart upload key=IN8Y7I0HKP6D upload=YK79LAI110GO tag=UJPB289WM9EU type=write size=3584079 2024-09-12T00:07:20.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.102+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~7OF1OEC9XRCE.0 size=455915 2024-09-12T00:07:20.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.102+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=7OF1OEC9XRCE tag=9LYFCDTDK225 type=write size=1504491 2024-09-12T00:07:20.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.105+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~JJ6ARZU64BWM.0 size=1048576 2024-09-12T00:07:20.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.106+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~JJ6ARZU64BWM.1 size=347019 2024-09-12T00:07:20.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.108+0000 7f82f8930780 1 < completed multipart upload key=IN8Y7I0HKP6D upload=JJ6ARZU64BWM tag=1AHZGFS3Y8IG type=write size=2444171 2024-09-12T00:07:20.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.110+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=ZNOR4F1GFKRN type=del size=3099921 2024-09-12T00:07:20.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.110+0000 7f82f8930780 1 < completed write operation key=2XM2CF1T4VGW tag=6D0OJ1ZKU54Y type=write size=103127 2024-09-12T00:07:20.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.112+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=W4DQ50BGI3PW type=del size=3015530 2024-09-12T00:07:20.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.113+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~WSCL7QCU84SM.0 size=1048576 2024-09-12T00:07:20.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.115+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~WSCL7QCU84SM.1 size=755385 2024-09-12T00:07:20.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.117+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=WSCL7QCU84SM tag=I55RNZL9W6TR type=write size=2852537 2024-09-12T00:07:20.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.119+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~496D8PDFH8L0.0 size=476695 2024-09-12T00:07:20.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.119+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=496D8PDFH8L0 tag=3C1X4TRYT68V type=write size=1525271 2024-09-12T00:07:20.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.121+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=7GLCDIC3D7M7 type=del 2024-09-12T00:07:20.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.122+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=3ZV553B5H3PU type=del size=2732492 2024-09-12T00:07:20.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.123+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=SWYXXKBP6UBE type=del 2024-09-12T00:07:20.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.127+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~FWCDBUYDZLJT.0 size=935444 2024-09-12T00:07:20.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.127+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=FWCDBUYDZLJT tag=COEQ3LMEOUI3 type=write size=1984020 2024-09-12T00:07:20.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.129+0000 7f82f8930780 1 < completed write operation key=MJZ56OX8PLSH tag=QYLVCYC9J9OZ type=write size=568648 2024-09-12T00:07:20.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.129+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=BVEYFS4VUF5R type=del size=2555053 2024-09-12T00:07:20.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.131+0000 7f82f8930780 1 < completed write operation key=80OUXNDPLGAG tag=FLPZ74F1ZFD1 type=write size=29049 2024-09-12T00:07:20.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.132+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=UYFTPCDNAYNG type=del size=3056978 2024-09-12T00:07:20.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.134+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=F23X3VJIL7RP type=del 2024-09-12T00:07:20.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.135+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=4HU7685G3LAI type=del size=3116726 2024-09-12T00:07:20.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.136+0000 7f82f8930780 1 < completed delete operation key=OVJOP07M9KB8 tag=YGWX7QTET649 type=del 2024-09-12T00:07:20.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.138+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=74S069CEGD04 type=del size=2944982 2024-09-12T00:07:20.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.139+0000 7f82f8930780 1 < completed write operation key=BJHGNT3HBS25 tag=ZRMUWJXC0D14 type=write size=572099 2024-09-12T00:07:20.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.141+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=7E2L7IUIGAFT type=write size=158267 2024-09-12T00:07:20.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.142+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=591NHFT5QYLX type=del 2024-09-12T00:07:20.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.144+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=273UBFKE8VE3 type=write size=457998 2024-09-12T00:07:20.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.145+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=MJ1TGCQ27U1N type=del 2024-09-12T00:07:20.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.146+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=30PU9M017SL7 type=del size=3533750 2024-09-12T00:07:20.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.148+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~Z5E8RT2QEP81.0 size=945548 2024-09-12T00:07:20.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.151+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=Z5E8RT2QEP81 tag=EGQWFIV7E5W3 type=write size=1994124 2024-09-12T00:07:20.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.152+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=U5GX2OFEJF9V type=write size=976741 2024-09-12T00:07:20.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.155+0000 7f82f8930780 1 < suggested remove operation key=W8SAQZWQHY36 tag=XVEHN4N37ZC6 type=write 2024-09-12T00:07:20.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.157+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~X5ETZYFAFVJG.0 size=49827 2024-09-12T00:07:20.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.157+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=X5ETZYFAFVJG tag=ZIOBSTRWQI8O type=write size=1098403 2024-09-12T00:07:20.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.160+0000 7f82f8930780 1 < completed write operation key=2XM2CF1T4VGW tag=W5K0BBPW668P type=write size=137973 2024-09-12T00:07:20.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.162+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~CJVHMHWWT53Y.0 size=1048576 2024-09-12T00:07:20.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.163+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~CJVHMHWWT53Y.1 size=1048576 2024-09-12T00:07:20.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.164+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~CJVHMHWWT53Y.2 size=454164 2024-09-12T00:07:20.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.164+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=CJVHMHWWT53Y tag=PGVLUYC6ZMT1 type=write size=3599892 2024-09-12T00:07:20.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.166+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~7OF1OEC9XRCE.0 size=455915 2024-09-12T00:07:20.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.168+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=7OF1OEC9XRCE tag=9LYFCDTDK225 type=write size=1504491 2024-09-12T00:07:20.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.170+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=1JNJLH15SCO6 type=write size=864723 2024-09-12T00:07:20.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.173+0000 7f82f8930780 1 < suggested remove operation key=X3PCR8TCWDTK tag=ZNOR4F1GFKRN type=del 2024-09-12T00:07:20.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.174+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=V5A3K92BHKR4 type=del size=2241313 2024-09-12T00:07:20.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.177+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=W4DQ50BGI3PW type=del 2024-09-12T00:07:20.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.178+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=79XVJE14NO6I type=del size=2411020 2024-09-12T00:07:20.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.179+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~496D8PDFH8L0.0 size=476695 2024-09-12T00:07:20.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.181+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=496D8PDFH8L0 tag=3C1X4TRYT68V type=write size=1525271 2024-09-12T00:07:20.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.182+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=TTAJ02BNXD0W type=del size=89288 2024-09-12T00:07:20.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.184+0000 7f82f8930780 1 < canceled operation key=O2ZGU2KOTUOT tag=3ZV553B5H3PU type=del size=2732492 2024-09-12T00:07:20.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.185+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=TNE3H12PSL2G type=del size=1142296 2024-09-12T00:07:20.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.188+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~FWCDBUYDZLJT.0 size=935444 2024-09-12T00:07:20.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.189+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=FWCDBUYDZLJT tag=COEQ3LMEOUI3 type=write size=1984020 2024-09-12T00:07:20.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.191+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~ZMPY2O18KIH1.0 size=805409 2024-09-12T00:07:20.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.191+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=ZMPY2O18KIH1 tag=PMBIE8HZBMO2 type=write size=1853985 2024-09-12T00:07:20.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.194+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=BVEYFS4VUF5R type=del 2024-09-12T00:07:20.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.196+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~SL2CMYXYL8VC.0 size=926039 2024-09-12T00:07:20.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.196+0000 7f82f8930780 1 > prepared multipart upload key=4IA4918NXXJW upload=SL2CMYXYL8VC tag=Q9LBJIB63IQ7 type=write size=1974615 2024-09-12T00:07:20.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.198+0000 7f82f8930780 1 < canceled operation key=4IA4918NXXJW tag=UYFTPCDNAYNG type=del size=3056978 2024-09-12T00:07:20.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.199+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=AVKWZZPUKS0V type=del size=91073 2024-09-12T00:07:20.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.202+0000 7f82f8930780 1 < suggested remove operation key=G55HN1VD6X47 tag=4HU7685G3LAI type=del 2024-09-12T00:07:20.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.205+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~S65HNFHOGFQT.0 size=745434 2024-09-12T00:07:20.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.205+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=S65HNFHOGFQT tag=6ZY4S79UUYTQ type=write size=1794010 2024-09-12T00:07:20.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.206+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=74S069CEGD04 type=del 2024-09-12T00:07:20.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.209+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~32AONJ97GYAS.0 size=1048576 2024-09-12T00:07:20.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.210+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~32AONJ97GYAS.1 size=257431 2024-09-12T00:07:20.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.210+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=32AONJ97GYAS tag=UB2K8DF1POVF type=write size=2354583 2024-09-12T00:07:20.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.211+0000 7f82f8930780 1 < completed write operation key=4SPRDO097JYQ tag=7E2L7IUIGAFT type=write size=158267 2024-09-12T00:07:20.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.213+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=UIK669QNQTNL type=del size=2026524 2024-09-12T00:07:20.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.214+0000 7f82f8930780 1 < completed write operation key=IN8Y7I0HKP6D tag=273UBFKE8VE3 type=write size=457998 2024-09-12T00:07:20.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.217+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~JBSJC5Q1STHY.0 size=1048576 2024-09-12T00:07:20.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.218+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~JBSJC5Q1STHY.1 size=1048576 2024-09-12T00:07:20.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.219+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~JBSJC5Q1STHY.2 size=193946 2024-09-12T00:07:20.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.219+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=JBSJC5Q1STHY tag=KGSM5ZGL7VRE type=write size=3339674 2024-09-12T00:07:20.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.221+0000 7f82f8930780 1 < suggested remove operation key=A8EFUP30RS65 tag=30PU9M017SL7 type=del 2024-09-12T00:07:20.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.224+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~BPB6ETM11LMT.0 size=1044680 2024-09-12T00:07:20.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.224+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=BPB6ETM11LMT tag=UOMX1FIZP0E9 type=write size=2093256 2024-09-12T00:07:20.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.225+0000 7f82f8930780 1 < completed write operation key=FHQADENLR6GP tag=U5GX2OFEJF9V type=write size=976741 2024-09-12T00:07:20.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.227+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=6L1ZF1S0FPC3 type=del size=1647872 2024-09-12T00:07:20.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.228+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~X5ETZYFAFVJG.0 size=49827 2024-09-12T00:07:20.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.231+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=X5ETZYFAFVJG tag=ZIOBSTRWQI8O type=write size=1098403 2024-09-12T00:07:20.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.232+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=01OMOYMGTS9F type=write size=626585 2024-09-12T00:07:20.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.234+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~CJVHMHWWT53Y.0 size=1048576 2024-09-12T00:07:20.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.236+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~CJVHMHWWT53Y.1 size=1048576 2024-09-12T00:07:20.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.236+0000 7f82f8930780 1 < canceled part key=_multipart_HCK59C6MAW0B.2~CJVHMHWWT53Y.2 size=454164 2024-09-12T00:07:20.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.238+0000 7f82f8930780 1 < canceled multipart upload key=HCK59C6MAW0B upload=CJVHMHWWT53Y tag=PGVLUYC6ZMT1 type=write size=3599892 2024-09-12T00:07:20.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.239+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=U8I1SP4KQHHP type=del size=2685963 2024-09-12T00:07:20.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.240+0000 7f82f8930780 1 < completed write operation key=77SDZHCSP0E3 tag=1JNJLH15SCO6 type=write size=864723 2024-09-12T00:07:20.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.242+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~JXK2J8JKH1NG.0 size=1048576 2024-09-12T00:07:20.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.243+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~JXK2J8JKH1NG.1 size=1048576 2024-09-12T00:07:20.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.244+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~JXK2J8JKH1NG.2 size=907601 2024-09-12T00:07:20.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.244+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=JXK2J8JKH1NG tag=2U0MZD1XSQ62 type=write size=4053329 2024-09-12T00:07:20.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.246+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=V5A3K92BHKR4 type=del 2024-09-12T00:07:20.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.247+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=A7YY8X6MGKQW type=del size=1696605 2024-09-12T00:07:20.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.250+0000 7f82f8930780 1 < suggested update operation key=4SPRDO097JYQ tag=79XVJE14NO6I type=del size=2411020 2024-09-12T00:07:20.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.253+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~C7ZJM2V2E71K.0 size=1048576 2024-09-12T00:07:20.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.254+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~C7ZJM2V2E71K.1 size=768829 2024-09-12T00:07:20.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.254+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=C7ZJM2V2E71K tag=AFXDP4F80OA3 type=write size=2865981 2024-09-12T00:07:20.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.257+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=TTAJ02BNXD0W type=del 2024-09-12T00:07:20.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.258+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=Q9N703R937OE type=del size=1873222 2024-09-12T00:07:20.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.259+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=TNE3H12PSL2G type=del 2024-09-12T00:07:20.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.262+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~SWI8TTER2TKZ.0 size=667427 2024-09-12T00:07:20.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.262+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=SWI8TTER2TKZ tag=6HCL5EAN2GCR type=write size=1716003 2024-09-12T00:07:20.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.264+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~ZMPY2O18KIH1.0 size=805409 2024-09-12T00:07:20.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.267+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=ZMPY2O18KIH1 tag=PMBIE8HZBMO2 type=write size=1853985 2024-09-12T00:07:20.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.268+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=9BT7SHHG13LX type=write size=70407 2024-09-12T00:07:20.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.271+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~SL2CMYXYL8VC.0 size=926039 2024-09-12T00:07:20.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.273+0000 7f82f8930780 1 < completed multipart upload key=4IA4918NXXJW upload=SL2CMYXYL8VC tag=Q9LBJIB63IQ7 type=write size=1974615 2024-09-12T00:07:20.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.275+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~87U53GAOVWVI.0 size=1048576 2024-09-12T00:07:20.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.277+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~87U53GAOVWVI.1 size=945125 2024-09-12T00:07:20.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.277+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=87U53GAOVWVI tag=A65V57IBHZJC type=write size=3042277 2024-09-12T00:07:20.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.278+0000 7f82f8930780 -1 < failed to complete operation key=4SPRDO097JYQ tag=AVKWZZPUKS0V type=del size=91073: (22) Invalid argument 2024-09-12T00:07:20.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.281+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=HSEB3CIBTCQW type=del size=1274615 2024-09-12T00:07:20.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.282+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~S65HNFHOGFQT.0 size=745434 2024-09-12T00:07:20.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.284+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=S65HNFHOGFQT tag=6ZY4S79UUYTQ type=write size=1794010 2024-09-12T00:07:20.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.286+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~8MCOR6JKUUDZ.0 size=1048576 2024-09-12T00:07:20.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.288+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~8MCOR6JKUUDZ.1 size=1048576 2024-09-12T00:07:20.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.289+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~8MCOR6JKUUDZ.2 size=287638 2024-09-12T00:07:20.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.289+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=8MCOR6JKUUDZ tag=9ERWHZJG8PE2 type=write size=3433366 2024-09-12T00:07:20.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.290+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~32AONJ97GYAS.0 size=1048576 2024-09-12T00:07:20.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.293+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~32AONJ97GYAS.1 size=257431 2024-09-12T00:07:20.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.294+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=32AONJ97GYAS tag=UB2K8DF1POVF type=write size=2354583 2024-09-12T00:07:20.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.297+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~35ZORHK2PO4Y.0 size=708240 2024-09-12T00:07:20.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.297+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=35ZORHK2PO4Y tag=C7AV0I0CFUJ1 type=write size=1756816 2024-09-12T00:07:20.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.299+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=UIK669QNQTNL type=del 2024-09-12T00:07:20.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.303+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~RWNV0PSTU88Q.0 size=1048576 2024-09-12T00:07:20.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.304+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~RWNV0PSTU88Q.1 size=1048576 2024-09-12T00:07:20.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.304+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~RWNV0PSTU88Q.2 size=684910 2024-09-12T00:07:20.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.304+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=RWNV0PSTU88Q tag=2U6OYICCA421 type=write size=3830638 2024-09-12T00:07:20.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.306+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~JBSJC5Q1STHY.0 size=1048576 2024-09-12T00:07:20.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.307+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~JBSJC5Q1STHY.1 size=1048576 2024-09-12T00:07:20.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.308+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~JBSJC5Q1STHY.2 size=193946 2024-09-12T00:07:20.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.311+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=JBSJC5Q1STHY tag=KGSM5ZGL7VRE type=write size=3339674 2024-09-12T00:07:20.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.312+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=MNGIERVR5FKQ type=del size=2747833 2024-09-12T00:07:20.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.314+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~BPB6ETM11LMT.0 size=1044680 2024-09-12T00:07:20.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.316+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=BPB6ETM11LMT tag=UOMX1FIZP0E9 type=write size=2093256 2024-09-12T00:07:20.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.317+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=FB2VFA1JAAFJ type=del size=2617706 2024-09-12T00:07:20.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.319+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=6L1ZF1S0FPC3 type=del 2024-09-12T00:07:20.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.320+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=LD1FKLW205SS type=del size=2072681 2024-09-12T00:07:20.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.323+0000 7f82f8930780 1 < suggested remove operation key=75GYP042UUC2 tag=01OMOYMGTS9F type=write 2024-09-12T00:07:20.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.326+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~PZYZRDF3FJ67.0 size=1048576 2024-09-12T00:07:20.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.327+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~PZYZRDF3FJ67.1 size=567931 2024-09-12T00:07:20.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.327+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=PZYZRDF3FJ67 tag=D0G544B8K8FE type=write size=2665083 2024-09-12T00:07:20.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.329+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=U8I1SP4KQHHP type=del 2024-09-12T00:07:20.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.333+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~R1M41RRIFMY9.0 size=1048576 2024-09-12T00:07:20.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.334+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~R1M41RRIFMY9.1 size=890300 2024-09-12T00:07:20.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.334+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=R1M41RRIFMY9 tag=M1BE5Z1UUX03 type=write size=2987452 2024-09-12T00:07:20.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.335+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~JXK2J8JKH1NG.0 size=1048576 2024-09-12T00:07:20.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.336+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~JXK2J8JKH1NG.1 size=1048576 2024-09-12T00:07:20.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.337+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~JXK2J8JKH1NG.2 size=907601 2024-09-12T00:07:20.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.340+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=JXK2J8JKH1NG tag=2U0MZD1XSQ62 type=write size=4053329 2024-09-12T00:07:20.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.341+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=I3WKVR218XUN type=write size=787079 2024-09-12T00:07:20.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.343+0000 7f82f8930780 -1 < failed to complete operation key=75GYP042UUC2 tag=A7YY8X6MGKQW type=del size=1696605: (22) Invalid argument 2024-09-12T00:07:20.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.345+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~YFJ6BVY92VJG.0 size=1048576 2024-09-12T00:07:20.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.346+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~YFJ6BVY92VJG.1 size=956381 2024-09-12T00:07:20.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.346+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=YFJ6BVY92VJG tag=LII50QV6BZ1Q type=write size=3053533 2024-09-12T00:07:20.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.348+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~C7ZJM2V2E71K.0 size=1048576 2024-09-12T00:07:20.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.349+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~C7ZJM2V2E71K.1 size=768829 2024-09-12T00:07:20.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.351+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=C7ZJM2V2E71K tag=AFXDP4F80OA3 type=write size=2865981 2024-09-12T00:07:20.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.353+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=PS82W5CV7GCJ type=del size=3740694 2024-09-12T00:07:20.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.355+0000 7f82f8930780 1 < canceled operation key=G55HN1VD6X47 tag=Q9N703R937OE type=del size=1873222 2024-09-12T00:07:20.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.355+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=00K91B5J7L6A type=del size=3828795 2024-09-12T00:07:20.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.358+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~SWI8TTER2TKZ.0 size=667427 2024-09-12T00:07:20.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.359+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=SWI8TTER2TKZ tag=6HCL5EAN2GCR type=write size=1716003 2024-09-12T00:07:20.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.360+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=0RBGSGAJE6ZT type=write size=976737 2024-09-12T00:07:20.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.363+0000 7f82f8930780 1 < suggested remove operation key=QB46N36A27QH tag=9BT7SHHG13LX type=write 2024-09-12T00:07:20.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.365+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=YQZHEKT03Q70 type=write size=1042873 2024-09-12T00:07:20.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.367+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~87U53GAOVWVI.0 size=1048576 2024-09-12T00:07:20.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.367+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~87U53GAOVWVI.1 size=945125 2024-09-12T00:07:20.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.369+0000 7f82f8930780 1 < completed multipart upload key=W8SAQZWQHY36 upload=87U53GAOVWVI tag=A65V57IBHZJC type=write size=3042277 2024-09-12T00:07:20.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.372+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~4EAXQ5EWAXRN.0 size=1030838 2024-09-12T00:07:20.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.372+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=4EAXQ5EWAXRN tag=00VE06EFCYDX type=write size=2079414 2024-09-12T00:07:20.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.375+0000 7f82f8930780 1 < suggested update operation key=FOWSB9RQ5TV5 tag=HSEB3CIBTCQW type=del size=1274615 2024-09-12T00:07:20.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.376+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=V0LC2CJCM3P1 type=del size=413482 2024-09-12T00:07:20.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.378+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~8MCOR6JKUUDZ.0 size=1048576 2024-09-12T00:07:20.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.379+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~8MCOR6JKUUDZ.1 size=1048576 2024-09-12T00:07:20.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.380+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~8MCOR6JKUUDZ.2 size=287638 2024-09-12T00:07:20.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.383+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=8MCOR6JKUUDZ tag=9ERWHZJG8PE2 type=write size=3433366 2024-09-12T00:07:20.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.384+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=3AUBROE0RG5L type=del size=2079450 2024-09-12T00:07:20.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.385+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~35ZORHK2PO4Y.0 size=708240 2024-09-12T00:07:20.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.388+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=35ZORHK2PO4Y tag=C7AV0I0CFUJ1 type=write size=1756816 2024-09-12T00:07:20.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.390+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~IUO646IWQB36.0 size=1048576 2024-09-12T00:07:20.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.391+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~IUO646IWQB36.1 size=700784 2024-09-12T00:07:20.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.391+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=IUO646IWQB36 tag=BD9UDY0KIFOO type=write size=2797936 2024-09-12T00:07:20.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.393+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~RWNV0PSTU88Q.0 size=1048576 2024-09-12T00:07:20.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.394+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~RWNV0PSTU88Q.1 size=1048576 2024-09-12T00:07:20.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.395+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~RWNV0PSTU88Q.2 size=684910 2024-09-12T00:07:20.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.397+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=RWNV0PSTU88Q tag=2U6OYICCA421 type=write size=3830638 2024-09-12T00:07:20.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.399+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=CKG4URMGVGB3 type=del size=1833252 2024-09-12T00:07:20.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.400+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=MNGIERVR5FKQ type=del 2024-09-12T00:07:20.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.402+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=XGR4KV2G09IH type=del size=1769164 2024-09-12T00:07:20.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.403+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=FB2VFA1JAAFJ type=del 2024-09-12T00:07:20.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.404+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=I234PYLDQYYG type=del size=639803 2024-09-12T00:07:20.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.406+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=LD1FKLW205SS type=del 2024-09-12T00:07:20.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.407+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=B614I7T63WPB type=write size=95557 2024-09-12T00:07:20.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.409+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~PZYZRDF3FJ67.0 size=1048576 2024-09-12T00:07:20.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.410+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~PZYZRDF3FJ67.1 size=567931 2024-09-12T00:07:20.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.413+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=PZYZRDF3FJ67 tag=D0G544B8K8FE type=write size=2665083 2024-09-12T00:07:20.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.415+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~EXQ56HUH643E.0 size=190921 2024-09-12T00:07:20.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.415+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=EXQ56HUH643E tag=1CN9JVHZUC8B type=write size=1239497 2024-09-12T00:07:20.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.415+0000 7f82f8930780 1 < canceled part key=_multipart_AMWMQXO10EXK.2~R1M41RRIFMY9.0 size=1048576 2024-09-12T00:07:20.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.416+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~R1M41RRIFMY9.1 size=890300 2024-09-12T00:07:20.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.419+0000 7f82f8930780 1 < canceled multipart upload key=AMWMQXO10EXK upload=R1M41RRIFMY9 tag=M1BE5Z1UUX03 type=write size=2987452 2024-09-12T00:07:20.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.420+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=OK3W7SR92Y0W type=del size=3392505 2024-09-12T00:07:20.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.422+0000 7f82f8930780 1 < completed write operation key=MJZ56OX8PLSH tag=I3WKVR218XUN type=write size=787079 2024-09-12T00:07:20.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.426+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~X2L9GHLZ371G.0 size=287180 2024-09-12T00:07:20.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.426+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=X2L9GHLZ371G tag=MULUY80OH2D0 type=write size=1335756 2024-09-12T00:07:20.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.426+0000 7f82f8930780 1 < canceled part key=_multipart_X3PCR8TCWDTK.2~YFJ6BVY92VJG.0 size=1048576 2024-09-12T00:07:20.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.427+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~YFJ6BVY92VJG.1 size=956381 2024-09-12T00:07:20.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.429+0000 7f82f8930780 1 < canceled multipart upload key=X3PCR8TCWDTK upload=YFJ6BVY92VJG tag=LII50QV6BZ1Q type=write size=3053533 2024-09-12T00:07:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.432+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~ZKSRG9K6T7FH.0 size=564709 2024-09-12T00:07:20.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.432+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=ZKSRG9K6T7FH tag=1NBXR22NU309 type=write size=1613285 2024-09-12T00:07:20.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.433+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=PS82W5CV7GCJ type=del 2024-09-12T00:07:20.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.436+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~E6S9X3OB3ZQB.0 size=1048576 2024-09-12T00:07:20.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.437+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~E6S9X3OB3ZQB.1 size=251007 2024-09-12T00:07:20.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.437+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=E6S9X3OB3ZQB tag=D6OTJH0RSD2O type=write size=2348159 2024-09-12T00:07:20.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.439+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=00K91B5J7L6A type=del 2024-09-12T00:07:20.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.440+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=0V1K1PDYRFGL type=write size=680001 2024-09-12T00:07:20.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.442+0000 7f82f8930780 1 < completed write operation key=Y8GDXNDCOHCW tag=0RBGSGAJE6ZT type=write size=976737 2024-09-12T00:07:20.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.443+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=CLUFAW2BVKET type=del size=1795572 2024-09-12T00:07:20.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.445+0000 7f82f8930780 1 < completed write operation key=A8EFUP30RS65 tag=YQZHEKT03Q70 type=write size=1042873 2024-09-12T00:07:20.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.447+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=DXJI7E5LBO45 type=del size=2546936 2024-09-12T00:07:20.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.449+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~4EAXQ5EWAXRN.0 size=1030838 2024-09-12T00:07:20.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.451+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=4EAXQ5EWAXRN tag=00VE06EFCYDX type=write size=2079414 2024-09-12T00:07:20.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.453+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=DQ6C9T6V4BYL type=del size=673817 2024-09-12T00:07:20.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.454+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=V0LC2CJCM3P1 type=del 2024-09-12T00:07:20.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.458+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~I64KS6ISAS63.0 size=956461 2024-09-12T00:07:20.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.458+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=I64KS6ISAS63 tag=D7A8FV4DI87U type=write size=2005037 2024-09-12T00:07:20.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.459+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=3AUBROE0RG5L type=del 2024-09-12T00:07:20.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.462+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~QN7J3ILBJ7BF.0 size=470095 2024-09-12T00:07:20.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.462+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=QN7J3ILBJ7BF tag=BKJULBFC3GR0 type=write size=1518671 2024-09-12T00:07:20.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.463+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~IUO646IWQB36.0 size=1048576 2024-09-12T00:07:20.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.464+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~IUO646IWQB36.1 size=700784 2024-09-12T00:07:20.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.468+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=IUO646IWQB36 tag=BD9UDY0KIFOO type=write size=2797936 2024-09-12T00:07:20.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.471+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~50075WQC74DR.0 size=1048576 2024-09-12T00:07:20.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.471+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~50075WQC74DR.1 size=321763 2024-09-12T00:07:20.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.471+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=50075WQC74DR tag=S3EPZ11ZQYRK type=write size=2418915 2024-09-12T00:07:20.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.473+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=CKG4URMGVGB3 type=del 2024-09-12T00:07:20.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.475+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=EDE7T06VREBP type=del size=2851710 2024-09-12T00:07:20.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.477+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=XGR4KV2G09IH type=del 2024-09-12T00:07:20.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.480+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~9GVNWHS96HHU.0 size=1048576 2024-09-12T00:07:20.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.480+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~9GVNWHS96HHU.1 size=1048576 2024-09-12T00:07:20.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.482+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~9GVNWHS96HHU.2 size=480855 2024-09-12T00:07:20.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.482+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=9GVNWHS96HHU tag=RQLOJM587M08 type=write size=3626583 2024-09-12T00:07:20.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.484+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=I234PYLDQYYG type=del 2024-09-12T00:07:20.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.486+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~KKG19OAS7TNO.0 size=1048576 2024-09-12T00:07:20.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.487+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~KKG19OAS7TNO.1 size=1048576 2024-09-12T00:07:20.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.488+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~KKG19OAS7TNO.2 size=619511 2024-09-12T00:07:20.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.488+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=KKG19OAS7TNO tag=240L280JJRB5 type=write size=3765239 2024-09-12T00:07:20.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.491+0000 7f82f8930780 1 < suggested remove operation key=4IA4918NXXJW tag=B614I7T63WPB type=write 2024-09-12T00:07:20.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.492+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=2Y2X05IGAPVB type=del size=1844155 2024-09-12T00:07:20.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.494+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~EXQ56HUH643E.0 size=190921 2024-09-12T00:07:20.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.496+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=EXQ56HUH643E tag=1CN9JVHZUC8B type=write size=1239497 2024-09-12T00:07:20.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.499+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~139T7PXJZ79G.0 size=1048576 2024-09-12T00:07:20.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.499+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~139T7PXJZ79G.1 size=1048576 2024-09-12T00:07:20.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.501+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~139T7PXJZ79G.2 size=512769 2024-09-12T00:07:20.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.501+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=139T7PXJZ79G tag=U91QTNL3MA32 type=write size=3658497 2024-09-12T00:07:20.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.502+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=OK3W7SR92Y0W type=del 2024-09-12T00:07:20.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.503+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=19XJ7AX4OZDE type=del size=4111396 2024-09-12T00:07:20.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.505+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~X2L9GHLZ371G.0 size=287180 2024-09-12T00:07:20.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.507+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=X2L9GHLZ371G tag=MULUY80OH2D0 type=write size=1335756 2024-09-12T00:07:20.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.510+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~L1H7X5S2K3WQ.0 size=1048576 2024-09-12T00:07:20.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.512+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~L1H7X5S2K3WQ.1 size=392704 2024-09-12T00:07:20.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.512+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=L1H7X5S2K3WQ tag=7OGCJY3BFP46 type=write size=2489856 2024-09-12T00:07:20.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.513+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~ZKSRG9K6T7FH.0 size=564709 2024-09-12T00:07:20.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.516+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=ZKSRG9K6T7FH tag=1NBXR22NU309 type=write size=1613285 2024-09-12T00:07:20.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.517+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=QNO4XW38WET8 type=del size=480195 2024-09-12T00:07:20.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.519+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~E6S9X3OB3ZQB.0 size=1048576 2024-09-12T00:07:20.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.519+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~E6S9X3OB3ZQB.1 size=251007 2024-09-12T00:07:20.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.522+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=E6S9X3OB3ZQB tag=D6OTJH0RSD2O type=write size=2348159 2024-09-12T00:07:20.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.523+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=NSV6BAGXEAEK type=del size=2147062 2024-09-12T00:07:20.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.524+0000 7f82f8930780 1 < completed write operation key=BJHGNT3HBS25 tag=0V1K1PDYRFGL type=write size=680001 2024-09-12T00:07:20.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.526+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=OWDHD3FLBRO0 type=del size=1839092 2024-09-12T00:07:20.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.527+0000 7f82f8930780 1 < canceled operation key=O2ZGU2KOTUOT tag=CLUFAW2BVKET type=del size=1795572 2024-09-12T00:07:20.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.531+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~P2SOT0UL9BYG.0 size=600050 2024-09-12T00:07:20.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.531+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=P2SOT0UL9BYG tag=HDH9TNVLWNCZ type=write size=1648626 2024-09-12T00:07:20.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.532+0000 7f82f8930780 -1 < failed to complete operation key=4IA4918NXXJW tag=DXJI7E5LBO45 type=del size=2546936: (22) Invalid argument 2024-09-12T00:07:20.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.533+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=EKVOFTE57NNN type=del size=3690334 2024-09-12T00:07:20.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.535+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=DQ6C9T6V4BYL type=del 2024-09-12T00:07:20.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.537+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=ISG1779V1O4Y type=del size=678233 2024-09-12T00:07:20.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.538+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~I64KS6ISAS63.0 size=956461 2024-09-12T00:07:20.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.540+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=I64KS6ISAS63 tag=D7A8FV4DI87U type=write size=2005037 2024-09-12T00:07:20.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.542+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=Y9WO5BAJLWNU type=del size=4063737 2024-09-12T00:07:20.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.543+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~QN7J3ILBJ7BF.0 size=470095 2024-09-12T00:07:20.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.545+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=QN7J3ILBJ7BF tag=BKJULBFC3GR0 type=write size=1518671 2024-09-12T00:07:20.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.547+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=SXAZA9KK2T9O type=write size=607759 2024-09-12T00:07:20.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.548+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~50075WQC74DR.0 size=1048576 2024-09-12T00:07:20.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.550+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~50075WQC74DR.1 size=321763 2024-09-12T00:07:20.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.552+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=50075WQC74DR tag=S3EPZ11ZQYRK type=write size=2418915 2024-09-12T00:07:20.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.553+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=5AS23YZXP0NP type=del size=2899760 2024-09-12T00:07:20.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.555+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=EDE7T06VREBP type=del 2024-09-12T00:07:20.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.559+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~RT09AI2ER1LY.0 size=1048576 2024-09-12T00:07:20.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.560+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~RT09AI2ER1LY.1 size=290773 2024-09-12T00:07:20.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.560+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=RT09AI2ER1LY tag=24S03AAQZ1JM type=write size=2387925 2024-09-12T00:07:20.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.561+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~9GVNWHS96HHU.0 size=1048576 2024-09-12T00:07:20.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.562+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~9GVNWHS96HHU.1 size=1048576 2024-09-12T00:07:20.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.564+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~9GVNWHS96HHU.2 size=480855 2024-09-12T00:07:20.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.566+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=9GVNWHS96HHU tag=RQLOJM587M08 type=write size=3626583 2024-09-12T00:07:20.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.569+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~70JI13OG5KNS.0 size=1048576 2024-09-12T00:07:20.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.570+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~70JI13OG5KNS.1 size=1048576 2024-09-12T00:07:20.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.571+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~70JI13OG5KNS.2 size=230356 2024-09-12T00:07:20.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.571+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=70JI13OG5KNS tag=K8VSIKRH0KKI type=write size=3376084 2024-09-12T00:07:20.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.573+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~KKG19OAS7TNO.0 size=1048576 2024-09-12T00:07:20.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.574+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~KKG19OAS7TNO.1 size=1048576 2024-09-12T00:07:20.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.575+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~KKG19OAS7TNO.2 size=619511 2024-09-12T00:07:20.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.578+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=KKG19OAS7TNO tag=240L280JJRB5 type=write size=3765239 2024-09-12T00:07:20.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.579+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=FNY2XRNN1Y59 type=write size=182259 2024-09-12T00:07:20.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.582+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=2Y2X05IGAPVB type=del 2024-09-12T00:07:20.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.583+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=X4UC5SQA1LPM type=del size=1784279 2024-09-12T00:07:20.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.584+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~139T7PXJZ79G.0 size=1048576 2024-09-12T00:07:20.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.586+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~139T7PXJZ79G.1 size=1048576 2024-09-12T00:07:20.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.587+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~139T7PXJZ79G.2 size=512769 2024-09-12T00:07:20.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.589+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=139T7PXJZ79G tag=U91QTNL3MA32 type=write size=3658497 2024-09-12T00:07:20.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.590+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=O4LILY72DIP2 type=del size=1402381 2024-09-12T00:07:20.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.592+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=19XJ7AX4OZDE type=del 2024-09-12T00:07:20.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.593+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=04VKLY2WKFOR type=write size=380403 2024-09-12T00:07:20.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.595+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~L1H7X5S2K3WQ.0 size=1048576 2024-09-12T00:07:20.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.596+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~L1H7X5S2K3WQ.1 size=392704 2024-09-12T00:07:20.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.599+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=L1H7X5S2K3WQ tag=7OGCJY3BFP46 type=write size=2489856 2024-09-12T00:07:20.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.600+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=W32GDL0LL9D9 type=del size=955166 2024-09-12T00:07:20.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.603+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=QNO4XW38WET8 type=del 2024-09-12T00:07:20.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.606+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~9IMRE5FKAK1E.0 size=350966 2024-09-12T00:07:20.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.606+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=9IMRE5FKAK1E tag=JJ6ZWYL1XKXR type=write size=1399542 2024-09-12T00:07:20.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.609+0000 7f82f8930780 1 < suggested update operation key=4SPRDO097JYQ tag=NSV6BAGXEAEK type=del size=2147062 2024-09-12T00:07:20.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.611+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=AN78XIUZD73N type=write size=721158 2024-09-12T00:07:20.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.613+0000 7f82f8930780 1 < suggested update operation key=62X93NOS23AF tag=OWDHD3FLBRO0 type=del size=1839092 2024-09-12T00:07:20.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.615+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=U0AV508JHP5C type=del size=1955528 2024-09-12T00:07:20.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.617+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~P2SOT0UL9BYG.0 size=600050 2024-09-12T00:07:20.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.620+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=P2SOT0UL9BYG tag=HDH9TNVLWNCZ type=write size=1648626 2024-09-12T00:07:20.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.621+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=EN59IJJW2SU7 type=del size=2390385 2024-09-12T00:07:20.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.622+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=EKVOFTE57NNN type=del 2024-09-12T00:07:20.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.624+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=3PAGMFKIBWNY type=del size=3315002 2024-09-12T00:07:20.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.625+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=ISG1779V1O4Y type=del 2024-09-12T00:07:20.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.628+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~23ZZZRN2LP6H.0 size=989979 2024-09-12T00:07:20.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.628+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=23ZZZRN2LP6H tag=HUE7UKNAHNMT type=write size=2038555 2024-09-12T00:07:20.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.629+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=Y9WO5BAJLWNU type=del 2024-09-12T00:07:20.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.632+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=OJW69G28X9SU type=del size=2655201 2024-09-12T00:07:20.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.632+0000 7f82f8930780 1 < completed write operation key=O2ZGU2KOTUOT tag=SXAZA9KK2T9O type=write size=607759 2024-09-12T00:07:20.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.635+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~W6LBLS6P545M.0 size=1048576 2024-09-12T00:07:20.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.637+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~W6LBLS6P545M.1 size=517205 2024-09-12T00:07:20.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.637+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=W6LBLS6P545M tag=0E7T0ZMGFHKH type=write size=2614357 2024-09-12T00:07:20.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.638+0000 7f82f8930780 1 < completed delete operation key=OVJOP07M9KB8 tag=5AS23YZXP0NP type=del 2024-09-12T00:07:20.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.639+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=YG2JFF75RK2W type=del size=2918676 2024-09-12T00:07:20.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.640+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~RT09AI2ER1LY.0 size=1048576 2024-09-12T00:07:20.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.642+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~RT09AI2ER1LY.1 size=290773 2024-09-12T00:07:20.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.644+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=RT09AI2ER1LY tag=24S03AAQZ1JM type=write size=2387925 2024-09-12T00:07:20.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.646+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~MS594OY36LNV.0 size=420356 2024-09-12T00:07:20.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.646+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=MS594OY36LNV tag=F1FRT5P89SOL type=write size=1468932 2024-09-12T00:07:20.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.648+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~70JI13OG5KNS.0 size=1048576 2024-09-12T00:07:20.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.649+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~70JI13OG5KNS.1 size=1048576 2024-09-12T00:07:20.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.650+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~70JI13OG5KNS.2 size=230356 2024-09-12T00:07:20.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.652+0000 7f82f8930780 1 < completed multipart upload key=Y5U8MO9TOJQQ upload=70JI13OG5KNS tag=K8VSIKRH0KKI type=write size=3376084 2024-09-12T00:07:20.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.654+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=KZ6B93ND391W type=del size=3599021 2024-09-12T00:07:20.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.655+0000 7f82f8930780 1 < completed write operation key=FHQADENLR6GP tag=FNY2XRNN1Y59 type=write size=182259 2024-09-12T00:07:20.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.657+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=0NKW8EOC53ZE type=write size=927581 2024-09-12T00:07:20.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.659+0000 7f82f8930780 -1 < failed to complete operation key=4SPRDO097JYQ tag=X4UC5SQA1LPM type=del size=1784279: (22) Invalid argument 2024-09-12T00:07:20.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.661+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=W3SLGNSIEY8P type=del size=1259312 2024-09-12T00:07:20.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.662+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=O4LILY72DIP2 type=del 2024-09-12T00:07:20.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.663+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=N5Z08IE4PJJ7 type=del size=3148490 2024-09-12T00:07:20.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.665+0000 7f82f8930780 1 < completed write operation key=MJZ56OX8PLSH tag=04VKLY2WKFOR type=write size=380403 2024-09-12T00:07:20.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.667+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=O2QP12D7FSGG type=del size=3929062 2024-09-12T00:07:20.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.668+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=W32GDL0LL9D9 type=del 2024-09-12T00:07:20.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.670+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=8TO7GN830HUQ type=del size=954739 2024-09-12T00:07:20.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.672+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~9IMRE5FKAK1E.0 size=350966 2024-09-12T00:07:20.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.674+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=9IMRE5FKAK1E tag=JJ6ZWYL1XKXR type=write size=1399542 2024-09-12T00:07:20.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.675+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=6EYL81BMQVBQ type=write size=735832 2024-09-12T00:07:20.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.676+0000 7f82f8930780 1 < completed write operation key=MJZ56OX8PLSH tag=AN78XIUZD73N type=write size=721158 2024-09-12T00:07:20.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.679+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~4I1FCIXSFLN4.0 size=1048576 2024-09-12T00:07:20.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.680+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~4I1FCIXSFLN4.1 size=329621 2024-09-12T00:07:20.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.680+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=4I1FCIXSFLN4 tag=X5L00GS768UN type=write size=2426773 2024-09-12T00:07:20.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.681+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=U0AV508JHP5C type=del 2024-09-12T00:07:20.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.683+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=WTSHNOW1RVYK type=del size=3681456 2024-09-12T00:07:20.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.687+0000 7f82f8930780 1 < suggested update operation key=IMAT4ZCLGFRN tag=EN59IJJW2SU7 type=del size=2390385 2024-09-12T00:07:20.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.688+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=263S0O3UUBWA type=del size=1462134 2024-09-12T00:07:20.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.689+0000 7f82f8930780 1 < completed delete operation key=HCK59C6MAW0B tag=3PAGMFKIBWNY type=del 2024-09-12T00:07:20.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.691+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=09WR5D362R2H type=del size=3156140 2024-09-12T00:07:20.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.693+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~23ZZZRN2LP6H.0 size=989979 2024-09-12T00:07:20.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.695+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=23ZZZRN2LP6H tag=HUE7UKNAHNMT type=write size=2038555 2024-09-12T00:07:20.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.697+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=C3264G0R3G7I type=del size=943837 2024-09-12T00:07:20.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.699+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=OJW69G28X9SU type=del 2024-09-12T00:07:20.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.701+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=F3T7GZS2HL7G type=del size=2008335 2024-09-12T00:07:20.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.703+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~W6LBLS6P545M.0 size=1048576 2024-09-12T00:07:20.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.703+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~W6LBLS6P545M.1 size=517205 2024-09-12T00:07:20.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.706+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=W6LBLS6P545M tag=0E7T0ZMGFHKH type=write size=2614357 2024-09-12T00:07:20.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.709+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~8X250GCQWRA3.0 size=1048576 2024-09-12T00:07:20.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.709+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~8X250GCQWRA3.1 size=1048576 2024-09-12T00:07:20.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.710+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~8X250GCQWRA3.2 size=626771 2024-09-12T00:07:20.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.710+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=8X250GCQWRA3 tag=PUAGF355ON40 type=write size=3772499 2024-09-12T00:07:20.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.714+0000 7f82f8930780 1 < suggested remove operation key=BJHGNT3HBS25 tag=YG2JFF75RK2W type=del 2024-09-12T00:07:20.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.715+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=E4EG65KBEISZ type=del size=821024 2024-09-12T00:07:20.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.716+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~MS594OY36LNV.0 size=420356 2024-09-12T00:07:20.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.719+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=MS594OY36LNV tag=F1FRT5P89SOL type=write size=1468932 2024-09-12T00:07:20.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.721+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~Q4P240OM3RHN.0 size=1048576 2024-09-12T00:07:20.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.723+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~Q4P240OM3RHN.1 size=545498 2024-09-12T00:07:20.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.723+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=Q4P240OM3RHN tag=DF8EN1KL9VC8 type=write size=2642650 2024-09-12T00:07:20.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.725+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=KZ6B93ND391W type=del 2024-09-12T00:07:20.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.728+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~A14RXTW3FVZB.0 size=1048576 2024-09-12T00:07:20.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.728+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~A14RXTW3FVZB.1 size=1048576 2024-09-12T00:07:20.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.729+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~A14RXTW3FVZB.2 size=78334 2024-09-12T00:07:20.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.729+0000 7f82f8930780 1 > prepared multipart upload key=4IA4918NXXJW upload=A14RXTW3FVZB tag=CATXMYH2MCB6 type=write size=3224062 2024-09-12T00:07:20.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.731+0000 7f82f8930780 1 < completed write operation key=9576W9WYJUJV tag=0NKW8EOC53ZE type=write size=927581 2024-09-12T00:07:20.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.734+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~2O1IU63R7PE0.0 size=1048576 2024-09-12T00:07:20.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.735+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~2O1IU63R7PE0.1 size=1048576 2024-09-12T00:07:20.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.736+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~2O1IU63R7PE0.2 size=693487 2024-09-12T00:07:20.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.736+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=2O1IU63R7PE0 tag=7LX0A0YCRYG7 type=write size=3839215 2024-09-12T00:07:20.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.737+0000 7f82f8930780 1 < canceled operation key=N2TYUAJITFNL tag=W3SLGNSIEY8P type=del size=1259312 2024-09-12T00:07:20.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.741+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~KP6117MKB4PQ.0 size=737233 2024-09-12T00:07:20.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.741+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=KP6117MKB4PQ tag=E91EY1EZQBLZ type=write size=1785809 2024-09-12T00:07:20.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.741+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=N5Z08IE4PJJ7 type=del 2024-09-12T00:07:20.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.744+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=MZML4E71OKPK type=write size=884753 2024-09-12T00:07:20.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.746+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=O2QP12D7FSGG type=del 2024-09-12T00:07:20.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.749+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~DR156W3UXPYD.0 size=1048576 2024-09-12T00:07:20.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.751+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~DR156W3UXPYD.1 size=475444 2024-09-12T00:07:20.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.751+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=DR156W3UXPYD tag=IEIGBVGRO4SE type=write size=2572596 2024-09-12T00:07:20.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.753+0000 7f82f8930780 -1 < failed to complete operation key=BJHGNT3HBS25 tag=8TO7GN830HUQ type=del size=954739: (22) Invalid argument 2024-09-12T00:07:20.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.753+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=HDIUQLDGJ2Q1 type=del size=3948759 2024-09-12T00:07:20.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.757+0000 7f82f8930780 1 < suggested update operation key=A8EFUP30RS65 tag=6EYL81BMQVBQ type=write size=735832 2024-09-12T00:07:20.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.759+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=O3US8ZIIBBRS type=del size=1842867 2024-09-12T00:07:20.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.760+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~4I1FCIXSFLN4.0 size=1048576 2024-09-12T00:07:20.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.762+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~4I1FCIXSFLN4.1 size=329621 2024-09-12T00:07:20.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.764+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=4I1FCIXSFLN4 tag=X5L00GS768UN type=write size=2426773 2024-09-12T00:07:20.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.765+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=JQI1SNTALE40 type=del size=3223600 2024-09-12T00:07:20.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.767+0000 7f82f8930780 1 < canceled operation key=4SPRDO097JYQ tag=WTSHNOW1RVYK type=del size=3681456 2024-09-12T00:07:20.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.768+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=ANUZB9V7O5XU type=del size=257684 2024-09-12T00:07:20.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.771+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=263S0O3UUBWA type=del 2024-09-12T00:07:20.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.773+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~X0NDLY58H7X3.0 size=1048576 2024-09-12T00:07:20.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.774+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~X0NDLY58H7X3.1 size=1048576 2024-09-12T00:07:20.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.775+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~X0NDLY58H7X3.2 size=416537 2024-09-12T00:07:20.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.775+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=X0NDLY58H7X3 tag=VXJ63ZUT4AW3 type=write size=3562265 2024-09-12T00:07:20.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.777+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=09WR5D362R2H type=del 2024-09-12T00:07:20.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.780+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~X1LLC2N1KETM.0 size=1048576 2024-09-12T00:07:20.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.781+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~X1LLC2N1KETM.1 size=739091 2024-09-12T00:07:20.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.781+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=X1LLC2N1KETM tag=8IWH2J4AMZ38 type=write size=2836243 2024-09-12T00:07:20.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.782+0000 7f82f8930780 1 < completed delete operation key=9576W9WYJUJV tag=C3264G0R3G7I type=del 2024-09-12T00:07:20.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.785+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=4MVQ5UHGFM39 type=del size=3995441 2024-09-12T00:07:20.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.786+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=F3T7GZS2HL7G type=del 2024-09-12T00:07:20.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.787+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=F32AX4LG2UOT type=write size=990839 2024-09-12T00:07:20.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.789+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~8X250GCQWRA3.0 size=1048576 2024-09-12T00:07:20.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.791+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~8X250GCQWRA3.1 size=1048576 2024-09-12T00:07:20.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.791+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~8X250GCQWRA3.2 size=626771 2024-09-12T00:07:20.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.794+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=8X250GCQWRA3 tag=PUAGF355ON40 type=write size=3772499 2024-09-12T00:07:20.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.795+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=BA2CDBT1EJ1A type=del size=3525918 2024-09-12T00:07:20.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.798+0000 7f82f8930780 1 < suggested update operation key=N2TYUAJITFNL tag=E4EG65KBEISZ type=del size=821024 2024-09-12T00:07:20.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.802+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~EGGRM8LVV4YW.0 size=51939 2024-09-12T00:07:20.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.802+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=EGGRM8LVV4YW tag=9PDQ0F13P31C type=write size=1100515 2024-09-12T00:07:20.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.803+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~Q4P240OM3RHN.0 size=1048576 2024-09-12T00:07:20.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.804+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~Q4P240OM3RHN.1 size=545498 2024-09-12T00:07:20.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.806+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=Q4P240OM3RHN tag=DF8EN1KL9VC8 type=write size=2642650 2024-09-12T00:07:20.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.808+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=9JNCJ363IXFN type=write size=946516 2024-09-12T00:07:20.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.809+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~A14RXTW3FVZB.0 size=1048576 2024-09-12T00:07:20.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.811+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~A14RXTW3FVZB.1 size=1048576 2024-09-12T00:07:20.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.811+0000 7f82f8930780 1 < canceled part key=_multipart_4IA4918NXXJW.2~A14RXTW3FVZB.2 size=78334 2024-09-12T00:07:20.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.813+0000 7f82f8930780 1 < canceled multipart upload key=4IA4918NXXJW upload=A14RXTW3FVZB tag=CATXMYH2MCB6 type=write size=3224062 2024-09-12T00:07:20.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.815+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=5JQEGOSTDRMI type=write size=165353 2024-09-12T00:07:20.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.815+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~2O1IU63R7PE0.0 size=1048576 2024-09-12T00:07:20.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.816+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~2O1IU63R7PE0.1 size=1048576 2024-09-12T00:07:20.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.816+0000 7f82f8930780 1 < canceled part key=_multipart_2XM2CF1T4VGW.2~2O1IU63R7PE0.2 size=693487 2024-09-12T00:07:20.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.819+0000 7f82f8930780 1 < canceled multipart upload key=2XM2CF1T4VGW upload=2O1IU63R7PE0 tag=7LX0A0YCRYG7 type=write size=3839215 2024-09-12T00:07:20.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.820+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=UXWBAXYQTL4V type=del size=2037602 2024-09-12T00:07:20.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.822+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~KP6117MKB4PQ.0 size=737233 2024-09-12T00:07:20.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.824+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=KP6117MKB4PQ tag=E91EY1EZQBLZ type=write size=1785809 2024-09-12T00:07:20.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.827+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~OUOCRP0CX8BU.0 size=1048576 2024-09-12T00:07:20.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.828+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~OUOCRP0CX8BU.1 size=1014627 2024-09-12T00:07:20.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.828+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=OUOCRP0CX8BU tag=N78JBYICG0NC type=write size=3111779 2024-09-12T00:07:20.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.829+0000 7f82f8930780 -1 < failed to complete operation key=A8EFUP30RS65 tag=MZML4E71OKPK type=write size=884753: (22) Invalid argument 2024-09-12T00:07:20.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.832+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~EIXI4ZV7ITW7.0 size=103654 2024-09-12T00:07:20.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.832+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=EIXI4ZV7ITW7 tag=RUA1I2SESTTE type=write size=1152230 2024-09-12T00:07:20.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.832+0000 7f82f8930780 1 < canceled part key=_multipart_N2TYUAJITFNL.2~DR156W3UXPYD.0 size=1048576 2024-09-12T00:07:20.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.832+0000 7f82f8930780 1 < canceled part key=_multipart_N2TYUAJITFNL.2~DR156W3UXPYD.1 size=475444 2024-09-12T00:07:20.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.834+0000 7f82f8930780 1 < canceled multipart upload key=N2TYUAJITFNL upload=DR156W3UXPYD tag=IEIGBVGRO4SE type=write size=2572596 2024-09-12T00:07:20.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.836+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=7Y25J2I0F9JA type=write size=962774 2024-09-12T00:07:20.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.837+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=HDIUQLDGJ2Q1 type=del 2024-09-12T00:07:20.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.839+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~7WT2KJ62SYXI.0 size=1048576 2024-09-12T00:07:20.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.841+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~7WT2KJ62SYXI.1 size=1048576 2024-09-12T00:07:20.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.842+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~7WT2KJ62SYXI.2 size=992278 2024-09-12T00:07:20.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.842+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=7WT2KJ62SYXI tag=VEYQ77IPJGGP type=write size=4138006 2024-09-12T00:07:20.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.843+0000 7f82f8930780 1 < canceled operation key=X3PCR8TCWDTK tag=O3US8ZIIBBRS type=del size=1842867 2024-09-12T00:07:20.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.846+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~4P78Y9DZB53H.0 size=1048576 2024-09-12T00:07:20.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.847+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~4P78Y9DZB53H.1 size=255215 2024-09-12T00:07:20.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.847+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=4P78Y9DZB53H tag=X09O8RN066HD type=write size=2352367 2024-09-12T00:07:20.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.848+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=JQI1SNTALE40 type=del 2024-09-12T00:07:20.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.851+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~G0ER7GUO7U5Q.0 size=1048576 2024-09-12T00:07:20.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.852+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~G0ER7GUO7U5Q.1 size=44460 2024-09-12T00:07:20.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.852+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=G0ER7GUO7U5Q tag=QGFF29L0WSG7 type=write size=2141612 2024-09-12T00:07:20.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.853+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=ANUZB9V7O5XU type=del 2024-09-12T00:07:20.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.855+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~3VNX086JWP1V.0 size=1048576 2024-09-12T00:07:20.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.856+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~3VNX086JWP1V.1 size=1048576 2024-09-12T00:07:20.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.857+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~3VNX086JWP1V.2 size=81479 2024-09-12T00:07:20.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.857+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=3VNX086JWP1V tag=MEL11BAXKO3N type=write size=3227207 2024-09-12T00:07:20.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.859+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~X0NDLY58H7X3.0 size=1048576 2024-09-12T00:07:20.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.860+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~X0NDLY58H7X3.1 size=1048576 2024-09-12T00:07:20.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.861+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~X0NDLY58H7X3.2 size=416537 2024-09-12T00:07:20.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.863+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=X0NDLY58H7X3 tag=VXJ63ZUT4AW3 type=write size=3562265 2024-09-12T00:07:20.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.865+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~5TIDIDJOP3R1.0 size=299177 2024-09-12T00:07:20.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.865+0000 7f82f8930780 1 > prepared multipart upload key=IN8Y7I0HKP6D upload=5TIDIDJOP3R1 tag=AHXNV3WKUSMI type=write size=1347753 2024-09-12T00:07:20.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.866+0000 7f82f8930780 1 < canceled part key=_multipart_2XM2CF1T4VGW.2~X1LLC2N1KETM.0 size=1048576 2024-09-12T00:07:20.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.866+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~X1LLC2N1KETM.1 size=739091 2024-09-12T00:07:20.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.869+0000 7f82f8930780 1 < canceled multipart upload key=2XM2CF1T4VGW upload=X1LLC2N1KETM tag=8IWH2J4AMZ38 type=write size=2836243 2024-09-12T00:07:20.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.870+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=INBM3F3EYYKB type=del size=1477277 2024-09-12T00:07:20.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.872+0000 7f82f8930780 1 < canceled operation key=YWC5JUV5B2N6 tag=4MVQ5UHGFM39 type=del size=3995441 2024-09-12T00:07:20.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.873+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=Q8EFINF40PMQ type=del size=3185300 2024-09-12T00:07:20.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.875+0000 7f82f8930780 1 < completed write operation key=A8EFUP30RS65 tag=F32AX4LG2UOT type=write size=990839 2024-09-12T00:07:20.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.878+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~P6Q2SRLDMVAH.0 size=1048576 2024-09-12T00:07:20.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.879+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~P6Q2SRLDMVAH.1 size=1048576 2024-09-12T00:07:20.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.880+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~P6Q2SRLDMVAH.2 size=192300 2024-09-12T00:07:20.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.880+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=P6Q2SRLDMVAH tag=R1IORBOVAMOJ type=write size=3338028 2024-09-12T00:07:20.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.882+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=BA2CDBT1EJ1A type=del 2024-09-12T00:07:20.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.885+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~MG1LUVFUCSY8.0 size=1048576 2024-09-12T00:07:20.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.886+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~MG1LUVFUCSY8.1 size=333654 2024-09-12T00:07:20.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.886+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=MG1LUVFUCSY8 tag=WZTPN9R34CZH type=write size=2430806 2024-09-12T00:07:20.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.887+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~EGGRM8LVV4YW.0 size=51939 2024-09-12T00:07:20.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.890+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=EGGRM8LVV4YW tag=9PDQ0F13P31C type=write size=1100515 2024-09-12T00:07:20.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.891+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=XWLF0CVR9J0Y type=del size=2502290 2024-09-12T00:07:20.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.893+0000 7f82f8930780 1 < completed write operation key=2XM2CF1T4VGW tag=9JNCJ363IXFN type=write size=946516 2024-09-12T00:07:20.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.895+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=4XVJ2OJH9FTH type=del size=1509089 2024-09-12T00:07:20.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.897+0000 7f82f8930780 1 < suggested remove operation key=OVJOP07M9KB8 tag=5JQEGOSTDRMI type=write 2024-09-12T00:07:20.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.900+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~X0A16O3YAEFL.0 size=1048576 2024-09-12T00:07:20.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.900+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~X0A16O3YAEFL.1 size=1048576 2024-09-12T00:07:20.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.901+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~X0A16O3YAEFL.2 size=242760 2024-09-12T00:07:20.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.901+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=X0A16O3YAEFL tag=AB1KM0KH41S3 type=write size=3388488 2024-09-12T00:07:20.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.903+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=UXWBAXYQTL4V type=del 2024-09-12T00:07:20.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.905+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~64F2MA93B86A.0 size=1048576 2024-09-12T00:07:20.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.907+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~64F2MA93B86A.1 size=1048576 2024-09-12T00:07:20.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.908+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~64F2MA93B86A.2 size=124169 2024-09-12T00:07:20.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.908+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=64F2MA93B86A tag=8AIJ7W5Z7Y7C type=write size=3269897 2024-09-12T00:07:20.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.909+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~OUOCRP0CX8BU.0 size=1048576 2024-09-12T00:07:20.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.910+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~OUOCRP0CX8BU.1 size=1014627 2024-09-12T00:07:20.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.912+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=OUOCRP0CX8BU tag=N78JBYICG0NC type=write size=3111779 2024-09-12T00:07:20.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.914+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=U2N5ZLCERN6T type=write size=412548 2024-09-12T00:07:20.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.915+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~EIXI4ZV7ITW7.0 size=103654 2024-09-12T00:07:20.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.917+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=EIXI4ZV7ITW7 tag=RUA1I2SESTTE type=write size=1152230 2024-09-12T00:07:20.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.920+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~KMB4GS3XQQ98.0 size=1048576 2024-09-12T00:07:20.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.922+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~KMB4GS3XQQ98.1 size=1048576 2024-09-12T00:07:20.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.924+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~KMB4GS3XQQ98.2 size=149247 2024-09-12T00:07:20.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.924+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=KMB4GS3XQQ98 tag=38TDS7UTULIG type=write size=3294975 2024-09-12T00:07:20.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.924+0000 7f82f8930780 1 < completed write operation key=BJHGNT3HBS25 tag=7Y25J2I0F9JA type=write size=962774 2024-09-12T00:07:20.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.927+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=LE9QD0XRYHL5 type=del size=1133579 2024-09-12T00:07:20.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.927+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~7WT2KJ62SYXI.0 size=1048576 2024-09-12T00:07:20.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.929+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~7WT2KJ62SYXI.1 size=1048576 2024-09-12T00:07:20.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.930+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~7WT2KJ62SYXI.2 size=992278 2024-09-12T00:07:20.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.932+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=7WT2KJ62SYXI tag=VEYQ77IPJGGP type=write size=4138006 2024-09-12T00:07:20.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.934+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~XEZ8D7S52999.0 size=867591 2024-09-12T00:07:20.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.934+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=XEZ8D7S52999 tag=33DPK45B61CU type=write size=1916167 2024-09-12T00:07:20.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.937+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~4P78Y9DZB53H.0 size=1048576 2024-09-12T00:07:20.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.938+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~4P78Y9DZB53H.1 size=255215 2024-09-12T00:07:20.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.940+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=4P78Y9DZB53H tag=X09O8RN066HD type=write size=2352367 2024-09-12T00:07:20.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.943+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~UJSCGA6JVVJR.0 size=1048576 2024-09-12T00:07:20.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.944+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~UJSCGA6JVVJR.1 size=1048576 2024-09-12T00:07:20.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.945+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~UJSCGA6JVVJR.2 size=364437 2024-09-12T00:07:20.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.945+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=UJSCGA6JVVJR tag=SNZMOOVD243K type=write size=3510165 2024-09-12T00:07:20.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.946+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~G0ER7GUO7U5Q.0 size=1048576 2024-09-12T00:07:20.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.948+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~G0ER7GUO7U5Q.1 size=44460 2024-09-12T00:07:20.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.951+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=G0ER7GUO7U5Q tag=QGFF29L0WSG7 type=write size=2141612 2024-09-12T00:07:20.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.952+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=V8146QCYOQA9 type=del size=3930575 2024-09-12T00:07:20.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.953+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~3VNX086JWP1V.0 size=1048576 2024-09-12T00:07:20.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.954+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~3VNX086JWP1V.1 size=1048576 2024-09-12T00:07:20.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.956+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~3VNX086JWP1V.2 size=81479 2024-09-12T00:07:20.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.958+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=3VNX086JWP1V tag=MEL11BAXKO3N type=write size=3227207 2024-09-12T00:07:20.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.959+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=REB01VHE01VS type=del size=2605004 2024-09-12T00:07:20.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.961+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~5TIDIDJOP3R1.0 size=299177 2024-09-12T00:07:20.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.963+0000 7f82f8930780 1 < completed multipart upload key=IN8Y7I0HKP6D upload=5TIDIDJOP3R1 tag=AHXNV3WKUSMI type=write size=1347753 2024-09-12T00:07:20.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.965+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=1P4O9N1SFUW2 type=del size=54754 2024-09-12T00:07:20.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.966+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=INBM3F3EYYKB type=del 2024-09-12T00:07:20.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.970+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~0XOPJ5RV8W3X.0 size=1021585 2024-09-12T00:07:20.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.970+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=0XOPJ5RV8W3X tag=UBIZSPYCLYBV type=write size=2070161 2024-09-12T00:07:20.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.972+0000 7f82f8930780 1 < suggested update operation key=FHQADENLR6GP tag=Q8EFINF40PMQ type=del size=3185300 2024-09-12T00:07:20.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.974+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~BYH8GPUYMS1D.0 size=1048576 2024-09-12T00:07:20.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.975+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~BYH8GPUYMS1D.1 size=375512 2024-09-12T00:07:20.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.975+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=BYH8GPUYMS1D tag=3JENRZWN41J2 type=write size=2472664 2024-09-12T00:07:20.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.977+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~P6Q2SRLDMVAH.0 size=1048576 2024-09-12T00:07:20.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.979+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~P6Q2SRLDMVAH.1 size=1048576 2024-09-12T00:07:20.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.980+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~P6Q2SRLDMVAH.2 size=192300 2024-09-12T00:07:20.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.982+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=P6Q2SRLDMVAH tag=R1IORBOVAMOJ type=write size=3338028 2024-09-12T00:07:20.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.983+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=EEY3J09IAZKS type=del size=3712416 2024-09-12T00:07:20.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.985+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~MG1LUVFUCSY8.0 size=1048576 2024-09-12T00:07:20.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.987+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~MG1LUVFUCSY8.1 size=333654 2024-09-12T00:07:20.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.989+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=MG1LUVFUCSY8 tag=WZTPN9R34CZH type=write size=2430806 2024-09-12T00:07:20.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.992+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~55REVWPE62OL.0 size=1048576 2024-09-12T00:07:20.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.992+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~55REVWPE62OL.1 size=710937 2024-09-12T00:07:20.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.992+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=55REVWPE62OL tag=GG2HC4OI1QTS type=write size=2808089 2024-09-12T00:07:20.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.994+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=XWLF0CVR9J0Y type=del 2024-09-12T00:07:20.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.996+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~L4923LAI8LCC.0 size=119395 2024-09-12T00:07:20.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.996+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=L4923LAI8LCC tag=R8JHQQKBH7GD type=write size=1167971 2024-09-12T00:07:20.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:20.998+0000 7f82f8930780 1 < canceled operation key=OC61OW2M7ZEI tag=4XVJ2OJH9FTH type=del size=1509089 2024-09-12T00:07:21.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.000+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~ZW7CO9XJ6I2J.0 size=1048576 2024-09-12T00:07:21.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.001+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~ZW7CO9XJ6I2J.1 size=1048576 2024-09-12T00:07:21.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.003+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~ZW7CO9XJ6I2J.2 size=193772 2024-09-12T00:07:21.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.003+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=ZW7CO9XJ6I2J tag=ZJK2KRDLRIDX type=write size=3339500 2024-09-12T00:07:21.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.004+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~X0A16O3YAEFL.0 size=1048576 2024-09-12T00:07:21.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.005+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~X0A16O3YAEFL.1 size=1048576 2024-09-12T00:07:21.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.006+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~X0A16O3YAEFL.2 size=242760 2024-09-12T00:07:21.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.010+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=X0A16O3YAEFL tag=AB1KM0KH41S3 type=write size=3388488 2024-09-12T00:07:21.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.011+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=E6U426ZE5OR5 type=del size=754600 2024-09-12T00:07:21.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.012+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~64F2MA93B86A.0 size=1048576 2024-09-12T00:07:21.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.012+0000 7f82f8930780 1 < canceled part key=_multipart_BJHGNT3HBS25.2~64F2MA93B86A.1 size=1048576 2024-09-12T00:07:21.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.013+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~64F2MA93B86A.2 size=124169 2024-09-12T00:07:21.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.016+0000 7f82f8930780 1 < canceled multipart upload key=BJHGNT3HBS25 upload=64F2MA93B86A tag=8AIJ7W5Z7Y7C type=write size=3269897 2024-09-12T00:07:21.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.017+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=6PV39PXSHKAU type=write size=100733 2024-09-12T00:07:21.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.019+0000 7f82f8930780 1 < completed write operation key=3H3D067Z8O0R tag=U2N5ZLCERN6T type=write size=412548 2024-09-12T00:07:21.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.020+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=MHD7RYRHBFLU type=del size=3555089 2024-09-12T00:07:21.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.021+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~KMB4GS3XQQ98.0 size=1048576 2024-09-12T00:07:21.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.022+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~KMB4GS3XQQ98.1 size=1048576 2024-09-12T00:07:21.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.024+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~KMB4GS3XQQ98.2 size=149247 2024-09-12T00:07:21.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.026+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=KMB4GS3XQQ98 tag=38TDS7UTULIG type=write size=3294975 2024-09-12T00:07:21.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.027+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=4PDMHKQUDOAO type=write size=664802 2024-09-12T00:07:21.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.029+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=LE9QD0XRYHL5 type=del 2024-09-12T00:07:21.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.030+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=V1FIQ0E7Y4YA type=del size=147458 2024-09-12T00:07:21.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.032+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~XEZ8D7S52999.0 size=867591 2024-09-12T00:07:21.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.035+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=XEZ8D7S52999 tag=33DPK45B61CU type=write size=1916167 2024-09-12T00:07:21.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.036+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~L130DQZLWZXR.0 size=532457 2024-09-12T00:07:21.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.037+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=L130DQZLWZXR tag=K28V611BHI2J type=write size=1581033 2024-09-12T00:07:21.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.038+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~UJSCGA6JVVJR.0 size=1048576 2024-09-12T00:07:21.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.039+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~UJSCGA6JVVJR.1 size=1048576 2024-09-12T00:07:21.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.040+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~UJSCGA6JVVJR.2 size=364437 2024-09-12T00:07:21.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.043+0000 7f82f8930780 1 < completed multipart upload key=W8SAQZWQHY36 upload=UJSCGA6JVVJR tag=SNZMOOVD243K type=write size=3510165 2024-09-12T00:07:21.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.044+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=PPNMY96CUNSP type=del size=2701679 2024-09-12T00:07:21.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.046+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=V8146QCYOQA9 type=del 2024-09-12T00:07:21.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.048+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~XFP2VZBLQ0N7.0 size=815174 2024-09-12T00:07:21.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.048+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=XFP2VZBLQ0N7 tag=F1WZPKWPFHZT type=write size=1863750 2024-09-12T00:07:21.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.050+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=REB01VHE01VS type=del 2024-09-12T00:07:21.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.052+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~CWKK1CATFSJN.0 size=1048576 2024-09-12T00:07:21.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.053+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~CWKK1CATFSJN.1 size=1048576 2024-09-12T00:07:21.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.055+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~CWKK1CATFSJN.2 size=564799 2024-09-12T00:07:21.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.055+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=CWKK1CATFSJN tag=O313B4IVQ7X5 type=write size=3710527 2024-09-12T00:07:21.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.056+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=1P4O9N1SFUW2 type=del 2024-09-12T00:07:21.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.057+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=Y6JF0S72WTW3 type=del size=2523164 2024-09-12T00:07:21.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.059+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~0XOPJ5RV8W3X.0 size=1021585 2024-09-12T00:07:21.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.061+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=0XOPJ5RV8W3X tag=UBIZSPYCLYBV type=write size=2070161 2024-09-12T00:07:21.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.063+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~TL5Q2UVYXL1L.0 size=246843 2024-09-12T00:07:21.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.063+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=TL5Q2UVYXL1L tag=GGFORM4WPIKU type=write size=1295419 2024-09-12T00:07:21.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.065+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~BYH8GPUYMS1D.0 size=1048576 2024-09-12T00:07:21.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.066+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~BYH8GPUYMS1D.1 size=375512 2024-09-12T00:07:21.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.068+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=BYH8GPUYMS1D tag=3JENRZWN41J2 type=write size=2472664 2024-09-12T00:07:21.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.071+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~O610DEN5276K.0 size=1048576 2024-09-12T00:07:21.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.072+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~O610DEN5276K.1 size=433309 2024-09-12T00:07:21.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.072+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=O610DEN5276K tag=5CTKAT17DUDK type=write size=2530461 2024-09-12T00:07:21.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.073+0000 7f82f8930780 1 < canceled operation key=OVJOP07M9KB8 tag=EEY3J09IAZKS type=del size=3712416 2024-09-12T00:07:21.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.075+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=GT3WX3XUVMZ0 type=del size=419561 2024-09-12T00:07:21.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.076+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~55REVWPE62OL.0 size=1048576 2024-09-12T00:07:21.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.077+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~55REVWPE62OL.1 size=710937 2024-09-12T00:07:21.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.080+0000 7f82f8930780 1 < completed multipart upload key=Y5U8MO9TOJQQ upload=55REVWPE62OL tag=GG2HC4OI1QTS type=write size=2808089 2024-09-12T00:07:21.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.082+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=1L6ORG67IKO2 type=write size=993524 2024-09-12T00:07:21.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.082+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~L4923LAI8LCC.0 size=119395 2024-09-12T00:07:21.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.085+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=L4923LAI8LCC tag=R8JHQQKBH7GD type=write size=1167971 2024-09-12T00:07:21.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.086+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=9SA9UKPESJIZ type=write size=874596 2024-09-12T00:07:21.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.087+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~ZW7CO9XJ6I2J.0 size=1048576 2024-09-12T00:07:21.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.089+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~ZW7CO9XJ6I2J.1 size=1048576 2024-09-12T00:07:21.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.091+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~ZW7CO9XJ6I2J.2 size=193772 2024-09-12T00:07:21.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.093+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=ZW7CO9XJ6I2J tag=ZJK2KRDLRIDX type=write size=3339500 2024-09-12T00:07:21.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.094+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=S3NXKJ9Q8VUU type=del size=2250020 2024-09-12T00:07:21.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.095+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=E6U426ZE5OR5 type=del 2024-09-12T00:07:21.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.096+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=663Y5WNC04SW type=del size=422234 2024-09-12T00:07:21.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.099+0000 7f82f8930780 1 < completed write operation key=FOWSB9RQ5TV5 tag=6PV39PXSHKAU type=write size=100733 2024-09-12T00:07:21.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.100+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~JCJ3XW3GN66Q.0 size=1048576 2024-09-12T00:07:21.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.101+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~JCJ3XW3GN66Q.1 size=1048576 2024-09-12T00:07:21.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.103+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~JCJ3XW3GN66Q.2 size=185224 2024-09-12T00:07:21.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.103+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=JCJ3XW3GN66Q tag=F2HCPWFZAS12 type=write size=3330952 2024-09-12T00:07:21.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.104+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=MHD7RYRHBFLU type=del 2024-09-12T00:07:21.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.105+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=X20JXK9VBAOE type=del size=235029 2024-09-12T00:07:21.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.107+0000 7f82f8930780 1 < completed write operation key=4IA4918NXXJW tag=4PDMHKQUDOAO type=write size=664802 2024-09-12T00:07:21.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.110+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~5T2488RGPQUD.0 size=1048576 2024-09-12T00:07:21.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.111+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~5T2488RGPQUD.1 size=1048576 2024-09-12T00:07:21.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.112+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~5T2488RGPQUD.2 size=235562 2024-09-12T00:07:21.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.112+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=5T2488RGPQUD tag=7D5HDQR90F5T type=write size=3381290 2024-09-12T00:07:21.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.113+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=V1FIQ0E7Y4YA type=del 2024-09-12T00:07:21.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.115+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=GVBXBXS0PU5W type=del size=693823 2024-09-12T00:07:21.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.116+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~L130DQZLWZXR.0 size=532457 2024-09-12T00:07:21.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.118+0000 7f82f8930780 1 < completed multipart upload key=W8SAQZWQHY36 upload=L130DQZLWZXR tag=K28V611BHI2J type=write size=1581033 2024-09-12T00:07:21.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.121+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~AIANDVJE21R8.0 size=1048576 2024-09-12T00:07:21.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.122+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~AIANDVJE21R8.1 size=879337 2024-09-12T00:07:21.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.122+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=AIANDVJE21R8 tag=55O0UR888VQO type=write size=2976489 2024-09-12T00:07:21.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.124+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=PPNMY96CUNSP type=del 2024-09-12T00:07:21.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.125+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=HXYKT1CPTHQV type=del size=1282408 2024-09-12T00:07:21.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.127+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~XFP2VZBLQ0N7.0 size=815174 2024-09-12T00:07:21.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.129+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=XFP2VZBLQ0N7 tag=F1WZPKWPFHZT type=write size=1863750 2024-09-12T00:07:21.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.130+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=IAK0U5AQAFCH type=del size=146491 2024-09-12T00:07:21.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.132+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~CWKK1CATFSJN.0 size=1048576 2024-09-12T00:07:21.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.133+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~CWKK1CATFSJN.1 size=1048576 2024-09-12T00:07:21.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.134+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~CWKK1CATFSJN.2 size=564799 2024-09-12T00:07:21.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.137+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=CWKK1CATFSJN tag=O313B4IVQ7X5 type=write size=3710527 2024-09-12T00:07:21.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.140+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~81IZ0HA3Z2LI.0 size=1048576 2024-09-12T00:07:21.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.140+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~81IZ0HA3Z2LI.1 size=895304 2024-09-12T00:07:21.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.140+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=81IZ0HA3Z2LI tag=5ZXRGELVBW7Z type=write size=2992456 2024-09-12T00:07:21.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.143+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=Y6JF0S72WTW3 type=del 2024-09-12T00:07:21.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.143+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=UMF1CSGHSULE type=del size=1995684 2024-09-12T00:07:21.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.145+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~TL5Q2UVYXL1L.0 size=246843 2024-09-12T00:07:21.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.147+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=TL5Q2UVYXL1L tag=GGFORM4WPIKU type=write size=1295419 2024-09-12T00:07:21.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.150+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~T7QLY68RA4RY.0 size=893855 2024-09-12T00:07:21.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.150+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=T7QLY68RA4RY tag=XUG1C7D8XQR1 type=write size=1942431 2024-09-12T00:07:21.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.151+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~O610DEN5276K.0 size=1048576 2024-09-12T00:07:21.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.152+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~O610DEN5276K.1 size=433309 2024-09-12T00:07:21.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.154+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=O610DEN5276K tag=5CTKAT17DUDK type=write size=2530461 2024-09-12T00:07:21.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.155+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=M9SGZ8B9754W type=del size=2749435 2024-09-12T00:07:21.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.157+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=GT3WX3XUVMZ0 type=del 2024-09-12T00:07:21.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.158+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=KS0I4B4CDY29 type=write size=304253 2024-09-12T00:07:21.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.160+0000 7f82f8930780 1 < completed write operation key=4SPRDO097JYQ tag=1L6ORG67IKO2 type=write size=993524 2024-09-12T00:07:21.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.161+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=WDM2P6ZS6AZ5 type=del size=3469374 2024-09-12T00:07:21.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.162+0000 7f82f8930780 1 < completed write operation key=O2ZGU2KOTUOT tag=9SA9UKPESJIZ type=write size=874596 2024-09-12T00:07:21.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.164+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=ECC22G2GL7Y5 type=write size=51018 2024-09-12T00:07:21.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.165+0000 7f82f8930780 1 < canceled operation key=QB46N36A27QH tag=S3NXKJ9Q8VUU type=del size=2250020 2024-09-12T00:07:21.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.166+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=GU5P5TMIQRR1 type=del size=2337262 2024-09-12T00:07:21.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.168+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=663Y5WNC04SW type=del 2024-09-12T00:07:21.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.169+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=RNRZCQL16QD4 type=write size=539675 2024-09-12T00:07:21.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.171+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~JCJ3XW3GN66Q.0 size=1048576 2024-09-12T00:07:21.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.173+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~JCJ3XW3GN66Q.1 size=1048576 2024-09-12T00:07:21.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.173+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~JCJ3XW3GN66Q.2 size=185224 2024-09-12T00:07:21.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.175+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=JCJ3XW3GN66Q tag=F2HCPWFZAS12 type=write size=3330952 2024-09-12T00:07:21.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.177+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=TSGQA9V4GBQI type=del size=2463070 2024-09-12T00:07:21.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.179+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=X20JXK9VBAOE type=del 2024-09-12T00:07:21.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.180+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=VUPQGT7IAF3O type=del size=2229569 2024-09-12T00:07:21.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.181+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~5T2488RGPQUD.0 size=1048576 2024-09-12T00:07:21.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.183+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~5T2488RGPQUD.1 size=1048576 2024-09-12T00:07:21.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.183+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~5T2488RGPQUD.2 size=235562 2024-09-12T00:07:21.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.186+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=5T2488RGPQUD tag=7D5HDQR90F5T type=write size=3381290 2024-09-12T00:07:21.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.187+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=TO3TBS3F4S0W type=del size=184166 2024-09-12T00:07:21.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.190+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=GVBXBXS0PU5W type=del 2024-09-12T00:07:21.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.191+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~Q0AFGJTG20LC.0 size=1048576 2024-09-12T00:07:21.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.192+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~Q0AFGJTG20LC.1 size=687186 2024-09-12T00:07:21.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.192+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=Q0AFGJTG20LC tag=NVQEMNXE85XR type=write size=2784338 2024-09-12T00:07:21.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.194+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~AIANDVJE21R8.0 size=1048576 2024-09-12T00:07:21.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.195+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~AIANDVJE21R8.1 size=879337 2024-09-12T00:07:21.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.197+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=AIANDVJE21R8 tag=55O0UR888VQO type=write size=2976489 2024-09-12T00:07:21.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.198+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=D606T1RREX4G type=del size=1533254 2024-09-12T00:07:21.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.199+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=HXYKT1CPTHQV type=del 2024-09-12T00:07:21.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.202+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~K0W6EPY4K8QA.0 size=1048576 2024-09-12T00:07:21.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.203+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~K0W6EPY4K8QA.1 size=107135 2024-09-12T00:07:21.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.203+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=K0W6EPY4K8QA tag=I6CH2H6C8Y3P type=write size=2204287 2024-09-12T00:07:21.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.204+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=IAK0U5AQAFCH type=del 2024-09-12T00:07:21.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.206+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=5SFUIEHG71F1 type=del size=3923990 2024-09-12T00:07:21.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.207+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~81IZ0HA3Z2LI.0 size=1048576 2024-09-12T00:07:21.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.208+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~81IZ0HA3Z2LI.1 size=895304 2024-09-12T00:07:21.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.211+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=81IZ0HA3Z2LI tag=5ZXRGELVBW7Z type=write size=2992456 2024-09-12T00:07:21.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.213+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~9E7UU2W34GRK.0 size=1048576 2024-09-12T00:07:21.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.214+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~9E7UU2W34GRK.1 size=731875 2024-09-12T00:07:21.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.214+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=9E7UU2W34GRK tag=HGUYHZDFD1T3 type=write size=2829027 2024-09-12T00:07:21.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.215+0000 7f82f8930780 1 < canceled operation key=LAKJS79KNBY7 tag=UMF1CSGHSULE type=del size=1995684 2024-09-12T00:07:21.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.217+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=3T75DRCG5NCQ type=del size=2542238 2024-09-12T00:07:21.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.218+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~T7QLY68RA4RY.0 size=893855 2024-09-12T00:07:21.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.221+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=T7QLY68RA4RY tag=XUG1C7D8XQR1 type=write size=1942431 2024-09-12T00:07:21.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.222+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=H7AUMYARTT28 type=del size=1961879 2024-09-12T00:07:21.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.223+0000 7f82f8930780 1 < canceled operation key=IN8Y7I0HKP6D tag=M9SGZ8B9754W type=del size=2749435 2024-09-12T00:07:21.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.225+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=1KD87Y79SOMK type=del size=2277810 2024-09-12T00:07:21.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.227+0000 7f82f8930780 1 < completed write operation key=O2ZGU2KOTUOT tag=KS0I4B4CDY29 type=write size=304253 2024-09-12T00:07:21.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.230+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~51V6YIAXIDCW.0 size=402992 2024-09-12T00:07:21.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.230+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=51V6YIAXIDCW tag=VY5YVE3X27CQ type=write size=1451568 2024-09-12T00:07:21.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.233+0000 7f82f8930780 1 < suggested remove operation key=OC61OW2M7ZEI tag=WDM2P6ZS6AZ5 type=del 2024-09-12T00:07:21.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.236+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~MTB1F2KW04ZT.0 size=1048576 2024-09-12T00:07:21.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.237+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~MTB1F2KW04ZT.1 size=168138 2024-09-12T00:07:21.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.237+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=MTB1F2KW04ZT tag=4E1TE1990EPQ type=write size=2265290 2024-09-12T00:07:21.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.238+0000 7f82f8930780 1 < completed write operation key=2XM2CF1T4VGW tag=ECC22G2GL7Y5 type=write size=51018 2024-09-12T00:07:21.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.240+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=3U8D6XPLSUZP type=write size=874918 2024-09-12T00:07:21.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.242+0000 7f82f8930780 1 < canceled operation key=FOWSB9RQ5TV5 tag=GU5P5TMIQRR1 type=del size=2337262 2024-09-12T00:07:21.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.244+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=XP9PACS210AB type=del size=2425367 2024-09-12T00:07:21.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.244+0000 7f82f8930780 1 < completed write operation key=X3PCR8TCWDTK tag=RNRZCQL16QD4 type=write size=539675 2024-09-12T00:07:21.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.247+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~QQMGEUHD2RHJ.0 size=1048576 2024-09-12T00:07:21.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.248+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~QQMGEUHD2RHJ.1 size=1048576 2024-09-12T00:07:21.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.250+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~QQMGEUHD2RHJ.2 size=66239 2024-09-12T00:07:21.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.250+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=QQMGEUHD2RHJ tag=T9KIE3C7HIBF type=write size=3211967 2024-09-12T00:07:21.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.250+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=TSGQA9V4GBQI type=del 2024-09-12T00:07:21.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.252+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=GRH30T4T8GXI type=del size=2650145 2024-09-12T00:07:21.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.254+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=VUPQGT7IAF3O type=del 2024-09-12T00:07:21.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.255+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=HXJZBX08PWFF type=del size=2673017 2024-09-12T00:07:21.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.258+0000 7f82f8930780 1 < suggested update operation key=YWC5JUV5B2N6 tag=TO3TBS3F4S0W type=del size=184166 2024-09-12T00:07:21.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.260+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=UMM6AM0D7BKI type=del size=3356159 2024-09-12T00:07:21.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.262+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~Q0AFGJTG20LC.0 size=1048576 2024-09-12T00:07:21.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.263+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~Q0AFGJTG20LC.1 size=687186 2024-09-12T00:07:21.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.265+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=Q0AFGJTG20LC tag=NVQEMNXE85XR type=write size=2784338 2024-09-12T00:07:21.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.267+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=O23J3MMFKAKC type=del size=3171062 2024-09-12T00:07:21.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.268+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=D606T1RREX4G type=del 2024-09-12T00:07:21.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.272+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=G1DDQF86SQ1H type=del size=3509302 2024-09-12T00:07:21.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.274+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~K0W6EPY4K8QA.0 size=1048576 2024-09-12T00:07:21.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.274+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~K0W6EPY4K8QA.1 size=107135 2024-09-12T00:07:21.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.276+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=K0W6EPY4K8QA tag=I6CH2H6C8Y3P type=write size=2204287 2024-09-12T00:07:21.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.278+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=11196UHAALLU type=del size=606135 2024-09-12T00:07:21.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.279+0000 7f82f8930780 -1 < failed to complete operation key=OC61OW2M7ZEI tag=5SFUIEHG71F1 type=del size=3923990: (22) Invalid argument 2024-09-12T00:07:21.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.282+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~34OKHD2N3PVY.0 size=1048576 2024-09-12T00:07:21.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.283+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~34OKHD2N3PVY.1 size=1048576 2024-09-12T00:07:21.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.285+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~34OKHD2N3PVY.2 size=553946 2024-09-12T00:07:21.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.285+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=34OKHD2N3PVY tag=ZAT3BIKV5R6P type=write size=3699674 2024-09-12T00:07:21.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.285+0000 7f82f8930780 1 < canceled part key=_multipart_2XM2CF1T4VGW.2~9E7UU2W34GRK.0 size=1048576 2024-09-12T00:07:21.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.286+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~9E7UU2W34GRK.1 size=731875 2024-09-12T00:07:21.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.289+0000 7f82f8930780 1 < canceled multipart upload key=2XM2CF1T4VGW upload=9E7UU2W34GRK tag=HGUYHZDFD1T3 type=write size=2829027 2024-09-12T00:07:21.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.291+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=3741TITMMBP7 type=del size=2982431 2024-09-12T00:07:21.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.292+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=3T75DRCG5NCQ type=del 2024-09-12T00:07:21.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.294+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=SF3VPP31764P type=del size=1043326 2024-09-12T00:07:21.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.295+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=H7AUMYARTT28 type=del 2024-09-12T00:07:21.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.297+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=L9ENS35VKO0V type=del size=3032330 2024-09-12T00:07:21.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.301+0000 7f82f8930780 1 < suggested update operation key=77SDZHCSP0E3 tag=1KD87Y79SOMK type=del size=2277810 2024-09-12T00:07:21.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.303+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~23RCV6HLCP7L.0 size=1048576 2024-09-12T00:07:21.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.304+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~23RCV6HLCP7L.1 size=1048576 2024-09-12T00:07:21.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.305+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~23RCV6HLCP7L.2 size=7101 2024-09-12T00:07:21.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.305+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=23RCV6HLCP7L tag=UWJ377RLIB4I type=write size=3152829 2024-09-12T00:07:21.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.306+0000 7f82f8930780 1 < canceled part key=_multipart_Y5U8MO9TOJQQ.2~51V6YIAXIDCW.0 size=402992 2024-09-12T00:07:21.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.308+0000 7f82f8930780 1 < canceled multipart upload key=Y5U8MO9TOJQQ upload=51V6YIAXIDCW tag=VY5YVE3X27CQ type=write size=1451568 2024-09-12T00:07:21.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.312+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~8I1JM9ZJA7B8.0 size=1048576 2024-09-12T00:07:21.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.313+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~8I1JM9ZJA7B8.1 size=79337 2024-09-12T00:07:21.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.313+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=8I1JM9ZJA7B8 tag=FW9W16S4CWEG type=write size=2176489 2024-09-12T00:07:21.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.314+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~MTB1F2KW04ZT.0 size=1048576 2024-09-12T00:07:21.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.315+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~MTB1F2KW04ZT.1 size=168138 2024-09-12T00:07:21.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.318+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=MTB1F2KW04ZT tag=4E1TE1990EPQ type=write size=2265290 2024-09-12T00:07:21.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.319+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=FHIPJ45LGZSF type=del size=65068 2024-09-12T00:07:21.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.323+0000 7f82f8930780 1 < suggested remove operation key=FHQADENLR6GP tag=3U8D6XPLSUZP type=write 2024-09-12T00:07:21.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.324+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=WWH7CP3HFHP1 type=del size=146154 2024-09-12T00:07:21.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.326+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=XP9PACS210AB type=del 2024-09-12T00:07:21.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.329+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~ZGKDPCRE16R0.0 size=543659 2024-09-12T00:07:21.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.329+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=ZGKDPCRE16R0 tag=EMBGDGXOPAGA type=write size=1592235 2024-09-12T00:07:21.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.330+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~QQMGEUHD2RHJ.0 size=1048576 2024-09-12T00:07:21.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.331+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~QQMGEUHD2RHJ.1 size=1048576 2024-09-12T00:07:21.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.333+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~QQMGEUHD2RHJ.2 size=66239 2024-09-12T00:07:21.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.335+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=QQMGEUHD2RHJ tag=T9KIE3C7HIBF type=write size=3211967 2024-09-12T00:07:21.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.338+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~OI2LUJLNQQR0.0 size=989330 2024-09-12T00:07:21.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.338+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=OI2LUJLNQQR0 tag=2FCS22DI8D19 type=write size=2037906 2024-09-12T00:07:21.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.338+0000 7f82f8930780 -1 < no bi entry to suggest for operation key=FHQADENLR6GP tag=GRH30T4T8GXI type=del size=2650145: (2) No such file or directory 2024-09-12T00:07:21.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.339+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=EW9Q2JQJ5JRM type=write size=822768 2024-09-12T00:07:21.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.341+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=HXJZBX08PWFF type=del 2024-09-12T00:07:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.342+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=HOR5DP5BR716 type=del size=2566569 2024-09-12T00:07:21.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.344+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=UMM6AM0D7BKI type=del 2024-09-12T00:07:21.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.345+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=58G005AATHDU type=del size=539326 2024-09-12T00:07:21.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.346+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=O23J3MMFKAKC type=del 2024-09-12T00:07:21.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.348+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=8NQ3BKS3S38G type=del size=3235834 2024-09-12T00:07:21.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.349+0000 7f82f8930780 -1 < failed to complete operation key=77SDZHCSP0E3 tag=G1DDQF86SQ1H type=del size=3509302: (22) Invalid argument 2024-09-12T00:07:21.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.351+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=1CVPYVL8V40F type=del size=1519224 2024-09-12T00:07:21.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.353+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=11196UHAALLU type=del 2024-09-12T00:07:21.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.353+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=33Q4LFKSP2BZ type=del size=3841773 2024-09-12T00:07:21.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.355+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~34OKHD2N3PVY.0 size=1048576 2024-09-12T00:07:21.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.356+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~34OKHD2N3PVY.1 size=1048576 2024-09-12T00:07:21.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.357+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~34OKHD2N3PVY.2 size=553946 2024-09-12T00:07:21.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.360+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=34OKHD2N3PVY tag=ZAT3BIKV5R6P type=write size=3699674 2024-09-12T00:07:21.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.362+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~EIVNG0PU6D52.0 size=1048576 2024-09-12T00:07:21.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.363+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~EIVNG0PU6D52.1 size=228551 2024-09-12T00:07:21.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.363+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=EIVNG0PU6D52 tag=8JVOM5DKE81L type=write size=2325703 2024-09-12T00:07:21.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.366+0000 7f82f8930780 1 < suggested update operation key=4IA4918NXXJW tag=3741TITMMBP7 type=del size=2982431 2024-09-12T00:07:21.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.367+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=D3V1JSMDO39L type=del size=1496805 2024-09-12T00:07:21.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.370+0000 7f82f8930780 1 < suggested update operation key=4IA4918NXXJW tag=SF3VPP31764P type=del size=1043326 2024-09-12T00:07:21.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.371+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=BG3JAIRXN1HN type=del size=802911 2024-09-12T00:07:21.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.373+0000 7f82f8930780 1 < canceled operation key=IMAT4ZCLGFRN tag=L9ENS35VKO0V type=del size=3032330 2024-09-12T00:07:21.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.374+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=K54QKU7XAOKG type=del size=729598 2024-09-12T00:07:21.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.376+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~23RCV6HLCP7L.0 size=1048576 2024-09-12T00:07:21.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.377+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~23RCV6HLCP7L.1 size=1048576 2024-09-12T00:07:21.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.378+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~23RCV6HLCP7L.2 size=7101 2024-09-12T00:07:21.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.381+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=23RCV6HLCP7L tag=UWJ377RLIB4I type=write size=3152829 2024-09-12T00:07:21.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.383+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~VIZXE7TOKPEM.0 size=1048576 2024-09-12T00:07:21.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.384+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~VIZXE7TOKPEM.1 size=461632 2024-09-12T00:07:21.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.384+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=VIZXE7TOKPEM tag=QHV1VEJF0XWK type=write size=2558784 2024-09-12T00:07:21.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.386+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~8I1JM9ZJA7B8.0 size=1048576 2024-09-12T00:07:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.388+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~8I1JM9ZJA7B8.1 size=79337 2024-09-12T00:07:21.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.390+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=8I1JM9ZJA7B8 tag=FW9W16S4CWEG type=write size=2176489 2024-09-12T00:07:21.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.392+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~2SVFS0RPHKRS.0 size=786949 2024-09-12T00:07:21.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.392+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=2SVFS0RPHKRS tag=E7UH3THV2OH8 type=write size=1835525 2024-09-12T00:07:21.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.393+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=FHIPJ45LGZSF type=del 2024-09-12T00:07:21.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.395+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=GCRV7M2PL3VZ type=del size=2054394 2024-09-12T00:07:21.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.396+0000 7f82f8930780 1 < canceled operation key=BJHGNT3HBS25 tag=WWH7CP3HFHP1 type=del size=146154 2024-09-12T00:07:21.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.398+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~JU5C3TM2YH2S.0 size=917642 2024-09-12T00:07:21.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.398+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=JU5C3TM2YH2S tag=USQKS82X10O9 type=write size=1966218 2024-09-12T00:07:21.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.400+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~ZGKDPCRE16R0.0 size=543659 2024-09-12T00:07:21.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.402+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=ZGKDPCRE16R0 tag=EMBGDGXOPAGA type=write size=1592235 2024-09-12T00:07:21.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.404+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~ZLCM7FXI7F4J.0 size=1024645 2024-09-12T00:07:21.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.404+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=ZLCM7FXI7F4J tag=JOWUQPWWGWTG type=write size=2073221 2024-09-12T00:07:21.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.406+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~OI2LUJLNQQR0.0 size=989330 2024-09-12T00:07:21.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.409+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=OI2LUJLNQQR0 tag=2FCS22DI8D19 type=write size=2037906 2024-09-12T00:07:21.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.410+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=77SR2BKNVO7C type=del size=3364537 2024-09-12T00:07:21.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.412+0000 7f82f8930780 1 < completed write operation key=FOWSB9RQ5TV5 tag=EW9Q2JQJ5JRM type=write size=822768 2024-09-12T00:07:21.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.414+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=IY0ZMGL24BRW type=del size=612188 2024-09-12T00:07:21.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.415+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=HOR5DP5BR716 type=del 2024-09-12T00:07:21.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.418+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~DSFFGWMS0QGD.0 size=1048576 2024-09-12T00:07:21.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.419+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~DSFFGWMS0QGD.1 size=96994 2024-09-12T00:07:21.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.419+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=DSFFGWMS0QGD tag=1PFJNCH0J2AH type=write size=2194146 2024-09-12T00:07:21.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.420+0000 7f82f8930780 1 < completed delete operation key=FOWSB9RQ5TV5 tag=58G005AATHDU type=del 2024-09-12T00:07:21.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.422+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=J0UAJ2IDKQ1U type=del size=1717767 2024-09-12T00:07:21.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.423+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=8NQ3BKS3S38G type=del 2024-09-12T00:07:21.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.425+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=J6T7HE3ZN10K type=write size=87611 2024-09-12T00:07:21.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.427+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=1CVPYVL8V40F type=del 2024-09-12T00:07:21.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.429+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~D02CPN085NE8.0 size=1048576 2024-09-12T00:07:21.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.431+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~D02CPN085NE8.1 size=509074 2024-09-12T00:07:21.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.431+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=D02CPN085NE8 tag=4EP4ZMPOVYPZ type=write size=2606226 2024-09-12T00:07:21.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.433+0000 7f82f8930780 1 < canceled operation key=9576W9WYJUJV tag=33Q4LFKSP2BZ type=del size=3841773 2024-09-12T00:07:21.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.433+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=Q6VAP9LTDA1B type=del size=3437381 2024-09-12T00:07:21.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.434+0000 7f82f8930780 1 < canceled part key=_multipart_X3PCR8TCWDTK.2~EIVNG0PU6D52.0 size=1048576 2024-09-12T00:07:21.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.434+0000 7f82f8930780 1 < canceled part key=_multipart_X3PCR8TCWDTK.2~EIVNG0PU6D52.1 size=228551 2024-09-12T00:07:21.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.436+0000 7f82f8930780 1 < canceled multipart upload key=X3PCR8TCWDTK upload=EIVNG0PU6D52 tag=8JVOM5DKE81L type=write size=2325703 2024-09-12T00:07:21.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.440+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~S1FD2AXLFHWR.0 size=1048576 2024-09-12T00:07:21.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.441+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~S1FD2AXLFHWR.1 size=591855 2024-09-12T00:07:21.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.441+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=S1FD2AXLFHWR tag=PCW4W6K8NYK8 type=write size=2689007 2024-09-12T00:07:21.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.442+0000 7f82f8930780 1 < canceled operation key=FHQADENLR6GP tag=D3V1JSMDO39L type=del size=1496805 2024-09-12T00:07:21.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.444+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~108K5UIJ6JR9.0 size=485158 2024-09-12T00:07:21.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.444+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=108K5UIJ6JR9 tag=5GLY0QZ938HH type=write size=1533734 2024-09-12T00:07:21.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.446+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=BG3JAIRXN1HN type=del 2024-09-12T00:07:21.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.448+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~0HAPFVTYVSD3.0 size=161033 2024-09-12T00:07:21.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.448+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=0HAPFVTYVSD3 tag=B7EB8YD2T23I type=write size=1209609 2024-09-12T00:07:21.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.449+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=K54QKU7XAOKG type=del 2024-09-12T00:07:21.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.451+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=EB20IZRH5CRL type=del size=241538 2024-09-12T00:07:21.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.452+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~VIZXE7TOKPEM.0 size=1048576 2024-09-12T00:07:21.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.454+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~VIZXE7TOKPEM.1 size=461632 2024-09-12T00:07:21.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.456+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=VIZXE7TOKPEM tag=QHV1VEJF0XWK type=write size=2558784 2024-09-12T00:07:21.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.460+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~ZVF8QAIX4LXW.0 size=317459 2024-09-12T00:07:21.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.460+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=ZVF8QAIX4LXW tag=HZUNIHYC0XLU type=write size=1366035 2024-09-12T00:07:21.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.461+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~2SVFS0RPHKRS.0 size=786949 2024-09-12T00:07:21.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.464+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=2SVFS0RPHKRS tag=E7UH3THV2OH8 type=write size=1835525 2024-09-12T00:07:21.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.466+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=WFYXJRTO9P0Q type=del size=3929638 2024-09-12T00:07:21.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.467+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=GCRV7M2PL3VZ type=del 2024-09-12T00:07:21.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.470+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~W91ZWP1F48DF.0 size=974592 2024-09-12T00:07:21.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.470+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=W91ZWP1F48DF tag=NEMG304OMBBR type=write size=2023168 2024-09-12T00:07:21.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.471+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~JU5C3TM2YH2S.0 size=917642 2024-09-12T00:07:21.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.473+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=JU5C3TM2YH2S tag=USQKS82X10O9 type=write size=1966218 2024-09-12T00:07:21.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.475+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=GJJUA7LU2I7N type=del size=2774384 2024-09-12T00:07:21.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.476+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~ZLCM7FXI7F4J.0 size=1024645 2024-09-12T00:07:21.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.480+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=ZLCM7FXI7F4J tag=JOWUQPWWGWTG type=write size=2073221 2024-09-12T00:07:21.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.480+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=717Q2LYC5LC7 type=del size=957635 2024-09-12T00:07:21.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.483+0000 7f82f8930780 1 < completed delete operation key=OVJOP07M9KB8 tag=77SR2BKNVO7C type=del 2024-09-12T00:07:21.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.484+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~PZRWCC23735G.0 size=1048576 2024-09-12T00:07:21.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.485+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~PZRWCC23735G.1 size=1048576 2024-09-12T00:07:21.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.487+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~PZRWCC23735G.2 size=112481 2024-09-12T00:07:21.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.487+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=PZRWCC23735G tag=L06TPJOGZOR0 type=write size=3258209 2024-09-12T00:07:21.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.488+0000 7f82f8930780 1 < completed delete operation key=FOWSB9RQ5TV5 tag=IY0ZMGL24BRW type=del 2024-09-12T00:07:21.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.492+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~3N0IX8S2NUET.0 size=1048576 2024-09-12T00:07:21.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.492+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~3N0IX8S2NUET.1 size=840436 2024-09-12T00:07:21.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.492+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=3N0IX8S2NUET tag=Y4CI8PX81WX3 type=write size=2937588 2024-09-12T00:07:21.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.494+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~DSFFGWMS0QGD.0 size=1048576 2024-09-12T00:07:21.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.495+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~DSFFGWMS0QGD.1 size=96994 2024-09-12T00:07:21.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.498+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=DSFFGWMS0QGD tag=1PFJNCH0J2AH type=write size=2194146 2024-09-12T00:07:21.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.501+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~XAYK8SSONG9W.0 size=1048576 2024-09-12T00:07:21.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.502+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~XAYK8SSONG9W.1 size=314867 2024-09-12T00:07:21.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.502+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=XAYK8SSONG9W tag=AW3N21OW8PT3 type=write size=2412019 2024-09-12T00:07:21.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.503+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=J0UAJ2IDKQ1U type=del 2024-09-12T00:07:21.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.506+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=WANO166DN8QY type=del size=907111 2024-09-12T00:07:21.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.507+0000 7f82f8930780 1 < completed write operation key=O2ZGU2KOTUOT tag=J6T7HE3ZN10K type=write size=87611 2024-09-12T00:07:21.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.510+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~S0KC82M296AX.0 size=60353 2024-09-12T00:07:21.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.510+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=S0KC82M296AX tag=BL0KKYO6ODVM type=write size=1108929 2024-09-12T00:07:21.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.511+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~D02CPN085NE8.0 size=1048576 2024-09-12T00:07:21.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.513+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~D02CPN085NE8.1 size=509074 2024-09-12T00:07:21.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.516+0000 7f82f8930780 1 < completed multipart upload key=W8SAQZWQHY36 upload=D02CPN085NE8 tag=4EP4ZMPOVYPZ type=write size=2606226 2024-09-12T00:07:21.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.517+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=4OPTB873PET0 type=del size=240324 2024-09-12T00:07:21.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.520+0000 7f82f8930780 1 < suggested update operation key=Y5U8MO9TOJQQ tag=Q6VAP9LTDA1B type=del size=3437381 2024-09-12T00:07:21.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.522+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=0QRL3BX272NM type=write size=164868 2024-09-12T00:07:21.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.523+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~S1FD2AXLFHWR.0 size=1048576 2024-09-12T00:07:21.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.525+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~S1FD2AXLFHWR.1 size=591855 2024-09-12T00:07:21.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.528+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=S1FD2AXLFHWR tag=PCW4W6K8NYK8 type=write size=2689007 2024-09-12T00:07:21.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.531+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~BN5AK4PA4LBU.0 size=201324 2024-09-12T00:07:21.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.531+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=BN5AK4PA4LBU tag=AU292VPDCUNA type=write size=1249900 2024-09-12T00:07:21.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.533+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~108K5UIJ6JR9.0 size=485158 2024-09-12T00:07:21.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.535+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=108K5UIJ6JR9 tag=5GLY0QZ938HH type=write size=1533734 2024-09-12T00:07:21.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.539+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~WW7XOGADCIDK.0 size=1048576 2024-09-12T00:07:21.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.539+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~WW7XOGADCIDK.1 size=897334 2024-09-12T00:07:21.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.539+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=WW7XOGADCIDK tag=CKSFNZGK1V8S type=write size=2994486 2024-09-12T00:07:21.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.541+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~0HAPFVTYVSD3.0 size=161033 2024-09-12T00:07:21.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.543+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=0HAPFVTYVSD3 tag=B7EB8YD2T23I type=write size=1209609 2024-09-12T00:07:21.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.546+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~R66JQ0A3FQRR.0 size=1048576 2024-09-12T00:07:21.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.547+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~R66JQ0A3FQRR.1 size=1048576 2024-09-12T00:07:21.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.549+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~R66JQ0A3FQRR.2 size=529671 2024-09-12T00:07:21.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.549+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=R66JQ0A3FQRR tag=YD15D1WO78OJ type=write size=3675399 2024-09-12T00:07:21.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.551+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=EB20IZRH5CRL type=del 2024-09-12T00:07:21.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.553+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~3LWZESRSZNPN.0 size=509250 2024-09-12T00:07:21.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.553+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=3LWZESRSZNPN tag=FDF926MIY7IJ type=write size=1557826 2024-09-12T00:07:21.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.554+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~ZVF8QAIX4LXW.0 size=317459 2024-09-12T00:07:21.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.557+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=ZVF8QAIX4LXW tag=HZUNIHYC0XLU type=write size=1366035 2024-09-12T00:07:21.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.559+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~C1FGHWLVI765.0 size=1048576 2024-09-12T00:07:21.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.561+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~C1FGHWLVI765.1 size=472096 2024-09-12T00:07:21.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.561+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=C1FGHWLVI765 tag=HPOFVU8E5MPQ type=write size=2569248 2024-09-12T00:07:21.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.564+0000 7f82f8930780 1 < suggested update operation key=G55HN1VD6X47 tag=WFYXJRTO9P0Q type=del size=3929638 2024-09-12T00:07:21.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.565+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=VK6BRCI2LAFM type=del size=2058123 2024-09-12T00:07:21.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.566+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~W91ZWP1F48DF.0 size=974592 2024-09-12T00:07:21.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.569+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=W91ZWP1F48DF tag=NEMG304OMBBR type=write size=2023168 2024-09-12T00:07:21.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.570+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=V3BS2BZL5QDH type=write size=573437 2024-09-12T00:07:21.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.572+0000 7f82f8930780 1 < completed delete operation key=HCK59C6MAW0B tag=GJJUA7LU2I7N type=del 2024-09-12T00:07:21.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.574+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=QZTCCD1GI4C5 type=write size=922593 2024-09-12T00:07:21.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.575+0000 7f82f8930780 1 < completed delete operation key=9576W9WYJUJV tag=717Q2LYC5LC7 type=del 2024-09-12T00:07:21.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.577+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=S4NROB4NFF5F type=write size=1013795 2024-09-12T00:07:21.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.578+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~PZRWCC23735G.0 size=1048576 2024-09-12T00:07:21.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.580+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~PZRWCC23735G.1 size=1048576 2024-09-12T00:07:21.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.581+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~PZRWCC23735G.2 size=112481 2024-09-12T00:07:21.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.584+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=PZRWCC23735G tag=L06TPJOGZOR0 type=write size=3258209 2024-09-12T00:07:21.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.587+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~6UAMNFKQDTQ4.0 size=1048576 2024-09-12T00:07:21.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.589+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~6UAMNFKQDTQ4.1 size=1048576 2024-09-12T00:07:21.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.589+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~6UAMNFKQDTQ4.2 size=646819 2024-09-12T00:07:21.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.589+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=6UAMNFKQDTQ4 tag=8VOYJSG9U6Y0 type=write size=3792547 2024-09-12T00:07:21.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.591+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~3N0IX8S2NUET.0 size=1048576 2024-09-12T00:07:21.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.592+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~3N0IX8S2NUET.1 size=840436 2024-09-12T00:07:21.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.595+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=3N0IX8S2NUET tag=Y4CI8PX81WX3 type=write size=2937588 2024-09-12T00:07:21.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.596+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=KCFVJL6WXOBE type=del size=1395304 2024-09-12T00:07:21.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.598+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~XAYK8SSONG9W.0 size=1048576 2024-09-12T00:07:21.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.599+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~XAYK8SSONG9W.1 size=314867 2024-09-12T00:07:21.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.601+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=XAYK8SSONG9W tag=AW3N21OW8PT3 type=write size=2412019 2024-09-12T00:07:21.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.603+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=EVTPL8QN46UU type=del size=3837896 2024-09-12T00:07:21.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.604+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=WANO166DN8QY type=del 2024-09-12T00:07:21.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.607+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~OYHKO0X64H8H.0 size=322808 2024-09-12T00:07:21.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.607+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=OYHKO0X64H8H tag=MZT671NX0XYG type=write size=1371384 2024-09-12T00:07:21.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.608+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~S0KC82M296AX.0 size=60353 2024-09-12T00:07:21.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.611+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=S0KC82M296AX tag=BL0KKYO6ODVM type=write size=1108929 2024-09-12T00:07:21.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.613+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~EH6JSED2FYPJ.0 size=323057 2024-09-12T00:07:21.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.613+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=EH6JSED2FYPJ tag=UUKZ9KEACOK1 type=write size=1371633 2024-09-12T00:07:21.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.615+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=4OPTB873PET0 type=del 2024-09-12T00:07:21.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.617+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~P9VHE2VJC0U1.0 size=651521 2024-09-12T00:07:21.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.617+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=P9VHE2VJC0U1 tag=L0O6YV3ZY363 type=write size=1700097 2024-09-12T00:07:21.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.620+0000 7f82f8930780 1 < suggested update operation key=77SDZHCSP0E3 tag=0QRL3BX272NM type=write size=164868 2024-09-12T00:07:21.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.621+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=O6RMVQ2ZEDCR type=del size=2785068 2024-09-12T00:07:21.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.623+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~BN5AK4PA4LBU.0 size=201324 2024-09-12T00:07:21.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.625+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=BN5AK4PA4LBU tag=AU292VPDCUNA type=write size=1249900 2024-09-12T00:07:21.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.626+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=SI5ROVRK27Q0 type=write size=1012625 2024-09-12T00:07:21.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.628+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~WW7XOGADCIDK.0 size=1048576 2024-09-12T00:07:21.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.629+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~WW7XOGADCIDK.1 size=897334 2024-09-12T00:07:21.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.632+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=WW7XOGADCIDK tag=CKSFNZGK1V8S type=write size=2994486 2024-09-12T00:07:21.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.635+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~DFGADDT1WW72.0 size=1048576 2024-09-12T00:07:21.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.636+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~DFGADDT1WW72.1 size=1048576 2024-09-12T00:07:21.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.636+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~DFGADDT1WW72.2 size=630371 2024-09-12T00:07:21.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.636+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=DFGADDT1WW72 tag=3XN4X9LO9CJN type=write size=3776099 2024-09-12T00:07:21.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.638+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~R66JQ0A3FQRR.0 size=1048576 2024-09-12T00:07:21.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.639+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~R66JQ0A3FQRR.1 size=1048576 2024-09-12T00:07:21.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.640+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~R66JQ0A3FQRR.2 size=529671 2024-09-12T00:07:21.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.642+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=R66JQ0A3FQRR tag=YD15D1WO78OJ type=write size=3675399 2024-09-12T00:07:21.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.645+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=BLIV3RMUCVIM type=del size=2699874 2024-09-12T00:07:21.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.645+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~3LWZESRSZNPN.0 size=509250 2024-09-12T00:07:21.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.648+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=3LWZESRSZNPN tag=FDF926MIY7IJ type=write size=1557826 2024-09-12T00:07:21.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.650+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~VAAJ9WIIZVJC.0 size=1028747 2024-09-12T00:07:21.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.650+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=VAAJ9WIIZVJC tag=3HAWMBWGHJXK type=write size=2077323 2024-09-12T00:07:21.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.651+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~C1FGHWLVI765.0 size=1048576 2024-09-12T00:07:21.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.653+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~C1FGHWLVI765.1 size=472096 2024-09-12T00:07:21.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.655+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=C1FGHWLVI765 tag=HPOFVU8E5MPQ type=write size=2569248 2024-09-12T00:07:21.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.658+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~OVBOLH1RWNCQ.0 size=528255 2024-09-12T00:07:21.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.658+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=OVBOLH1RWNCQ tag=SCXAS4K2K7TD type=write size=1576831 2024-09-12T00:07:21.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.661+0000 7f82f8930780 1 < suggested update operation key=4IA4918NXXJW tag=VK6BRCI2LAFM type=del size=2058123 2024-09-12T00:07:21.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.662+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=3ZHKZXLJJV4K type=del size=3943478 2024-09-12T00:07:21.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.664+0000 7f82f8930780 1 < canceled operation key=LAKJS79KNBY7 tag=V3BS2BZL5QDH type=write size=573437 2024-09-12T00:07:21.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.665+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=MD1QDBE4WGX6 type=write size=427548 2024-09-12T00:07:21.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.666+0000 7f82f8930780 1 < completed write operation key=OVJOP07M9KB8 tag=QZTCCD1GI4C5 type=write size=922593 2024-09-12T00:07:21.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.670+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~PL9WBOCBY7ZC.0 size=689538 2024-09-12T00:07:21.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.670+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=PL9WBOCBY7ZC tag=8X402CGMST8Z type=write size=1738114 2024-09-12T00:07:21.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.672+0000 7f82f8930780 1 < suggested update operation key=4IA4918NXXJW tag=S4NROB4NFF5F type=write size=1013795 2024-09-12T00:07:21.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.673+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=RHMZWT6F85D0 type=del size=287347 2024-09-12T00:07:21.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.675+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~6UAMNFKQDTQ4.0 size=1048576 2024-09-12T00:07:21.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.676+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~6UAMNFKQDTQ4.1 size=1048576 2024-09-12T00:07:21.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.676+0000 7f82f8930780 1 < canceled part key=_multipart_OC61OW2M7ZEI.2~6UAMNFKQDTQ4.2 size=646819 2024-09-12T00:07:21.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.678+0000 7f82f8930780 1 < canceled multipart upload key=OC61OW2M7ZEI upload=6UAMNFKQDTQ4 tag=8VOYJSG9U6Y0 type=write size=3792547 2024-09-12T00:07:21.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.680+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~E59PNJU1YA4F.0 size=1048576 2024-09-12T00:07:21.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.683+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~E59PNJU1YA4F.1 size=1048576 2024-09-12T00:07:21.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.684+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~E59PNJU1YA4F.2 size=876648 2024-09-12T00:07:21.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.684+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=E59PNJU1YA4F tag=MFDUCDRWJ0YJ type=write size=4022376 2024-09-12T00:07:21.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.685+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=KCFVJL6WXOBE type=del 2024-09-12T00:07:21.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.688+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~AE48RX3Z0JLO.0 size=1048576 2024-09-12T00:07:21.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.690+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~AE48RX3Z0JLO.1 size=513258 2024-09-12T00:07:21.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.690+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=AE48RX3Z0JLO tag=2XQFSW891TF7 type=write size=2610410 2024-09-12T00:07:21.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.691+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=EVTPL8QN46UU type=del 2024-09-12T00:07:21.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.693+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=NX9Z9NB7O8U4 type=del size=805250 2024-09-12T00:07:21.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.693+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~OYHKO0X64H8H.0 size=322808 2024-09-12T00:07:21.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.696+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=OYHKO0X64H8H tag=MZT671NX0XYG type=write size=1371384 2024-09-12T00:07:21.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.697+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=2WTF4LI54KJE type=del size=57848 2024-09-12T00:07:21.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.698+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~EH6JSED2FYPJ.0 size=323057 2024-09-12T00:07:21.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.701+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=EH6JSED2FYPJ tag=UUKZ9KEACOK1 type=write size=1371633 2024-09-12T00:07:21.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.703+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~D7LRA4KRYUYA.0 size=1048576 2024-09-12T00:07:21.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.705+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~D7LRA4KRYUYA.1 size=1048576 2024-09-12T00:07:21.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.705+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~D7LRA4KRYUYA.2 size=221676 2024-09-12T00:07:21.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.705+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=D7LRA4KRYUYA tag=QJSF4I3HVMRO type=write size=3367404 2024-09-12T00:07:21.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.707+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~P9VHE2VJC0U1.0 size=651521 2024-09-12T00:07:21.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.709+0000 7f82f8930780 1 < completed multipart upload key=Y5U8MO9TOJQQ upload=P9VHE2VJC0U1 tag=L0O6YV3ZY363 type=write size=1700097 2024-09-12T00:07:21.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.711+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~PA766BIDR60V.0 size=1048576 2024-09-12T00:07:21.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.713+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~PA766BIDR60V.1 size=62281 2024-09-12T00:07:21.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.713+0000 7f82f8930780 1 > prepared multipart upload key=77SDZHCSP0E3 upload=PA766BIDR60V tag=CHQN43EWKEG0 type=write size=2159433 2024-09-12T00:07:21.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.715+0000 7f82f8930780 1 < suggested update operation key=FHQADENLR6GP tag=O6RMVQ2ZEDCR type=del size=2785068 2024-09-12T00:07:21.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.717+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=AOIW5DSWGRJD type=del size=4130221 2024-09-12T00:07:21.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.718+0000 7f82f8930780 1 < completed write operation key=OVJOP07M9KB8 tag=SI5ROVRK27Q0 type=write size=1012625 2024-09-12T00:07:21.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.721+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~Q3DMNF4N83NT.0 size=1048576 2024-09-12T00:07:21.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.722+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~Q3DMNF4N83NT.1 size=1048576 2024-09-12T00:07:21.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.723+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~Q3DMNF4N83NT.2 size=630872 2024-09-12T00:07:21.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.723+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=Q3DMNF4N83NT tag=7L2DO94NETFB type=write size=3776600 2024-09-12T00:07:21.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.724+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~DFGADDT1WW72.0 size=1048576 2024-09-12T00:07:21.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.724+0000 7f82f8930780 1 < canceled part key=_multipart_3H3D067Z8O0R.2~DFGADDT1WW72.1 size=1048576 2024-09-12T00:07:21.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.724+0000 7f82f8930780 1 < canceled part key=_multipart_3H3D067Z8O0R.2~DFGADDT1WW72.2 size=630371 2024-09-12T00:07:21.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.727+0000 7f82f8930780 1 < canceled multipart upload key=3H3D067Z8O0R upload=DFGADDT1WW72 tag=3XN4X9LO9CJN type=write size=3776099 2024-09-12T00:07:21.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.728+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=FKXYCQG1TJS9 type=del size=1870374 2024-09-12T00:07:21.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.731+0000 7f82f8930780 1 < suggested update operation key=BJHGNT3HBS25 tag=BLIV3RMUCVIM type=del size=2699874 2024-09-12T00:07:21.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.733+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=BR8E2HCWHFHN type=del size=1450691 2024-09-12T00:07:21.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.733+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~VAAJ9WIIZVJC.0 size=1028747 2024-09-12T00:07:21.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.736+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=VAAJ9WIIZVJC tag=3HAWMBWGHJXK type=write size=2077323 2024-09-12T00:07:21.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.737+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=99T5515HLZQ5 type=del size=1927550 2024-09-12T00:07:21.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.739+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~OVBOLH1RWNCQ.0 size=528255 2024-09-12T00:07:21.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.742+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=OVBOLH1RWNCQ tag=SCXAS4K2K7TD type=write size=1576831 2024-09-12T00:07:21.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.743+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=WX0D82H4RI25 type=del size=2223341 2024-09-12T00:07:21.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.745+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=3ZHKZXLJJV4K type=del 2024-09-12T00:07:21.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.745+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=HLFCFJBNVUGC type=del size=2383863 2024-09-12T00:07:21.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.747+0000 7f82f8930780 1 < completed write operation key=O2ZGU2KOTUOT tag=MD1QDBE4WGX6 type=write size=427548 2024-09-12T00:07:21.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.749+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~A1FGV4Y6WFUB.0 size=1048576 2024-09-12T00:07:21.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.750+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~A1FGV4Y6WFUB.1 size=357066 2024-09-12T00:07:21.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.750+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=A1FGV4Y6WFUB tag=R61A5O7CZALH type=write size=2454218 2024-09-12T00:07:21.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.750+0000 7f82f8930780 1 < canceled part key=_multipart_X3PCR8TCWDTK.2~PL9WBOCBY7ZC.0 size=689538 2024-09-12T00:07:21.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.753+0000 7f82f8930780 1 < canceled multipart upload key=X3PCR8TCWDTK upload=PL9WBOCBY7ZC tag=8X402CGMST8Z type=write size=1738114 2024-09-12T00:07:21.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.755+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~YRSKONTJH541.0 size=1048576 2024-09-12T00:07:21.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.756+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~YRSKONTJH541.1 size=799175 2024-09-12T00:07:21.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.756+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=YRSKONTJH541 tag=5CQCD13I7QBV type=write size=2896327 2024-09-12T00:07:21.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.760+0000 7f82f8930780 1 < suggested remove operation key=N2TYUAJITFNL tag=RHMZWT6F85D0 type=del 2024-09-12T00:07:21.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.760+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=JM6JFQM1AZID type=del size=140384 2024-09-12T00:07:21.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.762+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~E59PNJU1YA4F.0 size=1048576 2024-09-12T00:07:21.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.764+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~E59PNJU1YA4F.1 size=1048576 2024-09-12T00:07:21.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.764+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~E59PNJU1YA4F.2 size=876648 2024-09-12T00:07:21.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.766+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=E59PNJU1YA4F tag=MFDUCDRWJ0YJ type=write size=4022376 2024-09-12T00:07:21.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.768+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=E18WULTJYBSO type=write size=165969 2024-09-12T00:07:21.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.769+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~AE48RX3Z0JLO.0 size=1048576 2024-09-12T00:07:21.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.771+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~AE48RX3Z0JLO.1 size=513258 2024-09-12T00:07:21.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.774+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=AE48RX3Z0JLO tag=2XQFSW891TF7 type=write size=2610410 2024-09-12T00:07:21.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.774+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=TUMBN2EDEIJL type=del size=2002728 2024-09-12T00:07:21.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.776+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=NX9Z9NB7O8U4 type=del 2024-09-12T00:07:21.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.777+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=H6TMKQP276X5 type=del size=934266 2024-09-12T00:07:21.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.779+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=2WTF4LI54KJE type=del 2024-09-12T00:07:21.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.781+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~323OEL56O27D.0 size=1048576 2024-09-12T00:07:21.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.782+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~323OEL56O27D.1 size=336155 2024-09-12T00:07:21.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.782+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=323OEL56O27D tag=2U394JV22E53 type=write size=2433307 2024-09-12T00:07:21.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.784+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~D7LRA4KRYUYA.0 size=1048576 2024-09-12T00:07:21.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.784+0000 7f82f8930780 1 < canceled part key=_multipart_2XM2CF1T4VGW.2~D7LRA4KRYUYA.1 size=1048576 2024-09-12T00:07:21.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.785+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~D7LRA4KRYUYA.2 size=221676 2024-09-12T00:07:21.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.787+0000 7f82f8930780 1 < canceled multipart upload key=2XM2CF1T4VGW upload=D7LRA4KRYUYA tag=QJSF4I3HVMRO type=write size=3367404 2024-09-12T00:07:21.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.789+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=OG92B87A513H type=write size=558214 2024-09-12T00:07:21.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.790+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~PA766BIDR60V.0 size=1048576 2024-09-12T00:07:21.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.792+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~PA766BIDR60V.1 size=62281 2024-09-12T00:07:21.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.794+0000 7f82f8930780 1 < completed multipart upload key=77SDZHCSP0E3 upload=PA766BIDR60V tag=CHQN43EWKEG0 type=write size=2159433 2024-09-12T00:07:21.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.797+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~IQLA30X4XRF7.0 size=1048576 2024-09-12T00:07:21.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.799+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~IQLA30X4XRF7.1 size=153061 2024-09-12T00:07:21.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.799+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=IQLA30X4XRF7 tag=CO4825UEQIS6 type=write size=2250213 2024-09-12T00:07:21.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.802+0000 7f82f8930780 1 < suggested remove operation key=OC61OW2M7ZEI tag=AOIW5DSWGRJD type=del 2024-09-12T00:07:21.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.804+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~N26UILR1EL4G.0 size=925482 2024-09-12T00:07:21.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.804+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=N26UILR1EL4G tag=KIQDP4H3W0U6 type=write size=1974058 2024-09-12T00:07:21.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.805+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~Q3DMNF4N83NT.0 size=1048576 2024-09-12T00:07:21.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.806+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~Q3DMNF4N83NT.1 size=1048576 2024-09-12T00:07:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.807+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~Q3DMNF4N83NT.2 size=630872 2024-09-12T00:07:21.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.810+0000 7f82f8930780 1 < completed multipart upload key=W8SAQZWQHY36 upload=Q3DMNF4N83NT tag=7L2DO94NETFB type=write size=3776600 2024-09-12T00:07:21.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.815+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~1S4S2SPJWGSR.0 size=1048576 2024-09-12T00:07:21.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.815+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~1S4S2SPJWGSR.1 size=345258 2024-09-12T00:07:21.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.815+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=1S4S2SPJWGSR tag=NMATB31JEA0J type=write size=2442410 2024-09-12T00:07:21.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.816+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=FKXYCQG1TJS9 type=del 2024-09-12T00:07:21.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.818+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=RPZUUVKI9M2L type=del size=3203504 2024-09-12T00:07:21.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.820+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=BR8E2HCWHFHN type=del 2024-09-12T00:07:21.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.821+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=FKG4HVZXX0FY type=del size=3663755 2024-09-12T00:07:21.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.823+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=99T5515HLZQ5 type=del 2024-09-12T00:07:21.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.826+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~6XF1HIZ44LH2.0 size=1048576 2024-09-12T00:07:21.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.827+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~6XF1HIZ44LH2.1 size=658171 2024-09-12T00:07:21.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.827+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=6XF1HIZ44LH2 tag=LQJRDG5WG8BV type=write size=2755323 2024-09-12T00:07:21.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.831+0000 7f82f8930780 1 < suggested remove operation key=IMAT4ZCLGFRN tag=WX0D82H4RI25 type=del 2024-09-12T00:07:21.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.834+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~S8MZE17WXSWD.0 size=1048576 2024-09-12T00:07:21.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.834+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~S8MZE17WXSWD.1 size=1048576 2024-09-12T00:07:21.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.836+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~S8MZE17WXSWD.2 size=561360 2024-09-12T00:07:21.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.836+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=S8MZE17WXSWD tag=ESHAVDVTK8JU type=write size=3707088 2024-09-12T00:07:21.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.838+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=HLFCFJBNVUGC type=del 2024-09-12T00:07:21.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.839+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=CFJCS8LD1GKE type=del size=382334 2024-09-12T00:07:21.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.839+0000 7f82f8930780 1 < canceled part key=_multipart_OC61OW2M7ZEI.2~A1FGV4Y6WFUB.0 size=1048576 2024-09-12T00:07:21.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.840+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~A1FGV4Y6WFUB.1 size=357066 2024-09-12T00:07:21.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.843+0000 7f82f8930780 1 < canceled multipart upload key=OC61OW2M7ZEI upload=A1FGV4Y6WFUB tag=R61A5O7CZALH type=write size=2454218 2024-09-12T00:07:21.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.844+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=ARJ47RGCDP0B type=del size=857711 2024-09-12T00:07:21.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.846+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~YRSKONTJH541.0 size=1048576 2024-09-12T00:07:21.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.847+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~YRSKONTJH541.1 size=799175 2024-09-12T00:07:21.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.850+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=YRSKONTJH541 tag=5CQCD13I7QBV type=write size=2896327 2024-09-12T00:07:21.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.851+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=5HKUQ3MF1OIX type=del size=2162409 2024-09-12T00:07:21.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.853+0000 7f82f8930780 1 < canceled operation key=77SDZHCSP0E3 tag=JM6JFQM1AZID type=del size=140384 2024-09-12T00:07:21.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.854+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=PRBJQSZATXYB type=del size=2961374 2024-09-12T00:07:21.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.855+0000 7f82f8930780 1 < completed write operation key=LAKJS79KNBY7 tag=E18WULTJYBSO type=write size=165969 2024-09-12T00:07:21.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.858+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~LFZI793LZ7E9.0 size=822435 2024-09-12T00:07:21.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.858+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=LFZI793LZ7E9 tag=7G6VV3GS2LHT type=write size=1871011 2024-09-12T00:07:21.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.860+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=TUMBN2EDEIJL type=del 2024-09-12T00:07:21.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.861+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=F4O8KTJYV13K type=write size=162643 2024-09-12T00:07:21.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.863+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=H6TMKQP276X5 type=del 2024-09-12T00:07:21.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.865+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=VNORZF5ISZ0E type=del size=2364046 2024-09-12T00:07:21.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.866+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~323OEL56O27D.0 size=1048576 2024-09-12T00:07:21.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.868+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~323OEL56O27D.1 size=336155 2024-09-12T00:07:21.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.870+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=323OEL56O27D tag=2U394JV22E53 type=write size=2433307 2024-09-12T00:07:21.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.874+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~LP2T4MRVBKCO.0 size=1048576 2024-09-12T00:07:21.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.874+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~LP2T4MRVBKCO.1 size=1048576 2024-09-12T00:07:21.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.875+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~LP2T4MRVBKCO.2 size=565668 2024-09-12T00:07:21.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.875+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=LP2T4MRVBKCO tag=33HPB5ESVL0E type=write size=3711396 2024-09-12T00:07:21.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.877+0000 7f82f8930780 1 < completed write operation key=YWC5JUV5B2N6 tag=OG92B87A513H type=write size=558214 2024-09-12T00:07:21.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.878+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=Q4EZN3GN9SYU type=del size=2766076 2024-09-12T00:07:21.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.880+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~IQLA30X4XRF7.0 size=1048576 2024-09-12T00:07:21.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.880+0000 7f82f8930780 1 < canceled part key=_multipart_62X93NOS23AF.2~IQLA30X4XRF7.1 size=153061 2024-09-12T00:07:21.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.883+0000 7f82f8930780 1 < canceled multipart upload key=62X93NOS23AF upload=IQLA30X4XRF7 tag=CO4825UEQIS6 type=write size=2250213 2024-09-12T00:07:21.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.886+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~CO4YVPROIZT4.0 size=1048576 2024-09-12T00:07:21.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.887+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~CO4YVPROIZT4.1 size=567173 2024-09-12T00:07:21.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.887+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=CO4YVPROIZT4 tag=SA156KIZQ2SM type=write size=2664325 2024-09-12T00:07:21.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.889+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~N26UILR1EL4G.0 size=925482 2024-09-12T00:07:21.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.891+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=N26UILR1EL4G tag=KIQDP4H3W0U6 type=write size=1974058 2024-09-12T00:07:21.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.893+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=P8V1ZNI1B4HF type=write size=237847 2024-09-12T00:07:21.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.894+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~1S4S2SPJWGSR.0 size=1048576 2024-09-12T00:07:21.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.896+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~1S4S2SPJWGSR.1 size=345258 2024-09-12T00:07:21.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.898+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=1S4S2SPJWGSR tag=NMATB31JEA0J type=write size=2442410 2024-09-12T00:07:21.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.901+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~LSWU1DHHE5MV.0 size=1048576 2024-09-12T00:07:21.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.902+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~LSWU1DHHE5MV.1 size=141006 2024-09-12T00:07:21.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.902+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=LSWU1DHHE5MV tag=U1S0AJ3CWM3I type=write size=2238158 2024-09-12T00:07:21.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.904+0000 7f82f8930780 1 < canceled operation key=2XM2CF1T4VGW tag=RPZUUVKI9M2L type=del size=3203504 2024-09-12T00:07:21.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.905+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=LTXTJXWKYTNM type=del size=712008 2024-09-12T00:07:21.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.907+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=FKG4HVZXX0FY type=del 2024-09-12T00:07:21.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.908+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=D96OTNEUMDZE type=write size=783965 2024-09-12T00:07:21.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.910+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~6XF1HIZ44LH2.0 size=1048576 2024-09-12T00:07:21.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.911+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~6XF1HIZ44LH2.1 size=658171 2024-09-12T00:07:21.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.915+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=6XF1HIZ44LH2 tag=LQJRDG5WG8BV type=write size=2755323 2024-09-12T00:07:21.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.915+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=IHKTKU07QGAH type=del size=1343245 2024-09-12T00:07:21.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.916+0000 7f82f8930780 1 < canceled part key=_multipart_Y8GDXNDCOHCW.2~S8MZE17WXSWD.0 size=1048576 2024-09-12T00:07:21.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.917+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~S8MZE17WXSWD.1 size=1048576 2024-09-12T00:07:21.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.918+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~S8MZE17WXSWD.2 size=561360 2024-09-12T00:07:21.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.921+0000 7f82f8930780 1 < canceled multipart upload key=Y8GDXNDCOHCW upload=S8MZE17WXSWD tag=ESHAVDVTK8JU type=write size=3707088 2024-09-12T00:07:21.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.923+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~ZET9ANGDG0RY.0 size=1048576 2024-09-12T00:07:21.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.925+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~ZET9ANGDG0RY.1 size=1023785 2024-09-12T00:07:21.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.925+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=ZET9ANGDG0RY tag=75K6T75F5G02 type=write size=3120937 2024-09-12T00:07:21.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.927+0000 7f82f8930780 1 < completed delete operation key=FOWSB9RQ5TV5 tag=CFJCS8LD1GKE type=del 2024-09-12T00:07:21.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.928+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=OVQ8NPX777GW type=write size=173580 2024-09-12T00:07:21.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.931+0000 7f82f8930780 1 < suggested update operation key=HCK59C6MAW0B tag=ARJ47RGCDP0B type=del size=857711 2024-09-12T00:07:21.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.933+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=H1QSQQVYK2W7 type=del size=2966723 2024-09-12T00:07:21.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.934+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=5HKUQ3MF1OIX type=del 2024-09-12T00:07:21.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.935+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=XN3R5V03K229 type=del size=2756519 2024-09-12T00:07:21.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.937+0000 7f82f8930780 1 < canceled operation key=2XM2CF1T4VGW tag=PRBJQSZATXYB type=del size=2961374 2024-09-12T00:07:21.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.938+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=NF8UNRWI1I95 type=write size=385699 2024-09-12T00:07:21.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.940+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~LFZI793LZ7E9.0 size=822435 2024-09-12T00:07:21.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.943+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=LFZI793LZ7E9 tag=7G6VV3GS2LHT type=write size=1871011 2024-09-12T00:07:21.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.944+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=8GO88058572B type=del size=2986951 2024-09-12T00:07:21.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.946+0000 7f82f8930780 1 < completed write operation key=3X2PLA3ODHJ1 tag=F4O8KTJYV13K type=write size=162643 2024-09-12T00:07:21.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.949+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~E9MLP4DMC911.0 size=1048576 2024-09-12T00:07:21.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.951+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~E9MLP4DMC911.1 size=1048576 2024-09-12T00:07:21.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.951+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~E9MLP4DMC911.2 size=392733 2024-09-12T00:07:21.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.951+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=E9MLP4DMC911 tag=BT0GCWUS3Z2G type=write size=3538461 2024-09-12T00:07:21.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.955+0000 7f82f8930780 1 < suggested remove operation key=A8EFUP30RS65 tag=VNORZF5ISZ0E type=del 2024-09-12T00:07:21.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.957+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=8Q03FFZ0GD52 type=write size=741564 2024-09-12T00:07:21.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.959+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~LP2T4MRVBKCO.0 size=1048576 2024-09-12T00:07:21.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.960+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~LP2T4MRVBKCO.1 size=1048576 2024-09-12T00:07:21.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.960+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~LP2T4MRVBKCO.2 size=565668 2024-09-12T00:07:21.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.964+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=LP2T4MRVBKCO tag=33HPB5ESVL0E type=write size=3711396 2024-09-12T00:07:21.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.965+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=T6U3NEUL0RYR type=del size=3140821 2024-09-12T00:07:21.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.966+0000 7f82f8930780 -1 < failed to complete operation key=HCK59C6MAW0B tag=Q4EZN3GN9SYU type=del size=2766076: (22) Invalid argument 2024-09-12T00:07:21.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.969+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~Z73VQD1E4WZX.0 size=277549 2024-09-12T00:07:21.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.969+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=Z73VQD1E4WZX tag=23TN8ZTWJ8G9 type=write size=1326125 2024-09-12T00:07:21.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.970+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~CO4YVPROIZT4.0 size=1048576 2024-09-12T00:07:21.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.972+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~CO4YVPROIZT4.1 size=567173 2024-09-12T00:07:21.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.975+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=CO4YVPROIZT4 tag=SA156KIZQ2SM type=write size=2664325 2024-09-12T00:07:21.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.975+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=Z3FLQ9FTCZRY type=write size=949605 2024-09-12T00:07:21.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.977+0000 7f82f8930780 1 < completed write operation key=9576W9WYJUJV tag=P8V1ZNI1B4HF type=write size=237847 2024-09-12T00:07:21.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.978+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=V3DR0D8E7G2Z type=write size=402641 2024-09-12T00:07:21.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.981+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~LSWU1DHHE5MV.0 size=1048576 2024-09-12T00:07:21.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.981+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~LSWU1DHHE5MV.1 size=141006 2024-09-12T00:07:21.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.984+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=LSWU1DHHE5MV tag=U1S0AJ3CWM3I type=write size=2238158 2024-09-12T00:07:21.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.985+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=DW1DBGZAE8PR type=del size=3678343 2024-09-12T00:07:21.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.986+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=LTXTJXWKYTNM type=del 2024-09-12T00:07:21.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.988+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=CX15FCJOACQJ type=del size=1064095 2024-09-12T00:07:21.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.989+0000 7f82f8930780 -1 < failed to complete operation key=HCK59C6MAW0B tag=D96OTNEUMDZE type=write size=783965: (22) Invalid argument 2024-09-12T00:07:21.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.991+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=6NJPPYJKUYT1 type=del size=2751900 2024-09-12T00:07:21.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.993+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=IHKTKU07QGAH type=del 2024-09-12T00:07:21.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.993+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=YHIYQ1A81DUR type=del size=3873145 2024-09-12T00:07:21.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.995+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~ZET9ANGDG0RY.0 size=1048576 2024-09-12T00:07:21.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.997+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~ZET9ANGDG0RY.1 size=1023785 2024-09-12T00:07:21.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:21.999+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=ZET9ANGDG0RY tag=75K6T75F5G02 type=write size=3120937 2024-09-12T00:07:21.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.000+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=TZ1MSQIFG47C type=del size=1897825 2024-09-12T00:07:22.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.002+0000 7f82f8930780 1 < completed write operation key=3H3D067Z8O0R tag=OVQ8NPX777GW type=write size=173580 2024-09-12T00:07:22.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.004+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~XI7D8BHVTDNT.0 size=419211 2024-09-12T00:07:22.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.004+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=XI7D8BHVTDNT tag=6VJS7XHWJ4EA type=write size=1467787 2024-09-12T00:07:22.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.006+0000 7f82f8930780 1 < canceled operation key=G55HN1VD6X47 tag=H1QSQQVYK2W7 type=del size=2966723 2024-09-12T00:07:22.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.009+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~2UQLPLB0RUHS.0 size=516276 2024-09-12T00:07:22.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.009+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=2UQLPLB0RUHS tag=34TQB6IT8S9Q type=write size=1564852 2024-09-12T00:07:22.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.011+0000 7f82f8930780 1 < suggested remove operation key=80OUXNDPLGAG tag=XN3R5V03K229 type=del 2024-09-12T00:07:22.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.014+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~U97OJ3YHSGZ1.0 size=782489 2024-09-12T00:07:22.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.014+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=U97OJ3YHSGZ1 tag=PH2V4UHG1935 type=write size=1831065 2024-09-12T00:07:22.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.015+0000 7f82f8930780 -1 < failed to complete operation key=A8EFUP30RS65 tag=NF8UNRWI1I95 type=write size=385699: (22) Invalid argument 2024-09-12T00:07:22.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.016+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=9ZVZBFLTDP6H type=del size=2951313 2024-09-12T00:07:22.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.019+0000 7f82f8930780 1 < suggested update operation key=3X2PLA3ODHJ1 tag=8GO88058572B type=del size=2986951 2024-09-12T00:07:22.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.021+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=25JK7KFJ3I2Z type=del size=363859 2024-09-12T00:07:22.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.022+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~E9MLP4DMC911.0 size=1048576 2024-09-12T00:07:22.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.023+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~E9MLP4DMC911.1 size=1048576 2024-09-12T00:07:22.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.025+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~E9MLP4DMC911.2 size=392733 2024-09-12T00:07:22.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.027+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=E9MLP4DMC911 tag=BT0GCWUS3Z2G type=write size=3538461 2024-09-12T00:07:22.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.028+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=4BWPE3JLLQP9 type=write size=879556 2024-09-12T00:07:22.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.029+0000 7f82f8930780 1 < completed write operation key=IN8Y7I0HKP6D tag=8Q03FFZ0GD52 type=write size=741564 2024-09-12T00:07:22.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.031+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=0BFBAMCI9291 type=del size=2648750 2024-09-12T00:07:22.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.032+0000 7f82f8930780 -1 < failed to complete operation key=3X2PLA3ODHJ1 tag=T6U3NEUL0RYR type=del size=3140821: (22) Invalid argument 2024-09-12T00:07:22.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.034+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~37D22WC3CWDO.0 size=1048576 2024-09-12T00:07:22.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.035+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~37D22WC3CWDO.1 size=1048576 2024-09-12T00:07:22.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.037+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~37D22WC3CWDO.2 size=121025 2024-09-12T00:07:22.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.037+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=37D22WC3CWDO tag=5VSJD2AW47GT type=write size=3266753 2024-09-12T00:07:22.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.038+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~Z73VQD1E4WZX.0 size=277549 2024-09-12T00:07:22.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.040+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=Z73VQD1E4WZX tag=23TN8ZTWJ8G9 type=write size=1326125 2024-09-12T00:07:22.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.044+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~X8Q7J2EROAX3.0 size=1048576 2024-09-12T00:07:22.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.045+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~X8Q7J2EROAX3.1 size=1048576 2024-09-12T00:07:22.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.046+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~X8Q7J2EROAX3.2 size=426069 2024-09-12T00:07:22.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.046+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=X8Q7J2EROAX3 tag=1HYHYDDVVFZL type=write size=3571797 2024-09-12T00:07:22.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.047+0000 7f82f8930780 1 < completed write operation key=FHQADENLR6GP tag=Z3FLQ9FTCZRY type=write size=949605 2024-09-12T00:07:22.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.048+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=KH62QJ3Z7MB6 type=write size=854164 2024-09-12T00:07:22.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.050+0000 7f82f8930780 1 < canceled operation key=FOWSB9RQ5TV5 tag=V3DR0D8E7G2Z type=write size=402641 2024-09-12T00:07:22.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.053+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~GT67GE7ECEV1.0 size=1048576 2024-09-12T00:07:22.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.054+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~GT67GE7ECEV1.1 size=1048576 2024-09-12T00:07:22.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.055+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~GT67GE7ECEV1.2 size=620814 2024-09-12T00:07:22.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.055+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=GT67GE7ECEV1 tag=EKVWGA499YTJ type=write size=3766542 2024-09-12T00:07:22.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.056+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=DW1DBGZAE8PR type=del 2024-09-12T00:07:22.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.058+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=Y6RYST587DSW type=del size=1697283 2024-09-12T00:07:22.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.059+0000 7f82f8930780 -1 < failed to complete operation key=3X2PLA3ODHJ1 tag=CX15FCJOACQJ type=del size=1064095: (22) Invalid argument 2024-09-12T00:07:22.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.063+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~N74VMMS22KZ0.0 size=1048576 2024-09-12T00:07:22.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.064+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~N74VMMS22KZ0.1 size=1048576 2024-09-12T00:07:22.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.064+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~N74VMMS22KZ0.2 size=610161 2024-09-12T00:07:22.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.064+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=N74VMMS22KZ0 tag=5YRCK2BGPPLK type=write size=3755889 2024-09-12T00:07:22.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.065+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=6NJPPYJKUYT1 type=del 2024-09-12T00:07:22.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.067+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=TU9NGM2OOYXK type=del size=3715597 2024-09-12T00:07:22.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.068+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=YHIYQ1A81DUR type=del 2024-09-12T00:07:22.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.071+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~PXVHVVS6TM1V.0 size=1048576 2024-09-12T00:07:22.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.072+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~PXVHVVS6TM1V.1 size=1048576 2024-09-12T00:07:22.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.073+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~PXVHVVS6TM1V.2 size=144065 2024-09-12T00:07:22.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.073+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=PXVHVVS6TM1V tag=JDB3DNJ7CIV0 type=write size=3289793 2024-09-12T00:07:22.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.074+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=TZ1MSQIFG47C type=del 2024-09-12T00:07:22.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.076+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=9R93R3446JEJ type=del size=974184 2024-09-12T00:07:22.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.076+0000 7f82f8930780 1 < canceled part key=_multipart_W8SAQZWQHY36.2~XI7D8BHVTDNT.0 size=419211 2024-09-12T00:07:22.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.078+0000 7f82f8930780 1 < canceled multipart upload key=W8SAQZWQHY36 upload=XI7D8BHVTDNT tag=6VJS7XHWJ4EA type=write size=1467787 2024-09-12T00:07:22.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.081+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~0L6TZGHTGDNF.0 size=151576 2024-09-12T00:07:22.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.081+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=0L6TZGHTGDNF tag=IL32DIOU6O92 type=write size=1200152 2024-09-12T00:07:22.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.082+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~2UQLPLB0RUHS.0 size=516276 2024-09-12T00:07:22.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.084+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=2UQLPLB0RUHS tag=34TQB6IT8S9Q type=write size=1564852 2024-09-12T00:07:22.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.086+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=KY0A6N0G8045 type=del size=3770198 2024-09-12T00:07:22.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.086+0000 7f82f8930780 1 < canceled part key=_multipart_9576W9WYJUJV.2~U97OJ3YHSGZ1.0 size=782489 2024-09-12T00:07:22.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.089+0000 7f82f8930780 1 < canceled multipart upload key=9576W9WYJUJV upload=U97OJ3YHSGZ1 tag=PH2V4UHG1935 type=write size=1831065 2024-09-12T00:07:22.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.091+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=Z76YAZ20TKCK type=write size=293601 2024-09-12T00:07:22.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.094+0000 7f82f8930780 1 < suggested update operation key=77SDZHCSP0E3 tag=9ZVZBFLTDP6H type=del size=2951313 2024-09-12T00:07:22.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.095+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=VNBBWXBYS49A type=del size=406228 2024-09-12T00:07:22.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.097+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=25JK7KFJ3I2Z type=del 2024-09-12T00:07:22.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.099+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=YSA5UNHGH25I type=write size=68081 2024-09-12T00:07:22.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.100+0000 7f82f8930780 1 < suggested remove operation key=77SDZHCSP0E3 tag=4BWPE3JLLQP9 type=write 2024-09-12T00:07:22.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.103+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~1HAD3X4ZD12C.0 size=1048576 2024-09-12T00:07:22.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.104+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~1HAD3X4ZD12C.1 size=67348 2024-09-12T00:07:22.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.104+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=1HAD3X4ZD12C tag=MQF42OWF02O7 type=write size=2164500 2024-09-12T00:07:22.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.106+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=0BFBAMCI9291 type=del 2024-09-12T00:07:22.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.108+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~DA1K8R0ST2Q0.0 size=101470 2024-09-12T00:07:22.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.108+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=DA1K8R0ST2Q0 tag=PKNBLAMQBRXZ type=write size=1150046 2024-09-12T00:07:22.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.110+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~37D22WC3CWDO.0 size=1048576 2024-09-12T00:07:22.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.110+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~37D22WC3CWDO.1 size=1048576 2024-09-12T00:07:22.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.111+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~37D22WC3CWDO.2 size=121025 2024-09-12T00:07:22.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.115+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=37D22WC3CWDO tag=5VSJD2AW47GT type=write size=3266753 2024-09-12T00:07:22.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.117+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~4C42NKCRUMKU.0 size=1048576 2024-09-12T00:07:22.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.117+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~4C42NKCRUMKU.1 size=1048576 2024-09-12T00:07:22.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.119+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~4C42NKCRUMKU.2 size=436308 2024-09-12T00:07:22.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.119+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=4C42NKCRUMKU tag=IBDR31SYREZX type=write size=3582036 2024-09-12T00:07:22.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.121+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~X8Q7J2EROAX3.0 size=1048576 2024-09-12T00:07:22.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.121+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~X8Q7J2EROAX3.1 size=1048576 2024-09-12T00:07:22.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.122+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~X8Q7J2EROAX3.2 size=426069 2024-09-12T00:07:22.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.125+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=X8Q7J2EROAX3 tag=1HYHYDDVVFZL type=write size=3571797 2024-09-12T00:07:22.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.128+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~516OPG0SLCK3.0 size=1048576 2024-09-12T00:07:22.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.129+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~516OPG0SLCK3.1 size=1048576 2024-09-12T00:07:22.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.130+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~516OPG0SLCK3.2 size=19406 2024-09-12T00:07:22.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.130+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=516OPG0SLCK3 tag=OQJBD31SU372 type=write size=3165134 2024-09-12T00:07:22.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.133+0000 7f82f8930780 1 < suggested remove operation key=AMWMQXO10EXK tag=KH62QJ3Z7MB6 type=write 2024-09-12T00:07:22.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.135+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~HDSBAM1UI44L.0 size=1048576 2024-09-12T00:07:22.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.135+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~HDSBAM1UI44L.1 size=1048576 2024-09-12T00:07:22.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.137+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~HDSBAM1UI44L.2 size=97734 2024-09-12T00:07:22.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.137+0000 7f82f8930780 1 > prepared multipart upload key=77SDZHCSP0E3 upload=HDSBAM1UI44L tag=0PJQVWSXCQPT type=write size=3243462 2024-09-12T00:07:22.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.138+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~GT67GE7ECEV1.0 size=1048576 2024-09-12T00:07:22.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.139+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~GT67GE7ECEV1.1 size=1048576 2024-09-12T00:07:22.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.140+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~GT67GE7ECEV1.2 size=620814 2024-09-12T00:07:22.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.143+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=GT67GE7ECEV1 tag=EKVWGA499YTJ type=write size=3766542 2024-09-12T00:07:22.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.146+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~ZTGFM4DXVJM0.0 size=1048576 2024-09-12T00:07:22.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.147+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~ZTGFM4DXVJM0.1 size=498013 2024-09-12T00:07:22.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.147+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=ZTGFM4DXVJM0 tag=T29VML3AS0DJ type=write size=2595165 2024-09-12T00:07:22.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.148+0000 7f82f8930780 1 < completed delete operation key=9576W9WYJUJV tag=Y6RYST587DSW type=del 2024-09-12T00:07:22.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.149+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=S0Y7MP6MHNPW type=write size=193647 2024-09-12T00:07:22.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.150+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~N74VMMS22KZ0.0 size=1048576 2024-09-12T00:07:22.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.152+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~N74VMMS22KZ0.1 size=1048576 2024-09-12T00:07:22.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.154+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~N74VMMS22KZ0.2 size=610161 2024-09-12T00:07:22.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.156+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=N74VMMS22KZ0 tag=5YRCK2BGPPLK type=write size=3755889 2024-09-12T00:07:22.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.158+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=TLDZMIIGU0K1 type=del size=450138 2024-09-12T00:07:22.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.160+0000 7f82f8930780 1 < suggested remove operation key=9576W9WYJUJV tag=TU9NGM2OOYXK type=del 2024-09-12T00:07:22.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.163+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~6O2OEMQJ0SZV.0 size=1048576 2024-09-12T00:07:22.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.164+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~6O2OEMQJ0SZV.1 size=1048576 2024-09-12T00:07:22.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.165+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~6O2OEMQJ0SZV.2 size=15948 2024-09-12T00:07:22.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.165+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=6O2OEMQJ0SZV tag=UITQB4Y2WSX9 type=write size=3161676 2024-09-12T00:07:22.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.166+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~PXVHVVS6TM1V.0 size=1048576 2024-09-12T00:07:22.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.167+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~PXVHVVS6TM1V.1 size=1048576 2024-09-12T00:07:22.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.169+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~PXVHVVS6TM1V.2 size=144065 2024-09-12T00:07:22.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.172+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=PXVHVVS6TM1V tag=JDB3DNJ7CIV0 type=write size=3289793 2024-09-12T00:07:22.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.172+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=XPE0OP8WD587 type=write size=366528 2024-09-12T00:07:22.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.174+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=9R93R3446JEJ type=del 2024-09-12T00:07:22.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.176+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~ANH6NRRG2TR1.0 size=978494 2024-09-12T00:07:22.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.176+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=ANH6NRRG2TR1 tag=DZB7PHJ5R9HZ type=write size=2027070 2024-09-12T00:07:22.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.178+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~0L6TZGHTGDNF.0 size=151576 2024-09-12T00:07:22.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.181+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=0L6TZGHTGDNF tag=IL32DIOU6O92 type=write size=1200152 2024-09-12T00:07:22.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.183+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~7GZLQ98I73NQ.0 size=1048576 2024-09-12T00:07:22.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.183+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~7GZLQ98I73NQ.1 size=433291 2024-09-12T00:07:22.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.183+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=7GZLQ98I73NQ tag=PH1FGCU1WRNT type=write size=2530443 2024-09-12T00:07:22.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.185+0000 7f82f8930780 -1 < failed to complete operation key=9576W9WYJUJV tag=KY0A6N0G8045 type=del size=3770198: (22) Invalid argument 2024-09-12T00:07:22.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.187+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~LFDV6VIXCXMA.0 size=1048576 2024-09-12T00:07:22.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.188+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~LFDV6VIXCXMA.1 size=1048576 2024-09-12T00:07:22.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.189+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~LFDV6VIXCXMA.2 size=927353 2024-09-12T00:07:22.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.189+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=LFDV6VIXCXMA tag=K41RFJYP6ES0 type=write size=4073081 2024-09-12T00:07:22.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.191+0000 7f82f8930780 1 < completed write operation key=2XM2CF1T4VGW tag=Z76YAZ20TKCK type=write size=293601 2024-09-12T00:07:22.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.193+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~E2LKUHGZT1LQ.0 size=1048576 2024-09-12T00:07:22.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.194+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~E2LKUHGZT1LQ.1 size=1048576 2024-09-12T00:07:22.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.196+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~E2LKUHGZT1LQ.2 size=3528 2024-09-12T00:07:22.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.196+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=E2LKUHGZT1LQ tag=XBF3JQDK9TNH type=write size=3149256 2024-09-12T00:07:22.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.198+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=VNBBWXBYS49A type=del 2024-09-12T00:07:22.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.199+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=XEVWZN5JC0DZ type=del size=1969782 2024-09-12T00:07:22.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.200+0000 7f82f8930780 1 < completed write operation key=62X93NOS23AF tag=YSA5UNHGH25I type=write size=68081 2024-09-12T00:07:22.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.203+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~2BPNO8GGXD1D.0 size=1048576 2024-09-12T00:07:22.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.204+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~2BPNO8GGXD1D.1 size=1048576 2024-09-12T00:07:22.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.206+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~2BPNO8GGXD1D.2 size=80048 2024-09-12T00:07:22.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.206+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=2BPNO8GGXD1D tag=M9APCKBD37DR type=write size=3225776 2024-09-12T00:07:22.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.206+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~1HAD3X4ZD12C.0 size=1048576 2024-09-12T00:07:22.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.207+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~1HAD3X4ZD12C.1 size=67348 2024-09-12T00:07:22.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.210+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=1HAD3X4ZD12C tag=MQF42OWF02O7 type=write size=2164500 2024-09-12T00:07:22.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.211+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=ESJDRB1RCSDB type=write size=626961 2024-09-12T00:07:22.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.214+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~DA1K8R0ST2Q0.0 size=101470 2024-09-12T00:07:22.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.217+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=DA1K8R0ST2Q0 tag=PKNBLAMQBRXZ type=write size=1150046 2024-09-12T00:07:22.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.218+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=5QCW7C5AN60Q type=write size=661655 2024-09-12T00:07:22.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.219+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~4C42NKCRUMKU.0 size=1048576 2024-09-12T00:07:22.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.221+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~4C42NKCRUMKU.1 size=1048576 2024-09-12T00:07:22.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.222+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~4C42NKCRUMKU.2 size=436308 2024-09-12T00:07:22.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.224+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=4C42NKCRUMKU tag=IBDR31SYREZX type=write size=3582036 2024-09-12T00:07:22.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.227+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=WKSE0RS6PF92 type=del size=396027 2024-09-12T00:07:22.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.228+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~516OPG0SLCK3.0 size=1048576 2024-09-12T00:07:22.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.229+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~516OPG0SLCK3.1 size=1048576 2024-09-12T00:07:22.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.231+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~516OPG0SLCK3.2 size=19406 2024-09-12T00:07:22.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.232+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=516OPG0SLCK3 tag=OQJBD31SU372 type=write size=3165134 2024-09-12T00:07:22.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.234+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=S02FU32FW8JY type=del size=2823016 2024-09-12T00:07:22.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.234+0000 7f82f8930780 1 < canceled part key=_multipart_77SDZHCSP0E3.2~HDSBAM1UI44L.0 size=1048576 2024-09-12T00:07:22.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.234+0000 7f82f8930780 1 < canceled part key=_multipart_77SDZHCSP0E3.2~HDSBAM1UI44L.1 size=1048576 2024-09-12T00:07:22.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.235+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~HDSBAM1UI44L.2 size=97734 2024-09-12T00:07:22.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.238+0000 7f82f8930780 1 < canceled multipart upload key=77SDZHCSP0E3 upload=HDSBAM1UI44L tag=0PJQVWSXCQPT type=write size=3243462 2024-09-12T00:07:22.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.239+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=72QURO9FMUGA type=del size=2090980 2024-09-12T00:07:22.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.241+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~ZTGFM4DXVJM0.0 size=1048576 2024-09-12T00:07:22.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.242+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~ZTGFM4DXVJM0.1 size=498013 2024-09-12T00:07:22.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.246+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=ZTGFM4DXVJM0 tag=T29VML3AS0DJ type=write size=2595165 2024-09-12T00:07:22.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.246+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=38992NI481EX type=del size=1602215 2024-09-12T00:07:22.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.249+0000 7f82f8930780 1 < completed write operation key=FHQADENLR6GP tag=S0Y7MP6MHNPW type=write size=193647 2024-09-12T00:07:22.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.249+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=0DJHSY5MB34G type=del size=835327 2024-09-12T00:07:22.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.252+0000 7f82f8930780 -1 < failed to complete operation key=9576W9WYJUJV tag=TLDZMIIGU0K1 type=del size=450138: (22) Invalid argument 2024-09-12T00:07:22.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.253+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=DEH8ACSADY70 type=del size=2303382 2024-09-12T00:07:22.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.254+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~6O2OEMQJ0SZV.0 size=1048576 2024-09-12T00:07:22.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.255+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~6O2OEMQJ0SZV.1 size=1048576 2024-09-12T00:07:22.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.256+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~6O2OEMQJ0SZV.2 size=15948 2024-09-12T00:07:22.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.259+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=6O2OEMQJ0SZV tag=UITQB4Y2WSX9 type=write size=3161676 2024-09-12T00:07:22.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.260+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=45IH7IK2H7MY type=del size=4072628 2024-09-12T00:07:22.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.263+0000 7f82f8930780 1 < completed write operation key=O2ZGU2KOTUOT tag=XPE0OP8WD587 type=write size=366528 2024-09-12T00:07:22.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.264+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~W1186844W6BB.0 size=1048576 2024-09-12T00:07:22.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.265+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~W1186844W6BB.1 size=703145 2024-09-12T00:07:22.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.265+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=W1186844W6BB tag=HA7J4X6VC9S2 type=write size=2800297 2024-09-12T00:07:22.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.268+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~ANH6NRRG2TR1.0 size=978494 2024-09-12T00:07:22.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.269+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=ANH6NRRG2TR1 tag=DZB7PHJ5R9HZ type=write size=2027070 2024-09-12T00:07:22.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.270+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=KW7E9WBLBJG6 type=del size=2764784 2024-09-12T00:07:22.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.273+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~7GZLQ98I73NQ.0 size=1048576 2024-09-12T00:07:22.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.273+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~7GZLQ98I73NQ.1 size=433291 2024-09-12T00:07:22.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.276+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=7GZLQ98I73NQ tag=PH1FGCU1WRNT type=write size=2530443 2024-09-12T00:07:22.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.278+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~PA41AEARI1A0.0 size=940369 2024-09-12T00:07:22.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.278+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=PA41AEARI1A0 tag=X358TA4JCYVX type=write size=1988945 2024-09-12T00:07:22.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.279+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~LFDV6VIXCXMA.0 size=1048576 2024-09-12T00:07:22.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.279+0000 7f82f8930780 1 < canceled part key=_multipart_3X2PLA3ODHJ1.2~LFDV6VIXCXMA.1 size=1048576 2024-09-12T00:07:22.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.281+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~LFDV6VIXCXMA.2 size=927353 2024-09-12T00:07:22.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.282+0000 7f82f8930780 1 < canceled multipart upload key=3X2PLA3ODHJ1 upload=LFDV6VIXCXMA tag=K41RFJYP6ES0 type=write size=4073081 2024-09-12T00:07:22.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.285+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~T8ECCLMV85EO.0 size=54648 2024-09-12T00:07:22.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.285+0000 7f82f8930780 1 > prepared multipart upload key=4IA4918NXXJW upload=T8ECCLMV85EO tag=8Z3HOEEWPU0O type=write size=1103224 2024-09-12T00:07:22.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.285+0000 7f82f8930780 1 < canceled part key=_multipart_4SPRDO097JYQ.2~E2LKUHGZT1LQ.0 size=1048576 2024-09-12T00:07:22.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.286+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~E2LKUHGZT1LQ.1 size=1048576 2024-09-12T00:07:22.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.288+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~E2LKUHGZT1LQ.2 size=3528 2024-09-12T00:07:22.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.290+0000 7f82f8930780 1 < canceled multipart upload key=4SPRDO097JYQ upload=E2LKUHGZT1LQ tag=XBF3JQDK9TNH type=write size=3149256 2024-09-12T00:07:22.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.292+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=TO15G5TICHUM type=del size=992241 2024-09-12T00:07:22.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.295+0000 7f82f8930780 1 < suggested remove operation key=W8SAQZWQHY36 tag=XEVWZN5JC0DZ type=del 2024-09-12T00:07:22.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.297+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=G4OYBTCAF2MG type=del size=2245390 2024-09-12T00:07:22.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.297+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~2BPNO8GGXD1D.0 size=1048576 2024-09-12T00:07:22.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.299+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~2BPNO8GGXD1D.1 size=1048576 2024-09-12T00:07:22.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.301+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~2BPNO8GGXD1D.2 size=80048 2024-09-12T00:07:22.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.304+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=2BPNO8GGXD1D tag=M9APCKBD37DR type=write size=3225776 2024-09-12T00:07:22.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.304+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=RP2EV0RZV6KJ type=del size=272554 2024-09-12T00:07:22.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.307+0000 7f82f8930780 1 < canceled operation key=HCK59C6MAW0B tag=ESJDRB1RCSDB type=write size=626961 2024-09-12T00:07:22.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.309+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~XMHKQXBSD56D.0 size=1048576 2024-09-12T00:07:22.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.311+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~XMHKQXBSD56D.1 size=597683 2024-09-12T00:07:22.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.311+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=XMHKQXBSD56D tag=PA9ZTZ55CYM5 type=write size=2694835 2024-09-12T00:07:22.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.311+0000 7f82f8930780 1 < completed write operation key=BJHGNT3HBS25 tag=5QCW7C5AN60Q type=write size=661655 2024-09-12T00:07:22.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.314+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=JVEKACQR3TT2 type=del size=1288895 2024-09-12T00:07:22.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.316+0000 7f82f8930780 -1 < failed to complete operation key=W8SAQZWQHY36 tag=WKSE0RS6PF92 type=del size=396027: (22) Invalid argument 2024-09-12T00:07:22.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.316+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=KM4MW00ITHUX type=del size=578326 2024-09-12T00:07:22.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.319+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=S02FU32FW8JY type=del 2024-09-12T00:07:22.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.321+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~PGK9OX579LQY.0 size=1048576 2024-09-12T00:07:22.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.322+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~PGK9OX579LQY.1 size=1048576 2024-09-12T00:07:22.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.323+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~PGK9OX579LQY.2 size=461664 2024-09-12T00:07:22.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.323+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=PGK9OX579LQY tag=XWK2CV933NPQ type=write size=3607392 2024-09-12T00:07:22.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.325+0000 7f82f8930780 -1 < failed to complete operation key=W8SAQZWQHY36 tag=72QURO9FMUGA type=del size=2090980: (22) Invalid argument 2024-09-12T00:07:22.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.327+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=BNTG59HKSA92 type=del size=4080132 2024-09-12T00:07:22.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.328+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=38992NI481EX type=del 2024-09-12T00:07:22.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.330+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~6UOKKDODSULG.0 size=570424 2024-09-12T00:07:22.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.330+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=6UOKKDODSULG tag=TR2HSY9VBNM0 type=write size=1619000 2024-09-12T00:07:22.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.332+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=0DJHSY5MB34G type=del 2024-09-12T00:07:22.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.333+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=WP2RINSPWE8M type=del size=3343707 2024-09-12T00:07:22.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.334+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=DEH8ACSADY70 type=del 2024-09-12T00:07:22.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.338+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~JT22LJT6GFBQ.0 size=1048576 2024-09-12T00:07:22.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.338+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~JT22LJT6GFBQ.1 size=390980 2024-09-12T00:07:22.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.338+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=JT22LJT6GFBQ tag=INN1LI4EK5KQ type=write size=2488132 2024-09-12T00:07:22.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.339+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=45IH7IK2H7MY type=del 2024-09-12T00:07:22.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.342+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=0WFE4H34QZ1I type=del size=2407457 2024-09-12T00:07:22.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.342+0000 7f82f8930780 1 < canceled part key=_multipart_Y5U8MO9TOJQQ.2~W1186844W6BB.0 size=1048576 2024-09-12T00:07:22.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.342+0000 7f82f8930780 1 < canceled part key=_multipart_Y5U8MO9TOJQQ.2~W1186844W6BB.1 size=703145 2024-09-12T00:07:22.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.344+0000 7f82f8930780 1 < canceled multipart upload key=Y5U8MO9TOJQQ upload=W1186844W6BB tag=HA7J4X6VC9S2 type=write size=2800297 2024-09-12T00:07:22.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.345+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=Y2YL4IB2UR0M type=del size=192542 2024-09-12T00:07:22.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.347+0000 7f82f8930780 1 < canceled operation key=NCIZ4HNPCZ94 tag=KW7E9WBLBJG6 type=del size=2764784 2024-09-12T00:07:22.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.348+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=EYXS6J1O616H type=del size=2664410 2024-09-12T00:07:22.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.349+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~PA41AEARI1A0.0 size=940369 2024-09-12T00:07:22.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.352+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=PA41AEARI1A0 tag=X358TA4JCYVX type=write size=1988945 2024-09-12T00:07:22.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.355+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=LNAJ9QD38SQG type=write size=724527 2024-09-12T00:07:22.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.356+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~T8ECCLMV85EO.0 size=54648 2024-09-12T00:07:22.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.358+0000 7f82f8930780 1 < completed multipart upload key=4IA4918NXXJW upload=T8ECCLMV85EO tag=8Z3HOEEWPU0O type=write size=1103224 2024-09-12T00:07:22.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.359+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=PG7WSJCS061P type=del size=2710990 2024-09-12T00:07:22.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.361+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=TO15G5TICHUM type=del 2024-09-12T00:07:22.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.362+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=ZJ6H46A8TY41 type=del size=2477951 2024-09-12T00:07:22.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.363+0000 7f82f8930780 1 < canceled operation key=X3PCR8TCWDTK tag=G4OYBTCAF2MG type=del size=2245390 2024-09-12T00:07:22.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.366+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~BS5GG5E5RBHS.0 size=1048576 2024-09-12T00:07:22.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.368+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~BS5GG5E5RBHS.1 size=1048576 2024-09-12T00:07:22.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.369+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~BS5GG5E5RBHS.2 size=38633 2024-09-12T00:07:22.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.369+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=BS5GG5E5RBHS tag=1ZPXSN99FN7R type=write size=3184361 2024-09-12T00:07:22.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.370+0000 7f82f8930780 1 < suggested update operation key=X3PCR8TCWDTK tag=RP2EV0RZV6KJ type=del size=272554 2024-09-12T00:07:22.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.372+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=7VDUAJX394HH type=del size=2856104 2024-09-12T00:07:22.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.373+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~XMHKQXBSD56D.0 size=1048576 2024-09-12T00:07:22.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.373+0000 7f82f8930780 1 < canceled part key=_multipart_3X2PLA3ODHJ1.2~XMHKQXBSD56D.1 size=597683 2024-09-12T00:07:22.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.376+0000 7f82f8930780 1 < canceled multipart upload key=3X2PLA3ODHJ1 upload=XMHKQXBSD56D tag=PA9ZTZ55CYM5 type=write size=2694835 2024-09-12T00:07:22.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.378+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=NZFAD5Q5ANTY type=del size=1888065 2024-09-12T00:07:22.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.379+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=JVEKACQR3TT2 type=del 2024-09-12T00:07:22.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.381+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=HDMWG86OXMEA type=del size=1882510 2024-09-12T00:07:22.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.382+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=KM4MW00ITHUX type=del 2024-09-12T00:07:22.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.385+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~EL4657D2MPPG.0 size=1048576 2024-09-12T00:07:22.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.386+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~EL4657D2MPPG.1 size=1048576 2024-09-12T00:07:22.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.388+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~EL4657D2MPPG.2 size=439601 2024-09-12T00:07:22.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.388+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=EL4657D2MPPG tag=UB05RUBBZI9O type=write size=3585329 2024-09-12T00:07:22.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.390+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~PGK9OX579LQY.0 size=1048576 2024-09-12T00:07:22.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.390+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~PGK9OX579LQY.1 size=1048576 2024-09-12T00:07:22.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.392+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~PGK9OX579LQY.2 size=461664 2024-09-12T00:07:22.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.394+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=PGK9OX579LQY tag=XWK2CV933NPQ type=write size=3607392 2024-09-12T00:07:22.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.395+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=29C3R4V10MY8 type=del size=2887759 2024-09-12T00:07:22.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.397+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=BNTG59HKSA92 type=del 2024-09-12T00:07:22.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.398+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=ACMJ4LEUU9H1 type=del size=709699 2024-09-12T00:07:22.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.401+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~6UOKKDODSULG.0 size=570424 2024-09-12T00:07:22.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.403+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=6UOKKDODSULG tag=TR2HSY9VBNM0 type=write size=1619000 2024-09-12T00:07:22.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.404+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=Z316FHZI2RPH type=del size=768809 2024-09-12T00:07:22.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.405+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=WP2RINSPWE8M type=del 2024-09-12T00:07:22.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.407+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=Q517DGVJRISX type=del size=4188166 2024-09-12T00:07:22.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.407+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~JT22LJT6GFBQ.0 size=1048576 2024-09-12T00:07:22.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.407+0000 7f82f8930780 1 < canceled part key=_multipart_9576W9WYJUJV.2~JT22LJT6GFBQ.1 size=390980 2024-09-12T00:07:22.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.411+0000 7f82f8930780 1 < canceled multipart upload key=9576W9WYJUJV upload=JT22LJT6GFBQ tag=INN1LI4EK5KQ type=write size=2488132 2024-09-12T00:07:22.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.411+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=3LR4UXIZE6R3 type=write size=215008 2024-09-12T00:07:22.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.412+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=0WFE4H34QZ1I type=del 2024-09-12T00:07:22.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.415+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=IKISGZ1UIEG1 type=del size=2929029 2024-09-12T00:07:22.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.415+0000 7f82f8930780 1 < completed delete operation key=N2TYUAJITFNL tag=Y2YL4IB2UR0M type=del 2024-09-12T00:07:22.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.418+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~NSFS94ZR03W4.0 size=829664 2024-09-12T00:07:22.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.418+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=NSFS94ZR03W4 tag=EY9QM7K6S638 type=write size=1878240 2024-09-12T00:07:22.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.419+0000 7f82f8930780 1 < completed delete operation key=9576W9WYJUJV tag=EYXS6J1O616H type=del 2024-09-12T00:07:22.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.421+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~ACH6OT6048SU.0 size=887215 2024-09-12T00:07:22.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.421+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=ACH6OT6048SU tag=H2YQ3BMJD95N type=write size=1935791 2024-09-12T00:07:22.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.423+0000 7f82f8930780 1 < completed write operation key=80OUXNDPLGAG tag=LNAJ9QD38SQG type=write size=724527 2024-09-12T00:07:22.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.425+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=Y5TL2YJPP9W8 type=del size=2278190 2024-09-12T00:07:22.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.428+0000 7f82f8930780 1 < suggested update operation key=77SDZHCSP0E3 tag=PG7WSJCS061P type=del size=2710990 2024-09-12T00:07:22.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.428+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=1KYAUZVXK35N type=del size=1226272 2024-09-12T00:07:22.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.432+0000 7f82f8930780 1 < suggested update operation key=X3PCR8TCWDTK tag=ZJ6H46A8TY41 type=del size=2477951 2024-09-12T00:07:22.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.432+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=VU81D41I3ZQH type=del size=1223264 2024-09-12T00:07:22.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.433+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~BS5GG5E5RBHS.0 size=1048576 2024-09-12T00:07:22.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.435+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~BS5GG5E5RBHS.1 size=1048576 2024-09-12T00:07:22.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.435+0000 7f82f8930780 1 < canceled part key=_multipart_4SPRDO097JYQ.2~BS5GG5E5RBHS.2 size=38633 2024-09-12T00:07:22.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.436+0000 7f82f8930780 1 < canceled multipart upload key=4SPRDO097JYQ upload=BS5GG5E5RBHS tag=1ZPXSN99FN7R type=write size=3184361 2024-09-12T00:07:22.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.440+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~NIDLK1ZN522G.0 size=1048576 2024-09-12T00:07:22.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.440+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~NIDLK1ZN522G.1 size=1048576 2024-09-12T00:07:22.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.441+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~NIDLK1ZN522G.2 size=134477 2024-09-12T00:07:22.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.441+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=NIDLK1ZN522G tag=TGKDEQHTWD01 type=write size=3280205 2024-09-12T00:07:22.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.443+0000 7f82f8930780 -1 < failed to complete operation key=X3PCR8TCWDTK tag=7VDUAJX394HH type=del size=2856104: (22) Invalid argument 2024-09-12T00:07:22.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.445+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=3U2RGUEXF72V type=del size=288775 2024-09-12T00:07:22.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.445+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=NZFAD5Q5ANTY type=del 2024-09-12T00:07:22.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.448+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~ME5OCIE302HQ.0 size=1048576 2024-09-12T00:07:22.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.449+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~ME5OCIE302HQ.1 size=1048576 2024-09-12T00:07:22.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.450+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~ME5OCIE302HQ.2 size=578028 2024-09-12T00:07:22.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.450+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=ME5OCIE302HQ tag=CUHE0RM3UPFK type=write size=3723756 2024-09-12T00:07:22.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.452+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=HDMWG86OXMEA type=del 2024-09-12T00:07:22.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.455+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~EIEIBYM2RH6P.0 size=1048576 2024-09-12T00:07:22.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.456+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~EIEIBYM2RH6P.1 size=1048576 2024-09-12T00:07:22.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.457+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~EIEIBYM2RH6P.2 size=724373 2024-09-12T00:07:22.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.457+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=EIEIBYM2RH6P tag=F5908BYQR88M type=write size=3870101 2024-09-12T00:07:22.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.458+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~EL4657D2MPPG.0 size=1048576 2024-09-12T00:07:22.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.458+0000 7f82f8930780 1 < canceled part key=_multipart_3H3D067Z8O0R.2~EL4657D2MPPG.1 size=1048576 2024-09-12T00:07:22.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.459+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~EL4657D2MPPG.2 size=439601 2024-09-12T00:07:22.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.462+0000 7f82f8930780 1 < canceled multipart upload key=3H3D067Z8O0R upload=EL4657D2MPPG tag=UB05RUBBZI9O type=write size=3585329 2024-09-12T00:07:22.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.465+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~05BDTGWVY4E6.0 size=1048576 2024-09-12T00:07:22.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.465+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~05BDTGWVY4E6.1 size=1048576 2024-09-12T00:07:22.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.467+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~05BDTGWVY4E6.2 size=210444 2024-09-12T00:07:22.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.467+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=05BDTGWVY4E6 tag=EGL5APMLY2CR type=write size=3356172 2024-09-12T00:07:22.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.470+0000 7f82f8930780 1 < suggested remove operation key=X3PCR8TCWDTK tag=29C3R4V10MY8 type=del 2024-09-12T00:07:22.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.472+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=JD07XXWFWPM2 type=del size=3309406 2024-09-12T00:07:22.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.474+0000 7f82f8930780 1 < suggested remove operation key=A8EFUP30RS65 tag=ACMJ4LEUU9H1 type=del 2024-09-12T00:07:22.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.476+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~84M96F77WB5Z.0 size=1048576 2024-09-12T00:07:22.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.477+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~84M96F77WB5Z.1 size=1048576 2024-09-12T00:07:22.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.478+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~84M96F77WB5Z.2 size=922280 2024-09-12T00:07:22.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.478+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=84M96F77WB5Z tag=2EMJQESYX5VT type=write size=4068008 2024-09-12T00:07:22.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.481+0000 7f82f8930780 1 < canceled operation key=3H3D067Z8O0R tag=Z316FHZI2RPH type=del size=768809 2024-09-12T00:07:22.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.485+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~UVRT70IWGUL9.0 size=1048576 2024-09-12T00:07:22.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.486+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~UVRT70IWGUL9.1 size=1048576 2024-09-12T00:07:22.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.486+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~UVRT70IWGUL9.2 size=507650 2024-09-12T00:07:22.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.486+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=UVRT70IWGUL9 tag=NXMG751QME0P type=write size=3653378 2024-09-12T00:07:22.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.487+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=Q517DGVJRISX type=del 2024-09-12T00:07:22.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.491+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~HZCUXOWQAUPN.0 size=1048576 2024-09-12T00:07:22.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.491+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~HZCUXOWQAUPN.1 size=1048576 2024-09-12T00:07:22.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.493+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~HZCUXOWQAUPN.2 size=81334 2024-09-12T00:07:22.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.493+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=HZCUXOWQAUPN tag=F5YZCHTNGM82 type=write size=3227062 2024-09-12T00:07:22.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.495+0000 7f82f8930780 1 < completed write operation key=OVJOP07M9KB8 tag=3LR4UXIZE6R3 type=write size=215008 2024-09-12T00:07:22.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.497+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=VN34OI2BRHV2 type=write size=418309 2024-09-12T00:07:22.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.499+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=IKISGZ1UIEG1 type=del 2024-09-12T00:07:22.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.499+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=C0KVWWB2BDGU type=del size=270136 2024-09-12T00:07:22.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.502+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~NSFS94ZR03W4.0 size=829664 2024-09-12T00:07:22.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.503+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=NSFS94ZR03W4 tag=EY9QM7K6S638 type=write size=1878240 2024-09-12T00:07:22.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.507+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~KTJJ6FZMVFRV.0 size=1048576 2024-09-12T00:07:22.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.508+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~KTJJ6FZMVFRV.1 size=102865 2024-09-12T00:07:22.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.508+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=KTJJ6FZMVFRV tag=M0TXVVNFS1L7 type=write size=2200017 2024-09-12T00:07:22.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.509+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~ACH6OT6048SU.0 size=887215 2024-09-12T00:07:22.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.510+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=ACH6OT6048SU tag=H2YQ3BMJD95N type=write size=1935791 2024-09-12T00:07:22.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.513+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=STDPYMTX7S6C type=del size=3219270 2024-09-12T00:07:22.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.513+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=Y5TL2YJPP9W8 type=del 2024-09-12T00:07:22.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.515+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~1LZTJ1KPW60P.0 size=710927 2024-09-12T00:07:22.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.515+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=1LZTJ1KPW60P tag=DXU3T49B71GO type=write size=1759503 2024-09-12T00:07:22.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.517+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=1KYAUZVXK35N type=del 2024-09-12T00:07:22.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.519+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~VY87FYXB6B9Z.0 size=313126 2024-09-12T00:07:22.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.519+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=VY87FYXB6B9Z tag=2O11TLR85DEY type=write size=1361702 2024-09-12T00:07:22.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.520+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=VU81D41I3ZQH type=del 2024-09-12T00:07:22.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.522+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=LDTG2Q8VC3O3 type=del size=1612888 2024-09-12T00:07:22.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.523+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~NIDLK1ZN522G.0 size=1048576 2024-09-12T00:07:22.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.524+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~NIDLK1ZN522G.1 size=1048576 2024-09-12T00:07:22.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.526+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~NIDLK1ZN522G.2 size=134477 2024-09-12T00:07:22.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.529+0000 7f82f8930780 1 < completed multipart upload key=W8SAQZWQHY36 upload=NIDLK1ZN522G tag=TGKDEQHTWD01 type=write size=3280205 2024-09-12T00:07:22.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.530+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=1O82RW5VU3G6 type=del size=1936597 2024-09-12T00:07:22.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.531+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=3U2RGUEXF72V type=del 2024-09-12T00:07:22.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.532+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=UVEHB325239O type=del size=3531648 2024-09-12T00:07:22.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.533+0000 7f82f8930780 1 < canceled part key=_multipart_75GYP042UUC2.2~ME5OCIE302HQ.0 size=1048576 2024-09-12T00:07:22.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.534+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~ME5OCIE302HQ.1 size=1048576 2024-09-12T00:07:22.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.535+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~ME5OCIE302HQ.2 size=578028 2024-09-12T00:07:22.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.537+0000 7f82f8930780 1 < canceled multipart upload key=75GYP042UUC2 upload=ME5OCIE302HQ tag=CUHE0RM3UPFK type=write size=3723756 2024-09-12T00:07:22.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.538+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=9IKA7Z93H31Z type=del size=1105110 2024-09-12T00:07:22.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.539+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~EIEIBYM2RH6P.0 size=1048576 2024-09-12T00:07:22.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.540+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~EIEIBYM2RH6P.1 size=1048576 2024-09-12T00:07:22.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.541+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~EIEIBYM2RH6P.2 size=724373 2024-09-12T00:07:22.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.544+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=EIEIBYM2RH6P tag=F5908BYQR88M type=write size=3870101 2024-09-12T00:07:22.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.546+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=UCNH0DSOSY2O type=del size=1727457 2024-09-12T00:07:22.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.548+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~05BDTGWVY4E6.0 size=1048576 2024-09-12T00:07:22.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.548+0000 7f82f8930780 1 < canceled part key=_multipart_62X93NOS23AF.2~05BDTGWVY4E6.1 size=1048576 2024-09-12T00:07:22.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.548+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~05BDTGWVY4E6.2 size=210444 2024-09-12T00:07:22.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.551+0000 7f82f8930780 1 < canceled multipart upload key=62X93NOS23AF upload=05BDTGWVY4E6 tag=EGL5APMLY2CR type=write size=3356172 2024-09-12T00:07:22.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.553+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~KEIBFDCSL3PP.0 size=1005026 2024-09-12T00:07:22.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.553+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=KEIBFDCSL3PP tag=KLAAZLK1L5DI type=write size=2053602 2024-09-12T00:07:22.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.555+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=JD07XXWFWPM2 type=del 2024-09-12T00:07:22.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.557+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=LB64QPMO10SW type=del size=3607096 2024-09-12T00:07:22.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.558+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~84M96F77WB5Z.0 size=1048576 2024-09-12T00:07:22.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.559+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~84M96F77WB5Z.1 size=1048576 2024-09-12T00:07:22.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.560+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~84M96F77WB5Z.2 size=922280 2024-09-12T00:07:22.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.563+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=84M96F77WB5Z tag=2EMJQESYX5VT type=write size=4068008 2024-09-12T00:07:22.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.565+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=TYJIAAYI1WML type=write size=829373 2024-09-12T00:07:22.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.565+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~UVRT70IWGUL9.0 size=1048576 2024-09-12T00:07:22.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.565+0000 7f82f8930780 1 < canceled part key=_multipart_80OUXNDPLGAG.2~UVRT70IWGUL9.1 size=1048576 2024-09-12T00:07:22.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.567+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~UVRT70IWGUL9.2 size=507650 2024-09-12T00:07:22.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.570+0000 7f82f8930780 1 < canceled multipart upload key=80OUXNDPLGAG upload=UVRT70IWGUL9 tag=NXMG751QME0P type=write size=3653378 2024-09-12T00:07:22.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.570+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=EOSGXWVW94F3 type=del size=3126205 2024-09-12T00:07:22.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.572+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~HZCUXOWQAUPN.0 size=1048576 2024-09-12T00:07:22.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.574+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~HZCUXOWQAUPN.1 size=1048576 2024-09-12T00:07:22.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.575+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~HZCUXOWQAUPN.2 size=81334 2024-09-12T00:07:22.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.577+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=HZCUXOWQAUPN tag=F5YZCHTNGM82 type=write size=3227062 2024-09-12T00:07:22.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.577+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=CV1NY9YVVXFX type=del size=1515466 2024-09-12T00:07:22.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.580+0000 7f82f8930780 1 < completed write operation key=IMAT4ZCLGFRN tag=VN34OI2BRHV2 type=write size=418309 2024-09-12T00:07:22.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.581+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~RMVVYTHSPHTX.0 size=174852 2024-09-12T00:07:22.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.581+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=RMVVYTHSPHTX tag=R2VU7VMH6X7M type=write size=1223428 2024-09-12T00:07:22.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.584+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=C0KVWWB2BDGU type=del 2024-09-12T00:07:22.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.587+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~5SGEDAQHPXJJ.0 size=380288 2024-09-12T00:07:22.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.587+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=5SGEDAQHPXJJ tag=MXV79D7Q5XEQ type=write size=1428864 2024-09-12T00:07:22.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.587+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~KTJJ6FZMVFRV.0 size=1048576 2024-09-12T00:07:22.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.589+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~KTJJ6FZMVFRV.1 size=102865 2024-09-12T00:07:22.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.591+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=KTJJ6FZMVFRV tag=M0TXVVNFS1L7 type=write size=2200017 2024-09-12T00:07:22.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.593+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~ZJYIFD909WNR.0 size=1048576 2024-09-12T00:07:22.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.594+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~ZJYIFD909WNR.1 size=1048576 2024-09-12T00:07:22.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.596+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~ZJYIFD909WNR.2 size=774192 2024-09-12T00:07:22.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.596+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=ZJYIFD909WNR tag=1A338KIMWY1L type=write size=3919920 2024-09-12T00:07:22.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.598+0000 7f82f8930780 1 < completed delete operation key=FOWSB9RQ5TV5 tag=STDPYMTX7S6C type=del 2024-09-12T00:07:22.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.599+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=MV3WGLKUSDQ5 type=del size=922609 2024-09-12T00:07:22.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.601+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~1LZTJ1KPW60P.0 size=710927 2024-09-12T00:07:22.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.603+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=1LZTJ1KPW60P tag=DXU3T49B71GO type=write size=1759503 2024-09-12T00:07:22.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.604+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=6WH4NTQNA8VS type=del size=3658405 2024-09-12T00:07:22.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.605+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~VY87FYXB6B9Z.0 size=313126 2024-09-12T00:07:22.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.609+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=VY87FYXB6B9Z tag=2O11TLR85DEY type=write size=1361702 2024-09-12T00:07:22.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.609+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=HYEP25N00DL8 type=del size=509615 2024-09-12T00:07:22.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.612+0000 7f82f8930780 1 < canceled operation key=QB46N36A27QH tag=LDTG2Q8VC3O3 type=del size=1612888 2024-09-12T00:07:22.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.615+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~QRNJHOVPVTXH.0 size=59622 2024-09-12T00:07:22.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.615+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=QRNJHOVPVTXH tag=R9UR92CB9BI5 type=write size=1108198 2024-09-12T00:07:22.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.616+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=1O82RW5VU3G6 type=del 2024-09-12T00:07:22.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.617+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=NVYHSD4H6UAG type=del size=2024357 2024-09-12T00:07:22.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.620+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=UVEHB325239O type=del 2024-09-12T00:07:22.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.620+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=TNBY30GI46XQ type=del size=1265487 2024-09-12T00:07:22.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.623+0000 7f82f8930780 1 < canceled operation key=O2ZGU2KOTUOT tag=9IKA7Z93H31Z type=del size=1105110 2024-09-12T00:07:22.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.623+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=7ZG1HY3MK2GM type=del size=1793698 2024-09-12T00:07:22.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.625+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=UCNH0DSOSY2O type=del 2024-09-12T00:07:22.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.628+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~BYA1OKHCJR77.0 size=1048576 2024-09-12T00:07:22.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.628+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~BYA1OKHCJR77.1 size=238524 2024-09-12T00:07:22.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.628+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=BYA1OKHCJR77 tag=P92UL7IMU3OX type=write size=2335676 2024-09-12T00:07:22.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.628+0000 7f82f8930780 1 < canceled part key=_multipart_X3PCR8TCWDTK.2~KEIBFDCSL3PP.0 size=1005026 2024-09-12T00:07:22.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.630+0000 7f82f8930780 1 < canceled multipart upload key=X3PCR8TCWDTK upload=KEIBFDCSL3PP tag=KLAAZLK1L5DI type=write size=2053602 2024-09-12T00:07:22.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.634+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~IEG0C4EDT0F6.0 size=1048576 2024-09-12T00:07:22.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.635+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~IEG0C4EDT0F6.1 size=340502 2024-09-12T00:07:22.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.635+0000 7f82f8930780 1 > prepared multipart upload key=77SDZHCSP0E3 upload=IEG0C4EDT0F6 tag=XHATYRMQCQM3 type=write size=2437654 2024-09-12T00:07:22.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.635+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=LB64QPMO10SW type=del 2024-09-12T00:07:22.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.639+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~WGHS4CXEG8NR.0 size=440259 2024-09-12T00:07:22.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.639+0000 7f82f8930780 1 > prepared multipart upload key=77SDZHCSP0E3 upload=WGHS4CXEG8NR tag=C7XGH0113STH type=write size=1488835 2024-09-12T00:07:22.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.641+0000 7f82f8930780 1 < suggested remove operation key=MJZ56OX8PLSH tag=TYJIAAYI1WML type=write 2024-09-12T00:07:22.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.643+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=H8F0CHO9Q9IK type=write size=1021838 2024-09-12T00:07:22.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.643+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=EOSGXWVW94F3 type=del 2024-09-12T00:07:22.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.647+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~003WI2B128VR.0 size=1048576 2024-09-12T00:07:22.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.648+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~003WI2B128VR.1 size=57027 2024-09-12T00:07:22.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.648+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=003WI2B128VR tag=SDVGRPZXCLVG type=write size=2154179 2024-09-12T00:07:22.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.650+0000 7f82f8930780 1 < suggested update operation key=9576W9WYJUJV tag=CV1NY9YVVXFX type=del size=1515466 2024-09-12T00:07:22.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.651+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=K0GJAJ54AH1K type=write size=903769 2024-09-12T00:07:22.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.653+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~RMVVYTHSPHTX.0 size=174852 2024-09-12T00:07:22.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.656+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=RMVVYTHSPHTX tag=R2VU7VMH6X7M type=write size=1223428 2024-09-12T00:07:22.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.657+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=POVTVYH9OIDB type=del size=22482 2024-09-12T00:07:22.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.657+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~5SGEDAQHPXJJ.0 size=380288 2024-09-12T00:07:22.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.661+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=5SGEDAQHPXJJ tag=MXV79D7Q5XEQ type=write size=1428864 2024-09-12T00:07:22.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.662+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=GONHBD1J09B5 type=write size=102799 2024-09-12T00:07:22.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.664+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~ZJYIFD909WNR.0 size=1048576 2024-09-12T00:07:22.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.664+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~ZJYIFD909WNR.1 size=1048576 2024-09-12T00:07:22.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.665+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~ZJYIFD909WNR.2 size=774192 2024-09-12T00:07:22.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.669+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=ZJYIFD909WNR tag=1A338KIMWY1L type=write size=3919920 2024-09-12T00:07:22.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.670+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~65VM05DAWXFI.0 size=1048576 2024-09-12T00:07:22.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.672+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~65VM05DAWXFI.1 size=1048576 2024-09-12T00:07:22.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.673+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~65VM05DAWXFI.2 size=390463 2024-09-12T00:07:22.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.673+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=65VM05DAWXFI tag=ZB8KSC0HGG8V type=write size=3536191 2024-09-12T00:07:22.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.675+0000 7f82f8930780 1 < suggested update operation key=62X93NOS23AF tag=MV3WGLKUSDQ5 type=del size=922609 2024-09-12T00:07:22.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.678+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~Z68E21EISIM0.0 size=1048576 2024-09-12T00:07:22.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.680+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~Z68E21EISIM0.1 size=1048576 2024-09-12T00:07:22.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.680+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~Z68E21EISIM0.2 size=368211 2024-09-12T00:07:22.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.680+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=Z68E21EISIM0 tag=7Y6NVEG1A45R type=write size=3513939 2024-09-12T00:07:22.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.683+0000 7f82f8930780 1 < suggested remove operation key=FOWSB9RQ5TV5 tag=6WH4NTQNA8VS type=del 2024-09-12T00:07:22.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.685+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=X1Z7QE36IKFW type=del size=819727 2024-09-12T00:07:22.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.685+0000 7f82f8930780 -1 < failed to complete operation key=FOWSB9RQ5TV5 tag=HYEP25N00DL8 type=del size=509615: (22) Invalid argument 2024-09-12T00:07:22.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.688+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=PGXDSP5HO6WH type=del size=2770809 2024-09-12T00:07:22.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.688+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~QRNJHOVPVTXH.0 size=59622 2024-09-12T00:07:22.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.691+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=QRNJHOVPVTXH tag=R9UR92CB9BI5 type=write size=1108198 2024-09-12T00:07:22.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.693+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=A9HDCMGCVMU9 type=del size=3385807 2024-09-12T00:07:22.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.694+0000 7f82f8930780 1 < completed delete operation key=N2TYUAJITFNL tag=NVYHSD4H6UAG type=del 2024-09-12T00:07:22.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.695+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=YY8W9PK49UJM type=del size=4078245 2024-09-12T00:07:22.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.696+0000 7f82f8930780 1 < canceled operation key=77SDZHCSP0E3 tag=TNBY30GI46XQ type=del size=1265487 2024-09-12T00:07:22.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.699+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=R77133WO9VSF type=del size=680274 2024-09-12T00:07:22.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.700+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=7ZG1HY3MK2GM type=del 2024-09-12T00:07:22.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.701+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=SYOY9HM38WBT type=del size=1491725 2024-09-12T00:07:22.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.702+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~BYA1OKHCJR77.0 size=1048576 2024-09-12T00:07:22.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.703+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~BYA1OKHCJR77.1 size=238524 2024-09-12T00:07:22.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.706+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=BYA1OKHCJR77 tag=P92UL7IMU3OX type=write size=2335676 2024-09-12T00:07:22.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.708+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=D8JDPQS14NZX type=write size=415815 2024-09-12T00:07:22.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.709+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~IEG0C4EDT0F6.0 size=1048576 2024-09-12T00:07:22.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.710+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~IEG0C4EDT0F6.1 size=340502 2024-09-12T00:07:22.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.713+0000 7f82f8930780 1 < completed multipart upload key=77SDZHCSP0E3 upload=IEG0C4EDT0F6 tag=XHATYRMQCQM3 type=write size=2437654 2024-09-12T00:07:22.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.713+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=ALDU1WV3P1SB type=write size=204243 2024-09-12T00:07:22.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.715+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~WGHS4CXEG8NR.0 size=440259 2024-09-12T00:07:22.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.718+0000 7f82f8930780 1 < completed multipart upload key=77SDZHCSP0E3 upload=WGHS4CXEG8NR tag=C7XGH0113STH type=write size=1488835 2024-09-12T00:07:22.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.718+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=GQ92JMYJ6X3H type=del size=1573766 2024-09-12T00:07:22.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.721+0000 7f82f8930780 1 < completed write operation key=80OUXNDPLGAG tag=H8F0CHO9Q9IK type=write size=1021838 2024-09-12T00:07:22.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.721+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=1A13KQXIZDTV type=del size=2894322 2024-09-12T00:07:22.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.723+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~003WI2B128VR.0 size=1048576 2024-09-12T00:07:22.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.724+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~003WI2B128VR.1 size=57027 2024-09-12T00:07:22.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.727+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=003WI2B128VR tag=SDVGRPZXCLVG type=write size=2154179 2024-09-12T00:07:22.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.729+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~81L9HOKWNAEL.0 size=1048576 2024-09-12T00:07:22.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.730+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~81L9HOKWNAEL.1 size=1048576 2024-09-12T00:07:22.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.731+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~81L9HOKWNAEL.2 size=1015741 2024-09-12T00:07:22.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.731+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=81L9HOKWNAEL tag=BNEOVT1H8HDZ type=write size=4161469 2024-09-12T00:07:22.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.732+0000 7f82f8930780 1 < completed write operation key=80OUXNDPLGAG tag=K0GJAJ54AH1K type=write size=903769 2024-09-12T00:07:22.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.733+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=0I0HLCBQ5E85 type=del size=413085 2024-09-12T00:07:22.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.736+0000 7f82f8930780 1 < canceled operation key=77SDZHCSP0E3 tag=POVTVYH9OIDB type=del size=22482 2024-09-12T00:07:22.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.738+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~ZHOJJOYGNESJ.0 size=1048576 2024-09-12T00:07:22.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.739+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~ZHOJJOYGNESJ.1 size=1048576 2024-09-12T00:07:22.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.740+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~ZHOJJOYGNESJ.2 size=1005048 2024-09-12T00:07:22.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.740+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=ZHOJJOYGNESJ tag=LGDZT0J7DWV3 type=write size=4150776 2024-09-12T00:07:22.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.741+0000 7f82f8930780 -1 < failed to complete operation key=62X93NOS23AF tag=GONHBD1J09B5 type=write size=102799: (22) Invalid argument 2024-09-12T00:07:22.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.746+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~06601IDZVG7V.0 size=39558 2024-09-12T00:07:22.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.746+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=06601IDZVG7V tag=WWUKKZUCKKVX type=write size=1088134 2024-09-12T00:07:22.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.746+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~65VM05DAWXFI.0 size=1048576 2024-09-12T00:07:22.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.747+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~65VM05DAWXFI.1 size=1048576 2024-09-12T00:07:22.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.747+0000 7f82f8930780 1 < canceled part key=_multipart_4SPRDO097JYQ.2~65VM05DAWXFI.2 size=390463 2024-09-12T00:07:22.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.751+0000 7f82f8930780 1 < canceled multipart upload key=4SPRDO097JYQ upload=65VM05DAWXFI tag=ZB8KSC0HGG8V type=write size=3536191 2024-09-12T00:07:22.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.753+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~43858GALZYN6.0 size=992317 2024-09-12T00:07:22.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.753+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=43858GALZYN6 tag=ZLTGBCZ483DU type=write size=2040893 2024-09-12T00:07:22.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.753+0000 7f82f8930780 1 < canceled part key=_multipart_75GYP042UUC2.2~Z68E21EISIM0.0 size=1048576 2024-09-12T00:07:22.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.754+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~Z68E21EISIM0.1 size=1048576 2024-09-12T00:07:22.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.754+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~Z68E21EISIM0.2 size=368211 2024-09-12T00:07:22.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.757+0000 7f82f8930780 1 < canceled multipart upload key=75GYP042UUC2 upload=Z68E21EISIM0 tag=7Y6NVEG1A45R type=write size=3513939 2024-09-12T00:07:22.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.759+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=1SDDOFDX84H0 type=del size=2284385 2024-09-12T00:07:22.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.759+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=X1Z7QE36IKFW type=del 2024-09-12T00:07:22.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.761+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=FBRE95L0VG2Z type=del size=54727 2024-09-12T00:07:22.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.762+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=PGXDSP5HO6WH type=del 2024-09-12T00:07:22.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.765+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~FWVFQGKLXSQA.0 size=877214 2024-09-12T00:07:22.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.765+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=FWVFQGKLXSQA tag=A29V0DM37UH5 type=write size=1925790 2024-09-12T00:07:22.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.767+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=A9HDCMGCVMU9 type=del 2024-09-12T00:07:22.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.767+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=D0MOVPAL2AUD type=del size=2265598 2024-09-12T00:07:22.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.769+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=YY8W9PK49UJM type=del 2024-09-12T00:07:22.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.771+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=QK4ZT3L2Z1NH type=del size=41449 2024-09-12T00:07:22.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.771+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=R77133WO9VSF type=del 2024-09-12T00:07:22.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.774+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=FRQ2OP2U4TAV type=del size=2893974 2024-09-12T00:07:22.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.774+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=SYOY9HM38WBT type=del 2024-09-12T00:07:22.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.775+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=HKUJZ0P5EQ02 type=del size=767971 2024-09-12T00:07:22.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.778+0000 7f82f8930780 1 < completed write operation key=IN8Y7I0HKP6D tag=D8JDPQS14NZX type=write size=415815 2024-09-12T00:07:22.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.779+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~WHS17P1D6GPA.0 size=637696 2024-09-12T00:07:22.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.779+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=WHS17P1D6GPA tag=A8X8TC1DR2T5 type=write size=1686272 2024-09-12T00:07:22.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.782+0000 7f82f8930780 1 < completed write operation key=O2ZGU2KOTUOT tag=ALDU1WV3P1SB type=write size=204243 2024-09-12T00:07:22.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.783+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=SYXBCFLFTU9W type=del size=66506 2024-09-12T00:07:22.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.784+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=GQ92JMYJ6X3H type=del 2024-09-12T00:07:22.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.786+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=6ZYQ7Q0FT7L1 type=del size=3831374 2024-09-12T00:07:22.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.786+0000 7f82f8930780 1 < completed delete operation key=N2TYUAJITFNL tag=1A13KQXIZDTV type=del 2024-09-12T00:07:22.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.790+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~FK37FTPIHDPL.0 size=1048576 2024-09-12T00:07:22.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.790+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~FK37FTPIHDPL.1 size=1048576 2024-09-12T00:07:22.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.791+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~FK37FTPIHDPL.2 size=333031 2024-09-12T00:07:22.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.791+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=FK37FTPIHDPL tag=264964P3GBAJ type=write size=3478759 2024-09-12T00:07:22.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.794+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~81L9HOKWNAEL.0 size=1048576 2024-09-12T00:07:22.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.794+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~81L9HOKWNAEL.1 size=1048576 2024-09-12T00:07:22.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.796+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~81L9HOKWNAEL.2 size=1015741 2024-09-12T00:07:22.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.797+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=81L9HOKWNAEL tag=BNEOVT1H8HDZ type=write size=4161469 2024-09-12T00:07:22.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.801+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~AQDDEO090RO1.0 size=1048576 2024-09-12T00:07:22.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.802+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~AQDDEO090RO1.1 size=874004 2024-09-12T00:07:22.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.802+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=AQDDEO090RO1 tag=1CEEIBG4Z47Y type=write size=2971156 2024-09-12T00:07:22.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.804+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=0I0HLCBQ5E85 type=del 2024-09-12T00:07:22.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.806+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=5935UFUGGF91 type=write size=327007 2024-09-12T00:07:22.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.806+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~ZHOJJOYGNESJ.0 size=1048576 2024-09-12T00:07:22.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.808+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~ZHOJJOYGNESJ.1 size=1048576 2024-09-12T00:07:22.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.809+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~ZHOJJOYGNESJ.2 size=1005048 2024-09-12T00:07:22.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.812+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=ZHOJJOYGNESJ tag=LGDZT0J7DWV3 type=write size=4150776 2024-09-12T00:07:22.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.814+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~Q9MIXF95HA7U.0 size=936110 2024-09-12T00:07:22.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.814+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=Q9MIXF95HA7U tag=89TXH6XNGO1A type=write size=1984686 2024-09-12T00:07:22.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.816+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~06601IDZVG7V.0 size=39558 2024-09-12T00:07:22.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.818+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=06601IDZVG7V tag=WWUKKZUCKKVX type=write size=1088134 2024-09-12T00:07:22.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.819+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=9XHAHSO8BYIY type=del size=3572350 2024-09-12T00:07:22.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.820+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~43858GALZYN6.0 size=992317 2024-09-12T00:07:22.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.823+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=43858GALZYN6 tag=ZLTGBCZ483DU type=write size=2040893 2024-09-12T00:07:22.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.824+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=3WVM5QKY12Q5 type=write size=225793 2024-09-12T00:07:22.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.827+0000 7f82f8930780 1 < canceled operation key=A8EFUP30RS65 tag=1SDDOFDX84H0 type=del size=2284385 2024-09-12T00:07:22.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.827+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=C7I1BS1YUL4R type=del size=1435476 2024-09-12T00:07:22.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.830+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=FBRE95L0VG2Z type=del 2024-09-12T00:07:22.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.833+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~5JRRWBSJD24Z.0 size=1048576 2024-09-12T00:07:22.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.834+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~5JRRWBSJD24Z.1 size=1048576 2024-09-12T00:07:22.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.834+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~5JRRWBSJD24Z.2 size=423449 2024-09-12T00:07:22.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.834+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=5JRRWBSJD24Z tag=S59H32AHK6R4 type=write size=3569177 2024-09-12T00:07:22.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.836+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~FWVFQGKLXSQA.0 size=877214 2024-09-12T00:07:22.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.837+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=FWVFQGKLXSQA tag=A29V0DM37UH5 type=write size=1925790 2024-09-12T00:07:22.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.840+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=BQ0G4XPHJW4I type=del size=915959 2024-09-12T00:07:22.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.842+0000 7f82f8930780 1 < suggested update operation key=OVJOP07M9KB8 tag=D0MOVPAL2AUD type=del size=2265598 2024-09-12T00:07:22.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.844+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=KIMW1PVES2EV type=del size=1519243 2024-09-12T00:07:22.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.844+0000 7f82f8930780 1 < completed delete operation key=N2TYUAJITFNL tag=QK4ZT3L2Z1NH type=del 2024-09-12T00:07:22.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.847+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~2TU0X0VUBCPQ.0 size=473818 2024-09-12T00:07:22.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.847+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=2TU0X0VUBCPQ tag=HM1SUL1LDSMO type=write size=1522394 2024-09-12T00:07:22.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.848+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=FRQ2OP2U4TAV type=del 2024-09-12T00:07:22.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.851+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~FFW3XNADA64W.0 size=1048576 2024-09-12T00:07:22.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.853+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~FFW3XNADA64W.1 size=1048576 2024-09-12T00:07:22.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.853+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~FFW3XNADA64W.2 size=237920 2024-09-12T00:07:22.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.853+0000 7f82f8930780 1 > prepared multipart upload key=4IA4918NXXJW upload=FFW3XNADA64W tag=MT13XQUYMQJS type=write size=3383648 2024-09-12T00:07:22.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.855+0000 7f82f8930780 1 < suggested update operation key=80OUXNDPLGAG tag=HKUJZ0P5EQ02 type=del size=767971 2024-09-12T00:07:22.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.857+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=NT2C631GV1QI type=del size=257436 2024-09-12T00:07:22.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.859+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~WHS17P1D6GPA.0 size=637696 2024-09-12T00:07:22.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.861+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=WHS17P1D6GPA tag=A8X8TC1DR2T5 type=write size=1686272 2024-09-12T00:07:22.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.863+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=YFS2MKMS2DPK type=del size=1621913 2024-09-12T00:07:22.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.863+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=SYXBCFLFTU9W type=del 2024-09-12T00:07:22.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.865+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=5QLB3BXIEYRL type=del size=367185 2024-09-12T00:07:22.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.866+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=6ZYQ7Q0FT7L1 type=del 2024-09-12T00:07:22.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.867+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=5F94CF7FOAY3 type=del size=1463495 2024-09-12T00:07:22.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.868+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~FK37FTPIHDPL.0 size=1048576 2024-09-12T00:07:22.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.870+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~FK37FTPIHDPL.1 size=1048576 2024-09-12T00:07:22.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.872+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~FK37FTPIHDPL.2 size=333031 2024-09-12T00:07:22.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.873+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=FK37FTPIHDPL tag=264964P3GBAJ type=write size=3478759 2024-09-12T00:07:22.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.876+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=A38OTR6BVIXE type=write size=354390 2024-09-12T00:07:22.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.878+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~AQDDEO090RO1.0 size=1048576 2024-09-12T00:07:22.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.878+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~AQDDEO090RO1.1 size=874004 2024-09-12T00:07:22.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.880+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=AQDDEO090RO1 tag=1CEEIBG4Z47Y type=write size=2971156 2024-09-12T00:07:22.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.883+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~S3YX7AQRUAIC.0 size=1048576 2024-09-12T00:07:22.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.885+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~S3YX7AQRUAIC.1 size=1048576 2024-09-12T00:07:22.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.885+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~S3YX7AQRUAIC.2 size=947235 2024-09-12T00:07:22.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.885+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=S3YX7AQRUAIC tag=LTZJTSEIP2U1 type=write size=4092963 2024-09-12T00:07:22.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.887+0000 7f82f8930780 1 < completed write operation key=4SPRDO097JYQ tag=5935UFUGGF91 type=write size=327007 2024-09-12T00:07:22.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.890+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~XY6H4J9SS7HG.0 size=1048576 2024-09-12T00:07:22.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.890+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~XY6H4J9SS7HG.1 size=1048576 2024-09-12T00:07:22.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.892+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~XY6H4J9SS7HG.2 size=734798 2024-09-12T00:07:22.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.892+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=XY6H4J9SS7HG tag=PA2DT7Z9ASOR type=write size=3880526 2024-09-12T00:07:22.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.893+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~Q9MIXF95HA7U.0 size=936110 2024-09-12T00:07:22.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.895+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=Q9MIXF95HA7U tag=89TXH6XNGO1A type=write size=1984686 2024-09-12T00:07:22.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.897+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=C3LQNBSCYEFB type=del size=544400 2024-09-12T00:07:22.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.899+0000 7f82f8930780 1 < suggested remove operation key=HCK59C6MAW0B tag=9XHAHSO8BYIY type=del 2024-09-12T00:07:22.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.901+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=X9YO4DCTO07V type=write size=87008 2024-09-12T00:07:22.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.901+0000 7f82f8930780 1 < completed write operation key=N2TYUAJITFNL tag=3WVM5QKY12Q5 type=write size=225793 2024-09-12T00:07:22.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.904+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=9786YRG1HE8A type=del size=1055704 2024-09-12T00:07:22.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.905+0000 7f82f8930780 1 < canceled operation key=Y8GDXNDCOHCW tag=C7I1BS1YUL4R type=del size=1435476 2024-09-12T00:07:22.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.905+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=Q58UWHP96X2I type=write size=362885 2024-09-12T00:07:22.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.908+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~5JRRWBSJD24Z.0 size=1048576 2024-09-12T00:07:22.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.909+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~5JRRWBSJD24Z.1 size=1048576 2024-09-12T00:07:22.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.910+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~5JRRWBSJD24Z.2 size=423449 2024-09-12T00:07:22.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.911+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=5JRRWBSJD24Z tag=S59H32AHK6R4 type=write size=3569177 2024-09-12T00:07:22.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.915+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~THMQ33LJES5T.0 size=1048576 2024-09-12T00:07:22.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.916+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~THMQ33LJES5T.1 size=1048576 2024-09-12T00:07:22.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.917+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~THMQ33LJES5T.2 size=880075 2024-09-12T00:07:22.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.917+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=THMQ33LJES5T tag=ZE15FTBPV5TY type=write size=4025803 2024-09-12T00:07:22.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.918+0000 7f82f8930780 1 < suggested remove operation key=9576W9WYJUJV tag=BQ0G4XPHJW4I type=del 2024-09-12T00:07:22.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.922+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~778HQKIYS1GO.0 size=1048576 2024-09-12T00:07:22.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.923+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~778HQKIYS1GO.1 size=786160 2024-09-12T00:07:22.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.923+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=778HQKIYS1GO tag=NXEDUVLH5QLA type=write size=2883312 2024-09-12T00:07:22.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.925+0000 7f82f8930780 1 < suggested update operation key=IMAT4ZCLGFRN tag=KIMW1PVES2EV type=del size=1519243 2024-09-12T00:07:22.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.926+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=JIXCSO421T92 type=write size=160808 2024-09-12T00:07:22.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.927+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~2TU0X0VUBCPQ.0 size=473818 2024-09-12T00:07:22.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.929+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=2TU0X0VUBCPQ tag=HM1SUL1LDSMO type=write size=1522394 2024-09-12T00:07:22.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.932+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=4LC2H6QRKKJQ type=write size=362237 2024-09-12T00:07:22.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.932+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~FFW3XNADA64W.0 size=1048576 2024-09-12T00:07:22.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.933+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~FFW3XNADA64W.1 size=1048576 2024-09-12T00:07:22.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.935+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~FFW3XNADA64W.2 size=237920 2024-09-12T00:07:22.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.937+0000 7f82f8930780 1 < completed multipart upload key=4IA4918NXXJW upload=FFW3XNADA64W tag=MT13XQUYMQJS type=write size=3383648 2024-09-12T00:07:22.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.940+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~BVRR12F965WM.0 size=151071 2024-09-12T00:07:22.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.940+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=BVRR12F965WM tag=CVWXZECKMKDG type=write size=1199647 2024-09-12T00:07:22.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.942+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=NT2C631GV1QI type=del 2024-09-12T00:07:22.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.942+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=2TIXDYT9OCDR type=del size=3495763 2024-09-12T00:07:22.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.945+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=YFS2MKMS2DPK type=del 2024-09-12T00:07:22.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.945+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=N3ZMKZLNDG7A type=del size=482539 2024-09-12T00:07:22.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.947+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=5QLB3BXIEYRL type=del 2024-09-12T00:07:22.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.950+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~CCW89XRI1F2S.0 size=1048576 2024-09-12T00:07:22.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.950+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~CCW89XRI1F2S.1 size=1036338 2024-09-12T00:07:22.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.950+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=CCW89XRI1F2S tag=1ECYOSIC3LE8 type=write size=3133490 2024-09-12T00:07:22.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.953+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=5F94CF7FOAY3 type=del 2024-09-12T00:07:22.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.953+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=QLNBPJ8EPCJ2 type=del size=646327 2024-09-12T00:07:22.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.956+0000 7f82f8930780 1 < completed write operation key=O2ZGU2KOTUOT tag=A38OTR6BVIXE type=write size=354390 2024-09-12T00:07:22.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.958+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~OXVB1EV5OJEU.0 size=1048576 2024-09-12T00:07:22.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.959+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~OXVB1EV5OJEU.1 size=1048576 2024-09-12T00:07:22.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.960+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~OXVB1EV5OJEU.2 size=478895 2024-09-12T00:07:22.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.960+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=OXVB1EV5OJEU tag=QWD9BKFL6EK7 type=write size=3624623 2024-09-12T00:07:22.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.961+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~S3YX7AQRUAIC.0 size=1048576 2024-09-12T00:07:22.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.962+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~S3YX7AQRUAIC.1 size=1048576 2024-09-12T00:07:22.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.964+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~S3YX7AQRUAIC.2 size=947235 2024-09-12T00:07:22.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.966+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=S3YX7AQRUAIC tag=LTZJTSEIP2U1 type=write size=4092963 2024-09-12T00:07:22.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.967+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=KIN6DOASZLZ3 type=del size=2850610 2024-09-12T00:07:22.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.968+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~XY6H4J9SS7HG.0 size=1048576 2024-09-12T00:07:22.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.970+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~XY6H4J9SS7HG.1 size=1048576 2024-09-12T00:07:22.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.971+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~XY6H4J9SS7HG.2 size=734798 2024-09-12T00:07:22.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.973+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=XY6H4J9SS7HG tag=PA2DT7Z9ASOR type=write size=3880526 2024-09-12T00:07:22.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.974+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=DJ10NBRQ2VIR type=del size=1407270 2024-09-12T00:07:22.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.976+0000 7f82f8930780 1 < canceled operation key=77SDZHCSP0E3 tag=C3LQNBSCYEFB type=del size=544400 2024-09-12T00:07:22.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.976+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=YQ8IDU51VRU3 type=del size=1233576 2024-09-12T00:07:22.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.979+0000 7f82f8930780 1 < completed write operation key=80OUXNDPLGAG tag=X9YO4DCTO07V type=write size=87008 2024-09-12T00:07:22.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.980+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=LP1OJ5X6Y5YO type=del size=3056950 2024-09-12T00:07:22.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.980+0000 7f82f8930780 1 < completed delete operation key=FOWSB9RQ5TV5 tag=9786YRG1HE8A type=del 2024-09-12T00:07:22.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.983+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=FRC0R22CGPRB type=del size=3252067 2024-09-12T00:07:22.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.983+0000 7f82f8930780 1 < completed write operation key=O2ZGU2KOTUOT tag=Q58UWHP96X2I type=write size=362885 2024-09-12T00:07:22.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.985+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=BCO299I7EXKW type=write size=547354 2024-09-12T00:07:22.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.985+0000 7f82f8930780 1 < canceled part key=_multipart_9576W9WYJUJV.2~THMQ33LJES5T.0 size=1048576 2024-09-12T00:07:22.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.986+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~THMQ33LJES5T.1 size=1048576 2024-09-12T00:07:22.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.987+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~THMQ33LJES5T.2 size=880075 2024-09-12T00:07:22.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.989+0000 7f82f8930780 1 < canceled multipart upload key=9576W9WYJUJV upload=THMQ33LJES5T tag=ZE15FTBPV5TY type=write size=4025803 2024-09-12T00:07:22.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.991+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=DC4X513YYDBG type=write size=14847 2024-09-12T00:07:22.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.992+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~778HQKIYS1GO.0 size=1048576 2024-09-12T00:07:22.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.993+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~778HQKIYS1GO.1 size=786160 2024-09-12T00:07:22.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.996+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=778HQKIYS1GO tag=NXEDUVLH5QLA type=write size=2883312 2024-09-12T00:07:22.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.996+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=JP75WL04XH77 type=del size=2798904 2024-09-12T00:07:22.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.999+0000 7f82f8930780 1 < completed write operation key=4SPRDO097JYQ tag=JIXCSO421T92 type=write size=160808 2024-09-12T00:07:22.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:22.999+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=M5X3734QOGIS type=del size=3907604 2024-09-12T00:07:23.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.003+0000 7f82f8930780 1 < completed write operation key=YWC5JUV5B2N6 tag=4LC2H6QRKKJQ type=write size=362237 2024-09-12T00:07:23.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.004+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~JFG1BUHN1FD5.0 size=176662 2024-09-12T00:07:23.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.004+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=JFG1BUHN1FD5 tag=EP8TRGMA4HVV type=write size=1225238 2024-09-12T00:07:23.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.004+0000 7f82f8930780 1 < canceled part key=_multipart_QB46N36A27QH.2~BVRR12F965WM.0 size=151071 2024-09-12T00:07:23.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.006+0000 7f82f8930780 1 < canceled multipart upload key=QB46N36A27QH upload=BVRR12F965WM tag=CVWXZECKMKDG type=write size=1199647 2024-09-12T00:07:23.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.010+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~7JWLRGVDEFKD.0 size=1048576 2024-09-12T00:07:23.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.010+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~7JWLRGVDEFKD.1 size=1048576 2024-09-12T00:07:23.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.011+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~7JWLRGVDEFKD.2 size=164153 2024-09-12T00:07:23.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.011+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=7JWLRGVDEFKD tag=W83Z07WDDXFB type=write size=3309881 2024-09-12T00:07:23.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.014+0000 7f82f8930780 1 < suggested update operation key=A8EFUP30RS65 tag=2TIXDYT9OCDR type=del size=3495763 2024-09-12T00:07:23.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.016+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~JV8MEZWMKAS2.0 size=1048576 2024-09-12T00:07:23.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.017+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~JV8MEZWMKAS2.1 size=1048576 2024-09-12T00:07:23.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.018+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~JV8MEZWMKAS2.2 size=583397 2024-09-12T00:07:23.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.018+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=JV8MEZWMKAS2 tag=1Y56DPM0BHZD type=write size=3729125 2024-09-12T00:07:23.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.019+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=N3ZMKZLNDG7A type=del 2024-09-12T00:07:23.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.022+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~WE1WDMVP1N28.0 size=1042073 2024-09-12T00:07:23.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.022+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=WE1WDMVP1N28 tag=K4QIVBNJ1UNL type=write size=2090649 2024-09-12T00:07:23.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.022+0000 7f82f8930780 1 < canceled part key=_multipart_BJHGNT3HBS25.2~CCW89XRI1F2S.0 size=1048576 2024-09-12T00:07:23.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.023+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~CCW89XRI1F2S.1 size=1036338 2024-09-12T00:07:23.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.026+0000 7f82f8930780 1 < canceled multipart upload key=BJHGNT3HBS25 upload=CCW89XRI1F2S tag=1ECYOSIC3LE8 type=write size=3133490 2024-09-12T00:07:23.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.027+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=6SDJ9TLLEQ1H type=del size=3630062 2024-09-12T00:07:23.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.028+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=QLNBPJ8EPCJ2 type=del 2024-09-12T00:07:23.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.030+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=5NSPQZWBTC50 type=del size=1339077 2024-09-12T00:07:23.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.032+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~OXVB1EV5OJEU.0 size=1048576 2024-09-12T00:07:23.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.032+0000 7f82f8930780 1 < canceled part key=_multipart_FOWSB9RQ5TV5.2~OXVB1EV5OJEU.1 size=1048576 2024-09-12T00:07:23.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.033+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~OXVB1EV5OJEU.2 size=478895 2024-09-12T00:07:23.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.035+0000 7f82f8930780 1 < canceled multipart upload key=FOWSB9RQ5TV5 upload=OXVB1EV5OJEU tag=QWD9BKFL6EK7 type=write size=3624623 2024-09-12T00:07:23.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.037+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~LF436B0LR6VP.0 size=186887 2024-09-12T00:07:23.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.037+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=LF436B0LR6VP tag=YRRZTG43AWRM type=write size=1235463 2024-09-12T00:07:23.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.040+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=KIN6DOASZLZ3 type=del 2024-09-12T00:07:23.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.041+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~NI7AFW8FVTU6.0 size=1048576 2024-09-12T00:07:23.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.042+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~NI7AFW8FVTU6.1 size=138663 2024-09-12T00:07:23.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.042+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=NI7AFW8FVTU6 tag=M4P0EJ7KPSQL type=write size=2235815 2024-09-12T00:07:23.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.043+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=DJ10NBRQ2VIR type=del 2024-09-12T00:07:23.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.045+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=ZI79A5DZN5ZI type=del size=653297 2024-09-12T00:07:23.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.046+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=YQ8IDU51VRU3 type=del 2024-09-12T00:07:23.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.050+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~X23W2GAZ8I61.0 size=716394 2024-09-12T00:07:23.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.050+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=X23W2GAZ8I61 tag=0T8DJ4XDTVUM type=write size=1764970 2024-09-12T00:07:23.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.050+0000 7f82f8930780 1 < completed delete operation key=N2TYUAJITFNL tag=LP1OJ5X6Y5YO type=del 2024-09-12T00:07:23.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.054+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~MS3TVCFC2NXC.0 size=1048576 2024-09-12T00:07:23.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.054+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~MS3TVCFC2NXC.1 size=285074 2024-09-12T00:07:23.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.054+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=MS3TVCFC2NXC tag=OFDBRL8YLK7R type=write size=2382226 2024-09-12T00:07:23.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.056+0000 7f82f8930780 1 < suggested update operation key=3H3D067Z8O0R tag=FRC0R22CGPRB type=del size=3252067 2024-09-12T00:07:23.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.058+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=XOZ5OOENHZ8X type=write size=273845 2024-09-12T00:07:23.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.060+0000 7f82f8930780 1 < suggested update operation key=62X93NOS23AF tag=BCO299I7EXKW type=write size=547354 2024-09-12T00:07:23.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.061+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=SDJS45D5Z9UZ type=del size=3845801 2024-09-12T00:07:23.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.063+0000 7f82f8930780 -1 < failed to complete operation key=A8EFUP30RS65 tag=DC4X513YYDBG type=write size=14847: (22) Invalid argument 2024-09-12T00:07:23.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.064+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=1OBTKCG8Q94Q type=del size=1326347 2024-09-12T00:07:23.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.065+0000 7f82f8930780 1 < completed delete operation key=N2TYUAJITFNL tag=JP75WL04XH77 type=del 2024-09-12T00:07:23.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.066+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=WHNFDH1BG3BA type=write size=68753 2024-09-12T00:07:23.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.068+0000 7f82f8930780 -1 < failed to complete operation key=3H3D067Z8O0R tag=M5X3734QOGIS type=del size=3907604: (22) Invalid argument 2024-09-12T00:07:23.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.070+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~LFKUZDQ1PZ6V.0 size=1048576 2024-09-12T00:07:23.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.071+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~LFKUZDQ1PZ6V.1 size=656445 2024-09-12T00:07:23.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.071+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=LFKUZDQ1PZ6V tag=6J0Q5OTHP90S type=write size=2753597 2024-09-12T00:07:23.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.073+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~JFG1BUHN1FD5.0 size=176662 2024-09-12T00:07:23.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.075+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=JFG1BUHN1FD5 tag=EP8TRGMA4HVV type=write size=1225238 2024-09-12T00:07:23.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.077+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~TOLWMDRKDJAK.0 size=1048576 2024-09-12T00:07:23.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.078+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~TOLWMDRKDJAK.1 size=940679 2024-09-12T00:07:23.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.078+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=TOLWMDRKDJAK tag=0Q1WYFTCH37O type=write size=3037831 2024-09-12T00:07:23.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.080+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~7JWLRGVDEFKD.0 size=1048576 2024-09-12T00:07:23.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.081+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~7JWLRGVDEFKD.1 size=1048576 2024-09-12T00:07:23.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.083+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~7JWLRGVDEFKD.2 size=164153 2024-09-12T00:07:23.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.085+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=7JWLRGVDEFKD tag=W83Z07WDDXFB type=write size=3309881 2024-09-12T00:07:23.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.085+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=6SOCKTSHJZM5 type=del size=1887936 2024-09-12T00:07:23.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.087+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~JV8MEZWMKAS2.0 size=1048576 2024-09-12T00:07:23.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.088+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~JV8MEZWMKAS2.1 size=1048576 2024-09-12T00:07:23.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.090+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~JV8MEZWMKAS2.2 size=583397 2024-09-12T00:07:23.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.092+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=JV8MEZWMKAS2 tag=1Y56DPM0BHZD type=write size=3729125 2024-09-12T00:07:23.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.093+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=BGITOWY0RCNG type=write size=44965 2024-09-12T00:07:23.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.094+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~WE1WDMVP1N28.0 size=1042073 2024-09-12T00:07:23.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.096+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=WE1WDMVP1N28 tag=K4QIVBNJ1UNL type=write size=2090649 2024-09-12T00:07:23.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.100+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~3XE4H2JBIK1X.0 size=1048576 2024-09-12T00:07:23.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.101+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~3XE4H2JBIK1X.1 size=73775 2024-09-12T00:07:23.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.101+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=3XE4H2JBIK1X tag=OSAT8O1RTCOJ type=write size=2170927 2024-09-12T00:07:23.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.103+0000 7f82f8930780 1 < suggested update operation key=OVJOP07M9KB8 tag=6SDJ9TLLEQ1H type=del size=3630062 2024-09-12T00:07:23.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.104+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=3S3QWBMNAHHR type=del size=466820 2024-09-12T00:07:23.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.107+0000 7f82f8930780 -1 < failed to complete operation key=62X93NOS23AF tag=5NSPQZWBTC50 type=del size=1339077: (22) Invalid argument 2024-09-12T00:07:23.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.107+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=HCBB979HCBKO type=write size=84326 2024-09-12T00:07:23.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.109+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~LF436B0LR6VP.0 size=186887 2024-09-12T00:07:23.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.112+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=LF436B0LR6VP tag=YRRZTG43AWRM type=write size=1235463 2024-09-12T00:07:23.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.115+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~1EGFCO2HHGOQ.0 size=142511 2024-09-12T00:07:23.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.115+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=1EGFCO2HHGOQ tag=ZTQ86HD1BDKM type=write size=1191087 2024-09-12T00:07:23.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.116+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~NI7AFW8FVTU6.0 size=1048576 2024-09-12T00:07:23.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.116+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~NI7AFW8FVTU6.1 size=138663 2024-09-12T00:07:23.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.120+0000 7f82f8930780 1 < completed multipart upload key=W8SAQZWQHY36 upload=NI7AFW8FVTU6 tag=M4P0EJ7KPSQL type=write size=2235815 2024-09-12T00:07:23.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.120+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=4EYRR2GNMFTJ type=write size=285680 2024-09-12T00:07:23.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.122+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=ZI79A5DZN5ZI type=del 2024-09-12T00:07:23.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.123+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=1XV99SSA3C16 type=del size=105777 2024-09-12T00:07:23.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.123+0000 7f82f8930780 1 < canceled part key=_multipart_OVJOP07M9KB8.2~X23W2GAZ8I61.0 size=716394 2024-09-12T00:07:23.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.125+0000 7f82f8930780 1 < canceled multipart upload key=OVJOP07M9KB8 upload=X23W2GAZ8I61 tag=0T8DJ4XDTVUM type=write size=1764970 2024-09-12T00:07:23.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.129+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=KBLSDOT3POY9 type=del size=1506585 2024-09-12T00:07:23.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.131+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~MS3TVCFC2NXC.0 size=1048576 2024-09-12T00:07:23.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.131+0000 7f82f8930780 1 < canceled part key=_multipart_O2ZGU2KOTUOT.2~MS3TVCFC2NXC.1 size=285074 2024-09-12T00:07:23.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.132+0000 7f82f8930780 1 < canceled multipart upload key=O2ZGU2KOTUOT upload=MS3TVCFC2NXC tag=OFDBRL8YLK7R type=write size=2382226 2024-09-12T00:07:23.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.133+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=VJKY4GAHZ10J type=del size=1885668 2024-09-12T00:07:23.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.135+0000 7f82f8930780 1 < completed write operation key=LAKJS79KNBY7 tag=XOZ5OOENHZ8X type=write size=273845 2024-09-12T00:07:23.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.138+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~7U9QNB6MDE2D.0 size=749960 2024-09-12T00:07:23.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.138+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=7U9QNB6MDE2D tag=2C2YFXQAF3MC type=write size=1798536 2024-09-12T00:07:23.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.139+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=SDJS45D5Z9UZ type=del 2024-09-12T00:07:23.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.142+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~R58HC4NLIO2I.0 size=994196 2024-09-12T00:07:23.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.142+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=R58HC4NLIO2I tag=UPGOQQJFLQTW type=write size=2042772 2024-09-12T00:07:23.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.144+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=1OBTKCG8Q94Q type=del 2024-09-12T00:07:23.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.146+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~XSLDVYIF7AWL.0 size=1048576 2024-09-12T00:07:23.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.147+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~XSLDVYIF7AWL.1 size=863902 2024-09-12T00:07:23.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.147+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=XSLDVYIF7AWL tag=LJZRE0JGDQEY type=write size=2961054 2024-09-12T00:07:23.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.150+0000 7f82f8930780 1 < canceled operation key=4SPRDO097JYQ tag=WHNFDH1BG3BA type=write size=68753 2024-09-12T00:07:23.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.152+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~S52XPN3LQ3QU.0 size=1048576 2024-09-12T00:07:23.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.153+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~S52XPN3LQ3QU.1 size=1048576 2024-09-12T00:07:23.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.154+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~S52XPN3LQ3QU.2 size=383199 2024-09-12T00:07:23.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.154+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=S52XPN3LQ3QU tag=VG120JKRKBR4 type=write size=3528927 2024-09-12T00:07:23.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.155+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~LFKUZDQ1PZ6V.0 size=1048576 2024-09-12T00:07:23.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.157+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~LFKUZDQ1PZ6V.1 size=656445 2024-09-12T00:07:23.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.159+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=LFKUZDQ1PZ6V tag=6J0Q5OTHP90S type=write size=2753597 2024-09-12T00:07:23.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.160+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=MHS3ZBGFZ5W6 type=write size=586101 2024-09-12T00:07:23.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.161+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~TOLWMDRKDJAK.0 size=1048576 2024-09-12T00:07:23.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.162+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~TOLWMDRKDJAK.1 size=940679 2024-09-12T00:07:23.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.164+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=TOLWMDRKDJAK tag=0Q1WYFTCH37O type=write size=3037831 2024-09-12T00:07:23.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.166+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=6F0N6XB7QPM3 type=write size=836040 2024-09-12T00:07:23.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.167+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=6SOCKTSHJZM5 type=del 2024-09-12T00:07:23.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.171+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~API5SR1HJDHB.0 size=1048576 2024-09-12T00:07:23.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.171+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~API5SR1HJDHB.1 size=1048576 2024-09-12T00:07:23.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.172+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~API5SR1HJDHB.2 size=243020 2024-09-12T00:07:23.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.172+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=API5SR1HJDHB tag=EDE1NY4ZRBW5 type=write size=3388748 2024-09-12T00:07:23.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.175+0000 7f82f8930780 1 < completed write operation key=QB46N36A27QH tag=BGITOWY0RCNG type=write size=44965 2024-09-12T00:07:23.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.175+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=S2EWFF84KBLZ type=write size=908372 2024-09-12T00:07:23.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.178+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~3XE4H2JBIK1X.0 size=1048576 2024-09-12T00:07:23.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.179+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~3XE4H2JBIK1X.1 size=73775 2024-09-12T00:07:23.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.181+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=3XE4H2JBIK1X tag=OSAT8O1RTCOJ type=write size=2170927 2024-09-12T00:07:23.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.183+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=94B9OI5KDGGI type=del size=2237 2024-09-12T00:07:23.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.185+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=3S3QWBMNAHHR type=del 2024-09-12T00:07:23.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.187+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=5H33GAZ7FZXJ type=del size=1845704 2024-09-12T00:07:23.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.187+0000 7f82f8930780 1 < completed write operation key=LAKJS79KNBY7 tag=HCBB979HCBKO type=write size=84326 2024-09-12T00:07:23.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.188+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=TZJBTGO7BHY9 type=del size=980093 2024-09-12T00:07:23.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.190+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~1EGFCO2HHGOQ.0 size=142511 2024-09-12T00:07:23.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.193+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=1EGFCO2HHGOQ tag=ZTQ86HD1BDKM type=write size=1191087 2024-09-12T00:07:23.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.195+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=Q1CCF51I9TTA type=write size=941093 2024-09-12T00:07:23.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.197+0000 7f82f8930780 1 < completed write operation key=X3PCR8TCWDTK tag=4EYRR2GNMFTJ type=write size=285680 2024-09-12T00:07:23.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.197+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=WEQJFW17LMCL type=del size=3345978 2024-09-12T00:07:23.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.199+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=1XV99SSA3C16 type=del 2024-09-12T00:07:23.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.201+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~K1S4GF204CUI.0 size=1048576 2024-09-12T00:07:23.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.202+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~K1S4GF204CUI.1 size=1041955 2024-09-12T00:07:23.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.202+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=K1S4GF204CUI tag=UTI7OW3HOJ1Y type=write size=3139107 2024-09-12T00:07:23.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.205+0000 7f82f8930780 1 < suggested update operation key=AMWMQXO10EXK tag=KBLSDOT3POY9 type=del size=1506585 2024-09-12T00:07:23.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.206+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=V5XRSYGMPHZV type=del size=3363934 2024-09-12T00:07:23.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.209+0000 7f82f8930780 1 < suggested remove operation key=3X2PLA3ODHJ1 tag=VJKY4GAHZ10J type=del 2024-09-12T00:07:23.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.212+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~BWGE0FMHNUDV.0 size=1048576 2024-09-12T00:07:23.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.213+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~BWGE0FMHNUDV.1 size=1048576 2024-09-12T00:07:23.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.213+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~BWGE0FMHNUDV.2 size=370140 2024-09-12T00:07:23.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.213+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=BWGE0FMHNUDV tag=69ESON3UAIEE type=write size=3515868 2024-09-12T00:07:23.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.215+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~7U9QNB6MDE2D.0 size=749960 2024-09-12T00:07:23.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.217+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=7U9QNB6MDE2D tag=2C2YFXQAF3MC type=write size=1798536 2024-09-12T00:07:23.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.220+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~TOJ8HA9TS9ZJ.0 size=1048576 2024-09-12T00:07:23.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.221+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~TOJ8HA9TS9ZJ.1 size=233264 2024-09-12T00:07:23.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.221+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=TOJ8HA9TS9ZJ tag=X5R5724608RZ type=write size=2330416 2024-09-12T00:07:23.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.223+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~R58HC4NLIO2I.0 size=994196 2024-09-12T00:07:23.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.224+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=R58HC4NLIO2I tag=UPGOQQJFLQTW type=write size=2042772 2024-09-12T00:07:23.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.228+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~V58VD84BH993.0 size=1048576 2024-09-12T00:07:23.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.228+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~V58VD84BH993.1 size=1048576 2024-09-12T00:07:23.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.229+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~V58VD84BH993.2 size=940015 2024-09-12T00:07:23.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.229+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=V58VD84BH993 tag=ZJY3U6G5SM1L type=write size=4085743 2024-09-12T00:07:23.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.230+0000 7f82f8930780 1 < canceled part key=_multipart_9576W9WYJUJV.2~XSLDVYIF7AWL.0 size=1048576 2024-09-12T00:07:23.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.231+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~XSLDVYIF7AWL.1 size=863902 2024-09-12T00:07:23.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.234+0000 7f82f8930780 1 < canceled multipart upload key=9576W9WYJUJV upload=XSLDVYIF7AWL tag=LJZRE0JGDQEY type=write size=2961054 2024-09-12T00:07:23.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.234+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=X5RZWR8BDTT4 type=del size=1676229 2024-09-12T00:07:23.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.236+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~S52XPN3LQ3QU.0 size=1048576 2024-09-12T00:07:23.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.237+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~S52XPN3LQ3QU.1 size=1048576 2024-09-12T00:07:23.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.238+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~S52XPN3LQ3QU.2 size=383199 2024-09-12T00:07:23.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.240+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=S52XPN3LQ3QU tag=VG120JKRKBR4 type=write size=3528927 2024-09-12T00:07:23.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.242+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~Y8Q4M2PRK8L5.0 size=1048576 2024-09-12T00:07:23.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.243+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~Y8Q4M2PRK8L5.1 size=377898 2024-09-12T00:07:23.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.243+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=Y8Q4M2PRK8L5 tag=0R59ZM2NS5NU type=write size=2475050 2024-09-12T00:07:23.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.245+0000 7f82f8930780 1 < completed write operation key=IN8Y7I0HKP6D tag=MHS3ZBGFZ5W6 type=write size=586101 2024-09-12T00:07:23.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.247+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~KTC3W66V2JSE.0 size=1048576 2024-09-12T00:07:23.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.248+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~KTC3W66V2JSE.1 size=1048576 2024-09-12T00:07:23.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.250+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~KTC3W66V2JSE.2 size=195391 2024-09-12T00:07:23.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.250+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=KTC3W66V2JSE tag=3ELAX1T3C395 type=write size=3341119 2024-09-12T00:07:23.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.251+0000 7f82f8930780 1 < canceled operation key=77SDZHCSP0E3 tag=6F0N6XB7QPM3 type=write size=836040 2024-09-12T00:07:23.252 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.253+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=0KVYCSTILHHR type=del size=2603821 2024-09-12T00:07:23.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.254+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~API5SR1HJDHB.0 size=1048576 2024-09-12T00:07:23.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.255+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~API5SR1HJDHB.1 size=1048576 2024-09-12T00:07:23.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.256+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~API5SR1HJDHB.2 size=243020 2024-09-12T00:07:23.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.261+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=API5SR1HJDHB tag=EDE1NY4ZRBW5 type=write size=3388748 2024-09-12T00:07:23.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.263+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=6IA8APJQMD2Q type=del size=4030167 2024-09-12T00:07:23.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.263+0000 7f82f8930780 1 < completed write operation key=G55HN1VD6X47 tag=S2EWFF84KBLZ type=write size=908372 2024-09-12T00:07:23.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.265+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=WGDMOMDH15CG type=del size=3027113 2024-09-12T00:07:23.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.268+0000 7f82f8930780 1 < suggested remove operation key=NCIZ4HNPCZ94 tag=94B9OI5KDGGI type=del 2024-09-12T00:07:23.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.272+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~V7GLUB02RUCW.0 size=1048576 2024-09-12T00:07:23.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.273+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~V7GLUB02RUCW.1 size=852727 2024-09-12T00:07:23.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.273+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=V7GLUB02RUCW tag=2ER1YVVCCIGY type=write size=2949879 2024-09-12T00:07:23.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.273+0000 7f82f8930780 1 < completed delete operation key=OVJOP07M9KB8 tag=5H33GAZ7FZXJ type=del 2024-09-12T00:07:23.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.276+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=OQ0HGUCEODO9 type=del size=3912699 2024-09-12T00:07:23.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.276+0000 7f82f8930780 -1 < failed to complete operation key=3X2PLA3ODHJ1 tag=TZJBTGO7BHY9 type=del size=980093: (22) Invalid argument 2024-09-12T00:07:23.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.278+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=JV5AKU2IVOEU type=write size=600558 2024-09-12T00:07:23.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.279+0000 7f82f8930780 1 < completed write operation key=N2TYUAJITFNL tag=Q1CCF51I9TTA type=write size=941093 2024-09-12T00:07:23.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.283+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~NLQGTKE1H1Y8.0 size=713402 2024-09-12T00:07:23.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.283+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=NLQGTKE1H1Y8 tag=I9189KYOYR7L type=write size=1761978 2024-09-12T00:07:23.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.284+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=WEQJFW17LMCL type=del 2024-09-12T00:07:23.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.287+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~73U14CKS9SND.0 size=479251 2024-09-12T00:07:23.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.287+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=73U14CKS9SND tag=SIMKLZV7KR4Q type=write size=1527827 2024-09-12T00:07:23.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.287+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~K1S4GF204CUI.0 size=1048576 2024-09-12T00:07:23.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.288+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~K1S4GF204CUI.1 size=1041955 2024-09-12T00:07:23.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.292+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=K1S4GF204CUI tag=UTI7OW3HOJ1Y type=write size=3139107 2024-09-12T00:07:23.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.294+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~G6A8UYWECCJE.0 size=32990 2024-09-12T00:07:23.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.294+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=G6A8UYWECCJE tag=5HEW02NFOVY7 type=write size=1081566 2024-09-12T00:07:23.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.296+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=V5XRSYGMPHZV type=del 2024-09-12T00:07:23.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.297+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=1DPSS4FIOHGH type=write size=227112 2024-09-12T00:07:23.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.299+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~BWGE0FMHNUDV.0 size=1048576 2024-09-12T00:07:23.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.299+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~BWGE0FMHNUDV.1 size=1048576 2024-09-12T00:07:23.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.301+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~BWGE0FMHNUDV.2 size=370140 2024-09-12T00:07:23.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.303+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=BWGE0FMHNUDV tag=69ESON3UAIEE type=write size=3515868 2024-09-12T00:07:23.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.305+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=S7764G10ZRTR type=del size=2907788 2024-09-12T00:07:23.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.305+0000 7f82f8930780 1 < canceled part key=_multipart_FOWSB9RQ5TV5.2~TOJ8HA9TS9ZJ.0 size=1048576 2024-09-12T00:07:23.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.305+0000 7f82f8930780 1 < canceled part key=_multipart_FOWSB9RQ5TV5.2~TOJ8HA9TS9ZJ.1 size=233264 2024-09-12T00:07:23.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.307+0000 7f82f8930780 1 < canceled multipart upload key=FOWSB9RQ5TV5 upload=TOJ8HA9TS9ZJ tag=X5R5724608RZ type=write size=2330416 2024-09-12T00:07:23.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.309+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~DB55C3LB3QP8.0 size=604373 2024-09-12T00:07:23.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.309+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=DB55C3LB3QP8 tag=BL4TESCGIL6B type=write size=1652949 2024-09-12T00:07:23.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.312+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~V58VD84BH993.0 size=1048576 2024-09-12T00:07:23.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.313+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~V58VD84BH993.1 size=1048576 2024-09-12T00:07:23.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.313+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~V58VD84BH993.2 size=940015 2024-09-12T00:07:23.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.316+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=V58VD84BH993 tag=ZJY3U6G5SM1L type=write size=4085743 2024-09-12T00:07:23.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.317+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=RU8331DDTU0W type=del size=2666102 2024-09-12T00:07:23.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.320+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=X5RZWR8BDTT4 type=del 2024-09-12T00:07:23.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.322+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~9XW8K6HQCW8O.0 size=1048576 2024-09-12T00:07:23.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.324+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~9XW8K6HQCW8O.1 size=1002598 2024-09-12T00:07:23.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.324+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=9XW8K6HQCW8O tag=OQPT48BMVVFP type=write size=3099750 2024-09-12T00:07:23.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.325+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~Y8Q4M2PRK8L5.0 size=1048576 2024-09-12T00:07:23.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.327+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~Y8Q4M2PRK8L5.1 size=377898 2024-09-12T00:07:23.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.329+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=Y8Q4M2PRK8L5 tag=0R59ZM2NS5NU type=write size=2475050 2024-09-12T00:07:23.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.330+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=73CJ7QIIOFQC type=del size=1879194 2024-09-12T00:07:23.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.332+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~KTC3W66V2JSE.0 size=1048576 2024-09-12T00:07:23.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.333+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~KTC3W66V2JSE.1 size=1048576 2024-09-12T00:07:23.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.334+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~KTC3W66V2JSE.2 size=195391 2024-09-12T00:07:23.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.337+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=KTC3W66V2JSE tag=3ELAX1T3C395 type=write size=3341119 2024-09-12T00:07:23.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.337+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=SZEFZ9RF9BPH type=write size=637771 2024-09-12T00:07:23.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.340+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=0KVYCSTILHHR type=del 2024-09-12T00:07:23.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.340+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=EOPD5LFY26FR type=del size=3239718 2024-09-12T00:07:23.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.343+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=6IA8APJQMD2Q type=del 2024-09-12T00:07:23.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.345+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~4UXGJKYGJ5G7.0 size=1048576 2024-09-12T00:07:23.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.347+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~4UXGJKYGJ5G7.1 size=524669 2024-09-12T00:07:23.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.347+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=4UXGJKYGJ5G7 tag=R6UX577DZIVC type=write size=2621821 2024-09-12T00:07:23.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.347+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=WGDMOMDH15CG type=del 2024-09-12T00:07:23.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.350+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=HF8C2SYKP1XX type=del size=2451371 2024-09-12T00:07:23.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.350+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~V7GLUB02RUCW.0 size=1048576 2024-09-12T00:07:23.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.351+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~V7GLUB02RUCW.1 size=852727 2024-09-12T00:07:23.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.354+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=V7GLUB02RUCW tag=2ER1YVVCCIGY type=write size=2949879 2024-09-12T00:07:23.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.356+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=MZKBLVL2ZJTC type=del size=3928364 2024-09-12T00:07:23.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.356+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=OQ0HGUCEODO9 type=del 2024-09-12T00:07:23.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.359+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=5XGAG51MOLW0 type=del size=1125762 2024-09-12T00:07:23.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.362+0000 7f82f8930780 1 < suggested remove operation key=MJZ56OX8PLSH tag=JV5AKU2IVOEU type=write 2024-09-12T00:07:23.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.363+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=YVEEMLQ9DHK3 type=del size=1339524 2024-09-12T00:07:23.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.365+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~NLQGTKE1H1Y8.0 size=713402 2024-09-12T00:07:23.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.367+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=NLQGTKE1H1Y8 tag=I9189KYOYR7L type=write size=1761978 2024-09-12T00:07:23.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.367+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=71KDQ0LDPV6S type=del size=2039299 2024-09-12T00:07:23.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.370+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~73U14CKS9SND.0 size=479251 2024-09-12T00:07:23.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.372+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=73U14CKS9SND tag=SIMKLZV7KR4Q type=write size=1527827 2024-09-12T00:07:23.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.376+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~2UB7QDORMJOY.0 size=1048576 2024-09-12T00:07:23.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.377+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~2UB7QDORMJOY.1 size=582905 2024-09-12T00:07:23.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.377+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=2UB7QDORMJOY tag=GBL93EBOEJN2 type=write size=2680057 2024-09-12T00:07:23.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.377+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~G6A8UYWECCJE.0 size=32990 2024-09-12T00:07:23.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.380+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=G6A8UYWECCJE tag=5HEW02NFOVY7 type=write size=1081566 2024-09-12T00:07:23.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.383+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~T09OUZHE1MDZ.0 size=317268 2024-09-12T00:07:23.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.383+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=T09OUZHE1MDZ tag=LKL043S92VAF type=write size=1365844 2024-09-12T00:07:23.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.384+0000 7f82f8930780 1 < completed write operation key=NCIZ4HNPCZ94 tag=1DPSS4FIOHGH type=write size=227112 2024-09-12T00:07:23.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.387+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~3JHTU9IDGJMD.0 size=494032 2024-09-12T00:07:23.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.387+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=3JHTU9IDGJMD tag=0NM9N0KJQTP9 type=write size=1542608 2024-09-12T00:07:23.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.389+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=S7764G10ZRTR type=del 2024-09-12T00:07:23.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.391+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~0QHZNV6HNBNG.0 size=1048576 2024-09-12T00:07:23.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.393+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~0QHZNV6HNBNG.1 size=384363 2024-09-12T00:07:23.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.393+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=0QHZNV6HNBNG tag=LBAOWPF1ZXDB type=write size=2481515 2024-09-12T00:07:23.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.393+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~DB55C3LB3QP8.0 size=604373 2024-09-12T00:07:23.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.397+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=DB55C3LB3QP8 tag=BL4TESCGIL6B type=write size=1652949 2024-09-12T00:07:23.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.398+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=ZO5KW2JR1O1J type=del size=3328193 2024-09-12T00:07:23.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.399+0000 7f82f8930780 -1 < failed to complete operation key=MJZ56OX8PLSH tag=RU8331DDTU0W type=del size=2666102: (22) Invalid argument 2024-09-12T00:07:23.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.402+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~C3VK7KWJ7LAN.0 size=1048576 2024-09-12T00:07:23.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.403+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~C3VK7KWJ7LAN.1 size=434185 2024-09-12T00:07:23.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.403+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=C3VK7KWJ7LAN tag=6BPFBX6PBRCY type=write size=2531337 2024-09-12T00:07:23.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.405+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~9XW8K6HQCW8O.0 size=1048576 2024-09-12T00:07:23.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.407+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~9XW8K6HQCW8O.1 size=1002598 2024-09-12T00:07:23.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.408+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=9XW8K6HQCW8O tag=OQPT48BMVVFP type=write size=3099750 2024-09-12T00:07:23.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.410+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=D7EPG88GZ6ZT type=del size=3136536 2024-09-12T00:07:23.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.411+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=73CJ7QIIOFQC type=del 2024-09-12T00:07:23.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.412+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=V3ULJ42CDOE7 type=del size=1082586 2024-09-12T00:07:23.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.414+0000 7f82f8930780 1 < completed write operation key=3H3D067Z8O0R tag=SZEFZ9RF9BPH type=write size=637771 2024-09-12T00:07:23.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.416+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~WSNGQ8CZGV7D.0 size=1048576 2024-09-12T00:07:23.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.417+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~WSNGQ8CZGV7D.1 size=679014 2024-09-12T00:07:23.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.417+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=WSNGQ8CZGV7D tag=SW5H0RXTP8BO type=write size=2776166 2024-09-12T00:07:23.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.419+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=EOPD5LFY26FR type=del 2024-09-12T00:07:23.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.421+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~JLNMRPSLJA12.0 size=663039 2024-09-12T00:07:23.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.421+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=JLNMRPSLJA12 tag=M8EU1SETL2T6 type=write size=1711615 2024-09-12T00:07:23.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.422+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~4UXGJKYGJ5G7.0 size=1048576 2024-09-12T00:07:23.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.423+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~4UXGJKYGJ5G7.1 size=524669 2024-09-12T00:07:23.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.427+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=4UXGJKYGJ5G7 tag=R6UX577DZIVC type=write size=2621821 2024-09-12T00:07:23.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.427+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=LFWSJM12FR9F type=write size=871517 2024-09-12T00:07:23.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.429+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=HF8C2SYKP1XX type=del 2024-09-12T00:07:23.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.430+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=ZDF2OYLNKLGV type=del size=3577411 2024-09-12T00:07:23.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.433+0000 7f82f8930780 1 < canceled operation key=62X93NOS23AF tag=MZKBLVL2ZJTC type=del size=3928364 2024-09-12T00:07:23.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.434+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~GI2XTRUEZ0QV.0 size=1048576 2024-09-12T00:07:23.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.435+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~GI2XTRUEZ0QV.1 size=570127 2024-09-12T00:07:23.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.435+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=GI2XTRUEZ0QV tag=GJHAWBALBRI8 type=write size=2667279 2024-09-12T00:07:23.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.439+0000 7f82f8930780 1 < suggested update operation key=Y5U8MO9TOJQQ tag=5XGAG51MOLW0 type=del size=1125762 2024-09-12T00:07:23.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.440+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=20TDC8S3YQA3 type=del size=959243 2024-09-12T00:07:23.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.443+0000 7f82f8930780 1 < suggested remove operation key=G55HN1VD6X47 tag=YVEEMLQ9DHK3 type=del 2024-09-12T00:07:23.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.444+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=DEZGTODMMQ1T type=del size=610449 2024-09-12T00:07:23.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.445+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=71KDQ0LDPV6S type=del 2024-09-12T00:07:23.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.447+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=DGR76IADY0O7 type=del size=3124568 2024-09-12T00:07:23.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.447+0000 7f82f8930780 1 < canceled part key=_multipart_Y8GDXNDCOHCW.2~2UB7QDORMJOY.0 size=1048576 2024-09-12T00:07:23.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.449+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~2UB7QDORMJOY.1 size=582905 2024-09-12T00:07:23.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.451+0000 7f82f8930780 1 < canceled multipart upload key=Y8GDXNDCOHCW upload=2UB7QDORMJOY tag=GBL93EBOEJN2 type=write size=2680057 2024-09-12T00:07:23.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.454+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~R1J6GJ2ANUIA.0 size=1048576 2024-09-12T00:07:23.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.454+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~R1J6GJ2ANUIA.1 size=1048576 2024-09-12T00:07:23.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.455+0000 7f82f8930780 1 > prepared part key=_multipart_BJHGNT3HBS25.2~R1J6GJ2ANUIA.2 size=444137 2024-09-12T00:07:23.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.455+0000 7f82f8930780 1 > prepared multipart upload key=BJHGNT3HBS25 upload=R1J6GJ2ANUIA tag=7W81AH3PBF76 type=write size=3589865 2024-09-12T00:07:23.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.458+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~T09OUZHE1MDZ.0 size=317268 2024-09-12T00:07:23.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.459+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=T09OUZHE1MDZ tag=LKL043S92VAF type=write size=1365844 2024-09-12T00:07:23.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.460+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=ED3ZYI6N80L2 type=write size=877346 2024-09-12T00:07:23.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.462+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~3JHTU9IDGJMD.0 size=494032 2024-09-12T00:07:23.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.464+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=3JHTU9IDGJMD tag=0NM9N0KJQTP9 type=write size=1542608 2024-09-12T00:07:23.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.465+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=WOAION0RD9VN type=del size=466166 2024-09-12T00:07:23.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.467+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~0QHZNV6HNBNG.0 size=1048576 2024-09-12T00:07:23.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.469+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~0QHZNV6HNBNG.1 size=384363 2024-09-12T00:07:23.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.471+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=0QHZNV6HNBNG tag=LBAOWPF1ZXDB type=write size=2481515 2024-09-12T00:07:23.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.472+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=4Z8LQYNK3O3A type=del size=837901 2024-09-12T00:07:23.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.474+0000 7f82f8930780 1 < completed delete operation key=N2TYUAJITFNL tag=ZO5KW2JR1O1J type=del 2024-09-12T00:07:23.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.477+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~45BZ59M4T1ZQ.0 size=240099 2024-09-12T00:07:23.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.477+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=45BZ59M4T1ZQ tag=AF72XM3DWMP2 type=write size=1288675 2024-09-12T00:07:23.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.479+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~C3VK7KWJ7LAN.0 size=1048576 2024-09-12T00:07:23.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.479+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~C3VK7KWJ7LAN.1 size=434185 2024-09-12T00:07:23.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.483+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=C3VK7KWJ7LAN tag=6BPFBX6PBRCY type=write size=2531337 2024-09-12T00:07:23.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.485+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~L656L2C5A03H.0 size=539257 2024-09-12T00:07:23.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.485+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=L656L2C5A03H tag=F4G862SX0VUY type=write size=1587833 2024-09-12T00:07:23.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.488+0000 7f82f8930780 1 < suggested update operation key=9576W9WYJUJV tag=D7EPG88GZ6ZT type=del size=3136536 2024-09-12T00:07:23.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.491+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~6SJFW75B4REQ.0 size=1048576 2024-09-12T00:07:23.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.491+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~6SJFW75B4REQ.1 size=890822 2024-09-12T00:07:23.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.491+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=6SJFW75B4REQ tag=62VXDU11U7OI type=write size=2987974 2024-09-12T00:07:23.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.493+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=V3ULJ42CDOE7 type=del 2024-09-12T00:07:23.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.496+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~XJ95OSZ7QBSX.0 size=1048576 2024-09-12T00:07:23.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.497+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~XJ95OSZ7QBSX.1 size=1048576 2024-09-12T00:07:23.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.498+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~XJ95OSZ7QBSX.2 size=598408 2024-09-12T00:07:23.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.498+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=XJ95OSZ7QBSX tag=6MVQ80IQ27PM type=write size=3744136 2024-09-12T00:07:23.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.501+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~WSNGQ8CZGV7D.0 size=1048576 2024-09-12T00:07:23.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.501+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~WSNGQ8CZGV7D.1 size=679014 2024-09-12T00:07:23.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.504+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=WSNGQ8CZGV7D tag=SW5H0RXTP8BO type=write size=2776166 2024-09-12T00:07:23.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.506+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~MH4MYVBSYWMJ.0 size=1048576 2024-09-12T00:07:23.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.508+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~MH4MYVBSYWMJ.1 size=428669 2024-09-12T00:07:23.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.508+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=MH4MYVBSYWMJ tag=JC7392X6G9E2 type=write size=2525821 2024-09-12T00:07:23.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.508+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~JLNMRPSLJA12.0 size=663039 2024-09-12T00:07:23.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.512+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=JLNMRPSLJA12 tag=M8EU1SETL2T6 type=write size=1711615 2024-09-12T00:07:23.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.514+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~ANO0GHMK28YZ.0 size=1048576 2024-09-12T00:07:23.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.516+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~ANO0GHMK28YZ.1 size=1048576 2024-09-12T00:07:23.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.516+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~ANO0GHMK28YZ.2 size=96781 2024-09-12T00:07:23.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.516+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=ANO0GHMK28YZ tag=LRC596ND3EX8 type=write size=3242509 2024-09-12T00:07:23.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.517+0000 7f82f8930780 1 < completed write operation key=62X93NOS23AF tag=LFWSJM12FR9F type=write size=871517 2024-09-12T00:07:23.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.520+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~H3WF93KZJDS7.0 size=1048576 2024-09-12T00:07:23.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.522+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~H3WF93KZJDS7.1 size=1048576 2024-09-12T00:07:23.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.523+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~H3WF93KZJDS7.2 size=167919 2024-09-12T00:07:23.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.523+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=H3WF93KZJDS7 tag=0C2DOEFYR61W type=write size=3313647 2024-09-12T00:07:23.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.525+0000 7f82f8930780 1 < suggested update operation key=A8EFUP30RS65 tag=ZDF2OYLNKLGV type=del size=3577411 2024-09-12T00:07:23.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.529+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~MJJJ3MY1PCSK.0 size=1048576 2024-09-12T00:07:23.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.531+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~MJJJ3MY1PCSK.1 size=1048576 2024-09-12T00:07:23.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.531+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~MJJJ3MY1PCSK.2 size=578137 2024-09-12T00:07:23.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.531+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=MJJJ3MY1PCSK tag=XVTHXV0426E8 type=write size=3723865 2024-09-12T00:07:23.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.532+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~GI2XTRUEZ0QV.0 size=1048576 2024-09-12T00:07:23.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.533+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~GI2XTRUEZ0QV.1 size=570127 2024-09-12T00:07:23.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.537+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=GI2XTRUEZ0QV tag=GJHAWBALBRI8 type=write size=2667279 2024-09-12T00:07:23.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.539+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~81MN7KJ4874W.0 size=919864 2024-09-12T00:07:23.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.539+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=81MN7KJ4874W tag=HF79HU36ULT5 type=write size=1968440 2024-09-12T00:07:23.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.540+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=20TDC8S3YQA3 type=del 2024-09-12T00:07:23.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.542+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=1EL29G2AC2A4 type=del size=2640408 2024-09-12T00:07:23.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.543+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=DEZGTODMMQ1T type=del 2024-09-12T00:07:23.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.546+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=Y3Q31RCV6D80 type=del size=170576 2024-09-12T00:07:23.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.548+0000 7f82f8930780 1 < suggested update operation key=4SPRDO097JYQ tag=DGR76IADY0O7 type=del size=3124568 2024-09-12T00:07:23.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.550+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=PXC12POE0Y1D type=write size=383994 2024-09-12T00:07:23.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.551+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~R1J6GJ2ANUIA.0 size=1048576 2024-09-12T00:07:23.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.552+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~R1J6GJ2ANUIA.1 size=1048576 2024-09-12T00:07:23.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.554+0000 7f82f8930780 1 < completed part key=_multipart_BJHGNT3HBS25.2~R1J6GJ2ANUIA.2 size=444137 2024-09-12T00:07:23.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.557+0000 7f82f8930780 1 < completed multipart upload key=BJHGNT3HBS25 upload=R1J6GJ2ANUIA tag=7W81AH3PBF76 type=write size=3589865 2024-09-12T00:07:23.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.557+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=Y3RL7ABVRS88 type=del size=626834 2024-09-12T00:07:23.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.559+0000 7f82f8930780 1 < completed write operation key=QB46N36A27QH tag=ED3ZYI6N80L2 type=write size=877346 2024-09-12T00:07:23.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.561+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~MXTWXLQR2PBG.0 size=1048576 2024-09-12T00:07:23.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.562+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~MXTWXLQR2PBG.1 size=475984 2024-09-12T00:07:23.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.562+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=MXTWXLQR2PBG tag=QZQWR32S5T69 type=write size=2573136 2024-09-12T00:07:23.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.564+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=WOAION0RD9VN type=del 2024-09-12T00:07:23.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.565+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=09P5XMKC1ZK2 type=del size=2177540 2024-09-12T00:07:23.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.566+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=4Z8LQYNK3O3A type=del 2024-09-12T00:07:23.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.568+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=OUAH6LYZEXIC type=write size=914657 2024-09-12T00:07:23.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.569+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~45BZ59M4T1ZQ.0 size=240099 2024-09-12T00:07:23.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.572+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=45BZ59M4T1ZQ tag=AF72XM3DWMP2 type=write size=1288675 2024-09-12T00:07:23.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.573+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=YL8PNYR4ZE8B type=del size=1358380 2024-09-12T00:07:23.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.574+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~L656L2C5A03H.0 size=539257 2024-09-12T00:07:23.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.578+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=L656L2C5A03H tag=F4G862SX0VUY type=write size=1587833 2024-09-12T00:07:23.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.578+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=ZBJHVBIY797B type=del size=611867 2024-09-12T00:07:23.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.578+0000 7f82f8930780 1 < canceled part key=_multipart_9576W9WYJUJV.2~6SJFW75B4REQ.0 size=1048576 2024-09-12T00:07:23.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.580+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~6SJFW75B4REQ.1 size=890822 2024-09-12T00:07:23.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.582+0000 7f82f8930780 1 < canceled multipart upload key=9576W9WYJUJV upload=6SJFW75B4REQ tag=62VXDU11U7OI type=write size=2987974 2024-09-12T00:07:23.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.584+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=79ERN010LE05 type=del size=3034353 2024-09-12T00:07:23.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.585+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~XJ95OSZ7QBSX.0 size=1048576 2024-09-12T00:07:23.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.586+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~XJ95OSZ7QBSX.1 size=1048576 2024-09-12T00:07:23.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.588+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~XJ95OSZ7QBSX.2 size=598408 2024-09-12T00:07:23.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.591+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=XJ95OSZ7QBSX tag=6MVQ80IQ27PM type=write size=3744136 2024-09-12T00:07:23.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.592+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~1U5JOAATFSJN.0 size=1033944 2024-09-12T00:07:23.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.592+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=1U5JOAATFSJN tag=W2IFA3TB2CBO type=write size=2082520 2024-09-12T00:07:23.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.595+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~MH4MYVBSYWMJ.0 size=1048576 2024-09-12T00:07:23.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.595+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~MH4MYVBSYWMJ.1 size=428669 2024-09-12T00:07:23.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.598+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=MH4MYVBSYWMJ tag=JC7392X6G9E2 type=write size=2525821 2024-09-12T00:07:23.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.599+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~WCH1RMANQ8JQ.0 size=1048576 2024-09-12T00:07:23.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.600+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~WCH1RMANQ8JQ.1 size=243125 2024-09-12T00:07:23.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.600+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=WCH1RMANQ8JQ tag=55Y5OGKW7FZ8 type=write size=2340277 2024-09-12T00:07:23.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.603+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~ANO0GHMK28YZ.0 size=1048576 2024-09-12T00:07:23.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.603+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~ANO0GHMK28YZ.1 size=1048576 2024-09-12T00:07:23.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.604+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~ANO0GHMK28YZ.2 size=96781 2024-09-12T00:07:23.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.607+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=ANO0GHMK28YZ tag=LRC596ND3EX8 type=write size=3242509 2024-09-12T00:07:23.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.609+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=4KKJ6NUPWRA2 type=write size=417334 2024-09-12T00:07:23.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.609+0000 7f82f8930780 1 < canceled part key=_multipart_Y5U8MO9TOJQQ.2~H3WF93KZJDS7.0 size=1048576 2024-09-12T00:07:23.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.609+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~H3WF93KZJDS7.1 size=1048576 2024-09-12T00:07:23.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.609+0000 7f82f8930780 1 < canceled part key=_multipart_Y5U8MO9TOJQQ.2~H3WF93KZJDS7.2 size=167919 2024-09-12T00:07:23.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.612+0000 7f82f8930780 1 < canceled multipart upload key=Y5U8MO9TOJQQ upload=H3WF93KZJDS7 tag=0C2DOEFYR61W type=write size=3313647 2024-09-12T00:07:23.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.614+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=8V9CE2DRO285 type=write size=73051 2024-09-12T00:07:23.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.614+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~MJJJ3MY1PCSK.0 size=1048576 2024-09-12T00:07:23.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.616+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~MJJJ3MY1PCSK.1 size=1048576 2024-09-12T00:07:23.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.618+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~MJJJ3MY1PCSK.2 size=578137 2024-09-12T00:07:23.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.619+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=MJJJ3MY1PCSK tag=XVTHXV0426E8 type=write size=3723865 2024-09-12T00:07:23.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.623+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~PNYB2PQQXR91.0 size=1048576 2024-09-12T00:07:23.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.623+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~PNYB2PQQXR91.1 size=536419 2024-09-12T00:07:23.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.623+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=PNYB2PQQXR91 tag=3UYP941334JO type=write size=2633571 2024-09-12T00:07:23.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.624+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~81MN7KJ4874W.0 size=919864 2024-09-12T00:07:23.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.627+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=81MN7KJ4874W tag=HF79HU36ULT5 type=write size=1968440 2024-09-12T00:07:23.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.629+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~GFBK5KG3NA2B.0 size=1048576 2024-09-12T00:07:23.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.630+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~GFBK5KG3NA2B.1 size=1048576 2024-09-12T00:07:23.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.632+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~GFBK5KG3NA2B.2 size=517771 2024-09-12T00:07:23.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.632+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=GFBK5KG3NA2B tag=629HVPROAWCK type=write size=3663499 2024-09-12T00:07:23.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.633+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=1EL29G2AC2A4 type=del 2024-09-12T00:07:23.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.636+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~IZF3J09X7O6T.0 size=1048576 2024-09-12T00:07:23.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.637+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~IZF3J09X7O6T.1 size=1048576 2024-09-12T00:07:23.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.638+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~IZF3J09X7O6T.2 size=933860 2024-09-12T00:07:23.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.638+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=IZF3J09X7O6T tag=Q1YQSX1PU2PT type=write size=4079588 2024-09-12T00:07:23.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.639+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=Y3Q31RCV6D80 type=del 2024-09-12T00:07:23.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.642+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~NWAMO1558GS3.0 size=1048576 2024-09-12T00:07:23.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.643+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~NWAMO1558GS3.1 size=1009940 2024-09-12T00:07:23.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.643+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=NWAMO1558GS3 tag=5JSRTDKZDA3C type=write size=3107092 2024-09-12T00:07:23.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.647+0000 7f82f8930780 1 < suggested update operation key=IMAT4ZCLGFRN tag=PXC12POE0Y1D type=write size=383994 2024-09-12T00:07:23.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.647+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=IXX39BWEEFIQ type=del size=2640802 2024-09-12T00:07:23.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.650+0000 7f82f8930780 1 < suggested remove operation key=75GYP042UUC2 tag=Y3RL7ABVRS88 type=del 2024-09-12T00:07:23.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.651+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=8OOJ62H534BD type=del size=1471556 2024-09-12T00:07:23.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.652+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~MXTWXLQR2PBG.0 size=1048576 2024-09-12T00:07:23.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.654+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~MXTWXLQR2PBG.1 size=475984 2024-09-12T00:07:23.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.657+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=MXTWXLQR2PBG tag=QZQWR32S5T69 type=write size=2573136 2024-09-12T00:07:23.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.661+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~733V7O0K3MBY.0 size=1048576 2024-09-12T00:07:23.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.661+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~733V7O0K3MBY.1 size=329565 2024-09-12T00:07:23.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.661+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=733V7O0K3MBY tag=EZGMPUPFQHEX type=write size=2426717 2024-09-12T00:07:23.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.664+0000 7f82f8930780 1 < suggested update operation key=O2ZGU2KOTUOT tag=09P5XMKC1ZK2 type=del size=2177540 2024-09-12T00:07:23.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.666+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=CYVP03W679HB type=del size=2753666 2024-09-12T00:07:23.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.666+0000 7f82f8930780 1 < completed write operation key=FHQADENLR6GP tag=OUAH6LYZEXIC type=write size=914657 2024-09-12T00:07:23.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.669+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~ZOH6RI1B0HQ6.0 size=608520 2024-09-12T00:07:23.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.669+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=ZOH6RI1B0HQ6 tag=XWE3L8YKB6T9 type=write size=1657096 2024-09-12T00:07:23.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.672+0000 7f82f8930780 1 < suggested update operation key=HCK59C6MAW0B tag=YL8PNYR4ZE8B type=del size=1358380 2024-09-12T00:07:23.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.675+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~UKZX61PO5S6V.0 size=1048576 2024-09-12T00:07:23.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.676+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~UKZX61PO5S6V.1 size=1048576 2024-09-12T00:07:23.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.677+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~UKZX61PO5S6V.2 size=346975 2024-09-12T00:07:23.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.677+0000 7f82f8930780 1 > prepared multipart upload key=4IA4918NXXJW upload=UKZX61PO5S6V tag=HFTYF691RO6U type=write size=3492703 2024-09-12T00:07:23.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.678+0000 7f82f8930780 1 < suggested remove operation key=MJZ56OX8PLSH tag=ZBJHVBIY797B type=del 2024-09-12T00:07:23.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.681+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=0NFO9E7MJF9G type=del size=1651853 2024-09-12T00:07:23.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.683+0000 7f82f8930780 1 < suggested remove operation key=Y5U8MO9TOJQQ tag=79ERN010LE05 type=del 2024-09-12T00:07:23.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.684+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=54GF2VJ6FO9U type=del size=532630 2024-09-12T00:07:23.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.686+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~1U5JOAATFSJN.0 size=1033944 2024-09-12T00:07:23.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.689+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=1U5JOAATFSJN tag=W2IFA3TB2CBO type=write size=2082520 2024-09-12T00:07:23.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.690+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=JT15JLCVXFX9 type=del size=1002544 2024-09-12T00:07:23.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.691+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~WCH1RMANQ8JQ.0 size=1048576 2024-09-12T00:07:23.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.692+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~WCH1RMANQ8JQ.1 size=243125 2024-09-12T00:07:23.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.696+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=WCH1RMANQ8JQ tag=55Y5OGKW7FZ8 type=write size=2340277 2024-09-12T00:07:23.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.697+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=FDACJOMFTCPM type=del size=3924080 2024-09-12T00:07:23.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.699+0000 7f82f8930780 -1 < failed to complete operation key=HCK59C6MAW0B tag=4KKJ6NUPWRA2 type=write size=417334: (22) Invalid argument 2024-09-12T00:07:23.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.700+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=B236QW78Z6KR type=del size=3035337 2024-09-12T00:07:23.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.704+0000 7f82f8930780 1 < suggested update operation key=IMAT4ZCLGFRN tag=8V9CE2DRO285 type=write size=73051 2024-09-12T00:07:23.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.707+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~FRTBBH78AE52.0 size=1048576 2024-09-12T00:07:23.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.708+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~FRTBBH78AE52.1 size=1048576 2024-09-12T00:07:23.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.709+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~FRTBBH78AE52.2 size=875675 2024-09-12T00:07:23.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.709+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=FRTBBH78AE52 tag=SGYEO6K939PR type=write size=4021403 2024-09-12T00:07:23.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.710+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~PNYB2PQQXR91.0 size=1048576 2024-09-12T00:07:23.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.712+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~PNYB2PQQXR91.1 size=536419 2024-09-12T00:07:23.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.715+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=PNYB2PQQXR91 tag=3UYP941334JO type=write size=2633571 2024-09-12T00:07:23.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.715+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=C0CW39IGS567 type=del size=3309514 2024-09-12T00:07:23.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.717+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~GFBK5KG3NA2B.0 size=1048576 2024-09-12T00:07:23.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.718+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~GFBK5KG3NA2B.1 size=1048576 2024-09-12T00:07:23.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.718+0000 7f82f8930780 1 < canceled part key=_multipart_N2TYUAJITFNL.2~GFBK5KG3NA2B.2 size=517771 2024-09-12T00:07:23.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.720+0000 7f82f8930780 1 < canceled multipart upload key=N2TYUAJITFNL upload=GFBK5KG3NA2B tag=629HVPROAWCK type=write size=3663499 2024-09-12T00:07:23.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.722+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=VQIE8ZWBHKG2 type=del size=1520816 2024-09-12T00:07:23.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.723+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~IZF3J09X7O6T.0 size=1048576 2024-09-12T00:07:23.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.725+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~IZF3J09X7O6T.1 size=1048576 2024-09-12T00:07:23.725 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.727+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~IZF3J09X7O6T.2 size=933860 2024-09-12T00:07:23.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.728+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=IZF3J09X7O6T tag=Q1YQSX1PU2PT type=write size=4079588 2024-09-12T00:07:23.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.731+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~2H6ABB76Z8E2.0 size=1048576 2024-09-12T00:07:23.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.733+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~2H6ABB76Z8E2.1 size=752167 2024-09-12T00:07:23.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.733+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=2H6ABB76Z8E2 tag=V6EU8XN9PQ6F type=write size=2849319 2024-09-12T00:07:23.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.733+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~NWAMO1558GS3.0 size=1048576 2024-09-12T00:07:23.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.736+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~NWAMO1558GS3.1 size=1009940 2024-09-12T00:07:23.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.737+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=NWAMO1558GS3 tag=5JSRTDKZDA3C type=write size=3107092 2024-09-12T00:07:23.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.738+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=ZL32LK60WZQN type=write size=194798 2024-09-12T00:07:23.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.740+0000 7f82f8930780 1 < canceled operation key=4SPRDO097JYQ tag=IXX39BWEEFIQ type=del size=2640802 2024-09-12T00:07:23.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.742+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=29F5ANSPCVEF type=del size=3291386 2024-09-12T00:07:23.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.744+0000 7f82f8930780 1 < suggested update operation key=62X93NOS23AF tag=8OOJ62H534BD type=del size=1471556 2024-09-12T00:07:23.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.745+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=8XE85P1TZ01A type=del size=2726638 2024-09-12T00:07:23.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.748+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~733V7O0K3MBY.0 size=1048576 2024-09-12T00:07:23.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.748+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~733V7O0K3MBY.1 size=329565 2024-09-12T00:07:23.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.751+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=733V7O0K3MBY tag=EZGMPUPFQHEX type=write size=2426717 2024-09-12T00:07:23.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.751+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=2RTKMS6MERMJ type=write size=304868 2024-09-12T00:07:23.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.754+0000 7f82f8930780 1 < suggested remove operation key=OVJOP07M9KB8 tag=CYVP03W679HB type=del 2024-09-12T00:07:23.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.758+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~LC82XNZ0855A.0 size=1048576 2024-09-12T00:07:23.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.758+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~LC82XNZ0855A.1 size=546384 2024-09-12T00:07:23.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.758+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=LC82XNZ0855A tag=DDMGP222DPRW type=write size=2643536 2024-09-12T00:07:23.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.759+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~ZOH6RI1B0HQ6.0 size=608520 2024-09-12T00:07:23.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.762+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=ZOH6RI1B0HQ6 tag=XWE3L8YKB6T9 type=write size=1657096 2024-09-12T00:07:23.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.764+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=IODSN1QN8OFA type=del size=4036128 2024-09-12T00:07:23.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.765+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~UKZX61PO5S6V.0 size=1048576 2024-09-12T00:07:23.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.765+0000 7f82f8930780 1 < canceled part key=_multipart_4IA4918NXXJW.2~UKZX61PO5S6V.1 size=1048576 2024-09-12T00:07:23.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.767+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~UKZX61PO5S6V.2 size=346975 2024-09-12T00:07:23.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.769+0000 7f82f8930780 1 < canceled multipart upload key=4IA4918NXXJW upload=UKZX61PO5S6V tag=HFTYF691RO6U type=write size=3492703 2024-09-12T00:07:23.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.769+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=5WQ97MQ84PGC type=del size=3718760 2024-09-12T00:07:23.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.772+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=0NFO9E7MJF9G type=del 2024-09-12T00:07:23.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.772+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=OE12MBBPI3SY type=del size=24301 2024-09-12T00:07:23.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.775+0000 7f82f8930780 1 < suggested update operation key=G55HN1VD6X47 tag=54GF2VJ6FO9U type=del size=532630 2024-09-12T00:07:23.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.778+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~U081UPK2Q4EB.0 size=1048576 2024-09-12T00:07:23.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.778+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~U081UPK2Q4EB.1 size=299050 2024-09-12T00:07:23.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.778+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=U081UPK2Q4EB tag=S73UZ48FHRKN type=write size=2396202 2024-09-12T00:07:23.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.781+0000 7f82f8930780 1 < canceled operation key=77SDZHCSP0E3 tag=JT15JLCVXFX9 type=del size=1002544 2024-09-12T00:07:23.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.781+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=WV1014HNFO0Z type=del size=3434972 2024-09-12T00:07:23.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.782+0000 7f82f8930780 -1 < failed to complete operation key=62X93NOS23AF tag=FDACJOMFTCPM type=del size=3924080: (22) Invalid argument 2024-09-12T00:07:23.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.785+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~REA6X19O1CC5.0 size=191589 2024-09-12T00:07:23.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.785+0000 7f82f8930780 1 > prepared multipart upload key=4IA4918NXXJW upload=REA6X19O1CC5 tag=NGP1Y73T0HSM type=write size=1240165 2024-09-12T00:07:23.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.786+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=B236QW78Z6KR type=del 2024-09-12T00:07:23.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.791+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~VITEI10KLXRA.0 size=1039124 2024-09-12T00:07:23.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.791+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=VITEI10KLXRA tag=FKO4USN83QZI type=write size=2087700 2024-09-12T00:07:23.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.791+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~FRTBBH78AE52.0 size=1048576 2024-09-12T00:07:23.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.792+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~FRTBBH78AE52.1 size=1048576 2024-09-12T00:07:23.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.795+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~FRTBBH78AE52.2 size=875675 2024-09-12T00:07:23.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.797+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=FRTBBH78AE52 tag=SGYEO6K939PR type=write size=4021403 2024-09-12T00:07:23.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.799+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~F5HUX22ZJ4JZ.0 size=1048576 2024-09-12T00:07:23.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.799+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~F5HUX22ZJ4JZ.1 size=1048576 2024-09-12T00:07:23.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.800+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~F5HUX22ZJ4JZ.2 size=110483 2024-09-12T00:07:23.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.800+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=F5HUX22ZJ4JZ tag=STQBHTEZ89OX type=write size=3256211 2024-09-12T00:07:23.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.802+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=C0CW39IGS567 type=del 2024-09-12T00:07:23.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.803+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=ETGXB3T1MSN0 type=del size=3962365 2024-09-12T00:07:23.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.806+0000 7f82f8930780 -1 < failed to complete operation key=62X93NOS23AF tag=VQIE8ZWBHKG2 type=del size=1520816: (22) Invalid argument 2024-09-12T00:07:23.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.806+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=RJ9DXLPXZ6JA type=del size=1768514 2024-09-12T00:07:23.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.808+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~2H6ABB76Z8E2.0 size=1048576 2024-09-12T00:07:23.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.808+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~2H6ABB76Z8E2.1 size=752167 2024-09-12T00:07:23.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.811+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=2H6ABB76Z8E2 tag=V6EU8XN9PQ6F type=write size=2849319 2024-09-12T00:07:23.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.813+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~U575WWQC3S26.0 size=197797 2024-09-12T00:07:23.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.813+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=U575WWQC3S26 tag=QF2AQY85ODPD type=write size=1246373 2024-09-12T00:07:23.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.814+0000 7f82f8930780 1 < completed write operation key=4IA4918NXXJW tag=ZL32LK60WZQN type=write size=194798 2024-09-12T00:07:23.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.816+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=T0RJ67UVPZWX type=write size=511019 2024-09-12T00:07:23.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.818+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=29F5ANSPCVEF type=del 2024-09-12T00:07:23.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.821+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~0LR1PZGXUBW9.0 size=1048576 2024-09-12T00:07:23.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.821+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~0LR1PZGXUBW9.1 size=447481 2024-09-12T00:07:23.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.821+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=0LR1PZGXUBW9 tag=C24SIQ5885ZP type=write size=2544633 2024-09-12T00:07:23.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.823+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=8XE85P1TZ01A type=del 2024-09-12T00:07:23.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.825+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~D5QRMOKT1XS2.0 size=1048576 2024-09-12T00:07:23.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.827+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~D5QRMOKT1XS2.1 size=1048576 2024-09-12T00:07:23.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.828+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~D5QRMOKT1XS2.2 size=242641 2024-09-12T00:07:23.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.828+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=D5QRMOKT1XS2 tag=868FW93TAJOI type=write size=3388369 2024-09-12T00:07:23.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.829+0000 7f82f8930780 1 < canceled operation key=9576W9WYJUJV tag=2RTKMS6MERMJ type=write size=304868 2024-09-12T00:07:23.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.832+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~G1FAHY0I0KDK.0 size=1048576 2024-09-12T00:07:23.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.833+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~G1FAHY0I0KDK.1 size=1048576 2024-09-12T00:07:23.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.833+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~G1FAHY0I0KDK.2 size=524484 2024-09-12T00:07:23.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.833+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=G1FAHY0I0KDK tag=LG323LH3CA53 type=write size=3670212 2024-09-12T00:07:23.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.835+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~LC82XNZ0855A.0 size=1048576 2024-09-12T00:07:23.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.837+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~LC82XNZ0855A.1 size=546384 2024-09-12T00:07:23.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.838+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=LC82XNZ0855A tag=DDMGP222DPRW type=write size=2643536 2024-09-12T00:07:23.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.841+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=YLL5IG8A3YHL type=del size=556646 2024-09-12T00:07:23.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.844+0000 7f82f8930780 1 < suggested update operation key=4IA4918NXXJW tag=IODSN1QN8OFA type=del size=4036128 2024-09-12T00:07:23.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.846+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~ORPYA3D7Z366.0 size=795912 2024-09-12T00:07:23.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.846+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=ORPYA3D7Z366 tag=C4GTD82PWLA5 type=write size=1844488 2024-09-12T00:07:23.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.848+0000 7f82f8930780 1 < completed delete operation key=FOWSB9RQ5TV5 tag=5WQ97MQ84PGC type=del 2024-09-12T00:07:23.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.850+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~6V68D5BE3EHC.0 size=1048576 2024-09-12T00:07:23.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.851+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~6V68D5BE3EHC.1 size=1048576 2024-09-12T00:07:23.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.852+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~6V68D5BE3EHC.2 size=942519 2024-09-12T00:07:23.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.852+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=6V68D5BE3EHC tag=K9LNC94XMYTV type=write size=4088247 2024-09-12T00:07:23.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.853+0000 7f82f8930780 1 < canceled operation key=O2ZGU2KOTUOT tag=OE12MBBPI3SY type=del size=24301 2024-09-12T00:07:23.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.854+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=KL6W4RUO5X9F type=write size=227335 2024-09-12T00:07:23.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.857+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~U081UPK2Q4EB.0 size=1048576 2024-09-12T00:07:23.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.857+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~U081UPK2Q4EB.1 size=299050 2024-09-12T00:07:23.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.859+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=U081UPK2Q4EB tag=S73UZ48FHRKN type=write size=2396202 2024-09-12T00:07:23.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.860+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=K9144U2I3ZR4 type=write size=545493 2024-09-12T00:07:23.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.862+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=WV1014HNFO0Z type=del 2024-09-12T00:07:23.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.863+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=7T9Y6O5RNJBV type=del size=4005197 2024-09-12T00:07:23.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.865+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~REA6X19O1CC5.0 size=191589 2024-09-12T00:07:23.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.867+0000 7f82f8930780 1 < completed multipart upload key=4IA4918NXXJW upload=REA6X19O1CC5 tag=NGP1Y73T0HSM type=write size=1240165 2024-09-12T00:07:23.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.870+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=7M9GWKKN9HK8 type=del size=1399534 2024-09-12T00:07:23.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.870+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~VITEI10KLXRA.0 size=1039124 2024-09-12T00:07:23.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.874+0000 7f82f8930780 1 < completed multipart upload key=W8SAQZWQHY36 upload=VITEI10KLXRA tag=FKO4USN83QZI type=write size=2087700 2024-09-12T00:07:23.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.874+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=QQV9LD6C63J5 type=del size=180961 2024-09-12T00:07:23.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.877+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~F5HUX22ZJ4JZ.0 size=1048576 2024-09-12T00:07:23.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.878+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~F5HUX22ZJ4JZ.1 size=1048576 2024-09-12T00:07:23.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.878+0000 7f82f8930780 1 < canceled part key=_multipart_G55HN1VD6X47.2~F5HUX22ZJ4JZ.2 size=110483 2024-09-12T00:07:23.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.880+0000 7f82f8930780 1 < canceled multipart upload key=G55HN1VD6X47 upload=F5HUX22ZJ4JZ tag=STQBHTEZ89OX type=write size=3256211 2024-09-12T00:07:23.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.882+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~6DE45O7M23WV.0 size=540081 2024-09-12T00:07:23.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.882+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=6DE45O7M23WV tag=Y6924F3CVN21 type=write size=1588657 2024-09-12T00:07:23.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.884+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=ETGXB3T1MSN0 type=del 2024-09-12T00:07:23.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.884+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=70W6FGDO9M3V type=del size=1309063 2024-09-12T00:07:23.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.888+0000 7f82f8930780 1 < suggested remove operation key=YWC5JUV5B2N6 tag=RJ9DXLPXZ6JA type=del 2024-09-12T00:07:23.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.888+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=84XSMLN6BOFF type=del size=2963640 2024-09-12T00:07:23.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.891+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~U575WWQC3S26.0 size=197797 2024-09-12T00:07:23.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.893+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=U575WWQC3S26 tag=QF2AQY85ODPD type=write size=1246373 2024-09-12T00:07:23.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.895+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~0ABEHEOST6MI.0 size=301510 2024-09-12T00:07:23.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.895+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=0ABEHEOST6MI tag=X4XV1RCF22NP type=write size=1350086 2024-09-12T00:07:23.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.897+0000 7f82f8930780 1 < completed write operation key=HCK59C6MAW0B tag=T0RJ67UVPZWX type=write size=511019 2024-09-12T00:07:23.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.899+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=X4096703T6AX type=del size=2303404 2024-09-12T00:07:23.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.900+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~0LR1PZGXUBW9.0 size=1048576 2024-09-12T00:07:23.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.900+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~0LR1PZGXUBW9.1 size=447481 2024-09-12T00:07:23.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.904+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=0LR1PZGXUBW9 tag=C24SIQ5885ZP type=write size=2544633 2024-09-12T00:07:23.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.905+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~GKPDW3UC2J8F.0 size=1048576 2024-09-12T00:07:23.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.907+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~GKPDW3UC2J8F.1 size=783061 2024-09-12T00:07:23.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.907+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=GKPDW3UC2J8F tag=7K9YT0KXSR1Q type=write size=2880213 2024-09-12T00:07:23.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.909+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~D5QRMOKT1XS2.0 size=1048576 2024-09-12T00:07:23.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.909+0000 7f82f8930780 1 < canceled part key=_multipart_FHQADENLR6GP.2~D5QRMOKT1XS2.1 size=1048576 2024-09-12T00:07:23.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.909+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~D5QRMOKT1XS2.2 size=242641 2024-09-12T00:07:23.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.913+0000 7f82f8930780 1 < canceled multipart upload key=FHQADENLR6GP upload=D5QRMOKT1XS2 tag=868FW93TAJOI type=write size=3388369 2024-09-12T00:07:23.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.913+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=CBYQLI0AM20O type=del size=970094 2024-09-12T00:07:23.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.916+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~G1FAHY0I0KDK.0 size=1048576 2024-09-12T00:07:23.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.916+0000 7f82f8930780 1 < canceled part key=_multipart_A8EFUP30RS65.2~G1FAHY0I0KDK.1 size=1048576 2024-09-12T00:07:23.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.916+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~G1FAHY0I0KDK.2 size=524484 2024-09-12T00:07:23.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.920+0000 7f82f8930780 1 < canceled multipart upload key=A8EFUP30RS65 upload=G1FAHY0I0KDK tag=LG323LH3CA53 type=write size=3670212 2024-09-12T00:07:23.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.921+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=1GSC67GTMOU6 type=write size=713675 2024-09-12T00:07:23.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.923+0000 7f82f8930780 1 < suggested update operation key=FHQADENLR6GP tag=YLL5IG8A3YHL type=del size=556646 2024-09-12T00:07:23.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.925+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=QP0DULWHWOGN type=del size=2531087 2024-09-12T00:07:23.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.926+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~ORPYA3D7Z366.0 size=795912 2024-09-12T00:07:23.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.928+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=ORPYA3D7Z366 tag=C4GTD82PWLA5 type=write size=1844488 2024-09-12T00:07:23.929 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.931+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=86F9ZBYXNIYO type=write size=435245 2024-09-12T00:07:23.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.932+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~6V68D5BE3EHC.0 size=1048576 2024-09-12T00:07:23.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.934+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~6V68D5BE3EHC.1 size=1048576 2024-09-12T00:07:23.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.935+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~6V68D5BE3EHC.2 size=942519 2024-09-12T00:07:23.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.936+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=6V68D5BE3EHC tag=K9LNC94XMYTV type=write size=4088247 2024-09-12T00:07:23.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.940+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~4JYLMG6BZMNF.0 size=1048576 2024-09-12T00:07:23.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.941+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~4JYLMG6BZMNF.1 size=527471 2024-09-12T00:07:23.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.941+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=4JYLMG6BZMNF tag=UO818K0OYYJD type=write size=2624623 2024-09-12T00:07:23.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.942+0000 7f82f8930780 1 < completed write operation key=W8SAQZWQHY36 tag=KL6W4RUO5X9F type=write size=227335 2024-09-12T00:07:23.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.943+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=9JL39SA3T1DX type=del size=319504 2024-09-12T00:07:23.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.946+0000 7f82f8930780 1 < completed write operation key=2XM2CF1T4VGW tag=K9144U2I3ZR4 type=write size=545493 2024-09-12T00:07:23.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.949+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~I726ARBYLYAD.0 size=1048576 2024-09-12T00:07:23.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.950+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~I726ARBYLYAD.1 size=1048576 2024-09-12T00:07:23.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.950+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~I726ARBYLYAD.2 size=1040416 2024-09-12T00:07:23.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.950+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=I726ARBYLYAD tag=6HYJLIF5BCB6 type=write size=4186144 2024-09-12T00:07:23.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.951+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=7T9Y6O5RNJBV type=del 2024-09-12T00:07:23.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.954+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~AA5A3KUZYX2P.0 size=417594 2024-09-12T00:07:23.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.954+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=AA5A3KUZYX2P tag=RQYSF1J94M3U type=write size=1466170 2024-09-12T00:07:23.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.955+0000 7f82f8930780 -1 < failed to complete operation key=YWC5JUV5B2N6 tag=7M9GWKKN9HK8 type=del size=1399534: (22) Invalid argument 2024-09-12T00:07:23.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.959+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~KYG8DLYM73S2.0 size=1048576 2024-09-12T00:07:23.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.960+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~KYG8DLYM73S2.1 size=1048576 2024-09-12T00:07:23.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.960+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~KYG8DLYM73S2.2 size=970091 2024-09-12T00:07:23.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.960+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=KYG8DLYM73S2 tag=1BBDTZ1PJ8MA type=write size=4115819 2024-09-12T00:07:23.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.964+0000 7f82f8930780 1 < suggested remove operation key=QB46N36A27QH tag=QQV9LD6C63J5 type=del 2024-09-12T00:07:23.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.967+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~VJP5CYM82G6Q.0 size=1048576 2024-09-12T00:07:23.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.967+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~VJP5CYM82G6Q.1 size=261379 2024-09-12T00:07:23.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.967+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=VJP5CYM82G6Q tag=7352B34Z27X4 type=write size=2358531 2024-09-12T00:07:23.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.970+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~6DE45O7M23WV.0 size=540081 2024-09-12T00:07:23.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.971+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=6DE45O7M23WV tag=Y6924F3CVN21 type=write size=1588657 2024-09-12T00:07:23.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.973+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=ZJWXV2UOZH2F type=del size=2825458 2024-09-12T00:07:23.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.975+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=70W6FGDO9M3V type=del 2024-09-12T00:07:23.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.976+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=W6M6DSGFLL8A type=del size=4096842 2024-09-12T00:07:23.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.977+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=84XSMLN6BOFF type=del 2024-09-12T00:07:23.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.980+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=7E9KSOIF995B type=del size=4098795 2024-09-12T00:07:23.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.981+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~0ABEHEOST6MI.0 size=301510 2024-09-12T00:07:23.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.984+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=0ABEHEOST6MI tag=X4XV1RCF22NP type=write size=1350086 2024-09-12T00:07:23.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.984+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=NP9HMFJ7SXO9 type=del size=3005948 2024-09-12T00:07:23.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.987+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=X4096703T6AX type=del 2024-09-12T00:07:23.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.989+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~C8IE0C06TW27.0 size=1048576 2024-09-12T00:07:23.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.989+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~C8IE0C06TW27.1 size=1048576 2024-09-12T00:07:23.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.990+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~C8IE0C06TW27.2 size=639319 2024-09-12T00:07:23.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.990+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=C8IE0C06TW27 tag=2FD2JI22QU2O type=write size=3785047 2024-09-12T00:07:23.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.993+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~GKPDW3UC2J8F.0 size=1048576 2024-09-12T00:07:23.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.994+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~GKPDW3UC2J8F.1 size=783061 2024-09-12T00:07:23.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.996+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=GKPDW3UC2J8F tag=7K9YT0KXSR1Q type=write size=2880213 2024-09-12T00:07:23.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.998+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=D5QL0CLKF4CL type=del size=82407 2024-09-12T00:07:23.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:23.999+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=CBYQLI0AM20O type=del 2024-09-12T00:07:23.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.000+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=QR2QXURX137H type=del size=2315699 2024-09-12T00:07:24.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.003+0000 7f82f8930780 1 < suggested update operation key=NCIZ4HNPCZ94 tag=1GSC67GTMOU6 type=write size=713675 2024-09-12T00:07:24.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.005+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=NT8JMO6BWFY0 type=del size=3328142 2024-09-12T00:07:24.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.008+0000 7f82f8930780 1 < suggested update operation key=AMWMQXO10EXK tag=QP0DULWHWOGN type=del size=2531087 2024-09-12T00:07:24.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.008+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=FHRTUKURNRAU type=del size=472395 2024-09-12T00:07:24.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.012+0000 7f82f8930780 1 < suggested remove operation key=77SDZHCSP0E3 tag=86F9ZBYXNIYO type=write 2024-09-12T00:07:24.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.012+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=KDK0SLF0TQAV type=del size=1407067 2024-09-12T00:07:24.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.014+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~4JYLMG6BZMNF.0 size=1048576 2024-09-12T00:07:24.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.016+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~4JYLMG6BZMNF.1 size=527471 2024-09-12T00:07:24.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.017+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=4JYLMG6BZMNF tag=UO818K0OYYJD type=write size=2624623 2024-09-12T00:07:24.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.018+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=WC7M32R5Q5HA type=del size=3567731 2024-09-12T00:07:24.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.020+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=9JL39SA3T1DX type=del 2024-09-12T00:07:24.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.021+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=FWLVGAJGMKSZ type=del size=273655 2024-09-12T00:07:24.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.023+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~I726ARBYLYAD.0 size=1048576 2024-09-12T00:07:24.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.024+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~I726ARBYLYAD.1 size=1048576 2024-09-12T00:07:24.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.025+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~I726ARBYLYAD.2 size=1040416 2024-09-12T00:07:24.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.027+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=I726ARBYLYAD tag=6HYJLIF5BCB6 type=write size=4186144 2024-09-12T00:07:24.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.029+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=EM1XLENAKNY2 type=write size=737117 2024-09-12T00:07:24.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.029+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~AA5A3KUZYX2P.0 size=417594 2024-09-12T00:07:24.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.031+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=AA5A3KUZYX2P tag=RQYSF1J94M3U type=write size=1466170 2024-09-12T00:07:24.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.032+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=VABYOKMKO7LC type=del size=1798744 2024-09-12T00:07:24.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.034+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~KYG8DLYM73S2.0 size=1048576 2024-09-12T00:07:24.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.035+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~KYG8DLYM73S2.1 size=1048576 2024-09-12T00:07:24.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.036+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~KYG8DLYM73S2.2 size=970091 2024-09-12T00:07:24.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.038+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=KYG8DLYM73S2 tag=1BBDTZ1PJ8MA type=write size=4115819 2024-09-12T00:07:24.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.042+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~SXPYEVLDHPAH.0 size=1048576 2024-09-12T00:07:24.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.043+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~SXPYEVLDHPAH.1 size=642866 2024-09-12T00:07:24.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.043+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=SXPYEVLDHPAH tag=P1VVUJ7DZWM1 type=write size=2740018 2024-09-12T00:07:24.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.043+0000 7f82f8930780 1 < canceled part key=_multipart_Y8GDXNDCOHCW.2~VJP5CYM82G6Q.0 size=1048576 2024-09-12T00:07:24.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.043+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~VJP5CYM82G6Q.1 size=261379 2024-09-12T00:07:24.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.047+0000 7f82f8930780 1 < canceled multipart upload key=Y8GDXNDCOHCW upload=VJP5CYM82G6Q tag=7352B34Z27X4 type=write size=2358531 2024-09-12T00:07:24.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.048+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=RWTZ87DCIOIM type=del size=4166854 2024-09-12T00:07:24.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.049+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=ZJWXV2UOZH2F type=del 2024-09-12T00:07:24.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.052+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=QY3HBQHXF6GP type=write size=51749 2024-09-12T00:07:24.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.052+0000 7f82f8930780 1 < completed delete operation key=IMAT4ZCLGFRN tag=W6M6DSGFLL8A type=del 2024-09-12T00:07:24.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.055+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=22M8D3F4IQ51 type=del size=771937 2024-09-12T00:07:24.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.058+0000 7f82f8930780 1 < suggested update operation key=MJZ56OX8PLSH tag=7E9KSOIF995B type=del size=4098795 2024-09-12T00:07:24.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.058+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=WKIOH16GASWW type=write size=279883 2024-09-12T00:07:24.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.061+0000 7f82f8930780 1 < completed delete operation key=FOWSB9RQ5TV5 tag=NP9HMFJ7SXO9 type=del 2024-09-12T00:07:24.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.062+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=BCUXSDRE8PPA type=del size=3958150 2024-09-12T00:07:24.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.064+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~C8IE0C06TW27.0 size=1048576 2024-09-12T00:07:24.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.065+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~C8IE0C06TW27.1 size=1048576 2024-09-12T00:07:24.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.066+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~C8IE0C06TW27.2 size=639319 2024-09-12T00:07:24.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.068+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=C8IE0C06TW27 tag=2FD2JI22QU2O type=write size=3785047 2024-09-12T00:07:24.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.070+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=7ATQV951DP79 type=del size=198071 2024-09-12T00:07:24.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.071+0000 7f82f8930780 1 < suggested update operation key=LAKJS79KNBY7 tag=D5QL0CLKF4CL type=del size=82407 2024-09-12T00:07:24.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.074+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=TJGJWFP4D196 type=write size=641225 2024-09-12T00:07:24.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.075+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=QR2QXURX137H type=del 2024-09-12T00:07:24.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.076+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=05DWOSA5NRGI type=del size=1445866 2024-09-12T00:07:24.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.078+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=NT8JMO6BWFY0 type=del 2024-09-12T00:07:24.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.081+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~TNEL9HG6BKVP.0 size=1048576 2024-09-12T00:07:24.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.081+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~TNEL9HG6BKVP.1 size=1048576 2024-09-12T00:07:24.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.083+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~TNEL9HG6BKVP.2 size=149740 2024-09-12T00:07:24.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.083+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=TNEL9HG6BKVP tag=27ARXXWV02RT type=write size=3295468 2024-09-12T00:07:24.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.085+0000 7f82f8930780 1 < completed delete operation key=9576W9WYJUJV tag=FHRTUKURNRAU type=del 2024-09-12T00:07:24.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.086+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=G403IBNJHKCR type=del size=3812397 2024-09-12T00:07:24.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.087+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=KDK0SLF0TQAV type=del 2024-09-12T00:07:24.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.089+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=VRA2VWDNQYLN type=del size=293394 2024-09-12T00:07:24.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.090+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=WC7M32R5Q5HA type=del 2024-09-12T00:07:24.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.090+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=Z02SUUKYPA1A type=del size=3743729 2024-09-12T00:07:24.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.094+0000 7f82f8930780 1 < suggested update operation key=Y8GDXNDCOHCW tag=FWLVGAJGMKSZ type=del size=273655 2024-09-12T00:07:24.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.097+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~DAD37BLU9RJJ.0 size=1048576 2024-09-12T00:07:24.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.099+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~DAD37BLU9RJJ.1 size=1048576 2024-09-12T00:07:24.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.100+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~DAD37BLU9RJJ.2 size=337778 2024-09-12T00:07:24.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.100+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=DAD37BLU9RJJ tag=Q793KHZM2T5L type=write size=3483506 2024-09-12T00:07:24.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.100+0000 7f82f8930780 1 < completed write operation key=IMAT4ZCLGFRN tag=EM1XLENAKNY2 type=write size=737117 2024-09-12T00:07:24.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.103+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=ZRZ9W805JFZZ type=write size=124649 2024-09-12T00:07:24.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.103+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=VABYOKMKO7LC type=del 2024-09-12T00:07:24.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.107+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~HJS4Y5AI07EK.0 size=1048576 2024-09-12T00:07:24.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.108+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~HJS4Y5AI07EK.1 size=1048576 2024-09-12T00:07:24.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.109+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~HJS4Y5AI07EK.2 size=27334 2024-09-12T00:07:24.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.109+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=HJS4Y5AI07EK tag=9WKF66J3DLF2 type=write size=3173062 2024-09-12T00:07:24.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.110+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~SXPYEVLDHPAH.0 size=1048576 2024-09-12T00:07:24.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.112+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~SXPYEVLDHPAH.1 size=642866 2024-09-12T00:07:24.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.114+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=SXPYEVLDHPAH tag=P1VVUJ7DZWM1 type=write size=2740018 2024-09-12T00:07:24.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.114+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=GI0H955AJTTO type=del size=1325374 2024-09-12T00:07:24.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.117+0000 7f82f8930780 -1 < failed to complete operation key=LAKJS79KNBY7 tag=RWTZ87DCIOIM type=del size=4166854: (22) Invalid argument 2024-09-12T00:07:24.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.120+0000 7f82f8930780 1 > prepared part key=_multipart_FOWSB9RQ5TV5.2~6I0DDMKPSYWP.0 size=779552 2024-09-12T00:07:24.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.120+0000 7f82f8930780 1 > prepared multipart upload key=FOWSB9RQ5TV5 upload=6I0DDMKPSYWP tag=I8XGZM2X4A2I type=write size=1828128 2024-09-12T00:07:24.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.123+0000 7f82f8930780 1 < suggested update operation key=75GYP042UUC2 tag=QY3HBQHXF6GP type=write size=51749 2024-09-12T00:07:24.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.124+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=JDIV58F39VK3 type=del size=875520 2024-09-12T00:07:24.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.126+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=22M8D3F4IQ51 type=del 2024-09-12T00:07:24.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.127+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~6F3JUAZOWV8S.0 size=1048576 2024-09-12T00:07:24.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.128+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~6F3JUAZOWV8S.1 size=1048576 2024-09-12T00:07:24.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.130+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~6F3JUAZOWV8S.2 size=564717 2024-09-12T00:07:24.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.130+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=6F3JUAZOWV8S tag=0OL3XH7VN256 type=write size=3710445 2024-09-12T00:07:24.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.131+0000 7f82f8930780 1 < canceled operation key=FOWSB9RQ5TV5 tag=WKIOH16GASWW type=write size=279883 2024-09-12T00:07:24.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.133+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~T9X869U85ZLO.0 size=1048576 2024-09-12T00:07:24.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.134+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~T9X869U85ZLO.1 size=881672 2024-09-12T00:07:24.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.134+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=T9X869U85ZLO tag=86WMCG8Z9351 type=write size=2978824 2024-09-12T00:07:24.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.138+0000 7f82f8930780 1 < suggested update operation key=QB46N36A27QH tag=BCUXSDRE8PPA type=del size=3958150 2024-09-12T00:07:24.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.140+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~VF3Z81COD12I.0 size=1012758 2024-09-12T00:07:24.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.140+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=VF3Z81COD12I tag=9PLRTXTRTBSI type=write size=2061334 2024-09-12T00:07:24.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.141+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=7ATQV951DP79 type=del 2024-09-12T00:07:24.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.143+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=C7QEIL7DHXM5 type=del size=2353244 2024-09-12T00:07:24.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.146+0000 7f82f8930780 1 < suggested remove operation key=3X2PLA3ODHJ1 tag=TJGJWFP4D196 type=write 2024-09-12T00:07:24.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.147+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=C30FKSRPNUZ0 type=del size=1746411 2024-09-12T00:07:24.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.147+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=05DWOSA5NRGI type=del 2024-09-12T00:07:24.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.149+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=KDXSPLTDB3WU type=write size=11539 2024-09-12T00:07:24.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.150+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~TNEL9HG6BKVP.0 size=1048576 2024-09-12T00:07:24.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.151+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~TNEL9HG6BKVP.1 size=1048576 2024-09-12T00:07:24.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.153+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~TNEL9HG6BKVP.2 size=149740 2024-09-12T00:07:24.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.155+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=TNEL9HG6BKVP tag=27ARXXWV02RT type=write size=3295468 2024-09-12T00:07:24.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.157+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=1WEKH3XP001R type=write size=49143 2024-09-12T00:07:24.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.157+0000 7f82f8930780 1 < completed delete operation key=OVJOP07M9KB8 tag=G403IBNJHKCR type=del 2024-09-12T00:07:24.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.159+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=H0CMX4R87K1V type=del size=1165467 2024-09-12T00:07:24.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.160+0000 7f82f8930780 -1 < failed to complete operation key=QB46N36A27QH tag=VRA2VWDNQYLN type=del size=293394: (22) Invalid argument 2024-09-12T00:07:24.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.161+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=0EV617TKSK2X type=del size=2002597 2024-09-12T00:07:24.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.164+0000 7f82f8930780 1 < completed delete operation key=FOWSB9RQ5TV5 tag=Z02SUUKYPA1A type=del 2024-09-12T00:07:24.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.164+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=M20FBIFYSJJM type=del size=2912131 2024-09-12T00:07:24.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.165+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~DAD37BLU9RJJ.0 size=1048576 2024-09-12T00:07:24.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.166+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~DAD37BLU9RJJ.1 size=1048576 2024-09-12T00:07:24.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.169+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~DAD37BLU9RJJ.2 size=337778 2024-09-12T00:07:24.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.171+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=DAD37BLU9RJJ tag=Q793KHZM2T5L type=write size=3483506 2024-09-12T00:07:24.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.174+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~K8SAPXPFMQVG.0 size=1048576 2024-09-12T00:07:24.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.175+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~K8SAPXPFMQVG.1 size=1048576 2024-09-12T00:07:24.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.176+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~K8SAPXPFMQVG.2 size=105437 2024-09-12T00:07:24.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.176+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=K8SAPXPFMQVG tag=KJ1JGBKZNGCW type=write size=3251165 2024-09-12T00:07:24.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.178+0000 7f82f8930780 1 < suggested remove operation key=Y8GDXNDCOHCW tag=ZRZ9W805JFZZ type=write 2024-09-12T00:07:24.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.181+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~XGITJWQ90974.0 size=1048576 2024-09-12T00:07:24.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.181+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~XGITJWQ90974.1 size=1048576 2024-09-12T00:07:24.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.185+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~XGITJWQ90974.2 size=738085 2024-09-12T00:07:24.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.185+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=XGITJWQ90974 tag=0CJ7JQQU6IXB type=write size=3883813 2024-09-12T00:07:24.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.187+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~HJS4Y5AI07EK.0 size=1048576 2024-09-12T00:07:24.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.187+0000 7f82f8930780 1 < canceled part key=_multipart_AMWMQXO10EXK.2~HJS4Y5AI07EK.1 size=1048576 2024-09-12T00:07:24.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.188+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~HJS4Y5AI07EK.2 size=27334 2024-09-12T00:07:24.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.189+0000 7f82f8930780 1 < canceled multipart upload key=AMWMQXO10EXK upload=HJS4Y5AI07EK tag=9WKF66J3DLF2 type=write size=3173062 2024-09-12T00:07:24.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.191+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=DE0P5IWMISMF type=del size=1778205 2024-09-12T00:07:24.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.193+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=GI0H955AJTTO type=del 2024-09-12T00:07:24.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.194+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=7CHN6JZJEZ92 type=del size=1593218 2024-09-12T00:07:24.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.196+0000 7f82f8930780 1 < completed part key=_multipart_FOWSB9RQ5TV5.2~6I0DDMKPSYWP.0 size=779552 2024-09-12T00:07:24.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.197+0000 7f82f8930780 1 < completed multipart upload key=FOWSB9RQ5TV5 upload=6I0DDMKPSYWP tag=I8XGZM2X4A2I type=write size=1828128 2024-09-12T00:07:24.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.200+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=NO01N9MIERTT type=del size=1106677 2024-09-12T00:07:24.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.201+0000 7f82f8930780 -1 < failed to complete operation key=QB46N36A27QH tag=JDIV58F39VK3 type=del size=875520: (22) Invalid argument 2024-09-12T00:07:24.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.201+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=4G5DEGRWUO1V type=write size=242993 2024-09-12T00:07:24.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.203+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~6F3JUAZOWV8S.0 size=1048576 2024-09-12T00:07:24.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.204+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~6F3JUAZOWV8S.1 size=1048576 2024-09-12T00:07:24.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.205+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~6F3JUAZOWV8S.2 size=564717 2024-09-12T00:07:24.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.208+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=6F3JUAZOWV8S tag=0OL3XH7VN256 type=write size=3710445 2024-09-12T00:07:24.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.209+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=V4ZZPQMTMVIW type=del size=1123829 2024-09-12T00:07:24.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.211+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~T9X869U85ZLO.0 size=1048576 2024-09-12T00:07:24.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.212+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~T9X869U85ZLO.1 size=881672 2024-09-12T00:07:24.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.213+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=T9X869U85ZLO tag=86WMCG8Z9351 type=write size=2978824 2024-09-12T00:07:24.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.217+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~EV04DUXM17DH.0 size=1048576 2024-09-12T00:07:24.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.218+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~EV04DUXM17DH.1 size=1048576 2024-09-12T00:07:24.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.219+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~EV04DUXM17DH.2 size=671989 2024-09-12T00:07:24.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.219+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=EV04DUXM17DH tag=JC3CWRIGKJA1 type=write size=3817717 2024-09-12T00:07:24.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.219+0000 7f82f8930780 1 < canceled part key=_multipart_HCK59C6MAW0B.2~VF3Z81COD12I.0 size=1012758 2024-09-12T00:07:24.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.222+0000 7f82f8930780 1 < canceled multipart upload key=HCK59C6MAW0B upload=VF3Z81COD12I tag=9PLRTXTRTBSI type=write size=2061334 2024-09-12T00:07:24.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.223+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=DBGAT602JVW8 type=write size=667336 2024-09-12T00:07:24.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.224+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=C7QEIL7DHXM5 type=del 2024-09-12T00:07:24.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.226+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~EA39ABM0ADOX.0 size=473961 2024-09-12T00:07:24.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.226+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=EA39ABM0ADOX tag=UHGSS2S3ML0S type=write size=1522537 2024-09-12T00:07:24.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.228+0000 7f82f8930780 1 < canceled operation key=80OUXNDPLGAG tag=C30FKSRPNUZ0 type=del size=1746411 2024-09-12T00:07:24.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.230+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=DORM9ZBT1CIZ type=del size=1648069 2024-09-12T00:07:24.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.230+0000 7f82f8930780 1 < canceled operation key=AMWMQXO10EXK tag=KDXSPLTDB3WU type=write size=11539 2024-09-12T00:07:24.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.233+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=Q01SMO5UQCFD type=write size=26745 2024-09-12T00:07:24.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.234+0000 7f82f8930780 1 < completed write operation key=QB46N36A27QH tag=1WEKH3XP001R type=write size=49143 2024-09-12T00:07:24.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.235+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=M8HPV2P383TP type=del size=1569511 2024-09-12T00:07:24.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.237+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=H0CMX4R87K1V type=del 2024-09-12T00:07:24.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.237+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=FRBM0O5M7P3G type=del size=2179685 2024-09-12T00:07:24.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.241+0000 7f82f8930780 1 < suggested update operation key=O2ZGU2KOTUOT tag=0EV617TKSK2X type=del size=2002597 2024-09-12T00:07:24.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.244+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~9BHH5MVY0CJS.0 size=1048576 2024-09-12T00:07:24.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.245+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~9BHH5MVY0CJS.1 size=185418 2024-09-12T00:07:24.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.245+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=9BHH5MVY0CJS tag=J5OOS1829BLI type=write size=2282570 2024-09-12T00:07:24.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.245+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=M20FBIFYSJJM type=del 2024-09-12T00:07:24.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.249+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~V7VKHJ6RX7XV.0 size=758912 2024-09-12T00:07:24.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.249+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=V7VKHJ6RX7XV tag=L9KV8QH9JHDJ type=write size=1807488 2024-09-12T00:07:24.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.249+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~K8SAPXPFMQVG.0 size=1048576 2024-09-12T00:07:24.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.251+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~K8SAPXPFMQVG.1 size=1048576 2024-09-12T00:07:24.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.253+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~K8SAPXPFMQVG.2 size=105437 2024-09-12T00:07:24.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.255+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=K8SAPXPFMQVG tag=KJ1JGBKZNGCW type=write size=3251165 2024-09-12T00:07:24.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.256+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~CE1U860EH8TP.0 size=647611 2024-09-12T00:07:24.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.256+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=CE1U860EH8TP tag=0M6B2ZHHYUHT type=write size=1696187 2024-09-12T00:07:24.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.259+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~XGITJWQ90974.0 size=1048576 2024-09-12T00:07:24.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.260+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~XGITJWQ90974.1 size=1048576 2024-09-12T00:07:24.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.261+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~XGITJWQ90974.2 size=738085 2024-09-12T00:07:24.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.264+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=XGITJWQ90974 tag=0CJ7JQQU6IXB type=write size=3883813 2024-09-12T00:07:24.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.265+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=3PTZ9L1VEBNP type=del size=2873652 2024-09-12T00:07:24.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.267+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=DE0P5IWMISMF type=del 2024-09-12T00:07:24.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.268+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=UIEEZSJM9WTO type=del size=2626334 2024-09-12T00:07:24.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.270+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=7CHN6JZJEZ92 type=del 2024-09-12T00:07:24.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.271+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=TKNRLV9PN5FT type=del size=2208939 2024-09-12T00:07:24.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.274+0000 7f82f8930780 1 < suggested update operation key=QB46N36A27QH tag=NO01N9MIERTT type=del size=1106677 2024-09-12T00:07:24.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.277+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~0EREM4RNJIHM.0 size=1048576 2024-09-12T00:07:24.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.277+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~0EREM4RNJIHM.1 size=1048576 2024-09-12T00:07:24.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.279+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~0EREM4RNJIHM.2 size=917998 2024-09-12T00:07:24.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.279+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=0EREM4RNJIHM tag=3FYXFBPDIM1R type=write size=4063726 2024-09-12T00:07:24.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.281+0000 7f82f8930780 1 < completed write operation key=75GYP042UUC2 tag=4G5DEGRWUO1V type=write size=242993 2024-09-12T00:07:24.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.284+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~RUTSC8KFRGP9.0 size=870775 2024-09-12T00:07:24.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.284+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=RUTSC8KFRGP9 tag=DAF4I03PG4UB type=write size=1919351 2024-09-12T00:07:24.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.285+0000 7f82f8930780 1 < canceled operation key=9576W9WYJUJV tag=V4ZZPQMTMVIW type=del size=1123829 2024-09-12T00:07:24.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.288+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~UM034DX95U0E.0 size=1048576 2024-09-12T00:07:24.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.289+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~UM034DX95U0E.1 size=823228 2024-09-12T00:07:24.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.289+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=UM034DX95U0E tag=HPRVS2J5CO68 type=write size=2920380 2024-09-12T00:07:24.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.290+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~EV04DUXM17DH.0 size=1048576 2024-09-12T00:07:24.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.291+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~EV04DUXM17DH.1 size=1048576 2024-09-12T00:07:24.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.293+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~EV04DUXM17DH.2 size=671989 2024-09-12T00:07:24.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.295+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=EV04DUXM17DH tag=JC3CWRIGKJA1 type=write size=3817717 2024-09-12T00:07:24.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.298+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~U517PPD5OCH6.0 size=1048576 2024-09-12T00:07:24.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.299+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~U517PPD5OCH6.1 size=1048576 2024-09-12T00:07:24.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.300+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~U517PPD5OCH6.2 size=76214 2024-09-12T00:07:24.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.300+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=U517PPD5OCH6 tag=A3SV3CXBAJZ9 type=write size=3221942 2024-09-12T00:07:24.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.302+0000 7f82f8930780 1 < completed write operation key=W8SAQZWQHY36 tag=DBGAT602JVW8 type=write size=667336 2024-09-12T00:07:24.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.303+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=7S4MT9BA5SVN type=del size=664612 2024-09-12T00:07:24.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.305+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~EA39ABM0ADOX.0 size=473961 2024-09-12T00:07:24.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.307+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=EA39ABM0ADOX tag=UHGSS2S3ML0S type=write size=1522537 2024-09-12T00:07:24.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.309+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=ILYNBP7RPIUU type=write size=926195 2024-09-12T00:07:24.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.311+0000 7f82f8930780 1 < suggested update operation key=X3PCR8TCWDTK tag=DORM9ZBT1CIZ type=del size=1648069 2024-09-12T00:07:24.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.313+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=Q2RBNKY4240F type=del size=1788114 2024-09-12T00:07:24.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.316+0000 7f82f8930780 1 < suggested update operation key=9576W9WYJUJV tag=Q01SMO5UQCFD type=write size=26745 2024-09-12T00:07:24.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.319+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=RUWKELB133Q1 type=del size=3688656 2024-09-12T00:07:24.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.320+0000 7f82f8930780 -1 < failed to complete operation key=O2ZGU2KOTUOT tag=M8HPV2P383TP type=del size=1569511: (22) Invalid argument 2024-09-12T00:07:24.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.322+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=H7LB50HYTSNY type=del size=360688 2024-09-12T00:07:24.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.323+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=FRBM0O5M7P3G type=del 2024-09-12T00:07:24.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.325+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=KFXS76MWBGJ3 type=write size=443792 2024-09-12T00:07:24.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.326+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~9BHH5MVY0CJS.0 size=1048576 2024-09-12T00:07:24.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.327+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~9BHH5MVY0CJS.1 size=185418 2024-09-12T00:07:24.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.330+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=9BHH5MVY0CJS tag=J5OOS1829BLI type=write size=2282570 2024-09-12T00:07:24.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.332+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~TO0V0CS4PEYV.0 size=900365 2024-09-12T00:07:24.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.332+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=TO0V0CS4PEYV tag=O29QZM4O0PIE type=write size=1948941 2024-09-12T00:07:24.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.334+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~V7VKHJ6RX7XV.0 size=758912 2024-09-12T00:07:24.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.336+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=V7VKHJ6RX7XV tag=L9KV8QH9JHDJ type=write size=1807488 2024-09-12T00:07:24.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.338+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=I4M2VAIMKPBL type=del size=3597056 2024-09-12T00:07:24.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.339+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~CE1U860EH8TP.0 size=647611 2024-09-12T00:07:24.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.342+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=CE1U860EH8TP tag=0M6B2ZHHYUHT type=write size=1696187 2024-09-12T00:07:24.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.343+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=I8CHP4EJRVF5 type=del size=500045 2024-09-12T00:07:24.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.345+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=3PTZ9L1VEBNP type=del 2024-09-12T00:07:24.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.348+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~ZMKFIKKI186N.0 size=1048576 2024-09-12T00:07:24.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.349+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~ZMKFIKKI186N.1 size=1048576 2024-09-12T00:07:24.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.350+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~ZMKFIKKI186N.2 size=224962 2024-09-12T00:07:24.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.350+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=ZMKFIKKI186N tag=QSZC39OZMFNM type=write size=3370690 2024-09-12T00:07:24.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.351+0000 7f82f8930780 -1 < failed to complete operation key=QB46N36A27QH tag=UIEEZSJM9WTO type=del size=2626334: (22) Invalid argument 2024-09-12T00:07:24.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.353+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=HDAN4ZO2ZVZ0 type=del size=1910567 2024-09-12T00:07:24.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.354+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=TKNRLV9PN5FT type=del 2024-09-12T00:07:24.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.356+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=NADFUX52KFL6 type=write size=690371 2024-09-12T00:07:24.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.357+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~0EREM4RNJIHM.0 size=1048576 2024-09-12T00:07:24.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.358+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~0EREM4RNJIHM.1 size=1048576 2024-09-12T00:07:24.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.360+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~0EREM4RNJIHM.2 size=917998 2024-09-12T00:07:24.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.362+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=0EREM4RNJIHM tag=3FYXFBPDIM1R type=write size=4063726 2024-09-12T00:07:24.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.363+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=MDSMRAY6318Z type=write size=210836 2024-09-12T00:07:24.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.365+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~RUTSC8KFRGP9.0 size=870775 2024-09-12T00:07:24.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.367+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=RUTSC8KFRGP9 tag=DAF4I03PG4UB type=write size=1919351 2024-09-12T00:07:24.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.369+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=UM6EQZS96D5T type=del size=2461684 2024-09-12T00:07:24.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.370+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~UM034DX95U0E.0 size=1048576 2024-09-12T00:07:24.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.372+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~UM034DX95U0E.1 size=823228 2024-09-12T00:07:24.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.374+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=UM034DX95U0E tag=HPRVS2J5CO68 type=write size=2920380 2024-09-12T00:07:24.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.376+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=5J4MO8O43LZW type=del size=3327180 2024-09-12T00:07:24.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.377+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~U517PPD5OCH6.0 size=1048576 2024-09-12T00:07:24.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.377+0000 7f82f8930780 1 < canceled part key=_multipart_MJZ56OX8PLSH.2~U517PPD5OCH6.1 size=1048576 2024-09-12T00:07:24.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.378+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~U517PPD5OCH6.2 size=76214 2024-09-12T00:07:24.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.381+0000 7f82f8930780 1 < canceled multipart upload key=MJZ56OX8PLSH upload=U517PPD5OCH6 tag=A3SV3CXBAJZ9 type=write size=3221942 2024-09-12T00:07:24.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.382+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=7BCDXP8F7FI6 type=del size=1486102 2024-09-12T00:07:24.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.384+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=7S4MT9BA5SVN type=del 2024-09-12T00:07:24.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.386+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~L8RPEFY1N87Z.0 size=1048576 2024-09-12T00:07:24.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.387+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~L8RPEFY1N87Z.1 size=852162 2024-09-12T00:07:24.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.387+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=L8RPEFY1N87Z tag=U2ZMZOI08VE9 type=write size=2949314 2024-09-12T00:07:24.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.390+0000 7f82f8930780 1 < suggested update operation key=MJZ56OX8PLSH tag=ILYNBP7RPIUU type=write size=926195 2024-09-12T00:07:24.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.393+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~OKIQ90I084TD.0 size=591750 2024-09-12T00:07:24.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.393+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=OKIQ90I084TD tag=GHMNXA5AXIYW type=write size=1640326 2024-09-12T00:07:24.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.395+0000 7f82f8930780 1 < suggested update operation key=Y8GDXNDCOHCW tag=Q2RBNKY4240F type=del size=1788114 2024-09-12T00:07:24.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.397+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=YPSJHQZON1QO type=del size=1098286 2024-09-12T00:07:24.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.398+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=RUWKELB133Q1 type=del 2024-09-12T00:07:24.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.399+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=S74B30BV4S9A type=write size=468695 2024-09-12T00:07:24.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.401+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=H7LB50HYTSNY type=del 2024-09-12T00:07:24.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.404+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~HJW2QKEF52QI.0 size=1048576 2024-09-12T00:07:24.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.405+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~HJW2QKEF52QI.1 size=197680 2024-09-12T00:07:24.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.405+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=HJW2QKEF52QI tag=Q6TAIWYXEN6O type=write size=2294832 2024-09-12T00:07:24.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.407+0000 7f82f8930780 1 < completed write operation key=IN8Y7I0HKP6D tag=KFXS76MWBGJ3 type=write size=443792 2024-09-12T00:07:24.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.408+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=JQDCEP9C4D8H type=del size=1193989 2024-09-12T00:07:24.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.409+0000 7f82f8930780 1 < canceled part key=_multipart_4SPRDO097JYQ.2~TO0V0CS4PEYV.0 size=900365 2024-09-12T00:07:24.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.411+0000 7f82f8930780 1 < canceled multipart upload key=4SPRDO097JYQ upload=TO0V0CS4PEYV tag=O29QZM4O0PIE type=write size=1948941 2024-09-12T00:07:24.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.413+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~AAI3NBL4Q4KM.0 size=461771 2024-09-12T00:07:24.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.413+0000 7f82f8930780 1 > prepared multipart upload key=IN8Y7I0HKP6D upload=AAI3NBL4Q4KM tag=1M8H9ER3DJ5G type=write size=1510347 2024-09-12T00:07:24.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.417+0000 7f82f8930780 1 < suggested remove operation key=IN8Y7I0HKP6D tag=I4M2VAIMKPBL type=del 2024-09-12T00:07:24.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.419+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=8EAW978L5VEC type=del size=1699292 2024-09-12T00:07:24.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.421+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=I8CHP4EJRVF5 type=del 2024-09-12T00:07:24.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.422+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=OSK0AMZOWB79 type=del size=1733150 2024-09-12T00:07:24.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.424+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~ZMKFIKKI186N.0 size=1048576 2024-09-12T00:07:24.423 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.425+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~ZMKFIKKI186N.1 size=1048576 2024-09-12T00:07:24.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.426+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~ZMKFIKKI186N.2 size=224962 2024-09-12T00:07:24.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.428+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=ZMKFIKKI186N tag=QSZC39OZMFNM type=write size=3370690 2024-09-12T00:07:24.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.430+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=PC66LV3ALE3P type=del size=76572 2024-09-12T00:07:24.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.434+0000 7f82f8930780 1 < suggested remove operation key=G55HN1VD6X47 tag=HDAN4ZO2ZVZ0 type=del 2024-09-12T00:07:24.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.435+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=EEPY7P4CT236 type=del size=3955684 2024-09-12T00:07:24.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.436+0000 7f82f8930780 1 < completed write operation key=3H3D067Z8O0R tag=NADFUX52KFL6 type=write size=690371 2024-09-12T00:07:24.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.440+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~UNX0EULTD6PA.0 size=743900 2024-09-12T00:07:24.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.440+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=UNX0EULTD6PA tag=9APT0UWT4DUN type=write size=1792476 2024-09-12T00:07:24.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.441+0000 7f82f8930780 1 < completed write operation key=80OUXNDPLGAG tag=MDSMRAY6318Z type=write size=210836 2024-09-12T00:07:24.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.442+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=5Z1E1NWBPZE2 type=del size=2592207 2024-09-12T00:07:24.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.444+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=UM6EQZS96D5T type=del 2024-09-12T00:07:24.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.445+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=SKF2VYD1OUDM type=write size=836894 2024-09-12T00:07:24.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.447+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=5J4MO8O43LZW type=del 2024-09-12T00:07:24.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.448+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=6KU4I8PEXEIV type=write size=100241 2024-09-12T00:07:24.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.450+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=7BCDXP8F7FI6 type=del 2024-09-12T00:07:24.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.452+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~LQVYEA3EQOFY.0 size=1048576 2024-09-12T00:07:24.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.453+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~LQVYEA3EQOFY.1 size=1048576 2024-09-12T00:07:24.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.455+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~LQVYEA3EQOFY.2 size=584645 2024-09-12T00:07:24.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.455+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=LQVYEA3EQOFY tag=UM7F0A3LEP4T type=write size=3730373 2024-09-12T00:07:24.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.456+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~L8RPEFY1N87Z.0 size=1048576 2024-09-12T00:07:24.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.458+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~L8RPEFY1N87Z.1 size=852162 2024-09-12T00:07:24.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.461+0000 7f82f8930780 1 < completed multipart upload key=Y5U8MO9TOJQQ upload=L8RPEFY1N87Z tag=U2ZMZOI08VE9 type=write size=2949314 2024-09-12T00:07:24.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.462+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=WZAN6B1GDZS7 type=del size=1423764 2024-09-12T00:07:24.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.463+0000 7f82f8930780 1 < canceled part key=_multipart_AMWMQXO10EXK.2~OKIQ90I084TD.0 size=591750 2024-09-12T00:07:24.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.465+0000 7f82f8930780 1 < canceled multipart upload key=AMWMQXO10EXK upload=OKIQ90I084TD tag=GHMNXA5AXIYW type=write size=1640326 2024-09-12T00:07:24.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.466+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=LM0FDC0R0LMW type=del size=4068023 2024-09-12T00:07:24.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.467+0000 7f82f8930780 -1 < no bi entry to suggest for operation key=IN8Y7I0HKP6D tag=YPSJHQZON1QO type=del size=1098286: (2) No such file or directory 2024-09-12T00:07:24.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.469+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=2E42LQVATCXK type=del size=707256 2024-09-12T00:07:24.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.470+0000 7f82f8930780 1 < completed write operation key=FOWSB9RQ5TV5 tag=S74B30BV4S9A type=write size=468695 2024-09-12T00:07:24.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.471+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=DREIYHHJA4RL type=del size=3838577 2024-09-12T00:07:24.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.473+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~HJW2QKEF52QI.0 size=1048576 2024-09-12T00:07:24.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.474+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~HJW2QKEF52QI.1 size=197680 2024-09-12T00:07:24.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.476+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=HJW2QKEF52QI tag=Q6TAIWYXEN6O type=write size=2294832 2024-09-12T00:07:24.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.479+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~8R0BA753RXJP.0 size=1048576 2024-09-12T00:07:24.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.480+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~8R0BA753RXJP.1 size=1048576 2024-09-12T00:07:24.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.481+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~8R0BA753RXJP.2 size=542545 2024-09-12T00:07:24.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.481+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=8R0BA753RXJP tag=ISU7UTUL9FTI type=write size=3688273 2024-09-12T00:07:24.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.482+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=JQDCEP9C4D8H type=del 2024-09-12T00:07:24.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.485+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~94PWBPJFW93F.0 size=688210 2024-09-12T00:07:24.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.485+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=94PWBPJFW93F tag=5PPG9ZO9CFTT type=write size=1736786 2024-09-12T00:07:24.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.487+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~AAI3NBL4Q4KM.0 size=461771 2024-09-12T00:07:24.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.489+0000 7f82f8930780 1 < completed multipart upload key=IN8Y7I0HKP6D upload=AAI3NBL4Q4KM tag=1M8H9ER3DJ5G type=write size=1510347 2024-09-12T00:07:24.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.491+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~290D1W2SZ9BF.0 size=1048576 2024-09-12T00:07:24.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.493+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~290D1W2SZ9BF.1 size=261742 2024-09-12T00:07:24.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.493+0000 7f82f8930780 1 > prepared multipart upload key=77SDZHCSP0E3 upload=290D1W2SZ9BF tag=RTJ5FD2I2O3L type=write size=2358894 2024-09-12T00:07:24.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.494+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=8EAW978L5VEC type=del 2024-09-12T00:07:24.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.495+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=MDTIC7AY12WO type=write size=5701 2024-09-12T00:07:24.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.497+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=OSK0AMZOWB79 type=del 2024-09-12T00:07:24.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.499+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=OGRHKSYYI692 type=del size=3630007 2024-09-12T00:07:24.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.500+0000 7f82f8930780 1 < completed delete operation key=OVJOP07M9KB8 tag=PC66LV3ALE3P type=del 2024-09-12T00:07:24.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.502+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=HU6IAXLP7Y1P type=del size=2156879 2024-09-12T00:07:24.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.503+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=EEPY7P4CT236 type=del 2024-09-12T00:07:24.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.505+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~4Y8AUNU0G95H.0 size=1048576 2024-09-12T00:07:24.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.506+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~4Y8AUNU0G95H.1 size=386746 2024-09-12T00:07:24.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.506+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=4Y8AUNU0G95H tag=L43Z1PIJ9WM2 type=write size=2483898 2024-09-12T00:07:24.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.508+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~UNX0EULTD6PA.0 size=743900 2024-09-12T00:07:24.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.510+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=UNX0EULTD6PA tag=9APT0UWT4DUN type=write size=1792476 2024-09-12T00:07:24.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.512+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=0IGFKX372B74 type=del size=2580984 2024-09-12T00:07:24.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.513+0000 7f82f8930780 1 < canceled operation key=3X2PLA3ODHJ1 tag=5Z1E1NWBPZE2 type=del size=2592207 2024-09-12T00:07:24.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.515+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=9T4IDROIHCEM type=del size=313975 2024-09-12T00:07:24.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.516+0000 7f82f8930780 1 < completed write operation key=BJHGNT3HBS25 tag=SKF2VYD1OUDM type=write size=836894 2024-09-12T00:07:24.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.517+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=VNDFCGZBJF4M type=del size=1407582 2024-09-12T00:07:24.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.519+0000 7f82f8930780 1 < completed write operation key=AMWMQXO10EXK tag=6KU4I8PEXEIV type=write size=100241 2024-09-12T00:07:24.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.521+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~EDDL1TGD1GZL.0 size=1048576 2024-09-12T00:07:24.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.522+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~EDDL1TGD1GZL.1 size=1048576 2024-09-12T00:07:24.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.523+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~EDDL1TGD1GZL.2 size=94212 2024-09-12T00:07:24.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.523+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=EDDL1TGD1GZL tag=50VFZXCVZGTC type=write size=3239940 2024-09-12T00:07:24.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.525+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~LQVYEA3EQOFY.0 size=1048576 2024-09-12T00:07:24.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.526+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~LQVYEA3EQOFY.1 size=1048576 2024-09-12T00:07:24.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.527+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~LQVYEA3EQOFY.2 size=584645 2024-09-12T00:07:24.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.529+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=LQVYEA3EQOFY tag=UM7F0A3LEP4T type=write size=3730373 2024-09-12T00:07:24.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.531+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=7V0GB2Y12VXN type=del size=249895 2024-09-12T00:07:24.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.532+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=WZAN6B1GDZS7 type=del 2024-09-12T00:07:24.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.533+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=5MBT7542431O type=del size=654726 2024-09-12T00:07:24.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.535+0000 7f82f8930780 1 < completed delete operation key=OVJOP07M9KB8 tag=LM0FDC0R0LMW type=del 2024-09-12T00:07:24.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.537+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~5Q51IOMEGXEV.0 size=1048576 2024-09-12T00:07:24.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.538+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~5Q51IOMEGXEV.1 size=1048576 2024-09-12T00:07:24.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.539+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~5Q51IOMEGXEV.2 size=847470 2024-09-12T00:07:24.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.539+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=5Q51IOMEGXEV tag=ZGO759RZ5Q58 type=write size=3993198 2024-09-12T00:07:24.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.541+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=2E42LQVATCXK type=del 2024-09-12T00:07:24.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.542+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=9LWFQ3CB4BVI type=del size=2607362 2024-09-12T00:07:24.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.544+0000 7f82f8930780 1 < completed delete operation key=NCIZ4HNPCZ94 tag=DREIYHHJA4RL type=del 2024-09-12T00:07:24.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.546+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=UHQVFK3QLD0C type=del size=986425 2024-09-12T00:07:24.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.548+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~8R0BA753RXJP.0 size=1048576 2024-09-12T00:07:24.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.549+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~8R0BA753RXJP.1 size=1048576 2024-09-12T00:07:24.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.550+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~8R0BA753RXJP.2 size=542545 2024-09-12T00:07:24.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.553+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=8R0BA753RXJP tag=ISU7UTUL9FTI type=write size=3688273 2024-09-12T00:07:24.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.554+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=6AVSCX00DQWH type=del size=708486 2024-09-12T00:07:24.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.556+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~94PWBPJFW93F.0 size=688210 2024-09-12T00:07:24.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.558+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=94PWBPJFW93F tag=5PPG9ZO9CFTT type=write size=1736786 2024-09-12T00:07:24.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.559+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=G12PKV1J5EVT type=del size=2480367 2024-09-12T00:07:24.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.561+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~290D1W2SZ9BF.0 size=1048576 2024-09-12T00:07:24.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.562+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~290D1W2SZ9BF.1 size=261742 2024-09-12T00:07:24.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.564+0000 7f82f8930780 1 < completed multipart upload key=77SDZHCSP0E3 upload=290D1W2SZ9BF tag=RTJ5FD2I2O3L type=write size=2358894 2024-09-12T00:07:24.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.566+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=82YEYJCCSU6Q type=del size=3123094 2024-09-12T00:07:24.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.569+0000 7f82f8930780 1 < suggested update operation key=AMWMQXO10EXK tag=MDTIC7AY12WO type=write size=5701 2024-09-12T00:07:24.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.571+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=KUHCOYODSJY0 type=write size=589237 2024-09-12T00:07:24.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.572+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=OGRHKSYYI692 type=del 2024-09-12T00:07:24.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.574+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=OKP9UMVXWD2I type=del size=757853 2024-09-12T00:07:24.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.575+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=HU6IAXLP7Y1P type=del 2024-09-12T00:07:24.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.577+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=8J8L7W4JEBPY type=del size=2685020 2024-09-12T00:07:24.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.578+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~4Y8AUNU0G95H.0 size=1048576 2024-09-12T00:07:24.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.579+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~4Y8AUNU0G95H.1 size=386746 2024-09-12T00:07:24.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.582+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=4Y8AUNU0G95H tag=L43Z1PIJ9WM2 type=write size=2483898 2024-09-12T00:07:24.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.584+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=7HJ5VLO5LLN0 type=write size=113500 2024-09-12T00:07:24.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.585+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=0IGFKX372B74 type=del 2024-09-12T00:07:24.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.588+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~6IPIGNOE75OT.0 size=1048576 2024-09-12T00:07:24.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.589+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~6IPIGNOE75OT.1 size=1048576 2024-09-12T00:07:24.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.591+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~6IPIGNOE75OT.2 size=863212 2024-09-12T00:07:24.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.591+0000 7f82f8930780 1 > prepared multipart upload key=4IA4918NXXJW upload=6IPIGNOE75OT tag=BE6KT79K2J5S type=write size=4008940 2024-09-12T00:07:24.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.592+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=9T4IDROIHCEM type=del 2024-09-12T00:07:24.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.595+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=OKFX91ALF3UG type=del size=3366620 2024-09-12T00:07:24.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.596+0000 7f82f8930780 1 < canceled operation key=FHQADENLR6GP tag=VNDFCGZBJF4M type=del size=1407582 2024-09-12T00:07:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.598+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=ERZ3WKLVZT81 type=del size=160124 2024-09-12T00:07:24.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.599+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~EDDL1TGD1GZL.0 size=1048576 2024-09-12T00:07:24.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.601+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~EDDL1TGD1GZL.1 size=1048576 2024-09-12T00:07:24.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.602+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~EDDL1TGD1GZL.2 size=94212 2024-09-12T00:07:24.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.604+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=EDDL1TGD1GZL tag=50VFZXCVZGTC type=write size=3239940 2024-09-12T00:07:24.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.606+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~HJQZ6MW7FZOD.0 size=1048576 2024-09-12T00:07:24.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.607+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~HJQZ6MW7FZOD.1 size=1048576 2024-09-12T00:07:24.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.608+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~HJQZ6MW7FZOD.2 size=628492 2024-09-12T00:07:24.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.608+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=HJQZ6MW7FZOD tag=L7NAEOUGZ4DA type=write size=3774220 2024-09-12T00:07:24.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.611+0000 7f82f8930780 1 < suggested update operation key=9576W9WYJUJV tag=7V0GB2Y12VXN type=del size=249895 2024-09-12T00:07:24.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.612+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=S1O04L8TAZNL type=del size=1201259 2024-09-12T00:07:24.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.615+0000 7f82f8930780 1 < suggested update operation key=G55HN1VD6X47 tag=5MBT7542431O type=del size=654726 2024-09-12T00:07:24.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.618+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~33E4AZIY663D.0 size=1048576 2024-09-12T00:07:24.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.619+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~33E4AZIY663D.1 size=1048576 2024-09-12T00:07:24.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.620+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~33E4AZIY663D.2 size=919642 2024-09-12T00:07:24.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.620+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=33E4AZIY663D tag=RX9MEB4GWSXD type=write size=4065370 2024-09-12T00:07:24.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.622+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~5Q51IOMEGXEV.0 size=1048576 2024-09-12T00:07:24.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.623+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~5Q51IOMEGXEV.1 size=1048576 2024-09-12T00:07:24.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.624+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~5Q51IOMEGXEV.2 size=847470 2024-09-12T00:07:24.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.626+0000 7f82f8930780 1 < completed multipart upload key=Y5U8MO9TOJQQ upload=5Q51IOMEGXEV tag=ZGO759RZ5Q58 type=write size=3993198 2024-09-12T00:07:24.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.629+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~4JX1HBFLY3U4.0 size=1048576 2024-09-12T00:07:24.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.630+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~4JX1HBFLY3U4.1 size=1048576 2024-09-12T00:07:24.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.631+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~4JX1HBFLY3U4.2 size=459367 2024-09-12T00:07:24.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.631+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=4JX1HBFLY3U4 tag=AVSJCVWN673K type=write size=3605095 2024-09-12T00:07:24.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.633+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=9LWFQ3CB4BVI type=del 2024-09-12T00:07:24.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.634+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=NBOFR465A0R0 type=del size=4181418 2024-09-12T00:07:24.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.636+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=UHQVFK3QLD0C type=del 2024-09-12T00:07:24.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.638+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~FI17E8D1HT41.0 size=1048576 2024-09-12T00:07:24.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.639+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~FI17E8D1HT41.1 size=401133 2024-09-12T00:07:24.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.639+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=FI17E8D1HT41 tag=V2OWS12I53YC type=write size=2498285 2024-09-12T00:07:24.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.641+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=6AVSCX00DQWH type=del 2024-09-12T00:07:24.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.643+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~ZVDZD7776VNE.0 size=1048576 2024-09-12T00:07:24.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.645+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~ZVDZD7776VNE.1 size=1048576 2024-09-12T00:07:24.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.646+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~ZVDZD7776VNE.2 size=235983 2024-09-12T00:07:24.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.646+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=ZVDZD7776VNE tag=3W9JADQZY3LA type=write size=3381711 2024-09-12T00:07:24.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.647+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=G12PKV1J5EVT type=del 2024-09-12T00:07:24.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.650+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~2NUKC9JILYS6.0 size=1048576 2024-09-12T00:07:24.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.651+0000 7f82f8930780 1 > prepared part key=_multipart_W8SAQZWQHY36.2~2NUKC9JILYS6.1 size=795126 2024-09-12T00:07:24.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.651+0000 7f82f8930780 1 > prepared multipart upload key=W8SAQZWQHY36 upload=2NUKC9JILYS6 tag=29FIZ1H4A1K2 type=write size=2892278 2024-09-12T00:07:24.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.653+0000 7f82f8930780 1 < canceled operation key=MJZ56OX8PLSH tag=82YEYJCCSU6Q type=del size=3123094 2024-09-12T00:07:24.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.656+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~S6TXPYBKGPML.0 size=1048576 2024-09-12T00:07:24.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.657+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~S6TXPYBKGPML.1 size=810287 2024-09-12T00:07:24.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.657+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=S6TXPYBKGPML tag=EY8Z0NILYWY2 type=write size=2907439 2024-09-12T00:07:24.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.659+0000 7f82f8930780 1 < completed write operation key=OC61OW2M7ZEI tag=KUHCOYODSJY0 type=write size=589237 2024-09-12T00:07:24.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.660+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=JGRAXIWUF2LO type=del size=2345129 2024-09-12T00:07:24.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.662+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=OKP9UMVXWD2I type=del 2024-09-12T00:07:24.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.665+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~5LA776N2O5I2.0 size=1018839 2024-09-12T00:07:24.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.665+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=5LA776N2O5I2 tag=O6IKAS7TS3JG type=write size=2067415 2024-09-12T00:07:24.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.668+0000 7f82f8930780 1 < suggested update operation key=A8EFUP30RS65 tag=8J8L7W4JEBPY type=del size=2685020 2024-09-12T00:07:24.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.670+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=Q65H07AFNZOC type=del size=3732649 2024-09-12T00:07:24.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.672+0000 7f82f8930780 1 < completed write operation key=N2TYUAJITFNL tag=7HJ5VLO5LLN0 type=write size=113500 2024-09-12T00:07:24.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.674+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~LM61KU984PLL.0 size=1048576 2024-09-12T00:07:24.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.676+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~LM61KU984PLL.1 size=1048576 2024-09-12T00:07:24.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.677+0000 7f82f8930780 1 > prepared part key=_multipart_3H3D067Z8O0R.2~LM61KU984PLL.2 size=362170 2024-09-12T00:07:24.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.677+0000 7f82f8930780 1 > prepared multipart upload key=3H3D067Z8O0R upload=LM61KU984PLL tag=UBF3VWKF9O0N type=write size=3507898 2024-09-12T00:07:24.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.677+0000 7f82f8930780 1 < canceled part key=_multipart_4IA4918NXXJW.2~6IPIGNOE75OT.0 size=1048576 2024-09-12T00:07:24.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.678+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~6IPIGNOE75OT.1 size=1048576 2024-09-12T00:07:24.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.679+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~6IPIGNOE75OT.2 size=863212 2024-09-12T00:07:24.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.682+0000 7f82f8930780 1 < canceled multipart upload key=4IA4918NXXJW upload=6IPIGNOE75OT tag=BE6KT79K2J5S type=write size=4008940 2024-09-12T00:07:24.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.683+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=L3PFMXK54YKG type=write size=323304 2024-09-12T00:07:24.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.684+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=OKFX91ALF3UG type=del 2024-09-12T00:07:24.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.686+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=VUPXVEWV1LV9 type=write size=481565 2024-09-12T00:07:24.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.687+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=ERZ3WKLVZT81 type=del 2024-09-12T00:07:24.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.688+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=BEESOX3WRKJ3 type=del size=2825783 2024-09-12T00:07:24.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.689+0000 7f82f8930780 1 < canceled part key=_multipart_YWC5JUV5B2N6.2~HJQZ6MW7FZOD.0 size=1048576 2024-09-12T00:07:24.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.690+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~HJQZ6MW7FZOD.1 size=1048576 2024-09-12T00:07:24.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.691+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~HJQZ6MW7FZOD.2 size=628492 2024-09-12T00:07:24.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.693+0000 7f82f8930780 1 < canceled multipart upload key=YWC5JUV5B2N6 upload=HJQZ6MW7FZOD tag=L7NAEOUGZ4DA type=write size=3774220 2024-09-12T00:07:24.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.695+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=W8E9WDPGYZBM type=del size=501564 2024-09-12T00:07:24.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.697+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=S1O04L8TAZNL type=del 2024-09-12T00:07:24.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.699+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~17MPUMXYL42Z.0 size=1048576 2024-09-12T00:07:24.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.700+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~17MPUMXYL42Z.1 size=1048576 2024-09-12T00:07:24.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.701+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~17MPUMXYL42Z.2 size=250910 2024-09-12T00:07:24.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.701+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=17MPUMXYL42Z tag=5SDBAVXQYZ7V type=write size=3396638 2024-09-12T00:07:24.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.702+0000 7f82f8930780 1 < canceled part key=_multipart_HCK59C6MAW0B.2~33E4AZIY663D.0 size=1048576 2024-09-12T00:07:24.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.703+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~33E4AZIY663D.1 size=1048576 2024-09-12T00:07:24.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.703+0000 7f82f8930780 1 < canceled part key=_multipart_HCK59C6MAW0B.2~33E4AZIY663D.2 size=919642 2024-09-12T00:07:24.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.705+0000 7f82f8930780 1 < canceled multipart upload key=HCK59C6MAW0B upload=33E4AZIY663D tag=RX9MEB4GWSXD type=write size=4065370 2024-09-12T00:07:24.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.708+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~31PBLUVZIE66.0 size=1048576 2024-09-12T00:07:24.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.709+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~31PBLUVZIE66.1 size=913498 2024-09-12T00:07:24.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.709+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=31PBLUVZIE66 tag=7KPQHSGISV05 type=write size=3010650 2024-09-12T00:07:24.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.711+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~4JX1HBFLY3U4.0 size=1048576 2024-09-12T00:07:24.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.712+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~4JX1HBFLY3U4.1 size=1048576 2024-09-12T00:07:24.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.712+0000 7f82f8930780 1 < canceled part key=_multipart_HCK59C6MAW0B.2~4JX1HBFLY3U4.2 size=459367 2024-09-12T00:07:24.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.714+0000 7f82f8930780 1 < canceled multipart upload key=HCK59C6MAW0B upload=4JX1HBFLY3U4 tag=AVSJCVWN673K type=write size=3605095 2024-09-12T00:07:24.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.716+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~69TIXFUZLTZQ.0 size=1048576 2024-09-12T00:07:24.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.718+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~69TIXFUZLTZQ.1 size=1048576 2024-09-12T00:07:24.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.719+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~69TIXFUZLTZQ.2 size=850006 2024-09-12T00:07:24.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.719+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=69TIXFUZLTZQ tag=P7PIIHAOQIJL type=write size=3995734 2024-09-12T00:07:24.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.720+0000 7f82f8930780 1 < canceled operation key=80OUXNDPLGAG tag=NBOFR465A0R0 type=del size=4181418 2024-09-12T00:07:24.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.723+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~2UOUYI32XBIS.0 size=446958 2024-09-12T00:07:24.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.723+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=2UOUYI32XBIS tag=ZXHW11CGC57L type=write size=1495534 2024-09-12T00:07:24.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.723+0000 7f82f8930780 1 < canceled part key=_multipart_Y5U8MO9TOJQQ.2~FI17E8D1HT41.0 size=1048576 2024-09-12T00:07:24.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.724+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~FI17E8D1HT41.1 size=401133 2024-09-12T00:07:24.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.728+0000 7f82f8930780 1 < canceled multipart upload key=Y5U8MO9TOJQQ upload=FI17E8D1HT41 tag=V2OWS12I53YC type=write size=2498285 2024-09-12T00:07:24.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.729+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=5XMWCC2LBM12 type=del size=3008057 2024-09-12T00:07:24.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.730+0000 7f82f8930780 1 < canceled part key=_multipart_3X2PLA3ODHJ1.2~ZVDZD7776VNE.0 size=1048576 2024-09-12T00:07:24.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.731+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~ZVDZD7776VNE.1 size=1048576 2024-09-12T00:07:24.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.732+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~ZVDZD7776VNE.2 size=235983 2024-09-12T00:07:24.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.734+0000 7f82f8930780 1 < canceled multipart upload key=3X2PLA3ODHJ1 upload=ZVDZD7776VNE tag=3W9JADQZY3LA type=write size=3381711 2024-09-12T00:07:24.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.736+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~V5J63BL1K16A.0 size=99281 2024-09-12T00:07:24.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.736+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=V5J63BL1K16A tag=88UQNV9KOU82 type=write size=1147857 2024-09-12T00:07:24.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.738+0000 7f82f8930780 1 < completed part key=_multipart_W8SAQZWQHY36.2~2NUKC9JILYS6.0 size=1048576 2024-09-12T00:07:24.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.738+0000 7f82f8930780 1 < canceled part key=_multipart_W8SAQZWQHY36.2~2NUKC9JILYS6.1 size=795126 2024-09-12T00:07:24.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.740+0000 7f82f8930780 1 < canceled multipart upload key=W8SAQZWQHY36 upload=2NUKC9JILYS6 tag=29FIZ1H4A1K2 type=write size=2892278 2024-09-12T00:07:24.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.741+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=0115A2APBMWL type=del size=3849154 2024-09-12T00:07:24.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.743+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~S6TXPYBKGPML.0 size=1048576 2024-09-12T00:07:24.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.744+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~S6TXPYBKGPML.1 size=810287 2024-09-12T00:07:24.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.746+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=S6TXPYBKGPML tag=EY8Z0NILYWY2 type=write size=2907439 2024-09-12T00:07:24.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.747+0000 7f82f8930780 1 > prepared operation key=Y5U8MO9TOJQQ tag=M0LKDZUISPU5 type=del size=2227385 2024-09-12T00:07:24.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.749+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=JGRAXIWUF2LO type=del 2024-09-12T00:07:24.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.750+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=YJ4PZ32G1HA3 type=del size=2074242 2024-09-12T00:07:24.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.752+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~5LA776N2O5I2.0 size=1018839 2024-09-12T00:07:24.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.754+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=5LA776N2O5I2 tag=O6IKAS7TS3JG type=write size=2067415 2024-09-12T00:07:24.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.755+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=LCJC9QOMNMD4 type=del size=1337475 2024-09-12T00:07:24.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.757+0000 7f82f8930780 1 < completed delete operation key=9576W9WYJUJV tag=Q65H07AFNZOC type=del 2024-09-12T00:07:24.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.759+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~K42TXRG42QVU.0 size=463866 2024-09-12T00:07:24.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.759+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=K42TXRG42QVU tag=U6CTMSUMZQIN type=write size=1512442 2024-09-12T00:07:24.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.760+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~LM61KU984PLL.0 size=1048576 2024-09-12T00:07:24.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.762+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~LM61KU984PLL.1 size=1048576 2024-09-12T00:07:24.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.763+0000 7f82f8930780 1 < completed part key=_multipart_3H3D067Z8O0R.2~LM61KU984PLL.2 size=362170 2024-09-12T00:07:24.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.765+0000 7f82f8930780 1 < completed multipart upload key=3H3D067Z8O0R upload=LM61KU984PLL tag=UBF3VWKF9O0N type=write size=3507898 2024-09-12T00:07:24.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.767+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=ASWLSSDB24FU type=write size=226469 2024-09-12T00:07:24.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.768+0000 7f82f8930780 1 < completed write operation key=NCIZ4HNPCZ94 tag=L3PFMXK54YKG type=write size=323304 2024-09-12T00:07:24.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.771+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~HN7RQOSPOMAG.0 size=1048576 2024-09-12T00:07:24.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.772+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~HN7RQOSPOMAG.1 size=1048576 2024-09-12T00:07:24.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.773+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~HN7RQOSPOMAG.2 size=833836 2024-09-12T00:07:24.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.773+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=HN7RQOSPOMAG tag=66F1SLCMKMNV type=write size=3979564 2024-09-12T00:07:24.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.775+0000 7f82f8930780 1 < completed write operation key=YWC5JUV5B2N6 tag=VUPXVEWV1LV9 type=write size=481565 2024-09-12T00:07:24.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.776+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=MZ5T8YLA9CEZ type=del size=98623 2024-09-12T00:07:24.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.778+0000 7f82f8930780 1 < completed delete operation key=3X2PLA3ODHJ1 tag=BEESOX3WRKJ3 type=del 2024-09-12T00:07:24.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.779+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=4ZKY3TWHC9CJ type=del size=2700193 2024-09-12T00:07:24.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.781+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=W8E9WDPGYZBM type=del 2024-09-12T00:07:24.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.783+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~S99GJHS8WBLK.0 size=433634 2024-09-12T00:07:24.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.783+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=S99GJHS8WBLK tag=KXILVGI25OO8 type=write size=1482210 2024-09-12T00:07:24.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.785+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~17MPUMXYL42Z.0 size=1048576 2024-09-12T00:07:24.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.786+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~17MPUMXYL42Z.1 size=1048576 2024-09-12T00:07:24.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.787+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~17MPUMXYL42Z.2 size=250910 2024-09-12T00:07:24.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.790+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=17MPUMXYL42Z tag=5SDBAVXQYZ7V type=write size=3396638 2024-09-12T00:07:24.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.791+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=EXDF7N0MZKP6 type=del size=1082541 2024-09-12T00:07:24.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.793+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~31PBLUVZIE66.0 size=1048576 2024-09-12T00:07:24.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.794+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~31PBLUVZIE66.1 size=913498 2024-09-12T00:07:24.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.796+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=31PBLUVZIE66 tag=7KPQHSGISV05 type=write size=3010650 2024-09-12T00:07:24.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.798+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=AYBPFSUK3N3Y type=write size=721050 2024-09-12T00:07:24.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.800+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~69TIXFUZLTZQ.0 size=1048576 2024-09-12T00:07:24.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.801+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~69TIXFUZLTZQ.1 size=1048576 2024-09-12T00:07:24.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.802+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~69TIXFUZLTZQ.2 size=850006 2024-09-12T00:07:24.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.804+0000 7f82f8930780 1 < completed multipart upload key=4SPRDO097JYQ upload=69TIXFUZLTZQ tag=P7PIIHAOQIJL type=write size=3995734 2024-09-12T00:07:24.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.807+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~KJN8KD6OWXXF.0 size=564115 2024-09-12T00:07:24.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.807+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=KJN8KD6OWXXF tag=29ZNK0LDO5EF type=write size=1612691 2024-09-12T00:07:24.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.808+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~2UOUYI32XBIS.0 size=446958 2024-09-12T00:07:24.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.810+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=2UOUYI32XBIS tag=ZXHW11CGC57L type=write size=1495534 2024-09-12T00:07:24.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.813+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~I3685XBF29S1.0 size=1048576 2024-09-12T00:07:24.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.814+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~I3685XBF29S1.1 size=978416 2024-09-12T00:07:24.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.814+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=I3685XBF29S1 tag=DBEUUP7PU3PR type=write size=3075568 2024-09-12T00:07:24.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.816+0000 7f82f8930780 1 < canceled operation key=75GYP042UUC2 tag=5XMWCC2LBM12 type=del size=3008057 2024-09-12T00:07:24.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.818+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~OC34ZYD8Q01P.0 size=1048576 2024-09-12T00:07:24.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.819+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~OC34ZYD8Q01P.1 size=1048576 2024-09-12T00:07:24.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.821+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~OC34ZYD8Q01P.2 size=1023590 2024-09-12T00:07:24.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.821+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=OC34ZYD8Q01P tag=M4A5GU7DF101 type=write size=4169318 2024-09-12T00:07:24.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.822+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~V5J63BL1K16A.0 size=99281 2024-09-12T00:07:24.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.825+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=V5J63BL1K16A tag=88UQNV9KOU82 type=write size=1147857 2024-09-12T00:07:24.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.827+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~B9U7JA3D14JM.0 size=1048576 2024-09-12T00:07:24.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.829+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~B9U7JA3D14JM.1 size=1048576 2024-09-12T00:07:24.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.830+0000 7f82f8930780 1 > prepared part key=_multipart_IN8Y7I0HKP6D.2~B9U7JA3D14JM.2 size=119507 2024-09-12T00:07:24.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.830+0000 7f82f8930780 1 > prepared multipart upload key=IN8Y7I0HKP6D upload=B9U7JA3D14JM tag=07E11ITD7SU7 type=write size=3265235 2024-09-12T00:07:24.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.831+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=0115A2APBMWL type=del 2024-09-12T00:07:24.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.833+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=JRXYUQMVE53X type=write size=327968 2024-09-12T00:07:24.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.835+0000 7f82f8930780 1 < completed delete operation key=Y5U8MO9TOJQQ tag=M0LKDZUISPU5 type=del 2024-09-12T00:07:24.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.836+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=MR8GBHQ8JA5I type=write size=1029244 2024-09-12T00:07:24.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.839+0000 7f82f8930780 1 < suggested remove operation key=OVJOP07M9KB8 tag=YJ4PZ32G1HA3 type=del 2024-09-12T00:07:24.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.840+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=P7U4F62TNL1M type=del size=3182087 2024-09-12T00:07:24.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.842+0000 7f82f8930780 1 < canceled operation key=X3PCR8TCWDTK tag=LCJC9QOMNMD4 type=del size=1337475 2024-09-12T00:07:24.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.844+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~K5NDUN1G1NC4.0 size=817381 2024-09-12T00:07:24.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.844+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=K5NDUN1G1NC4 tag=DD91NADRJWD1 type=write size=1865957 2024-09-12T00:07:24.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.846+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~K42TXRG42QVU.0 size=463866 2024-09-12T00:07:24.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.848+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=K42TXRG42QVU tag=U6CTMSUMZQIN type=write size=1512442 2024-09-12T00:07:24.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.849+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=PY3XUZWM3EGE type=del size=2420124 2024-09-12T00:07:24.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.851+0000 7f82f8930780 1 < completed write operation key=IMAT4ZCLGFRN tag=ASWLSSDB24FU type=write size=226469 2024-09-12T00:07:24.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.852+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=864YCRLWFDKR type=del size=4023068 2024-09-12T00:07:24.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.854+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~HN7RQOSPOMAG.0 size=1048576 2024-09-12T00:07:24.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.855+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~HN7RQOSPOMAG.1 size=1048576 2024-09-12T00:07:24.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.856+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~HN7RQOSPOMAG.2 size=833836 2024-09-12T00:07:24.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.859+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=HN7RQOSPOMAG tag=66F1SLCMKMNV type=write size=3979564 2024-09-12T00:07:24.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.861+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=W0CBP4ZOL4AN type=del size=232384 2024-09-12T00:07:24.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.862+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=MZ5T8YLA9CEZ type=del 2024-09-12T00:07:24.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.864+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=S0M6DQ1YG125 type=del size=3162531 2024-09-12T00:07:24.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.865+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=4ZKY3TWHC9CJ type=del 2024-09-12T00:07:24.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.867+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=A3RXGFNRI4LH type=del size=2460133 2024-09-12T00:07:24.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.868+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~S99GJHS8WBLK.0 size=433634 2024-09-12T00:07:24.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.870+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=S99GJHS8WBLK tag=KXILVGI25OO8 type=write size=1482210 2024-09-12T00:07:24.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.871+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=P0R1EJBOUVVT type=del size=2207103 2024-09-12T00:07:24.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.873+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=EXDF7N0MZKP6 type=del 2024-09-12T00:07:24.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.875+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~Z9ICZKR6TZ3S.0 size=1048576 2024-09-12T00:07:24.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.876+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~Z9ICZKR6TZ3S.1 size=1048576 2024-09-12T00:07:24.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.877+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~Z9ICZKR6TZ3S.2 size=74850 2024-09-12T00:07:24.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.877+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=Z9ICZKR6TZ3S tag=ZVZJSAR9WOKD type=write size=3220578 2024-09-12T00:07:24.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.879+0000 7f82f8930780 1 < completed write operation key=FHQADENLR6GP tag=AYBPFSUK3N3Y type=write size=721050 2024-09-12T00:07:24.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.880+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=OSIM35V1BZ2M type=del size=3100125 2024-09-12T00:07:24.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.882+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~KJN8KD6OWXXF.0 size=564115 2024-09-12T00:07:24.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.884+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=KJN8KD6OWXXF tag=29ZNK0LDO5EF type=write size=1612691 2024-09-12T00:07:24.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.886+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~ZVCKGH8S68M3.0 size=695084 2024-09-12T00:07:24.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.886+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=ZVCKGH8S68M3 tag=IO08RSN1YAWV type=write size=1743660 2024-09-12T00:07:24.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.888+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~I3685XBF29S1.0 size=1048576 2024-09-12T00:07:24.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.889+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~I3685XBF29S1.1 size=978416 2024-09-12T00:07:24.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.891+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=I3685XBF29S1 tag=DBEUUP7PU3PR type=write size=3075568 2024-09-12T00:07:24.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.893+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~7G3O35014L6V.0 size=1048576 2024-09-12T00:07:24.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.895+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~7G3O35014L6V.1 size=102447 2024-09-12T00:07:24.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.895+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=7G3O35014L6V tag=WCB8PYFA1FFT type=write size=2199599 2024-09-12T00:07:24.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.896+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~OC34ZYD8Q01P.0 size=1048576 2024-09-12T00:07:24.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.898+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~OC34ZYD8Q01P.1 size=1048576 2024-09-12T00:07:24.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.899+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~OC34ZYD8Q01P.2 size=1023590 2024-09-12T00:07:24.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.901+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=OC34ZYD8Q01P tag=M4A5GU7DF101 type=write size=4169318 2024-09-12T00:07:24.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.903+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=MPAKJ149QIJA type=del size=1845093 2024-09-12T00:07:24.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.903+0000 7f82f8930780 1 < canceled part key=_multipart_IN8Y7I0HKP6D.2~B9U7JA3D14JM.0 size=1048576 2024-09-12T00:07:24.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.905+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~B9U7JA3D14JM.1 size=1048576 2024-09-12T00:07:24.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.906+0000 7f82f8930780 1 < completed part key=_multipart_IN8Y7I0HKP6D.2~B9U7JA3D14JM.2 size=119507 2024-09-12T00:07:24.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.908+0000 7f82f8930780 1 < canceled multipart upload key=IN8Y7I0HKP6D upload=B9U7JA3D14JM tag=07E11ITD7SU7 type=write size=3265235 2024-09-12T00:07:24.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.911+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~EIGDQ59JNXLN.0 size=487960 2024-09-12T00:07:24.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.911+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=EIGDQ59JNXLN tag=QJMX33SQRCQH type=write size=1536536 2024-09-12T00:07:24.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.912+0000 7f82f8930780 1 < canceled operation key=NCIZ4HNPCZ94 tag=JRXYUQMVE53X type=write size=327968 2024-09-12T00:07:24.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.914+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=G6991NL1PS0N type=del size=1983959 2024-09-12T00:07:24.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.915+0000 7f82f8930780 1 < completed write operation key=4SPRDO097JYQ tag=MR8GBHQ8JA5I type=write size=1029244 2024-09-12T00:07:24.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.916+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=1ON2WD0IG2JL type=del size=2095274 2024-09-12T00:07:24.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.918+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=P7U4F62TNL1M type=del 2024-09-12T00:07:24.918 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.919+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=4ND93W0Y3QAJ type=del size=418984 2024-09-12T00:07:24.919 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.921+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~K5NDUN1G1NC4.0 size=817381 2024-09-12T00:07:24.921 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.923+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=K5NDUN1G1NC4 tag=DD91NADRJWD1 type=write size=1865957 2024-09-12T00:07:24.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.925+0000 7f82f8930780 1 > prepared part key=_multipart_LAKJS79KNBY7.2~1MAJHPBBYOZ5.0 size=906863 2024-09-12T00:07:24.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.925+0000 7f82f8930780 1 > prepared multipart upload key=LAKJS79KNBY7 upload=1MAJHPBBYOZ5 tag=9BFCQRO3AOBQ type=write size=1955439 2024-09-12T00:07:24.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.927+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=PY3XUZWM3EGE type=del 2024-09-12T00:07:24.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.929+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~PPD1HJLNEHG4.0 size=512027 2024-09-12T00:07:24.928 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.930+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=PPD1HJLNEHG4 tag=A0DNC1QZ9DVM type=write size=1560603 2024-09-12T00:07:24.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.932+0000 7f82f8930780 1 < suggested remove operation key=W8SAQZWQHY36 tag=864YCRLWFDKR type=del 2024-09-12T00:07:24.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.934+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=4CZS6SMGGIYL type=del size=3250829 2024-09-12T00:07:24.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.936+0000 7f82f8930780 1 < completed delete operation key=OVJOP07M9KB8 tag=W0CBP4ZOL4AN type=del 2024-09-12T00:07:24.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.937+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=CA2WAR7F6LF7 type=write size=270612 2024-09-12T00:07:24.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.940+0000 7f82f8930780 1 < suggested remove operation key=75GYP042UUC2 tag=S0M6DQ1YG125 type=del 2024-09-12T00:07:24.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.942+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=4BO3ANUYQ8R7 type=del size=2416114 2024-09-12T00:07:24.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.943+0000 7f82f8930780 -1 < failed to complete operation key=75GYP042UUC2 tag=A3RXGFNRI4LH type=del size=2460133: (22) Invalid argument 2024-09-12T00:07:24.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.945+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=W9ZUGPIYUHGK type=write size=441378 2024-09-12T00:07:24.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.948+0000 7f82f8930780 1 < suggested update operation key=4SPRDO097JYQ tag=P0R1EJBOUVVT type=del size=2207103 2024-09-12T00:07:24.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.950+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~PHX0X33HOZF0.0 size=1048576 2024-09-12T00:07:24.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.951+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~PHX0X33HOZF0.1 size=1048576 2024-09-12T00:07:24.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.953+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~PHX0X33HOZF0.2 size=870960 2024-09-12T00:07:24.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.953+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=PHX0X33HOZF0 tag=3WA7P0J6UG2B type=write size=4016688 2024-09-12T00:07:24.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.954+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~Z9ICZKR6TZ3S.0 size=1048576 2024-09-12T00:07:24.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.955+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~Z9ICZKR6TZ3S.1 size=1048576 2024-09-12T00:07:24.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.956+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~Z9ICZKR6TZ3S.2 size=74850 2024-09-12T00:07:24.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.958+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=Z9ICZKR6TZ3S tag=ZVZJSAR9WOKD type=write size=3220578 2024-09-12T00:07:24.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.960+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=ZKYWPCWX9P06 type=del size=1765521 2024-09-12T00:07:24.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.962+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=OSIM35V1BZ2M type=del 2024-09-12T00:07:24.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.963+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=U68N9X2G1GY4 type=del size=2117636 2024-09-12T00:07:24.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.964+0000 7f82f8930780 1 < canceled part key=_multipart_2XM2CF1T4VGW.2~ZVCKGH8S68M3.0 size=695084 2024-09-12T00:07:24.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.966+0000 7f82f8930780 1 < canceled multipart upload key=2XM2CF1T4VGW upload=ZVCKGH8S68M3 tag=IO08RSN1YAWV type=write size=1743660 2024-09-12T00:07:24.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.968+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=YVLEGTSWLZE3 type=write size=560797 2024-09-12T00:07:24.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.969+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~7G3O35014L6V.0 size=1048576 2024-09-12T00:07:24.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.971+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~7G3O35014L6V.1 size=102447 2024-09-12T00:07:24.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.973+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=7G3O35014L6V tag=WCB8PYFA1FFT type=write size=2199599 2024-09-12T00:07:24.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.975+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~RMB3MEKEIIFW.0 size=1048576 2024-09-12T00:07:24.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.976+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~RMB3MEKEIIFW.1 size=1048576 2024-09-12T00:07:24.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.977+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~RMB3MEKEIIFW.2 size=61850 2024-09-12T00:07:24.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.977+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=RMB3MEKEIIFW tag=QB7RVQSFJW0F type=write size=3207578 2024-09-12T00:07:24.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.978+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=MPAKJ149QIJA type=del 2024-09-12T00:07:24.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.980+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=XMTZDJR0TKGN type=del size=1780421 2024-09-12T00:07:24.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.981+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~EIGDQ59JNXLN.0 size=487960 2024-09-12T00:07:24.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.983+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=EIGDQ59JNXLN tag=QJMX33SQRCQH type=write size=1536536 2024-09-12T00:07:24.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.985+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=2Z0ILIXX0FGI type=del size=495465 2024-09-12T00:07:24.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.986+0000 7f82f8930780 1 < completed delete operation key=9576W9WYJUJV tag=G6991NL1PS0N type=del 2024-09-12T00:07:24.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.988+0000 7f82f8930780 1 > prepared operation key=9576W9WYJUJV tag=PA8U7CSVN58M type=del size=1558203 2024-09-12T00:07:24.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.990+0000 7f82f8930780 -1 < failed to complete operation key=4SPRDO097JYQ tag=1ON2WD0IG2JL type=del size=2095274: (22) Invalid argument 2024-09-12T00:07:24.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.991+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=3HE0FV2QZ7MI type=del size=3173263 2024-09-12T00:07:24.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.993+0000 7f82f8930780 1 < completed delete operation key=3H3D067Z8O0R tag=4ND93W0Y3QAJ type=del 2024-09-12T00:07:24.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.995+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=2GH0T576UX1W type=write size=979164 2024-09-12T00:07:24.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.996+0000 7f82f8930780 1 < completed part key=_multipart_LAKJS79KNBY7.2~1MAJHPBBYOZ5.0 size=906863 2024-09-12T00:07:24.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:24.999+0000 7f82f8930780 1 < completed multipart upload key=LAKJS79KNBY7 upload=1MAJHPBBYOZ5 tag=9BFCQRO3AOBQ type=write size=1955439 2024-09-12T00:07:24.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.001+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~7GHBZDZX79KH.0 size=997359 2024-09-12T00:07:24.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.001+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=7GHBZDZX79KH tag=J2TXICGIZPGF type=write size=2045935 2024-09-12T00:07:25.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.002+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~PPD1HJLNEHG4.0 size=512027 2024-09-12T00:07:25.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.005+0000 7f82f8930780 1 < completed multipart upload key=X3PCR8TCWDTK upload=PPD1HJLNEHG4 tag=A0DNC1QZ9DVM type=write size=1560603 2024-09-12T00:07:25.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.007+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~EUV9GUDMS48N.0 size=1048576 2024-09-12T00:07:25.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.008+0000 7f82f8930780 1 > prepared part key=_multipart_HCK59C6MAW0B.2~EUV9GUDMS48N.1 size=820222 2024-09-12T00:07:25.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.008+0000 7f82f8930780 1 > prepared multipart upload key=HCK59C6MAW0B upload=EUV9GUDMS48N tag=WM0WNNG5GCGA type=write size=2917374 2024-09-12T00:07:25.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.010+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=4CZS6SMGGIYL type=del 2024-09-12T00:07:25.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.011+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=XP0KLMVHD083 type=del size=2302049 2024-09-12T00:07:25.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.013+0000 7f82f8930780 1 < completed write operation key=N2TYUAJITFNL tag=CA2WAR7F6LF7 type=write size=270612 2024-09-12T00:07:25.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.015+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~5XYJDOU18EQI.0 size=1048576 2024-09-12T00:07:25.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.016+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~5XYJDOU18EQI.1 size=1048576 2024-09-12T00:07:25.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.017+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~5XYJDOU18EQI.2 size=579986 2024-09-12T00:07:25.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.017+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=5XYJDOU18EQI tag=94T0LYTY31WV type=write size=3725714 2024-09-12T00:07:25.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.020+0000 7f82f8930780 1 < suggested update operation key=Y8GDXNDCOHCW tag=4BO3ANUYQ8R7 type=del size=2416114 2024-09-12T00:07:25.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.021+0000 7f82f8930780 1 > prepared operation key=X3PCR8TCWDTK tag=5UY7VJ2LX0WJ type=del size=3891145 2024-09-12T00:07:25.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.022+0000 7f82f8930780 1 < completed write operation key=OC61OW2M7ZEI tag=W9ZUGPIYUHGK type=write size=441378 2024-09-12T00:07:25.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.025+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~ZATBXVYEBFK0.0 size=1048576 2024-09-12T00:07:25.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.026+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~ZATBXVYEBFK0.1 size=1048576 2024-09-12T00:07:25.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.027+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~ZATBXVYEBFK0.2 size=116423 2024-09-12T00:07:25.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.027+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=ZATBXVYEBFK0 tag=8RIK8HSVS84E type=write size=3262151 2024-09-12T00:07:25.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.028+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~PHX0X33HOZF0.0 size=1048576 2024-09-12T00:07:25.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.029+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~PHX0X33HOZF0.1 size=1048576 2024-09-12T00:07:25.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.030+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~PHX0X33HOZF0.2 size=870960 2024-09-12T00:07:25.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.032+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=PHX0X33HOZF0 tag=3WA7P0J6UG2B type=write size=4016688 2024-09-12T00:07:25.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.034+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=CK291JB88EUN type=del size=3290747 2024-09-12T00:07:25.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.035+0000 7f82f8930780 1 < completed delete operation key=OVJOP07M9KB8 tag=ZKYWPCWX9P06 type=del 2024-09-12T00:07:25.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.036+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=L03BRPSFNDXH type=write size=557418 2024-09-12T00:07:25.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.040+0000 7f82f8930780 1 < suggested remove operation key=4IA4918NXXJW tag=U68N9X2G1GY4 type=del 2024-09-12T00:07:25.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.041+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=FQ9LTF0VFFW3 type=del size=345781 2024-09-12T00:07:25.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.043+0000 7f82f8930780 1 < completed write operation key=IN8Y7I0HKP6D tag=YVLEGTSWLZE3 type=write size=560797 2024-09-12T00:07:25.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.045+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=HYLIMM91837O type=del size=4060344 2024-09-12T00:07:25.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.046+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~RMB3MEKEIIFW.0 size=1048576 2024-09-12T00:07:25.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.048+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~RMB3MEKEIIFW.1 size=1048576 2024-09-12T00:07:25.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.049+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~RMB3MEKEIIFW.2 size=61850 2024-09-12T00:07:25.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.051+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=RMB3MEKEIIFW tag=QB7RVQSFJW0F type=write size=3207578 2024-09-12T00:07:25.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.053+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=8X0C0RFW6N1Y type=del size=721906 2024-09-12T00:07:25.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.054+0000 7f82f8930780 1 < canceled operation key=OC61OW2M7ZEI tag=XMTZDJR0TKGN type=del size=1780421 2024-09-12T00:07:25.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.057+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~GA48ESD3JSHK.0 size=1048576 2024-09-12T00:07:25.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.058+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~GA48ESD3JSHK.1 size=106384 2024-09-12T00:07:25.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.058+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=GA48ESD3JSHK tag=R4DER51HNEPS type=write size=2203536 2024-09-12T00:07:25.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.060+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=2Z0ILIXX0FGI type=del 2024-09-12T00:07:25.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.061+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=IHRR5ZZA33R5 type=del size=2741503 2024-09-12T00:07:25.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.063+0000 7f82f8930780 1 < canceled operation key=9576W9WYJUJV tag=PA8U7CSVN58M type=del size=1558203 2024-09-12T00:07:25.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.064+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=C6KDPNERB4ET type=del size=2418009 2024-09-12T00:07:25.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.068+0000 7f82f8930780 1 < suggested remove operation key=OC61OW2M7ZEI tag=3HE0FV2QZ7MI type=del 2024-09-12T00:07:25.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.069+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=T1SOTMZ4B1HK type=del size=466210 2024-09-12T00:07:25.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.070+0000 7f82f8930780 1 < completed write operation key=75GYP042UUC2 tag=2GH0T576UX1W type=write size=979164 2024-09-12T00:07:25.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.072+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=EI3W9JK9IJ1P type=del size=2489586 2024-09-12T00:07:25.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.073+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~7GHBZDZX79KH.0 size=997359 2024-09-12T00:07:25.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.075+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=7GHBZDZX79KH tag=J2TXICGIZPGF type=write size=2045935 2024-09-12T00:07:25.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.077+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=SVXH7KLPLV7E type=del size=2954839 2024-09-12T00:07:25.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.078+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~EUV9GUDMS48N.0 size=1048576 2024-09-12T00:07:25.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.079+0000 7f82f8930780 1 < completed part key=_multipart_HCK59C6MAW0B.2~EUV9GUDMS48N.1 size=820222 2024-09-12T00:07:25.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.082+0000 7f82f8930780 1 < completed multipart upload key=HCK59C6MAW0B upload=EUV9GUDMS48N tag=WM0WNNG5GCGA type=write size=2917374 2024-09-12T00:07:25.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.084+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~A1JDXXXLRH32.0 size=1048576 2024-09-12T00:07:25.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.085+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~A1JDXXXLRH32.1 size=299700 2024-09-12T00:07:25.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.085+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=A1JDXXXLRH32 tag=T161J867UHVS type=write size=2396852 2024-09-12T00:07:25.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.087+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=XP0KLMVHD083 type=del 2024-09-12T00:07:25.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.088+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=QAUD7S1OSD65 type=del size=2966318 2024-09-12T00:07:25.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.090+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~5XYJDOU18EQI.0 size=1048576 2024-09-12T00:07:25.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.090+0000 7f82f8930780 1 < canceled part key=_multipart_4SPRDO097JYQ.2~5XYJDOU18EQI.1 size=1048576 2024-09-12T00:07:25.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.091+0000 7f82f8930780 1 < completed part key=_multipart_4SPRDO097JYQ.2~5XYJDOU18EQI.2 size=579986 2024-09-12T00:07:25.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.093+0000 7f82f8930780 1 < canceled multipart upload key=4SPRDO097JYQ upload=5XYJDOU18EQI tag=94T0LYTY31WV type=write size=3725714 2024-09-12T00:07:25.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.095+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~GPLP5MB5LVTU.0 size=692835 2024-09-12T00:07:25.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.095+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=GPLP5MB5LVTU tag=XZFZ1J6S48OJ type=write size=1741411 2024-09-12T00:07:25.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.097+0000 7f82f8930780 1 < completed delete operation key=X3PCR8TCWDTK tag=5UY7VJ2LX0WJ type=del 2024-09-12T00:07:25.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.100+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~J8Z8QRCH7XVF.0 size=362830 2024-09-12T00:07:25.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.100+0000 7f82f8930780 1 > prepared multipart upload key=77SDZHCSP0E3 upload=J8Z8QRCH7XVF tag=6DA32ZWEDLSC type=write size=1411406 2024-09-12T00:07:25.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.101+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~ZATBXVYEBFK0.0 size=1048576 2024-09-12T00:07:25.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.103+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~ZATBXVYEBFK0.1 size=1048576 2024-09-12T00:07:25.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.104+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~ZATBXVYEBFK0.2 size=116423 2024-09-12T00:07:25.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.106+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=ZATBXVYEBFK0 tag=8RIK8HSVS84E type=write size=3262151 2024-09-12T00:07:25.106 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.107+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=XAIIPLMDEV7J type=del size=504113 2024-09-12T00:07:25.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.109+0000 7f82f8930780 1 < canceled operation key=YWC5JUV5B2N6 tag=CK291JB88EUN type=del size=3290747 2024-09-12T00:07:25.109 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.110+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=ROL3UU3T8674 type=del size=3457645 2024-09-12T00:07:25.110 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.112+0000 7f82f8930780 1 < canceled operation key=YWC5JUV5B2N6 tag=L03BRPSFNDXH type=write size=557418 2024-09-12T00:07:25.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.113+0000 7f82f8930780 1 > prepared operation key=2XM2CF1T4VGW tag=UCFVFS4BAZWA type=del size=2819093 2024-09-12T00:07:25.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.115+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=FQ9LTF0VFFW3 type=del 2024-09-12T00:07:25.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.117+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=C6QGZ6BB0DH4 type=del size=1454681 2024-09-12T00:07:25.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.118+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=HYLIMM91837O type=del 2024-09-12T00:07:25.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.120+0000 7f82f8930780 1 > prepared operation key=OVJOP07M9KB8 tag=7C0MKHME9Z1T type=del size=1778486 2024-09-12T00:07:25.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.122+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=8X0C0RFW6N1Y type=del 2024-09-12T00:07:25.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.125+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~DYK0C2XVMX0F.0 size=1048576 2024-09-12T00:07:25.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.126+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~DYK0C2XVMX0F.1 size=224006 2024-09-12T00:07:25.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.126+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=DYK0C2XVMX0F tag=A0KMHDWJ0MNY type=write size=2321158 2024-09-12T00:07:25.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.129+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~GA48ESD3JSHK.0 size=1048576 2024-09-12T00:07:25.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.130+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~GA48ESD3JSHK.1 size=106384 2024-09-12T00:07:25.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.132+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=GA48ESD3JSHK tag=R4DER51HNEPS type=write size=2203536 2024-09-12T00:07:25.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.135+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~LY91N409OH60.0 size=1048576 2024-09-12T00:07:25.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.137+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~LY91N409OH60.1 size=1048576 2024-09-12T00:07:25.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.138+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~LY91N409OH60.2 size=139125 2024-09-12T00:07:25.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.138+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=LY91N409OH60 tag=WREZ26FVYMKW type=write size=3284853 2024-09-12T00:07:25.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.139+0000 7f82f8930780 1 < canceled operation key=YWC5JUV5B2N6 tag=IHRR5ZZA33R5 type=del size=2741503 2024-09-12T00:07:25.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.142+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~6HLI7YN30ZZB.0 size=77508 2024-09-12T00:07:25.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.142+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=6HLI7YN30ZZB tag=FFPDHBKSV1E9 type=write size=1126084 2024-09-12T00:07:25.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.143+0000 7f82f8930780 1 < completed delete operation key=62X93NOS23AF tag=C6KDPNERB4ET type=del 2024-09-12T00:07:25.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.145+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=A5JQG650KC3A type=del size=1177476 2024-09-12T00:07:25.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.147+0000 7f82f8930780 1 < canceled operation key=LAKJS79KNBY7 tag=T1SOTMZ4B1HK type=del size=466210 2024-09-12T00:07:25.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.148+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=CDBB613E8HSI type=del size=116330 2024-09-12T00:07:25.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.151+0000 7f82f8930780 1 < suggested remove operation key=75GYP042UUC2 tag=EI3W9JK9IJ1P type=del 2024-09-12T00:07:25.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.153+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=MMDC3BISVZNS type=del size=2019479 2024-09-12T00:07:25.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.155+0000 7f82f8930780 -1 < failed to complete operation key=75GYP042UUC2 tag=SVXH7KLPLV7E type=del size=2954839: (22) Invalid argument 2024-09-12T00:07:25.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.157+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~0J96H4236FL0.0 size=1048576 2024-09-12T00:07:25.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.158+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~0J96H4236FL0.1 size=1048576 2024-09-12T00:07:25.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.160+0000 7f82f8930780 1 > prepared part key=_multipart_4IA4918NXXJW.2~0J96H4236FL0.2 size=982374 2024-09-12T00:07:25.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.160+0000 7f82f8930780 1 > prepared multipart upload key=4IA4918NXXJW upload=0J96H4236FL0 tag=2UNWDODAQIKG type=write size=4128102 2024-09-12T00:07:25.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.161+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~A1JDXXXLRH32.0 size=1048576 2024-09-12T00:07:25.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.162+0000 7f82f8930780 1 < completed part key=_multipart_OC61OW2M7ZEI.2~A1JDXXXLRH32.1 size=299700 2024-09-12T00:07:25.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.164+0000 7f82f8930780 1 < completed multipart upload key=OC61OW2M7ZEI upload=A1JDXXXLRH32 tag=T161J867UHVS type=write size=2396852 2024-09-12T00:07:25.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.167+0000 7f82f8930780 1 > prepared part key=_multipart_G55HN1VD6X47.2~I248LFSIV779.0 size=79950 2024-09-12T00:07:25.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.167+0000 7f82f8930780 1 > prepared multipart upload key=G55HN1VD6X47 upload=I248LFSIV779 tag=E6YBHC21A2U5 type=write size=1128526 2024-09-12T00:07:25.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.170+0000 7f82f8930780 1 < suggested remove operation key=IMAT4ZCLGFRN tag=QAUD7S1OSD65 type=del 2024-09-12T00:07:25.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.172+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~M7ZETWI2WX7F.0 size=1048576 2024-09-12T00:07:25.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.174+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~M7ZETWI2WX7F.1 size=1048576 2024-09-12T00:07:25.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.175+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~M7ZETWI2WX7F.2 size=165355 2024-09-12T00:07:25.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.175+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=M7ZETWI2WX7F tag=QR6N5B71GETF type=write size=3311083 2024-09-12T00:07:25.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.176+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~GPLP5MB5LVTU.0 size=692835 2024-09-12T00:07:25.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.179+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=GPLP5MB5LVTU tag=XZFZ1J6S48OJ type=write size=1741411 2024-09-12T00:07:25.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.180+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=MDAXAJV7XLGM type=del size=3738645 2024-09-12T00:07:25.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.182+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~J8Z8QRCH7XVF.0 size=362830 2024-09-12T00:07:25.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.184+0000 7f82f8930780 1 < completed multipart upload key=77SDZHCSP0E3 upload=J8Z8QRCH7XVF tag=6DA32ZWEDLSC type=write size=1411406 2024-09-12T00:07:25.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.186+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~3PQDZ9KLBD6N.0 size=1048576 2024-09-12T00:07:25.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.187+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~3PQDZ9KLBD6N.1 size=927039 2024-09-12T00:07:25.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.187+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=3PQDZ9KLBD6N tag=FB473RELORAI type=write size=3024191 2024-09-12T00:07:25.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.189+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=XAIIPLMDEV7J type=del 2024-09-12T00:07:25.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.190+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=GE3ZJ42BFKAQ type=write size=69287 2024-09-12T00:07:25.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.192+0000 7f82f8930780 1 < canceled operation key=OC61OW2M7ZEI tag=ROL3UU3T8674 type=del size=3457645 2024-09-12T00:07:25.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.193+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=N7183LNS7WNT type=write size=655510 2024-09-12T00:07:25.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.194+0000 7f82f8930780 1 < completed delete operation key=2XM2CF1T4VGW tag=UCFVFS4BAZWA type=del 2024-09-12T00:07:25.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.196+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=YW1Y043PLPL2 type=write size=365892 2024-09-12T00:07:25.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.198+0000 7f82f8930780 1 < suggested remove operation key=3X2PLA3ODHJ1 tag=C6QGZ6BB0DH4 type=del 2024-09-12T00:07:25.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.200+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=W3VTJHOT0VPV type=write size=69213 2024-09-12T00:07:25.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.201+0000 7f82f8930780 1 < completed delete operation key=OVJOP07M9KB8 tag=7C0MKHME9Z1T type=del 2024-09-12T00:07:25.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.203+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=3JBMGAY7CQ3Q type=del size=4168260 2024-09-12T00:07:25.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.203+0000 7f82f8930780 1 < canceled part key=_multipart_QB46N36A27QH.2~DYK0C2XVMX0F.0 size=1048576 2024-09-12T00:07:25.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.204+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~DYK0C2XVMX0F.1 size=224006 2024-09-12T00:07:25.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.206+0000 7f82f8930780 1 < canceled multipart upload key=QB46N36A27QH upload=DYK0C2XVMX0F tag=A0KMHDWJ0MNY type=write size=2321158 2024-09-12T00:07:25.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.208+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=I7E667VAPRSF type=write size=40383 2024-09-12T00:07:25.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.209+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~LY91N409OH60.0 size=1048576 2024-09-12T00:07:25.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.210+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~LY91N409OH60.1 size=1048576 2024-09-12T00:07:25.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.211+0000 7f82f8930780 1 < completed part key=_multipart_75GYP042UUC2.2~LY91N409OH60.2 size=139125 2024-09-12T00:07:25.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.214+0000 7f82f8930780 1 < completed multipart upload key=75GYP042UUC2 upload=LY91N409OH60 tag=WREZ26FVYMKW type=write size=3284853 2024-09-12T00:07:25.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.216+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=50NGPQFZQ0XM type=write size=621214 2024-09-12T00:07:25.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.217+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~6HLI7YN30ZZB.0 size=77508 2024-09-12T00:07:25.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.219+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=6HLI7YN30ZZB tag=FFPDHBKSV1E9 type=write size=1126084 2024-09-12T00:07:25.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.221+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=KQW9L0TA5XGB type=write size=880485 2024-09-12T00:07:25.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.224+0000 7f82f8930780 1 < suggested remove operation key=HCK59C6MAW0B tag=A5JQG650KC3A type=del 2024-09-12T00:07:25.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.226+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~2EA794A153XS.0 size=1048576 2024-09-12T00:07:25.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.227+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~2EA794A153XS.1 size=1048576 2024-09-12T00:07:25.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.229+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~2EA794A153XS.2 size=509517 2024-09-12T00:07:25.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.229+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=2EA794A153XS tag=YSHZUH3DSHY5 type=write size=3655245 2024-09-12T00:07:25.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.230+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=CDBB613E8HSI type=del 2024-09-12T00:07:25.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.231+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=EOI16OZJ8YQ3 type=write size=666836 2024-09-12T00:07:25.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.233+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=MMDC3BISVZNS type=del 2024-09-12T00:07:25.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.234+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=F325LSXBC55G type=write size=146937 2024-09-12T00:07:25.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.236+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~0J96H4236FL0.0 size=1048576 2024-09-12T00:07:25.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.237+0000 7f82f8930780 1 < completed part key=_multipart_4IA4918NXXJW.2~0J96H4236FL0.1 size=1048576 2024-09-12T00:07:25.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.237+0000 7f82f8930780 1 < canceled part key=_multipart_4IA4918NXXJW.2~0J96H4236FL0.2 size=982374 2024-09-12T00:07:25.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.239+0000 7f82f8930780 1 < canceled multipart upload key=4IA4918NXXJW upload=0J96H4236FL0 tag=2UNWDODAQIKG type=write size=4128102 2024-09-12T00:07:25.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.241+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~2JASKF2CWWZ9.0 size=903263 2024-09-12T00:07:25.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.242+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=2JASKF2CWWZ9 tag=KF6Z22WBW8WM type=write size=1951839 2024-09-12T00:07:25.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.243+0000 7f82f8930780 1 < completed part key=_multipart_G55HN1VD6X47.2~I248LFSIV779.0 size=79950 2024-09-12T00:07:25.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.245+0000 7f82f8930780 1 < completed multipart upload key=G55HN1VD6X47 upload=I248LFSIV779 tag=E6YBHC21A2U5 type=write size=1128526 2024-09-12T00:07:25.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.248+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~37IJG8DZJ46V.0 size=1048576 2024-09-12T00:07:25.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.249+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~37IJG8DZJ46V.1 size=630369 2024-09-12T00:07:25.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.249+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=37IJG8DZJ46V tag=CPBJMUUOBT1P type=write size=2727521 2024-09-12T00:07:25.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.251+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~M7ZETWI2WX7F.0 size=1048576 2024-09-12T00:07:25.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.252+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~M7ZETWI2WX7F.1 size=1048576 2024-09-12T00:07:25.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.253+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~M7ZETWI2WX7F.2 size=165355 2024-09-12T00:07:25.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.255+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=M7ZETWI2WX7F tag=QR6N5B71GETF type=write size=3311083 2024-09-12T00:07:25.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.257+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=YPM4I99EV60A type=write size=90886 2024-09-12T00:07:25.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.258+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=MDAXAJV7XLGM type=del 2024-09-12T00:07:25.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.260+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=P17JE4HOH2P7 type=write size=886615 2024-09-12T00:07:25.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.262+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~3PQDZ9KLBD6N.0 size=1048576 2024-09-12T00:07:25.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.264+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~3PQDZ9KLBD6N.1 size=927039 2024-09-12T00:07:25.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.266+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=3PQDZ9KLBD6N tag=FB473RELORAI type=write size=3024191 2024-09-12T00:07:25.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.267+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=81XCXXSVKTKR type=del size=1486787 2024-09-12T00:07:25.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.269+0000 7f82f8930780 1 < canceled operation key=80OUXNDPLGAG tag=GE3ZJ42BFKAQ type=write size=69287 2024-09-12T00:07:25.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.271+0000 7f82f8930780 1 > prepared part key=_multipart_IMAT4ZCLGFRN.2~3IRGRR36XDXB.0 size=784476 2024-09-12T00:07:25.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.271+0000 7f82f8930780 1 > prepared multipart upload key=IMAT4ZCLGFRN upload=3IRGRR36XDXB tag=H55Q0YLW4N6O type=write size=1833052 2024-09-12T00:07:25.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.273+0000 7f82f8930780 1 < completed write operation key=NCIZ4HNPCZ94 tag=N7183LNS7WNT type=write size=655510 2024-09-12T00:07:25.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.274+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=P092M61B1EHR type=write size=857417 2024-09-12T00:07:25.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.275+0000 7f82f8930780 1 < canceled operation key=NCIZ4HNPCZ94 tag=YW1Y043PLPL2 type=write size=365892 2024-09-12T00:07:25.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.277+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=53KECQTDL16D type=del size=1310668 2024-09-12T00:07:25.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.278+0000 7f82f8930780 1 < completed write operation key=FOWSB9RQ5TV5 tag=W3VTJHOT0VPV type=write size=69213 2024-09-12T00:07:25.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.280+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=Y1VJULHF4TZA type=del size=835492 2024-09-12T00:07:25.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.281+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=3JBMGAY7CQ3Q type=del 2024-09-12T00:07:25.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.283+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~JEY1EJE1TEGN.0 size=1048576 2024-09-12T00:07:25.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.284+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~JEY1EJE1TEGN.1 size=1048576 2024-09-12T00:07:25.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.286+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~JEY1EJE1TEGN.2 size=529224 2024-09-12T00:07:25.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.286+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=JEY1EJE1TEGN tag=CY97ZERY06MV type=write size=3674952 2024-09-12T00:07:25.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.288+0000 7f82f8930780 1 < suggested update operation key=W8SAQZWQHY36 tag=I7E667VAPRSF type=write size=40383 2024-09-12T00:07:25.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.290+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=A269Z62OEUBX type=del size=1374009 2024-09-12T00:07:25.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.291+0000 7f82f8930780 1 < canceled operation key=NCIZ4HNPCZ94 tag=50NGPQFZQ0XM type=write size=621214 2024-09-12T00:07:25.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.294+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~YZ2LCR4N15GJ.0 size=895865 2024-09-12T00:07:25.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.294+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=YZ2LCR4N15GJ tag=VSVEOXLJLN9T type=write size=1944441 2024-09-12T00:07:25.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.295+0000 7f82f8930780 -1 < failed to complete operation key=W8SAQZWQHY36 tag=KQW9L0TA5XGB type=write size=880485: (22) Invalid argument 2024-09-12T00:07:25.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.298+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~BVCFZAB39UIF.0 size=1048576 2024-09-12T00:07:25.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.299+0000 7f82f8930780 1 > prepared part key=_multipart_62X93NOS23AF.2~BVCFZAB39UIF.1 size=204598 2024-09-12T00:07:25.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.299+0000 7f82f8930780 1 > prepared multipart upload key=62X93NOS23AF upload=BVCFZAB39UIF tag=OCSME87PJK1R type=write size=2301750 2024-09-12T00:07:25.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.300+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~2EA794A153XS.0 size=1048576 2024-09-12T00:07:25.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.301+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~2EA794A153XS.1 size=1048576 2024-09-12T00:07:25.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.302+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~2EA794A153XS.2 size=509517 2024-09-12T00:07:25.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.305+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=2EA794A153XS tag=YSHZUH3DSHY5 type=write size=3655245 2024-09-12T00:07:25.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.306+0000 7f82f8930780 1 > prepared operation key=OC61OW2M7ZEI tag=W5Y3J87XF317 type=del size=144869 2024-09-12T00:07:25.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.308+0000 7f82f8930780 1 < completed write operation key=QB46N36A27QH tag=EOI16OZJ8YQ3 type=write size=666836 2024-09-12T00:07:25.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.310+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~V4WB2HN71AW0.0 size=766132 2024-09-12T00:07:25.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.310+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=V4WB2HN71AW0 tag=54JNKOW9AKY2 type=write size=1814708 2024-09-12T00:07:25.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.312+0000 7f82f8930780 1 < completed write operation key=IN8Y7I0HKP6D tag=F325LSXBC55G type=write size=146937 2024-09-12T00:07:25.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.313+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=0AM7PGZQWFR2 type=del size=3962711 2024-09-12T00:07:25.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.315+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~2JASKF2CWWZ9.0 size=903263 2024-09-12T00:07:25.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.317+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=2JASKF2CWWZ9 tag=KF6Z22WBW8WM type=write size=1951839 2024-09-12T00:07:25.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.318+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=B7UX8H1YOADR type=write size=397047 2024-09-12T00:07:25.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.320+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~37IJG8DZJ46V.0 size=1048576 2024-09-12T00:07:25.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.321+0000 7f82f8930780 1 < completed part key=_multipart_QB46N36A27QH.2~37IJG8DZJ46V.1 size=630369 2024-09-12T00:07:25.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.323+0000 7f82f8930780 1 < completed multipart upload key=QB46N36A27QH upload=37IJG8DZJ46V tag=CPBJMUUOBT1P type=write size=2727521 2024-09-12T00:07:25.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.324+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=AWJPJEX6OOWM type=del size=505717 2024-09-12T00:07:25.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.326+0000 7f82f8930780 1 < completed write operation key=HCK59C6MAW0B tag=YPM4I99EV60A type=write size=90886 2024-09-12T00:07:25.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.327+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=4S7K8V6KLK5C type=del size=2642024 2024-09-12T00:07:25.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.330+0000 7f82f8930780 1 < suggested update operation key=77SDZHCSP0E3 tag=P17JE4HOH2P7 type=write size=886615 2024-09-12T00:07:25.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.331+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=5SLEL5MQ5QRL type=write size=775551 2024-09-12T00:07:25.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.332+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=81XCXXSVKTKR type=del 2024-09-12T00:07:25.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.335+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~3NBKM1IK66VV.0 size=888925 2024-09-12T00:07:25.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.335+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=3NBKM1IK66VV tag=4QNQNHCDE949 type=write size=1937501 2024-09-12T00:07:25.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.336+0000 7f82f8930780 1 < completed part key=_multipart_IMAT4ZCLGFRN.2~3IRGRR36XDXB.0 size=784476 2024-09-12T00:07:25.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.338+0000 7f82f8930780 1 < completed multipart upload key=IMAT4ZCLGFRN upload=3IRGRR36XDXB tag=H55Q0YLW4N6O type=write size=1833052 2024-09-12T00:07:25.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.341+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~V401IX490MOF.0 size=1048576 2024-09-12T00:07:25.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.342+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~V401IX490MOF.1 size=1048576 2024-09-12T00:07:25.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.343+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~V401IX490MOF.2 size=510659 2024-09-12T00:07:25.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.343+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=V401IX490MOF tag=D4VOGR90WFVU type=write size=3656387 2024-09-12T00:07:25.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.344+0000 7f82f8930780 1 < completed write operation key=4SPRDO097JYQ tag=P092M61B1EHR type=write size=857417 2024-09-12T00:07:25.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.346+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=FH1JSGARDNKG type=del size=2431632 2024-09-12T00:07:25.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.347+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=53KECQTDL16D type=del 2024-09-12T00:07:25.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.349+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=SRS5ZJX1MICJ type=del size=3963087 2024-09-12T00:07:25.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.350+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=Y1VJULHF4TZA type=del 2024-09-12T00:07:25.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.353+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~24GSF1TAJHG2.0 size=1048576 2024-09-12T00:07:25.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.354+0000 7f82f8930780 1 > prepared part key=_multipart_A8EFUP30RS65.2~24GSF1TAJHG2.1 size=793546 2024-09-12T00:07:25.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.354+0000 7f82f8930780 1 > prepared multipart upload key=A8EFUP30RS65 upload=24GSF1TAJHG2 tag=T2GAND5LAD75 type=write size=2890698 2024-09-12T00:07:25.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.355+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~JEY1EJE1TEGN.0 size=1048576 2024-09-12T00:07:25.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.356+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~JEY1EJE1TEGN.1 size=1048576 2024-09-12T00:07:25.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.358+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~JEY1EJE1TEGN.2 size=529224 2024-09-12T00:07:25.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.360+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=JEY1EJE1TEGN tag=CY97ZERY06MV type=write size=3674952 2024-09-12T00:07:25.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.363+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~Z3IACWZV26XD.0 size=1048576 2024-09-12T00:07:25.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.364+0000 7f82f8930780 1 > prepared part key=_multipart_O2ZGU2KOTUOT.2~Z3IACWZV26XD.1 size=572209 2024-09-12T00:07:25.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.364+0000 7f82f8930780 1 > prepared multipart upload key=O2ZGU2KOTUOT upload=Z3IACWZV26XD tag=0IETQXLFNXJP type=write size=2669361 2024-09-12T00:07:25.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.365+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=A269Z62OEUBX type=del 2024-09-12T00:07:25.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.367+0000 7f82f8930780 1 > prepared operation key=A8EFUP30RS65 tag=PU3KS2L38B4P type=del size=367580 2024-09-12T00:07:25.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.367+0000 7f82f8930780 1 < canceled part key=_multipart_AMWMQXO10EXK.2~YZ2LCR4N15GJ.0 size=895865 2024-09-12T00:07:25.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.369+0000 7f82f8930780 1 < canceled multipart upload key=AMWMQXO10EXK upload=YZ2LCR4N15GJ tag=VSVEOXLJLN9T type=write size=1944441 2024-09-12T00:07:25.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.371+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=3O1AWJ1GH22J type=del size=647243 2024-09-12T00:07:25.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.372+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~BVCFZAB39UIF.0 size=1048576 2024-09-12T00:07:25.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.373+0000 7f82f8930780 1 < completed part key=_multipart_62X93NOS23AF.2~BVCFZAB39UIF.1 size=204598 2024-09-12T00:07:25.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.376+0000 7f82f8930780 1 < completed multipart upload key=62X93NOS23AF upload=BVCFZAB39UIF tag=OCSME87PJK1R type=write size=2301750 2024-09-12T00:07:25.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.377+0000 7f82f8930780 1 > prepared operation key=77SDZHCSP0E3 tag=3UMTCIA7FAAO type=del size=474014 2024-09-12T00:07:25.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.379+0000 7f82f8930780 1 < completed delete operation key=OC61OW2M7ZEI tag=W5Y3J87XF317 type=del 2024-09-12T00:07:25.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.380+0000 7f82f8930780 1 > prepared operation key=IN8Y7I0HKP6D tag=OXTI1S9QW8K8 type=del size=3963103 2024-09-12T00:07:25.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.381+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~V4WB2HN71AW0.0 size=766132 2024-09-12T00:07:25.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.383+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=V4WB2HN71AW0 tag=54JNKOW9AKY2 type=write size=1814708 2024-09-12T00:07:25.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.385+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=LU375B84BNN0 type=del size=1875987 2024-09-12T00:07:25.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.386+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=0AM7PGZQWFR2 type=del 2024-09-12T00:07:25.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.387+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=E5X3ZRT2UO6U type=del size=1552131 2024-09-12T00:07:25.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.389+0000 7f82f8930780 1 < completed write operation key=NCIZ4HNPCZ94 tag=B7UX8H1YOADR type=write size=397047 2024-09-12T00:07:25.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.390+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=BZA4ZXW9G482 type=del size=21179 2024-09-12T00:07:25.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.393+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=AWJPJEX6OOWM type=del 2024-09-12T00:07:25.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.396+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~QN3HD1FIMGKP.0 size=1048576 2024-09-12T00:07:25.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.397+0000 7f82f8930780 1 > prepared part key=_multipart_2XM2CF1T4VGW.2~QN3HD1FIMGKP.1 size=775094 2024-09-12T00:07:25.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.397+0000 7f82f8930780 1 > prepared multipart upload key=2XM2CF1T4VGW upload=QN3HD1FIMGKP tag=3T3XJEBXYIJA type=write size=2872246 2024-09-12T00:07:25.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.398+0000 7f82f8930780 1 < completed delete operation key=W8SAQZWQHY36 tag=4S7K8V6KLK5C type=del 2024-09-12T00:07:25.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.399+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=4G8RIXO3BBYJ type=del size=321290 2024-09-12T00:07:25.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.401+0000 7f82f8930780 1 < completed write operation key=HCK59C6MAW0B tag=5SLEL5MQ5QRL type=write size=775551 2024-09-12T00:07:25.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.403+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~XEJ60HKCZDKZ.0 size=757220 2024-09-12T00:07:25.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.403+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=XEJ60HKCZDKZ tag=LXXERQJF03P2 type=write size=1805796 2024-09-12T00:07:25.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.405+0000 7f82f8930780 1 < completed part key=_multipart_Y8GDXNDCOHCW.2~3NBKM1IK66VV.0 size=888925 2024-09-12T00:07:25.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.407+0000 7f82f8930780 1 < completed multipart upload key=Y8GDXNDCOHCW upload=3NBKM1IK66VV tag=4QNQNHCDE949 type=write size=1937501 2024-09-12T00:07:25.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.410+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~9STCMWOH87UP.0 size=1048576 2024-09-12T00:07:25.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.411+0000 7f82f8930780 1 > prepared part key=_multipart_X3PCR8TCWDTK.2~9STCMWOH87UP.1 size=280724 2024-09-12T00:07:25.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.411+0000 7f82f8930780 1 > prepared multipart upload key=X3PCR8TCWDTK upload=9STCMWOH87UP tag=Z6B31JNF179Q type=write size=2377876 2024-09-12T00:07:25.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.413+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~V401IX490MOF.0 size=1048576 2024-09-12T00:07:25.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.414+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~V401IX490MOF.1 size=1048576 2024-09-12T00:07:25.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.415+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~V401IX490MOF.2 size=510659 2024-09-12T00:07:25.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.417+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=V401IX490MOF tag=D4VOGR90WFVU type=write size=3656387 2024-09-12T00:07:25.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.419+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=1XMQ9836K0H1 type=del size=1765925 2024-09-12T00:07:25.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.420+0000 7f82f8930780 1 < completed delete operation key=4IA4918NXXJW tag=FH1JSGARDNKG type=del 2024-09-12T00:07:25.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.422+0000 7f82f8930780 1 > prepared operation key=Y8GDXNDCOHCW tag=ER4O4AC88C8U type=del size=2512581 2024-09-12T00:07:25.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.423+0000 7f82f8930780 1 < completed delete operation key=AMWMQXO10EXK tag=SRS5ZJX1MICJ type=del 2024-09-12T00:07:25.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.426+0000 7f82f8930780 1 > prepared part key=_multipart_NCIZ4HNPCZ94.2~XXIBD8HQQ41D.0 size=702532 2024-09-12T00:07:25.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.426+0000 7f82f8930780 1 > prepared multipart upload key=NCIZ4HNPCZ94 upload=XXIBD8HQQ41D tag=YDIV28SC7TR4 type=write size=1751108 2024-09-12T00:07:25.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.427+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~24GSF1TAJHG2.0 size=1048576 2024-09-12T00:07:25.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.428+0000 7f82f8930780 1 < completed part key=_multipart_A8EFUP30RS65.2~24GSF1TAJHG2.1 size=793546 2024-09-12T00:07:25.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.431+0000 7f82f8930780 1 < completed multipart upload key=A8EFUP30RS65 upload=24GSF1TAJHG2 tag=T2GAND5LAD75 type=write size=2890698 2024-09-12T00:07:25.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.433+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~O2NQ9BMGP9KL.0 size=1048576 2024-09-12T00:07:25.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.434+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~O2NQ9BMGP9KL.1 size=1048576 2024-09-12T00:07:25.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.435+0000 7f82f8930780 1 > prepared part key=_multipart_80OUXNDPLGAG.2~O2NQ9BMGP9KL.2 size=451048 2024-09-12T00:07:25.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.435+0000 7f82f8930780 1 > prepared multipart upload key=80OUXNDPLGAG upload=O2NQ9BMGP9KL tag=W48L7AEKRN9D type=write size=3596776 2024-09-12T00:07:25.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.436+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~Z3IACWZV26XD.0 size=1048576 2024-09-12T00:07:25.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.438+0000 7f82f8930780 1 < completed part key=_multipart_O2ZGU2KOTUOT.2~Z3IACWZV26XD.1 size=572209 2024-09-12T00:07:25.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.440+0000 7f82f8930780 1 < completed multipart upload key=O2ZGU2KOTUOT upload=Z3IACWZV26XD tag=0IETQXLFNXJP type=write size=2669361 2024-09-12T00:07:25.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.443+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~FP47CLWHEIST.0 size=27073 2024-09-12T00:07:25.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.443+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=FP47CLWHEIST tag=KY9ZRD5SCZAJ type=write size=1075649 2024-09-12T00:07:25.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.444+0000 7f82f8930780 1 < completed delete operation key=A8EFUP30RS65 tag=PU3KS2L38B4P type=del 2024-09-12T00:07:25.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.447+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~7U0HA5GL378H.0 size=1048576 2024-09-12T00:07:25.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.448+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~7U0HA5GL378H.1 size=1048576 2024-09-12T00:07:25.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.449+0000 7f82f8930780 1 > prepared part key=_multipart_MJZ56OX8PLSH.2~7U0HA5GL378H.2 size=854786 2024-09-12T00:07:25.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.449+0000 7f82f8930780 1 > prepared multipart upload key=MJZ56OX8PLSH upload=7U0HA5GL378H tag=UYB34Q1RA7AS type=write size=4000514 2024-09-12T00:07:25.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.452+0000 7f82f8930780 1 < suggested update operation key=HCK59C6MAW0B tag=3O1AWJ1GH22J type=del size=647243 2024-09-12T00:07:25.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.454+0000 7f82f8930780 1 > prepared operation key=FHQADENLR6GP tag=3PWEZ0YKONLE type=del size=612562 2024-09-12T00:07:25.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.455+0000 7f82f8930780 1 < completed delete operation key=77SDZHCSP0E3 tag=3UMTCIA7FAAO type=del 2024-09-12T00:07:25.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.457+0000 7f82f8930780 1 > prepared operation key=G55HN1VD6X47 tag=T7WKKOH3U02K type=del size=4128888 2024-09-12T00:07:25.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.459+0000 7f82f8930780 1 < completed delete operation key=IN8Y7I0HKP6D tag=OXTI1S9QW8K8 type=del 2024-09-12T00:07:25.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.461+0000 7f82f8930780 1 > prepared part key=_multipart_N2TYUAJITFNL.2~30D9K3X6ZOB7.0 size=557761 2024-09-12T00:07:25.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.461+0000 7f82f8930780 1 > prepared multipart upload key=N2TYUAJITFNL upload=30D9K3X6ZOB7 tag=ZY5GRG14FJL1 type=write size=1606337 2024-09-12T00:07:25.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.465+0000 7f82f8930780 1 < suggested update operation key=62X93NOS23AF tag=LU375B84BNN0 type=del size=1875987 2024-09-12T00:07:25.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.467+0000 7f82f8930780 1 > prepared operation key=80OUXNDPLGAG tag=UW08U7Q4BJC9 type=del size=2507318 2024-09-12T00:07:25.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.468+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=E5X3ZRT2UO6U type=del 2024-09-12T00:07:25.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.471+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~N37JF285CULE.0 size=1048576 2024-09-12T00:07:25.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.472+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~N37JF285CULE.1 size=1048576 2024-09-12T00:07:25.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.473+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~N37JF285CULE.2 size=395547 2024-09-12T00:07:25.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.473+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=N37JF285CULE tag=L368PKIMJV36 type=write size=3541275 2024-09-12T00:07:25.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.475+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=BZA4ZXW9G482 type=del 2024-09-12T00:07:25.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.476+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=GGW8MPPTBCOG type=del size=2207499 2024-09-12T00:07:25.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.478+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~QN3HD1FIMGKP.0 size=1048576 2024-09-12T00:07:25.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.479+0000 7f82f8930780 1 < completed part key=_multipart_2XM2CF1T4VGW.2~QN3HD1FIMGKP.1 size=775094 2024-09-12T00:07:25.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.481+0000 7f82f8930780 1 < completed multipart upload key=2XM2CF1T4VGW upload=QN3HD1FIMGKP tag=3T3XJEBXYIJA type=write size=2872246 2024-09-12T00:07:25.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.484+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~AGF2G81UX2PN.0 size=1048576 2024-09-12T00:07:25.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.485+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~AGF2G81UX2PN.1 size=1048576 2024-09-12T00:07:25.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.486+0000 7f82f8930780 1 > prepared part key=_multipart_3X2PLA3ODHJ1.2~AGF2G81UX2PN.2 size=630552 2024-09-12T00:07:25.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.486+0000 7f82f8930780 1 > prepared multipart upload key=3X2PLA3ODHJ1 upload=AGF2G81UX2PN tag=0D2RYNZX0BFX type=write size=3776280 2024-09-12T00:07:25.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.487+0000 7f82f8930780 1 < completed delete operation key=4SPRDO097JYQ tag=4G8RIXO3BBYJ type=del 2024-09-12T00:07:25.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.489+0000 7f82f8930780 1 > prepared operation key=W8SAQZWQHY36 tag=TEED2ID3DQLX type=write size=42919 2024-09-12T00:07:25.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.490+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~XEJ60HKCZDKZ.0 size=757220 2024-09-12T00:07:25.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.492+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=XEJ60HKCZDKZ tag=LXXERQJF03P2 type=write size=1805796 2024-09-12T00:07:25.493 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.495+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~T3GHO5EUMLEL.0 size=1048576 2024-09-12T00:07:25.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.496+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~T3GHO5EUMLEL.1 size=1048576 2024-09-12T00:07:25.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.497+0000 7f82f8930780 1 > prepared part key=_multipart_AMWMQXO10EXK.2~T3GHO5EUMLEL.2 size=706987 2024-09-12T00:07:25.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.497+0000 7f82f8930780 1 > prepared multipart upload key=AMWMQXO10EXK upload=T3GHO5EUMLEL tag=AIXEYHQIZ7W4 type=write size=3852715 2024-09-12T00:07:25.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.497+0000 7f82f8930780 1 < canceled part key=_multipart_X3PCR8TCWDTK.2~9STCMWOH87UP.0 size=1048576 2024-09-12T00:07:25.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.498+0000 7f82f8930780 1 < completed part key=_multipart_X3PCR8TCWDTK.2~9STCMWOH87UP.1 size=280724 2024-09-12T00:07:25.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.501+0000 7f82f8930780 1 < canceled multipart upload key=X3PCR8TCWDTK upload=9STCMWOH87UP tag=Z6B31JNF179Q type=write size=2377876 2024-09-12T00:07:25.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.502+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=I2Q8V90JH103 type=del size=1689415 2024-09-12T00:07:25.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.504+0000 7f82f8930780 1 < completed delete operation key=MJZ56OX8PLSH tag=1XMQ9836K0H1 type=del 2024-09-12T00:07:25.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.505+0000 7f82f8930780 1 > prepared operation key=BJHGNT3HBS25 tag=86E4PPH3Q4G7 type=write size=344923 2024-09-12T00:07:25.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.506+0000 7f82f8930780 1 < completed delete operation key=Y8GDXNDCOHCW tag=ER4O4AC88C8U type=del 2024-09-12T00:07:25.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.508+0000 7f82f8930780 1 > prepared operation key=O2ZGU2KOTUOT tag=027C15JUUA3N type=del size=3742160 2024-09-12T00:07:25.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.509+0000 7f82f8930780 1 < completed part key=_multipart_NCIZ4HNPCZ94.2~XXIBD8HQQ41D.0 size=702532 2024-09-12T00:07:25.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.511+0000 7f82f8930780 1 < completed multipart upload key=NCIZ4HNPCZ94 upload=XXIBD8HQQ41D tag=YDIV28SC7TR4 type=write size=1751108 2024-09-12T00:07:25.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.514+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~AEYAJUWOHU6A.0 size=1048576 2024-09-12T00:07:25.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.515+0000 7f82f8930780 1 > prepared part key=_multipart_FHQADENLR6GP.2~AEYAJUWOHU6A.1 size=951200 2024-09-12T00:07:25.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.515+0000 7f82f8930780 1 > prepared multipart upload key=FHQADENLR6GP upload=AEYAJUWOHU6A tag=RWG3I7QQGXUX type=write size=3048352 2024-09-12T00:07:25.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.517+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~O2NQ9BMGP9KL.0 size=1048576 2024-09-12T00:07:25.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.518+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~O2NQ9BMGP9KL.1 size=1048576 2024-09-12T00:07:25.517 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.519+0000 7f82f8930780 1 < completed part key=_multipart_80OUXNDPLGAG.2~O2NQ9BMGP9KL.2 size=451048 2024-09-12T00:07:25.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.521+0000 7f82f8930780 1 < completed multipart upload key=80OUXNDPLGAG upload=O2NQ9BMGP9KL tag=W48L7AEKRN9D type=write size=3596776 2024-09-12T00:07:25.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.523+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=23AYP09HVE9L type=del size=3721373 2024-09-12T00:07:25.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.525+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~FP47CLWHEIST.0 size=27073 2024-09-12T00:07:25.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.528+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=FP47CLWHEIST tag=KY9ZRD5SCZAJ type=write size=1075649 2024-09-12T00:07:25.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.529+0000 7f82f8930780 1 > prepared operation key=4SPRDO097JYQ tag=3C87Z0OVGVZT type=write size=666488 2024-09-12T00:07:25.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.531+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~7U0HA5GL378H.0 size=1048576 2024-09-12T00:07:25.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.533+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~7U0HA5GL378H.1 size=1048576 2024-09-12T00:07:25.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.534+0000 7f82f8930780 1 < completed part key=_multipart_MJZ56OX8PLSH.2~7U0HA5GL378H.2 size=854786 2024-09-12T00:07:25.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.536+0000 7f82f8930780 1 < completed multipart upload key=MJZ56OX8PLSH upload=7U0HA5GL378H tag=UYB34Q1RA7AS type=write size=4000514 2024-09-12T00:07:25.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.537+0000 7f82f8930780 1 > prepared operation key=75GYP042UUC2 tag=Y4NXJX27ZF3S type=del size=678215 2024-09-12T00:07:25.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.539+0000 7f82f8930780 1 < completed delete operation key=FHQADENLR6GP tag=3PWEZ0YKONLE type=del 2024-09-12T00:07:25.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.540+0000 7f82f8930780 1 > prepared operation key=YWC5JUV5B2N6 tag=6VC1N4AN22ZR type=del size=610492 2024-09-12T00:07:25.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.542+0000 7f82f8930780 1 < completed delete operation key=G55HN1VD6X47 tag=T7WKKOH3U02K type=del 2024-09-12T00:07:25.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.543+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=JAOP5UX2UF0D type=del size=4014090 2024-09-12T00:07:25.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.545+0000 7f82f8930780 1 < completed part key=_multipart_N2TYUAJITFNL.2~30D9K3X6ZOB7.0 size=557761 2024-09-12T00:07:25.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.547+0000 7f82f8930780 1 < completed multipart upload key=N2TYUAJITFNL upload=30D9K3X6ZOB7 tag=ZY5GRG14FJL1 type=write size=1606337 2024-09-12T00:07:25.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.549+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~HPBE2816SOVX.0 size=1048576 2024-09-12T00:07:25.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.551+0000 7f82f8930780 1 > prepared part key=_multipart_9576W9WYJUJV.2~HPBE2816SOVX.1 size=584019 2024-09-12T00:07:25.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.551+0000 7f82f8930780 1 > prepared multipart upload key=9576W9WYJUJV upload=HPBE2816SOVX tag=NU7DHBJG4ELI type=write size=2681171 2024-09-12T00:07:25.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.552+0000 7f82f8930780 1 < completed delete operation key=80OUXNDPLGAG tag=UW08U7Q4BJC9 type=del 2024-09-12T00:07:25.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.554+0000 7f82f8930780 1 > prepared operation key=N2TYUAJITFNL tag=NYZ1RSFLGH9Y type=del size=3517670 2024-09-12T00:07:25.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.555+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~N37JF285CULE.0 size=1048576 2024-09-12T00:07:25.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.557+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~N37JF285CULE.1 size=1048576 2024-09-12T00:07:25.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.558+0000 7f82f8930780 1 < completed part key=_multipart_YWC5JUV5B2N6.2~N37JF285CULE.2 size=395547 2024-09-12T00:07:25.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.560+0000 7f82f8930780 1 < completed multipart upload key=YWC5JUV5B2N6 upload=N37JF285CULE tag=L368PKIMJV36 type=write size=3541275 2024-09-12T00:07:25.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.563+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~EL4PROSWVZYY.0 size=919503 2024-09-12T00:07:25.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.563+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=EL4PROSWVZYY tag=GDZABNMPCUGU type=write size=1968079 2024-09-12T00:07:25.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.564+0000 7f82f8930780 1 < completed delete operation key=BJHGNT3HBS25 tag=GGW8MPPTBCOG type=del 2024-09-12T00:07:25.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.566+0000 7f82f8930780 1 > prepared part key=_multipart_OVJOP07M9KB8.2~06K9QG0DRG5R.0 size=668200 2024-09-12T00:07:25.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.567+0000 7f82f8930780 1 > prepared multipart upload key=OVJOP07M9KB8 upload=06K9QG0DRG5R tag=R2VQM3NQQ0BS type=write size=1716776 2024-09-12T00:07:25.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.568+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~AGF2G81UX2PN.0 size=1048576 2024-09-12T00:07:25.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.569+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~AGF2G81UX2PN.1 size=1048576 2024-09-12T00:07:25.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.570+0000 7f82f8930780 1 < completed part key=_multipart_3X2PLA3ODHJ1.2~AGF2G81UX2PN.2 size=630552 2024-09-12T00:07:25.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.573+0000 7f82f8930780 1 < completed multipart upload key=3X2PLA3ODHJ1 upload=AGF2G81UX2PN tag=0D2RYNZX0BFX type=write size=3776280 2024-09-12T00:07:25.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.574+0000 7f82f8930780 1 > prepared operation key=LAKJS79KNBY7 tag=V74B84IOQDO1 type=del size=1655483 2024-09-12T00:07:25.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.576+0000 7f82f8930780 1 < completed write operation key=W8SAQZWQHY36 tag=TEED2ID3DQLX type=write size=42919 2024-09-12T00:07:25.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.577+0000 7f82f8930780 1 > prepared operation key=62X93NOS23AF tag=CX13AQT68ITQ type=write size=100946 2024-09-12T00:07:25.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.578+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~T3GHO5EUMLEL.0 size=1048576 2024-09-12T00:07:25.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.579+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~T3GHO5EUMLEL.1 size=1048576 2024-09-12T00:07:25.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.580+0000 7f82f8930780 1 < completed part key=_multipart_AMWMQXO10EXK.2~T3GHO5EUMLEL.2 size=706987 2024-09-12T00:07:25.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.582+0000 7f82f8930780 1 < completed multipart upload key=AMWMQXO10EXK upload=T3GHO5EUMLEL tag=AIXEYHQIZ7W4 type=write size=3852715 2024-09-12T00:07:25.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.585+0000 7f82f8930780 1 > prepared part key=_multipart_77SDZHCSP0E3.2~IP99WPY0SBHS.0 size=105207 2024-09-12T00:07:25.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.585+0000 7f82f8930780 1 > prepared multipart upload key=77SDZHCSP0E3 upload=IP99WPY0SBHS tag=S3GG8ZI7HIT1 type=write size=1153783 2024-09-12T00:07:25.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.588+0000 7f82f8930780 1 < suggested remove operation key=3H3D067Z8O0R tag=I2Q8V90JH103 type=del 2024-09-12T00:07:25.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.589+0000 7f82f8930780 1 > prepared operation key=QB46N36A27QH tag=OGYDD3BC829V type=del size=3130995 2024-09-12T00:07:25.589 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.590+0000 7f82f8930780 1 < completed write operation key=BJHGNT3HBS25 tag=86E4PPH3Q4G7 type=write size=344923 2024-09-12T00:07:25.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.593+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~GRUSZ4X12QBR.0 size=1048576 2024-09-12T00:07:25.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.594+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~GRUSZ4X12QBR.1 size=1048576 2024-09-12T00:07:25.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.595+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~GRUSZ4X12QBR.2 size=850359 2024-09-12T00:07:25.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.595+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=GRUSZ4X12QBR tag=IH4IQK2RVLF6 type=write size=3996087 2024-09-12T00:07:25.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.596+0000 7f82f8930780 1 < completed delete operation key=O2ZGU2KOTUOT tag=027C15JUUA3N type=del 2024-09-12T00:07:25.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.598+0000 7f82f8930780 1 > prepared operation key=AMWMQXO10EXK tag=CHV87MU5GGO0 type=del size=3466765 2024-09-12T00:07:25.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.599+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~AEYAJUWOHU6A.0 size=1048576 2024-09-12T00:07:25.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.600+0000 7f82f8930780 1 < completed part key=_multipart_FHQADENLR6GP.2~AEYAJUWOHU6A.1 size=951200 2024-09-12T00:07:25.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.602+0000 7f82f8930780 1 < completed multipart upload key=FHQADENLR6GP upload=AEYAJUWOHU6A tag=RWG3I7QQGXUX type=write size=3048352 2024-09-12T00:07:25.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.603+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=GTDENR2ZOXHB type=del size=2217175 2024-09-12T00:07:25.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.605+0000 7f82f8930780 1 < canceled operation key=FOWSB9RQ5TV5 tag=23AYP09HVE9L type=del size=3721373 2024-09-12T00:07:25.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.607+0000 7f82f8930780 1 > prepared part key=_multipart_Y8GDXNDCOHCW.2~5QNWRP5LHCRD.0 size=288176 2024-09-12T00:07:25.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.607+0000 7f82f8930780 1 > prepared multipart upload key=Y8GDXNDCOHCW upload=5QNWRP5LHCRD tag=OLYQYZBJVROX type=write size=1336752 2024-09-12T00:07:25.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.609+0000 7f82f8930780 1 < canceled operation key=4SPRDO097JYQ tag=3C87Z0OVGVZT type=write size=666488 2024-09-12T00:07:25.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.610+0000 7f82f8930780 1 > prepared operation key=HCK59C6MAW0B tag=IR6BTJ6ZAZT7 type=del size=1776515 2024-09-12T00:07:25.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.612+0000 7f82f8930780 1 < completed delete operation key=75GYP042UUC2 tag=Y4NXJX27ZF3S type=del 2024-09-12T00:07:25.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.613+0000 7f82f8930780 1 > prepared operation key=IMAT4ZCLGFRN tag=O8FX96B0G7K5 type=del size=3270569 2024-09-12T00:07:25.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.615+0000 7f82f8930780 1 < completed delete operation key=YWC5JUV5B2N6 tag=6VC1N4AN22ZR type=del 2024-09-12T00:07:25.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.617+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~OKLZ5Q3MTKY1.0 size=1048576 2024-09-12T00:07:25.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.618+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~OKLZ5Q3MTKY1.1 size=1048576 2024-09-12T00:07:25.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.620+0000 7f82f8930780 1 > prepared part key=_multipart_75GYP042UUC2.2~OKLZ5Q3MTKY1.2 size=893921 2024-09-12T00:07:25.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.620+0000 7f82f8930780 1 > prepared multipart upload key=75GYP042UUC2 upload=OKLZ5Q3MTKY1 tag=RM09ELR1HLR3 type=write size=4039649 2024-09-12T00:07:25.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.621+0000 7f82f8930780 1 < completed delete operation key=FOWSB9RQ5TV5 tag=JAOP5UX2UF0D type=del 2024-09-12T00:07:25.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.622+0000 7f82f8930780 1 > prepared operation key=FOWSB9RQ5TV5 tag=H3DR3MYJDX3W type=write size=577817 2024-09-12T00:07:25.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.624+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~HPBE2816SOVX.0 size=1048576 2024-09-12T00:07:25.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.625+0000 7f82f8930780 1 < completed part key=_multipart_9576W9WYJUJV.2~HPBE2816SOVX.1 size=584019 2024-09-12T00:07:25.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.627+0000 7f82f8930780 1 < completed multipart upload key=9576W9WYJUJV upload=HPBE2816SOVX tag=NU7DHBJG4ELI type=write size=2681171 2024-09-12T00:07:25.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.629+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~VTF4GTWQ3TMS.0 size=1048576 2024-09-12T00:07:25.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.630+0000 7f82f8930780 1 > prepared part key=_multipart_QB46N36A27QH.2~VTF4GTWQ3TMS.1 size=253714 2024-09-12T00:07:25.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.630+0000 7f82f8930780 1 > prepared multipart upload key=QB46N36A27QH upload=VTF4GTWQ3TMS tag=UADS2WM61FN5 type=write size=2350866 2024-09-12T00:07:25.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.632+0000 7f82f8930780 1 < completed delete operation key=N2TYUAJITFNL tag=NYZ1RSFLGH9Y type=del 2024-09-12T00:07:25.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.634+0000 7f82f8930780 1 > prepared part key=_multipart_YWC5JUV5B2N6.2~D1T9I7XMXTUR.0 size=697321 2024-09-12T00:07:25.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.634+0000 7f82f8930780 1 > prepared multipart upload key=YWC5JUV5B2N6 upload=D1T9I7XMXTUR tag=PKTJ4U3UYXZM type=write size=1745897 2024-09-12T00:07:25.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.636+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~EL4PROSWVZYY.0 size=919503 2024-09-12T00:07:25.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.638+0000 7f82f8930780 1 < completed multipart upload key=Y5U8MO9TOJQQ upload=EL4PROSWVZYY tag=GDZABNMPCUGU type=write size=1968079 2024-09-12T00:07:25.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.640+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~X7WCLHY2CO8C.0 size=1048576 2024-09-12T00:07:25.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.641+0000 7f82f8930780 1 > prepared part key=_multipart_Y5U8MO9TOJQQ.2~X7WCLHY2CO8C.1 size=952756 2024-09-12T00:07:25.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.641+0000 7f82f8930780 1 > prepared multipart upload key=Y5U8MO9TOJQQ upload=X7WCLHY2CO8C tag=AZPGK7LXG7T0 type=write size=3049908 2024-09-12T00:07:25.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.642+0000 7f82f8930780 1 < completed part key=_multipart_OVJOP07M9KB8.2~06K9QG0DRG5R.0 size=668200 2024-09-12T00:07:25.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.645+0000 7f82f8930780 1 < completed multipart upload key=OVJOP07M9KB8 upload=06K9QG0DRG5R tag=R2VQM3NQQ0BS type=write size=1716776 2024-09-12T00:07:25.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.648+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~N0C7KSY9964Y.0 size=1048576 2024-09-12T00:07:25.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.649+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~N0C7KSY9964Y.1 size=1048576 2024-09-12T00:07:25.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.650+0000 7f82f8930780 1 > prepared part key=_multipart_4SPRDO097JYQ.2~N0C7KSY9964Y.2 size=309284 2024-09-12T00:07:25.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.650+0000 7f82f8930780 1 > prepared multipart upload key=4SPRDO097JYQ upload=N0C7KSY9964Y tag=AWF1FQ84O1H6 type=write size=3455012 2024-09-12T00:07:25.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.652+0000 7f82f8930780 1 < completed delete operation key=LAKJS79KNBY7 tag=V74B84IOQDO1 type=del 2024-09-12T00:07:25.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.655+0000 7f82f8930780 1 > prepared operation key=MJZ56OX8PLSH tag=A3G7B7PLLN1B type=del size=2027577 2024-09-12T00:07:25.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.656+0000 7f82f8930780 1 < completed write operation key=62X93NOS23AF tag=CX13AQT68ITQ type=write size=100946 2024-09-12T00:07:25.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.657+0000 7f82f8930780 1 > prepared operation key=3H3D067Z8O0R tag=6NNRUTZVFSP9 type=del size=289949 2024-09-12T00:07:25.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.659+0000 7f82f8930780 1 < completed part key=_multipart_77SDZHCSP0E3.2~IP99WPY0SBHS.0 size=105207 2024-09-12T00:07:25.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.661+0000 7f82f8930780 1 < completed multipart upload key=77SDZHCSP0E3 upload=IP99WPY0SBHS tag=S3GG8ZI7HIT1 type=write size=1153783 2024-09-12T00:07:25.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.662+0000 7f82f8930780 1 > prepared operation key=3X2PLA3ODHJ1 tag=LZ24HJZ5ZMNI type=del size=2408631 2024-09-12T00:07:25.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.663+0000 7f82f8930780 1 < completed delete operation key=QB46N36A27QH tag=OGYDD3BC829V type=del 2024-09-12T00:07:25.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.666+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~QM6VE7YGIVNL.0 size=1048576 2024-09-12T00:07:25.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.667+0000 7f82f8930780 1 > prepared part key=_multipart_OC61OW2M7ZEI.2~QM6VE7YGIVNL.1 size=218044 2024-09-12T00:07:25.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.667+0000 7f82f8930780 1 > prepared multipart upload key=OC61OW2M7ZEI upload=QM6VE7YGIVNL tag=C5RLV0DCD910 type=write size=2315196 2024-09-12T00:07:25.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.668+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~GRUSZ4X12QBR.0 size=1048576 2024-09-12T00:07:25.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.670+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~GRUSZ4X12QBR.1 size=1048576 2024-09-12T00:07:25.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.671+0000 7f82f8930780 1 < completed part key=_multipart_Y5U8MO9TOJQQ.2~GRUSZ4X12QBR.2 size=850359 2024-09-12T00:07:25.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.673+0000 7f82f8930780 1 < completed multipart upload key=Y5U8MO9TOJQQ upload=GRUSZ4X12QBR tag=IH4IQK2RVLF6 type=write size=3996087 2024-09-12T00:07:25.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.675+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=2KSRLWI62RLQ type=write size=443652 2024-09-12T00:07:25.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.677+0000 7f82f8930780 1 < suggested remove operation key=AMWMQXO10EXK tag=CHV87MU5GGO0 type=del 2024-09-12T00:07:25.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.679+0000 7f82f8930780 1 > prepared operation key=NCIZ4HNPCZ94 tag=H4FLRSRRHZ04 type=del size=1087966 2024-09-12T00:07:25.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.680+0000 7f82f8930780 1 < canceled operation key=MJZ56OX8PLSH tag=GTDENR2ZOXHB type=del size=2217175 2024-09-12T00:07:25.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:07:25.682+0000 7f82f8930780 1 > prepared operation key=4IA4918NXXJW tag=CFOECMBM25QD type=del size=3733767 2024-09-12T00:07:25.680 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] cls_rgw_stats.simulate (10678 ms) 2024-09-12T00:07:25.681 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 1 test from cls_rgw_stats (10678 ms total) 2024-09-12T00:07:25.681 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:07:25.681 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:07:26.040 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 1 test from 1 test suite ran. (12898 ms total) 2024-09-12T00:07:26.040 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 1 test. 2024-09-12T00:07:26.045 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:07:26.045 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:07:26.131 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T00:07:26.132 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T00:07:26.132 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T00:07:26.181 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T00:07:26.181 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T00:07:26.181 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:07:28.055 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 31 tests from CmpOmap 2024-09-12T00:07:28.055 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T00:07:28.074 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (19 ms) 2024-09-12T00:07:28.074 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T00:07:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (7 ms) 2024-09-12T00:07:28.081 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T00:07:28.083 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-12T00:07:28.084 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T00:07:28.088 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2024-09-12T00:07:28.088 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T00:07:28.095 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-09-12T00:07:28.095 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T00:07:28.102 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_u64 (7 ms) 2024-09-12T00:07:28.103 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T00:07:28.106 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (4 ms) 2024-09-12T00:07:28.106 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T00:07:28.109 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-09-12T00:07:28.109 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T00:07:28.112 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (3 ms) 2024-09-12T00:07:28.112 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T00:07:28.116 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2024-09-12T00:07:28.117 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T00:07:28.117 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T00:07:28.117 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T00:07:28.118 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-12T00:07:28.118 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T00:07:28.124 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (6 ms) 2024-09-12T00:07:28.124 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T00:07:28.132 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2024-09-12T00:07:28.132 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T00:07:28.138 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (7 ms) 2024-09-12T00:07:28.138 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T00:07:28.145 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (6 ms) 2024-09-12T00:07:28.145 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T00:07:28.154 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_str (11 ms) 2024-09-12T00:07:28.155 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T00:07:28.162 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (7 ms) 2024-09-12T00:07:28.162 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T00:07:28.164 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (2 ms) 2024-09-12T00:07:28.164 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T00:07:28.167 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-12T00:07:28.167 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T00:07:28.168 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-12T00:07:28.168 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T00:07:28.168 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-12T00:07:28.169 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T00:07:28.176 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-09-12T00:07:28.176 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T00:07:28.183 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (7 ms) 2024-09-12T00:07:28.183 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T00:07:28.190 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-09-12T00:07:28.190 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T00:07:28.197 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (7 ms) 2024-09-12T00:07:28.197 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T00:07:28.199 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-12T00:07:28.199 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T00:07:28.202 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-12T00:07:28.202 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T00:07:28.203 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-12T00:07:28.203 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T00:07:28.204 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-09-12T00:07:28.204 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T00:07:28.212 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (8 ms) 2024-09-12T00:07:28.212 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 31 tests from CmpOmap (157 ms total) 2024-09-12T00:07:28.212 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:07:28.212 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:07:29.070 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 31 tests from 1 test suite ran. (2889 ms total) 2024-09-12T00:07:29.070 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 31 tests. 2024-09-12T00:07:29.073 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:07:29.073 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:07:29.118 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T00:07:29.119 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T00:07:29.119 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T00:07:29.211 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T00:07:29.211 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:07:29.211 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:07:29.211 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T00:07:29.211 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T00:07:32.077 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2866 ms) 2024-09-12T00:07:32.077 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T00:07:35.104 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3027 ms) 2024-09-12T00:07:35.104 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T00:07:38.123 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.Reserve (3018 ms) 2024-09-12T00:07:38.123 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T00:07:41.153 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3030 ms) 2024-09-12T00:07:41.153 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T00:07:44.165 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.Commit (3013 ms) 2024-09-12T00:07:44.166 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T00:07:47.185 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.Stats (3019 ms) 2024-09-12T00:07:47.185 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T00:07:51.211 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4027 ms) 2024-09-12T00:07:51.211 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T00:07:54.233 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.Abort (3021 ms) 2024-09-12T00:07:54.233 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T00:07:57.260 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.ReserveError (3028 ms) 2024-09-12T00:07:57.261 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T00:08:00.277 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.CommitError (3017 ms) 2024-09-12T00:08:00.278 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T00:08:03.314 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.AbortError (3036 ms) 2024-09-12T00:08:03.314 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T00:08:06.339 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3025 ms) 2024-09-12T00:08:06.339 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T00:08:09.361 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3019 ms) 2024-09-12T00:08:09.361 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T00:08:12.378 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3021 ms) 2024-09-12T00:08:12.378 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T00:08:15.386 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3008 ms) 2024-09-12T00:08:15.387 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T00:08:18.413 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3027 ms) 2024-09-12T00:08:18.413 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T00:08:21.479 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3064 ms) 2024-09-12T00:08:21.479 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T00:08:24.489 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.Cleanup (3011 ms) 2024-09-12T00:08:24.489 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T00:08:34.956 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10467 ms) 2024-09-12T00:08:34.956 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T00:08:37.976 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3021 ms) 2024-09-12T00:08:37.977 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T00:08:52.006 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14028 ms) 2024-09-12T00:08:52.007 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T00:08:56.047 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4043 ms) 2024-09-12T00:08:56.048 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T00:09:01.098 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (5051 ms) 2024-09-12T00:09:01.099 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T00:09:06.127 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5028 ms) 2024-09-12T00:09:06.127 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from TestCls2PCQueue (96915 ms total) 2024-09-12T00:09:06.127 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:09:06.127 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:09:06.127 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 24 tests from 1 test suite ran. (96915 ms total) 2024-09-12T00:09:06.127 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 24 tests. 2024-09-12T00:09:06.130 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:09:06.130 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:09:06.171 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T00:09:06.174 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T00:09:06.174 DEBUG:teuthology.orchestra.run.smithi067:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T00:09:06.264 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:09:06.264 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:09:06.265 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:09:06.265 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:09:08.152 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 4 tests from ClsAccount 2024-09-12T00:09:08.152 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsAccount.add 2024-09-12T00:09:08.175 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsAccount.add (23 ms) 2024-09-12T00:09:08.175 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsAccount.get 2024-09-12T00:09:08.180 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-12T00:09:08.180 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsAccount.rm 2024-09-12T00:09:08.188 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsAccount.rm (8 ms) 2024-09-12T00:09:08.188 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] ClsAccount.list 2024-09-12T00:09:08.202 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] ClsAccount.list (14 ms) 2024-09-12T00:09:08.202 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 4 tests from ClsAccount (50 ms total) 2024-09-12T00:09:08.202 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:09:08.202 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:09:09.161 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 4 tests from 1 test suite ran. (2895 ms total) 2024-09-12T00:09:09.161 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 4 tests. 2024-09-12T00:09:09.166 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:09:09.166 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:09:09.213 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T00:09:09.215 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T00:09:09.215 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T00:09:09.272 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:09:09.273 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:09:09.273 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T00:09:09.273 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:09:11.174 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T00:09:11.174 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T00:09:11.191 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] rgw_gc_log.init_existing_queue (18 ms) 2024-09-12T00:09:11.191 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T00:09:11.194 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-09-12T00:09:11.194 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T00:09:11.216 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (22 ms) 2024-09-12T00:09:11.216 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T00:09:11.217 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2024-09-12T00:09:11.217 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T00:09:11.220 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-12T00:09:11.220 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T00:09:11.222 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-12T00:09:11.222 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 6 tests from rgw_gc_log (49 ms total) 2024-09-12T00:09:11.222 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:09:11.222 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:09:12.177 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 6 tests from 1 test suite ran. (2905 ms total) 2024-09-12T00:09:12.178 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 6 tests. 2024-09-12T00:09:12.182 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:09:12.183 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:09:12.228 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T00:09:12.230 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T00:09:12.230 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T00:09:12.290 INFO:tasks.workunit.client.0.smithi067.stdout:Running main() from gmock_main.cc 2024-09-12T00:09:12.291 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:09:12.291 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:09:12.291 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T00:09:12.291 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T00:09:12.291 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T00:09:12.291 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T00:09:12.291 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns= i= 2024-09-12T00:09:12.291 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T00:09:12.291 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T00:09:12.291 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns= i= 2024-09-12T00:09:12.291 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T00:09:12.291 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T00:09:12.292 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns= i= 2024-09-12T00:09:12.292 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.292 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T00:09:12.292 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.292 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.292 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.292 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.292 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.292 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.293 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.293 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.293 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.293 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.293 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.293 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.293 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.293 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.293 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.293 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.293 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.293 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T00:09:12.293 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.294 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.294 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.294 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.294 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.294 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.294 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.294 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.294 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.294 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.294 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.294 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.295 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.295 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.295 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.295 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.295 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.295 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T00:09:12.295 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.295 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.295 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.295 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.295 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.295 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.295 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.296 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.296 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.296 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.296 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.296 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.296 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.296 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.296 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.296 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.296 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.297 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T00:09:12.297 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.297 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.297 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.297 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.297 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.297 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.297 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.297 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.297 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.298 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.298 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.298 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.298 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.298 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.298 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.298 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.298 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.298 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.298 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T00:09:12.298 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T00:09:12.298 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns=ns i= 2024-09-12T00:09:12.299 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T00:09:12.299 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T00:09:12.299 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns=ns i= 2024-09-12T00:09:12.299 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T00:09:12.299 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj 2024-09-12T00:09:12.299 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns=ns i= 2024-09-12T00:09:12.299 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.299 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T00:09:12.299 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.299 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.299 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.299 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.299 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.300 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.300 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.300 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.300 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.300 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.300 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.300 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.300 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.300 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.300 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.300 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.300 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.300 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T00:09:12.301 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.301 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.301 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.301 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.301 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.301 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.301 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.301 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.301 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.301 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.301 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.301 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.301 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.302 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.302 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.302 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.302 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.302 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T00:09:12.302 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.302 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.302 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.302 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.302 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.302 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.302 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.302 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.302 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.303 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.303 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.303 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.303 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.303 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.303 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.303 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.303 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.303 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T00:09:12.303 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.303 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.303 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.303 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.303 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.304 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.304 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.304 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.304 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.304 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.304 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.304 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.304 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.304 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.304 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.304 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.304 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.304 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.304 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T00:09:12.305 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T00:09:12.305 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns= i=v1 2024-09-12T00:09:12.305 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T00:09:12.305 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T00:09:12.305 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns= i=v1 2024-09-12T00:09:12.305 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T00:09:12.305 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T00:09:12.305 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns= i=v1 2024-09-12T00:09:12.305 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.305 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T00:09:12.305 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.305 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.305 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.305 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.306 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.306 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.306 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.306 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.306 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.306 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.306 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.306 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.306 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.306 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T00:09:12.306 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.306 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.306 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.306 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T00:09:12.307 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.307 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.307 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.307 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.307 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.307 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.307 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.307 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.307 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.307 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.307 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.307 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.307 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.307 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T00:09:12.308 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.308 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.308 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.308 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T00:09:12.308 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.308 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.308 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.308 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.308 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.308 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.308 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.308 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.308 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.308 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.309 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.309 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.309 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.309 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.309 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.309 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.309 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.309 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T00:09:12.310 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.310 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.310 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.310 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.310 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.310 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.310 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.310 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.310 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.310 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.311 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.311 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.311 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.311 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T00:09:12.311 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.311 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.311 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.311 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.311 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T00:09:12.311 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T00:09:12.311 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:09:12.311 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T00:09:12.311 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T00:09:12.311 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:09:12.312 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T00:09:12.312 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: _obj[v1] 2024-09-12T00:09:12.312 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:09:12.312 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.312 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T00:09:12.312 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.312 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.312 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.312 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.312 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.312 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.313 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.313 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.313 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.313 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.313 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.313 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.313 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.313 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T00:09:12.313 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.313 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.313 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.313 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T00:09:12.314 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.314 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.314 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.314 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.314 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.314 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.314 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.314 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.314 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.314 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.314 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.314 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.314 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.314 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T00:09:12.315 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.315 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.315 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.315 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T00:09:12.315 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.315 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.315 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.315 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.315 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.315 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.315 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.315 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.315 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.315 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.315 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.316 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.316 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.316 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.316 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.316 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.316 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.316 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T00:09:12.316 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.317 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.317 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.317 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.317 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.317 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.317 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.317 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.317 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.317 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.317 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.317 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.317 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_obj", 2024-09-12T00:09:12.318 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T00:09:12.318 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.318 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.318 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.318 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.318 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestRGWObj.underscore (1 ms) 2024-09-12T00:09:12.318 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T00:09:12.318 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T00:09:12.318 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T00:09:12.318 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns= i= 2024-09-12T00:09:12.318 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T00:09:12.318 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T00:09:12.318 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns= i= 2024-09-12T00:09:12.318 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T00:09:12.318 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T00:09:12.319 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns= i= 2024-09-12T00:09:12.319 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.319 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T00:09:12.319 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.319 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.319 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.320 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.320 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.320 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.320 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.320 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.320 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.321 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.321 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.321 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.321 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.321 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.321 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.322 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.322 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.322 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T00:09:12.322 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.322 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.322 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.323 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.323 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.323 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.323 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.323 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.324 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.324 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.324 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.324 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.324 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.324 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.324 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.324 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.324 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.324 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T00:09:12.324 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.324 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.325 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.325 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.325 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.325 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.325 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.325 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.325 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.325 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.325 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.325 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.325 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.325 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.325 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.326 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.326 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.326 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T00:09:12.326 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.326 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.326 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.326 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.326 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.326 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.326 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.326 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.326 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.326 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.326 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.327 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.327 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.327 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.327 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.327 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.327 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.327 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.327 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T00:09:12.327 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T00:09:12.327 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns=ns i= 2024-09-12T00:09:12.327 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T00:09:12.327 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T00:09:12.327 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns=ns i= 2024-09-12T00:09:12.327 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T00:09:12.328 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj 2024-09-12T00:09:12.328 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns=ns i= 2024-09-12T00:09:12.328 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.328 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T00:09:12.328 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.328 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.328 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.328 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.328 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.328 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.328 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.328 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.328 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.329 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.329 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.329 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.329 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.329 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.329 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.329 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.329 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.330 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T00:09:12.330 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.330 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.330 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.330 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.330 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.330 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.330 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.330 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.330 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.330 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.330 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.330 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.330 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.331 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.331 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.331 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.331 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.331 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T00:09:12.331 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.331 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.331 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.331 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.331 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.331 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.331 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.331 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.331 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.331 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.332 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.332 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.332 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.332 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.332 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.332 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.332 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.332 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T00:09:12.332 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.332 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.332 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.333 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.333 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.333 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.333 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.333 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.334 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.334 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.334 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.334 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.335 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.335 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.335 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.335 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.335 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.335 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.335 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T00:09:12.336 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T00:09:12.336 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns= i=v1 2024-09-12T00:09:12.336 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T00:09:12.336 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T00:09:12.336 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns= i=v1 2024-09-12T00:09:12.336 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T00:09:12.336 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T00:09:12.336 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns= i=v1 2024-09-12T00:09:12.336 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.336 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T00:09:12.336 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.336 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.336 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.337 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.337 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.337 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.337 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.337 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.337 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.337 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.338 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.338 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.338 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.338 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T00:09:12.338 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.338 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.338 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.338 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T00:09:12.338 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.338 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.338 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.338 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.339 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.339 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.339 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.339 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.339 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.339 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.339 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.339 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.339 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.339 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T00:09:12.339 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.339 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.340 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.340 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T00:09:12.340 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.340 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.340 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.340 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.340 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.340 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.340 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.340 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.340 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.340 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.340 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.341 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.341 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.341 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.341 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.341 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.341 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.341 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T00:09:12.341 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.341 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.341 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.341 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.341 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.341 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.341 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.342 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.342 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.342 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.342 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.342 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.342 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.342 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T00:09:12.342 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.342 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.342 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.342 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.343 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T00:09:12.343 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T00:09:12.343 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:09:12.343 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T00:09:12.343 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T00:09:12.343 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:09:12.343 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T00:09:12.343 INFO:tasks.workunit.client.0.smithi067.stdout:parsed: obj[v1] 2024-09-12T00:09:12.343 INFO:tasks.workunit.client.0.smithi067.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:09:12.343 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.343 INFO:tasks.workunit.client.0.smithi067.stdout: "obj1": { 2024-09-12T00:09:12.343 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.343 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.343 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.344 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.344 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.344 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.344 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.344 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.344 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.344 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.344 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.344 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.345 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.345 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T00:09:12.345 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.345 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.345 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.345 INFO:tasks.workunit.client.0.smithi067.stdout: "obj2": { 2024-09-12T00:09:12.345 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.345 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.345 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.345 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.346 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.346 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.346 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.346 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.346 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.346 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.346 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.346 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.346 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.346 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T00:09:12.346 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.346 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.346 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.346 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3": { 2024-09-12T00:09:12.347 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.347 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.347 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.347 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.347 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.347 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.347 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.347 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.347 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.347 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.347 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.347 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.347 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.347 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.348 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.348 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.348 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.348 INFO:tasks.workunit.client.0.smithi067.stdout: "obj3-2": { 2024-09-12T00:09:12.348 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.348 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.348 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.348 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.349 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.349 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.349 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.349 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.349 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.349 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.349 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.349 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.349 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "obj", 2024-09-12T00:09:12.349 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "v1", 2024-09-12T00:09:12.349 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.349 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.349 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.349 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.350 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T00:09:12.350 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T00:09:12.350 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.350 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.350 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.350 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.350 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.350 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.350 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.350 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.350 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.350 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.350 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.351 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.351 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.351 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.351 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.351 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.351 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.351 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.351 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.351 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.351 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.351 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.351 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.351 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.351 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.352 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.352 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.352 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.352 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.352 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.352 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.352 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.352 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.352 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.352 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.352 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T00:09:12.353 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker_myobj", 2024-09-12T00:09:12.353 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.353 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.353 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.353 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.353 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.353 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.353 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.353 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.353 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.353 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.353 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.353 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.354 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.354 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.354 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.354 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.354 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.354 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.354 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.354 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.354 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.354 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.354 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.354 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.354 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.354 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.354 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.355 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.355 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.355 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.355 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.355 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.355 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.355 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.355 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.355 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.355 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.356 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.356 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.356 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.356 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.356 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.356 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.356 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.356 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.356 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.356 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.356 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.356 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.356 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.357 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.357 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.357 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.357 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.357 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.357 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.357 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.357 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.357 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.357 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker_myobj", 2024-09-12T00:09:12.357 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.357 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.357 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.357 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.358 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.358 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.358 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.358 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.358 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.358 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.358 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.358 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.358 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.358 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.359 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.359 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.359 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.359 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.359 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.359 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.359 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.359 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.359 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.359 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.359 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.359 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.359 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.359 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.360 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.360 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.360 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.360 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.360 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.360 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.360 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.360 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.360 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.360 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.360 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.360 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.360 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.360 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.361 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.361 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.361 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.361 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.361 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.361 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.361 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.361 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.361 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.362 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.362 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.362 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.362 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.362 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.362 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.362 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.362 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T00:09:12.362 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:09:12.362 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.362 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.362 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.362 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.363 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.363 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.363 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.363 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.363 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.363 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.363 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.363 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.363 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.363 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.363 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.363 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.363 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.363 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.364 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.364 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.364 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.364 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.364 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.364 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.364 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.364 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.364 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.364 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.364 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.364 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.364 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.365 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.365 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.365 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.365 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.365 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.365 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.365 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.365 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.365 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.365 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.365 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.365 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.365 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.365 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.366 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.366 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.366 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.366 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.366 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.366 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.366 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.366 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.366 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.366 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.366 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.366 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.367 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.367 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.367 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:09:12.367 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.367 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.367 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.367 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.367 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.367 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.367 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.367 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.367 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.367 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.368 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.368 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.368 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.368 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.368 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.368 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.368 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.368 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.368 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.368 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.368 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.368 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.368 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.369 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.369 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.369 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.369 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.369 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.369 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.369 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.369 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.369 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.369 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.369 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.370 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.370 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.370 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.370 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.370 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.370 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.370 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.370 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.370 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.370 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.370 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.370 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.370 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.370 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.371 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.371 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.371 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.371 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.371 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.371 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.371 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.371 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.371 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.371 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.371 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T00:09:12.371 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:09:12.371 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.371 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.371 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.372 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.372 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.372 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.372 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.372 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.372 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.372 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.372 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.372 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.372 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.372 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.372 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.372 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.373 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.373 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.373 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.373 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.373 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.373 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.373 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.373 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.373 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.373 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.373 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.373 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.373 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.373 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.374 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.374 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.374 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.374 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.374 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.374 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.374 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.374 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.374 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.374 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.374 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.374 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.374 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.374 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.375 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.375 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.375 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.375 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.375 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.375 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.375 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.375 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.375 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.375 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.375 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.376 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.376 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.376 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.376 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.376 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:09:12.376 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.376 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.376 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.376 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.376 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.376 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.376 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.377 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.377 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.377 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.377 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.377 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.377 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.377 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.377 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.377 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.377 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.377 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.377 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.377 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.378 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.378 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.378 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.378 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.378 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.378 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.378 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.378 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.378 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.378 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.378 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.378 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.378 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.378 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.379 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.379 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.379 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.379 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.379 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.379 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.379 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.379 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.379 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.379 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.380 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.380 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.380 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.380 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.380 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.380 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.380 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.380 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.380 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.380 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.381 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.381 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.381 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.381 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.381 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T00:09:12.381 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:09:12.381 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.381 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.381 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.381 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.381 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.381 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.381 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.381 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.382 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.382 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.382 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.382 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.382 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.382 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.382 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.382 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.382 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.382 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.382 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.382 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.382 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.382 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.383 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.383 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.383 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.383 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.383 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.383 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.383 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.383 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.383 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.383 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.383 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.384 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.384 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.384 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.384 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.384 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.384 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.384 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.384 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.384 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.384 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.384 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.384 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.385 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.385 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.385 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.385 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.385 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.385 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.385 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.385 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.386 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.386 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.386 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.386 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.386 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.386 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.386 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:09:12.386 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.386 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.386 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.386 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.387 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.387 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.387 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.387 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.387 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.387 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.387 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.387 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.387 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.387 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.387 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.387 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.387 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.388 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.388 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.388 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.388 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.388 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.388 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.388 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.388 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.388 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.388 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.388 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.388 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.388 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.389 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.389 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.389 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.389 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.389 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.389 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.389 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.389 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.389 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.389 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.389 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.389 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.390 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.390 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.390 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.390 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.390 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.390 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.390 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.390 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.390 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.390 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.391 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.391 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.391 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.391 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.391 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.391 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.391 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T00:09:12.391 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj", 2024-09-12T00:09:12.391 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T00:09:12.391 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.391 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.391 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.391 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.391 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.392 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.392 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.392 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.392 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.392 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.392 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.392 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.392 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.392 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.392 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.393 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.393 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.393 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.393 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.393 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.393 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.393 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.393 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.393 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.393 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.393 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.393 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.393 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.393 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.394 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.394 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.394 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.394 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.394 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.394 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.394 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.394 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.394 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.394 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.394 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.394 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.394 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.394 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.395 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.395 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.395 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.395 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.395 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.395 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.395 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.395 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.395 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.395 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.395 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.395 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.396 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.396 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.396 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.396 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj", 2024-09-12T00:09:12.396 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T00:09:12.396 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.396 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.396 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.396 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.396 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.397 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.397 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.397 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.397 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.397 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.397 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.397 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.397 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.397 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.397 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.398 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.398 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.398 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.398 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.398 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.398 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.398 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.398 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.398 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.398 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.398 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.398 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.399 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.399 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.399 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.399 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.399 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.399 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.399 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.399 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.399 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.399 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.399 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.399 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.400 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.400 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.400 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.400 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.400 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.400 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.400 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.400 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.401 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.401 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.401 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.401 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.401 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.401 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.401 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.401 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.401 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.401 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.401 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T00:09:12.401 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:09:12.402 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.402 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.402 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.402 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.402 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.402 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.402 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.402 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.402 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.402 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.402 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.402 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.403 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.403 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.403 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.403 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.403 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.403 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.403 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.403 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.403 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.403 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.404 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.404 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.404 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.404 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.404 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.404 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.404 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.404 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.404 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.404 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.404 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.405 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.405 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.405 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.405 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.405 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.405 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.405 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.405 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.405 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.405 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.405 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.405 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.405 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.406 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.406 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.406 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.406 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.406 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.406 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.406 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.406 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.406 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.406 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.406 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.406 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.406 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.406 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:09:12.406 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.407 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.407 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.407 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.407 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.407 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.407 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.407 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.407 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.407 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.407 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.407 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.407 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.407 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.407 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.408 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.408 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.408 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.408 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.408 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.408 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.408 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.408 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.408 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.408 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.408 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.408 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.408 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.409 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.409 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.409 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.409 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.409 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.409 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.409 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.409 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.409 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.409 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.409 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.409 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.409 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.409 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.410 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.410 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.410 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.410 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.410 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.410 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.410 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.410 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.411 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.411 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.411 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.411 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.411 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.411 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.411 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.412 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.412 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T00:09:12.412 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:09:12.412 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T00:09:12.412 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.412 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.412 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.412 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.412 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.412 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.413 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.413 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.413 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.413 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.413 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.413 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.413 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.413 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.413 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.413 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.413 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.413 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.413 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.413 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.414 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.414 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.414 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.414 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.414 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.414 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.414 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.414 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.414 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.415 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.415 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.415 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.415 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.415 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.415 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.415 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.415 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.416 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.416 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.416 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.416 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.416 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.416 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.416 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.416 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.417 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.417 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.417 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.417 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.417 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.417 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.417 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.417 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.418 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.418 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.418 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.418 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.418 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.418 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:09:12.419 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T00:09:12.419 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.419 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.419 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.419 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.419 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.420 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.420 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.420 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.420 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.420 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.421 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.421 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.421 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.421 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.421 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.422 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.422 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.422 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.422 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.422 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.422 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.423 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.423 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.423 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.423 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.423 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.423 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.424 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.424 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.424 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.424 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.424 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.425 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.425 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.425 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.425 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.425 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.425 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.425 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.426 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.426 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.426 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.426 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.426 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.426 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.426 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.426 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.427 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.427 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.427 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.427 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.427 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.427 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.428 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.428 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.428 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.428 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.428 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T00:09:12.429 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:09:12.429 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.429 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.429 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.429 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.429 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.429 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.430 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.430 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.430 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.430 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.430 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.430 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.430 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.431 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.431 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.431 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.431 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.431 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.431 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.431 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.431 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.431 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.431 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.431 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.431 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.431 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.432 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.432 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.432 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.432 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.432 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.432 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.432 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.432 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.432 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.432 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.432 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.433 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.433 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.433 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.433 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.433 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.433 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.433 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.433 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.433 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.433 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.433 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.433 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.433 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.433 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.434 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.434 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.434 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.434 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.434 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.434 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.434 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.434 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.434 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:09:12.435 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.435 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.435 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.435 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.435 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.435 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.435 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.435 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.435 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.435 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.435 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.435 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.435 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.435 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.436 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.436 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.436 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.436 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.436 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.436 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.436 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.436 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.436 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.436 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.436 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.436 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.436 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.437 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.437 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.437 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.437 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.437 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.437 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.437 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.437 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.437 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.437 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.437 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.437 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.437 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.438 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.438 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.438 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.438 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.438 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.438 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.438 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.438 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.438 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.438 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.438 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.438 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.438 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.439 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.439 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.439 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.439 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.439 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.439 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T00:09:12.439 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj_", 2024-09-12T00:09:12.439 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T00:09:12.439 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.439 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.439 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.439 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.439 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.440 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.440 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.440 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.440 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.440 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.440 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.440 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.440 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.440 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.440 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.440 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.440 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.440 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.441 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.441 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.441 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.441 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.441 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.441 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.441 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.441 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.441 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.441 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.441 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.441 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.441 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.442 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.442 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.442 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.442 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.442 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.442 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.442 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.442 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.442 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.442 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.442 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.442 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.442 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.442 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.443 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.443 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.443 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.443 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.443 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.443 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.443 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.443 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.443 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.443 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.444 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.444 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.444 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.444 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj_", 2024-09-12T00:09:12.444 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T00:09:12.444 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.444 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.444 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.444 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.444 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.444 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.444 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.444 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.444 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.445 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.445 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.445 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.445 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.445 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.445 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.445 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.445 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.445 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.445 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.445 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.445 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.445 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.445 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.446 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.446 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.446 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.446 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.446 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.446 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.446 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.446 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.446 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.446 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.446 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.446 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.446 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.447 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.447 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.447 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.447 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.447 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.447 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.447 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.447 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.447 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.447 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.447 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.447 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.448 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.448 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.448 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.448 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.448 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.448 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.449 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.449 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.449 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.449 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T00:09:12.449 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:09:12.449 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.449 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.449 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.449 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.449 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.449 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.450 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.450 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.450 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.450 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.450 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.450 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.450 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.450 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.450 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.450 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.450 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.450 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.450 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.450 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.451 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.451 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.451 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.451 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.451 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.451 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.451 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.451 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.451 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.451 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.451 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.451 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.451 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.451 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.452 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.452 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.452 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.452 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.452 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.452 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.452 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.452 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.452 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.452 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.452 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.452 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.452 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.452 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.453 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.453 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.453 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.453 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.453 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.453 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.453 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.453 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.453 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.453 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.453 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.453 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:09:12.453 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.453 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.454 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.454 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.454 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.454 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.454 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.454 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.454 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.454 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.454 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.454 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.454 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.454 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.454 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.454 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.455 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.455 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.455 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.455 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.455 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.455 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.455 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.455 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.455 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.455 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.455 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.455 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.456 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.456 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.456 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.456 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.456 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.456 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.456 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.456 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.456 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.456 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.456 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.457 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.457 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.457 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.457 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.457 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.457 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.457 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.457 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.457 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.457 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.457 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.457 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.457 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.457 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.458 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.458 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.458 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.458 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.458 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.458 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T00:09:12.458 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:09:12.458 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T00:09:12.458 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.458 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.458 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.458 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.458 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.458 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.459 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.459 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.459 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.459 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.459 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.459 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.459 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.459 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.459 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.459 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.459 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.459 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.459 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.459 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.459 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.460 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.460 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.460 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.460 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.460 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.460 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.460 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.460 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.460 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.460 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.460 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.460 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.460 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.461 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.461 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.461 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.461 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.461 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.461 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.461 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.461 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.461 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.461 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.461 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.461 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.461 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.461 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.462 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.462 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.462 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.462 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.462 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.462 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.462 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.462 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.462 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.462 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.463 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:09:12.463 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T00:09:12.463 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.463 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.463 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.463 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.463 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.463 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.463 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.463 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.463 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.463 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.463 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.463 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.464 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.464 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.464 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.464 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.464 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.464 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.464 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.464 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.464 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.464 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.464 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.464 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.464 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.464 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.465 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.465 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.465 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.465 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.465 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.465 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.465 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.465 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.465 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.465 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.465 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.465 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.465 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.465 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.466 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.466 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.466 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.466 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.466 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.466 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.466 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.466 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.466 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.466 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.466 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.466 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.466 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.466 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.467 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.467 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.467 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.467 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": "default-placement.data", 2024-09-12T00:09:12.467 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:09:12.467 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.467 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.467 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.467 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.467 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.467 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.467 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "test", 2024-09-12T00:09:12.467 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.467 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.468 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.468 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.468 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": "", 2024-09-12T00:09:12.468 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.468 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": "" 2024-09-12T00:09:12.468 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.468 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.468 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.468 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.468 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.468 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.468 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.468 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.468 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.469 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.469 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.469 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.469 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.469 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.469 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.469 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.469 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.469 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.469 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.469 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.469 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.469 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.469 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.470 INFO:tasks.workunit.client.0.smithi067.stdout: "obj": { 2024-09-12T00:09:12.470 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.470 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.470 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.470 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.470 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.470 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.470 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.470 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.470 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.470 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.470 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.470 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.470 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.470 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.471 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.471 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.471 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.471 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.471 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.471 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.471 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.471 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:09:12.471 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.471 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.471 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.471 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.471 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.471 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.472 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.472 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.472 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.472 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.472 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.472 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.472 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.472 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.472 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.472 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.472 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.472 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.472 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.473 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.473 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.473 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.473 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.473 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-12T00:09:12.473 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T00:09:12.473 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.473 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.473 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.473 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker_myobj", 2024-09-12T00:09:12.473 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.473 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.473 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.473 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.474 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.474 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.474 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.474 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.474 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.474 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.474 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.474 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.474 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.475 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.475 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.475 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.475 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.475 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.475 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.475 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.475 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.475 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.475 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.475 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker_myobj 2024-09-12T00:09:12.476 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.476 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T00:09:12.476 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.476 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker_myobj", 2024-09-12T00:09:12.476 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.476 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.476 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.476 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.477 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T00:09:12.477 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.477 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.477 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.477 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.477 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.477 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.478 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.478 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.478 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.478 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.478 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.478 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.479 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.479 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.479 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.479 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.479 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.479 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.479 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker_myobj 2024-09-12T00:09:12.480 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.480 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.480 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.480 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:09:12.480 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.480 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.480 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.480 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.481 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.481 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.481 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.481 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.481 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.481 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.481 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.481 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.482 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.482 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.482 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.482 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.482 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.482 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.483 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.483 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.483 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.483 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.483 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.483 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T00:09:12.483 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.484 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T00:09:12.484 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.484 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:09:12.484 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.484 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.484 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.484 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.485 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T00:09:12.485 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.485 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.485 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.485 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.485 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.485 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.485 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.485 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.486 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.486 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.486 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.486 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.486 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.486 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.486 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.486 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.486 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.486 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.486 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T00:09:12.487 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.487 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.487 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.487 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:09:12.487 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.487 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.487 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.487 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.487 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.487 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.487 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.487 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.488 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.488 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.488 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.488 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.488 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.488 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.488 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.488 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.488 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.488 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.488 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.488 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.488 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.489 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.489 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.489 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T00:09:12.489 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.489 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T00:09:12.489 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.489 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:09:12.489 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.489 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.489 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.489 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.489 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T00:09:12.489 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.490 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.490 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.490 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.490 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.490 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.490 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.490 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.490 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.490 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.490 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.491 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.491 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.491 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.491 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.491 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.491 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.491 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.491 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T00:09:12.491 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.491 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.491 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.491 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:09:12.491 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.492 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.492 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.492 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.492 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.492 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.492 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.492 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.492 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.492 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.492 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.492 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.492 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.492 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.492 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.493 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.493 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.493 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.493 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.493 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.493 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.493 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.493 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.493 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T00:09:12.493 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.493 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T00:09:12.493 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.493 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:09:12.493 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.494 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.494 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.494 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.494 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T00:09:12.494 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.494 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.494 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.494 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.494 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.494 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.494 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.494 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.494 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.494 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.495 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.495 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.495 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "myobj", 2024-09-12T00:09:12.495 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.495 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.495 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.495 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.495 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.495 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T00:09:12.495 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.495 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.495 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.496 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj", 2024-09-12T00:09:12.496 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T00:09:12.496 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.496 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.496 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.496 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.496 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.496 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.496 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.497 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.497 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.497 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.497 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.497 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.497 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.497 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.497 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.498 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.498 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.498 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.498 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.498 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.498 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.498 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.498 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker___myobj 2024-09-12T00:09:12.498 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.499 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T00:09:12.499 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.499 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj", 2024-09-12T00:09:12.499 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T00:09:12.499 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.499 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.499 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.499 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T00:09:12.500 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.500 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.500 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.500 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.500 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.500 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.500 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.500 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.501 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.501 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.501 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.501 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.501 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.501 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.501 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.501 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.501 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.502 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.502 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker___myobj 2024-09-12T00:09:12.502 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.502 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.502 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.502 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:09:12.502 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.502 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.503 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.503 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.503 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.503 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.503 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.503 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.503 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.503 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.503 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.504 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.504 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.504 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.504 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.504 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.504 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.504 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.504 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.505 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.505 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.505 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.505 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.505 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T00:09:12.505 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.505 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T00:09:12.505 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.505 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:09:12.506 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.506 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.506 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.506 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.506 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T00:09:12.506 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.506 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.506 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.507 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.507 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.507 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.507 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.507 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.507 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.507 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.507 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.508 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.508 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.508 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.508 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.508 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.508 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.508 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.508 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T00:09:12.508 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.509 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.509 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.509 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:09:12.509 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T00:09:12.509 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.509 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.509 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.509 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.510 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.510 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.510 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.510 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.510 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.510 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.510 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.510 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.511 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.511 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.511 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.511 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.511 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.511 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.511 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.511 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.512 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.512 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.512 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T00:09:12.512 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.512 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T00:09:12.512 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.512 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:09:12.512 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj" 2024-09-12T00:09:12.512 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.512 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.512 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.512 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T00:09:12.513 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.513 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.513 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.513 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.513 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.513 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.513 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.513 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.516 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.516 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.517 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.517 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.517 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.517 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.517 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.517 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.517 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.517 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.517 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T00:09:12.517 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.517 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.517 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.517 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:09:12.517 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.518 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.518 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.518 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.518 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.518 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.518 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.518 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.518 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.518 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.518 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.518 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.518 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.518 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.518 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.519 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.519 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.519 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.519 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.519 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.519 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.519 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.519 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.519 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T00:09:12.519 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.519 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T00:09:12.519 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.519 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:09:12.519 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.520 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.520 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.520 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.520 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T00:09:12.520 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.520 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.520 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.520 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.520 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.520 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.520 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.520 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.520 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.520 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.521 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.521 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.521 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj", 2024-09-12T00:09:12.521 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.521 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.521 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.521 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.521 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.521 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T00:09:12.521 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.521 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.521 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.521 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj_", 2024-09-12T00:09:12.521 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T00:09:12.522 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.522 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.522 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.522 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.522 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.522 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.522 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.522 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.522 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.522 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.522 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.522 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.522 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.523 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.523 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.523 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.523 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.523 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.523 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.523 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.523 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.523 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.523 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T00:09:12.524 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.524 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T00:09:12.524 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.524 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker___myobj_", 2024-09-12T00:09:12.524 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T00:09:12.524 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.524 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.524 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.524 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T00:09:12.524 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.524 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.524 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.524 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.525 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.525 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.525 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.525 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.525 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.525 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.526 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.526 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.526 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.526 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.526 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.526 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.526 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.526 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.526 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T00:09:12.526 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.526 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.526 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.527 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:09:12.527 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.527 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.527 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.527 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.527 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.527 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.527 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.527 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.527 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.527 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.527 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.527 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.527 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.528 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.528 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.528 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.528 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.528 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.528 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.528 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.528 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.528 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.528 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.528 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T00:09:12.528 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.528 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T00:09:12.529 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.529 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:09:12.529 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.529 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.529 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.529 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.529 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T00:09:12.529 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.529 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.529 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.529 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.529 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.530 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.530 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.530 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.530 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.530 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.530 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.530 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.530 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.530 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "", 2024-09-12T00:09:12.530 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.530 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.530 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.531 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.531 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T00:09:12.531 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.531 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.531 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.531 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:09:12.531 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T00:09:12.531 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.531 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.531 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.531 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.531 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.531 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.531 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.532 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.532 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.532 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.532 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.532 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.532 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.532 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.532 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.532 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.532 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.533 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.533 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.533 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.533 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.533 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.533 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T00:09:12.533 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.533 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T00:09:12.533 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.533 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:09:12.533 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "marker__myobj_" 2024-09-12T00:09:12.533 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.533 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.534 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.534 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T00:09:12.534 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.534 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.534 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.534 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.534 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.534 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.534 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.534 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.534 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.535 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.535 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.535 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.535 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.535 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.535 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "" 2024-09-12T00:09:12.535 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.535 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.535 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.535 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T00:09:12.536 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.536 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj": { 2024-09-12T00:09:12.536 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.536 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:09:12.536 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.536 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.536 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.536 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.536 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj": { 2024-09-12T00:09:12.536 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.536 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.536 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.536 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.537 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.537 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.537 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.537 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.537 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.537 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.537 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.537 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.537 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.537 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.537 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.537 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.537 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.537 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.538 INFO:tasks.workunit.client.0.smithi067.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:09:12.538 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.538 INFO:tasks.workunit.client.0.smithi067.stdout: "raw_obj2": { 2024-09-12T00:09:12.538 INFO:tasks.workunit.client.0.smithi067.stdout: "pool": ".data-pool", 2024-09-12T00:09:12.538 INFO:tasks.workunit.client.0.smithi067.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:09:12.538 INFO:tasks.workunit.client.0.smithi067.stdout: "loc": "" 2024-09-12T00:09:12.538 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.538 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.538 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.538 INFO:tasks.workunit.client.0.smithi067.stdout: "new_obj2": { 2024-09-12T00:09:12.538 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket": { 2024-09-12T00:09:12.538 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "ebtest", 2024-09-12T00:09:12.538 INFO:tasks.workunit.client.0.smithi067.stdout: "marker": "marker", 2024-09-12T00:09:12.538 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_id": "bucket-id", 2024-09-12T00:09:12.538 INFO:tasks.workunit.client.0.smithi067.stdout: "tenant": "", 2024-09-12T00:09:12.539 INFO:tasks.workunit.client.0.smithi067.stdout: "explicit_placement": { 2024-09-12T00:09:12.539 INFO:tasks.workunit.client.0.smithi067.stdout: "data_pool": ".data-pool", 2024-09-12T00:09:12.539 INFO:tasks.workunit.client.0.smithi067.stdout: "data_extra_pool": "", 2024-09-12T00:09:12.539 INFO:tasks.workunit.client.0.smithi067.stdout: "index_pool": ".index-pool" 2024-09-12T00:09:12.539 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.539 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.539 INFO:tasks.workunit.client.0.smithi067.stdout: "key": { 2024-09-12T00:09:12.539 INFO:tasks.workunit.client.0.smithi067.stdout: "name": "_myobj_", 2024-09-12T00:09:12.539 INFO:tasks.workunit.client.0.smithi067.stdout: "instance": "inst", 2024-09-12T00:09:12.539 INFO:tasks.workunit.client.0.smithi067.stdout: "ns": "ns" 2024-09-12T00:09:12.539 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.539 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.539 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.539 INFO:tasks.workunit.client.0.smithi067.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:09:12.540 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T00:09:12.540 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T00:09:12.540 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:09:12.540 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:09:12.540 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T00:09:12.540 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 4 tests. 2024-09-12T00:09:12.540 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:09:12.540 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:09:12.584 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T00:09:12.585 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T00:09:12.586 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T00:09:12.731 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:09:12.731 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:09:12.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.772+0000 7fab92c40800 20 rados->read ofs=0 len=0 2024-09-12T00:09:12.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.773+0000 7fab92c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:09:12.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.773+0000 7fab92c40800 20 realm 2024-09-12T00:09:12.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.773+0000 7fab92c40800 20 rados->read ofs=0 len=0 2024-09-12T00:09:12.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.774+0000 7fab92c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:09:12.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.774+0000 7fab92c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:09:12.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.774+0000 7fab92c40800 20 rados->read ofs=0 len=0 2024-09-12T00:09:12.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.774+0000 7fab92c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:09:12.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.774+0000 7fab92c40800 20 rados->read ofs=0 len=0 2024-09-12T00:09:12.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.774+0000 7fab92c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:09:12.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.774+0000 7fab92c40800 20 rados->read ofs=0 len=0 2024-09-12T00:09:12.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.775+0000 7fab92c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:09:12.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.775+0000 7fab92c40800 20 searching for the correct realm 2024-09-12T00:09:12.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.779+0000 7fab90f2b640 0 -- 172.21.15.67:0/2894784273 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7fab78038020 msgr2=0x7fab78068a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:09:12.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.783+0000 7fab9072a640 0 -- 172.21.15.67:0/2894784273 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fab8802d040 msgr2=0x7fab8801e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:09:12.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.787+0000 7fab92c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:09:12.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.787+0000 7fab92c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:09:12.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.787+0000 7fab92c40800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:09:12.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.787+0000 7fab92c40800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:09:12.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.787+0000 7fab92c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:09:12.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.787+0000 7fab92c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:09:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.787+0000 7fab92c40800 20 rados->read ofs=0 len=0 2024-09-12T00:09:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.787+0000 7fab92c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:09:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.787+0000 7fab92c40800 20 rados->read ofs=0 len=0 2024-09-12T00:09:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.788+0000 7fab92c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:09:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.788+0000 7fab92c40800 20 rados->read ofs=0 len=0 2024-09-12T00:09:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.788+0000 7fab92c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:09:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.788+0000 7fab92c40800 20 zone default found 2024-09-12T00:09:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.788+0000 7fab92c40800 4 Realm: () 2024-09-12T00:09:12.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.788+0000 7fab92c40800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:09:12.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.788+0000 7fab92c40800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:09:12.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.788+0000 7fab92c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:09:12.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.788+0000 7fab92c40800 20 zonegroup default 2024-09-12T00:09:12.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.788+0000 7fab92c40800 20 rados->read ofs=0 len=0 2024-09-12T00:09:12.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.788+0000 7fab92c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:09:12.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.788+0000 7fab92c40800 20 rados->read ofs=0 len=0 2024-09-12T00:09:12.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.788+0000 7fab92c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:09:12.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.788+0000 7fab92c40800 20 rados->read ofs=0 len=0 2024-09-12T00:09:12.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.789+0000 7fab92c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:09:12.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.789+0000 7fab92c40800 20 started sync module instance, tier type = 2024-09-12T00:09:12.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.789+0000 7fab92c40800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:09:12.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.799+0000 7fab92c40800 20 add_watcher() i=0 2024-09-12T00:09:12.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.799+0000 7fab92c40800 20 add_watcher() i=1 2024-09-12T00:09:12.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.799+0000 7fab92c40800 20 add_watcher() i=2 2024-09-12T00:09:12.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.799+0000 7fab92c40800 20 add_watcher() i=3 2024-09-12T00:09:12.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.799+0000 7fab92c40800 20 add_watcher() i=4 2024-09-12T00:09:12.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.799+0000 7fab92c40800 20 add_watcher() i=5 2024-09-12T00:09:12.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.799+0000 7fab92c40800 20 add_watcher() i=6 2024-09-12T00:09:12.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.801+0000 7fab92c40800 20 add_watcher() i=7 2024-09-12T00:09:12.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.801+0000 7fab92c40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:09:12.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.803+0000 7faa467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:09:12.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.803+0000 7fab92c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:09:12.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.803+0000 7fab92c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:09:12.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.803+0000 7fab92c40800 5 note: GC not initialized 2024-09-12T00:09:12.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.803+0000 7faa457e2640 20 reqs_thread_entry: start 2024-09-12T00:09:12.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.803+0000 7fab92c40800 20 init_complete bucket index max shards: 1 2024-09-12T00:09:12.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.803+0000 7fab92c40800 20 Filter name: none 2024-09-12T00:09:12.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.804+0000 7fa9b6ffd640 20 reqs_thread_entry: start 2024-09-12T00:09:12.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.804+0000 7fab92c40800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T00:09:12.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.804+0000 7fab92c40800 20 rados->read ofs=0 len=0 2024-09-12T00:09:12.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.804+0000 7fab92c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:09:12.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.804+0000 7fab92c40800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T00:09:12.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.804+0000 7fab92c40800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:09:12.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.804+0000 7fab92c40800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T00:09:12.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.804+0000 7fab92c40800 20 rados->read ofs=0 len=0 2024-09-12T00:09:12.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.804+0000 7fab92c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:09:12.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.804+0000 7fab92c40800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T00:09:12.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.804+0000 7fab92c40800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:09:12.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.804+0000 7fab92c40800 10 cache get: name=default.rgw.meta+users.keys+qsJJMWn8HaKex5H9/u/Oegj9KmQ= : miss 2024-09-12T00:09:12.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.804+0000 7fab92c40800 20 rados->read ofs=0 len=0 2024-09-12T00:09:12.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.805+0000 7fab92c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:09:12.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.805+0000 7fab92c40800 10 cache put: name=default.rgw.meta+users.keys+qsJJMWn8HaKex5H9/u/Oegj9KmQ= info.flags=0x0 2024-09-12T00:09:12.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.805+0000 7fab92c40800 10 adding default.rgw.meta+users.keys+qsJJMWn8HaKex5H9/u/Oegj9KmQ= to cache LRU end 2024-09-12T00:09:12.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.805+0000 7fab92c40800 10 cache get: name=default.rgw.meta+users.keys+qsJJMWn8HaKex5H9/u/Oegj9KmQ= : hit (negative entry) 2024-09-12T00:09:12.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.805+0000 7fab92c40800 10 cache get: name=default.rgw.meta+users.keys+qsJJMWn8HaKex5H9/u/Oegj9KmQ= : hit (negative entry) 2024-09-12T00:09:12.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.806+0000 7fab92c40800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:09:12.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.806+0000 7fab92c40800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:09:12.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.806+0000 7fab92c40800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T00:09:12.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.806+0000 7faa6f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889412 cookie 94802516683600 notifier 5276 bl.length()=697 2024-09-12T00:09:12.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.806+0000 7faa6f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:09:12.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.806+0000 7faa6f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:09:12.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.808+0000 7fab92c40800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:09:12.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.808+0000 7fab92c40800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:09:12.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.808+0000 7fab92c40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T00:09:12.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.808+0000 7faa6f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889408 cookie 94802516678672 notifier 5276 bl.length()=194 2024-09-12T00:09:12.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.808+0000 7faa6f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:09:12.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.808+0000 7faa6f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:09:12.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.810+0000 7fab92c40800 10 cache put: name=default.rgw.meta+users.keys+qsJJMWn8HaKex5H9/u/Oegj9KmQ= info.flags=0x7 2024-09-12T00:09:12.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.810+0000 7fab92c40800 10 moving default.rgw.meta+users.keys+qsJJMWn8HaKex5H9/u/Oegj9KmQ= to cache LRU end 2024-09-12T00:09:12.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.810+0000 7fab92c40800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:qsJJMWn8HaKex5H9/u/Oegj9KmQ=, ofs0, ns] 2024-09-12T00:09:12.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.810+0000 7faa6f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1065151889409 cookie 94802516692176 notifier 5276 bl.length()=203 2024-09-12T00:09:12.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.810+0000 7faa6f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+qsJJMWn8HaKex5H9/u/Oegj9KmQ= info.flags=0x7 2024-09-12T00:09:12.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.810+0000 7faa6f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+qsJJMWn8HaKex5H9/u/Oegj9KmQ= to cache LRU end 2024-09-12T00:09:12.810 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:09:12.810 INFO:tasks.workunit.client.0.smithi067.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T00:09:12.810 INFO:tasks.workunit.client.0.smithi067.stdout: "display_name": "librgw test user", 2024-09-12T00:09:12.810 INFO:tasks.workunit.client.0.smithi067.stdout: "email": "librgw@example.com", 2024-09-12T00:09:12.811 INFO:tasks.workunit.client.0.smithi067.stdout: "suspended": 0, 2024-09-12T00:09:12.811 INFO:tasks.workunit.client.0.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:09:12.812 INFO:tasks.workunit.client.0.smithi067.stdout: "subusers": [], 2024-09-12T00:09:12.812 INFO:tasks.workunit.client.0.smithi067.stdout: "keys": [ 2024-09-12T00:09:12.812 INFO:tasks.workunit.client.0.smithi067.stdout: { 2024-09-12T00:09:12.813 INFO:tasks.workunit.client.0.smithi067.stdout: "user": "ceph-test-librgw-file", 2024-09-12T00:09:12.813 INFO:tasks.workunit.client.0.smithi067.stdout: "access_key": "qsJJMWn8HaKex5H9/u/Oegj9KmQ=", 2024-09-12T00:09:12.813 INFO:tasks.workunit.client.0.smithi067.stdout: "secret_key": "lk3sYNkJP0RiPhREmxBG7wPDoRScUNToMukauXOtjDuQPdTYAWmRvA==", 2024-09-12T00:09:12.813 INFO:tasks.workunit.client.0.smithi067.stdout: "active": true, 2024-09-12T00:09:12.813 INFO:tasks.workunit.client.0.smithi067.stdout: "create_date": "2024-09-12T00:09:12.805681Z" 2024-09-12T00:09:12.813 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:09:12.814 INFO:tasks.workunit.client.0.smithi067.stdout: ], 2024-09-12T00:09:12.814 INFO:tasks.workunit.client.0.smithi067.stdout: "swift_keys": [], 2024-09-12T00:09:12.815 INFO:tasks.workunit.client.0.smithi067.stdout: "caps": [], 2024-09-12T00:09:12.815 INFO:tasks.workunit.client.0.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T00:09:12.815 INFO:tasks.workunit.client.0.smithi067.stdout: "default_placement": "", 2024-09-12T00:09:12.815 INFO:tasks.workunit.client.0.smithi067.stdout: "default_storage_class": "", 2024-09-12T00:09:12.815 INFO:tasks.workunit.client.0.smithi067.stdout: "placement_tags": [], 2024-09-12T00:09:12.815 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_quota": { 2024-09-12T00:09:12.816 INFO:tasks.workunit.client.0.smithi067.stdout: "enabled": false, 2024-09-12T00:09:12.816 INFO:tasks.workunit.client.0.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:09:12.816 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size": -1, 2024-09-12T00:09:12.816 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:09:12.816 INFO:tasks.workunit.client.0.smithi067.stdout: "max_objects": -1 2024-09-12T00:09:12.817 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.817 INFO:tasks.workunit.client.0.smithi067.stdout: "user_quota": { 2024-09-12T00:09:12.817 INFO:tasks.workunit.client.0.smithi067.stdout: "enabled": false, 2024-09-12T00:09:12.817 INFO:tasks.workunit.client.0.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:09:12.817 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size": -1, 2024-09-12T00:09:12.817 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:09:12.818 INFO:tasks.workunit.client.0.smithi067.stdout: "max_objects": -1 2024-09-12T00:09:12.818 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:09:12.818 INFO:tasks.workunit.client.0.smithi067.stdout: "temp_url_keys": [], 2024-09-12T00:09:12.818 INFO:tasks.workunit.client.0.smithi067.stdout: "type": "rgw", 2024-09-12T00:09:12.818 INFO:tasks.workunit.client.0.smithi067.stdout: "mfa_ids": [], 2024-09-12T00:09:12.818 INFO:tasks.workunit.client.0.smithi067.stdout: "account_id": "", 2024-09-12T00:09:12.819 INFO:tasks.workunit.client.0.smithi067.stdout: "path": "/", 2024-09-12T00:09:12.819 INFO:tasks.workunit.client.0.smithi067.stdout: "create_date": "2024-09-12T00:09:12.805663Z", 2024-09-12T00:09:12.819 INFO:tasks.workunit.client.0.smithi067.stdout: "tags": [], 2024-09-12T00:09:12.819 INFO:tasks.workunit.client.0.smithi067.stdout: "group_ids": [] 2024-09-12T00:09:12.819 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:09:12.819 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:09:12.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.811+0000 7faa467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:09:12.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.814+0000 7fab92c40800 20 remove_watcher() i=0 2024-09-12T00:09:12.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.814+0000 7fab92c40800 2 removed watcher, disabling cache 2024-09-12T00:09:12.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.815+0000 7fab92c40800 20 remove_watcher() i=1 2024-09-12T00:09:12.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.816+0000 7fab92c40800 20 remove_watcher() i=2 2024-09-12T00:09:12.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.817+0000 7fab92c40800 20 remove_watcher() i=3 2024-09-12T00:09:12.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.818+0000 7fab92c40800 20 remove_watcher() i=4 2024-09-12T00:09:12.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.819+0000 7fab92c40800 20 remove_watcher() i=5 2024-09-12T00:09:12.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.820+0000 7fab92c40800 20 remove_watcher() i=6 2024-09-12T00:09:12.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:12.821+0000 7fab92c40800 20 remove_watcher() i=7 2024-09-12T00:09:12.831 INFO:tasks.workunit.client.0.smithi067.stdout:phase 1.1 2024-09-12T00:09:12.853 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:09:12.853 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:09:12.853 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:09:12.853 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:09:12.864 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:09:12.865 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:09:13.040 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (187 ms) 2024-09-12T00:09:13.041 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:09:13.041 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:09:13.042 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:09:13.042 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:09:13.042 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:09:13.049 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T00:09:13.054 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/f1 2024-09-12T00:09:13.057 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/f2 2024-09-12T00:09:13.061 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T00:09:13.064 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T00:09:13.067 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T00:09:13.070 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T00:09:13.074 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T00:09:13.077 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T00:09:13.080 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T00:09:13.083 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T00:09:13.087 INFO:tasks.workunit.client.0.smithi067.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T00:09:13.090 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETUP_HIER1 (49 ms) 2024-09-12T00:09:13.090 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:09:13.202 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETUP_DIRS1 (112 ms) 2024-09-12T00:09:13.203 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:09:13.203 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:09:13.203 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:09:13.219 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (17 ms) 2024-09-12T00:09:13.219 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:09:13.256 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (37 ms) 2024-09-12T00:09:13.256 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:09:13.256 INFO:tasks.workunit.client.0.smithi067.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T00:09:13.262 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (6 ms) 2024-09-12T00:09:13.262 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:09:13.263 INFO:tasks.workunit.client.0.smithi067.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T00:09:13.269 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (7 ms) 2024-09-12T00:09:13.269 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:09:13.269 INFO:tasks.workunit.client.0.smithi067.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:09:13.269 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:09:13.269 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:09:13.269 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:09:13.269 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:09:13.269 INFO:tasks.workunit.client.0.smithi067.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:09:13.269 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:09:13.269 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:09:13.269 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:09:13.270 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:09:13.270 INFO:tasks.workunit.client.0.smithi067.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:09:13.270 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:09:13.270 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:09:13.270 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:09:13.270 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:09:13.270 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:09:13.270 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:09:13.270 INFO:tasks.workunit.client.0.smithi067.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:09:13.270 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:09:13.271 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:09:13.271 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:09:13.272 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:09:13.272 INFO:tasks.workunit.client.0.smithi067.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:09:13.272 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:09:13.273 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:09:13.273 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:09:13.274 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:09:13.274 INFO:tasks.workunit.client.0.smithi067.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:09:13.275 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:09:13.277 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:09:13.277 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:09:13.278 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:09:13.278 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-09-12T00:09:13.278 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:09:13.459 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READF_SETUP1 (180 ms) 2024-09-12T00:09:13.459 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:09:13.459 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:09:13.459 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:09:13.459 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:09:13.459 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:09:13.459 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:09:13.459 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:09:13.459 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:09:13.459 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:09:13.459 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:09:13.459 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:09:13.460 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:09:13.460 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:09:13.460 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:09:13.460 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:09:13.460 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:09:13.460 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:09:13.460 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:09:13.460 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:09:13.466 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:09:13.466 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:09:13.469 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:09:13.470 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:09:13.473 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:09:13.474 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:09:13.474 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:09:13.475 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:09:13.476 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:09:13.476 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:09:13.477 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:09:13.479 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:09:13.479 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:09:13.479 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:09:13.479 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:09:13.479 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:09:13.479 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.HIER1 (20 ms) 2024-09-12T00:09:13.479 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:09:13.480 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:09:13.480 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:09:13.480 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:09:13.480 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:09:13.480 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:09:13.480 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:09:13.480 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:09:13.480 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:09:13.480 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:09:13.480 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:09:13.480 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:09:13.480 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:09:13.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:13.480+0000 7f8f237208c0 -1 shutting down 2024-09-12T00:09:13.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:13.481+0000 7f8dfb602640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64240, si_uid : 1000, si_addr0x3e80000faf0, si_status0 2024-09-12T00:09:43.379 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (29899 ms) 2024-09-12T00:09:43.379 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from LibRGW (30525 ms total) 2024-09-12T00:09:43.379 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:09:43.379 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:09:43.379 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 24 tests from 1 test suite ran. (30525 ms total) 2024-09-12T00:09:43.379 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 24 tests. 2024-09-12T00:09:43.386 INFO:tasks.workunit.client.0.smithi067.stdout:phase 1.2 2024-09-12T00:09:43.410 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:09:43.410 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:09:43.410 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:09:43.411 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:09:43.419 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:09:43.419 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:09:43.808 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (398 ms) 2024-09-12T00:09:43.809 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:09:43.810 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:09:43.810 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:09:43.810 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:09:43.810 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:09:43.810 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T00:09:43.810 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:09:43.810 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T00:09:43.810 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:09:43.811 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:09:43.811 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:09:43.811 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:09:43.811 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:09:43.811 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:09:43.811 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:09:43.811 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:09:43.811 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:09:43.811 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:09:43.811 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:09:43.811 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:09:43.811 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:09:43.811 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T00:09:43.811 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:09:43.812 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:09:43.812 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:09:43.812 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:09:43.812 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:09:43.812 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:09:43.812 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:09:43.812 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:09:43.812 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:09:43.812 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T00:09:43.812 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:09:43.812 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:09:43.812 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:09:43.812 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:09:43.813 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:09:43.813 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:09:43.813 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:09:43.813 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:09:43.813 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:09:43.813 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:09:43.813 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:09:43.813 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:09:43.813 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:09:43.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:43.811+0000 7ff2a3f228c0 -1 shutting down 2024-09-12T00:09:43.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:09:43.812+0000 7ff17bd9b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64859, si_uid : 1000, si_addr0x3e80000fd5b, si_status0 2024-09-12T00:10:14.113 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (30302 ms) 2024-09-12T00:10:14.113 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from LibRGW (30702 ms total) 2024-09-12T00:10:14.113 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:10:14.114 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:10:14.114 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 24 tests from 1 test suite ran. (30702 ms total) 2024-09-12T00:10:14.114 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 24 tests. 2024-09-12T00:10:14.118 INFO:tasks.workunit.client.0.smithi067.stdout:phase 1.3 2024-09-12T00:10:14.144 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:10:14.144 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:10:14.144 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:10:14.144 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:10:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:10:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:10:14.545 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (401 ms) 2024-09-12T00:10:14.545 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:10:14.546 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:10:14.546 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:10:14.546 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:10:14.546 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:10:14.551 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETUP_HIER1 (5 ms) 2024-09-12T00:10:14.551 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:10:14.613 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETUP_DIRS1 (61 ms) 2024-09-12T00:10:14.613 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:10:14.613 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:10:14.613 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:10:14.614 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:10:14.614 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:10:14.614 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:10:14.614 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:10:14.614 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:10:14.614 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:10:14.614 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:10:14.614 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:10:14.614 INFO:tasks.workunit.client.0.smithi067.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:10:14.614 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:10:14.614 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:10:14.614 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:10:14.614 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:10:14.615 INFO:tasks.workunit.client.0.smithi067.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:10:14.615 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:10:14.615 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:10:14.615 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:10:14.615 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:10:14.615 INFO:tasks.workunit.client.0.smithi067.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:10:14.615 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:10:14.615 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:10:14.615 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:10:14.615 INFO:tasks.workunit.client.0.smithi067.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:10:14.615 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:10:14.615 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:10:14.615 INFO:tasks.workunit.client.0.smithi067.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:10:14.615 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:10:14.616 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:10:14.616 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:10:14.616 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:10:14.616 INFO:tasks.workunit.client.0.smithi067.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:10:14.616 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:10:14.617 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:10:14.617 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:10:14.618 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:10:14.618 INFO:tasks.workunit.client.0.smithi067.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:10:14.618 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:10:14.620 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:10:14.620 INFO:tasks.workunit.client.0.smithi067.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:10:14.622 INFO:tasks.workunit.client.0.smithi067.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:10:14.622 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2024-09-12T00:10:14.622 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:10:14.622 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:10:14.622 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:10:14.623 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:10:14.623 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:10:14.623 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:10:14.623 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:10:14.623 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:10:14.623 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:10:14.623 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:10:14.623 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:10:14.623 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:10:14.623 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:10:14.623 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:10:14.623 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:10:14.623 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:10:14.623 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:10:14.624 INFO:tasks.workunit.client.0.smithi067.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:10:14.624 INFO:tasks.workunit.client.0.smithi067.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:10:14.624 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:10:14.624 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:10:14.628 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:10:14.628 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:10:14.631 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:10:14.633 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:10:14.638 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:10:14.638 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:10:14.638 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:10:14.639 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:10:14.639 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:10:14.639 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:10:14.639 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:10:14.641 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:10:14.641 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:10:14.641 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:10:14.641 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:10:14.641 INFO:tasks.workunit.client.0.smithi067.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:10:14.641 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.HIER1 (19 ms) 2024-09-12T00:10:14.641 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:10:14.641 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:10:14.642 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:10:14.642 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:10:14.642 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:10:14.642 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:10:14.642 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:10:14.642 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:10:14.642 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:10:14.642 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:10:14.642 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:10:14.642 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:10:14.642 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:10:14.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:10:14.641+0000 7f463b9348c0 -1 shutting down 2024-09-12T00:10:14.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:10:14.642+0000 7f451383c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65479, si_uid : 1000, si_addr0x3e80000ffc7, si_status0 2024-09-12T00:10:44.614 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (29972 ms) 2024-09-12T00:10:44.614 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 24 tests from LibRGW (30469 ms total) 2024-09-12T00:10:44.614 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:10:44.615 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:10:44.615 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 24 tests from 1 test suite ran. (30469 ms total) 2024-09-12T00:10:44.615 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 24 tests. 2024-09-12T00:10:44.620 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2.1 2024-09-12T00:10:44.646 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:10:44.647 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:10:44.647 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:10:44.647 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:10:44.656 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:10:44.656 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:10:45.049 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (404 ms) 2024-09-12T00:10:45.050 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:10:45.050 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:10:45.050 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:10:45.058 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-12T00:10:45.058 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:10:45.058 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:10:45.058 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:10:45.065 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave0 2024-09-12T00:10:45.072 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave1 2024-09-12T00:10:45.079 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave2 2024-09-12T00:10:45.086 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave3 2024-09-12T00:10:45.094 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave4 2024-09-12T00:10:45.101 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave5 2024-09-12T00:10:45.108 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave6 2024-09-12T00:10:45.115 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave7 2024-09-12T00:10:45.122 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave8 2024-09-12T00:10:45.129 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave9 2024-09-12T00:10:45.129 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (71 ms) 2024-09-12T00:10:45.129 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:10:45.277 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (148 ms) 2024-09-12T00:10:45.277 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:10:45.277 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:10:45.277 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:10:45.277 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:10:45.277 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:10:45.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:10:45.277+0000 7f02ed32e8c0 -1 shutting down 2024-09-12T00:10:45.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:10:45.278+0000 7f01c51b6640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66100, si_uid : 1000, si_addr0x3e800010234, si_status0 2024-09-12T00:11:15.205 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (29927 ms) 2024-09-12T00:11:15.206 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 9 tests from LibRGW (30558 ms total) 2024-09-12T00:11:15.206 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:11:15.206 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:11:15.206 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 9 tests from 1 test suite ran. (30558 ms total) 2024-09-12T00:11:15.206 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 9 tests. 2024-09-12T00:11:15.211 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2.2 2024-09-12T00:11:15.239 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:11:15.240 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:11:15.240 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:11:15.240 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:11:15.254 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:11:15.254 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:11:15.434 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (196 ms) 2024-09-12T00:11:15.434 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:11:15.435 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:11:15.435 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:11:15.435 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:11:15.435 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:11:15.453 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET (18 ms) 2024-09-12T00:11:15.453 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:11:15.469 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave0 2024-09-12T00:11:15.471 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave1 2024-09-12T00:11:15.477 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave2 2024-09-12T00:11:15.491 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave3 2024-09-12T00:11:15.493 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave4 2024-09-12T00:11:15.497 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave5 2024-09-12T00:11:15.504 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave6 2024-09-12T00:11:15.511 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave7 2024-09-12T00:11:15.517 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave8 2024-09-12T00:11:15.524 INFO:tasks.workunit.client.0.smithi067.stdout:created: sorrydave9 2024-09-12T00:11:15.524 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (71 ms) 2024-09-12T00:11:15.524 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:11:15.666 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (142 ms) 2024-09-12T00:11:15.666 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:11:15.666 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:11:15.666 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:11:15.666 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:11:15.666 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:11:15.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:11:15.667+0000 7f7c914318c0 -1 shutting down 2024-09-12T00:11:15.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:11:15.668+0000 7f7b6690f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66719, si_uid : 1000, si_addr0x3e80001049f, si_status0 2024-09-12T00:11:45.616 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (29949 ms) 2024-09-12T00:11:45.616 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 9 tests from LibRGW (30378 ms total) 2024-09-12T00:11:45.616 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:11:45.616 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:11:45.617 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 9 tests from 1 test suite ran. (30378 ms total) 2024-09-12T00:11:45.617 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 9 tests. 2024-09-12T00:11:45.621 INFO:tasks.workunit.client.0.smithi067.stdout:phase 3.1 2024-09-12T00:11:45.952 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:11:45.952 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:11:45.953 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:11:45.953 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:11:45.962 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:11:45.962 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:11:46.343 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (391 ms) 2024-09-12T00:11:46.343 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:11:46.343 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:11:46.343 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:11:46.350 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET (7 ms) 2024-09-12T00:11:46.350 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:11:46.353 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (2 ms) 2024-09-12T00:11:46.353 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:11:46.355 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T00:11:46.355 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:11:46.793 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LARGE1 (439 ms) 2024-09-12T00:11:46.794 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:11:46.843 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LARGE2 (49 ms) 2024-09-12T00:11:46.843 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:11:46.843 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:11:46.843 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:11:46.843 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:11:46.843 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:11:46.843 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:11:46.843 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:11:46.843 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:11:46.843 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:11:46.844 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:11:46.844 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:11:46.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:11:46.844+0000 7f366df228c0 -1 shutting down 2024-09-12T00:11:46.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:11:46.845+0000 7f3545ebd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67338, si_uid : 1000, si_addr0x3e80001070a, si_status0 2024-09-12T00:12:16.627 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (29783 ms) 2024-09-12T00:12:16.627 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 13 tests from LibRGW (30674 ms total) 2024-09-12T00:12:16.627 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:12:16.627 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:12:16.627 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 13 tests from 1 test suite ran. (30674 ms total) 2024-09-12T00:12:16.628 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 13 tests. 2024-09-12T00:12:16.634 INFO:tasks.workunit.client.0.smithi067.stdout:phase 3.2 2024-09-12T00:12:16.965 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:12:16.965 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:12:16.965 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:12:16.965 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:12:16.973 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:16.973 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:17.353 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (388 ms) 2024-09-12T00:12:17.353 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:12:17.353 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:12:17.354 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:12:17.354 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:12:17.354 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:12:17.358 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T00:12:17.358 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:12:17.361 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T00:12:17.361 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:12:17.411 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LARGE1 (49 ms) 2024-09-12T00:12:17.412 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:12:17.412 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T00:12:17.412 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:12:17.412 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:12:17.412 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:12:17.416 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-09-12T00:12:17.416 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:12:17.430 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET (14 ms) 2024-09-12T00:12:17.430 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:12:17.430 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:12:17.430 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:12:17.431 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:12:17.431 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:12:17.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:12:17.431+0000 7f915e6bf8c0 -1 shutting down 2024-09-12T00:12:17.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:12:17.432+0000 7f903561c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67957, si_uid : 1000, si_addr0x3e800010975, si_status0 2024-09-12T00:12:47.418 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (29987 ms) 2024-09-12T00:12:47.418 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 13 tests from LibRGW (30452 ms total) 2024-09-12T00:12:47.418 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:12:47.418 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:12:47.418 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 13 tests from 1 test suite ran. (30452 ms total) 2024-09-12T00:12:47.418 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 13 tests. 2024-09-12T00:12:47.424 INFO:tasks.workunit.client.0.smithi067.stdout:phase 4.1 2024-09-12T00:12:47.451 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:12:47.451 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:12:47.451 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:12:47.451 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:12:47.451 INFO:tasks.workunit.client.0.smithi067.stdout:read i1: 64001 2024-09-12T00:12:47.451 INFO:tasks.workunit.client.0.smithi067.stdout:read s1: blunderbuss 2024-09-12T00:12:47.451 INFO:tasks.workunit.client.0.smithi067.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:12:47.451 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:12:47.462 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:12:47.463 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:12:47.648 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (198 ms) 2024-09-12T00:12:47.649 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:12:47.649 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:12:47.649 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:12:47.665 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (15 ms) 2024-09-12T00:12:47.665 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:12:48.241 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_0 2024-09-12T00:12:48.241 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_1 2024-09-12T00:12:48.241 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_2 2024-09-12T00:12:48.241 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_3 2024-09-12T00:12:48.241 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_4 2024-09-12T00:12:48.241 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_5 2024-09-12T00:12:48.241 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_6 2024-09-12T00:12:48.241 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_7 2024-09-12T00:12:48.242 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_8 2024-09-12T00:12:48.242 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_9 2024-09-12T00:12:48.242 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_10 2024-09-12T00:12:48.242 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_11 2024-09-12T00:12:48.242 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_12 2024-09-12T00:12:48.242 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_13 2024-09-12T00:12:48.242 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_14 2024-09-12T00:12:48.242 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_15 2024-09-12T00:12:48.242 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_16 2024-09-12T00:12:48.242 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_17 2024-09-12T00:12:48.242 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_18 2024-09-12T00:12:48.242 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_19 2024-09-12T00:12:48.242 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_20 2024-09-12T00:12:48.242 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_21 2024-09-12T00:12:48.243 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_22 2024-09-12T00:12:48.243 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_23 2024-09-12T00:12:48.243 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_24 2024-09-12T00:12:48.243 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_25 2024-09-12T00:12:48.243 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_26 2024-09-12T00:12:48.243 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_27 2024-09-12T00:12:48.243 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_28 2024-09-12T00:12:48.243 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_29 2024-09-12T00:12:48.243 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_30 2024-09-12T00:12:48.243 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_31 2024-09-12T00:12:48.243 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_32 2024-09-12T00:12:48.244 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_33 2024-09-12T00:12:48.244 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_34 2024-09-12T00:12:48.244 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_35 2024-09-12T00:12:48.244 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_36 2024-09-12T00:12:48.244 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_37 2024-09-12T00:12:48.244 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_38 2024-09-12T00:12:48.244 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_39 2024-09-12T00:12:48.244 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_40 2024-09-12T00:12:48.244 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_41 2024-09-12T00:12:48.244 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_42 2024-09-12T00:12:48.244 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_43 2024-09-12T00:12:48.245 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_44 2024-09-12T00:12:48.245 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_45 2024-09-12T00:12:48.245 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_46 2024-09-12T00:12:48.245 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_47 2024-09-12T00:12:48.245 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_48 2024-09-12T00:12:48.245 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_49 2024-09-12T00:12:48.245 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_50 2024-09-12T00:12:48.245 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_51 2024-09-12T00:12:48.245 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_52 2024-09-12T00:12:48.245 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_53 2024-09-12T00:12:48.245 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_54 2024-09-12T00:12:48.246 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_55 2024-09-12T00:12:48.246 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_56 2024-09-12T00:12:48.246 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_57 2024-09-12T00:12:48.246 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_58 2024-09-12T00:12:48.246 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_59 2024-09-12T00:12:48.246 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_60 2024-09-12T00:12:48.246 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_61 2024-09-12T00:12:48.246 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_62 2024-09-12T00:12:48.246 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_63 2024-09-12T00:12:48.246 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_64 2024-09-12T00:12:48.246 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_65 2024-09-12T00:12:48.246 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_66 2024-09-12T00:12:48.247 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_67 2024-09-12T00:12:48.247 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_68 2024-09-12T00:12:48.247 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_69 2024-09-12T00:12:48.247 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_70 2024-09-12T00:12:48.247 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_71 2024-09-12T00:12:48.247 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_72 2024-09-12T00:12:48.247 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_73 2024-09-12T00:12:48.247 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_74 2024-09-12T00:12:48.248 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_75 2024-09-12T00:12:48.248 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_76 2024-09-12T00:12:48.248 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_77 2024-09-12T00:12:48.248 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_78 2024-09-12T00:12:48.248 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_79 2024-09-12T00:12:48.248 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_80 2024-09-12T00:12:48.248 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_81 2024-09-12T00:12:48.248 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_82 2024-09-12T00:12:48.248 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_83 2024-09-12T00:12:48.248 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_84 2024-09-12T00:12:48.249 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_85 2024-09-12T00:12:48.249 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_86 2024-09-12T00:12:48.249 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_87 2024-09-12T00:12:48.249 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_88 2024-09-12T00:12:48.249 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_89 2024-09-12T00:12:48.250 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_90 2024-09-12T00:12:48.250 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_91 2024-09-12T00:12:48.250 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_92 2024-09-12T00:12:48.250 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_93 2024-09-12T00:12:48.250 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_94 2024-09-12T00:12:48.250 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_95 2024-09-12T00:12:48.250 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_96 2024-09-12T00:12:48.250 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_97 2024-09-12T00:12:48.250 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_98 2024-09-12T00:12:48.250 INFO:tasks.workunit.client.0.smithi067.stdout:created: dmarker:f_99 2024-09-12T00:12:48.250 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (576 ms) 2024-09-12T00:12:48.251 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:12:48.252 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T00:12:48.253 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T00:12:48.253 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:12:48.253 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:12:48.253 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:12:48.253 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:12:48.253 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:12:48.253 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:12:48.254 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:12:48.254 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:12:48.254 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:12:48.254 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:12:48.254 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:12:48.254 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:12:48.254 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:12:48.254 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:12:48.254 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:12:48.254 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:12:48.254 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:12:48.254 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:12:48.255 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:12:48.255 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:12:48.255 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:12:48.255 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:12:48.255 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:12:48.255 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:12:48.255 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:12:48.255 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:12:48.255 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:12:48.255 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:12:48.255 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:12:48.255 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:12:48.255 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:12:48.256 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:12:48.256 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:12:48.256 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:12:48.256 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:12:48.256 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:12:48.256 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:12:48.256 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:12:48.256 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:12:48.256 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:12:48.256 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:12:48.256 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:12:48.256 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:12:48.256 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:12:48.256 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:12:48.257 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:12:48.257 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:12:48.257 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:12:48.257 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:12:48.257 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:12:48.257 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:12:48.257 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:12:48.257 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:12:48.257 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:12:48.257 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:12:48.257 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:12:48.257 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:12:48.257 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:12:48.258 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:12:48.258 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:12:48.258 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:12:48.258 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:12:48.258 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:12:48.258 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:12:48.258 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:12:48.258 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:12:48.258 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:12:48.258 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:12:48.258 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:12:48.258 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:12:48.258 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:12:48.258 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:12:48.259 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:12:48.259 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:12:48.259 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:12:48.259 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:12:48.259 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:12:48.259 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:12:48.259 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:12:48.259 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:12:48.259 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:12:48.259 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:12:48.259 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:12:48.259 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:12:48.259 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:12:48.259 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:12:48.260 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:12:48.260 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:12:48.260 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:12:48.260 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:12:48.260 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:12:48.260 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:12:48.260 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:12:48.260 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:12:48.260 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:12:48.260 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:12:48.260 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:12:48.260 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:12:48.260 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:12:48.260 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:12:48.261 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_READDIR (3 ms) 2024-09-12T00:12:48.261 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:12:48.261 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:12:48.261 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:12:48.261 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:12:48.261 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:12:48.261 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:12:48.261 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:12:48.261 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:12:48.261 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:12:48.261 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:12:48.261 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:12:48.261 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:12:48.262 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:12:48.262 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:12:48.262 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:12:48.262 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:12:48.262 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:12:48.262 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:12:48.262 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:12:48.262 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:12:48.262 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:12:48.262 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:12:48.262 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:12:48.263 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:12:48.263 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:12:48.263 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:12:48.263 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:12:48.263 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:12:48.263 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:12:48.263 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:12:48.263 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:12:48.263 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:12:48.263 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:12:48.263 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:12:48.263 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:12:48.263 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:12:48.264 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:12:48.264 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:12:48.264 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:12:48.264 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:12:48.264 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:12:48.264 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:12:48.264 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:12:48.264 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:12:48.264 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:12:48.264 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:12:48.264 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:12:48.264 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:12:48.264 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:12:48.265 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:12:48.265 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:12:48.265 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:12:48.265 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:12:48.265 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:12:48.265 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:12:48.265 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:12:48.265 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:12:48.265 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:12:48.265 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:12:48.265 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:12:48.265 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:12:48.265 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:12:48.266 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:12:48.266 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:12:48.266 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:12:48.266 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:12:48.266 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:12:48.266 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:12:48.266 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:12:48.266 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:12:48.266 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:12:48.266 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:12:48.266 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:12:48.266 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:12:48.266 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:12:48.266 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:12:48.267 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:12:48.267 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:12:48.267 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:12:48.267 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:12:48.267 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:12:48.267 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:12:48.267 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:12:48.267 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:12:48.267 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:12:48.267 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:12:48.267 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:12:48.267 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:12:48.267 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:12:48.267 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:12:48.267 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:12:48.268 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:12:48.268 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:12:48.268 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:12:48.268 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:12:48.268 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:12:48.268 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:12:48.268 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:12:48.268 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:12:48.268 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:12:48.268 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:12:48.268 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-12T00:12:48.268 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:12:48.268 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:12:48.269 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:12:48.269 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:12:48.269 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:12:48.269 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:12:48.269 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:12:48.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:12:48.248+0000 7f3d1e4bf8c0 -1 shutting down 2024-09-12T00:12:48.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:12:48.249+0000 7f3bf54d5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68579, si_uid : 1000, si_addr0x3e800010be3, si_status0 2024-09-12T00:13:17.939 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (29693 ms) 2024-09-12T00:13:17.940 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 11 tests from LibRGW (30488 ms total) 2024-09-12T00:13:17.940 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:13:17.940 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:13:17.940 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 11 tests from 1 test suite ran. (30488 ms total) 2024-09-12T00:13:17.940 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 11 tests. 2024-09-12T00:13:17.946 INFO:tasks.workunit.client.0.smithi067.stdout:phase 4.2 2024-09-12T00:13:17.972 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:13:17.972 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:13:17.972 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:13:17.972 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:13:17.972 INFO:tasks.workunit.client.0.smithi067.stdout:read i1: 64001 2024-09-12T00:13:17.972 INFO:tasks.workunit.client.0.smithi067.stdout:read s1: blunderbuss 2024-09-12T00:13:17.972 INFO:tasks.workunit.client.0.smithi067.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:13:17.972 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:13:17.980 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:17.980 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:18.167 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (195 ms) 2024-09-12T00:13:18.167 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:13:18.168 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:13:18.168 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:13:18.176 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (9 ms) 2024-09-12T00:13:18.177 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:13:18.177 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:13:18.177 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:13:18.177 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:13:18.177 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:13:18.180 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:13:18.180 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:13:18.180 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:13:18.180 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:13:18.181 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:13:18.181 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:13:18.181 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:13:18.181 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:13:18.181 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:13:18.181 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:13:18.181 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:13:18.181 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:13:18.181 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:13:18.181 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:13:18.181 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:13:18.181 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:13:18.182 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:13:18.182 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:13:18.182 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:13:18.182 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:13:18.182 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:13:18.182 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:13:18.182 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:13:18.182 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:13:18.182 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:13:18.182 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:13:18.182 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:13:18.182 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:13:18.182 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:13:18.183 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:13:18.183 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:13:18.183 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:13:18.183 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:13:18.183 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:13:18.183 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:13:18.183 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:13:18.183 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:13:18.183 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:13:18.183 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:13:18.183 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:13:18.183 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:13:18.183 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:13:18.184 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:13:18.184 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:13:18.184 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:13:18.184 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:13:18.184 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:13:18.184 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:13:18.184 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:13:18.184 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:13:18.184 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:13:18.184 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:13:18.184 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:13:18.184 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:13:18.184 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:13:18.185 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:13:18.185 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:13:18.185 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:13:18.185 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:13:18.185 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:13:18.185 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:13:18.185 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:13:18.185 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:13:18.185 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:13:18.185 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:13:18.185 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:13:18.185 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:13:18.185 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:13:18.185 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:13:18.186 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:13:18.186 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:13:18.186 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:13:18.186 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:13:18.186 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:13:18.186 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:13:18.186 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:13:18.186 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:13:18.186 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:13:18.186 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:13:18.186 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:13:18.186 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:13:18.186 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:13:18.186 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:13:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:13:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:13:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:13:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:13:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:13:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:13:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:13:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:13:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:13:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:13:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:13:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:13:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:13:18.187 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:13:18.188 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:13:18.188 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:13:18.188 INFO:tasks.workunit.client.0.smithi067.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:13:18.188 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-12T00:13:18.188 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:13:18.188 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:13:18.188 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:13:18.188 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:13:18.188 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:13:18.188 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:13:18.188 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:13:18.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:13:18.182+0000 7fa216d1f8c0 -1 shutting down 2024-09-12T00:13:18.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:13:18.183+0000 7fa0eebcf640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69198, si_uid : 1000, si_addr0x3e800010e4e, si_status0 2024-09-12T00:13:48.452 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (30271 ms) 2024-09-12T00:13:48.453 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 11 tests from LibRGW (30479 ms total) 2024-09-12T00:13:48.453 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:13:48.453 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:13:48.453 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 11 tests from 1 test suite ran. (30479 ms total) 2024-09-12T00:13:48.453 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 11 tests. 2024-09-12T00:13:48.458 INFO:tasks.workunit.client.0.smithi067.stdout:phase 5.1 2024-09-12T00:13:48.493 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:13:48.493 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:13:48.493 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:13:48.493 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:13:48.504 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:48.504 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:48.691 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (198 ms) 2024-09-12T00:13:48.691 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:13:48.692 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:13:48.692 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:13:48.700 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-12T00:13:48.700 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:13:48.702 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-12T00:13:48.702 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:13:48.702 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:13:48.702 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:13:48.704 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-09-12T00:13:48.704 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:13:48.704 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:13:48.704 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:13:48.709 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-09-12T00:13:48.709 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:13:48.711 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-12T00:13:48.711 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:13:48.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:13:48.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:13:48.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:13:48.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:13:48.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:13:48.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:13:48.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:13:48.712 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:13:48.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:13:48.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:13:48.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:13:48.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:13:48.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:13:48.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:13:48.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:13:48.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:13:48.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:13:48.713 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:13:48.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:13:48.712+0000 7faec93278c0 -1 shutting down 2024-09-12T00:13:48.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:13:48.713+0000 7fada11ac640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69817, si_uid : 1000, si_addr0x3e8000110b9, si_status0 2024-09-12T00:14:19.094 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (30383 ms) 2024-09-12T00:14:19.095 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 19 tests from LibRGW (30601 ms total) 2024-09-12T00:14:19.095 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:14:19.095 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:14:19.095 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 19 tests from 1 test suite ran. (30601 ms total) 2024-09-12T00:14:19.095 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 19 tests. 2024-09-12T00:14:19.100 INFO:tasks.workunit.client.0.smithi067.stdout:phase 5.2 2024-09-12T00:14:19.135 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:14:19.135 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:14:19.135 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:14:19.135 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:14:19.143 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:14:19.143 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:14:19.329 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (195 ms) 2024-09-12T00:14:19.329 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:14:19.330 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:14:19.330 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:14:19.330 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:14:19.330 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:14:19.334 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T00:14:19.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:14:19.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:14:19.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:14:19.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T00:14:19.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:14:19.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:14:19.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:14:19.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T00:14:19.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:14:19.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T00:14:19.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:14:19.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:14:19.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:14:19.335 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:14:19.336 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:14:19.336 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:14:19.336 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:14:19.336 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:14:19.336 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:14:19.336 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:14:19.336 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:14:19.339 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-12T00:14:19.340 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:14:19.355 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.DELETE_BUCKET (15 ms) 2024-09-12T00:14:19.355 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:14:19.355 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:14:19.355 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:14:19.355 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:14:19.355 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:14:19.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:14:19.356+0000 7f7e1372b8c0 -1 shutting down 2024-09-12T00:14:19.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:14:19.357+0000 7f7ceb701640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70437, si_uid : 1000, si_addr0x3e800011325, si_status0 2024-09-12T00:14:49.643 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (30287 ms) 2024-09-12T00:14:49.643 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 19 tests from LibRGW (30507 ms total) 2024-09-12T00:14:49.643 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:14:49.643 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:14:49.643 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 19 tests from 1 test suite ran. (30507 ms total) 2024-09-12T00:14:49.643 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 19 tests. 2024-09-12T00:14:49.648 INFO:tasks.workunit.client.0.smithi067.stdout:phase 6.1 2024-09-12T00:14:49.674 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:14:49.674 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment set-up. 2024-09-12T00:14:49.675 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 10 tests from LibRGW 2024-09-12T00:14:49.675 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:14:49.682 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:14:49.682 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:14:50.075 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.INIT (402 ms) 2024-09-12T00:14:50.076 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:14:50.076 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:14:50.076 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T00:14:50.091 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CREATE_BUCKETS (14 ms) 2024-09-12T00:14:50.091 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T00:14:50.096 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (6 ms) 2024-09-12T00:14:50.096 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T00:14:50.116 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.TOPDIR_RENAME (19 ms) 2024-09-12T00:14:50.116 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T00:14:50.140 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SUBDIR_RENAME (24 ms) 2024-09-12T00:14:50.140 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T00:14:50.163 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (23 ms) 2024-09-12T00:14:50.164 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:14:50.164 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:14:50.164 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:14:50.164 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:14:50.164 INFO:tasks.workunit.client.0.smithi067.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:14:50.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:14:50.164+0000 7ff5eab228c0 -1 shutting down 2024-09-12T00:14:50.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:14:50.165+0000 7ff4c2abd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71056, si_uid : 1000, si_addr0x3e800011590, si_status0 2024-09-12T00:15:20.516 INFO:tasks.workunit.client.0.smithi067.stdout:[ OK ] LibRGW.SHUTDOWN (30352 ms) 2024-09-12T00:15:20.516 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] 10 tests from LibRGW (30841 ms total) 2024-09-12T00:15:20.516 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:15:20.517 INFO:tasks.workunit.client.0.smithi067.stdout:[----------] Global test environment tear-down 2024-09-12T00:15:20.517 INFO:tasks.workunit.client.0.smithi067.stdout:[==========] 10 tests from 1 test suite ran. (30841 ms total) 2024-09-12T00:15:20.517 INFO:tasks.workunit.client.0.smithi067.stdout:[ PASSED ] 10 tests. 2024-09-12T00:15:20.523 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:15:20.523 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:15:20.570 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T00:15:20.571 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T00:15:20.571 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T00:15:20.608 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2024-09-12T00:15:20.608 INFO:tasks.workunit.client.0.smithi067.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:15:20.608 INFO:tasks.workunit.client.0.smithi067.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:15:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:15:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:15:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-12T00:15:20.646 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:20.646 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:20.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.687+0000 7f8250b32800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.689+0000 7f8250b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:20.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.689+0000 7f8250b32800 20 realm 2024-09-12T00:15:20.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.689+0000 7f8250b32800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.689+0000 7f8250b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:20.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.689+0000 7f8250b32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:20.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.689+0000 7f8250b32800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.689+0000 7f8250b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:20.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.689+0000 7f8250b32800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.690+0000 7f8250b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:20.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.690+0000 7f8250b32800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.691+0000 7f8250b32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:15:20.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.691+0000 7f8250b32800 20 searching for the correct realm 2024-09-12T00:15:20.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.694+0000 7f824bfbb640 0 -- 172.21.15.67:0/3516508692 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f8240002040 msgr2=0x7f8240001400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:15:20.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.698+0000 7f824cfbd640 0 -- 172.21.15.67:0/3516508692 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x555ccc0a47c0 msgr2=0x555ccc0a6c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:20.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.702+0000 7f8250b32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:20.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.702+0000 7f8250b32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:20.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.702+0000 7f8250b32800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:15:20.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.702+0000 7f8250b32800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:15:20.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.702+0000 7f8250b32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:20.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.702+0000 7f8250b32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:20.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.702+0000 7f8250b32800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.702+0000 7f8250b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:20.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.702+0000 7f8250b32800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.703+0000 7f8250b32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:20.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.703+0000 7f8250b32800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.703+0000 7f8250b32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:15:20.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.703+0000 7f8250b32800 20 zone default found 2024-09-12T00:15:20.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.703+0000 7f8250b32800 4 Realm: () 2024-09-12T00:15:20.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.703+0000 7f8250b32800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:15:20.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.703+0000 7f8250b32800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:15:20.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.703+0000 7f8250b32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:20.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.703+0000 7f8250b32800 20 zonegroup default 2024-09-12T00:15:20.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.703+0000 7f8250b32800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.703+0000 7f8250b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:20.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.703+0000 7f8250b32800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.704+0000 7f8250b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:20.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.704+0000 7f8250b32800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.704+0000 7f8250b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:20.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.704+0000 7f8250b32800 20 started sync module instance, tier type = 2024-09-12T00:15:20.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.704+0000 7f8250b32800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:15:20.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.713+0000 7f8250b32800 20 add_watcher() i=0 2024-09-12T00:15:20.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.713+0000 7f8250b32800 20 add_watcher() i=1 2024-09-12T00:15:20.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.713+0000 7f8250b32800 20 add_watcher() i=2 2024-09-12T00:15:20.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.713+0000 7f8250b32800 20 add_watcher() i=3 2024-09-12T00:15:20.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.713+0000 7f8250b32800 20 add_watcher() i=4 2024-09-12T00:15:20.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.713+0000 7f8250b32800 20 add_watcher() i=5 2024-09-12T00:15:20.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.713+0000 7f8250b32800 20 add_watcher() i=6 2024-09-12T00:15:20.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.714+0000 7f8250b32800 20 add_watcher() i=7 2024-09-12T00:15:20.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.714+0000 7f8250b32800 2 all 8 watchers are set, enabling cache 2024-09-12T00:15:20.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.716+0000 7f8102fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:20.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.716+0000 7f8250b32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:15:20.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.716+0000 7f8250b32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:15:20.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.716+0000 7f8250b32800 5 note: GC not initialized 2024-09-12T00:15:20.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.717+0000 7f8101fdb640 20 reqs_thread_entry: start 2024-09-12T00:15:20.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.717+0000 7f8250b32800 20 init_complete bucket index max shards: 1 2024-09-12T00:15:20.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.717+0000 7f8250b32800 20 Filter name: none 2024-09-12T00:15:20.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.717+0000 7f80737fe640 20 reqs_thread_entry: start 2024-09-12T00:15:20.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.717+0000 7f8250b32800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T00:15:20.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.717+0000 7f8250b32800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.717+0000 7f8250b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:20.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.717+0000 7f8250b32800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T00:15:20.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.717+0000 7f8250b32800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:15:20.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.717+0000 7f8250b32800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T00:15:20.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.717+0000 7f8250b32800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.718+0000 7f8250b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:20.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.718+0000 7f8250b32800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T00:15:20.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.718+0000 7f8250b32800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:15:20.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.718+0000 7f8250b32800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T00:15:20.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.718+0000 7f8250b32800 20 rados->read ofs=0 len=0 2024-09-12T00:15:20.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.718+0000 7f8250b32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:20.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.718+0000 7f8250b32800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T00:15:20.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.718+0000 7f8250b32800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:15:20.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.718+0000 7f8250b32800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:15:20.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.718+0000 7f8250b32800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:15:20.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.719+0000 7f8250b32800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:15:20.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.719+0000 7f8250b32800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:15:20.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.719+0000 7f8250b32800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T00:15:20.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.720+0000 7f81237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856713 cookie 93857048646256 notifier 5796 bl.length()=677 2024-09-12T00:15:20.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.720+0000 7f81237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:15:20.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.720+0000 7f81237fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:15:20.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.721+0000 7f8250b32800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:15:20.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.721+0000 7f8250b32800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:15:20.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.721+0000 7f8250b32800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T00:15:20.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.722+0000 7f81237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856714 cookie 93857048630096 notifier 5796 bl.length()=187 2024-09-12T00:15:20.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.722+0000 7f81237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:15:20.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.722+0000 7f81237fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:15:20.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.723+0000 7f8250b32800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:15:20.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.723+0000 7f8250b32800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:15:20.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.723+0000 7f8250b32800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T00:15:20.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.723+0000 7f8122ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856715 cookie 93857048630096 notifier 5796 bl.length()=197 2024-09-12T00:15:20.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.723+0000 7f8122ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:15:20.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.723+0000 7f8122ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:15:20.723 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:15:20.723 INFO:tasks.workunit.client.0.smithi067.stdout: "user_id": "ceph-test-maven", 2024-09-12T00:15:20.724 INFO:tasks.workunit.client.0.smithi067.stdout: "display_name": "maven test user", 2024-09-12T00:15:20.724 INFO:tasks.workunit.client.0.smithi067.stdout: "email": "sigv4@example.com", 2024-09-12T00:15:20.724 INFO:tasks.workunit.client.0.smithi067.stdout: "suspended": 0, 2024-09-12T00:15:20.724 INFO:tasks.workunit.client.0.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:15:20.724 INFO:tasks.workunit.client.0.smithi067.stdout: "subusers": [], 2024-09-12T00:15:20.724 INFO:tasks.workunit.client.0.smithi067.stdout: "keys": [ 2024-09-12T00:15:20.724 INFO:tasks.workunit.client.0.smithi067.stdout: { 2024-09-12T00:15:20.724 INFO:tasks.workunit.client.0.smithi067.stdout: "user": "ceph-test-maven", 2024-09-12T00:15:20.724 INFO:tasks.workunit.client.0.smithi067.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T00:15:20.724 INFO:tasks.workunit.client.0.smithi067.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T00:15:20.724 INFO:tasks.workunit.client.0.smithi067.stdout: "active": true, 2024-09-12T00:15:20.724 INFO:tasks.workunit.client.0.smithi067.stdout: "create_date": "2024-09-12T00:15:20.720047Z" 2024-09-12T00:15:20.724 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:15:20.725 INFO:tasks.workunit.client.0.smithi067.stdout: ], 2024-09-12T00:15:20.725 INFO:tasks.workunit.client.0.smithi067.stdout: "swift_keys": [], 2024-09-12T00:15:20.725 INFO:tasks.workunit.client.0.smithi067.stdout: "caps": [], 2024-09-12T00:15:20.725 INFO:tasks.workunit.client.0.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T00:15:20.725 INFO:tasks.workunit.client.0.smithi067.stdout: "default_placement": "", 2024-09-12T00:15:20.725 INFO:tasks.workunit.client.0.smithi067.stdout: "default_storage_class": "", 2024-09-12T00:15:20.725 INFO:tasks.workunit.client.0.smithi067.stdout: "placement_tags": [], 2024-09-12T00:15:20.725 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_quota": { 2024-09-12T00:15:20.725 INFO:tasks.workunit.client.0.smithi067.stdout: "enabled": false, 2024-09-12T00:15:20.725 INFO:tasks.workunit.client.0.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:15:20.725 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size": -1, 2024-09-12T00:15:20.725 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:15:20.725 INFO:tasks.workunit.client.0.smithi067.stdout: "max_objects": -1 2024-09-12T00:15:20.725 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:15:20.726 INFO:tasks.workunit.client.0.smithi067.stdout: "user_quota": { 2024-09-12T00:15:20.726 INFO:tasks.workunit.client.0.smithi067.stdout: "enabled": false, 2024-09-12T00:15:20.726 INFO:tasks.workunit.client.0.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:15:20.726 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size": -1, 2024-09-12T00:15:20.726 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:15:20.726 INFO:tasks.workunit.client.0.smithi067.stdout: "max_objects": -1 2024-09-12T00:15:20.726 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:15:20.726 INFO:tasks.workunit.client.0.smithi067.stdout: "temp_url_keys": [], 2024-09-12T00:15:20.726 INFO:tasks.workunit.client.0.smithi067.stdout: "type": "rgw", 2024-09-12T00:15:20.726 INFO:tasks.workunit.client.0.smithi067.stdout: "mfa_ids": [], 2024-09-12T00:15:20.726 INFO:tasks.workunit.client.0.smithi067.stdout: "account_id": "", 2024-09-12T00:15:20.726 INFO:tasks.workunit.client.0.smithi067.stdout: "path": "/", 2024-09-12T00:15:20.726 INFO:tasks.workunit.client.0.smithi067.stdout: "create_date": "2024-09-12T00:15:20.720031Z", 2024-09-12T00:15:20.727 INFO:tasks.workunit.client.0.smithi067.stdout: "tags": [], 2024-09-12T00:15:20.727 INFO:tasks.workunit.client.0.smithi067.stdout: "group_ids": [] 2024-09-12T00:15:20.727 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:15:20.727 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:15:20.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.725+0000 7f8102fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:15:20.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.727+0000 7f8250b32800 20 remove_watcher() i=0 2024-09-12T00:15:20.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.727+0000 7f8250b32800 2 removed watcher, disabling cache 2024-09-12T00:15:20.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.728+0000 7f8250b32800 20 remove_watcher() i=1 2024-09-12T00:15:20.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.729+0000 7f8250b32800 20 remove_watcher() i=2 2024-09-12T00:15:20.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.730+0000 7f8250b32800 20 remove_watcher() i=3 2024-09-12T00:15:20.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.731+0000 7f8250b32800 20 remove_watcher() i=4 2024-09-12T00:15:20.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.732+0000 7f8250b32800 20 remove_watcher() i=5 2024-09-12T00:15:20.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.733+0000 7f8250b32800 20 remove_watcher() i=6 2024-09-12T00:15:20.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:15:20.734+0000 7f8250b32800 20 remove_watcher() i=7 2024-09-12T00:15:20.744 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z ']' 2024-09-12T00:15:20.745 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-12T00:15:20.745 INFO:tasks.workunit.client.0.smithi067.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-12T00:15:20.746 INFO:tasks.workunit.client.0.smithi067.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi067.front.sepia.ceph.com:80 2024-09-12T00:15:20.746 INFO:tasks.workunit.client.0.smithi067.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi067.front.sepia.ceph.com:80 2024-09-12T00:15:20.746 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-12T00:15:20.746 INFO:tasks.workunit.client.0.smithi067.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T00:15:20.746 INFO:tasks.workunit.client.0.smithi067.stderr:+ ./mvnw clean package 2024-09-12T00:15:20.763 INFO:tasks.workunit.client.0.smithi067.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:15:22.354 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Scanning for projects... 2024-09-12T00:15:22.485 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T00:15:22.570 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 63 kB/s) 2024-09-12T00:15:22.583 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T00:15:22.622 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 18/83 kB Progress (1): 19/83 kB Progress (1): 21/83 kB Progress (1): 22/83 kB Progress (1): 23/83 kB Progress (1): 25/83 kB Progress (1): 26/83 kB Progress (1): 27/83 kB Progress (1): 29/83 kB Progress (1): 30/83 kB Progress (1): 32/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.1 MB/s) 2024-09-12T00:15:22.634 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T00:15:22.653 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 64/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.8 MB/s) 2024-09-12T00:15:22.685 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:22.685 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:15:22.685 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:15:22.685 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] from pom.xml 2024-09-12T00:15:22.685 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:15:22.689 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T00:15:22.709 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 295 kB/s) 2024-09-12T00:15:22.714 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T00:15:22.730 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-12T00:15:22.734 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T00:15:22.755 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.2 MB/s) 2024-09-12T00:15:22.764 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T00:15:22.782 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.1 MB/s) 2024-09-12T00:15:22.797 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T00:15:22.815 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 1.9 MB/s) 2024-09-12T00:15:22.824 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T00:15:22.842 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 453 kB/s) 2024-09-12T00:15:22.845 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T00:15:22.864 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 405 kB/s) 2024-09-12T00:15:22.867 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T00:15:22.884 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.8 MB/s) 2024-09-12T00:15:22.889 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T00:15:22.905 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.3 MB/s) 2024-09-12T00:15:22.911 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T00:15:22.928 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.9 MB/s) 2024-09-12T00:15:22.935 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T00:15:22.959 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 409 kB/s) 2024-09-12T00:15:22.967 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T00:15:22.986 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15/66 kB Progress (1): 31/66 kB Progress (1): 48/66 kB Progress (1): 64/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.5 MB/s) 2024-09-12T00:15:22.994 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T00:15:23.010 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 332 kB/s) 2024-09-12T00:15:23.012 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T00:15:23.029 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.3 MB/s) 2024-09-12T00:15:23.033 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T00:15:23.049 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.1 MB/s) 2024-09-12T00:15:23.055 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T00:15:23.074 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.2 MB/s) 2024-09-12T00:15:23.082 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T00:15:23.100 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 313 kB/s) 2024-09-12T00:15:23.104 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T00:15:23.128 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15/45 kB Progress (1): 31/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 1.9 MB/s) 2024-09-12T00:15:23.136 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T00:15:23.153 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 398 kB/s) 2024-09-12T00:15:23.156 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T00:15:23.173 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 619 kB/s) 2024-09-12T00:15:23.177 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T00:15:23.193 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/46 kB Progress (1): 32/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.7 MB/s) 2024-09-12T00:15:23.198 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T00:15:23.213 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.3 MB/s) 2024-09-12T00:15:23.218 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T00:15:23.233 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.8 MB/s) 2024-09-12T00:15:23.246 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T00:15:23.264 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 358 kB/s) 2024-09-12T00:15:23.266 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T00:15:23.281 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.3 MB/s) 2024-09-12T00:15:23.285 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T00:15:23.303 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.2 MB/s) 2024-09-12T00:15:23.310 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T00:15:23.327 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 250 kB/s) 2024-09-12T00:15:23.329 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T00:15:23.346 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 91 kB/s) 2024-09-12T00:15:23.347 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T00:15:23.369 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 101 kB/s) 2024-09-12T00:15:23.373 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T00:15:23.392 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 191 kB/s) 2024-09-12T00:15:23.396 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T00:15:23.412 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 201 kB/s) 2024-09-12T00:15:23.416 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T00:15:23.432 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 645 kB/s) 2024-09-12T00:15:23.437 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T00:15:23.457 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 89 kB/s) 2024-09-12T00:15:23.480 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T00:15:23.480 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 212 kB/s) 2024-09-12T00:15:23.484 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T00:15:23.499 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 327 kB/s) 2024-09-12T00:15:23.503 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T00:15:23.519 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 72 kB/s) 2024-09-12T00:15:23.521 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T00:15:23.537 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 226 kB/s) 2024-09-12T00:15:23.539 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T00:15:23.554 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 920 kB/s) 2024-09-12T00:15:23.557 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T00:15:23.572 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 230 kB/s) 2024-09-12T00:15:23.576 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T00:15:23.592 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 153 kB/s) 2024-09-12T00:15:23.595 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T00:15:23.611 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 194 kB/s) 2024-09-12T00:15:23.615 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T00:15:23.640 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 285 kB/s) 2024-09-12T00:15:23.644 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T00:15:23.660 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 341 kB/s) 2024-09-12T00:15:23.663 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T00:15:23.679 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 233 kB/s) 2024-09-12T00:15:23.683 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T00:15:23.713 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 151 kB/s) 2024-09-12T00:15:23.715 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T00:15:23.734 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 120 kB/s) 2024-09-12T00:15:23.738 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T00:15:23.753 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 429 kB/s) 2024-09-12T00:15:23.757 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T00:15:23.773 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 379 kB/s) 2024-09-12T00:15:23.776 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T00:15:23.791 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 186 kB/s) 2024-09-12T00:15:23.796 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T00:15:23.812 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 217 kB/s) 2024-09-12T00:15:23.816 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T00:15:23.833 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 240 kB/s) 2024-09-12T00:15:23.835 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T00:15:23.852 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-09-12T00:15:23.855 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T00:15:23.870 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 472 kB/s) 2024-09-12T00:15:23.873 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T00:15:23.888 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.1 MB/s) 2024-09-12T00:15:23.890 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T00:15:23.905 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.3 MB/s) 2024-09-12T00:15:23.908 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T00:15:23.922 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.1 MB/s) 2024-09-12T00:15:23.926 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T00:15:23.941 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 331 kB/s) 2024-09-12T00:15:23.944 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T00:15:23.959 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 878 kB/s) 2024-09-12T00:15:23.963 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T00:15:23.978 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 873 kB/s) 2024-09-12T00:15:23.981 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T00:15:23.999 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.8 MB/s) 2024-09-12T00:15:24.004 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T00:15:24.018 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.0 MB/s) 2024-09-12T00:15:24.023 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T00:15:24.038 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.0 MB/s) 2024-09-12T00:15:24.040 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T00:15:24.056 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-12T00:15:24.061 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T00:15:24.076 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.2 MB/s) 2024-09-12T00:15:24.081 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T00:15:24.099 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-09-12T00:15:24.102 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T00:15:24.120 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15/78 kB Progress (1): 31/78 kB Progress (1): 48/78 kB Progress (1): 64/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.6 MB/s) 2024-09-12T00:15:24.128 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T00:15:24.144 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 226 kB/s) 2024-09-12T00:15:24.147 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T00:15:24.162 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-12T00:15:24.165 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T00:15:24.180 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-12T00:15:24.182 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T00:15:24.198 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 212 kB/s) 2024-09-12T00:15:24.200 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T00:15:24.215 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-12T00:15:24.217 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T00:15:24.234 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 167 kB/s) 2024-09-12T00:15:24.236 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T00:15:24.252 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 102 kB/s) 2024-09-12T00:15:24.254 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T00:15:24.269 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 201 kB/s) 2024-09-12T00:15:24.271 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T00:15:24.286 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T00:15:24.288 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T00:15:24.304 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 200 kB/s) 2024-09-12T00:15:24.306 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T00:15:24.321 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 64 kB/s) 2024-09-12T00:15:24.325 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T00:15:24.341 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 64 kB/s) 2024-09-12T00:15:24.345 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T00:15:24.359 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 191 kB/s) 2024-09-12T00:15:24.361 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T00:15:24.378 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 190 kB/s) 2024-09-12T00:15:24.380 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T00:15:24.397 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-12T00:15:24.399 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T00:15:24.416 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 191 kB/s) 2024-09-12T00:15:24.418 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T00:15:24.435 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 189 kB/s) 2024-09-12T00:15:24.452 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T00:15:24.535 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 39 MB/s) 2024-09-12T00:15:24.537 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T00:15:24.537 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T00:15:24.537 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T00:15:24.537 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T00:15:24.538 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T00:15:24.557 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/98 kB Progress (1): 16/98 kB Progress (1): 33/98 kB Progress (1): 49/98 kB Progress (1): 66/98 kB Progress (1): 82/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 4.5 MB/s) 2024-09-12T00:15:24.558 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T00:15:24.575 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 433 kB/s) 2024-09-12T00:15:24.575 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T00:15:24.586 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (1): 5.5/16 kB Progress (1): 6.9/16 kB Progress (1): 8.3/16 kB Progress (1): 9.7/16 kB Progress (1): 11/16 kB Progress (1): 12/16 kB Progress (1): 14/16 kB Progress (1): 15/16 kB Progress (1): 16 kB Progress (2): 16 kB | 1.4/35 kB Progress (2): 16 kB | 2.8/35 kB Progress (2): 16 kB | 4.1/35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 359 kB/s) 2024-09-12T00:15:24.587 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.5/35 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T00:15:24.595 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 5.5/35 kB | 1.4/71 kB Progress (2): 6.9/35 kB | 1.4/71 kB Progress (2): 6.9/35 kB | 2.8/71 kB Progress (2): 8.3/35 kB | 2.8/71 kB Progress (2): 8.3/35 kB | 4.1/71 kB Progress (2): 9.7/35 kB | 4.1/71 kB Progress (2): 9.7/35 kB | 5.5/71 kB Progress (2): 11/35 kB | 5.5/71 kB Progress (2): 11/35 kB | 6.9/71 kB Progress (2): 12/35 kB | 6.9/71 kB Progress (2): 12/35 kB | 8.3/71 kB Progress (2): 14/35 kB | 8.3/71 kB Progress (2): 14/35 kB | 9.7/71 kB Progress (2): 15/35 kB | 9.7/71 kB Progress (2): 15/35 kB | 11/71 kB Progress (3): 15/35 kB | 11/71 kB | 1.4/49 kB Progress (3): 15/35 kB | 12/71 kB | 1.4/49 kB Progress (3): 15/35 kB | 12/71 kB | 2.8/49 kB Progress (3): 15/35 kB | 14/71 kB | 2.8/49 kB Progress (3): 15/35 kB | 14/71 kB | 4.1/49 kB Progress (3): 15/35 kB | 15/71 kB | 4.1/49 kB Progress (3): 15/35 kB | 15/71 kB | 5.5/49 kB Progress (3): 17/35 kB | 15/71 kB | 5.5/49 kB Progress (3): 17/35 kB | 16/71 kB | 5.5/49 kB Progress (3): 18/35 kB | 16/71 kB | 5.5/49 kB Progress (3): 18/35 kB | 16/71 kB | 6.9/49 kB Progress (3): 19/35 kB | 16/71 kB | 6.9/49 kB Progress (3): 19/35 kB | 18/71 kB | 6.9/49 kB Progress (3): 19/35 kB | 18/71 kB | 8.3/49 kB Progress (3): 21/35 kB | 18/71 kB | 8.3/49 kB Progress (3): 21/35 kB | 19/71 kB | 8.3/49 kB Progress (3): 21/35 kB | 19/71 kB | 9.7/49 kB Progress (3): 21/35 kB | 21/71 kB | 9.7/49 kB Progress (3): 21/35 kB | 21/71 kB | 11/49 kB Progress (3): 22/35 kB | 21/71 kB | 11/49 kB Progress (3): 22/35 kB | 21/71 kB | 12/49 kB Progress (3): 23/35 kB | 21/71 kB | 12/49 kB Progress (3): 23/35 kB | 21/71 kB | 14/49 kB Progress (3): 25/35 kB | 21/71 kB | 14/49 kB Progress (3): 25/35 kB | 21/71 kB | 15/49 kB Progress (3): 26/35 kB | 21/71 kB | 15/49 kB Progress (3): 26/35 kB | 22/71 kB | 15/49 kB Progress (3): 26/35 kB | 22/71 kB | 17/49 kB Progress (3): 26/35 kB | 23/71 kB | 17/49 kB Progress (3): 26/35 kB | 23/71 kB | 18/49 kB Progress (3): 26/35 kB | 25/71 kB | 18/49 kB Progress (3): 26/35 kB | 25/71 kB | 19/49 kB Progress (3): 26/35 kB | 26/71 kB | 19/49 kB Progress (3): 26/35 kB | 26/71 kB | 21/49 kB Progress (3): 28/35 kB | 26/71 kB | 21/49 kB Progress (3): 29/35 kB | 26/71 kB | 21/49 kB Progress (3): 30/35 kB | 26/71 kB | 21/49 kB Progress (3): 30/35 kB | 27/71 kB | 21/49 kB Progress (3): 30/35 kB | 29/71 kB | 21/49 kB Progress (3): 30/35 kB | 29/71 kB | 22/49 kB Progress (3): 30/35 kB | 30/71 kB | 22/49 kB Progress (3): 30/35 kB | 30/71 kB | 23/49 kB Progress (3): 30/35 kB | 30/71 kB | 25/49 kB Progress (3): 30/35 kB | 30/71 kB | 26/49 kB Progress (3): 30/35 kB | 30/71 kB | 28/49 kB Progress (3): 30/35 kB | 30/71 kB | 29/49 kB Progress (3): 30/35 kB | 30/71 kB | 30/49 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 16/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 33/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 49/782 kB Progress (4): 30/35 kB | 30/71 kB | 30/49 kB | 66/782 kB Progress (4): 32/35 kB | 30/71 kB | 30/49 kB | 66/782 kB Progress (4): 32/35 kB | 30/71 kB | 30/49 kB | 82/782 kB Progress (4): 33/35 kB | 30/71 kB | 30/49 kB | 82/782 kB Progress (4): 34/35 kB | 30/71 kB | 30/49 kB | 82/782 kB Progress (4): 34/35 kB | 32/71 kB | 30/49 kB | 82/782 kB Progress (4): 35 kB | 32/71 kB | 30/49 kB | 82/782 kB Progress (4): 35 kB | 33/71 kB | 30/49 kB | 82/782 kB Progress (4): 35 kB | 33/71 kB | 30/49 kB | 98/782 kB Progress (4): 35 kB | 34/71 kB | 30/49 kB | 98/782 kB Progress (4): 35 kB | 36/71 kB | 30/49 kB | 98/782 kB Progress (4): 35 kB | 36/71 kB | 30/49 kB | 115/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 617 kB/s) 2024-09-12T00:15:24.596 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T00:15:24.598 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 37/71 kB | 30/49 kB | 115/782 kB Progress (3): 37/71 kB | 32/49 kB | 115/782 kB Progress (3): 38/71 kB | 32/49 kB | 115/782 kB Progress (3): 38/71 kB | 32/49 kB | 131/782 kB Progress (3): 40/71 kB | 32/49 kB | 131/782 kB Progress (3): 40/71 kB | 33/49 kB | 131/782 kB Progress (3): 41/71 kB | 33/49 kB | 131/782 kB Progress (3): 41/71 kB | 34/49 kB | 131/782 kB Progress (3): 43/71 kB | 34/49 kB | 131/782 kB Progress (3): 43/71 kB | 34/49 kB | 147/782 kB Progress (3): 44/71 kB | 34/49 kB | 147/782 kB Progress (3): 44/71 kB | 36/49 kB | 147/782 kB Progress (3): 45/71 kB | 36/49 kB | 147/782 kB Progress (3): 45/71 kB | 37/49 kB | 147/782 kB Progress (3): 45/71 kB | 37/49 kB | 164/782 kB Progress (3): 45/71 kB | 39/49 kB | 164/782 kB Progress (3): 45/71 kB | 40/49 kB | 164/782 kB Progress (3): 45/71 kB | 41/49 kB | 164/782 kB Progress (3): 45/71 kB | 41/49 kB | 180/782 kB Progress (3): 45/71 kB | 43/49 kB | 180/782 kB Progress (3): 45/71 kB | 44/49 kB | 180/782 kB Progress (3): 45/71 kB | 44/49 kB | 197/782 kB Progress (3): 47/71 kB | 44/49 kB | 197/782 kB Progress (3): 48/71 kB | 44/49 kB | 197/782 kB Progress (3): 49/71 kB | 44/49 kB | 197/782 kB Progress (3): 49/71 kB | 44/49 kB | 213/782 kB Progress (4): 49/71 kB | 44/49 kB | 213/782 kB | 1.4/11 kB Progress (4): 49/71 kB | 44/49 kB | 213/782 kB | 2.8/11 kB Progress (4): 49/71 kB | 44/49 kB | 213/782 kB | 4.1/11 kB Progress (4): 49/71 kB | 44/49 kB | 229/782 kB | 4.1/11 kB Progress (4): 49/71 kB | 44/49 kB | 229/782 kB | 5.5/11 kB Progress (4): 49/71 kB | 46/49 kB | 229/782 kB | 5.5/11 kB Progress (4): 49/71 kB | 46/49 kB | 229/782 kB | 6.9/11 kB Progress (4): 49/71 kB | 47/49 kB | 229/782 kB | 6.9/11 kB Progress (4): 49/71 kB | 47/49 kB | 229/782 kB | 8.3/11 kB Progress (4): 49/71 kB | 48/49 kB | 229/782 kB | 8.3/11 kB Progress (4): 49/71 kB | 48/49 kB | 246/782 kB | 8.3/11 kB Progress (4): 49/71 kB | 48/49 kB | 246/782 kB | 9.7/11 kB Progress (4): 49/71 kB | 49 kB | 246/782 kB | 9.7/11 kB Progress (4): 49/71 kB | 49 kB | 246/782 kB | 11/11 kB Progress (4): 49/71 kB | 49 kB | 246/782 kB | 11 kB Progress (4): 49/71 kB | 49 kB | 262/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 189 kB/s) 2024-09-12T00:15:24.598 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 49/71 kB | 49 kB | 278/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 807 kB/s) 2024-09-12T00:15:24.598 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T00:15:24.598 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T00:15:24.606 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 49/71 kB | 295/782 kB Progress (2): 49/71 kB | 311/782 kB Progress (2): 49/71 kB | 328/782 kB Progress (2): 49/71 kB | 344/782 kB Progress (2): 49/71 kB | 360/782 kB Progress (2): 49/71 kB | 377/782 kB Progress (2): 49/71 kB | 393/782 kB Progress (2): 49/71 kB | 410/782 kB Progress (2): 49/71 kB | 426/782 kB Progress (2): 49/71 kB | 442/782 kB Progress (2): 49/71 kB | 459/782 kB Progress (2): 49/71 kB | 475/782 kB Progress (2): 49/71 kB | 491/782 kB Progress (2): 49/71 kB | 508/782 kB Progress (2): 49/71 kB | 524/782 kB Progress (2): 49/71 kB | 541/782 kB Progress (2): 49/71 kB | 557/782 kB Progress (2): 66/71 kB | 557/782 kB Progress (2): 71 kB | 557/782 kB Progress (2): 71 kB | 573/782 kB Progress (2): 71 kB | 590/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.0 MB/s) 2024-09-12T00:15:24.606 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 606/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T00:15:24.610 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 623/782 kB Progress (1): 639/782 kB Progress (1): 655/782 kB Progress (1): 672/782 kB Progress (1): 688/782 kB Progress (1): 704/782 kB Progress (1): 721/782 kB Progress (1): 737/782 kB Progress (1): 754/782 kB Progress (1): 770/782 kB Progress (1): 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 11 MB/s) 2024-09-12T00:15:24.611 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T00:15:24.620 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/81 kB Progress (1): 33/81 kB Progress (2): 33/81 kB | 1.4/30 kB Progress (2): 33/81 kB | 2.8/30 kB Progress (2): 33/81 kB | 4.1/30 kB Progress (2): 33/81 kB | 5.5/30 kB Progress (2): 33/81 kB | 6.9/30 kB Progress (2): 33/81 kB | 8.3/30 kB Progress (2): 33/81 kB | 9.7/30 kB Progress (2): 33/81 kB | 11/30 kB Progress (2): 33/81 kB | 12/30 kB Progress (2): 33/81 kB | 14/30 kB Progress (2): 33/81 kB | 15/30 kB Progress (2): 33/81 kB | 16/30 kB Progress (3): 33/81 kB | 16/30 kB | 16/205 kB Progress (3): 49/81 kB | 16/30 kB | 16/205 kB Progress (3): 49/81 kB | 17/30 kB | 16/205 kB Progress (3): 49/81 kB | 19/30 kB | 16/205 kB Progress (3): 49/81 kB | 20/30 kB | 16/205 kB Progress (3): 49/81 kB | 21/30 kB | 16/205 kB Progress (3): 49/81 kB | 23/30 kB | 16/205 kB Progress (3): 49/81 kB | 24/30 kB | 16/205 kB Progress (3): 49/81 kB | 25/30 kB | 16/205 kB Progress (3): 49/81 kB | 25/30 kB | 33/205 kB Progress (3): 49/81 kB | 27/30 kB | 33/205 kB Progress (3): 49/81 kB | 28/30 kB | 33/205 kB Progress (3): 49/81 kB | 30/30 kB | 33/205 kB Progress (3): 49/81 kB | 30 kB | 33/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 368 kB/s) 2024-09-12T00:15:24.620 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T00:15:24.626 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 49/81 kB | 33/205 kB | 16/798 kB Progress (3): 49/81 kB | 33/205 kB | 33/798 kB Progress (3): 49/81 kB | 33/205 kB | 49/798 kB Progress (4): 49/81 kB | 33/205 kB | 49/798 kB | 13 kB Progress (4): 66/81 kB | 33/205 kB | 49/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 152 kB/s) 2024-09-12T00:15:24.626 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T00:15:24.627 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 66/81 kB | 33/205 kB | 66/798 kB Progress (3): 80/81 kB | 33/205 kB | 66/798 kB Progress (3): 81 kB | 33/205 kB | 66/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 923 kB/s) 2024-09-12T00:15:24.627 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T00:15:24.642 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 49/205 kB | 66/798 kB Progress (2): 66/205 kB | 66/798 kB Progress (2): 80/205 kB | 66/798 kB Progress (2): 97/205 kB | 66/798 kB Progress (2): 113/205 kB | 66/798 kB Progress (2): 113/205 kB | 82/798 kB Progress (2): 129/205 kB | 82/798 kB Progress (2): 129/205 kB | 98/798 kB Progress (2): 146/205 kB | 98/798 kB Progress (2): 146/205 kB | 115/798 kB Progress (2): 146/205 kB | 131/798 kB Progress (3): 146/205 kB | 131/798 kB | 16/182 kB Progress (3): 146/205 kB | 147/798 kB | 16/182 kB Progress (3): 146/205 kB | 164/798 kB | 16/182 kB Progress (3): 146/205 kB | 164/798 kB | 33/182 kB Progress (3): 146/205 kB | 180/798 kB | 33/182 kB Progress (3): 146/205 kB | 180/798 kB | 49/182 kB Progress (3): 162/205 kB | 180/798 kB | 49/182 kB Progress (3): 179/205 kB | 180/798 kB | 49/182 kB Progress (3): 179/205 kB | 180/798 kB | 62/182 kB Progress (3): 195/205 kB | 180/798 kB | 62/182 kB Progress (4): 195/205 kB | 180/798 kB | 62/182 kB | 16/151 kB Progress (4): 205 kB | 180/798 kB | 62/182 kB | 16/151 kB Progress (4): 205 kB | 180/798 kB | 62/182 kB | 33/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.0 MB/s) 2024-09-12T00:15:24.642 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T00:15:24.645 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 180/798 kB | 62/182 kB | 49/151 kB Progress (3): 180/798 kB | 62/182 kB | 62/151 kB Progress (3): 180/798 kB | 62/182 kB | 79/151 kB Progress (4): 180/798 kB | 62/182 kB | 79/151 kB | 16/27 kB Progress (4): 197/798 kB | 62/182 kB | 79/151 kB | 16/27 kB Progress (4): 197/798 kB | 62/182 kB | 79/151 kB | 27 kB Progress (4): 213/798 kB | 62/182 kB | 79/151 kB | 27 kB Progress (4): 213/798 kB | 62/182 kB | 95/151 kB | 27 kB Progress (4): 229/798 kB | 62/182 kB | 95/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 257 kB/s) 2024-09-12T00:15:24.645 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T00:15:24.653 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 246/798 kB | 62/182 kB | 95/151 kB Progress (3): 246/798 kB | 62/182 kB | 111/151 kB Progress (3): 262/798 kB | 62/182 kB | 111/151 kB Progress (3): 262/798 kB | 62/182 kB | 128/151 kB Progress (3): 279/798 kB | 62/182 kB | 128/151 kB Progress (3): 279/798 kB | 62/182 kB | 144/151 kB Progress (3): 295/798 kB | 62/182 kB | 144/151 kB Progress (3): 311/798 kB | 62/182 kB | 144/151 kB Progress (3): 311/798 kB | 78/182 kB | 144/151 kB Progress (3): 328/798 kB | 78/182 kB | 144/151 kB Progress (3): 344/798 kB | 78/182 kB | 144/151 kB Progress (3): 360/798 kB | 78/182 kB | 144/151 kB Progress (3): 360/798 kB | 94/182 kB | 144/151 kB Progress (3): 377/798 kB | 94/182 kB | 144/151 kB Progress (3): 393/798 kB | 94/182 kB | 144/151 kB Progress (3): 393/798 kB | 111/182 kB | 144/151 kB Progress (3): 410/798 kB | 111/182 kB | 144/151 kB Progress (3): 426/798 kB | 111/182 kB | 144/151 kB Progress (3): 442/798 kB | 111/182 kB | 144/151 kB Progress (3): 442/798 kB | 127/182 kB | 144/151 kB Progress (3): 442/798 kB | 143/182 kB | 144/151 kB Progress (3): 442/798 kB | 143/182 kB | 151 kB Progress (3): 442/798 kB | 160/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.3 MB/s) 2024-09-12T00:15:24.654 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T00:15:24.654 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 442/798 kB | 176/182 kB Progress (2): 442/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.6 MB/s) 2024-09-12T00:15:24.654 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T00:15:24.658 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 459/798 kB Progress (1): 475/798 kB Progress (1): 492/798 kB Progress (1): 508/798 kB Progress (2): 508/798 kB | 16/30 kB Progress (2): 508/798 kB | 30 kB Progress (2): 524/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 253 kB/s) 2024-09-12T00:15:24.658 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T00:15:24.665 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 541/798 kB Progress (1): 557/798 kB Progress (1): 573/798 kB Progress (1): 590/798 kB Progress (1): 606/798 kB Progress (1): 623/798 kB Progress (1): 639/798 kB Progress (1): 655/798 kB Progress (1): 672/798 kB Progress (1): 688/798 kB Progress (1): 705/798 kB Progress (1): 721/798 kB Progress (1): 737/798 kB Progress (1): 754/798 kB Progress (1): 770/798 kB Progress (1): 786/798 kB Progress (1): 798 kB Progress (2): 798 kB | 16/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.3 MB/s) 2024-09-12T00:15:24.665 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T00:15:24.670 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 33/385 kB Progress (1): 49/385 kB Progress (1): 66/385 kB Progress (1): 82/385 kB Progress (1): 98/385 kB Progress (1): 114/385 kB Progress (1): 131/385 kB Progress (1): 147/385 kB Progress (1): 164/385 kB Progress (1): 180/385 kB Progress (1): 196/385 kB Progress (1): 213/385 kB Progress (1): 229/385 kB Progress (1): 245/385 kB Progress (1): 262/385 kB Progress (1): 278/385 kB Progress (1): 295/385 kB Progress (2): 295/385 kB | 13 kB Progress (2): 311/385 kB | 13 kB Progress (2): 327/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 101 kB/s) 2024-09-12T00:15:24.670 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 344/385 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T00:15:24.670 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 344/385 kB | 16/75 kB Progress (2): 360/385 kB | 16/75 kB Progress (2): 376/385 kB | 16/75 kB Progress (2): 376/385 kB | 32/75 kB Progress (2): 385 kB | 32/75 kB Progress (2): 385 kB | 49/75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.9 MB/s) 2024-09-12T00:15:24.670 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T00:15:24.671 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 61/75 kB Progress (1): 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 565 kB/s) 2024-09-12T00:15:24.671 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T00:15:24.688 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/780 kB Progress (1): 33/780 kB Progress (1): 37/780 kB Progress (1): 53/780 kB Progress (1): 69/780 kB Progress (1): 86/780 kB Progress (1): 102/780 kB Progress (1): 118/780 kB Progress (1): 135/780 kB Progress (1): 151/780 kB Progress (1): 168/780 kB Progress (1): 184/780 kB Progress (1): 200/780 kB Progress (1): 217/780 kB Progress (2): 217/780 kB | 16/329 kB Progress (2): 233/780 kB | 16/329 kB Progress (2): 233/780 kB | 32/329 kB Progress (2): 250/780 kB | 32/329 kB Progress (2): 250/780 kB | 49/329 kB Progress (2): 266/780 kB | 49/329 kB Progress (2): 266/780 kB | 65/329 kB Progress (2): 266/780 kB | 81/329 kB Progress (2): 266/780 kB | 98/329 kB Progress (2): 266/780 kB | 114/329 kB Progress (2): 266/780 kB | 130/329 kB Progress (2): 266/780 kB | 147/329 kB Progress (2): 266/780 kB | 163/329 kB Progress (2): 266/780 kB | 180/329 kB Progress (2): 266/780 kB | 196/329 kB Progress (3): 266/780 kB | 196/329 kB | 16/501 kB Progress (3): 266/780 kB | 212/329 kB | 16/501 kB Progress (3): 266/780 kB | 212/329 kB | 32/501 kB Progress (3): 266/780 kB | 229/329 kB | 32/501 kB Progress (3): 266/780 kB | 229/329 kB | 49/501 kB Progress (3): 266/780 kB | 245/329 kB | 49/501 kB Progress (3): 266/780 kB | 245/329 kB | 65/501 kB Progress (4): 266/780 kB | 245/329 kB | 65/501 kB | 16/41 kB Progress (4): 266/780 kB | 262/329 kB | 65/501 kB | 16/41 kB Progress (5): 266/780 kB | 262/329 kB | 65/501 kB | 16/41 kB | 16/354 kB Progress (5): 266/780 kB | 262/329 kB | 81/501 kB | 16/41 kB | 16/354 kB Progress (5): 266/780 kB | 262/329 kB | 81/501 kB | 33/41 kB | 16/354 kB Progress (5): 266/780 kB | 278/329 kB | 81/501 kB | 33/41 kB | 16/354 kB Progress (5): 266/780 kB | 278/329 kB | 81/501 kB | 33/41 kB | 33/354 kB Progress (5): 266/780 kB | 278/329 kB | 81/501 kB | 41 kB | 33/354 kB Progress (5): 266/780 kB | 278/329 kB | 98/501 kB | 41 kB | 33/354 kB Progress (5): 266/780 kB | 294/329 kB | 98/501 kB | 41 kB | 33/354 kB Progress (5): 266/780 kB | 294/329 kB | 98/501 kB | 41 kB | 49/354 kB Progress (5): 266/780 kB | 294/329 kB | 114/501 kB | 41 kB | 49/354 kB Progress (5): 266/780 kB | 311/329 kB | 114/501 kB | 41 kB | 49/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 280 kB/s) 2024-09-12T00:15:24.688 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (4): 266/780 kB | 311/329 kB | 114/501 kB | 66/354 kB Progress (4): 266/780 kB | 311/329 kB | 130/501 kB | 66/354 kB Progress (4): 266/780 kB | 327/329 kB | 130/501 kB | 66/354 kB Progress (4): 266/780 kB | 329 kB | 130/501 kB | 66/354 kB Progress (4): 266/780 kB | 329 kB | 130/501 kB | 82/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T00:15:24.688 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (4): 282/780 kB | 329 kB | 130/501 kB | 82/354 kB Progress (4): 292/780 kB | 329 kB | 130/501 kB | 82/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.2 MB/s) 2024-09-12T00:15:24.688 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T00:15:24.710 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 292/780 kB | 147/501 kB | 82/354 kB Progress (3): 309/780 kB | 147/501 kB | 82/354 kB Progress (3): 309/780 kB | 147/501 kB | 98/354 kB Progress (3): 309/780 kB | 163/501 kB | 98/354 kB Progress (3): 325/780 kB | 163/501 kB | 98/354 kB Progress (3): 325/780 kB | 180/501 kB | 98/354 kB Progress (3): 325/780 kB | 180/501 kB | 115/354 kB Progress (3): 342/780 kB | 180/501 kB | 115/354 kB Progress (4): 342/780 kB | 180/501 kB | 115/354 kB | 6.4 kB Progress (4): 342/780 kB | 196/501 kB | 115/354 kB | 6.4 kB Progress (4): 342/780 kB | 196/501 kB | 131/354 kB | 6.4 kB Progress (4): 358/780 kB | 196/501 kB | 131/354 kB | 6.4 kB Progress (4): 358/780 kB | 212/501 kB | 131/354 kB | 6.4 kB Progress (4): 358/780 kB | 212/501 kB | 147/354 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 37 kB/s) 2024-09-12T00:15:24.710 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T00:15:24.716 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 374/780 kB | 212/501 kB | 147/354 kB Progress (3): 374/780 kB | 229/501 kB | 147/354 kB Progress (3): 374/780 kB | 229/501 kB | 164/354 kB Progress (3): 391/780 kB | 229/501 kB | 164/354 kB Progress (3): 391/780 kB | 245/501 kB | 164/354 kB Progress (3): 391/780 kB | 245/501 kB | 180/354 kB Progress (3): 407/780 kB | 245/501 kB | 180/354 kB Progress (3): 407/780 kB | 262/501 kB | 180/354 kB Progress (3): 407/780 kB | 262/501 kB | 197/354 kB Progress (3): 423/780 kB | 262/501 kB | 197/354 kB Progress (3): 423/780 kB | 278/501 kB | 197/354 kB Progress (3): 423/780 kB | 278/501 kB | 213/354 kB Progress (3): 440/780 kB | 278/501 kB | 213/354 kB Progress (3): 440/780 kB | 294/501 kB | 213/354 kB Progress (3): 440/780 kB | 294/501 kB | 229/354 kB Progress (3): 456/780 kB | 294/501 kB | 229/354 kB Progress (3): 456/780 kB | 311/501 kB | 229/354 kB Progress (3): 456/780 kB | 311/501 kB | 246/354 kB Progress (3): 473/780 kB | 311/501 kB | 246/354 kB Progress (3): 473/780 kB | 311/501 kB | 256/354 kB Progress (3): 473/780 kB | 327/501 kB | 256/354 kB Progress (3): 489/780 kB | 327/501 kB | 256/354 kB Progress (3): 489/780 kB | 327/501 kB | 272/354 kB Progress (3): 489/780 kB | 343/501 kB | 272/354 kB Progress (3): 505/780 kB | 343/501 kB | 272/354 kB Progress (3): 505/780 kB | 343/501 kB | 289/354 kB Progress (3): 505/780 kB | 360/501 kB | 289/354 kB Progress (3): 522/780 kB | 360/501 kB | 289/354 kB Progress (3): 522/780 kB | 360/501 kB | 305/354 kB Progress (3): 522/780 kB | 376/501 kB | 305/354 kB Progress (3): 538/780 kB | 376/501 kB | 305/354 kB Progress (3): 538/780 kB | 393/501 kB | 305/354 kB Progress (3): 538/780 kB | 393/501 kB | 321/354 kB Progress (3): 538/780 kB | 402/501 kB | 321/354 kB Progress (3): 554/780 kB | 402/501 kB | 321/354 kB Progress (3): 554/780 kB | 402/501 kB | 338/354 kB Progress (3): 571/780 kB | 402/501 kB | 338/354 kB Progress (3): 571/780 kB | 418/501 kB | 338/354 kB Progress (3): 587/780 kB | 418/501 kB | 338/354 kB Progress (3): 587/780 kB | 435/501 kB | 338/354 kB Progress (3): 587/780 kB | 435/501 kB | 354 kB Progress (3): 604/780 kB | 435/501 kB | 354 kB Progress (3): 604/780 kB | 451/501 kB | 354 kB Progress (3): 604/780 kB | 468/501 kB | 354 kB Progress (3): 620/780 kB | 468/501 kB | 354 kB Progress (3): 620/780 kB | 484/501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.0 MB/s) 2024-09-12T00:15:24.716 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T00:15:24.716 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 636/780 kB | 484/501 kB Progress (2): 636/780 kB | 500/501 kB Progress (2): 636/780 kB | 501 kB Progress (2): 653/780 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.8 MB/s) 2024-09-12T00:15:24.716 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T00:15:24.720 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 669/780 kB Progress (1): 686/780 kB Progress (1): 702/780 kB Progress (1): 718/780 kB Progress (1): 735/780 kB Progress (1): 751/780 kB Progress (1): 767/780 kB Progress (1): 780 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.3 MB/s) 2024-09-12T00:15:24.720 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T00:15:24.732 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/586 kB Progress (1): 33/586 kB Progress (1): 49/586 kB Progress (1): 62/586 kB Progress (1): 78/586 kB Progress (1): 95/586 kB Progress (1): 111/586 kB Progress (1): 127/586 kB Progress (1): 144/586 kB Progress (2): 144/586 kB | 15/211 kB Progress (2): 144/586 kB | 31/211 kB Progress (2): 160/586 kB | 31/211 kB Progress (2): 160/586 kB | 48/211 kB Progress (2): 176/586 kB | 48/211 kB Progress (2): 176/586 kB | 64/211 kB Progress (2): 176/586 kB | 77/211 kB Progress (2): 193/586 kB | 77/211 kB Progress (2): 193/586 kB | 94/211 kB Progress (2): 209/586 kB | 94/211 kB Progress (2): 209/586 kB | 110/211 kB Progress (2): 209/586 kB | 127/211 kB Progress (2): 226/586 kB | 127/211 kB Progress (2): 226/586 kB | 143/211 kB Progress (2): 226/586 kB | 159/211 kB Progress (2): 226/586 kB | 176/211 kB Progress (2): 226/586 kB | 192/211 kB Progress (2): 226/586 kB | 208/211 kB Progress (2): 226/586 kB | 211 kB Progress (3): 226/586 kB | 211 kB | 16/106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.1 MB/s) 2024-09-12T00:15:24.732 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 226/586 kB | 32/106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T00:15:24.733 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 226/586 kB | 49/106 kB Progress (2): 226/586 kB | 65/106 kB Progress (2): 226/586 kB | 81/106 kB Progress (2): 226/586 kB | 98/106 kB Progress (2): 226/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 551 kB/s) 2024-09-12T00:15:24.733 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T00:15:24.734 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 226/586 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 35 kB/s) 2024-09-12T00:15:24.734 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T00:15:24.736 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 226/586 kB | 14 kB Progress (2): 242/586 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 73 kB/s) 2024-09-12T00:15:24.736 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:15:24.744 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 258/586 kB Progress (1): 275/586 kB Progress (1): 291/586 kB Progress (1): 308/586 kB Progress (1): 324/586 kB Progress (1): 340/586 kB Progress (1): 357/586 kB Progress (1): 373/586 kB Progress (1): 389/586 kB Progress (1): 406/586 kB Progress (1): 422/586 kB Progress (1): 439/586 kB Progress (1): 455/586 kB Progress (1): 471/586 kB Progress (1): 488/586 kB Progress (1): 504/586 kB Progress (1): 521/586 kB Progress (1): 537/586 kB Progress (1): 553/586 kB Progress (1): 570/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.9 MB/s) 2024-09-12T00:15:24.744 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T00:15:24.752 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (2): 49/245 kB | 16/205 kB Progress (2): 66/245 kB | 16/205 kB Progress (2): 66/245 kB | 32/205 kB Progress (2): 82/245 kB | 32/205 kB Progress (2): 82/245 kB | 49/205 kB Progress (2): 98/245 kB | 49/205 kB Progress (2): 98/245 kB | 65/205 kB Progress (2): 98/245 kB | 81/205 kB Progress (2): 115/245 kB | 81/205 kB Progress (2): 115/245 kB | 98/205 kB Progress (2): 131/245 kB | 98/205 kB Progress (2): 131/245 kB | 114/205 kB Progress (3): 131/245 kB | 114/205 kB | 16/16 kB Progress (3): 147/245 kB | 114/205 kB | 16/16 kB Progress (3): 147/245 kB | 114/205 kB | 16 kB Progress (3): 147/245 kB | 130/205 kB | 16 kB Progress (3): 164/245 kB | 130/205 kB | 16 kB Progress (3): 164/245 kB | 147/205 kB | 16 kB Progress (4): 164/245 kB | 147/205 kB | 16 kB | 15 kB Progress (4): 164/245 kB | 163/205 kB | 16 kB | 15 kB Progress (4): 180/245 kB | 163/205 kB | 16 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 78 kB/s) 2024-09-12T00:15:24.752 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T00:15:24.752 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 180/245 kB | 180/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 72 kB/s) 2024-09-12T00:15:24.752 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 194/245 kB | 180/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T00:15:24.752 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 194/245 kB | 196/205 kB Progress (2): 194/245 kB | 205 kB Progress (2): 210/245 kB | 205 kB Progress (2): 226/245 kB | 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 966 kB/s) 2024-09-12T00:15:24.753 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T00:15:24.753 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 243/245 kB Progress (1): 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-12T00:15:24.753 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T00:15:24.760 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 29 kB/s) 2024-09-12T00:15:24.766 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Progress (2): 17 kB | 16/24 kB Progress (2): 17 kB | 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 76 kB/s) 2024-09-12T00:15:24.767 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 106 kB/s) 2024-09-12T00:15:24.768 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15/23 kB Progress (1): 23 kB Progress (2): 23 kB | 16/184 kB Progress (2): 23 kB | 33/184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 99 kB/s) 2024-09-12T00:15:24.771 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 796 kB/s) 2024-09-12T00:15:24.789 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:24.790 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T00:15:24.796 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T00:15:24.810 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-12T00:15:24.812 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T00:15:24.828 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-12T00:15:24.829 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T00:15:24.846 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/43 kB Progress (1): 32/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.7 MB/s) 2024-09-12T00:15:24.850 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T00:15:24.866 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 891 kB/s) 2024-09-12T00:15:24.870 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T00:15:24.888 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 98/153 kB Progress (1): 114/153 kB Progress (1): 130/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-12T00:15:24.888 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T00:15:24.908 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/215 kB Progress (1): 32/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 81/215 kB Progress (1): 98/215 kB Progress (1): 114/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 163/215 kB Progress (1): 180/215 kB Progress (1): 196/215 kB Progress (1): 212/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 11 MB/s) 2024-09-12T00:15:24.953 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:24.953 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:15:24.957 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T00:15:24.972 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 177 kB/s) 2024-09-12T00:15:24.973 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T00:15:24.988 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-12T00:15:24.991 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T00:15:25.009 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 461 kB/s) 2024-09-12T00:15:25.011 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T00:15:25.026 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.7 MB/s) 2024-09-12T00:15:25.029 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T00:15:25.043 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-12T00:15:25.045 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T00:15:25.062 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 201 kB/s) 2024-09-12T00:15:25.065 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T00:15:25.080 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 38 kB/s) 2024-09-12T00:15:25.082 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T00:15:25.095 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-12T00:15:25.097 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T00:15:25.111 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-12T00:15:25.114 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T00:15:25.129 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 214 kB/s) 2024-09-12T00:15:25.131 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T00:15:25.146 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-12T00:15:25.148 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T00:15:25.168 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 398 kB/s) 2024-09-12T00:15:25.172 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T00:15:25.189 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 501 kB/s) 2024-09-12T00:15:25.192 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T00:15:25.207 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.3 MB/s) 2024-09-12T00:15:25.211 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T00:15:25.227 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 319 kB/s) 2024-09-12T00:15:25.230 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T00:15:25.245 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.9 MB/s) 2024-09-12T00:15:25.250 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T00:15:25.266 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 319 kB/s) 2024-09-12T00:15:25.272 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T00:15:25.288 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15/85 kB Progress (1): 31/85 kB Progress (1): 48/85 kB Progress (1): 64/85 kB Progress (1): 81/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.0 MB/s) 2024-09-12T00:15:25.289 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T00:15:25.289 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T00:15:25.289 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T00:15:25.289 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T00:15:25.290 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T00:15:25.304 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/41 kB Progress (2): 16/41 kB | 2.5 kB Progress (2): 33/41 kB | 2.5 kB Progress (2): 41 kB | 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 178 kB/s) 2024-09-12T00:15:25.304 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 41 kB | 16/55 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T00:15:25.304 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.7 MB/s) 2024-09-12T00:15:25.304 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T00:15:25.305 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 33/55 kB Progress (1): 49/55 kB Progress (1): 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.7 MB/s) 2024-09-12T00:15:25.308 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/269 kB Progress (1): 32/269 kB Progress (1): 49/269 kB Progress (1): 65/269 kB Progress (1): 81/269 kB Progress (1): 98/269 kB Progress (1): 114/269 kB Progress (1): 130/269 kB Progress (1): 147/269 kB Progress (1): 163/269 kB Progress (1): 180/269 kB Progress (2): 180/269 kB | 8.5 kB Progress (2): 196/269 kB | 8.5 kB Progress (2): 212/269 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 446 kB/s) 2024-09-12T00:15:25.309 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 229/269 kB Progress (1): 245/269 kB Progress (1): 262/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 13 MB/s) 2024-09-12T00:15:25.325 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/587 kB Progress (2): 16/587 kB | 16/327 kB Progress (2): 33/587 kB | 16/327 kB Progress (2): 33/587 kB | 33/327 kB Progress (2): 49/587 kB | 33/327 kB Progress (2): 49/587 kB | 49/327 kB Progress (2): 49/587 kB | 66/327 kB Progress (2): 66/587 kB | 66/327 kB Progress (2): 66/587 kB | 81/327 kB Progress (2): 82/587 kB | 81/327 kB Progress (2): 82/587 kB | 98/327 kB Progress (2): 98/587 kB | 98/327 kB Progress (2): 98/587 kB | 114/327 kB Progress (2): 115/587 kB | 114/327 kB Progress (2): 115/587 kB | 130/327 kB Progress (2): 131/587 kB | 130/327 kB Progress (2): 131/587 kB | 147/327 kB Progress (2): 147/587 kB | 147/327 kB Progress (2): 147/587 kB | 163/327 kB Progress (2): 164/587 kB | 163/327 kB Progress (2): 164/587 kB | 179/327 kB Progress (2): 180/587 kB | 179/327 kB Progress (2): 180/587 kB | 196/327 kB Progress (2): 197/587 kB | 196/327 kB Progress (2): 197/587 kB | 212/327 kB Progress (2): 213/587 kB | 212/327 kB Progress (2): 213/587 kB | 229/327 kB Progress (2): 229/587 kB | 229/327 kB Progress (2): 229/587 kB | 245/327 kB Progress (2): 246/587 kB | 245/327 kB Progress (2): 246/587 kB | 261/327 kB Progress (2): 256/587 kB | 261/327 kB Progress (2): 256/587 kB | 278/327 kB Progress (2): 272/587 kB | 278/327 kB Progress (2): 272/587 kB | 294/327 kB Progress (2): 289/587 kB | 294/327 kB Progress (2): 289/587 kB | 311/327 kB Progress (2): 305/587 kB | 311/327 kB Progress (2): 305/587 kB | 327/327 kB Progress (2): 305/587 kB | 327 kB Progress (2): 321/587 kB | 327 kB Progress (2): 338/587 kB | 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.3 MB/s) 2024-09-12T00:15:25.328 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 354/587 kB Progress (1): 370/587 kB Progress (1): 387/587 kB Progress (1): 403/587 kB Progress (1): 420/587 kB Progress (1): 436/587 kB Progress (1): 452/587 kB Progress (1): 469/587 kB Progress (1): 485/587 kB Progress (1): 502/587 kB Progress (1): 518/587 kB Progress (1): 534/587 kB Progress (1): 551/587 kB Progress (1): 567/587 kB Progress (1): 583/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 15 MB/s) 2024-09-12T00:15:25.360 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:15:25.360 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:25.360 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:15:25.364 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T00:15:25.378 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 339 kB/s) 2024-09-12T00:15:25.379 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T00:15:25.394 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-12T00:15:25.395 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T00:15:25.411 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.0 MB/s) 2024-09-12T00:15:25.413 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T00:15:25.428 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-12T00:15:25.431 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T00:15:25.447 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 51 kB/s) 2024-09-12T00:15:25.449 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T00:15:25.463 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 283 kB/s) 2024-09-12T00:15:25.466 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T00:15:25.482 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.1 MB/s) 2024-09-12T00:15:25.485 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T00:15:25.500 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 311 kB/s) 2024-09-12T00:15:25.502 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T00:15:25.518 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-12T00:15:25.520 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T00:15:25.536 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-12T00:15:25.538 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T00:15:25.553 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-12T00:15:25.555 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T00:15:25.573 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-12T00:15:25.573 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T00:15:25.587 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-12T00:15:25.589 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T00:15:25.606 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 62 kB/s) 2024-09-12T00:15:25.608 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T00:15:25.623 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-09-12T00:15:25.625 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T00:15:25.640 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 167 kB/s) 2024-09-12T00:15:25.643 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T00:15:25.658 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 352 kB/s) 2024-09-12T00:15:25.661 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T00:15:25.676 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-12T00:15:25.678 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T00:15:25.699 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 38 kB/s) 2024-09-12T00:15:25.700 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T00:15:25.715 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-12T00:15:25.716 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T00:15:25.733 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.5 MB/s) 2024-09-12T00:15:25.736 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T00:15:25.753 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 71 kB/s) 2024-09-12T00:15:25.754 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T00:15:25.770 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-12T00:15:25.775 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T00:15:25.790 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 903 kB/s) 2024-09-12T00:15:25.790 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T00:15:25.790 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T00:15:25.791 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T00:15:25.791 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T00:15:25.791 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T00:15:25.808 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/27 kB Progress (3): 4.2 kB | 16/27 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 281 kB/s) 2024-09-12T00:15:25.808 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 27 kB | 16/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T00:15:25.809 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 27 kB | 33/334 kB Progress (3): 27 kB | 33/334 kB | 16/122 kB Progress (3): 27 kB | 49/334 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.8 MB/s) 2024-09-12T00:15:25.809 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 49/334 kB | 16/122 kB | 16/55 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T00:15:25.809 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 66/334 kB | 16/122 kB | 16/55 kB Progress (3): 66/334 kB | 32/122 kB | 16/55 kB Progress (3): 66/334 kB | 32/122 kB | 33/55 kB Progress (3): 82/334 kB | 32/122 kB | 33/55 kB Progress (3): 82/334 kB | 49/122 kB | 33/55 kB Progress (3): 82/334 kB | 49/122 kB | 49/55 kB Progress (3): 98/334 kB | 49/122 kB | 49/55 kB Progress (3): 98/334 kB | 49/122 kB | 55 kB Progress (3): 98/334 kB | 65/122 kB | 55 kB Progress (3): 114/334 kB | 65/122 kB | 55 kB Progress (3): 114/334 kB | 81/122 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.2 MB/s) 2024-09-12T00:15:25.809 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 131/334 kB | 81/122 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T00:15:25.809 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 131/334 kB | 98/122 kB Progress (2): 147/334 kB | 98/122 kB Progress (2): 147/334 kB | 114/122 kB Progress (2): 147/334 kB | 122 kB Progress (2): 164/334 kB | 122 kB Progress (2): 180/334 kB | 122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.8 MB/s) 2024-09-12T00:15:25.810 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 196/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 295/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 17 MB/s) 2024-09-12T00:15:25.820 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 48/267 kB Progress (1): 64/267 kB Progress (2): 64/267 kB | 4.7 kB Progress (2): 81/267 kB | 4.7 kB Progress (2): 97/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 161 kB/s) 2024-09-12T00:15:25.823 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 113/267 kB Progress (1): 130/267 kB Progress (1): 146/267 kB Progress (1): 162/267 kB Progress (1): 179/267 kB Progress (1): 195/267 kB Progress (1): 212/267 kB Progress (1): 228/267 kB Progress (1): 244/267 kB Progress (1): 261/267 kB Progress (2): 261/267 kB | 16/23 kB Progress (2): 267 kB | 16/23 kB Progress (2): 267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.4 MB/s) 2024-09-12T00:15:25.823 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 712 kB/s) 2024-09-12T00:15:25.875 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T00:15:25.876 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T00:15:26.478 INFO:tasks.workunit.client.0.smithi067.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:15:26.478 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:26.478 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:15:26.481 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:15:26.481 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:26.481 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:15:26.485 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T00:15:26.485 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T00:15:26.637 INFO:tasks.workunit.client.0.smithi067.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:15:26.637 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:26.637 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:15:26.641 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T00:15:26.658 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 367 kB/s) 2024-09-12T00:15:26.662 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T00:15:26.677 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-12T00:15:26.680 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T00:15:26.695 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-12T00:15:26.698 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T00:15:26.714 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 254 kB/s) 2024-09-12T00:15:26.718 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T00:15:26.737 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 174 kB/s) 2024-09-12T00:15:26.741 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T00:15:26.761 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 223 kB/s) 2024-09-12T00:15:26.765 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T00:15:26.784 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 93 kB/s) 2024-09-12T00:15:26.788 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T00:15:26.803 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 137 kB/s) 2024-09-12T00:15:26.805 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T00:15:26.822 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.9 MB/s) 2024-09-12T00:15:26.824 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T00:15:26.840 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 118 kB/s) 2024-09-12T00:15:26.843 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T00:15:26.860 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 341 kB/s) 2024-09-12T00:15:26.864 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T00:15:26.881 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 130 kB/s) 2024-09-12T00:15:26.883 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T00:15:26.900 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.4 MB/s) 2024-09-12T00:15:26.902 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T00:15:26.918 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15/37 kB Progress (1): 31/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.2 MB/s) 2024-09-12T00:15:26.920 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T00:15:26.935 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.0 MB/s) 2024-09-12T00:15:26.938 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T00:15:26.955 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 541 kB/s) 2024-09-12T00:15:26.957 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T00:15:26.972 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.7 MB/s) 2024-09-12T00:15:26.975 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T00:15:26.990 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 538 kB/s) 2024-09-12T00:15:26.994 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T00:15:27.009 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 136 kB/s) 2024-09-12T00:15:27.013 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T00:15:27.028 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 162 kB/s) 2024-09-12T00:15:27.032 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T00:15:27.047 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 103 kB/s) 2024-09-12T00:15:27.048 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T00:15:27.064 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 204 kB/s) 2024-09-12T00:15:27.065 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T00:15:27.082 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.2 MB/s) 2024-09-12T00:15:27.085 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T00:15:27.101 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 422 kB/s) 2024-09-12T00:15:27.103 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T00:15:27.117 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-12T00:15:27.120 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T00:15:27.137 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 174 kB/s) 2024-09-12T00:15:27.138 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T00:15:27.155 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 425 kB/s) 2024-09-12T00:15:27.156 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T00:15:27.171 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 560 kB/s) 2024-09-12T00:15:27.174 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T00:15:27.188 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 138 kB/s) 2024-09-12T00:15:27.190 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T00:15:27.210 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 149 kB/s) 2024-09-12T00:15:27.210 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T00:15:27.225 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 202 kB/s) 2024-09-12T00:15:27.228 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T00:15:27.250 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 748 kB/s) 2024-09-12T00:15:27.251 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T00:15:27.266 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 967 kB/s) 2024-09-12T00:15:27.269 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T00:15:27.284 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 895 kB/s) 2024-09-12T00:15:27.286 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T00:15:27.300 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 319 kB/s) 2024-09-12T00:15:27.302 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T00:15:27.317 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-12T00:15:27.318 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T00:15:27.335 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15/32 kB Progress (1): 31/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.0 MB/s) 2024-09-12T00:15:27.337 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T00:15:27.352 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-12T00:15:27.354 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T00:15:27.368 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 987 kB/s) 2024-09-12T00:15:27.371 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T00:15:27.387 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 47 kB/s) 2024-09-12T00:15:27.389 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T00:15:27.402 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-12T00:15:27.404 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T00:15:27.419 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 527 kB/s) 2024-09-12T00:15:27.421 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T00:15:27.437 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 187 kB/s) 2024-09-12T00:15:27.439 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T00:15:27.462 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 193 kB/s) 2024-09-12T00:15:27.465 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T00:15:27.481 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 121 kB/s) 2024-09-12T00:15:27.484 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T00:15:27.504 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 165 kB/s) 2024-09-12T00:15:27.507 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T00:15:27.523 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 684 kB/s) 2024-09-12T00:15:27.524 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T00:15:27.539 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 898 kB/s) 2024-09-12T00:15:27.541 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T00:15:27.556 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-12T00:15:27.558 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T00:15:27.573 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 24 kB/s) 2024-09-12T00:15:27.574 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T00:15:27.592 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 359 kB/s) 2024-09-12T00:15:27.593 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T00:15:27.610 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 432 kB/s) 2024-09-12T00:15:27.612 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T00:15:27.627 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 322 kB/s) 2024-09-12T00:15:27.629 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T00:15:27.642 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 522 kB/s) 2024-09-12T00:15:27.645 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T00:15:27.661 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.3 MB/s) 2024-09-12T00:15:27.663 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T00:15:27.681 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.6 MB/s) 2024-09-12T00:15:27.684 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T00:15:27.704 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.2 MB/s) 2024-09-12T00:15:27.707 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T00:15:27.722 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 377 kB/s) 2024-09-12T00:15:27.724 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T00:15:27.746 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 194 kB/s) 2024-09-12T00:15:27.747 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T00:15:27.763 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 213 kB/s) 2024-09-12T00:15:27.764 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T00:15:27.780 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.9 MB/s) 2024-09-12T00:15:27.782 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T00:15:27.799 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 148 kB/s) 2024-09-12T00:15:27.807 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T00:15:27.829 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 15 MB/s) 2024-09-12T00:15:27.829 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T00:15:27.829 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T00:15:27.829 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T00:15:27.829 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T00:15:27.830 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T00:15:27.847 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.2 kB Progress (2): 8.2 kB | 14 kB Progress (3): 8.2 kB | 14 kB | 16/26 kB Progress (4): 8.2 kB | 14 kB | 16/26 kB | 16/118 kB Progress (4): 8.2 kB | 14 kB | 26 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 481 kB/s) 2024-09-12T00:15:27.847 INFO:tasks.workunit.client.0.smithi067.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 799 kB/s) 2024-09-12T00:15:27.848 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T00:15:27.848 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T00:15:27.848 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 26 kB | 33/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.5 MB/s) 2024-09-12T00:15:27.848 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T00:15:27.849 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 49/118 kB Progress (1): 66/118 kB Progress (1): 82/118 kB Progress (1): 98/118 kB Progress (1): 115/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.2 MB/s) 2024-09-12T00:15:27.849 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T00:15:27.854 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/171 kB Progress (1): 32/171 kB Progress (1): 49/171 kB Progress (1): 65/171 kB Progress (1): 81/171 kB Progress (1): 98/171 kB Progress (1): 114/171 kB Progress (1): 130/171 kB Progress (1): 147/171 kB Progress (1): 163/171 kB Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 6.6 MB/s) 2024-09-12T00:15:27.854 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T00:15:27.862 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/61 kB Progress (1): 33/61 kB Progress (1): 49/61 kB Progress (1): 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.8 MB/s) 2024-09-12T00:15:27.862 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T00:15:27.867 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15/501 kB Progress (1): 31/501 kB Progress (1): 48/501 kB Progress (1): 64/501 kB Progress (1): 77/501 kB Progress (1): 93/501 kB Progress (2): 93/501 kB | 16/146 kB Progress (2): 110/501 kB | 16/146 kB Progress (2): 126/501 kB | 16/146 kB Progress (2): 126/501 kB | 32/146 kB Progress (2): 143/501 kB | 32/146 kB Progress (2): 143/501 kB | 49/146 kB Progress (2): 159/501 kB | 49/146 kB Progress (2): 175/501 kB | 49/146 kB Progress (2): 175/501 kB | 65/146 kB Progress (2): 192/501 kB | 65/146 kB Progress (2): 208/501 kB | 65/146 kB Progress (2): 208/501 kB | 81/146 kB Progress (2): 224/501 kB | 81/146 kB Progress (2): 224/501 kB | 98/146 kB Progress (2): 241/501 kB | 98/146 kB Progress (2): 257/501 kB | 98/146 kB Progress (2): 257/501 kB | 114/146 kB Progress (2): 274/501 kB | 114/146 kB Progress (2): 290/501 kB | 114/146 kB Progress (2): 290/501 kB | 130/146 kB Progress (2): 306/501 kB | 130/146 kB Progress (2): 306/501 kB | 146 kB Progress (2): 323/501 kB | 146 kB Progress (2): 339/501 kB | 146 kB Progress (2): 356/501 kB | 146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.8 MB/s) 2024-09-12T00:15:27.867 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T00:15:27.869 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 372/501 kB Progress (1): 388/501 kB Progress (1): 405/501 kB Progress (1): 421/501 kB Progress (1): 437/501 kB Progress (1): 454/501 kB Progress (1): 458/501 kB Progress (1): 474/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 13 MB/s) 2024-09-12T00:15:27.874 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/136 kB Progress (1): 32/136 kB Progress (1): 49/136 kB Progress (1): 65/136 kB Progress (1): 81/136 kB Progress (1): 98/136 kB Progress (1): 114/136 kB Progress (1): 130/136 kB Progress (1): 136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.0 MB/s) 2024-09-12T00:15:27.877 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/58 kB Progress (1): 33/58 kB Progress (1): 49/58 kB Progress (1): 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.2 MB/s) 2024-09-12T00:15:27.882 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15/124 kB Progress (1): 31/124 kB Progress (1): 48/124 kB Progress (1): 64/124 kB Progress (1): 81/124 kB Progress (1): 97/124 kB Progress (1): 113/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.3 MB/s) 2024-09-12T00:15:27.919 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 27 MB/s) 2024-09-12T00:15:27.992 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:27.992 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T00:15:27.996 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T00:15:28.011 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 280 kB/s) 2024-09-12T00:15:28.014 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T00:15:28.034 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 306 kB/s) 2024-09-12T00:15:28.034 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T00:15:28.049 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.7 MB/s) 2024-09-12T00:15:28.052 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T00:15:28.072 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 978 kB/s) 2024-09-12T00:15:28.076 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T00:15:28.093 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 305 kB/s) 2024-09-12T00:15:28.095 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T00:15:28.110 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 261 kB/s) 2024-09-12T00:15:28.113 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T00:15:28.129 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 354 kB/s) 2024-09-12T00:15:28.132 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T00:15:28.147 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 417 kB/s) 2024-09-12T00:15:28.149 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T00:15:28.168 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.1 MB/s) 2024-09-12T00:15:28.172 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T00:15:28.187 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 909 kB/s) 2024-09-12T00:15:28.189 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T00:15:28.205 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 136 kB/s) 2024-09-12T00:15:28.207 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T00:15:28.227 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 514 kB/s) 2024-09-12T00:15:28.227 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T00:15:28.241 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 15/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.5 MB/s) 2024-09-12T00:15:28.247 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T00:15:28.263 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.1 MB/s) 2024-09-12T00:15:28.264 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T00:15:28.264 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T00:15:28.264 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T00:15:28.264 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T00:15:28.265 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T00:15:28.283 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 0/1.0 MB Progress (1): 0/1.0 MB Progress (1): 0/1.0 MB Progress (2): 0/1.0 MB | 16/211 kB Progress (3): 0/1.0 MB | 16/211 kB | 16/79 kB Progress (3): 0.1/1.0 MB | 16/211 kB | 16/79 kB Progress (3): 0.1/1.0 MB | 32/211 kB | 16/79 kB Progress (3): 0.1/1.0 MB | 32/211 kB | 16/79 kB Progress (4): 0.1/1.0 MB | 32/211 kB | 16/79 kB | 15/26 kB Progress (4): 0.1/1.0 MB | 49/211 kB | 16/79 kB | 15/26 kB Progress (5): 0.1/1.0 MB | 49/211 kB | 16/79 kB | 15/26 kB | 16/58 kB Progress (5): 0.1/1.0 MB | 49/211 kB | 16/79 kB | 26 kB | 16/58 kB Progress (5): 0.1/1.0 MB | 49/211 kB | 32/79 kB | 26 kB | 16/58 kB Progress (5): 0.1/1.0 MB | 49/211 kB | 32/79 kB | 26 kB | 16/58 kB Progress (5): 0.1/1.0 MB | 65/211 kB | 32/79 kB | 26 kB | 16/58 kB Progress (5): 0.1/1.0 MB | 65/211 kB | 32/79 kB | 26 kB | 33/58 kB Progress (5): 0.1/1.0 MB | 65/211 kB | 49/79 kB | 26 kB | 33/58 kB Progress (5): 0.1/1.0 MB | 65/211 kB | 49/79 kB | 26 kB | 33/58 kB Progress (5): 0.1/1.0 MB | 81/211 kB | 49/79 kB | 26 kB | 33/58 kB Progress (5): 0.1/1.0 MB | 81/211 kB | 49/79 kB | 26 kB | 49/58 kB Progress (5): 0.1/1.0 MB | 81/211 kB | 65/79 kB | 26 kB | 49/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-09-12T00:15:28.283 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (4): 0.1/1.0 MB | 81/211 kB | 65/79 kB | 58 kB Progress (4): 0.1/1.0 MB | 98/211 kB | 65/79 kB | 58 kB Progress (4): 0.1/1.0 MB | 98/211 kB | 65/79 kB | 58 kB Progress (4): 0.1/1.0 MB | 98/211 kB | 79 kB | 58 kB Progress (4): 0.1/1.0 MB | 114/211 kB | 79 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.2 MB/s) 2024-09-12T00:15:28.283 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T00:15:28.283 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T00:15:28.284 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 0.1/1.0 MB | 130/211 kB | 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.2 MB/s) 2024-09-12T00:15:28.285 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 0.1/1.0 MB | 130/211 kB Progress (2): 0.1/1.0 MB | 147/211 kB Progress (2): 0.2/1.0 MB | 147/211 kB Progress (2): 0.2/1.0 MB | 163/211 kB Progress (2): 0.2/1.0 MB | 163/211 kB Progress (2): 0.2/1.0 MB | 180/211 kB Progress (2): 0.2/1.0 MB | 180/211 kB Progress (2): 0.2/1.0 MB | 196/211 kB Progress (2): 0.2/1.0 MB | 196/211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.2/1.0 MB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 10 MB/s) 2024-09-12T00:15:28.302 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (2): 0.8/1.0 MB | 15/267 kB Progress (2): 0.9/1.0 MB | 15/267 kB Progress (2): 0.9/1.0 MB | 31/267 kB Progress (2): 0.9/1.0 MB | 31/267 kB Progress (2): 0.9/1.0 MB | 48/267 kB Progress (2): 0.9/1.0 MB | 48/267 kB Progress (2): 0.9/1.0 MB | 64/267 kB Progress (2): 0.9/1.0 MB | 64/267 kB Progress (2): 0.9/1.0 MB | 81/267 kB Progress (2): 0.9/1.0 MB | 81/267 kB Progress (2): 0.9/1.0 MB | 97/267 kB Progress (2): 0.9/1.0 MB | 97/267 kB Progress (2): 0.9/1.0 MB | 113/267 kB Progress (2): 1.0/1.0 MB | 113/267 kB Progress (2): 1.0/1.0 MB | 128/267 kB Progress (2): 1.0/1.0 MB | 128/267 kB Progress (2): 1.0/1.0 MB | 145/267 kB Progress (2): 1.0/1.0 MB | 145/267 kB Progress (2): 1.0/1.0 MB | 161/267 kB Progress (2): 1.0/1.0 MB | 161/267 kB Progress (2): 1.0/1.0 MB | 178/267 kB Progress (2): 1.0 MB | 178/267 kB Progress (2): 1.0 MB | 194/267 kB Progress (2): 1.0 MB | 210/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 26 MB/s) 2024-09-12T00:15:28.304 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 227/267 kB Progress (1): 243/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 6.9 MB/s) 2024-09-12T00:15:28.313 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/116 kB Progress (1): 32/116 kB Progress (1): 49/116 kB Progress (1): 65/116 kB Progress (1): 81/116 kB Progress (1): 98/116 kB Progress (1): 114/116 kB Progress (1): 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 2.4 MB/s) 2024-09-12T00:15:28.451 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T00:15:28.476 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:15:28.476 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:15:28.476 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:15:28.476 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Total time: 6.160 s 2024-09-12T00:15:28.477 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Finished at: 2024-09-12T00:15:28Z 2024-09-12T00:15:28.477 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:15:28.500 INFO:tasks.workunit.client.0.smithi067.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T00:15:28.509 INFO:tasks.workunit.client.0.smithi067.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:15:29.593 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Scanning for projects... 2024-09-12T00:15:29.669 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:29.669 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:15:29.670 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:15:29.670 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] from pom.xml 2024-09-12T00:15:29.670 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:15:29.905 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:29.905 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:15:29.993 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:15:29.994 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:29.994 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:15:30.085 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:15:30.086 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:30.086 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:15:30.087 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:15:30.088 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:30.088 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:15:30.092 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:15:30.093 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:30.093 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:15:30.273 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T00:15:30.472 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T00:15:30.708 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 19 kB/s) 2024-09-12T00:15:30.721 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T00:15:30.743 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 119 kB/s) 2024-09-12T00:15:30.750 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T00:15:30.769 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 148 kB/s) 2024-09-12T00:15:30.775 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T00:15:30.798 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 132 kB/s) 2024-09-12T00:15:30.801 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T00:15:30.824 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 139 kB/s) 2024-09-12T00:15:30.827 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T00:15:30.846 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 89 kB/s) 2024-09-12T00:15:30.849 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T00:15:30.868 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 149 kB/s) 2024-09-12T00:15:30.874 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T00:15:30.899 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-09-12T00:15:30.901 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T00:15:30.901 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T00:15:30.901 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T00:15:30.901 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T00:15:30.901 INFO:tasks.workunit.client.0.smithi067.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T00:15:30.945 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 16/189 kB Progress (1): 32/189 kB Progress (1): 49/189 kB Progress (1): 65/189 kB Progress (1): 81/189 kB Progress (1): 98/189 kB Progress (1): 114/189 kB Progress (1): 130/189 kB Progress (1): 147/189 kB Progress (1): 163/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 4.2 MB/s) 2024-09-12T00:15:30.960 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/18 kB Progress (2): 2.8/7.7 kB | 1.4/18 kB Progress (3): 2.8/7.7 kB | 1.4/18 kB | 1.4/169 kB Progress (3): 2.8/7.7 kB | 2.8/18 kB | 1.4/169 kB Progress (3): 2.8/7.7 kB | 2.8/18 kB | 2.8/169 kB Progress (3): 4.1/7.7 kB | 2.8/18 kB | 2.8/169 kB Progress (3): 4.1/7.7 kB | 2.8/18 kB | 4.1/169 kB Progress (3): 4.1/7.7 kB | 4.1/18 kB | 4.1/169 kB Progress (3): 4.1/7.7 kB | 4.1/18 kB | 5.5/169 kB Progress (3): 5.5/7.7 kB | 4.1/18 kB | 5.5/169 kB Progress (3): 5.5/7.7 kB | 4.1/18 kB | 6.9/169 kB Progress (3): 5.5/7.7 kB | 5.5/18 kB | 6.9/169 kB Progress (3): 5.5/7.7 kB | 5.5/18 kB | 8.3/169 kB Progress (4): 5.5/7.7 kB | 5.5/18 kB | 8.3/169 kB | 1.4/103 kB Progress (4): 6.9/7.7 kB | 5.5/18 kB | 8.3/169 kB | 1.4/103 kB Progress (4): 6.9/7.7 kB | 5.5/18 kB | 8.3/169 kB | 2.8/103 kB Progress (4): 6.9/7.7 kB | 5.5/18 kB | 9.7/169 kB | 2.8/103 kB Progress (4): 6.9/7.7 kB | 6.9/18 kB | 9.7/169 kB | 2.8/103 kB Progress (4): 6.9/7.7 kB | 6.9/18 kB | 11/169 kB | 2.8/103 kB Progress (4): 6.9/7.7 kB | 6.9/18 kB | 11/169 kB | 4.1/103 kB Progress (4): 7.7 kB | 6.9/18 kB | 11/169 kB | 4.1/103 kB Progress (4): 7.7 kB | 6.9/18 kB | 11/169 kB | 5.5/103 kB Progress (4): 7.7 kB | 6.9/18 kB | 12/169 kB | 5.5/103 kB Progress (4): 7.7 kB | 8.3/18 kB | 12/169 kB | 5.5/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 130 kB/s) 2024-09-12T00:15:30.967 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (3): 8.3/18 kB | 14/169 kB | 5.5/103 kB Progress (3): 8.3/18 kB | 14/169 kB | 6.9/103 kB Progress (3): 8.3/18 kB | 15/169 kB | 6.9/103 kB Progress (3): 9.7/18 kB | 15/169 kB | 6.9/103 kB Progress (3): 9.7/18 kB | 16/169 kB | 6.9/103 kB Progress (3): 9.7/18 kB | 16/169 kB | 8.3/103 kB Progress (3): 9.7/18 kB | 18/169 kB | 8.3/103 kB Progress (3): 11/18 kB | 18/169 kB | 8.3/103 kB Progress (3): 11/18 kB | 19/169 kB | 8.3/103 kB Progress (3): 11/18 kB | 19/169 kB | 9.7/103 kB Progress (3): 11/18 kB | 21/169 kB | 9.7/103 kB Progress (3): 12/18 kB | 21/169 kB | 9.7/103 kB Progress (3): 12/18 kB | 22/169 kB | 9.7/103 kB Progress (3): 12/18 kB | 22/169 kB | 11/103 kB Progress (3): 12/18 kB | 23/169 kB | 11/103 kB Progress (3): 14/18 kB | 23/169 kB | 11/103 kB Progress (3): 14/18 kB | 25/169 kB | 11/103 kB Progress (3): 14/18 kB | 25/169 kB | 12/103 kB Progress (3): 14/18 kB | 26/169 kB | 12/103 kB Progress (3): 15/18 kB | 26/169 kB | 12/103 kB Progress (3): 15/18 kB | 27/169 kB | 12/103 kB Progress (3): 15/18 kB | 27/169 kB | 14/103 kB Progress (3): 15/18 kB | 29/169 kB | 14/103 kB Progress (3): 17/18 kB | 29/169 kB | 14/103 kB Progress (3): 17/18 kB | 30/169 kB | 14/103 kB Progress (3): 17/18 kB | 30/169 kB | 15/103 kB Progress (3): 18 kB | 30/169 kB | 15/103 kB Progress (3): 18 kB | 32/169 kB | 15/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 258 kB/s) 2024-09-12T00:15:30.984 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (2): 33/169 kB | 15/103 kB Progress (2): 34/169 kB | 15/103 kB Progress (2): 36/169 kB | 15/103 kB Progress (2): 37/169 kB | 15/103 kB Progress (2): 38/169 kB | 15/103 kB Progress (2): 40/169 kB | 15/103 kB Progress (2): 41/169 kB | 15/103 kB Progress (2): 43/169 kB | 15/103 kB Progress (2): 43/169 kB | 31/103 kB Progress (2): 44/169 kB | 31/103 kB Progress (2): 45/169 kB | 31/103 kB Progress (2): 47/169 kB | 31/103 kB Progress (2): 48/169 kB | 31/103 kB Progress (2): 48/169 kB | 48/103 kB Progress (2): 64/169 kB | 48/103 kB Progress (2): 81/169 kB | 48/103 kB Progress (2): 81/169 kB | 64/103 kB Progress (2): 97/169 kB | 64/103 kB Progress (2): 97/169 kB | 81/103 kB Progress (2): 113/169 kB | 81/103 kB Progress (2): 113/169 kB | 97/103 kB Progress (2): 130/169 kB | 97/103 kB Progress (2): 130/169 kB | 103 kB Progress (2): 143/169 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-12T00:15:30.991 INFO:tasks.workunit.client.0.smithi067.stdout:Progress (1): 160/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.8 MB/s) 2024-09-12T00:15:31.005 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:31.005 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:15:31.005 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] T E S T S 2024-09-12T00:15:31.005 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:15:31.458 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T00:15:31.589 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjects.java: starting test run: 2024-09-12T00:15:31.589 INFO:tasks.workunit.client.0.smithi067.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:15:31.589 INFO:tasks.workunit.client.0.smithi067.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:15:31.589 INFO:tasks.workunit.client.0.smithi067.stdout: EndpointUrl=http://smithi067.front.sepia.ceph.com:80 2024-09-12T00:15:31.590 INFO:tasks.workunit.client.0.smithi067.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T00:15:31.687 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Environment Variables Read 2024-09-12T00:15:31.988 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: S3 Client Initialized 2024-09-12T00:15:31.988 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Generating File 2024-09-12T00:15:31.988 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: File Generated 2024-09-12T00:15:31.988 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Generating File 2024-09-12T00:15:31.988 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: File Generated 2024-09-12T00:15:31.988 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Generating File 2024-09-12T00:15:32.088 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: File Generated 2024-09-12T00:15:32.088 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Generating File 2024-09-12T00:15:32.089 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: File Generated 2024-09-12T00:15:32.089 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Generating File 2024-09-12T00:15:32.089 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: File Generated 2024-09-12T00:15:32.089 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Generating File 2024-09-12T00:15:32.089 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: File Generated 2024-09-12T00:15:32.089 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Generated Big Files 2024-09-12T00:15:32.234 INFO:tasks.workunit.client.0.smithi067.stdout:HeadBucketResponse() 2024-09-12T00:15:32.234 INFO:tasks.workunit.client.0.smithi067.stdout:sheik is ready 2024-09-12T00:15:32.234 INFO:tasks.workunit.client.0.smithi067.stdout:DEBUG: Test Bucket Created 2024-09-12T00:15:32.288 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T00:15:32.388 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T00:15:32.481 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T00:15:32.488 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T00:15:32.570 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T00:15:32.589 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T00:15:32.680 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T00:15:32.688 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T00:15:32.770 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T00:15:32.789 INFO:tasks.workunit.client.0.smithi067.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T00:15:34.793 INFO:tasks.workunit.client.0.smithi067.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T00:15:35.293 INFO:tasks.workunit.client.0.smithi067.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T00:15:39.130 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-0b 2024-09-12T00:15:39.131 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-8b 2024-09-12T00:15:39.132 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-200b 2024-09-12T00:15:39.133 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-21983b 2024-09-12T00:15:39.134 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-5519b 2024-09-12T00:15:39.135 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-204329b 2024-09-12T00:15:39.136 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-256k 2024-09-12T00:15:39.137 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-1m 2024-09-12T00:15:39.138 INFO:tasks.workunit.client.0.smithi067.stdout:arg: file-1038757b 2024-09-12T00:15:39.171 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T00:15:39.171 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T00:15:39.199 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T00:15:39.199 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T00:15:39.288 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T00:15:39.288 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T00:15:39.299 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T00:15:39.348 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T00:15:39.400 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T00:15:39.400 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T00:15:39.436 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T00:15:39.436 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T00:15:39.462 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T00:15:39.463 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T00:15:39.499 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T00:15:39.500 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T00:15:39.549 INFO:tasks.workunit.client.0.smithi067.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T00:15:39.549 INFO:tasks.workunit.client.0.smithi067.stdout:PutObjectResponse 2024-09-12T00:15:39.600 INFO:tasks.workunit.client.0.smithi067.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T00:15:39.800 INFO:tasks.workunit.client.0.smithi067.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T00:15:40.200 INFO:tasks.workunit.client.0.smithi067.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T00:15:42.659 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.19 s -- in io.ceph.jcksum.PutObjects 2024-09-12T00:15:42.670 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:42.670 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Results: 2024-09-12T00:15:42.670 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:42.670 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T00:15:42.670 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] 2024-09-12T00:15:42.672 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:15:42.672 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:15:42.672 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:15:42.673 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Total time: 13.100 s 2024-09-12T00:15:42.673 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] Finished at: 2024-09-12T00:15:42Z 2024-09-12T00:15:42.673 INFO:tasks.workunit.client.0.smithi067.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:15:42.695 INFO:tasks.workunit.client.0.smithi067.stderr:+ exit 2024-09-12T00:15:42.695 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:15:42.696 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:15:42.774 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T00:15:42.775 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:15:43.180 DEBUG:teuthology.parallel:result is None 2024-09-12T00:15:43.181 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:15:43.222 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:15:43.222 DEBUG:teuthology.orchestra.run.smithi067:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:15:43.291 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:15:43.292 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:15:43.312 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:15:43.312 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:15:43.313 DEBUG:teuthology.orchestra.run.smithi067:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:15:43.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:15:43.362 INFO:teuthology.orchestra.run.smithi067.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:15:43.362 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:15:43.432 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:15:43.432 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:15:43.502 INFO:tasks.workunit:timeout=3h 2024-09-12T00:15:43.502 INFO:tasks.workunit:cleanup=True 2024-09-12T00:15:43.502 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:15:43.572 INFO:tasks.workunit.client.0.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:16:29.442 INFO:tasks.workunit.client.0.smithi067.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:16:29.443 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:16:29.443 INFO:tasks.workunit.client.0.smithi067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:16:29.443 INFO:tasks.workunit.client.0.smithi067.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:16:29.444 INFO:tasks.workunit.client.0.smithi067.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:16:29.444 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:16:29.444 INFO:tasks.workunit.client.0.smithi067.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:16:29.444 INFO:tasks.workunit.client.0.smithi067.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:16:29.444 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:16:29.445 INFO:tasks.workunit.client.0.smithi067.stderr: git switch -c 2024-09-12T00:16:29.445 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:16:29.445 INFO:tasks.workunit.client.0.smithi067.stderr:Or undo this operation with: 2024-09-12T00:16:29.445 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:16:29.445 INFO:tasks.workunit.client.0.smithi067.stderr: git switch - 2024-09-12T00:16:29.446 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:16:29.446 INFO:tasks.workunit.client.0.smithi067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:16:29.446 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:16:29.446 INFO:tasks.workunit.client.0.smithi067.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:16:29.448 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:16:29.519 INFO:tasks.workunit.client.0.smithi067.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:16:29.521 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:16:29.521 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:16:29.571 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:16:29.620 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:16:29.662 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:16:29.663 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:16:29.663 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:16:29.704 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:16:29.708 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:16:29.708 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:16:29.779 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T00:16:29.780 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T00:16:29.780 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T00:16:29.857 INFO:tasks.workunit.client.0.smithi067.stdout:INFO: fully qualified domain name: smithi067.front.sepia.ceph.com 2024-09-12T00:16:29.857 INFO:tasks.workunit.client.0.smithi067.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T00:16:29.857 INFO:tasks.workunit.client.0.smithi067.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-12T00:16:32.493 INFO:tasks.workunit.client.0.smithi067.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:16:32.677 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting pip 2024-09-12T00:16:32.682 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:16:32.729 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: pip 2024-09-12T00:16:32.730 INFO:tasks.workunit.client.0.smithi067.stdout: Attempting uninstall: pip 2024-09-12T00:16:32.730 INFO:tasks.workunit.client.0.smithi067.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:16:32.893 INFO:tasks.workunit.client.0.smithi067.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:16:32.899 INFO:tasks.workunit.client.0.smithi067.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:16:33.673 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed pip-24.2 2024-09-12T00:16:34.549 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting boto3 2024-09-12T00:16:34.550 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:16:35.172 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:16:35.172 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:16:35.223 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:16:35.225 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:16:35.278 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:16:35.279 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:16:35.329 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:16:35.330 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:16:35.408 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:16:35.409 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:16:35.676 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:16:35.678 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:16:35.682 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:16:35.683 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:16:35.693 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:16:35.694 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:16:35.696 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:16:35.697 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:16:35.698 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:16:35.774 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:16:36.839 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:16:37.685 INFO:tasks.workunit.client.0.smithi067.stdout:INFO: creating user 2024-09-12T00:16:37.801 INFO:tasks.workunit.client.0.smithi067.stdout:{ 2024-09-12T00:16:37.801 INFO:tasks.workunit.client.0.smithi067.stdout: "user_id": "testid", 2024-09-12T00:16:37.801 INFO:tasks.workunit.client.0.smithi067.stdout: "display_name": "M. Tester", 2024-09-12T00:16:37.801 INFO:tasks.workunit.client.0.smithi067.stdout: "email": "tester@ceph.com", 2024-09-12T00:16:37.801 INFO:tasks.workunit.client.0.smithi067.stdout: "suspended": 0, 2024-09-12T00:16:37.802 INFO:tasks.workunit.client.0.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:16:37.802 INFO:tasks.workunit.client.0.smithi067.stdout: "subusers": [], 2024-09-12T00:16:37.802 INFO:tasks.workunit.client.0.smithi067.stdout: "keys": [ 2024-09-12T00:16:37.802 INFO:tasks.workunit.client.0.smithi067.stdout: { 2024-09-12T00:16:37.802 INFO:tasks.workunit.client.0.smithi067.stdout: "user": "testid", 2024-09-12T00:16:37.802 INFO:tasks.workunit.client.0.smithi067.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T00:16:37.802 INFO:tasks.workunit.client.0.smithi067.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T00:16:37.802 INFO:tasks.workunit.client.0.smithi067.stdout: "active": true, 2024-09-12T00:16:37.802 INFO:tasks.workunit.client.0.smithi067.stdout: "create_date": "2024-09-12T00:16:37.797243Z" 2024-09-12T00:16:37.802 INFO:tasks.workunit.client.0.smithi067.stdout: } 2024-09-12T00:16:37.802 INFO:tasks.workunit.client.0.smithi067.stdout: ], 2024-09-12T00:16:37.802 INFO:tasks.workunit.client.0.smithi067.stdout: "swift_keys": [], 2024-09-12T00:16:37.803 INFO:tasks.workunit.client.0.smithi067.stdout: "caps": [], 2024-09-12T00:16:37.803 INFO:tasks.workunit.client.0.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T00:16:37.803 INFO:tasks.workunit.client.0.smithi067.stdout: "default_placement": "", 2024-09-12T00:16:37.803 INFO:tasks.workunit.client.0.smithi067.stdout: "default_storage_class": "", 2024-09-12T00:16:37.803 INFO:tasks.workunit.client.0.smithi067.stdout: "placement_tags": [], 2024-09-12T00:16:37.803 INFO:tasks.workunit.client.0.smithi067.stdout: "bucket_quota": { 2024-09-12T00:16:37.803 INFO:tasks.workunit.client.0.smithi067.stdout: "enabled": false, 2024-09-12T00:16:37.803 INFO:tasks.workunit.client.0.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:16:37.803 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size": -1, 2024-09-12T00:16:37.803 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:16:37.803 INFO:tasks.workunit.client.0.smithi067.stdout: "max_objects": -1 2024-09-12T00:16:37.804 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:16:37.804 INFO:tasks.workunit.client.0.smithi067.stdout: "user_quota": { 2024-09-12T00:16:37.804 INFO:tasks.workunit.client.0.smithi067.stdout: "enabled": false, 2024-09-12T00:16:37.804 INFO:tasks.workunit.client.0.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:16:37.804 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size": -1, 2024-09-12T00:16:37.804 INFO:tasks.workunit.client.0.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:16:37.804 INFO:tasks.workunit.client.0.smithi067.stdout: "max_objects": -1 2024-09-12T00:16:37.804 INFO:tasks.workunit.client.0.smithi067.stdout: }, 2024-09-12T00:16:37.804 INFO:tasks.workunit.client.0.smithi067.stdout: "temp_url_keys": [], 2024-09-12T00:16:37.804 INFO:tasks.workunit.client.0.smithi067.stdout: "type": "rgw", 2024-09-12T00:16:37.804 INFO:tasks.workunit.client.0.smithi067.stdout: "mfa_ids": [], 2024-09-12T00:16:37.804 INFO:tasks.workunit.client.0.smithi067.stdout: "account_id": "", 2024-09-12T00:16:37.805 INFO:tasks.workunit.client.0.smithi067.stdout: "path": "/", 2024-09-12T00:16:37.805 INFO:tasks.workunit.client.0.smithi067.stdout: "create_date": "2024-09-12T00:16:37.797230Z", 2024-09-12T00:16:37.805 INFO:tasks.workunit.client.0.smithi067.stdout: "tags": [], 2024-09-12T00:16:37.805 INFO:tasks.workunit.client.0.smithi067.stdout: "group_ids": [] 2024-09-12T00:16:37.805 INFO:tasks.workunit.client.0.smithi067.stdout:} 2024-09-12T00:16:37.805 INFO:tasks.workunit.client.0.smithi067.stdout: 2024-09-12T00:16:38.058 INFO:tasks.workunit.client.0.smithi067.stderr:5+0 records in 2024-09-12T00:16:38.058 INFO:tasks.workunit.client.0.smithi067.stderr:5+0 records out 2024-09-12T00:16:38.058 INFO:tasks.workunit.client.0.smithi067.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0143299 s, 366 MB/s 2024-09-12T00:16:40.748 INFO:tasks.workunit.client.0.smithi067.stdout:bucket nams is reupload-bkt-131383 2024-09-12T00:16:40.749 INFO:tasks.workunit.client.0.smithi067.stdout:endpoint is http://smithi067.front.sepia.ceph.com:80 2024-09-12T00:16:40.749 INFO:tasks.workunit.client.0.smithi067.stdout:start UploadId=2~O6yrdYbADa64Y1fvyLvwcU5l623XHHr 2024-09-12T00:16:40.749 INFO:tasks.workunit.client.0.smithi067.stdout:phase 1 uploaded part {'ETag': '"cee36f477226a38a647340b50e01a7dc"', 'PartNumber': 1} 2024-09-12T00:16:40.749 INFO:tasks.workunit.client.0.smithi067.stdout:phase 1 uploaded part {'ETag': '"cee36f477226a38a647340b50e01a7dc"', 'PartNumber': 2} 2024-09-12T00:16:40.749 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"cee36f477226a38a647340b50e01a7dc"', 'PartNumber': 1} 2024-09-12T00:16:40.749 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"cee36f477226a38a647340b50e01a7dc"', 'PartNumber': 1} 2024-09-12T00:16:40.749 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"cee36f477226a38a647340b50e01a7dc"', 'PartNumber': 1} 2024-09-12T00:16:40.749 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"cee36f477226a38a647340b50e01a7dc"', 'PartNumber': 1} 2024-09-12T00:16:40.749 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"cee36f477226a38a647340b50e01a7dc"', 'PartNumber': 1} 2024-09-12T00:16:40.749 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"cee36f477226a38a647340b50e01a7dc"', 'PartNumber': 1} 2024-09-12T00:16:40.750 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"cee36f477226a38a647340b50e01a7dc"', 'PartNumber': 1} 2024-09-12T00:16:40.750 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"cee36f477226a38a647340b50e01a7dc"', 'PartNumber': 1} 2024-09-12T00:16:40.750 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"cee36f477226a38a647340b50e01a7dc"', 'PartNumber': 1} 2024-09-12T00:16:40.750 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"cee36f477226a38a647340b50e01a7dc"', 'PartNumber': 1} 2024-09-12T00:16:40.750 INFO:tasks.workunit.client.0.smithi067.stdout:phase 2 uploaded part {'ETag': '"cee36f477226a38a647340b50e01a7dc"', 'PartNumber': 1} 2024-09-12T00:16:40.750 INFO:tasks.workunit.client.0.smithi067.stdout:completing multipart upload, parts=[{'ETag': '"cee36f477226a38a647340b50e01a7dc"', 'PartNumber': 1}, {'ETag': '"cee36f477226a38a647340b50e01a7dc"', 'PartNumber': 2}] 2024-09-12T00:16:41.991 INFO:tasks.workunit.client.0.smithi067.stdout:radosgw-admin bucket radoslist: 2024-09-12T00:16:41.992 INFO:tasks.workunit.client.0.smithi067.stdout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3_mpu_test4 2024-09-12T00:16:41.993 INFO:tasks.workunit.client.0.smithi067.stdout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3__multipart_mpu_test4.2~O6yrdYbADa64Y1fvyLvwcU5l623XHHr.2 2024-09-12T00:16:41.993 INFO:tasks.workunit.client.0.smithi067.stdout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3__multipart_mpu_test4.I5oRl6ygmIhN3nABsIDWqNd7e8cYM1r2.1 2024-09-12T00:16:42.055 INFO:tasks.workunit.client.0.smithi067.stdout:rados ls: 2024-09-12T00:16:42.055 INFO:tasks.workunit.client.0.smithi067.stdout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3_mpu_test4 2024-09-12T00:16:42.055 INFO:tasks.workunit.client.0.smithi067.stdout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3__multipart_mpu_test4.2~O6yrdYbADa64Y1fvyLvwcU5l623XHHr.2 2024-09-12T00:16:42.056 INFO:tasks.workunit.client.0.smithi067.stdout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3__multipart_mpu_test4.I5oRl6ygmIhN3nABsIDWqNd7e8cYM1r2.1 2024-09-12T00:16:42.064 INFO:tasks.workunit.client.0.smithi067.stdout:== PASSED == 2024-09-12T00:16:42.065 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:16:42.065 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:16:42.145 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T00:16:42.146 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:16:42.555 DEBUG:teuthology.parallel:result is None 2024-09-12T00:16:42.555 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:16:42.595 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:16:42.595 DEBUG:teuthology.orchestra.run.smithi067:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:16:42.666 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:16:42.666 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T00:16:42.681 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T00:16:42.682 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T00:16:42.682 INFO:tasks.ragweed:Using branch 'wip-67986' for ragweed 2024-09-12T00:16:42.682 DEBUG:teuthology.orchestra.run.smithi067:> git clone -b wip-67986 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:16:42.737 INFO:teuthology.orchestra.run.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T00:16:42.892 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T00:16:42.892 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T00:16:42.893 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key BXJGHAWYQDMEUORNOKSI --secret 6TgduuA1t6GgaOK9H+Pyp1qHP4Uc063mj06xJPYXb+ZfWEbtqRrdMQ== --email ragweed.client.0+test@test.test --system false 2024-09-12T00:16:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:16:43.002 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:16:43.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.040+0000 7fd55f8b7800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.042+0000 7fd55f8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.042+0000 7fd55f8b7800 20 realm 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.042+0000 7fd55f8b7800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.043+0000 7fd55f8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.043+0000 7fd55f8b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.043+0000 7fd55f8b7800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.043+0000 7fd55f8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.043+0000 7fd55f8b7800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.044+0000 7fd55f8b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.044+0000 7fd55f8b7800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.045+0000 7fd55f8b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:16:43.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.045+0000 7fd55f8b7800 20 searching for the correct realm 2024-09-12T00:16:43.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.049+0000 7fd55d3a1640 0 -- 172.21.15.67:0/1129023736 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7fd55000b040 msgr2=0x7fd550007a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:16:43.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.053+0000 7fd55d3a1640 0 -- 172.21.15.67:0/1129023736 >> [v2:172.21.15.67:6800/2522402523,v1:172.21.15.67:6801/2522402523] conn(0x5645cfee3a70 msgr2=0x5645cfee5e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.056+0000 7fd55f8b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.056+0000 7fd55f8b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.056+0000 7fd55f8b7800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.056+0000 7fd55f8b7800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.056+0000 7fd55f8b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.056+0000 7fd55f8b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.056+0000 7fd55f8b7800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.057+0000 7fd55f8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.057+0000 7fd55f8b7800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.057+0000 7fd55f8b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.057+0000 7fd55f8b7800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.057+0000 7fd55f8b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.057+0000 7fd55f8b7800 20 zone default found 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.057+0000 7fd55f8b7800 4 Realm: () 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.057+0000 7fd55f8b7800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.057+0000 7fd55f8b7800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.057+0000 7fd55f8b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.057+0000 7fd55f8b7800 20 zonegroup default 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.057+0000 7fd55f8b7800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.058+0000 7fd55f8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.058+0000 7fd55f8b7800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.058+0000 7fd55f8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.058+0000 7fd55f8b7800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.059+0000 7fd55f8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.059+0000 7fd55f8b7800 20 started sync module instance, tier type = 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.059+0000 7fd55f8b7800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.068+0000 7fd55f8b7800 20 add_watcher() i=0 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.068+0000 7fd55f8b7800 20 add_watcher() i=1 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.068+0000 7fd55f8b7800 20 add_watcher() i=2 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.068+0000 7fd55f8b7800 20 add_watcher() i=3 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.068+0000 7fd55f8b7800 20 add_watcher() i=4 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.068+0000 7fd55f8b7800 20 add_watcher() i=5 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.068+0000 7fd55f8b7800 20 add_watcher() i=6 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.070+0000 7fd55f8b7800 20 add_watcher() i=7 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.070+0000 7fd55f8b7800 2 all 8 watchers are set, enabling cache 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.071+0000 7fd4137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.071+0000 7fd55f8b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.071+0000 7fd55f8b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.071+0000 7fd55f8b7800 5 note: GC not initialized 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.072+0000 7fd4127e4640 20 reqs_thread_entry: start 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.072+0000 7fd55f8b7800 20 init_complete bucket index max shards: 1 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.072+0000 7fd55f8b7800 20 Filter name: none 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.072+0000 7fd383fff640 20 reqs_thread_entry: start 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.072+0000 7fd55f8b7800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.072+0000 7fd55f8b7800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.072+0000 7fd55f8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.072+0000 7fd55f8b7800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.072+0000 7fd55f8b7800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.072+0000 7fd55f8b7800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.072+0000 7fd55f8b7800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.073+0000 7fd55f8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.073+0000 7fd55f8b7800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.073+0000 7fd55f8b7800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.073+0000 7fd55f8b7800 10 cache get: name=default.rgw.meta+users.keys+BXJGHAWYQDMEUORNOKSI : miss 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.073+0000 7fd55f8b7800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.073+0000 7fd55f8b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.073+0000 7fd55f8b7800 10 cache put: name=default.rgw.meta+users.keys+BXJGHAWYQDMEUORNOKSI info.flags=0x0 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.073+0000 7fd55f8b7800 10 adding default.rgw.meta+users.keys+BXJGHAWYQDMEUORNOKSI to cache LRU end 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.073+0000 7fd55f8b7800 10 cache get: name=default.rgw.meta+users.keys+BXJGHAWYQDMEUORNOKSI : hit (negative entry) 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.073+0000 7fd55f8b7800 10 cache get: name=default.rgw.meta+users.keys+BXJGHAWYQDMEUORNOKSI : hit (negative entry) 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.075+0000 7fd55f8b7800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.075+0000 7fd55f8b7800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.075+0000 7fd55f8b7800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.075+0000 7fd440ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758662 cookie 94857841271888 notifier 5919 bl.length()=675 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.075+0000 7fd440ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.075+0000 7fd440ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.077+0000 7fd55f8b7800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.077+0000 7fd55f8b7800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.077+0000 7fd55f8b7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.077+0000 7fd42ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758605 cookie 94857841264704 notifier 5919 bl.length()=202 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.077+0000 7fd42ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:16:43.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.077+0000 7fd42ffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.079+0000 7fd55f8b7800 10 cache put: name=default.rgw.meta+users.keys+BXJGHAWYQDMEUORNOKSI info.flags=0x7 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.079+0000 7fd55f8b7800 10 moving default.rgw.meta+users.keys+BXJGHAWYQDMEUORNOKSI to cache LRU end 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.079+0000 7fd55f8b7800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:BXJGHAWYQDMEUORNOKSI, ofs0, ns] 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.079+0000 7fd42ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758650 cookie 94857841236432 notifier 5919 bl.length()=190 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.079+0000 7fd42ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BXJGHAWYQDMEUORNOKSI info.flags=0x7 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.079+0000 7fd42ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BXJGHAWYQDMEUORNOKSI to cache LRU end 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "ragweed.client.0", 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "ragweed.client.0", 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "BXJGHAWYQDMEUORNOKSI", 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "6TgduuA1t6GgaOK9H+Pyp1qHP4Uc063mj06xJPYXb+ZfWEbtqRrdMQ==", 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:16:43.075256Z" 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "rgw", 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "", 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:16:43.075240Z", 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.081+0000 7fd4137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.083+0000 7fd55f8b7800 20 remove_watcher() i=0 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.083+0000 7fd55f8b7800 2 removed watcher, disabling cache 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.084+0000 7fd55f8b7800 20 remove_watcher() i=1 2024-09-12T00:16:43.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.085+0000 7fd55f8b7800 20 remove_watcher() i=2 2024-09-12T00:16:43.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.086+0000 7fd55f8b7800 20 remove_watcher() i=3 2024-09-12T00:16:43.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.087+0000 7fd55f8b7800 20 remove_watcher() i=4 2024-09-12T00:16:43.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.089+0000 7fd55f8b7800 20 remove_watcher() i=5 2024-09-12T00:16:43.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.090+0000 7fd55f8b7800 20 remove_watcher() i=6 2024-09-12T00:16:43.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.091+0000 7fd55f8b7800 20 remove_watcher() i=7 2024-09-12T00:16:43.101 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T00:16:43.101 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key HBCYZCOWUCZRWPKSZFUN --secret TLZb0KbpQJef6pAFWSXyp24r9FuGLQI7YvBAbyY0JLYsc+Euv8tbbQ== --email sysuser.client.0+test@test.test --system true 2024-09-12T00:16:43.172 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:16:43.172 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:16:43.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.211+0000 7f6cddb46800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.213+0000 7f6cddb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.213+0000 7f6cddb46800 20 realm 2024-09-12T00:16:43.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.213+0000 7f6cddb46800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.213+0000 7f6cddb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.213+0000 7f6cddb46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:16:43.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.213+0000 7f6cddb46800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.213+0000 7f6cddb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.213+0000 7f6cddb46800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.214+0000 7f6cddb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:16:43.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.214+0000 7f6cddb46800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.215+0000 7f6cddb46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:16:43.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.215+0000 7f6cddb46800 20 searching for the correct realm 2024-09-12T00:16:43.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.218+0000 7f6cdae2f640 0 -- 172.21.15.67:0/1017207463 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f6cd001a040 msgr2=0x7f6cd0071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:16:43.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.424+0000 7f6cdbe31640 0 -- 172.21.15.67:0/1017207463 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x562a7bd93280 msgr2=0x562a7bd95710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:16:43.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.428+0000 7f6cddb46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:16:43.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.428+0000 7f6cddb46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:16:43.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.428+0000 7f6cddb46800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:16:43.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.428+0000 7f6cddb46800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:16:43.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.428+0000 7f6cddb46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:16:43.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.428+0000 7f6cddb46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:16:43.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.428+0000 7f6cddb46800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.429+0000 7f6cddb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.429+0000 7f6cddb46800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.429+0000 7f6cddb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:16:43.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.429+0000 7f6cddb46800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.429+0000 7f6cddb46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:16:43.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.429+0000 7f6cddb46800 20 zone default found 2024-09-12T00:16:43.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.429+0000 7f6cddb46800 4 Realm: () 2024-09-12T00:16:43.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.429+0000 7f6cddb46800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:16:43.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.429+0000 7f6cddb46800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:16:43.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.429+0000 7f6cddb46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:16:43.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.429+0000 7f6cddb46800 20 zonegroup default 2024-09-12T00:16:43.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.429+0000 7f6cddb46800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.430+0000 7f6cddb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.430+0000 7f6cddb46800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.430+0000 7f6cddb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.430+0000 7f6cddb46800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.431+0000 7f6cddb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.431+0000 7f6cddb46800 20 started sync module instance, tier type = 2024-09-12T00:16:43.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.431+0000 7f6cddb46800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:16:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.440+0000 7f6cddb46800 20 add_watcher() i=0 2024-09-12T00:16:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.440+0000 7f6cddb46800 20 add_watcher() i=1 2024-09-12T00:16:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.440+0000 7f6cddb46800 20 add_watcher() i=2 2024-09-12T00:16:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.440+0000 7f6cddb46800 20 add_watcher() i=3 2024-09-12T00:16:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.440+0000 7f6cddb46800 20 add_watcher() i=4 2024-09-12T00:16:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.440+0000 7f6cddb46800 20 add_watcher() i=5 2024-09-12T00:16:43.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.440+0000 7f6cddb46800 20 add_watcher() i=6 2024-09-12T00:16:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.441+0000 7f6cddb46800 20 add_watcher() i=7 2024-09-12T00:16:43.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.441+0000 7f6cddb46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:16:43.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.443+0000 7f6b91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:16:43.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.443+0000 7f6cddb46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:16:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.443+0000 7f6cddb46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:16:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.443+0000 7f6cddb46800 5 note: GC not initialized 2024-09-12T00:16:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.443+0000 7f6b90fe1640 20 reqs_thread_entry: start 2024-09-12T00:16:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.443+0000 7f6cddb46800 20 init_complete bucket index max shards: 1 2024-09-12T00:16:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.443+0000 7f6cddb46800 20 Filter name: none 2024-09-12T00:16:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.443+0000 7f6b0a7fc640 20 reqs_thread_entry: start 2024-09-12T00:16:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.443+0000 7f6cddb46800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:16:43.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.443+0000 7f6cddb46800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.444+0000 7f6cddb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.444+0000 7f6cddb46800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T00:16:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.444+0000 7f6cddb46800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:16:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.444+0000 7f6cddb46800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T00:16:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.444+0000 7f6cddb46800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.444+0000 7f6cddb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.444+0000 7f6cddb46800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T00:16:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.444+0000 7f6cddb46800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:16:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.444+0000 7f6cddb46800 10 cache get: name=default.rgw.meta+users.keys+HBCYZCOWUCZRWPKSZFUN : miss 2024-09-12T00:16:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.444+0000 7f6cddb46800 20 rados->read ofs=0 len=0 2024-09-12T00:16:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.444+0000 7f6cddb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.444+0000 7f6cddb46800 10 cache put: name=default.rgw.meta+users.keys+HBCYZCOWUCZRWPKSZFUN info.flags=0x0 2024-09-12T00:16:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.444+0000 7f6cddb46800 10 adding default.rgw.meta+users.keys+HBCYZCOWUCZRWPKSZFUN to cache LRU end 2024-09-12T00:16:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.445+0000 7f6cddb46800 10 cache get: name=default.rgw.meta+users.keys+HBCYZCOWUCZRWPKSZFUN : hit (negative entry) 2024-09-12T00:16:43.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.445+0000 7f6cddb46800 10 cache get: name=default.rgw.meta+users.keys+HBCYZCOWUCZRWPKSZFUN : hit (negative entry) 2024-09-12T00:16:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.446+0000 7f6cddb46800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:16:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.446+0000 7f6cddb46800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:16:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.446+0000 7f6cddb46800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:16:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.446+0000 7f6bbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758606 cookie 94740466500752 notifier 5940 bl.length()=675 2024-09-12T00:16:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.446+0000 7f6bbeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:16:43.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.446+0000 7f6bbeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:16:43.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.448+0000 7f6cddb46800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:16:43.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.448+0000 7f6cddb46800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:16:43.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.448+0000 7f6cddb46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:16:43.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.448+0000 7f6bbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758663 cookie 94740466507008 notifier 5940 bl.length()=202 2024-09-12T00:16:43.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.448+0000 7f6bbeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:16:43.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.448+0000 7f6bbeffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:16:43.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.450+0000 7f6cddb46800 10 cache put: name=default.rgw.meta+users.keys+HBCYZCOWUCZRWPKSZFUN info.flags=0x7 2024-09-12T00:16:43.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.450+0000 7f6cddb46800 10 moving default.rgw.meta+users.keys+HBCYZCOWUCZRWPKSZFUN to cache LRU end 2024-09-12T00:16:43.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.450+0000 7f6cddb46800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:HBCYZCOWUCZRWPKSZFUN, ofs0, ns] 2024-09-12T00:16:43.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.450+0000 7f6bbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758607 cookie 94740466500752 notifier 5940 bl.length()=190 2024-09-12T00:16:43.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.450+0000 7f6bbeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+HBCYZCOWUCZRWPKSZFUN info.flags=0x7 2024-09-12T00:16:43.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.450+0000 7f6bbeffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+HBCYZCOWUCZRWPKSZFUN to cache LRU end 2024-09-12T00:16:43.450 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:16:43.450 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "sysuser.client.0", 2024-09-12T00:16:43.450 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T00:16:43.450 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T00:16:43.450 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T00:16:43.450 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:16:43.450 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T00:16:43.451 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T00:16:43.451 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T00:16:43.451 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "sysuser.client.0", 2024-09-12T00:16:43.451 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "HBCYZCOWUCZRWPKSZFUN", 2024-09-12T00:16:43.451 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "TLZb0KbpQJef6pAFWSXyp24r9FuGLQI7YvBAbyY0JLYsc+Euv8tbbQ==", 2024-09-12T00:16:43.451 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T00:16:43.451 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:16:43.446541Z" 2024-09-12T00:16:43.451 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T00:16:43.451 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T00:16:43.451 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T00:16:43.451 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T00:16:43.451 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T00:16:43.451 INFO:teuthology.orchestra.run.smithi067.stdout: "system": true, 2024-09-12T00:16:43.451 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T00:16:43.452 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T00:16:43.452 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T00:16:43.452 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T00:16:43.452 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:16:43.452 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:16:43.452 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:16:43.452 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:16:43.452 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:16:43.452 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:16:43.452 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T00:16:43.452 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:16:43.452 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:16:43.452 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:16:43.452 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:16:43.453 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:16:43.453 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:16:43.453 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T00:16:43.453 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "rgw", 2024-09-12T00:16:43.453 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T00:16:43.453 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "", 2024-09-12T00:16:43.453 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T00:16:43.453 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:16:43.446518Z", 2024-09-12T00:16:43.453 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T00:16:43.453 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T00:16:43.453 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:16:43.453 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:16:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.452+0000 7f6b91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:16:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.454+0000 7f6cddb46800 20 remove_watcher() i=0 2024-09-12T00:16:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.454+0000 7f6cddb46800 2 removed watcher, disabling cache 2024-09-12T00:16:43.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.455+0000 7f6cddb46800 20 remove_watcher() i=1 2024-09-12T00:16:43.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.456+0000 7f6cddb46800 20 remove_watcher() i=2 2024-09-12T00:16:43.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.457+0000 7f6cddb46800 20 remove_watcher() i=3 2024-09-12T00:16:43.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.458+0000 7f6cddb46800 20 remove_watcher() i=4 2024-09-12T00:16:43.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.459+0000 7f6cddb46800 20 remove_watcher() i=5 2024-09-12T00:16:43.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.461+0000 7f6cddb46800 20 remove_watcher() i=6 2024-09-12T00:16:43.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:16:43.462+0000 7f6cddb46800 20 remove_watcher() i=7 2024-09-12T00:16:43.473 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T00:16:43.473 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:16:43.473 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T00:16:43.503 INFO:tasks.ragweed:Configuring boto... 2024-09-12T00:16:43.503 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:16:43.503 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T00:16:43.574 DEBUG:teuthology.orchestra.run.smithi067:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T00:16:43.776 INFO:teuthology.orchestra.run.smithi067.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T00:16:43.953 INFO:teuthology.orchestra.run.smithi067.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T00:16:44.557 INFO:teuthology.orchestra.run.smithi067.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:16:51.649 INFO:teuthology.orchestra.run.smithi067.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi067.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=4adea06faaa52dd6f8a49da8e37180a0f28373607f79c5f3abe2b7902c691a24,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi067.stdout:py run-test-pre: PYTHONHASHSEED='3452241824' 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi067.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T00:16:55.423 INFO:teuthology.orchestra.run.smithi067.stdout:============================= test session starts ============================== 2024-09-12T00:16:55.423 INFO:teuthology.orchestra.run.smithi067.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T00:16:55.423 INFO:teuthology.orchestra.run.smithi067.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:16:55.424 INFO:teuthology.orchestra.run.smithi067.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:16:55.424 INFO:teuthology.orchestra.run.smithi067.stdout:configfile: pytest.ini 2024-09-12T00:16:55.524 INFO:teuthology.orchestra.run.smithi067.stdout:collecting ... collected 9 items 2024-09-12T00:16:55.524 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:16:56.007 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T00:16:56.604 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T00:16:57.032 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T00:16:57.569 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T00:16:58.109 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T00:17:05.013 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T00:17:06.296 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T00:17:07.456 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T00:17:09.619 INFO:teuthology.orchestra.run.smithi067.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T00:17:09.619 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:17:09.619 INFO:teuthology.orchestra.run.smithi067.stdout:=============================== warnings summary =============================== 2024-09-12T00:17:09.619 INFO:teuthology.orchestra.run.smithi067.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T00:17:09.619 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T00:17:09.619 INFO:teuthology.orchestra.run.smithi067.stdout: import imp 2024-09-12T00:17:09.619 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:17:09.619 INFO:teuthology.orchestra.run.smithi067.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T00:17:09.619 INFO:teuthology.orchestra.run.smithi067.stdout:======================== 9 passed, 1 warning in 14.20s ========================= 2024-09-12T00:17:09.650 INFO:teuthology.orchestra.run.smithi067.stdout:___________________________________ summary ____________________________________ 2024-09-12T00:17:09.650 INFO:teuthology.orchestra.run.smithi067.stdout: py: commands succeeded 2024-09-12T00:17:09.650 INFO:teuthology.orchestra.run.smithi067.stdout: congratulations :) 2024-09-12T00:17:09.668 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T00:17:09.669 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T00:17:09.699 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T00:17:09.797 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:09.797 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:09.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:09.835+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:09.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:09.836+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:09.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:09.836+0000 7f4166528800 20 realm 2024-09-12T00:17:09.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:09.837+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:09.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:09.837+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:09.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:09.837+0000 7f4166528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:09.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:09.837+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:09.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:09.837+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:09.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:09.837+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:09.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:09.838+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:09.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:09.838+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:09.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:09.839+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:09.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:09.839+0000 7f4166528800 20 searching for the correct realm 2024-09-12T00:17:09.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:09.840+0000 7f416224b640 0 -- 172.21.15.67:0/2402907792 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f4154085410 msgr2=0x7f4154085830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:10.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.045+0000 7f416224b640 0 -- 172.21.15.67:0/2402907792 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x556b6127d210 msgr2=0x7f415c0662a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:10.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.252+0000 7f4166528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:10.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.252+0000 7f4166528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:10.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.252+0000 7f4166528800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:17:10.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.252+0000 7f4166528800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:17:10.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.252+0000 7f4166528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:10.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.252+0000 7f4166528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:10.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.252+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.252+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.252+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.253+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:10.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.253+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.253+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:10.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.253+0000 7f4166528800 20 zone default found 2024-09-12T00:17:10.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.253+0000 7f4166528800 4 Realm: () 2024-09-12T00:17:10.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.253+0000 7f4166528800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:17:10.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.253+0000 7f4166528800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:17:10.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.253+0000 7f4166528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:10.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.253+0000 7f4166528800 20 zonegroup default 2024-09-12T00:17:10.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.253+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.253+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.253+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.254+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.254+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.254+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.254+0000 7f4166528800 20 started sync module instance, tier type = 2024-09-12T00:17:10.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.254+0000 7f4166528800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:17:10.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.264+0000 7f4166528800 20 add_watcher() i=0 2024-09-12T00:17:10.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.264+0000 7f4166528800 20 add_watcher() i=1 2024-09-12T00:17:10.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.264+0000 7f4166528800 20 add_watcher() i=2 2024-09-12T00:17:10.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.264+0000 7f4166528800 20 add_watcher() i=3 2024-09-12T00:17:10.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.264+0000 7f4166528800 20 add_watcher() i=4 2024-09-12T00:17:10.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.264+0000 7f4166528800 20 add_watcher() i=5 2024-09-12T00:17:10.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.264+0000 7f4166528800 20 add_watcher() i=6 2024-09-12T00:17:10.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.265+0000 7f4166528800 20 add_watcher() i=7 2024-09-12T00:17:10.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.265+0000 7f4166528800 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:10.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.267+0000 7f4018fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:10.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.267+0000 7f4166528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:10.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.267+0000 7f4166528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:10.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.307+0000 7f3f937fe640 20 reqs_thread_entry: start 2024-09-12T00:17:10.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.307+0000 7f4166528800 20 init_complete bucket index max shards: 1 2024-09-12T00:17:10.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.307+0000 7f4166528800 20 Filter name: none 2024-09-12T00:17:10.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.307+0000 7f3f917fa640 20 reqs_thread_entry: start 2024-09-12T00:17:10.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.307+0000 7f4166528800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:17:10.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.307+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.308+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:17:10.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.308+0000 7f4166528800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T00:17:10.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.308+0000 7f4166528800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:17:10.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.308+0000 7f4166528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:10.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.309+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4 : miss 2024-09-12T00:17:10.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.309+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.309+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T00:17:10.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.309+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4 info.flags=0x17 2024-09-12T00:17:10.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.309+0000 7f4166528800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4 to cache LRU end 2024-09-12T00:17:10.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.309+0000 7f4166528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:10.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.309+0000 7f4166528800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:17:10.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.309+0000 7f4166528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4 2024-09-12T00:17:10.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.310+0000 7f4166528800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T00:17:10.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.310+0000 7f4166528800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T00:17:10.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.310+0000 7f4166528800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T00:17:10.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.310+0000 7f4166528800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T00:17:10.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.310+0000 7f4166528800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T00:17:10.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.310+0000 7f4166528800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T00:17:10.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.310+0000 7f4166528800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T00:17:10.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.310+0000 7f4166528800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:17:10.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.310+0000 7f4166528800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T00:17:10.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.310+0000 7f4166528800 20 get_obj_state: octx=0x556b614124e0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x556b614179c8 s->prefetch_data=0 2024-09-12T00:17:10.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.310+0000 7f4166528800 10 manifest: total_size = 7543 2024-09-12T00:17:10.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.310+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16692790965145902790 2024-09-12T00:17:10.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.310+0000 7f4166528800 20 get_obj_state: octx=0x556b614124e0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x556b614179c8 s->prefetch_data=0 2024-09-12T00:17:10.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.310+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b614179c8 2024-09-12T00:17:10.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.310+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4.0 2024-09-12T00:17:10.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.313+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.313+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=7543 stripe_ofs=7543 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.313+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16692790965145902790 2024-09-12T00:17:10.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.313+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.313+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.HR8p7NAcmJA867Xv1coTlfVQLKnS_Fq_0 2024-09-12T00:17:10.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.313+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:17:10.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.313+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.313+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16692790965145902790 2024-09-12T00:17:10.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.314+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T00:17:10.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.314+0000 7f4166528800 20 get_obj_state: octx=0x556b614124e0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x556b6141c1a8 s->prefetch_data=0 2024-09-12T00:17:10.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.315+0000 7f4166528800 10 manifest: total_size = 7650 2024-09-12T00:17:10.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.315+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6106510527396649690 2024-09-12T00:17:10.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.315+0000 7f4166528800 20 get_obj_state: octx=0x556b614124e0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x556b6141c1a8 s->prefetch_data=0 2024-09-12T00:17:10.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.315+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6141c1a8 2024-09-12T00:17:10.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.315+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4.0 2024-09-12T00:17:10.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.317+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.317+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=7650 stripe_ofs=7650 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.317+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6106510527396649690 2024-09-12T00:17:10.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.317+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.317+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.8p4GulM72kNpOMtC-ofLrJdbPFMWxH__0 2024-09-12T00:17:10.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.317+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:17:10.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.317+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.317+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6106510527396649690 2024-09-12T00:17:10.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.319+0000 7f40457fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T00:17:10.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.319+0000 7f4166528800 20 get_obj_state: octx=0x556b614124e0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x556b614174b8 s->prefetch_data=0 2024-09-12T00:17:10.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.319+0000 7f4166528800 10 manifest: total_size = 5092 2024-09-12T00:17:10.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.319+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13840641934420598038 2024-09-12T00:17:10.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.319+0000 7f4166528800 20 get_obj_state: octx=0x556b614124e0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x556b614174b8 s->prefetch_data=0 2024-09-12T00:17:10.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.319+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b614174b8 2024-09-12T00:17:10.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.319+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4.0 2024-09-12T00:17:10.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.323+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.323+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5092 stripe_ofs=5092 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.323+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13840641934420598038 2024-09-12T00:17:10.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.323+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.323+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.RNU8REt_6IgJ-SE18x8k7LSHOO1IG1C_0 2024-09-12T00:17:10.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.323+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:17:10.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.323+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.323+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13840641934420598038 2024-09-12T00:17:10.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.324+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T00:17:10.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.324+0000 7f4166528800 20 get_obj_state: octx=0x556b614124e0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x556b614174b8 s->prefetch_data=0 2024-09-12T00:17:10.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.325+0000 7f4166528800 10 manifest: total_size = 7508 2024-09-12T00:17:10.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.325+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8194616003558093925 2024-09-12T00:17:10.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.325+0000 7f4166528800 20 get_obj_state: octx=0x556b614124e0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x556b614174b8 s->prefetch_data=0 2024-09-12T00:17:10.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.325+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b614174b8 2024-09-12T00:17:10.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.325+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4.0 2024-09-12T00:17:10.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.327+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.327+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=7508 stripe_ofs=7508 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.327+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8194616003558093925 2024-09-12T00:17:10.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.327+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.327+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.tmCjtk36IWcX3-GyGZHKoSF22vwDViu_0 2024-09-12T00:17:10.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.327+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:17:10.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.327+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.327+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8194616003558093925 2024-09-12T00:17:10.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.329+0000 7f4166528800 20 get_obj_state: octx=0x556b61413790 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x556b614174b8 s->prefetch_data=0 2024-09-12T00:17:10.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.329+0000 7f40457fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T00:17:10.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.329+0000 7f4166528800 10 manifest: total_size = 7626 2024-09-12T00:17:10.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.329+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12192607557588473183 2024-09-12T00:17:10.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.329+0000 7f4166528800 20 get_obj_state: octx=0x556b61413790 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x556b614174b8 s->prefetch_data=0 2024-09-12T00:17:10.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.329+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b614174b8 2024-09-12T00:17:10.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.329+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4.0 2024-09-12T00:17:10.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.332+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.332+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=7626 stripe_ofs=7626 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.332+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12192607557588473183 2024-09-12T00:17:10.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.332+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.332+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.PgZ7kWN0VBZ5Zt2bjoGAa9BAspxEShR_0 2024-09-12T00:17:10.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.332+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:17:10.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.332+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.332+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12192607557588473183 2024-09-12T00:17:10.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.333+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T00:17:10.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.333+0000 7f4166528800 20 get_obj_state: octx=0x556b61413790 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x556b614174b8 s->prefetch_data=0 2024-09-12T00:17:10.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.334+0000 7f4166528800 10 manifest: total_size = 15904 2024-09-12T00:17:10.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.334+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2314637739760701431 2024-09-12T00:17:10.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.334+0000 7f4166528800 20 get_obj_state: octx=0x556b61413790 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x556b614174b8 s->prefetch_data=0 2024-09-12T00:17:10.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.334+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b614174b8 2024-09-12T00:17:10.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.334+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4.0 2024-09-12T00:17:10.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.336+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.336+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=15904 stripe_ofs=15904 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.336+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2314637739760701431 2024-09-12T00:17:10.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.336+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.336+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.76Aw6-Kth9DBBYzPPzR_-ZpxCccziXe_0 2024-09-12T00:17:10.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.336+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:17:10.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.336+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.336+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2314637739760701431 2024-09-12T00:17:10.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.338+0000 7f40457fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T00:17:10.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.338+0000 7f4166528800 20 get_obj_state: octx=0x556b6141e940 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x556b614174b8 s->prefetch_data=0 2024-09-12T00:17:10.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.338+0000 7f4166528800 10 manifest: total_size = 7895 2024-09-12T00:17:10.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.338+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18435194141957721611 2024-09-12T00:17:10.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.338+0000 7f4166528800 20 get_obj_state: octx=0x556b6141e940 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x556b614174b8 s->prefetch_data=0 2024-09-12T00:17:10.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.338+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b614174b8 2024-09-12T00:17:10.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.338+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4.0 2024-09-12T00:17:10.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.340+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.340+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=7895 stripe_ofs=7895 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.340+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18435194141957721611 2024-09-12T00:17:10.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.340+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.340+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.SUhj6XMqlLy6CfkwJ2AKlnnDW1iyCuZ_0 2024-09-12T00:17:10.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.340+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:17:10.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.340+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.340+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18435194141957721611 2024-09-12T00:17:10.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.342+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T00:17:10.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.342+0000 7f4166528800 20 get_obj_state: octx=0x556b614124e0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x556b614174b8 s->prefetch_data=0 2024-09-12T00:17:10.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.342+0000 7f4166528800 10 manifest: total_size = 7739 2024-09-12T00:17:10.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.342+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18208721276073510748 2024-09-12T00:17:10.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.342+0000 7f4166528800 20 get_obj_state: octx=0x556b614124e0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x556b614174b8 s->prefetch_data=0 2024-09-12T00:17:10.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.342+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b614174b8 2024-09-12T00:17:10.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.342+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4.0 2024-09-12T00:17:10.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.345+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.345+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=7739 stripe_ofs=7739 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.345+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18208721276073510748 2024-09-12T00:17:10.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.345+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.345+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.NRejX9C6Y1Px1M_tNd3G5CCotk180yM_0 2024-09-12T00:17:10.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.345+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:17:10.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.345+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.345+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18208721276073510748 2024-09-12T00:17:10.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.346+0000 7f40457fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:17:10.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.347+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063c40 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x556b614174b8 s->prefetch_data=0 2024-09-12T00:17:10.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.347+0000 7f4166528800 10 manifest: total_size = 5373 2024-09-12T00:17:10.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.347+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13642781602211229377 2024-09-12T00:17:10.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.347+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063c40 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x556b614174b8 s->prefetch_data=0 2024-09-12T00:17:10.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.347+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b614174b8 2024-09-12T00:17:10.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.347+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4.0 2024-09-12T00:17:10.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.349+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.349+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5373 stripe_ofs=5373 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.349+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13642781602211229377 2024-09-12T00:17:10.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.349+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.349+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.r8RlORvEtOF_RwhsHaRoeSAFNAdUo88_0 2024-09-12T00:17:10.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.349+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:17:10.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.349+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.349+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13642781602211229377 2024-09-12T00:17:10.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.350+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T00:17:10.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.351+0000 7f4166528800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:17:10.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.351+0000 7f4166528800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:17:10.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.351+0000 7f4166528800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:17:10.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.351+0000 7f4166528800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:17:10.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.351+0000 7f4166528800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:17:10.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.351+0000 7f4166528800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:17:10.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.351+0000 7f4166528800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4])"; uploads.size()=0; is_truncated=0 2024-09-12T00:17:10.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.352+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T00:17:10.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.352+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.353+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T00:17:10.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.353+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T00:17:10.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.353+0000 7f4166528800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T00:17:10.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.354+0000 7f4166528800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T00:17:10.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.354+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T00:17:10.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.354+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562428 cookie 93919681265696 notifier 5645 bl.length()=162 2024-09-12T00:17:10.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.355+0000 7f4166528800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4 from cache 2024-09-12T00:17:10.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.355+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4, ofs0, ns] 2024-09-12T00:17:10.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.356+0000 7f4045ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562387 cookie 93919681287792 notifier 5645 bl.length()=219 2024-09-12T00:17:10.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.357+0000 7f4166528800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4 : miss 2024-09-12T00:17:10.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.357+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.357+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.357+0000 7f4166528800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4 info.flags=0x0 2024-09-12T00:17:10.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.357+0000 7f4166528800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4 to cache LRU end 2024-09-12T00:17:10.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.359+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11 : miss 2024-09-12T00:17:10.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.359+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.360+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T00:17:10.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.360+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11 info.flags=0x17 2024-09-12T00:17:10.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.360+0000 7f4166528800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11 to cache LRU end 2024-09-12T00:17:10.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.360+0000 7f4166528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:10.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.360+0000 7f4166528800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:17:10.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.360+0000 7f4166528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11 2024-09-12T00:17:10.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.360+0000 7f4166528800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:17:10.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.360+0000 7f4166528800 20 get_obj_state: octx=0x556b6141d4c0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x556b61416f28 s->prefetch_data=0 2024-09-12T00:17:10.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.360+0000 7f4166528800 10 manifest: total_size = 1667 2024-09-12T00:17:10.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.360+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6663266903519560550 2024-09-12T00:17:10.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.360+0000 7f4166528800 20 get_obj_state: octx=0x556b6141d4c0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x556b61416f28 s->prefetch_data=0 2024-09-12T00:17:10.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.360+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61416f28 2024-09-12T00:17:10.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.360+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11.0 2024-09-12T00:17:10.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:17:10.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T00:17:10.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:17:10.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:17:10.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T00:17:10.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T00:17:10.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:17:10.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-12T00:17:10.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T00:17:10.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T00:17:10.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-12T00:17:10.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T00:17:10.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6663266903519560550 2024-09-12T00:17:10.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11__multipart_foo.2~2mt8P5vX3fUl7B1PcG4_ifgGBqG_Ymh.1 2024-09-12T00:17:10.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:17:10.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11__multipart_foo.2~2mt8P5vX3fUl7B1PcG4_ifgGBqG_Ymh.2 2024-09-12T00:17:10.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:17:10.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11__multipart_foo.2~2mt8P5vX3fUl7B1PcG4_ifgGBqG_Ymh.3 2024-09-12T00:17:10.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:17:10.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11__multipart_foo.2~2mt8P5vX3fUl7B1PcG4_ifgGBqG_Ymh.4 2024-09-12T00:17:10.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:17:10.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.363+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6663266903519560550 2024-09-12T00:17:10.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.364+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:17:10.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.365+0000 7f4166528800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:17:10.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.365+0000 7f4166528800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:17:10.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.365+0000 7f4166528800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:17:10.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.365+0000 7f4166528800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:17:10.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.365+0000 7f4166528800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:17:10.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.365+0000 7f4166528800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:17:10.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.365+0000 7f4166528800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11])"; uploads.size()=0; is_truncated=0 2024-09-12T00:17:10.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.367+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T00:17:10.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.367+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.367+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T00:17:10.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.367+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T00:17:10.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.367+0000 7f4166528800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T00:17:10.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.368+0000 7f4166528800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T00:17:10.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.368+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T00:17:10.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.369+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562447 cookie 93919681269792 notifier 5645 bl.length()=191 2024-09-12T00:17:10.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.370+0000 7f4166528800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11 from cache 2024-09-12T00:17:10.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.370+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11, ofs0, ns] 2024-09-12T00:17:10.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.370+0000 7f4045ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562388 cookie 93919681287792 notifier 5645 bl.length()=249 2024-09-12T00:17:10.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.371+0000 7f4166528800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11 : miss 2024-09-12T00:17:10.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.371+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.372+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.372+0000 7f4166528800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11 info.flags=0x0 2024-09-12T00:17:10.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.372+0000 7f4166528800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11 to cache LRU end 2024-09-12T00:17:10.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.374+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12 : miss 2024-09-12T00:17:10.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.374+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.374+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T00:17:10.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.374+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12 info.flags=0x17 2024-09-12T00:17:10.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.374+0000 7f4166528800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12 to cache LRU end 2024-09-12T00:17:10.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.374+0000 7f4166528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:10.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.374+0000 7f4166528800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:17:10.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.374+0000 7f4166528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12 2024-09-12T00:17:10.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.375+0000 7f4166528800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:17:10.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.375+0000 7f4166528800 20 get_obj_state: octx=0x7f414c060620 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.375+0000 7f4166528800 10 manifest: total_size = 1667 2024-09-12T00:17:10.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.375+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5081495957436820623 2024-09-12T00:17:10.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.375+0000 7f4166528800 20 get_obj_state: octx=0x7f414c060620 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.375+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61421a98 2024-09-12T00:17:10.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.375+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12.0 2024-09-12T00:17:10.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:17:10.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T00:17:10.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:17:10.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:17:10.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T00:17:10.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T00:17:10.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:17:10.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-12T00:17:10.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T00:17:10.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T00:17:10.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-12T00:17:10.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T00:17:10.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5081495957436820623 2024-09-12T00:17:10.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12__multipart_foo.2~JLYIf8thVUjjzH8CIRV7gHVokajsy6x.1 2024-09-12T00:17:10.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:17:10.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12__multipart_foo.2~JLYIf8thVUjjzH8CIRV7gHVokajsy6x.2 2024-09-12T00:17:10.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:17:10.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12__multipart_foo.2~JLYIf8thVUjjzH8CIRV7gHVokajsy6x.3 2024-09-12T00:17:10.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:17:10.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12__multipart_foo.2~JLYIf8thVUjjzH8CIRV7gHVokajsy6x.4 2024-09-12T00:17:10.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:17:10.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.378+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5081495957436820623 2024-09-12T00:17:10.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.379+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:17:10.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.379+0000 7f4166528800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:17:10.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.379+0000 7f4166528800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:17:10.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.380+0000 7f4166528800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:17:10.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.380+0000 7f4166528800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:17:10.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.380+0000 7f4166528800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:17:10.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.380+0000 7f4166528800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:17:10.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.380+0000 7f4166528800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12])"; uploads.size()=0; is_truncated=0 2024-09-12T00:17:10.380 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.381+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T00:17:10.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.381+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.381+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T00:17:10.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.381+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T00:17:10.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.381+0000 7f4166528800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T00:17:10.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.382+0000 7f4166528800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T00:17:10.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.382+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T00:17:10.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.383+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 93919681272544 notifier 5645 bl.length()=198 2024-09-12T00:17:10.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.384+0000 7f4166528800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12 from cache 2024-09-12T00:17:10.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.384+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12, ofs0, ns] 2024-09-12T00:17:10.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.384+0000 7f4045ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562448 cookie 93919681276608 notifier 5645 bl.length()=256 2024-09-12T00:17:10.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.386+0000 7f4166528800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12 : miss 2024-09-12T00:17:10.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.386+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.386+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.386+0000 7f4166528800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12 info.flags=0x0 2024-09-12T00:17:10.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.386+0000 7f4166528800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12 to cache LRU end 2024-09-12T00:17:10.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.388+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10 : miss 2024-09-12T00:17:10.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.388+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.389+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T00:17:10.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.389+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10 info.flags=0x17 2024-09-12T00:17:10.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.389+0000 7f4166528800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10 to cache LRU end 2024-09-12T00:17:10.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.389+0000 7f4166528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:10.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.389+0000 7f4166528800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:17:10.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.389+0000 7f4166528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10 2024-09-12T00:17:10.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.389+0000 7f4166528800 10 cls_bucket_list_unordered: got foo[Qu73Vb3-9DDsYn5HTm3vZUYg40VwwEo] 2024-09-12T00:17:10.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.389+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10.0 2024-09-12T00:17:10.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.389+0000 7f4166528800 20 get_obj_state: octx=0x7f415c066d40 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.390+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to 83tga5ptz77723nhkab2ytsm8qfalp1q 2024-09-12T00:17:10.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.390+0000 7f4166528800 20 get_obj_state_impl: setting s->olh_tag to 5hmmjlx62bc1qtx59kuoxa0cpvqt9ozv 2024-09-12T00:17:10.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.390+0000 7f4166528800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=5hmmjlx62bc1qtx59kuoxa0cpvqt9ozv 2024-09-12T00:17:10.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.391+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10.0 2024-09-12T00:17:10.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.392+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10.0 2024-09-12T00:17:10.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.393+0000 7f4166528800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T00:17:10.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.393+0000 7f4166528800 20 olh_log_entry: epoch=3 op=3 key=foo[Qu73Vb3-9DDsYn5HTm3vZUYg40VwwEo] 2024-09-12T00:17:10.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.393+0000 7f4166528800 20 get_obj_state: octx=0x7f415c066d40 obj=test-client.0-r-test-multipart-index-versioning.1:_:Qu73Vb3-9DDsYn5HTm3vZUYg40VwwEo_foo state=0x556b61429a28 s->prefetch_data=0 2024-09-12T00:17:10.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.393+0000 7f4166528800 10 manifest: total_size = 74198 2024-09-12T00:17:10.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.393+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6546225208223285114 2024-09-12T00:17:10.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.393+0000 7f4166528800 20 get_obj_state: octx=0x7f415c066d40 obj=test-client.0-r-test-multipart-index-versioning.1:_:Qu73Vb3-9DDsYn5HTm3vZUYg40VwwEo_foo state=0x556b61429a28 s->prefetch_data=0 2024-09-12T00:17:10.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.393+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61429a28 2024-09-12T00:17:10.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.393+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10.0 2024-09-12T00:17:10.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:17:10.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T00:17:10.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:17:10.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:17:10.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T00:17:10.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T00:17:10.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:17:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-12T00:17:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T00:17:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T00:17:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-12T00:17:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T00:17:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6546225208223285114 2024-09-12T00:17:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10__multipart_foo.2~VUFoh8XPOKbac87fYhuX_DrYUTcxIQ3.1 2024-09-12T00:17:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:17:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10__multipart_foo.2~VUFoh8XPOKbac87fYhuX_DrYUTcxIQ3.2 2024-09-12T00:17:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:17:10.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10__multipart_foo.2~VUFoh8XPOKbac87fYhuX_DrYUTcxIQ3.3 2024-09-12T00:17:10.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:17:10.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10__multipart_foo.2~VUFoh8XPOKbac87fYhuX_DrYUTcxIQ3.4 2024-09-12T00:17:10.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:17:10.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.395+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.396+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6546225208223285114 2024-09-12T00:17:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.397+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo[Qu73Vb3-9DDsYn5HTm3vZUYg40VwwEo] 2024-09-12T00:17:10.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.398+0000 7f4166528800 20 get_obj_state: octx=0x7f415c066d40 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.400+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10.0 2024-09-12T00:17:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.401+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10.0 2024-09-12T00:17:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.401+0000 7f4166528800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:17:10.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.401+0000 7f4166528800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:17:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.401+0000 7f4166528800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:17:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.401+0000 7f4166528800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:17:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.401+0000 7f4166528800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:17:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.401+0000 7f4166528800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:17:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.401+0000 7f4166528800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10])"; uploads.size()=0; is_truncated=0 2024-09-12T00:17:10.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.402+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T00:17:10.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.402+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.403+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T00:17:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.403+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T00:17:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.403+0000 7f4166528800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T00:17:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.404+0000 7f4166528800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T00:17:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.404+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T00:17:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.404+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562395 cookie 93919681272544 notifier 5645 bl.length()=193 2024-09-12T00:17:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.406+0000 7f4166528800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10 from cache 2024-09-12T00:17:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.406+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10, ofs0, ns] 2024-09-12T00:17:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.406+0000 7f4045ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562396 cookie 93919681272544 notifier 5645 bl.length()=251 2024-09-12T00:17:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.407+0000 7f4166528800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10 : miss 2024-09-12T00:17:10.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.407+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.408+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.408+0000 7f4166528800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10 info.flags=0x0 2024-09-12T00:17:10.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.408+0000 7f4166528800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10 to cache LRU end 2024-09-12T00:17:10.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.410+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9 : miss 2024-09-12T00:17:10.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.410+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.410+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:17:10.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.410+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9 info.flags=0x17 2024-09-12T00:17:10.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.410+0000 7f4166528800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9 to cache LRU end 2024-09-12T00:17:10.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.410+0000 7f4166528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:10.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.410+0000 7f4166528800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:17:10.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.410+0000 7f4166528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9 2024-09-12T00:17:10.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.411+0000 7f4166528800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:17:10.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.411+0000 7f4166528800 20 get_obj_state: octx=0x7f414c08c590 obj=test-client.0-r-test-multipart-simple.1:foo state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.411+0000 7f4166528800 10 manifest: total_size = 26078 2024-09-12T00:17:10.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.411+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.844547769493095040 2024-09-12T00:17:10.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.411+0000 7f4166528800 20 get_obj_state: octx=0x7f414c08c590 obj=test-client.0-r-test-multipart-simple.1:foo state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.411+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61421a98 2024-09-12T00:17:10.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.411+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9.0 2024-09-12T00:17:10.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-09-12T00:17:10.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2024-09-12T00:17:10.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7668 2024-09-12T00:17:10.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=7668 rules.size()=4 2024-09-12T00:17:10.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6299127 part_ofs=7671 rule->part_size=7668 2024-09-12T00:17:10.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=15339 stripe_ofs=15339 part_ofs=15339 rule->part_size=7672 2024-09-12T00:17:10.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-12T00:17:10.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6306795 part_ofs=15339 rule->part_size=7672 2024-09-12T00:17:10.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=23011 stripe_ofs=23011 part_ofs=23011 rule->part_size=3067 2024-09-12T00:17:10.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-12T00:17:10.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6314467 part_ofs=23011 rule->part_size=3067 2024-09-12T00:17:10.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=26078 stripe_ofs=26078 part_ofs=26078 rule->part_size=3067 2024-09-12T00:17:10.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.844547769493095040 2024-09-12T00:17:10.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9__multipart_foo.2~IXQ-idoVse8yJQiwkcC3efu7s6NvGI8.1 2024-09-12T00:17:10.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 343 2024-09-12T00:17:10.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9__multipart_foo.2~IXQ-idoVse8yJQiwkcC3efu7s6NvGI8.2 2024-09-12T00:17:10.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 587 2024-09-12T00:17:10.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9__multipart_foo.2~IXQ-idoVse8yJQiwkcC3efu7s6NvGI8.3 2024-09-12T00:17:10.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 831 2024-09-12T00:17:10.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9__multipart_foo.2~IXQ-idoVse8yJQiwkcC3efu7s6NvGI8.4 2024-09-12T00:17:10.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1075 2024-09-12T00:17:10.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.413+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.844547769493095040 2024-09-12T00:17:10.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.415+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:17:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.415+0000 7f4166528800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:17:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.415+0000 7f4166528800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:17:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.415+0000 7f4166528800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:17:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.415+0000 7f4166528800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:17:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.415+0000 7f4166528800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:17:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.415+0000 7f4166528800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:17:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.415+0000 7f4166528800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9])"; uploads.size()=0; is_truncated=0 2024-09-12T00:17:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.416+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T00:17:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.416+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.417+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:17:10.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.417+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T00:17:10.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.417+0000 7f4166528800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T00:17:10.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.418+0000 7f4166528800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T00:17:10.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.418+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T00:17:10.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.418+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562449 cookie 93919681276608 notifier 5645 bl.length()=183 2024-09-12T00:17:10.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.420+0000 7f4166528800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9 from cache 2024-09-12T00:17:10.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.420+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9, ofs0, ns] 2024-09-12T00:17:10.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.420+0000 7f4045ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562389 cookie 93919681282448 notifier 5645 bl.length()=240 2024-09-12T00:17:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.423+0000 7f4166528800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9 : miss 2024-09-12T00:17:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.423+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.423+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.423+0000 7f4166528800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9 info.flags=0x0 2024-09-12T00:17:10.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.423+0000 7f4166528800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9 to cache LRU end 2024-09-12T00:17:10.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.425+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15 : miss 2024-09-12T00:17:10.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.425+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.425+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:17:10.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.425+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15 info.flags=0x17 2024-09-12T00:17:10.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.425+0000 7f4166528800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15 to cache LRU end 2024-09-12T00:17:10.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.425+0000 7f4166528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:10.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.425+0000 7f4166528800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:17:10.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.425+0000 7f4166528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15 2024-09-12T00:17:10.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:17:10.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:17:10.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:17:10.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:17:10.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:17:10.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:17:10.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:17:10.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:17:10.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:17:10.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:17:10.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:17:10.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:17:10.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 20 get_obj_state: octx=0x556b613dab90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 10 manifest: total_size = 5242880 2024-09-12T00:17:10.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17599000181439824352 2024-09-12T00:17:10.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 20 get_obj_state: octx=0x556b613dab90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61421a98 2024-09-12T00:17:10.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.426+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15.0 2024-09-12T00:17:10.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.429+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.429+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.429+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17599000181439824352 2024-09-12T00:17:10.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.429+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.429+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.vOAufwm3RgCNFJYw6v3V51rXscFwVZh_0 2024-09-12T00:17:10.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.429+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:17:10.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.429+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.429+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17599000181439824352 2024-09-12T00:17:10.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.430+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:17:10.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.430+0000 7f4166528800 20 get_obj_state: octx=0x556b613dab90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.431+0000 7f4166528800 10 manifest: total_size = 5242880 2024-09-12T00:17:10.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.431+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18061739891822321467 2024-09-12T00:17:10.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.431+0000 7f4166528800 20 get_obj_state: octx=0x556b613dab90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.431+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61421a98 2024-09-12T00:17:10.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.431+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15.0 2024-09-12T00:17:10.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.433+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.433+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.433+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18061739891822321467 2024-09-12T00:17:10.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.433+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.433+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.vOAufwm3RgCNFJYw6v3V51rXscFwVZh_0 2024-09-12T00:17:10.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.433+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:17:10.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.433+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.433+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18061739891822321467 2024-09-12T00:17:10.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.434+0000 7f40457fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:17:10.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.434+0000 7f4166528800 20 get_obj_state: octx=0x556b61417800 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.435+0000 7f4166528800 10 manifest: total_size = 5242880 2024-09-12T00:17:10.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.435+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to _o8GG0lsR-dSXtuSl_rzM4SLm8KKl7Cy 2024-09-12T00:17:10.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.435+0000 7f4166528800 20 get_obj_state: octx=0x556b61417800 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.435+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61421a98 2024-09-12T00:17:10.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.435+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15.0 2024-09-12T00:17:10.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.437+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.437+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.437+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: _o8GG0lsR-dSXtuSl_rzM4SLm8KKl7Cy 2024-09-12T00:17:10.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.437+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.437+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.BTVooYDstqajOrnoqtpzSdlR93K-lgn_0 2024-09-12T00:17:10.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.437+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:17:10.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.437+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.437+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _o8GG0lsR-dSXtuSl_rzM4SLm8KKl7Cy 2024-09-12T00:17:10.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.438+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:17:10.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.439+0000 7f4166528800 20 get_obj_state: octx=0x556b61417800 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.439+0000 7f4166528800 10 manifest: total_size = 5242880 2024-09-12T00:17:10.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.439+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to _lN10VIgzPwWO6Y8CrzwsaGm2hH6IEHU 2024-09-12T00:17:10.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.439+0000 7f4166528800 20 get_obj_state: octx=0x556b61417800 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.439+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61421a98 2024-09-12T00:17:10.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.439+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15.0 2024-09-12T00:17:10.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.442+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.442+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.442+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: _lN10VIgzPwWO6Y8CrzwsaGm2hH6IEHU 2024-09-12T00:17:10.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.442+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.442+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.B9vxmkI8x8VvnUe6TgVT6otznmLPbuZ_0 2024-09-12T00:17:10.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.442+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:17:10.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.442+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.442+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _lN10VIgzPwWO6Y8CrzwsaGm2hH6IEHU 2024-09-12T00:17:10.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.443+0000 7f4166528800 20 get_obj_state: octx=0x556b613dab90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.443+0000 7f40457fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:17:10.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.443+0000 7f4166528800 10 manifest: total_size = 5242880 2024-09-12T00:17:10.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.443+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13287149950113972360 2024-09-12T00:17:10.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.443+0000 7f4166528800 20 get_obj_state: octx=0x556b613dab90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.443+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61421a98 2024-09-12T00:17:10.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.443+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15.0 2024-09-12T00:17:10.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.446+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.446+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.446+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13287149950113972360 2024-09-12T00:17:10.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.446+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.446+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.IJCw_FVUPsZv_rripl9Nn8Y2TRjwCmW_0 2024-09-12T00:17:10.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.446+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:17:10.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.446+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.446+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13287149950113972360 2024-09-12T00:17:10.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.447+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:17:10.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.447+0000 7f4166528800 20 get_obj_state: octx=0x556b61413c30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.448+0000 7f4166528800 10 manifest: total_size = 5242880 2024-09-12T00:17:10.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.448+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to _ZHx7urWTDuxvId0XNCaspnAFeKU9Adf 2024-09-12T00:17:10.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.448+0000 7f4166528800 20 get_obj_state: octx=0x556b61413c30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.448+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61421a98 2024-09-12T00:17:10.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.448+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15.0 2024-09-12T00:17:10.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.450+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.450+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.450+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: _ZHx7urWTDuxvId0XNCaspnAFeKU9Adf 2024-09-12T00:17:10.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.450+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.450+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.g_tZbNPUbvbzYJUQ-esO9R6eCtIfRGF_0 2024-09-12T00:17:10.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.450+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:17:10.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.450+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.450+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _ZHx7urWTDuxvId0XNCaspnAFeKU9Adf 2024-09-12T00:17:10.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.451+0000 7f40457fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:17:10.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.451+0000 7f4166528800 20 get_obj_state: octx=0x7f415c066d40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.452+0000 7f4166528800 10 manifest: total_size = 5242880 2024-09-12T00:17:10.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.452+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16184568788611412005 2024-09-12T00:17:10.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.452+0000 7f4166528800 20 get_obj_state: octx=0x7f415c066d40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.452+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61421a98 2024-09-12T00:17:10.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.452+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15.0 2024-09-12T00:17:10.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.454+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.454+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.454+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16184568788611412005 2024-09-12T00:17:10.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.454+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.454+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.IJCw_FVUPsZv_rripl9Nn8Y2TRjwCmW_0 2024-09-12T00:17:10.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.454+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:17:10.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.454+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.454+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16184568788611412005 2024-09-12T00:17:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.455+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:17:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.456+0000 7f4166528800 20 get_obj_state: octx=0x7f415c066d40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.456+0000 7f4166528800 10 manifest: total_size = 5242880 2024-09-12T00:17:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.456+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to _Hm1Yd-yS5lbUgZE9EDbNA7HA95WfOcP 2024-09-12T00:17:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.456+0000 7f4166528800 20 get_obj_state: octx=0x7f415c066d40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.456+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61421a98 2024-09-12T00:17:10.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.456+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15.0 2024-09-12T00:17:10.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.458+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.458+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.458+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: _Hm1Yd-yS5lbUgZE9EDbNA7HA95WfOcP 2024-09-12T00:17:10.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.458+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.458+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.Q1Gy028-ru7pmDgNtJUO7DDsnf3Hul9_0 2024-09-12T00:17:10.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.458+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:17:10.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.458+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.458+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _Hm1Yd-yS5lbUgZE9EDbNA7HA95WfOcP 2024-09-12T00:17:10.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.459+0000 7f40457fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:17:10.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.460+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063c40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.460+0000 7f4166528800 10 manifest: total_size = 27199 2024-09-12T00:17:10.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.460+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9445920949108672434 2024-09-12T00:17:10.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.460+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063c40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.460+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61421a98 2024-09-12T00:17:10.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.460+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15.0 2024-09-12T00:17:10.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.463+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.463+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=27199 stripe_ofs=27199 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.463+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9445920949108672434 2024-09-12T00:17:10.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.463+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.463+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.YnmTbQdqQ-SwYpJdhF1b44o8oB7_tuo_0 2024-09-12T00:17:10.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.463+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T00:17:10.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.463+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.463+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9445920949108672434 2024-09-12T00:17:10.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.464+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:17:10.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.464+0000 7f4166528800 20 get_obj_state: octx=0x556b6141a8a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.464+0000 7f4166528800 10 manifest: total_size = 27199 2024-09-12T00:17:10.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.464+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to _Y5XhdlY9773n4sKwCkBpRp1aCL31goU 2024-09-12T00:17:10.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.464+0000 7f4166528800 20 get_obj_state: octx=0x556b6141a8a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.464+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61421a98 2024-09-12T00:17:10.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.464+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15.0 2024-09-12T00:17:10.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.467+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.467+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=27199 stripe_ofs=27199 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.467+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: _Y5XhdlY9773n4sKwCkBpRp1aCL31goU 2024-09-12T00:17:10.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.467+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.467+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.hkMfXNNdU55kcekFvQaFDDr-13AcOW1_0 2024-09-12T00:17:10.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.467+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:17:10.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.467+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.467+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _Y5XhdlY9773n4sKwCkBpRp1aCL31goU 2024-09-12T00:17:10.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.468+0000 7f40457fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:17:10.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.468+0000 7f4166528800 20 get_obj_state: octx=0x556b6141a8a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.468+0000 7f4166528800 10 manifest: total_size = 27199 2024-09-12T00:17:10.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.468+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to _iufA0rYOorKmORSnaD8JpTS2e2oN93X 2024-09-12T00:17:10.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.468+0000 7f4166528800 20 get_obj_state: octx=0x556b6141a8a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.468+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61421a98 2024-09-12T00:17:10.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.469+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15.0 2024-09-12T00:17:10.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.471+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.471+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=27199 stripe_ofs=27199 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.471+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: _iufA0rYOorKmORSnaD8JpTS2e2oN93X 2024-09-12T00:17:10.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.471+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.471+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.pOLjBZ7giBOvNsfxS_CW9MRaqgcBPzf_0 2024-09-12T00:17:10.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.471+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:17:10.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.471+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.471+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _iufA0rYOorKmORSnaD8JpTS2e2oN93X 2024-09-12T00:17:10.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.472+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:17:10.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.473+0000 7f4166528800 20 get_obj_state: octx=0x556b61413c30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.473+0000 7f4166528800 10 manifest: total_size = 27199 2024-09-12T00:17:10.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.473+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14022861258467132135 2024-09-12T00:17:10.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.473+0000 7f4166528800 20 get_obj_state: octx=0x556b61413c30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x556b61421a98 s->prefetch_data=0 2024-09-12T00:17:10.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.473+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61421a98 2024-09-12T00:17:10.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.473+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15.0 2024-09-12T00:17:10.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.475+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.475+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=27199 stripe_ofs=27199 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.475+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14022861258467132135 2024-09-12T00:17:10.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.475+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.475+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.YnmTbQdqQ-SwYpJdhF1b44o8oB7_tuo_0 2024-09-12T00:17:10.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.475+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:17:10.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.475+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.475+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14022861258467132135 2024-09-12T00:17:10.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.477+0000 7f40457fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:17:10.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.477+0000 7f4166528800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:17:10.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.477+0000 7f4166528800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:17:10.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.477+0000 7f4166528800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:17:10.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.477+0000 7f4166528800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:17:10.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.477+0000 7f4166528800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:17:10.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.477+0000 7f4166528800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:17:10.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.477+0000 7f4166528800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15])"; uploads.size()=0; is_truncated=0 2024-09-12T00:17:10.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.479+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T00:17:10.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.479+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.480+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T00:17:10.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.480+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T00:17:10.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.480+0000 7f4166528800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T00:17:10.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.481+0000 7f4166528800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T00:17:10.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.481+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T00:17:10.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.481+0000 7f4045ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562397 cookie 93919681272544 notifier 5645 bl.length()=189 2024-09-12T00:17:10.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.482+0000 7f4166528800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15 from cache 2024-09-12T00:17:10.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.482+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15, ofs0, ns] 2024-09-12T00:17:10.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.483+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562398 cookie 93919681272544 notifier 5645 bl.length()=247 2024-09-12T00:17:10.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.484+0000 7f4166528800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15 : miss 2024-09-12T00:17:10.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.484+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.484+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.484+0000 7f4166528800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15 info.flags=0x0 2024-09-12T00:17:10.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.484+0000 7f4166528800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15 to cache LRU end 2024-09-12T00:17:10.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.486+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16 : miss 2024-09-12T00:17:10.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.486+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:17:10.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16 info.flags=0x17 2024-09-12T00:17:10.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16 to cache LRU end 2024-09-12T00:17:10.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:10.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:17:10.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16 2024-09-12T00:17:10.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:17:10.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:17:10.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:17:10.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:17:10.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:17:10.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:17:10.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:17:10.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:17:10.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:17:10.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:17:10.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:17:10.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:17:10.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.487+0000 7f4166528800 20 get_obj_state: octx=0x556b614212a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.488+0000 7f4166528800 10 manifest: total_size = 11534336 2024-09-12T00:17:10.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.488+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5375310947842992831 2024-09-12T00:17:10.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.488+0000 7f4166528800 20 get_obj_state: octx=0x556b614212a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.488+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127f5e8 2024-09-12T00:17:10.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.488+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16.0 2024-09-12T00:17:10.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:17:10.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:17:10.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:17:10.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:17:10.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:17:10.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:17:10.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:17:10.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:17:10.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:17:10.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5375310947842992831 2024-09-12T00:17:10.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-FROZEN.2~sIcHF2inUJKAFYg19ZFLRgtZXnaKUP8.1 2024-09-12T00:17:10.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:17:10.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-FROZEN.2~sIcHF2inUJKAFYg19ZFLRgtZXnaKUP8.2 2024-09-12T00:17:10.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T00:17:10.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-FROZEN.2~sIcHF2inUJKAFYg19ZFLRgtZXnaKUP8.3 2024-09-12T00:17:10.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T00:17:10.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.490+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5375310947842992831 2024-09-12T00:17:10.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.491+0000 7f40457fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:17:10.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.491+0000 7f4166528800 20 get_obj_state: octx=0x7f415c09d630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.492+0000 7f4166528800 10 manifest: total_size = 11534336 2024-09-12T00:17:10.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.492+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16138576808649423202 2024-09-12T00:17:10.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.492+0000 7f4166528800 20 get_obj_state: octx=0x7f415c09d630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.492+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127f5e8 2024-09-12T00:17:10.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.492+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16.0 2024-09-12T00:17:10.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:17:10.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:17:10.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:17:10.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:17:10.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:17:10.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:17:10.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:17:10.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:17:10.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:17:10.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16138576808649423202 2024-09-12T00:17:10.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-FROZEN.2~sIcHF2inUJKAFYg19ZFLRgtZXnaKUP8.1 2024-09-12T00:17:10.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:17:10.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-FROZEN.2~sIcHF2inUJKAFYg19ZFLRgtZXnaKUP8.2 2024-09-12T00:17:10.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-12T00:17:10.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-FROZEN.2~sIcHF2inUJKAFYg19ZFLRgtZXnaKUP8.3 2024-09-12T00:17:10.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-12T00:17:10.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.494+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16138576808649423202 2024-09-12T00:17:10.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.495+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:17:10.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.495+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063b00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.496+0000 7f4166528800 10 manifest: total_size = 11534336 2024-09-12T00:17:10.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.496+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to _YbHyWBFZqUuPb4sLazkOzQgLcK68-M8 2024-09-12T00:17:10.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.496+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063b00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.496+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127f5e8 2024-09-12T00:17:10.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.496+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16.0 2024-09-12T00:17:10.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.498+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.498+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.498+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.498+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.498+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: _YbHyWBFZqUuPb4sLazkOzQgLcK68-M8 2024-09-12T00:17:10.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.498+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.498+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.GSuJlOUWZr3hyscZAwirvpfS5A7kwyc_0 2024-09-12T00:17:10.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.498+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:17:10.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.498+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.GSuJlOUWZr3hyscZAwirvpfS5A7kwyc_1 2024-09-12T00:17:10.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.498+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:17:10.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.498+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.498+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _YbHyWBFZqUuPb4sLazkOzQgLcK68-M8 2024-09-12T00:17:10.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.500+0000 7f4166528800 20 get_obj_state: octx=0x7f414c060620 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.500+0000 7f40457fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:17:10.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.500+0000 7f4166528800 10 manifest: total_size = 11534336 2024-09-12T00:17:10.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.500+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to _Go59nfED_3WDg1FT_pFVkEV9kBzFluy 2024-09-12T00:17:10.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.500+0000 7f4166528800 20 get_obj_state: octx=0x7f414c060620 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.500+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127f5e8 2024-09-12T00:17:10.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.500+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16.0 2024-09-12T00:17:10.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.503+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.503+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.503+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.503+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.503+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: _Go59nfED_3WDg1FT_pFVkEV9kBzFluy 2024-09-12T00:17:10.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.503+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.503+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.e3tQjNShJ7L5Re0U41OLyDJzXQI9aJC_0 2024-09-12T00:17:10.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.503+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:17:10.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.503+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.e3tQjNShJ7L5Re0U41OLyDJzXQI9aJC_1 2024-09-12T00:17:10.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.503+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:17:10.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.503+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.503+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _Go59nfED_3WDg1FT_pFVkEV9kBzFluy 2024-09-12T00:17:10.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.504+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:17:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.506+0000 7f4166528800 20 get_obj_state: octx=0x7f414c08bfe0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.506+0000 7f4166528800 10 manifest: total_size = 11534336 2024-09-12T00:17:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.506+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9026642825346727520 2024-09-12T00:17:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.506+0000 7f4166528800 20 get_obj_state: octx=0x7f414c08bfe0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.506+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127f5e8 2024-09-12T00:17:10.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.506+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16.0 2024-09-12T00:17:10.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:17:10.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:17:10.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:17:10.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:17:10.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:17:10.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:17:10.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:17:10.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:17:10.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:17:10.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9026642825346727520 2024-09-12T00:17:10.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-LUKEWARM.2~AhGggEpNPmAOYLbKRyTstpmdWYqNeRi.1 2024-09-12T00:17:10.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:17:10.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-LUKEWARM.2~AhGggEpNPmAOYLbKRyTstpmdWYqNeRi.2 2024-09-12T00:17:10.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-12T00:17:10.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-LUKEWARM.2~AhGggEpNPmAOYLbKRyTstpmdWYqNeRi.3 2024-09-12T00:17:10.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-12T00:17:10.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.509+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9026642825346727520 2024-09-12T00:17:10.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.510+0000 7f40457fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:17:10.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.510+0000 7f4166528800 20 get_obj_state: octx=0x556b61413c30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.510+0000 7f4166528800 10 manifest: total_size = 11534336 2024-09-12T00:17:10.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.510+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to _JG4PYlQpMlCfJSdGbPqqSS6d1cMV8hW 2024-09-12T00:17:10.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.510+0000 7f4166528800 20 get_obj_state: octx=0x556b61413c30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.510+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127f5e8 2024-09-12T00:17:10.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.510+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16.0 2024-09-12T00:17:10.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.513+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.513+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.513+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.513+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.513+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: _JG4PYlQpMlCfJSdGbPqqSS6d1cMV8hW 2024-09-12T00:17:10.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.513+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.513+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.msQiyBSHO7j6OlmKyK6BlT3zla80yI4_0 2024-09-12T00:17:10.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.513+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:17:10.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.513+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.msQiyBSHO7j6OlmKyK6BlT3zla80yI4_1 2024-09-12T00:17:10.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.513+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:17:10.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.513+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.513+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _JG4PYlQpMlCfJSdGbPqqSS6d1cMV8hW 2024-09-12T00:17:10.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.514+0000 7f4166528800 20 get_obj_state: octx=0x7f414c060620 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.514+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:17:10.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.515+0000 7f4166528800 10 manifest: total_size = 11534336 2024-09-12T00:17:10.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.515+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15381223345067176499 2024-09-12T00:17:10.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.515+0000 7f4166528800 20 get_obj_state: octx=0x7f414c060620 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.515+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127f5e8 2024-09-12T00:17:10.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.515+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16.0 2024-09-12T00:17:10.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:17:10.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:17:10.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:17:10.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:17:10.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:17:10.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:17:10.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:17:10.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:17:10.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:17:10.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15381223345067176499 2024-09-12T00:17:10.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-LUKEWARM.2~AhGggEpNPmAOYLbKRyTstpmdWYqNeRi.1 2024-09-12T00:17:10.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:17:10.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-LUKEWARM.2~AhGggEpNPmAOYLbKRyTstpmdWYqNeRi.2 2024-09-12T00:17:10.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-12T00:17:10.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-LUKEWARM.2~AhGggEpNPmAOYLbKRyTstpmdWYqNeRi.3 2024-09-12T00:17:10.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-12T00:17:10.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.517+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15381223345067176499 2024-09-12T00:17:10.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.518+0000 7f40457fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:17:10.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.520+0000 7f4166528800 20 get_obj_state: octx=0x556b61280110 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.520+0000 7f4166528800 10 manifest: total_size = 11534336 2024-09-12T00:17:10.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.520+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to _zEn5BymptQLPOe0Ccc4Iv568f5sRoby 2024-09-12T00:17:10.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.520+0000 7f4166528800 20 get_obj_state: octx=0x556b61280110 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.520+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127f5e8 2024-09-12T00:17:10.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.520+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16.0 2024-09-12T00:17:10.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.522+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.522+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.522+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.522+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.522+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: _zEn5BymptQLPOe0Ccc4Iv568f5sRoby 2024-09-12T00:17:10.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.522+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.522+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.ieCU9R1Z5kVTdoivphmB_C-3f9IS6_m_0 2024-09-12T00:17:10.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.522+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:17:10.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.522+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.ieCU9R1Z5kVTdoivphmB_C-3f9IS6_m_1 2024-09-12T00:17:10.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.522+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:17:10.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.522+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.522+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _zEn5BymptQLPOe0Ccc4Iv568f5sRoby 2024-09-12T00:17:10.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.524+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:17:10.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.524+0000 7f4166528800 20 get_obj_state: octx=0x7f414c075f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.524+0000 7f4166528800 10 manifest: total_size = 45360 2024-09-12T00:17:10.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.524+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3792881447123768246 2024-09-12T00:17:10.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.524+0000 7f4166528800 20 get_obj_state: octx=0x7f414c075f80 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.524+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127f5e8 2024-09-12T00:17:10.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.524+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16.0 2024-09-12T00:17:10.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:17:10.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T00:17:10.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:17:10.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:17:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T00:17:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-12T00:17:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-12T00:17:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2024-09-12T00:17:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-12T00:17:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3792881447123768246 2024-09-12T00:17:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-STANDARD.2~aHqUWSYdKe1S-x9yY0MsASwii3H_QZY.1 2024-09-12T00:17:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T00:17:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-STANDARD.2~aHqUWSYdKe1S-x9yY0MsASwii3H_QZY.2 2024-09-12T00:17:10.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T00:17:10.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-STANDARD.2~aHqUWSYdKe1S-x9yY0MsASwii3H_QZY.3 2024-09-12T00:17:10.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T00:17:10.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.527+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3792881447123768246 2024-09-12T00:17:10.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.528+0000 7f40457fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:17:10.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.528+0000 7f4166528800 20 get_obj_state: octx=0x556b61424fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.528+0000 7f4166528800 10 manifest: total_size = 45360 2024-09-12T00:17:10.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.528+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to _sLSNSI_CbG9EVO0Hc_-Gj8l5I5V-QRU 2024-09-12T00:17:10.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.528+0000 7f4166528800 20 get_obj_state: octx=0x556b61424fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.528+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127f5e8 2024-09-12T00:17:10.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.528+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16.0 2024-09-12T00:17:10.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.531+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.531+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.531+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: _sLSNSI_CbG9EVO0Hc_-Gj8l5I5V-QRU 2024-09-12T00:17:10.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.531+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.531+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.zeMKtiELy-LgOw1zmw_BaELJ97jLsYK_0 2024-09-12T00:17:10.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.531+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:17:10.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.531+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.531+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _sLSNSI_CbG9EVO0Hc_-Gj8l5I5V-QRU 2024-09-12T00:17:10.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.532+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:17:10.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.532+0000 7f4166528800 20 get_obj_state: octx=0x556b61424fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.533+0000 7f4166528800 10 manifest: total_size = 45360 2024-09-12T00:17:10.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.533+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to _z9-ejIDhAGHnMJnpjsVn2ZM5MueHa6H 2024-09-12T00:17:10.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.533+0000 7f4166528800 20 get_obj_state: octx=0x556b61424fc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.533+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127f5e8 2024-09-12T00:17:10.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.533+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16.0 2024-09-12T00:17:10.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.535+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.535+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.535+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: _z9-ejIDhAGHnMJnpjsVn2ZM5MueHa6H 2024-09-12T00:17:10.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.535+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.535+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.jpCGXokVTBD3Ybr3yIvmXEUHDOkwsq__0 2024-09-12T00:17:10.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.535+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:17:10.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.535+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.535+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _z9-ejIDhAGHnMJnpjsVn2ZM5MueHa6H 2024-09-12T00:17:10.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.536+0000 7f40457fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:17:10.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.536+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063b00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.537+0000 7f4166528800 10 manifest: total_size = 45360 2024-09-12T00:17:10.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.537+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1194118301278931954 2024-09-12T00:17:10.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.537+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063b00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x556b6127f5e8 s->prefetch_data=0 2024-09-12T00:17:10.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.537+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127f5e8 2024-09-12T00:17:10.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.537+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16.0 2024-09-12T00:17:10.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:17:10.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T00:17:10.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:17:10.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:17:10.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T00:17:10.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-12T00:17:10.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-12T00:17:10.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2024-09-12T00:17:10.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-12T00:17:10.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1194118301278931954 2024-09-12T00:17:10.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-STANDARD.2~aHqUWSYdKe1S-x9yY0MsASwii3H_QZY.1 2024-09-12T00:17:10.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T00:17:10.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-STANDARD.2~aHqUWSYdKe1S-x9yY0MsASwii3H_QZY.2 2024-09-12T00:17:10.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T00:17:10.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-STANDARD.2~aHqUWSYdKe1S-x9yY0MsASwii3H_QZY.3 2024-09-12T00:17:10.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T00:17:10.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.539+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1194118301278931954 2024-09-12T00:17:10.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.540+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:17:10.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.540+0000 7f4166528800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:17:10.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.540+0000 7f4166528800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:17:10.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.541+0000 7f4166528800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:17:10.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.541+0000 7f4166528800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:17:10.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.541+0000 7f4166528800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:17:10.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.541+0000 7f4166528800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:17:10.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.541+0000 7f4166528800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16])"; uploads.size()=0; is_truncated=0 2024-09-12T00:17:10.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.542+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T00:17:10.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.542+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.543+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T00:17:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.543+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T00:17:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.543+0000 7f4166528800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T00:17:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.544+0000 7f4166528800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T00:17:10.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.544+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T00:17:10.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.544+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562378 cookie 93919681274864 notifier 5645 bl.length()=199 2024-09-12T00:17:10.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.546+0000 7f4166528800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16 from cache 2024-09-12T00:17:10.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.546+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16, ofs0, ns] 2024-09-12T00:17:10.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.546+0000 7f4045ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562390 cookie 93919681282448 notifier 5645 bl.length()=257 2024-09-12T00:17:10.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.547+0000 7f4166528800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16 : miss 2024-09-12T00:17:10.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.547+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.548+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.548+0000 7f4166528800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16 info.flags=0x0 2024-09-12T00:17:10.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.548+0000 7f4166528800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16 to cache LRU end 2024-09-12T00:17:10.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.550+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14 : miss 2024-09-12T00:17:10.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.550+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.550+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:17:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.550+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14 info.flags=0x17 2024-09-12T00:17:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.550+0000 7f4166528800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14 to cache LRU end 2024-09-12T00:17:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.550+0000 7f4166528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.550+0000 7f4166528800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:17:10.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.550+0000 7f4166528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14 2024-09-12T00:17:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.551+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:17:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.551+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:17:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.551+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:17:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.551+0000 7f4166528800 20 get_obj_state: octx=0x556b613dc000 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.551+0000 7f4166528800 10 manifest: total_size = 11534336 2024-09-12T00:17:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.551+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6279667171895921171 2024-09-12T00:17:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.551+0000 7f4166528800 20 get_obj_state: octx=0x556b613dc000 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.551+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127e208 2024-09-12T00:17:10.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.551+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14.0 2024-09-12T00:17:10.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:17:10.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:17:10.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:17:10.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:17:10.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:17:10.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:17:10.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:17:10.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:17:10.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:17:10.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6279667171895921171 2024-09-12T00:17:10.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-FROZEN.2~jseCU4do2NnD4CPj2P1ELkQbfZqn7WO.1 2024-09-12T00:17:10.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:17:10.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-FROZEN.2~jseCU4do2NnD4CPj2P1ELkQbfZqn7WO.2 2024-09-12T00:17:10.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T00:17:10.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-FROZEN.2~jseCU4do2NnD4CPj2P1ELkQbfZqn7WO.3 2024-09-12T00:17:10.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T00:17:10.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.554+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6279667171895921171 2024-09-12T00:17:10.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.555+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:17:10.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.555+0000 7f4166528800 20 get_obj_state: octx=0x556b6141bf10 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.556+0000 7f4166528800 10 manifest: total_size = 11534336 2024-09-12T00:17:10.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.556+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15899411167106971393 2024-09-12T00:17:10.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.556+0000 7f4166528800 20 get_obj_state: octx=0x556b6141bf10 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.556+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127e208 2024-09-12T00:17:10.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.556+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14.0 2024-09-12T00:17:10.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:17:10.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:17:10.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:17:10.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:17:10.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:17:10.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:17:10.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:17:10.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:17:10.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:17:10.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15899411167106971393 2024-09-12T00:17:10.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-LUKEWARM.2~A6cO4zFzU40OlRaW9KRQobnvNRlB8Sd.1 2024-09-12T00:17:10.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:17:10.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-LUKEWARM.2~A6cO4zFzU40OlRaW9KRQobnvNRlB8Sd.2 2024-09-12T00:17:10.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-12T00:17:10.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-LUKEWARM.2~A6cO4zFzU40OlRaW9KRQobnvNRlB8Sd.3 2024-09-12T00:17:10.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-12T00:17:10.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.558+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15899411167106971393 2024-09-12T00:17:10.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.559+0000 7f40457fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:17:10.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.560+0000 7f4166528800 20 get_obj_state: octx=0x556b61419e30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x556b61415b78 s->prefetch_data=0 2024-09-12T00:17:10.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.560+0000 7f4166528800 10 manifest: total_size = 11534336 2024-09-12T00:17:10.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.560+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7037082653143750061 2024-09-12T00:17:10.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.560+0000 7f4166528800 20 get_obj_state: octx=0x556b61419e30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x556b61415b78 s->prefetch_data=0 2024-09-12T00:17:10.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.560+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b61415b78 2024-09-12T00:17:10.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.560+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14.0 2024-09-12T00:17:10.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:17:10.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:17:10.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:17:10.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:17:10.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:17:10.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:17:10.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:17:10.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:17:10.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:17:10.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7037082653143750061 2024-09-12T00:17:10.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-STANDARD.2~fofVkMmtQN04LDrtJ5q3TDVOcUx4U6c.1 2024-09-12T00:17:10.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T00:17:10.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-STANDARD.2~fofVkMmtQN04LDrtJ5q3TDVOcUx4U6c.2 2024-09-12T00:17:10.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T00:17:10.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-STANDARD.2~fofVkMmtQN04LDrtJ5q3TDVOcUx4U6c.3 2024-09-12T00:17:10.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T00:17:10.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.562+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7037082653143750061 2024-09-12T00:17:10.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.564+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:17:10.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.564+0000 7f4166528800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:17:10.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.564+0000 7f4166528800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:17:10.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.564+0000 7f4166528800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:17:10.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.564+0000 7f4166528800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:17:10.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.564+0000 7f4166528800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:17:10.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.564+0000 7f4166528800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:17:10.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.564+0000 7f4166528800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14])"; uploads.size()=0; is_truncated=0 2024-09-12T00:17:10.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.565+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T00:17:10.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.565+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.566+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T00:17:10.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.566+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T00:17:10.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.566+0000 7f4166528800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T00:17:10.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.567+0000 7f4166528800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T00:17:10.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.567+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T00:17:10.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.567+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562391 cookie 93919681282448 notifier 5645 bl.length()=194 2024-09-12T00:17:10.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.569+0000 7f4166528800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14 from cache 2024-09-12T00:17:10.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.569+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14, ofs0, ns] 2024-09-12T00:17:10.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.569+0000 7f4045ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562392 cookie 93919681282448 notifier 5645 bl.length()=252 2024-09-12T00:17:10.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.571+0000 7f4166528800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14 : miss 2024-09-12T00:17:10.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.571+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.571+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.571+0000 7f4166528800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14 info.flags=0x0 2024-09-12T00:17:10.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.571+0000 7f4166528800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14 to cache LRU end 2024-09-12T00:17:10.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.574+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13 : miss 2024-09-12T00:17:10.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.574+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.575+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T00:17:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.575+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13 info.flags=0x17 2024-09-12T00:17:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.575+0000 7f4166528800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13 to cache LRU end 2024-09-12T00:17:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.575+0000 7f4166528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.575+0000 7f4166528800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:17:10.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.575+0000 7f4166528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13 2024-09-12T00:17:10.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.575+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:17:10.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.575+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:17:10.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.575+0000 7f4166528800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:17:10.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.575+0000 7f4166528800 20 get_obj_state: octx=0x556b61413c30 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x556b6141f6c8 s->prefetch_data=0 2024-09-12T00:17:10.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.576+0000 7f4166528800 10 manifest: total_size = 10485760 2024-09-12T00:17:10.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.576+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17746145654053126910 2024-09-12T00:17:10.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.576+0000 7f4166528800 20 get_obj_state: octx=0x556b61413c30 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x556b6141f6c8 s->prefetch_data=0 2024-09-12T00:17:10.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.576+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6141f6c8 2024-09-12T00:17:10.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.576+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13.0 2024-09-12T00:17:10.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.578+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.578+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.578+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.578+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.578+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17746145654053126910 2024-09-12T00:17:10.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.578+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.578+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13__shadow_.ImYpZcXiAIgikSQkxL7hR0QCHhsDxiZ_0 2024-09-12T00:17:10.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.578+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:17:10.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.578+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13__shadow_.ImYpZcXiAIgikSQkxL7hR0QCHhsDxiZ_1 2024-09-12T00:17:10.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.578+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T00:17:10.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.578+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.578+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17746145654053126910 2024-09-12T00:17:10.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.579+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:17:10.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.580+0000 7f4166528800 20 get_obj_state: octx=0x7f414c060580 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x556b614240c8 s->prefetch_data=0 2024-09-12T00:17:10.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.580+0000 7f4166528800 10 manifest: total_size = 10485760 2024-09-12T00:17:10.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.580+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1147801548380917796 2024-09-12T00:17:10.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.580+0000 7f4166528800 20 get_obj_state: octx=0x7f414c060580 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x556b614240c8 s->prefetch_data=0 2024-09-12T00:17:10.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.580+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b614240c8 2024-09-12T00:17:10.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.580+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13.0 2024-09-12T00:17:10.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.582+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.582+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.582+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.582+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.582+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1147801548380917796 2024-09-12T00:17:10.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.582+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.582+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13__shadow_.7FaSbOiVWn2m1qorwASfsVW12WswszV_0 2024-09-12T00:17:10.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.582+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:17:10.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.582+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13__shadow_.7FaSbOiVWn2m1qorwASfsVW12WswszV_1 2024-09-12T00:17:10.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.582+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:17:10.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.582+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.582+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1147801548380917796 2024-09-12T00:17:10.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.583+0000 7f40457fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:17:10.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.584+0000 7f4166528800 20 get_obj_state: octx=0x7f414c08c3f0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x556b614240c8 s->prefetch_data=0 2024-09-12T00:17:10.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.584+0000 7f4166528800 10 manifest: total_size = 10485760 2024-09-12T00:17:10.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.584+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2284166190106078535 2024-09-12T00:17:10.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.584+0000 7f4166528800 20 get_obj_state: octx=0x7f414c08c3f0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x556b614240c8 s->prefetch_data=0 2024-09-12T00:17:10.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.584+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b614240c8 2024-09-12T00:17:10.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.584+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13.0 2024-09-12T00:17:10.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.586+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.586+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.586+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.586+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.586+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2284166190106078535 2024-09-12T00:17:10.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.586+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.586+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13__shadow_.Pu6ZmHf9T_KocCr9CFhijALCm1vdlYA_0 2024-09-12T00:17:10.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.586+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T00:17:10.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.586+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13__shadow_.Pu6ZmHf9T_KocCr9CFhijALCm1vdlYA_1 2024-09-12T00:17:10.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.586+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 560 2024-09-12T00:17:10.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.586+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.586+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2284166190106078535 2024-09-12T00:17:10.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.588+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:17:10.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.588+0000 7f4166528800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:17:10.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.588+0000 7f4166528800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:17:10.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.588+0000 7f4166528800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:17:10.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.588+0000 7f4166528800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:17:10.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.588+0000 7f4166528800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:17:10.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.588+0000 7f4166528800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:17:10.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.588+0000 7f4166528800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13])"; uploads.size()=0; is_truncated=0 2024-09-12T00:17:10.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.589+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T00:17:10.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.589+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.590+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T00:17:10.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.590+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T00:17:10.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.590+0000 7f4166528800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T00:17:10.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.591+0000 7f4166528800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T00:17:10.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.591+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T00:17:10.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.591+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562399 cookie 93919681272544 notifier 5645 bl.length()=184 2024-09-12T00:17:10.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.593+0000 7f4166528800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13 from cache 2024-09-12T00:17:10.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.593+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13, ofs0, ns] 2024-09-12T00:17:10.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.593+0000 7f4045ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562450 cookie 93919681276608 notifier 5645 bl.length()=242 2024-09-12T00:17:10.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.594+0000 7f4166528800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13 : miss 2024-09-12T00:17:10.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.594+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.595+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.595+0000 7f4166528800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13 info.flags=0x0 2024-09-12T00:17:10.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.595+0000 7f4166528800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13 to cache LRU end 2024-09-12T00:17:10.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.597+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6 : miss 2024-09-12T00:17:10.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.597+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.597+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:17:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.597+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6 info.flags=0x17 2024-09-12T00:17:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.597+0000 7f4166528800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6 to cache LRU end 2024-09-12T00:17:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.597+0000 7f4166528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.597+0000 7f4166528800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:17:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.597+0000 7f4166528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6 2024-09-12T00:17:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.597+0000 7f4166528800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:17:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.597+0000 7f4166528800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:17:10.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.597+0000 7f4166528800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:17:10.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.598+0000 7f4166528800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:17:10.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.598+0000 7f4166528800 20 get_obj_state: octx=0x556b61423900 obj=test-client.0-r-test-small-obj-data.1:__ state=0x556b6141f6c8 s->prefetch_data=0 2024-09-12T00:17:10.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.598+0000 7f4166528800 10 manifest: total_size = 0 2024-09-12T00:17:10.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.598+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11204534088558359538 2024-09-12T00:17:10.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.598+0000 7f4166528800 20 get_obj_state: octx=0x556b61423900 obj=test-client.0-r-test-small-obj-data.1:__ state=0x556b6141f6c8 s->prefetch_data=0 2024-09-12T00:17:10.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.598+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6141f6c8 2024-09-12T00:17:10.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.598+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6.0 2024-09-12T00:17:10.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.600+0000 7f4166528800 20 get_obj_state: octx=0x556b61423900 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x556b6141f6c8 s->prefetch_data=0 2024-09-12T00:17:10.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.601+0000 7f4166528800 10 manifest: total_size = 0 2024-09-12T00:17:10.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.601+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11074951559703394265 2024-09-12T00:17:10.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.601+0000 7f4166528800 20 get_obj_state: octx=0x556b61423900 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x556b6141f6c8 s->prefetch_data=0 2024-09-12T00:17:10.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.601+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6141f6c8 2024-09-12T00:17:10.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.601+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6.0 2024-09-12T00:17:10.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.602+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:17:10.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.603+0000 7f4166528800 20 get_obj_state: octx=0x556b61423900 obj=test-client.0-r-test-small-obj-data.1:___ state=0x556b6141f6c8 s->prefetch_data=0 2024-09-12T00:17:10.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.604+0000 7f4166528800 10 manifest: total_size = 0 2024-09-12T00:17:10.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.604+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16342231440681394462 2024-09-12T00:17:10.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.604+0000 7f4166528800 20 get_obj_state: octx=0x556b61423900 obj=test-client.0-r-test-small-obj-data.1:___ state=0x556b6141f6c8 s->prefetch_data=0 2024-09-12T00:17:10.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.604+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6141f6c8 2024-09-12T00:17:10.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.604+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6.0 2024-09-12T00:17:10.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.605+0000 7f40457fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:17:10.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.606+0000 7f4166528800 20 get_obj_state: octx=0x556b61423900 obj=test-client.0-r-test-small-obj-data.1:obj state=0x556b6141f6c8 s->prefetch_data=0 2024-09-12T00:17:10.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.607+0000 7f4166528800 10 manifest: total_size = 0 2024-09-12T00:17:10.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.607+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10668341833174564648 2024-09-12T00:17:10.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.607+0000 7f4166528800 20 get_obj_state: octx=0x556b61423900 obj=test-client.0-r-test-small-obj-data.1:obj state=0x556b6141f6c8 s->prefetch_data=0 2024-09-12T00:17:10.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.607+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6141f6c8 2024-09-12T00:17:10.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.607+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6.0 2024-09-12T00:17:10.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.607+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:17:10.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.609+0000 7f4166528800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:17:10.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.609+0000 7f4166528800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:17:10.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.610+0000 7f40457fa640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:17:10.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.610+0000 7f4166528800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:17:10.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.610+0000 7f4166528800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:17:10.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.610+0000 7f4166528800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:17:10.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.610+0000 7f4166528800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:17:10.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.610+0000 7f4166528800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6])"; uploads.size()=0; is_truncated=0 2024-09-12T00:17:10.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.612+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T00:17:10.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.612+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.612+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:17:10.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.612+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T00:17:10.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.612+0000 7f4166528800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T00:17:10.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.613+0000 7f4166528800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T00:17:10.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.613+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T00:17:10.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.613+0000 7f4045ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562451 cookie 93919681269792 notifier 5645 bl.length()=181 2024-09-12T00:17:10.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.615+0000 7f4166528800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6 from cache 2024-09-12T00:17:10.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.615+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6, ofs0, ns] 2024-09-12T00:17:10.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.615+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562400 cookie 93919681272544 notifier 5645 bl.length()=238 2024-09-12T00:17:10.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.617+0000 7f4166528800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6 : miss 2024-09-12T00:17:10.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.617+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.617+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.617+0000 7f4166528800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6 info.flags=0x0 2024-09-12T00:17:10.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.617+0000 7f4166528800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6 to cache LRU end 2024-09-12T00:17:10.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.619+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7 : miss 2024-09-12T00:17:10.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.619+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:17:10.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7 info.flags=0x17 2024-09-12T00:17:10.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7 to cache LRU end 2024-09-12T00:17:10.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:10.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:17:10.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7 2024-09-12T00:17:10.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:17:10.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:17:10.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:17:10.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:17:10.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 20 get_obj_state: octx=0x556b6142f4d0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 10 manifest: total_size = 24595 2024-09-12T00:17:10.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7137548434544945584 2024-09-12T00:17:10.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 20 get_obj_state: octx=0x556b6142f4d0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127e208 2024-09-12T00:17:10.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.620+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7.0 2024-09-12T00:17:10.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.623+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.623+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.623+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7137548434544945584 2024-09-12T00:17:10.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.623+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.623+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7__shadow_.nXfEB243TQMz983ib3m_SemU9VRJpZw_0 2024-09-12T00:17:10.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.623+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:17:10.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.623+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.623+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7137548434544945584 2024-09-12T00:17:10.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.624+0000 7f40457fa640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:17:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.624+0000 7f4166528800 20 get_obj_state: octx=0x556b6142f4d0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.625+0000 7f4166528800 10 manifest: total_size = 38 2024-09-12T00:17:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.625+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10955790951480014717 2024-09-12T00:17:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.625+0000 7f4166528800 20 get_obj_state: octx=0x556b6142f4d0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.625+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127e208 2024-09-12T00:17:10.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.625+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7.0 2024-09-12T00:17:10.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.627+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.627+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.627+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10955790951480014717 2024-09-12T00:17:10.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.627+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.627+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7__shadow_.8yd3yXm7EkhhgyJ6ZkSEZ_ak9aV3ItX_0 2024-09-12T00:17:10.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.627+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:17:10.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.627+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.627+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10955790951480014717 2024-09-12T00:17:10.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.628+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:17:10.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.628+0000 7f4166528800 20 get_obj_state: octx=0x556b6142f4d0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.629+0000 7f4166528800 10 manifest: total_size = 2078 2024-09-12T00:17:10.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.629+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7355122415036461853 2024-09-12T00:17:10.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.629+0000 7f4166528800 20 get_obj_state: octx=0x556b6142f4d0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.629+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127e208 2024-09-12T00:17:10.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.629+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7.0 2024-09-12T00:17:10.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.631+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.631+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.631+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7355122415036461853 2024-09-12T00:17:10.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.631+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.631+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7__shadow_.f35QEf0RqH6EEV5x_lTBKyWjEj5aPGN_0 2024-09-12T00:17:10.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.631+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:17:10.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.631+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.631+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7355122415036461853 2024-09-12T00:17:10.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.632+0000 7f40457fa640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:17:10.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.632+0000 7f4166528800 20 get_obj_state: octx=0x7f415c004480 obj=test-client.0-r-test-small-obj-data.2:obj state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.633+0000 7f4166528800 10 manifest: total_size = 2078 2024-09-12T00:17:10.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.633+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4848140764920394780 2024-09-12T00:17:10.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.633+0000 7f4166528800 20 get_obj_state: octx=0x7f415c004480 obj=test-client.0-r-test-small-obj-data.2:obj state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.633+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127e208 2024-09-12T00:17:10.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.633+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7.0 2024-09-12T00:17:10.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.635+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.635+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.635+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4848140764920394780 2024-09-12T00:17:10.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.635+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.635+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7__shadow_.LVb8nPMyWpl2ozyJ7rG3MT8ETimEXRi_0 2024-09-12T00:17:10.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.635+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:17:10.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.635+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.635+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4848140764920394780 2024-09-12T00:17:10.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.637+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:17:10.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.637+0000 7f4166528800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:17:10.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.637+0000 7f4166528800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:17:10.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.637+0000 7f4166528800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:17:10.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.637+0000 7f4166528800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:17:10.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.637+0000 7f4166528800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:17:10.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.637+0000 7f4166528800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:17:10.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.637+0000 7f4166528800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7])"; uploads.size()=0; is_truncated=0 2024-09-12T00:17:10.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.638+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T00:17:10.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.638+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.639+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:17:10.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.639+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T00:17:10.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.639+0000 7f4166528800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T00:17:10.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.640+0000 7f4166528800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T00:17:10.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.640+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T00:17:10.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.640+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562452 cookie 93919681269792 notifier 5645 bl.length()=181 2024-09-12T00:17:10.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.641+0000 7f4166528800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7 from cache 2024-09-12T00:17:10.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.641+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7, ofs0, ns] 2024-09-12T00:17:10.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.642+0000 7f4045ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562401 cookie 93919681272544 notifier 5645 bl.length()=238 2024-09-12T00:17:10.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.643+0000 7f4166528800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7 : miss 2024-09-12T00:17:10.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.643+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.643+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.643+0000 7f4166528800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7 info.flags=0x0 2024-09-12T00:17:10.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.643+0000 7f4166528800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7 to cache LRU end 2024-09-12T00:17:10.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.645+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8 : miss 2024-09-12T00:17:10.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.645+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.646+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:17:10.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.646+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8 info.flags=0x17 2024-09-12T00:17:10.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.646+0000 7f4166528800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8 to cache LRU end 2024-09-12T00:17:10.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.646+0000 7f4166528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:10.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.646+0000 7f4166528800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:17:10.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.646+0000 7f4166528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8 2024-09-12T00:17:10.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.646+0000 7f4166528800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:17:10.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.646+0000 7f4166528800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:17:10.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.646+0000 7f4166528800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:17:10.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.646+0000 7f4166528800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:17:10.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.646+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063b00 obj=test-client.0-r-test-small-obj-data.3:__ state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.647+0000 7f4166528800 10 manifest: total_size = 1035 2024-09-12T00:17:10.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.647+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5838808566970432648 2024-09-12T00:17:10.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.647+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063b00 obj=test-client.0-r-test-small-obj-data.3:__ state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.647+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127e208 2024-09-12T00:17:10.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.647+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8.0 2024-09-12T00:17:10.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.649+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.649+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.649+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5838808566970432648 2024-09-12T00:17:10.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.649+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.649+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8__shadow_.dlrKm5dejuFzoflRA-ZY5rj6T17m403_0 2024-09-12T00:17:10.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.649+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:17:10.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.649+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.649+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5838808566970432648 2024-09-12T00:17:10.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.651+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063b00 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x556b6141f6c8 s->prefetch_data=0 2024-09-12T00:17:10.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.651+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:17:10.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.651+0000 7f4166528800 10 manifest: total_size = 1035 2024-09-12T00:17:10.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.651+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3569600327410535288 2024-09-12T00:17:10.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.651+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063b00 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x556b6141f6c8 s->prefetch_data=0 2024-09-12T00:17:10.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.651+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6141f6c8 2024-09-12T00:17:10.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.651+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8.0 2024-09-12T00:17:10.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.653+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.653+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.653+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3569600327410535288 2024-09-12T00:17:10.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.653+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.653+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8__shadow_.FjCU9X0ssr_QGxC_cFjceHcEUQ5DZdz_0 2024-09-12T00:17:10.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.653+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:17:10.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.653+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.653+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3569600327410535288 2024-09-12T00:17:10.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.655+0000 7f40457fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:17:10.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.655+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063b00 obj=test-client.0-r-test-small-obj-data.3:___ state=0x556b6141f6c8 s->prefetch_data=0 2024-09-12T00:17:10.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.655+0000 7f4166528800 10 manifest: total_size = 4134 2024-09-12T00:17:10.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.655+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9347209589677660627 2024-09-12T00:17:10.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.655+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063b00 obj=test-client.0-r-test-small-obj-data.3:___ state=0x556b6141f6c8 s->prefetch_data=0 2024-09-12T00:17:10.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.655+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6141f6c8 2024-09-12T00:17:10.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.655+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8.0 2024-09-12T00:17:10.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.658+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.658+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.658+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9347209589677660627 2024-09-12T00:17:10.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.658+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.658+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8__shadow_.W27yP5R8zu6ROttOWO8OrxsvW2w8Hmn_0 2024-09-12T00:17:10.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.658+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:17:10.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.658+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.658+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9347209589677660627 2024-09-12T00:17:10.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.659+0000 7f4045ffb640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:17:10.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.659+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063b00 obj=test-client.0-r-test-small-obj-data.3:obj state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.659+0000 7f4166528800 10 manifest: total_size = 1035 2024-09-12T00:17:10.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.659+0000 7f4166528800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17232408011302351498 2024-09-12T00:17:10.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.659+0000 7f4166528800 20 get_obj_state: octx=0x7f415c063b00 obj=test-client.0-r-test-small-obj-data.3:obj state=0x556b6127e208 s->prefetch_data=0 2024-09-12T00:17:10.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.659+0000 7f4166528800 20 prepare_atomic_modification: state is not atomic. state=0x556b6127e208 2024-09-12T00:17:10.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.659+0000 7f4166528800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8.0 2024-09-12T00:17:10.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.662+0000 7f4166528800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:10.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.662+0000 7f4166528800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-12T00:17:10.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.662+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17232408011302351498 2024-09-12T00:17:10.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.662+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:17:10.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.662+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8__shadow_.nuVi78fL_oxC2W_yYdva6LPubXwfmO7_0 2024-09-12T00:17:10.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.662+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:17:10.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.662+0000 7f4166528800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:17:10.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.662+0000 7f4166528800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17232408011302351498 2024-09-12T00:17:10.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.663+0000 7f40457fa640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:17:10.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.663+0000 7f4166528800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:17:10.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.663+0000 7f4166528800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:17:10.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.663+0000 7f4166528800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:17:10.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.663+0000 7f4166528800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:17:10.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.663+0000 7f4166528800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:17:10.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.663+0000 7f4166528800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:17:10.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.663+0000 7f4166528800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8])"; uploads.size()=0; is_truncated=0 2024-09-12T00:17:10.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.665+0000 7f4166528800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T00:17:10.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.665+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.665+0000 7f4166528800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:17:10.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.665+0000 7f4166528800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T00:17:10.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.665+0000 7f4166528800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T00:17:10.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.666+0000 7f4166528800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T00:17:10.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.666+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T00:17:10.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.667+0000 7f4045ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562453 cookie 93919681269792 notifier 5645 bl.length()=181 2024-09-12T00:17:10.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.668+0000 7f4166528800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8 from cache 2024-09-12T00:17:10.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.668+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8, ofs0, ns] 2024-09-12T00:17:10.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.668+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562402 cookie 93919681272544 notifier 5645 bl.length()=238 2024-09-12T00:17:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.670+0000 7f4166528800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8 : miss 2024-09-12T00:17:10.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.670+0000 7f4166528800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.670+0000 7f4166528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.670+0000 7f4166528800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8 info.flags=0x0 2024-09-12T00:17:10.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.670+0000 7f4166528800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8 to cache LRU end 2024-09-12T00:17:10.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.672+0000 7f4166528800 10 removing key index: BXJGHAWYQDMEUORNOKSI 2024-09-12T00:17:10.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.673+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:BXJGHAWYQDMEUORNOKSI, ofs0, ns] 2024-09-12T00:17:10.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.673+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562429 cookie 93919681265696 notifier 5645 bl.length()=170 2024-09-12T00:17:10.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.674+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562430 cookie 93919681265696 notifier 5645 bl.length()=170 2024-09-12T00:17:10.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.675+0000 7f4166528800 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T00:17:10.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.676+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:17:10.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.676+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562403 cookie 93919681272544 notifier 5645 bl.length()=182 2024-09-12T00:17:10.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.676+0000 7f4166528800 10 removing user buckets index 2024-09-12T00:17:10.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.677+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T00:17:10.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.678+0000 7f4045ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562393 cookie 93919681282448 notifier 5645 bl.length()=173 2024-09-12T00:17:10.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.678+0000 7f4166528800 10 removing user index: ragweed.client.0 2024-09-12T00:17:10.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.679+0000 7f4166528800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T00:17:10.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.679+0000 7f4166528800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:17:10.678 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.679+0000 7f40457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562454 cookie 93919681276608 notifier 5645 bl.length()=165 2024-09-12T00:17:10.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.681+0000 7f4018fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:10.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.683+0000 7f4166528800 20 remove_watcher() i=0 2024-09-12T00:17:10.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.683+0000 7f4166528800 2 removed watcher, disabling cache 2024-09-12T00:17:10.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.684+0000 7f4166528800 20 remove_watcher() i=1 2024-09-12T00:17:10.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.685+0000 7f4166528800 20 remove_watcher() i=2 2024-09-12T00:17:10.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.686+0000 7f4166528800 20 remove_watcher() i=3 2024-09-12T00:17:10.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.687+0000 7f4166528800 20 remove_watcher() i=4 2024-09-12T00:17:10.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.688+0000 7f4166528800 20 remove_watcher() i=5 2024-09-12T00:17:10.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.689+0000 7f4166528800 20 remove_watcher() i=6 2024-09-12T00:17:10.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.690+0000 7f4166528800 20 remove_watcher() i=7 2024-09-12T00:17:10.699 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T00:17:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:10.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.794+0000 7f55882b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.796+0000 7f55882b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.796+0000 7f55882b7800 20 realm 2024-09-12T00:17:10.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.796+0000 7f55882b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.796+0000 7f55882b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.796+0000 7f55882b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:10.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.796+0000 7f55882b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.797+0000 7f55882b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.797+0000 7f55882b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.797+0000 7f55882b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:10.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.797+0000 7f55882b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.798+0000 7f55882b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:10.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.798+0000 7f55882b7800 20 searching for the correct realm 2024-09-12T00:17:10.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.801+0000 7f557ffff640 0 -- 172.21.15.67:0/4148857752 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f557001a930 msgr2=0x7f5570019410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:10.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.805+0000 7f557ffff640 0 -- 172.21.15.67:0/4148857752 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x559d491cf8c0 msgr2=0x559d491d1d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:10.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.809+0000 7f55882b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:10.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.809+0000 7f55882b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:10.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.809+0000 7f55882b7800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:17:10.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.809+0000 7f55882b7800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:17:10.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.809+0000 7f55882b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:10.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.809+0000 7f55882b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:10.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.809+0000 7f55882b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.809+0000 7f55882b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.809+0000 7f55882b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.809+0000 7f55882b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:10.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.809+0000 7f55882b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.810+0000 7f55882b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:10.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.810+0000 7f55882b7800 20 zone default found 2024-09-12T00:17:10.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.810+0000 7f55882b7800 4 Realm: () 2024-09-12T00:17:10.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.810+0000 7f55882b7800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:17:10.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.810+0000 7f55882b7800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:17:10.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.810+0000 7f55882b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:10.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.810+0000 7f55882b7800 20 zonegroup default 2024-09-12T00:17:10.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.810+0000 7f55882b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.810+0000 7f55882b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.810+0000 7f55882b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.810+0000 7f55882b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.810+0000 7f55882b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.811+0000 7f55882b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:10.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.811+0000 7f55882b7800 20 started sync module instance, tier type = 2024-09-12T00:17:10.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.811+0000 7f55882b7800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:17:10.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.819+0000 7f55882b7800 20 add_watcher() i=0 2024-09-12T00:17:10.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.819+0000 7f55882b7800 20 add_watcher() i=1 2024-09-12T00:17:10.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.819+0000 7f55882b7800 20 add_watcher() i=2 2024-09-12T00:17:10.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.819+0000 7f55882b7800 20 add_watcher() i=3 2024-09-12T00:17:10.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.819+0000 7f55882b7800 20 add_watcher() i=4 2024-09-12T00:17:10.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.819+0000 7f55882b7800 20 add_watcher() i=5 2024-09-12T00:17:10.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.819+0000 7f55882b7800 20 add_watcher() i=6 2024-09-12T00:17:10.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.820+0000 7f55882b7800 20 add_watcher() i=7 2024-09-12T00:17:10.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.820+0000 7f55882b7800 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.822+0000 7f5437fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.822+0000 7f55882b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:10.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.822+0000 7f55882b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:10.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.856+0000 7f5436ffd640 20 reqs_thread_entry: start 2024-09-12T00:17:10.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.856+0000 7f55882b7800 20 init_complete bucket index max shards: 1 2024-09-12T00:17:10.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.856+0000 7f55882b7800 20 Filter name: none 2024-09-12T00:17:10.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.856+0000 7f5434ff9640 20 reqs_thread_entry: start 2024-09-12T00:17:10.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.856+0000 7f55882b7800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:17:10.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.856+0000 7f55882b7800 20 rados->read ofs=0 len=0 2024-09-12T00:17:10.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.857+0000 7f55882b7800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:17:10.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.857+0000 7f55882b7800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T00:17:10.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.857+0000 7f55882b7800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:17:10.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.857+0000 7f55882b7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:10.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.857+0000 7f55882b7800 10 removing key index: HBCYZCOWUCZRWPKSZFUN 2024-09-12T00:17:10.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.858+0000 7f55882b7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:HBCYZCOWUCZRWPKSZFUN, ofs0, ns] 2024-09-12T00:17:10.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.858+0000 7f54697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562404 cookie 94134024914128 notifier 5663 bl.length()=170 2024-09-12T00:17:10.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.859+0000 7f55882b7800 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T00:17:10.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.860+0000 7f55882b7800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:17:10.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.860+0000 7f5468ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562455 cookie 94134024921328 notifier 5663 bl.length()=182 2024-09-12T00:17:10.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.860+0000 7f55882b7800 10 removing user buckets index 2024-09-12T00:17:10.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.861+0000 7f55882b7800 10 removing user index: sysuser.client.0 2024-09-12T00:17:10.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.862+0000 7f55882b7800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T00:17:10.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.862+0000 7f55882b7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:17:10.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.863+0000 7f54697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562405 cookie 94134024914128 notifier 5663 bl.length()=165 2024-09-12T00:17:10.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.864+0000 7f5437fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.867+0000 7f55882b7800 20 remove_watcher() i=0 2024-09-12T00:17:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.867+0000 7f55882b7800 2 removed watcher, disabling cache 2024-09-12T00:17:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.868+0000 7f55882b7800 20 remove_watcher() i=1 2024-09-12T00:17:10.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.868+0000 7f55882b7800 20 remove_watcher() i=2 2024-09-12T00:17:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.870+0000 7f55882b7800 20 remove_watcher() i=3 2024-09-12T00:17:10.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.871+0000 7f55882b7800 20 remove_watcher() i=4 2024-09-12T00:17:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.872+0000 7f55882b7800 20 remove_watcher() i=5 2024-09-12T00:17:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.873+0000 7f55882b7800 20 remove_watcher() i=6 2024-09-12T00:17:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:17:10.874+0000 7f55882b7800 20 remove_watcher() i=7 2024-09-12T00:17:10.883 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T00:17:10.883 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:17:10.960 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:17:10.971 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:17:10.971 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:17:10.972 DEBUG:teuthology.orchestra.run.smithi067:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:17:11.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:17:11.001 INFO:teuthology.orchestra.run.smithi067.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:17:11.002 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:17:11.074 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:17:11.074 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:17:11.144 INFO:tasks.workunit:timeout=3h 2024-09-12T00:17:11.144 INFO:tasks.workunit:cleanup=True 2024-09-12T00:17:11.144 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:17:11.215 INFO:tasks.workunit.client.0.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:17:57.118 INFO:tasks.workunit.client.0.smithi067.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:17:57.119 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:17:57.119 INFO:tasks.workunit.client.0.smithi067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:17:57.119 INFO:tasks.workunit.client.0.smithi067.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:17:57.119 INFO:tasks.workunit.client.0.smithi067.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:17:57.119 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:17:57.119 INFO:tasks.workunit.client.0.smithi067.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:17:57.119 INFO:tasks.workunit.client.0.smithi067.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:17:57.119 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:17:57.119 INFO:tasks.workunit.client.0.smithi067.stderr: git switch -c 2024-09-12T00:17:57.119 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:17:57.119 INFO:tasks.workunit.client.0.smithi067.stderr:Or undo this operation with: 2024-09-12T00:17:57.119 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:17:57.120 INFO:tasks.workunit.client.0.smithi067.stderr: git switch - 2024-09-12T00:17:57.120 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:17:57.120 INFO:tasks.workunit.client.0.smithi067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:17:57.120 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:17:57.120 INFO:tasks.workunit.client.0.smithi067.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:17:57.123 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:17:57.197 INFO:tasks.workunit.client.0.smithi067.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:17:57.199 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:17:57.199 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:17:57.249 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:17:57.301 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:17:57.342 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:17:57.343 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:17:57.343 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:17:57.383 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:17:57.386 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:17:57.387 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:17:57.458 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T00:17:57.460 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T00:17:57.460 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:17:57.533 INFO:tasks.workunit.client.0.smithi067.stderr:+ ulimit -c 0 2024-09-12T00:17:57.533 INFO:tasks.workunit.client.0.smithi067.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:17:57.533 INFO:tasks.workunit.client.0.smithi067.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:17:57.533 INFO:tasks.workunit.client.0.smithi067.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:17:59.912 INFO:tasks.workunit.client.0.smithi067.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:17:59.913 INFO:tasks.workunit.client.0.smithi067.stderr:++ deactivate nondestructive 2024-09-12T00:17:59.913 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T00:17:59.913 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T00:17:59.913 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:17:59.913 INFO:tasks.workunit.client.0.smithi067.stderr:++ hash -r 2024-09-12T00:17:59.913 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T00:17:59.913 INFO:tasks.workunit.client.0.smithi067.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:17:59.913 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:17:59.913 INFO:tasks.workunit.client.0.smithi067.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:17:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:++ export VIRTUAL_ENV 2024-09-12T00:17:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:17:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:17:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:++ export PATH 2024-09-12T00:17:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T00:17:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -z '' ']' 2024-09-12T00:17:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:17:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:++ PS1='(rgw) ' 2024-09-12T00:17:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:++ export PS1 2024-09-12T00:17:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:17:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:++ hash -r 2024-09-12T00:17:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:+ pip install pip --upgrade 2024-09-12T00:18:00.150 INFO:tasks.workunit.client.0.smithi067.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:18:00.335 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting pip 2024-09-12T00:18:00.341 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:18:00.388 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: pip 2024-09-12T00:18:00.388 INFO:tasks.workunit.client.0.smithi067.stdout: Attempting uninstall: pip 2024-09-12T00:18:00.388 INFO:tasks.workunit.client.0.smithi067.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:18:00.552 INFO:tasks.workunit.client.0.smithi067.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:18:00.557 INFO:tasks.workunit.client.0.smithi067.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:18:01.331 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed pip-24.2 2024-09-12T00:18:01.379 INFO:tasks.workunit.client.0.smithi067.stderr:+ pip install boto3 2024-09-12T00:18:02.198 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting boto3 2024-09-12T00:18:02.200 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:18:02.808 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:18:02.809 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:18:02.859 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:18:02.860 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:18:02.914 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:18:02.915 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:18:02.965 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:18:02.966 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:18:03.043 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:18:03.044 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:18:03.262 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:18:03.263 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:18:03.268 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:18:03.269 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:18:03.279 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:18:03.280 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:18:03.281 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:18:03.283 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:18:03.284 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:18:03.360 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:18:04.467 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:18:04.586 INFO:tasks.workunit.client.0.smithi067.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T00:18:04.715 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T00:18:04.752 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:04.753 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:04.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:04.793+0000 7fc74cb26800 20 rados->read ofs=0 len=0 2024-09-12T00:18:04.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:04.795+0000 7fc74cb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:04.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:04.795+0000 7fc74cb26800 20 realm 2024-09-12T00:18:04.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:04.795+0000 7fc74cb26800 20 rados->read ofs=0 len=0 2024-09-12T00:18:04.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:04.795+0000 7fc74cb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:04.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:04.795+0000 7fc74cb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:04.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:04.795+0000 7fc74cb26800 20 rados->read ofs=0 len=0 2024-09-12T00:18:04.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:04.796+0000 7fc74cb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:04.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:04.796+0000 7fc74cb26800 20 rados->read ofs=0 len=0 2024-09-12T00:18:04.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:04.796+0000 7fc74cb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:04.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:04.796+0000 7fc74cb26800 20 rados->read ofs=0 len=0 2024-09-12T00:18:04.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:04.797+0000 7fc74cb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:04.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:04.797+0000 7fc74cb26800 20 searching for the correct realm 2024-09-12T00:18:04.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:04.800+0000 7fc747fd8640 0 -- 172.21.15.67:0/1591090860 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fc73c0aa820 msgr2=0x7fc73c0e2180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:05.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.407+0000 7fc7487d9640 0 -- 172.21.15.67:0/1591090860 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fc74002db40 msgr2=0x7fc740021940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:05.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.413+0000 7fc74cb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:05.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.413+0000 7fc74cb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:05.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.413+0000 7fc74cb26800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:05.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.413+0000 7fc74cb26800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:05.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.413+0000 7fc74cb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:05.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.413+0000 7fc74cb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:05.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.413+0000 7fc74cb26800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.413+0000 7fc74cb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:05.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.413+0000 7fc74cb26800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.414+0000 7fc74cb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:05.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.414+0000 7fc74cb26800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.414+0000 7fc74cb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:05.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.414+0000 7fc74cb26800 20 zone default found 2024-09-12T00:18:05.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.414+0000 7fc74cb26800 4 Realm: () 2024-09-12T00:18:05.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.414+0000 7fc74cb26800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:05.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.414+0000 7fc74cb26800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:05.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.414+0000 7fc74cb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:05.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.414+0000 7fc74cb26800 20 zonegroup default 2024-09-12T00:18:05.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.414+0000 7fc74cb26800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.414+0000 7fc74cb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:05.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.414+0000 7fc74cb26800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.415+0000 7fc74cb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:05.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.415+0000 7fc74cb26800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.415+0000 7fc74cb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:05.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.415+0000 7fc74cb26800 20 started sync module instance, tier type = 2024-09-12T00:18:05.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.415+0000 7fc74cb26800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:05.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.425+0000 7fc74cb26800 20 add_watcher() i=0 2024-09-12T00:18:05.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.425+0000 7fc74cb26800 20 add_watcher() i=1 2024-09-12T00:18:05.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.425+0000 7fc74cb26800 20 add_watcher() i=2 2024-09-12T00:18:05.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.425+0000 7fc74cb26800 20 add_watcher() i=3 2024-09-12T00:18:05.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.425+0000 7fc74cb26800 20 add_watcher() i=4 2024-09-12T00:18:05.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.425+0000 7fc74cb26800 20 add_watcher() i=5 2024-09-12T00:18:05.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.425+0000 7fc74cb26800 20 add_watcher() i=6 2024-09-12T00:18:05.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.426+0000 7fc74cb26800 20 add_watcher() i=7 2024-09-12T00:18:05.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.427+0000 7fc74cb26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:05.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.429+0000 7fc5fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:05.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.429+0000 7fc74cb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:05.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.429+0000 7fc74cb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:05.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.430+0000 7fc74cb26800 5 note: GC not initialized 2024-09-12T00:18:05.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.430+0000 7fc5fdfdb640 20 reqs_thread_entry: start 2024-09-12T00:18:05.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.430+0000 7fc74cb26800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:05.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.430+0000 7fc74cb26800 20 Filter name: none 2024-09-12T00:18:05.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.430+0000 7fc56f7fe640 20 reqs_thread_entry: start 2024-09-12T00:18:05.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.430+0000 7fc74cb26800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T00:18:05.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.430+0000 7fc74cb26800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.431+0000 7fc74cb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:05.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.431+0000 7fc74cb26800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T00:18:05.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.431+0000 7fc74cb26800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:18:05.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.431+0000 7fc74cb26800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T00:18:05.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.431+0000 7fc74cb26800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.431+0000 7fc74cb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:05.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.431+0000 7fc74cb26800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T00:18:05.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.431+0000 7fc74cb26800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:18:05.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.431+0000 7fc74cb26800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:18:05.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.431+0000 7fc74cb26800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:18:05.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.433+0000 7fc74cb26800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:18:05.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.433+0000 7fc74cb26800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:18:05.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.433+0000 7fc74cb26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-12T00:18:05.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.433+0000 7fc61f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 94692411954528 notifier 5681 bl.length()=569 2024-09-12T00:18:05.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.433+0000 7fc61f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:18:05.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.433+0000 7fc61f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:18:05.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.435+0000 7fc74cb26800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:18:05.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.435+0000 7fc74cb26800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:18:05.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.435+0000 7fc74cb26800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T00:18:05.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.436+0000 7fc61f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562395 cookie 94692411945296 notifier 5681 bl.length()=180 2024-09-12T00:18:05.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.436+0000 7fc61f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:18:05.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.436+0000 7fc61f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:18:05.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.437+0000 7fc5fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:05.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.440+0000 7fc74cb26800 20 remove_watcher() i=0 2024-09-12T00:18:05.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.440+0000 7fc74cb26800 2 removed watcher, disabling cache 2024-09-12T00:18:05.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.441+0000 7fc74cb26800 20 remove_watcher() i=1 2024-09-12T00:18:05.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.442+0000 7fc74cb26800 20 remove_watcher() i=2 2024-09-12T00:18:05.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.443+0000 7fc74cb26800 20 remove_watcher() i=3 2024-09-12T00:18:05.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.444+0000 7fc74cb26800 20 remove_watcher() i=4 2024-09-12T00:18:05.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.445+0000 7fc74cb26800 20 remove_watcher() i=5 2024-09-12T00:18:05.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.446+0000 7fc74cb26800 20 remove_watcher() i=6 2024-09-12T00:18:05.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.447+0000 7fc74cb26800 20 remove_watcher() i=7 2024-09-12T00:18:05.687 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard add 2024-09-12T00:18:05.687 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:05.689 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:18:05.718 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:05.718 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:05.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.759+0000 7efcf1410800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.761+0000 7efcf1410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:05.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.761+0000 7efcf1410800 20 realm 2024-09-12T00:18:05.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.761+0000 7efcf1410800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.761+0000 7efcf1410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:05.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.761+0000 7efcf1410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:05.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.761+0000 7efcf1410800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.761+0000 7efcf1410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:05.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.761+0000 7efcf1410800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.762+0000 7efcf1410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:05.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.762+0000 7efcf1410800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.763+0000 7efcf1410800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:05.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.763+0000 7efcf1410800 20 searching for the correct realm 2024-09-12T00:18:05.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.766+0000 7efce7fff640 0 -- 172.21.15.67:0/2738107802 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7efcd801b040 msgr2=0x7efcd8037400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:05.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.971+0000 7efced3bd640 0 -- 172.21.15.67:0/2738107802 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55e3dce65870 msgr2=0x55e3dce67cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:05.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.975+0000 7efcf1410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:05.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.975+0000 7efcf1410800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:05.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.975+0000 7efcf1410800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:05.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.975+0000 7efcf1410800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:05.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.975+0000 7efcf1410800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:05.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.975+0000 7efcf1410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:05.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.975+0000 7efcf1410800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.976+0000 7efcf1410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:05.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.976+0000 7efcf1410800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.976+0000 7efcf1410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:05.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.976+0000 7efcf1410800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.976+0000 7efcf1410800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:05.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.976+0000 7efcf1410800 20 zone default found 2024-09-12T00:18:05.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.976+0000 7efcf1410800 4 Realm: () 2024-09-12T00:18:05.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.976+0000 7efcf1410800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:05.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.976+0000 7efcf1410800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:05.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.976+0000 7efcf1410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:05.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.976+0000 7efcf1410800 20 zonegroup default 2024-09-12T00:18:05.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.976+0000 7efcf1410800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.977+0000 7efcf1410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:05.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.977+0000 7efcf1410800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.977+0000 7efcf1410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:05.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.977+0000 7efcf1410800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.978+0000 7efcf1410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:05.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.978+0000 7efcf1410800 20 started sync module instance, tier type = 2024-09-12T00:18:05.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.978+0000 7efcf1410800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:05.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.987+0000 7efcf1410800 20 add_watcher() i=0 2024-09-12T00:18:05.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.987+0000 7efcf1410800 20 add_watcher() i=1 2024-09-12T00:18:05.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.987+0000 7efcf1410800 20 add_watcher() i=2 2024-09-12T00:18:05.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.987+0000 7efcf1410800 20 add_watcher() i=3 2024-09-12T00:18:05.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.987+0000 7efcf1410800 20 add_watcher() i=4 2024-09-12T00:18:05.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.987+0000 7efcf1410800 20 add_watcher() i=5 2024-09-12T00:18:05.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.987+0000 7efcf1410800 20 add_watcher() i=6 2024-09-12T00:18:05.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.988+0000 7efcf1410800 20 add_watcher() i=7 2024-09-12T00:18:05.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.988+0000 7efcf1410800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:05.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.990+0000 7efba37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:05.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.991+0000 7efcf1410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:05.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.991+0000 7efcf1410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:05.991 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.991+0000 7efcf1410800 5 note: GC not initialized 2024-09-12T00:18:05.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.991+0000 7efba27e4640 20 reqs_thread_entry: start 2024-09-12T00:18:05.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.991+0000 7efcf1410800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:05.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.991+0000 7efcf1410800 20 Filter name: none 2024-09-12T00:18:05.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.991+0000 7efb9b7fe640 20 reqs_thread_entry: start 2024-09-12T00:18:05.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.991+0000 7efcf1410800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.992+0000 7efcf1410800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:18:05.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.992+0000 7efcf1410800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.992+0000 7efcf1410800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:18:05.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.992+0000 7efcf1410800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:05.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.992+0000 7efcf1410800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.993+0000 7efcf1410800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:18:05.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.993+0000 7efcf1410800 20 rados->read ofs=0 len=0 2024-09-12T00:18:05.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.993+0000 7efcf1410800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:18:05.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.993+0000 7efcf1410800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:05.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.995+0000 7efba37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:05.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.997+0000 7efcf1410800 20 remove_watcher() i=0 2024-09-12T00:18:05.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.997+0000 7efcf1410800 2 removed watcher, disabling cache 2024-09-12T00:18:05.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.998+0000 7efcf1410800 20 remove_watcher() i=1 2024-09-12T00:18:05.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:05.999+0000 7efcf1410800 20 remove_watcher() i=2 2024-09-12T00:18:05.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.000+0000 7efcf1410800 20 remove_watcher() i=3 2024-09-12T00:18:06.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.001+0000 7efcf1410800 20 remove_watcher() i=4 2024-09-12T00:18:06.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.002+0000 7efcf1410800 20 remove_watcher() i=5 2024-09-12T00:18:06.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.003+0000 7efcf1410800 20 remove_watcher() i=6 2024-09-12T00:18:06.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.004+0000 7efcf1410800 20 remove_watcher() i=7 2024-09-12T00:18:06.015 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:06.015 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:06.015 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T00:18:06.015 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:06.016 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-09-12T00:18:06.049 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:06.049 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:06.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.088+0000 7f06e0734800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.089+0000 7f06e0734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.089+0000 7f06e0734800 20 realm 2024-09-12T00:18:06.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.089+0000 7f06e0734800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.090+0000 7f06e0734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.090+0000 7f06e0734800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:06.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.090+0000 7f06e0734800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.090+0000 7f06e0734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.090+0000 7f06e0734800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.091+0000 7f06e0734800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:06.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.091+0000 7f06e0734800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.092+0000 7f06e0734800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:06.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.092+0000 7f06e0734800 20 searching for the correct realm 2024-09-12T00:18:06.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.094+0000 7f06dbcb6640 0 -- 172.21.15.67:0/4044144412 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f06d006bb30 msgr2=0x7f06d0001970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:06.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.300+0000 7f06dccb8640 0 -- 172.21.15.67:0/4044144412 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55e313f7a350 msgr2=0x55e313f7c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:06.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.304+0000 7f06e0734800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:06.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.304+0000 7f06e0734800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:06.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.304+0000 7f06e0734800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:06.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.304+0000 7f06e0734800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:06.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.304+0000 7f06e0734800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:06.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.304+0000 7f06e0734800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:06.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.304+0000 7f06e0734800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.502+0000 7f06e0734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.502+0000 7f06e0734800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.502+0000 7f06e0734800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:06.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.502+0000 7f06e0734800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.502+0000 7f06e0734800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:06.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.502+0000 7f06e0734800 20 zone default found 2024-09-12T00:18:06.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.502+0000 7f06e0734800 4 Realm: () 2024-09-12T00:18:06.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.502+0000 7f06e0734800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:06.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.502+0000 7f06e0734800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:06.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.502+0000 7f06e0734800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:06.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.502+0000 7f06e0734800 20 zonegroup default 2024-09-12T00:18:06.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.502+0000 7f06e0734800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.503+0000 7f06e0734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.503+0000 7f06e0734800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.503+0000 7f06e0734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.503+0000 7f06e0734800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.504+0000 7f06e0734800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.504+0000 7f06e0734800 20 started sync module instance, tier type = 2024-09-12T00:18:06.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.504+0000 7f06e0734800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:06.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.514+0000 7f06e0734800 20 add_watcher() i=0 2024-09-12T00:18:06.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.514+0000 7f06e0734800 20 add_watcher() i=1 2024-09-12T00:18:06.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.514+0000 7f06e0734800 20 add_watcher() i=2 2024-09-12T00:18:06.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.514+0000 7f06e0734800 20 add_watcher() i=3 2024-09-12T00:18:06.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.514+0000 7f06e0734800 20 add_watcher() i=4 2024-09-12T00:18:06.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.514+0000 7f06e0734800 20 add_watcher() i=5 2024-09-12T00:18:06.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.514+0000 7f06e0734800 20 add_watcher() i=6 2024-09-12T00:18:06.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.515+0000 7f06e0734800 20 add_watcher() i=7 2024-09-12T00:18:06.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.515+0000 7f06e0734800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:06.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.517+0000 7f0592fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:06.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.517+0000 7f06e0734800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:06.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.517+0000 7f06e0734800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:06.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.518+0000 7f06e0734800 5 note: GC not initialized 2024-09-12T00:18:06.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.518+0000 7f0591fdb640 20 reqs_thread_entry: start 2024-09-12T00:18:06.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.518+0000 7f06e0734800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:06.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.518+0000 7f06e0734800 20 Filter name: none 2024-09-12T00:18:06.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.518+0000 7f05037fe640 20 reqs_thread_entry: start 2024-09-12T00:18:06.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.518+0000 7f06e0734800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:18:06.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.518+0000 7f06e0734800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.518+0000 7f06e0734800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:18:06.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.518+0000 7f06e0734800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:18:06.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.518+0000 7f06e0734800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:18:06.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.518+0000 7f06e0734800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:18:06.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.518+0000 7f06e0734800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.519+0000 7f06e0734800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:18:06.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.519+0000 7f06e0734800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:06.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.519+0000 7f06e0734800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:06.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.519+0000 7f06e0734800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:06.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.519+0000 7f06e0734800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:06.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.519+0000 7f06e0734800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:18:06.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.521+0000 7f0592fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:06.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.523+0000 7f06e0734800 20 remove_watcher() i=0 2024-09-12T00:18:06.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.523+0000 7f06e0734800 2 removed watcher, disabling cache 2024-09-12T00:18:06.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.524+0000 7f06e0734800 20 remove_watcher() i=1 2024-09-12T00:18:06.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.526+0000 7f06e0734800 20 remove_watcher() i=2 2024-09-12T00:18:06.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.527+0000 7f06e0734800 20 remove_watcher() i=3 2024-09-12T00:18:06.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.528+0000 7f06e0734800 20 remove_watcher() i=4 2024-09-12T00:18:06.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.529+0000 7f06e0734800 20 remove_watcher() i=5 2024-09-12T00:18:06.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.530+0000 7f06e0734800 20 remove_watcher() i=6 2024-09-12T00:18:06.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.531+0000 7f06e0734800 20 remove_watcher() i=7 2024-09-12T00:18:06.543 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshard list 2024-09-12T00:18:06.571 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:06.571 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:06.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.610+0000 7f2914e40800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.613+0000 7f2914e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.613+0000 7f2914e40800 20 realm 2024-09-12T00:18:06.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.613+0000 7f2914e40800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.613+0000 7f2914e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.613+0000 7f2914e40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:06.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.613+0000 7f2914e40800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.613+0000 7f2914e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.613+0000 7f2914e40800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.614+0000 7f2914e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:06.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.614+0000 7f2914e40800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.615+0000 7f2914e40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:06.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.615+0000 7f2914e40800 20 searching for the correct realm 2024-09-12T00:18:06.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.618+0000 7f291312b640 0 -- 172.21.15.67:0/3473240392 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7f28fc00b040 msgr2=0x7f28fc021990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:06.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.622+0000 7f291292a640 0 -- 172.21.15.67:0/3473240392 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f290c0aabf0 msgr2=0x7f290c0e0ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:06.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.627+0000 7f2914e40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:06.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.627+0000 7f2914e40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:06.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.627+0000 7f2914e40800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:06.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.627+0000 7f2914e40800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:06.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.627+0000 7f2914e40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:06.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.627+0000 7f2914e40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:06.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.627+0000 7f2914e40800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.627+0000 7f2914e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.627+0000 7f2914e40800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.627+0000 7f2914e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:06.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.627+0000 7f2914e40800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.628+0000 7f2914e40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:06.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.628+0000 7f2914e40800 20 zone default found 2024-09-12T00:18:06.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.628+0000 7f2914e40800 4 Realm: () 2024-09-12T00:18:06.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.628+0000 7f2914e40800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:06.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.628+0000 7f2914e40800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:06.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.628+0000 7f2914e40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:06.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.628+0000 7f2914e40800 20 zonegroup default 2024-09-12T00:18:06.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.628+0000 7f2914e40800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.628+0000 7f2914e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.628+0000 7f2914e40800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.628+0000 7f2914e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.628+0000 7f2914e40800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.629+0000 7f2914e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.629+0000 7f2914e40800 20 started sync module instance, tier type = 2024-09-12T00:18:06.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.629+0000 7f2914e40800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:06.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.638+0000 7f2914e40800 20 add_watcher() i=0 2024-09-12T00:18:06.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.638+0000 7f2914e40800 20 add_watcher() i=1 2024-09-12T00:18:06.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.638+0000 7f2914e40800 20 add_watcher() i=2 2024-09-12T00:18:06.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.638+0000 7f2914e40800 20 add_watcher() i=3 2024-09-12T00:18:06.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.638+0000 7f2914e40800 20 add_watcher() i=4 2024-09-12T00:18:06.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.638+0000 7f2914e40800 20 add_watcher() i=5 2024-09-12T00:18:06.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.638+0000 7f2914e40800 20 add_watcher() i=6 2024-09-12T00:18:06.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.639+0000 7f2914e40800 20 add_watcher() i=7 2024-09-12T00:18:06.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.639+0000 7f2914e40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:06.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.641+0000 7f27c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:06.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.641+0000 7f2914e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:06.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.641+0000 7f2914e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:06.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.641+0000 7f2914e40800 5 note: GC not initialized 2024-09-12T00:18:06.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.642+0000 7f2743fff640 20 reqs_thread_entry: start 2024-09-12T00:18:06.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.642+0000 7f2914e40800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:06.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.642+0000 7f2914e40800 20 Filter name: none 2024-09-12T00:18:06.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.642+0000 7f2741ffb640 20 reqs_thread_entry: start 2024-09-12T00:18:06.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.649+0000 7f27c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:06.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.651+0000 7f2914e40800 20 remove_watcher() i=0 2024-09-12T00:18:06.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.651+0000 7f2914e40800 2 removed watcher, disabling cache 2024-09-12T00:18:06.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.652+0000 7f2914e40800 20 remove_watcher() i=1 2024-09-12T00:18:06.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.653+0000 7f2914e40800 20 remove_watcher() i=2 2024-09-12T00:18:06.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.654+0000 7f2914e40800 20 remove_watcher() i=3 2024-09-12T00:18:06.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.655+0000 7f2914e40800 20 remove_watcher() i=4 2024-09-12T00:18:06.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.657+0000 7f2914e40800 20 remove_watcher() i=5 2024-09-12T00:18:06.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.658+0000 7f2914e40800 20 remove_watcher() i=6 2024-09-12T00:18:06.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.659+0000 7f2914e40800 20 remove_watcher() i=7 2024-09-12T00:18:06.669 INFO:tasks.workunit.client.0.smithi067.stderr:bucket name a-bucket 2024-09-12T00:18:06.669 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard process 2024-09-12T00:18:06.669 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:06.670 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshard process 2024-09-12T00:18:06.697 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:06.698 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:06.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.738+0000 7f5a1f726800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.740+0000 7f5a1f726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.740+0000 7f5a1f726800 20 realm 2024-09-12T00:18:06.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.740+0000 7f5a1f726800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.741+0000 7f5a1f726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.741+0000 7f5a1f726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:06.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.741+0000 7f5a1f726800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.741+0000 7f5a1f726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.741+0000 7f5a1f726800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.741+0000 7f5a1f726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:06.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.741+0000 7f5a1f726800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.742+0000 7f5a1f726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:06.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.742+0000 7f5a1f726800 20 searching for the correct realm 2024-09-12T00:18:06.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.744+0000 7f5a1b309640 0 -- 172.21.15.67:0/2713479797 >> [v2:172.21.15.67:6800/2522402523,v1:172.21.15.67:6801/2522402523] conn(0x5594a30a0bf0 msgr2=0x5594a30a3040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:06.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.747+0000 7f5a1bb0a640 0 -- 172.21.15.67:0/2713479797 >> [v2:172.21.15.170:6824/783534599,v1:172.21.15.170:6825/783534599] conn(0x5594a30a0bf0 msgr2=0x7f5a0c073860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:06.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.955+0000 7f5a1f726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:06.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.955+0000 7f5a1f726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:06.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.955+0000 7f5a1f726800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:06.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.955+0000 7f5a1f726800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:06.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.955+0000 7f5a1f726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:06.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.955+0000 7f5a1f726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:06.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.955+0000 7f5a1f726800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.955+0000 7f5a1f726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.955+0000 7f5a1f726800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.955+0000 7f5a1f726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:06.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.955+0000 7f5a1f726800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.956+0000 7f5a1f726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:06.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.956+0000 7f5a1f726800 20 zone default found 2024-09-12T00:18:06.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.956+0000 7f5a1f726800 4 Realm: () 2024-09-12T00:18:06.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.956+0000 7f5a1f726800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:06.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.956+0000 7f5a1f726800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:06.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.956+0000 7f5a1f726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:06.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.956+0000 7f5a1f726800 20 zonegroup default 2024-09-12T00:18:06.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.956+0000 7f5a1f726800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.956+0000 7f5a1f726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.956+0000 7f5a1f726800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.957+0000 7f5a1f726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.957+0000 7f5a1f726800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.957+0000 7f5a1f726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:06.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.957+0000 7f5a1f726800 20 started sync module instance, tier type = 2024-09-12T00:18:06.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.957+0000 7f5a1f726800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:06.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.966+0000 7f5a1f726800 20 add_watcher() i=0 2024-09-12T00:18:06.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.966+0000 7f5a1f726800 20 add_watcher() i=1 2024-09-12T00:18:06.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.966+0000 7f5a1f726800 20 add_watcher() i=2 2024-09-12T00:18:06.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.966+0000 7f5a1f726800 20 add_watcher() i=3 2024-09-12T00:18:06.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.966+0000 7f5a1f726800 20 add_watcher() i=4 2024-09-12T00:18:06.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.966+0000 7f5a1f726800 20 add_watcher() i=5 2024-09-12T00:18:06.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.967+0000 7f5a1f726800 20 add_watcher() i=6 2024-09-12T00:18:06.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.968+0000 7f5a1f726800 20 add_watcher() i=7 2024-09-12T00:18:06.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.968+0000 7f5a1f726800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:06.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.969+0000 7f58d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:06.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.970+0000 7f5a1f726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:06.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.970+0000 7f5a1f726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:06.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.970+0000 7f5a1f726800 5 note: GC not initialized 2024-09-12T00:18:06.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.970+0000 7f58d17e2640 20 reqs_thread_entry: start 2024-09-12T00:18:06.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.970+0000 7f5a1f726800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:06.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.970+0000 7f5a1f726800 20 Filter name: none 2024-09-12T00:18:06.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.970+0000 7f58ca7fc640 20 reqs_thread_entry: start 2024-09-12T00:18:06.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.970+0000 7f5a1f726800 20 processing logshard = reshard.0000000000 2024-09-12T00:18:06.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.973+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:18:06.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.973+0000 7f5a1f726800 20 processing logshard = reshard.0000000001 2024-09-12T00:18:06.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.975+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:18:06.974 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.975+0000 7f5a1f726800 20 processing logshard = reshard.0000000002 2024-09-12T00:18:06.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.978+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:18:06.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.978+0000 7f5a1f726800 20 processing logshard = reshard.0000000003 2024-09-12T00:18:06.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.980+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:18:06.979 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.980+0000 7f5a1f726800 20 processing logshard = reshard.0000000004 2024-09-12T00:18:06.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.983+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:18:06.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.983+0000 7f5a1f726800 20 processing logshard = reshard.0000000005 2024-09-12T00:18:06.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.985+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:18:06.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.985+0000 7f5a1f726800 20 processing logshard = reshard.0000000006 2024-09-12T00:18:06.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.986+0000 7f5a1f726800 20 process_entry resharding a-bucket 2024-09-12T00:18:06.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.986+0000 7f5a1f726800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:18:06.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.986+0000 7f5a1f726800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.987+0000 7f5a1f726800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:18:06.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.987+0000 7f5a1f726800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:18:06.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.987+0000 7f5a1f726800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:18:06.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.987+0000 7f5a1f726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:18:06.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.987+0000 7f5a1f726800 20 rados->read ofs=0 len=0 2024-09-12T00:18:06.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.987+0000 7f5a1f726800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:18:06.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.987+0000 7f5a1f726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:06.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.987+0000 7f5a1f726800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:06.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.987+0000 7f5a1f726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:06.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.987+0000 7f5a1f726800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:06.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.987+0000 7f5a1f726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:18:06.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.993+0000 7f5a1f726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:06.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.993+0000 7f5a1f726800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:06.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.993+0000 7f5a1f726800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:06.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.993+0000 7f5a1f726800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:18:06.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.993+0000 7f58feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562397 cookie 94096878920544 notifier 6087 bl.length()=827 2024-09-12T00:18:06.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.993+0000 7f58feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:06.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.993+0000 7f58feffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:06.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.993+0000 7f58feffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:06.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.994+0000 7f5a1f726800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:18:06.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.994+0000 7f5a1f726800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:18:06.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.994+0000 7f5a1f726800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:18:06.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.994+0000 7f5a1f726800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:18:06.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.996+0000 7f5a1f726800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.1.0 2024-09-12T00:18:06.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.996+0000 7f5a1f726800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.1.0 2024-09-12T00:18:06.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.996+0000 7f5a1f726800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.1.1 2024-09-12T00:18:06.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.996+0000 7f5a1f726800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.1.1 2024-09-12T00:18:06.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.996+0000 7f5a1f726800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.0 2024-09-12T00:18:06.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.996+0000 7f5a1f726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:18:06.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.997+0000 7f5a1f726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:18:06.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.998+0000 7f5a1f726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:06.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.998+0000 7f5a1f726800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:06.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.998+0000 7f5a1f726800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:06.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.998+0000 7f5a1f726800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:18:06.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.998+0000 7f58feffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562398 cookie 94096878920544 notifier 6087 bl.length()=827 2024-09-12T00:18:06.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.998+0000 7f58feffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:06.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.998+0000 7f58feffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:06.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.998+0000 7f58feffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:06.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.999+0000 7f5a1f726800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:18:06.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.999+0000 7f5a1f726800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:18:06.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.999+0000 7f5a1f726800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:18:06.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:06.999+0000 7f5a1f726800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:18:06.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.000+0000 7f5a1f726800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.0 2024-09-12T00:18:06.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.000+0000 7f5a1f726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:18:06.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.000+0000 7f5a1f726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:18:07.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.001+0000 7f5a1f726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:07.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.001+0000 7f5a1f726800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:07.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.001+0000 7f5a1f726800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:07.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.001+0000 7f5a1f726800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:18:07.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.002+0000 7f58fe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562399 cookie 94096878920544 notifier 6087 bl.length()=795 2024-09-12T00:18:07.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.002+0000 7f58fe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:07.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.002+0000 7f58fe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:07.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.002+0000 7f58fe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:07.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.002+0000 7f5a1f726800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:18:07.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.002+0000 7f5a1f726800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:18:07.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.002+0000 7f5a1f726800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:18:07.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.002+0000 7f5a1f726800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:18:07.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.004+0000 7f5a1f726800 1 execute INFO: reshard of bucket "a-bucket" from 1 shards to 2 shards completed successfully 2024-09-12T00:18:07.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.005+0000 7f5a1f726800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:18:07.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.007+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:18:07.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.007+0000 7f5a1f726800 20 processing logshard = reshard.0000000007 2024-09-12T00:18:07.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.009+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:18:07.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.009+0000 7f5a1f726800 20 processing logshard = reshard.0000000008 2024-09-12T00:18:07.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.012+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:18:07.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.012+0000 7f5a1f726800 20 processing logshard = reshard.0000000009 2024-09-12T00:18:07.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.014+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:18:07.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.014+0000 7f5a1f726800 20 processing logshard = reshard.0000000010 2024-09-12T00:18:07.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.017+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:18:07.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.017+0000 7f5a1f726800 20 processing logshard = reshard.0000000011 2024-09-12T00:18:07.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.019+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:18:07.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.019+0000 7f5a1f726800 20 processing logshard = reshard.0000000012 2024-09-12T00:18:07.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.022+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:18:07.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.022+0000 7f5a1f726800 20 processing logshard = reshard.0000000013 2024-09-12T00:18:07.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.024+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:18:07.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.024+0000 7f5a1f726800 20 processing logshard = reshard.0000000014 2024-09-12T00:18:07.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.027+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:18:07.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.027+0000 7f5a1f726800 20 processing logshard = reshard.0000000015 2024-09-12T00:18:07.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.029+0000 7f5a1f726800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:18:07.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.030+0000 7f58d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:07.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.032+0000 7f5a1f726800 20 remove_watcher() i=0 2024-09-12T00:18:07.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.032+0000 7f5a1f726800 2 removed watcher, disabling cache 2024-09-12T00:18:07.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.033+0000 7f5a1f726800 20 remove_watcher() i=1 2024-09-12T00:18:07.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.034+0000 7f5a1f726800 20 remove_watcher() i=2 2024-09-12T00:18:07.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.035+0000 7f5a1f726800 20 remove_watcher() i=3 2024-09-12T00:18:07.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.036+0000 7f5a1f726800 20 remove_watcher() i=4 2024-09-12T00:18:07.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.038+0000 7f5a1f726800 20 remove_watcher() i=5 2024-09-12T00:18:07.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.039+0000 7f5a1f726800 20 remove_watcher() i=6 2024-09-12T00:18:07.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:07.040+0000 7f5a1f726800 20 remove_watcher() i=7 2024-09-12T00:18:12.058 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:18:12.092 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:12.092 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.138+0000 7f6116146800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.140+0000 7f6116146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.140+0000 7f6116146800 20 realm 2024-09-12T00:18:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.140+0000 7f6116146800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.140+0000 7f6116146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.140+0000 7f6116146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.141+0000 7f6116146800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.141+0000 7f6116146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.141+0000 7f6116146800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.142+0000 7f6116146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:12.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.142+0000 7f6116146800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.143+0000 7f6116146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:12.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.143+0000 7f6116146800 20 searching for the correct realm 2024-09-12T00:18:12.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.146+0000 7f610b436640 0 -- 172.21.15.67:0/3648647510 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f60fc03b940 msgr2=0x7f60fc020430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:12.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.352+0000 7f6114438640 0 -- 172.21.15.67:0/3648647510 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55c101971740 msgr2=0x55c101973b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:12.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.357+0000 7f6116146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:12.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.357+0000 7f6116146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:12.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.357+0000 7f6116146800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:12.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.357+0000 7f6116146800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:12.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.357+0000 7f6116146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:12.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.357+0000 7f6116146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:12.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.357+0000 7f6116146800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.358+0000 7f6116146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:12.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.358+0000 7f6116146800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.358+0000 7f6116146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:12.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.358+0000 7f6116146800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.358+0000 7f6116146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:12.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.358+0000 7f6116146800 20 zone default found 2024-09-12T00:18:12.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.358+0000 7f6116146800 4 Realm: () 2024-09-12T00:18:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.358+0000 7f6116146800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.358+0000 7f6116146800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.358+0000 7f6116146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.358+0000 7f6116146800 20 zonegroup default 2024-09-12T00:18:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.358+0000 7f6116146800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.359+0000 7f6116146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.359+0000 7f6116146800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.359+0000 7f6116146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:12.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.359+0000 7f6116146800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.360+0000 7f6116146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:12.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.360+0000 7f6116146800 20 started sync module instance, tier type = 2024-09-12T00:18:12.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.360+0000 7f6116146800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:12.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.371+0000 7f6116146800 20 add_watcher() i=0 2024-09-12T00:18:12.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.371+0000 7f6116146800 20 add_watcher() i=1 2024-09-12T00:18:12.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.371+0000 7f6116146800 20 add_watcher() i=2 2024-09-12T00:18:12.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.371+0000 7f6116146800 20 add_watcher() i=3 2024-09-12T00:18:12.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.371+0000 7f6116146800 20 add_watcher() i=4 2024-09-12T00:18:12.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.371+0000 7f6116146800 20 add_watcher() i=5 2024-09-12T00:18:12.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.371+0000 7f6116146800 20 add_watcher() i=6 2024-09-12T00:18:12.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.372+0000 7f6116146800 20 add_watcher() i=7 2024-09-12T00:18:12.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.372+0000 7f6116146800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:12.373 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.374+0000 7f5fc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.374+0000 7f6116146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.374+0000 7f6116146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.374+0000 7f6116146800 5 note: GC not initialized 2024-09-12T00:18:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.374+0000 7f5fc8fe1640 20 reqs_thread_entry: start 2024-09-12T00:18:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.374+0000 7f6116146800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.374+0000 7f6116146800 20 Filter name: none 2024-09-12T00:18:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.375+0000 7f5f427fc640 20 reqs_thread_entry: start 2024-09-12T00:18:12.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.375+0000 7f6116146800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.375+0000 7f6116146800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:18:12.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.375+0000 7f6116146800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.376+0000 7f6116146800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:18:12.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.376+0000 7f6116146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:12.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.376+0000 7f6116146800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.376+0000 7f6116146800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:18:12.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.376+0000 7f6116146800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.376+0000 7f6116146800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:18:12.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.377+0000 7f6116146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:12.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.378+0000 7f5fc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:12.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.381+0000 7f6116146800 20 remove_watcher() i=0 2024-09-12T00:18:12.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.381+0000 7f6116146800 2 removed watcher, disabling cache 2024-09-12T00:18:12.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.382+0000 7f6116146800 20 remove_watcher() i=1 2024-09-12T00:18:12.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.383+0000 7f6116146800 20 remove_watcher() i=2 2024-09-12T00:18:12.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.384+0000 7f6116146800 20 remove_watcher() i=3 2024-09-12T00:18:12.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.385+0000 7f6116146800 20 remove_watcher() i=4 2024-09-12T00:18:12.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.386+0000 7f6116146800 20 remove_watcher() i=5 2024-09-12T00:18:12.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.387+0000 7f6116146800 20 remove_watcher() i=6 2024-09-12T00:18:12.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.388+0000 7f6116146800 20 remove_watcher() i=7 2024-09-12T00:18:12.400 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:12.400 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:12.400 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:18:12.400 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:12.400 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard add non empty bucket 2024-09-12T00:18:12.401 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:12.493 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:18:12.522 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:12.522 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:12.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.563+0000 7f1cd5c32800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.565+0000 7f1cd5c32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:12.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.565+0000 7f1cd5c32800 20 realm 2024-09-12T00:18:12.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.566+0000 7f1cd5c32800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.566+0000 7f1cd5c32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:12.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.566+0000 7f1cd5c32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:12.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.566+0000 7f1cd5c32800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.566+0000 7f1cd5c32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:12.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.566+0000 7f1cd5c32800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.567+0000 7f1cd5c32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:12.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.567+0000 7f1cd5c32800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.568+0000 7f1cd5c32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:12.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.568+0000 7f1cd5c32800 20 searching for the correct realm 2024-09-12T00:18:12.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.569+0000 7f1cd0f53640 0 -- 172.21.15.67:0/520054026 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f1cc406c040 msgr2=0x7f1cc40cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:12.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.774+0000 7f1cd0f53640 0 -- 172.21.15.67:0/520054026 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f1ccc02c040 msgr2=0x7f1ccc03b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:12.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.981+0000 7f1cd5c32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:12.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.981+0000 7f1cd5c32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:12.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.981+0000 7f1cd5c32800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:12.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.981+0000 7f1cd5c32800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:12.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.981+0000 7f1cd5c32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:12.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.981+0000 7f1cd5c32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:12.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.981+0000 7f1cd5c32800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.981+0000 7f1cd5c32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:12.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.981+0000 7f1cd5c32800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.981+0000 7f1cd5c32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:12.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.981+0000 7f1cd5c32800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.982+0000 7f1cd5c32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:12.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.982+0000 7f1cd5c32800 20 zone default found 2024-09-12T00:18:12.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.982+0000 7f1cd5c32800 4 Realm: () 2024-09-12T00:18:12.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.982+0000 7f1cd5c32800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:12.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.982+0000 7f1cd5c32800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:12.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.982+0000 7f1cd5c32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:12.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.982+0000 7f1cd5c32800 20 zonegroup default 2024-09-12T00:18:12.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.982+0000 7f1cd5c32800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.982+0000 7f1cd5c32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:12.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.982+0000 7f1cd5c32800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.983+0000 7f1cd5c32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:12.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.983+0000 7f1cd5c32800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.983+0000 7f1cd5c32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:12.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.983+0000 7f1cd5c32800 20 started sync module instance, tier type = 2024-09-12T00:18:12.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.983+0000 7f1cd5c32800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:12.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.993+0000 7f1cd5c32800 20 add_watcher() i=0 2024-09-12T00:18:12.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.993+0000 7f1cd5c32800 20 add_watcher() i=1 2024-09-12T00:18:12.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.993+0000 7f1cd5c32800 20 add_watcher() i=2 2024-09-12T00:18:12.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.993+0000 7f1cd5c32800 20 add_watcher() i=3 2024-09-12T00:18:12.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.993+0000 7f1cd5c32800 20 add_watcher() i=4 2024-09-12T00:18:12.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.993+0000 7f1cd5c32800 20 add_watcher() i=5 2024-09-12T00:18:12.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.993+0000 7f1cd5c32800 20 add_watcher() i=6 2024-09-12T00:18:12.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.995+0000 7f1cd5c32800 20 add_watcher() i=7 2024-09-12T00:18:12.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.995+0000 7f1cd5c32800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:12.995 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.996+0000 7f1b86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:12.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.997+0000 7f1cd5c32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:12.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.997+0000 7f1cd5c32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:12.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.997+0000 7f1cd5c32800 5 note: GC not initialized 2024-09-12T00:18:12.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.997+0000 7f1b85fe3640 20 reqs_thread_entry: start 2024-09-12T00:18:12.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.997+0000 7f1cd5c32800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:12.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.997+0000 7f1cd5c32800 20 Filter name: none 2024-09-12T00:18:12.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.997+0000 7f1af77fe640 20 reqs_thread_entry: start 2024-09-12T00:18:12.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.997+0000 7f1cd5c32800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.998+0000 7f1cd5c32800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:18:12.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.998+0000 7f1cd5c32800 20 rados->read ofs=0 len=0 2024-09-12T00:18:12.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.998+0000 7f1cd5c32800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:18:12.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.998+0000 7f1cd5c32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:13.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.998+0000 7f1cd5c32800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.999+0000 7f1cd5c32800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:18:13.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.999+0000 7f1cd5c32800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.999+0000 7f1cd5c32800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:18:13.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:12.999+0000 7f1cd5c32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:13.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.000+0000 7f1b86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:13.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.003+0000 7f1cd5c32800 20 remove_watcher() i=0 2024-09-12T00:18:13.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.003+0000 7f1cd5c32800 2 removed watcher, disabling cache 2024-09-12T00:18:13.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.004+0000 7f1cd5c32800 20 remove_watcher() i=1 2024-09-12T00:18:13.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.006+0000 7f1cd5c32800 20 remove_watcher() i=2 2024-09-12T00:18:13.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.007+0000 7f1cd5c32800 20 remove_watcher() i=3 2024-09-12T00:18:13.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.008+0000 7f1cd5c32800 20 remove_watcher() i=4 2024-09-12T00:18:13.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.009+0000 7f1cd5c32800 20 remove_watcher() i=5 2024-09-12T00:18:13.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.010+0000 7f1cd5c32800 20 remove_watcher() i=6 2024-09-12T00:18:13.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.011+0000 7f1cd5c32800 20 remove_watcher() i=7 2024-09-12T00:18:13.023 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:13.023 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:13.024 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 num_objects: 8 size_kb: 1 num_shards: 2 2024-09-12T00:18:13.024 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:13.025 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-09-12T00:18:13.057 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:13.057 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:13.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.098+0000 7f0cb4723800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.100+0000 7f0cb4723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.100+0000 7f0cb4723800 20 realm 2024-09-12T00:18:13.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.100+0000 7f0cb4723800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.100+0000 7f0cb4723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.100+0000 7f0cb4723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:13.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.100+0000 7f0cb4723800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.100+0000 7f0cb4723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.100+0000 7f0cb4723800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.101+0000 7f0cb4723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:13.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.101+0000 7f0cb4723800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.102+0000 7f0cb4723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:13.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.102+0000 7f0cb4723800 20 searching for the correct realm 2024-09-12T00:18:13.104 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.105+0000 7f0cb0c0d640 0 -- 172.21.15.67:0/1467393037 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7f0c9807f040 msgr2=0x7f0c9807f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:13.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.109+0000 7f0cb040c640 0 -- 172.21.15.67:0/1467393037 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f0ca807b5b0 msgr2=0x7f0ca8060310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:13.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.112+0000 7f0cb4723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.112+0000 7f0cb4723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.112+0000 7f0cb4723800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.112+0000 7f0cb4723800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.112+0000 7f0cb4723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.112+0000 7f0cb4723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.112+0000 7f0cb4723800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.112+0000 7f0cb4723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.112+0000 7f0cb4723800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.113+0000 7f0cb4723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.113+0000 7f0cb4723800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.113+0000 7f0cb4723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.113+0000 7f0cb4723800 20 zone default found 2024-09-12T00:18:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.113+0000 7f0cb4723800 4 Realm: () 2024-09-12T00:18:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.113+0000 7f0cb4723800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.113+0000 7f0cb4723800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.113+0000 7f0cb4723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.113+0000 7f0cb4723800 20 zonegroup default 2024-09-12T00:18:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.113+0000 7f0cb4723800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.113+0000 7f0cb4723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.113+0000 7f0cb4723800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.114+0000 7f0cb4723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.114+0000 7f0cb4723800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.114+0000 7f0cb4723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.114+0000 7f0cb4723800 20 started sync module instance, tier type = 2024-09-12T00:18:13.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.114+0000 7f0cb4723800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:13.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.123+0000 7f0cb4723800 20 add_watcher() i=0 2024-09-12T00:18:13.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.123+0000 7f0cb4723800 20 add_watcher() i=1 2024-09-12T00:18:13.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.123+0000 7f0cb4723800 20 add_watcher() i=2 2024-09-12T00:18:13.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.123+0000 7f0cb4723800 20 add_watcher() i=3 2024-09-12T00:18:13.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.123+0000 7f0cb4723800 20 add_watcher() i=4 2024-09-12T00:18:13.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.123+0000 7f0cb4723800 20 add_watcher() i=5 2024-09-12T00:18:13.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.123+0000 7f0cb4723800 20 add_watcher() i=6 2024-09-12T00:18:13.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.124+0000 7f0cb4723800 20 add_watcher() i=7 2024-09-12T00:18:13.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.124+0000 7f0cb4723800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.126+0000 7f0b66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.126+0000 7f0cb4723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.126+0000 7f0cb4723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.126+0000 7f0cb4723800 5 note: GC not initialized 2024-09-12T00:18:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.126+0000 7f0b65fe3640 20 reqs_thread_entry: start 2024-09-12T00:18:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.126+0000 7f0cb4723800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.126+0000 7f0cb4723800 20 Filter name: none 2024-09-12T00:18:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.127+0000 7f0b5f7fe640 20 reqs_thread_entry: start 2024-09-12T00:18:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.127+0000 7f0cb4723800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:18:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.127+0000 7f0cb4723800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.127+0000 7f0cb4723800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:18:13.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.127+0000 7f0cb4723800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:18:13.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.127+0000 7f0cb4723800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:18:13.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.127+0000 7f0cb4723800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:18:13.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.127+0000 7f0cb4723800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.127+0000 7f0cb4723800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:18:13.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.127+0000 7f0cb4723800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:13.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.127+0000 7f0cb4723800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:13.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.127+0000 7f0cb4723800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:13.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.127+0000 7f0cb4723800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:13.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.127+0000 7f0cb4723800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:18:13.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.129+0000 7f0b66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:13.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.132+0000 7f0cb4723800 20 remove_watcher() i=0 2024-09-12T00:18:13.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.132+0000 7f0cb4723800 2 removed watcher, disabling cache 2024-09-12T00:18:13.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.133+0000 7f0cb4723800 20 remove_watcher() i=1 2024-09-12T00:18:13.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.134+0000 7f0cb4723800 20 remove_watcher() i=2 2024-09-12T00:18:13.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.135+0000 7f0cb4723800 20 remove_watcher() i=3 2024-09-12T00:18:13.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.136+0000 7f0cb4723800 20 remove_watcher() i=4 2024-09-12T00:18:13.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.137+0000 7f0cb4723800 20 remove_watcher() i=5 2024-09-12T00:18:13.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.138+0000 7f0cb4723800 20 remove_watcher() i=6 2024-09-12T00:18:13.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.139+0000 7f0cb4723800 20 remove_watcher() i=7 2024-09-12T00:18:13.151 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshard list 2024-09-12T00:18:13.182 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:13.182 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:13.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.224+0000 7f15ca72c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.226+0000 7f15ca72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.226+0000 7f15ca72c800 20 realm 2024-09-12T00:18:13.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.226+0000 7f15ca72c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.226+0000 7f15ca72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.226+0000 7f15ca72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:13.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.226+0000 7f15ca72c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.226+0000 7f15ca72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.226+0000 7f15ca72c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.227+0000 7f15ca72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:13.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.227+0000 7f15ca72c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.228+0000 7f15ca72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:13.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.228+0000 7f15ca72c800 20 searching for the correct realm 2024-09-12T00:18:13.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.231+0000 7f15c5b3d640 0 -- 172.21.15.67:0/2459637410 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f15bc0b48a0 msgr2=0x7f15bc0cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:13.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.436+0000 7f15c6b3f640 0 -- 172.21.15.67:0/2459637410 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x555f66236680 msgr2=0x555f66238b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:13.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.440+0000 7f15ca72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:13.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.440+0000 7f15ca72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:13.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.440+0000 7f15ca72c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:13.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.440+0000 7f15ca72c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:13.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.440+0000 7f15ca72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:13.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.440+0000 7f15ca72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:13.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.441+0000 7f15ca72c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.441+0000 7f15ca72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.441+0000 7f15ca72c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.441+0000 7f15ca72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:13.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.441+0000 7f15ca72c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.441+0000 7f15ca72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:13.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.441+0000 7f15ca72c800 20 zone default found 2024-09-12T00:18:13.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.441+0000 7f15ca72c800 4 Realm: () 2024-09-12T00:18:13.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.441+0000 7f15ca72c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:13.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.441+0000 7f15ca72c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:13.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.441+0000 7f15ca72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:13.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.441+0000 7f15ca72c800 20 zonegroup default 2024-09-12T00:18:13.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.441+0000 7f15ca72c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.442+0000 7f15ca72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.442+0000 7f15ca72c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.442+0000 7f15ca72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.442+0000 7f15ca72c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.442+0000 7f15ca72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.442+0000 7f15ca72c800 20 started sync module instance, tier type = 2024-09-12T00:18:13.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.442+0000 7f15ca72c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:13.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.452+0000 7f15ca72c800 20 add_watcher() i=0 2024-09-12T00:18:13.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.452+0000 7f15ca72c800 20 add_watcher() i=1 2024-09-12T00:18:13.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.452+0000 7f15ca72c800 20 add_watcher() i=2 2024-09-12T00:18:13.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.452+0000 7f15ca72c800 20 add_watcher() i=3 2024-09-12T00:18:13.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.452+0000 7f15ca72c800 20 add_watcher() i=4 2024-09-12T00:18:13.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.452+0000 7f15ca72c800 20 add_watcher() i=5 2024-09-12T00:18:13.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.452+0000 7f15ca72c800 20 add_watcher() i=6 2024-09-12T00:18:13.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.453+0000 7f15ca72c800 20 add_watcher() i=7 2024-09-12T00:18:13.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.453+0000 7f15ca72c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:13.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.455+0000 7f147cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:13.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.455+0000 7f15ca72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:13.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.455+0000 7f15ca72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:13.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.455+0000 7f15ca72c800 5 note: GC not initialized 2024-09-12T00:18:13.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.455+0000 7f13f77fe640 20 reqs_thread_entry: start 2024-09-12T00:18:13.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.456+0000 7f15ca72c800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:13.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.456+0000 7f15ca72c800 20 Filter name: none 2024-09-12T00:18:13.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.456+0000 7f13f57fa640 20 reqs_thread_entry: start 2024-09-12T00:18:13.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.463+0000 7f147cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:13.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.465+0000 7f15ca72c800 20 remove_watcher() i=0 2024-09-12T00:18:13.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.465+0000 7f15ca72c800 2 removed watcher, disabling cache 2024-09-12T00:18:13.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.466+0000 7f15ca72c800 20 remove_watcher() i=1 2024-09-12T00:18:13.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.467+0000 7f15ca72c800 20 remove_watcher() i=2 2024-09-12T00:18:13.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.468+0000 7f15ca72c800 20 remove_watcher() i=3 2024-09-12T00:18:13.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.469+0000 7f15ca72c800 20 remove_watcher() i=4 2024-09-12T00:18:13.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.470+0000 7f15ca72c800 20 remove_watcher() i=5 2024-09-12T00:18:13.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.471+0000 7f15ca72c800 20 remove_watcher() i=6 2024-09-12T00:18:13.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.472+0000 7f15ca72c800 20 remove_watcher() i=7 2024-09-12T00:18:13.484 INFO:tasks.workunit.client.0.smithi067.stderr:bucket name a-bucket 2024-09-12T00:18:13.484 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard process non empty bucket 2024-09-12T00:18:13.484 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:13.485 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshard process 2024-09-12T00:18:13.512 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:13.512 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:13.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.552+0000 7f6e43123800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.554+0000 7f6e43123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.554+0000 7f6e43123800 20 realm 2024-09-12T00:18:13.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.554+0000 7f6e43123800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.554+0000 7f6e43123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.554+0000 7f6e43123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:13.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.554+0000 7f6e43123800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.554+0000 7f6e43123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.554+0000 7f6e43123800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.555+0000 7f6e43123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:13.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.555+0000 7f6e43123800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.556+0000 7f6e43123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:13.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.556+0000 7f6e43123800 20 searching for the correct realm 2024-09-12T00:18:13.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.558+0000 7f6e3e612640 0 -- 172.21.15.67:0/36753075 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f6e2806e0e0 msgr2=0x7f6e2809d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:13.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.763+0000 7f6e3e612640 0 -- 172.21.15.67:0/36753075 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5630dc1953f0 msgr2=0x5630dc1977e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.767+0000 7f6e43123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.767+0000 7f6e43123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.767+0000 7f6e43123800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.767+0000 7f6e43123800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.767+0000 7f6e43123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.767+0000 7f6e43123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.767+0000 7f6e43123800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.767+0000 7f6e43123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.767+0000 7f6e43123800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.768+0000 7f6e43123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.768+0000 7f6e43123800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.768+0000 7f6e43123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.768+0000 7f6e43123800 20 zone default found 2024-09-12T00:18:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.768+0000 7f6e43123800 4 Realm: () 2024-09-12T00:18:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.768+0000 7f6e43123800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.768+0000 7f6e43123800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.768+0000 7f6e43123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.768+0000 7f6e43123800 20 zonegroup default 2024-09-12T00:18:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.768+0000 7f6e43123800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.768+0000 7f6e43123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.768+0000 7f6e43123800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.769+0000 7f6e43123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.769+0000 7f6e43123800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.769+0000 7f6e43123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.769+0000 7f6e43123800 20 started sync module instance, tier type = 2024-09-12T00:18:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.769+0000 7f6e43123800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.778+0000 7f6e43123800 20 add_watcher() i=0 2024-09-12T00:18:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.778+0000 7f6e43123800 20 add_watcher() i=1 2024-09-12T00:18:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.778+0000 7f6e43123800 20 add_watcher() i=2 2024-09-12T00:18:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.778+0000 7f6e43123800 20 add_watcher() i=3 2024-09-12T00:18:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.778+0000 7f6e43123800 20 add_watcher() i=4 2024-09-12T00:18:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.778+0000 7f6e43123800 20 add_watcher() i=5 2024-09-12T00:18:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.778+0000 7f6e43123800 20 add_watcher() i=6 2024-09-12T00:18:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.779+0000 7f6e43123800 20 add_watcher() i=7 2024-09-12T00:18:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.779+0000 7f6e43123800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:13.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.781+0000 7f6cf57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:13.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.781+0000 7f6e43123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:13.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.781+0000 7f6e43123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:13.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.781+0000 7f6e43123800 5 note: GC not initialized 2024-09-12T00:18:13.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.782+0000 7f6c6ffff640 20 reqs_thread_entry: start 2024-09-12T00:18:13.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.782+0000 7f6e43123800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:13.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.782+0000 7f6e43123800 20 Filter name: none 2024-09-12T00:18:13.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.782+0000 7f6c6dffb640 20 reqs_thread_entry: start 2024-09-12T00:18:13.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.782+0000 7f6e43123800 20 processing logshard = reshard.0000000000 2024-09-12T00:18:13.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.784+0000 7f6e43123800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:18:13.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.784+0000 7f6e43123800 20 processing logshard = reshard.0000000001 2024-09-12T00:18:13.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.787+0000 7f6e43123800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:18:13.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.787+0000 7f6e43123800 20 processing logshard = reshard.0000000002 2024-09-12T00:18:13.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.789+0000 7f6e43123800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:18:13.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.789+0000 7f6e43123800 20 processing logshard = reshard.0000000003 2024-09-12T00:18:13.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.792+0000 7f6e43123800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:18:13.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.792+0000 7f6e43123800 20 processing logshard = reshard.0000000004 2024-09-12T00:18:13.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.794+0000 7f6e43123800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:18:13.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.794+0000 7f6e43123800 20 processing logshard = reshard.0000000005 2024-09-12T00:18:13.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.796+0000 7f6e43123800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:18:13.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.796+0000 7f6e43123800 20 processing logshard = reshard.0000000006 2024-09-12T00:18:13.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.797+0000 7f6e43123800 20 process_entry resharding a-bucket 2024-09-12T00:18:13.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.797+0000 7f6e43123800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:18:13.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.797+0000 7f6e43123800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.798+0000 7f6e43123800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:18:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.798+0000 7f6e43123800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:18:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.798+0000 7f6e43123800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:18:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.798+0000 7f6e43123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:18:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.798+0000 7f6e43123800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.798+0000 7f6e43123800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:18:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.798+0000 7f6e43123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.798+0000 7f6e43123800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.798+0000 7f6e43123800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.798+0000 7f6e43123800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.798+0000 7f6e43123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:18:13.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.803+0000 7f6e43123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:13.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.803+0000 7f6e43123800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:13.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.803+0000 7f6e43123800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:13.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.803+0000 7f6e43123800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:18:13.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.803+0000 7f6d21ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562400 cookie 94767851134096 notifier 6180 bl.length()=827 2024-09-12T00:18:13.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.803+0000 7f6d21ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:13.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.803+0000 7f6d21ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:13.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.803+0000 7f6d21ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:13.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.804+0000 7f6e43123800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:18:13.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.804+0000 7f6e43123800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:18:13.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.804+0000 7f6e43123800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:18:13.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.804+0000 7f6e43123800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:18:13.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.806+0000 7f6e43123800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:18:13.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.806+0000 7f6e43123800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:18:13.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.806+0000 7f6e43123800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:18:13.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.806+0000 7f6e43123800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:18:13.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.806+0000 7f6e43123800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:18:13.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.806+0000 7f6e43123800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:18:13.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.806+0000 7f6e43123800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.1.0 2024-09-12T00:18:13.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.806+0000 7f6e43123800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.1.0 2024-09-12T00:18:13.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.807+0000 7f6e43123800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.1.1 2024-09-12T00:18:13.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.807+0000 7f6e43123800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.1.1 2024-09-12T00:18:13.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.808+0000 7f6e43123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:18:13.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.808+0000 7f6e43123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:18:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.810+0000 7f6e43123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.810+0000 7f6e43123800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.810+0000 7f6e43123800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.810+0000 7f6e43123800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:18:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.810+0000 7f6d227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562401 cookie 94767851134096 notifier 6180 bl.length()=827 2024-09-12T00:18:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.810+0000 7f6d227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:13.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.810+0000 7f6d227fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:13.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.810+0000 7f6d227fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.810+0000 7f6e43123800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:18:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.810+0000 7f6e43123800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:18:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.810+0000 7f6e43123800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:18:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.810+0000 7f6e43123800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:18:13.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.811+0000 7f6e43123800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.1.0 2024-09-12T00:18:13.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.811+0000 7f6e43123800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.1.0 2024-09-12T00:18:13.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.812+0000 7f6e43123800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.1.1 2024-09-12T00:18:13.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.812+0000 7f6e43123800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.1.1 2024-09-12T00:18:13.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.812+0000 7f6e43123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:18:13.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.812+0000 7f6e43123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:18:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.813+0000 7f6e43123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.813+0000 7f6e43123800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.813+0000 7f6e43123800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.813+0000 7f6e43123800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:18:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.814+0000 7f6d227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562402 cookie 94767851134096 notifier 6180 bl.length()=795 2024-09-12T00:18:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.814+0000 7f6d227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:18:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.814+0000 7f6d227fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:18:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.814+0000 7f6d227fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:18:13.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.814+0000 7f6e43123800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:18:13.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.814+0000 7f6e43123800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:18:13.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.814+0000 7f6e43123800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:18:13.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.814+0000 7f6e43123800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:18:13.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.815+0000 7f6e43123800 1 execute INFO: reshard of bucket "a-bucket" from 2 shards to 3 shards completed successfully 2024-09-12T00:18:13.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.816+0000 7f6e43123800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:18:13.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.818+0000 7f6e43123800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:18:13.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.818+0000 7f6e43123800 20 processing logshard = reshard.0000000007 2024-09-12T00:18:13.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.820+0000 7f6e43123800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:18:13.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.820+0000 7f6e43123800 20 processing logshard = reshard.0000000008 2024-09-12T00:18:13.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.823+0000 7f6e43123800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:18:13.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.823+0000 7f6e43123800 20 processing logshard = reshard.0000000009 2024-09-12T00:18:13.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.826+0000 7f6e43123800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:18:13.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.826+0000 7f6e43123800 20 processing logshard = reshard.0000000010 2024-09-12T00:18:13.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.829+0000 7f6e43123800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:18:13.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.829+0000 7f6e43123800 20 processing logshard = reshard.0000000011 2024-09-12T00:18:13.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.831+0000 7f6e43123800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:18:13.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.831+0000 7f6e43123800 20 processing logshard = reshard.0000000012 2024-09-12T00:18:13.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.834+0000 7f6e43123800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:18:13.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.834+0000 7f6e43123800 20 processing logshard = reshard.0000000013 2024-09-12T00:18:13.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.836+0000 7f6e43123800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:18:13.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.836+0000 7f6e43123800 20 processing logshard = reshard.0000000014 2024-09-12T00:18:13.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.838+0000 7f6e43123800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:18:13.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.838+0000 7f6e43123800 20 processing logshard = reshard.0000000015 2024-09-12T00:18:13.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.841+0000 7f6e43123800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:18:13.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.842+0000 7f6cf57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:13.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.844+0000 7f6e43123800 20 remove_watcher() i=0 2024-09-12T00:18:13.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.844+0000 7f6e43123800 2 removed watcher, disabling cache 2024-09-12T00:18:13.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.845+0000 7f6e43123800 20 remove_watcher() i=1 2024-09-12T00:18:13.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.846+0000 7f6e43123800 20 remove_watcher() i=2 2024-09-12T00:18:13.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.847+0000 7f6e43123800 20 remove_watcher() i=3 2024-09-12T00:18:13.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.848+0000 7f6e43123800 20 remove_watcher() i=4 2024-09-12T00:18:13.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.849+0000 7f6e43123800 20 remove_watcher() i=5 2024-09-12T00:18:13.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.850+0000 7f6e43123800 20 remove_watcher() i=6 2024-09-12T00:18:13.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.852+0000 7f6e43123800 20 remove_watcher() i=7 2024-09-12T00:18:13.863 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:18:13.893 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:13.893 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:13.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.932+0000 7f2d2772e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.934+0000 7f2d2772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.934+0000 7f2d2772e800 20 realm 2024-09-12T00:18:13.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.934+0000 7f2d2772e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.934+0000 7f2d2772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.934+0000 7f2d2772e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:13.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.934+0000 7f2d2772e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.935+0000 7f2d2772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:13.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.935+0000 7f2d2772e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.935+0000 7f2d2772e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:13.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.935+0000 7f2d2772e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:13.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.936+0000 7f2d2772e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:13.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.936+0000 7f2d2772e800 20 searching for the correct realm 2024-09-12T00:18:13.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.939+0000 7f2d22b63640 0 -- 172.21.15.67:0/3052885329 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f2d0c05f5a0 msgr2=0x7f2d0c065040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:13.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:13.941+0000 7f2d23364640 0 -- 172.21.15.67:0/3052885329 >> [v2:172.21.15.170:6824/783534599,v1:172.21.15.170:6825/783534599] conn(0x7f2d1409e160 msgr2=0x7f2d1408a2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:14.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.147+0000 7f2d2772e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:14.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.147+0000 7f2d2772e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:14.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.147+0000 7f2d2772e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:14.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.147+0000 7f2d2772e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:14.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.147+0000 7f2d2772e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:14.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.147+0000 7f2d2772e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:14.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.147+0000 7f2d2772e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.148+0000 7f2d2772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:14.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.148+0000 7f2d2772e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.148+0000 7f2d2772e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:14.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.148+0000 7f2d2772e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.148+0000 7f2d2772e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:14.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.148+0000 7f2d2772e800 20 zone default found 2024-09-12T00:18:14.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.148+0000 7f2d2772e800 4 Realm: () 2024-09-12T00:18:14.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.148+0000 7f2d2772e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:14.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.148+0000 7f2d2772e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:14.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.148+0000 7f2d2772e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:14.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.148+0000 7f2d2772e800 20 zonegroup default 2024-09-12T00:18:14.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.148+0000 7f2d2772e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.149+0000 7f2d2772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:14.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.149+0000 7f2d2772e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.149+0000 7f2d2772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:14.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.149+0000 7f2d2772e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.149+0000 7f2d2772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:14.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.149+0000 7f2d2772e800 20 started sync module instance, tier type = 2024-09-12T00:18:14.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.149+0000 7f2d2772e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:14.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.158+0000 7f2d2772e800 20 add_watcher() i=0 2024-09-12T00:18:14.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.158+0000 7f2d2772e800 20 add_watcher() i=1 2024-09-12T00:18:14.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.158+0000 7f2d2772e800 20 add_watcher() i=2 2024-09-12T00:18:14.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.158+0000 7f2d2772e800 20 add_watcher() i=3 2024-09-12T00:18:14.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.158+0000 7f2d2772e800 20 add_watcher() i=4 2024-09-12T00:18:14.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.158+0000 7f2d2772e800 20 add_watcher() i=5 2024-09-12T00:18:14.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.158+0000 7f2d2772e800 20 add_watcher() i=6 2024-09-12T00:18:14.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.159+0000 7f2d2772e800 20 add_watcher() i=7 2024-09-12T00:18:14.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.159+0000 7f2d2772e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:14.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.160+0000 7f2bd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:14.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.161+0000 7f2d2772e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:14.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.161+0000 7f2d2772e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:14.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.161+0000 7f2d2772e800 5 note: GC not initialized 2024-09-12T00:18:14.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.161+0000 7f2bd8fe1640 20 reqs_thread_entry: start 2024-09-12T00:18:14.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.161+0000 7f2d2772e800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:14.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.161+0000 7f2d2772e800 20 Filter name: none 2024-09-12T00:18:14.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.161+0000 7f2b527fc640 20 reqs_thread_entry: start 2024-09-12T00:18:14.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.161+0000 7f2d2772e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.162+0000 7f2d2772e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:18:14.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.162+0000 7f2d2772e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.162+0000 7f2d2772e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:18:14.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.162+0000 7f2d2772e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:14.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.162+0000 7f2d2772e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.163+0000 7f2d2772e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:18:14.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.163+0000 7f2d2772e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.163+0000 7f2d2772e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:18:14.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.163+0000 7f2d2772e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:14.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.164+0000 7f2bd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:14.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.167+0000 7f2d2772e800 20 remove_watcher() i=0 2024-09-12T00:18:14.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.167+0000 7f2d2772e800 2 removed watcher, disabling cache 2024-09-12T00:18:14.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.168+0000 7f2d2772e800 20 remove_watcher() i=1 2024-09-12T00:18:14.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.169+0000 7f2d2772e800 20 remove_watcher() i=2 2024-09-12T00:18:14.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.170+0000 7f2d2772e800 20 remove_watcher() i=3 2024-09-12T00:18:14.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.171+0000 7f2d2772e800 20 remove_watcher() i=4 2024-09-12T00:18:14.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.172+0000 7f2d2772e800 20 remove_watcher() i=5 2024-09-12T00:18:14.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.173+0000 7f2d2772e800 20 remove_watcher() i=6 2024-09-12T00:18:14.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.174+0000 7f2d2772e800 20 remove_watcher() i=7 2024-09-12T00:18:14.184 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:14.185 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:14.185 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T00:18:14.185 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:14.185 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T00:18:14.185 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:14.399 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:18:14.429 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:14.430 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:14.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.470+0000 7f6ff5216800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.472+0000 7f6ff5216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:14.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.472+0000 7f6ff5216800 20 realm 2024-09-12T00:18:14.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.472+0000 7f6ff5216800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.472+0000 7f6ff5216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:14.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.472+0000 7f6ff5216800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:14.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.472+0000 7f6ff5216800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.473+0000 7f6ff5216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:14.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.473+0000 7f6ff5216800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.473+0000 7f6ff5216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:14.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.473+0000 7f6ff5216800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.675+0000 7f6ff5216800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:14.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.675+0000 7f6ff5216800 20 searching for the correct realm 2024-09-12T00:18:14.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.676+0000 7f6ff11e8640 0 -- 172.21.15.67:0/3620550355 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7f6fe40dcba0 msgr2=0x7f6fe40d8a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:14.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.679+0000 7f6ff01e6640 0 -- 172.21.15.67:0/3620550355 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5610086c9540 msgr2=0x5610086cb930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.886+0000 7f6ff5216800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.886+0000 7f6ff5216800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.886+0000 7f6ff5216800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.886+0000 7f6ff5216800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.886+0000 7f6ff5216800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.886+0000 7f6ff5216800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.886+0000 7f6ff5216800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.886+0000 7f6ff5216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.886+0000 7f6ff5216800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.886+0000 7f6ff5216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:14.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.886+0000 7f6ff5216800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.887+0000 7f6ff5216800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.887+0000 7f6ff5216800 20 zone default found 2024-09-12T00:18:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.887+0000 7f6ff5216800 4 Realm: () 2024-09-12T00:18:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.887+0000 7f6ff5216800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.887+0000 7f6ff5216800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.887+0000 7f6ff5216800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.887+0000 7f6ff5216800 20 zonegroup default 2024-09-12T00:18:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.887+0000 7f6ff5216800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.887+0000 7f6ff5216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.887+0000 7f6ff5216800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.887+0000 7f6ff5216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.887+0000 7f6ff5216800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.888+0000 7f6ff5216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:14.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.888+0000 7f6ff5216800 20 started sync module instance, tier type = 2024-09-12T00:18:14.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.888+0000 7f6ff5216800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:14.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.897+0000 7f6ff5216800 20 add_watcher() i=0 2024-09-12T00:18:14.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.897+0000 7f6ff5216800 20 add_watcher() i=1 2024-09-12T00:18:14.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.897+0000 7f6ff5216800 20 add_watcher() i=2 2024-09-12T00:18:14.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.897+0000 7f6ff5216800 20 add_watcher() i=3 2024-09-12T00:18:14.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.897+0000 7f6ff5216800 20 add_watcher() i=4 2024-09-12T00:18:14.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.897+0000 7f6ff5216800 20 add_watcher() i=5 2024-09-12T00:18:14.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.897+0000 7f6ff5216800 20 add_watcher() i=6 2024-09-12T00:18:14.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.898+0000 7f6ff5216800 20 add_watcher() i=7 2024-09-12T00:18:14.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.898+0000 7f6ff5216800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:14.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.900+0000 7f6ea6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:14.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.900+0000 7f6ff5216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:14.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.900+0000 7f6ff5216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:14.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.900+0000 7f6ff5216800 5 note: GC not initialized 2024-09-12T00:18:14.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.900+0000 7f6ea5fe3640 20 reqs_thread_entry: start 2024-09-12T00:18:14.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.901+0000 7f6ff5216800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:14.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.901+0000 7f6ff5216800 20 Filter name: none 2024-09-12T00:18:14.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.901+0000 7f6e177fe640 20 reqs_thread_entry: start 2024-09-12T00:18:14.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.901+0000 7f6ff5216800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.901+0000 7f6ff5216800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:18:14.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.901+0000 7f6ff5216800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.902+0000 7f6ff5216800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:18:14.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.902+0000 7f6ff5216800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:14.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.902+0000 7f6ff5216800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.902+0000 7f6ff5216800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:18:14.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.902+0000 7f6ff5216800 20 rados->read ofs=0 len=0 2024-09-12T00:18:14.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.902+0000 7f6ff5216800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:18:14.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.902+0000 7f6ff5216800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:14.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.904+0000 7f6ea6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:14.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.906+0000 7f6ff5216800 20 remove_watcher() i=0 2024-09-12T00:18:14.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.906+0000 7f6ff5216800 2 removed watcher, disabling cache 2024-09-12T00:18:14.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.907+0000 7f6ff5216800 20 remove_watcher() i=1 2024-09-12T00:18:14.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.908+0000 7f6ff5216800 20 remove_watcher() i=2 2024-09-12T00:18:14.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.909+0000 7f6ff5216800 20 remove_watcher() i=3 2024-09-12T00:18:14.908 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.910+0000 7f6ff5216800 20 remove_watcher() i=4 2024-09-12T00:18:14.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.911+0000 7f6ff5216800 20 remove_watcher() i=5 2024-09-12T00:18:14.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.912+0000 7f6ff5216800 20 remove_watcher() i=6 2024-09-12T00:18:14.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:14.913+0000 7f6ff5216800 20 remove_watcher() i=7 2024-09-12T00:18:14.923 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:14.923 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:14.923 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-init-index id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:18:14.923 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:14.925 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T00:18:14.959 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:14.959 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:14.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.001+0000 7fb6eb0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.002+0000 7fb6eb0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.002+0000 7fb6eb0bb800 20 realm 2024-09-12T00:18:15.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.002+0000 7fb6eb0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.002+0000 7fb6eb0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.002+0000 7fb6eb0bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:15.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.002+0000 7fb6eb0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.003+0000 7fb6eb0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.003+0000 7fb6eb0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.003+0000 7fb6eb0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:15.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.004+0000 7fb6eb0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.004+0000 7fb6eb0bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:15.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.004+0000 7fb6eb0bb800 20 searching for the correct realm 2024-09-12T00:18:15.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.008+0000 7fb6e3fff640 0 -- 172.21.15.67:0/4016449998 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fb6d40be920 msgr2=0x7fb6d40be130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:15.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.213+0000 7fb6e8ba5640 0 -- 172.21.15.67:0/4016449998 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fb6e4017040 msgr2=0x7fb6e4035410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:15.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.218+0000 7fb6eb0bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:15.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.218+0000 7fb6eb0bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:15.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.218+0000 7fb6eb0bb800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:15.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.218+0000 7fb6eb0bb800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:15.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.218+0000 7fb6eb0bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:15.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.218+0000 7fb6eb0bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:15.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.218+0000 7fb6eb0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.218+0000 7fb6eb0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.218+0000 7fb6eb0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.218+0000 7fb6eb0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:15.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.219+0000 7fb6eb0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.219+0000 7fb6eb0bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:15.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.219+0000 7fb6eb0bb800 20 zone default found 2024-09-12T00:18:15.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.219+0000 7fb6eb0bb800 4 Realm: () 2024-09-12T00:18:15.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.219+0000 7fb6eb0bb800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:15.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.219+0000 7fb6eb0bb800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:15.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.219+0000 7fb6eb0bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:15.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.219+0000 7fb6eb0bb800 20 zonegroup default 2024-09-12T00:18:15.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.219+0000 7fb6eb0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.219+0000 7fb6eb0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.219+0000 7fb6eb0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.219+0000 7fb6eb0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.219+0000 7fb6eb0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.220+0000 7fb6eb0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.220+0000 7fb6eb0bb800 20 started sync module instance, tier type = 2024-09-12T00:18:15.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.220+0000 7fb6eb0bb800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:15.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.228+0000 7fb6eb0bb800 20 add_watcher() i=0 2024-09-12T00:18:15.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.228+0000 7fb6eb0bb800 20 add_watcher() i=1 2024-09-12T00:18:15.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.228+0000 7fb6eb0bb800 20 add_watcher() i=2 2024-09-12T00:18:15.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.228+0000 7fb6eb0bb800 20 add_watcher() i=3 2024-09-12T00:18:15.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.228+0000 7fb6eb0bb800 20 add_watcher() i=4 2024-09-12T00:18:15.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.228+0000 7fb6eb0bb800 20 add_watcher() i=5 2024-09-12T00:18:15.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.228+0000 7fb6eb0bb800 20 add_watcher() i=6 2024-09-12T00:18:15.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.229+0000 7fb6eb0bb800 20 add_watcher() i=7 2024-09-12T00:18:15.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.229+0000 7fb6eb0bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:15.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.231+0000 7fb59efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:15.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.231+0000 7fb6eb0bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:15.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.231+0000 7fb6eb0bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:15.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.231+0000 7fb6eb0bb800 5 note: GC not initialized 2024-09-12T00:18:15.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.231+0000 7fb59dfe3640 20 reqs_thread_entry: start 2024-09-12T00:18:15.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.232+0000 7fb6eb0bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:15.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.232+0000 7fb6eb0bb800 20 Filter name: none 2024-09-12T00:18:15.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.232+0000 7fb50f7fe640 20 reqs_thread_entry: start 2024-09-12T00:18:15.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.232+0000 7fb6eb0bb800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:18:15.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.232+0000 7fb6eb0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.232+0000 7fb6eb0bb800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:18:15.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.232+0000 7fb6eb0bb800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:18:15.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.232+0000 7fb6eb0bb800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:18:15.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.232+0000 7fb6eb0bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 : miss 2024-09-12T00:18:15.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.232+0000 7fb6eb0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.232+0000 7fb6eb0bb800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:18:15.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.232+0000 7fb6eb0bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 info.flags=0x17 2024-09-12T00:18:15.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.232+0000 7fb6eb0bb800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 to cache LRU end 2024-09-12T00:18:15.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.232+0000 7fb6eb0bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:15.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.232+0000 7fb6eb0bb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:15.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.233+0000 7fb6eb0bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 2024-09-12T00:18:15.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.234+0000 7fb6eb0bb800 -1 Injecting error=-5 at location=init_index 2024-09-12T00:18:15.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.234+0000 7fb6eb0bb800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T00:18:15.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.235+0000 7fb59efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:15.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.237+0000 7fb6eb0bb800 20 remove_watcher() i=0 2024-09-12T00:18:15.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.237+0000 7fb6eb0bb800 2 removed watcher, disabling cache 2024-09-12T00:18:15.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.238+0000 7fb6eb0bb800 20 remove_watcher() i=1 2024-09-12T00:18:15.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.239+0000 7fb6eb0bb800 20 remove_watcher() i=2 2024-09-12T00:18:15.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.241+0000 7fb6eb0bb800 20 remove_watcher() i=3 2024-09-12T00:18:15.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.241+0000 7fb6eb0bb800 20 remove_watcher() i=4 2024-09-12T00:18:15.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.242+0000 7fb6eb0bb800 20 remove_watcher() i=5 2024-09-12T00:18:15.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.243+0000 7fb6eb0bb800 20 remove_watcher() i=6 2024-09-12T00:18:15.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.244+0000 7fb6eb0bb800 20 remove_watcher() i=7 2024-09-12T00:18:15.256 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:18:15.284 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:15.285 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:15.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.326+0000 7febd0c20800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.328+0000 7febd0c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.328+0000 7febd0c20800 20 realm 2024-09-12T00:18:15.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.328+0000 7febd0c20800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.328+0000 7febd0c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.328+0000 7febd0c20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:15.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.329+0000 7febd0c20800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.329+0000 7febd0c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.329+0000 7febd0c20800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.329+0000 7febd0c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:15.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.329+0000 7febd0c20800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.330+0000 7febd0c20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:15.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.330+0000 7febd0c20800 20 searching for the correct realm 2024-09-12T00:18:15.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.333+0000 7febcdf09640 0 -- 172.21.15.67:0/2051137706 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7febb8068910 msgr2=0x7febb8069930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:15.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.337+0000 7febcef0b640 0 -- 172.21.15.67:0/2051137706 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x559a5160fc80 msgr2=0x559a51612070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:15.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.340+0000 7febd0c20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:15.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.340+0000 7febd0c20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:15.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.340+0000 7febd0c20800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:15.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.340+0000 7febd0c20800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:15.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.340+0000 7febd0c20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:15.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.340+0000 7febd0c20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:15.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.340+0000 7febd0c20800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.341+0000 7febd0c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.341+0000 7febd0c20800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.341+0000 7febd0c20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:15.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.341+0000 7febd0c20800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.341+0000 7febd0c20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:15.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.341+0000 7febd0c20800 20 zone default found 2024-09-12T00:18:15.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.341+0000 7febd0c20800 4 Realm: () 2024-09-12T00:18:15.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.341+0000 7febd0c20800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:15.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.341+0000 7febd0c20800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:15.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.341+0000 7febd0c20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:15.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.341+0000 7febd0c20800 20 zonegroup default 2024-09-12T00:18:15.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.341+0000 7febd0c20800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.341+0000 7febd0c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.341+0000 7febd0c20800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.342+0000 7febd0c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.342+0000 7febd0c20800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.342+0000 7febd0c20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.342+0000 7febd0c20800 20 started sync module instance, tier type = 2024-09-12T00:18:15.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.342+0000 7febd0c20800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:15.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.350+0000 7febd0c20800 20 add_watcher() i=0 2024-09-12T00:18:15.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.350+0000 7febd0c20800 20 add_watcher() i=1 2024-09-12T00:18:15.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.350+0000 7febd0c20800 20 add_watcher() i=2 2024-09-12T00:18:15.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.350+0000 7febd0c20800 20 add_watcher() i=3 2024-09-12T00:18:15.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.350+0000 7febd0c20800 20 add_watcher() i=4 2024-09-12T00:18:15.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.350+0000 7febd0c20800 20 add_watcher() i=5 2024-09-12T00:18:15.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.350+0000 7febd0c20800 20 add_watcher() i=6 2024-09-12T00:18:15.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.351+0000 7febd0c20800 20 add_watcher() i=7 2024-09-12T00:18:15.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.351+0000 7febd0c20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:15.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.353+0000 7fea84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:15.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.353+0000 7febd0c20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:15.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.353+0000 7febd0c20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:15.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.353+0000 7febd0c20800 5 note: GC not initialized 2024-09-12T00:18:15.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.353+0000 7fe9ff7fe640 20 reqs_thread_entry: start 2024-09-12T00:18:15.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.353+0000 7febd0c20800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:15.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.353+0000 7febd0c20800 20 Filter name: none 2024-09-12T00:18:15.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.353+0000 7fe9fd7fa640 20 reqs_thread_entry: start 2024-09-12T00:18:15.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.354+0000 7febd0c20800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.354+0000 7febd0c20800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:18:15.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.354+0000 7febd0c20800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.354+0000 7febd0c20800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:18:15.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.354+0000 7febd0c20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:15.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.354+0000 7febd0c20800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.355+0000 7febd0c20800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:18:15.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.355+0000 7febd0c20800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.355+0000 7febd0c20800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:18:15.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.355+0000 7febd0c20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:15.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.356+0000 7fea84fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:15.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.359+0000 7febd0c20800 20 remove_watcher() i=0 2024-09-12T00:18:15.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.359+0000 7febd0c20800 2 removed watcher, disabling cache 2024-09-12T00:18:15.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.360+0000 7febd0c20800 20 remove_watcher() i=1 2024-09-12T00:18:15.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.361+0000 7febd0c20800 20 remove_watcher() i=2 2024-09-12T00:18:15.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.362+0000 7febd0c20800 20 remove_watcher() i=3 2024-09-12T00:18:15.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.363+0000 7febd0c20800 20 remove_watcher() i=4 2024-09-12T00:18:15.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.364+0000 7febd0c20800 20 remove_watcher() i=5 2024-09-12T00:18:15.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.365+0000 7febd0c20800 20 remove_watcher() i=6 2024-09-12T00:18:15.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.366+0000 7febd0c20800 20 remove_watcher() i=7 2024-09-12T00:18:15.375 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:15.375 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:15.375 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-init-index id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:18:15.376 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:15.429 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:18:15.462 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:15.462 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:15.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.504+0000 7f391632e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.506+0000 7f391632e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.506+0000 7f391632e800 20 realm 2024-09-12T00:18:15.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.506+0000 7f391632e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.506+0000 7f391632e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.506+0000 7f391632e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:15.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.506+0000 7f391632e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.506+0000 7f391632e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.506+0000 7f391632e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.507+0000 7f391632e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:15.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.507+0000 7f391632e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.508+0000 7f391632e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:15.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.508+0000 7f391632e800 20 searching for the correct realm 2024-09-12T00:18:15.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.510+0000 7f39118dc640 0 -- 172.21.15.67:0/255150596 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f3908070d50 msgr2=0x7f3908066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:15.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.715+0000 7f39128de640 0 -- 172.21.15.67:0/255150596 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5628836c7020 msgr2=0x5628836c9410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:15.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.719+0000 7f391632e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:15.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.719+0000 7f391632e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:15.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.719+0000 7f391632e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:15.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.719+0000 7f391632e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:15.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.719+0000 7f391632e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:15.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.719+0000 7f391632e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:15.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.719+0000 7f391632e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.720+0000 7f391632e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.720+0000 7f391632e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.720+0000 7f391632e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:15.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.720+0000 7f391632e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.720+0000 7f391632e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:15.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.720+0000 7f391632e800 20 zone default found 2024-09-12T00:18:15.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.720+0000 7f391632e800 4 Realm: () 2024-09-12T00:18:15.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.720+0000 7f391632e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:15.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.720+0000 7f391632e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:15.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.720+0000 7f391632e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:15.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.720+0000 7f391632e800 20 zonegroup default 2024-09-12T00:18:15.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.720+0000 7f391632e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.720+0000 7f391632e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.720+0000 7f391632e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.721+0000 7f391632e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.721+0000 7f391632e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.721+0000 7f391632e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.721+0000 7f391632e800 20 started sync module instance, tier type = 2024-09-12T00:18:15.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.721+0000 7f391632e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:15.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.729+0000 7f391632e800 20 add_watcher() i=0 2024-09-12T00:18:15.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.729+0000 7f391632e800 20 add_watcher() i=1 2024-09-12T00:18:15.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.729+0000 7f391632e800 20 add_watcher() i=2 2024-09-12T00:18:15.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.729+0000 7f391632e800 20 add_watcher() i=3 2024-09-12T00:18:15.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.729+0000 7f391632e800 20 add_watcher() i=4 2024-09-12T00:18:15.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.729+0000 7f391632e800 20 add_watcher() i=5 2024-09-12T00:18:15.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.729+0000 7f391632e800 20 add_watcher() i=6 2024-09-12T00:18:15.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.730+0000 7f391632e800 20 add_watcher() i=7 2024-09-12T00:18:15.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.730+0000 7f391632e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:15.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.732+0000 7f37c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:15.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.733+0000 7f391632e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:15.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.733+0000 7f391632e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:15.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.733+0000 7f391632e800 5 note: GC not initialized 2024-09-12T00:18:15.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.733+0000 7f37437fe640 20 reqs_thread_entry: start 2024-09-12T00:18:15.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.733+0000 7f391632e800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:15.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.733+0000 7f391632e800 20 Filter name: none 2024-09-12T00:18:15.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.733+0000 7f37417fa640 20 reqs_thread_entry: start 2024-09-12T00:18:15.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.733+0000 7f391632e800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:18:15.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.733+0000 7f391632e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.734+0000 7f391632e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:18:15.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.734+0000 7f391632e800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:18:15.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.734+0000 7f391632e800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:18:15.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.734+0000 7f391632e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 : miss 2024-09-12T00:18:15.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.734+0000 7f391632e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.734+0000 7f391632e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:18:15.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.734+0000 7f391632e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 info.flags=0x17 2024-09-12T00:18:15.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.734+0000 7f391632e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 to cache LRU end 2024-09-12T00:18:15.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.734+0000 7f391632e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:15.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.734+0000 7f391632e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:15.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.734+0000 7f391632e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 2024-09-12T00:18:15.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.738+0000 7f391632e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 info.flags=0x17 2024-09-12T00:18:15.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.738+0000 7f391632e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 to cache LRU end 2024-09-12T00:18:15.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.738+0000 7f391632e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:15.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.738+0000 7f391632e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19, ofs0, ns] 2024-09-12T00:18:15.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.738+0000 7f37f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562458 cookie 94732003654800 notifier 6273 bl.length()=911 2024-09-12T00:18:15.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.738+0000 7f37f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 info.flags=0x17 2024-09-12T00:18:15.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.738+0000 7f37f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 to cache LRU end 2024-09-12T00:18:15.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.738+0000 7f37f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:15.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.739+0000 7f391632e800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19]): orig_sources= new_sources= 2024-09-12T00:18:15.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.739+0000 7f391632e800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19]): potential sources added=[] removed=[] 2024-09-12T00:18:15.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.739+0000 7f391632e800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19]): orig_dests= new_dests= 2024-09-12T00:18:15.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.739+0000 7f391632e800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19]): potential dests added=[] removed=[] 2024-09-12T00:18:15.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.741+0000 7f391632e800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19.1.0 2024-09-12T00:18:15.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.741+0000 7f391632e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19.1.0 2024-09-12T00:18:15.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.741+0000 7f391632e800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19.1.1 2024-09-12T00:18:15.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.741+0000 7f391632e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19.1.1 2024-09-12T00:18:15.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.741+0000 7f391632e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19.0 2024-09-12T00:18:15.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.744+0000 7f391632e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:18:15.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.744+0000 7f391632e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 2024-09-12T00:18:15.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.745+0000 7f391632e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 info.flags=0x17 2024-09-12T00:18:15.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.745+0000 7f391632e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 to cache LRU end 2024-09-12T00:18:15.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.745+0000 7f391632e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:15.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.745+0000 7f391632e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19, ofs0, ns] 2024-09-12T00:18:15.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.745+0000 7f37f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562459 cookie 94732003654800 notifier 6273 bl.length()=911 2024-09-12T00:18:15.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.745+0000 7f37f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 info.flags=0x17 2024-09-12T00:18:15.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.745+0000 7f37f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 to cache LRU end 2024-09-12T00:18:15.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.745+0000 7f37f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:15.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.745+0000 7f391632e800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19]): orig_sources= new_sources= 2024-09-12T00:18:15.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.745+0000 7f391632e800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19]): potential sources added=[] removed=[] 2024-09-12T00:18:15.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.745+0000 7f391632e800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19]): orig_dests= new_dests= 2024-09-12T00:18:15.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.745+0000 7f391632e800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19]): potential dests added=[] removed=[] 2024-09-12T00:18:15.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.746+0000 7f391632e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19.0 2024-09-12T00:18:15.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.747+0000 7f391632e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:18:15.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.747+0000 7f391632e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 2024-09-12T00:18:15.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.748+0000 7f391632e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 info.flags=0x17 2024-09-12T00:18:15.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.748+0000 7f391632e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 to cache LRU end 2024-09-12T00:18:15.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.748+0000 7f391632e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:15.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.748+0000 7f391632e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19, ofs0, ns] 2024-09-12T00:18:15.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.748+0000 7f37f5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562460 cookie 94732003654800 notifier 6273 bl.length()=879 2024-09-12T00:18:15.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.748+0000 7f37f5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 info.flags=0x17 2024-09-12T00:18:15.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.748+0000 7f37f5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 to cache LRU end 2024-09-12T00:18:15.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.748+0000 7f37f5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:15.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.748+0000 7f391632e800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19]): orig_sources= new_sources= 2024-09-12T00:18:15.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.748+0000 7f391632e800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19]): potential sources added=[] removed=[] 2024-09-12T00:18:15.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.748+0000 7f391632e800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19]): orig_dests= new_dests= 2024-09-12T00:18:15.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.748+0000 7f391632e800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19]): potential dests added=[] removed=[] 2024-09-12T00:18:15.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.750+0000 7f391632e800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T00:18:15.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.751+0000 7f37c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:15.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.754+0000 7f391632e800 20 remove_watcher() i=0 2024-09-12T00:18:15.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.754+0000 7f391632e800 2 removed watcher, disabling cache 2024-09-12T00:18:15.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.754+0000 7f391632e800 20 remove_watcher() i=1 2024-09-12T00:18:15.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.755+0000 7f391632e800 20 remove_watcher() i=2 2024-09-12T00:18:15.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.756+0000 7f391632e800 20 remove_watcher() i=3 2024-09-12T00:18:15.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.757+0000 7f391632e800 20 remove_watcher() i=4 2024-09-12T00:18:15.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.758+0000 7f391632e800 20 remove_watcher() i=5 2024-09-12T00:18:15.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.759+0000 7f391632e800 20 remove_watcher() i=6 2024-09-12T00:18:15.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.760+0000 7f391632e800 20 remove_watcher() i=7 2024-09-12T00:18:15.771 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:18:15.800 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:15.800 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:15.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.840+0000 7fc17f212800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.842+0000 7fc17f212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.842+0000 7fc17f212800 20 realm 2024-09-12T00:18:15.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.842+0000 7fc17f212800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.842+0000 7fc17f212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.842+0000 7fc17f212800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:15.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.842+0000 7fc17f212800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.843+0000 7fc17f212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.843+0000 7fc17f212800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.843+0000 7fc17f212800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:15.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.843+0000 7fc17f212800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.844+0000 7fc17f212800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:15.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.844+0000 7fc17f212800 20 searching for the correct realm 2024-09-12T00:18:15.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.847+0000 7fc17b1e1640 0 -- 172.21.15.67:0/3452875446 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7fc170062450 msgr2=0x7fc170062850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:15.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.850+0000 7fc17a9e0640 0 -- 172.21.15.67:0/3452875446 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fc17406dee0 msgr2=0x7fc174063db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:15.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:15.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:15.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:15.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:15.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:15.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:15.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:15.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:15.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 20 zone default found 2024-09-12T00:18:15.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 4 Realm: () 2024-09-12T00:18:15.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:15.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:15.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:15.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 20 zonegroup default 2024-09-12T00:18:15.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.855+0000 7fc17f212800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.856+0000 7fc17f212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.856+0000 7fc17f212800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.856+0000 7fc17f212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.856+0000 7fc17f212800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.856+0000 7fc17f212800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:15.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.856+0000 7fc17f212800 20 started sync module instance, tier type = 2024-09-12T00:18:15.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.856+0000 7fc17f212800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:15.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.864+0000 7fc17f212800 20 add_watcher() i=0 2024-09-12T00:18:15.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.864+0000 7fc17f212800 20 add_watcher() i=1 2024-09-12T00:18:15.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.864+0000 7fc17f212800 20 add_watcher() i=2 2024-09-12T00:18:15.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.864+0000 7fc17f212800 20 add_watcher() i=3 2024-09-12T00:18:15.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.864+0000 7fc17f212800 20 add_watcher() i=4 2024-09-12T00:18:15.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.864+0000 7fc17f212800 20 add_watcher() i=5 2024-09-12T00:18:15.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.864+0000 7fc17f212800 20 add_watcher() i=6 2024-09-12T00:18:15.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.865+0000 7fc17f212800 20 add_watcher() i=7 2024-09-12T00:18:15.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.865+0000 7fc17f212800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:15.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.867+0000 7fc0317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:15.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.867+0000 7fc17f212800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:15.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.867+0000 7fc17f212800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:15.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.867+0000 7fc17f212800 5 note: GC not initialized 2024-09-12T00:18:15.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.867+0000 7fbfabfff640 20 reqs_thread_entry: start 2024-09-12T00:18:15.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.867+0000 7fc17f212800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:15.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.867+0000 7fc17f212800 20 Filter name: none 2024-09-12T00:18:15.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.867+0000 7fbfa9ffb640 20 reqs_thread_entry: start 2024-09-12T00:18:15.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.868+0000 7fc17f212800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.868+0000 7fc17f212800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:18:15.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.868+0000 7fc17f212800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.868+0000 7fc17f212800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:18:15.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.868+0000 7fc17f212800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:15.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.868+0000 7fc17f212800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.869+0000 7fc17f212800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:18:15.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.869+0000 7fc17f212800 20 rados->read ofs=0 len=0 2024-09-12T00:18:15.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.869+0000 7fc17f212800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:18:15.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.869+0000 7fc17f212800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:15.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.870+0000 7fc0317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:15.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.872+0000 7fc17f212800 20 remove_watcher() i=0 2024-09-12T00:18:15.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.872+0000 7fc17f212800 2 removed watcher, disabling cache 2024-09-12T00:18:15.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.873+0000 7fc17f212800 20 remove_watcher() i=1 2024-09-12T00:18:15.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.874+0000 7fc17f212800 20 remove_watcher() i=2 2024-09-12T00:18:15.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.875+0000 7fc17f212800 20 remove_watcher() i=3 2024-09-12T00:18:15.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.876+0000 7fc17f212800 20 remove_watcher() i=4 2024-09-12T00:18:15.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.877+0000 7fc17f212800 20 remove_watcher() i=5 2024-09-12T00:18:15.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.878+0000 7fc17f212800 20 remove_watcher() i=6 2024-09-12T00:18:15.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:15.879+0000 7fc17f212800 20 remove_watcher() i=7 2024-09-12T00:18:15.888 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:15.888 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:15.888 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-init-index id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:18:15.889 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:15.952 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T00:18:15.953 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:16.160 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:18:16.189 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:16.189 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:16.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.230+0000 7ff17fb35800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.232+0000 7ff17fb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.232+0000 7ff17fb35800 20 realm 2024-09-12T00:18:16.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.232+0000 7ff17fb35800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.232+0000 7ff17fb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.232+0000 7ff17fb35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:16.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.232+0000 7ff17fb35800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.232+0000 7ff17fb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.232+0000 7ff17fb35800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.233+0000 7ff17fb35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:16.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.233+0000 7ff17fb35800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.234+0000 7ff17fb35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:16.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.234+0000 7ff17fb35800 20 searching for the correct realm 2024-09-12T00:18:16.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.237+0000 7ff17b0e3640 0 -- 172.21.15.67:0/3517117365 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7ff170080040 msgr2=0x7ff170065420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:16.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.241+0000 7ff17c0e5640 0 -- 172.21.15.67:0/3517117365 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5618904560e0 msgr2=0x561890458570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:16.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.244+0000 7ff17fb35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:16.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.244+0000 7ff17fb35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:16.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.244+0000 7ff17fb35800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:16.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.244+0000 7ff17fb35800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:16.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.244+0000 7ff17fb35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:16.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.244+0000 7ff17fb35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:16.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.244+0000 7ff17fb35800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.245+0000 7ff17fb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.245+0000 7ff17fb35800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.245+0000 7ff17fb35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:16.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.245+0000 7ff17fb35800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.245+0000 7ff17fb35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:16.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.245+0000 7ff17fb35800 20 zone default found 2024-09-12T00:18:16.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.245+0000 7ff17fb35800 4 Realm: () 2024-09-12T00:18:16.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.245+0000 7ff17fb35800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:16.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.245+0000 7ff17fb35800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:16.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.245+0000 7ff17fb35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:16.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.245+0000 7ff17fb35800 20 zonegroup default 2024-09-12T00:18:16.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.245+0000 7ff17fb35800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.245+0000 7ff17fb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.246+0000 7ff17fb35800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.246+0000 7ff17fb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.246+0000 7ff17fb35800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.246+0000 7ff17fb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.246+0000 7ff17fb35800 20 started sync module instance, tier type = 2024-09-12T00:18:16.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.246+0000 7ff17fb35800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:16.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.254+0000 7ff17fb35800 20 add_watcher() i=0 2024-09-12T00:18:16.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.254+0000 7ff17fb35800 20 add_watcher() i=1 2024-09-12T00:18:16.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.254+0000 7ff17fb35800 20 add_watcher() i=2 2024-09-12T00:18:16.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.254+0000 7ff17fb35800 20 add_watcher() i=3 2024-09-12T00:18:16.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.254+0000 7ff17fb35800 20 add_watcher() i=4 2024-09-12T00:18:16.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.254+0000 7ff17fb35800 20 add_watcher() i=5 2024-09-12T00:18:16.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.254+0000 7ff17fb35800 20 add_watcher() i=6 2024-09-12T00:18:16.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.255+0000 7ff17fb35800 20 add_watcher() i=7 2024-09-12T00:18:16.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.255+0000 7ff17fb35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:16.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.257+0000 7ff031fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:16.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.258+0000 7ff17fb35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:16.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.258+0000 7ff17fb35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:16.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.258+0000 7ff17fb35800 5 note: GC not initialized 2024-09-12T00:18:16.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.258+0000 7ff030fe1640 20 reqs_thread_entry: start 2024-09-12T00:18:16.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.258+0000 7ff17fb35800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:16.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.258+0000 7ff17fb35800 20 Filter name: none 2024-09-12T00:18:16.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.258+0000 7fefaa7fc640 20 reqs_thread_entry: start 2024-09-12T00:18:16.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.258+0000 7ff17fb35800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.259+0000 7ff17fb35800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:18:16.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.259+0000 7ff17fb35800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.260+0000 7ff17fb35800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:18:16.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.260+0000 7ff17fb35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:16.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.260+0000 7ff17fb35800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.260+0000 7ff17fb35800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:18:16.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.260+0000 7ff17fb35800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.260+0000 7ff17fb35800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:18:16.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.260+0000 7ff17fb35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:16.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.261+0000 7ff031fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:16.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.264+0000 7ff17fb35800 20 remove_watcher() i=0 2024-09-12T00:18:16.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.264+0000 7ff17fb35800 2 removed watcher, disabling cache 2024-09-12T00:18:16.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.265+0000 7ff17fb35800 20 remove_watcher() i=1 2024-09-12T00:18:16.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.267+0000 7ff17fb35800 20 remove_watcher() i=2 2024-09-12T00:18:16.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.268+0000 7ff17fb35800 20 remove_watcher() i=3 2024-09-12T00:18:16.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.269+0000 7ff17fb35800 20 remove_watcher() i=4 2024-09-12T00:18:16.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.271+0000 7ff17fb35800 20 remove_watcher() i=5 2024-09-12T00:18:16.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.272+0000 7ff17fb35800 20 remove_watcher() i=6 2024-09-12T00:18:16.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.272+0000 7ff17fb35800 20 remove_watcher() i=7 2024-09-12T00:18:16.282 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:16.282 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:16.282 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-init-index id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:18:16.282 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:16.283 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T00:18:16.321 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:16.321 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:16.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.361+0000 7f5402d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.362+0000 7f5402d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.362+0000 7f5402d1f800 20 realm 2024-09-12T00:18:16.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.362+0000 7f5402d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.361 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.363+0000 7f5402d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.363+0000 7f5402d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:16.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.363+0000 7f5402d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.363+0000 7f5402d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.363+0000 7f5402d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.364+0000 7f5402d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:16.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.364+0000 7f5402d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.364+0000 7f5402d1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:16.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.365+0000 7f5402d1f800 20 searching for the correct realm 2024-09-12T00:18:16.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.368+0000 7f53fe20b640 0 -- 172.21.15.67:0/2793151028 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f53f40416e0 msgr2=0x7f53f4037430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:16.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.371+0000 7f53fe20b640 0 -- 172.21.15.67:0/2793151028 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55c6f4b039d0 msgr2=0x55c6f4b05e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:16.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.375+0000 7f5402d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:16.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.375+0000 7f5402d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:16.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.375+0000 7f5402d1f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:16.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.375+0000 7f5402d1f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:16.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.375+0000 7f5402d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:16.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.375+0000 7f5402d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:16.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.375+0000 7f5402d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.376+0000 7f5402d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.376+0000 7f5402d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.376+0000 7f5402d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:16.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.376+0000 7f5402d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.376+0000 7f5402d1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:16.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.376+0000 7f5402d1f800 20 zone default found 2024-09-12T00:18:16.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.376+0000 7f5402d1f800 4 Realm: () 2024-09-12T00:18:16.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.376+0000 7f5402d1f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:16.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.376+0000 7f5402d1f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:16.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.376+0000 7f5402d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:16.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.376+0000 7f5402d1f800 20 zonegroup default 2024-09-12T00:18:16.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.376+0000 7f5402d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.376+0000 7f5402d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.376+0000 7f5402d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.377+0000 7f5402d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.377+0000 7f5402d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.377+0000 7f5402d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.377+0000 7f5402d1f800 20 started sync module instance, tier type = 2024-09-12T00:18:16.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.377+0000 7f5402d1f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:16.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.388+0000 7f5402d1f800 20 add_watcher() i=0 2024-09-12T00:18:16.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.388+0000 7f5402d1f800 20 add_watcher() i=1 2024-09-12T00:18:16.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.388+0000 7f5402d1f800 20 add_watcher() i=2 2024-09-12T00:18:16.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.388+0000 7f5402d1f800 20 add_watcher() i=3 2024-09-12T00:18:16.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.388+0000 7f5402d1f800 20 add_watcher() i=4 2024-09-12T00:18:16.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.388+0000 7f5402d1f800 20 add_watcher() i=5 2024-09-12T00:18:16.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.388+0000 7f5402d1f800 20 add_watcher() i=6 2024-09-12T00:18:16.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.389+0000 7f5402d1f800 20 add_watcher() i=7 2024-09-12T00:18:16.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.389+0000 7f5402d1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:16.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.391+0000 7f52b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:16.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.391+0000 7f5402d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:16.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.391+0000 7f5402d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:16.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.391+0000 7f5402d1f800 5 note: GC not initialized 2024-09-12T00:18:16.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.392+0000 7f522ffff640 20 reqs_thread_entry: start 2024-09-12T00:18:16.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.392+0000 7f5402d1f800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:16.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.392+0000 7f5402d1f800 20 Filter name: none 2024-09-12T00:18:16.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.392+0000 7f522dffb640 20 reqs_thread_entry: start 2024-09-12T00:18:16.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.392+0000 7f5402d1f800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:18:16.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.392+0000 7f5402d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.392+0000 7f5402d1f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:18:16.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.392+0000 7f5402d1f800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:18:16.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.392+0000 7f5402d1f800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:18:16.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.392+0000 7f5402d1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 : miss 2024-09-12T00:18:16.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.392+0000 7f5402d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.393+0000 7f5402d1f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:18:16.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.393+0000 7f5402d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 info.flags=0x17 2024-09-12T00:18:16.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.393+0000 7f5402d1f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 to cache LRU end 2024-09-12T00:18:16.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.393+0000 7f5402d1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:16.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.393+0000 7f5402d1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:16.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.393+0000 7f5402d1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 2024-09-12T00:18:16.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.394+0000 7f5402d1f800 -1 Injecting error=-95 at location=init_index 2024-09-12T00:18:16.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.394+0000 7f5402d1f800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:18:16.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.397+0000 7f5402d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 info.flags=0x17 2024-09-12T00:18:16.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.397+0000 7f5402d1f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 to cache LRU end 2024-09-12T00:18:16.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.397+0000 7f5402d1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:16.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.397+0000 7f5402d1f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20, ofs0, ns] 2024-09-12T00:18:16.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.397+0000 7f52e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562463 cookie 94312997081552 notifier 6324 bl.length()=911 2024-09-12T00:18:16.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.397+0000 7f52e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 info.flags=0x17 2024-09-12T00:18:16.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.397+0000 7f52e27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 to cache LRU end 2024-09-12T00:18:16.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.397+0000 7f52e27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:16.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.398+0000 7f5402d1f800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20]): orig_sources= new_sources= 2024-09-12T00:18:16.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.398+0000 7f5402d1f800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20]): potential sources added=[] removed=[] 2024-09-12T00:18:16.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.398+0000 7f5402d1f800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20]): orig_dests= new_dests= 2024-09-12T00:18:16.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.398+0000 7f5402d1f800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20]): potential dests added=[] removed=[] 2024-09-12T00:18:16.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.399+0000 7f5402d1f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20.1.0 2024-09-12T00:18:16.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.399+0000 7f5402d1f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20.1.0 2024-09-12T00:18:16.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.399+0000 7f5402d1f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20.1.1 2024-09-12T00:18:16.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.399+0000 7f5402d1f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20.1.1 2024-09-12T00:18:16.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.399+0000 7f5402d1f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20.0 2024-09-12T00:18:16.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.401+0000 7f5402d1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:18:16.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.401+0000 7f5402d1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 2024-09-12T00:18:16.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.402+0000 7f5402d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 info.flags=0x17 2024-09-12T00:18:16.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.402+0000 7f5402d1f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 to cache LRU end 2024-09-12T00:18:16.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.402+0000 7f5402d1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:16.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.402+0000 7f5402d1f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20, ofs0, ns] 2024-09-12T00:18:16.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.402+0000 7f52e1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562464 cookie 94312997081552 notifier 6324 bl.length()=879 2024-09-12T00:18:16.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.402+0000 7f52e1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 info.flags=0x17 2024-09-12T00:18:16.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.402+0000 7f52e1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 to cache LRU end 2024-09-12T00:18:16.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.402+0000 7f52e1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:16.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.403+0000 7f5402d1f800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20]): orig_sources= new_sources= 2024-09-12T00:18:16.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.403+0000 7f5402d1f800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20]): potential sources added=[] removed=[] 2024-09-12T00:18:16.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.403+0000 7f5402d1f800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20]): orig_dests= new_dests= 2024-09-12T00:18:16.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.403+0000 7f5402d1f800 20 handle_bi_update(): bucket=:error-at-init-index[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20]): potential dests added=[] removed=[] 2024-09-12T00:18:16.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.404+0000 7f5402d1f800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T00:18:16.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.406+0000 7f52b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:16.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.408+0000 7f5402d1f800 20 remove_watcher() i=0 2024-09-12T00:18:16.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.408+0000 7f5402d1f800 2 removed watcher, disabling cache 2024-09-12T00:18:16.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.409+0000 7f5402d1f800 20 remove_watcher() i=1 2024-09-12T00:18:16.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.410+0000 7f5402d1f800 20 remove_watcher() i=2 2024-09-12T00:18:16.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.411+0000 7f5402d1f800 20 remove_watcher() i=3 2024-09-12T00:18:16.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.412+0000 7f5402d1f800 20 remove_watcher() i=4 2024-09-12T00:18:16.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.414+0000 7f5402d1f800 20 remove_watcher() i=5 2024-09-12T00:18:16.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.415+0000 7f5402d1f800 20 remove_watcher() i=6 2024-09-12T00:18:16.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.416+0000 7f5402d1f800 20 remove_watcher() i=7 2024-09-12T00:18:16.427 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:18:16.456 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:16.456 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:16.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.497+0000 7f940a923800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.499+0000 7f940a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.499+0000 7f940a923800 20 realm 2024-09-12T00:18:16.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.499+0000 7f940a923800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.500+0000 7f940a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.500+0000 7f940a923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:16.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.500+0000 7f940a923800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.500+0000 7f940a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.500+0000 7f940a923800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.501+0000 7f940a923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:16.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.501+0000 7f940a923800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.501+0000 7f940a923800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:16.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.501+0000 7f940a923800 20 searching for the correct realm 2024-09-12T00:18:16.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.504+0000 7f9405e12640 0 -- 172.21.15.67:0/3315102159 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f93fc0e5b60 msgr2=0x7f93fc0093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:16.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.710+0000 7f9406e14640 0 -- 172.21.15.67:0/3315102159 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5629cb1fe770 msgr2=0x5629cb200c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:16.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.714+0000 7f940a923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:16.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.714+0000 7f940a923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:16.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.714+0000 7f940a923800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:16.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.714+0000 7f940a923800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:16.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.714+0000 7f940a923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:16.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.714+0000 7f940a923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:16.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.714+0000 7f940a923800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.715+0000 7f940a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.715+0000 7f940a923800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.715+0000 7f940a923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:16.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.715+0000 7f940a923800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.715+0000 7f940a923800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:16.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.715+0000 7f940a923800 20 zone default found 2024-09-12T00:18:16.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.715+0000 7f940a923800 4 Realm: () 2024-09-12T00:18:16.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.715+0000 7f940a923800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:16.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.715+0000 7f940a923800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:16.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.715+0000 7f940a923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:16.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.715+0000 7f940a923800 20 zonegroup default 2024-09-12T00:18:16.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.715+0000 7f940a923800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.716+0000 7f940a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.716+0000 7f940a923800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.716+0000 7f940a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.716+0000 7f940a923800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.716+0000 7f940a923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:16.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.716+0000 7f940a923800 20 started sync module instance, tier type = 2024-09-12T00:18:16.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.716+0000 7f940a923800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:16.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.725+0000 7f940a923800 20 add_watcher() i=0 2024-09-12T00:18:16.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.725+0000 7f940a923800 20 add_watcher() i=1 2024-09-12T00:18:16.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.725+0000 7f940a923800 20 add_watcher() i=2 2024-09-12T00:18:16.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.725+0000 7f940a923800 20 add_watcher() i=3 2024-09-12T00:18:16.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.725+0000 7f940a923800 20 add_watcher() i=4 2024-09-12T00:18:16.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.725+0000 7f940a923800 20 add_watcher() i=5 2024-09-12T00:18:16.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.725+0000 7f940a923800 20 add_watcher() i=6 2024-09-12T00:18:16.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.726+0000 7f940a923800 20 add_watcher() i=7 2024-09-12T00:18:16.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.726+0000 7f940a923800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:16.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.728+0000 7f92bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:16.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.728+0000 7f940a923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:16.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.728+0000 7f940a923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:16.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.728+0000 7f940a923800 5 note: GC not initialized 2024-09-12T00:18:16.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.729+0000 7f92377fe640 20 reqs_thread_entry: start 2024-09-12T00:18:16.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.729+0000 7f940a923800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:16.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.729+0000 7f940a923800 20 Filter name: none 2024-09-12T00:18:16.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.729+0000 7f92357fa640 20 reqs_thread_entry: start 2024-09-12T00:18:16.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.729+0000 7f940a923800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.729+0000 7f940a923800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:18:16.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.729+0000 7f940a923800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.730+0000 7f940a923800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:18:16.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.730+0000 7f940a923800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:16.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.730+0000 7f940a923800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.730+0000 7f940a923800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:18:16.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.730+0000 7f940a923800 20 rados->read ofs=0 len=0 2024-09-12T00:18:16.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.731+0000 7f940a923800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:18:16.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.731+0000 7f940a923800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:16.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.732+0000 7f92bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:16.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.734+0000 7f940a923800 20 remove_watcher() i=0 2024-09-12T00:18:16.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.734+0000 7f940a923800 2 removed watcher, disabling cache 2024-09-12T00:18:16.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.735+0000 7f940a923800 20 remove_watcher() i=1 2024-09-12T00:18:16.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.737+0000 7f940a923800 20 remove_watcher() i=2 2024-09-12T00:18:16.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.738+0000 7f940a923800 20 remove_watcher() i=3 2024-09-12T00:18:16.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.739+0000 7f940a923800 20 remove_watcher() i=4 2024-09-12T00:18:16.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.740+0000 7f940a923800 20 remove_watcher() i=5 2024-09-12T00:18:16.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.741+0000 7f940a923800 20 remove_watcher() i=6 2024-09-12T00:18:16.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:16.741+0000 7f940a923800 20 remove_watcher() i=7 2024-09-12T00:18:16.751 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:16.751 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:16.751 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-init-index id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:18:16.751 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:16.813 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T00:18:16.813 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.022 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:18:17.051 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:17.051 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:17.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.092+0000 7fec01519800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.094+0000 7fec01519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.094+0000 7fec01519800 20 realm 2024-09-12T00:18:17.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.094+0000 7fec01519800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.094+0000 7fec01519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.094+0000 7fec01519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:17.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.094+0000 7fec01519800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.094+0000 7fec01519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.094+0000 7fec01519800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.095+0000 7fec01519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:17.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.095+0000 7fec01519800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.096+0000 7fec01519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:17.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.096+0000 7fec01519800 20 searching for the correct realm 2024-09-12T00:18:17.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.098+0000 7febf7fff640 0 -- 172.21.15.67:0/1676377179 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7febe802ba40 msgr2=0x7febe809e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:17.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.303+0000 7febff80b640 0 -- 172.21.15.67:0/1676377179 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55c802ce1c00 msgr2=0x55c802ce40a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:17.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.307+0000 7fec01519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:17.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.307+0000 7fec01519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:17.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.307+0000 7fec01519800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:17.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.307+0000 7fec01519800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:17.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.307+0000 7fec01519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:17.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.307+0000 7fec01519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:17.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.307+0000 7fec01519800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.308+0000 7fec01519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.308+0000 7fec01519800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.308+0000 7fec01519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:17.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.308+0000 7fec01519800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.308+0000 7fec01519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:17.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.308+0000 7fec01519800 20 zone default found 2024-09-12T00:18:17.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.308+0000 7fec01519800 4 Realm: () 2024-09-12T00:18:17.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.308+0000 7fec01519800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:17.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.308+0000 7fec01519800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:17.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.308+0000 7fec01519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:17.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.308+0000 7fec01519800 20 zonegroup default 2024-09-12T00:18:17.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.308+0000 7fec01519800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.309+0000 7fec01519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.309+0000 7fec01519800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.309+0000 7fec01519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.309+0000 7fec01519800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.309+0000 7fec01519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.309+0000 7fec01519800 20 started sync module instance, tier type = 2024-09-12T00:18:17.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.309+0000 7fec01519800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:17.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.317+0000 7fec01519800 20 add_watcher() i=0 2024-09-12T00:18:17.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.317+0000 7fec01519800 20 add_watcher() i=1 2024-09-12T00:18:17.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.317+0000 7fec01519800 20 add_watcher() i=2 2024-09-12T00:18:17.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.317+0000 7fec01519800 20 add_watcher() i=3 2024-09-12T00:18:17.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.317+0000 7fec01519800 20 add_watcher() i=4 2024-09-12T00:18:17.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.317+0000 7fec01519800 20 add_watcher() i=5 2024-09-12T00:18:17.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.318+0000 7fec01519800 20 add_watcher() i=6 2024-09-12T00:18:17.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.318+0000 7fec01519800 20 add_watcher() i=7 2024-09-12T00:18:17.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.318+0000 7fec01519800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:17.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.320+0000 7feab5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:17.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.320+0000 7fec01519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:17.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.320+0000 7fec01519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:17.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.320+0000 7fec01519800 5 note: GC not initialized 2024-09-12T00:18:17.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.321+0000 7feab4fe1640 20 reqs_thread_entry: start 2024-09-12T00:18:17.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.321+0000 7fec01519800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:17.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.321+0000 7fec01519800 20 Filter name: none 2024-09-12T00:18:17.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.321+0000 7fea2e7fc640 20 reqs_thread_entry: start 2024-09-12T00:18:17.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.321+0000 7fec01519800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.321+0000 7fec01519800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:18:17.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.321+0000 7fec01519800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.322+0000 7fec01519800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:18:17.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.322+0000 7fec01519800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:17.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.322+0000 7fec01519800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.322+0000 7fec01519800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:18:17.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.322+0000 7fec01519800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.323+0000 7fec01519800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:18:17.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.323+0000 7fec01519800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:17.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.324+0000 7feab5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:17.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.327+0000 7fec01519800 20 remove_watcher() i=0 2024-09-12T00:18:17.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.327+0000 7fec01519800 2 removed watcher, disabling cache 2024-09-12T00:18:17.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.328+0000 7fec01519800 20 remove_watcher() i=1 2024-09-12T00:18:17.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.329+0000 7fec01519800 20 remove_watcher() i=2 2024-09-12T00:18:17.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.330+0000 7fec01519800 20 remove_watcher() i=3 2024-09-12T00:18:17.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.331+0000 7fec01519800 20 remove_watcher() i=4 2024-09-12T00:18:17.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.332+0000 7fec01519800 20 remove_watcher() i=5 2024-09-12T00:18:17.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.333+0000 7fec01519800 20 remove_watcher() i=6 2024-09-12T00:18:17.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.334+0000 7fec01519800 20 remove_watcher() i=7 2024-09-12T00:18:17.343 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.343 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:17.343 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-init-indext id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:18:17.343 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.344 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T00:18:17.379 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:17.380 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:17.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.420+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.422+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.422+0000 7f5875746800 20 realm 2024-09-12T00:18:17.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.422+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.422+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.422+0000 7f5875746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:17.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.422+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.422+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.422+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.423+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:17.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.423+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.424+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:17.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.424+0000 7f5875746800 20 searching for the correct realm 2024-09-12T00:18:17.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.427+0000 7f5872a36640 0 -- 172.21.15.67:0/1118657054 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f5868032030 msgr2=0x7f58680327f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:17.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.430+0000 7f5873a38640 0 -- 172.21.15.67:0/1118657054 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55b853a2a380 msgr2=0x55b853a2c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:17.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:17.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:17.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:17.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:17.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.434+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.434+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.434+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.435+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.435+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.435+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.435+0000 7f5875746800 20 zone default found 2024-09-12T00:18:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.435+0000 7f5875746800 4 Realm: () 2024-09-12T00:18:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.435+0000 7f5875746800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.435+0000 7f5875746800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.435+0000 7f5875746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.435+0000 7f5875746800 20 zonegroup default 2024-09-12T00:18:17.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.435+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.435+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.435+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.436+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.436+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.436+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.436+0000 7f5875746800 20 started sync module instance, tier type = 2024-09-12T00:18:17.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.436+0000 7f5875746800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=0 2024-09-12T00:18:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=1 2024-09-12T00:18:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=2 2024-09-12T00:18:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=3 2024-09-12T00:18:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=4 2024-09-12T00:18:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=5 2024-09-12T00:18:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=6 2024-09-12T00:18:17.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=7 2024-09-12T00:18:17.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.444+0000 7f5875746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:17.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.446+0000 7f5729fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:17.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.446+0000 7f5875746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:17.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.446+0000 7f5875746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:17.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.447+0000 7f5875746800 5 note: GC not initialized 2024-09-12T00:18:17.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.447+0000 7f5728fe1640 20 reqs_thread_entry: start 2024-09-12T00:18:17.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.447+0000 7f5875746800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:17.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.447+0000 7f5875746800 20 Filter name: none 2024-09-12T00:18:17.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.447+0000 7f56a27fc640 20 reqs_thread_entry: start 2024-09-12T00:18:17.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.447+0000 7f5875746800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:18:17.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.447+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.447+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:18:17.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.447+0000 7f5875746800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:18:17.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.448+0000 7f5875746800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:18:17.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.448+0000 7f5875746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 : miss 2024-09-12T00:18:17.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.448+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.448+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:18:17.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.448+0000 7f5875746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 info.flags=0x17 2024-09-12T00:18:17.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.448+0000 7f5875746800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 to cache LRU end 2024-09-12T00:18:17.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.448+0000 7f5875746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:17.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.448+0000 7f5875746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:17.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.448+0000 7f5875746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 2024-09-12T00:18:17.448 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5875746800 time 2024-09-12T00:18:17.450019+0000 2024-09-12T00:18:17.448 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:18:17.448 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:17.448 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5878d8c71a] 2024-09-12T00:18:17.448 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5878d8c8d8] 2024-09-12T00:18:17.448 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b851783641] 2024-09-12T00:18:17.448 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd877a4) [0x55b851c957a4] 2024-09-12T00:18:17.449 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85179331d] 2024-09-12T00:18:17.449 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:18:17.449 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5877a29590] 2024-09-12T00:18:17.449 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:18:17.449 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:18:17.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.450+0000 7f5875746800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5875746800 time 2024-09-12T00:18:17.450019+0000 2024-09-12T00:18:17.449 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:18:17.449 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.449 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:17.449 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5878d8c71a] 2024-09-12T00:18:17.449 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5878d8c8d8] 2024-09-12T00:18:17.449 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b851783641] 2024-09-12T00:18:17.449 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd877a4) [0x55b851c957a4] 2024-09-12T00:18:17.450 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85179331d] 2024-09-12T00:18:17.450 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:18:17.450 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5877a29590] 2024-09-12T00:18:17.450 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:18:17.450 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:18:17.450 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.450 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:18:17.450 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f5875746800 thread_name:radosgw-admin 2024-09-12T00:18:17.473 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:17.474 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5877a3e6f0] 2024-09-12T00:18:17.474 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5877a8b99c] 2024-09-12T00:18:17.474 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:18:17.474 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:18:17.474 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5878d8c774] 2024-09-12T00:18:17.474 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5878d8c8d8] 2024-09-12T00:18:17.474 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b851783641] 2024-09-12T00:18:17.474 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd877a4) [0x55b851c957a4] 2024-09-12T00:18:17.474 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85179331d] 2024-09-12T00:18:17.474 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:18:17.474 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5877a29590] 2024-09-12T00:18:17.474 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:18:17.474 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:18:17.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.451+0000 7f5875746800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:18:17.475 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f5875746800 thread_name:radosgw-admin 2024-09-12T00:18:17.475 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.475 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:17.475 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5877a3e6f0] 2024-09-12T00:18:17.475 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5877a8b99c] 2024-09-12T00:18:17.475 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:18:17.475 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:18:17.475 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5878d8c774] 2024-09-12T00:18:17.475 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5878d8c8d8] 2024-09-12T00:18:17.475 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b851783641] 2024-09-12T00:18:17.475 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd877a4) [0x55b851c957a4] 2024-09-12T00:18:17.475 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85179331d] 2024-09-12T00:18:17.476 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:18:17.476 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5877a29590] 2024-09-12T00:18:17.476 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:18:17.476 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:18:17.476 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:18:17.476 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.476 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:18:17.476 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:18:17.402+0000 7f5873237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.476 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:18:17.402+0000 7f5873237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.476 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:18:17.402+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.476 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:18:17.402+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.476 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:18:17.402+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.476 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:18:17.402+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.477 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:18:17.402+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.477 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:18:17.402+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.477 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:18:17.402+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.477 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:18:17.402+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.477 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:18:17.402+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.477 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:18:17.402+0000 7f5872a36640 10 monclient(hunting): handle_auth_done global_id 5996 payload 274 2024-09-12T00:18:17.477 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:18:17.402+0000 7f5872a36640 10 monclient: _finish_hunting 0 2024-09-12T00:18:17.477 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:18:17.402+0000 7f5872a36640 1 monclient: found mon.noname-c 2024-09-12T00:18:17.477 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:18:17.402+0000 7f5872a36640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.477 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.477 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:18:17.477 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: dump: 2024-09-12T00:18:17.477 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.478 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.478 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.478 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.478 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.478 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.478 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.478 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.478 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.478 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.478 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: _finish_auth 0 2024-09-12T00:18:17.478 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: _check_auth_tickets 2024-09-12T00:18:17.478 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:17.478 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.478 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:18:17.479 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: dump: 2024-09-12T00:18:17.479 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.479 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.479 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.479 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.479 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.479 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.479 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.479 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.479 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.479 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.479 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:18:17.403+0000 7f5875746800 5 monclient: authenticate success, global_id 5996 2024-09-12T00:18:17.479 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:18:17.403+0000 7f5875746800 10 monclient: get_monmap_and_config success 2024-09-12T00:18:17.479 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:18:17.403+0000 7f5875746800 4 set_mon_vals no callback set 2024-09-12T00:18:17.480 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:18:17.403+0000 7f5875746800 10 monclient: shutdown 2024-09-12T00:18:17.480 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:18:17.403+0000 7f5875746800 5 asok(0x55b85371f630) unregister_commands rotate-key 2024-09-12T00:18:17.480 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:18:17.404+0000 7f5875746800 10 monclient: build_initial_monmap 2024-09-12T00:18:17.480 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:18:17.404+0000 7f5875746800 1 build_initial for_mkfs: 0 2024-09-12T00:18:17.480 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:18:17.404+0000 7f5875746800 10 monclient: monmap: 2024-09-12T00:18:17.480 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:17.480 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:17.480 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:17.480 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:17.480 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:17.480 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.480 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:17.480 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:17.481 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:17.481 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.481 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding auth protocol: cephx 2024-09-12T00:18:17.481 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding auth protocol: cephx 2024-09-12T00:18:17.481 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding auth protocol: cephx 2024-09-12T00:18:17.481 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: secure 2024-09-12T00:18:17.481 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: crc 2024-09-12T00:18:17.481 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: secure 2024-09-12T00:18:17.481 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: crc 2024-09-12T00:18:17.481 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: secure 2024-09-12T00:18:17.482 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: crc 2024-09-12T00:18:17.482 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: crc 2024-09-12T00:18:17.482 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: secure 2024-09-12T00:18:17.482 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: crc 2024-09-12T00:18:17.482 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: secure 2024-09-12T00:18:17.482 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: crc 2024-09-12T00:18:17.482 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: secure 2024-09-12T00:18:17.482 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:18:17.404+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.482 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:18:17.404+0000 7f5875746800 1 librados: starting msgr at 2024-09-12T00:18:17.482 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:18:17.404+0000 7f5875746800 1 librados: starting objecter 2024-09-12T00:18:17.482 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:18:17.404+0000 7f5875746800 5 asok(0x55b85371f630) register_command objecter_requests hook 0x55b853946d60 2024-09-12T00:18:17.482 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:18:17.404+0000 7f5875746800 1 librados: setting wanted keys 2024-09-12T00:18:17.482 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:18:17.404+0000 7f5875746800 1 librados: calling monclient init 2024-09-12T00:18:17.483 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:18:17.404+0000 7f5875746800 10 monclient: init 2024-09-12T00:18:17.483 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding auth protocol: cephx 2024-09-12T00:18:17.483 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding auth protocol: cephx 2024-09-12T00:18:17.483 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding auth protocol: cephx 2024-09-12T00:18:17.483 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: secure 2024-09-12T00:18:17.483 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: crc 2024-09-12T00:18:17.483 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: secure 2024-09-12T00:18:17.483 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: crc 2024-09-12T00:18:17.483 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: secure 2024-09-12T00:18:17.483 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: crc 2024-09-12T00:18:17.483 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: crc 2024-09-12T00:18:17.483 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: secure 2024-09-12T00:18:17.484 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: crc 2024-09-12T00:18:17.484 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: secure 2024-09-12T00:18:17.484 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: crc 2024-09-12T00:18:17.484 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: secure 2024-09-12T00:18:17.484 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:18:17.404+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.484 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:18:17.404+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.484 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:18:17.404+0000 7f5875746800 5 asok(0x55b85371f630) register_command rotate-key hook 0x55b85393f6e8 2024-09-12T00:18:17.484 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:18:17.404+0000 7f5875746800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:17.484 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:18:17.404+0000 7f5875746800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:18:17.484 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): picked mon.noname-b con 0x55b8537ed020 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:17.484 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): picked mon.noname-a con 0x55b8537f6f10 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:17.484 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): picked mon.noname-c con 0x55b853882e70 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:17.484 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.484 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.485 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.485 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:17.485 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): authenticate will time out at 1774.661038s 2024-09-12T00:18:17.485 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): get_auth_request con 0x55b853882e70 auth_method 0 2024-09-12T00:18:17.485 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.485 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.485 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.485 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:18:17.405+0000 7f5872a36640 10 monclient(hunting): get_auth_request con 0x55b8537f6f10 auth_method 0 2024-09-12T00:18:17.485 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:18:17.405+0000 7f5872a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.485 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:18:17.405+0000 7f5872a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.485 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:18:17.405+0000 7f5872a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.485 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.486 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.486 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.486 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:18:17.405+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.486 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:18:17.405+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.486 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:18:17.405+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.486 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:18:17.405+0000 7f5873237640 10 monclient(hunting): get_auth_request con 0x55b8537ed020 auth_method 0 2024-09-12T00:18:17.486 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:18:17.405+0000 7f5873237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.486 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:18:17.405+0000 7f5873237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.486 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:18:17.405+0000 7f5873237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.486 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): handle_auth_done global_id 5999 payload 824 2024-09-12T00:18:17.486 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient: _finish_hunting 0 2024-09-12T00:18:17.486 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:18:17.405+0000 7f5873a38640 1 monclient: found mon.noname-c 2024-09-12T00:18:17.486 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.487 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.487 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:18:17.487 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: dump: 2024-09-12T00:18:17.487 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.487 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.487 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.487 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.487 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.487 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.487 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.487 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.487 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.487 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.488 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: _finish_auth 0 2024-09-12T00:18:17.488 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: _check_auth_tickets 2024-09-12T00:18:17.488 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:17.488 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.488 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:18:17.488 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: dump: 2024-09-12T00:18:17.488 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.488 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.488 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.489 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.489 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.489 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.489 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.489 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.489 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.489 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.489 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:18:17.405+0000 7f5875746800 5 monclient: authenticate success, global_id 5999 2024-09-12T00:18:17.489 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient: _renew_subs 2024-09-12T00:18:17.489 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.489 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:18:17.405+0000 7f576160a640 4 set_mon_vals no callback set 2024-09-12T00:18:17.489 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient: _renew_subs 2024-09-12T00:18:17.489 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.490 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:18:17.405+0000 7f5875746800 1 librados: init done 2024-09-12T00:18:17.490 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:18:17.407+0000 7f575fe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:18:17.490 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:18:17.407+0000 7f575fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:17.490 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:18:17.407+0000 7f575fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:17.490 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:18:17.408+0000 7f5873237640 10 monclient: get_auth_request con 0x7f5758076470 auth_method 0 2024-09-12T00:18:17.490 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:18:17.408+0000 7f5872a36640 10 monclient: get_auth_request con 0x55b85396b7c0 auth_method 0 2024-09-12T00:18:17.490 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:18:17.409+0000 7f5873237640 10 monclient: get_auth_request con 0x55b85398ae40 auth_method 0 2024-09-12T00:18:17.490 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:18:17.409+0000 7f5872a36640 10 monclient: get_auth_request con 0x55b85398f220 auth_method 0 2024-09-12T00:18:17.490 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:18:17.411+0000 7f5875746800 10 monclient: build_initial_monmap 2024-09-12T00:18:17.490 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:18:17.411+0000 7f5875746800 1 build_initial for_mkfs: 0 2024-09-12T00:18:17.490 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:18:17.411+0000 7f5875746800 10 monclient: monmap: 2024-09-12T00:18:17.490 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:17.490 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:17.490 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:17.491 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:17.491 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:17.491 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.491 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:17.491 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:17.491 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:17.491 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.491 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding auth protocol: cephx 2024-09-12T00:18:17.491 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding auth protocol: cephx 2024-09-12T00:18:17.491 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding auth protocol: cephx 2024-09-12T00:18:17.491 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: secure 2024-09-12T00:18:17.491 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: crc 2024-09-12T00:18:17.491 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: secure 2024-09-12T00:18:17.492 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: crc 2024-09-12T00:18:17.492 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: secure 2024-09-12T00:18:17.492 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: crc 2024-09-12T00:18:17.492 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: crc 2024-09-12T00:18:17.492 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: secure 2024-09-12T00:18:17.492 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: crc 2024-09-12T00:18:17.492 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: secure 2024-09-12T00:18:17.492 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: crc 2024-09-12T00:18:17.492 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: secure 2024-09-12T00:18:17.492 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:18:17.411+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.492 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:18:17.411+0000 7f5875746800 5 asok(0x55b85371f630) register_command objecter_requests cmddesc objecter_requests hook 0x55b853997570 EEXIST 2024-09-12T00:18:17.492 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:18:17.411+0000 7f5875746800 10 monclient: init 2024-09-12T00:18:17.493 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding auth protocol: cephx 2024-09-12T00:18:17.493 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding auth protocol: cephx 2024-09-12T00:18:17.493 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding auth protocol: cephx 2024-09-12T00:18:17.493 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: secure 2024-09-12T00:18:17.493 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: crc 2024-09-12T00:18:17.493 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: secure 2024-09-12T00:18:17.493 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: crc 2024-09-12T00:18:17.493 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: secure 2024-09-12T00:18:17.493 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: crc 2024-09-12T00:18:17.493 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: crc 2024-09-12T00:18:17.493 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: secure 2024-09-12T00:18:17.493 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: crc 2024-09-12T00:18:17.493 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: secure 2024-09-12T00:18:17.493 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: crc 2024-09-12T00:18:17.494 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: secure 2024-09-12T00:18:17.494 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:18:17.411+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.494 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:18:17.412+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.494 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:18:17.412+0000 7f5875746800 5 asok(0x55b85371f630) register_command rotate-key cmddesc rotate-key hook 0x55b8539928d0 EEXIST 2024-09-12T00:18:17.494 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:17.494 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:18:17.494 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): picked mon.noname-b con 0x55b8539bb890 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:17.494 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): picked mon.noname-c con 0x55b8539bbc70 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:17.494 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): picked mon.noname-a con 0x55b8539ba5a0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:17.494 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.494 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.494 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.494 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:17.494 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): authenticate will time out at 1774.668306s 2024-09-12T00:18:17.495 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:18:17.412+0000 7f5873a38640 10 monclient(hunting): get_auth_request con 0x55b8539ba5a0 auth_method 0 2024-09-12T00:18:17.495 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:18:17.412+0000 7f5873a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.495 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:18:17.412+0000 7f5873a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.495 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:18:17.412+0000 7f5873a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.495 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): get_auth_request con 0x55b8539bbc70 auth_method 0 2024-09-12T00:18:17.495 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.495 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.495 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.495 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:18:17.412+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.495 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:18:17.412+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.495 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:18:17.412+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.495 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.495 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.496 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.496 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): handle_auth_done global_id 6002 payload 824 2024-09-12T00:18:17.496 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient: _finish_hunting 0 2024-09-12T00:18:17.496 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:18:17.412+0000 7f5872a36640 1 monclient: found mon.noname-c 2024-09-12T00:18:17.496 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.496 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:18:17.412+0000 7f575d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.496 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:18:17.412+0000 7f575d602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:18:17.496 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:18:17.412+0000 7f575d602640 10 monclient: dump: 2024-09-12T00:18:17.496 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.496 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.496 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.496 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.496 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.497 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.497 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.497 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.497 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.497 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.497 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:18:17.412+0000 7f575d602640 10 monclient: _finish_auth 0 2024-09-12T00:18:17.497 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:18:17.412+0000 7f575d602640 10 monclient: _check_auth_tickets 2024-09-12T00:18:17.498 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:18:17.412+0000 7f575d602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:17.498 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:18:17.412+0000 7f575d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.498 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:18:17.413+0000 7f575d602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:18:17.498 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:18:17.413+0000 7f575d602640 10 monclient: dump: 2024-09-12T00:18:17.498 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.498 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.498 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.498 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.498 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.498 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.498 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.498 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.498 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.499 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.499 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:18:17.413+0000 7f5875746800 5 monclient: authenticate success, global_id 6002 2024-09-12T00:18:17.499 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:18:17.413+0000 7f5875746800 10 monclient: _renew_subs 2024-09-12T00:18:17.499 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:18:17.412+0000 7f5874239640 4 set_mon_vals no callback set 2024-09-12T00:18:17.499 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:18:17.413+0000 7f5875746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.499 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:18:17.413+0000 7f5875746800 10 monclient: _renew_subs 2024-09-12T00:18:17.499 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:18:17.413+0000 7f5875746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.499 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:18:17.414+0000 7f575d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:18:17.499 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:18:17.414+0000 7f575d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:17.499 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:18:17.414+0000 7f575d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:17.499 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:18:17.415+0000 7f5873237640 10 monclient: get_auth_request con 0x7f574c076380 auth_method 0 2024-09-12T00:18:17.499 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:18:17.415+0000 7f5875746800 10 monclient: get_monmap_and_config 2024-09-12T00:18:17.499 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:18:17.415+0000 7f5875746800 10 monclient: build_initial_monmap 2024-09-12T00:18:17.499 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:18:17.415+0000 7f5875746800 1 build_initial for_mkfs: 0 2024-09-12T00:18:17.500 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:18:17.415+0000 7f5875746800 10 monclient: monmap: 2024-09-12T00:18:17.500 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:17.500 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:17.500 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:17.500 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:17.500 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:17.500 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.500 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:17.500 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:17.500 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:17.500 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.500 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding auth protocol: cephx 2024-09-12T00:18:17.500 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding auth protocol: cephx 2024-09-12T00:18:17.501 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding auth protocol: cephx 2024-09-12T00:18:17.501 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: secure 2024-09-12T00:18:17.501 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: crc 2024-09-12T00:18:17.501 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: secure 2024-09-12T00:18:17.501 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: crc 2024-09-12T00:18:17.501 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: secure 2024-09-12T00:18:17.501 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: crc 2024-09-12T00:18:17.501 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: crc 2024-09-12T00:18:17.501 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: secure 2024-09-12T00:18:17.501 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: crc 2024-09-12T00:18:17.501 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: secure 2024-09-12T00:18:17.501 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: crc 2024-09-12T00:18:17.501 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: secure 2024-09-12T00:18:17.501 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:18:17.415+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.501 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:18:17.415+0000 7f5875746800 10 monclient: init 2024-09-12T00:18:17.502 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding auth protocol: cephx 2024-09-12T00:18:17.502 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding auth protocol: cephx 2024-09-12T00:18:17.502 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding auth protocol: cephx 2024-09-12T00:18:17.502 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: secure 2024-09-12T00:18:17.502 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: crc 2024-09-12T00:18:17.502 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: secure 2024-09-12T00:18:17.502 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: crc 2024-09-12T00:18:17.502 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: secure 2024-09-12T00:18:17.502 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: crc 2024-09-12T00:18:17.502 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: crc 2024-09-12T00:18:17.502 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: secure 2024-09-12T00:18:17.502 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: crc 2024-09-12T00:18:17.502 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: secure 2024-09-12T00:18:17.502 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: crc 2024-09-12T00:18:17.503 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: secure 2024-09-12T00:18:17.503 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:18:17.416+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.503 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:18:17.416+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.503 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:18:17.416+0000 7f5875746800 5 asok(0x55b85371f630) register_command rotate-key cmddesc rotate-key hook 0x7ffd819eee98 EEXIST 2024-09-12T00:18:17.503 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:17.503 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:18:17.503 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): picked mon.noname-a con 0x55b853a0fbc0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:17.503 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): picked mon.noname-c con 0x55b8539e0b10 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:17.503 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): picked mon.noname-b con 0x55b853a0b460 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:17.503 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.503 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.503 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.504 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:17.504 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): authenticate will time out at 1774.672328s 2024-09-12T00:18:17.504 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:18:17.416+0000 7f5873237640 10 monclient(hunting): get_auth_request con 0x55b853a0fbc0 auth_method 0 2024-09-12T00:18:17.504 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:18:17.416+0000 7f5873237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.504 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:18:17.416+0000 7f5873237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.504 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:18:17.416+0000 7f5873237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.504 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): get_auth_request con 0x55b8539e0b10 auth_method 0 2024-09-12T00:18:17.504 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.504 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.504 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.504 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.504 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.504 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.505 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:18:17.416+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.505 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:18:17.416+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.505 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:18:17.416+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.505 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:18:17.416+0000 7f5873a38640 10 monclient(hunting): get_auth_request con 0x55b853a0b460 auth_method 0 2024-09-12T00:18:17.505 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:18:17.416+0000 7f5873a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.505 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:18:17.416+0000 7f5873a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.505 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:18:17.416+0000 7f5873a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.505 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): handle_auth_done global_id 6005 payload 274 2024-09-12T00:18:17.505 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient: _finish_hunting 0 2024-09-12T00:18:17.505 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:18:17.416+0000 7f5872a36640 1 monclient: found mon.noname-c 2024-09-12T00:18:17.505 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.505 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.505 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:18:17.505 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: dump: 2024-09-12T00:18:17.506 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.506 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.506 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.506 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.506 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.506 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.506 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.506 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.506 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.506 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.506 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: _finish_auth 0 2024-09-12T00:18:17.506 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:18:17.506 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:17.506 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.507 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:18:17.507 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: dump: 2024-09-12T00:18:17.507 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.507 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.507 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.507 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.507 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.507 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.507 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.507 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.507 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.507 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.507 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:18:17.416+0000 7f5875746800 5 monclient: authenticate success, global_id 6005 2024-09-12T00:18:17.507 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient: get_monmap_and_config success 2024-09-12T00:18:17.508 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:18:17.416+0000 7f5875746800 4 set_mon_vals no callback set 2024-09-12T00:18:17.508 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:18:17.417+0000 7f5875746800 10 monclient: shutdown 2024-09-12T00:18:17.508 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:18:17.417+0000 7f5875746800 10 monclient: build_initial_monmap 2024-09-12T00:18:17.508 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:18:17.417+0000 7f5875746800 1 build_initial for_mkfs: 0 2024-09-12T00:18:17.508 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:18:17.417+0000 7f5875746800 10 monclient: monmap: 2024-09-12T00:18:17.508 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:17.508 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:17.508 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:17.508 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:17.508 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:17.508 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.508 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:17.508 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:17.508 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:17.509 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.509 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding auth protocol: cephx 2024-09-12T00:18:17.509 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding auth protocol: cephx 2024-09-12T00:18:17.509 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding auth protocol: cephx 2024-09-12T00:18:17.509 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: secure 2024-09-12T00:18:17.509 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: crc 2024-09-12T00:18:17.509 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: secure 2024-09-12T00:18:17.509 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: crc 2024-09-12T00:18:17.509 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: secure 2024-09-12T00:18:17.509 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: crc 2024-09-12T00:18:17.509 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: crc 2024-09-12T00:18:17.509 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: secure 2024-09-12T00:18:17.509 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: crc 2024-09-12T00:18:17.509 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: secure 2024-09-12T00:18:17.510 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: crc 2024-09-12T00:18:17.510 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: secure 2024-09-12T00:18:17.510 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:18:17.417+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.510 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:18:17.417+0000 7f5875746800 1 librados: starting msgr at 2024-09-12T00:18:17.510 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:18:17.417+0000 7f5875746800 1 librados: starting objecter 2024-09-12T00:18:17.510 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:18:17.417+0000 7f5875746800 5 asok(0x55b85371f630) register_command objecter_requests cmddesc objecter_requests hook 0x55b8539e0630 EEXIST 2024-09-12T00:18:17.510 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:18:17.418+0000 7f5875746800 1 librados: setting wanted keys 2024-09-12T00:18:17.510 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:18:17.418+0000 7f5875746800 1 librados: calling monclient init 2024-09-12T00:18:17.510 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient: init 2024-09-12T00:18:17.510 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding auth protocol: cephx 2024-09-12T00:18:17.510 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding auth protocol: cephx 2024-09-12T00:18:17.510 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding auth protocol: cephx 2024-09-12T00:18:17.511 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: secure 2024-09-12T00:18:17.511 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: crc 2024-09-12T00:18:17.511 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: secure 2024-09-12T00:18:17.511 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: crc 2024-09-12T00:18:17.511 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: secure 2024-09-12T00:18:17.511 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: crc 2024-09-12T00:18:17.511 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: crc 2024-09-12T00:18:17.511 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: secure 2024-09-12T00:18:17.511 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: crc 2024-09-12T00:18:17.511 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: secure 2024-09-12T00:18:17.511 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: crc 2024-09-12T00:18:17.511 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: secure 2024-09-12T00:18:17.511 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:18:17.418+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.511 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:18:17.418+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.512 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:18:17.418+0000 7f5875746800 5 asok(0x55b85371f630) register_command rotate-key cmddesc rotate-key hook 0x55b8539d0298 EEXIST 2024-09-12T00:18:17.512 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:17.512 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:18:17.512 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): picked mon.noname-c con 0x55b8539e0b10 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:17.512 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): picked mon.noname-a con 0x55b853a0b460 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:17.512 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): picked mon.noname-b con 0x55b853a0fbc0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:17.512 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.512 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.512 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.512 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:17.512 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): authenticate will time out at 1774.674630s 2024-09-12T00:18:17.512 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:18:17.418+0000 7f5872a36640 10 monclient(hunting): get_auth_request con 0x55b853a0b460 auth_method 0 2024-09-12T00:18:17.512 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:18:17.418+0000 7f5872a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.513 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:18:17.418+0000 7f5872a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.513 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:18:17.418+0000 7f5872a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.513 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): get_auth_request con 0x55b8539e0b10 auth_method 0 2024-09-12T00:18:17.513 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.513 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.513 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.513 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:18:17.418+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.513 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:18:17.418+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.513 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:18:17.418+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.513 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.513 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.513 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.513 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): handle_auth_done global_id 6008 payload 824 2024-09-12T00:18:17.513 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient: _finish_hunting 0 2024-09-12T00:18:17.514 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:18:17.418+0000 7f5873237640 1 monclient: found mon.noname-c 2024-09-12T00:18:17.514 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.514 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.514 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:18:17.514 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: dump: 2024-09-12T00:18:17.514 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.514 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.514 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.514 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.514 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.514 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.514 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.514 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.514 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.515 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.515 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: _finish_auth 0 2024-09-12T00:18:17.515 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: _check_auth_tickets 2024-09-12T00:18:17.515 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:17.515 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.515 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:18:17.515 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: dump: 2024-09-12T00:18:17.515 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.515 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.515 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.515 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.515 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.515 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.515 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.516 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.516 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.516 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.516 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:18:17.419+0000 7f5875746800 5 monclient: authenticate success, global_id 6008 2024-09-12T00:18:17.516 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:18:17.419+0000 7f5875746800 10 monclient: _renew_subs 2024-09-12T00:18:17.516 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:18:17.419+0000 7f5875746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.516 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:18:17.419+0000 7f5756ffd640 4 set_mon_vals no callback set 2024-09-12T00:18:17.516 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:18:17.419+0000 7f5875746800 10 monclient: _renew_subs 2024-09-12T00:18:17.516 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:18:17.419+0000 7f5875746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.516 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:18:17.419+0000 7f5875746800 1 librados: init done 2024-09-12T00:18:17.516 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:18:17.419+0000 7f5875746800 5 asok(0x55b85371f630) register_command cr dump hook 0x55b8539fdf48 2024-09-12T00:18:17.516 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:18:17.420+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.516 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:18:17.421+0000 7f57557fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:18:17.516 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:18:17.421+0000 7f57557fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:17.517 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:18:17.421+0000 7f57557fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:17.517 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:18:17.421+0000 7f5872a36640 10 monclient: get_auth_request con 0x7f573c076470 auth_method 0 2024-09-12T00:18:17.517 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:18:17.421+0000 7f5873a38640 10 monclient: get_auth_request con 0x55b853a2a380 auth_method 0 2024-09-12T00:18:17.517 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:18:17.422+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.517 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:18:17.422+0000 7f5875746800 20 realm 2024-09-12T00:18:17.517 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:18:17.422+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.517 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:18:17.422+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.517 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:18:17.422+0000 7f5875746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:17.517 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:18:17.422+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.517 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:18:17.422+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.517 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:18:17.422+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.517 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:18:17.423+0000 7f5873237640 10 monclient: get_auth_request con 0x55b853a2e5d0 auth_method 0 2024-09-12T00:18:17.517 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:18:17.423+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:17.517 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:18:17.423+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.518 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:18:17.423+0000 7f5872a36640 10 monclient: get_auth_request con 0x55b853a31e30 auth_method 0 2024-09-12T00:18:17.518 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:18:17.424+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:17.518 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:18:17.424+0000 7f5875746800 20 searching for the correct realm 2024-09-12T00:18:17.518 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:18:17.424+0000 7f5873a38640 10 monclient: get_auth_request con 0x7f586809b070 auth_method 0 2024-09-12T00:18:17.518 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:18:17.426+0000 7f5873237640 10 monclient: get_auth_request con 0x7f586407e050 auth_method 0 2024-09-12T00:18:17.518 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:18:17.426+0000 7f5872a36640 10 monclient: get_auth_request con 0x7f5868032030 auth_method 0 2024-09-12T00:18:17.518 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:18:17.427+0000 7f5872a36640 0 -- 172.21.15.67:0/1118657054 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f5868032030 msgr2=0x7f58680327f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:17.518 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:18:17.427+0000 7f57557fa640 1 client.6008.objecter ms_handle_reset 0x7f5868032030 session 0x7f586806cc40 osd.5 2024-09-12T00:18:17.518 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:18:17.427+0000 7f57557fa640 10 monclient: _renew_subs 2024-09-12T00:18:17.518 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:18:17.427+0000 7f57557fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.518 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:18:17.427+0000 7f5872a36640 10 monclient: get_auth_request con 0x7f573c086790 auth_method 0 2024-09-12T00:18:17.518 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:18:17.429+0000 7f5873a38640 10 monclient: get_auth_request con 0x7f58640b9950 auth_method 0 2024-09-12T00:18:17.518 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:18:17.430+0000 7f5873237640 10 monclient: get_auth_request con 0x7f586c014030 auth_method 0 2024-09-12T00:18:17.519 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:18:17.430+0000 7f5873a38640 0 -- 172.21.15.67:0/1118657054 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55b853a2a380 msgr2=0x55b853a2c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:17.519 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:18:17.430+0000 7f57557fa640 1 client.6008.objecter ms_handle_reset 0x55b853a2a380 session 0x55b853a29d00 osd.6 2024-09-12T00:18:17.519 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:18:17.431+0000 7f5873a38640 10 monclient: get_auth_request con 0x7f5868032030 auth_method 0 2024-09-12T00:18:17.519 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:17.519 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:17.519 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:17.519 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:17.519 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:17.519 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:17.519 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:18:17.434+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.519 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:18:17.434+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.519 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:18:17.434+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.519 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:18:17.435+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:17.520 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:18:17.435+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.520 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:18:17.435+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:17.520 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:18:17.435+0000 7f5875746800 20 zone default found 2024-09-12T00:18:17.520 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:18:17.435+0000 7f5875746800 4 Realm: () 2024-09-12T00:18:17.520 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:18:17.435+0000 7f5875746800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:17.520 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:18:17.435+0000 7f5875746800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:17.520 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:18:17.435+0000 7f5875746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:17.520 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:18:17.435+0000 7f5875746800 20 zonegroup default 2024-09-12T00:18:17.520 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:18:17.435+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.520 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:18:17.435+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.520 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:18:17.435+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.520 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:18:17.436+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.520 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:18:17.436+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.521 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:18:17.436+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.521 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:18:17.436+0000 7f5875746800 20 started sync module instance, tier type = 2024-09-12T00:18:17.521 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:18:17.436+0000 7f5875746800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:17.521 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=0 2024-09-12T00:18:17.521 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=1 2024-09-12T00:18:17.521 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=2 2024-09-12T00:18:17.521 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=3 2024-09-12T00:18:17.521 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=4 2024-09-12T00:18:17.521 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=5 2024-09-12T00:18:17.521 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=6 2024-09-12T00:18:17.521 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=7 2024-09-12T00:18:17.521 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:18:17.444+0000 7f5875746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:17.521 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding auth protocol: cephx 2024-09-12T00:18:17.521 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding auth protocol: cephx 2024-09-12T00:18:17.521 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding auth protocol: cephx 2024-09-12T00:18:17.522 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: secure 2024-09-12T00:18:17.522 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: crc 2024-09-12T00:18:17.522 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: secure 2024-09-12T00:18:17.522 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: crc 2024-09-12T00:18:17.522 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: secure 2024-09-12T00:18:17.522 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: crc 2024-09-12T00:18:17.522 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: crc 2024-09-12T00:18:17.522 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: secure 2024-09-12T00:18:17.522 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: crc 2024-09-12T00:18:17.522 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: secure 2024-09-12T00:18:17.522 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: crc 2024-09-12T00:18:17.522 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: secure 2024-09-12T00:18:17.522 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:18:17.446+0000 7f5729fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:17.523 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:18:17.446+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.523 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:18:17.446+0000 7f5875746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:17.523 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:18:17.446+0000 7f5875746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:17.523 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:18:17.446+0000 7f5875746800 5 asok(0x55b85371f630) register_command cache list hook 0x55b8539fd930 2024-09-12T00:18:17.523 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:18:17.446+0000 7f5875746800 5 asok(0x55b85371f630) register_command cache inspect hook 0x55b8539fd930 2024-09-12T00:18:17.523 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:18:17.446+0000 7f5875746800 5 asok(0x55b85371f630) register_command cache erase hook 0x55b8539fd930 2024-09-12T00:18:17.523 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:18:17.446+0000 7f5875746800 5 asok(0x55b85371f630) register_command cache zap hook 0x55b8539fd930 2024-09-12T00:18:17.523 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:18:17.447+0000 7f5875746800 5 note: GC not initialized 2024-09-12T00:18:17.523 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:18:17.447+0000 7f5728fe1640 20 reqs_thread_entry: start 2024-09-12T00:18:17.523 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:18:17.447+0000 7f5875746800 5 asok(0x55b85371f630) register_command sync trace show hook 0x7f586c005470 2024-09-12T00:18:17.523 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:18:17.447+0000 7f5875746800 5 asok(0x55b85371f630) register_command sync trace history hook 0x7f586c005470 2024-09-12T00:18:17.523 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:18:17.447+0000 7f5875746800 5 asok(0x55b85371f630) register_command sync trace active hook 0x7f586c005470 2024-09-12T00:18:17.523 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:18:17.447+0000 7f5875746800 5 asok(0x55b85371f630) register_command sync trace active_short hook 0x7f586c005470 2024-09-12T00:18:17.523 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:18:17.447+0000 7f5875746800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:17.524 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:18:17.447+0000 7f5875746800 20 Filter name: none 2024-09-12T00:18:17.524 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:18:17.447+0000 7f56a27fc640 20 reqs_thread_entry: start 2024-09-12T00:18:17.524 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:18:17.447+0000 7f5875746800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:18:17.524 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:18:17.447+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.524 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:18:17.447+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:18:17.524 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:18:17.447+0000 7f5875746800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:18:17.524 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:18:17.448+0000 7f5875746800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:18:17.524 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:18:17.448+0000 7f5875746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 : miss 2024-09-12T00:18:17.524 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:18:17.448+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.524 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:18:17.448+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:18:17.524 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:18:17.448+0000 7f5875746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 info.flags=0x17 2024-09-12T00:18:17.524 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:18:17.448+0000 7f5875746800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 to cache LRU end 2024-09-12T00:18:17.525 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:18:17.448+0000 7f5875746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:17.525 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:18:17.448+0000 7f5875746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:17.525 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:18:17.448+0000 7f5875746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 2024-09-12T00:18:17.525 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:18:17.450+0000 7f5875746800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5875746800 time 2024-09-12T00:18:17.450019+0000 2024-09-12T00:18:17.525 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:18:17.525 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.525 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:17.525 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5878d8c71a] 2024-09-12T00:18:17.525 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5878d8c8d8] 2024-09-12T00:18:17.525 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b851783641] 2024-09-12T00:18:17.526 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd877a4) [0x55b851c957a4] 2024-09-12T00:18:17.526 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85179331d] 2024-09-12T00:18:17.526 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:18:17.526 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5877a29590] 2024-09-12T00:18:17.526 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:18:17.526 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:18:17.526 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.526 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:18:17.451+0000 7f5875746800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:18:17.526 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f5875746800 thread_name:radosgw-admin 2024-09-12T00:18:17.526 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.526 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:17.526 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5877a3e6f0] 2024-09-12T00:18:17.526 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5877a8b99c] 2024-09-12T00:18:17.527 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:18:17.527 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:18:17.527 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5878d8c774] 2024-09-12T00:18:17.527 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5878d8c8d8] 2024-09-12T00:18:17.527 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b851783641] 2024-09-12T00:18:17.527 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd877a4) [0x55b851c957a4] 2024-09-12T00:18:17.527 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85179331d] 2024-09-12T00:18:17.527 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:18:17.527 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5877a29590] 2024-09-12T00:18:17.527 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:18:17.527 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:18:17.527 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:18:17.527 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.527 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:18:17.528 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:18:17.528 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:18:17.528 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:18:17.528 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:18:17.528 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:18:17.528 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:18:17.528 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:18:17.528 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:18:17.528 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:18:17.528 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:18:17.528 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:18:17.528 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:18:17.528 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:18:17.529 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:18:17.529 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:18:17.529 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:18:17.529 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:18:17.529 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:18:17.529 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:18:17.529 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:18:17.529 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:18:17.529 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:18:17.529 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:18:17.529 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:18:17.529 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:18:17.529 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:18:17.529 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:18:17.530 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:18:17.530 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:18:17.530 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:18:17.530 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:18:17.530 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:18:17.530 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:18:17.530 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:18:17.530 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:18:17.530 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:18:17.530 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:18:17.530 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:18:17.530 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:18:17.530 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:18:17.530 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:18:17.531 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:18:17.531 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:18:17.531 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:18:17.531 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:18:17.531 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:18:17.531 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:18:17.531 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:18:17.531 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:18:17.532 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:18:17.532 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:18:17.532 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:18:17.532 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:18:17.532 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:18:17.532 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:18:17.532 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:18:17.532 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:18:17.532 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:18:17.532 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:18:17.533 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:18:17.533 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:18:17.533 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:18:17.533 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:18:17.533 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:18:17.533 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:18:17.533 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:18:17.533 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:18:17.533 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:18:17.533 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:18:17.533 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:18:17.533 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:18:17.534 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:18:17.534 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:18:17.534 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:18:17.534 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:18:17.534 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:18:17.534 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:18:17.534 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:18:17.534 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:18:17.534 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:18:17.535 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:18:17.535 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:18:17.535 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:18:17.535 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:18:17.535 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:18:17.535 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:18:17.535 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:18:17.535 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:18:17.535 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:18:17.535 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:18:17.536 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:18:17.536 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:18:17.536 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:18:17.536 INFO:tasks.workunit.client.0.smithi067.stderr: 7f56a27fc640 / http_manager 2024-09-12T00:18:17.536 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5728fe1640 / http_manager 2024-09-12T00:18:17.536 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5729fe3640 / rgw_dt_lg_renew 2024-09-12T00:18:17.536 INFO:tasks.workunit.client.0.smithi067.stderr: 7f57557fa640 / ms_dispatch 2024-09-12T00:18:17.536 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5756ffd640 / io_context_pool 2024-09-12T00:18:17.536 INFO:tasks.workunit.client.0.smithi067.stderr: 7f575d602640 / ms_dispatch 2024-09-12T00:18:17.536 INFO:tasks.workunit.client.0.smithi067.stderr: 7f575fe07640 / ms_dispatch 2024-09-12T00:18:17.536 INFO:tasks.workunit.client.0.smithi067.stderr: 7f576160a640 / io_context_pool 2024-09-12T00:18:17.537 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5872a36640 / msgr-worker-2 2024-09-12T00:18:17.537 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5873237640 / msgr-worker-1 2024-09-12T00:18:17.537 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5873a38640 / msgr-worker-0 2024-09-12T00:18:17.537 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5874239640 / io_context_pool 2024-09-12T00:18:17.537 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5875746800 / radosgw-admin 2024-09-12T00:18:17.537 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:18:17.537 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:18:17.537 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.90493.log 2024-09-12T00:18:17.537 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:18:17.537 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:18:17.537 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:18:17.402+0000 7f5873237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.538 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:18:17.402+0000 7f5873237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.538 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:18:17.402+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.538 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:18:17.402+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.538 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:18:17.402+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.538 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:18:17.402+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.538 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:18:17.402+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.538 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:18:17.402+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.538 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:18:17.402+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.538 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:18:17.402+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.538 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:18:17.402+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.538 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:18:17.402+0000 7f5872a36640 10 monclient(hunting): handle_auth_done global_id 5996 payload 274 2024-09-12T00:18:17.539 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:18:17.402+0000 7f5872a36640 10 monclient: _finish_hunting 0 2024-09-12T00:18:17.539 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:18:17.402+0000 7f5872a36640 1 monclient: found mon.noname-c 2024-09-12T00:18:17.539 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:18:17.402+0000 7f5872a36640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.539 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.539 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:18:17.539 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: dump: 2024-09-12T00:18:17.539 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.539 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.539 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.539 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.540 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.540 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.540 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.540 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.540 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.540 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.540 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: _finish_auth 0 2024-09-12T00:18:17.540 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: _check_auth_tickets 2024-09-12T00:18:17.540 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:17.540 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.540 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:18:17.541 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:18:17.403+0000 7f576160a640 10 monclient: dump: 2024-09-12T00:18:17.541 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.541 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.541 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.541 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.541 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.541 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.541 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.541 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.541 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.541 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.542 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:18:17.403+0000 7f5875746800 5 monclient: authenticate success, global_id 5996 2024-09-12T00:18:17.542 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:18:17.403+0000 7f5875746800 10 monclient: get_monmap_and_config success 2024-09-12T00:18:17.542 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:18:17.403+0000 7f5875746800 4 set_mon_vals no callback set 2024-09-12T00:18:17.542 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:18:17.403+0000 7f5875746800 10 monclient: shutdown 2024-09-12T00:18:17.542 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:18:17.403+0000 7f5875746800 5 asok(0x55b85371f630) unregister_commands rotate-key 2024-09-12T00:18:17.542 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:18:17.404+0000 7f5875746800 10 monclient: build_initial_monmap 2024-09-12T00:18:17.542 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:18:17.404+0000 7f5875746800 1 build_initial for_mkfs: 0 2024-09-12T00:18:17.542 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:18:17.404+0000 7f5875746800 10 monclient: monmap: 2024-09-12T00:18:17.542 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:17.542 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:17.542 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:17.542 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:17.543 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:17.543 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.543 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:17.543 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:17.543 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:17.543 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.543 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding auth protocol: cephx 2024-09-12T00:18:17.543 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding auth protocol: cephx 2024-09-12T00:18:17.543 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding auth protocol: cephx 2024-09-12T00:18:17.543 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: secure 2024-09-12T00:18:17.543 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: crc 2024-09-12T00:18:17.543 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: secure 2024-09-12T00:18:17.544 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: crc 2024-09-12T00:18:17.544 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: secure 2024-09-12T00:18:17.544 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: crc 2024-09-12T00:18:17.544 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: crc 2024-09-12T00:18:17.544 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: secure 2024-09-12T00:18:17.544 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: crc 2024-09-12T00:18:17.544 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: secure 2024-09-12T00:18:17.544 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: crc 2024-09-12T00:18:17.544 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b8539452a0) adding con mode: secure 2024-09-12T00:18:17.544 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:18:17.404+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.544 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:18:17.404+0000 7f5875746800 1 librados: starting msgr at 2024-09-12T00:18:17.545 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:18:17.404+0000 7f5875746800 1 librados: starting objecter 2024-09-12T00:18:17.545 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:18:17.404+0000 7f5875746800 5 asok(0x55b85371f630) register_command objecter_requests hook 0x55b853946d60 2024-09-12T00:18:17.545 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:18:17.404+0000 7f5875746800 1 librados: setting wanted keys 2024-09-12T00:18:17.545 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:18:17.404+0000 7f5875746800 1 librados: calling monclient init 2024-09-12T00:18:17.545 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:18:17.404+0000 7f5875746800 10 monclient: init 2024-09-12T00:18:17.545 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding auth protocol: cephx 2024-09-12T00:18:17.545 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding auth protocol: cephx 2024-09-12T00:18:17.545 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding auth protocol: cephx 2024-09-12T00:18:17.545 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: secure 2024-09-12T00:18:17.545 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: crc 2024-09-12T00:18:17.545 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: secure 2024-09-12T00:18:17.546 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: crc 2024-09-12T00:18:17.546 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: secure 2024-09-12T00:18:17.546 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: crc 2024-09-12T00:18:17.546 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: crc 2024-09-12T00:18:17.546 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: secure 2024-09-12T00:18:17.546 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: crc 2024-09-12T00:18:17.546 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: secure 2024-09-12T00:18:17.546 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: crc 2024-09-12T00:18:17.546 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:18:17.404+0000 7f5875746800 5 AuthRegistry(0x55b85393f5a0) adding con mode: secure 2024-09-12T00:18:17.546 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:18:17.404+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.547 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:18:17.404+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.547 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:18:17.404+0000 7f5875746800 5 asok(0x55b85371f630) register_command rotate-key hook 0x55b85393f6e8 2024-09-12T00:18:17.547 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:18:17.404+0000 7f5875746800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:17.547 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:18:17.404+0000 7f5875746800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:18:17.547 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): picked mon.noname-b con 0x55b8537ed020 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:17.547 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): picked mon.noname-a con 0x55b8537f6f10 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:17.547 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): picked mon.noname-c con 0x55b853882e70 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:17.547 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.547 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.547 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.548 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:17.548 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient(hunting): authenticate will time out at 1774.661038s 2024-09-12T00:18:17.548 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): get_auth_request con 0x55b853882e70 auth_method 0 2024-09-12T00:18:17.548 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.548 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.548 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.548 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:18:17.405+0000 7f5872a36640 10 monclient(hunting): get_auth_request con 0x55b8537f6f10 auth_method 0 2024-09-12T00:18:17.548 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:18:17.405+0000 7f5872a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.548 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:18:17.405+0000 7f5872a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.548 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:18:17.405+0000 7f5872a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.548 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.549 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.549 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.549 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:18:17.405+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.549 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:18:17.405+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.549 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:18:17.405+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.549 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:18:17.405+0000 7f5873237640 10 monclient(hunting): get_auth_request con 0x55b8537ed020 auth_method 0 2024-09-12T00:18:17.549 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:18:17.405+0000 7f5873237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.549 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:18:17.405+0000 7f5873237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.549 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:18:17.405+0000 7f5873237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.549 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient(hunting): handle_auth_done global_id 5999 payload 824 2024-09-12T00:18:17.550 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient: _finish_hunting 0 2024-09-12T00:18:17.550 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:18:17.405+0000 7f5873a38640 1 monclient: found mon.noname-c 2024-09-12T00:18:17.550 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:18:17.405+0000 7f5873a38640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.550 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.550 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:18:17.550 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: dump: 2024-09-12T00:18:17.550 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.550 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.550 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.550 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.551 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.551 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.551 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.551 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.551 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.551 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.551 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: _finish_auth 0 2024-09-12T00:18:17.551 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: _check_auth_tickets 2024-09-12T00:18:17.551 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:17.551 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.552 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:18:17.552 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:18:17.405+0000 7f575fe07640 10 monclient: dump: 2024-09-12T00:18:17.552 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.552 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.552 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.552 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.552 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.552 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.552 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.552 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.553 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.553 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.553 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:18:17.405+0000 7f5875746800 5 monclient: authenticate success, global_id 5999 2024-09-12T00:18:17.553 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient: _renew_subs 2024-09-12T00:18:17.553 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.553 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:18:17.405+0000 7f576160a640 4 set_mon_vals no callback set 2024-09-12T00:18:17.553 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient: _renew_subs 2024-09-12T00:18:17.553 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:18:17.405+0000 7f5875746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.553 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:18:17.405+0000 7f5875746800 1 librados: init done 2024-09-12T00:18:17.553 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:18:17.407+0000 7f575fe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:18:17.554 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:18:17.407+0000 7f575fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:17.554 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:18:17.407+0000 7f575fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:17.554 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:18:17.408+0000 7f5873237640 10 monclient: get_auth_request con 0x7f5758076470 auth_method 0 2024-09-12T00:18:17.554 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:18:17.408+0000 7f5872a36640 10 monclient: get_auth_request con 0x55b85396b7c0 auth_method 0 2024-09-12T00:18:17.554 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:18:17.409+0000 7f5873237640 10 monclient: get_auth_request con 0x55b85398ae40 auth_method 0 2024-09-12T00:18:17.554 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:18:17.409+0000 7f5872a36640 10 monclient: get_auth_request con 0x55b85398f220 auth_method 0 2024-09-12T00:18:17.554 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:18:17.411+0000 7f5875746800 10 monclient: build_initial_monmap 2024-09-12T00:18:17.554 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:18:17.411+0000 7f5875746800 1 build_initial for_mkfs: 0 2024-09-12T00:18:17.554 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:18:17.411+0000 7f5875746800 10 monclient: monmap: 2024-09-12T00:18:17.554 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:17.554 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:17.554 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:17.554 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:17.555 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:17.555 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.555 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:17.555 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:17.555 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:17.555 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.555 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding auth protocol: cephx 2024-09-12T00:18:17.555 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding auth protocol: cephx 2024-09-12T00:18:17.555 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding auth protocol: cephx 2024-09-12T00:18:17.555 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: secure 2024-09-12T00:18:17.555 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: crc 2024-09-12T00:18:17.556 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: secure 2024-09-12T00:18:17.556 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: crc 2024-09-12T00:18:17.556 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: secure 2024-09-12T00:18:17.556 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: crc 2024-09-12T00:18:17.556 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: crc 2024-09-12T00:18:17.556 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: secure 2024-09-12T00:18:17.556 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: crc 2024-09-12T00:18:17.556 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: secure 2024-09-12T00:18:17.556 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: crc 2024-09-12T00:18:17.556 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853994060) adding con mode: secure 2024-09-12T00:18:17.556 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:18:17.411+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.557 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:18:17.411+0000 7f5875746800 5 asok(0x55b85371f630) register_command objecter_requests cmddesc objecter_requests hook 0x55b853997570 EEXIST 2024-09-12T00:18:17.557 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:18:17.411+0000 7f5875746800 10 monclient: init 2024-09-12T00:18:17.557 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding auth protocol: cephx 2024-09-12T00:18:17.557 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding auth protocol: cephx 2024-09-12T00:18:17.557 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding auth protocol: cephx 2024-09-12T00:18:17.557 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: secure 2024-09-12T00:18:17.557 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: crc 2024-09-12T00:18:17.557 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: secure 2024-09-12T00:18:17.557 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: crc 2024-09-12T00:18:17.557 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: secure 2024-09-12T00:18:17.557 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: crc 2024-09-12T00:18:17.558 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: crc 2024-09-12T00:18:17.558 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: secure 2024-09-12T00:18:17.558 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: crc 2024-09-12T00:18:17.558 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: secure 2024-09-12T00:18:17.558 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: crc 2024-09-12T00:18:17.558 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:18:17.411+0000 7f5875746800 5 AuthRegistry(0x55b853992788) adding con mode: secure 2024-09-12T00:18:17.558 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:18:17.411+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.558 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:18:17.412+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.558 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:18:17.412+0000 7f5875746800 5 asok(0x55b85371f630) register_command rotate-key cmddesc rotate-key hook 0x55b8539928d0 EEXIST 2024-09-12T00:18:17.558 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:17.559 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:18:17.559 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): picked mon.noname-b con 0x55b8539bb890 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:17.559 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): picked mon.noname-c con 0x55b8539bbc70 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:17.559 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): picked mon.noname-a con 0x55b8539ba5a0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:17.559 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.559 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.559 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.559 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:17.559 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:18:17.412+0000 7f5875746800 10 monclient(hunting): authenticate will time out at 1774.668306s 2024-09-12T00:18:17.559 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:18:17.412+0000 7f5873a38640 10 monclient(hunting): get_auth_request con 0x55b8539ba5a0 auth_method 0 2024-09-12T00:18:17.559 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:18:17.412+0000 7f5873a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.559 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:18:17.412+0000 7f5873a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.560 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:18:17.412+0000 7f5873a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.560 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): get_auth_request con 0x55b8539bbc70 auth_method 0 2024-09-12T00:18:17.560 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.560 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.560 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.560 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:18:17.412+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.560 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:18:17.412+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.560 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:18:17.412+0000 7f5873a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.560 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.560 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.560 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.561 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient(hunting): handle_auth_done global_id 6002 payload 824 2024-09-12T00:18:17.561 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient: _finish_hunting 0 2024-09-12T00:18:17.561 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:18:17.412+0000 7f5872a36640 1 monclient: found mon.noname-c 2024-09-12T00:18:17.561 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:18:17.412+0000 7f5872a36640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.561 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:18:17.412+0000 7f575d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.561 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:18:17.412+0000 7f575d602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:18:17.561 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:18:17.412+0000 7f575d602640 10 monclient: dump: 2024-09-12T00:18:17.561 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.561 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.561 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.561 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.562 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.562 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.562 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.562 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.562 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.562 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.562 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:18:17.412+0000 7f575d602640 10 monclient: _finish_auth 0 2024-09-12T00:18:17.562 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:18:17.412+0000 7f575d602640 10 monclient: _check_auth_tickets 2024-09-12T00:18:17.562 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:18:17.412+0000 7f575d602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:17.562 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:18:17.412+0000 7f575d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.562 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:18:17.413+0000 7f575d602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:18:17.563 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:18:17.413+0000 7f575d602640 10 monclient: dump: 2024-09-12T00:18:17.563 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.563 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.563 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.563 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.563 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.563 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.563 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.563 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.563 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.563 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.564 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:18:17.413+0000 7f5875746800 5 monclient: authenticate success, global_id 6002 2024-09-12T00:18:17.564 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:18:17.413+0000 7f5875746800 10 monclient: _renew_subs 2024-09-12T00:18:17.564 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:18:17.412+0000 7f5874239640 4 set_mon_vals no callback set 2024-09-12T00:18:17.564 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:18:17.413+0000 7f5875746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.564 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:18:17.413+0000 7f5875746800 10 monclient: _renew_subs 2024-09-12T00:18:17.564 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:18:17.413+0000 7f5875746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.564 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:18:17.414+0000 7f575d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:18:17.564 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:18:17.414+0000 7f575d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:17.564 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:18:17.414+0000 7f575d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:17.564 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:18:17.415+0000 7f5873237640 10 monclient: get_auth_request con 0x7f574c076380 auth_method 0 2024-09-12T00:18:17.564 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:18:17.415+0000 7f5875746800 10 monclient: get_monmap_and_config 2024-09-12T00:18:17.565 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:18:17.415+0000 7f5875746800 10 monclient: build_initial_monmap 2024-09-12T00:18:17.565 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:18:17.415+0000 7f5875746800 1 build_initial for_mkfs: 0 2024-09-12T00:18:17.565 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:18:17.415+0000 7f5875746800 10 monclient: monmap: 2024-09-12T00:18:17.565 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:17.565 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:17.565 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:17.565 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:17.565 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:17.565 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.565 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:17.565 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:17.566 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:17.566 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.566 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding auth protocol: cephx 2024-09-12T00:18:17.566 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding auth protocol: cephx 2024-09-12T00:18:17.566 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding auth protocol: cephx 2024-09-12T00:18:17.566 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: secure 2024-09-12T00:18:17.566 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: crc 2024-09-12T00:18:17.566 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: secure 2024-09-12T00:18:17.566 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: crc 2024-09-12T00:18:17.566 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: secure 2024-09-12T00:18:17.567 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: crc 2024-09-12T00:18:17.567 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: crc 2024-09-12T00:18:17.567 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: secure 2024-09-12T00:18:17.567 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: crc 2024-09-12T00:18:17.567 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: secure 2024-09-12T00:18:17.567 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: crc 2024-09-12T00:18:17.567 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x55b8539db4c0) adding con mode: secure 2024-09-12T00:18:17.567 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:18:17.415+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.567 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:18:17.415+0000 7f5875746800 10 monclient: init 2024-09-12T00:18:17.567 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding auth protocol: cephx 2024-09-12T00:18:17.567 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding auth protocol: cephx 2024-09-12T00:18:17.567 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding auth protocol: cephx 2024-09-12T00:18:17.568 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: secure 2024-09-12T00:18:17.568 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: crc 2024-09-12T00:18:17.568 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: secure 2024-09-12T00:18:17.568 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: crc 2024-09-12T00:18:17.568 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: secure 2024-09-12T00:18:17.568 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: crc 2024-09-12T00:18:17.568 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: crc 2024-09-12T00:18:17.568 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: secure 2024-09-12T00:18:17.568 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: crc 2024-09-12T00:18:17.568 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: secure 2024-09-12T00:18:17.569 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: crc 2024-09-12T00:18:17.569 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:18:17.415+0000 7f5875746800 5 AuthRegistry(0x7ffd819eed50) adding con mode: secure 2024-09-12T00:18:17.569 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:18:17.416+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.569 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:18:17.416+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.569 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:18:17.416+0000 7f5875746800 5 asok(0x55b85371f630) register_command rotate-key cmddesc rotate-key hook 0x7ffd819eee98 EEXIST 2024-09-12T00:18:17.569 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:17.569 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:18:17.569 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): picked mon.noname-a con 0x55b853a0fbc0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:17.569 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): picked mon.noname-c con 0x55b8539e0b10 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:17.569 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): picked mon.noname-b con 0x55b853a0b460 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:17.569 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.569 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.570 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.570 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:17.570 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient(hunting): authenticate will time out at 1774.672328s 2024-09-12T00:18:17.570 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:18:17.416+0000 7f5873237640 10 monclient(hunting): get_auth_request con 0x55b853a0fbc0 auth_method 0 2024-09-12T00:18:17.570 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:18:17.416+0000 7f5873237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.570 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:18:17.416+0000 7f5873237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.570 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:18:17.416+0000 7f5873237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.570 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): get_auth_request con 0x55b8539e0b10 auth_method 0 2024-09-12T00:18:17.570 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.570 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.570 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.571 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.571 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.571 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.571 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:18:17.416+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.571 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:18:17.416+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.571 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:18:17.416+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.571 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:18:17.416+0000 7f5873a38640 10 monclient(hunting): get_auth_request con 0x55b853a0b460 auth_method 0 2024-09-12T00:18:17.571 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:18:17.416+0000 7f5873a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.571 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:18:17.416+0000 7f5873a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.571 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:18:17.416+0000 7f5873a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.572 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient(hunting): handle_auth_done global_id 6005 payload 274 2024-09-12T00:18:17.572 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient: _finish_hunting 0 2024-09-12T00:18:17.572 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:18:17.416+0000 7f5872a36640 1 monclient: found mon.noname-c 2024-09-12T00:18:17.572 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:18:17.416+0000 7f5872a36640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.572 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.572 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:18:17.572 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: dump: 2024-09-12T00:18:17.572 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.572 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.572 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.572 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.573 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.573 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.573 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.573 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.573 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.573 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.573 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: _finish_auth 0 2024-09-12T00:18:17.573 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:18:17.573 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:17.573 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.573 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:18:17.573 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:18:17.416+0000 7f5756ffd640 10 monclient: dump: 2024-09-12T00:18:17.574 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.574 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.574 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.574 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.574 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.574 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.574 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.574 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.574 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.574 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.574 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:18:17.416+0000 7f5875746800 5 monclient: authenticate success, global_id 6005 2024-09-12T00:18:17.575 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:18:17.416+0000 7f5875746800 10 monclient: get_monmap_and_config success 2024-09-12T00:18:17.575 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:18:17.416+0000 7f5875746800 4 set_mon_vals no callback set 2024-09-12T00:18:17.575 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:18:17.417+0000 7f5875746800 10 monclient: shutdown 2024-09-12T00:18:17.575 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:18:17.417+0000 7f5875746800 10 monclient: build_initial_monmap 2024-09-12T00:18:17.575 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:18:17.417+0000 7f5875746800 1 build_initial for_mkfs: 0 2024-09-12T00:18:17.575 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:18:17.417+0000 7f5875746800 10 monclient: monmap: 2024-09-12T00:18:17.575 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:17.575 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:17.575 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:17.575 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:17.575 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:17.576 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.576 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:17.576 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:17.576 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:17.576 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.576 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding auth protocol: cephx 2024-09-12T00:18:17.576 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding auth protocol: cephx 2024-09-12T00:18:17.576 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding auth protocol: cephx 2024-09-12T00:18:17.576 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: secure 2024-09-12T00:18:17.576 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: crc 2024-09-12T00:18:17.576 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: secure 2024-09-12T00:18:17.577 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: crc 2024-09-12T00:18:17.577 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: secure 2024-09-12T00:18:17.577 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: crc 2024-09-12T00:18:17.577 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: crc 2024-09-12T00:18:17.577 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: secure 2024-09-12T00:18:17.577 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: crc 2024-09-12T00:18:17.577 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: secure 2024-09-12T00:18:17.577 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: crc 2024-09-12T00:18:17.577 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:18:17.417+0000 7f5875746800 5 AuthRegistry(0x55b8539db470) adding con mode: secure 2024-09-12T00:18:17.577 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:18:17.417+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.577 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:18:17.417+0000 7f5875746800 1 librados: starting msgr at 2024-09-12T00:18:17.578 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:18:17.417+0000 7f5875746800 1 librados: starting objecter 2024-09-12T00:18:17.578 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:18:17.417+0000 7f5875746800 5 asok(0x55b85371f630) register_command objecter_requests cmddesc objecter_requests hook 0x55b8539e0630 EEXIST 2024-09-12T00:18:17.578 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:18:17.418+0000 7f5875746800 1 librados: setting wanted keys 2024-09-12T00:18:17.578 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:18:17.418+0000 7f5875746800 1 librados: calling monclient init 2024-09-12T00:18:17.578 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient: init 2024-09-12T00:18:17.578 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding auth protocol: cephx 2024-09-12T00:18:17.578 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding auth protocol: cephx 2024-09-12T00:18:17.578 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding auth protocol: cephx 2024-09-12T00:18:17.578 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: secure 2024-09-12T00:18:17.578 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: crc 2024-09-12T00:18:17.578 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: secure 2024-09-12T00:18:17.578 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: crc 2024-09-12T00:18:17.579 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: secure 2024-09-12T00:18:17.579 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: crc 2024-09-12T00:18:17.579 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: crc 2024-09-12T00:18:17.579 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: secure 2024-09-12T00:18:17.579 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: crc 2024-09-12T00:18:17.579 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: secure 2024-09-12T00:18:17.579 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: crc 2024-09-12T00:18:17.579 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:18:17.418+0000 7f5875746800 5 AuthRegistry(0x55b8539d0150) adding con mode: secure 2024-09-12T00:18:17.579 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:18:17.418+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.579 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:18:17.418+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.579 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:18:17.418+0000 7f5875746800 5 asok(0x55b85371f630) register_command rotate-key cmddesc rotate-key hook 0x55b8539d0298 EEXIST 2024-09-12T00:18:17.580 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:17.580 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:18:17.580 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): picked mon.noname-c con 0x55b8539e0b10 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:17.580 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): picked mon.noname-a con 0x55b853a0b460 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:17.580 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): picked mon.noname-b con 0x55b853a0fbc0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:17.580 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.580 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.580 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:17.580 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:17.580 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:18:17.418+0000 7f5875746800 10 monclient(hunting): authenticate will time out at 1774.674630s 2024-09-12T00:18:17.580 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:18:17.418+0000 7f5872a36640 10 monclient(hunting): get_auth_request con 0x55b853a0b460 auth_method 0 2024-09-12T00:18:17.581 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:18:17.418+0000 7f5872a36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.581 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:18:17.418+0000 7f5872a36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.581 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:18:17.418+0000 7f5872a36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.581 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): get_auth_request con 0x55b8539e0b10 auth_method 0 2024-09-12T00:18:17.581 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:17.581 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:17.581 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:17.581 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:18:17.418+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.581 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:18:17.418+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.581 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:18:17.418+0000 7f5872a36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.582 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:17.582 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:17.582 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:17.582 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient(hunting): handle_auth_done global_id 6008 payload 824 2024-09-12T00:18:17.582 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient: _finish_hunting 0 2024-09-12T00:18:17.582 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:18:17.418+0000 7f5873237640 1 monclient: found mon.noname-c 2024-09-12T00:18:17.582 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:18:17.418+0000 7f5873237640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.583 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.583 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:18:17.583 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: dump: 2024-09-12T00:18:17.583 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.583 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.583 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.583 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.583 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.583 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.583 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.583 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.584 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.584 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.584 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: _finish_auth 0 2024-09-12T00:18:17.584 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: _check_auth_tickets 2024-09-12T00:18:17.584 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:17.584 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:17.584 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:18:17.584 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:18:17.419+0000 7f57557fa640 10 monclient: dump: 2024-09-12T00:18:17.584 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:17.584 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:17.584 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.584 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:17.585 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:17.585 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:17.585 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:17.585 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:17.585 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:17.585 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.585 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:18:17.419+0000 7f5875746800 5 monclient: authenticate success, global_id 6008 2024-09-12T00:18:17.585 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:18:17.419+0000 7f5875746800 10 monclient: _renew_subs 2024-09-12T00:18:17.585 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:18:17.419+0000 7f5875746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.585 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:18:17.419+0000 7f5756ffd640 4 set_mon_vals no callback set 2024-09-12T00:18:17.585 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:18:17.419+0000 7f5875746800 10 monclient: _renew_subs 2024-09-12T00:18:17.586 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:18:17.419+0000 7f5875746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.586 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:18:17.419+0000 7f5875746800 1 librados: init done 2024-09-12T00:18:17.586 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:18:17.419+0000 7f5875746800 5 asok(0x55b85371f630) register_command cr dump hook 0x55b8539fdf48 2024-09-12T00:18:17.586 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:18:17.420+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.586 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:18:17.421+0000 7f57557fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:18:17.586 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:18:17.421+0000 7f57557fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:17.586 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:18:17.421+0000 7f57557fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:17.586 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:18:17.421+0000 7f5872a36640 10 monclient: get_auth_request con 0x7f573c076470 auth_method 0 2024-09-12T00:18:17.586 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:18:17.421+0000 7f5873a38640 10 monclient: get_auth_request con 0x55b853a2a380 auth_method 0 2024-09-12T00:18:17.586 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:18:17.422+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.586 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:18:17.422+0000 7f5875746800 20 realm 2024-09-12T00:18:17.586 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:18:17.422+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.587 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:18:17.422+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.587 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:18:17.422+0000 7f5875746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:17.587 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:18:17.422+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.587 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:18:17.422+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.587 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:18:17.422+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.587 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:18:17.423+0000 7f5873237640 10 monclient: get_auth_request con 0x55b853a2e5d0 auth_method 0 2024-09-12T00:18:17.587 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:18:17.423+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:17.587 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:18:17.423+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.587 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:18:17.423+0000 7f5872a36640 10 monclient: get_auth_request con 0x55b853a31e30 auth_method 0 2024-09-12T00:18:17.587 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:18:17.424+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:17.587 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:18:17.424+0000 7f5875746800 20 searching for the correct realm 2024-09-12T00:18:17.587 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:18:17.424+0000 7f5873a38640 10 monclient: get_auth_request con 0x7f586809b070 auth_method 0 2024-09-12T00:18:17.588 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:18:17.426+0000 7f5873237640 10 monclient: get_auth_request con 0x7f586407e050 auth_method 0 2024-09-12T00:18:17.588 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:18:17.426+0000 7f5872a36640 10 monclient: get_auth_request con 0x7f5868032030 auth_method 0 2024-09-12T00:18:17.588 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:18:17.427+0000 7f5872a36640 0 -- 172.21.15.67:0/1118657054 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f5868032030 msgr2=0x7f58680327f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:17.588 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:18:17.427+0000 7f57557fa640 1 client.6008.objecter ms_handle_reset 0x7f5868032030 session 0x7f586806cc40 osd.5 2024-09-12T00:18:17.588 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:18:17.427+0000 7f57557fa640 10 monclient: _renew_subs 2024-09-12T00:18:17.588 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:18:17.427+0000 7f57557fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:17.588 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:18:17.427+0000 7f5872a36640 10 monclient: get_auth_request con 0x7f573c086790 auth_method 0 2024-09-12T00:18:17.588 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:18:17.429+0000 7f5873a38640 10 monclient: get_auth_request con 0x7f58640b9950 auth_method 0 2024-09-12T00:18:17.588 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:18:17.430+0000 7f5873237640 10 monclient: get_auth_request con 0x7f586c014030 auth_method 0 2024-09-12T00:18:17.588 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:18:17.430+0000 7f5873a38640 0 -- 172.21.15.67:0/1118657054 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55b853a2a380 msgr2=0x55b853a2c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:17.588 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:18:17.430+0000 7f57557fa640 1 client.6008.objecter ms_handle_reset 0x55b853a2a380 session 0x55b853a29d00 osd.6 2024-09-12T00:18:17.589 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:18:17.431+0000 7f5873a38640 10 monclient: get_auth_request con 0x7f5868032030 auth_method 0 2024-09-12T00:18:17.589 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:17.589 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:17.589 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:17.589 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:17.589 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:17.589 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:18:17.434+0000 7f5875746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:17.589 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:18:17.434+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.589 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:18:17.434+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.590 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:18:17.434+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.590 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:18:17.435+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:17.590 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:18:17.435+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.590 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:18:17.435+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:17.590 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:18:17.435+0000 7f5875746800 20 zone default found 2024-09-12T00:18:17.590 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:18:17.435+0000 7f5875746800 4 Realm: () 2024-09-12T00:18:17.590 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:18:17.435+0000 7f5875746800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:17.590 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:18:17.435+0000 7f5875746800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:17.590 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:18:17.435+0000 7f5875746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:17.590 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:18:17.435+0000 7f5875746800 20 zonegroup default 2024-09-12T00:18:17.590 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:18:17.435+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.591 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:18:17.435+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.591 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:18:17.435+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.591 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:18:17.436+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.591 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:18:17.436+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.591 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:18:17.436+0000 7f5875746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.591 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:18:17.436+0000 7f5875746800 20 started sync module instance, tier type = 2024-09-12T00:18:17.591 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:18:17.436+0000 7f5875746800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:17.591 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=0 2024-09-12T00:18:17.591 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=1 2024-09-12T00:18:17.591 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=2 2024-09-12T00:18:17.591 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=3 2024-09-12T00:18:17.591 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=4 2024-09-12T00:18:17.592 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=5 2024-09-12T00:18:17.592 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=6 2024-09-12T00:18:17.592 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:18:17.444+0000 7f5875746800 20 add_watcher() i=7 2024-09-12T00:18:17.592 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:18:17.444+0000 7f5875746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:17.592 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding auth protocol: cephx 2024-09-12T00:18:17.592 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding auth protocol: cephx 2024-09-12T00:18:17.592 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding auth protocol: cephx 2024-09-12T00:18:17.592 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: secure 2024-09-12T00:18:17.592 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: crc 2024-09-12T00:18:17.592 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: secure 2024-09-12T00:18:17.593 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: crc 2024-09-12T00:18:17.593 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: secure 2024-09-12T00:18:17.593 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: crc 2024-09-12T00:18:17.593 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: crc 2024-09-12T00:18:17.593 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: secure 2024-09-12T00:18:17.593 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: crc 2024-09-12T00:18:17.593 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: secure 2024-09-12T00:18:17.593 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: crc 2024-09-12T00:18:17.593 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:18:17.446+0000 7f5875746800 5 AuthRegistry(0x7ffd819ef230) adding con mode: secure 2024-09-12T00:18:17.593 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:18:17.446+0000 7f5729fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:17.593 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:18:17.446+0000 7f5875746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:17.593 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:18:17.446+0000 7f5875746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:17.594 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:18:17.446+0000 7f5875746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:17.594 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:18:17.446+0000 7f5875746800 5 asok(0x55b85371f630) register_command cache list hook 0x55b8539fd930 2024-09-12T00:18:17.594 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:18:17.446+0000 7f5875746800 5 asok(0x55b85371f630) register_command cache inspect hook 0x55b8539fd930 2024-09-12T00:18:17.594 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:18:17.446+0000 7f5875746800 5 asok(0x55b85371f630) register_command cache erase hook 0x55b8539fd930 2024-09-12T00:18:17.594 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:18:17.446+0000 7f5875746800 5 asok(0x55b85371f630) register_command cache zap hook 0x55b8539fd930 2024-09-12T00:18:17.594 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:18:17.447+0000 7f5875746800 5 note: GC not initialized 2024-09-12T00:18:17.594 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:18:17.447+0000 7f5728fe1640 20 reqs_thread_entry: start 2024-09-12T00:18:17.594 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:18:17.447+0000 7f5875746800 5 asok(0x55b85371f630) register_command sync trace show hook 0x7f586c005470 2024-09-12T00:18:17.594 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:18:17.447+0000 7f5875746800 5 asok(0x55b85371f630) register_command sync trace history hook 0x7f586c005470 2024-09-12T00:18:17.594 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:18:17.447+0000 7f5875746800 5 asok(0x55b85371f630) register_command sync trace active hook 0x7f586c005470 2024-09-12T00:18:17.594 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:18:17.447+0000 7f5875746800 5 asok(0x55b85371f630) register_command sync trace active_short hook 0x7f586c005470 2024-09-12T00:18:17.594 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:18:17.447+0000 7f5875746800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:17.595 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:18:17.447+0000 7f5875746800 20 Filter name: none 2024-09-12T00:18:17.595 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:18:17.447+0000 7f56a27fc640 20 reqs_thread_entry: start 2024-09-12T00:18:17.595 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:18:17.447+0000 7f5875746800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:18:17.595 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:18:17.447+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.595 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:18:17.447+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:18:17.595 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:18:17.447+0000 7f5875746800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:18:17.595 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:18:17.448+0000 7f5875746800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:18:17.595 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:18:17.448+0000 7f5875746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 : miss 2024-09-12T00:18:17.595 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:18:17.448+0000 7f5875746800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.595 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:18:17.448+0000 7f5875746800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:18:17.595 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:18:17.448+0000 7f5875746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 info.flags=0x17 2024-09-12T00:18:17.596 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:18:17.448+0000 7f5875746800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 to cache LRU end 2024-09-12T00:18:17.596 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:18:17.448+0000 7f5875746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:17.596 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:18:17.448+0000 7f5875746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:17.596 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:18:17.448+0000 7f5875746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 2024-09-12T00:18:17.596 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:18:17.450+0000 7f5875746800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5875746800 time 2024-09-12T00:18:17.450019+0000 2024-09-12T00:18:17.596 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:18:17.596 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.596 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:17.596 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5878d8c71a] 2024-09-12T00:18:17.596 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5878d8c8d8] 2024-09-12T00:18:17.596 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b851783641] 2024-09-12T00:18:17.597 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd877a4) [0x55b851c957a4] 2024-09-12T00:18:17.597 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85179331d] 2024-09-12T00:18:17.597 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:18:17.597 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5877a29590] 2024-09-12T00:18:17.597 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:18:17.597 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:18:17.597 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.597 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:18:17.451+0000 7f5875746800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:18:17.597 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f5875746800 thread_name:radosgw-admin 2024-09-12T00:18:17.597 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.598 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:17.598 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5877a3e6f0] 2024-09-12T00:18:17.598 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5877a8b99c] 2024-09-12T00:18:17.598 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:18:17.598 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:18:17.598 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5878d8c774] 2024-09-12T00:18:17.598 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5878d8c8d8] 2024-09-12T00:18:17.598 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b851783641] 2024-09-12T00:18:17.598 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd877a4) [0x55b851c957a4] 2024-09-12T00:18:17.598 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85179331d] 2024-09-12T00:18:17.599 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:18:17.599 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5877a29590] 2024-09-12T00:18:17.599 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:18:17.599 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:18:17.599 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:18:17.599 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.599 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:18:17.599 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:18:17.599 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:18:17.599 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:18:17.600 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:18:17.600 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:18:17.600 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:18:17.600 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:18:17.600 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:18:17.600 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:18:17.600 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:18:17.600 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:18:17.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:18:17.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:18:17.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:18:17.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:18:17.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:18:17.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:18:17.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:18:17.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:18:17.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:18:17.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:18:17.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:18:17.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:18:17.602 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:18:17.602 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:18:17.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:18:17.602 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:18:17.602 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:18:17.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:18:17.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:18:17.602 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:18:17.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:18:17.602 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:18:17.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:18:17.602 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:18:17.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:18:17.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:18:17.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:18:17.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:18:17.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:18:17.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:18:17.603 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:18:17.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:18:17.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:18:17.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:18:17.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:18:17.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:18:17.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:18:17.604 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:18:17.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:18:17.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:18:17.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:18:17.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:18:17.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:18:17.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:18:17.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:18:17.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:18:17.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:18:17.605 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:18:17.605 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:18:17.605 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:18:17.605 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:18:17.605 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:18:17.605 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:18:17.605 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:18:17.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:18:17.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:18:17.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:18:17.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:18:17.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:18:17.606 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:18:17.606 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:18:17.606 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:18:17.606 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:18:17.606 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:18:17.606 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:18:17.606 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:18:17.606 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:18:17.606 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:18:17.606 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:18:17.606 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:18:17.607 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:18:17.607 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:18:17.607 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:18:17.607 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:18:17.607 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:18:17.607 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:18:17.607 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:18:17.607 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:18:17.607 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:18:17.607 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:18:17.607 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:18:17.608 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:18:17.608 INFO:tasks.workunit.client.0.smithi067.stderr: 7f56a27fc640 / http_manager 2024-09-12T00:18:17.608 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5728fe1640 / http_manager 2024-09-12T00:18:17.608 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5729fe3640 / rgw_dt_lg_renew 2024-09-12T00:18:17.608 INFO:tasks.workunit.client.0.smithi067.stderr: 7f57557fa640 / ms_dispatch 2024-09-12T00:18:17.608 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5756ffd640 / io_context_pool 2024-09-12T00:18:17.608 INFO:tasks.workunit.client.0.smithi067.stderr: 7f575d602640 / ms_dispatch 2024-09-12T00:18:17.608 INFO:tasks.workunit.client.0.smithi067.stderr: 7f575fe07640 / ms_dispatch 2024-09-12T00:18:17.608 INFO:tasks.workunit.client.0.smithi067.stderr: 7f576160a640 / io_context_pool 2024-09-12T00:18:17.608 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5872a36640 / msgr-worker-2 2024-09-12T00:18:17.608 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5873237640 / msgr-worker-1 2024-09-12T00:18:17.609 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5873a38640 / msgr-worker-0 2024-09-12T00:18:17.609 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5874239640 / io_context_pool 2024-09-12T00:18:17.609 INFO:tasks.workunit.client.0.smithi067.stderr: 7f5875746800 / radosgw-admin 2024-09-12T00:18:17.609 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:18:17.609 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:18:17.609 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:18:17.451688Z_6082bd57-aa8c-46a7-a2d9-de4b4bb77635/log 2024-09-12T00:18:17.609 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:18:17.609 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:18:17.611 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:17.611 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:17.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.529+0000 7f951313d800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.531+0000 7f951313d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.531+0000 7f951313d800 20 realm 2024-09-12T00:18:17.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.531+0000 7f951313d800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.532+0000 7f951313d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.532+0000 7f951313d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:17.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.532+0000 7f951313d800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.532+0000 7f951313d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.532+0000 7f951313d800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.533+0000 7f951313d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:17.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.533+0000 7f951313d800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.533+0000 7f951313d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:17.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.533+0000 7f951313d800 20 searching for the correct realm 2024-09-12T00:18:17.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.536+0000 7f950e629640 0 -- 172.21.15.67:0/598354848 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f9504081c20 msgr2=0x7f9504098810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:17.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.742+0000 7f950f62b640 0 -- 172.21.15.67:0/598354848 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x559860411e40 msgr2=0x559860414230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:17.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.746+0000 7f951313d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:17.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.746+0000 7f951313d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:17.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.746+0000 7f951313d800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:17.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.746+0000 7f951313d800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:17.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.746+0000 7f951313d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:17.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.746+0000 7f951313d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:17.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.746+0000 7f951313d800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.746+0000 7f951313d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.746+0000 7f951313d800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.747+0000 7f951313d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:17.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.747+0000 7f951313d800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.747+0000 7f951313d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:17.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.747+0000 7f951313d800 20 zone default found 2024-09-12T00:18:17.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.747+0000 7f951313d800 4 Realm: () 2024-09-12T00:18:17.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.747+0000 7f951313d800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:17.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.747+0000 7f951313d800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:17.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.747+0000 7f951313d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:17.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.747+0000 7f951313d800 20 zonegroup default 2024-09-12T00:18:17.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.747+0000 7f951313d800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.747+0000 7f951313d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.747+0000 7f951313d800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.748+0000 7f951313d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.748+0000 7f951313d800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.748+0000 7f951313d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.748+0000 7f951313d800 20 started sync module instance, tier type = 2024-09-12T00:18:17.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.748+0000 7f951313d800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:17.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.756+0000 7f951313d800 20 add_watcher() i=0 2024-09-12T00:18:17.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.756+0000 7f951313d800 20 add_watcher() i=1 2024-09-12T00:18:17.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.756+0000 7f951313d800 20 add_watcher() i=2 2024-09-12T00:18:17.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.756+0000 7f951313d800 20 add_watcher() i=3 2024-09-12T00:18:17.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.756+0000 7f951313d800 20 add_watcher() i=4 2024-09-12T00:18:17.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.756+0000 7f951313d800 20 add_watcher() i=5 2024-09-12T00:18:17.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.756+0000 7f951313d800 20 add_watcher() i=6 2024-09-12T00:18:17.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.757+0000 7f951313d800 20 add_watcher() i=7 2024-09-12T00:18:17.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.757+0000 7f951313d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:17.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.759+0000 7f93c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.759+0000 7f951313d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.759+0000 7f951313d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.759+0000 7f951313d800 5 note: GC not initialized 2024-09-12T00:18:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.759+0000 7f933ffff640 20 reqs_thread_entry: start 2024-09-12T00:18:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.759+0000 7f951313d800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.760+0000 7f951313d800 20 Filter name: none 2024-09-12T00:18:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.760+0000 7f933dffb640 20 reqs_thread_entry: start 2024-09-12T00:18:17.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.760+0000 7f951313d800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.760+0000 7f951313d800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:18:17.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.760+0000 7f951313d800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.760+0000 7f951313d800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:18:17.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.760+0000 7f951313d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:17.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.760+0000 7f951313d800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.761+0000 7f951313d800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:18:17.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.761+0000 7f951313d800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.761+0000 7f951313d800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:18:17.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.761+0000 7f951313d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:17.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.762+0000 7f93c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:17.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.765+0000 7f951313d800 20 remove_watcher() i=0 2024-09-12T00:18:17.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.765+0000 7f951313d800 2 removed watcher, disabling cache 2024-09-12T00:18:17.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.766+0000 7f951313d800 20 remove_watcher() i=1 2024-09-12T00:18:17.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.766+0000 7f951313d800 20 remove_watcher() i=2 2024-09-12T00:18:17.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.767+0000 7f951313d800 20 remove_watcher() i=3 2024-09-12T00:18:17.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.768+0000 7f951313d800 20 remove_watcher() i=4 2024-09-12T00:18:17.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.769+0000 7f951313d800 20 remove_watcher() i=5 2024-09-12T00:18:17.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.770+0000 7f951313d800 20 remove_watcher() i=6 2024-09-12T00:18:17.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.771+0000 7f951313d800 20 remove_watcher() i=7 2024-09-12T00:18:17.780 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.781 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:17.781 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-init-indext id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:18:17.781 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:17.833 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:18:17.867 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:17.867 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:17.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.908+0000 7fed2400e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.910+0000 7fed2400e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.910+0000 7fed2400e800 20 realm 2024-09-12T00:18:17.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.910+0000 7fed2400e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.911+0000 7fed2400e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.911+0000 7fed2400e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:17.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.911+0000 7fed2400e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.911+0000 7fed2400e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:17.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.911+0000 7fed2400e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.911+0000 7fed2400e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:17.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.911+0000 7fed2400e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:17.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.913+0000 7fed2400e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:17.911 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.913+0000 7fed2400e800 20 searching for the correct realm 2024-09-12T00:18:17.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:17.915+0000 7fed1ee58640 0 -- 172.21.15.67:0/622208272 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fed140b70f0 msgr2=0x7fed140b77d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:18.119 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.121+0000 7fed1fe5a640 0 -- 172.21.15.67:0/622208272 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55cba3efa1f0 msgr2=0x55cba3efc660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:18.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.125+0000 7fed2400e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:18.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.125+0000 7fed2400e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:18.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.125+0000 7fed2400e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:18.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.125+0000 7fed2400e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:18.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.125+0000 7fed2400e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:18.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.125+0000 7fed2400e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:18.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.125+0000 7fed2400e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:18.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.125+0000 7fed2400e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:18.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.125+0000 7fed2400e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:18.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.126+0000 7fed2400e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:18.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.126+0000 7fed2400e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:18.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.126+0000 7fed2400e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:18.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.126+0000 7fed2400e800 20 zone default found 2024-09-12T00:18:18.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.126+0000 7fed2400e800 4 Realm: () 2024-09-12T00:18:18.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.126+0000 7fed2400e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:18.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.126+0000 7fed2400e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:18.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.126+0000 7fed2400e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:18.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.126+0000 7fed2400e800 20 zonegroup default 2024-09-12T00:18:18.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.126+0000 7fed2400e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:18.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.126+0000 7fed2400e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:18.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.126+0000 7fed2400e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:18.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.127+0000 7fed2400e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:18.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.127+0000 7fed2400e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:18.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.127+0000 7fed2400e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:18.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.127+0000 7fed2400e800 20 started sync module instance, tier type = 2024-09-12T00:18:18.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.127+0000 7fed2400e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:18.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.135+0000 7fed2400e800 20 add_watcher() i=0 2024-09-12T00:18:18.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.135+0000 7fed2400e800 20 add_watcher() i=1 2024-09-12T00:18:18.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.135+0000 7fed2400e800 20 add_watcher() i=2 2024-09-12T00:18:18.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.135+0000 7fed2400e800 20 add_watcher() i=3 2024-09-12T00:18:18.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.135+0000 7fed2400e800 20 add_watcher() i=4 2024-09-12T00:18:18.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.135+0000 7fed2400e800 20 add_watcher() i=5 2024-09-12T00:18:18.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.135+0000 7fed2400e800 20 add_watcher() i=6 2024-09-12T00:18:18.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.136+0000 7fed2400e800 20 add_watcher() i=7 2024-09-12T00:18:18.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.136+0000 7fed2400e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:18.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.138+0000 7febd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:18.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.139+0000 7fed2400e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:18.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.139+0000 7fed2400e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:18.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.139+0000 7fed2400e800 5 note: GC not initialized 2024-09-12T00:18:18.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.139+0000 7febd4fe1640 20 reqs_thread_entry: start 2024-09-12T00:18:18.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.139+0000 7fed2400e800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:18.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.139+0000 7fed2400e800 20 Filter name: none 2024-09-12T00:18:18.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.139+0000 7feb4e7fc640 20 reqs_thread_entry: start 2024-09-12T00:18:18.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.139+0000 7fed2400e800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:18:18.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.139+0000 7fed2400e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:18.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.140+0000 7fed2400e800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:18:18.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.140+0000 7fed2400e800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:18:18.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.140+0000 7fed2400e800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:18:18.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.140+0000 7fed2400e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 : miss 2024-09-12T00:18:18.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.140+0000 7fed2400e800 20 rados->read ofs=0 len=0 2024-09-12T00:18:18.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.140+0000 7fed2400e800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:18:18.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.140+0000 7fed2400e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 info.flags=0x17 2024-09-12T00:18:18.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.140+0000 7fed2400e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 to cache LRU end 2024-09-12T00:18:18.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.140+0000 7fed2400e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:18.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.140+0000 7fed2400e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:18.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.140+0000 7fed2400e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 2024-09-12T00:18:18.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.142+0000 7fed2400e800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 to be held by another RGW process; skipping for now 2024-09-12T00:18:18.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.143+0000 7febd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:18.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.145+0000 7fed2400e800 20 remove_watcher() i=0 2024-09-12T00:18:18.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.145+0000 7fed2400e800 2 removed watcher, disabling cache 2024-09-12T00:18:18.144 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.146+0000 7fed2400e800 20 remove_watcher() i=1 2024-09-12T00:18:18.145 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.147+0000 7fed2400e800 20 remove_watcher() i=2 2024-09-12T00:18:18.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.148+0000 7fed2400e800 20 remove_watcher() i=3 2024-09-12T00:18:18.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.149+0000 7fed2400e800 20 remove_watcher() i=4 2024-09-12T00:18:18.148 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.150+0000 7fed2400e800 20 remove_watcher() i=5 2024-09-12T00:18:18.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.151+0000 7fed2400e800 20 remove_watcher() i=6 2024-09-12T00:18:18.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:18.152+0000 7fed2400e800 20 remove_watcher() i=7 2024-09-12T00:18:18.162 INFO:tasks.workunit.client.0.smithi067.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:18:48.174 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:18:48.210 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:48.211 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:48.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.257+0000 7f85bfa10800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.259+0000 7f85bfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:48.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.259+0000 7f85bfa10800 20 realm 2024-09-12T00:18:48.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.259+0000 7f85bfa10800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.260+0000 7f85bfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:48.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.260+0000 7f85bfa10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:48.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.260+0000 7f85bfa10800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.260+0000 7f85bfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:48.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.260+0000 7f85bfa10800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.261+0000 7f85bfa10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:48.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.261+0000 7f85bfa10800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.262+0000 7f85bfa10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:48.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.262+0000 7f85bfa10800 20 searching for the correct realm 2024-09-12T00:18:48.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.266+0000 7f85ba9bb640 0 -- 172.21.15.67:0/3283210162 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f85b0067230 msgr2=0x7f85b006c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:48.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.271+0000 7f85ba9bb640 0 -- 172.21.15.67:0/3283210162 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x56491fae7e50 msgr2=0x56491faea260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:48.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.275+0000 7f85bfa10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:48.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.275+0000 7f85bfa10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:48.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.275+0000 7f85bfa10800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:48.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.275+0000 7f85bfa10800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:48.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.275+0000 7f85bfa10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:48.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.275+0000 7f85bfa10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:48.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.276+0000 7f85bfa10800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.276+0000 7f85bfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:48.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.276+0000 7f85bfa10800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.276+0000 7f85bfa10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:48.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.276+0000 7f85bfa10800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.277+0000 7f85bfa10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:48.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.277+0000 7f85bfa10800 20 zone default found 2024-09-12T00:18:48.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.277+0000 7f85bfa10800 4 Realm: () 2024-09-12T00:18:48.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.277+0000 7f85bfa10800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:48.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.277+0000 7f85bfa10800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:48.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.277+0000 7f85bfa10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:48.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.277+0000 7f85bfa10800 20 zonegroup default 2024-09-12T00:18:48.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.277+0000 7f85bfa10800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.277+0000 7f85bfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:48.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.277+0000 7f85bfa10800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.277+0000 7f85bfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:48.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.277+0000 7f85bfa10800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.278+0000 7f85bfa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:48.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.278+0000 7f85bfa10800 20 started sync module instance, tier type = 2024-09-12T00:18:48.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.278+0000 7f85bfa10800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:48.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.288+0000 7f85bfa10800 20 add_watcher() i=0 2024-09-12T00:18:48.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.288+0000 7f85bfa10800 20 add_watcher() i=1 2024-09-12T00:18:48.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.288+0000 7f85bfa10800 20 add_watcher() i=2 2024-09-12T00:18:48.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.288+0000 7f85bfa10800 20 add_watcher() i=3 2024-09-12T00:18:48.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.288+0000 7f85bfa10800 20 add_watcher() i=4 2024-09-12T00:18:48.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.288+0000 7f85bfa10800 20 add_watcher() i=5 2024-09-12T00:18:48.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.288+0000 7f85bfa10800 20 add_watcher() i=6 2024-09-12T00:18:48.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.289+0000 7f85bfa10800 20 add_watcher() i=7 2024-09-12T00:18:48.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.289+0000 7f85bfa10800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:48.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.291+0000 7f8471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:48.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.292+0000 7f85bfa10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:48.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.292+0000 7f85bfa10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:48.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.292+0000 7f85bfa10800 5 note: GC not initialized 2024-09-12T00:18:48.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.292+0000 7f8470fe1640 20 reqs_thread_entry: start 2024-09-12T00:18:48.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.292+0000 7f85bfa10800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:48.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.292+0000 7f85bfa10800 20 Filter name: none 2024-09-12T00:18:48.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.292+0000 7f83ea7fc640 20 reqs_thread_entry: start 2024-09-12T00:18:48.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.292+0000 7f85bfa10800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:18:48.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.292+0000 7f85bfa10800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.293+0000 7f85bfa10800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:18:48.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.293+0000 7f85bfa10800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:18:48.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.293+0000 7f85bfa10800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:18:48.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.293+0000 7f85bfa10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 : miss 2024-09-12T00:18:48.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.293+0000 7f85bfa10800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.293+0000 7f85bfa10800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:18:48.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.293+0000 7f85bfa10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 info.flags=0x17 2024-09-12T00:18:48.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.293+0000 7f85bfa10800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 to cache LRU end 2024-09-12T00:18:48.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.293+0000 7f85bfa10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:48.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.293+0000 7f85bfa10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:48.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.293+0000 7f85bfa10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 2024-09-12T00:18:48.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.298+0000 7f85bfa10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 info.flags=0x17 2024-09-12T00:18:48.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.298+0000 7f85bfa10800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 to cache LRU end 2024-09-12T00:18:48.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.298+0000 7f85bfa10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:48.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.298+0000 7f85bfa10800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21, ofs0, ns] 2024-09-12T00:18:48.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.298+0000 7f849effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562469 cookie 94872064137312 notifier 6435 bl.length()=913 2024-09-12T00:18:48.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.298+0000 7f849effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 info.flags=0x17 2024-09-12T00:18:48.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.298+0000 7f849effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 to cache LRU end 2024-09-12T00:18:48.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.298+0000 7f849effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:48.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.298+0000 7f85bfa10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21]): orig_sources= new_sources= 2024-09-12T00:18:48.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.298+0000 7f85bfa10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21]): potential sources added=[] removed=[] 2024-09-12T00:18:48.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.298+0000 7f85bfa10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21]): orig_dests= new_dests= 2024-09-12T00:18:48.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.298+0000 7f85bfa10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21]): potential dests added=[] removed=[] 2024-09-12T00:18:48.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.301+0000 7f85bfa10800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21.1.0 2024-09-12T00:18:48.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.301+0000 7f85bfa10800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21.1.0 2024-09-12T00:18:48.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.301+0000 7f85bfa10800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21.1.1 2024-09-12T00:18:48.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.301+0000 7f85bfa10800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21.1.1 2024-09-12T00:18:48.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.301+0000 7f85bfa10800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21.0 2024-09-12T00:18:48.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.304+0000 7f85bfa10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:18:48.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.304+0000 7f85bfa10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 2024-09-12T00:18:48.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.305+0000 7f85bfa10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 info.flags=0x17 2024-09-12T00:18:48.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.305+0000 7f85bfa10800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 to cache LRU end 2024-09-12T00:18:48.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.305+0000 7f85bfa10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:48.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.305+0000 7f85bfa10800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21, ofs0, ns] 2024-09-12T00:18:48.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.305+0000 7f849e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562470 cookie 94872064137312 notifier 6435 bl.length()=913 2024-09-12T00:18:48.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.305+0000 7f849e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 info.flags=0x17 2024-09-12T00:18:48.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.305+0000 7f849e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 to cache LRU end 2024-09-12T00:18:48.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.305+0000 7f849e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:48.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.306+0000 7f85bfa10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21]): orig_sources= new_sources= 2024-09-12T00:18:48.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.306+0000 7f85bfa10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21]): potential sources added=[] removed=[] 2024-09-12T00:18:48.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.306+0000 7f85bfa10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21]): orig_dests= new_dests= 2024-09-12T00:18:48.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.306+0000 7f85bfa10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21]): potential dests added=[] removed=[] 2024-09-12T00:18:48.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.307+0000 7f85bfa10800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21.0 2024-09-12T00:18:48.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.308+0000 7f85bfa10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:18:48.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.308+0000 7f85bfa10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 2024-09-12T00:18:48.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.309+0000 7f85bfa10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 info.flags=0x17 2024-09-12T00:18:48.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.309+0000 7f85bfa10800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 to cache LRU end 2024-09-12T00:18:48.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.309+0000 7f85bfa10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:48.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.309+0000 7f85bfa10800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21, ofs0, ns] 2024-09-12T00:18:48.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.309+0000 7f849e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562471 cookie 94872064137312 notifier 6435 bl.length()=881 2024-09-12T00:18:48.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.309+0000 7f849e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 info.flags=0x17 2024-09-12T00:18:48.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.309+0000 7f849e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 to cache LRU end 2024-09-12T00:18:48.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.309+0000 7f849e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:48.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.310+0000 7f85bfa10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21]): orig_sources= new_sources= 2024-09-12T00:18:48.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.310+0000 7f85bfa10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21]): potential sources added=[] removed=[] 2024-09-12T00:18:48.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.310+0000 7f85bfa10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21]): orig_dests= new_dests= 2024-09-12T00:18:48.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.310+0000 7f85bfa10800 20 handle_bi_update(): bucket=:abort-at-init-indext[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21]): potential dests added=[] removed=[] 2024-09-12T00:18:48.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.311+0000 7f85bfa10800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 1 shards to 2 shards completed successfully 2024-09-12T00:18:48.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.313+0000 7f8471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:48.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.315+0000 7f85bfa10800 20 remove_watcher() i=0 2024-09-12T00:18:48.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.315+0000 7f85bfa10800 2 removed watcher, disabling cache 2024-09-12T00:18:48.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.317+0000 7f85bfa10800 20 remove_watcher() i=1 2024-09-12T00:18:48.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.318+0000 7f85bfa10800 20 remove_watcher() i=2 2024-09-12T00:18:48.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.319+0000 7f85bfa10800 20 remove_watcher() i=3 2024-09-12T00:18:48.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.320+0000 7f85bfa10800 20 remove_watcher() i=4 2024-09-12T00:18:48.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.321+0000 7f85bfa10800 20 remove_watcher() i=5 2024-09-12T00:18:48.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.322+0000 7f85bfa10800 20 remove_watcher() i=6 2024-09-12T00:18:48.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.323+0000 7f85bfa10800 20 remove_watcher() i=7 2024-09-12T00:18:48.335 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:18:48.365 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:48.365 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:48.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.405+0000 7ff9ae812800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.407+0000 7ff9ae812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:48.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.407+0000 7ff9ae812800 20 realm 2024-09-12T00:18:48.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.407+0000 7ff9ae812800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.407+0000 7ff9ae812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:48.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.407+0000 7ff9ae812800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:48.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.407+0000 7ff9ae812800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.407+0000 7ff9ae812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:48.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.407+0000 7ff9ae812800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.408+0000 7ff9ae812800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:48.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.408+0000 7ff9ae812800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.409+0000 7ff9ae812800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:48.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.409+0000 7ff9ae812800 20 searching for the correct realm 2024-09-12T00:18:48.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.411+0000 7ff9a96ca640 0 -- 172.21.15.67:0/3835025149 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7ff99404d150 msgr2=0x7ff9940660c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:48.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.616+0000 7ff9aa6cc640 0 -- 172.21.15.67:0/3835025149 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55ee91611430 msgr2=0x55ee916138d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:48.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.621+0000 7ff9ae812800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:48.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.621+0000 7ff9ae812800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:48.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.621+0000 7ff9ae812800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:48.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.621+0000 7ff9ae812800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:48.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.621+0000 7ff9ae812800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:48.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.621+0000 7ff9ae812800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:48.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.621+0000 7ff9ae812800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.621+0000 7ff9ae812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:48.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.621+0000 7ff9ae812800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.621+0000 7ff9ae812800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:48.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.621+0000 7ff9ae812800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.622+0000 7ff9ae812800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:48.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.622+0000 7ff9ae812800 20 zone default found 2024-09-12T00:18:48.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.622+0000 7ff9ae812800 4 Realm: () 2024-09-12T00:18:48.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.622+0000 7ff9ae812800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:48.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.622+0000 7ff9ae812800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:48.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.622+0000 7ff9ae812800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:48.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.622+0000 7ff9ae812800 20 zonegroup default 2024-09-12T00:18:48.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.622+0000 7ff9ae812800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.622+0000 7ff9ae812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:48.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.622+0000 7ff9ae812800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.622+0000 7ff9ae812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:48.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.622+0000 7ff9ae812800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.623+0000 7ff9ae812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:48.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.623+0000 7ff9ae812800 20 started sync module instance, tier type = 2024-09-12T00:18:48.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.623+0000 7ff9ae812800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:48.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.632+0000 7ff9ae812800 20 add_watcher() i=0 2024-09-12T00:18:48.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.632+0000 7ff9ae812800 20 add_watcher() i=1 2024-09-12T00:18:48.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.632+0000 7ff9ae812800 20 add_watcher() i=2 2024-09-12T00:18:48.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.632+0000 7ff9ae812800 20 add_watcher() i=3 2024-09-12T00:18:48.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.632+0000 7ff9ae812800 20 add_watcher() i=4 2024-09-12T00:18:48.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.632+0000 7ff9ae812800 20 add_watcher() i=5 2024-09-12T00:18:48.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.632+0000 7ff9ae812800 20 add_watcher() i=6 2024-09-12T00:18:48.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.633+0000 7ff9ae812800 20 add_watcher() i=7 2024-09-12T00:18:48.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.633+0000 7ff9ae812800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:48.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.635+0000 7ff85b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:48.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.635+0000 7ff9ae812800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:48.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.635+0000 7ff9ae812800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:48.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.635+0000 7ff9ae812800 5 note: GC not initialized 2024-09-12T00:18:48.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.636+0000 7ff85a7fc640 20 reqs_thread_entry: start 2024-09-12T00:18:48.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.636+0000 7ff9ae812800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:48.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.636+0000 7ff9ae812800 20 Filter name: none 2024-09-12T00:18:48.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.636+0000 7ff7cffff640 20 reqs_thread_entry: start 2024-09-12T00:18:48.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.636+0000 7ff9ae812800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.636+0000 7ff9ae812800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:18:48.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.636+0000 7ff9ae812800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.637+0000 7ff9ae812800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:18:48.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.637+0000 7ff9ae812800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:48.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.637+0000 7ff9ae812800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.637+0000 7ff9ae812800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:18:48.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.637+0000 7ff9ae812800 20 rados->read ofs=0 len=0 2024-09-12T00:18:48.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.638+0000 7ff9ae812800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:18:48.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.638+0000 7ff9ae812800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:48.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.639+0000 7ff85b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:48.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.641+0000 7ff9ae812800 20 remove_watcher() i=0 2024-09-12T00:18:48.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.641+0000 7ff9ae812800 2 removed watcher, disabling cache 2024-09-12T00:18:48.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.642+0000 7ff9ae812800 20 remove_watcher() i=1 2024-09-12T00:18:48.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.643+0000 7ff9ae812800 20 remove_watcher() i=2 2024-09-12T00:18:48.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.644+0000 7ff9ae812800 20 remove_watcher() i=3 2024-09-12T00:18:48.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.645+0000 7ff9ae812800 20 remove_watcher() i=4 2024-09-12T00:18:48.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.647+0000 7ff9ae812800 20 remove_watcher() i=5 2024-09-12T00:18:48.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.648+0000 7ff9ae812800 20 remove_watcher() i=6 2024-09-12T00:18:48.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:48.649+0000 7ff9ae812800 20 remove_watcher() i=7 2024-09-12T00:18:48.661 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:48.661 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:48.662 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-init-indext id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:18:48.662 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:48.724 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T00:18:48.724 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:48.937 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:18:48.966 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:48.966 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:49.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.006+0000 7fe459213800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.007+0000 7fe459213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.007+0000 7fe459213800 20 realm 2024-09-12T00:18:49.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.007+0000 7fe459213800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.008+0000 7fe459213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.008+0000 7fe459213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:49.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.008+0000 7fe459213800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.008+0000 7fe459213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.008+0000 7fe459213800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.008+0000 7fe459213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:49.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.009+0000 7fe459213800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.009+0000 7fe459213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:49.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.009+0000 7fe459213800 20 searching for the correct realm 2024-09-12T00:18:49.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.012+0000 7fe44ffff640 0 -- 172.21.15.67:0/3876030943 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fe44000e070 msgr2=0x7fe44005f350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:49.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.217+0000 7fe44ffff640 0 -- 172.21.15.67:0/3876030943 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x562a1013ea80 msgr2=0x562a10140eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:49.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.221+0000 7fe459213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:49.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.221+0000 7fe459213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:49.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.221+0000 7fe459213800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:49.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.221+0000 7fe459213800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:49.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.221+0000 7fe459213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:49.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.221+0000 7fe459213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:49.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.221+0000 7fe459213800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.221+0000 7fe459213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.221+0000 7fe459213800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.222+0000 7fe459213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:49.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.222+0000 7fe459213800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.222+0000 7fe459213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:49.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.222+0000 7fe459213800 20 zone default found 2024-09-12T00:18:49.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.222+0000 7fe459213800 4 Realm: () 2024-09-12T00:18:49.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.222+0000 7fe459213800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:49.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.222+0000 7fe459213800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:49.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.222+0000 7fe459213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:49.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.222+0000 7fe459213800 20 zonegroup default 2024-09-12T00:18:49.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.222+0000 7fe459213800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.222+0000 7fe459213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.222+0000 7fe459213800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.222+0000 7fe459213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.222+0000 7fe459213800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.223+0000 7fe459213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.223+0000 7fe459213800 20 started sync module instance, tier type = 2024-09-12T00:18:49.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.223+0000 7fe459213800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:49.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.231+0000 7fe459213800 20 add_watcher() i=0 2024-09-12T00:18:49.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.231+0000 7fe459213800 20 add_watcher() i=1 2024-09-12T00:18:49.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.231+0000 7fe459213800 20 add_watcher() i=2 2024-09-12T00:18:49.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.231+0000 7fe459213800 20 add_watcher() i=3 2024-09-12T00:18:49.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.231+0000 7fe459213800 20 add_watcher() i=4 2024-09-12T00:18:49.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.231+0000 7fe459213800 20 add_watcher() i=5 2024-09-12T00:18:49.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.231+0000 7fe459213800 20 add_watcher() i=6 2024-09-12T00:18:49.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.232+0000 7fe459213800 20 add_watcher() i=7 2024-09-12T00:18:49.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.232+0000 7fe459213800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:49.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.234+0000 7fe30afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:49.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.234+0000 7fe459213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:49.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.234+0000 7fe459213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:49.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.234+0000 7fe459213800 5 note: GC not initialized 2024-09-12T00:18:49.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.234+0000 7fe309fe3640 20 reqs_thread_entry: start 2024-09-12T00:18:49.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.234+0000 7fe459213800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:49.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.234+0000 7fe459213800 20 Filter name: none 2024-09-12T00:18:49.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.234+0000 7fe27b7fe640 20 reqs_thread_entry: start 2024-09-12T00:18:49.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.235+0000 7fe459213800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.235+0000 7fe459213800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:49.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.235+0000 7fe459213800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.236+0000 7fe459213800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:49.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.236+0000 7fe459213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:49.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.236+0000 7fe459213800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.236+0000 7fe459213800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:49.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.236+0000 7fe459213800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.236+0000 7fe459213800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:49.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.236+0000 7fe459213800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:49.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.238+0000 7fe30afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:49.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.240+0000 7fe459213800 20 remove_watcher() i=0 2024-09-12T00:18:49.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.240+0000 7fe459213800 2 removed watcher, disabling cache 2024-09-12T00:18:49.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.241+0000 7fe459213800 20 remove_watcher() i=1 2024-09-12T00:18:49.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.242+0000 7fe459213800 20 remove_watcher() i=2 2024-09-12T00:18:49.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.243+0000 7fe459213800 20 remove_watcher() i=3 2024-09-12T00:18:49.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.244+0000 7fe459213800 20 remove_watcher() i=4 2024-09-12T00:18:49.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.245+0000 7fe459213800 20 remove_watcher() i=5 2024-09-12T00:18:49.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.246+0000 7fe459213800 20 remove_watcher() i=6 2024-09-12T00:18:49.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.247+0000 7fe459213800 20 remove_watcher() i=7 2024-09-12T00:18:49.257 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:49.257 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:49.257 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-set-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:18:49.257 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:49.259 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T00:18:49.293 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:49.293 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:49.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.333+0000 7f3840f28800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.335+0000 7f3840f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.335+0000 7f3840f28800 20 realm 2024-09-12T00:18:49.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.335+0000 7f3840f28800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.335+0000 7f3840f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.335+0000 7f3840f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:49.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.335+0000 7f3840f28800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.335+0000 7f3840f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.335+0000 7f3840f28800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.336+0000 7f3840f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:49.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.336+0000 7f3840f28800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.336+0000 7f3840f28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:49.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.336+0000 7f3840f28800 20 searching for the correct realm 2024-09-12T00:18:49.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.339+0000 7f3837fff640 0 -- 172.21.15.67:0/3686103724 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f3828056c20 msgr2=0x7f382807e970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:49.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.544+0000 7f383cc6f640 0 -- 172.21.15.67:0/3686103724 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f383804f040 msgr2=0x7f38380927a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:49.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.751+0000 7f3840f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:49.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.751+0000 7f3840f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:49.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.751+0000 7f3840f28800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:49.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.751+0000 7f3840f28800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:49.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.751+0000 7f3840f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:49.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.751+0000 7f3840f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:49.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.751+0000 7f3840f28800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.751+0000 7f3840f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.751+0000 7f3840f28800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.751+0000 7f3840f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:49.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.751+0000 7f3840f28800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.752+0000 7f3840f28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:49.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.752+0000 7f3840f28800 20 zone default found 2024-09-12T00:18:49.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.752+0000 7f3840f28800 4 Realm: () 2024-09-12T00:18:49.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.752+0000 7f3840f28800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:49.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.752+0000 7f3840f28800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:49.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.752+0000 7f3840f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:49.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.752+0000 7f3840f28800 20 zonegroup default 2024-09-12T00:18:49.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.752+0000 7f3840f28800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.752+0000 7f3840f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.752+0000 7f3840f28800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.752+0000 7f3840f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.752+0000 7f3840f28800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.753+0000 7f3840f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.753+0000 7f3840f28800 20 started sync module instance, tier type = 2024-09-12T00:18:49.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.753+0000 7f3840f28800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:49.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.761+0000 7f3840f28800 20 add_watcher() i=0 2024-09-12T00:18:49.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.761+0000 7f3840f28800 20 add_watcher() i=1 2024-09-12T00:18:49.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.761+0000 7f3840f28800 20 add_watcher() i=2 2024-09-12T00:18:49.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.761+0000 7f3840f28800 20 add_watcher() i=3 2024-09-12T00:18:49.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.761+0000 7f3840f28800 20 add_watcher() i=4 2024-09-12T00:18:49.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.761+0000 7f3840f28800 20 add_watcher() i=5 2024-09-12T00:18:49.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.761+0000 7f3840f28800 20 add_watcher() i=6 2024-09-12T00:18:49.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.762+0000 7f3840f28800 20 add_watcher() i=7 2024-09-12T00:18:49.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.762+0000 7f3840f28800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:49.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.764+0000 7f36f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:49.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.765+0000 7f3840f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:49.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.765+0000 7f3840f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:49.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.765+0000 7f3840f28800 5 note: GC not initialized 2024-09-12T00:18:49.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.765+0000 7f36f0fe1640 20 reqs_thread_entry: start 2024-09-12T00:18:49.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.765+0000 7f3840f28800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:49.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.765+0000 7f3840f28800 20 Filter name: none 2024-09-12T00:18:49.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.765+0000 7f366a7fc640 20 reqs_thread_entry: start 2024-09-12T00:18:49.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.765+0000 7f3840f28800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:18:49.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.765+0000 7f3840f28800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.766+0000 7f3840f28800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:49.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.766+0000 7f3840f28800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:18:49.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.766+0000 7f3840f28800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:18:49.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.766+0000 7f3840f28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 : miss 2024-09-12T00:18:49.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.766+0000 7f3840f28800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.766+0000 7f3840f28800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:49.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.766+0000 7f3840f28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 info.flags=0x17 2024-09-12T00:18:49.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.766+0000 7f3840f28800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 to cache LRU end 2024-09-12T00:18:49.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.766+0000 7f3840f28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:49.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.766+0000 7f3840f28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:49.767 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.766+0000 7f3840f28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 2024-09-12T00:18:49.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.769+0000 7f3840f28800 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T00:18:49.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.769+0000 7f3840f28800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T00:18:49.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.772+0000 7f36f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:49.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.774+0000 7f3840f28800 20 remove_watcher() i=0 2024-09-12T00:18:49.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.774+0000 7f3840f28800 2 removed watcher, disabling cache 2024-09-12T00:18:49.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.775+0000 7f3840f28800 20 remove_watcher() i=1 2024-09-12T00:18:49.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.776+0000 7f3840f28800 20 remove_watcher() i=2 2024-09-12T00:18:49.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.777+0000 7f3840f28800 20 remove_watcher() i=3 2024-09-12T00:18:49.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.778+0000 7f3840f28800 20 remove_watcher() i=4 2024-09-12T00:18:49.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.779+0000 7f3840f28800 20 remove_watcher() i=5 2024-09-12T00:18:49.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.780+0000 7f3840f28800 20 remove_watcher() i=6 2024-09-12T00:18:49.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.781+0000 7f3840f28800 20 remove_watcher() i=7 2024-09-12T00:18:49.794 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:18:49.824 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:49.825 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:49.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.863+0000 7f0cf292c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.865+0000 7f0cf292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.865+0000 7f0cf292c800 20 realm 2024-09-12T00:18:49.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.865+0000 7f0cf292c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.865+0000 7f0cf292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.865+0000 7f0cf292c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:49.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.865+0000 7f0cf292c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.865+0000 7f0cf292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:49.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.865+0000 7f0cf292c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.866+0000 7f0cf292c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:49.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.866+0000 7f0cf292c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:49.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.867+0000 7f0cf292c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:49.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.867+0000 7f0cf292c800 20 searching for the correct realm 2024-09-12T00:18:49.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.870+0000 7f0ceed62640 0 -- 172.21.15.67:0/4039017007 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7f0ce403b040 msgr2=0x7f0ce403b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:49.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:49.873+0000 7f0cee561640 0 -- 172.21.15.67:0/4039017007 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f0ce80c92f0 msgr2=0x7f0ce80a66d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:50.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.079+0000 7f0cf292c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:50.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.079+0000 7f0cf292c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:50.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.079+0000 7f0cf292c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:50.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.079+0000 7f0cf292c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:50.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.079+0000 7f0cf292c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:50.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.079+0000 7f0cf292c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:50.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.079+0000 7f0cf292c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.079+0000 7f0cf292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.079+0000 7f0cf292c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.079+0000 7f0cf292c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:50.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.079+0000 7f0cf292c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.080+0000 7f0cf292c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:50.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.080+0000 7f0cf292c800 20 zone default found 2024-09-12T00:18:50.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.080+0000 7f0cf292c800 4 Realm: () 2024-09-12T00:18:50.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.080+0000 7f0cf292c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:50.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.080+0000 7f0cf292c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:50.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.080+0000 7f0cf292c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:50.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.080+0000 7f0cf292c800 20 zonegroup default 2024-09-12T00:18:50.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.080+0000 7f0cf292c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.080+0000 7f0cf292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.080+0000 7f0cf292c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.080+0000 7f0cf292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.080+0000 7f0cf292c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.081+0000 7f0cf292c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.081+0000 7f0cf292c800 20 started sync module instance, tier type = 2024-09-12T00:18:50.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.081+0000 7f0cf292c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:50.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.089+0000 7f0cf292c800 20 add_watcher() i=0 2024-09-12T00:18:50.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.089+0000 7f0cf292c800 20 add_watcher() i=1 2024-09-12T00:18:50.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.089+0000 7f0cf292c800 20 add_watcher() i=2 2024-09-12T00:18:50.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.089+0000 7f0cf292c800 20 add_watcher() i=3 2024-09-12T00:18:50.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.089+0000 7f0cf292c800 20 add_watcher() i=4 2024-09-12T00:18:50.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.089+0000 7f0cf292c800 20 add_watcher() i=5 2024-09-12T00:18:50.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.089+0000 7f0cf292c800 20 add_watcher() i=6 2024-09-12T00:18:50.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.090+0000 7f0cf292c800 20 add_watcher() i=7 2024-09-12T00:18:50.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.090+0000 7f0cf292c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:50.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.092+0000 7f0ba4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:50.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.092+0000 7f0cf292c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:50.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.092+0000 7f0cf292c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:50.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.092+0000 7f0cf292c800 5 note: GC not initialized 2024-09-12T00:18:50.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.092+0000 7f0b1f7fe640 20 reqs_thread_entry: start 2024-09-12T00:18:50.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.092+0000 7f0cf292c800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:50.092 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.093+0000 7f0cf292c800 20 Filter name: none 2024-09-12T00:18:50.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.093+0000 7f0b1d7fa640 20 reqs_thread_entry: start 2024-09-12T00:18:50.093 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.093+0000 7f0cf292c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.093+0000 7f0cf292c800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:50.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.093+0000 7f0cf292c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.094+0000 7f0cf292c800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:50.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.094+0000 7f0cf292c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:50.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.094+0000 7f0cf292c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.094+0000 7f0cf292c800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:50.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.094+0000 7f0cf292c800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.094+0000 7f0cf292c800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:50.094 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.094+0000 7f0cf292c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:50.095 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.095+0000 7f0ba4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:50.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.097+0000 7f0cf292c800 20 remove_watcher() i=0 2024-09-12T00:18:50.097 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.097+0000 7f0cf292c800 2 removed watcher, disabling cache 2024-09-12T00:18:50.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.098+0000 7f0cf292c800 20 remove_watcher() i=1 2024-09-12T00:18:50.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.099+0000 7f0cf292c800 20 remove_watcher() i=2 2024-09-12T00:18:50.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.100+0000 7f0cf292c800 20 remove_watcher() i=3 2024-09-12T00:18:50.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.101+0000 7f0cf292c800 20 remove_watcher() i=4 2024-09-12T00:18:50.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.102+0000 7f0cf292c800 20 remove_watcher() i=5 2024-09-12T00:18:50.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.103+0000 7f0cf292c800 20 remove_watcher() i=6 2024-09-12T00:18:50.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.104+0000 7f0cf292c800 20 remove_watcher() i=7 2024-09-12T00:18:50.115 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:50.115 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:50.115 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-set-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:18:50.115 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:50.168 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:18:50.200 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:50.200 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:50.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.240+0000 7f1d25125800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.242+0000 7f1d25125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.242+0000 7f1d25125800 20 realm 2024-09-12T00:18:50.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.242+0000 7f1d25125800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.242+0000 7f1d25125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.242+0000 7f1d25125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:50.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.242+0000 7f1d25125800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.243+0000 7f1d25125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.243+0000 7f1d25125800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.243+0000 7f1d25125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:50.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.244+0000 7f1d25125800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.244+0000 7f1d25125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:50.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.244+0000 7f1d25125800 20 searching for the correct realm 2024-09-12T00:18:50.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.247+0000 7f1d1bfff640 0 -- 172.21.15.67:0/2704916267 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f1d0c09e130 msgr2=0x7f1d0c029880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:50.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.250+0000 7f1d20d33640 0 -- 172.21.15.67:0/2704916267 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f1d1c0d7040 msgr2=0x7f1d1c0a4280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:50.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.254+0000 7f1d25125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:50.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.254+0000 7f1d25125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:50.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.254+0000 7f1d25125800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:50.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.254+0000 7f1d25125800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:50.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.254+0000 7f1d25125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:50.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.254+0000 7f1d25125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:50.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.254+0000 7f1d25125800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.255+0000 7f1d25125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.255+0000 7f1d25125800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.255+0000 7f1d25125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:50.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.255+0000 7f1d25125800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.255+0000 7f1d25125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:50.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.255+0000 7f1d25125800 20 zone default found 2024-09-12T00:18:50.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.255+0000 7f1d25125800 4 Realm: () 2024-09-12T00:18:50.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.255+0000 7f1d25125800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:50.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.255+0000 7f1d25125800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:50.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.255+0000 7f1d25125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:50.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.255+0000 7f1d25125800 20 zonegroup default 2024-09-12T00:18:50.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.255+0000 7f1d25125800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.255+0000 7f1d25125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.255+0000 7f1d25125800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.256+0000 7f1d25125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.256+0000 7f1d25125800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.256+0000 7f1d25125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.256+0000 7f1d25125800 20 started sync module instance, tier type = 2024-09-12T00:18:50.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.256+0000 7f1d25125800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:50.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.264+0000 7f1d25125800 20 add_watcher() i=0 2024-09-12T00:18:50.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.264+0000 7f1d25125800 20 add_watcher() i=1 2024-09-12T00:18:50.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.264+0000 7f1d25125800 20 add_watcher() i=2 2024-09-12T00:18:50.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.264+0000 7f1d25125800 20 add_watcher() i=3 2024-09-12T00:18:50.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.264+0000 7f1d25125800 20 add_watcher() i=4 2024-09-12T00:18:50.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.264+0000 7f1d25125800 20 add_watcher() i=5 2024-09-12T00:18:50.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.264+0000 7f1d25125800 20 add_watcher() i=6 2024-09-12T00:18:50.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.265+0000 7f1d25125800 20 add_watcher() i=7 2024-09-12T00:18:50.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.265+0000 7f1d25125800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:50.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.267+0000 7f1bd6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:50.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.267+0000 7f1d25125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:50.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.267+0000 7f1d25125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:50.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.267+0000 7f1d25125800 5 note: GC not initialized 2024-09-12T00:18:50.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.267+0000 7f1bd5fe3640 20 reqs_thread_entry: start 2024-09-12T00:18:50.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.268+0000 7f1d25125800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:50.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.268+0000 7f1d25125800 20 Filter name: none 2024-09-12T00:18:50.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.268+0000 7f1b477fe640 20 reqs_thread_entry: start 2024-09-12T00:18:50.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.268+0000 7f1d25125800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:18:50.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.268+0000 7f1d25125800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.268+0000 7f1d25125800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:50.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.268+0000 7f1d25125800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:18:50.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.268+0000 7f1d25125800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:18:50.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.268+0000 7f1d25125800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 : miss 2024-09-12T00:18:50.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.268+0000 7f1d25125800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.269+0000 7f1d25125800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:50.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.269+0000 7f1d25125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 info.flags=0x17 2024-09-12T00:18:50.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.269+0000 7f1d25125800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 to cache LRU end 2024-09-12T00:18:50.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.269+0000 7f1d25125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:50.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.269+0000 7f1d25125800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:50.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.269+0000 7f1d25125800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 2024-09-12T00:18:50.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.272+0000 7f1d25125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 info.flags=0x17 2024-09-12T00:18:50.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.272+0000 7f1d25125800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 to cache LRU end 2024-09-12T00:18:50.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.272+0000 7f1d25125800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:50.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.272+0000 7f1d25125800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22, ofs0, ns] 2024-09-12T00:18:50.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.272+0000 7f1bf7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562408 cookie 93940150355984 notifier 6146 bl.length()=925 2024-09-12T00:18:50.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.272+0000 7f1bf7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 info.flags=0x17 2024-09-12T00:18:50.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.272+0000 7f1bf7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 to cache LRU end 2024-09-12T00:18:50.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.272+0000 7f1bf7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:50.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.273+0000 7f1d25125800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22]): orig_sources= new_sources= 2024-09-12T00:18:50.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.273+0000 7f1d25125800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22]): potential sources added=[] removed=[] 2024-09-12T00:18:50.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.273+0000 7f1d25125800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22]): orig_dests= new_dests= 2024-09-12T00:18:50.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.273+0000 7f1d25125800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22]): potential dests added=[] removed=[] 2024-09-12T00:18:50.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.275+0000 7f1d25125800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22.1.0 2024-09-12T00:18:50.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.275+0000 7f1d25125800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22.1.0 2024-09-12T00:18:50.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.275+0000 7f1d25125800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22.1.1 2024-09-12T00:18:50.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.275+0000 7f1d25125800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22.1.1 2024-09-12T00:18:50.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.275+0000 7f1d25125800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22.0 2024-09-12T00:18:50.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.278+0000 7f1d25125800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:18:50.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.278+0000 7f1d25125800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 2024-09-12T00:18:50.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.279+0000 7f1d25125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 info.flags=0x17 2024-09-12T00:18:50.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.279+0000 7f1d25125800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 to cache LRU end 2024-09-12T00:18:50.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.279+0000 7f1d25125800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:50.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.279+0000 7f1d25125800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22, ofs0, ns] 2024-09-12T00:18:50.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.279+0000 7f1bf77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562409 cookie 93940150355984 notifier 6146 bl.length()=925 2024-09-12T00:18:50.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.279+0000 7f1bf77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 info.flags=0x17 2024-09-12T00:18:50.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.279+0000 7f1bf77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 to cache LRU end 2024-09-12T00:18:50.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.279+0000 7f1bf77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:50.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.279+0000 7f1d25125800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22]): orig_sources= new_sources= 2024-09-12T00:18:50.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.279+0000 7f1d25125800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22]): potential sources added=[] removed=[] 2024-09-12T00:18:50.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.279+0000 7f1d25125800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22]): orig_dests= new_dests= 2024-09-12T00:18:50.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.279+0000 7f1d25125800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22]): potential dests added=[] removed=[] 2024-09-12T00:18:50.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.281+0000 7f1d25125800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22.0 2024-09-12T00:18:50.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.281+0000 7f1d25125800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:18:50.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.281+0000 7f1d25125800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 2024-09-12T00:18:50.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.282+0000 7f1d25125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 info.flags=0x17 2024-09-12T00:18:50.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.282+0000 7f1d25125800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 to cache LRU end 2024-09-12T00:18:50.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.282+0000 7f1d25125800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:50.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.282+0000 7f1d25125800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22, ofs0, ns] 2024-09-12T00:18:50.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.283+0000 7f1bf7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562410 cookie 93940150355984 notifier 6146 bl.length()=893 2024-09-12T00:18:50.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.283+0000 7f1bf7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 info.flags=0x17 2024-09-12T00:18:50.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.283+0000 7f1bf7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 to cache LRU end 2024-09-12T00:18:50.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.283+0000 7f1bf7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:50.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.283+0000 7f1d25125800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22]): orig_sources= new_sources= 2024-09-12T00:18:50.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.283+0000 7f1d25125800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22]): potential sources added=[] removed=[] 2024-09-12T00:18:50.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.283+0000 7f1d25125800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22]): orig_dests= new_dests= 2024-09-12T00:18:50.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.283+0000 7f1d25125800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22]): potential dests added=[] removed=[] 2024-09-12T00:18:50.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.284+0000 7f1d25125800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:18:50.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.286+0000 7f1bd6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:50.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.288+0000 7f1d25125800 20 remove_watcher() i=0 2024-09-12T00:18:50.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.288+0000 7f1d25125800 2 removed watcher, disabling cache 2024-09-12T00:18:50.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.289+0000 7f1d25125800 20 remove_watcher() i=1 2024-09-12T00:18:50.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.290+0000 7f1d25125800 20 remove_watcher() i=2 2024-09-12T00:18:50.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.291+0000 7f1d25125800 20 remove_watcher() i=3 2024-09-12T00:18:50.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.292+0000 7f1d25125800 20 remove_watcher() i=4 2024-09-12T00:18:50.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.293+0000 7f1d25125800 20 remove_watcher() i=5 2024-09-12T00:18:50.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.294+0000 7f1d25125800 20 remove_watcher() i=6 2024-09-12T00:18:50.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.294+0000 7f1d25125800 20 remove_watcher() i=7 2024-09-12T00:18:50.306 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:18:50.335 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:50.335 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:50.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.375+0000 7f3fc5daf800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.377+0000 7f3fc5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.377+0000 7f3fc5daf800 20 realm 2024-09-12T00:18:50.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.377+0000 7f3fc5daf800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.377+0000 7f3fc5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.377+0000 7f3fc5daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:50.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.377+0000 7f3fc5daf800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.377+0000 7f3fc5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.377+0000 7f3fc5daf800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.378+0000 7f3fc5daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:50.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.378+0000 7f3fc5daf800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.379+0000 7f3fc5daf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:50.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.379+0000 7f3fc5daf800 20 searching for the correct realm 2024-09-12T00:18:50.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.382+0000 7f3fc309f640 0 -- 172.21.15.67:0/973302263 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f3fb8080110 msgr2=0x7f3fb806b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:50.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.385+0000 7f3fc38a0640 0 -- 172.21.15.67:0/973302263 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f3fbc021040 msgr2=0x7f3fbc010440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:50.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.592+0000 7f3fc5daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:50.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.592+0000 7f3fc5daf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:50.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.592+0000 7f3fc5daf800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:50.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.592+0000 7f3fc5daf800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:50.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.592+0000 7f3fc5daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:50.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.592+0000 7f3fc5daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:50.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.592+0000 7f3fc5daf800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.593+0000 7f3fc5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.593+0000 7f3fc5daf800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.593+0000 7f3fc5daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:50.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.593+0000 7f3fc5daf800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.593+0000 7f3fc5daf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:50.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.593+0000 7f3fc5daf800 20 zone default found 2024-09-12T00:18:50.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.593+0000 7f3fc5daf800 4 Realm: () 2024-09-12T00:18:50.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.593+0000 7f3fc5daf800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:50.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.593+0000 7f3fc5daf800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:50.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.593+0000 7f3fc5daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:50.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.593+0000 7f3fc5daf800 20 zonegroup default 2024-09-12T00:18:50.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.593+0000 7f3fc5daf800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.594+0000 7f3fc5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.594+0000 7f3fc5daf800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.594+0000 7f3fc5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.594+0000 7f3fc5daf800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.595+0000 7f3fc5daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.595+0000 7f3fc5daf800 20 started sync module instance, tier type = 2024-09-12T00:18:50.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.595+0000 7f3fc5daf800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:50.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.603+0000 7f3fc5daf800 20 add_watcher() i=0 2024-09-12T00:18:50.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.603+0000 7f3fc5daf800 20 add_watcher() i=1 2024-09-12T00:18:50.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.603+0000 7f3fc5daf800 20 add_watcher() i=2 2024-09-12T00:18:50.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.603+0000 7f3fc5daf800 20 add_watcher() i=3 2024-09-12T00:18:50.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.603+0000 7f3fc5daf800 20 add_watcher() i=4 2024-09-12T00:18:50.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.603+0000 7f3fc5daf800 20 add_watcher() i=5 2024-09-12T00:18:50.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.603+0000 7f3fc5daf800 20 add_watcher() i=6 2024-09-12T00:18:50.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.604+0000 7f3fc5daf800 20 add_watcher() i=7 2024-09-12T00:18:50.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.604+0000 7f3fc5daf800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:50.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.606+0000 7f3e79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:50.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.606+0000 7f3fc5daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:50.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.606+0000 7f3fc5daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:50.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.606+0000 7f3fc5daf800 5 note: GC not initialized 2024-09-12T00:18:50.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.606+0000 7f3e78fe1640 20 reqs_thread_entry: start 2024-09-12T00:18:50.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.607+0000 7f3fc5daf800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:50.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.607+0000 7f3fc5daf800 20 Filter name: none 2024-09-12T00:18:50.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.607+0000 7f3df27fc640 20 reqs_thread_entry: start 2024-09-12T00:18:50.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.607+0000 7f3fc5daf800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.607+0000 7f3fc5daf800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:50.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.607+0000 7f3fc5daf800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.608+0000 7f3fc5daf800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:50.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.608+0000 7f3fc5daf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:50.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.608+0000 7f3fc5daf800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.608+0000 7f3fc5daf800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:50.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.608+0000 7f3fc5daf800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.609+0000 7f3fc5daf800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:50.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.609+0000 7f3fc5daf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:50.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.610+0000 7f3e79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:50.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.612+0000 7f3fc5daf800 20 remove_watcher() i=0 2024-09-12T00:18:50.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.612+0000 7f3fc5daf800 2 removed watcher, disabling cache 2024-09-12T00:18:50.612 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.613+0000 7f3fc5daf800 20 remove_watcher() i=1 2024-09-12T00:18:50.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.614+0000 7f3fc5daf800 20 remove_watcher() i=2 2024-09-12T00:18:50.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.615+0000 7f3fc5daf800 20 remove_watcher() i=3 2024-09-12T00:18:50.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.616+0000 7f3fc5daf800 20 remove_watcher() i=4 2024-09-12T00:18:50.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.617+0000 7f3fc5daf800 20 remove_watcher() i=5 2024-09-12T00:18:50.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.618+0000 7f3fc5daf800 20 remove_watcher() i=6 2024-09-12T00:18:50.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.619+0000 7f3fc5daf800 20 remove_watcher() i=7 2024-09-12T00:18:50.629 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:50.629 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:50.629 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-set-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:18:50.629 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:50.691 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T00:18:50.691 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:50.892 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:18:50.921 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:50.921 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:50.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.962+0000 7f6b7ff33800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.968+0000 7f6b7ff33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.968+0000 7f6b7ff33800 20 realm 2024-09-12T00:18:50.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.968+0000 7f6b7ff33800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.968+0000 7f6b7ff33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.968+0000 7f6b7ff33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:50.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.968+0000 7f6b7ff33800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.969+0000 7f6b7ff33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:50.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.969+0000 7f6b7ff33800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.969+0000 7f6b7ff33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:50.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.969+0000 7f6b7ff33800 20 rados->read ofs=0 len=0 2024-09-12T00:18:50.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.970+0000 7f6b7ff33800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:50.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.970+0000 7f6b7ff33800 20 searching for the correct realm 2024-09-12T00:18:50.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.972+0000 7f6b7bc76640 0 -- 172.21.15.67:0/1704923917 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f6b6c017070 msgr2=0x7f6b6c048970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:50.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:50.976+0000 7f6b7bc76640 0 -- 172.21.15.67:0/1704923917 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f6b74072070 msgr2=0x7f6b740afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:51.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.183+0000 7f6b7ff33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:51.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.183+0000 7f6b7ff33800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:51.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.183+0000 7f6b7ff33800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:51.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.183+0000 7f6b7ff33800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:51.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.183+0000 7f6b7ff33800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:51.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.183+0000 7f6b7ff33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:51.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.183+0000 7f6b7ff33800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.184+0000 7f6b7ff33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.184+0000 7f6b7ff33800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.184+0000 7f6b7ff33800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:51.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.184+0000 7f6b7ff33800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.185+0000 7f6b7ff33800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:51.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.185+0000 7f6b7ff33800 20 zone default found 2024-09-12T00:18:51.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.185+0000 7f6b7ff33800 4 Realm: () 2024-09-12T00:18:51.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.185+0000 7f6b7ff33800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:51.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.185+0000 7f6b7ff33800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:51.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.185+0000 7f6b7ff33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:51.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.185+0000 7f6b7ff33800 20 zonegroup default 2024-09-12T00:18:51.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.185+0000 7f6b7ff33800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.185+0000 7f6b7ff33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.185+0000 7f6b7ff33800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.185+0000 7f6b7ff33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.185+0000 7f6b7ff33800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.186+0000 7f6b7ff33800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.186+0000 7f6b7ff33800 20 started sync module instance, tier type = 2024-09-12T00:18:51.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.186+0000 7f6b7ff33800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:51.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.194+0000 7f6b7ff33800 20 add_watcher() i=0 2024-09-12T00:18:51.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.194+0000 7f6b7ff33800 20 add_watcher() i=1 2024-09-12T00:18:51.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.194+0000 7f6b7ff33800 20 add_watcher() i=2 2024-09-12T00:18:51.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.194+0000 7f6b7ff33800 20 add_watcher() i=3 2024-09-12T00:18:51.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.194+0000 7f6b7ff33800 20 add_watcher() i=4 2024-09-12T00:18:51.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.194+0000 7f6b7ff33800 20 add_watcher() i=5 2024-09-12T00:18:51.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.194+0000 7f6b7ff33800 20 add_watcher() i=6 2024-09-12T00:18:51.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.195+0000 7f6b7ff33800 20 add_watcher() i=7 2024-09-12T00:18:51.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.195+0000 7f6b7ff33800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:51.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.196+0000 7f6a31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:51.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.197+0000 7f6b7ff33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:51.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.197+0000 7f6b7ff33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:51.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.197+0000 7f6b7ff33800 5 note: GC not initialized 2024-09-12T00:18:51.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.197+0000 7f6a30fe1640 20 reqs_thread_entry: start 2024-09-12T00:18:51.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.197+0000 7f6b7ff33800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:51.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.197+0000 7f6b7ff33800 20 Filter name: none 2024-09-12T00:18:51.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.197+0000 7f69aa7fc640 20 reqs_thread_entry: start 2024-09-12T00:18:51.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.197+0000 7f6b7ff33800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.198+0000 7f6b7ff33800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.198+0000 7f6b7ff33800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.198+0000 7f6b7ff33800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.198+0000 7f6b7ff33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:51.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.198+0000 7f6b7ff33800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.199+0000 7f6b7ff33800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:51.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.199+0000 7f6b7ff33800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.200+0000 7f6b7ff33800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:51.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.200+0000 7f6b7ff33800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:51.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.201+0000 7f6a31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:51.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.203+0000 7f6b7ff33800 20 remove_watcher() i=0 2024-09-12T00:18:51.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.203+0000 7f6b7ff33800 2 removed watcher, disabling cache 2024-09-12T00:18:51.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.204+0000 7f6b7ff33800 20 remove_watcher() i=1 2024-09-12T00:18:51.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.205+0000 7f6b7ff33800 20 remove_watcher() i=2 2024-09-12T00:18:51.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.206+0000 7f6b7ff33800 20 remove_watcher() i=3 2024-09-12T00:18:51.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.207+0000 7f6b7ff33800 20 remove_watcher() i=4 2024-09-12T00:18:51.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.208+0000 7f6b7ff33800 20 remove_watcher() i=5 2024-09-12T00:18:51.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.209+0000 7f6b7ff33800 20 remove_watcher() i=6 2024-09-12T00:18:51.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.210+0000 7f6b7ff33800 20 remove_watcher() i=7 2024-09-12T00:18:51.221 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:51.221 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:51.221 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-set-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:18:51.221 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:51.222 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T00:18:51.260 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:51.260 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:51.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.300+0000 7fe329537800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.302+0000 7fe329537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.302+0000 7fe329537800 20 realm 2024-09-12T00:18:51.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.302+0000 7fe329537800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.302+0000 7fe329537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.302+0000 7fe329537800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:51.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.302+0000 7fe329537800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.302+0000 7fe329537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.302+0000 7fe329537800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.303+0000 7fe329537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:51.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.303+0000 7fe329537800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.303+0000 7fe329537800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:51.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.303+0000 7fe329537800 20 searching for the correct realm 2024-09-12T00:18:51.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.305+0000 7fe325221640 0 -- 172.21.15.67:0/2882016592 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7fe31803f030 msgr2=0x7fe318041460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:51.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.510+0000 7fe325221640 0 -- 172.21.15.67:0/2882016592 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x563d809a3660 msgr2=0x7fe3200a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:51.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.716+0000 7fe329537800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:51.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.716+0000 7fe329537800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:51.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.716+0000 7fe329537800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:51.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.716+0000 7fe329537800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:51.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.716+0000 7fe329537800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:51.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.716+0000 7fe329537800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:51.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.716+0000 7fe329537800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.716+0000 7fe329537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.716+0000 7fe329537800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.717+0000 7fe329537800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:51.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.717+0000 7fe329537800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.717+0000 7fe329537800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:51.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.717+0000 7fe329537800 20 zone default found 2024-09-12T00:18:51.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.717+0000 7fe329537800 4 Realm: () 2024-09-12T00:18:51.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.717+0000 7fe329537800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:51.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.717+0000 7fe329537800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:51.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.717+0000 7fe329537800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:51.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.717+0000 7fe329537800 20 zonegroup default 2024-09-12T00:18:51.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.717+0000 7fe329537800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.717+0000 7fe329537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.717+0000 7fe329537800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.718+0000 7fe329537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.718+0000 7fe329537800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.718+0000 7fe329537800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.718+0000 7fe329537800 20 started sync module instance, tier type = 2024-09-12T00:18:51.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.718+0000 7fe329537800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:51.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.727+0000 7fe329537800 20 add_watcher() i=0 2024-09-12T00:18:51.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.727+0000 7fe329537800 20 add_watcher() i=1 2024-09-12T00:18:51.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.727+0000 7fe329537800 20 add_watcher() i=2 2024-09-12T00:18:51.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.727+0000 7fe329537800 20 add_watcher() i=3 2024-09-12T00:18:51.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.727+0000 7fe329537800 20 add_watcher() i=4 2024-09-12T00:18:51.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.727+0000 7fe329537800 20 add_watcher() i=5 2024-09-12T00:18:51.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.727+0000 7fe329537800 20 add_watcher() i=6 2024-09-12T00:18:51.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.728+0000 7fe329537800 20 add_watcher() i=7 2024-09-12T00:18:51.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.728+0000 7fe329537800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:51.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.730+0000 7fe1db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:51.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.730+0000 7fe329537800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:51.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.730+0000 7fe329537800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:51.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.730+0000 7fe329537800 5 note: GC not initialized 2024-09-12T00:18:51.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.730+0000 7fe1da7e4640 20 reqs_thread_entry: start 2024-09-12T00:18:51.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.730+0000 7fe329537800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:51.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.731+0000 7fe329537800 20 Filter name: none 2024-09-12T00:18:51.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.731+0000 7fe14bfff640 20 reqs_thread_entry: start 2024-09-12T00:18:51.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.731+0000 7fe329537800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:18:51.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.731+0000 7fe329537800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.731+0000 7fe329537800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:51.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.731+0000 7fe329537800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:18:51.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.731+0000 7fe329537800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:18:51.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.731+0000 7fe329537800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 : miss 2024-09-12T00:18:51.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.731+0000 7fe329537800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.732+0000 7fe329537800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:51.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.732+0000 7fe329537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 info.flags=0x17 2024-09-12T00:18:51.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.732+0000 7fe329537800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 to cache LRU end 2024-09-12T00:18:51.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.732+0000 7fe329537800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:51.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.732+0000 7fe329537800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:51.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.732+0000 7fe329537800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 2024-09-12T00:18:51.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.734+0000 7fe329537800 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T00:18:51.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.735+0000 7fe329537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 info.flags=0x17 2024-09-12T00:18:51.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.735+0000 7fe329537800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 to cache LRU end 2024-09-12T00:18:51.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.735+0000 7fe329537800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:51.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.735+0000 7fe329537800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23, ofs0, ns] 2024-09-12T00:18:51.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.736+0000 7fe208ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562413 cookie 94822153012240 notifier 6194 bl.length()=925 2024-09-12T00:18:51.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.736+0000 7fe208ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 info.flags=0x17 2024-09-12T00:18:51.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.736+0000 7fe208ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 to cache LRU end 2024-09-12T00:18:51.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.736+0000 7fe208ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:51.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.736+0000 7fe329537800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23]): orig_sources= new_sources= 2024-09-12T00:18:51.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.736+0000 7fe329537800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23]): potential sources added=[] removed=[] 2024-09-12T00:18:51.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.736+0000 7fe329537800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23]): orig_dests= new_dests= 2024-09-12T00:18:51.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.736+0000 7fe329537800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23]): potential dests added=[] removed=[] 2024-09-12T00:18:51.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.738+0000 7fe329537800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23.1.0 2024-09-12T00:18:51.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.738+0000 7fe329537800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23.1.0 2024-09-12T00:18:51.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.739+0000 7fe329537800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23.1.1 2024-09-12T00:18:51.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.739+0000 7fe329537800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23.1.1 2024-09-12T00:18:51.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.739+0000 7fe329537800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23.0 2024-09-12T00:18:51.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.741+0000 7fe329537800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:18:51.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.741+0000 7fe329537800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 2024-09-12T00:18:51.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.742+0000 7fe329537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 info.flags=0x17 2024-09-12T00:18:51.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.742+0000 7fe329537800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 to cache LRU end 2024-09-12T00:18:51.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.742+0000 7fe329537800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:51.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.742+0000 7fe329537800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23, ofs0, ns] 2024-09-12T00:18:51.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.743+0000 7fe208ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562414 cookie 94822153012240 notifier 6194 bl.length()=925 2024-09-12T00:18:51.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.743+0000 7fe208ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 info.flags=0x17 2024-09-12T00:18:51.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.743+0000 7fe208ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 to cache LRU end 2024-09-12T00:18:51.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.743+0000 7fe208ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:51.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.743+0000 7fe329537800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23]): orig_sources= new_sources= 2024-09-12T00:18:51.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.743+0000 7fe329537800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23]): potential sources added=[] removed=[] 2024-09-12T00:18:51.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.743+0000 7fe329537800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23]): orig_dests= new_dests= 2024-09-12T00:18:51.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.743+0000 7fe329537800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23]): potential dests added=[] removed=[] 2024-09-12T00:18:51.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.744+0000 7fe329537800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23.0 2024-09-12T00:18:51.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.744+0000 7fe329537800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:18:51.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.745+0000 7fe329537800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 2024-09-12T00:18:51.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.746+0000 7fe329537800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 info.flags=0x17 2024-09-12T00:18:51.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.746+0000 7fe329537800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 to cache LRU end 2024-09-12T00:18:51.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.746+0000 7fe329537800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:51.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.746+0000 7fe329537800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23, ofs0, ns] 2024-09-12T00:18:51.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.746+0000 7fe1f7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562415 cookie 94822153012240 notifier 6194 bl.length()=893 2024-09-12T00:18:51.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.746+0000 7fe1f7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 info.flags=0x17 2024-09-12T00:18:51.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.746+0000 7fe1f7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 to cache LRU end 2024-09-12T00:18:51.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.746+0000 7fe1f7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:51.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.747+0000 7fe329537800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23]): orig_sources= new_sources= 2024-09-12T00:18:51.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.747+0000 7fe329537800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23]): potential sources added=[] removed=[] 2024-09-12T00:18:51.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.747+0000 7fe329537800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23]): orig_dests= new_dests= 2024-09-12T00:18:51.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.747+0000 7fe329537800 20 handle_bi_update(): bucket=:error-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23]): potential dests added=[] removed=[] 2024-09-12T00:18:51.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.748+0000 7fe329537800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:18:51.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.750+0000 7fe1db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:51.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.752+0000 7fe329537800 20 remove_watcher() i=0 2024-09-12T00:18:51.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.752+0000 7fe329537800 2 removed watcher, disabling cache 2024-09-12T00:18:51.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.753+0000 7fe329537800 20 remove_watcher() i=1 2024-09-12T00:18:51.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.754+0000 7fe329537800 20 remove_watcher() i=2 2024-09-12T00:18:51.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.755+0000 7fe329537800 20 remove_watcher() i=3 2024-09-12T00:18:51.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.756+0000 7fe329537800 20 remove_watcher() i=4 2024-09-12T00:18:51.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.757+0000 7fe329537800 20 remove_watcher() i=5 2024-09-12T00:18:51.757 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.758+0000 7fe329537800 20 remove_watcher() i=6 2024-09-12T00:18:51.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.759+0000 7fe329537800 20 remove_watcher() i=7 2024-09-12T00:18:51.771 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:18:51.801 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:51.801 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:51.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.840+0000 7fe577339800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.842+0000 7fe577339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.842+0000 7fe577339800 20 realm 2024-09-12T00:18:51.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.842+0000 7fe577339800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.842+0000 7fe577339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.842+0000 7fe577339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:51.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.842+0000 7fe577339800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.843+0000 7fe577339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.843+0000 7fe577339800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.843+0000 7fe577339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:51.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.843+0000 7fe577339800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.844+0000 7fe577339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:51.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.844+0000 7fe577339800 20 searching for the correct realm 2024-09-12T00:18:51.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.847+0000 7fe5727cd640 0 -- 172.21.15.67:0/826111254 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fe5680af0e0 msgr2=0x7fe5680b9040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:51.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.851+0000 7fe5727cd640 0 -- 172.21.15.67:0/826111254 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55efe725fc30 msgr2=0x55efe7262050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:51.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.854+0000 7fe577339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:51.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.854+0000 7fe577339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:51.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.854+0000 7fe577339800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:51.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.854+0000 7fe577339800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:51.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.854+0000 7fe577339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:51.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.854+0000 7fe577339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:51.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.854+0000 7fe577339800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.854+0000 7fe577339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.854+0000 7fe577339800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.855+0000 7fe577339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:51.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.855+0000 7fe577339800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.855+0000 7fe577339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:51.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.855+0000 7fe577339800 20 zone default found 2024-09-12T00:18:51.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.855+0000 7fe577339800 4 Realm: () 2024-09-12T00:18:51.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.855+0000 7fe577339800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:51.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.855+0000 7fe577339800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:51.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.855+0000 7fe577339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:51.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.855+0000 7fe577339800 20 zonegroup default 2024-09-12T00:18:51.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.855+0000 7fe577339800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.855+0000 7fe577339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.855+0000 7fe577339800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.855+0000 7fe577339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.855+0000 7fe577339800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.856+0000 7fe577339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:51.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.856+0000 7fe577339800 20 started sync module instance, tier type = 2024-09-12T00:18:51.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.856+0000 7fe577339800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:51.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.864+0000 7fe577339800 20 add_watcher() i=0 2024-09-12T00:18:51.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.864+0000 7fe577339800 20 add_watcher() i=1 2024-09-12T00:18:51.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.864+0000 7fe577339800 20 add_watcher() i=2 2024-09-12T00:18:51.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.864+0000 7fe577339800 20 add_watcher() i=3 2024-09-12T00:18:51.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.864+0000 7fe577339800 20 add_watcher() i=4 2024-09-12T00:18:51.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.864+0000 7fe577339800 20 add_watcher() i=5 2024-09-12T00:18:51.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.864+0000 7fe577339800 20 add_watcher() i=6 2024-09-12T00:18:51.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.865+0000 7fe577339800 20 add_watcher() i=7 2024-09-12T00:18:51.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.865+0000 7fe577339800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:51.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.867+0000 7fe4297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:51.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.867+0000 7fe577339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:51.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.867+0000 7fe577339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:51.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.867+0000 7fe577339800 5 note: GC not initialized 2024-09-12T00:18:51.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.867+0000 7fe3a3fff640 20 reqs_thread_entry: start 2024-09-12T00:18:51.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.867+0000 7fe577339800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:51.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.867+0000 7fe577339800 20 Filter name: none 2024-09-12T00:18:51.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.868+0000 7fe3a1ffb640 20 reqs_thread_entry: start 2024-09-12T00:18:51.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.868+0000 7fe577339800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.868+0000 7fe577339800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:51.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.868+0000 7fe577339800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.868+0000 7fe577339800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:51.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.869+0000 7fe577339800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:51.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.869+0000 7fe577339800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.869+0000 7fe577339800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:51.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.869+0000 7fe577339800 20 rados->read ofs=0 len=0 2024-09-12T00:18:51.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.869+0000 7fe577339800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:51.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.869+0000 7fe577339800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:51.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.870+0000 7fe4297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:51.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.873+0000 7fe577339800 20 remove_watcher() i=0 2024-09-12T00:18:51.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.873+0000 7fe577339800 2 removed watcher, disabling cache 2024-09-12T00:18:51.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.874+0000 7fe577339800 20 remove_watcher() i=1 2024-09-12T00:18:51.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.875+0000 7fe577339800 20 remove_watcher() i=2 2024-09-12T00:18:51.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.876+0000 7fe577339800 20 remove_watcher() i=3 2024-09-12T00:18:51.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.877+0000 7fe577339800 20 remove_watcher() i=4 2024-09-12T00:18:51.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.878+0000 7fe577339800 20 remove_watcher() i=5 2024-09-12T00:18:51.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.879+0000 7fe577339800 20 remove_watcher() i=6 2024-09-12T00:18:51.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:51.879+0000 7fe577339800 20 remove_watcher() i=7 2024-09-12T00:18:51.890 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:51.890 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:51.890 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-set-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:18:51.890 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:51.952 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T00:18:51.952 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:52.165 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:18:52.195 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:52.195 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:52.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.432+0000 7fef4a153640 0 --2- 172.21.15.67:0/806160800 >> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] conn(0x557e0de80280 0x557e0de7a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:18:52.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.436+0000 7fef4ee30800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.438+0000 7fef4ee30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:52.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.438+0000 7fef4ee30800 20 realm 2024-09-12T00:18:52.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.438+0000 7fef4ee30800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.438+0000 7fef4ee30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:52.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.438+0000 7fef4ee30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:52.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.438+0000 7fef4ee30800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.439+0000 7fef4ee30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:52.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.439+0000 7fef4ee30800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.439+0000 7fef4ee30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:52.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.439+0000 7fef4ee30800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.440+0000 7fef4ee30800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:52.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.440+0000 7fef4ee30800 20 searching for the correct realm 2024-09-12T00:18:52.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.442+0000 7fef4a153640 0 -- 172.21.15.67:0/2677867297 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7fef3c06e070 msgr2=0x7fef3c022120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:18:52.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.647+0000 7fef4a153640 0 -- 172.21.15.67:0/2677867297 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fef44055920 msgr2=0x7fef4406f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:52.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.852+0000 7fef4ee30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:52.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.852+0000 7fef4ee30800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:52.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.852+0000 7fef4ee30800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:52.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.852+0000 7fef4ee30800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:52.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.852+0000 7fef4ee30800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:52.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.852+0000 7fef4ee30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:52.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.852+0000 7fef4ee30800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.853+0000 7fef4ee30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:52.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.853+0000 7fef4ee30800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.853+0000 7fef4ee30800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:52.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.853+0000 7fef4ee30800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.853+0000 7fef4ee30800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:52.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.853+0000 7fef4ee30800 20 zone default found 2024-09-12T00:18:52.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.853+0000 7fef4ee30800 4 Realm: () 2024-09-12T00:18:52.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.853+0000 7fef4ee30800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:52.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.853+0000 7fef4ee30800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:52.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.853+0000 7fef4ee30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:52.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.853+0000 7fef4ee30800 20 zonegroup default 2024-09-12T00:18:52.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.853+0000 7fef4ee30800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.854+0000 7fef4ee30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:52.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.854+0000 7fef4ee30800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.854+0000 7fef4ee30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:52.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.854+0000 7fef4ee30800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.854+0000 7fef4ee30800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:52.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.854+0000 7fef4ee30800 20 started sync module instance, tier type = 2024-09-12T00:18:52.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.854+0000 7fef4ee30800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:52.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.864+0000 7fef4ee30800 20 add_watcher() i=0 2024-09-12T00:18:52.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.864+0000 7fef4ee30800 20 add_watcher() i=1 2024-09-12T00:18:52.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.864+0000 7fef4ee30800 20 add_watcher() i=2 2024-09-12T00:18:52.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.864+0000 7fef4ee30800 20 add_watcher() i=3 2024-09-12T00:18:52.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.864+0000 7fef4ee30800 20 add_watcher() i=4 2024-09-12T00:18:52.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.864+0000 7fef4ee30800 20 add_watcher() i=5 2024-09-12T00:18:52.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.864+0000 7fef4ee30800 20 add_watcher() i=6 2024-09-12T00:18:52.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.865+0000 7fef4ee30800 20 add_watcher() i=7 2024-09-12T00:18:52.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.865+0000 7fef4ee30800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:52.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.867+0000 7fee00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:52.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.867+0000 7fef4ee30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:52.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.867+0000 7fef4ee30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:52.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.867+0000 7fef4ee30800 5 note: GC not initialized 2024-09-12T00:18:52.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.867+0000 7fed7b7fe640 20 reqs_thread_entry: start 2024-09-12T00:18:52.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.867+0000 7fef4ee30800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:52.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.867+0000 7fef4ee30800 20 Filter name: none 2024-09-12T00:18:52.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.868+0000 7fed797fa640 20 reqs_thread_entry: start 2024-09-12T00:18:52.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.868+0000 7fef4ee30800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.868+0000 7fef4ee30800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:52.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.868+0000 7fef4ee30800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.869+0000 7fef4ee30800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:52.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.869+0000 7fef4ee30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:52.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.869+0000 7fef4ee30800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.869+0000 7fef4ee30800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:52.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.869+0000 7fef4ee30800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.869+0000 7fef4ee30800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:52.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.869+0000 7fef4ee30800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:52.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.871+0000 7fee00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:52.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.873+0000 7fef4ee30800 20 remove_watcher() i=0 2024-09-12T00:18:52.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.873+0000 7fef4ee30800 2 removed watcher, disabling cache 2024-09-12T00:18:52.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.874+0000 7fef4ee30800 20 remove_watcher() i=1 2024-09-12T00:18:52.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.875+0000 7fef4ee30800 20 remove_watcher() i=2 2024-09-12T00:18:52.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.876+0000 7fef4ee30800 20 remove_watcher() i=3 2024-09-12T00:18:52.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.877+0000 7fef4ee30800 20 remove_watcher() i=4 2024-09-12T00:18:52.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.878+0000 7fef4ee30800 20 remove_watcher() i=5 2024-09-12T00:18:52.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.879+0000 7fef4ee30800 20 remove_watcher() i=6 2024-09-12T00:18:52.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.880+0000 7fef4ee30800 20 remove_watcher() i=7 2024-09-12T00:18:52.890 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:52.890 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:52.891 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-set-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:18:52.891 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:52.892 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T00:18:52.928 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:52.928 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:52.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.968+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:52.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.970+0000 7f9cfd333800 20 realm 2024-09-12T00:18:52.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:52.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.970+0000 7f9cfd333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:52.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:52.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.971+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:52.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.971+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.972+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:52.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.972+0000 7f9cfd333800 20 searching for the correct realm 2024-09-12T00:18:52.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.975+0000 7f9cf8819640 0 -- 172.21.15.67:0/3378070414 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f9cf00e4500 msgr2=0x7f9cf00df880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:52.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.979+0000 7f9cf981b640 0 -- 172.21.15.67:0/3378070414 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x559de3b67850 msgr2=0x559de3b69c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:52.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:52.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:52.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:52.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:52.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:52.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:52.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.983+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:52.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:52.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:52.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.984+0000 7f9cfd333800 20 zone default found 2024-09-12T00:18:52.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.984+0000 7f9cfd333800 4 Realm: () 2024-09-12T00:18:52.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.984+0000 7f9cfd333800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:52.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.984+0000 7f9cfd333800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:52.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.984+0000 7f9cfd333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:52.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.984+0000 7f9cfd333800 20 zonegroup default 2024-09-12T00:18:52.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:52.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.985+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:52.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.985+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.985+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:52.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.985+0000 7f9cfd333800 20 started sync module instance, tier type = 2024-09-12T00:18:52.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.985+0000 7f9cfd333800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:52.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=0 2024-09-12T00:18:52.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=1 2024-09-12T00:18:52.992 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=2 2024-09-12T00:18:52.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=3 2024-09-12T00:18:52.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=4 2024-09-12T00:18:52.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=5 2024-09-12T00:18:52.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=6 2024-09-12T00:18:52.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.994+0000 7f9cfd333800 20 add_watcher() i=7 2024-09-12T00:18:52.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.994+0000 7f9cfd333800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:52.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.995+0000 7f9baffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:52.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.996+0000 7f9cfd333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:52.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.996+0000 7f9cfd333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:52.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.996+0000 7f9cfd333800 5 note: GC not initialized 2024-09-12T00:18:52.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.996+0000 7f9baefe5640 20 reqs_thread_entry: start 2024-09-12T00:18:52.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.996+0000 7f9cfd333800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:52.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.996+0000 7f9cfd333800 20 Filter name: none 2024-09-12T00:18:52.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.996+0000 7f9bacfe1640 20 reqs_thread_entry: start 2024-09-12T00:18:52.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.996+0000 7f9cfd333800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:18:52.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.996+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.997+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:52.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.997+0000 7f9cfd333800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:18:52.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.997+0000 7f9cfd333800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:18:52.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.997+0000 7f9cfd333800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 : miss 2024-09-12T00:18:52.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.997+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:52.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.997+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:52.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.997+0000 7f9cfd333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 info.flags=0x17 2024-09-12T00:18:52.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.997+0000 7f9cfd333800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 to cache LRU end 2024-09-12T00:18:52.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.997+0000 7f9cfd333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:52.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.997+0000 7f9cfd333800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:52.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:52.997+0000 7f9cfd333800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 2024-09-12T00:18:52.999 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9cfd333800 time 2024-09-12T00:18:53.001941+0000 2024-09-12T00:18:52.999 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:18:53.000 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:53.000 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9cfe98c71a] 2024-09-12T00:18:53.000 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9cfe98c8d8] 2024-09-12T00:18:53.000 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559de2340641] 2024-09-12T00:18:53.000 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd878e8) [0x559de28528e8] 2024-09-12T00:18:53.000 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559de235031d] 2024-09-12T00:18:53.000 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:18:53.001 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9cfd629590] 2024-09-12T00:18:53.001 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:18:53.001 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:18:53.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.001+0000 7f9cfd333800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9cfd333800 time 2024-09-12T00:18:53.001941+0000 2024-09-12T00:18:53.001 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:18:53.001 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.001 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:53.001 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9cfe98c71a] 2024-09-12T00:18:53.001 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9cfe98c8d8] 2024-09-12T00:18:53.001 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559de2340641] 2024-09-12T00:18:53.001 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd878e8) [0x559de28528e8] 2024-09-12T00:18:53.001 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559de235031d] 2024-09-12T00:18:53.001 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:18:53.001 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9cfd629590] 2024-09-12T00:18:53.002 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:18:53.002 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:18:53.002 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.002 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:18:53.002 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f9cfd333800 thread_name:radosgw-admin 2024-09-12T00:18:53.016 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:53.016 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9cfd63e6f0] 2024-09-12T00:18:53.016 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9cfd68b99c] 2024-09-12T00:18:53.016 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:18:53.016 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:18:53.016 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9cfe98c774] 2024-09-12T00:18:53.016 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9cfe98c8d8] 2024-09-12T00:18:53.017 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559de2340641] 2024-09-12T00:18:53.017 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd878e8) [0x559de28528e8] 2024-09-12T00:18:53.017 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559de235031d] 2024-09-12T00:18:53.017 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:18:53.017 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9cfd629590] 2024-09-12T00:18:53.017 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:18:53.017 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:18:53.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.002+0000 7f9cfd333800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:18:53.017 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f9cfd333800 thread_name:radosgw-admin 2024-09-12T00:18:53.017 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.017 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:53.017 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9cfd63e6f0] 2024-09-12T00:18:53.017 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9cfd68b99c] 2024-09-12T00:18:53.018 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:18:53.018 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:18:53.018 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9cfe98c774] 2024-09-12T00:18:53.018 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9cfe98c8d8] 2024-09-12T00:18:53.018 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559de2340641] 2024-09-12T00:18:53.018 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd878e8) [0x559de28528e8] 2024-09-12T00:18:53.018 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559de235031d] 2024-09-12T00:18:53.018 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:18:53.018 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9cfd629590] 2024-09-12T00:18:53.018 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:18:53.018 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:18:53.018 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:18:53.018 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.019 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:18:53.019 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:18:52.949+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.019 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:18:52.949+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.019 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:18:52.949+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.019 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:18:52.949+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.019 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:18:52.949+0000 7f9cf981b640 10 monclient(hunting): get_auth_request con 0x559de39c5ac0 auth_method 0 2024-09-12T00:18:53.019 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:18:52.949+0000 7f9cf981b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.019 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:18:52.949+0000 7f9cf981b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.019 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:18:52.949+0000 7f9cf981b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.019 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:18:52.950+0000 7f9cf8819640 10 monclient(hunting): handle_auth_done global_id 6630 payload 274 2024-09-12T00:18:53.019 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:18:52.950+0000 7f9cf8819640 10 monclient: _finish_hunting 0 2024-09-12T00:18:53.020 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:18:52.950+0000 7f9cf8819640 1 monclient: found mon.noname-a 2024-09-12T00:18:53.020 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:18:52.950+0000 7f9cf8819640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.020 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.020 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:18:53.020 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: dump: 2024-09-12T00:18:53.020 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.020 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.020 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.020 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.020 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.020 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.020 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.020 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.021 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.021 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.021 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: _finish_auth 0 2024-09-12T00:18:53.021 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: _check_auth_tickets 2024-09-12T00:18:53.021 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:53.021 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:18:52.950+0000 7f9cfd333800 5 monclient: authenticate success, global_id 6630 2024-09-12T00:18:53.021 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:18:52.950+0000 7f9cfd333800 10 monclient: get_monmap_and_config success 2024-09-12T00:18:53.021 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:18:52.950+0000 7f9cfd333800 4 set_mon_vals no callback set 2024-09-12T00:18:53.021 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.021 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:18:53.021 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: dump: 2024-09-12T00:18:53.021 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.021 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.021 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.022 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.022 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.022 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.022 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.022 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.022 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.022 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.022 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:18:52.951+0000 7f9cfd333800 10 monclient: shutdown 2024-09-12T00:18:53.022 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 asok(0x559de385d630) unregister_commands rotate-key 2024-09-12T00:18:53.022 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:18:52.951+0000 7f9cfd333800 10 monclient: build_initial_monmap 2024-09-12T00:18:53.022 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:18:52.951+0000 7f9cfd333800 1 build_initial for_mkfs: 0 2024-09-12T00:18:53.022 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:18:52.951+0000 7f9cfd333800 10 monclient: monmap: 2024-09-12T00:18:53.022 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:53.022 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:53.023 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:53.023 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:53.023 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:53.023 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.023 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:53.023 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:53.023 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:53.023 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.023 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding auth protocol: cephx 2024-09-12T00:18:53.023 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding auth protocol: cephx 2024-09-12T00:18:53.023 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding auth protocol: cephx 2024-09-12T00:18:53.023 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: secure 2024-09-12T00:18:53.023 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: crc 2024-09-12T00:18:53.023 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: secure 2024-09-12T00:18:53.024 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: crc 2024-09-12T00:18:53.024 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: secure 2024-09-12T00:18:53.024 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: crc 2024-09-12T00:18:53.024 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: crc 2024-09-12T00:18:53.024 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: secure 2024-09-12T00:18:53.024 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: crc 2024-09-12T00:18:53.024 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: secure 2024-09-12T00:18:53.024 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: crc 2024-09-12T00:18:53.024 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: secure 2024-09-12T00:18:53.024 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:18:52.951+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.024 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:18:52.951+0000 7f9cfd333800 1 librados: starting msgr at 2024-09-12T00:18:53.024 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:18:52.951+0000 7f9cfd333800 1 librados: starting objecter 2024-09-12T00:18:53.025 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 asok(0x559de385d630) register_command objecter_requests hook 0x559de3a82740 2024-09-12T00:18:53.025 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:18:52.951+0000 7f9cfd333800 1 librados: setting wanted keys 2024-09-12T00:18:53.025 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:18:52.951+0000 7f9cfd333800 1 librados: calling monclient init 2024-09-12T00:18:53.025 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:18:52.951+0000 7f9cfd333800 10 monclient: init 2024-09-12T00:18:53.025 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding auth protocol: cephx 2024-09-12T00:18:53.025 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding auth protocol: cephx 2024-09-12T00:18:53.025 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding auth protocol: cephx 2024-09-12T00:18:53.025 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: secure 2024-09-12T00:18:53.025 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: crc 2024-09-12T00:18:53.025 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: secure 2024-09-12T00:18:53.025 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: crc 2024-09-12T00:18:53.025 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: secure 2024-09-12T00:18:53.025 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: crc 2024-09-12T00:18:53.026 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: crc 2024-09-12T00:18:53.026 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: secure 2024-09-12T00:18:53.026 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: crc 2024-09-12T00:18:53.026 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: secure 2024-09-12T00:18:53.026 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: crc 2024-09-12T00:18:53.026 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: secure 2024-09-12T00:18:53.026 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:18:52.952+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.026 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:18:52.952+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.026 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:18:52.952+0000 7f9cfd333800 5 asok(0x559de385d630) register_command rotate-key hook 0x559de3a7c5f8 2024-09-12T00:18:53.026 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:53.026 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:18:53.026 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-a con 0x559de3935d20 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:53.026 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-c con 0x559de39bf870 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:53.026 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-b con 0x559de39c5ac0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:53.027 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.027 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.027 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.027 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:53.027 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): authenticate will time out at 1810.209329s 2024-09-12T00:18:53.027 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): get_auth_request con 0x559de3935d20 auth_method 0 2024-09-12T00:18:53.027 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.027 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.027 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.027 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:18:52.952+0000 7f9cf8819640 10 monclient(hunting): get_auth_request con 0x559de39bf870 auth_method 0 2024-09-12T00:18:53.027 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:18:52.952+0000 7f9cf8819640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.027 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:18:52.952+0000 7f9cf8819640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.027 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:18:52.952+0000 7f9cf8819640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.027 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.028 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.028 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.028 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:18:52.952+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.028 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:18:52.952+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.028 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:18:52.952+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.028 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): handle_auth_done global_id 6633 payload 824 2024-09-12T00:18:53.028 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient: _finish_hunting 0 2024-09-12T00:18:53.028 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:18:52.952+0000 7f9cf901a640 1 monclient: found mon.noname-a 2024-09-12T00:18:53.028 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.028 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.028 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:18:53.028 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: dump: 2024-09-12T00:18:53.028 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.028 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.029 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.029 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.029 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.029 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.029 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.029 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.029 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.029 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.029 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: _finish_auth 0 2024-09-12T00:18:53.029 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: _check_auth_tickets 2024-09-12T00:18:53.029 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:53.029 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.029 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:18:53.029 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: dump: 2024-09-12T00:18:53.030 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.030 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.030 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.030 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.030 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.030 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.030 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.030 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.030 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.030 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.030 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:18:52.952+0000 7f9cfd333800 5 monclient: authenticate success, global_id 6633 2024-09-12T00:18:53.030 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient: _renew_subs 2024-09-12T00:18:53.030 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.030 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:18:52.952+0000 7f9be7606640 4 set_mon_vals no callback set 2024-09-12T00:18:53.031 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:18:52.953+0000 7f9cfd333800 10 monclient: _renew_subs 2024-09-12T00:18:53.031 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:18:52.953+0000 7f9cfd333800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.031 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:18:52.953+0000 7f9cfd333800 1 librados: init done 2024-09-12T00:18:53.031 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:18:52.955+0000 7f9be5e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:18:53.031 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:18:52.955+0000 7f9be5e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:53.031 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:18:52.955+0000 7f9be5e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:53.031 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:18:52.955+0000 7f9cf8819640 10 monclient: get_auth_request con 0x7f9be0076470 auth_method 0 2024-09-12T00:18:53.031 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:18:52.955+0000 7f9cf981b640 10 monclient: get_auth_request con 0x559de3aa5450 auth_method 0 2024-09-12T00:18:53.031 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:18:52.956+0000 7f9cf901a640 10 monclient: get_auth_request con 0x559de3ac7cd0 auth_method 0 2024-09-12T00:18:53.031 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:18:52.957+0000 7f9cf8819640 10 monclient: get_auth_request con 0x559de3acc030 auth_method 0 2024-09-12T00:18:53.031 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:18:52.958+0000 7f9cfd333800 10 monclient: build_initial_monmap 2024-09-12T00:18:53.031 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:18:52.958+0000 7f9cfd333800 1 build_initial for_mkfs: 0 2024-09-12T00:18:53.031 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:18:52.958+0000 7f9cfd333800 10 monclient: monmap: 2024-09-12T00:18:53.031 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:53.032 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:53.032 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:53.032 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:53.032 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:53.032 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.032 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:53.032 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:53.032 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:53.032 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.032 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding auth protocol: cephx 2024-09-12T00:18:53.032 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding auth protocol: cephx 2024-09-12T00:18:53.032 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding auth protocol: cephx 2024-09-12T00:18:53.032 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: secure 2024-09-12T00:18:53.032 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: crc 2024-09-12T00:18:53.033 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: secure 2024-09-12T00:18:53.033 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: crc 2024-09-12T00:18:53.033 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: secure 2024-09-12T00:18:53.033 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: crc 2024-09-12T00:18:53.033 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: crc 2024-09-12T00:18:53.033 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: secure 2024-09-12T00:18:53.033 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: crc 2024-09-12T00:18:53.033 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: secure 2024-09-12T00:18:53.033 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: crc 2024-09-12T00:18:53.033 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: secure 2024-09-12T00:18:53.033 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:18:52.959+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.033 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 asok(0x559de385d630) register_command objecter_requests cmddesc objecter_requests hook 0x559de3ad4850 EEXIST 2024-09-12T00:18:53.033 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:18:52.959+0000 7f9cfd333800 10 monclient: init 2024-09-12T00:18:53.033 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding auth protocol: cephx 2024-09-12T00:18:53.034 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding auth protocol: cephx 2024-09-12T00:18:53.034 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding auth protocol: cephx 2024-09-12T00:18:53.034 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: secure 2024-09-12T00:18:53.034 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: crc 2024-09-12T00:18:53.034 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: secure 2024-09-12T00:18:53.034 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: crc 2024-09-12T00:18:53.034 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: secure 2024-09-12T00:18:53.034 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: crc 2024-09-12T00:18:53.034 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: crc 2024-09-12T00:18:53.034 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: secure 2024-09-12T00:18:53.034 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: crc 2024-09-12T00:18:53.034 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: secure 2024-09-12T00:18:53.034 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: crc 2024-09-12T00:18:53.034 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: secure 2024-09-12T00:18:53.035 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:18:52.959+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.035 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:18:52.959+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.035 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:18:52.960+0000 7f9cfd333800 5 asok(0x559de385d630) register_command rotate-key cmddesc rotate-key hook 0x559de3acf660 EEXIST 2024-09-12T00:18:53.035 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:53.035 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:18:53.035 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-b con 0x559de3af8540 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:53.035 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-a con 0x559de3afa810 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:53.035 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-c con 0x559de3af6d10 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:53.035 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.035 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.035 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.035 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:53.035 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): authenticate will time out at 1810.217090s 2024-09-12T00:18:53.035 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:18:52.960+0000 7f9cf981b640 10 monclient(hunting): get_auth_request con 0x559de3af6d10 auth_method 0 2024-09-12T00:18:53.036 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:18:52.960+0000 7f9cf981b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.036 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:18:52.960+0000 7f9cf981b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.036 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:18:52.960+0000 7f9cf981b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.036 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): get_auth_request con 0x559de3afa810 auth_method 0 2024-09-12T00:18:53.036 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.036 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.036 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.036 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:18:52.960+0000 7f9cf901a640 10 monclient(hunting): get_auth_request con 0x559de3af8540 auth_method 0 2024-09-12T00:18:53.036 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:18:52.960+0000 7f9cf901a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.036 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:18:52.960+0000 7f9cf901a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.036 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:18:52.960+0000 7f9cf901a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.036 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.036 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.036 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.037 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:18:52.960+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.037 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:18:52.960+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.037 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:18:52.960+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.037 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): handle_auth_done global_id 6636 payload 824 2024-09-12T00:18:53.037 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient: _finish_hunting 0 2024-09-12T00:18:53.037 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:18:52.960+0000 7f9cf8819640 1 monclient: found mon.noname-a 2024-09-12T00:18:53.037 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.037 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.037 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:18:53.037 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: dump: 2024-09-12T00:18:53.037 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.037 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.037 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.038 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.038 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.038 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.038 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.038 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.038 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.038 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.039 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: _finish_auth 0 2024-09-12T00:18:53.039 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: _check_auth_tickets 2024-09-12T00:18:53.039 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:53.039 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.039 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:18:53.039 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: dump: 2024-09-12T00:18:53.039 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.039 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.039 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.040 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.040 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.040 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.040 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.040 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.040 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.040 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.040 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:18:52.960+0000 7f9cfd333800 5 monclient: authenticate success, global_id 6636 2024-09-12T00:18:53.040 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient: _renew_subs 2024-09-12T00:18:53.040 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.040 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:18:52.960+0000 7f9cfa01c640 4 set_mon_vals no callback set 2024-09-12T00:18:53.040 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient: _renew_subs 2024-09-12T00:18:53.040 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.041 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:18:52.962+0000 7f9bdeffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:18:53.041 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:18:52.962+0000 7f9bdeffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:53.041 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:18:52.962+0000 7f9bdeffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:53.041 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:18:52.962+0000 7f9cf901a640 10 monclient: get_auth_request con 0x7f9bd4076380 auth_method 0 2024-09-12T00:18:53.041 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient: get_monmap_and_config 2024-09-12T00:18:53.041 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient: build_initial_monmap 2024-09-12T00:18:53.041 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:18:52.963+0000 7f9cfd333800 1 build_initial for_mkfs: 0 2024-09-12T00:18:53.041 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient: monmap: 2024-09-12T00:18:53.041 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:53.041 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:53.041 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:53.041 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:53.041 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:53.041 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.042 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:53.042 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:53.042 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:53.042 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.042 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding auth protocol: cephx 2024-09-12T00:18:53.042 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding auth protocol: cephx 2024-09-12T00:18:53.042 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding auth protocol: cephx 2024-09-12T00:18:53.042 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: secure 2024-09-12T00:18:53.042 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: crc 2024-09-12T00:18:53.042 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: secure 2024-09-12T00:18:53.042 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: crc 2024-09-12T00:18:53.042 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: secure 2024-09-12T00:18:53.042 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: crc 2024-09-12T00:18:53.043 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: crc 2024-09-12T00:18:53.043 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: secure 2024-09-12T00:18:53.043 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: crc 2024-09-12T00:18:53.043 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: secure 2024-09-12T00:18:53.043 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: crc 2024-09-12T00:18:53.043 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: secure 2024-09-12T00:18:53.043 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:18:52.963+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.043 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient: init 2024-09-12T00:18:53.043 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding auth protocol: cephx 2024-09-12T00:18:53.043 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding auth protocol: cephx 2024-09-12T00:18:53.043 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding auth protocol: cephx 2024-09-12T00:18:53.043 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: secure 2024-09-12T00:18:53.043 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: crc 2024-09-12T00:18:53.043 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: secure 2024-09-12T00:18:53.044 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: crc 2024-09-12T00:18:53.044 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: secure 2024-09-12T00:18:53.044 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: crc 2024-09-12T00:18:53.044 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: crc 2024-09-12T00:18:53.044 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: secure 2024-09-12T00:18:53.044 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: crc 2024-09-12T00:18:53.044 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: secure 2024-09-12T00:18:53.044 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: crc 2024-09-12T00:18:53.044 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: secure 2024-09-12T00:18:53.044 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:18:52.963+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.044 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:18:52.963+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.044 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 asok(0x559de385d630) register_command rotate-key cmddesc rotate-key hook 0x7ffe12e5f9c8 EEXIST 2024-09-12T00:18:53.044 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:53.044 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:18:53.045 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-a con 0x559de3b479a0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:53.045 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-b con 0x559de3b521b0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:53.045 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-c con 0x559de3b49c40 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:53.045 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.045 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.045 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.045 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:53.045 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:18:52.964+0000 7f9cfd333800 10 monclient(hunting): authenticate will time out at 1810.221004s 2024-09-12T00:18:53.045 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:18:52.964+0000 7f9cf981b640 10 monclient(hunting): get_auth_request con 0x559de3b49c40 auth_method 0 2024-09-12T00:18:53.045 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:18:52.964+0000 7f9cf981b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.045 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:18:52.964+0000 7f9cf981b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.045 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:18:52.964+0000 7f9cf981b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.045 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): get_auth_request con 0x559de3b479a0 auth_method 0 2024-09-12T00:18:53.046 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.046 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.046 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.046 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:18:52.964+0000 7f9cf981b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.046 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:18:52.964+0000 7f9cf981b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.046 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:18:52.964+0000 7f9cf981b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.046 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.046 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.046 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.046 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): handle_auth_done global_id 6639 payload 274 2024-09-12T00:18:53.046 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient: _finish_hunting 0 2024-09-12T00:18:53.046 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:18:52.964+0000 7f9cf901a640 1 monclient: found mon.noname-a 2024-09-12T00:18:53.046 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.047 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.047 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:18:53.047 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: dump: 2024-09-12T00:18:53.047 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.047 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.047 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.047 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.047 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.047 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.047 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.047 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.047 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.047 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.047 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: _finish_auth 0 2024-09-12T00:18:53.048 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: _check_auth_tickets 2024-09-12T00:18:53.048 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:53.048 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.048 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:18:53.048 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: dump: 2024-09-12T00:18:53.048 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.048 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.048 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.048 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.048 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.048 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.048 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.048 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.049 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.049 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.049 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:18:52.964+0000 7f9cfd333800 5 monclient: authenticate success, global_id 6639 2024-09-12T00:18:53.049 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:18:52.964+0000 7f9cfd333800 10 monclient: get_monmap_and_config success 2024-09-12T00:18:53.049 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:18:52.964+0000 7f9cfd333800 4 set_mon_vals no callback set 2024-09-12T00:18:53.049 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:18:52.965+0000 7f9cfd333800 10 monclient: shutdown 2024-09-12T00:18:53.049 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:18:52.965+0000 7f9cfd333800 10 monclient: build_initial_monmap 2024-09-12T00:18:53.049 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:18:52.965+0000 7f9cfd333800 1 build_initial for_mkfs: 0 2024-09-12T00:18:53.049 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:18:52.965+0000 7f9cfd333800 10 monclient: monmap: 2024-09-12T00:18:53.049 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:53.049 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:53.049 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:53.049 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:53.049 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:53.050 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.050 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:53.050 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:53.050 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:53.050 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.050 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding auth protocol: cephx 2024-09-12T00:18:53.050 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding auth protocol: cephx 2024-09-12T00:18:53.050 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding auth protocol: cephx 2024-09-12T00:18:53.050 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: secure 2024-09-12T00:18:53.050 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: crc 2024-09-12T00:18:53.050 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: secure 2024-09-12T00:18:53.050 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: crc 2024-09-12T00:18:53.050 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: secure 2024-09-12T00:18:53.051 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: crc 2024-09-12T00:18:53.051 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: crc 2024-09-12T00:18:53.051 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: secure 2024-09-12T00:18:53.051 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: crc 2024-09-12T00:18:53.051 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: secure 2024-09-12T00:18:53.051 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: crc 2024-09-12T00:18:53.051 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: secure 2024-09-12T00:18:53.051 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:18:52.965+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.051 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:18:52.965+0000 7f9cfd333800 1 librados: starting msgr at 2024-09-12T00:18:53.051 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:18:52.965+0000 7f9cfd333800 1 librados: starting objecter 2024-09-12T00:18:53.051 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 asok(0x559de385d630) register_command objecter_requests cmddesc objecter_requests hook 0x559de3af6980 EEXIST 2024-09-12T00:18:53.051 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:18:52.965+0000 7f9cfd333800 1 librados: setting wanted keys 2024-09-12T00:18:53.051 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:18:52.965+0000 7f9cfd333800 1 librados: calling monclient init 2024-09-12T00:18:53.051 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:18:52.965+0000 7f9cfd333800 10 monclient: init 2024-09-12T00:18:53.052 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding auth protocol: cephx 2024-09-12T00:18:53.052 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding auth protocol: cephx 2024-09-12T00:18:53.052 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding auth protocol: cephx 2024-09-12T00:18:53.052 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: secure 2024-09-12T00:18:53.052 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: crc 2024-09-12T00:18:53.052 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: secure 2024-09-12T00:18:53.052 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: crc 2024-09-12T00:18:53.052 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: secure 2024-09-12T00:18:53.052 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: crc 2024-09-12T00:18:53.052 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: crc 2024-09-12T00:18:53.052 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: secure 2024-09-12T00:18:53.052 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: crc 2024-09-12T00:18:53.052 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: secure 2024-09-12T00:18:53.053 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: crc 2024-09-12T00:18:53.053 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: secure 2024-09-12T00:18:53.053 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:18:52.965+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.053 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:18:52.966+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.053 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:18:52.966+0000 7f9cfd333800 5 asok(0x559de385d630) register_command rotate-key cmddesc rotate-key hook 0x559de3b10438 EEXIST 2024-09-12T00:18:53.053 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:53.053 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:18:53.053 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-c con 0x559de3b479a0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:53.053 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-a con 0x559de3b49c40 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:53.053 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-b con 0x559de3b521b0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:53.053 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.053 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.053 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.054 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:53.054 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): authenticate will time out at 1810.223291s 2024-09-12T00:18:53.054 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): get_auth_request con 0x559de3b479a0 auth_method 0 2024-09-12T00:18:53.054 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.054 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.054 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.054 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:18:52.966+0000 7f9cf8819640 10 monclient(hunting): get_auth_request con 0x559de3b49c40 auth_method 0 2024-09-12T00:18:53.054 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:18:52.966+0000 7f9cf8819640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.054 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:18:52.966+0000 7f9cf8819640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.054 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:18:52.966+0000 7f9cf8819640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.054 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.054 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.054 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.054 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:18:52.966+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.055 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:18:52.966+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.055 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:18:52.966+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.055 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:18:52.966+0000 7f9cf981b640 10 monclient(hunting): get_auth_request con 0x559de3b521b0 auth_method 0 2024-09-12T00:18:53.055 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:18:52.966+0000 7f9cf981b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.055 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:18:52.966+0000 7f9cf981b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.055 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:18:52.966+0000 7f9cf981b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.055 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:18:52.966+0000 7f9cf981b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.055 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:18:52.966+0000 7f9cf981b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.055 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:18:52.966+0000 7f9cf981b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.055 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): handle_auth_done global_id 6245 payload 824 2024-09-12T00:18:53.055 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient: _finish_hunting 0 2024-09-12T00:18:53.055 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:18:52.966+0000 7f9cf901a640 1 monclient: found mon.noname-c 2024-09-12T00:18:53.055 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:18:53.056 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.056 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:18:53.056 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: dump: 2024-09-12T00:18:53.056 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.056 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.056 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.056 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.056 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.056 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.056 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.056 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.056 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.056 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.057 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: _finish_auth 0 2024-09-12T00:18:53.057 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: _check_auth_tickets 2024-09-12T00:18:53.057 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:53.057 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.057 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:18:53.057 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: dump: 2024-09-12T00:18:53.057 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.057 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.057 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.057 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.057 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.057 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.057 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.058 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.058 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.058 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.058 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:18:52.966+0000 7f9cfd333800 5 monclient: authenticate success, global_id 6245 2024-09-12T00:18:53.058 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:18:52.967+0000 7f9cfd333800 10 monclient: _renew_subs 2024-09-12T00:18:53.058 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:18:52.966+0000 7f9bdcff9640 4 set_mon_vals no callback set 2024-09-12T00:18:53.058 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:18:52.967+0000 7f9cfd333800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:53.058 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:18:52.967+0000 7f9cfd333800 10 monclient: _renew_subs 2024-09-12T00:18:53.058 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:18:52.967+0000 7f9cfd333800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:53.058 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:18:52.967+0000 7f9cfd333800 1 librados: init done 2024-09-12T00:18:53.058 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:18:52.967+0000 7f9cfd333800 5 asok(0x559de385d630) register_command cr dump hook 0x559de3b456a8 2024-09-12T00:18:53.058 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:18:52.968+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.058 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:18:52.969+0000 7f9bcaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:18:53.058 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:18:52.969+0000 7f9bcaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:53.059 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:18:52.969+0000 7f9bcaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:53.059 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:18:52.969+0000 7f9cf8819640 10 monclient: get_auth_request con 0x7f9bc4076470 auth_method 0 2024-09-12T00:18:53.059 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:18:52.969+0000 7f9cf981b640 10 monclient: get_auth_request con 0x559de3b67850 auth_method 0 2024-09-12T00:18:53.059 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.059 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:18:52.970+0000 7f9cfd333800 20 realm 2024-09-12T00:18:53.059 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.059 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.059 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:18:52.970+0000 7f9cfd333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:53.059 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.059 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.059 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.059 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:18:52.971+0000 7f9cf901a640 10 monclient: get_auth_request con 0x559de3b6bba0 auth_method 0 2024-09-12T00:18:53.059 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:18:52.971+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:53.060 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:18:52.971+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.060 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:18:52.971+0000 7f9cf8819640 10 monclient: get_auth_request con 0x559de3b6f300 auth_method 0 2024-09-12T00:18:53.060 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:18:52.972+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:53.060 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:18:52.972+0000 7f9cfd333800 20 searching for the correct realm 2024-09-12T00:18:53.060 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:18:52.973+0000 7f9cf981b640 10 monclient: get_auth_request con 0x7f9cf00e40e0 auth_method 0 2024-09-12T00:18:53.060 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:18:52.974+0000 7f9cf901a640 10 monclient: get_auth_request con 0x7f9cec097970 auth_method 0 2024-09-12T00:18:53.060 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:18:52.975+0000 7f9cf8819640 10 monclient: get_auth_request con 0x7f9cf00e4500 auth_method 0 2024-09-12T00:18:53.060 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:18:52.975+0000 7f9cf8819640 0 -- 172.21.15.67:0/3378070414 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f9cf00e4500 msgr2=0x7f9cf00df880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:53.060 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:18:52.975+0000 7f9bcaffd640 1 client.6245.objecter ms_handle_reset 0x7f9cf00e4500 session 0x7f9cf0005040 osd.5 2024-09-12T00:18:53.060 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:18:52.975+0000 7f9bcaffd640 10 monclient: _renew_subs 2024-09-12T00:18:53.060 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:18:52.975+0000 7f9bcaffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:53.060 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:18:52.975+0000 7f9cf8819640 10 monclient: get_auth_request con 0x7f9bc4086710 auth_method 0 2024-09-12T00:18:53.060 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:18:52.978+0000 7f9cf981b640 10 monclient: get_auth_request con 0x7f9cec05b4f0 auth_method 0 2024-09-12T00:18:53.061 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:18:52.978+0000 7f9cf901a640 10 monclient: get_auth_request con 0x7f9cf4018040 auth_method 0 2024-09-12T00:18:53.061 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:18:52.979+0000 7f9cf981b640 0 -- 172.21.15.67:0/3378070414 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x559de3b67850 msgr2=0x559de3b69c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:53.061 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:18:52.979+0000 7f9bcaffd640 1 client.6245.objecter ms_handle_reset 0x559de3b67850 session 0x559de3b671d0 osd.6 2024-09-12T00:18:53.061 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:18:52.980+0000 7f9cf981b640 10 monclient: get_auth_request con 0x7f9cf00e4500 auth_method 0 2024-09-12T00:18:53.061 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:53.061 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:53.061 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:53.061 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:53.061 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:53.061 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:53.061 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:18:52.983+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.061 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.061 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.062 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:53.062 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.062 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:53.062 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 zone default found 2024-09-12T00:18:53.062 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:18:52.984+0000 7f9cfd333800 4 Realm: () 2024-09-12T00:18:53.062 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:18:52.984+0000 7f9cfd333800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:53.062 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:18:52.984+0000 7f9cfd333800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:53.062 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:18:52.984+0000 7f9cfd333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:53.062 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 zonegroup default 2024-09-12T00:18:53.062 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.062 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.062 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.062 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:18:52.985+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.062 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:18:52.985+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.063 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:18:52.985+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.063 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:18:52.985+0000 7f9cfd333800 20 started sync module instance, tier type = 2024-09-12T00:18:53.063 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:18:52.985+0000 7f9cfd333800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:53.063 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=0 2024-09-12T00:18:53.063 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=1 2024-09-12T00:18:53.063 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=2 2024-09-12T00:18:53.063 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=3 2024-09-12T00:18:53.063 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=4 2024-09-12T00:18:53.063 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=5 2024-09-12T00:18:53.063 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=6 2024-09-12T00:18:53.063 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:18:52.994+0000 7f9cfd333800 20 add_watcher() i=7 2024-09-12T00:18:53.063 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:18:52.994+0000 7f9cfd333800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:53.063 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding auth protocol: cephx 2024-09-12T00:18:53.064 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding auth protocol: cephx 2024-09-12T00:18:53.064 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding auth protocol: cephx 2024-09-12T00:18:53.064 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: secure 2024-09-12T00:18:53.064 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: crc 2024-09-12T00:18:53.064 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: secure 2024-09-12T00:18:53.064 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: crc 2024-09-12T00:18:53.064 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: secure 2024-09-12T00:18:53.064 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:18:52.995+0000 7f9baffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:53.064 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: crc 2024-09-12T00:18:53.064 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: crc 2024-09-12T00:18:53.064 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: secure 2024-09-12T00:18:53.064 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: crc 2024-09-12T00:18:53.064 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: secure 2024-09-12T00:18:53.065 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: crc 2024-09-12T00:18:53.065 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: secure 2024-09-12T00:18:53.065 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:18:52.996+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.065 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:18:52.996+0000 7f9cfd333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:53.065 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:18:52.996+0000 7f9cfd333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:53.065 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command cache list hook 0x559de3b421d0 2024-09-12T00:18:53.065 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command cache inspect hook 0x559de3b421d0 2024-09-12T00:18:53.065 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command cache erase hook 0x559de3b421d0 2024-09-12T00:18:53.065 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command cache zap hook 0x559de3b421d0 2024-09-12T00:18:53.065 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 note: GC not initialized 2024-09-12T00:18:53.065 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:18:52.996+0000 7f9baefe5640 20 reqs_thread_entry: start 2024-09-12T00:18:53.065 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command sync trace show hook 0x7f9cec00e070 2024-09-12T00:18:53.066 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command sync trace history hook 0x7f9cec00e070 2024-09-12T00:18:53.066 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command sync trace active hook 0x7f9cec00e070 2024-09-12T00:18:53.066 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command sync trace active_short hook 0x7f9cec00e070 2024-09-12T00:18:53.066 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:18:52.996+0000 7f9cfd333800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:53.066 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:18:52.996+0000 7f9cfd333800 20 Filter name: none 2024-09-12T00:18:53.066 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:18:52.996+0000 7f9bacfe1640 20 reqs_thread_entry: start 2024-09-12T00:18:53.066 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:18:52.996+0000 7f9cfd333800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:18:53.066 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:18:52.996+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.066 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:18:52.997+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:53.066 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:18:53.066 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:18:53.066 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 : miss 2024-09-12T00:18:53.066 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:18:52.997+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.067 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:18:52.997+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:53.067 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 info.flags=0x17 2024-09-12T00:18:53.067 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 to cache LRU end 2024-09-12T00:18:53.067 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:53.067 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:53.067 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 2024-09-12T00:18:53.067 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:18:53.001+0000 7f9cfd333800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9cfd333800 time 2024-09-12T00:18:53.001941+0000 2024-09-12T00:18:53.067 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:18:53.067 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.067 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:53.067 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9cfe98c71a] 2024-09-12T00:18:53.067 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9cfe98c8d8] 2024-09-12T00:18:53.067 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559de2340641] 2024-09-12T00:18:53.067 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd878e8) [0x559de28528e8] 2024-09-12T00:18:53.068 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559de235031d] 2024-09-12T00:18:53.068 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:18:53.068 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9cfd629590] 2024-09-12T00:18:53.068 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:18:53.068 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:18:53.068 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.068 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:18:53.002+0000 7f9cfd333800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:18:53.068 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f9cfd333800 thread_name:radosgw-admin 2024-09-12T00:18:53.068 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.068 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:53.068 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9cfd63e6f0] 2024-09-12T00:18:53.068 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9cfd68b99c] 2024-09-12T00:18:53.068 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:18:53.069 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:18:53.069 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9cfe98c774] 2024-09-12T00:18:53.069 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9cfe98c8d8] 2024-09-12T00:18:53.069 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559de2340641] 2024-09-12T00:18:53.069 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd878e8) [0x559de28528e8] 2024-09-12T00:18:53.069 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559de235031d] 2024-09-12T00:18:53.069 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:18:53.069 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9cfd629590] 2024-09-12T00:18:53.069 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:18:53.069 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:18:53.069 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:18:53.069 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.069 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:18:53.069 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:18:53.070 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:18:53.070 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:18:53.070 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:18:53.070 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:18:53.070 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:18:53.070 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:18:53.070 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:18:53.070 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:18:53.070 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:18:53.070 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:18:53.070 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:18:53.070 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:18:53.070 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:18:53.070 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:18:53.071 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:18:53.071 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:18:53.071 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:18:53.071 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:18:53.071 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:18:53.071 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:18:53.071 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:18:53.071 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:18:53.071 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:18:53.071 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:18:53.071 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:18:53.071 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:18:53.071 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:18:53.071 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:18:53.072 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:18:53.072 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:18:53.072 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:18:53.072 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:18:53.072 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:18:53.072 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:18:53.072 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:18:53.072 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:18:53.072 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:18:53.072 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:18:53.072 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:18:53.072 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:18:53.072 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:18:53.072 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:18:53.072 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:18:53.073 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:18:53.073 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:18:53.073 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:18:53.073 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:18:53.073 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:18:53.073 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:18:53.073 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:18:53.073 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:18:53.073 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:18:53.073 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:18:53.073 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:18:53.073 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:18:53.073 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:18:53.073 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:18:53.074 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:18:53.074 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:18:53.074 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:18:53.074 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:18:53.074 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:18:53.074 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:18:53.074 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:18:53.074 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:18:53.074 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:18:53.074 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:18:53.074 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:18:53.074 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:18:53.074 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:18:53.074 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:18:53.075 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:18:53.075 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:18:53.075 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:18:53.075 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:18:53.075 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:18:53.075 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:18:53.075 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:18:53.075 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:18:53.075 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:18:53.075 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:18:53.075 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:18:53.075 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:18:53.075 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:18:53.075 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:18:53.076 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:18:53.076 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:18:53.076 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:18:53.076 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:18:53.076 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:18:53.076 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:18:53.076 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:18:53.076 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9bacfe1640 / http_manager 2024-09-12T00:18:53.076 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9baefe5640 / http_manager 2024-09-12T00:18:53.076 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9baffe7640 / rgw_dt_lg_renew 2024-09-12T00:18:53.076 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9bcaffd640 / ms_dispatch 2024-09-12T00:18:53.076 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9bdcff9640 / io_context_pool 2024-09-12T00:18:53.076 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9bdeffd640 / ms_dispatch 2024-09-12T00:18:53.077 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9be5e03640 / ms_dispatch 2024-09-12T00:18:53.077 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9be7606640 / io_context_pool 2024-09-12T00:18:53.077 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9cf8819640 / msgr-worker-2 2024-09-12T00:18:53.077 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9cf901a640 / msgr-worker-1 2024-09-12T00:18:53.077 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9cf981b640 / msgr-worker-0 2024-09-12T00:18:53.077 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9cfa01c640 / io_context_pool 2024-09-12T00:18:53.077 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9cfd333800 / radosgw-admin 2024-09-12T00:18:53.077 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:18:53.077 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:18:53.077 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.98740.log 2024-09-12T00:18:53.077 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:18:53.077 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:18:53.077 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:18:52.949+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.077 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:18:52.949+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.078 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:18:52.949+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.078 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:18:52.949+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.078 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:18:52.949+0000 7f9cf981b640 10 monclient(hunting): get_auth_request con 0x559de39c5ac0 auth_method 0 2024-09-12T00:18:53.078 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:18:52.949+0000 7f9cf981b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.078 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:18:52.949+0000 7f9cf981b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.078 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:18:52.949+0000 7f9cf981b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.078 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:18:52.950+0000 7f9cf8819640 10 monclient(hunting): handle_auth_done global_id 6630 payload 274 2024-09-12T00:18:53.078 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:18:52.950+0000 7f9cf8819640 10 monclient: _finish_hunting 0 2024-09-12T00:18:53.078 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:18:52.950+0000 7f9cf8819640 1 monclient: found mon.noname-a 2024-09-12T00:18:53.078 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:18:52.950+0000 7f9cf8819640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.078 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.078 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:18:53.078 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: dump: 2024-09-12T00:18:53.078 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.079 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.079 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.079 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.079 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.079 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.079 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.079 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.079 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.079 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.079 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: _finish_auth 0 2024-09-12T00:18:53.079 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: _check_auth_tickets 2024-09-12T00:18:53.079 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:53.079 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:18:52.950+0000 7f9cfd333800 5 monclient: authenticate success, global_id 6630 2024-09-12T00:18:53.080 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:18:52.950+0000 7f9cfd333800 10 monclient: get_monmap_and_config success 2024-09-12T00:18:53.080 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:18:52.950+0000 7f9cfd333800 4 set_mon_vals no callback set 2024-09-12T00:18:53.080 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.080 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:18:53.080 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:18:52.950+0000 7f9be7606640 10 monclient: dump: 2024-09-12T00:18:53.080 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.080 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.080 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.080 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.080 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.080 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.080 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.080 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.081 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.081 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.081 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:18:52.951+0000 7f9cfd333800 10 monclient: shutdown 2024-09-12T00:18:53.081 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 asok(0x559de385d630) unregister_commands rotate-key 2024-09-12T00:18:53.081 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:18:52.951+0000 7f9cfd333800 10 monclient: build_initial_monmap 2024-09-12T00:18:53.081 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:18:52.951+0000 7f9cfd333800 1 build_initial for_mkfs: 0 2024-09-12T00:18:53.081 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:18:52.951+0000 7f9cfd333800 10 monclient: monmap: 2024-09-12T00:18:53.081 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:53.081 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:53.081 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:53.081 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:53.081 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:53.081 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.082 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:53.082 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:53.082 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:53.082 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.082 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding auth protocol: cephx 2024-09-12T00:18:53.082 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding auth protocol: cephx 2024-09-12T00:18:53.082 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding auth protocol: cephx 2024-09-12T00:18:53.082 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: secure 2024-09-12T00:18:53.082 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: crc 2024-09-12T00:18:53.082 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: secure 2024-09-12T00:18:53.082 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: crc 2024-09-12T00:18:53.082 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: secure 2024-09-12T00:18:53.082 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: crc 2024-09-12T00:18:53.082 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: crc 2024-09-12T00:18:53.082 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: secure 2024-09-12T00:18:53.083 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: crc 2024-09-12T00:18:53.083 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: secure 2024-09-12T00:18:53.083 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: crc 2024-09-12T00:18:53.083 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7f7a0) adding con mode: secure 2024-09-12T00:18:53.083 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:18:52.951+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.083 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:18:52.951+0000 7f9cfd333800 1 librados: starting msgr at 2024-09-12T00:18:53.083 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:18:52.951+0000 7f9cfd333800 1 librados: starting objecter 2024-09-12T00:18:53.083 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 asok(0x559de385d630) register_command objecter_requests hook 0x559de3a82740 2024-09-12T00:18:53.083 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:18:52.951+0000 7f9cfd333800 1 librados: setting wanted keys 2024-09-12T00:18:53.083 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:18:52.951+0000 7f9cfd333800 1 librados: calling monclient init 2024-09-12T00:18:53.083 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:18:52.951+0000 7f9cfd333800 10 monclient: init 2024-09-12T00:18:53.083 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding auth protocol: cephx 2024-09-12T00:18:53.083 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding auth protocol: cephx 2024-09-12T00:18:53.084 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding auth protocol: cephx 2024-09-12T00:18:53.084 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: secure 2024-09-12T00:18:53.084 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: crc 2024-09-12T00:18:53.084 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: secure 2024-09-12T00:18:53.084 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: crc 2024-09-12T00:18:53.084 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: secure 2024-09-12T00:18:53.084 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: crc 2024-09-12T00:18:53.084 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: crc 2024-09-12T00:18:53.084 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: secure 2024-09-12T00:18:53.084 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: crc 2024-09-12T00:18:53.084 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: secure 2024-09-12T00:18:53.084 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: crc 2024-09-12T00:18:53.084 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:18:52.951+0000 7f9cfd333800 5 AuthRegistry(0x559de3a7c4b0) adding con mode: secure 2024-09-12T00:18:53.085 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:18:52.952+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.085 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:18:52.952+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.085 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:18:52.952+0000 7f9cfd333800 5 asok(0x559de385d630) register_command rotate-key hook 0x559de3a7c5f8 2024-09-12T00:18:53.085 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:53.085 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:18:53.085 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-a con 0x559de3935d20 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:53.085 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-c con 0x559de39bf870 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:53.085 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-b con 0x559de39c5ac0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:53.085 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.085 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.085 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.085 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:53.085 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient(hunting): authenticate will time out at 1810.209329s 2024-09-12T00:18:53.085 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): get_auth_request con 0x559de3935d20 auth_method 0 2024-09-12T00:18:53.086 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.086 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.086 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.086 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:18:52.952+0000 7f9cf8819640 10 monclient(hunting): get_auth_request con 0x559de39bf870 auth_method 0 2024-09-12T00:18:53.086 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:18:52.952+0000 7f9cf8819640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.086 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:18:52.952+0000 7f9cf8819640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.086 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:18:52.952+0000 7f9cf8819640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.086 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.086 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.086 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.086 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:18:52.952+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.086 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:18:52.952+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.086 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:18:52.952+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.086 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient(hunting): handle_auth_done global_id 6633 payload 824 2024-09-12T00:18:53.086 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient: _finish_hunting 0 2024-09-12T00:18:53.087 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:18:52.952+0000 7f9cf901a640 1 monclient: found mon.noname-a 2024-09-12T00:18:53.087 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:18:52.952+0000 7f9cf901a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.087 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.087 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:18:53.087 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: dump: 2024-09-12T00:18:53.087 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.087 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.087 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.087 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.087 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.087 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.087 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.087 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.087 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.088 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.088 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: _finish_auth 0 2024-09-12T00:18:53.088 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: _check_auth_tickets 2024-09-12T00:18:53.088 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:53.088 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.088 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:18:53.088 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:18:52.952+0000 7f9be5e03640 10 monclient: dump: 2024-09-12T00:18:53.088 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.089 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.089 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.089 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.089 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.089 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.089 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.089 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.089 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.089 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.089 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:18:52.952+0000 7f9cfd333800 5 monclient: authenticate success, global_id 6633 2024-09-12T00:18:53.089 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient: _renew_subs 2024-09-12T00:18:53.089 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:18:52.952+0000 7f9cfd333800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.089 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:18:52.952+0000 7f9be7606640 4 set_mon_vals no callback set 2024-09-12T00:18:53.089 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:18:52.953+0000 7f9cfd333800 10 monclient: _renew_subs 2024-09-12T00:18:53.090 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:18:52.953+0000 7f9cfd333800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.090 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:18:52.953+0000 7f9cfd333800 1 librados: init done 2024-09-12T00:18:53.090 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:18:52.955+0000 7f9be5e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:18:53.090 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:18:52.955+0000 7f9be5e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:53.090 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:18:52.955+0000 7f9be5e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:53.090 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:18:52.955+0000 7f9cf8819640 10 monclient: get_auth_request con 0x7f9be0076470 auth_method 0 2024-09-12T00:18:53.090 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:18:52.955+0000 7f9cf981b640 10 monclient: get_auth_request con 0x559de3aa5450 auth_method 0 2024-09-12T00:18:53.090 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:18:52.956+0000 7f9cf901a640 10 monclient: get_auth_request con 0x559de3ac7cd0 auth_method 0 2024-09-12T00:18:53.090 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:18:52.957+0000 7f9cf8819640 10 monclient: get_auth_request con 0x559de3acc030 auth_method 0 2024-09-12T00:18:53.090 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:18:52.958+0000 7f9cfd333800 10 monclient: build_initial_monmap 2024-09-12T00:18:53.090 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:18:52.958+0000 7f9cfd333800 1 build_initial for_mkfs: 0 2024-09-12T00:18:53.090 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:18:52.958+0000 7f9cfd333800 10 monclient: monmap: 2024-09-12T00:18:53.090 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:53.090 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:53.091 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:53.091 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:53.091 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:53.091 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.091 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:53.091 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:53.091 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:53.091 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.091 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding auth protocol: cephx 2024-09-12T00:18:53.091 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding auth protocol: cephx 2024-09-12T00:18:53.091 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding auth protocol: cephx 2024-09-12T00:18:53.091 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: secure 2024-09-12T00:18:53.091 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: crc 2024-09-12T00:18:53.092 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: secure 2024-09-12T00:18:53.092 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: crc 2024-09-12T00:18:53.092 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: secure 2024-09-12T00:18:53.092 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: crc 2024-09-12T00:18:53.092 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: crc 2024-09-12T00:18:53.092 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: secure 2024-09-12T00:18:53.092 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: crc 2024-09-12T00:18:53.092 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: secure 2024-09-12T00:18:53.092 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: crc 2024-09-12T00:18:53.092 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:18:52.958+0000 7f9cfd333800 5 AuthRegistry(0x559de3ad0e40) adding con mode: secure 2024-09-12T00:18:53.092 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:18:52.959+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.092 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 asok(0x559de385d630) register_command objecter_requests cmddesc objecter_requests hook 0x559de3ad4850 EEXIST 2024-09-12T00:18:53.092 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:18:52.959+0000 7f9cfd333800 10 monclient: init 2024-09-12T00:18:53.093 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding auth protocol: cephx 2024-09-12T00:18:53.093 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding auth protocol: cephx 2024-09-12T00:18:53.093 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding auth protocol: cephx 2024-09-12T00:18:53.093 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: secure 2024-09-12T00:18:53.093 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: crc 2024-09-12T00:18:53.093 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: secure 2024-09-12T00:18:53.093 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: crc 2024-09-12T00:18:53.093 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: secure 2024-09-12T00:18:53.093 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: crc 2024-09-12T00:18:53.093 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: crc 2024-09-12T00:18:53.093 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: secure 2024-09-12T00:18:53.093 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: crc 2024-09-12T00:18:53.093 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: secure 2024-09-12T00:18:53.093 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: crc 2024-09-12T00:18:53.094 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:18:52.959+0000 7f9cfd333800 5 AuthRegistry(0x559de3acf518) adding con mode: secure 2024-09-12T00:18:53.094 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:18:52.959+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.094 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:18:52.959+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.094 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:18:52.960+0000 7f9cfd333800 5 asok(0x559de385d630) register_command rotate-key cmddesc rotate-key hook 0x559de3acf660 EEXIST 2024-09-12T00:18:53.094 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:53.094 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:18:53.094 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-b con 0x559de3af8540 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:53.094 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-a con 0x559de3afa810 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:53.094 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-c con 0x559de3af6d10 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:53.094 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.094 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.094 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.095 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:53.095 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient(hunting): authenticate will time out at 1810.217090s 2024-09-12T00:18:53.095 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:18:52.960+0000 7f9cf981b640 10 monclient(hunting): get_auth_request con 0x559de3af6d10 auth_method 0 2024-09-12T00:18:53.095 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:18:52.960+0000 7f9cf981b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.095 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:18:52.960+0000 7f9cf981b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.095 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:18:52.960+0000 7f9cf981b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.095 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): get_auth_request con 0x559de3afa810 auth_method 0 2024-09-12T00:18:53.095 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.095 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.095 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.095 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:18:52.960+0000 7f9cf901a640 10 monclient(hunting): get_auth_request con 0x559de3af8540 auth_method 0 2024-09-12T00:18:53.095 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:18:52.960+0000 7f9cf901a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.095 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:18:52.960+0000 7f9cf901a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.096 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:18:52.960+0000 7f9cf901a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.096 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.096 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.096 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.096 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:18:52.960+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.096 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:18:52.960+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.096 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:18:52.960+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.096 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient(hunting): handle_auth_done global_id 6636 payload 824 2024-09-12T00:18:53.096 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient: _finish_hunting 0 2024-09-12T00:18:53.096 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:18:52.960+0000 7f9cf8819640 1 monclient: found mon.noname-a 2024-09-12T00:18:53.096 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:18:52.960+0000 7f9cf8819640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.096 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.096 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:18:53.097 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: dump: 2024-09-12T00:18:53.097 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.097 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.097 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.097 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.097 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.097 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.097 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.097 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.097 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.097 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.097 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: _finish_auth 0 2024-09-12T00:18:53.097 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: _check_auth_tickets 2024-09-12T00:18:53.097 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:53.098 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.098 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:18:53.098 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:18:52.960+0000 7f9bdeffd640 10 monclient: dump: 2024-09-12T00:18:53.098 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.098 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.098 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.098 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.098 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.098 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.098 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.098 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.098 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.098 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.099 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:18:52.960+0000 7f9cfd333800 5 monclient: authenticate success, global_id 6636 2024-09-12T00:18:53.099 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient: _renew_subs 2024-09-12T00:18:53.099 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.099 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:18:52.960+0000 7f9cfa01c640 4 set_mon_vals no callback set 2024-09-12T00:18:53.099 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient: _renew_subs 2024-09-12T00:18:53.099 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:18:52.960+0000 7f9cfd333800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.099 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:18:52.962+0000 7f9bdeffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:18:53.099 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:18:52.962+0000 7f9bdeffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:53.099 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:18:52.962+0000 7f9bdeffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:53.099 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:18:52.962+0000 7f9cf901a640 10 monclient: get_auth_request con 0x7f9bd4076380 auth_method 0 2024-09-12T00:18:53.099 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient: get_monmap_and_config 2024-09-12T00:18:53.099 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient: build_initial_monmap 2024-09-12T00:18:53.099 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:18:52.963+0000 7f9cfd333800 1 build_initial for_mkfs: 0 2024-09-12T00:18:53.099 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient: monmap: 2024-09-12T00:18:53.100 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:53.100 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:53.100 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:53.100 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:53.100 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:53.100 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.100 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:53.100 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:53.100 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:53.100 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.100 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding auth protocol: cephx 2024-09-12T00:18:53.100 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding auth protocol: cephx 2024-09-12T00:18:53.101 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding auth protocol: cephx 2024-09-12T00:18:53.101 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: secure 2024-09-12T00:18:53.101 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: crc 2024-09-12T00:18:53.101 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: secure 2024-09-12T00:18:53.101 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: crc 2024-09-12T00:18:53.101 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: secure 2024-09-12T00:18:53.101 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: crc 2024-09-12T00:18:53.101 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: crc 2024-09-12T00:18:53.101 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: secure 2024-09-12T00:18:53.101 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: crc 2024-09-12T00:18:53.101 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: secure 2024-09-12T00:18:53.101 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: crc 2024-09-12T00:18:53.101 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x559de3b17fe0) adding con mode: secure 2024-09-12T00:18:53.102 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:18:52.963+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.102 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient: init 2024-09-12T00:18:53.102 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding auth protocol: cephx 2024-09-12T00:18:53.102 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding auth protocol: cephx 2024-09-12T00:18:53.102 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding auth protocol: cephx 2024-09-12T00:18:53.102 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: secure 2024-09-12T00:18:53.102 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: crc 2024-09-12T00:18:53.102 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: secure 2024-09-12T00:18:53.102 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: crc 2024-09-12T00:18:53.102 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: secure 2024-09-12T00:18:53.102 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: crc 2024-09-12T00:18:53.102 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: crc 2024-09-12T00:18:53.102 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: secure 2024-09-12T00:18:53.102 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: crc 2024-09-12T00:18:53.103 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: secure 2024-09-12T00:18:53.103 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: crc 2024-09-12T00:18:53.103 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5f880) adding con mode: secure 2024-09-12T00:18:53.103 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:18:52.963+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.103 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:18:52.963+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.103 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:18:52.963+0000 7f9cfd333800 5 asok(0x559de385d630) register_command rotate-key cmddesc rotate-key hook 0x7ffe12e5f9c8 EEXIST 2024-09-12T00:18:53.103 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:53.103 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:18:53.103 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-a con 0x559de3b479a0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:53.103 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-b con 0x559de3b521b0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:53.103 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-c con 0x559de3b49c40 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:53.103 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.103 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.104 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.104 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:18:52.963+0000 7f9cfd333800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:53.104 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:18:52.964+0000 7f9cfd333800 10 monclient(hunting): authenticate will time out at 1810.221004s 2024-09-12T00:18:53.104 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:18:52.964+0000 7f9cf981b640 10 monclient(hunting): get_auth_request con 0x559de3b49c40 auth_method 0 2024-09-12T00:18:53.104 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:18:52.964+0000 7f9cf981b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.104 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:18:52.964+0000 7f9cf981b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.104 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:18:52.964+0000 7f9cf981b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.104 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): get_auth_request con 0x559de3b479a0 auth_method 0 2024-09-12T00:18:53.104 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.104 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.104 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.104 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:18:52.964+0000 7f9cf981b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.104 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:18:52.964+0000 7f9cf981b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.104 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:18:52.964+0000 7f9cf981b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.105 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.105 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.105 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.105 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient(hunting): handle_auth_done global_id 6639 payload 274 2024-09-12T00:18:53.105 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient: _finish_hunting 0 2024-09-12T00:18:53.105 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:18:52.964+0000 7f9cf901a640 1 monclient: found mon.noname-a 2024-09-12T00:18:53.105 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:18:52.964+0000 7f9cf901a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:18:53.105 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.105 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:18:53.105 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: dump: 2024-09-12T00:18:53.105 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.105 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.105 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.106 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.106 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.106 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.106 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.106 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.106 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.106 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.106 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: _finish_auth 0 2024-09-12T00:18:53.106 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: _check_auth_tickets 2024-09-12T00:18:53.106 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:53.106 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.106 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:18:53.106 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:18:52.964+0000 7f9bdcff9640 10 monclient: dump: 2024-09-12T00:18:53.107 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.107 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.107 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.107 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.107 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.107 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.107 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.107 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.107 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.107 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.107 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:18:52.964+0000 7f9cfd333800 5 monclient: authenticate success, global_id 6639 2024-09-12T00:18:53.107 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:18:52.964+0000 7f9cfd333800 10 monclient: get_monmap_and_config success 2024-09-12T00:18:53.107 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:18:52.964+0000 7f9cfd333800 4 set_mon_vals no callback set 2024-09-12T00:18:53.107 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:18:52.965+0000 7f9cfd333800 10 monclient: shutdown 2024-09-12T00:18:53.108 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:18:52.965+0000 7f9cfd333800 10 monclient: build_initial_monmap 2024-09-12T00:18:53.108 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:18:52.965+0000 7f9cfd333800 1 build_initial for_mkfs: 0 2024-09-12T00:18:53.108 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:18:52.965+0000 7f9cfd333800 10 monclient: monmap: 2024-09-12T00:18:53.108 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:18:53.108 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:18:53.108 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:18:53.108 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:18:53.108 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:18:53.108 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.108 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:18:53.108 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:18:53.108 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:18:53.109 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.109 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding auth protocol: cephx 2024-09-12T00:18:53.109 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding auth protocol: cephx 2024-09-12T00:18:53.109 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding auth protocol: cephx 2024-09-12T00:18:53.109 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: secure 2024-09-12T00:18:53.109 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: crc 2024-09-12T00:18:53.109 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: secure 2024-09-12T00:18:53.109 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: crc 2024-09-12T00:18:53.109 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: secure 2024-09-12T00:18:53.109 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: crc 2024-09-12T00:18:53.109 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: crc 2024-09-12T00:18:53.109 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: secure 2024-09-12T00:18:53.109 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: crc 2024-09-12T00:18:53.110 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: secure 2024-09-12T00:18:53.110 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: crc 2024-09-12T00:18:53.110 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3907220) adding con mode: secure 2024-09-12T00:18:53.110 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:18:52.965+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.110 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:18:52.965+0000 7f9cfd333800 1 librados: starting msgr at 2024-09-12T00:18:53.110 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:18:52.965+0000 7f9cfd333800 1 librados: starting objecter 2024-09-12T00:18:53.110 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 asok(0x559de385d630) register_command objecter_requests cmddesc objecter_requests hook 0x559de3af6980 EEXIST 2024-09-12T00:18:53.110 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:18:52.965+0000 7f9cfd333800 1 librados: setting wanted keys 2024-09-12T00:18:53.110 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:18:52.965+0000 7f9cfd333800 1 librados: calling monclient init 2024-09-12T00:18:53.110 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:18:52.965+0000 7f9cfd333800 10 monclient: init 2024-09-12T00:18:53.110 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding auth protocol: cephx 2024-09-12T00:18:53.110 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding auth protocol: cephx 2024-09-12T00:18:53.110 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding auth protocol: cephx 2024-09-12T00:18:53.110 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: secure 2024-09-12T00:18:53.111 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: crc 2024-09-12T00:18:53.111 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: secure 2024-09-12T00:18:53.111 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: crc 2024-09-12T00:18:53.111 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: secure 2024-09-12T00:18:53.111 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: crc 2024-09-12T00:18:53.111 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: crc 2024-09-12T00:18:53.111 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: secure 2024-09-12T00:18:53.111 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: crc 2024-09-12T00:18:53.111 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: secure 2024-09-12T00:18:53.111 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: crc 2024-09-12T00:18:53.111 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:18:52.965+0000 7f9cfd333800 5 AuthRegistry(0x559de3b102f0) adding con mode: secure 2024-09-12T00:18:53.111 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:18:52.965+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.111 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:18:52.966+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.112 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:18:52.966+0000 7f9cfd333800 5 asok(0x559de385d630) register_command rotate-key cmddesc rotate-key hook 0x559de3b10438 EEXIST 2024-09-12T00:18:53.112 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient: _reopen_session rank -1 2024-09-12T00:18:53.112 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:18:53.112 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-c con 0x559de3b479a0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:18:53.112 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-a con 0x559de3b49c40 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:18:53.112 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): picked mon.noname-b con 0x559de3b521b0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:18:53.112 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.112 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.112 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): start opening mon connection 2024-09-12T00:18:53.112 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): _renew_subs 2024-09-12T00:18:53.112 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:18:52.966+0000 7f9cfd333800 10 monclient(hunting): authenticate will time out at 1810.223291s 2024-09-12T00:18:53.112 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): get_auth_request con 0x559de3b479a0 auth_method 0 2024-09-12T00:18:53.112 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.113 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.113 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.113 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:18:52.966+0000 7f9cf8819640 10 monclient(hunting): get_auth_request con 0x559de3b49c40 auth_method 0 2024-09-12T00:18:53.113 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:18:52.966+0000 7f9cf8819640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.113 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:18:52.966+0000 7f9cf8819640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.113 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:18:52.966+0000 7f9cf8819640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.113 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.113 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.113 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.113 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:18:52.966+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.113 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:18:52.966+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.113 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:18:52.966+0000 7f9cf8819640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.113 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:18:52.966+0000 7f9cf981b640 10 monclient(hunting): get_auth_request con 0x559de3b521b0 auth_method 0 2024-09-12T00:18:53.113 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:18:52.966+0000 7f9cf981b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:18:53.114 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:18:52.966+0000 7f9cf981b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:18:53.114 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:18:52.966+0000 7f9cf981b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:18:53.114 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:18:52.966+0000 7f9cf981b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:18:53.114 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:18:52.966+0000 7f9cf981b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:18:53.114 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:18:52.966+0000 7f9cf981b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:18:53.114 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient(hunting): handle_auth_done global_id 6245 payload 824 2024-09-12T00:18:53.114 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient: _finish_hunting 0 2024-09-12T00:18:53.114 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:18:52.966+0000 7f9cf901a640 1 monclient: found mon.noname-c 2024-09-12T00:18:53.114 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:18:52.966+0000 7f9cf901a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:18:53.114 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.114 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:18:53.114 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: dump: 2024-09-12T00:18:53.114 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.114 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.115 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.115 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.115 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.115 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.115 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.115 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.115 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.115 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.115 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: _finish_auth 0 2024-09-12T00:18:53.115 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: _check_auth_tickets 2024-09-12T00:18:53.115 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:18:53.115 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:18:53.115 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:18:53.115 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:18:52.966+0000 7f9bcaffd640 10 monclient: dump: 2024-09-12T00:18:53.116 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:18:53.116 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:18:53.116 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.116 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:18:53.116 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:18:53.116 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:18:53.116 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:18:53.116 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:18:53.116 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:18:53.116 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.116 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:18:52.966+0000 7f9cfd333800 5 monclient: authenticate success, global_id 6245 2024-09-12T00:18:53.116 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:18:52.967+0000 7f9cfd333800 10 monclient: _renew_subs 2024-09-12T00:18:53.116 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:18:52.966+0000 7f9bdcff9640 4 set_mon_vals no callback set 2024-09-12T00:18:53.117 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:18:52.967+0000 7f9cfd333800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:53.117 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:18:52.967+0000 7f9cfd333800 10 monclient: _renew_subs 2024-09-12T00:18:53.117 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:18:52.967+0000 7f9cfd333800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:53.117 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:18:52.967+0000 7f9cfd333800 1 librados: init done 2024-09-12T00:18:53.117 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:18:52.967+0000 7f9cfd333800 5 asok(0x559de385d630) register_command cr dump hook 0x559de3b456a8 2024-09-12T00:18:53.117 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:18:52.968+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.117 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:18:52.969+0000 7f9bcaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:18:53.117 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:18:52.969+0000 7f9bcaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:53.117 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:18:52.969+0000 7f9bcaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:18:53.117 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:18:52.969+0000 7f9cf8819640 10 monclient: get_auth_request con 0x7f9bc4076470 auth_method 0 2024-09-12T00:18:53.117 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:18:52.969+0000 7f9cf981b640 10 monclient: get_auth_request con 0x559de3b67850 auth_method 0 2024-09-12T00:18:53.117 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.117 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:18:52.970+0000 7f9cfd333800 20 realm 2024-09-12T00:18:53.117 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.118 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.118 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:18:52.970+0000 7f9cfd333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:53.118 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.118 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.118 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:18:52.970+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.118 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:18:52.971+0000 7f9cf901a640 10 monclient: get_auth_request con 0x559de3b6bba0 auth_method 0 2024-09-12T00:18:53.118 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:18:52.971+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:53.118 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:18:52.971+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.118 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:18:52.971+0000 7f9cf8819640 10 monclient: get_auth_request con 0x559de3b6f300 auth_method 0 2024-09-12T00:18:53.118 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:18:52.972+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:53.118 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:18:52.972+0000 7f9cfd333800 20 searching for the correct realm 2024-09-12T00:18:53.118 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:18:52.973+0000 7f9cf981b640 10 monclient: get_auth_request con 0x7f9cf00e40e0 auth_method 0 2024-09-12T00:18:53.118 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:18:52.974+0000 7f9cf901a640 10 monclient: get_auth_request con 0x7f9cec097970 auth_method 0 2024-09-12T00:18:53.118 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:18:52.975+0000 7f9cf8819640 10 monclient: get_auth_request con 0x7f9cf00e4500 auth_method 0 2024-09-12T00:18:53.118 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:18:52.975+0000 7f9cf8819640 0 -- 172.21.15.67:0/3378070414 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f9cf00e4500 msgr2=0x7f9cf00df880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:53.119 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:18:52.975+0000 7f9bcaffd640 1 client.6245.objecter ms_handle_reset 0x7f9cf00e4500 session 0x7f9cf0005040 osd.5 2024-09-12T00:18:53.119 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:18:52.975+0000 7f9bcaffd640 10 monclient: _renew_subs 2024-09-12T00:18:53.119 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:18:52.975+0000 7f9bcaffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:18:53.119 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:18:52.975+0000 7f9cf8819640 10 monclient: get_auth_request con 0x7f9bc4086710 auth_method 0 2024-09-12T00:18:53.119 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:18:52.978+0000 7f9cf981b640 10 monclient: get_auth_request con 0x7f9cec05b4f0 auth_method 0 2024-09-12T00:18:53.119 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:18:52.978+0000 7f9cf901a640 10 monclient: get_auth_request con 0x7f9cf4018040 auth_method 0 2024-09-12T00:18:53.119 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:18:52.979+0000 7f9cf981b640 0 -- 172.21.15.67:0/3378070414 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x559de3b67850 msgr2=0x559de3b69c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:53.119 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:18:52.979+0000 7f9bcaffd640 1 client.6245.objecter ms_handle_reset 0x559de3b67850 session 0x559de3b671d0 osd.6 2024-09-12T00:18:53.119 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:18:52.980+0000 7f9cf981b640 10 monclient: get_auth_request con 0x7f9cf00e4500 auth_method 0 2024-09-12T00:18:53.119 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:53.119 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:53.119 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:53.120 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:53.120 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:53.120 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:18:52.983+0000 7f9cfd333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:53.120 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:18:52.983+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.120 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.120 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.120 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:53.120 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.120 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:53.120 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 zone default found 2024-09-12T00:18:53.120 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:18:52.984+0000 7f9cfd333800 4 Realm: () 2024-09-12T00:18:53.120 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:18:52.984+0000 7f9cfd333800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:53.120 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:18:52.984+0000 7f9cfd333800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:53.121 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:18:52.984+0000 7f9cfd333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:53.121 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 zonegroup default 2024-09-12T00:18:53.121 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.121 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.121 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:18:52.984+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.121 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:18:52.985+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.121 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:18:52.985+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.121 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:18:52.985+0000 7f9cfd333800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.121 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:18:52.985+0000 7f9cfd333800 20 started sync module instance, tier type = 2024-09-12T00:18:53.121 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:18:52.985+0000 7f9cfd333800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:53.121 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=0 2024-09-12T00:18:53.121 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=1 2024-09-12T00:18:53.121 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=2 2024-09-12T00:18:53.121 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=3 2024-09-12T00:18:53.122 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=4 2024-09-12T00:18:53.122 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=5 2024-09-12T00:18:53.122 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:18:52.993+0000 7f9cfd333800 20 add_watcher() i=6 2024-09-12T00:18:53.122 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:18:52.994+0000 7f9cfd333800 20 add_watcher() i=7 2024-09-12T00:18:53.122 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:18:52.994+0000 7f9cfd333800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:53.122 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding auth protocol: cephx 2024-09-12T00:18:53.122 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding auth protocol: cephx 2024-09-12T00:18:53.122 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding auth protocol: cephx 2024-09-12T00:18:53.122 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: secure 2024-09-12T00:18:53.122 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: crc 2024-09-12T00:18:53.122 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: secure 2024-09-12T00:18:53.122 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: crc 2024-09-12T00:18:53.122 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:18:52.995+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: secure 2024-09-12T00:18:53.123 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:18:52.995+0000 7f9baffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:53.123 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: crc 2024-09-12T00:18:53.123 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: crc 2024-09-12T00:18:53.123 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: secure 2024-09-12T00:18:53.123 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: crc 2024-09-12T00:18:53.123 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: secure 2024-09-12T00:18:53.123 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: crc 2024-09-12T00:18:53.123 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 AuthRegistry(0x7ffe12e5fd60) adding con mode: secure 2024-09-12T00:18:53.123 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:18:52.996+0000 7f9cfd333800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:18:53.123 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:18:52.996+0000 7f9cfd333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:53.123 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:18:52.996+0000 7f9cfd333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:53.123 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command cache list hook 0x559de3b421d0 2024-09-12T00:18:53.123 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command cache inspect hook 0x559de3b421d0 2024-09-12T00:18:53.123 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command cache erase hook 0x559de3b421d0 2024-09-12T00:18:53.124 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command cache zap hook 0x559de3b421d0 2024-09-12T00:18:53.124 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 note: GC not initialized 2024-09-12T00:18:53.124 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:18:52.996+0000 7f9baefe5640 20 reqs_thread_entry: start 2024-09-12T00:18:53.124 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command sync trace show hook 0x7f9cec00e070 2024-09-12T00:18:53.124 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command sync trace history hook 0x7f9cec00e070 2024-09-12T00:18:53.124 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command sync trace active hook 0x7f9cec00e070 2024-09-12T00:18:53.124 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:18:52.996+0000 7f9cfd333800 5 asok(0x559de385d630) register_command sync trace active_short hook 0x7f9cec00e070 2024-09-12T00:18:53.124 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:18:52.996+0000 7f9cfd333800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:53.124 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:18:52.996+0000 7f9cfd333800 20 Filter name: none 2024-09-12T00:18:53.124 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:18:52.996+0000 7f9bacfe1640 20 reqs_thread_entry: start 2024-09-12T00:18:53.124 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:18:52.996+0000 7f9cfd333800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:18:53.124 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:18:52.996+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.124 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:18:52.997+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:53.125 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:18:53.125 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:18:53.125 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 : miss 2024-09-12T00:18:53.125 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:18:52.997+0000 7f9cfd333800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.125 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:18:52.997+0000 7f9cfd333800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:53.125 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 info.flags=0x17 2024-09-12T00:18:53.125 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 to cache LRU end 2024-09-12T00:18:53.125 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:53.125 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:53.125 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:18:52.997+0000 7f9cfd333800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 2024-09-12T00:18:53.125 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:18:53.001+0000 7f9cfd333800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9cfd333800 time 2024-09-12T00:18:53.001941+0000 2024-09-12T00:18:53.125 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:18:53.125 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.126 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:53.126 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f9cfe98c71a] 2024-09-12T00:18:53.126 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9cfe98c8d8] 2024-09-12T00:18:53.126 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559de2340641] 2024-09-12T00:18:53.126 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd878e8) [0x559de28528e8] 2024-09-12T00:18:53.126 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559de235031d] 2024-09-12T00:18:53.126 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:18:53.126 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f9cfd629590] 2024-09-12T00:18:53.126 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:18:53.126 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:18:53.126 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.126 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:18:53.002+0000 7f9cfd333800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:18:53.126 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f9cfd333800 thread_name:radosgw-admin 2024-09-12T00:18:53.126 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.127 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:18:53.127 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f9cfd63e6f0] 2024-09-12T00:18:53.127 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f9cfd68b99c] 2024-09-12T00:18:53.127 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:18:53.127 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:18:53.127 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f9cfe98c774] 2024-09-12T00:18:53.127 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f9cfe98c8d8] 2024-09-12T00:18:53.127 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559de2340641] 2024-09-12T00:18:53.127 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd878e8) [0x559de28528e8] 2024-09-12T00:18:53.127 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559de235031d] 2024-09-12T00:18:53.127 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:18:53.127 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f9cfd629590] 2024-09-12T00:18:53.127 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:18:53.127 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:18:53.128 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:18:53.128 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.128 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:18:53.128 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:18:53.128 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:18:53.128 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:18:53.128 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:18:53.128 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:18:53.128 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:18:53.128 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:18:53.128 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:18:53.128 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:18:53.128 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:18:53.129 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:18:53.129 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:18:53.129 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:18:53.129 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:18:53.129 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:18:53.129 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:18:53.129 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:18:53.129 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:18:53.129 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:18:53.129 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:18:53.129 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:18:53.129 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:18:53.129 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:18:53.129 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:18:53.130 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:18:53.130 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:18:53.130 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:18:53.130 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:18:53.130 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:18:53.130 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:18:53.130 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:18:53.130 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:18:53.130 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:18:53.130 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:18:53.130 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:18:53.130 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:18:53.130 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:18:53.130 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:18:53.130 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:18:53.131 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:18:53.131 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:18:53.131 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:18:53.131 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:18:53.131 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:18:53.131 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:18:53.131 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:18:53.131 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:18:53.131 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:18:53.131 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:18:53.131 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:18:53.131 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:18:53.131 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:18:53.132 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:18:53.132 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:18:53.132 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:18:53.132 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:18:53.132 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:18:53.132 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:18:53.132 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:18:53.132 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:18:53.132 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:18:53.132 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:18:53.132 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:18:53.132 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:18:53.132 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:18:53.132 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:18:53.133 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:18:53.133 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:18:53.133 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:18:53.133 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:18:53.133 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:18:53.133 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:18:53.133 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:18:53.133 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:18:53.133 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:18:53.133 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:18:53.133 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:18:53.133 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:18:53.133 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:18:53.134 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:18:53.134 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:18:53.134 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:18:53.134 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:18:53.134 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:18:53.134 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:18:53.134 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:18:53.134 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:18:53.134 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:18:53.134 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:18:53.134 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:18:53.134 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:18:53.134 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:18:53.134 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:18:53.134 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9bacfe1640 / http_manager 2024-09-12T00:18:53.135 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9baefe5640 / http_manager 2024-09-12T00:18:53.135 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9baffe7640 / rgw_dt_lg_renew 2024-09-12T00:18:53.135 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9bcaffd640 / ms_dispatch 2024-09-12T00:18:53.135 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9bdcff9640 / io_context_pool 2024-09-12T00:18:53.135 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9bdeffd640 / ms_dispatch 2024-09-12T00:18:53.135 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9be5e03640 / ms_dispatch 2024-09-12T00:18:53.135 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9be7606640 / io_context_pool 2024-09-12T00:18:53.135 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9cf8819640 / msgr-worker-2 2024-09-12T00:18:53.135 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9cf901a640 / msgr-worker-1 2024-09-12T00:18:53.135 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9cf981b640 / msgr-worker-0 2024-09-12T00:18:53.135 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9cfa01c640 / io_context_pool 2024-09-12T00:18:53.135 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9cfd333800 / radosgw-admin 2024-09-12T00:18:53.135 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:18:53.136 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:18:53.136 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:18:53.003623Z_3c6f4fab-2267-4fdd-841c-1d06bdf1593e/log 2024-09-12T00:18:53.136 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:18:53.136 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:18:53.137 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:53.137 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:53.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.079+0000 7ff362739800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.081+0000 7ff362739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.081+0000 7ff362739800 20 realm 2024-09-12T00:18:53.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.081+0000 7ff362739800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.081+0000 7ff362739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.081+0000 7ff362739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:53.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.081+0000 7ff362739800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.081+0000 7ff362739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.082+0000 7ff362739800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.082+0000 7ff362739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:53.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.082+0000 7ff362739800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.083+0000 7ff362739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:53.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.083+0000 7ff362739800 20 searching for the correct realm 2024-09-12T00:18:53.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.086+0000 7ff35dbc6640 0 -- 172.21.15.67:0/971674516 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7ff354030040 msgr2=0x7ff354026420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:53.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.290+0000 7ff35ebc8640 0 -- 172.21.15.67:0/971674516 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x565556495620 msgr2=0x565556497ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:53.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:53.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:53.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:53.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:53.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:53.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:53.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:53.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:53.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 20 zone default found 2024-09-12T00:18:53.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 4 Realm: () 2024-09-12T00:18:53.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:53.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:53.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:53.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 20 zonegroup default 2024-09-12T00:18:53.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.295+0000 7ff362739800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.296+0000 7ff362739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.296+0000 7ff362739800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.296+0000 7ff362739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.296+0000 7ff362739800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.296+0000 7ff362739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.297+0000 7ff362739800 20 started sync module instance, tier type = 2024-09-12T00:18:53.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.297+0000 7ff362739800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:53.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.305+0000 7ff362739800 20 add_watcher() i=0 2024-09-12T00:18:53.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.305+0000 7ff362739800 20 add_watcher() i=1 2024-09-12T00:18:53.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.305+0000 7ff362739800 20 add_watcher() i=2 2024-09-12T00:18:53.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.305+0000 7ff362739800 20 add_watcher() i=3 2024-09-12T00:18:53.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.305+0000 7ff362739800 20 add_watcher() i=4 2024-09-12T00:18:53.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.305+0000 7ff362739800 20 add_watcher() i=5 2024-09-12T00:18:53.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.305+0000 7ff362739800 20 add_watcher() i=6 2024-09-12T00:18:53.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.306+0000 7ff362739800 20 add_watcher() i=7 2024-09-12T00:18:53.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.306+0000 7ff362739800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:53.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.308+0000 7ff214fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:53.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.308+0000 7ff362739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:53.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.308+0000 7ff362739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:53.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.308+0000 7ff362739800 5 note: GC not initialized 2024-09-12T00:18:53.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.309+0000 7ff18f7fe640 20 reqs_thread_entry: start 2024-09-12T00:18:53.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.309+0000 7ff362739800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:53.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.309+0000 7ff362739800 20 Filter name: none 2024-09-12T00:18:53.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.309+0000 7ff18d7fa640 20 reqs_thread_entry: start 2024-09-12T00:18:53.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.309+0000 7ff362739800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.309+0000 7ff362739800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:53.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.309+0000 7ff362739800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.310+0000 7ff362739800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:53.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.310+0000 7ff362739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:53.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.310+0000 7ff362739800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.310+0000 7ff362739800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:53.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.310+0000 7ff362739800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.310+0000 7ff362739800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:53.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.310+0000 7ff362739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:18:53.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.312+0000 7ff214fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:53.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.314+0000 7ff362739800 20 remove_watcher() i=0 2024-09-12T00:18:53.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.314+0000 7ff362739800 2 removed watcher, disabling cache 2024-09-12T00:18:53.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.315+0000 7ff362739800 20 remove_watcher() i=1 2024-09-12T00:18:53.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.316+0000 7ff362739800 20 remove_watcher() i=2 2024-09-12T00:18:53.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.317+0000 7ff362739800 20 remove_watcher() i=3 2024-09-12T00:18:53.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.318+0000 7ff362739800 20 remove_watcher() i=4 2024-09-12T00:18:53.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.319+0000 7ff362739800 20 remove_watcher() i=5 2024-09-12T00:18:53.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.320+0000 7ff362739800 20 remove_watcher() i=6 2024-09-12T00:18:53.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.321+0000 7ff362739800 20 remove_watcher() i=7 2024-09-12T00:18:53.331 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.331 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:18:53.331 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-set-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:18:53.331 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:18:53.385 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:18:53.416 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:18:53.417 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:18:53.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.659+0000 7f7392c14800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.660+0000 7f7392c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.660+0000 7f7392c14800 20 realm 2024-09-12T00:18:53.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.660+0000 7f7392c14800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.660+0000 7f7392c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.660+0000 7f7392c14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:18:53.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.660+0000 7f7392c14800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.661+0000 7f7392c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.661+0000 7f7392c14800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.661+0000 7f7392c14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:53.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.662+0000 7f7392c14800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.662+0000 7f7392c14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:18:53.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.662+0000 7f7392c14800 20 searching for the correct realm 2024-09-12T00:18:53.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.665+0000 7f738daca640 0 -- 172.21.15.67:0/421912890 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f73840cff00 msgr2=0x7f7384056ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:53.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.871+0000 7f738eacc640 0 -- 172.21.15.67:0/421912890 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55b6edb91770 msgr2=0x55b6edb93bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:18:53.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.875+0000 7f7392c14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:18:53.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.875+0000 7f7392c14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:18:53.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.875+0000 7f7392c14800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:18:53.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.875+0000 7f7392c14800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:18:53.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.875+0000 7f7392c14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:18:53.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.875+0000 7f7392c14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:18:53.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.875+0000 7f7392c14800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.875+0000 7f7392c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.875+0000 7f7392c14800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.875+0000 7f7392c14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:18:53.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.875+0000 7f7392c14800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.876+0000 7f7392c14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:18:53.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.876+0000 7f7392c14800 20 zone default found 2024-09-12T00:18:53.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.876+0000 7f7392c14800 4 Realm: () 2024-09-12T00:18:53.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.876+0000 7f7392c14800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:18:53.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.876+0000 7f7392c14800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:18:53.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.876+0000 7f7392c14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:18:53.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.876+0000 7f7392c14800 20 zonegroup default 2024-09-12T00:18:53.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.876+0000 7f7392c14800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.876+0000 7f7392c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.876+0000 7f7392c14800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.876+0000 7f7392c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.876+0000 7f7392c14800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.877+0000 7f7392c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:18:53.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.877+0000 7f7392c14800 20 started sync module instance, tier type = 2024-09-12T00:18:53.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.877+0000 7f7392c14800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:18:53.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.886+0000 7f7392c14800 20 add_watcher() i=0 2024-09-12T00:18:53.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.886+0000 7f7392c14800 20 add_watcher() i=1 2024-09-12T00:18:53.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.886+0000 7f7392c14800 20 add_watcher() i=2 2024-09-12T00:18:53.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.886+0000 7f7392c14800 20 add_watcher() i=3 2024-09-12T00:18:53.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.886+0000 7f7392c14800 20 add_watcher() i=4 2024-09-12T00:18:53.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.886+0000 7f7392c14800 20 add_watcher() i=5 2024-09-12T00:18:53.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.886+0000 7f7392c14800 20 add_watcher() i=6 2024-09-12T00:18:53.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.887+0000 7f7392c14800 20 add_watcher() i=7 2024-09-12T00:18:53.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.887+0000 7f7392c14800 2 all 8 watchers are set, enabling cache 2024-09-12T00:18:53.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.889+0000 7f7244fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:53.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.889+0000 7f7392c14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:18:53.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.889+0000 7f7392c14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:18:53.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.890+0000 7f7392c14800 5 note: GC not initialized 2024-09-12T00:18:53.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.890+0000 7f71bf7fe640 20 reqs_thread_entry: start 2024-09-12T00:18:53.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.890+0000 7f7392c14800 20 init_complete bucket index max shards: 1 2024-09-12T00:18:53.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.890+0000 7f7392c14800 20 Filter name: none 2024-09-12T00:18:53.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.890+0000 7f71bd7fa640 20 reqs_thread_entry: start 2024-09-12T00:18:53.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.890+0000 7f7392c14800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:18:53.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.890+0000 7f7392c14800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.890+0000 7f7392c14800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:18:53.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.890+0000 7f7392c14800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:18:53.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.890+0000 7f7392c14800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:18:53.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.890+0000 7f7392c14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 : miss 2024-09-12T00:18:53.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.890+0000 7f7392c14800 20 rados->read ofs=0 len=0 2024-09-12T00:18:53.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.891+0000 7f7392c14800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:18:53.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.891+0000 7f7392c14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 info.flags=0x17 2024-09-12T00:18:53.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.891+0000 7f7392c14800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 to cache LRU end 2024-09-12T00:18:53.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.891+0000 7f7392c14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:18:53.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.891+0000 7f7392c14800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:18:53.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.891+0000 7f7392c14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 2024-09-12T00:18:53.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.892+0000 7f7392c14800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 to be held by another RGW process; skipping for now 2024-09-12T00:18:53.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.893+0000 7f7244fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:18:53.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.895+0000 7f7392c14800 20 remove_watcher() i=0 2024-09-12T00:18:53.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.895+0000 7f7392c14800 2 removed watcher, disabling cache 2024-09-12T00:18:53.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.896+0000 7f7392c14800 20 remove_watcher() i=1 2024-09-12T00:18:53.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.897+0000 7f7392c14800 20 remove_watcher() i=2 2024-09-12T00:18:53.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.898+0000 7f7392c14800 20 remove_watcher() i=3 2024-09-12T00:18:53.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.899+0000 7f7392c14800 20 remove_watcher() i=4 2024-09-12T00:18:53.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.901+0000 7f7392c14800 20 remove_watcher() i=5 2024-09-12T00:18:53.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.902+0000 7f7392c14800 20 remove_watcher() i=6 2024-09-12T00:18:53.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:18:53.903+0000 7f7392c14800 20 remove_watcher() i=7 2024-09-12T00:18:53.913 INFO:tasks.workunit.client.0.smithi067.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:19:23.932 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:19:23.969 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:23.969 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:24.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.014+0000 7f502f840800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.016+0000 7f502f840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.016+0000 7f502f840800 20 realm 2024-09-12T00:19:24.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.016+0000 7f502f840800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.016+0000 7f502f840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.016+0000 7f502f840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:24.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.016+0000 7f502f840800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.017+0000 7f502f840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.017+0000 7f502f840800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.017+0000 7f502f840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:24.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.017+0000 7f502f840800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.018+0000 7f502f840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:24.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.018+0000 7f502f840800 20 searching for the correct realm 2024-09-12T00:19:24.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.022+0000 7f502cb30640 0 -- 172.21.15.67:0/1836574629 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f50240aecc0 msgr2=0x7f50240bfa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:24.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.027+0000 7f502db32640 0 -- 172.21.15.67:0/1836574629 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5625cd31ac50 msgr2=0x5625cd31d0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:24.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.032+0000 7f502f840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:24.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.032+0000 7f502f840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:24.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.032+0000 7f502f840800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:24.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.032+0000 7f502f840800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:24.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.032+0000 7f502f840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:24.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.032+0000 7f502f840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:24.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.032+0000 7f502f840800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.032+0000 7f502f840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.032+0000 7f502f840800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.032+0000 7f502f840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:24.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.032+0000 7f502f840800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.033+0000 7f502f840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:24.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.033+0000 7f502f840800 20 zone default found 2024-09-12T00:19:24.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.033+0000 7f502f840800 4 Realm: () 2024-09-12T00:19:24.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.033+0000 7f502f840800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:24.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.033+0000 7f502f840800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:24.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.033+0000 7f502f840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:24.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.033+0000 7f502f840800 20 zonegroup default 2024-09-12T00:19:24.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.033+0000 7f502f840800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.033+0000 7f502f840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.033+0000 7f502f840800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.033+0000 7f502f840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.033+0000 7f502f840800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.034+0000 7f502f840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.034+0000 7f502f840800 20 started sync module instance, tier type = 2024-09-12T00:19:24.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.034+0000 7f502f840800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:24.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.044+0000 7f502f840800 20 add_watcher() i=0 2024-09-12T00:19:24.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.044+0000 7f502f840800 20 add_watcher() i=1 2024-09-12T00:19:24.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.044+0000 7f502f840800 20 add_watcher() i=2 2024-09-12T00:19:24.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.044+0000 7f502f840800 20 add_watcher() i=3 2024-09-12T00:19:24.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.044+0000 7f502f840800 20 add_watcher() i=4 2024-09-12T00:19:24.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.044+0000 7f502f840800 20 add_watcher() i=5 2024-09-12T00:19:24.043 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.044+0000 7f502f840800 20 add_watcher() i=6 2024-09-12T00:19:24.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.045+0000 7f502f840800 20 add_watcher() i=7 2024-09-12T00:19:24.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.045+0000 7f502f840800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:24.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.047+0000 7f4ee37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:24.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.047+0000 7f502f840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:24.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.047+0000 7f502f840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:24.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.047+0000 7f502f840800 5 note: GC not initialized 2024-09-12T00:19:24.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.047+0000 7f4ee27e4640 20 reqs_thread_entry: start 2024-09-12T00:19:24.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.047+0000 7f502f840800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:24.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.047+0000 7f502f840800 20 Filter name: none 2024-09-12T00:19:24.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.048+0000 7f4e53fff640 20 reqs_thread_entry: start 2024-09-12T00:19:24.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.048+0000 7f502f840800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:19:24.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.048+0000 7f502f840800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.048+0000 7f502f840800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:19:24.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.048+0000 7f502f840800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:19:24.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.048+0000 7f502f840800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:19:24.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.048+0000 7f502f840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 : miss 2024-09-12T00:19:24.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.048+0000 7f502f840800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.048+0000 7f502f840800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:19:24.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.048+0000 7f502f840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 info.flags=0x17 2024-09-12T00:19:24.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.048+0000 7f502f840800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 to cache LRU end 2024-09-12T00:19:24.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.048+0000 7f502f840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:24.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.048+0000 7f502f840800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:24.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.048+0000 7f502f840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 2024-09-12T00:19:24.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.053+0000 7f502f840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 info.flags=0x17 2024-09-12T00:19:24.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.053+0000 7f502f840800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 to cache LRU end 2024-09-12T00:19:24.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.053+0000 7f502f840800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:24.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.053+0000 7f502f840800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24, ofs0, ns] 2024-09-12T00:19:24.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.053+0000 7f4f10ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562475 cookie 94720356422672 notifier 6699 bl.length()=925 2024-09-12T00:19:24.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.053+0000 7f4f10ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 info.flags=0x17 2024-09-12T00:19:24.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.053+0000 7f4f10ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 to cache LRU end 2024-09-12T00:19:24.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.053+0000 7f4f10ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:24.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.053+0000 7f502f840800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24]): orig_sources= new_sources= 2024-09-12T00:19:24.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.053+0000 7f502f840800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24]): potential sources added=[] removed=[] 2024-09-12T00:19:24.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.053+0000 7f502f840800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24]): orig_dests= new_dests= 2024-09-12T00:19:24.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.053+0000 7f502f840800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24]): potential dests added=[] removed=[] 2024-09-12T00:19:24.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.056+0000 7f502f840800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24.1.0 2024-09-12T00:19:24.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.056+0000 7f502f840800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24.1.0 2024-09-12T00:19:24.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.056+0000 7f502f840800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24.1.1 2024-09-12T00:19:24.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.056+0000 7f502f840800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24.1.1 2024-09-12T00:19:24.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.056+0000 7f502f840800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24.0 2024-09-12T00:19:24.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.058+0000 7f502f840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:19:24.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.058+0000 7f502f840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 2024-09-12T00:19:24.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.060+0000 7f502f840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 info.flags=0x17 2024-09-12T00:19:24.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.060+0000 7f502f840800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 to cache LRU end 2024-09-12T00:19:24.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.060+0000 7f502f840800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:24.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.060+0000 7f502f840800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24, ofs0, ns] 2024-09-12T00:19:24.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.060+0000 7f4f10ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562476 cookie 94720356422672 notifier 6699 bl.length()=925 2024-09-12T00:19:24.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.060+0000 7f4f10ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 info.flags=0x17 2024-09-12T00:19:24.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.060+0000 7f4f10ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 to cache LRU end 2024-09-12T00:19:24.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.060+0000 7f4f10ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:24.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.060+0000 7f502f840800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24]): orig_sources= new_sources= 2024-09-12T00:19:24.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.060+0000 7f502f840800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24]): potential sources added=[] removed=[] 2024-09-12T00:19:24.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.060+0000 7f502f840800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24]): orig_dests= new_dests= 2024-09-12T00:19:24.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.060+0000 7f502f840800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24]): potential dests added=[] removed=[] 2024-09-12T00:19:24.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.062+0000 7f502f840800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24.0 2024-09-12T00:19:24.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.062+0000 7f502f840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:19:24.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.062+0000 7f502f840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 2024-09-12T00:19:24.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.064+0000 7f502f840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 info.flags=0x17 2024-09-12T00:19:24.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.064+0000 7f502f840800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 to cache LRU end 2024-09-12T00:19:24.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.064+0000 7f502f840800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:24.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.064+0000 7f502f840800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24, ofs0, ns] 2024-09-12T00:19:24.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.064+0000 7f4efffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562477 cookie 94720356422672 notifier 6699 bl.length()=893 2024-09-12T00:19:24.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.064+0000 7f4efffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 info.flags=0x17 2024-09-12T00:19:24.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.064+0000 7f4efffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 to cache LRU end 2024-09-12T00:19:24.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.064+0000 7f4efffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:24.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.064+0000 7f502f840800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24]): orig_sources= new_sources= 2024-09-12T00:19:24.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.064+0000 7f502f840800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24]): potential sources added=[] removed=[] 2024-09-12T00:19:24.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.064+0000 7f502f840800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24]): orig_dests= new_dests= 2024-09-12T00:19:24.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.064+0000 7f502f840800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24]): potential dests added=[] removed=[] 2024-09-12T00:19:24.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.066+0000 7f502f840800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:19:24.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.068+0000 7f4ee37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:24.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.070+0000 7f502f840800 20 remove_watcher() i=0 2024-09-12T00:19:24.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.070+0000 7f502f840800 2 removed watcher, disabling cache 2024-09-12T00:19:24.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.071+0000 7f502f840800 20 remove_watcher() i=1 2024-09-12T00:19:24.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.072+0000 7f502f840800 20 remove_watcher() i=2 2024-09-12T00:19:24.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.073+0000 7f502f840800 20 remove_watcher() i=3 2024-09-12T00:19:24.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.074+0000 7f502f840800 20 remove_watcher() i=4 2024-09-12T00:19:24.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.075+0000 7f502f840800 20 remove_watcher() i=5 2024-09-12T00:19:24.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.076+0000 7f502f840800 20 remove_watcher() i=6 2024-09-12T00:19:24.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.077+0000 7f502f840800 20 remove_watcher() i=7 2024-09-12T00:19:24.090 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:19:24.120 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:24.120 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:24.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.161+0000 7f77bde10800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.163+0000 7f77bde10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.163+0000 7f77bde10800 20 realm 2024-09-12T00:19:24.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.163+0000 7f77bde10800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.163+0000 7f77bde10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.163+0000 7f77bde10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:24.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.163+0000 7f77bde10800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.163+0000 7f77bde10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.163+0000 7f77bde10800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.164+0000 7f77bde10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:24.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.164+0000 7f77bde10800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.165+0000 7f77bde10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:24.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.165+0000 7f77bde10800 20 searching for the correct realm 2024-09-12T00:19:24.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.166+0000 7f77b957a640 0 -- 172.21.15.67:0/1986576019 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f77ac075030 msgr2=0x7f77ac064940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:24.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.372+0000 7f77b957a640 0 -- 172.21.15.67:0/1986576019 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f77b4065930 msgr2=0x7f77b40753c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:24.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.580+0000 7f77bde10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:24.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.580+0000 7f77bde10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:24.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.580+0000 7f77bde10800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:24.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.580+0000 7f77bde10800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:24.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.580+0000 7f77bde10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:24.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.580+0000 7f77bde10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:24.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.580+0000 7f77bde10800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.580+0000 7f77bde10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.580+0000 7f77bde10800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.580+0000 7f77bde10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:24.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.581+0000 7f77bde10800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.581+0000 7f77bde10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:24.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.581+0000 7f77bde10800 20 zone default found 2024-09-12T00:19:24.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.581+0000 7f77bde10800 4 Realm: () 2024-09-12T00:19:24.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.581+0000 7f77bde10800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:24.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.581+0000 7f77bde10800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:24.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.581+0000 7f77bde10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:24.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.581+0000 7f77bde10800 20 zonegroup default 2024-09-12T00:19:24.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.581+0000 7f77bde10800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.581+0000 7f77bde10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.581+0000 7f77bde10800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.581+0000 7f77bde10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.581+0000 7f77bde10800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.582+0000 7f77bde10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.582+0000 7f77bde10800 20 started sync module instance, tier type = 2024-09-12T00:19:24.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.582+0000 7f77bde10800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:24.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.592+0000 7f77bde10800 20 add_watcher() i=0 2024-09-12T00:19:24.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.592+0000 7f77bde10800 20 add_watcher() i=1 2024-09-12T00:19:24.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.592+0000 7f77bde10800 20 add_watcher() i=2 2024-09-12T00:19:24.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.592+0000 7f77bde10800 20 add_watcher() i=3 2024-09-12T00:19:24.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.592+0000 7f77bde10800 20 add_watcher() i=4 2024-09-12T00:19:24.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.592+0000 7f77bde10800 20 add_watcher() i=5 2024-09-12T00:19:24.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.592+0000 7f77bde10800 20 add_watcher() i=6 2024-09-12T00:19:24.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.593+0000 7f77bde10800 20 add_watcher() i=7 2024-09-12T00:19:24.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.593+0000 7f77bde10800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:24.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.595+0000 7f766b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:24.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.595+0000 7f77bde10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:24.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.595+0000 7f77bde10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:24.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.595+0000 7f77bde10800 5 note: GC not initialized 2024-09-12T00:19:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.595+0000 7f766a7e4640 20 reqs_thread_entry: start 2024-09-12T00:19:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.595+0000 7f77bde10800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.595+0000 7f77bde10800 20 Filter name: none 2024-09-12T00:19:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.596+0000 7f75dbfff640 20 reqs_thread_entry: start 2024-09-12T00:19:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.596+0000 7f77bde10800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.596+0000 7f77bde10800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:19:24.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.596+0000 7f77bde10800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.596+0000 7f77bde10800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:19:24.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.597+0000 7f77bde10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:24.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.597+0000 7f77bde10800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.597+0000 7f77bde10800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:19:24.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.597+0000 7f77bde10800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.597+0000 7f77bde10800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:19:24.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.597+0000 7f77bde10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:24.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.599+0000 7f766b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:24.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.601+0000 7f77bde10800 20 remove_watcher() i=0 2024-09-12T00:19:24.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.601+0000 7f77bde10800 2 removed watcher, disabling cache 2024-09-12T00:19:24.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.602+0000 7f77bde10800 20 remove_watcher() i=1 2024-09-12T00:19:24.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.603+0000 7f77bde10800 20 remove_watcher() i=2 2024-09-12T00:19:24.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.604+0000 7f77bde10800 20 remove_watcher() i=3 2024-09-12T00:19:24.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.605+0000 7f77bde10800 20 remove_watcher() i=4 2024-09-12T00:19:24.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.606+0000 7f77bde10800 20 remove_watcher() i=5 2024-09-12T00:19:24.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.608+0000 7f77bde10800 20 remove_watcher() i=6 2024-09-12T00:19:24.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.609+0000 7f77bde10800 20 remove_watcher() i=7 2024-09-12T00:19:24.620 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:24.620 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:19:24.620 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-set-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:19:24.620 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:24.685 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T00:19:24.685 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:24.901 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:19:24.930 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:24.930 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:24.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.970+0000 7f8efda0f800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.972+0000 7f8efda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.972+0000 7f8efda0f800 20 realm 2024-09-12T00:19:24.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.972+0000 7f8efda0f800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.972+0000 7f8efda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.972+0000 7f8efda0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:24.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.972+0000 7f8efda0f800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.972+0000 7f8efda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.972+0000 7f8efda0f800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.973+0000 7f8efda0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:24.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.973+0000 7f8efda0f800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.974+0000 7f8efda0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:24.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.974+0000 7f8efda0f800 20 searching for the correct realm 2024-09-12T00:19:24.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.977+0000 7f8ef9122640 0 -- 172.21.15.67:0/1458639100 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f8eec0a0420 msgr2=0x7f8eec0a0840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:24.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.981+0000 7f8ef9122640 0 -- 172.21.15.67:0/1458639100 >> [v2:172.21.15.67:6800/2522402523,v1:172.21.15.67:6801/2522402523] conn(0x55fd830f3900 msgr2=0x55fd830f5cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:24.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.984+0000 7f8efda0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:24.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.984+0000 7f8efda0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:24.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.984+0000 7f8efda0f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:24.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.984+0000 7f8efda0f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:24.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.984+0000 7f8efda0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:24.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.984+0000 7f8efda0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:24.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.984+0000 7f8efda0f800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.984+0000 7f8efda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.984+0000 7f8efda0f800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.985+0000 7f8efda0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:24.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.985+0000 7f8efda0f800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.985+0000 7f8efda0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:24.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.985+0000 7f8efda0f800 20 zone default found 2024-09-12T00:19:24.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.985+0000 7f8efda0f800 4 Realm: () 2024-09-12T00:19:24.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.985+0000 7f8efda0f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:24.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.985+0000 7f8efda0f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:24.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.985+0000 7f8efda0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:24.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.985+0000 7f8efda0f800 20 zonegroup default 2024-09-12T00:19:24.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.985+0000 7f8efda0f800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.985+0000 7f8efda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.985+0000 7f8efda0f800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.985+0000 7f8efda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.985+0000 7f8efda0f800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.986+0000 7f8efda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:24.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.986+0000 7f8efda0f800 20 started sync module instance, tier type = 2024-09-12T00:19:24.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.986+0000 7f8efda0f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:24.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.994+0000 7f8efda0f800 20 add_watcher() i=0 2024-09-12T00:19:24.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.994+0000 7f8efda0f800 20 add_watcher() i=1 2024-09-12T00:19:24.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.994+0000 7f8efda0f800 20 add_watcher() i=2 2024-09-12T00:19:24.993 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.994+0000 7f8efda0f800 20 add_watcher() i=3 2024-09-12T00:19:24.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.994+0000 7f8efda0f800 20 add_watcher() i=4 2024-09-12T00:19:24.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.994+0000 7f8efda0f800 20 add_watcher() i=5 2024-09-12T00:19:24.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.994+0000 7f8efda0f800 20 add_watcher() i=6 2024-09-12T00:19:24.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.995+0000 7f8efda0f800 20 add_watcher() i=7 2024-09-12T00:19:24.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.995+0000 7f8efda0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:24.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.997+0000 7f8daffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:24.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.997+0000 7f8efda0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:24.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.997+0000 7f8efda0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:24.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.997+0000 7f8efda0f800 5 note: GC not initialized 2024-09-12T00:19:24.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.997+0000 7f8daefe5640 20 reqs_thread_entry: start 2024-09-12T00:19:24.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.997+0000 7f8efda0f800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:24.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.997+0000 7f8efda0f800 20 Filter name: none 2024-09-12T00:19:24.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.998+0000 7f8dacfe1640 20 reqs_thread_entry: start 2024-09-12T00:19:24.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.998+0000 7f8efda0f800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.998+0000 7f8efda0f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:24.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.998+0000 7f8efda0f800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.999+0000 7f8efda0f800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:19:24.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.999+0000 7f8efda0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:24.998 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.999+0000 7f8efda0f800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.999+0000 7f8efda0f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:24.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.999+0000 7f8efda0f800 20 rados->read ofs=0 len=0 2024-09-12T00:19:24.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.999+0000 7f8efda0f800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:19:24.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:24.999+0000 7f8efda0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:25.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.001+0000 7f8daffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:25.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.003+0000 7f8efda0f800 20 remove_watcher() i=0 2024-09-12T00:19:25.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.003+0000 7f8efda0f800 2 removed watcher, disabling cache 2024-09-12T00:19:25.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.004+0000 7f8efda0f800 20 remove_watcher() i=1 2024-09-12T00:19:25.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.005+0000 7f8efda0f800 20 remove_watcher() i=2 2024-09-12T00:19:25.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.006+0000 7f8efda0f800 20 remove_watcher() i=3 2024-09-12T00:19:25.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.007+0000 7f8efda0f800 20 remove_watcher() i=4 2024-09-12T00:19:25.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.008+0000 7f8efda0f800 20 remove_watcher() i=5 2024-09-12T00:19:25.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.009+0000 7f8efda0f800 20 remove_watcher() i=6 2024-09-12T00:19:25.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.010+0000 7f8efda0f800 20 remove_watcher() i=7 2024-09-12T00:19:25.020 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:25.020 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:19:25.020 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-trim-reshard-log-entries id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:19:25.020 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:25.021 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T00:19:25.057 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:25.057 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:25.096 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.097+0000 7f1508413800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.099+0000 7f1508413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.099+0000 7f1508413800 20 realm 2024-09-12T00:19:25.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.099+0000 7f1508413800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.099+0000 7f1508413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.099+0000 7f1508413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:25.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.099+0000 7f1508413800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.099+0000 7f1508413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.099 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.099+0000 7f1508413800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.100+0000 7f1508413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:25.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.100+0000 7f1508413800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.101+0000 7f1508413800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:25.100 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.101+0000 7f1508413800 20 searching for the correct realm 2024-09-12T00:19:25.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.103+0000 7f1503347640 0 -- 172.21.15.67:0/1416834102 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f14f806c700 msgr2=0x7f14f806a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:19:25.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.311+0000 7f1503b48640 0 -- 172.21.15.67:0/1416834102 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f14fc06c410 msgr2=0x7f14fc06c810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:19:25.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.315+0000 7f1508413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:25.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.315+0000 7f1508413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:25.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.315+0000 7f1508413800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:25.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.315+0000 7f1508413800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:25.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.315+0000 7f1508413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:25.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.315+0000 7f1508413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:25.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.315+0000 7f1508413800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.315+0000 7f1508413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.315+0000 7f1508413800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.316+0000 7f1508413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:25.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.316+0000 7f1508413800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.316+0000 7f1508413800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:25.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.316+0000 7f1508413800 20 zone default found 2024-09-12T00:19:25.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.316+0000 7f1508413800 4 Realm: () 2024-09-12T00:19:25.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.316+0000 7f1508413800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:25.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.316+0000 7f1508413800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:25.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.316+0000 7f1508413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:25.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.316+0000 7f1508413800 20 zonegroup default 2024-09-12T00:19:25.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.316+0000 7f1508413800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.316+0000 7f1508413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.316+0000 7f1508413800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.317+0000 7f1508413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.317+0000 7f1508413800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.317+0000 7f1508413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.317+0000 7f1508413800 20 started sync module instance, tier type = 2024-09-12T00:19:25.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.317+0000 7f1508413800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:25.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.326+0000 7f1508413800 20 add_watcher() i=0 2024-09-12T00:19:25.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.326+0000 7f1508413800 20 add_watcher() i=1 2024-09-12T00:19:25.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.326+0000 7f1508413800 20 add_watcher() i=2 2024-09-12T00:19:25.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.326+0000 7f1508413800 20 add_watcher() i=3 2024-09-12T00:19:25.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.326+0000 7f1508413800 20 add_watcher() i=4 2024-09-12T00:19:25.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.326+0000 7f1508413800 20 add_watcher() i=5 2024-09-12T00:19:25.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.326+0000 7f1508413800 20 add_watcher() i=6 2024-09-12T00:19:25.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.327+0000 7f1508413800 20 add_watcher() i=7 2024-09-12T00:19:25.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.327+0000 7f1508413800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:25.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.328+0000 7f13b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:25.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.328+0000 7f1508413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:25.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.329+0000 7f1508413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:25.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.329+0000 7f1508413800 5 note: GC not initialized 2024-09-12T00:19:25.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.329+0000 7f13b8fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:25.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.329+0000 7f1508413800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:25.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.329+0000 7f1508413800 20 Filter name: none 2024-09-12T00:19:25.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.329+0000 7f13327fc640 20 reqs_thread_entry: start 2024-09-12T00:19:25.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.329+0000 7f1508413800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:19:25.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.329+0000 7f1508413800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.329+0000 7f1508413800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:25.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.329+0000 7f1508413800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:19:25.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.329+0000 7f1508413800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:19:25.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.330+0000 7f1508413800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 : miss 2024-09-12T00:19:25.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.330+0000 7f1508413800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.330+0000 7f1508413800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:19:25.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.330+0000 7f1508413800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 info.flags=0x17 2024-09-12T00:19:25.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.330+0000 7f1508413800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 to cache LRU end 2024-09-12T00:19:25.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.330+0000 7f1508413800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:25.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.330+0000 7f1508413800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:25.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.330+0000 7f1508413800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 2024-09-12T00:19:25.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.334+0000 7f1508413800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 info.flags=0x17 2024-09-12T00:19:25.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.334+0000 7f1508413800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 to cache LRU end 2024-09-12T00:19:25.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.334+0000 7f1508413800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:25.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.334+0000 7f1508413800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25, ofs0, ns] 2024-09-12T00:19:25.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.334+0000 7f13e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562418 cookie 94740625815664 notifier 6350 bl.length()=939 2024-09-12T00:19:25.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.334+0000 7f13e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 info.flags=0x17 2024-09-12T00:19:25.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.334+0000 7f13e2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 to cache LRU end 2024-09-12T00:19:25.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.334+0000 7f13e2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:25.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.334+0000 7f1508413800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): orig_sources= new_sources= 2024-09-12T00:19:25.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.334+0000 7f1508413800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): potential sources added=[] removed=[] 2024-09-12T00:19:25.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.334+0000 7f1508413800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): orig_dests= new_dests= 2024-09-12T00:19:25.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.334+0000 7f1508413800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): potential dests added=[] removed=[] 2024-09-12T00:19:25.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.334+0000 7f1508413800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T00:19:25.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.334+0000 7f1508413800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T00:19:25.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.336+0000 7f13b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:25.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.338+0000 7f1508413800 20 remove_watcher() i=0 2024-09-12T00:19:25.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.338+0000 7f1508413800 2 removed watcher, disabling cache 2024-09-12T00:19:25.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.339+0000 7f1508413800 20 remove_watcher() i=1 2024-09-12T00:19:25.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.340+0000 7f1508413800 20 remove_watcher() i=2 2024-09-12T00:19:25.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.341+0000 7f1508413800 20 remove_watcher() i=3 2024-09-12T00:19:25.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.342+0000 7f1508413800 20 remove_watcher() i=4 2024-09-12T00:19:25.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.343+0000 7f1508413800 20 remove_watcher() i=5 2024-09-12T00:19:25.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.344+0000 7f1508413800 20 remove_watcher() i=6 2024-09-12T00:19:25.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.345+0000 7f1508413800 20 remove_watcher() i=7 2024-09-12T00:19:25.357 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:19:25.386 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:25.387 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:25.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.427+0000 7fa1be923800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.429+0000 7fa1be923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.429+0000 7fa1be923800 20 realm 2024-09-12T00:19:25.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.429+0000 7fa1be923800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.429+0000 7fa1be923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.429+0000 7fa1be923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:25.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.429+0000 7fa1be923800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.429+0000 7fa1be923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.429+0000 7fa1be923800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.430+0000 7fa1be923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:25.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.430+0000 7fa1be923800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.431+0000 7fa1be923800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:25.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.431+0000 7fa1be923800 20 searching for the correct realm 2024-09-12T00:19:25.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.433+0000 7fa1b9e12640 0 -- 172.21.15.67:0/3536584964 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fa1b00b7780 msgr2=0x7fa1b00a3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:25.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.638+0000 7fa1bae14640 0 -- 172.21.15.67:0/3536584964 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5594e6a34070 msgr2=0x5594e6a364c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:25.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.642+0000 7fa1be923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:25.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.642+0000 7fa1be923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:25.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.642+0000 7fa1be923800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:25.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.642+0000 7fa1be923800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:25.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.642+0000 7fa1be923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:25.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.642+0000 7fa1be923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:25.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.642+0000 7fa1be923800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.642+0000 7fa1be923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.642+0000 7fa1be923800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.642+0000 7fa1be923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:25.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.642+0000 7fa1be923800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.643+0000 7fa1be923800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:25.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.643+0000 7fa1be923800 20 zone default found 2024-09-12T00:19:25.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.643+0000 7fa1be923800 4 Realm: () 2024-09-12T00:19:25.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.643+0000 7fa1be923800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:25.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.643+0000 7fa1be923800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:25.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.643+0000 7fa1be923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:25.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.643+0000 7fa1be923800 20 zonegroup default 2024-09-12T00:19:25.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.643+0000 7fa1be923800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.643+0000 7fa1be923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.643+0000 7fa1be923800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.643+0000 7fa1be923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.643+0000 7fa1be923800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.644+0000 7fa1be923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.644+0000 7fa1be923800 20 started sync module instance, tier type = 2024-09-12T00:19:25.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.644+0000 7fa1be923800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:25.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.652+0000 7fa1be923800 20 add_watcher() i=0 2024-09-12T00:19:25.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.652+0000 7fa1be923800 20 add_watcher() i=1 2024-09-12T00:19:25.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.652+0000 7fa1be923800 20 add_watcher() i=2 2024-09-12T00:19:25.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.652+0000 7fa1be923800 20 add_watcher() i=3 2024-09-12T00:19:25.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.652+0000 7fa1be923800 20 add_watcher() i=4 2024-09-12T00:19:25.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.652+0000 7fa1be923800 20 add_watcher() i=5 2024-09-12T00:19:25.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.652+0000 7fa1be923800 20 add_watcher() i=6 2024-09-12T00:19:25.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.654+0000 7fa1be923800 20 add_watcher() i=7 2024-09-12T00:19:25.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.654+0000 7fa1be923800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:25.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.656+0000 7fa070fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:25.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.656+0000 7fa1be923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:25.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.656+0000 7fa1be923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:25.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.656+0000 7fa1be923800 5 note: GC not initialized 2024-09-12T00:19:25.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.656+0000 7f9feb7fe640 20 reqs_thread_entry: start 2024-09-12T00:19:25.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.656+0000 7fa1be923800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:25.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.656+0000 7fa1be923800 20 Filter name: none 2024-09-12T00:19:25.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.656+0000 7f9fe97fa640 20 reqs_thread_entry: start 2024-09-12T00:19:25.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.657+0000 7fa1be923800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.657+0000 7fa1be923800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:25.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.657+0000 7fa1be923800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.657+0000 7fa1be923800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:19:25.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.657+0000 7fa1be923800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:25.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.657+0000 7fa1be923800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.658+0000 7fa1be923800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:25.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.658+0000 7fa1be923800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.658+0000 7fa1be923800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:19:25.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.658+0000 7fa1be923800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:25.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.659+0000 7fa070fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:25.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.662+0000 7fa1be923800 20 remove_watcher() i=0 2024-09-12T00:19:25.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.662+0000 7fa1be923800 2 removed watcher, disabling cache 2024-09-12T00:19:25.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.663+0000 7fa1be923800 20 remove_watcher() i=1 2024-09-12T00:19:25.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.664+0000 7fa1be923800 20 remove_watcher() i=2 2024-09-12T00:19:25.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.665+0000 7fa1be923800 20 remove_watcher() i=3 2024-09-12T00:19:25.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.666+0000 7fa1be923800 20 remove_watcher() i=4 2024-09-12T00:19:25.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.667+0000 7fa1be923800 20 remove_watcher() i=5 2024-09-12T00:19:25.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.668+0000 7fa1be923800 20 remove_watcher() i=6 2024-09-12T00:19:25.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.669+0000 7fa1be923800 20 remove_watcher() i=7 2024-09-12T00:19:25.679 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:25.679 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:19:25.679 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-trim-reshard-log-entries id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:19:25.680 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:25.732 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:19:25.764 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:25.764 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:25.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.805+0000 7f07ee40e800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.807+0000 7f07ee40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.807+0000 7f07ee40e800 20 realm 2024-09-12T00:19:25.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.807+0000 7f07ee40e800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.807+0000 7f07ee40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.807+0000 7f07ee40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:25.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.807+0000 7f07ee40e800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.807+0000 7f07ee40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:25.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.807+0000 7f07ee40e800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.808+0000 7f07ee40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:25.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.808+0000 7f07ee40e800 20 rados->read ofs=0 len=0 2024-09-12T00:19:25.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.809+0000 7f07ee40e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:25.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.809+0000 7f07ee40e800 20 searching for the correct realm 2024-09-12T00:19:25.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:25.812+0000 7f07e9258640 0 -- 172.21.15.67:0/751562291 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f07e001f070 msgr2=0x7f07e0008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:26.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.017+0000 7f07e9258640 0 -- 172.21.15.67:0/751562291 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55daac6aa410 msgr2=0x55daac6ac860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:26.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:26.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:26.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:26.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:26.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:26.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:26.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:26.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:26.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:26.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 20 zone default found 2024-09-12T00:19:26.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 4 Realm: () 2024-09-12T00:19:26.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:26.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:26.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:26.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 20 zonegroup default 2024-09-12T00:19:26.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.022+0000 7f07ee40e800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.023+0000 7f07ee40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:26.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.023+0000 7f07ee40e800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.023+0000 7f07ee40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:26.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.023+0000 7f07ee40e800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.023+0000 7f07ee40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:26.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.023+0000 7f07ee40e800 20 started sync module instance, tier type = 2024-09-12T00:19:26.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.023+0000 7f07ee40e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:26.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.032+0000 7f07ee40e800 20 add_watcher() i=0 2024-09-12T00:19:26.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.032+0000 7f07ee40e800 20 add_watcher() i=1 2024-09-12T00:19:26.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.032+0000 7f07ee40e800 20 add_watcher() i=2 2024-09-12T00:19:26.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.032+0000 7f07ee40e800 20 add_watcher() i=3 2024-09-12T00:19:26.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.032+0000 7f07ee40e800 20 add_watcher() i=4 2024-09-12T00:19:26.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.032+0000 7f07ee40e800 20 add_watcher() i=5 2024-09-12T00:19:26.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.032+0000 7f07ee40e800 20 add_watcher() i=6 2024-09-12T00:19:26.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.033+0000 7f07ee40e800 20 add_watcher() i=7 2024-09-12T00:19:26.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.033+0000 7f07ee40e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:26.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.035+0000 7f069bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:26.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.035+0000 7f07ee40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:26.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.035+0000 7f07ee40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:26.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.035+0000 7f07ee40e800 5 note: GC not initialized 2024-09-12T00:19:26.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.035+0000 7f069affd640 20 reqs_thread_entry: start 2024-09-12T00:19:26.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.035+0000 7f07ee40e800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:26.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.035+0000 7f07ee40e800 20 Filter name: none 2024-09-12T00:19:26.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.036+0000 7f0698ff9640 20 reqs_thread_entry: start 2024-09-12T00:19:26.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.036+0000 7f07ee40e800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:19:26.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.036+0000 7f07ee40e800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.036+0000 7f07ee40e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:26.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.036+0000 7f07ee40e800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:19:26.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.036+0000 7f07ee40e800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:19:26.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.036+0000 7f07ee40e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 : miss 2024-09-12T00:19:26.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.036+0000 7f07ee40e800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.036+0000 7f07ee40e800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:19:26.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.036+0000 7f07ee40e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 info.flags=0x17 2024-09-12T00:19:26.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.036+0000 7f07ee40e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 to cache LRU end 2024-09-12T00:19:26.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.036+0000 7f07ee40e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:26.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.036+0000 7f07ee40e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:26.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.036+0000 7f07ee40e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 2024-09-12T00:19:26.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.038+0000 7f07ee40e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:19:26.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.042+0000 7f07ee40e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 info.flags=0x17 2024-09-12T00:19:26.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.042+0000 7f07ee40e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 to cache LRU end 2024-09-12T00:19:26.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.042+0000 7f07ee40e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:26.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.042+0000 7f07ee40e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25, ofs0, ns] 2024-09-12T00:19:26.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.042+0000 7f06cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562419 cookie 94397683965952 notifier 6386 bl.length()=939 2024-09-12T00:19:26.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.042+0000 7f06cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 info.flags=0x17 2024-09-12T00:19:26.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.042+0000 7f06cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 to cache LRU end 2024-09-12T00:19:26.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.042+0000 7f06cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:26.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.043+0000 7f07ee40e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): orig_sources= new_sources= 2024-09-12T00:19:26.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.043+0000 7f07ee40e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): potential sources added=[] removed=[] 2024-09-12T00:19:26.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.043+0000 7f07ee40e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): orig_dests= new_dests= 2024-09-12T00:19:26.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.043+0000 7f07ee40e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): potential dests added=[] removed=[] 2024-09-12T00:19:26.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.045+0000 7f07ee40e800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25.2.0 2024-09-12T00:19:26.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.045+0000 7f07ee40e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25.2.0 2024-09-12T00:19:26.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.045+0000 7f07ee40e800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25.2.1 2024-09-12T00:19:26.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.045+0000 7f07ee40e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25.2.1 2024-09-12T00:19:26.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.045+0000 7f07ee40e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25.0 2024-09-12T00:19:26.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.047+0000 7f07ee40e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:19:26.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.047+0000 7f07ee40e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 2024-09-12T00:19:26.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.048+0000 7f07ee40e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 info.flags=0x17 2024-09-12T00:19:26.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.048+0000 7f07ee40e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 to cache LRU end 2024-09-12T00:19:26.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.048+0000 7f07ee40e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:26.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.048+0000 7f07ee40e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25, ofs0, ns] 2024-09-12T00:19:26.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.049+0000 7f06cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562420 cookie 94397683965952 notifier 6386 bl.length()=939 2024-09-12T00:19:26.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.049+0000 7f06cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 info.flags=0x17 2024-09-12T00:19:26.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.049+0000 7f06cd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 to cache LRU end 2024-09-12T00:19:26.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.049+0000 7f06cd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:26.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.049+0000 7f07ee40e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): orig_sources= new_sources= 2024-09-12T00:19:26.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.049+0000 7f07ee40e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): potential sources added=[] removed=[] 2024-09-12T00:19:26.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.049+0000 7f07ee40e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): orig_dests= new_dests= 2024-09-12T00:19:26.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.049+0000 7f07ee40e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): potential dests added=[] removed=[] 2024-09-12T00:19:26.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.050+0000 7f07ee40e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25.0 2024-09-12T00:19:26.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.050+0000 7f07ee40e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:19:26.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.050+0000 7f07ee40e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 2024-09-12T00:19:26.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.052+0000 7f07ee40e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 info.flags=0x17 2024-09-12T00:19:26.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.052+0000 7f07ee40e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 to cache LRU end 2024-09-12T00:19:26.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.052+0000 7f07ee40e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:26.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.052+0000 7f07ee40e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25, ofs0, ns] 2024-09-12T00:19:26.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.052+0000 7f06ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562421 cookie 94397683965952 notifier 6386 bl.length()=907 2024-09-12T00:19:26.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.052+0000 7f06ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 info.flags=0x17 2024-09-12T00:19:26.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.052+0000 7f06ccff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 to cache LRU end 2024-09-12T00:19:26.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.052+0000 7f06ccff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:26.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.053+0000 7f07ee40e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): orig_sources= new_sources= 2024-09-12T00:19:26.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.053+0000 7f07ee40e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): potential sources added=[] removed=[] 2024-09-12T00:19:26.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.053+0000 7f07ee40e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): orig_dests= new_dests= 2024-09-12T00:19:26.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.053+0000 7f07ee40e800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25]): potential dests added=[] removed=[] 2024-09-12T00:19:26.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.054+0000 7f07ee40e800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:19:26.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.056+0000 7f069bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:26.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.058+0000 7f07ee40e800 20 remove_watcher() i=0 2024-09-12T00:19:26.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.058+0000 7f07ee40e800 2 removed watcher, disabling cache 2024-09-12T00:19:26.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.059+0000 7f07ee40e800 20 remove_watcher() i=1 2024-09-12T00:19:26.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.060+0000 7f07ee40e800 20 remove_watcher() i=2 2024-09-12T00:19:26.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.061+0000 7f07ee40e800 20 remove_watcher() i=3 2024-09-12T00:19:26.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.062+0000 7f07ee40e800 20 remove_watcher() i=4 2024-09-12T00:19:26.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.063+0000 7f07ee40e800 20 remove_watcher() i=5 2024-09-12T00:19:26.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.064+0000 7f07ee40e800 20 remove_watcher() i=6 2024-09-12T00:19:26.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.066+0000 7f07ee40e800 20 remove_watcher() i=7 2024-09-12T00:19:26.078 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:19:26.107 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:26.107 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:26.146 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.147+0000 7fd724f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.149+0000 7fd724f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:26.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.149+0000 7fd724f0c800 20 realm 2024-09-12T00:19:26.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.149+0000 7fd724f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.149+0000 7fd724f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:26.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.149+0000 7fd724f0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:26.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.149+0000 7fd724f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.149+0000 7fd724f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:26.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.149+0000 7fd724f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.150+0000 7fd724f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:26.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.150+0000 7fd724f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.151+0000 7fd724f0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:26.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.151+0000 7fd724f0c800 20 searching for the correct realm 2024-09-12T00:19:26.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.154+0000 7fd7221f5640 0 -- 172.21.15.67:0/1708274595 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fd70c01f970 msgr2=0x7fd70c045420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:26.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.359+0000 7fd7231f7640 0 -- 172.21.15.67:0/1708274595 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x560425811de0 msgr2=0x560425814230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:26.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.363+0000 7fd724f0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:26.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:26.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:26.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:26.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:26.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:26.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:26.364 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:26.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:26.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 20 zone default found 2024-09-12T00:19:26.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 4 Realm: () 2024-09-12T00:19:26.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:26.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:26.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:26.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 20 zonegroup default 2024-09-12T00:19:26.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.364+0000 7fd724f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.365+0000 7fd724f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:26.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.365+0000 7fd724f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.365+0000 7fd724f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:26.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.365+0000 7fd724f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.365+0000 7fd724f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:26.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.365+0000 7fd724f0c800 20 started sync module instance, tier type = 2024-09-12T00:19:26.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.365+0000 7fd724f0c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:26.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.374+0000 7fd724f0c800 20 add_watcher() i=0 2024-09-12T00:19:26.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.374+0000 7fd724f0c800 20 add_watcher() i=1 2024-09-12T00:19:26.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.374+0000 7fd724f0c800 20 add_watcher() i=2 2024-09-12T00:19:26.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.374+0000 7fd724f0c800 20 add_watcher() i=3 2024-09-12T00:19:26.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.374+0000 7fd724f0c800 20 add_watcher() i=4 2024-09-12T00:19:26.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.374+0000 7fd724f0c800 20 add_watcher() i=5 2024-09-12T00:19:26.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.374+0000 7fd724f0c800 20 add_watcher() i=6 2024-09-12T00:19:26.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.375+0000 7fd724f0c800 20 add_watcher() i=7 2024-09-12T00:19:26.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.375+0000 7fd724f0c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:26.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.377+0000 7fd5d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:26.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.377+0000 7fd724f0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:26.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.377+0000 7fd724f0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:26.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.377+0000 7fd724f0c800 5 note: GC not initialized 2024-09-12T00:19:26.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.377+0000 7fd553fff640 20 reqs_thread_entry: start 2024-09-12T00:19:26.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.377+0000 7fd724f0c800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:26.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.377+0000 7fd724f0c800 20 Filter name: none 2024-09-12T00:19:26.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.378+0000 7fd551ffb640 20 reqs_thread_entry: start 2024-09-12T00:19:26.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.378+0000 7fd724f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.378+0000 7fd724f0c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:26.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.378+0000 7fd724f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.378+0000 7fd724f0c800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:19:26.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.378+0000 7fd724f0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:26.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.379+0000 7fd724f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.379+0000 7fd724f0c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:26.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.379+0000 7fd724f0c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.379+0000 7fd724f0c800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:19:26.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.379+0000 7fd724f0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:26.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.381+0000 7fd5d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:26.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.383+0000 7fd724f0c800 20 remove_watcher() i=0 2024-09-12T00:19:26.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.383+0000 7fd724f0c800 2 removed watcher, disabling cache 2024-09-12T00:19:26.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.384+0000 7fd724f0c800 20 remove_watcher() i=1 2024-09-12T00:19:26.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.384+0000 7fd724f0c800 20 remove_watcher() i=2 2024-09-12T00:19:26.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.385+0000 7fd724f0c800 20 remove_watcher() i=3 2024-09-12T00:19:26.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.386+0000 7fd724f0c800 20 remove_watcher() i=4 2024-09-12T00:19:26.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.388+0000 7fd724f0c800 20 remove_watcher() i=5 2024-09-12T00:19:26.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.388+0000 7fd724f0c800 20 remove_watcher() i=6 2024-09-12T00:19:26.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.389+0000 7fd724f0c800 20 remove_watcher() i=7 2024-09-12T00:19:26.399 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:26.400 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:19:26.400 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-trim-reshard-log-entries id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:19:26.400 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:26.462 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T00:19:26.463 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:26.701 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:19:26.730 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:26.730 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:26.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.769+0000 7f067cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.771+0000 7f067cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:26.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.771+0000 7f067cd46800 20 realm 2024-09-12T00:19:26.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.771+0000 7f067cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.771+0000 7f067cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:26.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.771+0000 7f067cd46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:26.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.771+0000 7f067cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.771+0000 7f067cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:26.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.771+0000 7f067cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.772+0000 7f067cd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:26.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.772+0000 7f067cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:19:26.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.773+0000 7f067cd46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:26.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.773+0000 7f067cd46800 20 searching for the correct realm 2024-09-12T00:19:26.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.775+0000 7f067a036640 0 -- 172.21.15.67:0/1972522362 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f06700a48b0 msgr2=0x7f06700639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:26.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:26.981+0000 7f067a837640 0 -- 172.21.15.67:0/1972522362 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f0674066040 msgr2=0x7f0674070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:19:27.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.188+0000 7f067cd46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:27.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.188+0000 7f067cd46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.188+0000 7f067cd46800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.188+0000 7f067cd46800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.188+0000 7f067cd46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.188+0000 7f067cd46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.188+0000 7f067cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.188+0000 7f067cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.188+0000 7f067cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.188+0000 7f067cd46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.188+0000 7f067cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.189 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.189+0000 7f067cd46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:27.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.189+0000 7f067cd46800 20 zone default found 2024-09-12T00:19:27.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.189+0000 7f067cd46800 4 Realm: () 2024-09-12T00:19:27.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.189+0000 7f067cd46800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:27.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.189+0000 7f067cd46800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:27.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.189+0000 7f067cd46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:27.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.189+0000 7f067cd46800 20 zonegroup default 2024-09-12T00:19:27.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.189+0000 7f067cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.189+0000 7f067cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.189+0000 7f067cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.189+0000 7f067cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.189+0000 7f067cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.189+0000 7f067cd46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.189+0000 7f067cd46800 20 started sync module instance, tier type = 2024-09-12T00:19:27.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.189+0000 7f067cd46800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:27.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.199+0000 7f067cd46800 20 add_watcher() i=0 2024-09-12T00:19:27.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.199+0000 7f067cd46800 20 add_watcher() i=1 2024-09-12T00:19:27.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.199+0000 7f067cd46800 20 add_watcher() i=2 2024-09-12T00:19:27.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.199+0000 7f067cd46800 20 add_watcher() i=3 2024-09-12T00:19:27.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.199+0000 7f067cd46800 20 add_watcher() i=4 2024-09-12T00:19:27.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.199+0000 7f067cd46800 20 add_watcher() i=5 2024-09-12T00:19:27.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.199+0000 7f067cd46800 20 add_watcher() i=6 2024-09-12T00:19:27.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.200+0000 7f067cd46800 20 add_watcher() i=7 2024-09-12T00:19:27.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.200+0000 7f067cd46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:27.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.203+0000 7f05317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:27.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.203+0000 7f067cd46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:27.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.203+0000 7f067cd46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:27.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.203+0000 7f067cd46800 5 note: GC not initialized 2024-09-12T00:19:27.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.203+0000 7f04abfff640 20 reqs_thread_entry: start 2024-09-12T00:19:27.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.203+0000 7f067cd46800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:27.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.203+0000 7f067cd46800 20 Filter name: none 2024-09-12T00:19:27.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.203+0000 7f04a9ffb640 20 reqs_thread_entry: start 2024-09-12T00:19:27.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.204+0000 7f067cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.204+0000 7f067cd46800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:27.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.204+0000 7f067cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.205+0000 7f067cd46800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:19:27.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.205+0000 7f067cd46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:27.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.205+0000 7f067cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.205+0000 7f067cd46800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:27.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.205+0000 7f067cd46800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.205+0000 7f067cd46800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:19:27.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.205+0000 7f067cd46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:27.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.206+0000 7f05317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:27.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.209+0000 7f067cd46800 20 remove_watcher() i=0 2024-09-12T00:19:27.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.209+0000 7f067cd46800 2 removed watcher, disabling cache 2024-09-12T00:19:27.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.210+0000 7f067cd46800 20 remove_watcher() i=1 2024-09-12T00:19:27.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.210+0000 7f067cd46800 20 remove_watcher() i=2 2024-09-12T00:19:27.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.211+0000 7f067cd46800 20 remove_watcher() i=3 2024-09-12T00:19:27.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.213+0000 7f067cd46800 20 remove_watcher() i=4 2024-09-12T00:19:27.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.214+0000 7f067cd46800 20 remove_watcher() i=5 2024-09-12T00:19:27.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.215+0000 7f067cd46800 20 remove_watcher() i=6 2024-09-12T00:19:27.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.216+0000 7f067cd46800 20 remove_watcher() i=7 2024-09-12T00:19:27.226 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:27.226 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:19:27.226 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-trim-reshard-log-entries id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:19:27.226 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:27.228 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T00:19:27.265 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:27.265 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:27.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.305+0000 7f9a2c135800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.307+0000 7f9a2c135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.307+0000 7f9a2c135800 20 realm 2024-09-12T00:19:27.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.307+0000 7f9a2c135800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.307+0000 7f9a2c135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.307+0000 7f9a2c135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:27.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.307+0000 7f9a2c135800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.307+0000 7f9a2c135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.307+0000 7f9a2c135800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.308+0000 7f9a2c135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:27.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.308+0000 7f9a2c135800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.309+0000 7f9a2c135800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:27.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.309+0000 7f9a2c135800 20 searching for the correct realm 2024-09-12T00:19:27.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.312+0000 7f9a286e5640 0 -- 172.21.15.67:0/4186827266 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7f9a1c08f070 msgr2=0x7f9a1c090970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:27.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.315+0000 7f9a27ee4640 0 -- 172.21.15.67:0/4186827266 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f9a20093920 msgr2=0x7f9a20055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:27.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.319+0000 7f9a2c135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:27.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.319+0000 7f9a2c135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:27.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.319+0000 7f9a2c135800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:27.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.319+0000 7f9a2c135800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:27.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.319+0000 7f9a2c135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:27.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.319+0000 7f9a2c135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:27.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.319+0000 7f9a2c135800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.320+0000 7f9a2c135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.320+0000 7f9a2c135800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.320+0000 7f9a2c135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:27.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.320+0000 7f9a2c135800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.320+0000 7f9a2c135800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:27.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.320+0000 7f9a2c135800 20 zone default found 2024-09-12T00:19:27.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.320+0000 7f9a2c135800 4 Realm: () 2024-09-12T00:19:27.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.320+0000 7f9a2c135800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:27.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.320+0000 7f9a2c135800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:27.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.320+0000 7f9a2c135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:27.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.320+0000 7f9a2c135800 20 zonegroup default 2024-09-12T00:19:27.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.320+0000 7f9a2c135800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.320+0000 7f9a2c135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.320+0000 7f9a2c135800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.321+0000 7f9a2c135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.321+0000 7f9a2c135800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.321+0000 7f9a2c135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.321+0000 7f9a2c135800 20 started sync module instance, tier type = 2024-09-12T00:19:27.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.321+0000 7f9a2c135800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:27.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.329+0000 7f9a2c135800 20 add_watcher() i=0 2024-09-12T00:19:27.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.329+0000 7f9a2c135800 20 add_watcher() i=1 2024-09-12T00:19:27.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.329+0000 7f9a2c135800 20 add_watcher() i=2 2024-09-12T00:19:27.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.329+0000 7f9a2c135800 20 add_watcher() i=3 2024-09-12T00:19:27.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.329+0000 7f9a2c135800 20 add_watcher() i=4 2024-09-12T00:19:27.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.329+0000 7f9a2c135800 20 add_watcher() i=5 2024-09-12T00:19:27.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.329+0000 7f9a2c135800 20 add_watcher() i=6 2024-09-12T00:19:27.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.330+0000 7f9a2c135800 20 add_watcher() i=7 2024-09-12T00:19:27.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.330+0000 7f9a2c135800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:27.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.332+0000 7f98ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:27.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.332+0000 7f9a2c135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:27.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.332+0000 7f9a2c135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:27.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.332+0000 7f9a2c135800 5 note: GC not initialized 2024-09-12T00:19:27.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.333+0000 7f98dcfe1640 20 reqs_thread_entry: start 2024-09-12T00:19:27.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.333+0000 7f9a2c135800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:27.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.333+0000 7f9a2c135800 20 Filter name: none 2024-09-12T00:19:27.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.333+0000 7f98567fc640 20 reqs_thread_entry: start 2024-09-12T00:19:27.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.333+0000 7f9a2c135800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:19:27.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.333+0000 7f9a2c135800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.333+0000 7f9a2c135800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:27.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.333+0000 7f9a2c135800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:19:27.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.333+0000 7f9a2c135800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:19:27.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.333+0000 7f9a2c135800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 : miss 2024-09-12T00:19:27.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.333+0000 7f9a2c135800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.334+0000 7f9a2c135800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:19:27.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.334+0000 7f9a2c135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 info.flags=0x17 2024-09-12T00:19:27.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.334+0000 7f9a2c135800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 to cache LRU end 2024-09-12T00:19:27.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.334+0000 7f9a2c135800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:27.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.334+0000 7f9a2c135800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:27.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.334+0000 7f9a2c135800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 2024-09-12T00:19:27.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.338+0000 7f9a2c135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 info.flags=0x17 2024-09-12T00:19:27.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.338+0000 7f9a2c135800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 to cache LRU end 2024-09-12T00:19:27.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.338+0000 7f9a2c135800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:27.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.338+0000 7f9a2c135800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26, ofs0, ns] 2024-09-12T00:19:27.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.338+0000 7f9906ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562424 cookie 94789754650480 notifier 6846 bl.length()=939 2024-09-12T00:19:27.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.338+0000 7f9906ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 info.flags=0x17 2024-09-12T00:19:27.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.338+0000 7f9906ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 to cache LRU end 2024-09-12T00:19:27.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.338+0000 7f9906ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:27.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.338+0000 7f9a2c135800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26]): orig_sources= new_sources= 2024-09-12T00:19:27.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.338+0000 7f9a2c135800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26]): potential sources added=[] removed=[] 2024-09-12T00:19:27.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.338+0000 7f9a2c135800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26]): orig_dests= new_dests= 2024-09-12T00:19:27.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.338+0000 7f9a2c135800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26]): potential dests added=[] removed=[] 2024-09-12T00:19:27.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.338+0000 7f9a2c135800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T00:19:27.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.338+0000 7f9a2c135800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:19:27.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.339+0000 7f9a2c135800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26.1.0 2024-09-12T00:19:27.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.339+0000 7f9a2c135800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26.1.0 2024-09-12T00:19:27.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.339+0000 7f9a2c135800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26.1.1 2024-09-12T00:19:27.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.339+0000 7f9a2c135800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26.1.1 2024-09-12T00:19:27.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.339+0000 7f9a2c135800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26.0 2024-09-12T00:19:27.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.341+0000 7f9a2c135800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:19:27.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.341+0000 7f9a2c135800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 2024-09-12T00:19:27.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.342+0000 7f9a2c135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 info.flags=0x17 2024-09-12T00:19:27.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.342+0000 7f9a2c135800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 to cache LRU end 2024-09-12T00:19:27.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.342+0000 7f9a2c135800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:27.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.342+0000 7f9a2c135800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26, ofs0, ns] 2024-09-12T00:19:27.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.343+0000 7f99067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562425 cookie 94789754650480 notifier 6846 bl.length()=907 2024-09-12T00:19:27.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.343+0000 7f99067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 info.flags=0x17 2024-09-12T00:19:27.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.343+0000 7f99067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 to cache LRU end 2024-09-12T00:19:27.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.343+0000 7f99067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:27.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.343+0000 7f9a2c135800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26]): orig_sources= new_sources= 2024-09-12T00:19:27.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.343+0000 7f9a2c135800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26]): potential sources added=[] removed=[] 2024-09-12T00:19:27.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.343+0000 7f9a2c135800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26]): orig_dests= new_dests= 2024-09-12T00:19:27.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.343+0000 7f9a2c135800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26]): potential dests added=[] removed=[] 2024-09-12T00:19:27.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.344+0000 7f9a2c135800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:19:27.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.346+0000 7f98ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:27.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.348+0000 7f9a2c135800 20 remove_watcher() i=0 2024-09-12T00:19:27.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.348+0000 7f9a2c135800 2 removed watcher, disabling cache 2024-09-12T00:19:27.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.349+0000 7f9a2c135800 20 remove_watcher() i=1 2024-09-12T00:19:27.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.350+0000 7f9a2c135800 20 remove_watcher() i=2 2024-09-12T00:19:27.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.351+0000 7f9a2c135800 20 remove_watcher() i=3 2024-09-12T00:19:27.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.352+0000 7f9a2c135800 20 remove_watcher() i=4 2024-09-12T00:19:27.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.354+0000 7f9a2c135800 20 remove_watcher() i=5 2024-09-12T00:19:27.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.355+0000 7f9a2c135800 20 remove_watcher() i=6 2024-09-12T00:19:27.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.355+0000 7f9a2c135800 20 remove_watcher() i=7 2024-09-12T00:19:27.367 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:19:27.396 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:27.397 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:27.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.436+0000 7fe221939800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.439+0000 7fe221939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.439+0000 7fe221939800 20 realm 2024-09-12T00:19:27.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.439+0000 7fe221939800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.439+0000 7fe221939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.439+0000 7fe221939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:27.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.439+0000 7fe221939800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.439+0000 7fe221939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.439+0000 7fe221939800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.440+0000 7fe221939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:27.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.440+0000 7fe221939800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.441+0000 7fe221939800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:27.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.441+0000 7fe221939800 20 searching for the correct realm 2024-09-12T00:19:27.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.443+0000 7fe21cdc6640 0 -- 172.21.15.67:0/2360285459 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fe214083c20 msgr2=0x7fe21405fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:27.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.648+0000 7fe21cdc6640 0 -- 172.21.15.67:0/2360285459 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5573416d31e0 msgr2=0x5573416d55d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:27.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.652+0000 7fe221939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:27.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.652+0000 7fe221939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:27.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.652+0000 7fe221939800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:27.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.652+0000 7fe221939800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:27.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.652+0000 7fe221939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:27.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.652+0000 7fe221939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:27.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.652+0000 7fe221939800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.653+0000 7fe221939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.653+0000 7fe221939800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.653+0000 7fe221939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:27.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.653+0000 7fe221939800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.653+0000 7fe221939800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:27.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.653+0000 7fe221939800 20 zone default found 2024-09-12T00:19:27.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.653+0000 7fe221939800 4 Realm: () 2024-09-12T00:19:27.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.653+0000 7fe221939800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:27.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.653+0000 7fe221939800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:27.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.653+0000 7fe221939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:27.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.653+0000 7fe221939800 20 zonegroup default 2024-09-12T00:19:27.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.653+0000 7fe221939800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.654+0000 7fe221939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.654+0000 7fe221939800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.654+0000 7fe221939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.654+0000 7fe221939800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.654+0000 7fe221939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:27.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.654+0000 7fe221939800 20 started sync module instance, tier type = 2024-09-12T00:19:27.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.654+0000 7fe221939800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:27.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.663+0000 7fe221939800 20 add_watcher() i=0 2024-09-12T00:19:27.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.663+0000 7fe221939800 20 add_watcher() i=1 2024-09-12T00:19:27.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.663+0000 7fe221939800 20 add_watcher() i=2 2024-09-12T00:19:27.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.663+0000 7fe221939800 20 add_watcher() i=3 2024-09-12T00:19:27.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.663+0000 7fe221939800 20 add_watcher() i=4 2024-09-12T00:19:27.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.663+0000 7fe221939800 20 add_watcher() i=5 2024-09-12T00:19:27.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.663+0000 7fe221939800 20 add_watcher() i=6 2024-09-12T00:19:27.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.664+0000 7fe221939800 20 add_watcher() i=7 2024-09-12T00:19:27.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.664+0000 7fe221939800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:27.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.666+0000 7fe0d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:27.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.666+0000 7fe221939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:27.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.666+0000 7fe221939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:27.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.666+0000 7fe221939800 5 note: GC not initialized 2024-09-12T00:19:27.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.667+0000 7fe0d27e4640 20 reqs_thread_entry: start 2024-09-12T00:19:27.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.667+0000 7fe221939800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:27.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.667+0000 7fe221939800 20 Filter name: none 2024-09-12T00:19:27.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.667+0000 7fe043fff640 20 reqs_thread_entry: start 2024-09-12T00:19:27.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.667+0000 7fe221939800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.667+0000 7fe221939800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:27.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.667+0000 7fe221939800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.668+0000 7fe221939800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:19:27.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.668+0000 7fe221939800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:27.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.668+0000 7fe221939800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.668+0000 7fe221939800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:27.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.668+0000 7fe221939800 20 rados->read ofs=0 len=0 2024-09-12T00:19:27.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.669+0000 7fe221939800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:19:27.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.669+0000 7fe221939800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:27.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.670+0000 7fe0d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:27.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.672+0000 7fe221939800 20 remove_watcher() i=0 2024-09-12T00:19:27.671 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.672+0000 7fe221939800 2 removed watcher, disabling cache 2024-09-12T00:19:27.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.673+0000 7fe221939800 20 remove_watcher() i=1 2024-09-12T00:19:27.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.674+0000 7fe221939800 20 remove_watcher() i=2 2024-09-12T00:19:27.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.675+0000 7fe221939800 20 remove_watcher() i=3 2024-09-12T00:19:27.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.676+0000 7fe221939800 20 remove_watcher() i=4 2024-09-12T00:19:27.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.677+0000 7fe221939800 20 remove_watcher() i=5 2024-09-12T00:19:27.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.678+0000 7fe221939800 20 remove_watcher() i=6 2024-09-12T00:19:27.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:27.679+0000 7fe221939800 20 remove_watcher() i=7 2024-09-12T00:19:27.689 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:27.690 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:19:27.690 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-trim-reshard-log-entries id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:19:27.690 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:27.754 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T00:19:27.755 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:27.973 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:19:28.002 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:28.002 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:28.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.042+0000 7faeea128800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.044+0000 7faeea128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.044+0000 7faeea128800 20 realm 2024-09-12T00:19:28.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.044+0000 7faeea128800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.044+0000 7faeea128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.044+0000 7faeea128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:28.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.044+0000 7faeea128800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.045+0000 7faeea128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.044 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.045+0000 7faeea128800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.045+0000 7faeea128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:28.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.045+0000 7faeea128800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.046+0000 7faeea128800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:28.046 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.046+0000 7faeea128800 20 searching for the correct realm 2024-09-12T00:19:28.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.048+0000 7faee5e6f640 0 -- 172.21.15.67:0/16527361 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7faed8003000 msgr2=0x7faed80a3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:28.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.254+0000 7faee5e6f640 0 -- 172.21.15.67:0/16527361 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7faed0003b20 msgr2=0x7faee0041450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:28.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.461+0000 7faeea128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:28.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.461+0000 7faeea128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:28.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.461+0000 7faeea128800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:28.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.461+0000 7faeea128800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:28.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.461+0000 7faeea128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:28.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.461+0000 7faeea128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:28.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.461+0000 7faeea128800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.461+0000 7faeea128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.461+0000 7faeea128800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.462+0000 7faeea128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:28.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.462+0000 7faeea128800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.462+0000 7faeea128800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:28.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.462+0000 7faeea128800 20 zone default found 2024-09-12T00:19:28.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.462+0000 7faeea128800 4 Realm: () 2024-09-12T00:19:28.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.462+0000 7faeea128800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:28.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.462+0000 7faeea128800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:28.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.462+0000 7faeea128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:28.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.462+0000 7faeea128800 20 zonegroup default 2024-09-12T00:19:28.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.462+0000 7faeea128800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.462+0000 7faeea128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.462+0000 7faeea128800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.463+0000 7faeea128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.463+0000 7faeea128800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.463+0000 7faeea128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.463+0000 7faeea128800 20 started sync module instance, tier type = 2024-09-12T00:19:28.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.463+0000 7faeea128800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:28.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.472+0000 7faeea128800 20 add_watcher() i=0 2024-09-12T00:19:28.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.472+0000 7faeea128800 20 add_watcher() i=1 2024-09-12T00:19:28.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.472+0000 7faeea128800 20 add_watcher() i=2 2024-09-12T00:19:28.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.472+0000 7faeea128800 20 add_watcher() i=3 2024-09-12T00:19:28.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.472+0000 7faeea128800 20 add_watcher() i=4 2024-09-12T00:19:28.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.472+0000 7faeea128800 20 add_watcher() i=5 2024-09-12T00:19:28.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.472+0000 7faeea128800 20 add_watcher() i=6 2024-09-12T00:19:28.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.473+0000 7faeea128800 20 add_watcher() i=7 2024-09-12T00:19:28.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.473+0000 7faeea128800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:28.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.475+0000 7fad977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:28.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.475+0000 7faeea128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:28.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.475+0000 7faeea128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:28.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.475+0000 7faeea128800 5 note: GC not initialized 2024-09-12T00:19:28.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.475+0000 7fad967fc640 20 reqs_thread_entry: start 2024-09-12T00:19:28.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.476+0000 7faeea128800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:28.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.476+0000 7faeea128800 20 Filter name: none 2024-09-12T00:19:28.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.476+0000 7fad07fff640 20 reqs_thread_entry: start 2024-09-12T00:19:28.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.476+0000 7faeea128800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.477+0000 7faeea128800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:28.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.477+0000 7faeea128800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.478+0000 7faeea128800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:19:28.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.478+0000 7faeea128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:28.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.478+0000 7faeea128800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.479+0000 7faeea128800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:28.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.479+0000 7faeea128800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.479+0000 7faeea128800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:19:28.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.479+0000 7faeea128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:28.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.481+0000 7fad977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:28.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.483+0000 7faeea128800 20 remove_watcher() i=0 2024-09-12T00:19:28.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.483+0000 7faeea128800 2 removed watcher, disabling cache 2024-09-12T00:19:28.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.484+0000 7faeea128800 20 remove_watcher() i=1 2024-09-12T00:19:28.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.485+0000 7faeea128800 20 remove_watcher() i=2 2024-09-12T00:19:28.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.486+0000 7faeea128800 20 remove_watcher() i=3 2024-09-12T00:19:28.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.487+0000 7faeea128800 20 remove_watcher() i=4 2024-09-12T00:19:28.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.488+0000 7faeea128800 20 remove_watcher() i=5 2024-09-12T00:19:28.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.489+0000 7faeea128800 20 remove_watcher() i=6 2024-09-12T00:19:28.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.490+0000 7faeea128800 20 remove_watcher() i=7 2024-09-12T00:19:28.501 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.501 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:19:28.501 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-trim-reshard-log-entries id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:19:28.501 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.503 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T00:19:28.538 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:28.539 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:28.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.579+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.581+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.581+0000 7f4743742800 20 realm 2024-09-12T00:19:28.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.581+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.581+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.581+0000 7f4743742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:28.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.581+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.581+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.581+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.582+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:28.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.582+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.583+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:28.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.583+0000 7f4743742800 20 searching for the correct realm 2024-09-12T00:19:28.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.585+0000 7f4736c85640 0 -- 172.21.15.67:0/265077795 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f4728083180 msgr2=0x7f472807b020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:28.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.791+0000 7f473fc87640 0 -- 172.21.15.67:0/265077795 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55923246ba20 msgr2=0x55923246deb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:28.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:28.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:28.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:28.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:28.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:28.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:28.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.795+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.796+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.796+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.796+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:28.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.796+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.797+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:28.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.797+0000 7f4743742800 20 zone default found 2024-09-12T00:19:28.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.797+0000 7f4743742800 4 Realm: () 2024-09-12T00:19:28.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.797+0000 7f4743742800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:28.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.797+0000 7f4743742800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:28.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.797+0000 7f4743742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:28.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.797+0000 7f4743742800 20 zonegroup default 2024-09-12T00:19:28.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.797+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.797+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.797+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.798+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.798+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.798+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.798+0000 7f4743742800 20 started sync module instance, tier type = 2024-09-12T00:19:28.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.798+0000 7f4743742800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:28.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=0 2024-09-12T00:19:28.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=1 2024-09-12T00:19:28.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=2 2024-09-12T00:19:28.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=3 2024-09-12T00:19:28.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=4 2024-09-12T00:19:28.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=5 2024-09-12T00:19:28.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=6 2024-09-12T00:19:28.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.808+0000 7f4743742800 20 add_watcher() i=7 2024-09-12T00:19:28.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.808+0000 7f4743742800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:28.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.810+0000 7f45f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:28.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.810+0000 7f4743742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:28.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.810+0000 7f4743742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:28.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.810+0000 7f4743742800 5 note: GC not initialized 2024-09-12T00:19:28.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.811+0000 7f45f4fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:28.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.811+0000 7f4743742800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:28.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.811+0000 7f4743742800 20 Filter name: none 2024-09-12T00:19:28.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.811+0000 7f456e7fc640 20 reqs_thread_entry: start 2024-09-12T00:19:28.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.811+0000 7f4743742800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:19:28.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.811+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.811+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:28.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.811+0000 7f4743742800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:19:28.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.811+0000 7f4743742800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:19:28.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.811+0000 7f4743742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 : miss 2024-09-12T00:19:28.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.811+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.812+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:19:28.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.812+0000 7f4743742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:28.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.812+0000 7f4743742800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:28.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.812+0000 7f4743742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:28.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.812+0000 7f4743742800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:28.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.812+0000 7f4743742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 2024-09-12T00:19:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.815+0000 7f4743742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.816+0000 7f4743742800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.816+0000 7f4743742800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.816+0000 7f4743742800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27, ofs0, ns] 2024-09-12T00:19:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.816+0000 7f4622ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562480 cookie 94086397143008 notifier 6485 bl.length()=939 2024-09-12T00:19:28.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.816+0000 7f4622ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.816+0000 7f4622ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.816+0000 7f4622ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.816+0000 7f4743742800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): orig_sources= new_sources= 2024-09-12T00:19:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.816+0000 7f4743742800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): potential sources added=[] removed=[] 2024-09-12T00:19:28.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.816+0000 7f4743742800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): orig_dests= new_dests= 2024-09-12T00:19:28.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.816+0000 7f4743742800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): potential dests added=[] removed=[] 2024-09-12T00:19:28.817 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4743742800 time 2024-09-12T00:19:28.818248+0000 2024-09-12T00:19:28.817 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:19:28.817 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:19:28.817 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4744f8c71a] 2024-09-12T00:19:28.817 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4744f8c8d8] 2024-09-12T00:19:28.817 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55922fdf4641] 2024-09-12T00:19:28.817 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd884de) [0x5592303074de] 2024-09-12T00:19:28.817 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55922fe0431d] 2024-09-12T00:19:28.817 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:19:28.818 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4743c29590] 2024-09-12T00:19:28.818 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:19:28.818 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:19:28.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.817+0000 7f4743742800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4743742800 time 2024-09-12T00:19:28.818248+0000 2024-09-12T00:19:28.818 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:19:28.818 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.818 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:19:28.818 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4744f8c71a] 2024-09-12T00:19:28.818 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4744f8c8d8] 2024-09-12T00:19:28.818 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55922fdf4641] 2024-09-12T00:19:28.818 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd884de) [0x5592303074de] 2024-09-12T00:19:28.818 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55922fe0431d] 2024-09-12T00:19:28.819 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:19:28.819 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4743c29590] 2024-09-12T00:19:28.819 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:19:28.819 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:19:28.819 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.819 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:19:28.819 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f4743742800 thread_name:radosgw-admin 2024-09-12T00:19:28.834 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:19:28.834 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4743c3e6f0] 2024-09-12T00:19:28.834 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4743c8b99c] 2024-09-12T00:19:28.834 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:19:28.834 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:19:28.834 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4744f8c774] 2024-09-12T00:19:28.834 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4744f8c8d8] 2024-09-12T00:19:28.834 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55922fdf4641] 2024-09-12T00:19:28.834 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd884de) [0x5592303074de] 2024-09-12T00:19:28.835 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55922fe0431d] 2024-09-12T00:19:28.835 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:19:28.835 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4743c29590] 2024-09-12T00:19:28.835 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:19:28.835 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:19:28.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.818+0000 7f4743742800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:19:28.835 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f4743742800 thread_name:radosgw-admin 2024-09-12T00:19:28.835 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.835 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:19:28.835 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4743c3e6f0] 2024-09-12T00:19:28.835 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4743c8b99c] 2024-09-12T00:19:28.835 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:19:28.835 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:19:28.836 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4744f8c774] 2024-09-12T00:19:28.836 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4744f8c8d8] 2024-09-12T00:19:28.836 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55922fdf4641] 2024-09-12T00:19:28.836 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd884de) [0x5592303074de] 2024-09-12T00:19:28.836 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55922fe0431d] 2024-09-12T00:19:28.836 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:19:28.836 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4743c29590] 2024-09-12T00:19:28.836 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:19:28.836 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:19:28.836 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:19:28.836 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.836 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:19:28.836 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:19:28.561+0000 7f462d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:19:28.837 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:19:28.561+0000 7f462d60a640 10 monclient: dump: 2024-09-12T00:19:28.837 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.837 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.837 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.837 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.837 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.837 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.837 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.837 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.837 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.837 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.837 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:19:28.561+0000 7f4743742800 5 monclient: authenticate success, global_id 6894 2024-09-12T00:19:28.837 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:19:28.561+0000 7f4743742800 10 monclient: get_monmap_and_config success 2024-09-12T00:19:28.838 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:19:28.561+0000 7f4743742800 4 set_mon_vals no callback set 2024-09-12T00:19:28.838 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:19:28.562+0000 7f4743742800 10 monclient: shutdown 2024-09-12T00:19:28.838 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:19:28.562+0000 7f4743742800 5 asok(0x55923215e630) unregister_commands rotate-key 2024-09-12T00:19:28.838 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:19:28.562+0000 7f4743742800 10 monclient: build_initial_monmap 2024-09-12T00:19:28.838 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:19:28.562+0000 7f4743742800 1 build_initial for_mkfs: 0 2024-09-12T00:19:28.838 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:19:28.562+0000 7f4743742800 10 monclient: monmap: 2024-09-12T00:19:28.838 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:19:28.838 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:19:28.838 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:19:28.838 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:19:28.838 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:19:28.838 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.838 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:19:28.839 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:19:28.839 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:19:28.839 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.839 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding auth protocol: cephx 2024-09-12T00:19:28.839 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding auth protocol: cephx 2024-09-12T00:19:28.839 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding auth protocol: cephx 2024-09-12T00:19:28.839 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: secure 2024-09-12T00:19:28.839 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: crc 2024-09-12T00:19:28.839 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: secure 2024-09-12T00:19:28.839 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: crc 2024-09-12T00:19:28.839 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: secure 2024-09-12T00:19:28.839 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: crc 2024-09-12T00:19:28.839 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: crc 2024-09-12T00:19:28.839 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: secure 2024-09-12T00:19:28.839 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: crc 2024-09-12T00:19:28.840 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: secure 2024-09-12T00:19:28.840 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: crc 2024-09-12T00:19:28.840 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: secure 2024-09-12T00:19:28.840 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:19:28.562+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.840 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:19:28.562+0000 7f4743742800 1 librados: starting msgr at 2024-09-12T00:19:28.840 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:19:28.562+0000 7f4743742800 1 librados: starting objecter 2024-09-12T00:19:28.840 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:19:28.562+0000 7f4743742800 5 asok(0x55923215e630) register_command objecter_requests hook 0x559232383e00 2024-09-12T00:19:28.840 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:19:28.563+0000 7f4743742800 1 librados: setting wanted keys 2024-09-12T00:19:28.840 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:19:28.563+0000 7f4743742800 1 librados: calling monclient init 2024-09-12T00:19:28.840 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient: init 2024-09-12T00:19:28.840 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding auth protocol: cephx 2024-09-12T00:19:28.840 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding auth protocol: cephx 2024-09-12T00:19:28.841 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding auth protocol: cephx 2024-09-12T00:19:28.841 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: secure 2024-09-12T00:19:28.841 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: crc 2024-09-12T00:19:28.841 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: secure 2024-09-12T00:19:28.841 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: crc 2024-09-12T00:19:28.841 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: secure 2024-09-12T00:19:28.841 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: crc 2024-09-12T00:19:28.841 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: crc 2024-09-12T00:19:28.841 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: secure 2024-09-12T00:19:28.841 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: crc 2024-09-12T00:19:28.841 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: secure 2024-09-12T00:19:28.841 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: crc 2024-09-12T00:19:28.841 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: secure 2024-09-12T00:19:28.842 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:19:28.563+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.842 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:19:28.563+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.842 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:19:28.563+0000 7f4743742800 5 asok(0x55923215e630) register_command rotate-key hook 0x55923237e8c8 2024-09-12T00:19:28.842 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient: _reopen_session rank -1 2024-09-12T00:19:28.842 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:19:28.842 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): picked mon.noname-b con 0x559232208db0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:19:28.842 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): picked mon.noname-a con 0x55923222a470 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:19:28.842 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): picked mon.noname-c con 0x559232236a80 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:19:28.842 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.842 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.842 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.842 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): _renew_subs 2024-09-12T00:19:28.842 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): authenticate will time out at 1845.820566s 2024-09-12T00:19:28.842 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:19:28.563+0000 7f473fc87640 10 monclient(hunting): get_auth_request con 0x559232236a80 auth_method 0 2024-09-12T00:19:28.843 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:19:28.563+0000 7f473fc87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.843 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:19:28.563+0000 7f473fc87640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.843 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:19:28.563+0000 7f473fc87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.843 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): get_auth_request con 0x55923222a470 auth_method 0 2024-09-12T00:19:28.843 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.843 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.843 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.843 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:19:28.563+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.843 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:19:28.563+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.843 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:19:28.563+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.843 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.843 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.843 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.843 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:19:28.563+0000 7f473f486640 10 monclient(hunting): get_auth_request con 0x559232208db0 auth_method 0 2024-09-12T00:19:28.844 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:19:28.563+0000 7f473f486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.844 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:19:28.563+0000 7f473f486640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.844 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:19:28.563+0000 7f473f486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.844 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): handle_auth_done global_id 6897 payload 824 2024-09-12T00:19:28.844 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient: _finish_hunting 0 2024-09-12T00:19:28.844 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:19:28.563+0000 7f4736c85640 1 monclient: found mon.noname-a 2024-09-12T00:19:28.844 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:19:28.844 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.844 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:19:28.844 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: dump: 2024-09-12T00:19:28.844 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.844 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.844 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.845 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.845 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.845 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.845 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.845 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.845 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.845 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.845 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: _finish_auth 0 2024-09-12T00:19:28.845 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: _check_auth_tickets 2024-09-12T00:19:28.845 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:19:28.845 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.845 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:19:28.845 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: dump: 2024-09-12T00:19:28.845 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.846 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.846 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.846 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.846 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.846 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.846 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.846 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.846 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.846 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.846 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:19:28.564+0000 7f4743742800 5 monclient: authenticate success, global_id 6897 2024-09-12T00:19:28.846 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:19:28.564+0000 7f4743742800 10 monclient: _renew_subs 2024-09-12T00:19:28.846 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:19:28.564+0000 7f4743742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:19:28.846 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:19:28.564+0000 7f462d60a640 4 set_mon_vals no callback set 2024-09-12T00:19:28.847 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:19:28.564+0000 7f4743742800 10 monclient: _renew_subs 2024-09-12T00:19:28.847 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:19:28.564+0000 7f4743742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:19:28.847 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:19:28.564+0000 7f4743742800 1 librados: init done 2024-09-12T00:19:28.847 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:19:28.566+0000 7f462be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:19:28.847 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:19:28.566+0000 7f462be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:19:28.847 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:19:28.566+0000 7f462be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:19:28.847 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:19:28.566+0000 7f473f486640 10 monclient: get_auth_request con 0x7f4624076470 auth_method 0 2024-09-12T00:19:28.847 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:19:28.566+0000 7f473fc87640 10 monclient: get_auth_request con 0x5592323ac1a0 auth_method 0 2024-09-12T00:19:28.847 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:19:28.567+0000 7f473f486640 10 monclient: get_auth_request con 0x5592323cc650 auth_method 0 2024-09-12T00:19:28.847 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:19:28.568+0000 7f4736c85640 10 monclient: get_auth_request con 0x5592323d09b0 auth_method 0 2024-09-12T00:19:28.847 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:19:28.569+0000 7f4743742800 10 monclient: build_initial_monmap 2024-09-12T00:19:28.847 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:19:28.569+0000 7f4743742800 1 build_initial for_mkfs: 0 2024-09-12T00:19:28.847 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:19:28.569+0000 7f4743742800 10 monclient: monmap: 2024-09-12T00:19:28.847 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:19:28.848 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:19:28.848 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:19:28.848 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:19:28.848 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:19:28.848 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.848 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:19:28.848 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:19:28.848 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:19:28.848 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.848 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding auth protocol: cephx 2024-09-12T00:19:28.848 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding auth protocol: cephx 2024-09-12T00:19:28.848 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding auth protocol: cephx 2024-09-12T00:19:28.848 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: secure 2024-09-12T00:19:28.849 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: crc 2024-09-12T00:19:28.849 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: secure 2024-09-12T00:19:28.849 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: crc 2024-09-12T00:19:28.849 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: secure 2024-09-12T00:19:28.849 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: crc 2024-09-12T00:19:28.849 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: crc 2024-09-12T00:19:28.849 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: secure 2024-09-12T00:19:28.849 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: crc 2024-09-12T00:19:28.849 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: secure 2024-09-12T00:19:28.849 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: crc 2024-09-12T00:19:28.849 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: secure 2024-09-12T00:19:28.849 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:19:28.570+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.849 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:19:28.570+0000 7f4743742800 5 asok(0x55923215e630) register_command objecter_requests cmddesc objecter_requests hook 0x5592323d8c20 EEXIST 2024-09-12T00:19:28.849 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient: init 2024-09-12T00:19:28.850 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding auth protocol: cephx 2024-09-12T00:19:28.850 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding auth protocol: cephx 2024-09-12T00:19:28.850 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding auth protocol: cephx 2024-09-12T00:19:28.850 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: secure 2024-09-12T00:19:28.850 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: crc 2024-09-12T00:19:28.850 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: secure 2024-09-12T00:19:28.850 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: crc 2024-09-12T00:19:28.850 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: secure 2024-09-12T00:19:28.850 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: crc 2024-09-12T00:19:28.850 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: crc 2024-09-12T00:19:28.850 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: secure 2024-09-12T00:19:28.850 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: crc 2024-09-12T00:19:28.850 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: secure 2024-09-12T00:19:28.850 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: crc 2024-09-12T00:19:28.851 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: secure 2024-09-12T00:19:28.851 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:19:28.570+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.851 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:19:28.570+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.851 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:19:28.570+0000 7f4743742800 5 asok(0x55923215e630) register_command rotate-key cmddesc rotate-key hook 0x5592323d3fe0 EEXIST 2024-09-12T00:19:28.851 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient: _reopen_session rank -1 2024-09-12T00:19:28.851 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:19:28.851 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): picked mon.noname-c con 0x5592323fcf40 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:19:28.851 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): picked mon.noname-a con 0x5592323fd320 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:19:28.851 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): picked mon.noname-b con 0x5592323fbc50 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:19:28.851 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.851 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.851 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.851 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): _renew_subs 2024-09-12T00:19:28.852 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): authenticate will time out at 1845.827906s 2024-09-12T00:19:28.852 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): get_auth_request con 0x5592323fd320 auth_method 0 2024-09-12T00:19:28.852 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.852 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.852 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.852 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:19:28.571+0000 7f473f486640 10 monclient(hunting): get_auth_request con 0x5592323fcf40 auth_method 0 2024-09-12T00:19:28.852 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:19:28.571+0000 7f473f486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.852 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:19:28.571+0000 7f473f486640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.852 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:19:28.571+0000 7f473f486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.852 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:19:28.571+0000 7f473fc87640 10 monclient(hunting): get_auth_request con 0x5592323fbc50 auth_method 0 2024-09-12T00:19:28.852 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:19:28.571+0000 7f473fc87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.852 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:19:28.571+0000 7f473fc87640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.852 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:19:28.571+0000 7f473fc87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.852 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.853 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.853 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.853 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:19:28.571+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.853 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:19:28.571+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.853 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:19:28.571+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.853 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:19:28.571+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.853 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:19:28.571+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.853 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:19:28.571+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.853 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): handle_auth_done global_id 6900 payload 824 2024-09-12T00:19:28.853 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient: _finish_hunting 0 2024-09-12T00:19:28.853 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:19:28.571+0000 7f4736c85640 1 monclient: found mon.noname-a 2024-09-12T00:19:28.853 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:19:28.853 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.854 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:19:28.854 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: dump: 2024-09-12T00:19:28.854 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.854 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.854 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.854 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.854 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.854 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.854 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.854 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.854 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.854 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.855 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: _finish_auth 0 2024-09-12T00:19:28.855 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: _check_auth_tickets 2024-09-12T00:19:28.855 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:19:28.855 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.855 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:19:28.855 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: dump: 2024-09-12T00:19:28.855 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.855 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.855 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.855 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.855 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.855 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.855 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.855 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.856 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.856 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.856 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:19:28.571+0000 7f4743742800 5 monclient: authenticate success, global_id 6900 2024-09-12T00:19:28.856 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:19:28.571+0000 7f4743742800 10 monclient: _renew_subs 2024-09-12T00:19:28.856 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:19:28.571+0000 7f4743742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:19:28.856 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:19:28.571+0000 7f4740488640 4 set_mon_vals no callback set 2024-09-12T00:19:28.856 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:19:28.571+0000 7f4743742800 10 monclient: _renew_subs 2024-09-12T00:19:28.856 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:19:28.571+0000 7f4743742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:19:28.856 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:19:28.573+0000 7f4629602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:19:28.856 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:19:28.573+0000 7f4629602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:19:28.856 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:19:28.573+0000 7f4629602640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:19:28.856 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:19:28.573+0000 7f473f486640 10 monclient: get_auth_request con 0x7f4618076380 auth_method 0 2024-09-12T00:19:28.856 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:19:28.573+0000 7f4743742800 10 monclient: get_monmap_and_config 2024-09-12T00:19:28.857 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:19:28.573+0000 7f4743742800 10 monclient: build_initial_monmap 2024-09-12T00:19:28.857 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:19:28.573+0000 7f4743742800 1 build_initial for_mkfs: 0 2024-09-12T00:19:28.857 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:19:28.573+0000 7f4743742800 10 monclient: monmap: 2024-09-12T00:19:28.857 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:19:28.857 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:19:28.857 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:19:28.857 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:19:28.857 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:19:28.857 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.857 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:19:28.857 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:19:28.857 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:19:28.857 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.857 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding auth protocol: cephx 2024-09-12T00:19:28.858 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding auth protocol: cephx 2024-09-12T00:19:28.858 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding auth protocol: cephx 2024-09-12T00:19:28.858 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: secure 2024-09-12T00:19:28.858 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: crc 2024-09-12T00:19:28.858 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: secure 2024-09-12T00:19:28.858 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: crc 2024-09-12T00:19:28.858 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: secure 2024-09-12T00:19:28.858 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: crc 2024-09-12T00:19:28.858 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: crc 2024-09-12T00:19:28.858 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: secure 2024-09-12T00:19:28.858 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: crc 2024-09-12T00:19:28.858 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: secure 2024-09-12T00:19:28.858 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: crc 2024-09-12T00:19:28.858 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: secure 2024-09-12T00:19:28.859 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:19:28.574+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.859 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient: init 2024-09-12T00:19:28.859 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding auth protocol: cephx 2024-09-12T00:19:28.859 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding auth protocol: cephx 2024-09-12T00:19:28.859 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding auth protocol: cephx 2024-09-12T00:19:28.859 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: secure 2024-09-12T00:19:28.859 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: crc 2024-09-12T00:19:28.859 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: secure 2024-09-12T00:19:28.859 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: crc 2024-09-12T00:19:28.859 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: secure 2024-09-12T00:19:28.859 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: crc 2024-09-12T00:19:28.859 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: crc 2024-09-12T00:19:28.859 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: secure 2024-09-12T00:19:28.860 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: crc 2024-09-12T00:19:28.860 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: secure 2024-09-12T00:19:28.860 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: crc 2024-09-12T00:19:28.860 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: secure 2024-09-12T00:19:28.860 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:19:28.574+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.860 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:19:28.574+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.860 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:19:28.574+0000 7f4743742800 5 asok(0x55923215e630) register_command rotate-key cmddesc rotate-key hook 0x7ffd379c36b8 EEXIST 2024-09-12T00:19:28.860 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient: _reopen_session rank -1 2024-09-12T00:19:28.860 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:19:28.860 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): picked mon.noname-c con 0x559232450e20 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:19:28.860 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): picked mon.noname-b con 0x559232441770 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:19:28.860 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): picked mon.noname-a con 0x55923244c250 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:19:28.860 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.861 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.861 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.861 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): _renew_subs 2024-09-12T00:19:28.861 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): authenticate will time out at 1845.831705s 2024-09-12T00:19:28.861 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:19:28.574+0000 7f473f486640 10 monclient(hunting): get_auth_request con 0x559232450e20 auth_method 0 2024-09-12T00:19:28.861 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:19:28.574+0000 7f473f486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.861 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:19:28.574+0000 7f473f486640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.861 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:19:28.574+0000 7f473f486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.861 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:19:28.574+0000 7f473fc87640 10 monclient(hunting): get_auth_request con 0x55923244c250 auth_method 0 2024-09-12T00:19:28.861 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:19:28.574+0000 7f473fc87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.861 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:19:28.574+0000 7f473fc87640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.861 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:19:28.574+0000 7f473fc87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.861 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:19:28.574+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.862 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:19:28.574+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.862 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:19:28.574+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.862 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:19:28.574+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.862 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:19:28.574+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.862 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:19:28.574+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.862 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:19:28.574+0000 7f4736c85640 10 monclient(hunting): get_auth_request con 0x559232441770 auth_method 0 2024-09-12T00:19:28.862 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:19:28.574+0000 7f4736c85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.862 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:19:28.574+0000 7f4736c85640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.862 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:19:28.574+0000 7f4736c85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.862 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:19:28.575+0000 7f473fc87640 10 monclient(hunting): handle_auth_done global_id 6903 payload 274 2024-09-12T00:19:28.862 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:19:28.575+0000 7f473fc87640 10 monclient: _finish_hunting 0 2024-09-12T00:19:28.862 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:19:28.575+0000 7f473fc87640 1 monclient: found mon.noname-a 2024-09-12T00:19:28.862 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:19:28.575+0000 7f473fc87640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:19:28.863 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.863 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:19:28.863 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: dump: 2024-09-12T00:19:28.863 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.863 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.863 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.863 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.863 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.863 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.863 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.863 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.863 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.863 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.864 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: _finish_auth 0 2024-09-12T00:19:28.864 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:19:28.864 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:19:28.864 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.864 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:19:28.864 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: dump: 2024-09-12T00:19:28.864 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.864 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.864 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.864 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.864 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.864 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.864 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.865 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.865 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.865 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.865 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:19:28.575+0000 7f4743742800 5 monclient: authenticate success, global_id 6903 2024-09-12T00:19:28.865 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:19:28.575+0000 7f4743742800 10 monclient: get_monmap_and_config success 2024-09-12T00:19:28.865 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:19:28.575+0000 7f4743742800 4 set_mon_vals no callback set 2024-09-12T00:19:28.865 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:19:28.575+0000 7f4743742800 10 monclient: shutdown 2024-09-12T00:19:28.865 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:19:28.576+0000 7f4743742800 10 monclient: build_initial_monmap 2024-09-12T00:19:28.865 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:19:28.576+0000 7f4743742800 1 build_initial for_mkfs: 0 2024-09-12T00:19:28.865 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:19:28.576+0000 7f4743742800 10 monclient: monmap: 2024-09-12T00:19:28.865 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:19:28.865 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:19:28.865 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:19:28.865 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:19:28.866 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:19:28.866 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.866 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:19:28.866 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:19:28.866 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:19:28.866 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.866 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding auth protocol: cephx 2024-09-12T00:19:28.866 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding auth protocol: cephx 2024-09-12T00:19:28.866 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding auth protocol: cephx 2024-09-12T00:19:28.866 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: secure 2024-09-12T00:19:28.866 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: crc 2024-09-12T00:19:28.866 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: secure 2024-09-12T00:19:28.866 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: crc 2024-09-12T00:19:28.867 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: secure 2024-09-12T00:19:28.867 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: crc 2024-09-12T00:19:28.867 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: crc 2024-09-12T00:19:28.867 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: secure 2024-09-12T00:19:28.867 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: crc 2024-09-12T00:19:28.867 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: secure 2024-09-12T00:19:28.867 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: crc 2024-09-12T00:19:28.867 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: secure 2024-09-12T00:19:28.867 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:19:28.576+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.867 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:19:28.576+0000 7f4743742800 1 librados: starting msgr at 2024-09-12T00:19:28.867 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:19:28.576+0000 7f4743742800 1 librados: starting objecter 2024-09-12T00:19:28.867 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:19:28.576+0000 7f4743742800 5 asok(0x55923215e630) register_command objecter_requests cmddesc objecter_requests hook 0x5592324020a0 EEXIST 2024-09-12T00:19:28.867 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:19:28.576+0000 7f4743742800 1 librados: setting wanted keys 2024-09-12T00:19:28.868 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:19:28.576+0000 7f4743742800 1 librados: calling monclient init 2024-09-12T00:19:28.868 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:19:28.576+0000 7f4743742800 10 monclient: init 2024-09-12T00:19:28.868 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding auth protocol: cephx 2024-09-12T00:19:28.868 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding auth protocol: cephx 2024-09-12T00:19:28.868 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding auth protocol: cephx 2024-09-12T00:19:28.868 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: secure 2024-09-12T00:19:28.868 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: crc 2024-09-12T00:19:28.868 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: secure 2024-09-12T00:19:28.868 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: crc 2024-09-12T00:19:28.868 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: secure 2024-09-12T00:19:28.868 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: crc 2024-09-12T00:19:28.868 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: crc 2024-09-12T00:19:28.868 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: secure 2024-09-12T00:19:28.869 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: crc 2024-09-12T00:19:28.869 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: secure 2024-09-12T00:19:28.869 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: crc 2024-09-12T00:19:28.869 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: secure 2024-09-12T00:19:28.869 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:19:28.576+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.869 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:19:28.576+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.869 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:19:28.577+0000 7f4743742800 5 asok(0x55923215e630) register_command rotate-key cmddesc rotate-key hook 0x559232411948 EEXIST 2024-09-12T00:19:28.869 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient: _reopen_session rank -1 2024-09-12T00:19:28.869 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:19:28.869 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): picked mon.noname-c con 0x559232441770 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:19:28.869 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): picked mon.noname-b con 0x55923244c250 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:19:28.869 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): picked mon.noname-a con 0x559232450e20 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:19:28.869 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.870 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.870 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.870 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): _renew_subs 2024-09-12T00:19:28.870 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): authenticate will time out at 1845.834110s 2024-09-12T00:19:28.870 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): get_auth_request con 0x559232441770 auth_method 0 2024-09-12T00:19:28.870 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.870 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.870 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.870 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:19:28.577+0000 7f473fc87640 10 monclient(hunting): get_auth_request con 0x559232450e20 auth_method 0 2024-09-12T00:19:28.870 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:19:28.577+0000 7f473fc87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.870 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:19:28.577+0000 7f473fc87640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.870 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:19:28.577+0000 7f473fc87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.870 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.871 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.871 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.871 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:19:28.577+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.871 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:19:28.577+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.871 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:19:28.577+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.871 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:19:28.577+0000 7f4736c85640 10 monclient(hunting): get_auth_request con 0x55923244c250 auth_method 0 2024-09-12T00:19:28.871 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:19:28.577+0000 7f4736c85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.871 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:19:28.577+0000 7f4736c85640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.871 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:19:28.577+0000 7f4736c85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.871 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): handle_auth_done global_id 6485 payload 824 2024-09-12T00:19:28.871 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient: _finish_hunting 0 2024-09-12T00:19:28.871 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:19:28.577+0000 7f473f486640 1 monclient: found mon.noname-c 2024-09-12T00:19:28.871 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:19:28.871 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.872 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:19:28.872 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: dump: 2024-09-12T00:19:28.872 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.872 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.872 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.872 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.872 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.872 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.872 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.872 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.872 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.872 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: _finish_auth 0 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: _check_auth_tickets 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: dump: 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.873 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.874 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.874 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.874 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:19:28.577+0000 7f4743742800 5 monclient: authenticate success, global_id 6485 2024-09-12T00:19:28.874 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient: _renew_subs 2024-09-12T00:19:28.874 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:19:28.577+0000 7f4622ffd640 4 set_mon_vals no callback set 2024-09-12T00:19:28.874 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:19:28.874 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient: _renew_subs 2024-09-12T00:19:28.874 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:19:28.874 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:19:28.577+0000 7f4743742800 1 librados: init done 2024-09-12T00:19:28.874 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:19:28.577+0000 7f4743742800 5 asok(0x55923215e630) register_command cr dump hook 0x559232444668 2024-09-12T00:19:28.874 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:19:28.579+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.874 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:19:28.579+0000 7f46217fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:19:28.874 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:19:28.579+0000 7f46217fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:19:28.875 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:19:28.579+0000 7f46217fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:19:28.875 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:19:28.580+0000 7f4736c85640 10 monclient: get_auth_request con 0x7f4608076470 auth_method 0 2024-09-12T00:19:28.875 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:19:28.580+0000 7f473fc87640 10 monclient: get_auth_request con 0x55923246ba20 auth_method 0 2024-09-12T00:19:28.875 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:19:28.581+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.875 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:19:28.581+0000 7f4743742800 20 realm 2024-09-12T00:19:28.875 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:19:28.581+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.875 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:19:28.581+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.875 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:19:28.581+0000 7f4743742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:28.875 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:19:28.581+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.875 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:19:28.581+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.875 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:19:28.581+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.875 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:19:28.581+0000 7f473f486640 10 monclient: get_auth_request con 0x55923246fc20 auth_method 0 2024-09-12T00:19:28.875 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:19:28.582+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:28.876 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:19:28.582+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.876 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:19:28.582+0000 7f4736c85640 10 monclient: get_auth_request con 0x559232473480 auth_method 0 2024-09-12T00:19:28.876 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:19:28.583+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:28.876 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:19:28.583+0000 7f4743742800 20 searching for the correct realm 2024-09-12T00:19:28.876 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:19:28.583+0000 7f473fc87640 10 monclient: get_auth_request con 0x7f4728015070 auth_method 0 2024-09-12T00:19:28.876 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:19:28.584+0000 7f473f486640 10 monclient: get_auth_request con 0x7f4730003310 auth_method 0 2024-09-12T00:19:28.876 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:19:28.585+0000 7f4736c85640 10 monclient: get_auth_request con 0x7f4728083180 auth_method 0 2024-09-12T00:19:28.876 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:19:28.585+0000 7f4736c85640 0 -- 172.21.15.67:0/265077795 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f4728083180 msgr2=0x7f472807b020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:28.876 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:19:28.787+0000 7f4736c85640 10 monclient: get_auth_request con 0x7f4728083180 auth_method 0 2024-09-12T00:19:28.876 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:19:28.789+0000 7f473fc87640 10 monclient: get_auth_request con 0x7f47300ba070 auth_method 0 2024-09-12T00:19:28.876 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:19:28.790+0000 7f473f486640 10 monclient: get_auth_request con 0x7f4738018b50 auth_method 0 2024-09-12T00:19:28.876 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:19:28.791+0000 7f473fc87640 0 -- 172.21.15.67:0/265077795 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55923246ba20 msgr2=0x55923246deb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:28.877 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:19:28.791+0000 7f46217fa640 1 client.6485.objecter ms_handle_reset 0x55923246ba20 session 0x55923246b310 osd.6 2024-09-12T00:19:28.877 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:19:28.791+0000 7f46217fa640 10 monclient: _renew_subs 2024-09-12T00:19:28.877 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:19:28.791+0000 7f46217fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:19:28.877 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:19:28.791+0000 7f473fc87640 10 monclient: get_auth_request con 0x7f4608086790 auth_method 0 2024-09-12T00:19:28.877 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:28.877 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:28.877 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:28.877 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:28.877 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:28.877 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:28.877 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:19:28.795+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.877 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:19:28.796+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.877 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:19:28.796+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.878 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:19:28.796+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:28.878 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:19:28.796+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.878 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:19:28.797+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:28.878 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:19:28.797+0000 7f4743742800 20 zone default found 2024-09-12T00:19:28.878 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:19:28.797+0000 7f4743742800 4 Realm: () 2024-09-12T00:19:28.878 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:19:28.797+0000 7f4743742800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:28.878 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:19:28.797+0000 7f4743742800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:28.878 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:19:28.797+0000 7f4743742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:28.878 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:19:28.797+0000 7f4743742800 20 zonegroup default 2024-09-12T00:19:28.878 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:19:28.797+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.878 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:19:28.797+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.878 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:19:28.797+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.878 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:19:28.798+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.879 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:19:28.798+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.879 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:19:28.798+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.879 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:19:28.798+0000 7f4743742800 20 started sync module instance, tier type = 2024-09-12T00:19:28.879 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:19:28.798+0000 7f4743742800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:28.879 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=0 2024-09-12T00:19:28.879 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=1 2024-09-12T00:19:28.879 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=2 2024-09-12T00:19:28.879 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=3 2024-09-12T00:19:28.879 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=4 2024-09-12T00:19:28.879 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=5 2024-09-12T00:19:28.879 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=6 2024-09-12T00:19:28.879 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:19:28.808+0000 7f4743742800 20 add_watcher() i=7 2024-09-12T00:19:28.879 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:19:28.808+0000 7f4743742800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:28.880 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding auth protocol: cephx 2024-09-12T00:19:28.880 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding auth protocol: cephx 2024-09-12T00:19:28.880 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding auth protocol: cephx 2024-09-12T00:19:28.880 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: secure 2024-09-12T00:19:28.880 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: crc 2024-09-12T00:19:28.880 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: secure 2024-09-12T00:19:28.880 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: crc 2024-09-12T00:19:28.880 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: secure 2024-09-12T00:19:28.880 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: crc 2024-09-12T00:19:28.880 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: crc 2024-09-12T00:19:28.880 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: secure 2024-09-12T00:19:28.880 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: crc 2024-09-12T00:19:28.880 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: secure 2024-09-12T00:19:28.880 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: crc 2024-09-12T00:19:28.881 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: secure 2024-09-12T00:19:28.881 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:19:28.810+0000 7f45f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:28.881 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:19:28.810+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.881 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:19:28.810+0000 7f4743742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:28.881 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:19:28.810+0000 7f4743742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:28.881 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:19:28.810+0000 7f4743742800 5 asok(0x55923215e630) register_command cache list hook 0x55923244a550 2024-09-12T00:19:28.881 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:19:28.810+0000 7f4743742800 5 asok(0x55923215e630) register_command cache inspect hook 0x55923244a550 2024-09-12T00:19:28.881 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:19:28.810+0000 7f4743742800 5 asok(0x55923215e630) register_command cache erase hook 0x55923244a550 2024-09-12T00:19:28.881 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:19:28.810+0000 7f4743742800 5 asok(0x55923215e630) register_command cache zap hook 0x55923244a550 2024-09-12T00:19:28.881 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:19:28.810+0000 7f4743742800 5 note: GC not initialized 2024-09-12T00:19:28.881 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:19:28.811+0000 7f45f4fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:28.881 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:19:28.811+0000 7f4743742800 5 asok(0x55923215e630) register_command sync trace show hook 0x7f4738005b40 2024-09-12T00:19:28.881 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:19:28.811+0000 7f4743742800 5 asok(0x55923215e630) register_command sync trace history hook 0x7f4738005b40 2024-09-12T00:19:28.882 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:19:28.811+0000 7f4743742800 5 asok(0x55923215e630) register_command sync trace active hook 0x7f4738005b40 2024-09-12T00:19:28.882 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:19:28.811+0000 7f4743742800 5 asok(0x55923215e630) register_command sync trace active_short hook 0x7f4738005b40 2024-09-12T00:19:28.882 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:19:28.811+0000 7f4743742800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:28.882 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:19:28.811+0000 7f4743742800 20 Filter name: none 2024-09-12T00:19:28.882 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:19:28.811+0000 7f456e7fc640 20 reqs_thread_entry: start 2024-09-12T00:19:28.882 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:19:28.811+0000 7f4743742800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:19:28.882 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:19:28.811+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.882 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:19:28.811+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:28.882 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:19:28.811+0000 7f4743742800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:19:28.882 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:19:28.811+0000 7f4743742800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:19:28.882 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:19:28.811+0000 7f4743742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 : miss 2024-09-12T00:19:28.882 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:19:28.811+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.882 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:19:28.812+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:19:28.883 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:19:28.812+0000 7f4743742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:28.883 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:19:28.812+0000 7f4743742800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:28.883 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:19:28.812+0000 7f4743742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:28.883 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:19:28.812+0000 7f4743742800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:28.883 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:19:28.812+0000 7f4743742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 2024-09-12T00:19:28.883 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:19:28.815+0000 7f4743742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:28.883 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:19:28.816+0000 7f4743742800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:28.883 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:19:28.816+0000 7f4743742800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:28.883 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:19:28.816+0000 7f4743742800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27, ofs0, ns] 2024-09-12T00:19:28.883 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:19:28.816+0000 7f4622ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562480 cookie 94086397143008 notifier 6485 bl.length()=939 2024-09-12T00:19:28.883 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:19:28.816+0000 7f4622ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:28.883 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:19:28.816+0000 7f4622ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:28.884 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:19:28.816+0000 7f4622ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:28.884 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:19:28.816+0000 7f4743742800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): orig_sources= new_sources= 2024-09-12T00:19:28.884 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:19:28.816+0000 7f4743742800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): potential sources added=[] removed=[] 2024-09-12T00:19:28.884 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:19:28.816+0000 7f4743742800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): orig_dests= new_dests= 2024-09-12T00:19:28.884 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:19:28.816+0000 7f4743742800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): potential dests added=[] removed=[] 2024-09-12T00:19:28.884 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:19:28.817+0000 7f4743742800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4743742800 time 2024-09-12T00:19:28.818248+0000 2024-09-12T00:19:28.884 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:19:28.884 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.884 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:19:28.884 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4744f8c71a] 2024-09-12T00:19:28.884 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4744f8c8d8] 2024-09-12T00:19:28.884 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55922fdf4641] 2024-09-12T00:19:28.884 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd884de) [0x5592303074de] 2024-09-12T00:19:28.885 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55922fe0431d] 2024-09-12T00:19:28.885 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:19:28.885 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4743c29590] 2024-09-12T00:19:28.885 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:19:28.885 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:19:28.885 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.885 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:19:28.818+0000 7f4743742800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:19:28.885 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f4743742800 thread_name:radosgw-admin 2024-09-12T00:19:28.885 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.885 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:19:28.885 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4743c3e6f0] 2024-09-12T00:19:28.885 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4743c8b99c] 2024-09-12T00:19:28.885 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4744f8c774] 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4744f8c8d8] 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55922fdf4641] 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd884de) [0x5592303074de] 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55922fe0431d] 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4743c29590] 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:19:28.886 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:19:28.887 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:19:28.887 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:19:28.887 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:19:28.887 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:19:28.887 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:19:28.887 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:19:28.887 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:19:28.887 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:19:28.887 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:19:28.887 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:19:28.887 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:19:28.887 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:19:28.887 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:19:28.888 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:19:28.888 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:19:28.888 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:19:28.888 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:19:28.888 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:19:28.888 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:19:28.888 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:19:28.888 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:19:28.888 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:19:28.888 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:19:28.888 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:19:28.888 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:19:28.888 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:19:28.889 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:19:28.889 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:19:28.889 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:19:28.889 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:19:28.889 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:19:28.889 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:19:28.889 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:19:28.889 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:19:28.889 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:19:28.889 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:19:28.889 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:19:28.889 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:19:28.889 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:19:28.889 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:19:28.890 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:19:28.890 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:19:28.890 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:19:28.890 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:19:28.890 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:19:28.890 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:19:28.890 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:19:28.890 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:19:28.890 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:19:28.890 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:19:28.890 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:19:28.890 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:19:28.890 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:19:28.891 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:19:28.891 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:19:28.891 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:19:28.891 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:19:28.891 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:19:28.891 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:19:28.891 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:19:28.891 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:19:28.891 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:19:28.891 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:19:28.891 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:19:28.891 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:19:28.891 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:19:28.891 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:19:28.892 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:19:28.892 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:19:28.892 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:19:28.892 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:19:28.892 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:19:28.892 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:19:28.892 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:19:28.892 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:19:28.892 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:19:28.892 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:19:28.892 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:19:28.892 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:19:28.892 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:19:28.893 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:19:28.893 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:19:28.893 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:19:28.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:19:28.893 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:19:28.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:19:28.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:19:28.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:19:28.893 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:19:28.893 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:19:28.893 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:19:28.893 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:19:28.893 INFO:tasks.workunit.client.0.smithi067.stderr: 7f456e7fc640 / http_manager 2024-09-12T00:19:28.894 INFO:tasks.workunit.client.0.smithi067.stderr: 7f45f4fe1640 / http_manager 2024-09-12T00:19:28.894 INFO:tasks.workunit.client.0.smithi067.stderr: 7f45f5fe3640 / rgw_dt_lg_renew 2024-09-12T00:19:28.894 INFO:tasks.workunit.client.0.smithi067.stderr: 7f46217fa640 / ms_dispatch 2024-09-12T00:19:28.894 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4622ffd640 / io_context_pool 2024-09-12T00:19:28.894 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4629602640 / ms_dispatch 2024-09-12T00:19:28.894 INFO:tasks.workunit.client.0.smithi067.stderr: 7f462be07640 / ms_dispatch 2024-09-12T00:19:28.894 INFO:tasks.workunit.client.0.smithi067.stderr: 7f462d60a640 / io_context_pool 2024-09-12T00:19:28.894 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4736c85640 / msgr-worker-2 2024-09-12T00:19:28.894 INFO:tasks.workunit.client.0.smithi067.stderr: 7f473f486640 / msgr-worker-1 2024-09-12T00:19:28.894 INFO:tasks.workunit.client.0.smithi067.stderr: 7f473fc87640 / msgr-worker-0 2024-09-12T00:19:28.894 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4740488640 / io_context_pool 2024-09-12T00:19:28.894 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4743742800 / radosgw-admin 2024-09-12T00:19:28.894 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:19:28.895 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:19:28.895 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.106986.log 2024-09-12T00:19:28.895 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:19:28.895 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:19:28.895 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:19:28.561+0000 7f462d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:19:28.895 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:19:28.561+0000 7f462d60a640 10 monclient: dump: 2024-09-12T00:19:28.895 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.895 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.895 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.895 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.895 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.895 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.895 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.895 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.896 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.896 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.896 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:19:28.561+0000 7f4743742800 5 monclient: authenticate success, global_id 6894 2024-09-12T00:19:28.896 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:19:28.561+0000 7f4743742800 10 monclient: get_monmap_and_config success 2024-09-12T00:19:28.896 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:19:28.561+0000 7f4743742800 4 set_mon_vals no callback set 2024-09-12T00:19:28.896 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:19:28.562+0000 7f4743742800 10 monclient: shutdown 2024-09-12T00:19:28.896 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:19:28.562+0000 7f4743742800 5 asok(0x55923215e630) unregister_commands rotate-key 2024-09-12T00:19:28.896 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:19:28.562+0000 7f4743742800 10 monclient: build_initial_monmap 2024-09-12T00:19:28.896 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:19:28.562+0000 7f4743742800 1 build_initial for_mkfs: 0 2024-09-12T00:19:28.896 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:19:28.562+0000 7f4743742800 10 monclient: monmap: 2024-09-12T00:19:28.896 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:19:28.896 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:19:28.896 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:19:28.897 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:19:28.897 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:19:28.897 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.897 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:19:28.897 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:19:28.897 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:19:28.897 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.897 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding auth protocol: cephx 2024-09-12T00:19:28.897 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding auth protocol: cephx 2024-09-12T00:19:28.897 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding auth protocol: cephx 2024-09-12T00:19:28.897 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: secure 2024-09-12T00:19:28.897 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: crc 2024-09-12T00:19:28.897 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: secure 2024-09-12T00:19:28.898 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: crc 2024-09-12T00:19:28.898 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: secure 2024-09-12T00:19:28.898 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: crc 2024-09-12T00:19:28.898 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: crc 2024-09-12T00:19:28.898 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: secure 2024-09-12T00:19:28.898 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: crc 2024-09-12T00:19:28.898 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: secure 2024-09-12T00:19:28.898 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: crc 2024-09-12T00:19:28.898 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:19:28.562+0000 7f4743742800 5 AuthRegistry(0x559232384390) adding con mode: secure 2024-09-12T00:19:28.898 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:19:28.562+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.898 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:19:28.562+0000 7f4743742800 1 librados: starting msgr at 2024-09-12T00:19:28.898 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:19:28.562+0000 7f4743742800 1 librados: starting objecter 2024-09-12T00:19:28.898 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:19:28.562+0000 7f4743742800 5 asok(0x55923215e630) register_command objecter_requests hook 0x559232383e00 2024-09-12T00:19:28.898 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:19:28.563+0000 7f4743742800 1 librados: setting wanted keys 2024-09-12T00:19:28.899 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:19:28.563+0000 7f4743742800 1 librados: calling monclient init 2024-09-12T00:19:28.899 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient: init 2024-09-12T00:19:28.899 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding auth protocol: cephx 2024-09-12T00:19:28.899 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding auth protocol: cephx 2024-09-12T00:19:28.899 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding auth protocol: cephx 2024-09-12T00:19:28.899 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: secure 2024-09-12T00:19:28.899 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: crc 2024-09-12T00:19:28.899 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: secure 2024-09-12T00:19:28.899 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: crc 2024-09-12T00:19:28.899 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: secure 2024-09-12T00:19:28.899 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: crc 2024-09-12T00:19:28.899 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: crc 2024-09-12T00:19:28.899 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: secure 2024-09-12T00:19:28.899 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: crc 2024-09-12T00:19:28.900 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: secure 2024-09-12T00:19:28.900 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: crc 2024-09-12T00:19:28.900 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:19:28.563+0000 7f4743742800 5 AuthRegistry(0x55923237e780) adding con mode: secure 2024-09-12T00:19:28.900 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:19:28.563+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.900 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:19:28.563+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.900 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:19:28.563+0000 7f4743742800 5 asok(0x55923215e630) register_command rotate-key hook 0x55923237e8c8 2024-09-12T00:19:28.900 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient: _reopen_session rank -1 2024-09-12T00:19:28.900 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:19:28.900 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): picked mon.noname-b con 0x559232208db0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:19:28.900 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): picked mon.noname-a con 0x55923222a470 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:19:28.900 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): picked mon.noname-c con 0x559232236a80 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:19:28.900 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.900 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.901 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.901 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): _renew_subs 2024-09-12T00:19:28.901 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:19:28.563+0000 7f4743742800 10 monclient(hunting): authenticate will time out at 1845.820566s 2024-09-12T00:19:28.901 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:19:28.563+0000 7f473fc87640 10 monclient(hunting): get_auth_request con 0x559232236a80 auth_method 0 2024-09-12T00:19:28.901 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:19:28.563+0000 7f473fc87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.901 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:19:28.563+0000 7f473fc87640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.901 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:19:28.563+0000 7f473fc87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.901 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): get_auth_request con 0x55923222a470 auth_method 0 2024-09-12T00:19:28.901 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.901 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.901 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.901 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:19:28.563+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.901 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:19:28.563+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.902 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:19:28.563+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.902 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.902 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.902 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.902 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:19:28.563+0000 7f473f486640 10 monclient(hunting): get_auth_request con 0x559232208db0 auth_method 0 2024-09-12T00:19:28.902 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:19:28.563+0000 7f473f486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.902 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:19:28.563+0000 7f473f486640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.902 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:19:28.563+0000 7f473f486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.902 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient(hunting): handle_auth_done global_id 6897 payload 824 2024-09-12T00:19:28.902 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient: _finish_hunting 0 2024-09-12T00:19:28.902 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:19:28.563+0000 7f4736c85640 1 monclient: found mon.noname-a 2024-09-12T00:19:28.902 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:19:28.563+0000 7f4736c85640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:19:28.902 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.902 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:19:28.903 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: dump: 2024-09-12T00:19:28.903 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.903 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.903 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.903 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.903 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.903 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.903 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.903 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.903 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.903 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.903 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: _finish_auth 0 2024-09-12T00:19:28.903 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: _check_auth_tickets 2024-09-12T00:19:28.903 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:19:28.904 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.904 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:19:28.904 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:19:28.564+0000 7f462be07640 10 monclient: dump: 2024-09-12T00:19:28.904 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.904 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.904 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.904 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.904 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.904 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.904 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.904 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.904 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.904 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.905 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:19:28.564+0000 7f4743742800 5 monclient: authenticate success, global_id 6897 2024-09-12T00:19:28.905 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:19:28.564+0000 7f4743742800 10 monclient: _renew_subs 2024-09-12T00:19:28.905 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:19:28.564+0000 7f4743742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:19:28.905 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:19:28.564+0000 7f462d60a640 4 set_mon_vals no callback set 2024-09-12T00:19:28.905 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:19:28.564+0000 7f4743742800 10 monclient: _renew_subs 2024-09-12T00:19:28.905 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:19:28.564+0000 7f4743742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:19:28.905 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:19:28.564+0000 7f4743742800 1 librados: init done 2024-09-12T00:19:28.905 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:19:28.566+0000 7f462be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:19:28.905 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:19:28.566+0000 7f462be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:19:28.905 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:19:28.566+0000 7f462be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:19:28.905 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:19:28.566+0000 7f473f486640 10 monclient: get_auth_request con 0x7f4624076470 auth_method 0 2024-09-12T00:19:28.905 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:19:28.566+0000 7f473fc87640 10 monclient: get_auth_request con 0x5592323ac1a0 auth_method 0 2024-09-12T00:19:28.905 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:19:28.567+0000 7f473f486640 10 monclient: get_auth_request con 0x5592323cc650 auth_method 0 2024-09-12T00:19:28.905 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:19:28.568+0000 7f4736c85640 10 monclient: get_auth_request con 0x5592323d09b0 auth_method 0 2024-09-12T00:19:28.906 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:19:28.569+0000 7f4743742800 10 monclient: build_initial_monmap 2024-09-12T00:19:28.906 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:19:28.569+0000 7f4743742800 1 build_initial for_mkfs: 0 2024-09-12T00:19:28.906 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:19:28.569+0000 7f4743742800 10 monclient: monmap: 2024-09-12T00:19:28.906 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:19:28.906 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:19:28.906 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:19:28.906 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:19:28.906 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:19:28.906 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.906 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:19:28.906 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:19:28.906 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:19:28.906 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.907 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding auth protocol: cephx 2024-09-12T00:19:28.907 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding auth protocol: cephx 2024-09-12T00:19:28.907 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding auth protocol: cephx 2024-09-12T00:19:28.907 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: secure 2024-09-12T00:19:28.907 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: crc 2024-09-12T00:19:28.907 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: secure 2024-09-12T00:19:28.907 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: crc 2024-09-12T00:19:28.907 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: secure 2024-09-12T00:19:28.907 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: crc 2024-09-12T00:19:28.907 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: crc 2024-09-12T00:19:28.907 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: secure 2024-09-12T00:19:28.907 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: crc 2024-09-12T00:19:28.907 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: secure 2024-09-12T00:19:28.908 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: crc 2024-09-12T00:19:28.908 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:19:28.569+0000 7f4743742800 5 AuthRegistry(0x5592323d57c0) adding con mode: secure 2024-09-12T00:19:28.908 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:19:28.570+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.908 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:19:28.570+0000 7f4743742800 5 asok(0x55923215e630) register_command objecter_requests cmddesc objecter_requests hook 0x5592323d8c20 EEXIST 2024-09-12T00:19:28.908 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient: init 2024-09-12T00:19:28.908 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding auth protocol: cephx 2024-09-12T00:19:28.908 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding auth protocol: cephx 2024-09-12T00:19:28.908 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding auth protocol: cephx 2024-09-12T00:19:28.908 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: secure 2024-09-12T00:19:28.908 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: crc 2024-09-12T00:19:28.908 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: secure 2024-09-12T00:19:28.908 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: crc 2024-09-12T00:19:28.908 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: secure 2024-09-12T00:19:28.909 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: crc 2024-09-12T00:19:28.909 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: crc 2024-09-12T00:19:28.909 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: secure 2024-09-12T00:19:28.909 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: crc 2024-09-12T00:19:28.909 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: secure 2024-09-12T00:19:28.909 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: crc 2024-09-12T00:19:28.909 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:19:28.570+0000 7f4743742800 5 AuthRegistry(0x5592323d3e98) adding con mode: secure 2024-09-12T00:19:28.909 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:19:28.570+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.909 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:19:28.570+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.909 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:19:28.570+0000 7f4743742800 5 asok(0x55923215e630) register_command rotate-key cmddesc rotate-key hook 0x5592323d3fe0 EEXIST 2024-09-12T00:19:28.909 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient: _reopen_session rank -1 2024-09-12T00:19:28.909 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:19:28.909 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): picked mon.noname-c con 0x5592323fcf40 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:19:28.909 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): picked mon.noname-a con 0x5592323fd320 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:19:28.910 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): picked mon.noname-b con 0x5592323fbc50 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:19:28.910 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.910 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.910 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.910 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): _renew_subs 2024-09-12T00:19:28.910 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:19:28.570+0000 7f4743742800 10 monclient(hunting): authenticate will time out at 1845.827906s 2024-09-12T00:19:28.910 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): get_auth_request con 0x5592323fd320 auth_method 0 2024-09-12T00:19:28.910 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.910 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.910 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.910 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:19:28.571+0000 7f473f486640 10 monclient(hunting): get_auth_request con 0x5592323fcf40 auth_method 0 2024-09-12T00:19:28.910 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:19:28.571+0000 7f473f486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.910 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:19:28.571+0000 7f473f486640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.911 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:19:28.571+0000 7f473f486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.911 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:19:28.571+0000 7f473fc87640 10 monclient(hunting): get_auth_request con 0x5592323fbc50 auth_method 0 2024-09-12T00:19:28.911 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:19:28.571+0000 7f473fc87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.911 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:19:28.571+0000 7f473fc87640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.911 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:19:28.571+0000 7f473fc87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.911 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.911 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.911 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.911 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:19:28.571+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.911 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:19:28.571+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.911 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:19:28.571+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.911 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:19:28.571+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.911 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:19:28.571+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.911 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:19:28.571+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.912 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient(hunting): handle_auth_done global_id 6900 payload 824 2024-09-12T00:19:28.912 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient: _finish_hunting 0 2024-09-12T00:19:28.912 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:19:28.571+0000 7f4736c85640 1 monclient: found mon.noname-a 2024-09-12T00:19:28.912 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:19:28.571+0000 7f4736c85640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:19:28.912 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.912 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:19:28.912 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: dump: 2024-09-12T00:19:28.912 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.912 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.912 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.912 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.912 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.912 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.913 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.913 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.913 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.913 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.913 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: _finish_auth 0 2024-09-12T00:19:28.913 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: _check_auth_tickets 2024-09-12T00:19:28.913 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:19:28.913 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.913 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:19:28.913 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:19:28.571+0000 7f4629602640 10 monclient: dump: 2024-09-12T00:19:28.913 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.913 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.913 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.914 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.914 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.914 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.914 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.914 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.914 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.914 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.914 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:19:28.571+0000 7f4743742800 5 monclient: authenticate success, global_id 6900 2024-09-12T00:19:28.914 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:19:28.571+0000 7f4743742800 10 monclient: _renew_subs 2024-09-12T00:19:28.914 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:19:28.571+0000 7f4743742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:19:28.914 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:19:28.571+0000 7f4740488640 4 set_mon_vals no callback set 2024-09-12T00:19:28.914 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:19:28.571+0000 7f4743742800 10 monclient: _renew_subs 2024-09-12T00:19:28.915 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:19:28.571+0000 7f4743742800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:19:28.915 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:19:28.573+0000 7f4629602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:19:28.915 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:19:28.573+0000 7f4629602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:19:28.915 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:19:28.573+0000 7f4629602640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:19:28.915 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:19:28.573+0000 7f473f486640 10 monclient: get_auth_request con 0x7f4618076380 auth_method 0 2024-09-12T00:19:28.915 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:19:28.573+0000 7f4743742800 10 monclient: get_monmap_and_config 2024-09-12T00:19:28.915 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:19:28.573+0000 7f4743742800 10 monclient: build_initial_monmap 2024-09-12T00:19:28.915 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:19:28.573+0000 7f4743742800 1 build_initial for_mkfs: 0 2024-09-12T00:19:28.915 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:19:28.573+0000 7f4743742800 10 monclient: monmap: 2024-09-12T00:19:28.915 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:19:28.915 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:19:28.915 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:19:28.915 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:19:28.915 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:19:28.916 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.916 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:19:28.916 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:19:28.916 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:19:28.916 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.916 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding auth protocol: cephx 2024-09-12T00:19:28.916 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding auth protocol: cephx 2024-09-12T00:19:28.916 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding auth protocol: cephx 2024-09-12T00:19:28.916 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: secure 2024-09-12T00:19:28.916 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: crc 2024-09-12T00:19:28.916 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: secure 2024-09-12T00:19:28.916 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: crc 2024-09-12T00:19:28.916 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: secure 2024-09-12T00:19:28.917 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: crc 2024-09-12T00:19:28.917 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: crc 2024-09-12T00:19:28.917 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: secure 2024-09-12T00:19:28.917 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: crc 2024-09-12T00:19:28.917 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: secure 2024-09-12T00:19:28.917 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: crc 2024-09-12T00:19:28.917 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:19:28.573+0000 7f4743742800 5 AuthRegistry(0x55923241c860) adding con mode: secure 2024-09-12T00:19:28.917 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:19:28.574+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.917 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient: init 2024-09-12T00:19:28.917 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding auth protocol: cephx 2024-09-12T00:19:28.917 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding auth protocol: cephx 2024-09-12T00:19:28.917 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding auth protocol: cephx 2024-09-12T00:19:28.917 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: secure 2024-09-12T00:19:28.917 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: crc 2024-09-12T00:19:28.918 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: secure 2024-09-12T00:19:28.918 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: crc 2024-09-12T00:19:28.918 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: secure 2024-09-12T00:19:28.918 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: crc 2024-09-12T00:19:28.918 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: crc 2024-09-12T00:19:28.918 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: secure 2024-09-12T00:19:28.918 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: crc 2024-09-12T00:19:28.918 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: secure 2024-09-12T00:19:28.918 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: crc 2024-09-12T00:19:28.918 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:19:28.574+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3570) adding con mode: secure 2024-09-12T00:19:28.918 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:19:28.574+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.918 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:19:28.574+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.918 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:19:28.574+0000 7f4743742800 5 asok(0x55923215e630) register_command rotate-key cmddesc rotate-key hook 0x7ffd379c36b8 EEXIST 2024-09-12T00:19:28.919 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient: _reopen_session rank -1 2024-09-12T00:19:28.919 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:19:28.919 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): picked mon.noname-c con 0x559232450e20 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:19:28.919 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): picked mon.noname-b con 0x559232441770 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:19:28.919 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): picked mon.noname-a con 0x55923244c250 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:19:28.919 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.919 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.919 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.919 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): _renew_subs 2024-09-12T00:19:28.919 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:19:28.574+0000 7f4743742800 10 monclient(hunting): authenticate will time out at 1845.831705s 2024-09-12T00:19:28.919 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:19:28.574+0000 7f473f486640 10 monclient(hunting): get_auth_request con 0x559232450e20 auth_method 0 2024-09-12T00:19:28.919 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:19:28.574+0000 7f473f486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.919 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:19:28.574+0000 7f473f486640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.919 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:19:28.574+0000 7f473f486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:19:28.574+0000 7f473fc87640 10 monclient(hunting): get_auth_request con 0x55923244c250 auth_method 0 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:19:28.574+0000 7f473fc87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:19:28.574+0000 7f473fc87640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:19:28.574+0000 7f473fc87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:19:28.574+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:19:28.574+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:19:28.574+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:19:28.574+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:19:28.574+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:19:28.574+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:19:28.574+0000 7f4736c85640 10 monclient(hunting): get_auth_request con 0x559232441770 auth_method 0 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:19:28.574+0000 7f4736c85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:19:28.574+0000 7f4736c85640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.920 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:19:28.574+0000 7f4736c85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.921 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:19:28.575+0000 7f473fc87640 10 monclient(hunting): handle_auth_done global_id 6903 payload 274 2024-09-12T00:19:28.921 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:19:28.575+0000 7f473fc87640 10 monclient: _finish_hunting 0 2024-09-12T00:19:28.921 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:19:28.575+0000 7f473fc87640 1 monclient: found mon.noname-a 2024-09-12T00:19:28.921 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:19:28.575+0000 7f473fc87640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:19:28.921 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.921 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:19:28.921 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: dump: 2024-09-12T00:19:28.921 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.921 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.921 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.921 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.921 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.921 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: _finish_auth 0 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:19:28.575+0000 7f4622ffd640 10 monclient: dump: 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.922 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.923 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.923 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.923 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.923 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.923 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.923 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.923 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:19:28.575+0000 7f4743742800 5 monclient: authenticate success, global_id 6903 2024-09-12T00:19:28.923 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:19:28.575+0000 7f4743742800 10 monclient: get_monmap_and_config success 2024-09-12T00:19:28.923 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:19:28.575+0000 7f4743742800 4 set_mon_vals no callback set 2024-09-12T00:19:28.923 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:19:28.575+0000 7f4743742800 10 monclient: shutdown 2024-09-12T00:19:28.923 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:19:28.576+0000 7f4743742800 10 monclient: build_initial_monmap 2024-09-12T00:19:28.923 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:19:28.576+0000 7f4743742800 1 build_initial for_mkfs: 0 2024-09-12T00:19:28.923 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:19:28.576+0000 7f4743742800 10 monclient: monmap: 2024-09-12T00:19:28.923 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:19:28.924 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:19:28.924 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:19:28.924 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:19:28.924 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:19:28.924 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.924 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:19:28.924 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:19:28.924 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:19:28.924 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.924 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding auth protocol: cephx 2024-09-12T00:19:28.924 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding auth protocol: cephx 2024-09-12T00:19:28.924 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding auth protocol: cephx 2024-09-12T00:19:28.924 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: secure 2024-09-12T00:19:28.925 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: crc 2024-09-12T00:19:28.925 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: secure 2024-09-12T00:19:28.925 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: crc 2024-09-12T00:19:28.925 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: secure 2024-09-12T00:19:28.925 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: crc 2024-09-12T00:19:28.925 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: crc 2024-09-12T00:19:28.925 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: secure 2024-09-12T00:19:28.925 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: crc 2024-09-12T00:19:28.925 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: secure 2024-09-12T00:19:28.925 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: crc 2024-09-12T00:19:28.925 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232441c60) adding con mode: secure 2024-09-12T00:19:28.925 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:19:28.576+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.925 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:19:28.576+0000 7f4743742800 1 librados: starting msgr at 2024-09-12T00:19:28.925 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:19:28.576+0000 7f4743742800 1 librados: starting objecter 2024-09-12T00:19:28.926 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:19:28.576+0000 7f4743742800 5 asok(0x55923215e630) register_command objecter_requests cmddesc objecter_requests hook 0x5592324020a0 EEXIST 2024-09-12T00:19:28.926 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:19:28.576+0000 7f4743742800 1 librados: setting wanted keys 2024-09-12T00:19:28.926 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:19:28.576+0000 7f4743742800 1 librados: calling monclient init 2024-09-12T00:19:28.926 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:19:28.576+0000 7f4743742800 10 monclient: init 2024-09-12T00:19:28.926 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding auth protocol: cephx 2024-09-12T00:19:28.926 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding auth protocol: cephx 2024-09-12T00:19:28.926 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding auth protocol: cephx 2024-09-12T00:19:28.926 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: secure 2024-09-12T00:19:28.926 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: crc 2024-09-12T00:19:28.926 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: secure 2024-09-12T00:19:28.926 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: crc 2024-09-12T00:19:28.926 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: secure 2024-09-12T00:19:28.926 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: crc 2024-09-12T00:19:28.927 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: crc 2024-09-12T00:19:28.927 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: secure 2024-09-12T00:19:28.927 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: crc 2024-09-12T00:19:28.927 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: secure 2024-09-12T00:19:28.927 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: crc 2024-09-12T00:19:28.927 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:19:28.576+0000 7f4743742800 5 AuthRegistry(0x559232411800) adding con mode: secure 2024-09-12T00:19:28.927 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:19:28.576+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.927 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:19:28.576+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.927 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:19:28.577+0000 7f4743742800 5 asok(0x55923215e630) register_command rotate-key cmddesc rotate-key hook 0x559232411948 EEXIST 2024-09-12T00:19:28.927 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient: _reopen_session rank -1 2024-09-12T00:19:28.927 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:19:28.927 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): picked mon.noname-c con 0x559232441770 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:19:28.927 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): picked mon.noname-b con 0x55923244c250 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:19:28.927 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): picked mon.noname-a con 0x559232450e20 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:19:28.928 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.928 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.928 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): start opening mon connection 2024-09-12T00:19:28.928 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): _renew_subs 2024-09-12T00:19:28.928 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient(hunting): authenticate will time out at 1845.834110s 2024-09-12T00:19:28.928 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): get_auth_request con 0x559232441770 auth_method 0 2024-09-12T00:19:28.928 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.928 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.928 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.928 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:19:28.577+0000 7f473fc87640 10 monclient(hunting): get_auth_request con 0x559232450e20 auth_method 0 2024-09-12T00:19:28.928 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:19:28.577+0000 7f473fc87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.928 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:19:28.577+0000 7f473fc87640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.928 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:19:28.577+0000 7f473fc87640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:19:28.577+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:19:28.577+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:19:28.577+0000 7f473fc87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:19:28.577+0000 7f4736c85640 10 monclient(hunting): get_auth_request con 0x55923244c250 auth_method 0 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:19:28.577+0000 7f4736c85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:19:28.577+0000 7f4736c85640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:19:28.577+0000 7f4736c85640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient(hunting): handle_auth_done global_id 6485 payload 824 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient: _finish_hunting 0 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:19:28.577+0000 7f473f486640 1 monclient: found mon.noname-c 2024-09-12T00:19:28.929 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:19:28.577+0000 7f473f486640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:19:28.930 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.930 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:19:28.930 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: dump: 2024-09-12T00:19:28.930 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.930 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.930 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.930 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.930 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.930 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.930 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.930 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.930 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.930 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.930 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: _finish_auth 0 2024-09-12T00:19:28.931 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: _check_auth_tickets 2024-09-12T00:19:28.931 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:19:28.931 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:19:28.931 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:19:28.931 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:19:28.577+0000 7f46217fa640 10 monclient: dump: 2024-09-12T00:19:28.931 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:19:28.931 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:19:28.931 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.931 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:19:28.931 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:19:28.931 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:19:28.931 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:19:28.931 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:19:28.932 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:19:28.932 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.932 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:19:28.577+0000 7f4743742800 5 monclient: authenticate success, global_id 6485 2024-09-12T00:19:28.932 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient: _renew_subs 2024-09-12T00:19:28.932 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:19:28.577+0000 7f4622ffd640 4 set_mon_vals no callback set 2024-09-12T00:19:28.932 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:19:28.932 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient: _renew_subs 2024-09-12T00:19:28.932 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:19:28.577+0000 7f4743742800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:19:28.932 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:19:28.577+0000 7f4743742800 1 librados: init done 2024-09-12T00:19:28.932 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:19:28.577+0000 7f4743742800 5 asok(0x55923215e630) register_command cr dump hook 0x559232444668 2024-09-12T00:19:28.932 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:19:28.579+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.932 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:19:28.579+0000 7f46217fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:19:28.932 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:19:28.579+0000 7f46217fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:19:28.933 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:19:28.579+0000 7f46217fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:19:28.933 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:19:28.580+0000 7f4736c85640 10 monclient: get_auth_request con 0x7f4608076470 auth_method 0 2024-09-12T00:19:28.933 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:19:28.580+0000 7f473fc87640 10 monclient: get_auth_request con 0x55923246ba20 auth_method 0 2024-09-12T00:19:28.933 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:19:28.581+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.933 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:19:28.581+0000 7f4743742800 20 realm 2024-09-12T00:19:28.933 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:19:28.581+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.933 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:19:28.581+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.933 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:19:28.581+0000 7f4743742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:28.933 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:19:28.581+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.933 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:19:28.581+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.933 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:19:28.581+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.933 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:19:28.581+0000 7f473f486640 10 monclient: get_auth_request con 0x55923246fc20 auth_method 0 2024-09-12T00:19:28.933 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:19:28.582+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:28.933 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:19:28.582+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.934 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:19:28.582+0000 7f4736c85640 10 monclient: get_auth_request con 0x559232473480 auth_method 0 2024-09-12T00:19:28.934 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:19:28.583+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:28.934 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:19:28.583+0000 7f4743742800 20 searching for the correct realm 2024-09-12T00:19:28.934 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:19:28.583+0000 7f473fc87640 10 monclient: get_auth_request con 0x7f4728015070 auth_method 0 2024-09-12T00:19:28.934 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:19:28.584+0000 7f473f486640 10 monclient: get_auth_request con 0x7f4730003310 auth_method 0 2024-09-12T00:19:28.934 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:19:28.585+0000 7f4736c85640 10 monclient: get_auth_request con 0x7f4728083180 auth_method 0 2024-09-12T00:19:28.934 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:19:28.585+0000 7f4736c85640 0 -- 172.21.15.67:0/265077795 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f4728083180 msgr2=0x7f472807b020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:28.934 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:19:28.787+0000 7f4736c85640 10 monclient: get_auth_request con 0x7f4728083180 auth_method 0 2024-09-12T00:19:28.934 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:19:28.789+0000 7f473fc87640 10 monclient: get_auth_request con 0x7f47300ba070 auth_method 0 2024-09-12T00:19:28.934 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:19:28.790+0000 7f473f486640 10 monclient: get_auth_request con 0x7f4738018b50 auth_method 0 2024-09-12T00:19:28.934 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:19:28.791+0000 7f473fc87640 0 -- 172.21.15.67:0/265077795 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55923246ba20 msgr2=0x55923246deb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:28.934 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:19:28.791+0000 7f46217fa640 1 client.6485.objecter ms_handle_reset 0x55923246ba20 session 0x55923246b310 osd.6 2024-09-12T00:19:28.934 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:19:28.791+0000 7f46217fa640 10 monclient: _renew_subs 2024-09-12T00:19:28.935 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:19:28.791+0000 7f46217fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:19:28.935 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:19:28.791+0000 7f473fc87640 10 monclient: get_auth_request con 0x7f4608086790 auth_method 0 2024-09-12T00:19:28.935 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:28.935 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:28.935 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:28.935 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:28.935 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:28.935 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:19:28.795+0000 7f4743742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:28.935 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:19:28.795+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.935 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:19:28.796+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.935 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:19:28.796+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.935 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:19:28.796+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:28.935 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:19:28.796+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.935 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:19:28.797+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:28.936 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:19:28.797+0000 7f4743742800 20 zone default found 2024-09-12T00:19:28.936 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:19:28.797+0000 7f4743742800 4 Realm: () 2024-09-12T00:19:28.936 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:19:28.797+0000 7f4743742800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:28.936 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:19:28.797+0000 7f4743742800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:28.936 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:19:28.797+0000 7f4743742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:28.936 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:19:28.797+0000 7f4743742800 20 zonegroup default 2024-09-12T00:19:28.936 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:19:28.797+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.936 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:19:28.797+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.936 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:19:28.797+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.936 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:19:28.798+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.936 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:19:28.798+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.936 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:19:28.798+0000 7f4743742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.936 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:19:28.798+0000 7f4743742800 20 started sync module instance, tier type = 2024-09-12T00:19:28.936 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:19:28.798+0000 7f4743742800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:28.937 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=0 2024-09-12T00:19:28.937 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=1 2024-09-12T00:19:28.937 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=2 2024-09-12T00:19:28.937 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=3 2024-09-12T00:19:28.937 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=4 2024-09-12T00:19:28.937 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=5 2024-09-12T00:19:28.937 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:19:28.807+0000 7f4743742800 20 add_watcher() i=6 2024-09-12T00:19:28.937 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:19:28.808+0000 7f4743742800 20 add_watcher() i=7 2024-09-12T00:19:28.937 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:19:28.808+0000 7f4743742800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:28.937 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding auth protocol: cephx 2024-09-12T00:19:28.937 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding auth protocol: cephx 2024-09-12T00:19:28.937 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding auth protocol: cephx 2024-09-12T00:19:28.937 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: secure 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: crc 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: secure 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: crc 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: secure 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: crc 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: crc 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: secure 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: crc 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: secure 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: crc 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:19:28.810+0000 7f4743742800 5 AuthRegistry(0x7ffd379c3a50) adding con mode: secure 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:19:28.810+0000 7f45f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:19:28.810+0000 7f4743742800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:19:28.938 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:19:28.810+0000 7f4743742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:28.939 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:19:28.810+0000 7f4743742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:28.939 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:19:28.810+0000 7f4743742800 5 asok(0x55923215e630) register_command cache list hook 0x55923244a550 2024-09-12T00:19:28.939 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:19:28.810+0000 7f4743742800 5 asok(0x55923215e630) register_command cache inspect hook 0x55923244a550 2024-09-12T00:19:28.939 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:19:28.810+0000 7f4743742800 5 asok(0x55923215e630) register_command cache erase hook 0x55923244a550 2024-09-12T00:19:28.939 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:19:28.810+0000 7f4743742800 5 asok(0x55923215e630) register_command cache zap hook 0x55923244a550 2024-09-12T00:19:28.939 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:19:28.810+0000 7f4743742800 5 note: GC not initialized 2024-09-12T00:19:28.939 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:19:28.811+0000 7f45f4fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:28.939 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:19:28.811+0000 7f4743742800 5 asok(0x55923215e630) register_command sync trace show hook 0x7f4738005b40 2024-09-12T00:19:28.939 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:19:28.811+0000 7f4743742800 5 asok(0x55923215e630) register_command sync trace history hook 0x7f4738005b40 2024-09-12T00:19:28.939 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:19:28.811+0000 7f4743742800 5 asok(0x55923215e630) register_command sync trace active hook 0x7f4738005b40 2024-09-12T00:19:28.939 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:19:28.811+0000 7f4743742800 5 asok(0x55923215e630) register_command sync trace active_short hook 0x7f4738005b40 2024-09-12T00:19:28.939 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:19:28.811+0000 7f4743742800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:28.939 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:19:28.811+0000 7f4743742800 20 Filter name: none 2024-09-12T00:19:28.939 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:19:28.811+0000 7f456e7fc640 20 reqs_thread_entry: start 2024-09-12T00:19:28.940 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:19:28.811+0000 7f4743742800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:19:28.940 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:19:28.811+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.940 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:19:28.811+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:28.940 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:19:28.811+0000 7f4743742800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:19:28.940 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:19:28.811+0000 7f4743742800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:19:28.940 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:19:28.811+0000 7f4743742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 : miss 2024-09-12T00:19:28.940 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:19:28.811+0000 7f4743742800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.940 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:19:28.812+0000 7f4743742800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:19:28.940 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:19:28.812+0000 7f4743742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:28.940 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:19:28.812+0000 7f4743742800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:28.940 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:19:28.812+0000 7f4743742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:28.940 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:19:28.812+0000 7f4743742800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:28.941 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:19:28.812+0000 7f4743742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 2024-09-12T00:19:28.941 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:19:28.815+0000 7f4743742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:28.941 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:19:28.816+0000 7f4743742800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:28.941 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:19:28.816+0000 7f4743742800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:28.941 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:19:28.816+0000 7f4743742800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27, ofs0, ns] 2024-09-12T00:19:28.941 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:19:28.816+0000 7f4622ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562480 cookie 94086397143008 notifier 6485 bl.length()=939 2024-09-12T00:19:28.941 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:19:28.816+0000 7f4622ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:28.941 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:19:28.816+0000 7f4622ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:28.941 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:19:28.816+0000 7f4622ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:28.941 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:19:28.816+0000 7f4743742800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): orig_sources= new_sources= 2024-09-12T00:19:28.941 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:19:28.816+0000 7f4743742800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): potential sources added=[] removed=[] 2024-09-12T00:19:28.941 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:19:28.816+0000 7f4743742800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): orig_dests= new_dests= 2024-09-12T00:19:28.941 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:19:28.816+0000 7f4743742800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): potential dests added=[] removed=[] 2024-09-12T00:19:28.942 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:19:28.817+0000 7f4743742800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4743742800 time 2024-09-12T00:19:28.818248+0000 2024-09-12T00:19:28.942 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:19:28.942 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.942 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:19:28.942 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f4744f8c71a] 2024-09-12T00:19:28.942 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4744f8c8d8] 2024-09-12T00:19:28.942 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55922fdf4641] 2024-09-12T00:19:28.942 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd884de) [0x5592303074de] 2024-09-12T00:19:28.942 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55922fe0431d] 2024-09-12T00:19:28.942 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:19:28.942 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4743c29590] 2024-09-12T00:19:28.942 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:19:28.942 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:19:28.942 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.943 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:19:28.818+0000 7f4743742800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:19:28.943 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f4743742800 thread_name:radosgw-admin 2024-09-12T00:19:28.943 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.943 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:19:28.943 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4743c3e6f0] 2024-09-12T00:19:28.943 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4743c8b99c] 2024-09-12T00:19:28.943 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:19:28.943 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:19:28.943 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f4744f8c774] 2024-09-12T00:19:28.943 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f4744f8c8d8] 2024-09-12T00:19:28.943 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55922fdf4641] 2024-09-12T00:19:28.943 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd884de) [0x5592303074de] 2024-09-12T00:19:28.943 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55922fe0431d] 2024-09-12T00:19:28.943 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:19:28.944 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4743c29590] 2024-09-12T00:19:28.944 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:19:28.944 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:19:28.944 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:19:28.944 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.944 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:19:28.944 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:19:28.944 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:19:28.944 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:19:28.944 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:19:28.944 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:19:28.944 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:19:28.944 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:19:28.945 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:19:28.946 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:19:28.946 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:19:28.946 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:19:28.946 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:19:28.946 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:19:28.946 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:19:28.946 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:19:28.946 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:19:28.946 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:19:28.946 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:19:28.946 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:19:28.946 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:19:28.946 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:19:28.946 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:19:28.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:19:28.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:19:28.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:19:28.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:19:28.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:19:28.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:19:28.947 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:19:28.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:19:28.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:19:28.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:19:28.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:19:28.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:19:28.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:19:28.947 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:19:28.948 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:19:28.948 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:19:28.948 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:19:28.948 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:19:28.948 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:19:28.948 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:19:28.948 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:19:28.948 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:19:28.948 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:19:28.948 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:19:28.948 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:19:28.948 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:19:28.948 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:19:28.949 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:19:28.949 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:19:28.949 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:19:28.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:19:28.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:19:28.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:19:28.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:19:28.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:19:28.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:19:28.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:19:28.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:19:28.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:19:28.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:19:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:19:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:19:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:19:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:19:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:19:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:19:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:19:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:19:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:19:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:19:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:19:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:19:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:19:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:19:28.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:19:28.951 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:19:28.951 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:19:28.951 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:19:28.951 INFO:tasks.workunit.client.0.smithi067.stderr: 7f456e7fc640 / http_manager 2024-09-12T00:19:28.951 INFO:tasks.workunit.client.0.smithi067.stderr: 7f45f4fe1640 / http_manager 2024-09-12T00:19:28.951 INFO:tasks.workunit.client.0.smithi067.stderr: 7f45f5fe3640 / rgw_dt_lg_renew 2024-09-12T00:19:28.951 INFO:tasks.workunit.client.0.smithi067.stderr: 7f46217fa640 / ms_dispatch 2024-09-12T00:19:28.951 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4622ffd640 / io_context_pool 2024-09-12T00:19:28.951 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4629602640 / ms_dispatch 2024-09-12T00:19:28.951 INFO:tasks.workunit.client.0.smithi067.stderr: 7f462be07640 / ms_dispatch 2024-09-12T00:19:28.951 INFO:tasks.workunit.client.0.smithi067.stderr: 7f462d60a640 / io_context_pool 2024-09-12T00:19:28.952 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4736c85640 / msgr-worker-2 2024-09-12T00:19:28.952 INFO:tasks.workunit.client.0.smithi067.stderr: 7f473f486640 / msgr-worker-1 2024-09-12T00:19:28.952 INFO:tasks.workunit.client.0.smithi067.stderr: 7f473fc87640 / msgr-worker-0 2024-09-12T00:19:28.952 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4740488640 / io_context_pool 2024-09-12T00:19:28.952 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4743742800 / radosgw-admin 2024-09-12T00:19:28.952 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:19:28.952 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:19:28.952 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:19:28.819927Z_c90dcd18-851e-4f36-9ed7-5453214b454c/log 2024-09-12T00:19:28.952 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:19:28.952 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:19:28.957 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:28.957 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:28.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.895+0000 7f21b072c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.897+0000 7f21b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.897+0000 7f21b072c800 20 realm 2024-09-12T00:19:28.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.897+0000 7f21b072c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.898+0000 7f21b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.898+0000 7f21b072c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:28.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.898+0000 7f21b072c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.898+0000 7f21b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.898+0000 7f21b072c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.898+0000 7f21b072c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:28.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.898+0000 7f21b072c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.899+0000 7f21b072c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:28.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.900+0000 7f21b072c800 20 searching for the correct realm 2024-09-12T00:19:28.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.903+0000 7f21abc4e640 0 -- 172.21.15.67:0/2457632092 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f21a0044400 msgr2=0x7f21a0044880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:19:28.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.907+0000 7f21acc50640 0 -- 172.21.15.67:0/2457632092 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x56012449f2c0 msgr2=0x5601244a1780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:28.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:28.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:28.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:28.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:28.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:28.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:28.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:28.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:28.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 20 zone default found 2024-09-12T00:19:28.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 4 Realm: () 2024-09-12T00:19:28.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:28.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:28.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:28.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 20 zonegroup default 2024-09-12T00:19:28.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.911+0000 7f21b072c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.912+0000 7f21b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.912+0000 7f21b072c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.912+0000 7f21b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.912+0000 7f21b072c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.912+0000 7f21b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:28.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.912+0000 7f21b072c800 20 started sync module instance, tier type = 2024-09-12T00:19:28.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.912+0000 7f21b072c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:28.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.920+0000 7f21b072c800 20 add_watcher() i=0 2024-09-12T00:19:28.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.920+0000 7f21b072c800 20 add_watcher() i=1 2024-09-12T00:19:28.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.920+0000 7f21b072c800 20 add_watcher() i=2 2024-09-12T00:19:28.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.920+0000 7f21b072c800 20 add_watcher() i=3 2024-09-12T00:19:28.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.920+0000 7f21b072c800 20 add_watcher() i=4 2024-09-12T00:19:28.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.920+0000 7f21b072c800 20 add_watcher() i=5 2024-09-12T00:19:28.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.920+0000 7f21b072c800 20 add_watcher() i=6 2024-09-12T00:19:28.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.921+0000 7f21b072c800 20 add_watcher() i=7 2024-09-12T00:19:28.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.921+0000 7f21b072c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:28.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.923+0000 7f2062fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:28.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.923+0000 7f21b072c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:28.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.923+0000 7f21b072c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:28.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.924+0000 7f21b072c800 5 note: GC not initialized 2024-09-12T00:19:28.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.924+0000 7f2061fdb640 20 reqs_thread_entry: start 2024-09-12T00:19:28.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.924+0000 7f21b072c800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:28.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.924+0000 7f21b072c800 20 Filter name: none 2024-09-12T00:19:28.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.924+0000 7f1fd37fe640 20 reqs_thread_entry: start 2024-09-12T00:19:28.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.924+0000 7f21b072c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.924+0000 7f21b072c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:28.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.924+0000 7f21b072c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.925+0000 7f21b072c800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:19:28.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.925+0000 7f21b072c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:28.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.925+0000 7f21b072c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.925+0000 7f21b072c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:28.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.925+0000 7f21b072c800 20 rados->read ofs=0 len=0 2024-09-12T00:19:28.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.926+0000 7f21b072c800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:19:28.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.926+0000 7f21b072c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:19:28.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.927+0000 7f2062fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:28.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.929+0000 7f21b072c800 20 remove_watcher() i=0 2024-09-12T00:19:28.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.929+0000 7f21b072c800 2 removed watcher, disabling cache 2024-09-12T00:19:28.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.930+0000 7f21b072c800 20 remove_watcher() i=1 2024-09-12T00:19:28.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.931+0000 7f21b072c800 20 remove_watcher() i=2 2024-09-12T00:19:28.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.932+0000 7f21b072c800 20 remove_watcher() i=3 2024-09-12T00:19:28.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.933+0000 7f21b072c800 20 remove_watcher() i=4 2024-09-12T00:19:28.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.934+0000 7f21b072c800 20 remove_watcher() i=5 2024-09-12T00:19:28.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.935+0000 7f21b072c800 20 remove_watcher() i=6 2024-09-12T00:19:28.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:28.936+0000 7f21b072c800 20 remove_watcher() i=7 2024-09-12T00:19:28.964 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.964 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:19:28.964 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-trim-reshard-log-entries id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:19:28.964 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:19:28.999 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:19:29.033 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:29.033 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:29.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.073+0000 7f3d14325800 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.075+0000 7f3d14325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.075+0000 7f3d14325800 20 realm 2024-09-12T00:19:29.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.075+0000 7f3d14325800 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.075+0000 7f3d14325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.075+0000 7f3d14325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:29.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.075+0000 7f3d14325800 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.075+0000 7f3d14325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.075+0000 7f3d14325800 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.076+0000 7f3d14325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:29.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.076+0000 7f3d14325800 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.077+0000 7f3d14325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:29.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.077+0000 7f3d14325800 20 searching for the correct realm 2024-09-12T00:19:29.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.079+0000 7f3d0f732640 0 -- 172.21.15.67:0/2843095555 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f3d0406d3a0 msgr2=0x7f3d0405f2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:29.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.284+0000 7f3d10734640 0 -- 172.21.15.67:0/2843095555 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x564d067c0d60 msgr2=0x564d067c31f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:29.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.288+0000 7f3d14325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:29.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.288+0000 7f3d14325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:29.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.288+0000 7f3d14325800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:29.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.288+0000 7f3d14325800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:29.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.288+0000 7f3d14325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:29.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.288+0000 7f3d14325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:29.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.288+0000 7f3d14325800 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.289+0000 7f3d14325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.289+0000 7f3d14325800 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.289+0000 7f3d14325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:29.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.289+0000 7f3d14325800 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.289+0000 7f3d14325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:29.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.289+0000 7f3d14325800 20 zone default found 2024-09-12T00:19:29.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.289+0000 7f3d14325800 4 Realm: () 2024-09-12T00:19:29.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.289+0000 7f3d14325800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:29.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.289+0000 7f3d14325800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:29.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.289+0000 7f3d14325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:29.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.289+0000 7f3d14325800 20 zonegroup default 2024-09-12T00:19:29.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.289+0000 7f3d14325800 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.289+0000 7f3d14325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.289+0000 7f3d14325800 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.290+0000 7f3d14325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.290+0000 7f3d14325800 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.291+0000 7f3d14325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:29.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.291+0000 7f3d14325800 20 started sync module instance, tier type = 2024-09-12T00:19:29.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.291+0000 7f3d14325800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:29.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.301+0000 7f3d14325800 20 add_watcher() i=0 2024-09-12T00:19:29.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.301+0000 7f3d14325800 20 add_watcher() i=1 2024-09-12T00:19:29.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.301+0000 7f3d14325800 20 add_watcher() i=2 2024-09-12T00:19:29.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.301+0000 7f3d14325800 20 add_watcher() i=3 2024-09-12T00:19:29.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.301+0000 7f3d14325800 20 add_watcher() i=4 2024-09-12T00:19:29.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.301+0000 7f3d14325800 20 add_watcher() i=5 2024-09-12T00:19:29.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.301+0000 7f3d14325800 20 add_watcher() i=6 2024-09-12T00:19:29.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.302+0000 7f3d14325800 20 add_watcher() i=7 2024-09-12T00:19:29.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.302+0000 7f3d14325800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:29.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.304+0000 7f3bc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:29.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.304+0000 7f3d14325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:29.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.304+0000 7f3d14325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:29.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.304+0000 7f3d14325800 5 note: GC not initialized 2024-09-12T00:19:29.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.305+0000 7f3bc4fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:29.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.305+0000 7f3d14325800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:29.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.305+0000 7f3d14325800 20 Filter name: none 2024-09-12T00:19:29.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.305+0000 7f3b3e7fc640 20 reqs_thread_entry: start 2024-09-12T00:19:29.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.305+0000 7f3d14325800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:19:29.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.305+0000 7f3d14325800 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.305+0000 7f3d14325800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:29.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.305+0000 7f3d14325800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:19:29.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.305+0000 7f3d14325800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:19:29.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.305+0000 7f3d14325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 : miss 2024-09-12T00:19:29.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.305+0000 7f3d14325800 20 rados->read ofs=0 len=0 2024-09-12T00:19:29.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.306+0000 7f3d14325800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:19:29.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.306+0000 7f3d14325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:29.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.306+0000 7f3d14325800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:29.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.306+0000 7f3d14325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:29.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.306+0000 7f3d14325800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:29.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.306+0000 7f3d14325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 2024-09-12T00:19:29.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.307+0000 7f3d14325800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to be held by another RGW process; skipping for now 2024-09-12T00:19:29.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.308+0000 7f3bc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:29.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.310+0000 7f3d14325800 20 remove_watcher() i=0 2024-09-12T00:19:29.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.310+0000 7f3d14325800 2 removed watcher, disabling cache 2024-09-12T00:19:29.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.311+0000 7f3d14325800 20 remove_watcher() i=1 2024-09-12T00:19:29.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.312+0000 7f3d14325800 20 remove_watcher() i=2 2024-09-12T00:19:29.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.313+0000 7f3d14325800 20 remove_watcher() i=3 2024-09-12T00:19:29.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.314+0000 7f3d14325800 20 remove_watcher() i=4 2024-09-12T00:19:29.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.315+0000 7f3d14325800 20 remove_watcher() i=5 2024-09-12T00:19:29.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.316+0000 7f3d14325800 20 remove_watcher() i=6 2024-09-12T00:19:29.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:29.317+0000 7f3d14325800 20 remove_watcher() i=7 2024-09-12T00:19:29.327 INFO:tasks.workunit.client.0.smithi067.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:19:59.360 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:19:59.398 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:59.398 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:59.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.447+0000 7f5db3d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.448+0000 7f5db3d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:59.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.448+0000 7f5db3d3d800 20 realm 2024-09-12T00:19:59.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.448+0000 7f5db3d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.449+0000 7f5db3d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:59.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.449+0000 7f5db3d3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:59.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.449+0000 7f5db3d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.449+0000 7f5db3d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:59.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.449+0000 7f5db3d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.450+0000 7f5db3d3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:59.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.450+0000 7f5db3d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.451+0000 7f5db3d3d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:59.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.451+0000 7f5db3d3d800 20 searching for the correct realm 2024-09-12T00:19:59.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.452+0000 7f5daf229640 0 -- 172.21.15.67:0/273036314 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x562ec8d5c220 msgr2=0x562ec8d5e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:59.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.456+0000 7f5db022b640 0 -- 172.21.15.67:0/273036314 >> [v2:172.21.15.170:6824/783534599,v1:172.21.15.170:6825/783534599] conn(0x7f5da0081070 msgr2=0x7f5da00a3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:19:59.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.665+0000 7f5db3d3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:19:59.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.665+0000 7f5db3d3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:19:59.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.665+0000 7f5db3d3d800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:19:59.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.665+0000 7f5db3d3d800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:19:59.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.665+0000 7f5db3d3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:19:59.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.665+0000 7f5db3d3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:19:59.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.665+0000 7f5db3d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.665+0000 7f5db3d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:59.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.665+0000 7f5db3d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.666+0000 7f5db3d3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:59.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.666+0000 7f5db3d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.666+0000 7f5db3d3d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:19:59.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.666+0000 7f5db3d3d800 20 zone default found 2024-09-12T00:19:59.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.666+0000 7f5db3d3d800 4 Realm: () 2024-09-12T00:19:59.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.666+0000 7f5db3d3d800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:19:59.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.666+0000 7f5db3d3d800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:19:59.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.666+0000 7f5db3d3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:19:59.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.666+0000 7f5db3d3d800 20 zonegroup default 2024-09-12T00:19:59.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.666+0000 7f5db3d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.666+0000 7f5db3d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:59.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.666+0000 7f5db3d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.667+0000 7f5db3d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:59.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.667+0000 7f5db3d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.667+0000 7f5db3d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:59.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.667+0000 7f5db3d3d800 20 started sync module instance, tier type = 2024-09-12T00:19:59.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.667+0000 7f5db3d3d800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:19:59.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.677+0000 7f5db3d3d800 20 add_watcher() i=0 2024-09-12T00:19:59.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.677+0000 7f5db3d3d800 20 add_watcher() i=1 2024-09-12T00:19:59.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.677+0000 7f5db3d3d800 20 add_watcher() i=2 2024-09-12T00:19:59.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.677+0000 7f5db3d3d800 20 add_watcher() i=3 2024-09-12T00:19:59.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.677+0000 7f5db3d3d800 20 add_watcher() i=4 2024-09-12T00:19:59.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.677+0000 7f5db3d3d800 20 add_watcher() i=5 2024-09-12T00:19:59.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.677+0000 7f5db3d3d800 20 add_watcher() i=6 2024-09-12T00:19:59.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.678+0000 7f5db3d3d800 20 add_watcher() i=7 2024-09-12T00:19:59.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.678+0000 7f5db3d3d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:19:59.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.680+0000 7f5c65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:59.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.681+0000 7f5db3d3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:19:59.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.681+0000 7f5db3d3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:19:59.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.681+0000 7f5db3d3d800 5 note: GC not initialized 2024-09-12T00:19:59.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.681+0000 7f5c64fe1640 20 reqs_thread_entry: start 2024-09-12T00:19:59.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.681+0000 7f5db3d3d800 20 init_complete bucket index max shards: 1 2024-09-12T00:19:59.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.681+0000 7f5db3d3d800 20 Filter name: none 2024-09-12T00:19:59.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.681+0000 7f5bde7fc640 20 reqs_thread_entry: start 2024-09-12T00:19:59.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.681+0000 7f5db3d3d800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:19:59.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.681+0000 7f5db3d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.682+0000 7f5db3d3d800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:19:59.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.682+0000 7f5db3d3d800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:19:59.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.682+0000 7f5db3d3d800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:19:59.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.682+0000 7f5db3d3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 : miss 2024-09-12T00:19:59.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.682+0000 7f5db3d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.682+0000 7f5db3d3d800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:19:59.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.682+0000 7f5db3d3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:59.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.682+0000 7f5db3d3d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:59.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.682+0000 7f5db3d3d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:19:59.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.682+0000 7f5db3d3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:59.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.682+0000 7f5db3d3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 2024-09-12T00:19:59.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.684+0000 7f5db3d3d800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:19:59.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.688+0000 7f5db3d3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:59.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.688+0000 7f5db3d3d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:59.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.688+0000 7f5db3d3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:59.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.688+0000 7f5db3d3d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27, ofs0, ns] 2024-09-12T00:19:59.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.688+0000 7f5c8effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562481 cookie 94758937989040 notifier 6536 bl.length()=939 2024-09-12T00:19:59.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.688+0000 7f5c8effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:59.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.688+0000 7f5c8effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:59.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.688+0000 7f5c8effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:59.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.688+0000 7f5db3d3d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): orig_sources= new_sources= 2024-09-12T00:19:59.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.688+0000 7f5db3d3d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): potential sources added=[] removed=[] 2024-09-12T00:19:59.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.688+0000 7f5db3d3d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): orig_dests= new_dests= 2024-09-12T00:19:59.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.688+0000 7f5db3d3d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): potential dests added=[] removed=[] 2024-09-12T00:19:59.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.691+0000 7f5db3d3d800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27.2.0 2024-09-12T00:19:59.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.691+0000 7f5db3d3d800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27.2.0 2024-09-12T00:19:59.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.691+0000 7f5db3d3d800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27.2.1 2024-09-12T00:19:59.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.691+0000 7f5db3d3d800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27.2.1 2024-09-12T00:19:59.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.691+0000 7f5db3d3d800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27.0 2024-09-12T00:19:59.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.693+0000 7f5db3d3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:19:59.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.693+0000 7f5db3d3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 2024-09-12T00:19:59.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.694+0000 7f5db3d3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:59.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.694+0000 7f5db3d3d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:59.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.694+0000 7f5db3d3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:59.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.694+0000 7f5db3d3d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27, ofs0, ns] 2024-09-12T00:19:59.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.695+0000 7f5c8effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562482 cookie 94758937989040 notifier 6536 bl.length()=939 2024-09-12T00:19:59.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.695+0000 7f5c8effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:59.698 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.695+0000 7f5c8effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:59.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.695+0000 7f5c8effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:59.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.695+0000 7f5db3d3d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): orig_sources= new_sources= 2024-09-12T00:19:59.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.695+0000 7f5db3d3d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): potential sources added=[] removed=[] 2024-09-12T00:19:59.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.695+0000 7f5db3d3d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): orig_dests= new_dests= 2024-09-12T00:19:59.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.695+0000 7f5db3d3d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): potential dests added=[] removed=[] 2024-09-12T00:19:59.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.696+0000 7f5db3d3d800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27.0 2024-09-12T00:19:59.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.697+0000 7f5db3d3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:19:59.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.697+0000 7f5db3d3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 2024-09-12T00:19:59.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.698+0000 7f5db3d3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:59.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.698+0000 7f5db3d3d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:59.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.698+0000 7f5db3d3d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:59.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.698+0000 7f5db3d3d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27, ofs0, ns] 2024-09-12T00:19:59.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.699+0000 7f5c8e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562483 cookie 94758937989040 notifier 6536 bl.length()=907 2024-09-12T00:19:59.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.699+0000 7f5c8e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 info.flags=0x17 2024-09-12T00:19:59.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.699+0000 7f5c8e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 to cache LRU end 2024-09-12T00:19:59.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.699+0000 7f5c8e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:19:59.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.699+0000 7f5db3d3d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): orig_sources= new_sources= 2024-09-12T00:19:59.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.699+0000 7f5db3d3d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): potential sources added=[] removed=[] 2024-09-12T00:19:59.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.699+0000 7f5db3d3d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): orig_dests= new_dests= 2024-09-12T00:19:59.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.699+0000 7f5db3d3d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27]): potential dests added=[] removed=[] 2024-09-12T00:19:59.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.700+0000 7f5db3d3d800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:19:59.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.702+0000 7f5c65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:19:59.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.705+0000 7f5db3d3d800 20 remove_watcher() i=0 2024-09-12T00:19:59.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.705+0000 7f5db3d3d800 2 removed watcher, disabling cache 2024-09-12T00:19:59.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.706+0000 7f5db3d3d800 20 remove_watcher() i=1 2024-09-12T00:19:59.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.707+0000 7f5db3d3d800 20 remove_watcher() i=2 2024-09-12T00:19:59.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.708+0000 7f5db3d3d800 20 remove_watcher() i=3 2024-09-12T00:19:59.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.709+0000 7f5db3d3d800 20 remove_watcher() i=4 2024-09-12T00:19:59.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.710+0000 7f5db3d3d800 20 remove_watcher() i=5 2024-09-12T00:19:59.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.711+0000 7f5db3d3d800 20 remove_watcher() i=6 2024-09-12T00:19:59.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.712+0000 7f5db3d3d800 20 remove_watcher() i=7 2024-09-12T00:19:59.724 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:19:59.754 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:19:59.754 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:19:59.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.794+0000 7faa19f75800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.797+0000 7faa19f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:59.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.797+0000 7faa19f75800 20 realm 2024-09-12T00:19:59.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.797+0000 7faa19f75800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.797+0000 7faa19f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:59.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.797+0000 7faa19f75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:19:59.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.797+0000 7faa19f75800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.797+0000 7faa19f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:19:59.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.797+0000 7faa19f75800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.798+0000 7faa19f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:19:59.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.798+0000 7faa19f75800 20 rados->read ofs=0 len=0 2024-09-12T00:19:59.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.799+0000 7faa19f75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:19:59.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.799+0000 7faa19f75800 20 searching for the correct realm 2024-09-12T00:19:59.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:19:59.802+0000 7faa1725e640 0 -- 172.21.15.67:0/92572191 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7faa0c06f050 msgr2=0x7faa0c09e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:20:00.007 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.009+0000 7faa18260640 0 -- 172.21.15.67:0/92572191 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x561b9752e1d0 msgr2=0x561b975305c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:00.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.013+0000 7faa19f75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:00.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.013+0000 7faa19f75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:00.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.013+0000 7faa19f75800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:00.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.013+0000 7faa19f75800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:00.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.013+0000 7faa19f75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:00.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.013+0000 7faa19f75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:00.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.013+0000 7faa19f75800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.013+0000 7faa19f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.013+0000 7faa19f75800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.014+0000 7faa19f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:00.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.014+0000 7faa19f75800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.014+0000 7faa19f75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:00.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.014+0000 7faa19f75800 20 zone default found 2024-09-12T00:20:00.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.014+0000 7faa19f75800 4 Realm: () 2024-09-12T00:20:00.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.014+0000 7faa19f75800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:00.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.014+0000 7faa19f75800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:00.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.014+0000 7faa19f75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:00.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.014+0000 7faa19f75800 20 zonegroup default 2024-09-12T00:20:00.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.014+0000 7faa19f75800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.014+0000 7faa19f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.015+0000 7faa19f75800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.015+0000 7faa19f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.015+0000 7faa19f75800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.015+0000 7faa19f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.015+0000 7faa19f75800 20 started sync module instance, tier type = 2024-09-12T00:20:00.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.015+0000 7faa19f75800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:00.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.024+0000 7faa19f75800 20 add_watcher() i=0 2024-09-12T00:20:00.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.024+0000 7faa19f75800 20 add_watcher() i=1 2024-09-12T00:20:00.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.024+0000 7faa19f75800 20 add_watcher() i=2 2024-09-12T00:20:00.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.024+0000 7faa19f75800 20 add_watcher() i=3 2024-09-12T00:20:00.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.024+0000 7faa19f75800 20 add_watcher() i=4 2024-09-12T00:20:00.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.024+0000 7faa19f75800 20 add_watcher() i=5 2024-09-12T00:20:00.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.025+0000 7faa19f75800 20 add_watcher() i=6 2024-09-12T00:20:00.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.026+0000 7faa19f75800 20 add_watcher() i=7 2024-09-12T00:20:00.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.026+0000 7faa19f75800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:00.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.028+0000 7fa8cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:00.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.028+0000 7faa19f75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:00.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.028+0000 7faa19f75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:00.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.028+0000 7faa19f75800 5 note: GC not initialized 2024-09-12T00:20:00.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.028+0000 7fa8ccfe1640 20 reqs_thread_entry: start 2024-09-12T00:20:00.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.028+0000 7faa19f75800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:00.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.028+0000 7faa19f75800 20 Filter name: none 2024-09-12T00:20:00.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.029+0000 7fa8467fc640 20 reqs_thread_entry: start 2024-09-12T00:20:00.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.029+0000 7faa19f75800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.029+0000 7faa19f75800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:20:00.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.029+0000 7faa19f75800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.029+0000 7faa19f75800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:20:00.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.029+0000 7faa19f75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:00.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.029+0000 7faa19f75800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.030+0000 7faa19f75800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:20:00.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.030+0000 7faa19f75800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.030+0000 7faa19f75800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:20:00.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.030+0000 7faa19f75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:00.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.031+0000 7fa8cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:00.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.034+0000 7faa19f75800 20 remove_watcher() i=0 2024-09-12T00:20:00.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.034+0000 7faa19f75800 2 removed watcher, disabling cache 2024-09-12T00:20:00.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.035+0000 7faa19f75800 20 remove_watcher() i=1 2024-09-12T00:20:00.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.037+0000 7faa19f75800 20 remove_watcher() i=2 2024-09-12T00:20:00.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.038+0000 7faa19f75800 20 remove_watcher() i=3 2024-09-12T00:20:00.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.039+0000 7faa19f75800 20 remove_watcher() i=4 2024-09-12T00:20:00.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.040+0000 7faa19f75800 20 remove_watcher() i=5 2024-09-12T00:20:00.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.041+0000 7faa19f75800 20 remove_watcher() i=6 2024-09-12T00:20:00.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.042+0000 7faa19f75800 20 remove_watcher() i=7 2024-09-12T00:20:00.051 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:00.051 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:20:00.051 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-trim-reshard-log-entries id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:20:00.051 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:00.115 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T00:20:00.115 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:00.330 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:20:00.359 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:00.359 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:00.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.400+0000 7f4aeae98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.402+0000 7f4aeae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.402+0000 7f4aeae98800 20 realm 2024-09-12T00:20:00.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.402+0000 7f4aeae98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.402+0000 7f4aeae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.402+0000 7f4aeae98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:00.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.402+0000 7f4aeae98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.402+0000 7f4aeae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.402+0000 7f4aeae98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.403+0000 7f4aeae98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:00.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.403+0000 7f4aeae98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.404+0000 7f4aeae98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:00.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.404+0000 7f4aeae98800 20 searching for the correct realm 2024-09-12T00:20:00.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.407+0000 7f4ae3fff640 0 -- 172.21.15.67:0/3637314491 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f4ad407c930 msgr2=0x7f4ad4064410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:20:00.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.613+0000 7f4ae3fff640 0 -- 172.21.15.67:0/3637314491 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x558fb0db4f40 msgr2=0x558fb0db7390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:00.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.617+0000 7f4aeae98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:00.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.617+0000 7f4aeae98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:00.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.617+0000 7f4aeae98800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:00.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.617+0000 7f4aeae98800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:00.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.617+0000 7f4aeae98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:00.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.617+0000 7f4aeae98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:00.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.617+0000 7f4aeae98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.618+0000 7f4aeae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.618+0000 7f4aeae98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.618+0000 7f4aeae98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:00.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.618+0000 7f4aeae98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.618+0000 7f4aeae98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:00.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.618+0000 7f4aeae98800 20 zone default found 2024-09-12T00:20:00.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.618+0000 7f4aeae98800 4 Realm: () 2024-09-12T00:20:00.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.618+0000 7f4aeae98800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:00.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.618+0000 7f4aeae98800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:00.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.618+0000 7f4aeae98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:00.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.618+0000 7f4aeae98800 20 zonegroup default 2024-09-12T00:20:00.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.618+0000 7f4aeae98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.619+0000 7f4aeae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.619+0000 7f4aeae98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.619+0000 7f4aeae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.619+0000 7f4aeae98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.619+0000 7f4aeae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.619+0000 7f4aeae98800 20 started sync module instance, tier type = 2024-09-12T00:20:00.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.619+0000 7f4aeae98800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:00.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.628+0000 7f4aeae98800 20 add_watcher() i=0 2024-09-12T00:20:00.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.628+0000 7f4aeae98800 20 add_watcher() i=1 2024-09-12T00:20:00.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.628+0000 7f4aeae98800 20 add_watcher() i=2 2024-09-12T00:20:00.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.628+0000 7f4aeae98800 20 add_watcher() i=3 2024-09-12T00:20:00.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.628+0000 7f4aeae98800 20 add_watcher() i=4 2024-09-12T00:20:00.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.628+0000 7f4aeae98800 20 add_watcher() i=5 2024-09-12T00:20:00.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.628+0000 7f4aeae98800 20 add_watcher() i=6 2024-09-12T00:20:00.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.629+0000 7f4aeae98800 20 add_watcher() i=7 2024-09-12T00:20:00.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.629+0000 7f4aeae98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:00.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.630+0000 7f499efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:00.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.630+0000 7f4aeae98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:00.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.630+0000 7f4aeae98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:00.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.631+0000 7f4aeae98800 5 note: GC not initialized 2024-09-12T00:20:00.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.631+0000 7f499dfe3640 20 reqs_thread_entry: start 2024-09-12T00:20:00.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.631+0000 7f4aeae98800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:00.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.631+0000 7f4aeae98800 20 Filter name: none 2024-09-12T00:20:00.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.631+0000 7f490f7fe640 20 reqs_thread_entry: start 2024-09-12T00:20:00.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.631+0000 7f4aeae98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.632+0000 7f4aeae98800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:00.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.632+0000 7f4aeae98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.632+0000 7f4aeae98800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:20:00.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.632+0000 7f4aeae98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:00.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.632+0000 7f4aeae98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.632+0000 7f4aeae98800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:00.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.632+0000 7f4aeae98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.633+0000 7f4aeae98800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:20:00.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.633+0000 7f4aeae98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:00.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.634+0000 7f499efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:00.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.636+0000 7f4aeae98800 20 remove_watcher() i=0 2024-09-12T00:20:00.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.636+0000 7f4aeae98800 2 removed watcher, disabling cache 2024-09-12T00:20:00.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.637+0000 7f4aeae98800 20 remove_watcher() i=1 2024-09-12T00:20:00.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.638+0000 7f4aeae98800 20 remove_watcher() i=2 2024-09-12T00:20:00.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.639+0000 7f4aeae98800 20 remove_watcher() i=3 2024-09-12T00:20:00.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.640+0000 7f4aeae98800 20 remove_watcher() i=4 2024-09-12T00:20:00.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.641+0000 7f4aeae98800 20 remove_watcher() i=5 2024-09-12T00:20:00.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.642+0000 7f4aeae98800 20 remove_watcher() i=6 2024-09-12T00:20:00.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.643+0000 7f4aeae98800 20 remove_watcher() i=7 2024-09-12T00:20:00.653 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:00.653 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:20:00.653 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-block-writes id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:20:00.653 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:00.655 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T00:20:00.689 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:00.690 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:00.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.731+0000 7f20f752c800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.733+0000 7f20f752c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.733+0000 7f20f752c800 20 realm 2024-09-12T00:20:00.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.733+0000 7f20f752c800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.733+0000 7f20f752c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.733+0000 7f20f752c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:00.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.733+0000 7f20f752c800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.733+0000 7f20f752c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.733+0000 7f20f752c800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.734+0000 7f20f752c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:00.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.734+0000 7f20f752c800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.735+0000 7f20f752c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:00.733 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.735+0000 7f20f752c800 20 searching for the correct realm 2024-09-12T00:20:00.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.738+0000 7f20f2aac640 0 -- 172.21.15.67:0/1876538651 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f20e803d760 msgr2=0x7f20e80303c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:20:00.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.943+0000 7f20f2aac640 0 -- 172.21.15.67:0/1876538651 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55dea652ca60 msgr2=0x55dea652eec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:00.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:00.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:00.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:00.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:00.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:00.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:00.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:00.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:00.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 20 zone default found 2024-09-12T00:20:00.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 4 Realm: () 2024-09-12T00:20:00.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:00.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:00.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:00.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 20 zonegroup default 2024-09-12T00:20:00.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.948+0000 7f20f752c800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.949+0000 7f20f752c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.949+0000 7f20f752c800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.949+0000 7f20f752c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.949+0000 7f20f752c800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.949+0000 7f20f752c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:00.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.949+0000 7f20f752c800 20 started sync module instance, tier type = 2024-09-12T00:20:00.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.949+0000 7f20f752c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:00.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.958+0000 7f20f752c800 20 add_watcher() i=0 2024-09-12T00:20:00.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.958+0000 7f20f752c800 20 add_watcher() i=1 2024-09-12T00:20:00.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.958+0000 7f20f752c800 20 add_watcher() i=2 2024-09-12T00:20:00.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.958+0000 7f20f752c800 20 add_watcher() i=3 2024-09-12T00:20:00.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.958+0000 7f20f752c800 20 add_watcher() i=4 2024-09-12T00:20:00.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.958+0000 7f20f752c800 20 add_watcher() i=5 2024-09-12T00:20:00.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.958+0000 7f20f752c800 20 add_watcher() i=6 2024-09-12T00:20:00.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.959+0000 7f20f752c800 20 add_watcher() i=7 2024-09-12T00:20:00.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.959+0000 7f20f752c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:00.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.960+0000 7f1fa9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:00.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.960+0000 7f20f752c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:00.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.960+0000 7f20f752c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:00.959 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.961+0000 7f20f752c800 5 note: GC not initialized 2024-09-12T00:20:00.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.961+0000 7f1fa8fe1640 20 reqs_thread_entry: start 2024-09-12T00:20:00.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.961+0000 7f20f752c800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:00.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.961+0000 7f20f752c800 20 Filter name: none 2024-09-12T00:20:00.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.961+0000 7f1f227fc640 20 reqs_thread_entry: start 2024-09-12T00:20:00.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.961+0000 7f20f752c800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:20:00.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.961+0000 7f20f752c800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.961+0000 7f20f752c800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:00.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.962+0000 7f20f752c800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:20:00.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.962+0000 7f20f752c800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:20:00.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.962+0000 7f20f752c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 : miss 2024-09-12T00:20:00.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.962+0000 7f20f752c800 20 rados->read ofs=0 len=0 2024-09-12T00:20:00.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.962+0000 7f20f752c800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:20:00.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.962+0000 7f20f752c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 info.flags=0x17 2024-09-12T00:20:00.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.962+0000 7f20f752c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 to cache LRU end 2024-09-12T00:20:00.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.962+0000 7f20f752c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:00.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.962+0000 7f20f752c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:00.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.962+0000 7f20f752c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 2024-09-12T00:20:00.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.965+0000 7f20f752c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 info.flags=0x17 2024-09-12T00:20:00.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.965+0000 7f20f752c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 to cache LRU end 2024-09-12T00:20:00.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.965+0000 7f20f752c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:00.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.965+0000 7f20f752c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28, ofs0, ns] 2024-09-12T00:20:00.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.966+0000 7f1fd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562428 cookie 94414761606528 notifier 7020 bl.length()=915 2024-09-12T00:20:00.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.966+0000 7f1fd67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 info.flags=0x17 2024-09-12T00:20:00.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.966+0000 7f1fd67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 to cache LRU end 2024-09-12T00:20:00.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.966+0000 7f1fd67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:00.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.966+0000 7f20f752c800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): orig_sources= new_sources= 2024-09-12T00:20:00.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.966+0000 7f20f752c800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): potential sources added=[] removed=[] 2024-09-12T00:20:00.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.966+0000 7f20f752c800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): orig_dests= new_dests= 2024-09-12T00:20:00.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.966+0000 7f20f752c800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): potential dests added=[] removed=[] 2024-09-12T00:20:00.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.968+0000 7f20f752c800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28.1.0 2024-09-12T00:20:00.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.968+0000 7f20f752c800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28.1.0 2024-09-12T00:20:00.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.968+0000 7f20f752c800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28.1.1 2024-09-12T00:20:00.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.968+0000 7f20f752c800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28.1.1 2024-09-12T00:20:00.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.968+0000 7f20f752c800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28.0 2024-09-12T00:20:00.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.971+0000 7f20f752c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:00.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.971+0000 7f20f752c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 2024-09-12T00:20:00.970 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.972+0000 7f20f752c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 info.flags=0x17 2024-09-12T00:20:00.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.972+0000 7f20f752c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 to cache LRU end 2024-09-12T00:20:00.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.972+0000 7f20f752c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:00.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.972+0000 7f20f752c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28, ofs0, ns] 2024-09-12T00:20:00.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.972+0000 7f1fd67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562429 cookie 94414761606528 notifier 7020 bl.length()=915 2024-09-12T00:20:00.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.972+0000 7f1fd67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 info.flags=0x17 2024-09-12T00:20:00.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.972+0000 7f1fd67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 to cache LRU end 2024-09-12T00:20:00.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.972+0000 7f1fd67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:00.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.973+0000 7f20f752c800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): orig_sources= new_sources= 2024-09-12T00:20:00.971 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.973+0000 7f20f752c800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): potential sources added=[] removed=[] 2024-09-12T00:20:00.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.973+0000 7f20f752c800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): orig_dests= new_dests= 2024-09-12T00:20:00.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.973+0000 7f20f752c800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): potential dests added=[] removed=[] 2024-09-12T00:20:00.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.973+0000 7f20f752c800 -1 Injecting error=-5 at location=block_writes 2024-09-12T00:20:00.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.973+0000 7f20f752c800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:20:00.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.975+0000 7f20f752c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:00.973 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.975+0000 7f20f752c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 2024-09-12T00:20:00.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.976+0000 7f20f752c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 info.flags=0x17 2024-09-12T00:20:00.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.976+0000 7f20f752c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 to cache LRU end 2024-09-12T00:20:00.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.976+0000 7f20f752c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:00.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.976+0000 7f20f752c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28, ofs0, ns] 2024-09-12T00:20:00.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.977+0000 7f1fd6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562430 cookie 94414761606528 notifier 7020 bl.length()=883 2024-09-12T00:20:00.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.977+0000 7f1fd6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 info.flags=0x17 2024-09-12T00:20:00.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.977+0000 7f1fd6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 to cache LRU end 2024-09-12T00:20:00.975 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.977+0000 7f1fd6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:00.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.977+0000 7f20f752c800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): orig_sources= new_sources= 2024-09-12T00:20:00.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.977+0000 7f20f752c800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): potential sources added=[] removed=[] 2024-09-12T00:20:00.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.977+0000 7f20f752c800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): orig_dests= new_dests= 2024-09-12T00:20:00.976 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.977+0000 7f20f752c800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): potential dests added=[] removed=[] 2024-09-12T00:20:00.977 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.978+0000 7f20f752c800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T00:20:00.978 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.980+0000 7f1fa9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:00.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.982+0000 7f20f752c800 20 remove_watcher() i=0 2024-09-12T00:20:00.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.982+0000 7f20f752c800 2 removed watcher, disabling cache 2024-09-12T00:20:00.981 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.983+0000 7f20f752c800 20 remove_watcher() i=1 2024-09-12T00:20:00.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.984+0000 7f20f752c800 20 remove_watcher() i=2 2024-09-12T00:20:00.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.985+0000 7f20f752c800 20 remove_watcher() i=3 2024-09-12T00:20:00.985 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.986+0000 7f20f752c800 20 remove_watcher() i=4 2024-09-12T00:20:00.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.988+0000 7f20f752c800 20 remove_watcher() i=5 2024-09-12T00:20:00.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.989+0000 7f20f752c800 20 remove_watcher() i=6 2024-09-12T00:20:00.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:00.990+0000 7f20f752c800 20 remove_watcher() i=7 2024-09-12T00:20:01.000 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:20:01.030 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:01.030 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:01.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.070+0000 7ff9c0935800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.072+0000 7ff9c0935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:01.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.072+0000 7ff9c0935800 20 realm 2024-09-12T00:20:01.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.072+0000 7ff9c0935800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.072+0000 7ff9c0935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:01.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.072+0000 7ff9c0935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:01.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.072+0000 7ff9c0935800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.072+0000 7ff9c0935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:01.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.072+0000 7ff9c0935800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.073+0000 7ff9c0935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:01.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.073+0000 7ff9c0935800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.074+0000 7ff9c0935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:01.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.074+0000 7ff9c0935800 20 searching for the correct realm 2024-09-12T00:20:01.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.077+0000 7ff9bbee3640 0 -- 172.21.15.67:0/2920495960 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7ff9b0056bd0 msgr2=0x7ff9b0085980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:20:01.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.283+0000 7ff9bcee5640 0 -- 172.21.15.67:0/2920495960 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x556d8b1adcd0 msgr2=0x556d8b1b0170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:01.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.286+0000 7ff9c0935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:01.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.286+0000 7ff9c0935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:01.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.286+0000 7ff9c0935800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:01.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.286+0000 7ff9c0935800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:01.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.286+0000 7ff9c0935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:01.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.286+0000 7ff9c0935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:01.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.286+0000 7ff9c0935800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.287+0000 7ff9c0935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:01.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.287+0000 7ff9c0935800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.287+0000 7ff9c0935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:01.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.287+0000 7ff9c0935800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.287+0000 7ff9c0935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:01.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.287+0000 7ff9c0935800 20 zone default found 2024-09-12T00:20:01.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.287+0000 7ff9c0935800 4 Realm: () 2024-09-12T00:20:01.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.287+0000 7ff9c0935800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:01.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.287+0000 7ff9c0935800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:01.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.287+0000 7ff9c0935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:01.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.287+0000 7ff9c0935800 20 zonegroup default 2024-09-12T00:20:01.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.287+0000 7ff9c0935800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.288+0000 7ff9c0935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:01.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.288+0000 7ff9c0935800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.288+0000 7ff9c0935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:01.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.288+0000 7ff9c0935800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.288+0000 7ff9c0935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:01.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.288+0000 7ff9c0935800 20 started sync module instance, tier type = 2024-09-12T00:20:01.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.288+0000 7ff9c0935800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:01.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.296+0000 7ff9c0935800 20 add_watcher() i=0 2024-09-12T00:20:01.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.296+0000 7ff9c0935800 20 add_watcher() i=1 2024-09-12T00:20:01.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.296+0000 7ff9c0935800 20 add_watcher() i=2 2024-09-12T00:20:01.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.296+0000 7ff9c0935800 20 add_watcher() i=3 2024-09-12T00:20:01.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.296+0000 7ff9c0935800 20 add_watcher() i=4 2024-09-12T00:20:01.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.296+0000 7ff9c0935800 20 add_watcher() i=5 2024-09-12T00:20:01.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.296+0000 7ff9c0935800 20 add_watcher() i=6 2024-09-12T00:20:01.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.297+0000 7ff9c0935800 20 add_watcher() i=7 2024-09-12T00:20:01.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.297+0000 7ff9c0935800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:01.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.299+0000 7ff872fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:01.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.299+0000 7ff9c0935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:01.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.299+0000 7ff9c0935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:01.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.299+0000 7ff9c0935800 5 note: GC not initialized 2024-09-12T00:20:01.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.299+0000 7ff871fdb640 20 reqs_thread_entry: start 2024-09-12T00:20:01.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.300+0000 7ff9c0935800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:01.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.300+0000 7ff9c0935800 20 Filter name: none 2024-09-12T00:20:01.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.300+0000 7ff7e37fe640 20 reqs_thread_entry: start 2024-09-12T00:20:01.298 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.300+0000 7ff9c0935800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.300+0000 7ff9c0935800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:01.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.300+0000 7ff9c0935800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.301+0000 7ff9c0935800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:20:01.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.301+0000 7ff9c0935800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:01.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.301+0000 7ff9c0935800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.301+0000 7ff9c0935800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:01.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.301+0000 7ff9c0935800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.302+0000 7ff9c0935800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:20:01.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.302+0000 7ff9c0935800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:01.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.303+0000 7ff872fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:01.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.305+0000 7ff9c0935800 20 remove_watcher() i=0 2024-09-12T00:20:01.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.305+0000 7ff9c0935800 2 removed watcher, disabling cache 2024-09-12T00:20:01.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.306+0000 7ff9c0935800 20 remove_watcher() i=1 2024-09-12T00:20:01.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.307+0000 7ff9c0935800 20 remove_watcher() i=2 2024-09-12T00:20:01.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.308+0000 7ff9c0935800 20 remove_watcher() i=3 2024-09-12T00:20:01.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.309+0000 7ff9c0935800 20 remove_watcher() i=4 2024-09-12T00:20:01.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.310+0000 7ff9c0935800 20 remove_watcher() i=5 2024-09-12T00:20:01.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.311+0000 7ff9c0935800 20 remove_watcher() i=6 2024-09-12T00:20:01.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.312+0000 7ff9c0935800 20 remove_watcher() i=7 2024-09-12T00:20:01.321 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:01.321 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:20:01.321 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-block-writes id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:20:01.322 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:01.374 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:20:01.406 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:01.407 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:01.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.448+0000 7fbe93b28800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.651+0000 7fbe93b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:01.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.651+0000 7fbe93b28800 20 realm 2024-09-12T00:20:01.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.651+0000 7fbe93b28800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.651+0000 7fbe93b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:01.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.651+0000 7fbe93b28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:01.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.651+0000 7fbe93b28800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.651+0000 7fbe93b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:01.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.651+0000 7fbe93b28800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.652+0000 7fbe93b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:01.650 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.652+0000 7fbe93b28800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.653+0000 7fbe93b28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:01.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.653+0000 7fbe93b28800 20 searching for the correct realm 2024-09-12T00:20:01.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.655+0000 7fbe8f04a640 0 -- 172.21.15.67:0/601652150 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fbe8406f390 msgr2=0x7fbe84097240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:20:01.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.861+0000 7fbe9004c640 0 -- 172.21.15.67:0/601652150 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x560612d9fe90 msgr2=0x560612da2350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:01.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.865+0000 7fbe93b28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:01.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.865+0000 7fbe93b28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:01.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.865+0000 7fbe93b28800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:01.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.865+0000 7fbe93b28800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:01.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.865+0000 7fbe93b28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:01.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.865+0000 7fbe93b28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:01.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.865+0000 7fbe93b28800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.865+0000 7fbe93b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:01.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.865+0000 7fbe93b28800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.865+0000 7fbe93b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:01.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.865+0000 7fbe93b28800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.866+0000 7fbe93b28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:01.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.866+0000 7fbe93b28800 20 zone default found 2024-09-12T00:20:01.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.866+0000 7fbe93b28800 4 Realm: () 2024-09-12T00:20:01.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.866+0000 7fbe93b28800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:01.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.866+0000 7fbe93b28800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:01.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.866+0000 7fbe93b28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:01.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.866+0000 7fbe93b28800 20 zonegroup default 2024-09-12T00:20:01.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.866+0000 7fbe93b28800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.866+0000 7fbe93b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:01.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.866+0000 7fbe93b28800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.866+0000 7fbe93b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:01.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.866+0000 7fbe93b28800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.867+0000 7fbe93b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:01.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.867+0000 7fbe93b28800 20 started sync module instance, tier type = 2024-09-12T00:20:01.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.867+0000 7fbe93b28800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:01.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.875+0000 7fbe93b28800 20 add_watcher() i=0 2024-09-12T00:20:01.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.875+0000 7fbe93b28800 20 add_watcher() i=1 2024-09-12T00:20:01.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.875+0000 7fbe93b28800 20 add_watcher() i=2 2024-09-12T00:20:01.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.875+0000 7fbe93b28800 20 add_watcher() i=3 2024-09-12T00:20:01.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.875+0000 7fbe93b28800 20 add_watcher() i=4 2024-09-12T00:20:01.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.875+0000 7fbe93b28800 20 add_watcher() i=5 2024-09-12T00:20:01.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.875+0000 7fbe93b28800 20 add_watcher() i=6 2024-09-12T00:20:01.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.876+0000 7fbe93b28800 20 add_watcher() i=7 2024-09-12T00:20:01.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.876+0000 7fbe93b28800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:01.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.878+0000 7fbd45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:01.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.878+0000 7fbe93b28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:01.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.878+0000 7fbe93b28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:01.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.878+0000 7fbe93b28800 5 note: GC not initialized 2024-09-12T00:20:01.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.878+0000 7fbd44fe1640 20 reqs_thread_entry: start 2024-09-12T00:20:01.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.879+0000 7fbe93b28800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:01.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.879+0000 7fbe93b28800 20 Filter name: none 2024-09-12T00:20:01.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.879+0000 7fbcbe7fc640 20 reqs_thread_entry: start 2024-09-12T00:20:01.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.879+0000 7fbe93b28800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:20:01.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.879+0000 7fbe93b28800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.879+0000 7fbe93b28800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:01.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.879+0000 7fbe93b28800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:20:01.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.879+0000 7fbe93b28800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:20:01.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.879+0000 7fbe93b28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 : miss 2024-09-12T00:20:01.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.879+0000 7fbe93b28800 20 rados->read ofs=0 len=0 2024-09-12T00:20:01.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.880+0000 7fbe93b28800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:20:01.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.880+0000 7fbe93b28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 info.flags=0x17 2024-09-12T00:20:01.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.880+0000 7fbe93b28800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 to cache LRU end 2024-09-12T00:20:01.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.880+0000 7fbe93b28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:01.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.880+0000 7fbe93b28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:01.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.880+0000 7fbe93b28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 2024-09-12T00:20:01.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.884+0000 7fbe93b28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 info.flags=0x17 2024-09-12T00:20:01.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.884+0000 7fbe93b28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 to cache LRU end 2024-09-12T00:20:01.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.884+0000 7fbe93b28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:01.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.884+0000 7fbe93b28800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28, ofs0, ns] 2024-09-12T00:20:01.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.884+0000 7fbd6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562431 cookie 94584086132176 notifier 7053 bl.length()=915 2024-09-12T00:20:01.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.884+0000 7fbd6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 info.flags=0x17 2024-09-12T00:20:01.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.884+0000 7fbd6effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 to cache LRU end 2024-09-12T00:20:01.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.884+0000 7fbd6effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:01.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.884+0000 7fbe93b28800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): orig_sources= new_sources= 2024-09-12T00:20:01.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.884+0000 7fbe93b28800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): potential sources added=[] removed=[] 2024-09-12T00:20:01.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.884+0000 7fbe93b28800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): orig_dests= new_dests= 2024-09-12T00:20:01.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.884+0000 7fbe93b28800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): potential dests added=[] removed=[] 2024-09-12T00:20:01.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.887+0000 7fbe93b28800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28.1.0 2024-09-12T00:20:01.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.887+0000 7fbe93b28800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28.1.0 2024-09-12T00:20:01.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.887+0000 7fbe93b28800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28.1.1 2024-09-12T00:20:01.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.887+0000 7fbe93b28800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28.1.1 2024-09-12T00:20:01.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.887+0000 7fbe93b28800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28.0 2024-09-12T00:20:01.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.889+0000 7fbe93b28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:01.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.889+0000 7fbe93b28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 2024-09-12T00:20:01.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.890+0000 7fbe93b28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 info.flags=0x17 2024-09-12T00:20:01.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.890+0000 7fbe93b28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 to cache LRU end 2024-09-12T00:20:01.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.890+0000 7fbe93b28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:01.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.890+0000 7fbe93b28800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28, ofs0, ns] 2024-09-12T00:20:01.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.890+0000 7fbd6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562432 cookie 94584086132176 notifier 7053 bl.length()=915 2024-09-12T00:20:01.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.890+0000 7fbd6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 info.flags=0x17 2024-09-12T00:20:01.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.890+0000 7fbd6effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 to cache LRU end 2024-09-12T00:20:01.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.890+0000 7fbd6effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:01.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.891+0000 7fbe93b28800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): orig_sources= new_sources= 2024-09-12T00:20:01.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.891+0000 7fbe93b28800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): potential sources added=[] removed=[] 2024-09-12T00:20:01.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.891+0000 7fbe93b28800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): orig_dests= new_dests= 2024-09-12T00:20:01.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.891+0000 7fbe93b28800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): potential dests added=[] removed=[] 2024-09-12T00:20:01.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.892+0000 7fbe93b28800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28.0 2024-09-12T00:20:01.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.892+0000 7fbe93b28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:01.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.892+0000 7fbe93b28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 2024-09-12T00:20:01.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.894+0000 7fbe93b28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 info.flags=0x17 2024-09-12T00:20:01.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.894+0000 7fbe93b28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 to cache LRU end 2024-09-12T00:20:01.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.894+0000 7fbe93b28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:01.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.894+0000 7fbe93b28800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28, ofs0, ns] 2024-09-12T00:20:01.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.894+0000 7fbd6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562433 cookie 94584086132176 notifier 7053 bl.length()=883 2024-09-12T00:20:01.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.894+0000 7fbd6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 info.flags=0x17 2024-09-12T00:20:01.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.894+0000 7fbd6effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 to cache LRU end 2024-09-12T00:20:01.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.894+0000 7fbd6effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:01.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.894+0000 7fbe93b28800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): orig_sources= new_sources= 2024-09-12T00:20:01.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.894+0000 7fbe93b28800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): potential sources added=[] removed=[] 2024-09-12T00:20:01.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.894+0000 7fbe93b28800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): orig_dests= new_dests= 2024-09-12T00:20:01.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.894+0000 7fbe93b28800 20 handle_bi_update(): bucket=:error-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28]): potential dests added=[] removed=[] 2024-09-12T00:20:01.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.896+0000 7fbe93b28800 1 execute INFO: reshard of bucket "error-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:20:01.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.897+0000 7fbd45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:01.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.899+0000 7fbe93b28800 20 remove_watcher() i=0 2024-09-12T00:20:01.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.899+0000 7fbe93b28800 2 removed watcher, disabling cache 2024-09-12T00:20:01.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.900+0000 7fbe93b28800 20 remove_watcher() i=1 2024-09-12T00:20:01.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.901+0000 7fbe93b28800 20 remove_watcher() i=2 2024-09-12T00:20:01.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.902+0000 7fbe93b28800 20 remove_watcher() i=3 2024-09-12T00:20:01.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.903+0000 7fbe93b28800 20 remove_watcher() i=4 2024-09-12T00:20:01.902 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.904+0000 7fbe93b28800 20 remove_watcher() i=5 2024-09-12T00:20:01.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.905+0000 7fbe93b28800 20 remove_watcher() i=6 2024-09-12T00:20:01.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:01.906+0000 7fbe93b28800 20 remove_watcher() i=7 2024-09-12T00:20:01.917 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:20:01.948 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:01.948 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:02.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.186+0000 7f83eae6f640 0 --2- 172.21.15.67:0/1280123429 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x558d71a67cc0 0x558d71a376b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:20:02.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.190+0000 7f83ef128800 20 rados->read ofs=0 len=0 2024-09-12T00:20:02.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.192+0000 7f83ef128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:02.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.192+0000 7f83ef128800 20 realm 2024-09-12T00:20:02.190 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.192+0000 7f83ef128800 20 rados->read ofs=0 len=0 2024-09-12T00:20:02.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.192+0000 7f83ef128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:02.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.192+0000 7f83ef128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:02.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.192+0000 7f83ef128800 20 rados->read ofs=0 len=0 2024-09-12T00:20:02.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.192+0000 7f83ef128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:02.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.192+0000 7f83ef128800 20 rados->read ofs=0 len=0 2024-09-12T00:20:02.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.193+0000 7f83ef128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:02.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.193+0000 7f83ef128800 20 rados->read ofs=0 len=0 2024-09-12T00:20:02.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.194+0000 7f83ef128800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:02.192 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.194+0000 7f83ef128800 20 searching for the correct realm 2024-09-12T00:20:02.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.195+0000 7f83eae6f640 0 -- 172.21.15.67:0/565540728 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f83dc086060 msgr2=0x7f83dc0ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:02.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.400+0000 7f83eae6f640 0 -- 172.21.15.67:0/565540728 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f83e4037040 msgr2=0x7f83e4037420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:02.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.608+0000 7f83ef128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:02.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.608+0000 7f83ef128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:02.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.608+0000 7f83ef128800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:02.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.608+0000 7f83ef128800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:02.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.608+0000 7f83ef128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:02.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.608+0000 7f83ef128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:02.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.608+0000 7f83ef128800 20 rados->read ofs=0 len=0 2024-09-12T00:20:02.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.608+0000 7f83ef128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:02.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.608+0000 7f83ef128800 20 rados->read ofs=0 len=0 2024-09-12T00:20:02.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.608+0000 7f83ef128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:02.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.608+0000 7f83ef128800 20 rados->read ofs=0 len=0 2024-09-12T00:20:02.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.609+0000 7f83ef128800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:02.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.609+0000 7f83ef128800 20 zone default found 2024-09-12T00:20:02.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.609+0000 7f83ef128800 4 Realm: () 2024-09-12T00:20:02.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.609+0000 7f83ef128800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:02.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.609+0000 7f83ef128800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:02.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.609+0000 7f83ef128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:02.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.609+0000 7f83ef128800 20 zonegroup default 2024-09-12T00:20:02.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.609+0000 7f83ef128800 20 rados->read ofs=0 len=0 2024-09-12T00:20:02.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.609+0000 7f83ef128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:02.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.609+0000 7f83ef128800 20 rados->read ofs=0 len=0 2024-09-12T00:20:02.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.609+0000 7f83ef128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:02.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.609+0000 7f83ef128800 20 rados->read ofs=0 len=0 2024-09-12T00:20:02.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.610+0000 7f83ef128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:02.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.610+0000 7f83ef128800 20 started sync module instance, tier type = 2024-09-12T00:20:02.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.610+0000 7f83ef128800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:02.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.620+0000 7f83ef128800 20 add_watcher() i=0 2024-09-12T00:20:02.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.620+0000 7f83ef128800 20 add_watcher() i=1 2024-09-12T00:20:02.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.620+0000 7f83ef128800 20 add_watcher() i=2 2024-09-12T00:20:02.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.620+0000 7f83ef128800 20 add_watcher() i=3 2024-09-12T00:20:02.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.620+0000 7f83ef128800 20 add_watcher() i=4 2024-09-12T00:20:02.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.620+0000 7f83ef128800 20 add_watcher() i=5 2024-09-12T00:20:02.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.620+0000 7f83ef128800 20 add_watcher() i=6 2024-09-12T00:20:02.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.621+0000 7f83ef128800 20 add_watcher() i=7 2024-09-12T00:20:02.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.621+0000 7f83ef128800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:02.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.623+0000 7f82a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:02.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.624+0000 7f83ef128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:02.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.624+0000 7f83ef128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:02.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.624+0000 7f83ef128800 5 note: GC not initialized 2024-09-12T00:20:02.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.624+0000 7f821bfff640 20 reqs_thread_entry: start 2024-09-12T00:20:02.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.624+0000 7f83ef128800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:02.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.624+0000 7f83ef128800 20 Filter name: none 2024-09-12T00:20:02.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.624+0000 7f8219ffb640 20 reqs_thread_entry: start 2024-09-12T00:20:02.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.624+0000 7f83ef128800 20 rados->read ofs=0 len=0 2024-09-12T00:20:02.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.624+0000 7f83ef128800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:02.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.624+0000 7f83ef128800 20 rados->read ofs=0 len=0 2024-09-12T00:20:02.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.625+0000 7f83ef128800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:20:02.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.625+0000 7f83ef128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:02.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.625+0000 7f83ef128800 20 rados->read ofs=0 len=0 2024-09-12T00:20:02.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.626+0000 7f83ef128800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:02.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.626+0000 7f83ef128800 20 rados->read ofs=0 len=0 2024-09-12T00:20:02.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.626+0000 7f83ef128800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:20:02.625 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.626+0000 7f83ef128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:02.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.628+0000 7f82a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:02.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.630+0000 7f83ef128800 20 remove_watcher() i=0 2024-09-12T00:20:02.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.630+0000 7f83ef128800 2 removed watcher, disabling cache 2024-09-12T00:20:02.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.631+0000 7f83ef128800 20 remove_watcher() i=1 2024-09-12T00:20:02.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.632+0000 7f83ef128800 20 remove_watcher() i=2 2024-09-12T00:20:02.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.634+0000 7f83ef128800 20 remove_watcher() i=3 2024-09-12T00:20:02.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.635+0000 7f83ef128800 20 remove_watcher() i=4 2024-09-12T00:20:02.634 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.636+0000 7f83ef128800 20 remove_watcher() i=5 2024-09-12T00:20:02.635 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.637+0000 7f83ef128800 20 remove_watcher() i=6 2024-09-12T00:20:02.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:02.638+0000 7f83ef128800 20 remove_watcher() i=7 2024-09-12T00:20:02.647 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:02.647 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:20:02.647 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-block-writes id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:20:02.647 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:02.711 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T00:20:02.712 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:02.931 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:20:02.959 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:02.960 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:03.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.002+0000 7f31eba15800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.003+0000 7f31eba15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.003+0000 7f31eba15800 20 realm 2024-09-12T00:20:03.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.003+0000 7f31eba15800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.003+0000 7f31eba15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.003+0000 7f31eba15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:03.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.003+0000 7f31eba15800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.004+0000 7f31eba15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.004+0000 7f31eba15800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.004+0000 7f31eba15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:03.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.004+0000 7f31eba15800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.005+0000 7f31eba15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:03.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.005+0000 7f31eba15800 20 searching for the correct realm 2024-09-12T00:20:03.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.007+0000 7f31e7192640 0 -- 172.21.15.67:0/857946540 >> [v2:172.21.15.67:6800/2522402523,v1:172.21.15.67:6801/2522402523] conn(0x5631af3eced0 msgr2=0x5631af3ef2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:03.008 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.010+0000 7f31e7993640 0 -- 172.21.15.67:0/857946540 >> [v2:172.21.15.170:6824/783534599,v1:172.21.15.170:6825/783534599] conn(0x5631af3eced0 msgr2=0x7f31d8046a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:20:03.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.216+0000 7f31eba15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:03.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.216+0000 7f31eba15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:03.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.216+0000 7f31eba15800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:03.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.216+0000 7f31eba15800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:03.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.216+0000 7f31eba15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:03.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.216+0000 7f31eba15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:03.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.216+0000 7f31eba15800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.217+0000 7f31eba15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.217+0000 7f31eba15800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.217+0000 7f31eba15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:03.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.217+0000 7f31eba15800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.217+0000 7f31eba15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:03.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.217+0000 7f31eba15800 20 zone default found 2024-09-12T00:20:03.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.217+0000 7f31eba15800 4 Realm: () 2024-09-12T00:20:03.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.217+0000 7f31eba15800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:03.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.217+0000 7f31eba15800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:03.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.217+0000 7f31eba15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:03.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.217+0000 7f31eba15800 20 zonegroup default 2024-09-12T00:20:03.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.217+0000 7f31eba15800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.217+0000 7f31eba15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.217+0000 7f31eba15800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.218+0000 7f31eba15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.218+0000 7f31eba15800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.218+0000 7f31eba15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.218+0000 7f31eba15800 20 started sync module instance, tier type = 2024-09-12T00:20:03.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.218+0000 7f31eba15800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:03.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.227+0000 7f31eba15800 20 add_watcher() i=0 2024-09-12T00:20:03.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.227+0000 7f31eba15800 20 add_watcher() i=1 2024-09-12T00:20:03.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.227+0000 7f31eba15800 20 add_watcher() i=2 2024-09-12T00:20:03.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.227+0000 7f31eba15800 20 add_watcher() i=3 2024-09-12T00:20:03.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.227+0000 7f31eba15800 20 add_watcher() i=4 2024-09-12T00:20:03.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.227+0000 7f31eba15800 20 add_watcher() i=5 2024-09-12T00:20:03.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.227+0000 7f31eba15800 20 add_watcher() i=6 2024-09-12T00:20:03.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.228+0000 7f31eba15800 20 add_watcher() i=7 2024-09-12T00:20:03.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.228+0000 7f31eba15800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:03.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.229+0000 7f309dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:03.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.230+0000 7f31eba15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:03.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.230+0000 7f31eba15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:03.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.230+0000 7f31eba15800 5 note: GC not initialized 2024-09-12T00:20:03.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.230+0000 7f309cfe1640 20 reqs_thread_entry: start 2024-09-12T00:20:03.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.230+0000 7f31eba15800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:03.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.230+0000 7f31eba15800 20 Filter name: none 2024-09-12T00:20:03.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.230+0000 7f30167fc640 20 reqs_thread_entry: start 2024-09-12T00:20:03.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.230+0000 7f31eba15800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.231+0000 7f31eba15800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:03.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.231+0000 7f31eba15800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.232+0000 7f31eba15800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:20:03.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.232+0000 7f31eba15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:03.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.232+0000 7f31eba15800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.232+0000 7f31eba15800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:03.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.232+0000 7f31eba15800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.232+0000 7f31eba15800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:20:03.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.232+0000 7f31eba15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:03.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.234+0000 7f309dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:03.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.236+0000 7f31eba15800 20 remove_watcher() i=0 2024-09-12T00:20:03.234 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.236+0000 7f31eba15800 2 removed watcher, disabling cache 2024-09-12T00:20:03.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.237+0000 7f31eba15800 20 remove_watcher() i=1 2024-09-12T00:20:03.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.237+0000 7f31eba15800 20 remove_watcher() i=2 2024-09-12T00:20:03.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.238+0000 7f31eba15800 20 remove_watcher() i=3 2024-09-12T00:20:03.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.239+0000 7f31eba15800 20 remove_watcher() i=4 2024-09-12T00:20:03.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.240+0000 7f31eba15800 20 remove_watcher() i=5 2024-09-12T00:20:03.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.241+0000 7f31eba15800 20 remove_watcher() i=6 2024-09-12T00:20:03.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.242+0000 7f31eba15800 20 remove_watcher() i=7 2024-09-12T00:20:03.252 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.252 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:20:03.252 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-block-writes id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:20:03.252 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.253 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T00:20:03.289 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:03.289 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:03.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.328+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.330+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.330+0000 7f75af630800 20 realm 2024-09-12T00:20:03.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.330+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.330+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.330+0000 7f75af630800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:03.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.330+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.331+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.331+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.331+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:03.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.331+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.332+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:03.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.332+0000 7f75af630800 20 searching for the correct realm 2024-09-12T00:20:03.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.335+0000 7f75aa1cb640 0 -- 172.21.15.67:0/826125496 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f75a00647b0 msgr2=0x7f75a0093240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:20:03.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.540+0000 7f75ab1cd640 0 -- 172.21.15.67:0/826125496 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55fa052d34b0 msgr2=0x55fa052d58a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:03.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:03.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:03.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:03.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:03.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:03.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:03.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.544+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.544+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.544+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.544+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:03.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.544+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.545+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:03.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.545+0000 7f75af630800 20 zone default found 2024-09-12T00:20:03.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.545+0000 7f75af630800 4 Realm: () 2024-09-12T00:20:03.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.545+0000 7f75af630800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:03.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.545+0000 7f75af630800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:03.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.545+0000 7f75af630800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:03.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.545+0000 7f75af630800 20 zonegroup default 2024-09-12T00:20:03.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.545+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.545+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.545+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.545+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.545+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.546+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.546+0000 7f75af630800 20 started sync module instance, tier type = 2024-09-12T00:20:03.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.546+0000 7f75af630800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:03.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=0 2024-09-12T00:20:03.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=1 2024-09-12T00:20:03.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=2 2024-09-12T00:20:03.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=3 2024-09-12T00:20:03.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=4 2024-09-12T00:20:03.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=5 2024-09-12T00:20:03.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=6 2024-09-12T00:20:03.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.555+0000 7f75af630800 20 add_watcher() i=7 2024-09-12T00:20:03.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.555+0000 7f75af630800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:03.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.557+0000 7f74617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:03.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.557+0000 7f75af630800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:03.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.557+0000 7f75af630800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:03.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.558+0000 7f75af630800 5 note: GC not initialized 2024-09-12T00:20:03.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.558+0000 7f73dbfff640 20 reqs_thread_entry: start 2024-09-12T00:20:03.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.558+0000 7f75af630800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:03.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.558+0000 7f75af630800 20 Filter name: none 2024-09-12T00:20:03.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.558+0000 7f73d9ffb640 20 reqs_thread_entry: start 2024-09-12T00:20:03.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.558+0000 7f75af630800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:20:03.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.558+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.559+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:03.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.559+0000 7f75af630800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:20:03.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.559+0000 7f75af630800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:20:03.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.559+0000 7f75af630800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 : miss 2024-09-12T00:20:03.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.559+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.559+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:20:03.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.559+0000 7f75af630800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:03.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.559+0000 7f75af630800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:03.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.559+0000 7f75af630800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:03.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.559+0000 7f75af630800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:03.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.559+0000 7f75af630800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 2024-09-12T00:20:03.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.563+0000 7f75af630800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:03.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.563+0000 7f75af630800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:03.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.563+0000 7f75af630800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:03.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.563+0000 7f75af630800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29, ofs0, ns] 2024-09-12T00:20:03.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.563+0000 7f748e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562486 cookie 94532317094496 notifier 6671 bl.length()=915 2024-09-12T00:20:03.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.563+0000 7f748e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:03.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.563+0000 7f748e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:03.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.563+0000 7f748e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:03.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.564+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_sources= new_sources= 2024-09-12T00:20:03.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.564+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential sources added=[] removed=[] 2024-09-12T00:20:03.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.564+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_dests= new_dests= 2024-09-12T00:20:03.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.564+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential dests added=[] removed=[] 2024-09-12T00:20:03.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.566+0000 7f75af630800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.1.0 2024-09-12T00:20:03.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.566+0000 7f75af630800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.1.0 2024-09-12T00:20:03.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.566+0000 7f75af630800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.1.1 2024-09-12T00:20:03.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.566+0000 7f75af630800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.1.1 2024-09-12T00:20:03.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.566+0000 7f75af630800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.0 2024-09-12T00:20:03.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.568+0000 7f75af630800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:03.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.568+0000 7f75af630800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 2024-09-12T00:20:03.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.569+0000 7f75af630800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:03.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.569+0000 7f75af630800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:03.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.569+0000 7f75af630800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:03.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.569+0000 7f75af630800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29, ofs0, ns] 2024-09-12T00:20:03.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.570+0000 7f748e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562487 cookie 94532317094496 notifier 6671 bl.length()=915 2024-09-12T00:20:03.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.570+0000 7f748e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:03.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.570+0000 7f748e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:03.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.570+0000 7f748e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:03.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.570+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_sources= new_sources= 2024-09-12T00:20:03.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.570+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential sources added=[] removed=[] 2024-09-12T00:20:03.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.570+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_dests= new_dests= 2024-09-12T00:20:03.570 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f75af630800 time 2024-09-12T00:20:03.572142+0000 2024-09-12T00:20:03.570 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:20:03.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.570+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential dests added=[] removed=[] 2024-09-12T00:20:03.571 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:03.571 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f75b038c71a] 2024-09-12T00:20:03.571 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75b038c8d8] 2024-09-12T00:20:03.571 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa042fc641] 2024-09-12T00:20:03.571 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55fa0430b582] 2024-09-12T00:20:03.571 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fa0430c3e4] 2024-09-12T00:20:03.571 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:20:03.571 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f75af029590] 2024-09-12T00:20:03.571 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:20:03.571 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:20:03.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.571+0000 7f75af630800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f75af630800 time 2024-09-12T00:20:03.572142+0000 2024-09-12T00:20:03.571 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:20:03.571 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.572 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:03.572 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f75b038c71a] 2024-09-12T00:20:03.572 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75b038c8d8] 2024-09-12T00:20:03.572 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa042fc641] 2024-09-12T00:20:03.572 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55fa0430b582] 2024-09-12T00:20:03.572 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fa0430c3e4] 2024-09-12T00:20:03.572 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:20:03.572 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f75af029590] 2024-09-12T00:20:03.572 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:20:03.572 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:20:03.572 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.572 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:20:03.572 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f75af630800 thread_name:radosgw-admin 2024-09-12T00:20:03.591 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:03.591 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f75af03e6f0] 2024-09-12T00:20:03.591 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f75af08b99c] 2024-09-12T00:20:03.591 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:20:03.591 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:20:03.591 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f75b038c774] 2024-09-12T00:20:03.591 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75b038c8d8] 2024-09-12T00:20:03.591 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa042fc641] 2024-09-12T00:20:03.591 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55fa0430b582] 2024-09-12T00:20:03.592 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fa0430c3e4] 2024-09-12T00:20:03.592 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:20:03.592 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f75af029590] 2024-09-12T00:20:03.592 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:20:03.592 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:20:03.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.572+0000 7f75af630800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:20:03.592 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f75af630800 thread_name:radosgw-admin 2024-09-12T00:20:03.592 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.592 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:03.592 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f75af03e6f0] 2024-09-12T00:20:03.592 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f75af08b99c] 2024-09-12T00:20:03.593 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:20:03.593 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:20:03.593 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f75b038c774] 2024-09-12T00:20:03.593 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75b038c8d8] 2024-09-12T00:20:03.593 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa042fc641] 2024-09-12T00:20:03.593 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55fa0430b582] 2024-09-12T00:20:03.593 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fa0430c3e4] 2024-09-12T00:20:03.593 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:20:03.593 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f75af029590] 2024-09-12T00:20:03.593 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:20:03.593 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:20:03.593 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:20:03.593 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.594 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:20:03.594 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:20:03.312+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.594 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:20:03.312+0000 7f75af630800 1 librados: starting msgr at 2024-09-12T00:20:03.594 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:20:03.312+0000 7f75af630800 1 librados: starting objecter 2024-09-12T00:20:03.594 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:20:03.312+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command objecter_requests hook 0x55fa051ef390 2024-09-12T00:20:03.594 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:20:03.312+0000 7f75af630800 1 librados: setting wanted keys 2024-09-12T00:20:03.594 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:20:03.312+0000 7f75af630800 1 librados: calling monclient init 2024-09-12T00:20:03.594 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:20:03.312+0000 7f75af630800 10 monclient: init 2024-09-12T00:20:03.594 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding auth protocol: cephx 2024-09-12T00:20:03.594 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding auth protocol: cephx 2024-09-12T00:20:03.594 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding auth protocol: cephx 2024-09-12T00:20:03.594 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: secure 2024-09-12T00:20:03.594 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: crc 2024-09-12T00:20:03.595 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: secure 2024-09-12T00:20:03.595 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: crc 2024-09-12T00:20:03.595 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: secure 2024-09-12T00:20:03.595 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: crc 2024-09-12T00:20:03.595 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: crc 2024-09-12T00:20:03.595 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: secure 2024-09-12T00:20:03.595 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: crc 2024-09-12T00:20:03.595 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: secure 2024-09-12T00:20:03.595 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: crc 2024-09-12T00:20:03.595 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: secure 2024-09-12T00:20:03.595 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:20:03.312+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.595 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:20:03.313+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.595 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:20:03.313+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command rotate-key hook 0x55fa051e89f8 2024-09-12T00:20:03.595 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:03.596 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:20:03.596 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): picked mon.noname-a con 0x55fa050a09d0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:03.596 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): picked mon.noname-c con 0x55fa0512be60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:03.596 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): picked mon.noname-b con 0x55fa0512ec10 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:03.596 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.596 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.596 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.596 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:03.596 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): authenticate will time out at 1880.570226s 2024-09-12T00:20:03.596 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request con 0x55fa0512be60 auth_method 0 2024-09-12T00:20:03.596 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.596 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.596 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.596 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:20:03.313+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request con 0x55fa050a09d0 auth_method 0 2024-09-12T00:20:03.597 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:20:03.313+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.597 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:20:03.313+0000 7f75aa9cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.597 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:20:03.313+0000 7f75aa9cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.597 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.597 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.597 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.597 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:20:03.313+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.597 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:20:03.313+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.597 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:20:03.313+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.597 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:20:03.313+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request con 0x55fa0512ec10 auth_method 0 2024-09-12T00:20:03.597 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:20:03.313+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.597 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:20:03.313+0000 7f75ab1cd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.597 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:20:03.313+0000 7f75ab1cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.598 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_done global_id 6662 payload 824 2024-09-12T00:20:03.598 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient: _finish_hunting 0 2024-09-12T00:20:03.598 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 1 monclient: found mon.noname-c 2024-09-12T00:20:03.598 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.598 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.598 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:20:03.598 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: dump: 2024-09-12T00:20:03.598 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.598 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.598 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.598 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.598 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.598 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.599 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.599 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.599 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.599 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.599 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: _finish_auth 0 2024-09-12T00:20:03.599 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: _check_auth_tickets 2024-09-12T00:20:03.599 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:03.599 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.599 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:20:03.599 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: dump: 2024-09-12T00:20:03.599 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.599 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.599 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.600 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.600 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.600 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.600 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.600 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.600 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.600 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.600 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:20:03.313+0000 7f75af630800 5 monclient: authenticate success, global_id 6662 2024-09-12T00:20:03.600 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient: _renew_subs 2024-09-12T00:20:03.600 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.600 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:20:03.313+0000 7f7498e09640 4 set_mon_vals no callback set 2024-09-12T00:20:03.600 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient: _renew_subs 2024-09-12T00:20:03.601 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.601 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:20:03.313+0000 7f75af630800 1 librados: init done 2024-09-12T00:20:03.601 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:20:03.316+0000 7f7497606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:20:03.601 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:20:03.316+0000 7f7497606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:03.601 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:20:03.316+0000 7f7497606640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:03.601 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:20:03.316+0000 7f75aa9cc640 10 monclient: get_auth_request con 0x7f74900764a0 auth_method 0 2024-09-12T00:20:03.601 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:20:03.316+0000 7f75ab1cd640 10 monclient: get_auth_request con 0x55fa05212380 auth_method 0 2024-09-12T00:20:03.601 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:20:03.317+0000 7f75aa9cc640 10 monclient: get_auth_request con 0x55fa05235390 auth_method 0 2024-09-12T00:20:03.601 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:20:03.318+0000 7f75aa1cb640 10 monclient: get_auth_request con 0x55fa05239580 auth_method 0 2024-09-12T00:20:03.601 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:20:03.319+0000 7f75af630800 10 monclient: build_initial_monmap 2024-09-12T00:20:03.601 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:20:03.319+0000 7f75af630800 1 build_initial for_mkfs: 0 2024-09-12T00:20:03.602 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:20:03.319+0000 7f75af630800 10 monclient: monmap: 2024-09-12T00:20:03.602 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:20:03.602 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:20:03.602 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:20:03.602 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:20:03.602 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:20:03.602 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.602 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:20:03.602 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:20:03.602 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:20:03.602 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.602 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding auth protocol: cephx 2024-09-12T00:20:03.602 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding auth protocol: cephx 2024-09-12T00:20:03.602 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding auth protocol: cephx 2024-09-12T00:20:03.603 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: secure 2024-09-12T00:20:03.603 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: crc 2024-09-12T00:20:03.603 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: secure 2024-09-12T00:20:03.603 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: crc 2024-09-12T00:20:03.603 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: secure 2024-09-12T00:20:03.603 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: crc 2024-09-12T00:20:03.603 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: crc 2024-09-12T00:20:03.603 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: secure 2024-09-12T00:20:03.603 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: crc 2024-09-12T00:20:03.603 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: secure 2024-09-12T00:20:03.603 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: crc 2024-09-12T00:20:03.603 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: secure 2024-09-12T00:20:03.603 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:20:03.319+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.604 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:20:03.319+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command objecter_requests cmddesc objecter_requests hook 0x55fa05241820 EEXIST 2024-09-12T00:20:03.604 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:20:03.319+0000 7f75af630800 10 monclient: init 2024-09-12T00:20:03.604 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding auth protocol: cephx 2024-09-12T00:20:03.604 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding auth protocol: cephx 2024-09-12T00:20:03.604 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding auth protocol: cephx 2024-09-12T00:20:03.604 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: secure 2024-09-12T00:20:03.604 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: crc 2024-09-12T00:20:03.604 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: secure 2024-09-12T00:20:03.604 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: crc 2024-09-12T00:20:03.604 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: secure 2024-09-12T00:20:03.604 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: crc 2024-09-12T00:20:03.604 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: crc 2024-09-12T00:20:03.604 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: secure 2024-09-12T00:20:03.605 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: crc 2024-09-12T00:20:03.605 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: secure 2024-09-12T00:20:03.605 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: crc 2024-09-12T00:20:03.605 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: secure 2024-09-12T00:20:03.605 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:20:03.320+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.605 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:20:03.320+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.605 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:20:03.320+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command rotate-key cmddesc rotate-key hook 0x55fa0523cb70 EEXIST 2024-09-12T00:20:03.605 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:03.605 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:20:03.605 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): picked mon.noname-b con 0x55fa05265b40 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:03.605 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): picked mon.noname-a con 0x55fa05265f20 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:03.605 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): picked mon.noname-c con 0x55fa05264850 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:03.605 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.606 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.606 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.606 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:03.606 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): authenticate will time out at 1880.577512s 2024-09-12T00:20:03.606 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request con 0x55fa05265f20 auth_method 0 2024-09-12T00:20:03.606 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.606 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.606 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.606 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:20:03.320+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request con 0x55fa05264850 auth_method 0 2024-09-12T00:20:03.606 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:20:03.320+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.606 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:20:03.320+0000 7f75ab1cd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.606 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:20:03.320+0000 7f75ab1cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.606 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:20:03.320+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request con 0x55fa05265b40 auth_method 0 2024-09-12T00:20:03.606 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:20:03.320+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.607 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:20:03.320+0000 7f75aa9cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.607 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:20:03.320+0000 7f75aa9cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.607 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.607 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.607 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.607 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:20:03.320+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.607 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:20:03.320+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.607 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:20:03.320+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.607 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:20:03.320+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.607 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:20:03.320+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.607 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:20:03.320+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.607 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_done global_id 7104 payload 824 2024-09-12T00:20:03.607 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient: _finish_hunting 0 2024-09-12T00:20:03.608 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 1 monclient: found mon.noname-a 2024-09-12T00:20:03.608 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:20:03.608 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.608 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:20:03.608 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: dump: 2024-09-12T00:20:03.608 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.608 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.608 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.608 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.608 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.608 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.608 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.609 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.609 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.609 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.609 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: _finish_auth 0 2024-09-12T00:20:03.609 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: _check_auth_tickets 2024-09-12T00:20:03.609 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:03.609 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.609 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:20:03.609 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: dump: 2024-09-12T00:20:03.609 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.609 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.609 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.609 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.609 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.610 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.610 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.610 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.610 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.610 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.610 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:20:03.321+0000 7f75af630800 5 monclient: authenticate success, global_id 7104 2024-09-12T00:20:03.610 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:20:03.321+0000 7f75af630800 10 monclient: _renew_subs 2024-09-12T00:20:03.610 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:20:03.321+0000 7f75af630800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:20:03.610 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:20:03.321+0000 7f75ab9ce640 4 set_mon_vals no callback set 2024-09-12T00:20:03.610 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:20:03.321+0000 7f75af630800 10 monclient: _renew_subs 2024-09-12T00:20:03.610 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:20:03.321+0000 7f75af630800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:20:03.610 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:20:03.322+0000 7f7494e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:20:03.610 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:20:03.322+0000 7f7494e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:03.611 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:20:03.322+0000 7f7494e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:03.611 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:20:03.323+0000 7f75aa9cc640 10 monclient: get_auth_request con 0x7f7484076380 auth_method 0 2024-09-12T00:20:03.611 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:20:03.323+0000 7f75af630800 10 monclient: get_monmap_and_config 2024-09-12T00:20:03.611 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:20:03.323+0000 7f75af630800 10 monclient: build_initial_monmap 2024-09-12T00:20:03.611 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:20:03.323+0000 7f75af630800 1 build_initial for_mkfs: 0 2024-09-12T00:20:03.611 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:20:03.323+0000 7f75af630800 10 monclient: monmap: 2024-09-12T00:20:03.611 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:20:03.611 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:20:03.611 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:20:03.611 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:20:03.611 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:20:03.611 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.611 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:20:03.611 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:20:03.612 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:20:03.612 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.612 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding auth protocol: cephx 2024-09-12T00:20:03.612 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding auth protocol: cephx 2024-09-12T00:20:03.612 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding auth protocol: cephx 2024-09-12T00:20:03.612 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: secure 2024-09-12T00:20:03.612 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: crc 2024-09-12T00:20:03.612 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: secure 2024-09-12T00:20:03.612 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: crc 2024-09-12T00:20:03.612 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: secure 2024-09-12T00:20:03.612 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: crc 2024-09-12T00:20:03.612 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: crc 2024-09-12T00:20:03.612 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: secure 2024-09-12T00:20:03.613 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: crc 2024-09-12T00:20:03.613 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: secure 2024-09-12T00:20:03.613 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: crc 2024-09-12T00:20:03.613 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: secure 2024-09-12T00:20:03.613 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:20:03.323+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.613 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:20:03.323+0000 7f75af630800 10 monclient: init 2024-09-12T00:20:03.613 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding auth protocol: cephx 2024-09-12T00:20:03.613 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding auth protocol: cephx 2024-09-12T00:20:03.613 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding auth protocol: cephx 2024-09-12T00:20:03.613 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: secure 2024-09-12T00:20:03.613 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: crc 2024-09-12T00:20:03.613 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: secure 2024-09-12T00:20:03.613 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: crc 2024-09-12T00:20:03.614 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: secure 2024-09-12T00:20:03.614 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: crc 2024-09-12T00:20:03.614 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: crc 2024-09-12T00:20:03.614 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: secure 2024-09-12T00:20:03.614 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: crc 2024-09-12T00:20:03.614 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: secure 2024-09-12T00:20:03.614 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: crc 2024-09-12T00:20:03.614 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: secure 2024-09-12T00:20:03.614 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:20:03.323+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.614 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:20:03.324+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.614 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:20:03.324+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command rotate-key cmddesc rotate-key hook 0x7ffdd478fe78 EEXIST 2024-09-12T00:20:03.614 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:03.614 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:20:03.615 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): picked mon.noname-b con 0x55fa052b9d20 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:03.615 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): picked mon.noname-c con 0x55fa052aa670 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:03.615 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): picked mon.noname-a con 0x55fa052b5150 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:03.615 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.615 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.615 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.615 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:03.615 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): authenticate will time out at 1880.581257s 2024-09-12T00:20:03.615 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:20:03.324+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request con 0x55fa052b5150 auth_method 0 2024-09-12T00:20:03.615 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:20:03.324+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.615 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:20:03.324+0000 7f75ab1cd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.615 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:20:03.324+0000 7f75ab1cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.615 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request con 0x55fa052aa670 auth_method 0 2024-09-12T00:20:03.615 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.616 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.616 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.616 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:20:03.324+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request con 0x55fa052b9d20 auth_method 0 2024-09-12T00:20:03.616 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:20:03.324+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.616 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:20:03.324+0000 7f75aa9cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.616 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:20:03.324+0000 7f75aa9cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.616 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:20:03.324+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.616 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:20:03.324+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.616 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:20:03.324+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.616 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.616 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.616 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.616 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:20:03.324+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.617 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:20:03.324+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.617 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:20:03.324+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.617 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_done global_id 6668 payload 274 2024-09-12T00:20:03.617 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient: _finish_hunting 0 2024-09-12T00:20:03.617 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 1 monclient: found mon.noname-c 2024-09-12T00:20:03.617 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.617 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.617 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:20:03.617 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: dump: 2024-09-12T00:20:03.617 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.617 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.617 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.617 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.617 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.618 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.618 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.618 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.618 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.618 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.618 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:20:03.618 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:20:03.618 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:03.618 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.618 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:20:03.618 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: dump: 2024-09-12T00:20:03.618 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.619 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.619 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.619 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.619 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.619 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.619 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.619 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.619 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.619 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.619 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:20:03.324+0000 7f75af630800 5 monclient: authenticate success, global_id 6668 2024-09-12T00:20:03.619 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient: get_monmap_and_config success 2024-09-12T00:20:03.619 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:20:03.324+0000 7f75af630800 4 set_mon_vals no callback set 2024-09-12T00:20:03.619 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:20:03.325+0000 7f75af630800 10 monclient: shutdown 2024-09-12T00:20:03.619 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:20:03.325+0000 7f75af630800 10 monclient: build_initial_monmap 2024-09-12T00:20:03.620 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:20:03.325+0000 7f75af630800 1 build_initial for_mkfs: 0 2024-09-12T00:20:03.620 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:20:03.325+0000 7f75af630800 10 monclient: monmap: 2024-09-12T00:20:03.620 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:20:03.620 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:20:03.620 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:20:03.620 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:20:03.620 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:20:03.620 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.620 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:20:03.620 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:20:03.620 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:20:03.620 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.621 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding auth protocol: cephx 2024-09-12T00:20:03.621 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding auth protocol: cephx 2024-09-12T00:20:03.621 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding auth protocol: cephx 2024-09-12T00:20:03.621 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: secure 2024-09-12T00:20:03.621 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: crc 2024-09-12T00:20:03.621 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: secure 2024-09-12T00:20:03.621 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: crc 2024-09-12T00:20:03.621 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: secure 2024-09-12T00:20:03.621 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: crc 2024-09-12T00:20:03.621 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: crc 2024-09-12T00:20:03.621 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: secure 2024-09-12T00:20:03.621 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: crc 2024-09-12T00:20:03.621 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: secure 2024-09-12T00:20:03.621 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: crc 2024-09-12T00:20:03.621 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: secure 2024-09-12T00:20:03.622 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:20:03.325+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.622 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:20:03.325+0000 7f75af630800 1 librados: starting msgr at 2024-09-12T00:20:03.622 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:20:03.325+0000 7f75af630800 1 librados: starting objecter 2024-09-12T00:20:03.622 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:20:03.325+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command objecter_requests cmddesc objecter_requests hook 0x55fa052b9270 EEXIST 2024-09-12T00:20:03.622 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:20:03.325+0000 7f75af630800 1 librados: setting wanted keys 2024-09-12T00:20:03.622 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:20:03.325+0000 7f75af630800 1 librados: calling monclient init 2024-09-12T00:20:03.622 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:20:03.325+0000 7f75af630800 10 monclient: init 2024-09-12T00:20:03.622 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding auth protocol: cephx 2024-09-12T00:20:03.622 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding auth protocol: cephx 2024-09-12T00:20:03.622 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding auth protocol: cephx 2024-09-12T00:20:03.622 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: secure 2024-09-12T00:20:03.622 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: crc 2024-09-12T00:20:03.622 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: secure 2024-09-12T00:20:03.623 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: crc 2024-09-12T00:20:03.623 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: secure 2024-09-12T00:20:03.623 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: crc 2024-09-12T00:20:03.623 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: crc 2024-09-12T00:20:03.623 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: secure 2024-09-12T00:20:03.623 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: crc 2024-09-12T00:20:03.623 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: secure 2024-09-12T00:20:03.623 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: crc 2024-09-12T00:20:03.623 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: secure 2024-09-12T00:20:03.623 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:20:03.326+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.623 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:20:03.326+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.623 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:20:03.326+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command rotate-key cmddesc rotate-key hook 0x55fa0527a548 EEXIST 2024-09-12T00:20:03.623 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:03.623 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:20:03.624 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): picked mon.noname-b con 0x55fa052aa670 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:03.624 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): picked mon.noname-c con 0x55fa052b5150 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:03.624 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): picked mon.noname-a con 0x55fa052b9d20 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:03.624 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.624 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.624 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.624 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:03.624 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): authenticate will time out at 1880.583519s 2024-09-12T00:20:03.624 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request con 0x55fa052b5150 auth_method 0 2024-09-12T00:20:03.625 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.625 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.625 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.625 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:20:03.326+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request con 0x55fa052b9d20 auth_method 0 2024-09-12T00:20:03.625 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:20:03.326+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.625 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:20:03.326+0000 7f75ab1cd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.625 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:20:03.326+0000 7f75ab1cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.625 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:20:03.326+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request con 0x55fa052aa670 auth_method 0 2024-09-12T00:20:03.625 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:20:03.326+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.625 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:20:03.326+0000 7f75aa9cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.625 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:20:03.326+0000 7f75aa9cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.625 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.625 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.626 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.626 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:20:03.326+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.626 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:20:03.326+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.626 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:20:03.326+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.626 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:20:03.326+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.626 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:20:03.326+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.626 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:20:03.326+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.626 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_done global_id 6671 payload 824 2024-09-12T00:20:03.626 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient: _finish_hunting 0 2024-09-12T00:20:03.626 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 1 monclient: found mon.noname-c 2024-09-12T00:20:03.626 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.626 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.626 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:20:03.627 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: dump: 2024-09-12T00:20:03.627 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.627 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.627 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.627 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.627 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.627 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.627 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.627 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.627 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.627 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.627 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: _finish_auth 0 2024-09-12T00:20:03.627 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: _check_auth_tickets 2024-09-12T00:20:03.628 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:03.628 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.628 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:20:03.628 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: dump: 2024-09-12T00:20:03.628 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.628 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.628 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.628 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.628 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.628 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.628 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.628 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.628 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.629 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.629 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:20:03.327+0000 7f75af630800 5 monclient: authenticate success, global_id 6671 2024-09-12T00:20:03.629 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:20:03.327+0000 7f748e7fc640 4 set_mon_vals no callback set 2024-09-12T00:20:03.629 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:20:03.327+0000 7f75af630800 10 monclient: _renew_subs 2024-09-12T00:20:03.629 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:20:03.327+0000 7f75af630800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.629 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:20:03.327+0000 7f75af630800 10 monclient: _renew_subs 2024-09-12T00:20:03.629 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:20:03.327+0000 7f75af630800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.629 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:20:03.327+0000 7f75af630800 1 librados: init done 2024-09-12T00:20:03.629 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:20:03.327+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command cr dump hook 0x55fa052a9ea8 2024-09-12T00:20:03.629 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:20:03.328+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.629 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:20:03.329+0000 7f748cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:20:03.629 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:20:03.329+0000 7f748cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:03.629 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:20:03.329+0000 7f748cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:03.630 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:20:03.329+0000 7f75aa9cc640 10 monclient: get_auth_request con 0x7f7474076530 auth_method 0 2024-09-12T00:20:03.630 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:20:03.330+0000 7f75ab1cd640 10 monclient: get_auth_request con 0x55fa052d34b0 auth_method 0 2024-09-12T00:20:03.630 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:20:03.330+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.630 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:20:03.330+0000 7f75af630800 20 realm 2024-09-12T00:20:03.630 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:20:03.330+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.630 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:20:03.330+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.630 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:20:03.330+0000 7f75af630800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:03.630 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:20:03.330+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.630 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:20:03.331+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.630 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:20:03.331+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.630 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:20:03.331+0000 7f75aa9cc640 10 monclient: get_auth_request con 0x55fa052d7810 auth_method 0 2024-09-12T00:20:03.630 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:20:03.331+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:03.630 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:20:03.331+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.630 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:20:03.332+0000 7f75aa1cb640 10 monclient: get_auth_request con 0x55fa052daf90 auth_method 0 2024-09-12T00:20:03.631 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:20:03.332+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:03.631 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:20:03.332+0000 7f75af630800 20 searching for the correct realm 2024-09-12T00:20:03.631 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:20:03.333+0000 7f75ab1cd640 10 monclient: get_auth_request con 0x7f75a0057560 auth_method 0 2024-09-12T00:20:03.631 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:20:03.334+0000 7f75aa9cc640 10 monclient: get_auth_request con 0x7f759c08b030 auth_method 0 2024-09-12T00:20:03.631 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:20:03.335+0000 7f75aa1cb640 10 monclient: get_auth_request con 0x7f75a00647b0 auth_method 0 2024-09-12T00:20:03.631 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:20:03.335+0000 7f75aa1cb640 0 -- 172.21.15.67:0/826125496 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f75a00647b0 msgr2=0x7f75a0093240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:20:03.631 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:20:03.536+0000 7f75aa1cb640 10 monclient: get_auth_request con 0x7f75a00647b0 auth_method 0 2024-09-12T00:20:03.631 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:20:03.538+0000 7f75ab1cd640 10 monclient: get_auth_request con 0x7f759c056980 auth_method 0 2024-09-12T00:20:03.632 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:20:03.539+0000 7f75aa9cc640 10 monclient: get_auth_request con 0x7f75a4029040 auth_method 0 2024-09-12T00:20:03.632 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:20:03.540+0000 7f75ab1cd640 0 -- 172.21.15.67:0/826125496 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55fa052d34b0 msgr2=0x55fa052d58a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:03.632 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:20:03.540+0000 7f748cff9640 1 client.6671.objecter ms_handle_reset 0x55fa052d34b0 session 0x55fa05288020 osd.6 2024-09-12T00:20:03.632 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:20:03.540+0000 7f748cff9640 10 monclient: _renew_subs 2024-09-12T00:20:03.632 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:20:03.540+0000 7f748cff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.632 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:20:03.540+0000 7f75ab1cd640 10 monclient: get_auth_request con 0x7f7474086850 auth_method 0 2024-09-12T00:20:03.632 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:03.632 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:03.632 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:03.632 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:03.633 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:03.633 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:03.633 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:20:03.544+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.633 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:20:03.544+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.633 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:20:03.544+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.633 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:20:03.544+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:03.633 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:20:03.544+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.633 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:20:03.545+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:03.633 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:20:03.545+0000 7f75af630800 20 zone default found 2024-09-12T00:20:03.633 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:20:03.545+0000 7f75af630800 4 Realm: () 2024-09-12T00:20:03.633 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:20:03.545+0000 7f75af630800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:03.633 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:20:03.545+0000 7f75af630800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:03.633 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:20:03.545+0000 7f75af630800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:03.634 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:20:03.545+0000 7f75af630800 20 zonegroup default 2024-09-12T00:20:03.634 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:20:03.545+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.634 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:20:03.545+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.634 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:20:03.545+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.634 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:20:03.545+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.634 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:20:03.545+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.634 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:20:03.546+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.634 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:20:03.546+0000 7f75af630800 20 started sync module instance, tier type = 2024-09-12T00:20:03.634 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:20:03.546+0000 7f75af630800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:03.634 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=0 2024-09-12T00:20:03.634 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=1 2024-09-12T00:20:03.634 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=2 2024-09-12T00:20:03.634 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=3 2024-09-12T00:20:03.635 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=4 2024-09-12T00:20:03.635 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=5 2024-09-12T00:20:03.635 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=6 2024-09-12T00:20:03.635 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:20:03.555+0000 7f75af630800 20 add_watcher() i=7 2024-09-12T00:20:03.635 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:20:03.555+0000 7f75af630800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:03.635 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding auth protocol: cephx 2024-09-12T00:20:03.635 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding auth protocol: cephx 2024-09-12T00:20:03.635 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding auth protocol: cephx 2024-09-12T00:20:03.635 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: secure 2024-09-12T00:20:03.635 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: crc 2024-09-12T00:20:03.635 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: secure 2024-09-12T00:20:03.635 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: crc 2024-09-12T00:20:03.635 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: secure 2024-09-12T00:20:03.636 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: crc 2024-09-12T00:20:03.636 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:20:03.557+0000 7f74617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:03.636 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: crc 2024-09-12T00:20:03.636 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: secure 2024-09-12T00:20:03.636 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: crc 2024-09-12T00:20:03.636 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: secure 2024-09-12T00:20:03.636 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: crc 2024-09-12T00:20:03.636 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: secure 2024-09-12T00:20:03.636 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:20:03.557+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.636 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:20:03.557+0000 7f75af630800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:03.636 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:20:03.557+0000 7f75af630800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:03.636 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command cache list hook 0x55fa052aec70 2024-09-12T00:20:03.636 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command cache inspect hook 0x55fa052aec70 2024-09-12T00:20:03.637 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command cache erase hook 0x55fa052aec70 2024-09-12T00:20:03.637 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command cache zap hook 0x55fa052aec70 2024-09-12T00:20:03.637 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:20:03.558+0000 7f75af630800 5 note: GC not initialized 2024-09-12T00:20:03.637 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:20:03.558+0000 7f73dbfff640 20 reqs_thread_entry: start 2024-09-12T00:20:03.637 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command sync trace show hook 0x7f75a0088070 2024-09-12T00:20:03.637 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command sync trace history hook 0x7f75a0088070 2024-09-12T00:20:03.637 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command sync trace active hook 0x7f75a0088070 2024-09-12T00:20:03.637 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command sync trace active_short hook 0x7f75a0088070 2024-09-12T00:20:03.637 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:20:03.558+0000 7f75af630800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:03.637 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:20:03.558+0000 7f75af630800 20 Filter name: none 2024-09-12T00:20:03.637 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:20:03.558+0000 7f73d9ffb640 20 reqs_thread_entry: start 2024-09-12T00:20:03.637 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:20:03.558+0000 7f75af630800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:20:03.637 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:20:03.558+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.637 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:20:03.559+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:03.638 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:20:03.559+0000 7f75af630800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:20:03.638 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:20:03.559+0000 7f75af630800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:20:03.638 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:20:03.559+0000 7f75af630800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 : miss 2024-09-12T00:20:03.638 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:20:03.559+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.638 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:20:03.559+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:20:03.638 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:20:03.559+0000 7f75af630800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:03.638 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:20:03.559+0000 7f75af630800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:03.638 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:20:03.559+0000 7f75af630800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:03.638 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:20:03.559+0000 7f75af630800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:03.638 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:20:03.559+0000 7f75af630800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 2024-09-12T00:20:03.638 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:20:03.563+0000 7f75af630800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:03.639 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:20:03.563+0000 7f75af630800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:03.639 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:20:03.563+0000 7f75af630800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:03.639 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:20:03.563+0000 7f75af630800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29, ofs0, ns] 2024-09-12T00:20:03.639 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:20:03.563+0000 7f748e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562486 cookie 94532317094496 notifier 6671 bl.length()=915 2024-09-12T00:20:03.639 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:20:03.563+0000 7f748e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:03.639 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:20:03.563+0000 7f748e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:03.639 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:20:03.563+0000 7f748e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:03.639 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:20:03.564+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_sources= new_sources= 2024-09-12T00:20:03.640 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:20:03.564+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential sources added=[] removed=[] 2024-09-12T00:20:03.640 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:20:03.564+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_dests= new_dests= 2024-09-12T00:20:03.640 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:20:03.564+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential dests added=[] removed=[] 2024-09-12T00:20:03.640 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:20:03.566+0000 7f75af630800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.1.0 2024-09-12T00:20:03.640 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:20:03.566+0000 7f75af630800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.1.0 2024-09-12T00:20:03.640 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:20:03.566+0000 7f75af630800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.1.1 2024-09-12T00:20:03.640 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:20:03.566+0000 7f75af630800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.1.1 2024-09-12T00:20:03.640 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:20:03.566+0000 7f75af630800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.0 2024-09-12T00:20:03.640 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:20:03.568+0000 7f75af630800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:03.640 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:20:03.568+0000 7f75af630800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 2024-09-12T00:20:03.640 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:20:03.569+0000 7f75af630800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:03.640 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:20:03.569+0000 7f75af630800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:03.640 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:20:03.569+0000 7f75af630800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:03.641 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:20:03.569+0000 7f75af630800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29, ofs0, ns] 2024-09-12T00:20:03.641 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:20:03.570+0000 7f748e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562487 cookie 94532317094496 notifier 6671 bl.length()=915 2024-09-12T00:20:03.641 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:20:03.570+0000 7f748e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:03.641 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:20:03.570+0000 7f748e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:03.641 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:20:03.570+0000 7f748e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:03.641 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:20:03.570+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_sources= new_sources= 2024-09-12T00:20:03.641 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:20:03.570+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential sources added=[] removed=[] 2024-09-12T00:20:03.641 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:20:03.570+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_dests= new_dests= 2024-09-12T00:20:03.641 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:20:03.570+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential dests added=[] removed=[] 2024-09-12T00:20:03.641 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:20:03.571+0000 7f75af630800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f75af630800 time 2024-09-12T00:20:03.572142+0000 2024-09-12T00:20:03.641 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:20:03.641 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.641 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:03.642 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f75b038c71a] 2024-09-12T00:20:03.642 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75b038c8d8] 2024-09-12T00:20:03.642 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa042fc641] 2024-09-12T00:20:03.642 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55fa0430b582] 2024-09-12T00:20:03.642 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fa0430c3e4] 2024-09-12T00:20:03.642 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:20:03.642 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f75af029590] 2024-09-12T00:20:03.642 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:20:03.642 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:20:03.643 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.643 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:20:03.572+0000 7f75af630800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:20:03.643 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f75af630800 thread_name:radosgw-admin 2024-09-12T00:20:03.643 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.643 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:03.643 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f75af03e6f0] 2024-09-12T00:20:03.643 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f75af08b99c] 2024-09-12T00:20:03.643 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:20:03.643 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:20:03.643 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f75b038c774] 2024-09-12T00:20:03.643 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75b038c8d8] 2024-09-12T00:20:03.643 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa042fc641] 2024-09-12T00:20:03.643 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55fa0430b582] 2024-09-12T00:20:03.644 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fa0430c3e4] 2024-09-12T00:20:03.644 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:20:03.644 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f75af029590] 2024-09-12T00:20:03.644 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:20:03.644 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:20:03.644 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:20:03.644 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.644 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:20:03.644 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:20:03.644 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:20:03.644 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:20:03.644 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:20:03.644 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:20:03.645 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:20:03.645 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:20:03.645 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:20:03.645 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:20:03.645 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:20:03.645 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:20:03.645 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:20:03.645 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:20:03.645 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:20:03.645 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:20:03.645 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:20:03.645 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:20:03.645 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:20:03.645 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:20:03.646 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:20:03.646 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:20:03.646 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:20:03.646 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:20:03.646 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:20:03.646 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:20:03.646 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:20:03.646 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:20:03.646 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:20:03.646 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:20:03.646 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:20:03.646 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:20:03.646 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:20:03.646 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:20:03.647 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:20:03.647 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:20:03.647 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:20:03.647 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:20:03.647 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:20:03.647 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:20:03.647 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:20:03.647 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:20:03.647 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:20:03.647 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:20:03.647 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:20:03.647 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:20:03.647 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:20:03.647 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:20:03.648 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:20:03.648 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:20:03.648 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:20:03.648 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:20:03.648 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:20:03.648 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:20:03.648 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:20:03.648 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:20:03.648 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:20:03.648 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:20:03.648 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:20:03.648 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:20:03.648 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:20:03.649 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:20:03.649 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:20:03.649 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:20:03.649 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:20:03.649 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:20:03.649 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:20:03.649 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:20:03.649 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:20:03.649 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:20:03.649 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:20:03.649 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:20:03.649 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:20:03.649 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:20:03.649 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:20:03.650 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:20:03.650 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:20:03.650 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:20:03.650 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:20:03.650 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:20:03.650 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:20:03.650 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:20:03.650 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:20:03.650 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:20:03.650 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:20:03.650 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:20:03.650 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:20:03.650 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:20:03.651 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:20:03.651 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:20:03.651 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:20:03.651 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:20:03.651 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:20:03.651 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:20:03.651 INFO:tasks.workunit.client.0.smithi067.stderr: 7f73d9ffb640 / http_manager 2024-09-12T00:20:03.651 INFO:tasks.workunit.client.0.smithi067.stderr: 7f73dbfff640 / http_manager 2024-09-12T00:20:03.651 INFO:tasks.workunit.client.0.smithi067.stderr: 7f74617e2640 / rgw_dt_lg_renew 2024-09-12T00:20:03.651 INFO:tasks.workunit.client.0.smithi067.stderr: 7f748cff9640 / ms_dispatch 2024-09-12T00:20:03.651 INFO:tasks.workunit.client.0.smithi067.stderr: 7f748e7fc640 / io_context_pool 2024-09-12T00:20:03.651 INFO:tasks.workunit.client.0.smithi067.stderr: 7f7494e01640 / ms_dispatch 2024-09-12T00:20:03.651 INFO:tasks.workunit.client.0.smithi067.stderr: 7f7497606640 / ms_dispatch 2024-09-12T00:20:03.651 INFO:tasks.workunit.client.0.smithi067.stderr: 7f7498e09640 / io_context_pool 2024-09-12T00:20:03.652 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75aa1cb640 / msgr-worker-2 2024-09-12T00:20:03.652 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75aa9cc640 / msgr-worker-1 2024-09-12T00:20:03.652 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75ab1cd640 / msgr-worker-0 2024-09-12T00:20:03.652 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75ab9ce640 / io_context_pool 2024-09-12T00:20:03.652 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75af630800 / radosgw-admin 2024-09-12T00:20:03.652 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:20:03.652 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:20:03.652 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.113465.log 2024-09-12T00:20:03.652 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:20:03.652 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:20:03.652 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:20:03.312+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.652 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:20:03.312+0000 7f75af630800 1 librados: starting msgr at 2024-09-12T00:20:03.652 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:20:03.312+0000 7f75af630800 1 librados: starting objecter 2024-09-12T00:20:03.652 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:20:03.312+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command objecter_requests hook 0x55fa051ef390 2024-09-12T00:20:03.653 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:20:03.312+0000 7f75af630800 1 librados: setting wanted keys 2024-09-12T00:20:03.653 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:20:03.312+0000 7f75af630800 1 librados: calling monclient init 2024-09-12T00:20:03.653 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:20:03.312+0000 7f75af630800 10 monclient: init 2024-09-12T00:20:03.653 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding auth protocol: cephx 2024-09-12T00:20:03.653 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding auth protocol: cephx 2024-09-12T00:20:03.653 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding auth protocol: cephx 2024-09-12T00:20:03.653 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: secure 2024-09-12T00:20:03.653 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: crc 2024-09-12T00:20:03.653 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: secure 2024-09-12T00:20:03.653 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: crc 2024-09-12T00:20:03.653 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: secure 2024-09-12T00:20:03.653 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: crc 2024-09-12T00:20:03.653 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: crc 2024-09-12T00:20:03.654 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: secure 2024-09-12T00:20:03.654 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: crc 2024-09-12T00:20:03.654 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: secure 2024-09-12T00:20:03.654 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: crc 2024-09-12T00:20:03.654 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:20:03.312+0000 7f75af630800 5 AuthRegistry(0x55fa051e88b0) adding con mode: secure 2024-09-12T00:20:03.654 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:20:03.312+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.654 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:20:03.313+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.654 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:20:03.313+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command rotate-key hook 0x55fa051e89f8 2024-09-12T00:20:03.654 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:03.654 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:20:03.654 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): picked mon.noname-a con 0x55fa050a09d0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:03.654 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): picked mon.noname-c con 0x55fa0512be60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:03.654 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): picked mon.noname-b con 0x55fa0512ec10 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:03.654 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.655 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.655 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.655 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:03.655 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient(hunting): authenticate will time out at 1880.570226s 2024-09-12T00:20:03.655 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request con 0x55fa0512be60 auth_method 0 2024-09-12T00:20:03.655 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.655 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.655 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.655 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:20:03.313+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request con 0x55fa050a09d0 auth_method 0 2024-09-12T00:20:03.655 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:20:03.313+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.655 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:20:03.313+0000 7f75aa9cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.655 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:20:03.313+0000 7f75aa9cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.655 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.656 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.656 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.656 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:20:03.313+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.656 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:20:03.313+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.656 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:20:03.313+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.656 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:20:03.313+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request con 0x55fa0512ec10 auth_method 0 2024-09-12T00:20:03.656 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:20:03.313+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.656 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:20:03.313+0000 7f75ab1cd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.656 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:20:03.313+0000 7f75ab1cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.656 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_done global_id 6662 payload 824 2024-09-12T00:20:03.656 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient: _finish_hunting 0 2024-09-12T00:20:03.656 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 1 monclient: found mon.noname-c 2024-09-12T00:20:03.656 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:20:03.313+0000 7f75aa1cb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.656 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.657 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:20:03.657 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: dump: 2024-09-12T00:20:03.657 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.657 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.657 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.657 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.657 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.657 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.657 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.657 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.657 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.657 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.657 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: _finish_auth 0 2024-09-12T00:20:03.658 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: _check_auth_tickets 2024-09-12T00:20:03.658 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:03.658 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.658 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:20:03.658 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:20:03.313+0000 7f7497606640 10 monclient: dump: 2024-09-12T00:20:03.658 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.658 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.658 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.658 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.658 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.658 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.658 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.658 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.658 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.659 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.659 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:20:03.313+0000 7f75af630800 5 monclient: authenticate success, global_id 6662 2024-09-12T00:20:03.659 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient: _renew_subs 2024-09-12T00:20:03.659 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.659 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:20:03.313+0000 7f7498e09640 4 set_mon_vals no callback set 2024-09-12T00:20:03.659 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient: _renew_subs 2024-09-12T00:20:03.659 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:20:03.313+0000 7f75af630800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.659 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:20:03.313+0000 7f75af630800 1 librados: init done 2024-09-12T00:20:03.659 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:20:03.316+0000 7f7497606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:20:03.659 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:20:03.316+0000 7f7497606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:03.659 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:20:03.316+0000 7f7497606640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:03.659 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:20:03.316+0000 7f75aa9cc640 10 monclient: get_auth_request con 0x7f74900764a0 auth_method 0 2024-09-12T00:20:03.659 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:20:03.316+0000 7f75ab1cd640 10 monclient: get_auth_request con 0x55fa05212380 auth_method 0 2024-09-12T00:20:03.660 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:20:03.317+0000 7f75aa9cc640 10 monclient: get_auth_request con 0x55fa05235390 auth_method 0 2024-09-12T00:20:03.660 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:20:03.318+0000 7f75aa1cb640 10 monclient: get_auth_request con 0x55fa05239580 auth_method 0 2024-09-12T00:20:03.660 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:20:03.319+0000 7f75af630800 10 monclient: build_initial_monmap 2024-09-12T00:20:03.660 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:20:03.319+0000 7f75af630800 1 build_initial for_mkfs: 0 2024-09-12T00:20:03.660 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:20:03.319+0000 7f75af630800 10 monclient: monmap: 2024-09-12T00:20:03.660 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:20:03.660 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:20:03.660 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:20:03.660 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:20:03.660 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:20:03.660 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.660 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:20:03.660 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:20:03.660 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:20:03.661 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.661 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding auth protocol: cephx 2024-09-12T00:20:03.661 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding auth protocol: cephx 2024-09-12T00:20:03.661 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding auth protocol: cephx 2024-09-12T00:20:03.661 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: secure 2024-09-12T00:20:03.661 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: crc 2024-09-12T00:20:03.661 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: secure 2024-09-12T00:20:03.661 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: crc 2024-09-12T00:20:03.661 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: secure 2024-09-12T00:20:03.661 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: crc 2024-09-12T00:20:03.661 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: crc 2024-09-12T00:20:03.661 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: secure 2024-09-12T00:20:03.661 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: crc 2024-09-12T00:20:03.662 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: secure 2024-09-12T00:20:03.662 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: crc 2024-09-12T00:20:03.662 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523e3a0) adding con mode: secure 2024-09-12T00:20:03.662 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:20:03.319+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.662 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:20:03.319+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command objecter_requests cmddesc objecter_requests hook 0x55fa05241820 EEXIST 2024-09-12T00:20:03.662 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:20:03.319+0000 7f75af630800 10 monclient: init 2024-09-12T00:20:03.662 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding auth protocol: cephx 2024-09-12T00:20:03.662 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding auth protocol: cephx 2024-09-12T00:20:03.662 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding auth protocol: cephx 2024-09-12T00:20:03.662 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: secure 2024-09-12T00:20:03.662 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: crc 2024-09-12T00:20:03.662 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: secure 2024-09-12T00:20:03.662 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: crc 2024-09-12T00:20:03.662 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: secure 2024-09-12T00:20:03.663 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: crc 2024-09-12T00:20:03.663 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: crc 2024-09-12T00:20:03.663 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: secure 2024-09-12T00:20:03.663 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: crc 2024-09-12T00:20:03.663 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: secure 2024-09-12T00:20:03.663 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: crc 2024-09-12T00:20:03.663 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:20:03.319+0000 7f75af630800 5 AuthRegistry(0x55fa0523ca28) adding con mode: secure 2024-09-12T00:20:03.663 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:20:03.320+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.663 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:20:03.320+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.663 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:20:03.320+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command rotate-key cmddesc rotate-key hook 0x55fa0523cb70 EEXIST 2024-09-12T00:20:03.663 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:03.663 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:20:03.663 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): picked mon.noname-b con 0x55fa05265b40 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:03.664 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): picked mon.noname-a con 0x55fa05265f20 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:03.664 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): picked mon.noname-c con 0x55fa05264850 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:03.664 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.664 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.664 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.664 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:03.664 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:20:03.320+0000 7f75af630800 10 monclient(hunting): authenticate will time out at 1880.577512s 2024-09-12T00:20:03.664 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request con 0x55fa05265f20 auth_method 0 2024-09-12T00:20:03.664 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.664 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.664 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.664 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:20:03.320+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request con 0x55fa05264850 auth_method 0 2024-09-12T00:20:03.664 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:20:03.320+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.665 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:20:03.320+0000 7f75ab1cd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.665 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:20:03.320+0000 7f75ab1cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.665 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:20:03.320+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request con 0x55fa05265b40 auth_method 0 2024-09-12T00:20:03.665 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:20:03.320+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.665 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:20:03.320+0000 7f75aa9cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.665 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:20:03.320+0000 7f75aa9cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.665 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.665 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.665 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.665 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:20:03.320+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.665 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:20:03.320+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.665 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:20:03.320+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.665 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:20:03.320+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.665 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:20:03.320+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.666 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:20:03.320+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.666 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_done global_id 7104 payload 824 2024-09-12T00:20:03.666 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient: _finish_hunting 0 2024-09-12T00:20:03.666 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 1 monclient: found mon.noname-a 2024-09-12T00:20:03.666 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:20:03.320+0000 7f75aa1cb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:20:03.666 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.666 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:20:03.666 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: dump: 2024-09-12T00:20:03.666 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.666 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.666 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.666 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.666 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.667 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.667 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.667 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.667 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.667 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.667 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: _finish_auth 0 2024-09-12T00:20:03.667 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: _check_auth_tickets 2024-09-12T00:20:03.667 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:03.667 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.667 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:20:03.667 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:20:03.321+0000 7f7494e01640 10 monclient: dump: 2024-09-12T00:20:03.667 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.667 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.668 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.668 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.668 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.668 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.668 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.668 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.668 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.668 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.668 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:20:03.321+0000 7f75af630800 5 monclient: authenticate success, global_id 7104 2024-09-12T00:20:03.668 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:20:03.321+0000 7f75af630800 10 monclient: _renew_subs 2024-09-12T00:20:03.668 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:20:03.321+0000 7f75af630800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:20:03.668 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:20:03.321+0000 7f75ab9ce640 4 set_mon_vals no callback set 2024-09-12T00:20:03.668 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:20:03.321+0000 7f75af630800 10 monclient: _renew_subs 2024-09-12T00:20:03.669 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:20:03.321+0000 7f75af630800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:20:03.669 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:20:03.322+0000 7f7494e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:20:03.669 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:20:03.322+0000 7f7494e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:03.669 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:20:03.322+0000 7f7494e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:03.669 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:20:03.323+0000 7f75aa9cc640 10 monclient: get_auth_request con 0x7f7484076380 auth_method 0 2024-09-12T00:20:03.669 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:20:03.323+0000 7f75af630800 10 monclient: get_monmap_and_config 2024-09-12T00:20:03.669 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:20:03.323+0000 7f75af630800 10 monclient: build_initial_monmap 2024-09-12T00:20:03.669 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:20:03.323+0000 7f75af630800 1 build_initial for_mkfs: 0 2024-09-12T00:20:03.669 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:20:03.323+0000 7f75af630800 10 monclient: monmap: 2024-09-12T00:20:03.669 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:20:03.669 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:20:03.669 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:20:03.669 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:20:03.669 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:20:03.670 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.670 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:20:03.670 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:20:03.670 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:20:03.670 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.670 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding auth protocol: cephx 2024-09-12T00:20:03.670 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding auth protocol: cephx 2024-09-12T00:20:03.670 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding auth protocol: cephx 2024-09-12T00:20:03.671 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: secure 2024-09-12T00:20:03.671 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: crc 2024-09-12T00:20:03.671 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: secure 2024-09-12T00:20:03.671 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: crc 2024-09-12T00:20:03.671 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: secure 2024-09-12T00:20:03.671 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: crc 2024-09-12T00:20:03.671 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: crc 2024-09-12T00:20:03.671 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: secure 2024-09-12T00:20:03.671 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: crc 2024-09-12T00:20:03.671 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: secure 2024-09-12T00:20:03.671 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: crc 2024-09-12T00:20:03.671 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x55fa05285700) adding con mode: secure 2024-09-12T00:20:03.671 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:20:03.323+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.672 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:20:03.323+0000 7f75af630800 10 monclient: init 2024-09-12T00:20:03.672 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding auth protocol: cephx 2024-09-12T00:20:03.672 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding auth protocol: cephx 2024-09-12T00:20:03.672 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding auth protocol: cephx 2024-09-12T00:20:03.672 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: secure 2024-09-12T00:20:03.672 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: crc 2024-09-12T00:20:03.672 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: secure 2024-09-12T00:20:03.672 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: crc 2024-09-12T00:20:03.672 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: secure 2024-09-12T00:20:03.672 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: crc 2024-09-12T00:20:03.672 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: crc 2024-09-12T00:20:03.672 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: secure 2024-09-12T00:20:03.672 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: crc 2024-09-12T00:20:03.673 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: secure 2024-09-12T00:20:03.673 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: crc 2024-09-12T00:20:03.673 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:20:03.323+0000 7f75af630800 5 AuthRegistry(0x7ffdd478fd30) adding con mode: secure 2024-09-12T00:20:03.673 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:20:03.323+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.673 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:20:03.324+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.673 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:20:03.324+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command rotate-key cmddesc rotate-key hook 0x7ffdd478fe78 EEXIST 2024-09-12T00:20:03.673 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:03.673 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:20:03.673 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): picked mon.noname-b con 0x55fa052b9d20 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:03.673 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): picked mon.noname-c con 0x55fa052aa670 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:03.673 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): picked mon.noname-a con 0x55fa052b5150 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:03.673 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.673 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.674 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.674 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:03.674 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient(hunting): authenticate will time out at 1880.581257s 2024-09-12T00:20:03.674 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:20:03.324+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request con 0x55fa052b5150 auth_method 0 2024-09-12T00:20:03.674 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:20:03.324+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.674 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:20:03.324+0000 7f75ab1cd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.674 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:20:03.324+0000 7f75ab1cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.674 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request con 0x55fa052aa670 auth_method 0 2024-09-12T00:20:03.674 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.674 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.674 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.674 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:20:03.324+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request con 0x55fa052b9d20 auth_method 0 2024-09-12T00:20:03.674 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:20:03.324+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.675 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:20:03.324+0000 7f75aa9cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.675 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:20:03.324+0000 7f75aa9cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.675 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:20:03.324+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.675 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:20:03.324+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.675 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:20:03.324+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.675 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.675 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.675 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.675 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:20:03.324+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.675 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:20:03.324+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.675 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:20:03.324+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.675 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_done global_id 6668 payload 274 2024-09-12T00:20:03.675 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient: _finish_hunting 0 2024-09-12T00:20:03.675 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 1 monclient: found mon.noname-c 2024-09-12T00:20:03.676 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:20:03.324+0000 7f75aa1cb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.676 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.676 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:20:03.676 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: dump: 2024-09-12T00:20:03.676 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.676 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.676 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.676 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.676 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.676 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.676 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.676 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.676 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.676 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.677 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:20:03.677 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:20:03.677 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:03.677 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.677 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:20:03.677 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:20:03.324+0000 7f748e7fc640 10 monclient: dump: 2024-09-12T00:20:03.677 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.677 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.677 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.677 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.677 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.677 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.677 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.678 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.678 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.678 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.678 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:20:03.324+0000 7f75af630800 5 monclient: authenticate success, global_id 6668 2024-09-12T00:20:03.678 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:20:03.324+0000 7f75af630800 10 monclient: get_monmap_and_config success 2024-09-12T00:20:03.678 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:20:03.324+0000 7f75af630800 4 set_mon_vals no callback set 2024-09-12T00:20:03.678 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:20:03.325+0000 7f75af630800 10 monclient: shutdown 2024-09-12T00:20:03.678 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:20:03.325+0000 7f75af630800 10 monclient: build_initial_monmap 2024-09-12T00:20:03.678 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:20:03.325+0000 7f75af630800 1 build_initial for_mkfs: 0 2024-09-12T00:20:03.678 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:20:03.325+0000 7f75af630800 10 monclient: monmap: 2024-09-12T00:20:03.678 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:20:03.678 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:20:03.678 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:20:03.678 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:20:03.679 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:20:03.679 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.679 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:20:03.679 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:20:03.679 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:20:03.679 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.679 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding auth protocol: cephx 2024-09-12T00:20:03.679 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding auth protocol: cephx 2024-09-12T00:20:03.679 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding auth protocol: cephx 2024-09-12T00:20:03.679 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: secure 2024-09-12T00:20:03.679 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: crc 2024-09-12T00:20:03.679 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: secure 2024-09-12T00:20:03.679 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: crc 2024-09-12T00:20:03.679 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: secure 2024-09-12T00:20:03.680 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: crc 2024-09-12T00:20:03.680 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: crc 2024-09-12T00:20:03.680 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: secure 2024-09-12T00:20:03.680 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: crc 2024-09-12T00:20:03.680 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: secure 2024-09-12T00:20:03.680 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: crc 2024-09-12T00:20:03.680 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:20:03.325+0000 7f75af630800 5 AuthRegistry(0x55fa052aab20) adding con mode: secure 2024-09-12T00:20:03.680 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:20:03.325+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.680 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:20:03.325+0000 7f75af630800 1 librados: starting msgr at 2024-09-12T00:20:03.680 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:20:03.325+0000 7f75af630800 1 librados: starting objecter 2024-09-12T00:20:03.680 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:20:03.325+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command objecter_requests cmddesc objecter_requests hook 0x55fa052b9270 EEXIST 2024-09-12T00:20:03.680 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:20:03.325+0000 7f75af630800 1 librados: setting wanted keys 2024-09-12T00:20:03.680 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:20:03.325+0000 7f75af630800 1 librados: calling monclient init 2024-09-12T00:20:03.681 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:20:03.325+0000 7f75af630800 10 monclient: init 2024-09-12T00:20:03.681 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding auth protocol: cephx 2024-09-12T00:20:03.681 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding auth protocol: cephx 2024-09-12T00:20:03.681 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding auth protocol: cephx 2024-09-12T00:20:03.681 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: secure 2024-09-12T00:20:03.681 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: crc 2024-09-12T00:20:03.681 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: secure 2024-09-12T00:20:03.681 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: crc 2024-09-12T00:20:03.681 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: secure 2024-09-12T00:20:03.681 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: crc 2024-09-12T00:20:03.681 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: crc 2024-09-12T00:20:03.681 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: secure 2024-09-12T00:20:03.681 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: crc 2024-09-12T00:20:03.681 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: secure 2024-09-12T00:20:03.682 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: crc 2024-09-12T00:20:03.682 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:20:03.326+0000 7f75af630800 5 AuthRegistry(0x55fa0527a400) adding con mode: secure 2024-09-12T00:20:03.682 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:20:03.326+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.682 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:20:03.326+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.682 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:20:03.326+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command rotate-key cmddesc rotate-key hook 0x55fa0527a548 EEXIST 2024-09-12T00:20:03.682 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:03.682 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:20:03.682 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): picked mon.noname-b con 0x55fa052aa670 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:03.682 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): picked mon.noname-c con 0x55fa052b5150 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:03.682 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): picked mon.noname-a con 0x55fa052b9d20 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:03.682 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.682 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.682 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:03.682 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:03.683 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:20:03.326+0000 7f75af630800 10 monclient(hunting): authenticate will time out at 1880.583519s 2024-09-12T00:20:03.683 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request con 0x55fa052b5150 auth_method 0 2024-09-12T00:20:03.683 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.683 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.683 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.683 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:20:03.326+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request con 0x55fa052b9d20 auth_method 0 2024-09-12T00:20:03.683 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:20:03.326+0000 7f75ab1cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.683 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:20:03.326+0000 7f75ab1cd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.683 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:20:03.326+0000 7f75ab1cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.683 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:20:03.326+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request con 0x55fa052aa670 auth_method 0 2024-09-12T00:20:03.683 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:20:03.326+0000 7f75aa9cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:03.683 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:20:03.326+0000 7f75aa9cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:03.683 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:20:03.326+0000 7f75aa9cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:03.683 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.684 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.684 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.684 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:20:03.326+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.684 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:20:03.326+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.684 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:20:03.326+0000 7f75ab1cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.684 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:20:03.326+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:03.684 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:20:03.326+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:03.684 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:20:03.326+0000 7f75aa9cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:03.684 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient(hunting): handle_auth_done global_id 6671 payload 824 2024-09-12T00:20:03.684 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient: _finish_hunting 0 2024-09-12T00:20:03.684 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 1 monclient: found mon.noname-c 2024-09-12T00:20:03.684 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:20:03.326+0000 7f75aa1cb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.684 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.685 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:20:03.685 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: dump: 2024-09-12T00:20:03.685 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.685 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.685 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.685 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.685 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.685 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.685 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.685 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.685 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.685 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.685 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: _finish_auth 0 2024-09-12T00:20:03.685 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: _check_auth_tickets 2024-09-12T00:20:03.686 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:03.686 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:03.686 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:20:03.686 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:20:03.327+0000 7f748cff9640 10 monclient: dump: 2024-09-12T00:20:03.686 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:03.686 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:03.686 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.686 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:03.686 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:03.686 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:03.686 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:03.686 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:03.686 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:03.687 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.687 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:20:03.327+0000 7f75af630800 5 monclient: authenticate success, global_id 6671 2024-09-12T00:20:03.687 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:20:03.327+0000 7f748e7fc640 4 set_mon_vals no callback set 2024-09-12T00:20:03.687 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:20:03.327+0000 7f75af630800 10 monclient: _renew_subs 2024-09-12T00:20:03.687 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:20:03.327+0000 7f75af630800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.687 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:20:03.327+0000 7f75af630800 10 monclient: _renew_subs 2024-09-12T00:20:03.687 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:20:03.327+0000 7f75af630800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.687 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:20:03.327+0000 7f75af630800 1 librados: init done 2024-09-12T00:20:03.687 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:20:03.327+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command cr dump hook 0x55fa052a9ea8 2024-09-12T00:20:03.688 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:20:03.328+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.688 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:20:03.329+0000 7f748cff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:20:03.688 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:20:03.329+0000 7f748cff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:03.688 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:20:03.329+0000 7f748cff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:03.688 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:20:03.329+0000 7f75aa9cc640 10 monclient: get_auth_request con 0x7f7474076530 auth_method 0 2024-09-12T00:20:03.688 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:20:03.330+0000 7f75ab1cd640 10 monclient: get_auth_request con 0x55fa052d34b0 auth_method 0 2024-09-12T00:20:03.688 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:20:03.330+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.688 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:20:03.330+0000 7f75af630800 20 realm 2024-09-12T00:20:03.688 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:20:03.330+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.688 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:20:03.330+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.688 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:20:03.330+0000 7f75af630800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:03.688 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:20:03.330+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.688 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:20:03.331+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.689 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:20:03.331+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.689 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:20:03.331+0000 7f75aa9cc640 10 monclient: get_auth_request con 0x55fa052d7810 auth_method 0 2024-09-12T00:20:03.689 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:20:03.331+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:03.689 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:20:03.331+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.689 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:20:03.332+0000 7f75aa1cb640 10 monclient: get_auth_request con 0x55fa052daf90 auth_method 0 2024-09-12T00:20:03.689 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:20:03.332+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:03.689 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:20:03.332+0000 7f75af630800 20 searching for the correct realm 2024-09-12T00:20:03.689 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:20:03.333+0000 7f75ab1cd640 10 monclient: get_auth_request con 0x7f75a0057560 auth_method 0 2024-09-12T00:20:03.689 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:20:03.334+0000 7f75aa9cc640 10 monclient: get_auth_request con 0x7f759c08b030 auth_method 0 2024-09-12T00:20:03.689 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:20:03.335+0000 7f75aa1cb640 10 monclient: get_auth_request con 0x7f75a00647b0 auth_method 0 2024-09-12T00:20:03.689 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:20:03.335+0000 7f75aa1cb640 0 -- 172.21.15.67:0/826125496 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f75a00647b0 msgr2=0x7f75a0093240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:20:03.689 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:20:03.536+0000 7f75aa1cb640 10 monclient: get_auth_request con 0x7f75a00647b0 auth_method 0 2024-09-12T00:20:03.689 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:20:03.538+0000 7f75ab1cd640 10 monclient: get_auth_request con 0x7f759c056980 auth_method 0 2024-09-12T00:20:03.690 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:20:03.539+0000 7f75aa9cc640 10 monclient: get_auth_request con 0x7f75a4029040 auth_method 0 2024-09-12T00:20:03.690 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:20:03.540+0000 7f75ab1cd640 0 -- 172.21.15.67:0/826125496 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55fa052d34b0 msgr2=0x55fa052d58a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:03.690 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:20:03.540+0000 7f748cff9640 1 client.6671.objecter ms_handle_reset 0x55fa052d34b0 session 0x55fa05288020 osd.6 2024-09-12T00:20:03.690 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:20:03.540+0000 7f748cff9640 10 monclient: _renew_subs 2024-09-12T00:20:03.690 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:20:03.540+0000 7f748cff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:03.690 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:20:03.540+0000 7f75ab1cd640 10 monclient: get_auth_request con 0x7f7474086850 auth_method 0 2024-09-12T00:20:03.690 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:03.690 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:03.690 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:03.690 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:03.690 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:03.690 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:20:03.544+0000 7f75af630800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:03.690 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:20:03.544+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.690 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:20:03.544+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.691 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:20:03.544+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.691 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:20:03.544+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:03.691 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:20:03.544+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.691 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:20:03.545+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:03.691 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:20:03.545+0000 7f75af630800 20 zone default found 2024-09-12T00:20:03.691 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:20:03.545+0000 7f75af630800 4 Realm: () 2024-09-12T00:20:03.691 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:20:03.545+0000 7f75af630800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:03.691 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:20:03.545+0000 7f75af630800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:03.691 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:20:03.545+0000 7f75af630800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:03.691 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:20:03.545+0000 7f75af630800 20 zonegroup default 2024-09-12T00:20:03.691 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:20:03.545+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.691 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:20:03.545+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.691 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:20:03.545+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.692 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:20:03.545+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.692 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:20:03.545+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.692 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:20:03.546+0000 7f75af630800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.692 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:20:03.546+0000 7f75af630800 20 started sync module instance, tier type = 2024-09-12T00:20:03.692 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:20:03.546+0000 7f75af630800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:03.692 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=0 2024-09-12T00:20:03.692 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=1 2024-09-12T00:20:03.692 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=2 2024-09-12T00:20:03.692 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=3 2024-09-12T00:20:03.692 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=4 2024-09-12T00:20:03.692 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=5 2024-09-12T00:20:03.692 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:20:03.554+0000 7f75af630800 20 add_watcher() i=6 2024-09-12T00:20:03.692 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:20:03.555+0000 7f75af630800 20 add_watcher() i=7 2024-09-12T00:20:03.693 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:20:03.555+0000 7f75af630800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:03.693 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding auth protocol: cephx 2024-09-12T00:20:03.693 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding auth protocol: cephx 2024-09-12T00:20:03.693 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding auth protocol: cephx 2024-09-12T00:20:03.693 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: secure 2024-09-12T00:20:03.693 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: crc 2024-09-12T00:20:03.693 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: secure 2024-09-12T00:20:03.693 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: crc 2024-09-12T00:20:03.693 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: secure 2024-09-12T00:20:03.693 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: crc 2024-09-12T00:20:03.693 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:20:03.557+0000 7f74617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:03.693 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: crc 2024-09-12T00:20:03.693 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: secure 2024-09-12T00:20:03.693 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: crc 2024-09-12T00:20:03.694 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: secure 2024-09-12T00:20:03.694 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: crc 2024-09-12T00:20:03.694 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:20:03.557+0000 7f75af630800 5 AuthRegistry(0x7ffdd4790210) adding con mode: secure 2024-09-12T00:20:03.694 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:20:03.557+0000 7f75af630800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:03.694 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:20:03.557+0000 7f75af630800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:03.694 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:20:03.557+0000 7f75af630800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:03.694 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command cache list hook 0x55fa052aec70 2024-09-12T00:20:03.694 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command cache inspect hook 0x55fa052aec70 2024-09-12T00:20:03.694 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command cache erase hook 0x55fa052aec70 2024-09-12T00:20:03.694 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command cache zap hook 0x55fa052aec70 2024-09-12T00:20:03.694 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:20:03.558+0000 7f75af630800 5 note: GC not initialized 2024-09-12T00:20:03.694 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:20:03.558+0000 7f73dbfff640 20 reqs_thread_entry: start 2024-09-12T00:20:03.694 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command sync trace show hook 0x7f75a0088070 2024-09-12T00:20:03.695 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command sync trace history hook 0x7f75a0088070 2024-09-12T00:20:03.695 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command sync trace active hook 0x7f75a0088070 2024-09-12T00:20:03.695 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:20:03.558+0000 7f75af630800 5 asok(0x55fa04fc9630) register_command sync trace active_short hook 0x7f75a0088070 2024-09-12T00:20:03.695 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:20:03.558+0000 7f75af630800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:03.695 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:20:03.558+0000 7f75af630800 20 Filter name: none 2024-09-12T00:20:03.695 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:20:03.558+0000 7f73d9ffb640 20 reqs_thread_entry: start 2024-09-12T00:20:03.695 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:20:03.558+0000 7f75af630800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:20:03.695 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:20:03.558+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.695 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:20:03.559+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:03.695 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:20:03.559+0000 7f75af630800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:20:03.695 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:20:03.559+0000 7f75af630800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:20:03.695 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:20:03.559+0000 7f75af630800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 : miss 2024-09-12T00:20:03.695 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:20:03.559+0000 7f75af630800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.695 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:20:03.559+0000 7f75af630800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:20:03.695 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:20:03.559+0000 7f75af630800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:03.696 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:20:03.559+0000 7f75af630800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:03.696 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:20:03.559+0000 7f75af630800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:03.696 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:20:03.559+0000 7f75af630800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:03.696 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:20:03.559+0000 7f75af630800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 2024-09-12T00:20:03.696 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:20:03.563+0000 7f75af630800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:03.696 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:20:03.563+0000 7f75af630800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:03.696 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:20:03.563+0000 7f75af630800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:03.696 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:20:03.563+0000 7f75af630800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29, ofs0, ns] 2024-09-12T00:20:03.696 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:20:03.563+0000 7f748e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562486 cookie 94532317094496 notifier 6671 bl.length()=915 2024-09-12T00:20:03.696 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:20:03.563+0000 7f748e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:03.696 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:20:03.563+0000 7f748e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:03.696 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:20:03.563+0000 7f748e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:03.696 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:20:03.564+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_sources= new_sources= 2024-09-12T00:20:03.697 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:20:03.564+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential sources added=[] removed=[] 2024-09-12T00:20:03.697 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:20:03.564+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_dests= new_dests= 2024-09-12T00:20:03.697 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:20:03.564+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential dests added=[] removed=[] 2024-09-12T00:20:03.697 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:20:03.566+0000 7f75af630800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.1.0 2024-09-12T00:20:03.697 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:20:03.566+0000 7f75af630800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.1.0 2024-09-12T00:20:03.697 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:20:03.566+0000 7f75af630800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.1.1 2024-09-12T00:20:03.697 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:20:03.566+0000 7f75af630800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.1.1 2024-09-12T00:20:03.697 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:20:03.566+0000 7f75af630800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.0 2024-09-12T00:20:03.697 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:20:03.568+0000 7f75af630800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:03.697 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:20:03.568+0000 7f75af630800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 2024-09-12T00:20:03.697 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:20:03.569+0000 7f75af630800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:03.697 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:20:03.569+0000 7f75af630800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:03.697 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:20:03.569+0000 7f75af630800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:03.698 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:20:03.569+0000 7f75af630800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29, ofs0, ns] 2024-09-12T00:20:03.698 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:20:03.570+0000 7f748e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562487 cookie 94532317094496 notifier 6671 bl.length()=915 2024-09-12T00:20:03.698 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:20:03.570+0000 7f748e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:03.698 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:20:03.570+0000 7f748e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:03.698 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:20:03.570+0000 7f748e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:03.698 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:20:03.570+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_sources= new_sources= 2024-09-12T00:20:03.698 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:20:03.570+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential sources added=[] removed=[] 2024-09-12T00:20:03.698 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:20:03.570+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_dests= new_dests= 2024-09-12T00:20:03.698 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:20:03.570+0000 7f75af630800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential dests added=[] removed=[] 2024-09-12T00:20:03.698 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:20:03.571+0000 7f75af630800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f75af630800 time 2024-09-12T00:20:03.572142+0000 2024-09-12T00:20:03.698 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:20:03.698 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.698 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:03.699 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f75b038c71a] 2024-09-12T00:20:03.699 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75b038c8d8] 2024-09-12T00:20:03.699 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa042fc641] 2024-09-12T00:20:03.699 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55fa0430b582] 2024-09-12T00:20:03.699 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fa0430c3e4] 2024-09-12T00:20:03.699 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:20:03.699 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f75af029590] 2024-09-12T00:20:03.699 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:20:03.699 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:20:03.699 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.699 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:20:03.572+0000 7f75af630800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:20:03.699 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f75af630800 thread_name:radosgw-admin 2024-09-12T00:20:03.699 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.700 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:03.700 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f75af03e6f0] 2024-09-12T00:20:03.700 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f75af08b99c] 2024-09-12T00:20:03.700 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:20:03.700 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:20:03.700 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f75b038c774] 2024-09-12T00:20:03.700 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f75b038c8d8] 2024-09-12T00:20:03.700 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa042fc641] 2024-09-12T00:20:03.700 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55fa0430b582] 2024-09-12T00:20:03.700 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55fa0430c3e4] 2024-09-12T00:20:03.700 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:20:03.700 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f75af029590] 2024-09-12T00:20:03.700 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:20:03.701 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:20:03.701 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:20:03.701 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.701 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:20:03.701 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:20:03.701 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:20:03.701 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:20:03.701 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:20:03.701 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:20:03.701 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:20:03.701 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:20:03.701 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:20:03.701 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:20:03.702 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:20:03.702 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:20:03.702 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:20:03.702 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:20:03.702 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:20:03.702 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:20:03.702 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:20:03.702 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:20:03.702 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:20:03.702 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:20:03.702 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:20:03.702 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:20:03.702 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:20:03.703 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:20:03.703 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:20:03.703 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:20:03.703 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:20:03.703 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:20:03.703 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:20:03.703 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:20:03.703 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:20:03.703 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:20:03.703 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:20:03.703 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:20:03.703 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:20:03.703 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:20:03.703 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:20:03.704 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:20:03.704 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:20:03.704 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:20:03.704 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:20:03.704 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:20:03.704 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:20:03.704 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:20:03.704 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:20:03.704 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:20:03.704 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:20:03.704 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:20:03.704 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:20:03.704 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:20:03.705 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:20:03.705 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:20:03.705 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:20:03.705 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:20:03.705 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:20:03.705 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:20:03.705 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:20:03.705 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:20:03.705 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:20:03.705 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:20:03.705 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:20:03.705 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:20:03.705 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:20:03.705 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:20:03.706 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:20:03.706 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:20:03.706 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:20:03.706 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:20:03.706 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:20:03.706 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:20:03.706 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:20:03.706 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:20:03.706 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:20:03.706 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:20:03.706 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:20:03.706 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:20:03.706 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:20:03.706 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:20:03.707 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:20:03.707 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:20:03.707 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:20:03.707 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:20:03.707 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:20:03.707 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:20:03.707 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:20:03.707 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:20:03.707 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:20:03.707 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:20:03.707 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:20:03.707 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:20:03.707 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:20:03.707 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:20:03.708 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:20:03.708 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:20:03.708 INFO:tasks.workunit.client.0.smithi067.stderr: 7f73d9ffb640 / http_manager 2024-09-12T00:20:03.708 INFO:tasks.workunit.client.0.smithi067.stderr: 7f73dbfff640 / http_manager 2024-09-12T00:20:03.708 INFO:tasks.workunit.client.0.smithi067.stderr: 7f74617e2640 / rgw_dt_lg_renew 2024-09-12T00:20:03.708 INFO:tasks.workunit.client.0.smithi067.stderr: 7f748cff9640 / ms_dispatch 2024-09-12T00:20:03.708 INFO:tasks.workunit.client.0.smithi067.stderr: 7f748e7fc640 / io_context_pool 2024-09-12T00:20:03.708 INFO:tasks.workunit.client.0.smithi067.stderr: 7f7494e01640 / ms_dispatch 2024-09-12T00:20:03.708 INFO:tasks.workunit.client.0.smithi067.stderr: 7f7497606640 / ms_dispatch 2024-09-12T00:20:03.708 INFO:tasks.workunit.client.0.smithi067.stderr: 7f7498e09640 / io_context_pool 2024-09-12T00:20:03.708 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75aa1cb640 / msgr-worker-2 2024-09-12T00:20:03.708 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75aa9cc640 / msgr-worker-1 2024-09-12T00:20:03.708 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75ab1cd640 / msgr-worker-0 2024-09-12T00:20:03.709 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75ab9ce640 / io_context_pool 2024-09-12T00:20:03.709 INFO:tasks.workunit.client.0.smithi067.stderr: 7f75af630800 / radosgw-admin 2024-09-12T00:20:03.709 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:20:03.709 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:20:03.709 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:20:03.573786Z_3bbca8d7-981b-4a65-a8cf-a93074bcd1ab/log 2024-09-12T00:20:03.709 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:20:03.709 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:20:03.711 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:03.711 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:03.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.650+0000 7f1e32d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.652+0000 7f1e32d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.652+0000 7f1e32d2e800 20 realm 2024-09-12T00:20:03.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.652+0000 7f1e32d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.652+0000 7f1e32d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.652+0000 7f1e32d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:03.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.652+0000 7f1e32d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.652+0000 7f1e32d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.652+0000 7f1e32d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.653+0000 7f1e32d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:03.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.653+0000 7f1e32d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.654+0000 7f1e32d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:03.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.654+0000 7f1e32d2e800 20 searching for the correct realm 2024-09-12T00:20:03.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.656+0000 7f1e2e163640 0 -- 172.21.15.67:0/1215764753 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f1e2407b8d0 msgr2=0x7f1e240633a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:03.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.861+0000 7f1e2f165640 0 -- 172.21.15.67:0/1215764753 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5623a3193800 msgr2=0x5623a3195cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:03.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.865+0000 7f1e32d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:03.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.865+0000 7f1e32d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:03.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.865+0000 7f1e32d2e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:03.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.865+0000 7f1e32d2e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:03.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.865+0000 7f1e32d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:03.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.865+0000 7f1e32d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:03.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.865+0000 7f1e32d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.866+0000 7f1e32d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.866+0000 7f1e32d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.866+0000 7f1e32d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:03.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.866+0000 7f1e32d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.866+0000 7f1e32d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:03.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.866+0000 7f1e32d2e800 20 zone default found 2024-09-12T00:20:03.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.866+0000 7f1e32d2e800 4 Realm: () 2024-09-12T00:20:03.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.866+0000 7f1e32d2e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:03.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.866+0000 7f1e32d2e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:03.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.866+0000 7f1e32d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:03.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.866+0000 7f1e32d2e800 20 zonegroup default 2024-09-12T00:20:03.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.866+0000 7f1e32d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.866+0000 7f1e32d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.866+0000 7f1e32d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.867+0000 7f1e32d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.867+0000 7f1e32d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.867+0000 7f1e32d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:03.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.867+0000 7f1e32d2e800 20 started sync module instance, tier type = 2024-09-12T00:20:03.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.867+0000 7f1e32d2e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:03.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.875+0000 7f1e32d2e800 20 add_watcher() i=0 2024-09-12T00:20:03.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.875+0000 7f1e32d2e800 20 add_watcher() i=1 2024-09-12T00:20:03.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.875+0000 7f1e32d2e800 20 add_watcher() i=2 2024-09-12T00:20:03.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.875+0000 7f1e32d2e800 20 add_watcher() i=3 2024-09-12T00:20:03.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.875+0000 7f1e32d2e800 20 add_watcher() i=4 2024-09-12T00:20:03.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.875+0000 7f1e32d2e800 20 add_watcher() i=5 2024-09-12T00:20:03.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.875+0000 7f1e32d2e800 20 add_watcher() i=6 2024-09-12T00:20:03.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.876+0000 7f1e32d2e800 20 add_watcher() i=7 2024-09-12T00:20:03.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.876+0000 7f1e32d2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:03.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.878+0000 7f1ce57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:03.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.878+0000 7f1e32d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:03.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.878+0000 7f1e32d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:03.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.878+0000 7f1e32d2e800 5 note: GC not initialized 2024-09-12T00:20:03.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.878+0000 7f1c5ffff640 20 reqs_thread_entry: start 2024-09-12T00:20:03.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.878+0000 7f1e32d2e800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:03.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.878+0000 7f1e32d2e800 20 Filter name: none 2024-09-12T00:20:03.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.879+0000 7f1c5dffb640 20 reqs_thread_entry: start 2024-09-12T00:20:03.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.879+0000 7f1e32d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.879+0000 7f1e32d2e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:03.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.879+0000 7f1e32d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.880+0000 7f1e32d2e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:20:03.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.880+0000 7f1e32d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:03.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.880+0000 7f1e32d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.880+0000 7f1e32d2e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:03.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.880+0000 7f1e32d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:03.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.880+0000 7f1e32d2e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:20:03.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.880+0000 7f1e32d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:03.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.882+0000 7f1ce57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:03.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.884+0000 7f1e32d2e800 20 remove_watcher() i=0 2024-09-12T00:20:03.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.884+0000 7f1e32d2e800 2 removed watcher, disabling cache 2024-09-12T00:20:03.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.885+0000 7f1e32d2e800 20 remove_watcher() i=1 2024-09-12T00:20:03.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.886+0000 7f1e32d2e800 20 remove_watcher() i=2 2024-09-12T00:20:03.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.887+0000 7f1e32d2e800 20 remove_watcher() i=3 2024-09-12T00:20:03.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.888+0000 7f1e32d2e800 20 remove_watcher() i=4 2024-09-12T00:20:03.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.889+0000 7f1e32d2e800 20 remove_watcher() i=5 2024-09-12T00:20:03.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.890+0000 7f1e32d2e800 20 remove_watcher() i=6 2024-09-12T00:20:03.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:03.891+0000 7f1e32d2e800 20 remove_watcher() i=7 2024-09-12T00:20:03.901 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.901 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:20:03.901 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-block-writes id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:20:03.901 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:03.954 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:20:03.986 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:03.987 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:04.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.226+0000 7f35ccc70640 0 --2- 172.21.15.67:0/292252387 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55ac654d6b20 0x55ac654b9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:20:04.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.229+0000 7f35d0726800 20 rados->read ofs=0 len=0 2024-09-12T00:20:04.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.231+0000 7f35d0726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:04.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.231+0000 7f35d0726800 20 realm 2024-09-12T00:20:04.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.231+0000 7f35d0726800 20 rados->read ofs=0 len=0 2024-09-12T00:20:04.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.231+0000 7f35d0726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:04.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.231+0000 7f35d0726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:04.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.231+0000 7f35d0726800 20 rados->read ofs=0 len=0 2024-09-12T00:20:04.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.231+0000 7f35d0726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:04.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.231+0000 7f35d0726800 20 rados->read ofs=0 len=0 2024-09-12T00:20:04.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.232+0000 7f35d0726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:04.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.232+0000 7f35d0726800 20 rados->read ofs=0 len=0 2024-09-12T00:20:04.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.233+0000 7f35d0726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:04.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.233+0000 7f35d0726800 20 searching for the correct realm 2024-09-12T00:20:04.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.435+0000 7f35cc46f640 0 -- 172.21.15.67:0/292252387 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f35bc046040 msgr2=0x7f35bc018980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:20:04.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:04.841+0000 7f35cc46f640 0 -- 172.21.15.67:0/292252387 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f35c40a9fe0 msgr2=0x7f35c40b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:05.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.048+0000 7f35d0726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:05.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.048+0000 7f35d0726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:05.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.048+0000 7f35d0726800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:05.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.048+0000 7f35d0726800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:05.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.048+0000 7f35d0726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:05.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.048+0000 7f35d0726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:05.048 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.048+0000 7f35d0726800 20 rados->read ofs=0 len=0 2024-09-12T00:20:05.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.049+0000 7f35d0726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:05.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.049+0000 7f35d0726800 20 rados->read ofs=0 len=0 2024-09-12T00:20:05.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.049+0000 7f35d0726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:05.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.049+0000 7f35d0726800 20 rados->read ofs=0 len=0 2024-09-12T00:20:05.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.049+0000 7f35d0726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:05.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.049+0000 7f35d0726800 20 zone default found 2024-09-12T00:20:05.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.049+0000 7f35d0726800 4 Realm: () 2024-09-12T00:20:05.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.049+0000 7f35d0726800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:05.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.049+0000 7f35d0726800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:05.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.049+0000 7f35d0726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:05.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.049+0000 7f35d0726800 20 zonegroup default 2024-09-12T00:20:05.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.049+0000 7f35d0726800 20 rados->read ofs=0 len=0 2024-09-12T00:20:05.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.050+0000 7f35d0726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:05.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.050+0000 7f35d0726800 20 rados->read ofs=0 len=0 2024-09-12T00:20:05.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.050+0000 7f35d0726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:05.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.050+0000 7f35d0726800 20 rados->read ofs=0 len=0 2024-09-12T00:20:05.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.051+0000 7f35d0726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:05.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.051+0000 7f35d0726800 20 started sync module instance, tier type = 2024-09-12T00:20:05.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.051+0000 7f35d0726800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:05.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.060+0000 7f35d0726800 20 add_watcher() i=0 2024-09-12T00:20:05.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.060+0000 7f35d0726800 20 add_watcher() i=1 2024-09-12T00:20:05.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.060+0000 7f35d0726800 20 add_watcher() i=2 2024-09-12T00:20:05.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.060+0000 7f35d0726800 20 add_watcher() i=3 2024-09-12T00:20:05.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.060+0000 7f35d0726800 20 add_watcher() i=4 2024-09-12T00:20:05.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.060+0000 7f35d0726800 20 add_watcher() i=5 2024-09-12T00:20:05.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.060+0000 7f35d0726800 20 add_watcher() i=6 2024-09-12T00:20:05.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.061+0000 7f35d0726800 20 add_watcher() i=7 2024-09-12T00:20:05.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.061+0000 7f35d0726800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:05.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.064+0000 7f3482fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:05.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.064+0000 7f35d0726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:05.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.064+0000 7f35d0726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:05.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.064+0000 7f35d0726800 5 note: GC not initialized 2024-09-12T00:20:05.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.064+0000 7f3481fdb640 20 reqs_thread_entry: start 2024-09-12T00:20:05.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.065+0000 7f35d0726800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:05.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.065+0000 7f35d0726800 20 Filter name: none 2024-09-12T00:20:05.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.065+0000 7f33f37fe640 20 reqs_thread_entry: start 2024-09-12T00:20:05.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.065+0000 7f35d0726800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:20:05.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.065+0000 7f35d0726800 20 rados->read ofs=0 len=0 2024-09-12T00:20:05.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.065+0000 7f35d0726800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:05.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.065+0000 7f35d0726800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:20:05.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.065+0000 7f35d0726800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:20:05.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.065+0000 7f35d0726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 : miss 2024-09-12T00:20:05.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.065+0000 7f35d0726800 20 rados->read ofs=0 len=0 2024-09-12T00:20:05.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.066+0000 7f35d0726800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:20:05.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.066+0000 7f35d0726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:05.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.066+0000 7f35d0726800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:05.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.066+0000 7f35d0726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:05.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.066+0000 7f35d0726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:05.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.066+0000 7f35d0726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 2024-09-12T00:20:05.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.067+0000 7f35d0726800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to be held by another RGW process; skipping for now 2024-09-12T00:20:05.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.068+0000 7f3482fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:05.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.071+0000 7f35d0726800 20 remove_watcher() i=0 2024-09-12T00:20:05.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.071+0000 7f35d0726800 2 removed watcher, disabling cache 2024-09-12T00:20:05.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.072+0000 7f35d0726800 20 remove_watcher() i=1 2024-09-12T00:20:05.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.073+0000 7f35d0726800 20 remove_watcher() i=2 2024-09-12T00:20:05.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.074+0000 7f35d0726800 20 remove_watcher() i=3 2024-09-12T00:20:05.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.075+0000 7f35d0726800 20 remove_watcher() i=4 2024-09-12T00:20:05.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.077+0000 7f35d0726800 20 remove_watcher() i=5 2024-09-12T00:20:05.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.078+0000 7f35d0726800 20 remove_watcher() i=6 2024-09-12T00:20:05.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:05.078+0000 7f35d0726800 20 remove_watcher() i=7 2024-09-12T00:20:05.090 INFO:tasks.workunit.client.0.smithi067.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:20:35.124 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:20:35.159 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:35.160 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:35.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.209+0000 7f8737e96800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.211+0000 7f8737e96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:35.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.211+0000 7f8737e96800 20 realm 2024-09-12T00:20:35.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.211+0000 7f8737e96800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.211+0000 7f8737e96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:35.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.211+0000 7f8737e96800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:35.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.211+0000 7f8737e96800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.212+0000 7f8737e96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:35.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.212+0000 7f8737e96800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.213+0000 7f8737e96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:35.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.213+0000 7f8737e96800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.214+0000 7f8737e96800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:35.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.214+0000 7f8737e96800 20 searching for the correct realm 2024-09-12T00:20:35.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.216+0000 7f873517f640 0 -- 172.21.15.67:0/3179839664 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f872c0d36f0 msgr2=0x7f872c0c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:20:35.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.422+0000 7f8736181640 0 -- 172.21.15.67:0/3179839664 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5557f8bbd5c0 msgr2=0x5557f8bbf9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:35.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.428+0000 7f8737e96800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:35.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.428+0000 7f8737e96800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:35.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.428+0000 7f8737e96800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:35.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.428+0000 7f8737e96800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:35.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.428+0000 7f8737e96800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:35.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.428+0000 7f8737e96800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:35.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.428+0000 7f8737e96800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.428+0000 7f8737e96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:35.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.428+0000 7f8737e96800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.429+0000 7f8737e96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:35.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.429+0000 7f8737e96800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.429+0000 7f8737e96800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:35.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.429+0000 7f8737e96800 20 zone default found 2024-09-12T00:20:35.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.429+0000 7f8737e96800 4 Realm: () 2024-09-12T00:20:35.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.429+0000 7f8737e96800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:35.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.429+0000 7f8737e96800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:35.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.429+0000 7f8737e96800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:35.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.429+0000 7f8737e96800 20 zonegroup default 2024-09-12T00:20:35.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.429+0000 7f8737e96800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.430+0000 7f8737e96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:35.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.430+0000 7f8737e96800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.430+0000 7f8737e96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:35.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.430+0000 7f8737e96800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.431+0000 7f8737e96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:35.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.431+0000 7f8737e96800 20 started sync module instance, tier type = 2024-09-12T00:20:35.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.431+0000 7f8737e96800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:35.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.441+0000 7f8737e96800 20 add_watcher() i=0 2024-09-12T00:20:35.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.441+0000 7f8737e96800 20 add_watcher() i=1 2024-09-12T00:20:35.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.441+0000 7f8737e96800 20 add_watcher() i=2 2024-09-12T00:20:35.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.441+0000 7f8737e96800 20 add_watcher() i=3 2024-09-12T00:20:35.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.441+0000 7f8737e96800 20 add_watcher() i=4 2024-09-12T00:20:35.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.441+0000 7f8737e96800 20 add_watcher() i=5 2024-09-12T00:20:35.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.441+0000 7f8737e96800 20 add_watcher() i=6 2024-09-12T00:20:35.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.442+0000 7f8737e96800 20 add_watcher() i=7 2024-09-12T00:20:35.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.442+0000 7f8737e96800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:35.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.444+0000 7f85e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:35.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.444+0000 7f8737e96800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:35.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.444+0000 7f8737e96800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:35.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.445+0000 7f8737e96800 5 note: GC not initialized 2024-09-12T00:20:35.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.445+0000 7f85e67fc640 20 reqs_thread_entry: start 2024-09-12T00:20:35.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.445+0000 7f8737e96800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:35.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.445+0000 7f8737e96800 20 Filter name: none 2024-09-12T00:20:35.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.445+0000 7f8557fff640 20 reqs_thread_entry: start 2024-09-12T00:20:35.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.445+0000 7f8737e96800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:20:35.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.445+0000 7f8737e96800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.446+0000 7f8737e96800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:35.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.446+0000 7f8737e96800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:20:35.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.446+0000 7f8737e96800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:20:35.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.446+0000 7f8737e96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 : miss 2024-09-12T00:20:35.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.446+0000 7f8737e96800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.446+0000 7f8737e96800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:20:35.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.446+0000 7f8737e96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:35.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.446+0000 7f8737e96800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:35.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.446+0000 7f8737e96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:35.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.446+0000 7f8737e96800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:35.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.446+0000 7f8737e96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 2024-09-12T00:20:35.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.448+0000 7f8737e96800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:20:35.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.452+0000 7f8737e96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:35.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.452+0000 7f8737e96800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:35.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.452+0000 7f8737e96800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:35.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.452+0000 7f8737e96800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29, ofs0, ns] 2024-09-12T00:20:35.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.452+0000 7f86197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562488 cookie 93836323633424 notifier 6722 bl.length()=915 2024-09-12T00:20:35.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.452+0000 7f86197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:35.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.452+0000 7f86197fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:35.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.452+0000 7f86197fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:35.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.453+0000 7f8737e96800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_sources= new_sources= 2024-09-12T00:20:35.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.453+0000 7f8737e96800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential sources added=[] removed=[] 2024-09-12T00:20:35.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.453+0000 7f8737e96800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_dests= new_dests= 2024-09-12T00:20:35.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.453+0000 7f8737e96800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential dests added=[] removed=[] 2024-09-12T00:20:35.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.458+0000 7f8737e96800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.2.0 2024-09-12T00:20:35.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.458+0000 7f8737e96800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.2.0 2024-09-12T00:20:35.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.458+0000 7f8737e96800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.2.1 2024-09-12T00:20:35.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.458+0000 7f8737e96800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.2.1 2024-09-12T00:20:35.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.458+0000 7f8737e96800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.0 2024-09-12T00:20:35.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.461+0000 7f8737e96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:35.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.461+0000 7f8737e96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 2024-09-12T00:20:35.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.462+0000 7f8737e96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:35.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.462+0000 7f8737e96800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:35.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.462+0000 7f8737e96800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:35.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.462+0000 7f8737e96800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29, ofs0, ns] 2024-09-12T00:20:35.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.462+0000 7f8618ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562489 cookie 93836323633424 notifier 6722 bl.length()=915 2024-09-12T00:20:35.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.462+0000 7f8618ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:35.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.462+0000 7f8618ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:35.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.462+0000 7f8618ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:35.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.463+0000 7f8737e96800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_sources= new_sources= 2024-09-12T00:20:35.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.463+0000 7f8737e96800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential sources added=[] removed=[] 2024-09-12T00:20:35.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.463+0000 7f8737e96800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_dests= new_dests= 2024-09-12T00:20:35.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.463+0000 7f8737e96800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential dests added=[] removed=[] 2024-09-12T00:20:35.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.464+0000 7f8737e96800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29.0 2024-09-12T00:20:35.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.464+0000 7f8737e96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:35.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.464+0000 7f8737e96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 2024-09-12T00:20:35.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.466+0000 7f8737e96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:35.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.466+0000 7f8737e96800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:35.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.466+0000 7f8737e96800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:35.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.466+0000 7f8737e96800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29, ofs0, ns] 2024-09-12T00:20:35.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.466+0000 7f86197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562490 cookie 93836323633424 notifier 6722 bl.length()=883 2024-09-12T00:20:35.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.466+0000 7f86197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 info.flags=0x17 2024-09-12T00:20:35.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.466+0000 7f86197fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 to cache LRU end 2024-09-12T00:20:35.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.466+0000 7f86197fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:35.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.466+0000 7f8737e96800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_sources= new_sources= 2024-09-12T00:20:35.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.466+0000 7f8737e96800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential sources added=[] removed=[] 2024-09-12T00:20:35.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.466+0000 7f8737e96800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): orig_dests= new_dests= 2024-09-12T00:20:35.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.466+0000 7f8737e96800 20 handle_bi_update(): bucket=:abort-at-block-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29]): potential dests added=[] removed=[] 2024-09-12T00:20:35.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.468+0000 7f8737e96800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:20:35.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.470+0000 7f85e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:35.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.472+0000 7f8737e96800 20 remove_watcher() i=0 2024-09-12T00:20:35.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.472+0000 7f8737e96800 2 removed watcher, disabling cache 2024-09-12T00:20:35.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.473+0000 7f8737e96800 20 remove_watcher() i=1 2024-09-12T00:20:35.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.475+0000 7f8737e96800 20 remove_watcher() i=2 2024-09-12T00:20:35.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.476+0000 7f8737e96800 20 remove_watcher() i=3 2024-09-12T00:20:35.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.477+0000 7f8737e96800 20 remove_watcher() i=4 2024-09-12T00:20:35.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.478+0000 7f8737e96800 20 remove_watcher() i=5 2024-09-12T00:20:35.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.479+0000 7f8737e96800 20 remove_watcher() i=6 2024-09-12T00:20:35.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.480+0000 7f8737e96800 20 remove_watcher() i=7 2024-09-12T00:20:35.492 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:20:35.525 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:35.525 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:35.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.568+0000 7fc37d410800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.570+0000 7fc37d410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:35.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.570+0000 7fc37d410800 20 realm 2024-09-12T00:20:35.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.570+0000 7fc37d410800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.570+0000 7fc37d410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:35.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.570+0000 7fc37d410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:35.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.570+0000 7fc37d410800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.571+0000 7fc37d410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:35.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.571+0000 7fc37d410800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.571+0000 7fc37d410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:35.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.571+0000 7fc37d410800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.572+0000 7fc37d410800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:35.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.572+0000 7fc37d410800 20 searching for the correct realm 2024-09-12T00:20:35.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.575+0000 7fc3783bb640 0 -- 172.21.15.67:0/2757716127 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fc36c0b2bb0 msgr2=0x7fc36c0c08d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:20:35.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.781+0000 7fc3793bd640 0 -- 172.21.15.67:0/2757716127 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55bc7c06e5b0 msgr2=0x55bc7c070a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:35.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.786+0000 7fc37d410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:35.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.786+0000 7fc37d410800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:35.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.786+0000 7fc37d410800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:35.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.786+0000 7fc37d410800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:35.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.786+0000 7fc37d410800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:35.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.786+0000 7fc37d410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:35.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.786+0000 7fc37d410800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.786+0000 7fc37d410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:35.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.786+0000 7fc37d410800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.786+0000 7fc37d410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:35.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.786+0000 7fc37d410800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.787+0000 7fc37d410800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:35.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.787+0000 7fc37d410800 20 zone default found 2024-09-12T00:20:35.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.787+0000 7fc37d410800 4 Realm: () 2024-09-12T00:20:35.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.787+0000 7fc37d410800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:35.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.787+0000 7fc37d410800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:35.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.787+0000 7fc37d410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:35.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.787+0000 7fc37d410800 20 zonegroup default 2024-09-12T00:20:35.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.787+0000 7fc37d410800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.787+0000 7fc37d410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:35.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.787+0000 7fc37d410800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.787+0000 7fc37d410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:35.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.787+0000 7fc37d410800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.788+0000 7fc37d410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:35.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.788+0000 7fc37d410800 20 started sync module instance, tier type = 2024-09-12T00:20:35.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.788+0000 7fc37d410800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:35.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.797+0000 7fc37d410800 20 add_watcher() i=0 2024-09-12T00:20:35.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.797+0000 7fc37d410800 20 add_watcher() i=1 2024-09-12T00:20:35.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.797+0000 7fc37d410800 20 add_watcher() i=2 2024-09-12T00:20:35.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.797+0000 7fc37d410800 20 add_watcher() i=3 2024-09-12T00:20:35.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.797+0000 7fc37d410800 20 add_watcher() i=4 2024-09-12T00:20:35.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.797+0000 7fc37d410800 20 add_watcher() i=5 2024-09-12T00:20:35.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.797+0000 7fc37d410800 20 add_watcher() i=6 2024-09-12T00:20:35.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.798+0000 7fc37d410800 20 add_watcher() i=7 2024-09-12T00:20:35.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.798+0000 7fc37d410800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:35.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.800+0000 7fc22efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:35.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.800+0000 7fc37d410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:35.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.800+0000 7fc37d410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:35.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.800+0000 7fc37d410800 5 note: GC not initialized 2024-09-12T00:20:35.799 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.801+0000 7fc22dfe3640 20 reqs_thread_entry: start 2024-09-12T00:20:35.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.801+0000 7fc37d410800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:35.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.801+0000 7fc37d410800 20 Filter name: none 2024-09-12T00:20:35.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.801+0000 7fc19f7fe640 20 reqs_thread_entry: start 2024-09-12T00:20:35.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.801+0000 7fc37d410800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.801+0000 7fc37d410800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:35.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.801+0000 7fc37d410800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.802+0000 7fc37d410800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:20:35.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.802+0000 7fc37d410800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:35.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.802+0000 7fc37d410800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.802+0000 7fc37d410800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:20:35.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.802+0000 7fc37d410800 20 rados->read ofs=0 len=0 2024-09-12T00:20:35.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.803+0000 7fc37d410800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:20:35.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.803+0000 7fc37d410800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:35.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.804+0000 7fc22efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:35.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.806+0000 7fc37d410800 20 remove_watcher() i=0 2024-09-12T00:20:35.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.806+0000 7fc37d410800 2 removed watcher, disabling cache 2024-09-12T00:20:35.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.808+0000 7fc37d410800 20 remove_watcher() i=1 2024-09-12T00:20:35.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.809+0000 7fc37d410800 20 remove_watcher() i=2 2024-09-12T00:20:35.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.810+0000 7fc37d410800 20 remove_watcher() i=3 2024-09-12T00:20:35.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.811+0000 7fc37d410800 20 remove_watcher() i=4 2024-09-12T00:20:35.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.812+0000 7fc37d410800 20 remove_watcher() i=5 2024-09-12T00:20:35.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.814+0000 7fc37d410800 20 remove_watcher() i=6 2024-09-12T00:20:35.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:35.815+0000 7fc37d410800 20 remove_watcher() i=7 2024-09-12T00:20:35.824 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:35.824 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:20:35.825 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-block-writes id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:20:35.825 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:35.888 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T00:20:35.888 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:36.101 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:20:36.130 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:36.130 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:36.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.171+0000 7f0d2600e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.173+0000 7f0d2600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.173+0000 7f0d2600e800 20 realm 2024-09-12T00:20:36.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.173+0000 7f0d2600e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.173+0000 7f0d2600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.173+0000 7f0d2600e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:36.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.173+0000 7f0d2600e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.173+0000 7f0d2600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.173+0000 7f0d2600e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.174+0000 7f0d2600e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:36.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.174+0000 7f0d2600e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.175+0000 7f0d2600e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:36.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.175+0000 7f0d2600e800 20 searching for the correct realm 2024-09-12T00:20:36.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.177+0000 7f0d20f6a640 0 -- 172.21.15.67:0/1925183302 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f0d180b2c20 msgr2=0x7f0d180df920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:36.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.382+0000 7f0d20f6a640 0 -- 172.21.15.67:0/1925183302 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55606e2a4050 msgr2=0x55606e2a6440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:36.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.386+0000 7f0d2600e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:36.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.386+0000 7f0d2600e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:36.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.386+0000 7f0d2600e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:36.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.386+0000 7f0d2600e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:36.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.386+0000 7f0d2600e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:36.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.386+0000 7f0d2600e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:36.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.386+0000 7f0d2600e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.386+0000 7f0d2600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.386+0000 7f0d2600e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.386+0000 7f0d2600e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:36.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.386+0000 7f0d2600e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.387+0000 7f0d2600e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:36.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.387+0000 7f0d2600e800 20 zone default found 2024-09-12T00:20:36.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.387+0000 7f0d2600e800 4 Realm: () 2024-09-12T00:20:36.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.387+0000 7f0d2600e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:36.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.387+0000 7f0d2600e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:36.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.387+0000 7f0d2600e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:36.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.387+0000 7f0d2600e800 20 zonegroup default 2024-09-12T00:20:36.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.387+0000 7f0d2600e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.387+0000 7f0d2600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.387+0000 7f0d2600e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.387+0000 7f0d2600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.387+0000 7f0d2600e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.388+0000 7f0d2600e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.388+0000 7f0d2600e800 20 started sync module instance, tier type = 2024-09-12T00:20:36.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.388+0000 7f0d2600e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:36.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.396+0000 7f0d2600e800 20 add_watcher() i=0 2024-09-12T00:20:36.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.396+0000 7f0d2600e800 20 add_watcher() i=1 2024-09-12T00:20:36.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.396+0000 7f0d2600e800 20 add_watcher() i=2 2024-09-12T00:20:36.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.396+0000 7f0d2600e800 20 add_watcher() i=3 2024-09-12T00:20:36.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.396+0000 7f0d2600e800 20 add_watcher() i=4 2024-09-12T00:20:36.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.396+0000 7f0d2600e800 20 add_watcher() i=5 2024-09-12T00:20:36.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.396+0000 7f0d2600e800 20 add_watcher() i=6 2024-09-12T00:20:36.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.397+0000 7f0d2600e800 20 add_watcher() i=7 2024-09-12T00:20:36.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.397+0000 7f0d2600e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:36.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.399+0000 7f0bd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:36.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.399+0000 7f0d2600e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:36.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.399+0000 7f0d2600e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:36.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.399+0000 7f0d2600e800 5 note: GC not initialized 2024-09-12T00:20:36.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.400+0000 7f0bd67e4640 20 reqs_thread_entry: start 2024-09-12T00:20:36.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.400+0000 7f0d2600e800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:36.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.400+0000 7f0d2600e800 20 Filter name: none 2024-09-12T00:20:36.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.400+0000 7f0b47fff640 20 reqs_thread_entry: start 2024-09-12T00:20:36.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.400+0000 7f0d2600e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.401+0000 7f0d2600e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:36.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.401+0000 7f0d2600e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.401+0000 7f0d2600e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:20:36.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.401+0000 7f0d2600e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:36.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.401+0000 7f0d2600e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.401+0000 7f0d2600e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:36.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.401+0000 7f0d2600e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.402+0000 7f0d2600e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:20:36.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.402+0000 7f0d2600e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:36.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.403+0000 7f0bd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:36.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.405+0000 7f0d2600e800 20 remove_watcher() i=0 2024-09-12T00:20:36.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.405+0000 7f0d2600e800 2 removed watcher, disabling cache 2024-09-12T00:20:36.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.406+0000 7f0d2600e800 20 remove_watcher() i=1 2024-09-12T00:20:36.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.407+0000 7f0d2600e800 20 remove_watcher() i=2 2024-09-12T00:20:36.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.408+0000 7f0d2600e800 20 remove_watcher() i=3 2024-09-12T00:20:36.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.409+0000 7f0d2600e800 20 remove_watcher() i=4 2024-09-12T00:20:36.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.410+0000 7f0d2600e800 20 remove_watcher() i=5 2024-09-12T00:20:36.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.411+0000 7f0d2600e800 20 remove_watcher() i=6 2024-09-12T00:20:36.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.412+0000 7f0d2600e800 20 remove_watcher() i=7 2024-09-12T00:20:36.421 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:36.421 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:20:36.421 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-commit-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:20:36.421 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:36.423 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T00:20:36.457 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:36.457 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:36.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.498+0000 7fa150c98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.501+0000 7fa150c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.501+0000 7fa150c98800 20 realm 2024-09-12T00:20:36.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.501+0000 7fa150c98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.501+0000 7fa150c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.501+0000 7fa150c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:36.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.501+0000 7fa150c98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.501+0000 7fa150c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.501+0000 7fa150c98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.502+0000 7fa150c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:36.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.502+0000 7fa150c98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.503+0000 7fa150c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:36.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.503+0000 7fa150c98800 20 searching for the correct realm 2024-09-12T00:20:36.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.506+0000 7fa14df81640 0 -- 172.21.15.67:0/2629923366 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fa1440d2c00 msgr2=0x7fa1440b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:20:36.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.712+0000 7fa14ef83640 0 -- 172.21.15.67:0/2629923366 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55b614b2e410 msgr2=0x55b614b30840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:36.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.717+0000 7fa150c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:36.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.717+0000 7fa150c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:36.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.717+0000 7fa150c98800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:36.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.717+0000 7fa150c98800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:36.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.717+0000 7fa150c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:36.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.717+0000 7fa150c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:36.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.717+0000 7fa150c98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.717+0000 7fa150c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.717+0000 7fa150c98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.718+0000 7fa150c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:36.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.718+0000 7fa150c98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.718+0000 7fa150c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:36.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.718+0000 7fa150c98800 20 zone default found 2024-09-12T00:20:36.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.718+0000 7fa150c98800 4 Realm: () 2024-09-12T00:20:36.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.718+0000 7fa150c98800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:36.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.718+0000 7fa150c98800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:36.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.718+0000 7fa150c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:36.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.718+0000 7fa150c98800 20 zonegroup default 2024-09-12T00:20:36.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.718+0000 7fa150c98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.718+0000 7fa150c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.718+0000 7fa150c98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.718+0000 7fa150c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.718+0000 7fa150c98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.719+0000 7fa150c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.719+0000 7fa150c98800 20 started sync module instance, tier type = 2024-09-12T00:20:36.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.719+0000 7fa150c98800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:36.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.728+0000 7fa150c98800 20 add_watcher() i=0 2024-09-12T00:20:36.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.728+0000 7fa150c98800 20 add_watcher() i=1 2024-09-12T00:20:36.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.728+0000 7fa150c98800 20 add_watcher() i=2 2024-09-12T00:20:36.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.728+0000 7fa150c98800 20 add_watcher() i=3 2024-09-12T00:20:36.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.728+0000 7fa150c98800 20 add_watcher() i=4 2024-09-12T00:20:36.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.728+0000 7fa150c98800 20 add_watcher() i=5 2024-09-12T00:20:36.726 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.728+0000 7fa150c98800 20 add_watcher() i=6 2024-09-12T00:20:36.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.728+0000 7fa150c98800 20 add_watcher() i=7 2024-09-12T00:20:36.727 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.728+0000 7fa150c98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:36.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.730+0000 7fa004fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:36.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.730+0000 7fa150c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:36.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.730+0000 7fa150c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:36.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.731+0000 7fa150c98800 5 note: GC not initialized 2024-09-12T00:20:36.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.731+0000 7f9f7f7fe640 20 reqs_thread_entry: start 2024-09-12T00:20:36.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.731+0000 7fa150c98800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:36.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.731+0000 7fa150c98800 20 Filter name: none 2024-09-12T00:20:36.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.731+0000 7f9f7d7fa640 20 reqs_thread_entry: start 2024-09-12T00:20:36.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.731+0000 7fa150c98800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:20:36.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.731+0000 7fa150c98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.731+0000 7fa150c98800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:36.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.731+0000 7fa150c98800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:20:36.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.731+0000 7fa150c98800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:20:36.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.731+0000 7fa150c98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 : miss 2024-09-12T00:20:36.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.731+0000 7fa150c98800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.732+0000 7fa150c98800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:20:36.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.732+0000 7fa150c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 info.flags=0x17 2024-09-12T00:20:36.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.732+0000 7fa150c98800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 to cache LRU end 2024-09-12T00:20:36.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.732+0000 7fa150c98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:36.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.732+0000 7fa150c98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:36.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.732+0000 7fa150c98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 2024-09-12T00:20:36.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.735+0000 7fa150c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 info.flags=0x17 2024-09-12T00:20:36.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.735+0000 7fa150c98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 to cache LRU end 2024-09-12T00:20:36.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.735+0000 7fa150c98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:36.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.735+0000 7fa150c98800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30, ofs0, ns] 2024-09-12T00:20:36.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.736+0000 7fa0317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562438 cookie 94240519685936 notifier 6770 bl.length()=931 2024-09-12T00:20:36.734 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.736+0000 7fa0317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 info.flags=0x17 2024-09-12T00:20:36.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.736+0000 7fa0317fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 to cache LRU end 2024-09-12T00:20:36.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.736+0000 7fa0317fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:36.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.736+0000 7fa150c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): orig_sources= new_sources= 2024-09-12T00:20:36.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.736+0000 7fa150c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): potential sources added=[] removed=[] 2024-09-12T00:20:36.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.736+0000 7fa150c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): orig_dests= new_dests= 2024-09-12T00:20:36.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.736+0000 7fa150c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): potential dests added=[] removed=[] 2024-09-12T00:20:36.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.738+0000 7fa150c98800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30.1.0 2024-09-12T00:20:36.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.738+0000 7fa150c98800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30.1.0 2024-09-12T00:20:36.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.738+0000 7fa150c98800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30.1.1 2024-09-12T00:20:36.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.738+0000 7fa150c98800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30.1.1 2024-09-12T00:20:36.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.738+0000 7fa150c98800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30.0 2024-09-12T00:20:36.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.741+0000 7fa150c98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:36.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.741+0000 7fa150c98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 2024-09-12T00:20:36.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.742+0000 7fa150c98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 info.flags=0x17 2024-09-12T00:20:36.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.742+0000 7fa150c98800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 to cache LRU end 2024-09-12T00:20:36.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.742+0000 7fa150c98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:36.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.742+0000 7fa150c98800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30, ofs0, ns] 2024-09-12T00:20:36.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.742+0000 7fa0317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562439 cookie 94240519685936 notifier 6770 bl.length()=931 2024-09-12T00:20:36.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.742+0000 7fa0317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 info.flags=0x17 2024-09-12T00:20:36.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.742+0000 7fa0317fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 to cache LRU end 2024-09-12T00:20:36.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.742+0000 7fa0317fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:36.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.743+0000 7fa150c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): orig_sources= new_sources= 2024-09-12T00:20:36.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.743+0000 7fa150c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): potential sources added=[] removed=[] 2024-09-12T00:20:36.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.743+0000 7fa150c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): orig_dests= new_dests= 2024-09-12T00:20:36.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.743+0000 7fa150c98800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): potential dests added=[] removed=[] 2024-09-12T00:20:36.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.744+0000 7fa150c98800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30.0 2024-09-12T00:20:36.742 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.744+0000 7fa150c98800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T00:20:36.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.744+0000 7fa150c98800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T00:20:36.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.747+0000 7fa004fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:36.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.749+0000 7fa150c98800 20 remove_watcher() i=0 2024-09-12T00:20:36.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.749+0000 7fa150c98800 2 removed watcher, disabling cache 2024-09-12T00:20:36.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.750+0000 7fa150c98800 20 remove_watcher() i=1 2024-09-12T00:20:36.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.751+0000 7fa150c98800 20 remove_watcher() i=2 2024-09-12T00:20:36.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.752+0000 7fa150c98800 20 remove_watcher() i=3 2024-09-12T00:20:36.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.753+0000 7fa150c98800 20 remove_watcher() i=4 2024-09-12T00:20:36.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.754+0000 7fa150c98800 20 remove_watcher() i=5 2024-09-12T00:20:36.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.755+0000 7fa150c98800 20 remove_watcher() i=6 2024-09-12T00:20:36.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.756+0000 7fa150c98800 20 remove_watcher() i=7 2024-09-12T00:20:36.767 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:20:36.796 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:36.797 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:36.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.837+0000 7fe49af2a800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.839+0000 7fe49af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.839+0000 7fe49af2a800 20 realm 2024-09-12T00:20:36.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.839+0000 7fe49af2a800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.840+0000 7fe49af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.840+0000 7fe49af2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:36.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.840+0000 7fe49af2a800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.840+0000 7fe49af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:36.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.840+0000 7fe49af2a800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.841+0000 7fe49af2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:36.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.841+0000 7fe49af2a800 20 rados->read ofs=0 len=0 2024-09-12T00:20:36.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.845+0000 7fe49af2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:36.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.845+0000 7fe49af2a800 20 searching for the correct realm 2024-09-12T00:20:36.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:36.850+0000 7fe496360640 0 -- 172.21.15.67:0/707649687 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fe48c06ac30 msgr2=0x7fe48c069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:37.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.055+0000 7fe497362640 0 -- 172.21.15.67:0/707649687 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5573bc49ffb0 msgr2=0x5573bc4a23a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:37.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.059+0000 7fe49af2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:37.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.059+0000 7fe49af2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:37.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.059+0000 7fe49af2a800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:37.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.059+0000 7fe49af2a800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:37.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.059+0000 7fe49af2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:37.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.059+0000 7fe49af2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:37.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.059+0000 7fe49af2a800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.060+0000 7fe49af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.060+0000 7fe49af2a800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.060+0000 7fe49af2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:37.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.060+0000 7fe49af2a800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.060+0000 7fe49af2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:37.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.060+0000 7fe49af2a800 20 zone default found 2024-09-12T00:20:37.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.060+0000 7fe49af2a800 4 Realm: () 2024-09-12T00:20:37.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.060+0000 7fe49af2a800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:37.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.060+0000 7fe49af2a800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:37.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.060+0000 7fe49af2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:37.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.060+0000 7fe49af2a800 20 zonegroup default 2024-09-12T00:20:37.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.060+0000 7fe49af2a800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.060+0000 7fe49af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.060+0000 7fe49af2a800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.061+0000 7fe49af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.061+0000 7fe49af2a800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.061+0000 7fe49af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.061+0000 7fe49af2a800 20 started sync module instance, tier type = 2024-09-12T00:20:37.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.061+0000 7fe49af2a800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:37.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.070+0000 7fe49af2a800 20 add_watcher() i=0 2024-09-12T00:20:37.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.070+0000 7fe49af2a800 20 add_watcher() i=1 2024-09-12T00:20:37.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.070+0000 7fe49af2a800 20 add_watcher() i=2 2024-09-12T00:20:37.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.070+0000 7fe49af2a800 20 add_watcher() i=3 2024-09-12T00:20:37.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.070+0000 7fe49af2a800 20 add_watcher() i=4 2024-09-12T00:20:37.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.070+0000 7fe49af2a800 20 add_watcher() i=5 2024-09-12T00:20:37.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.070+0000 7fe49af2a800 20 add_watcher() i=6 2024-09-12T00:20:37.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.071+0000 7fe49af2a800 20 add_watcher() i=7 2024-09-12T00:20:37.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.071+0000 7fe49af2a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:37.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.072+0000 7fe34d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:37.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.073+0000 7fe49af2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:37.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.073+0000 7fe49af2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:37.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.073+0000 7fe49af2a800 5 note: GC not initialized 2024-09-12T00:20:37.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.073+0000 7fe2c7fff640 20 reqs_thread_entry: start 2024-09-12T00:20:37.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.073+0000 7fe49af2a800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:37.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.073+0000 7fe49af2a800 20 Filter name: none 2024-09-12T00:20:37.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.073+0000 7fe2c5ffb640 20 reqs_thread_entry: start 2024-09-12T00:20:37.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.073+0000 7fe49af2a800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.074+0000 7fe49af2a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:37.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.074+0000 7fe49af2a800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.074+0000 7fe49af2a800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:20:37.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.074+0000 7fe49af2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:37.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.074+0000 7fe49af2a800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.075+0000 7fe49af2a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:37.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.075+0000 7fe49af2a800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.075+0000 7fe49af2a800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:20:37.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.075+0000 7fe49af2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:37.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.076+0000 7fe34d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:37.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.079+0000 7fe49af2a800 20 remove_watcher() i=0 2024-09-12T00:20:37.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.079+0000 7fe49af2a800 2 removed watcher, disabling cache 2024-09-12T00:20:37.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.080+0000 7fe49af2a800 20 remove_watcher() i=1 2024-09-12T00:20:37.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.080+0000 7fe49af2a800 20 remove_watcher() i=2 2024-09-12T00:20:37.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.081+0000 7fe49af2a800 20 remove_watcher() i=3 2024-09-12T00:20:37.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.082+0000 7fe49af2a800 20 remove_watcher() i=4 2024-09-12T00:20:37.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.083+0000 7fe49af2a800 20 remove_watcher() i=5 2024-09-12T00:20:37.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.084+0000 7fe49af2a800 20 remove_watcher() i=6 2024-09-12T00:20:37.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.085+0000 7fe49af2a800 20 remove_watcher() i=7 2024-09-12T00:20:37.094 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:37.095 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:20:37.095 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-commit-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:20:37.095 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:37.147 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:20:37.185 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:37.185 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:37.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.228+0000 7f9c45a10800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.230+0000 7f9c45a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.230+0000 7f9c45a10800 20 realm 2024-09-12T00:20:37.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.230+0000 7f9c45a10800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.230+0000 7f9c45a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.230+0000 7f9c45a10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:37.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.230+0000 7f9c45a10800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.230+0000 7f9c45a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.230+0000 7f9c45a10800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.231+0000 7f9c45a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:37.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.231+0000 7f9c45a10800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.232+0000 7f9c45a10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:37.230 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.232+0000 7f9c45a10800 20 searching for the correct realm 2024-09-12T00:20:37.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.235+0000 7f9c410cb640 0 -- 172.21.15.67:0/3184087348 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f9c34003d40 msgr2=0x7f9c340cb0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:37.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.238+0000 7f9c410cb640 0 -- 172.21.15.67:0/3184087348 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f9c3c069d50 msgr2=0x7f9c3c068ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:37.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.242+0000 7f9c45a10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:37.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.242+0000 7f9c45a10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:37.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.242+0000 7f9c45a10800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:37.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.242+0000 7f9c45a10800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:37.240 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.242+0000 7f9c45a10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:37.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.242+0000 7f9c45a10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:37.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.242+0000 7f9c45a10800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.242+0000 7f9c45a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.241 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.242+0000 7f9c45a10800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.242+0000 7f9c45a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:37.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.242+0000 7f9c45a10800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.243+0000 7f9c45a10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:37.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.243+0000 7f9c45a10800 20 zone default found 2024-09-12T00:20:37.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.243+0000 7f9c45a10800 4 Realm: () 2024-09-12T00:20:37.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.243+0000 7f9c45a10800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:37.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.243+0000 7f9c45a10800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:37.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.243+0000 7f9c45a10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:37.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.243+0000 7f9c45a10800 20 zonegroup default 2024-09-12T00:20:37.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.243+0000 7f9c45a10800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.243+0000 7f9c45a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.243+0000 7f9c45a10800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.243+0000 7f9c45a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.243+0000 7f9c45a10800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.244+0000 7f9c45a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.244+0000 7f9c45a10800 20 started sync module instance, tier type = 2024-09-12T00:20:37.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.244+0000 7f9c45a10800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:37.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.252+0000 7f9c45a10800 20 add_watcher() i=0 2024-09-12T00:20:37.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.252+0000 7f9c45a10800 20 add_watcher() i=1 2024-09-12T00:20:37.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.252+0000 7f9c45a10800 20 add_watcher() i=2 2024-09-12T00:20:37.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.252+0000 7f9c45a10800 20 add_watcher() i=3 2024-09-12T00:20:37.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.252+0000 7f9c45a10800 20 add_watcher() i=4 2024-09-12T00:20:37.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.252+0000 7f9c45a10800 20 add_watcher() i=5 2024-09-12T00:20:37.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.252+0000 7f9c45a10800 20 add_watcher() i=6 2024-09-12T00:20:37.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.253+0000 7f9c45a10800 20 add_watcher() i=7 2024-09-12T00:20:37.251 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.253+0000 7f9c45a10800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:37.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.254+0000 7f9af7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:37.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.255+0000 7f9c45a10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:37.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.255+0000 7f9c45a10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:37.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.255+0000 7f9c45a10800 5 note: GC not initialized 2024-09-12T00:20:37.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.255+0000 7f9af6fe5640 20 reqs_thread_entry: start 2024-09-12T00:20:37.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.255+0000 7f9c45a10800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:37.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.255+0000 7f9c45a10800 20 Filter name: none 2024-09-12T00:20:37.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.255+0000 7f9af4fe1640 20 reqs_thread_entry: start 2024-09-12T00:20:37.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.255+0000 7f9c45a10800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:20:37.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.255+0000 7f9c45a10800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.256+0000 7f9c45a10800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:37.255 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.256+0000 7f9c45a10800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:20:37.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.256+0000 7f9c45a10800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:20:37.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.256+0000 7f9c45a10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 : miss 2024-09-12T00:20:37.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.256+0000 7f9c45a10800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.256+0000 7f9c45a10800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:20:37.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.256+0000 7f9c45a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 info.flags=0x17 2024-09-12T00:20:37.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.256+0000 7f9c45a10800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 to cache LRU end 2024-09-12T00:20:37.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.256+0000 7f9c45a10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:37.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.256+0000 7f9c45a10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:37.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.256+0000 7f9c45a10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 2024-09-12T00:20:37.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.257+0000 7f9c45a10800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:20:37.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.261+0000 7f9c45a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 info.flags=0x17 2024-09-12T00:20:37.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.261+0000 7f9c45a10800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 to cache LRU end 2024-09-12T00:20:37.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.261+0000 7f9c45a10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:37.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.261+0000 7f9c45a10800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30, ofs0, ns] 2024-09-12T00:20:37.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.262+0000 7f9b24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562440 cookie 94210057546624 notifier 7263 bl.length()=931 2024-09-12T00:20:37.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.262+0000 7f9b24ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 info.flags=0x17 2024-09-12T00:20:37.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.262+0000 7f9b24ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 to cache LRU end 2024-09-12T00:20:37.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.262+0000 7f9b24ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:37.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.262+0000 7f9c45a10800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): orig_sources= new_sources= 2024-09-12T00:20:37.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.262+0000 7f9c45a10800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): potential sources added=[] removed=[] 2024-09-12T00:20:37.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.262+0000 7f9c45a10800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): orig_dests= new_dests= 2024-09-12T00:20:37.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.262+0000 7f9c45a10800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): potential dests added=[] removed=[] 2024-09-12T00:20:37.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.264+0000 7f9c45a10800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30.2.0 2024-09-12T00:20:37.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.264+0000 7f9c45a10800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30.2.0 2024-09-12T00:20:37.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.264+0000 7f9c45a10800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30.2.1 2024-09-12T00:20:37.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.264+0000 7f9c45a10800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30.2.1 2024-09-12T00:20:37.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.264+0000 7f9c45a10800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30.0 2024-09-12T00:20:37.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.267+0000 7f9c45a10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:37.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.267+0000 7f9c45a10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 2024-09-12T00:20:37.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.268+0000 7f9c45a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 info.flags=0x17 2024-09-12T00:20:37.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.268+0000 7f9c45a10800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 to cache LRU end 2024-09-12T00:20:37.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.268+0000 7f9c45a10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:37.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.268+0000 7f9c45a10800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30, ofs0, ns] 2024-09-12T00:20:37.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.268+0000 7f9b24ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562441 cookie 94210057546624 notifier 7263 bl.length()=931 2024-09-12T00:20:37.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.268+0000 7f9b24ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 info.flags=0x17 2024-09-12T00:20:37.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.268+0000 7f9b24ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 to cache LRU end 2024-09-12T00:20:37.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.268+0000 7f9b24ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:37.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.269+0000 7f9c45a10800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): orig_sources= new_sources= 2024-09-12T00:20:37.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.269+0000 7f9c45a10800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): potential sources added=[] removed=[] 2024-09-12T00:20:37.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.269+0000 7f9c45a10800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): orig_dests= new_dests= 2024-09-12T00:20:37.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.269+0000 7f9c45a10800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): potential dests added=[] removed=[] 2024-09-12T00:20:37.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.270+0000 7f9c45a10800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30.0 2024-09-12T00:20:37.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.270+0000 7f9c45a10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:37.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.270+0000 7f9c45a10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 2024-09-12T00:20:37.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.271+0000 7f9c45a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 info.flags=0x17 2024-09-12T00:20:37.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.271+0000 7f9c45a10800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 to cache LRU end 2024-09-12T00:20:37.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.271+0000 7f9c45a10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:37.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.271+0000 7f9c45a10800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30, ofs0, ns] 2024-09-12T00:20:37.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.272+0000 7f9b13fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562442 cookie 94210057546624 notifier 7263 bl.length()=899 2024-09-12T00:20:37.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.272+0000 7f9b13fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 info.flags=0x17 2024-09-12T00:20:37.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.272+0000 7f9b13fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 to cache LRU end 2024-09-12T00:20:37.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.272+0000 7f9b13fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:37.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.272+0000 7f9c45a10800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): orig_sources= new_sources= 2024-09-12T00:20:37.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.272+0000 7f9c45a10800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): potential sources added=[] removed=[] 2024-09-12T00:20:37.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.272+0000 7f9c45a10800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): orig_dests= new_dests= 2024-09-12T00:20:37.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.272+0000 7f9c45a10800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30]): potential dests added=[] removed=[] 2024-09-12T00:20:37.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.273+0000 7f9c45a10800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:20:37.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.275+0000 7f9af7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:37.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.277+0000 7f9c45a10800 20 remove_watcher() i=0 2024-09-12T00:20:37.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.277+0000 7f9c45a10800 2 removed watcher, disabling cache 2024-09-12T00:20:37.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.278+0000 7f9c45a10800 20 remove_watcher() i=1 2024-09-12T00:20:37.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.279+0000 7f9c45a10800 20 remove_watcher() i=2 2024-09-12T00:20:37.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.280+0000 7f9c45a10800 20 remove_watcher() i=3 2024-09-12T00:20:37.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.281+0000 7f9c45a10800 20 remove_watcher() i=4 2024-09-12T00:20:37.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.282+0000 7f9c45a10800 20 remove_watcher() i=5 2024-09-12T00:20:37.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.283+0000 7f9c45a10800 20 remove_watcher() i=6 2024-09-12T00:20:37.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.284+0000 7f9c45a10800 20 remove_watcher() i=7 2024-09-12T00:20:37.295 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:20:37.324 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:37.324 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:37.363 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.365+0000 7f9bc6946800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.366+0000 7f9bc6946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.366+0000 7f9bc6946800 20 realm 2024-09-12T00:20:37.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.366+0000 7f9bc6946800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.367+0000 7f9bc6946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.367+0000 7f9bc6946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:37.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.367+0000 7f9bc6946800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.367+0000 7f9bc6946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.365 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.367+0000 7f9bc6946800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.367+0000 7f9bc6946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:37.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.367+0000 7f9bc6946800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.368+0000 7f9bc6946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:37.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.368+0000 7f9bc6946800 20 searching for the correct realm 2024-09-12T00:20:37.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.371+0000 7f9bc3c2f640 0 -- 172.21.15.67:0/1983105704 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f9bac067920 msgr2=0x7f9bac0821b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:37.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.577+0000 7f9bc4c31640 0 -- 172.21.15.67:0/1983105704 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x561bd7183060 msgr2=0x561bd7185520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.581+0000 7f9bc6946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.581+0000 7f9bc6946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.581+0000 7f9bc6946800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.581+0000 7f9bc6946800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.581+0000 7f9bc6946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.581+0000 7f9bc6946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.581+0000 7f9bc6946800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.582+0000 7f9bc6946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.582+0000 7f9bc6946800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.582+0000 7f9bc6946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:37.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.582+0000 7f9bc6946800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.582+0000 7f9bc6946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:37.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.582+0000 7f9bc6946800 20 zone default found 2024-09-12T00:20:37.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.582+0000 7f9bc6946800 4 Realm: () 2024-09-12T00:20:37.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.582+0000 7f9bc6946800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:37.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.582+0000 7f9bc6946800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:37.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.582+0000 7f9bc6946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:37.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.582+0000 7f9bc6946800 20 zonegroup default 2024-09-12T00:20:37.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.582+0000 7f9bc6946800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.583+0000 7f9bc6946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.583+0000 7f9bc6946800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.583+0000 7f9bc6946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.583+0000 7f9bc6946800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.583+0000 7f9bc6946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.583+0000 7f9bc6946800 20 started sync module instance, tier type = 2024-09-12T00:20:37.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.583+0000 7f9bc6946800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:37.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.592+0000 7f9bc6946800 20 add_watcher() i=0 2024-09-12T00:20:37.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.592+0000 7f9bc6946800 20 add_watcher() i=1 2024-09-12T00:20:37.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.592+0000 7f9bc6946800 20 add_watcher() i=2 2024-09-12T00:20:37.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.592+0000 7f9bc6946800 20 add_watcher() i=3 2024-09-12T00:20:37.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.592+0000 7f9bc6946800 20 add_watcher() i=4 2024-09-12T00:20:37.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.592+0000 7f9bc6946800 20 add_watcher() i=5 2024-09-12T00:20:37.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.592+0000 7f9bc6946800 20 add_watcher() i=6 2024-09-12T00:20:37.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.593+0000 7f9bc6946800 20 add_watcher() i=7 2024-09-12T00:20:37.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.593+0000 7f9bc6946800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:37.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.596+0000 7f9a7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:37.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.596+0000 7f9bc6946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:37.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.596+0000 7f9bc6946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:37.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.596+0000 7f9bc6946800 5 note: GC not initialized 2024-09-12T00:20:37.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.596+0000 7f9a79fe3640 20 reqs_thread_entry: start 2024-09-12T00:20:37.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.596+0000 7f9bc6946800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:37.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.596+0000 7f9bc6946800 20 Filter name: none 2024-09-12T00:20:37.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.596+0000 7f9a72ffd640 20 reqs_thread_entry: start 2024-09-12T00:20:37.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.597+0000 7f9bc6946800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.597+0000 7f9bc6946800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:37.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.597+0000 7f9bc6946800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.597+0000 7f9bc6946800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:20:37.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.598+0000 7f9bc6946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:37.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.598+0000 7f9bc6946800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.598+0000 7f9bc6946800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:37.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.598+0000 7f9bc6946800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.598+0000 7f9bc6946800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:20:37.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.598+0000 7f9bc6946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:37.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.600+0000 7f9a7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:37.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.602+0000 7f9bc6946800 20 remove_watcher() i=0 2024-09-12T00:20:37.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.602+0000 7f9bc6946800 2 removed watcher, disabling cache 2024-09-12T00:20:37.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.603+0000 7f9bc6946800 20 remove_watcher() i=1 2024-09-12T00:20:37.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.604+0000 7f9bc6946800 20 remove_watcher() i=2 2024-09-12T00:20:37.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.605+0000 7f9bc6946800 20 remove_watcher() i=3 2024-09-12T00:20:37.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.606+0000 7f9bc6946800 20 remove_watcher() i=4 2024-09-12T00:20:37.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.607+0000 7f9bc6946800 20 remove_watcher() i=5 2024-09-12T00:20:37.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.608+0000 7f9bc6946800 20 remove_watcher() i=6 2024-09-12T00:20:37.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.609+0000 7f9bc6946800 20 remove_watcher() i=7 2024-09-12T00:20:37.618 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:37.618 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:20:37.618 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-commit-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:20:37.618 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:37.684 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T00:20:37.685 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:37.896 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:20:37.925 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:37.926 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:37.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.967+0000 7f791533e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.969+0000 7f791533e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.969+0000 7f791533e800 20 realm 2024-09-12T00:20:37.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.969+0000 7f791533e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.969+0000 7f791533e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.969+0000 7f791533e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:37.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.969+0000 7f791533e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.969+0000 7f791533e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:37.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.969+0000 7f791533e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.970+0000 7f791533e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:37.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.970+0000 7f791533e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:37.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.971+0000 7f791533e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:37.969 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.971+0000 7f791533e800 20 searching for the correct realm 2024-09-12T00:20:37.972 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:37.974+0000 7f79108bf640 0 -- 172.21.15.67:0/2281359845 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f7908001c20 msgr2=0x7f790802d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:20:38.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.179+0000 7f79108bf640 0 -- 172.21.15.67:0/2281359845 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x561d9c0f3920 msgr2=0x561d9c0f5d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:38.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.184+0000 7f791533e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:38.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.184+0000 7f791533e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:38.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.184+0000 7f791533e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:38.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.184+0000 7f791533e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:38.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.184+0000 7f791533e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:38.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.184+0000 7f791533e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:38.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.184+0000 7f791533e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.184+0000 7f791533e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.184+0000 7f791533e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.185+0000 7f791533e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:38.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.185+0000 7f791533e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.185+0000 7f791533e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:38.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.185+0000 7f791533e800 20 zone default found 2024-09-12T00:20:38.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.185+0000 7f791533e800 4 Realm: () 2024-09-12T00:20:38.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.185+0000 7f791533e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:38.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.185+0000 7f791533e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:38.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.185+0000 7f791533e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:38.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.185+0000 7f791533e800 20 zonegroup default 2024-09-12T00:20:38.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.185+0000 7f791533e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.185+0000 7f791533e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.185 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.185+0000 7f791533e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.185+0000 7f791533e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.185+0000 7f791533e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.186+0000 7f791533e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.186+0000 7f791533e800 20 started sync module instance, tier type = 2024-09-12T00:20:38.188 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.186+0000 7f791533e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:38.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.195+0000 7f791533e800 20 add_watcher() i=0 2024-09-12T00:20:38.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.195+0000 7f791533e800 20 add_watcher() i=1 2024-09-12T00:20:38.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.195+0000 7f791533e800 20 add_watcher() i=2 2024-09-12T00:20:38.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.195+0000 7f791533e800 20 add_watcher() i=3 2024-09-12T00:20:38.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.195+0000 7f791533e800 20 add_watcher() i=4 2024-09-12T00:20:38.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.195+0000 7f791533e800 20 add_watcher() i=5 2024-09-12T00:20:38.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.195+0000 7f791533e800 20 add_watcher() i=6 2024-09-12T00:20:38.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.195+0000 7f791533e800 20 add_watcher() i=7 2024-09-12T00:20:38.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.195+0000 7f791533e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:38.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.197+0000 7f77c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:38.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.198+0000 7f791533e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:38.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.198+0000 7f791533e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:38.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.198+0000 7f791533e800 5 note: GC not initialized 2024-09-12T00:20:38.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.198+0000 7f77c67e4640 20 reqs_thread_entry: start 2024-09-12T00:20:38.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.198+0000 7f791533e800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:38.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.198+0000 7f791533e800 20 Filter name: none 2024-09-12T00:20:38.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.198+0000 7f7737fff640 20 reqs_thread_entry: start 2024-09-12T00:20:38.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.198+0000 7f791533e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.199+0000 7f791533e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:38.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.199+0000 7f791533e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.199+0000 7f791533e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:20:38.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.200+0000 7f791533e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:38.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.200+0000 7f791533e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.200+0000 7f791533e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:38.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.200+0000 7f791533e800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.200+0000 7f791533e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:20:38.199 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.200+0000 7f791533e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:38.200 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.202+0000 7f77c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:38.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.204+0000 7f791533e800 20 remove_watcher() i=0 2024-09-12T00:20:38.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.204+0000 7f791533e800 2 removed watcher, disabling cache 2024-09-12T00:20:38.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.205+0000 7f791533e800 20 remove_watcher() i=1 2024-09-12T00:20:38.204 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.206+0000 7f791533e800 20 remove_watcher() i=2 2024-09-12T00:20:38.205 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.207+0000 7f791533e800 20 remove_watcher() i=3 2024-09-12T00:20:38.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.209+0000 7f791533e800 20 remove_watcher() i=4 2024-09-12T00:20:38.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.210+0000 7f791533e800 20 remove_watcher() i=5 2024-09-12T00:20:38.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.211+0000 7f791533e800 20 remove_watcher() i=6 2024-09-12T00:20:38.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.212+0000 7f791533e800 20 remove_watcher() i=7 2024-09-12T00:20:38.222 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:38.222 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:20:38.222 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-commit-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:20:38.222 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:38.223 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T00:20:38.261 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:38.261 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:38.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.302+0000 7ff2aed21800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.304+0000 7ff2aed21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.304+0000 7ff2aed21800 20 realm 2024-09-12T00:20:38.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.304+0000 7ff2aed21800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.304+0000 7ff2aed21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.304+0000 7ff2aed21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:38.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.304+0000 7ff2aed21800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.304+0000 7ff2aed21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.304+0000 7ff2aed21800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.305+0000 7ff2aed21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:38.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.305+0000 7ff2aed21800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.306+0000 7ff2aed21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:38.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.306+0000 7ff2aed21800 20 searching for the correct realm 2024-09-12T00:20:38.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.309+0000 7ff2aa20b640 0 -- 172.21.15.67:0/4050003957 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7ff2a00c8fd0 msgr2=0x7ff2a00b3020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:38.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.514+0000 7ff2aaa0c640 0 -- 172.21.15.67:0/4050003957 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7ff2a4017410 msgr2=0x7ff2a4017890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:38.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.722+0000 7ff2aed21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:38.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.722+0000 7ff2aed21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:38.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.722+0000 7ff2aed21800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:38.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.722+0000 7ff2aed21800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:38.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.722+0000 7ff2aed21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:38.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.722+0000 7ff2aed21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:38.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.722+0000 7ff2aed21800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.722+0000 7ff2aed21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.722+0000 7ff2aed21800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.722+0000 7ff2aed21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:38.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.722+0000 7ff2aed21800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.723+0000 7ff2aed21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:38.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.723+0000 7ff2aed21800 20 zone default found 2024-09-12T00:20:38.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.723+0000 7ff2aed21800 4 Realm: () 2024-09-12T00:20:38.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.723+0000 7ff2aed21800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:38.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.723+0000 7ff2aed21800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:38.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.723+0000 7ff2aed21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:38.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.723+0000 7ff2aed21800 20 zonegroup default 2024-09-12T00:20:38.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.723+0000 7ff2aed21800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.723+0000 7ff2aed21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.723+0000 7ff2aed21800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.723+0000 7ff2aed21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.723+0000 7ff2aed21800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.724+0000 7ff2aed21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.724+0000 7ff2aed21800 20 started sync module instance, tier type = 2024-09-12T00:20:38.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.724+0000 7ff2aed21800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:38.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.733+0000 7ff2aed21800 20 add_watcher() i=0 2024-09-12T00:20:38.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.733+0000 7ff2aed21800 20 add_watcher() i=1 2024-09-12T00:20:38.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.733+0000 7ff2aed21800 20 add_watcher() i=2 2024-09-12T00:20:38.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.733+0000 7ff2aed21800 20 add_watcher() i=3 2024-09-12T00:20:38.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.733+0000 7ff2aed21800 20 add_watcher() i=4 2024-09-12T00:20:38.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.733+0000 7ff2aed21800 20 add_watcher() i=5 2024-09-12T00:20:38.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.733+0000 7ff2aed21800 20 add_watcher() i=6 2024-09-12T00:20:38.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.734+0000 7ff2aed21800 20 add_watcher() i=7 2024-09-12T00:20:38.732 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.734+0000 7ff2aed21800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:38.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.736+0000 7ff1617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:38.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.736+0000 7ff2aed21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:38.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.736+0000 7ff2aed21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:38.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.736+0000 7ff2aed21800 5 note: GC not initialized 2024-09-12T00:20:38.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.736+0000 7ff0dbfff640 20 reqs_thread_entry: start 2024-09-12T00:20:38.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.736+0000 7ff2aed21800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:38.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.736+0000 7ff2aed21800 20 Filter name: none 2024-09-12T00:20:38.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.736+0000 7ff0d9ffb640 20 reqs_thread_entry: start 2024-09-12T00:20:38.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.737+0000 7ff2aed21800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:20:38.735 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.737+0000 7ff2aed21800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.737+0000 7ff2aed21800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:38.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.737+0000 7ff2aed21800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:20:38.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.737+0000 7ff2aed21800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:20:38.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.737+0000 7ff2aed21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 : miss 2024-09-12T00:20:38.736 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.737+0000 7ff2aed21800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.737+0000 7ff2aed21800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:20:38.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.737+0000 7ff2aed21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 info.flags=0x17 2024-09-12T00:20:38.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.737+0000 7ff2aed21800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 to cache LRU end 2024-09-12T00:20:38.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.737+0000 7ff2aed21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:38.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.737+0000 7ff2aed21800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:38.737 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.737+0000 7ff2aed21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 2024-09-12T00:20:38.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.741+0000 7ff2aed21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 info.flags=0x17 2024-09-12T00:20:38.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.741+0000 7ff2aed21800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 to cache LRU end 2024-09-12T00:20:38.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.741+0000 7ff2aed21800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:38.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.741+0000 7ff2aed21800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31, ofs0, ns] 2024-09-12T00:20:38.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.742+0000 7ff18e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562445 cookie 94353925448272 notifier 7317 bl.length()=931 2024-09-12T00:20:38.740 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.742+0000 7ff18e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 info.flags=0x17 2024-09-12T00:20:38.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.742+0000 7ff18e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 to cache LRU end 2024-09-12T00:20:38.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.742+0000 7ff18e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:38.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.742+0000 7ff2aed21800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31]): orig_sources= new_sources= 2024-09-12T00:20:38.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.742+0000 7ff2aed21800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31]): potential sources added=[] removed=[] 2024-09-12T00:20:38.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.742+0000 7ff2aed21800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31]): orig_dests= new_dests= 2024-09-12T00:20:38.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.742+0000 7ff2aed21800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31]): potential dests added=[] removed=[] 2024-09-12T00:20:38.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.745+0000 7ff2aed21800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31.1.0 2024-09-12T00:20:38.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.745+0000 7ff2aed21800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31.1.0 2024-09-12T00:20:38.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.745+0000 7ff2aed21800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31.1.1 2024-09-12T00:20:38.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.745+0000 7ff2aed21800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31.1.1 2024-09-12T00:20:38.743 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.745+0000 7ff2aed21800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31.0 2024-09-12T00:20:38.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.747+0000 7ff2aed21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:38.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.747+0000 7ff2aed21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 2024-09-12T00:20:38.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.748+0000 7ff2aed21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 info.flags=0x17 2024-09-12T00:20:38.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.748+0000 7ff2aed21800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 to cache LRU end 2024-09-12T00:20:38.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.748+0000 7ff2aed21800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:38.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.748+0000 7ff2aed21800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31, ofs0, ns] 2024-09-12T00:20:38.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.748+0000 7ff18e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562446 cookie 94353925448272 notifier 7317 bl.length()=931 2024-09-12T00:20:38.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.748+0000 7ff18e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 info.flags=0x17 2024-09-12T00:20:38.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.748+0000 7ff18e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 to cache LRU end 2024-09-12T00:20:38.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.748+0000 7ff18e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:38.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.749+0000 7ff2aed21800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31]): orig_sources= new_sources= 2024-09-12T00:20:38.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.749+0000 7ff2aed21800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31]): potential sources added=[] removed=[] 2024-09-12T00:20:38.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.749+0000 7ff2aed21800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31]): orig_dests= new_dests= 2024-09-12T00:20:38.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.749+0000 7ff2aed21800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31]): potential dests added=[] removed=[] 2024-09-12T00:20:38.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.750+0000 7ff2aed21800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31.0 2024-09-12T00:20:38.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.751+0000 7ff2aed21800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T00:20:38.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.751+0000 7ff2aed21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:38.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.751+0000 7ff2aed21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 2024-09-12T00:20:38.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.752+0000 7ff2aed21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 info.flags=0x17 2024-09-12T00:20:38.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.752+0000 7ff2aed21800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 to cache LRU end 2024-09-12T00:20:38.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.752+0000 7ff2aed21800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:38.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.752+0000 7ff2aed21800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31, ofs0, ns] 2024-09-12T00:20:38.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.752+0000 7ff18e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562447 cookie 94353925448272 notifier 7317 bl.length()=899 2024-09-12T00:20:38.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.752+0000 7ff18e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 info.flags=0x17 2024-09-12T00:20:38.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.752+0000 7ff18e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 to cache LRU end 2024-09-12T00:20:38.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.752+0000 7ff18e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:38.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.752+0000 7ff2aed21800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31]): orig_sources= new_sources= 2024-09-12T00:20:38.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.752+0000 7ff2aed21800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31]): potential sources added=[] removed=[] 2024-09-12T00:20:38.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.752+0000 7ff2aed21800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31]): orig_dests= new_dests= 2024-09-12T00:20:38.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.752+0000 7ff2aed21800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31]): potential dests added=[] removed=[] 2024-09-12T00:20:38.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.755+0000 7ff2aed21800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:20:38.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.757+0000 7ff1617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:38.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.760+0000 7ff2aed21800 20 remove_watcher() i=0 2024-09-12T00:20:38.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.760+0000 7ff2aed21800 2 removed watcher, disabling cache 2024-09-12T00:20:38.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.761+0000 7ff2aed21800 20 remove_watcher() i=1 2024-09-12T00:20:38.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.762+0000 7ff2aed21800 20 remove_watcher() i=2 2024-09-12T00:20:38.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.762+0000 7ff2aed21800 20 remove_watcher() i=3 2024-09-12T00:20:38.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.764+0000 7ff2aed21800 20 remove_watcher() i=4 2024-09-12T00:20:38.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.765+0000 7ff2aed21800 20 remove_watcher() i=5 2024-09-12T00:20:38.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.766+0000 7ff2aed21800 20 remove_watcher() i=6 2024-09-12T00:20:38.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.766+0000 7ff2aed21800 20 remove_watcher() i=7 2024-09-12T00:20:38.777 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:20:38.806 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:38.807 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:38.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.847+0000 7f7580d2b800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.849+0000 7f7580d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.849+0000 7f7580d2b800 20 realm 2024-09-12T00:20:38.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.849+0000 7f7580d2b800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.849+0000 7f7580d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.849+0000 7f7580d2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:38.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.849+0000 7f7580d2b800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.849+0000 7f7580d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.849+0000 7f7580d2b800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.850+0000 7f7580d2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:38.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.850+0000 7f7580d2b800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.851+0000 7f7580d2b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:38.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.851+0000 7f7580d2b800 20 searching for the correct realm 2024-09-12T00:20:38.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.854+0000 7f7577fff640 0 -- 172.21.15.67:0/479330069 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f7568019b60 msgr2=0x7f756809fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:38.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.857+0000 7f757ca73640 0 -- 172.21.15.67:0/479330069 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f7578070040 msgr2=0x7f7578070930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:38.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.861+0000 7f7580d2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:38.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.861+0000 7f7580d2b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:38.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.861+0000 7f7580d2b800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:38.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.861+0000 7f7580d2b800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:38.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.861+0000 7f7580d2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:38.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.861+0000 7f7580d2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:38.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.861+0000 7f7580d2b800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.861+0000 7f7580d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.861+0000 7f7580d2b800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.862+0000 7f7580d2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:38.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.862+0000 7f7580d2b800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.862+0000 7f7580d2b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:38.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.862+0000 7f7580d2b800 20 zone default found 2024-09-12T00:20:38.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.862+0000 7f7580d2b800 4 Realm: () 2024-09-12T00:20:38.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.862+0000 7f7580d2b800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:38.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.862+0000 7f7580d2b800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:38.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.862+0000 7f7580d2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:38.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.862+0000 7f7580d2b800 20 zonegroup default 2024-09-12T00:20:38.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.862+0000 7f7580d2b800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.862+0000 7f7580d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.862+0000 7f7580d2b800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.862+0000 7f7580d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.862+0000 7f7580d2b800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.863+0000 7f7580d2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:38.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.863+0000 7f7580d2b800 20 started sync module instance, tier type = 2024-09-12T00:20:38.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.863+0000 7f7580d2b800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:38.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.871+0000 7f7580d2b800 20 add_watcher() i=0 2024-09-12T00:20:38.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.871+0000 7f7580d2b800 20 add_watcher() i=1 2024-09-12T00:20:38.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.871+0000 7f7580d2b800 20 add_watcher() i=2 2024-09-12T00:20:38.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.871+0000 7f7580d2b800 20 add_watcher() i=3 2024-09-12T00:20:38.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.871+0000 7f7580d2b800 20 add_watcher() i=4 2024-09-12T00:20:38.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.871+0000 7f7580d2b800 20 add_watcher() i=5 2024-09-12T00:20:38.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.871+0000 7f7580d2b800 20 add_watcher() i=6 2024-09-12T00:20:38.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.872+0000 7f7580d2b800 20 add_watcher() i=7 2024-09-12T00:20:38.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.872+0000 7f7580d2b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:38.872 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.874+0000 7f74337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:38.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.874+0000 7f7580d2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:38.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.874+0000 7f7580d2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:38.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.874+0000 7f7580d2b800 5 note: GC not initialized 2024-09-12T00:20:38.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.874+0000 7f74327e4640 20 reqs_thread_entry: start 2024-09-12T00:20:38.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.874+0000 7f7580d2b800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:38.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.875+0000 7f7580d2b800 20 Filter name: none 2024-09-12T00:20:38.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.875+0000 7f742b7fe640 20 reqs_thread_entry: start 2024-09-12T00:20:38.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.875+0000 7f7580d2b800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.875+0000 7f7580d2b800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:38.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.875+0000 7f7580d2b800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.876+0000 7f7580d2b800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:20:38.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.876+0000 7f7580d2b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:38.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.876+0000 7f7580d2b800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.876+0000 7f7580d2b800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:38.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.876+0000 7f7580d2b800 20 rados->read ofs=0 len=0 2024-09-12T00:20:38.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.876+0000 7f7580d2b800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:20:38.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.876+0000 7f7580d2b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:38.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.877+0000 7f74337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:38.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.880+0000 7f7580d2b800 20 remove_watcher() i=0 2024-09-12T00:20:38.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.880+0000 7f7580d2b800 2 removed watcher, disabling cache 2024-09-12T00:20:38.879 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.881+0000 7f7580d2b800 20 remove_watcher() i=1 2024-09-12T00:20:38.880 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.882+0000 7f7580d2b800 20 remove_watcher() i=2 2024-09-12T00:20:38.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.883+0000 7f7580d2b800 20 remove_watcher() i=3 2024-09-12T00:20:38.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.884+0000 7f7580d2b800 20 remove_watcher() i=4 2024-09-12T00:20:38.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.885+0000 7f7580d2b800 20 remove_watcher() i=5 2024-09-12T00:20:38.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.886+0000 7f7580d2b800 20 remove_watcher() i=6 2024-09-12T00:20:38.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:38.887+0000 7f7580d2b800 20 remove_watcher() i=7 2024-09-12T00:20:38.896 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:38.896 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:20:38.896 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-commit-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:20:38.896 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:38.958 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T00:20:38.958 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.170 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:20:39.201 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:39.201 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:39.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.244+0000 7f6fa8f23800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.245+0000 7f6fa8f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.245+0000 7f6fa8f23800 20 realm 2024-09-12T00:20:39.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.245+0000 7f6fa8f23800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.245+0000 7f6fa8f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.245+0000 7f6fa8f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:39.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.245+0000 7f6fa8f23800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.246+0000 7f6fa8f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.246+0000 7f6fa8f23800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.246+0000 7f6fa8f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:39.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.246+0000 7f6fa8f23800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.247+0000 7f6fa8f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:39.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.247+0000 7f6fa8f23800 20 searching for the correct realm 2024-09-12T00:20:39.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.250+0000 7f6f9ffff640 0 -- 172.21.15.67:0/3748620553 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f6f90040bf0 msgr2=0x7f6f90018410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:39.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.456+0000 7f6f9ffff640 0 -- 172.21.15.67:0/3748620553 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5578e188d1a0 msgr2=0x5578e188f620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:39.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.459+0000 7f6fa8f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:39.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.459+0000 7f6fa8f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:39.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.459+0000 7f6fa8f23800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:39.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.459+0000 7f6fa8f23800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:39.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.459+0000 7f6fa8f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:39.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.459+0000 7f6fa8f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:39.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.459+0000 7f6fa8f23800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.460+0000 7f6fa8f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.460+0000 7f6fa8f23800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.460+0000 7f6fa8f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:39.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.460+0000 7f6fa8f23800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.460+0000 7f6fa8f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:39.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.460+0000 7f6fa8f23800 20 zone default found 2024-09-12T00:20:39.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.460+0000 7f6fa8f23800 4 Realm: () 2024-09-12T00:20:39.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.460+0000 7f6fa8f23800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:39.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.460+0000 7f6fa8f23800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:39.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.460+0000 7f6fa8f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:39.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.460+0000 7f6fa8f23800 20 zonegroup default 2024-09-12T00:20:39.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.460+0000 7f6fa8f23800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.461+0000 7f6fa8f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.461+0000 7f6fa8f23800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.461+0000 7f6fa8f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.461+0000 7f6fa8f23800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.461+0000 7f6fa8f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.461+0000 7f6fa8f23800 20 started sync module instance, tier type = 2024-09-12T00:20:39.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.461+0000 7f6fa8f23800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:39.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.470+0000 7f6fa8f23800 20 add_watcher() i=0 2024-09-12T00:20:39.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.470+0000 7f6fa8f23800 20 add_watcher() i=1 2024-09-12T00:20:39.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.470+0000 7f6fa8f23800 20 add_watcher() i=2 2024-09-12T00:20:39.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.470+0000 7f6fa8f23800 20 add_watcher() i=3 2024-09-12T00:20:39.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.470+0000 7f6fa8f23800 20 add_watcher() i=4 2024-09-12T00:20:39.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.470+0000 7f6fa8f23800 20 add_watcher() i=5 2024-09-12T00:20:39.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.470+0000 7f6fa8f23800 20 add_watcher() i=6 2024-09-12T00:20:39.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.471+0000 7f6fa8f23800 20 add_watcher() i=7 2024-09-12T00:20:39.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.471+0000 7f6fa8f23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:39.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.473+0000 7f6e5afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:39.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.473+0000 7f6fa8f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:39.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.473+0000 7f6fa8f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:39.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.473+0000 7f6fa8f23800 5 note: GC not initialized 2024-09-12T00:20:39.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.473+0000 7f6e59fe3640 20 reqs_thread_entry: start 2024-09-12T00:20:39.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.473+0000 7f6fa8f23800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:39.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.473+0000 7f6fa8f23800 20 Filter name: none 2024-09-12T00:20:39.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.473+0000 7f6dcb7fe640 20 reqs_thread_entry: start 2024-09-12T00:20:39.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.473+0000 7f6fa8f23800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.474+0000 7f6fa8f23800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:39.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.474+0000 7f6fa8f23800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.475+0000 7f6fa8f23800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:20:39.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.475+0000 7f6fa8f23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:39.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.475+0000 7f6fa8f23800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.475+0000 7f6fa8f23800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:39.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.475+0000 7f6fa8f23800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.475+0000 7f6fa8f23800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:20:39.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.475+0000 7f6fa8f23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:39.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.477+0000 7f6e5afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:39.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.478+0000 7f6fa8f23800 20 remove_watcher() i=0 2024-09-12T00:20:39.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.478+0000 7f6fa8f23800 2 removed watcher, disabling cache 2024-09-12T00:20:39.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.480+0000 7f6fa8f23800 20 remove_watcher() i=1 2024-09-12T00:20:39.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.481+0000 7f6fa8f23800 20 remove_watcher() i=2 2024-09-12T00:20:39.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.482+0000 7f6fa8f23800 20 remove_watcher() i=3 2024-09-12T00:20:39.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.482+0000 7f6fa8f23800 20 remove_watcher() i=4 2024-09-12T00:20:39.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.483+0000 7f6fa8f23800 20 remove_watcher() i=5 2024-09-12T00:20:39.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.484+0000 7f6fa8f23800 20 remove_watcher() i=6 2024-09-12T00:20:39.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.485+0000 7f6fa8f23800 20 remove_watcher() i=7 2024-09-12T00:20:39.494 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.494 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:20:39.495 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-commit-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:20:39.495 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.496 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T00:20:39.532 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:39.532 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:39.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.573+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.575+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.575+0000 7f8507014800 20 realm 2024-09-12T00:20:39.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.575+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.575+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.575+0000 7f8507014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:39.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.576+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.576+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.576+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.577+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:39.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.577+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.581+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:39.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.581+0000 7f8507014800 20 searching for the correct realm 2024-09-12T00:20:39.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.584+0000 7f8501eca640 0 -- 172.21.15.67:0/1705772434 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f84f806c4c0 msgr2=0x7f84f80385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:39.788 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.789+0000 7f8502ecc640 0 -- 172.21.15.67:0/1705772434 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5627cfb11ad0 msgr2=0x5627cfb13f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:39.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:39.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:39.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:39.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:39.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:39.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:39.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.793+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.794+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.794+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.794+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:39.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.794+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.794+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:39.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.794+0000 7f8507014800 20 zone default found 2024-09-12T00:20:39.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.794+0000 7f8507014800 4 Realm: () 2024-09-12T00:20:39.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.794+0000 7f8507014800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:39.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.794+0000 7f8507014800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:39.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.794+0000 7f8507014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:39.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.794+0000 7f8507014800 20 zonegroup default 2024-09-12T00:20:39.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.794+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.795+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.795+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.795+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.795+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.795+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.795+0000 7f8507014800 20 started sync module instance, tier type = 2024-09-12T00:20:39.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.795+0000 7f8507014800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:39.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=0 2024-09-12T00:20:39.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=1 2024-09-12T00:20:39.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=2 2024-09-12T00:20:39.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=3 2024-09-12T00:20:39.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=4 2024-09-12T00:20:39.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=5 2024-09-12T00:20:39.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=6 2024-09-12T00:20:39.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.805+0000 7f8507014800 20 add_watcher() i=7 2024-09-12T00:20:39.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.805+0000 7f8507014800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:39.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.806+0000 7f83b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:39.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.806+0000 7f8507014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:39.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.806+0000 7f8507014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:39.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.807+0000 7f8507014800 5 note: GC not initialized 2024-09-12T00:20:39.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.807+0000 7f83337fe640 20 reqs_thread_entry: start 2024-09-12T00:20:39.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.807+0000 7f8507014800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:39.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.807+0000 7f8507014800 20 Filter name: none 2024-09-12T00:20:39.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.807+0000 7f83317fa640 20 reqs_thread_entry: start 2024-09-12T00:20:39.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.807+0000 7f8507014800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:20:39.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.807+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.808+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:39.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.808+0000 7f8507014800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:20:39.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.808+0000 7f8507014800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:20:39.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.808+0000 7f8507014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 : miss 2024-09-12T00:20:39.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.808+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.808+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:20:39.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.808+0000 7f8507014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:20:39.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.808+0000 7f8507014800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:20:39.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.808+0000 7f8507014800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:39.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.808+0000 7f8507014800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:39.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.808+0000 7f8507014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 2024-09-12T00:20:39.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.812+0000 7f8507014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:20:39.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.812+0000 7f8507014800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:20:39.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.812+0000 7f8507014800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:39.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.812+0000 7f8507014800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32, ofs0, ns] 2024-09-12T00:20:39.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.813+0000 7f83e5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562436 cookie 94728988272000 notifier 7371 bl.length()=931 2024-09-12T00:20:39.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.813+0000 7f83e5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:20:39.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.813+0000 7f83e5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:20:39.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.813+0000 7f83e5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:39.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.813+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_sources= new_sources= 2024-09-12T00:20:39.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.813+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential sources added=[] removed=[] 2024-09-12T00:20:39.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.813+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_dests= new_dests= 2024-09-12T00:20:39.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.813+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential dests added=[] removed=[] 2024-09-12T00:20:39.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.815+0000 7f8507014800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.0 2024-09-12T00:20:39.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.815+0000 7f8507014800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.0 2024-09-12T00:20:39.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.815+0000 7f8507014800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.1 2024-09-12T00:20:39.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.815+0000 7f8507014800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.1 2024-09-12T00:20:39.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.815+0000 7f8507014800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.0 2024-09-12T00:20:39.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.818+0000 7f8507014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:39.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.818+0000 7f8507014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 2024-09-12T00:20:39.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.819+0000 7f8507014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:20:39.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.819+0000 7f8507014800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:20:39.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.819+0000 7f8507014800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:39.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.819+0000 7f8507014800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32, ofs0, ns] 2024-09-12T00:20:39.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.820+0000 7f83e5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562437 cookie 94728988272000 notifier 7371 bl.length()=931 2024-09-12T00:20:39.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.820+0000 7f83e5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:20:39.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.820+0000 7f83e5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:20:39.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.820+0000 7f83e5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:39.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.820+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_sources= new_sources= 2024-09-12T00:20:39.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.820+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential sources added=[] removed=[] 2024-09-12T00:20:39.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.820+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_dests= new_dests= 2024-09-12T00:20:39.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.820+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential dests added=[] removed=[] 2024-09-12T00:20:39.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.822+0000 7f8507014800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.0 2024-09-12T00:20:39.820 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8507014800 time 2024-09-12T00:20:39.823038+0000 2024-09-12T00:20:39.820 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:20:39.821 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:39.821 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f850818c71a] 2024-09-12T00:20:39.821 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f850818c8d8] 2024-09-12T00:20:39.821 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ccf87641] 2024-09-12T00:20:39.821 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ccf97637] 2024-09-12T00:20:39.821 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:20:39.821 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f8506e29590] 2024-09-12T00:20:39.821 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:20:39.822 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:20:39.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.823+0000 7f8507014800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8507014800 time 2024-09-12T00:20:39.823038+0000 2024-09-12T00:20:39.822 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:20:39.822 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.822 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:39.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f850818c71a] 2024-09-12T00:20:39.822 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f850818c8d8] 2024-09-12T00:20:39.822 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ccf87641] 2024-09-12T00:20:39.822 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ccf97637] 2024-09-12T00:20:39.822 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:20:39.822 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f8506e29590] 2024-09-12T00:20:39.822 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:20:39.822 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:20:39.822 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.823 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:20:39.823 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f8507014800 thread_name:radosgw-admin 2024-09-12T00:20:39.843 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:39.843 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8506e3e6f0] 2024-09-12T00:20:39.844 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8506e8b99c] 2024-09-12T00:20:39.844 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:20:39.844 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:20:39.844 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f850818c774] 2024-09-12T00:20:39.844 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f850818c8d8] 2024-09-12T00:20:39.844 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ccf87641] 2024-09-12T00:20:39.844 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ccf97637] 2024-09-12T00:20:39.844 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:20:39.844 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f8506e29590] 2024-09-12T00:20:39.844 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:20:39.844 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:20:39.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.823+0000 7f8507014800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:20:39.845 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f8507014800 thread_name:radosgw-admin 2024-09-12T00:20:39.845 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.845 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:39.845 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8506e3e6f0] 2024-09-12T00:20:39.845 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8506e8b99c] 2024-09-12T00:20:39.845 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:20:39.845 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:20:39.845 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f850818c774] 2024-09-12T00:20:39.845 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f850818c8d8] 2024-09-12T00:20:39.845 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ccf87641] 2024-09-12T00:20:39.845 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ccf97637] 2024-09-12T00:20:39.846 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:20:39.846 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f8506e29590] 2024-09-12T00:20:39.846 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:20:39.846 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:20:39.846 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:20:39.846 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.846 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:20:39.846 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:20:39.556+0000 7f8507014800 5 AuthRegistry(0x5627cfa2d1f0) adding con mode: crc 2024-09-12T00:20:39.846 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:20:39.556+0000 7f8507014800 5 AuthRegistry(0x5627cfa2d1f0) adding con mode: crc 2024-09-12T00:20:39.846 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:20:39.556+0000 7f8507014800 5 AuthRegistry(0x5627cfa2d1f0) adding con mode: secure 2024-09-12T00:20:39.846 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:20:39.556+0000 7f8507014800 5 AuthRegistry(0x5627cfa2d1f0) adding con mode: crc 2024-09-12T00:20:39.846 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:20:39.556+0000 7f8507014800 5 AuthRegistry(0x5627cfa2d1f0) adding con mode: secure 2024-09-12T00:20:39.846 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:20:39.556+0000 7f8507014800 5 AuthRegistry(0x5627cfa2d1f0) adding con mode: crc 2024-09-12T00:20:39.846 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:20:39.556+0000 7f8507014800 5 AuthRegistry(0x5627cfa2d1f0) adding con mode: secure 2024-09-12T00:20:39.847 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:20:39.557+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.847 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:20:39.557+0000 7f8507014800 1 librados: starting msgr at 2024-09-12T00:20:39.847 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:20:39.557+0000 7f8507014800 1 librados: starting objecter 2024-09-12T00:20:39.847 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:20:39.557+0000 7f8507014800 5 asok(0x5627cf807630) register_command objecter_requests hook 0x5627cfa2b5a0 2024-09-12T00:20:39.847 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:20:39.557+0000 7f8507014800 1 librados: setting wanted keys 2024-09-12T00:20:39.847 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:20:39.557+0000 7f8507014800 1 librados: calling monclient init 2024-09-12T00:20:39.847 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient: init 2024-09-12T00:20:39.847 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding auth protocol: cephx 2024-09-12T00:20:39.847 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding auth protocol: cephx 2024-09-12T00:20:39.847 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding auth protocol: cephx 2024-09-12T00:20:39.847 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: secure 2024-09-12T00:20:39.847 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: crc 2024-09-12T00:20:39.847 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: secure 2024-09-12T00:20:39.847 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: crc 2024-09-12T00:20:39.848 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: secure 2024-09-12T00:20:39.848 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: crc 2024-09-12T00:20:39.848 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: crc 2024-09-12T00:20:39.848 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: secure 2024-09-12T00:20:39.848 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: crc 2024-09-12T00:20:39.848 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: secure 2024-09-12T00:20:39.848 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: crc 2024-09-12T00:20:39.848 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: secure 2024-09-12T00:20:39.848 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:20:39.557+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.848 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:20:39.557+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.848 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:20:39.557+0000 7f8507014800 5 asok(0x5627cf807630) register_command rotate-key hook 0x5627cfa276f8 2024-09-12T00:20:39.848 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:39.848 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:20:39.848 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): picked mon.noname-c con 0x5627cf8d5020 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:39.849 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): picked mon.noname-a con 0x5627cf8def10 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:39.849 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): picked mon.noname-b con 0x5627cf96ae70 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:39.849 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.849 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.849 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.849 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:39.849 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): authenticate will time out at 1916.813832s 2024-09-12T00:20:39.849 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:20:39.557+0000 7f85026cb640 10 monclient(hunting): get_auth_request con 0x5627cf8d5020 auth_method 0 2024-09-12T00:20:39.849 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:20:39.557+0000 7f85026cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.849 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:20:39.557+0000 7f85026cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.849 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:20:39.557+0000 7f85026cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.849 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:20:39.557+0000 7f8501eca640 10 monclient(hunting): get_auth_request con 0x5627cf8def10 auth_method 0 2024-09-12T00:20:39.849 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:20:39.557+0000 7f8501eca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.850 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:20:39.557+0000 7f8501eca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.850 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:20:39.557+0000 7f8501eca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.850 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:20:39.557+0000 7f85026cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.850 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:20:39.557+0000 7f85026cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.850 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:20:39.557+0000 7f85026cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.850 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:20:39.558+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.850 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:20:39.558+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.850 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:20:39.558+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.850 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:20:39.558+0000 7f8502ecc640 10 monclient(hunting): get_auth_request con 0x5627cf96ae70 auth_method 0 2024-09-12T00:20:39.850 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:20:39.558+0000 7f8502ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.850 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:20:39.558+0000 7f8502ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.850 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:20:39.558+0000 7f8502ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.850 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:20:39.558+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.850 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:20:39.558+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.851 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:20:39.558+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.851 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:20:39.558+0000 7f85026cb640 10 monclient(hunting): handle_auth_done global_id 6896 payload 824 2024-09-12T00:20:39.851 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:20:39.558+0000 7f85026cb640 10 monclient: _finish_hunting 0 2024-09-12T00:20:39.851 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:20:39.558+0000 7f85026cb640 1 monclient: found mon.noname-c 2024-09-12T00:20:39.851 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:20:39.558+0000 7f85026cb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:20:39.851 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.851 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:20:39.851 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: dump: 2024-09-12T00:20:39.851 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.851 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.851 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.851 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.851 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.851 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.852 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.852 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.852 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.852 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.852 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: _finish_auth 0 2024-09-12T00:20:39.852 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: _check_auth_tickets 2024-09-12T00:20:39.852 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:39.852 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.852 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:20:39.852 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: dump: 2024-09-12T00:20:39.852 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.852 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.852 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.852 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.852 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.853 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.853 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.853 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.853 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.853 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.853 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:20:39.558+0000 7f8507014800 5 monclient: authenticate success, global_id 6896 2024-09-12T00:20:39.853 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:20:39.558+0000 7f8507014800 10 monclient: _renew_subs 2024-09-12T00:20:39.853 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:20:39.558+0000 7f83f0608640 4 set_mon_vals no callback set 2024-09-12T00:20:39.853 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:20:39.558+0000 7f8507014800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:39.853 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:20:39.558+0000 7f8507014800 10 monclient: _renew_subs 2024-09-12T00:20:39.853 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:20:39.558+0000 7f8507014800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:39.853 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:20:39.558+0000 7f8507014800 1 librados: init done 2024-09-12T00:20:39.853 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:20:39.560+0000 7f83eee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:20:39.854 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:20:39.560+0000 7f83eee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:39.854 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:20:39.560+0000 7f83eee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:39.854 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:20:39.560+0000 7f8501eca640 10 monclient: get_auth_request con 0x7f83e8076470 auth_method 0 2024-09-12T00:20:39.854 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:20:39.561+0000 7f8502ecc640 10 monclient: get_auth_request con 0x5627cfa50250 auth_method 0 2024-09-12T00:20:39.854 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:20:39.562+0000 7f85026cb640 10 monclient: get_auth_request con 0x5627cfa72c70 auth_method 0 2024-09-12T00:20:39.854 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:20:39.562+0000 7f8501eca640 10 monclient: get_auth_request con 0x5627cfa77020 auth_method 0 2024-09-12T00:20:39.854 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:20:39.564+0000 7f8507014800 10 monclient: build_initial_monmap 2024-09-12T00:20:39.854 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:20:39.564+0000 7f8507014800 1 build_initial for_mkfs: 0 2024-09-12T00:20:39.854 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:20:39.564+0000 7f8507014800 10 monclient: monmap: 2024-09-12T00:20:39.854 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:20:39.854 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:20:39.854 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:20:39.854 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:20:39.854 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:20:39.855 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.855 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:20:39.855 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:20:39.855 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:20:39.855 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.855 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding auth protocol: cephx 2024-09-12T00:20:39.855 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding auth protocol: cephx 2024-09-12T00:20:39.855 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding auth protocol: cephx 2024-09-12T00:20:39.855 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: secure 2024-09-12T00:20:39.855 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: crc 2024-09-12T00:20:39.855 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: secure 2024-09-12T00:20:39.855 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: crc 2024-09-12T00:20:39.855 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: secure 2024-09-12T00:20:39.855 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: crc 2024-09-12T00:20:39.856 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: crc 2024-09-12T00:20:39.856 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: secure 2024-09-12T00:20:39.856 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: crc 2024-09-12T00:20:39.856 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: secure 2024-09-12T00:20:39.856 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: crc 2024-09-12T00:20:39.856 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: secure 2024-09-12T00:20:39.856 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:20:39.564+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.856 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:20:39.564+0000 7f8507014800 5 asok(0x5627cf807630) register_command objecter_requests cmddesc objecter_requests hook 0x5627cfa7f800 EEXIST 2024-09-12T00:20:39.856 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:20:39.564+0000 7f8507014800 10 monclient: init 2024-09-12T00:20:39.856 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding auth protocol: cephx 2024-09-12T00:20:39.856 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding auth protocol: cephx 2024-09-12T00:20:39.856 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding auth protocol: cephx 2024-09-12T00:20:39.856 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: secure 2024-09-12T00:20:39.856 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: crc 2024-09-12T00:20:39.857 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: secure 2024-09-12T00:20:39.857 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: crc 2024-09-12T00:20:39.857 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: secure 2024-09-12T00:20:39.857 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: crc 2024-09-12T00:20:39.857 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: crc 2024-09-12T00:20:39.857 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: secure 2024-09-12T00:20:39.857 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: crc 2024-09-12T00:20:39.857 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: secure 2024-09-12T00:20:39.857 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: crc 2024-09-12T00:20:39.857 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: secure 2024-09-12T00:20:39.857 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:20:39.564+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.857 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:20:39.565+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.857 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:20:39.565+0000 7f8507014800 5 asok(0x5627cf807630) register_command rotate-key cmddesc rotate-key hook 0x5627cfa7a660 EEXIST 2024-09-12T00:20:39.857 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:39.858 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:20:39.858 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): picked mon.noname-c con 0x5627cfaa34f0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:39.858 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): picked mon.noname-b con 0x5627cfaa57c0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:39.858 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): picked mon.noname-a con 0x5627cfaa1cc0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:39.858 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.858 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.858 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.858 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:39.858 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): authenticate will time out at 1916.821195s 2024-09-12T00:20:39.858 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): get_auth_request con 0x5627cfaa34f0 auth_method 0 2024-09-12T00:20:39.858 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.858 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.858 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.858 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:20:39.565+0000 7f8502ecc640 10 monclient(hunting): get_auth_request con 0x5627cfaa1cc0 auth_method 0 2024-09-12T00:20:39.859 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:20:39.565+0000 7f8502ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.859 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:20:39.565+0000 7f8502ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.859 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:20:39.565+0000 7f8502ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.859 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.859 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.859 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.859 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:20:39.565+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.859 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:20:39.565+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.859 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:20:39.565+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.859 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): handle_auth_done global_id 6899 payload 824 2024-09-12T00:20:39.859 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient: _finish_hunting 0 2024-09-12T00:20:39.859 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:20:39.565+0000 7f85026cb640 1 monclient: found mon.noname-c 2024-09-12T00:20:39.859 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:20:39.860 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.860 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:20:39.860 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: dump: 2024-09-12T00:20:39.860 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.860 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.860 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.860 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.860 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.860 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.860 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.860 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.860 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.860 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.860 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: _finish_auth 0 2024-09-12T00:20:39.860 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: _check_auth_tickets 2024-09-12T00:20:39.861 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:39.861 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.861 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:20:39.861 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: dump: 2024-09-12T00:20:39.861 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.861 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.861 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.861 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.861 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.861 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.861 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.861 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.861 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.861 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.861 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:20:39.565+0000 7f8507014800 5 monclient: authenticate success, global_id 6899 2024-09-12T00:20:39.862 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient: _renew_subs 2024-09-12T00:20:39.862 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:20:39.565+0000 7f85036cd640 4 set_mon_vals no callback set 2024-09-12T00:20:39.862 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:39.862 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient: _renew_subs 2024-09-12T00:20:39.862 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:39.862 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:20:39.567+0000 7f83e7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:20:39.862 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:20:39.567+0000 7f83e7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:39.862 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:20:39.567+0000 7f83e7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:39.862 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:20:39.567+0000 7f8501eca640 10 monclient: get_auth_request con 0x7f83dc076380 auth_method 0 2024-09-12T00:20:39.862 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:20:39.567+0000 7f8507014800 10 monclient: get_monmap_and_config 2024-09-12T00:20:39.862 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:20:39.567+0000 7f8507014800 10 monclient: build_initial_monmap 2024-09-12T00:20:39.862 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:20:39.567+0000 7f8507014800 1 build_initial for_mkfs: 0 2024-09-12T00:20:39.862 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:20:39.568+0000 7f8507014800 10 monclient: monmap: 2024-09-12T00:20:39.863 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:20:39.863 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:20:39.863 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:20:39.863 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:20:39.863 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:20:39.863 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.863 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:20:39.863 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:20:39.863 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:20:39.863 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.863 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding auth protocol: cephx 2024-09-12T00:20:39.863 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding auth protocol: cephx 2024-09-12T00:20:39.863 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding auth protocol: cephx 2024-09-12T00:20:39.864 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: secure 2024-09-12T00:20:39.864 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: crc 2024-09-12T00:20:39.864 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: secure 2024-09-12T00:20:39.864 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: crc 2024-09-12T00:20:39.864 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: secure 2024-09-12T00:20:39.864 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: crc 2024-09-12T00:20:39.864 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: crc 2024-09-12T00:20:39.864 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: secure 2024-09-12T00:20:39.864 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: crc 2024-09-12T00:20:39.864 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: secure 2024-09-12T00:20:39.864 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: crc 2024-09-12T00:20:39.865 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: secure 2024-09-12T00:20:39.865 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:20:39.568+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.865 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:20:39.568+0000 7f8507014800 10 monclient: init 2024-09-12T00:20:39.865 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding auth protocol: cephx 2024-09-12T00:20:39.865 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding auth protocol: cephx 2024-09-12T00:20:39.865 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding auth protocol: cephx 2024-09-12T00:20:39.865 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: secure 2024-09-12T00:20:39.865 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: crc 2024-09-12T00:20:39.865 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: secure 2024-09-12T00:20:39.865 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: crc 2024-09-12T00:20:39.865 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: secure 2024-09-12T00:20:39.865 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: crc 2024-09-12T00:20:39.865 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: crc 2024-09-12T00:20:39.866 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: secure 2024-09-12T00:20:39.866 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: crc 2024-09-12T00:20:39.866 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: secure 2024-09-12T00:20:39.866 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: crc 2024-09-12T00:20:39.866 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: secure 2024-09-12T00:20:39.866 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:20:39.568+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.866 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:20:39.568+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.866 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:20:39.568+0000 7f8507014800 5 asok(0x5627cf807630) register_command rotate-key cmddesc rotate-key hook 0x7ffc659da398 EEXIST 2024-09-12T00:20:39.866 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:20:39.568+0000 7f8507014800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:39.866 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:20:39.568+0000 7f8507014800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:20:39.866 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:20:39.568+0000 7f8507014800 10 monclient(hunting): picked mon.noname-b con 0x5627cfaf7580 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:39.866 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:20:39.568+0000 7f8507014800 10 monclient(hunting): picked mon.noname-a con 0x5627cfac84d0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:39.866 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:20:39.568+0000 7f8507014800 10 monclient(hunting): picked mon.noname-c con 0x5627cfaf2e20 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:39.866 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:20:39.569+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.866 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:20:39.569+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.867 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:20:39.569+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.867 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:20:39.569+0000 7f8507014800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:39.867 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:20:39.569+0000 7f8507014800 10 monclient(hunting): authenticate will time out at 1916.825022s 2024-09-12T00:20:39.867 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): get_auth_request con 0x5627cfaf2e20 auth_method 0 2024-09-12T00:20:39.867 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.867 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.867 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.867 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:20:39.569+0000 7f8501eca640 10 monclient(hunting): get_auth_request con 0x5627cfac84d0 auth_method 0 2024-09-12T00:20:39.867 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:20:39.569+0000 7f8501eca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.867 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:20:39.569+0000 7f8501eca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.867 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:20:39.569+0000 7f8501eca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.867 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.867 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.867 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.868 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:20:39.569+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.868 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:20:39.569+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.868 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:20:39.569+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.868 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:20:39.569+0000 7f85026cb640 10 monclient(hunting): get_auth_request con 0x5627cfaf7580 auth_method 0 2024-09-12T00:20:39.868 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:20:39.569+0000 7f85026cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.868 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:20:39.569+0000 7f85026cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.868 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:20:39.569+0000 7f85026cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.868 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): handle_auth_done global_id 6902 payload 274 2024-09-12T00:20:39.868 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient: _finish_hunting 0 2024-09-12T00:20:39.868 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:20:39.569+0000 7f8502ecc640 1 monclient: found mon.noname-c 2024-09-12T00:20:39.868 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:20:39.868 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.868 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:20:39.868 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: dump: 2024-09-12T00:20:39.869 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.869 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.869 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.869 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.869 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.869 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.869 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.869 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.869 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.869 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.869 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: _finish_auth 0 2024-09-12T00:20:39.869 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:20:39.869 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:39.870 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:20:39.569+0000 7f8507014800 5 monclient: authenticate success, global_id 6902 2024-09-12T00:20:39.870 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:20:39.569+0000 7f8507014800 10 monclient: get_monmap_and_config success 2024-09-12T00:20:39.870 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.870 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:20:39.569+0000 7f8507014800 4 set_mon_vals no callback set 2024-09-12T00:20:39.870 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:20:39.870 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: dump: 2024-09-12T00:20:39.870 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.870 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.870 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.870 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.870 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.870 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.871 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.871 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.871 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.871 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.871 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:20:39.570+0000 7f8507014800 10 monclient: shutdown 2024-09-12T00:20:39.871 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:20:39.570+0000 7f8507014800 10 monclient: build_initial_monmap 2024-09-12T00:20:39.871 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:20:39.570+0000 7f8507014800 1 build_initial for_mkfs: 0 2024-09-12T00:20:39.871 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:20:39.570+0000 7f8507014800 10 monclient: monmap: 2024-09-12T00:20:39.871 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:20:39.871 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:20:39.871 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:20:39.871 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:20:39.871 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:20:39.871 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.872 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:20:39.872 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:20:39.872 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:20:39.872 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.872 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding auth protocol: cephx 2024-09-12T00:20:39.872 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding auth protocol: cephx 2024-09-12T00:20:39.872 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding auth protocol: cephx 2024-09-12T00:20:39.872 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: secure 2024-09-12T00:20:39.872 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: crc 2024-09-12T00:20:39.872 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: secure 2024-09-12T00:20:39.872 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: crc 2024-09-12T00:20:39.872 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: secure 2024-09-12T00:20:39.872 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: crc 2024-09-12T00:20:39.873 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: crc 2024-09-12T00:20:39.873 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: secure 2024-09-12T00:20:39.873 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: crc 2024-09-12T00:20:39.873 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: secure 2024-09-12T00:20:39.873 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: crc 2024-09-12T00:20:39.873 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: secure 2024-09-12T00:20:39.873 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:20:39.570+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.873 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:20:39.570+0000 7f8507014800 1 librados: starting msgr at 2024-09-12T00:20:39.873 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:20:39.570+0000 7f8507014800 1 librados: starting objecter 2024-09-12T00:20:39.873 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:20:39.570+0000 7f8507014800 5 asok(0x5627cf807630) register_command objecter_requests cmddesc objecter_requests hook 0x5627cfac90e0 EEXIST 2024-09-12T00:20:39.873 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:20:39.570+0000 7f8507014800 1 librados: setting wanted keys 2024-09-12T00:20:39.873 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:20:39.570+0000 7f8507014800 1 librados: calling monclient init 2024-09-12T00:20:39.873 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:20:39.570+0000 7f8507014800 10 monclient: init 2024-09-12T00:20:39.874 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding auth protocol: cephx 2024-09-12T00:20:39.874 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding auth protocol: cephx 2024-09-12T00:20:39.874 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding auth protocol: cephx 2024-09-12T00:20:39.874 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: secure 2024-09-12T00:20:39.874 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: crc 2024-09-12T00:20:39.874 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: secure 2024-09-12T00:20:39.874 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: crc 2024-09-12T00:20:39.874 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: secure 2024-09-12T00:20:39.874 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: crc 2024-09-12T00:20:39.874 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: crc 2024-09-12T00:20:39.874 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: secure 2024-09-12T00:20:39.874 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: crc 2024-09-12T00:20:39.874 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: secure 2024-09-12T00:20:39.874 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: crc 2024-09-12T00:20:39.875 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: secure 2024-09-12T00:20:39.875 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:20:39.571+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.875 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:20:39.571+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.875 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:20:39.571+0000 7f8507014800 5 asok(0x5627cf807630) register_command rotate-key cmddesc rotate-key hook 0x5627cfabb3e8 EEXIST 2024-09-12T00:20:39.875 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:39.875 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:20:39.875 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): picked mon.noname-b con 0x5627cfac84d0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:39.875 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): picked mon.noname-a con 0x5627cfaf2e20 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:39.875 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): picked mon.noname-c con 0x5627cfaf7580 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:39.875 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.875 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.875 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.875 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:39.876 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): authenticate will time out at 1916.827373s 2024-09-12T00:20:39.876 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:20:39.571+0000 7f8502ecc640 10 monclient(hunting): get_auth_request con 0x5627cfaf7580 auth_method 0 2024-09-12T00:20:39.876 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:20:39.571+0000 7f8502ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.876 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:20:39.571+0000 7f8502ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.876 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:20:39.571+0000 7f8502ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.876 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): get_auth_request con 0x5627cfaf2e20 auth_method 0 2024-09-12T00:20:39.876 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.876 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.876 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.876 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:20:39.571+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.876 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:20:39.571+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.876 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:20:39.571+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.876 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.876 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.877 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.877 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:20:39.571+0000 7f85026cb640 10 monclient(hunting): get_auth_request con 0x5627cfac84d0 auth_method 0 2024-09-12T00:20:39.877 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:20:39.571+0000 7f85026cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.877 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:20:39.571+0000 7f85026cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.877 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:20:39.571+0000 7f85026cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.877 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): handle_auth_done global_id 7371 payload 824 2024-09-12T00:20:39.877 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient: _finish_hunting 0 2024-09-12T00:20:39.877 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:20:39.571+0000 7f8501eca640 1 monclient: found mon.noname-a 2024-09-12T00:20:39.877 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:20:39.877 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.877 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:20:39.877 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: dump: 2024-09-12T00:20:39.877 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.878 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.878 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.878 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.878 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.878 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.878 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.878 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.878 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.878 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.878 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: _finish_auth 0 2024-09-12T00:20:39.878 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: _check_auth_tickets 2024-09-12T00:20:39.878 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:39.878 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.879 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:20:39.879 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: dump: 2024-09-12T00:20:39.879 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.879 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.879 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.879 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.879 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.879 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.879 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.879 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.879 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.879 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.879 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:20:39.572+0000 7f8507014800 5 monclient: authenticate success, global_id 7371 2024-09-12T00:20:39.880 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:20:39.572+0000 7f83e5ffb640 4 set_mon_vals no callback set 2024-09-12T00:20:39.880 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:20:39.572+0000 7f8507014800 10 monclient: _renew_subs 2024-09-12T00:20:39.880 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:20:39.572+0000 7f8507014800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:20:39.880 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:20:39.572+0000 7f8507014800 10 monclient: _renew_subs 2024-09-12T00:20:39.880 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:20:39.572+0000 7f8507014800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:20:39.880 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:20:39.572+0000 7f8507014800 1 librados: init done 2024-09-12T00:20:39.880 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:20:39.572+0000 7f8507014800 5 asok(0x5627cf807630) register_command cr dump hook 0x5627cfae7ee8 2024-09-12T00:20:39.880 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:20:39.573+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.880 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:20:39.574+0000 7f83d3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:20:39.880 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:20:39.574+0000 7f83d3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:39.880 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:20:39.574+0000 7f83d3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:39.880 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:20:39.574+0000 7f85026cb640 10 monclient: get_auth_request con 0x7f83cc076470 auth_method 0 2024-09-12T00:20:39.880 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:20:39.575+0000 7f8502ecc640 10 monclient: get_auth_request con 0x5627cfb11ad0 auth_method 0 2024-09-12T00:20:39.881 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:20:39.575+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.881 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:20:39.575+0000 7f8507014800 20 realm 2024-09-12T00:20:39.881 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:20:39.575+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.881 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:20:39.575+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.881 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:20:39.575+0000 7f8507014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:39.881 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:20:39.576+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.881 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:20:39.576+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.881 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:20:39.576+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.881 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:20:39.576+0000 7f85026cb640 10 monclient: get_auth_request con 0x5627cfb15c70 auth_method 0 2024-09-12T00:20:39.881 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:20:39.577+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:39.881 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:20:39.577+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.881 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:20:39.578+0000 7f8501eca640 10 monclient: get_auth_request con 0x5627cfb194b0 auth_method 0 2024-09-12T00:20:39.881 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:20:39.581+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:39.882 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:20:39.581+0000 7f8507014800 20 searching for the correct realm 2024-09-12T00:20:39.882 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:20:39.581+0000 7f8502ecc640 10 monclient: get_auth_request con 0x7f84f8042060 auth_method 0 2024-09-12T00:20:39.882 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:20:39.583+0000 7f85026cb640 10 monclient: get_auth_request con 0x7f84f4088ba0 auth_method 0 2024-09-12T00:20:39.882 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:20:39.584+0000 7f8501eca640 10 monclient: get_auth_request con 0x7f84f806c4c0 auth_method 0 2024-09-12T00:20:39.882 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:20:39.584+0000 7f8501eca640 0 -- 172.21.15.67:0/1705772434 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f84f806c4c0 msgr2=0x7f84f80385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:39.882 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:20:39.785+0000 7f8501eca640 10 monclient: get_auth_request con 0x7f84f806c4c0 auth_method 0 2024-09-12T00:20:39.882 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:20:39.788+0000 7f8502ecc640 10 monclient: get_auth_request con 0x7f84f4061b50 auth_method 0 2024-09-12T00:20:39.882 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:20:39.788+0000 7f85026cb640 10 monclient: get_auth_request con 0x7f84fc061040 auth_method 0 2024-09-12T00:20:39.882 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:20:39.789+0000 7f8502ecc640 0 -- 172.21.15.67:0/1705772434 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5627cfb11ad0 msgr2=0x5627cfb13f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:39.882 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:20:39.789+0000 7f83d3fff640 1 client.7371.objecter ms_handle_reset 0x5627cfb11ad0 session 0x5627cfb11450 osd.6 2024-09-12T00:20:39.882 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:20:39.789+0000 7f83d3fff640 10 monclient: _renew_subs 2024-09-12T00:20:39.882 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:20:39.789+0000 7f83d3fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:20:39.882 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:20:39.790+0000 7f8502ecc640 10 monclient: get_auth_request con 0x7f83cc086790 auth_method 0 2024-09-12T00:20:39.882 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:20:39.793+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:20:39.794+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:20:39.794+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:20:39.794+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:20:39.794+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:20:39.794+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:20:39.794+0000 7f8507014800 20 zone default found 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:20:39.794+0000 7f8507014800 4 Realm: () 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:20:39.794+0000 7f8507014800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:20:39.794+0000 7f8507014800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:39.883 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:20:39.794+0000 7f8507014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:39.884 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:20:39.794+0000 7f8507014800 20 zonegroup default 2024-09-12T00:20:39.884 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:20:39.794+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.884 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:20:39.795+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.884 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:20:39.795+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.884 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:20:39.795+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.884 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:20:39.795+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.884 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:20:39.795+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.884 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:20:39.795+0000 7f8507014800 20 started sync module instance, tier type = 2024-09-12T00:20:39.884 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:20:39.795+0000 7f8507014800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:39.884 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=0 2024-09-12T00:20:39.884 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=1 2024-09-12T00:20:39.884 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=2 2024-09-12T00:20:39.884 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=3 2024-09-12T00:20:39.885 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=4 2024-09-12T00:20:39.885 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=5 2024-09-12T00:20:39.885 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=6 2024-09-12T00:20:39.885 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:20:39.805+0000 7f8507014800 20 add_watcher() i=7 2024-09-12T00:20:39.885 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:20:39.805+0000 7f8507014800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:39.885 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding auth protocol: cephx 2024-09-12T00:20:39.885 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding auth protocol: cephx 2024-09-12T00:20:39.885 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding auth protocol: cephx 2024-09-12T00:20:39.885 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: secure 2024-09-12T00:20:39.885 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: crc 2024-09-12T00:20:39.885 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: secure 2024-09-12T00:20:39.885 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: crc 2024-09-12T00:20:39.885 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: secure 2024-09-12T00:20:39.885 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: crc 2024-09-12T00:20:39.886 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: crc 2024-09-12T00:20:39.886 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: secure 2024-09-12T00:20:39.886 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: crc 2024-09-12T00:20:39.886 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: secure 2024-09-12T00:20:39.886 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: crc 2024-09-12T00:20:39.886 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: secure 2024-09-12T00:20:39.886 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:20:39.806+0000 7f83b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:39.886 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:20:39.806+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.886 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:20:39.806+0000 7f8507014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:39.886 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:20:39.806+0000 7f8507014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:39.886 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command cache list hook 0x5627cfaeb9c0 2024-09-12T00:20:39.886 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command cache inspect hook 0x5627cfaeb9c0 2024-09-12T00:20:39.886 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command cache erase hook 0x5627cfaeb9c0 2024-09-12T00:20:39.886 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command cache zap hook 0x5627cfaeb9c0 2024-09-12T00:20:39.886 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:20:39.807+0000 7f8507014800 5 note: GC not initialized 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:20:39.807+0000 7f83337fe640 20 reqs_thread_entry: start 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command sync trace show hook 0x7f84fc04da70 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command sync trace history hook 0x7f84fc04da70 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command sync trace active hook 0x7f84fc04da70 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command sync trace active_short hook 0x7f84fc04da70 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:20:39.807+0000 7f8507014800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:20:39.807+0000 7f8507014800 20 Filter name: none 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:20:39.807+0000 7f83317fa640 20 reqs_thread_entry: start 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:20:39.807+0000 7f8507014800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:20:39.807+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:20:39.808+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:20:39.808+0000 7f8507014800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:20:39.808+0000 7f8507014800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:20:39.808+0000 7f8507014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 : miss 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:20:39.808+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.887 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:20:39.808+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:20:39.888 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:20:39.808+0000 7f8507014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:20:39.888 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:20:39.808+0000 7f8507014800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:20:39.888 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:20:39.808+0000 7f8507014800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:39.888 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:20:39.808+0000 7f8507014800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:39.888 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:20:39.808+0000 7f8507014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 2024-09-12T00:20:39.888 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:20:39.812+0000 7f8507014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:20:39.888 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:20:39.812+0000 7f8507014800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:20:39.888 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:20:39.812+0000 7f8507014800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:39.888 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:20:39.812+0000 7f8507014800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32, ofs0, ns] 2024-09-12T00:20:39.888 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:20:39.813+0000 7f83e5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562436 cookie 94728988272000 notifier 7371 bl.length()=931 2024-09-12T00:20:39.888 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:20:39.813+0000 7f83e5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:20:39.888 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:20:39.813+0000 7f83e5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:20:39.888 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:20:39.813+0000 7f83e5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:39.888 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:20:39.813+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_sources= new_sources= 2024-09-12T00:20:39.889 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:20:39.813+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential sources added=[] removed=[] 2024-09-12T00:20:39.889 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:20:39.813+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_dests= new_dests= 2024-09-12T00:20:39.889 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:20:39.813+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential dests added=[] removed=[] 2024-09-12T00:20:39.889 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:20:39.815+0000 7f8507014800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.0 2024-09-12T00:20:39.889 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:20:39.815+0000 7f8507014800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.0 2024-09-12T00:20:39.889 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:20:39.815+0000 7f8507014800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.1 2024-09-12T00:20:39.889 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:20:39.815+0000 7f8507014800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.1 2024-09-12T00:20:39.889 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:20:39.815+0000 7f8507014800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.0 2024-09-12T00:20:39.889 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:20:39.818+0000 7f8507014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:39.889 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:20:39.818+0000 7f8507014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 2024-09-12T00:20:39.889 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:20:39.819+0000 7f8507014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:20:39.889 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:20:39.819+0000 7f8507014800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:20:39.890 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:20:39.819+0000 7f8507014800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:39.890 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:20:39.819+0000 7f8507014800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32, ofs0, ns] 2024-09-12T00:20:39.890 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:20:39.820+0000 7f83e5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562437 cookie 94728988272000 notifier 7371 bl.length()=931 2024-09-12T00:20:39.890 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:20:39.820+0000 7f83e5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:20:39.890 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:20:39.820+0000 7f83e5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:20:39.890 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:20:39.820+0000 7f83e5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:39.890 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:20:39.820+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_sources= new_sources= 2024-09-12T00:20:39.890 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:20:39.820+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential sources added=[] removed=[] 2024-09-12T00:20:39.890 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:20:39.820+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_dests= new_dests= 2024-09-12T00:20:39.890 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:20:39.820+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential dests added=[] removed=[] 2024-09-12T00:20:39.890 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:20:39.820+0000 7f83d3fff640 1 client.7371.objecter ms_handle_reset 0x7f84f806c4c0 session 0x7f84f8068100 osd.5 2024-09-12T00:20:39.890 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:20:39.820+0000 7f8501eca640 10 monclient: get_auth_request con 0x5627cfb11ad0 auth_method 0 2024-09-12T00:20:39.890 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:20:39.822+0000 7f8507014800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.0 2024-09-12T00:20:39.890 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:20:39.823+0000 7f8507014800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8507014800 time 2024-09-12T00:20:39.823038+0000 2024-09-12T00:20:39.890 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:20:39.891 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.891 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:39.891 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f850818c71a] 2024-09-12T00:20:39.891 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f850818c8d8] 2024-09-12T00:20:39.891 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ccf87641] 2024-09-12T00:20:39.891 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ccf97637] 2024-09-12T00:20:39.891 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:20:39.891 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f8506e29590] 2024-09-12T00:20:39.891 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:20:39.891 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:20:39.891 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.891 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:20:39.823+0000 7f8507014800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:20:39.891 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f8507014800 thread_name:radosgw-admin 2024-09-12T00:20:39.891 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.891 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:39.892 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8506e3e6f0] 2024-09-12T00:20:39.892 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8506e8b99c] 2024-09-12T00:20:39.892 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:20:39.892 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:20:39.892 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f850818c774] 2024-09-12T00:20:39.892 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f850818c8d8] 2024-09-12T00:20:39.892 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ccf87641] 2024-09-12T00:20:39.892 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ccf97637] 2024-09-12T00:20:39.892 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:20:39.892 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f8506e29590] 2024-09-12T00:20:39.892 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:20:39.892 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:20:39.892 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:20:39.893 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.893 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:20:39.893 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:20:39.893 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:20:39.893 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:20:39.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:20:39.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:20:39.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:20:39.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:20:39.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:20:39.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:20:39.893 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:20:39.893 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:20:39.893 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:20:39.893 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:20:39.894 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:20:39.894 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:20:39.894 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:20:39.894 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:20:39.894 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:20:39.894 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:20:39.894 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:20:39.894 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:20:39.894 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:20:39.894 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:20:39.894 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:20:39.894 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:20:39.894 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:20:39.895 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:20:39.895 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:20:39.895 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:20:39.895 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:20:39.895 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:20:39.895 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:20:39.895 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:20:39.895 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:20:39.895 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:20:39.895 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:20:39.895 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:20:39.895 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:20:39.895 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:20:39.895 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:20:39.896 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:20:39.896 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:20:39.896 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:20:39.896 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:20:39.896 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:20:39.896 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:20:39.896 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:20:39.896 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:20:39.896 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:20:39.896 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:20:39.896 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:20:39.896 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:20:39.896 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:20:39.896 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:20:39.896 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:20:39.897 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:20:39.897 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:20:39.897 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:20:39.897 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:20:39.897 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:20:39.897 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:20:39.897 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:20:39.897 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:20:39.897 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:20:39.897 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:20:39.897 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:20:39.897 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:20:39.897 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:20:39.897 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:20:39.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:20:39.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:20:39.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:20:39.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:20:39.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:20:39.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:20:39.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:20:39.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:20:39.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:20:39.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:20:39.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:20:39.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:20:39.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:20:39.898 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:20:39.899 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:20:39.899 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:20:39.899 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:20:39.899 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:20:39.899 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:20:39.899 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:20:39.899 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:20:39.899 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:20:39.899 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:20:39.899 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:20:39.899 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83317fa640 / http_manager 2024-09-12T00:20:39.899 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83337fe640 / http_manager 2024-09-12T00:20:39.899 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83b8fe1640 / rgw_dt_lg_renew 2024-09-12T00:20:39.900 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83d3fff640 / ms_dispatch 2024-09-12T00:20:39.900 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83e5ffb640 / io_context_pool 2024-09-12T00:20:39.900 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83e7fff640 / ms_dispatch 2024-09-12T00:20:39.900 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83eee05640 / ms_dispatch 2024-09-12T00:20:39.900 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83f0608640 / io_context_pool 2024-09-12T00:20:39.900 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8501eca640 / msgr-worker-2 2024-09-12T00:20:39.900 INFO:tasks.workunit.client.0.smithi067.stderr: 7f85026cb640 / msgr-worker-1 2024-09-12T00:20:39.900 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8502ecc640 / msgr-worker-0 2024-09-12T00:20:39.900 INFO:tasks.workunit.client.0.smithi067.stderr: 7f85036cd640 / io_context_pool 2024-09-12T00:20:39.900 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8507014800 / radosgw-admin 2024-09-12T00:20:39.900 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:20:39.900 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:20:39.901 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.121713.log 2024-09-12T00:20:39.901 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:20:39.901 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:20:39.901 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:20:39.556+0000 7f8507014800 5 AuthRegistry(0x5627cfa2d1f0) adding con mode: crc 2024-09-12T00:20:39.901 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:20:39.556+0000 7f8507014800 5 AuthRegistry(0x5627cfa2d1f0) adding con mode: crc 2024-09-12T00:20:39.901 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:20:39.556+0000 7f8507014800 5 AuthRegistry(0x5627cfa2d1f0) adding con mode: secure 2024-09-12T00:20:39.901 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:20:39.556+0000 7f8507014800 5 AuthRegistry(0x5627cfa2d1f0) adding con mode: crc 2024-09-12T00:20:39.901 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:20:39.556+0000 7f8507014800 5 AuthRegistry(0x5627cfa2d1f0) adding con mode: secure 2024-09-12T00:20:39.901 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:20:39.556+0000 7f8507014800 5 AuthRegistry(0x5627cfa2d1f0) adding con mode: crc 2024-09-12T00:20:39.901 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:20:39.556+0000 7f8507014800 5 AuthRegistry(0x5627cfa2d1f0) adding con mode: secure 2024-09-12T00:20:39.901 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:20:39.557+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.901 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:20:39.557+0000 7f8507014800 1 librados: starting msgr at 2024-09-12T00:20:39.901 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:20:39.557+0000 7f8507014800 1 librados: starting objecter 2024-09-12T00:20:39.901 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:20:39.557+0000 7f8507014800 5 asok(0x5627cf807630) register_command objecter_requests hook 0x5627cfa2b5a0 2024-09-12T00:20:39.902 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:20:39.557+0000 7f8507014800 1 librados: setting wanted keys 2024-09-12T00:20:39.902 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:20:39.557+0000 7f8507014800 1 librados: calling monclient init 2024-09-12T00:20:39.902 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient: init 2024-09-12T00:20:39.902 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding auth protocol: cephx 2024-09-12T00:20:39.902 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding auth protocol: cephx 2024-09-12T00:20:39.902 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding auth protocol: cephx 2024-09-12T00:20:39.902 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: secure 2024-09-12T00:20:39.902 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: crc 2024-09-12T00:20:39.902 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: secure 2024-09-12T00:20:39.902 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: crc 2024-09-12T00:20:39.902 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: secure 2024-09-12T00:20:39.902 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: crc 2024-09-12T00:20:39.902 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: crc 2024-09-12T00:20:39.903 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: secure 2024-09-12T00:20:39.903 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: crc 2024-09-12T00:20:39.903 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: secure 2024-09-12T00:20:39.903 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: crc 2024-09-12T00:20:39.903 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:20:39.557+0000 7f8507014800 5 AuthRegistry(0x5627cfa275b0) adding con mode: secure 2024-09-12T00:20:39.903 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:20:39.557+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.903 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:20:39.557+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.903 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:20:39.557+0000 7f8507014800 5 asok(0x5627cf807630) register_command rotate-key hook 0x5627cfa276f8 2024-09-12T00:20:39.903 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:39.903 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:20:39.903 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): picked mon.noname-c con 0x5627cf8d5020 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:39.903 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): picked mon.noname-a con 0x5627cf8def10 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:39.903 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): picked mon.noname-b con 0x5627cf96ae70 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:39.904 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.904 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.904 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.904 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:39.904 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:20:39.557+0000 7f8507014800 10 monclient(hunting): authenticate will time out at 1916.813832s 2024-09-12T00:20:39.904 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:20:39.557+0000 7f85026cb640 10 monclient(hunting): get_auth_request con 0x5627cf8d5020 auth_method 0 2024-09-12T00:20:39.904 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:20:39.557+0000 7f85026cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.904 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:20:39.557+0000 7f85026cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.904 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:20:39.557+0000 7f85026cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.904 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:20:39.557+0000 7f8501eca640 10 monclient(hunting): get_auth_request con 0x5627cf8def10 auth_method 0 2024-09-12T00:20:39.904 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:20:39.557+0000 7f8501eca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.904 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:20:39.557+0000 7f8501eca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.904 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:20:39.557+0000 7f8501eca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.905 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:20:39.557+0000 7f85026cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.905 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:20:39.557+0000 7f85026cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.905 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:20:39.557+0000 7f85026cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.905 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:20:39.558+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.905 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:20:39.558+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.905 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:20:39.558+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.905 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:20:39.558+0000 7f8502ecc640 10 monclient(hunting): get_auth_request con 0x5627cf96ae70 auth_method 0 2024-09-12T00:20:39.905 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:20:39.558+0000 7f8502ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.905 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:20:39.558+0000 7f8502ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.905 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:20:39.558+0000 7f8502ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.905 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:20:39.558+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.905 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:20:39.558+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.905 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:20:39.558+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.906 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:20:39.558+0000 7f85026cb640 10 monclient(hunting): handle_auth_done global_id 6896 payload 824 2024-09-12T00:20:39.906 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:20:39.558+0000 7f85026cb640 10 monclient: _finish_hunting 0 2024-09-12T00:20:39.906 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:20:39.558+0000 7f85026cb640 1 monclient: found mon.noname-c 2024-09-12T00:20:39.906 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:20:39.558+0000 7f85026cb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:20:39.906 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.906 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:20:39.906 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: dump: 2024-09-12T00:20:39.906 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.906 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.906 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.906 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.906 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.906 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.906 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.907 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.907 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.907 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.907 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: _finish_auth 0 2024-09-12T00:20:39.907 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: _check_auth_tickets 2024-09-12T00:20:39.907 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:39.907 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.907 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:20:39.907 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:20:39.558+0000 7f83eee05640 10 monclient: dump: 2024-09-12T00:20:39.907 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.907 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.907 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.907 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.907 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.907 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.908 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.908 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.908 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.908 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.908 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:20:39.558+0000 7f8507014800 5 monclient: authenticate success, global_id 6896 2024-09-12T00:20:39.908 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:20:39.558+0000 7f8507014800 10 monclient: _renew_subs 2024-09-12T00:20:39.908 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:20:39.558+0000 7f83f0608640 4 set_mon_vals no callback set 2024-09-12T00:20:39.908 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:20:39.558+0000 7f8507014800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:39.908 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:20:39.558+0000 7f8507014800 10 monclient: _renew_subs 2024-09-12T00:20:39.908 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:20:39.558+0000 7f8507014800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:39.908 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:20:39.558+0000 7f8507014800 1 librados: init done 2024-09-12T00:20:39.908 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:20:39.560+0000 7f83eee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:20:39.908 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:20:39.560+0000 7f83eee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:39.909 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:20:39.560+0000 7f83eee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:39.909 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:20:39.560+0000 7f8501eca640 10 monclient: get_auth_request con 0x7f83e8076470 auth_method 0 2024-09-12T00:20:39.909 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:20:39.561+0000 7f8502ecc640 10 monclient: get_auth_request con 0x5627cfa50250 auth_method 0 2024-09-12T00:20:39.909 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:20:39.562+0000 7f85026cb640 10 monclient: get_auth_request con 0x5627cfa72c70 auth_method 0 2024-09-12T00:20:39.909 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:20:39.562+0000 7f8501eca640 10 monclient: get_auth_request con 0x5627cfa77020 auth_method 0 2024-09-12T00:20:39.909 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:20:39.564+0000 7f8507014800 10 monclient: build_initial_monmap 2024-09-12T00:20:39.909 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:20:39.564+0000 7f8507014800 1 build_initial for_mkfs: 0 2024-09-12T00:20:39.909 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:20:39.564+0000 7f8507014800 10 monclient: monmap: 2024-09-12T00:20:39.909 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:20:39.909 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:20:39.909 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:20:39.909 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:20:39.909 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:20:39.910 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.910 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:20:39.910 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:20:39.910 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:20:39.910 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.910 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding auth protocol: cephx 2024-09-12T00:20:39.910 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding auth protocol: cephx 2024-09-12T00:20:39.910 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding auth protocol: cephx 2024-09-12T00:20:39.910 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: secure 2024-09-12T00:20:39.910 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: crc 2024-09-12T00:20:39.910 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: secure 2024-09-12T00:20:39.910 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: crc 2024-09-12T00:20:39.910 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: secure 2024-09-12T00:20:39.911 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: crc 2024-09-12T00:20:39.911 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: crc 2024-09-12T00:20:39.911 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: secure 2024-09-12T00:20:39.911 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: crc 2024-09-12T00:20:39.911 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: secure 2024-09-12T00:20:39.911 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: crc 2024-09-12T00:20:39.911 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7be40) adding con mode: secure 2024-09-12T00:20:39.911 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:20:39.564+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.911 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:20:39.564+0000 7f8507014800 5 asok(0x5627cf807630) register_command objecter_requests cmddesc objecter_requests hook 0x5627cfa7f800 EEXIST 2024-09-12T00:20:39.911 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:20:39.564+0000 7f8507014800 10 monclient: init 2024-09-12T00:20:39.911 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding auth protocol: cephx 2024-09-12T00:20:39.911 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding auth protocol: cephx 2024-09-12T00:20:39.911 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding auth protocol: cephx 2024-09-12T00:20:39.912 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: secure 2024-09-12T00:20:39.912 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: crc 2024-09-12T00:20:39.912 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: secure 2024-09-12T00:20:39.912 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: crc 2024-09-12T00:20:39.912 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: secure 2024-09-12T00:20:39.912 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: crc 2024-09-12T00:20:39.912 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: crc 2024-09-12T00:20:39.912 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: secure 2024-09-12T00:20:39.912 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: crc 2024-09-12T00:20:39.912 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: secure 2024-09-12T00:20:39.912 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: crc 2024-09-12T00:20:39.913 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:20:39.564+0000 7f8507014800 5 AuthRegistry(0x5627cfa7a518) adding con mode: secure 2024-09-12T00:20:39.913 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:20:39.564+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.913 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:20:39.565+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.913 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:20:39.565+0000 7f8507014800 5 asok(0x5627cf807630) register_command rotate-key cmddesc rotate-key hook 0x5627cfa7a660 EEXIST 2024-09-12T00:20:39.913 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:39.913 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:20:39.913 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): picked mon.noname-c con 0x5627cfaa34f0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:39.913 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): picked mon.noname-b con 0x5627cfaa57c0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:39.914 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): picked mon.noname-a con 0x5627cfaa1cc0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:39.914 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.914 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.914 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.914 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:39.914 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient(hunting): authenticate will time out at 1916.821195s 2024-09-12T00:20:39.914 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): get_auth_request con 0x5627cfaa34f0 auth_method 0 2024-09-12T00:20:39.914 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.914 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.914 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.914 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:20:39.565+0000 7f8502ecc640 10 monclient(hunting): get_auth_request con 0x5627cfaa1cc0 auth_method 0 2024-09-12T00:20:39.914 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:20:39.565+0000 7f8502ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.914 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:20:39.565+0000 7f8502ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.914 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:20:39.565+0000 7f8502ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.915 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.915 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.915 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.915 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:20:39.565+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.915 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:20:39.565+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.915 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:20:39.565+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.915 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient(hunting): handle_auth_done global_id 6899 payload 824 2024-09-12T00:20:39.915 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient: _finish_hunting 0 2024-09-12T00:20:39.915 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:20:39.565+0000 7f85026cb640 1 monclient: found mon.noname-c 2024-09-12T00:20:39.915 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:20:39.565+0000 7f85026cb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:20:39.915 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.915 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:20:39.915 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: dump: 2024-09-12T00:20:39.915 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.916 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.916 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.916 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.916 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.916 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.916 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.916 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.916 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.916 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.916 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: _finish_auth 0 2024-09-12T00:20:39.916 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: _check_auth_tickets 2024-09-12T00:20:39.916 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:39.917 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.917 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:20:39.917 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:20:39.565+0000 7f83e7fff640 10 monclient: dump: 2024-09-12T00:20:39.917 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.917 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.917 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.917 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.917 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.917 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.917 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.917 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.917 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.917 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.917 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:20:39.565+0000 7f8507014800 5 monclient: authenticate success, global_id 6899 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient: _renew_subs 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:20:39.565+0000 7f85036cd640 4 set_mon_vals no callback set 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient: _renew_subs 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:20:39.565+0000 7f8507014800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:20:39.567+0000 7f83e7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:20:39.567+0000 7f83e7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:20:39.567+0000 7f83e7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:20:39.567+0000 7f8501eca640 10 monclient: get_auth_request con 0x7f83dc076380 auth_method 0 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:20:39.567+0000 7f8507014800 10 monclient: get_monmap_and_config 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:20:39.567+0000 7f8507014800 10 monclient: build_initial_monmap 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:20:39.567+0000 7f8507014800 1 build_initial for_mkfs: 0 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:20:39.568+0000 7f8507014800 10 monclient: monmap: 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:20:39.918 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:20:39.919 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:20:39.919 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:20:39.919 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.919 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:20:39.919 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:20:39.919 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:20:39.919 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.919 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding auth protocol: cephx 2024-09-12T00:20:39.919 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding auth protocol: cephx 2024-09-12T00:20:39.919 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding auth protocol: cephx 2024-09-12T00:20:39.919 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: secure 2024-09-12T00:20:39.919 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: crc 2024-09-12T00:20:39.919 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: secure 2024-09-12T00:20:39.919 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: crc 2024-09-12T00:20:39.919 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: secure 2024-09-12T00:20:39.920 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: crc 2024-09-12T00:20:39.920 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: crc 2024-09-12T00:20:39.920 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: secure 2024-09-12T00:20:39.920 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: crc 2024-09-12T00:20:39.920 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: secure 2024-09-12T00:20:39.920 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: crc 2024-09-12T00:20:39.920 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x5627cfac2f20) adding con mode: secure 2024-09-12T00:20:39.920 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:20:39.568+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.920 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:20:39.568+0000 7f8507014800 10 monclient: init 2024-09-12T00:20:39.920 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding auth protocol: cephx 2024-09-12T00:20:39.920 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding auth protocol: cephx 2024-09-12T00:20:39.920 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding auth protocol: cephx 2024-09-12T00:20:39.920 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: secure 2024-09-12T00:20:39.921 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: crc 2024-09-12T00:20:39.921 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: secure 2024-09-12T00:20:39.921 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: crc 2024-09-12T00:20:39.921 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: secure 2024-09-12T00:20:39.921 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: crc 2024-09-12T00:20:39.921 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: crc 2024-09-12T00:20:39.921 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: secure 2024-09-12T00:20:39.921 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: crc 2024-09-12T00:20:39.921 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: secure 2024-09-12T00:20:39.921 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: crc 2024-09-12T00:20:39.921 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:20:39.568+0000 7f8507014800 5 AuthRegistry(0x7ffc659da250) adding con mode: secure 2024-09-12T00:20:39.921 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:20:39.568+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.922 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:20:39.568+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.922 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:20:39.568+0000 7f8507014800 5 asok(0x5627cf807630) register_command rotate-key cmddesc rotate-key hook 0x7ffc659da398 EEXIST 2024-09-12T00:20:39.922 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:20:39.568+0000 7f8507014800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:39.922 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:20:39.568+0000 7f8507014800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:20:39.922 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:20:39.568+0000 7f8507014800 10 monclient(hunting): picked mon.noname-b con 0x5627cfaf7580 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:39.922 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:20:39.568+0000 7f8507014800 10 monclient(hunting): picked mon.noname-a con 0x5627cfac84d0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:39.922 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:20:39.568+0000 7f8507014800 10 monclient(hunting): picked mon.noname-c con 0x5627cfaf2e20 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:39.922 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:20:39.569+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.922 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:20:39.569+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.922 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:20:39.569+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.922 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:20:39.569+0000 7f8507014800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:39.922 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:20:39.569+0000 7f8507014800 10 monclient(hunting): authenticate will time out at 1916.825022s 2024-09-12T00:20:39.923 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): get_auth_request con 0x5627cfaf2e20 auth_method 0 2024-09-12T00:20:39.923 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.923 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.923 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.923 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:20:39.569+0000 7f8501eca640 10 monclient(hunting): get_auth_request con 0x5627cfac84d0 auth_method 0 2024-09-12T00:20:39.923 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:20:39.569+0000 7f8501eca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.923 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:20:39.569+0000 7f8501eca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.923 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:20:39.569+0000 7f8501eca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.923 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.923 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.923 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.923 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:20:39.569+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.923 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:20:39.569+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.924 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:20:39.569+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.924 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:20:39.569+0000 7f85026cb640 10 monclient(hunting): get_auth_request con 0x5627cfaf7580 auth_method 0 2024-09-12T00:20:39.924 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:20:39.569+0000 7f85026cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.924 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:20:39.569+0000 7f85026cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.924 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:20:39.569+0000 7f85026cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.924 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient(hunting): handle_auth_done global_id 6902 payload 274 2024-09-12T00:20:39.924 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient: _finish_hunting 0 2024-09-12T00:20:39.924 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:20:39.569+0000 7f8502ecc640 1 monclient: found mon.noname-c 2024-09-12T00:20:39.924 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:20:39.569+0000 7f8502ecc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:20:39.924 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.924 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:20:39.924 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: dump: 2024-09-12T00:20:39.924 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.924 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.925 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.925 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.925 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.925 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.925 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.925 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.925 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.925 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.925 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: _finish_auth 0 2024-09-12T00:20:39.925 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:20:39.925 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:39.925 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:20:39.569+0000 7f8507014800 5 monclient: authenticate success, global_id 6902 2024-09-12T00:20:39.925 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:20:39.569+0000 7f8507014800 10 monclient: get_monmap_and_config success 2024-09-12T00:20:39.926 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.926 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:20:39.569+0000 7f8507014800 4 set_mon_vals no callback set 2024-09-12T00:20:39.926 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:20:39.926 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:20:39.569+0000 7f83e5ffb640 10 monclient: dump: 2024-09-12T00:20:39.926 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.926 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.926 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.926 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.926 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.926 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.926 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.926 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.926 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.927 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.927 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:20:39.570+0000 7f8507014800 10 monclient: shutdown 2024-09-12T00:20:39.927 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:20:39.570+0000 7f8507014800 10 monclient: build_initial_monmap 2024-09-12T00:20:39.927 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:20:39.570+0000 7f8507014800 1 build_initial for_mkfs: 0 2024-09-12T00:20:39.927 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:20:39.570+0000 7f8507014800 10 monclient: monmap: 2024-09-12T00:20:39.927 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:20:39.927 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:20:39.927 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:20:39.927 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:20:39.927 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:20:39.928 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.928 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:20:39.928 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:20:39.928 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:20:39.928 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.928 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding auth protocol: cephx 2024-09-12T00:20:39.928 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding auth protocol: cephx 2024-09-12T00:20:39.928 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding auth protocol: cephx 2024-09-12T00:20:39.928 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: secure 2024-09-12T00:20:39.928 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: crc 2024-09-12T00:20:39.928 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: secure 2024-09-12T00:20:39.928 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: crc 2024-09-12T00:20:39.928 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: secure 2024-09-12T00:20:39.929 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: crc 2024-09-12T00:20:39.929 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: crc 2024-09-12T00:20:39.929 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: secure 2024-09-12T00:20:39.929 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: crc 2024-09-12T00:20:39.929 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: secure 2024-09-12T00:20:39.929 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: crc 2024-09-12T00:20:39.929 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfaf3750) adding con mode: secure 2024-09-12T00:20:39.929 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:20:39.570+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.929 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:20:39.570+0000 7f8507014800 1 librados: starting msgr at 2024-09-12T00:20:39.929 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:20:39.570+0000 7f8507014800 1 librados: starting objecter 2024-09-12T00:20:39.929 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:20:39.570+0000 7f8507014800 5 asok(0x5627cf807630) register_command objecter_requests cmddesc objecter_requests hook 0x5627cfac90e0 EEXIST 2024-09-12T00:20:39.929 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:20:39.570+0000 7f8507014800 1 librados: setting wanted keys 2024-09-12T00:20:39.929 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:20:39.570+0000 7f8507014800 1 librados: calling monclient init 2024-09-12T00:20:39.930 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:20:39.570+0000 7f8507014800 10 monclient: init 2024-09-12T00:20:39.930 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding auth protocol: cephx 2024-09-12T00:20:39.930 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding auth protocol: cephx 2024-09-12T00:20:39.930 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding auth protocol: cephx 2024-09-12T00:20:39.930 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: secure 2024-09-12T00:20:39.930 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: crc 2024-09-12T00:20:39.930 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: secure 2024-09-12T00:20:39.930 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: crc 2024-09-12T00:20:39.930 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: secure 2024-09-12T00:20:39.930 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: crc 2024-09-12T00:20:39.930 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: crc 2024-09-12T00:20:39.930 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: secure 2024-09-12T00:20:39.930 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: crc 2024-09-12T00:20:39.930 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: secure 2024-09-12T00:20:39.931 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: crc 2024-09-12T00:20:39.931 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:20:39.570+0000 7f8507014800 5 AuthRegistry(0x5627cfabb2a0) adding con mode: secure 2024-09-12T00:20:39.931 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:20:39.571+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.931 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:20:39.571+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.931 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:20:39.571+0000 7f8507014800 5 asok(0x5627cf807630) register_command rotate-key cmddesc rotate-key hook 0x5627cfabb3e8 EEXIST 2024-09-12T00:20:39.931 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient: _reopen_session rank -1 2024-09-12T00:20:39.931 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:20:39.931 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): picked mon.noname-b con 0x5627cfac84d0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:20:39.931 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): picked mon.noname-a con 0x5627cfaf2e20 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:20:39.931 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): picked mon.noname-c con 0x5627cfaf7580 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:20:39.931 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.931 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.932 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): start opening mon connection 2024-09-12T00:20:39.932 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): _renew_subs 2024-09-12T00:20:39.932 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:20:39.571+0000 7f8507014800 10 monclient(hunting): authenticate will time out at 1916.827373s 2024-09-12T00:20:39.932 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:20:39.571+0000 7f8502ecc640 10 monclient(hunting): get_auth_request con 0x5627cfaf7580 auth_method 0 2024-09-12T00:20:39.932 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:20:39.571+0000 7f8502ecc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.932 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:20:39.571+0000 7f8502ecc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.932 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:20:39.571+0000 7f8502ecc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.932 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): get_auth_request con 0x5627cfaf2e20 auth_method 0 2024-09-12T00:20:39.932 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.932 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.932 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.932 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:20:39.571+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.932 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:20:39.571+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.932 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:20:39.571+0000 7f8502ecc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.933 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:20:39.933 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:20:39.933 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:20:39.933 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:20:39.571+0000 7f85026cb640 10 monclient(hunting): get_auth_request con 0x5627cfac84d0 auth_method 0 2024-09-12T00:20:39.933 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:20:39.571+0000 7f85026cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:20:39.933 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:20:39.571+0000 7f85026cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:20:39.933 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:20:39.571+0000 7f85026cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:20:39.933 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient(hunting): handle_auth_done global_id 7371 payload 824 2024-09-12T00:20:39.933 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient: _finish_hunting 0 2024-09-12T00:20:39.933 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:20:39.571+0000 7f8501eca640 1 monclient: found mon.noname-a 2024-09-12T00:20:39.933 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:20:39.571+0000 7f8501eca640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:20:39.933 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.933 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:20:39.933 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: dump: 2024-09-12T00:20:39.934 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.934 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.934 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.934 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.934 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.934 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.934 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.934 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.934 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.934 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.934 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: _finish_auth 0 2024-09-12T00:20:39.934 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: _check_auth_tickets 2024-09-12T00:20:39.934 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:20:39.935 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:20:39.935 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:20:39.935 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:20:39.572+0000 7f83d3fff640 10 monclient: dump: 2024-09-12T00:20:39.935 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:20:39.935 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:20:39.935 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.935 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:20:39.935 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:20:39.935 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:20:39.935 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:20:39.935 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:20:39.935 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:20:39.935 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.935 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:20:39.572+0000 7f8507014800 5 monclient: authenticate success, global_id 7371 2024-09-12T00:20:39.936 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:20:39.572+0000 7f83e5ffb640 4 set_mon_vals no callback set 2024-09-12T00:20:39.936 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:20:39.572+0000 7f8507014800 10 monclient: _renew_subs 2024-09-12T00:20:39.936 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:20:39.572+0000 7f8507014800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:20:39.936 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:20:39.572+0000 7f8507014800 10 monclient: _renew_subs 2024-09-12T00:20:39.936 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:20:39.572+0000 7f8507014800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:20:39.936 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:20:39.572+0000 7f8507014800 1 librados: init done 2024-09-12T00:20:39.936 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:20:39.572+0000 7f8507014800 5 asok(0x5627cf807630) register_command cr dump hook 0x5627cfae7ee8 2024-09-12T00:20:39.936 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:20:39.573+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.936 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:20:39.574+0000 7f83d3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:20:39.936 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:20:39.574+0000 7f83d3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:39.936 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:20:39.574+0000 7f83d3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:20:39.936 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:20:39.574+0000 7f85026cb640 10 monclient: get_auth_request con 0x7f83cc076470 auth_method 0 2024-09-12T00:20:39.936 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:20:39.575+0000 7f8502ecc640 10 monclient: get_auth_request con 0x5627cfb11ad0 auth_method 0 2024-09-12T00:20:39.936 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:20:39.575+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.937 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:20:39.575+0000 7f8507014800 20 realm 2024-09-12T00:20:39.937 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:20:39.575+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.937 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:20:39.575+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.937 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:20:39.575+0000 7f8507014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:39.937 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:20:39.576+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.937 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:20:39.576+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.937 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:20:39.576+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.937 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:20:39.576+0000 7f85026cb640 10 monclient: get_auth_request con 0x5627cfb15c70 auth_method 0 2024-09-12T00:20:39.937 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:20:39.577+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:39.937 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:20:39.577+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.937 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:20:39.578+0000 7f8501eca640 10 monclient: get_auth_request con 0x5627cfb194b0 auth_method 0 2024-09-12T00:20:39.937 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:20:39.581+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:39.937 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:20:39.581+0000 7f8507014800 20 searching for the correct realm 2024-09-12T00:20:39.937 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:20:39.581+0000 7f8502ecc640 10 monclient: get_auth_request con 0x7f84f8042060 auth_method 0 2024-09-12T00:20:39.938 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:20:39.583+0000 7f85026cb640 10 monclient: get_auth_request con 0x7f84f4088ba0 auth_method 0 2024-09-12T00:20:39.938 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:20:39.584+0000 7f8501eca640 10 monclient: get_auth_request con 0x7f84f806c4c0 auth_method 0 2024-09-12T00:20:39.938 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:20:39.584+0000 7f8501eca640 0 -- 172.21.15.67:0/1705772434 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f84f806c4c0 msgr2=0x7f84f80385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:39.938 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:20:39.785+0000 7f8501eca640 10 monclient: get_auth_request con 0x7f84f806c4c0 auth_method 0 2024-09-12T00:20:39.938 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:20:39.788+0000 7f8502ecc640 10 monclient: get_auth_request con 0x7f84f4061b50 auth_method 0 2024-09-12T00:20:39.938 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:20:39.788+0000 7f85026cb640 10 monclient: get_auth_request con 0x7f84fc061040 auth_method 0 2024-09-12T00:20:39.938 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:20:39.789+0000 7f8502ecc640 0 -- 172.21.15.67:0/1705772434 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5627cfb11ad0 msgr2=0x5627cfb13f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:39.938 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:20:39.789+0000 7f83d3fff640 1 client.7371.objecter ms_handle_reset 0x5627cfb11ad0 session 0x5627cfb11450 osd.6 2024-09-12T00:20:39.938 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:20:39.789+0000 7f83d3fff640 10 monclient: _renew_subs 2024-09-12T00:20:39.938 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:20:39.789+0000 7f83d3fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:20:39.938 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:20:39.790+0000 7f8502ecc640 10 monclient: get_auth_request con 0x7f83cc086790 auth_method 0 2024-09-12T00:20:39.938 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:39.938 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:39.939 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:39.939 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:39.939 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:39.939 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:20:39.793+0000 7f8507014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:39.939 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:20:39.793+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.939 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:20:39.794+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.939 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:20:39.794+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.939 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:20:39.794+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:39.939 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:20:39.794+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.939 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:20:39.794+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:39.939 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:20:39.794+0000 7f8507014800 20 zone default found 2024-09-12T00:20:39.939 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:20:39.794+0000 7f8507014800 4 Realm: () 2024-09-12T00:20:39.939 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:20:39.794+0000 7f8507014800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:39.939 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:20:39.794+0000 7f8507014800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:39.940 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:20:39.794+0000 7f8507014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:39.940 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:20:39.794+0000 7f8507014800 20 zonegroup default 2024-09-12T00:20:39.940 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:20:39.794+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.940 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:20:39.795+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.940 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:20:39.795+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.940 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:20:39.795+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.940 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:20:39.795+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.940 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:20:39.795+0000 7f8507014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.940 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:20:39.795+0000 7f8507014800 20 started sync module instance, tier type = 2024-09-12T00:20:39.940 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:20:39.795+0000 7f8507014800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:39.940 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=0 2024-09-12T00:20:39.940 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=1 2024-09-12T00:20:39.941 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=2 2024-09-12T00:20:39.941 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=3 2024-09-12T00:20:39.941 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=4 2024-09-12T00:20:39.941 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=5 2024-09-12T00:20:39.941 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:20:39.804+0000 7f8507014800 20 add_watcher() i=6 2024-09-12T00:20:39.941 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:20:39.805+0000 7f8507014800 20 add_watcher() i=7 2024-09-12T00:20:39.941 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:20:39.805+0000 7f8507014800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:39.941 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding auth protocol: cephx 2024-09-12T00:20:39.941 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding auth protocol: cephx 2024-09-12T00:20:39.941 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding auth protocol: cephx 2024-09-12T00:20:39.941 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: secure 2024-09-12T00:20:39.941 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: crc 2024-09-12T00:20:39.941 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: secure 2024-09-12T00:20:39.941 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: crc 2024-09-12T00:20:39.942 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: secure 2024-09-12T00:20:39.942 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: crc 2024-09-12T00:20:39.942 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: crc 2024-09-12T00:20:39.942 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: secure 2024-09-12T00:20:39.942 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: crc 2024-09-12T00:20:39.942 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: secure 2024-09-12T00:20:39.942 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: crc 2024-09-12T00:20:39.942 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:20:39.806+0000 7f8507014800 5 AuthRegistry(0x7ffc659da730) adding con mode: secure 2024-09-12T00:20:39.942 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:20:39.806+0000 7f83b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:39.942 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:20:39.806+0000 7f8507014800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:20:39.942 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:20:39.806+0000 7f8507014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:39.942 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:20:39.806+0000 7f8507014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:39.942 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command cache list hook 0x5627cfaeb9c0 2024-09-12T00:20:39.943 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command cache inspect hook 0x5627cfaeb9c0 2024-09-12T00:20:39.943 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command cache erase hook 0x5627cfaeb9c0 2024-09-12T00:20:39.943 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command cache zap hook 0x5627cfaeb9c0 2024-09-12T00:20:39.943 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:20:39.807+0000 7f8507014800 5 note: GC not initialized 2024-09-12T00:20:39.943 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:20:39.807+0000 7f83337fe640 20 reqs_thread_entry: start 2024-09-12T00:20:39.943 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command sync trace show hook 0x7f84fc04da70 2024-09-12T00:20:39.943 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command sync trace history hook 0x7f84fc04da70 2024-09-12T00:20:39.943 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command sync trace active hook 0x7f84fc04da70 2024-09-12T00:20:39.943 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:20:39.807+0000 7f8507014800 5 asok(0x5627cf807630) register_command sync trace active_short hook 0x7f84fc04da70 2024-09-12T00:20:39.943 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:20:39.807+0000 7f8507014800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:39.943 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:20:39.807+0000 7f8507014800 20 Filter name: none 2024-09-12T00:20:39.943 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:20:39.807+0000 7f83317fa640 20 reqs_thread_entry: start 2024-09-12T00:20:39.943 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:20:39.807+0000 7f8507014800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:20:39.943 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:20:39.807+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.943 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:20:39.808+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:39.944 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:20:39.808+0000 7f8507014800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:20:39.944 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:20:39.808+0000 7f8507014800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:20:39.944 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:20:39.808+0000 7f8507014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 : miss 2024-09-12T00:20:39.944 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:20:39.808+0000 7f8507014800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.944 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:20:39.808+0000 7f8507014800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:20:39.944 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:20:39.808+0000 7f8507014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:20:39.944 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:20:39.808+0000 7f8507014800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:20:39.944 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:20:39.808+0000 7f8507014800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:20:39.944 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:20:39.808+0000 7f8507014800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:39.944 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:20:39.808+0000 7f8507014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 2024-09-12T00:20:39.944 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:20:39.812+0000 7f8507014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:20:39.944 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:20:39.812+0000 7f8507014800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:20:39.944 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:20:39.812+0000 7f8507014800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:39.945 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:20:39.812+0000 7f8507014800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32, ofs0, ns] 2024-09-12T00:20:39.945 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:20:39.813+0000 7f83e5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562436 cookie 94728988272000 notifier 7371 bl.length()=931 2024-09-12T00:20:39.945 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:20:39.813+0000 7f83e5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:20:39.945 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:20:39.813+0000 7f83e5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:20:39.945 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:20:39.813+0000 7f83e5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:39.945 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:20:39.813+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_sources= new_sources= 2024-09-12T00:20:39.945 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:20:39.813+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential sources added=[] removed=[] 2024-09-12T00:20:39.945 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:20:39.813+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_dests= new_dests= 2024-09-12T00:20:39.945 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:20:39.813+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential dests added=[] removed=[] 2024-09-12T00:20:39.945 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:20:39.815+0000 7f8507014800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.0 2024-09-12T00:20:39.945 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:20:39.815+0000 7f8507014800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.0 2024-09-12T00:20:39.945 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:20:39.815+0000 7f8507014800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.1 2024-09-12T00:20:39.946 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:20:39.815+0000 7f8507014800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.1 2024-09-12T00:20:39.946 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:20:39.815+0000 7f8507014800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.0 2024-09-12T00:20:39.946 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:20:39.818+0000 7f8507014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:20:39.946 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:20:39.818+0000 7f8507014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 2024-09-12T00:20:39.946 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:20:39.819+0000 7f8507014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:20:39.946 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:20:39.819+0000 7f8507014800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:20:39.946 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:20:39.819+0000 7f8507014800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:39.946 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:20:39.819+0000 7f8507014800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32, ofs0, ns] 2024-09-12T00:20:39.946 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:20:39.820+0000 7f83e5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562437 cookie 94728988272000 notifier 7371 bl.length()=931 2024-09-12T00:20:39.946 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:20:39.820+0000 7f83e5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:20:39.946 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:20:39.820+0000 7f83e5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:20:39.946 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:20:39.820+0000 7f83e5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:20:39.946 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:20:39.820+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_sources= new_sources= 2024-09-12T00:20:39.947 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:20:39.820+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential sources added=[] removed=[] 2024-09-12T00:20:39.947 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:20:39.820+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_dests= new_dests= 2024-09-12T00:20:39.947 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:20:39.820+0000 7f8507014800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential dests added=[] removed=[] 2024-09-12T00:20:39.947 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:20:39.820+0000 7f83d3fff640 1 client.7371.objecter ms_handle_reset 0x7f84f806c4c0 session 0x7f84f8068100 osd.5 2024-09-12T00:20:39.947 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:20:39.820+0000 7f8501eca640 10 monclient: get_auth_request con 0x5627cfb11ad0 auth_method 0 2024-09-12T00:20:39.947 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:20:39.822+0000 7f8507014800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.0 2024-09-12T00:20:39.947 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:20:39.823+0000 7f8507014800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8507014800 time 2024-09-12T00:20:39.823038+0000 2024-09-12T00:20:39.947 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:20:39.947 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.947 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:39.947 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f850818c71a] 2024-09-12T00:20:39.947 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f850818c8d8] 2024-09-12T00:20:39.947 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ccf87641] 2024-09-12T00:20:39.947 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ccf97637] 2024-09-12T00:20:39.948 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:20:39.948 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f8506e29590] 2024-09-12T00:20:39.948 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:20:39.948 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:20:39.948 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.948 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:20:39.823+0000 7f8507014800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:20:39.948 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f8507014800 thread_name:radosgw-admin 2024-09-12T00:20:39.948 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.948 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:20:39.948 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8506e3e6f0] 2024-09-12T00:20:39.948 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8506e8b99c] 2024-09-12T00:20:39.948 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:20:39.948 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:20:39.948 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f850818c774] 2024-09-12T00:20:39.949 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f850818c8d8] 2024-09-12T00:20:39.949 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5627ccf87641] 2024-09-12T00:20:39.949 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x5627ccf97637] 2024-09-12T00:20:39.949 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:20:39.949 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f8506e29590] 2024-09-12T00:20:39.949 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:20:39.949 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:20:39.949 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:20:39.949 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.949 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:20:39.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:20:39.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:20:39.949 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:20:39.950 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:20:39.951 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:20:39.951 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:20:39.951 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:20:39.951 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:20:39.951 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:20:39.951 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:20:39.951 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:20:39.951 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:20:39.951 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:20:39.951 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:20:39.951 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:20:39.951 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:20:39.951 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:20:39.951 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:20:39.951 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:20:39.952 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:20:39.952 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:20:39.952 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:20:39.952 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:20:39.952 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:20:39.952 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:20:39.952 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:20:39.952 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:20:39.952 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:20:39.952 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:20:39.952 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:20:39.952 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:20:39.952 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:20:39.952 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:20:39.953 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:20:39.953 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:20:39.953 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:20:39.953 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:20:39.953 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:20:39.953 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:20:39.953 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:20:39.953 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:20:39.953 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:20:39.953 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:20:39.953 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:20:39.953 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:20:39.953 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:20:39.953 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:20:39.953 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:20:39.954 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:20:39.954 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:20:39.954 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:20:39.954 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:20:39.954 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:20:39.954 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:20:39.954 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:20:39.954 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:20:39.954 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:20:39.954 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:20:39.954 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:20:39.954 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:20:39.954 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:20:39.954 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:20:39.954 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:20:39.955 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:20:39.955 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:20:39.955 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:20:39.955 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:20:39.955 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:20:39.955 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:20:39.955 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:20:39.955 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:20:39.955 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:20:39.955 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:20:39.955 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:20:39.955 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:20:39.955 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:20:39.955 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:20:39.956 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:20:39.956 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83317fa640 / http_manager 2024-09-12T00:20:39.956 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83337fe640 / http_manager 2024-09-12T00:20:39.956 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83b8fe1640 / rgw_dt_lg_renew 2024-09-12T00:20:39.956 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83d3fff640 / ms_dispatch 2024-09-12T00:20:39.956 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83e5ffb640 / io_context_pool 2024-09-12T00:20:39.956 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83e7fff640 / ms_dispatch 2024-09-12T00:20:39.956 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83eee05640 / ms_dispatch 2024-09-12T00:20:39.956 INFO:tasks.workunit.client.0.smithi067.stderr: 7f83f0608640 / io_context_pool 2024-09-12T00:20:39.956 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8501eca640 / msgr-worker-2 2024-09-12T00:20:39.956 INFO:tasks.workunit.client.0.smithi067.stderr: 7f85026cb640 / msgr-worker-1 2024-09-12T00:20:39.956 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8502ecc640 / msgr-worker-0 2024-09-12T00:20:39.956 INFO:tasks.workunit.client.0.smithi067.stderr: 7f85036cd640 / io_context_pool 2024-09-12T00:20:39.956 INFO:tasks.workunit.client.0.smithi067.stderr: 7f8507014800 / radosgw-admin 2024-09-12T00:20:39.957 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:20:39.957 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:20:39.957 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:20:39.824462Z_61aa5980-7e23-4c59-ae87-edb8b572effa/log 2024-09-12T00:20:39.957 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:20:39.957 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:20:39.962 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:39.962 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:39.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.902+0000 7fab9f526800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.904+0000 7fab9f526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.904+0000 7fab9f526800 20 realm 2024-09-12T00:20:39.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.904+0000 7fab9f526800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.904+0000 7fab9f526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.904+0000 7fab9f526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:39.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.904+0000 7fab9f526800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.905+0000 7fab9f526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.905+0000 7fab9f526800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.905+0000 7fab9f526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:39.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.905+0000 7fab9f526800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.906+0000 7fab9f526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:39.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.906+0000 7fab9f526800 20 searching for the correct realm 2024-09-12T00:20:39.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.910+0000 7fab9b95e640 0 -- 172.21.15.67:0/50356152 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7fab90008070 msgr2=0x7fab900615c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:39.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.913+0000 7fab9b15d640 0 -- 172.21.15.67:0/50356152 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fab94061040 msgr2=0x7fab940a7030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:39.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.917+0000 7fab9f526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:39.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.917+0000 7fab9f526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:39.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.917+0000 7fab9f526800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:20:39.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.917+0000 7fab9f526800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:20:39.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.917+0000 7fab9f526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:39.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.917+0000 7fab9f526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:39.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.917+0000 7fab9f526800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.918+0000 7fab9f526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.918+0000 7fab9f526800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.918+0000 7fab9f526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:39.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.918+0000 7fab9f526800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.918+0000 7fab9f526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:39.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.918+0000 7fab9f526800 20 zone default found 2024-09-12T00:20:39.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.918+0000 7fab9f526800 4 Realm: () 2024-09-12T00:20:39.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.918+0000 7fab9f526800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:20:39.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.918+0000 7fab9f526800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:20:39.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.918+0000 7fab9f526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:39.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.918+0000 7fab9f526800 20 zonegroup default 2024-09-12T00:20:39.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.918+0000 7fab9f526800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.919+0000 7fab9f526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.919+0000 7fab9f526800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.919+0000 7fab9f526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.919+0000 7fab9f526800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.919+0000 7fab9f526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:39.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.919+0000 7fab9f526800 20 started sync module instance, tier type = 2024-09-12T00:20:39.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.919+0000 7fab9f526800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:20:39.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.927+0000 7fab9f526800 20 add_watcher() i=0 2024-09-12T00:20:39.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.927+0000 7fab9f526800 20 add_watcher() i=1 2024-09-12T00:20:39.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.927+0000 7fab9f526800 20 add_watcher() i=2 2024-09-12T00:20:39.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.927+0000 7fab9f526800 20 add_watcher() i=3 2024-09-12T00:20:39.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.927+0000 7fab9f526800 20 add_watcher() i=4 2024-09-12T00:20:39.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.927+0000 7fab9f526800 20 add_watcher() i=5 2024-09-12T00:20:39.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.927+0000 7fab9f526800 20 add_watcher() i=6 2024-09-12T00:20:39.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.928+0000 7fab9f526800 20 add_watcher() i=7 2024-09-12T00:20:39.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.928+0000 7fab9f526800 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:39.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.930+0000 7faa51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:39.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.930+0000 7fab9f526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:39.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.930+0000 7fab9f526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:39.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.930+0000 7fab9f526800 5 note: GC not initialized 2024-09-12T00:20:39.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.930+0000 7faa50fe1640 20 reqs_thread_entry: start 2024-09-12T00:20:39.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.931+0000 7fab9f526800 20 init_complete bucket index max shards: 1 2024-09-12T00:20:39.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.931+0000 7fab9f526800 20 Filter name: none 2024-09-12T00:20:39.966 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.931+0000 7fa9ca7fc640 20 reqs_thread_entry: start 2024-09-12T00:20:39.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.931+0000 7fab9f526800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.931+0000 7fab9f526800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:39.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.931+0000 7fab9f526800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.932+0000 7fab9f526800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:20:39.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.932+0000 7fab9f526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:39.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.932+0000 7fab9f526800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.932+0000 7fab9f526800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:20:39.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.932+0000 7fab9f526800 20 rados->read ofs=0 len=0 2024-09-12T00:20:39.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.932+0000 7fab9f526800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:20:39.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.932+0000 7fab9f526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:20:39.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.934+0000 7faa51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:39.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.936+0000 7fab9f526800 20 remove_watcher() i=0 2024-09-12T00:20:39.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.936+0000 7fab9f526800 2 removed watcher, disabling cache 2024-09-12T00:20:39.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.937+0000 7fab9f526800 20 remove_watcher() i=1 2024-09-12T00:20:39.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.938+0000 7fab9f526800 20 remove_watcher() i=2 2024-09-12T00:20:39.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.939+0000 7fab9f526800 20 remove_watcher() i=3 2024-09-12T00:20:39.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.940+0000 7fab9f526800 20 remove_watcher() i=4 2024-09-12T00:20:39.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.941+0000 7fab9f526800 20 remove_watcher() i=5 2024-09-12T00:20:39.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.942+0000 7fab9f526800 20 remove_watcher() i=6 2024-09-12T00:20:39.968 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:20:39.943+0000 7fab9f526800 20 remove_watcher() i=7 2024-09-12T00:20:39.968 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:20:39.968 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:20:39.968 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-commit-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:20:39.968 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:10.038 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:21:10.073 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:10.074 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:10.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.120+0000 7f12e1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.121+0000 7f12e1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:10.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.121+0000 7f12e1e13800 20 realm 2024-09-12T00:21:10.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.121+0000 7f12e1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.122+0000 7f12e1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:10.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.122+0000 7f12e1e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:10.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.122+0000 7f12e1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.122+0000 7f12e1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:10.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.122+0000 7f12e1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.123+0000 7f12e1e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:10.121 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.123+0000 7f12e1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.124+0000 7f12e1e13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:10.122 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.124+0000 7f12e1e13800 20 searching for the correct realm 2024-09-12T00:21:10.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.126+0000 7f12dd548640 0 -- 172.21.15.67:0/3445148480 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f12c8002340 msgr2=0x7f12d0048a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:10.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.332+0000 7f12dd548640 0 -- 172.21.15.67:0/3445148480 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x55f6b3325330 msgr2=0x7f12d8023460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:10.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.541+0000 7f12e1e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:10.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.541+0000 7f12e1e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:10.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.541+0000 7f12e1e13800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:10.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.541+0000 7f12e1e13800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:10.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.541+0000 7f12e1e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:10.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.541+0000 7f12e1e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:10.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.541+0000 7f12e1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.541+0000 7f12e1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:10.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.541+0000 7f12e1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.541+0000 7f12e1e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:10.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.541+0000 7f12e1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.542+0000 7f12e1e13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:10.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.542+0000 7f12e1e13800 20 zone default found 2024-09-12T00:21:10.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.542+0000 7f12e1e13800 4 Realm: () 2024-09-12T00:21:10.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.542+0000 7f12e1e13800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:10.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.542+0000 7f12e1e13800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:10.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.542+0000 7f12e1e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:10.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.542+0000 7f12e1e13800 20 zonegroup default 2024-09-12T00:21:10.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.542+0000 7f12e1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.542+0000 7f12e1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:10.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.542+0000 7f12e1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.542+0000 7f12e1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:10.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.542+0000 7f12e1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.543+0000 7f12e1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:10.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.543+0000 7f12e1e13800 20 started sync module instance, tier type = 2024-09-12T00:21:10.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.543+0000 7f12e1e13800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:10.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.553+0000 7f12e1e13800 20 add_watcher() i=0 2024-09-12T00:21:10.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.553+0000 7f12e1e13800 20 add_watcher() i=1 2024-09-12T00:21:10.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.553+0000 7f12e1e13800 20 add_watcher() i=2 2024-09-12T00:21:10.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.553+0000 7f12e1e13800 20 add_watcher() i=3 2024-09-12T00:21:10.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.553+0000 7f12e1e13800 20 add_watcher() i=4 2024-09-12T00:21:10.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.553+0000 7f12e1e13800 20 add_watcher() i=5 2024-09-12T00:21:10.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.553+0000 7f12e1e13800 20 add_watcher() i=6 2024-09-12T00:21:10.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.554+0000 7f12e1e13800 20 add_watcher() i=7 2024-09-12T00:21:10.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.554+0000 7f12e1e13800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:10.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.556+0000 7f1193fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:10.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.556+0000 7f12e1e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:10.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.556+0000 7f12e1e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:10.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.556+0000 7f12e1e13800 5 note: GC not initialized 2024-09-12T00:21:10.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.557+0000 7f1192fe5640 20 reqs_thread_entry: start 2024-09-12T00:21:10.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.557+0000 7f12e1e13800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:10.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.557+0000 7f12e1e13800 20 Filter name: none 2024-09-12T00:21:10.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.557+0000 7f1190fe1640 20 reqs_thread_entry: start 2024-09-12T00:21:10.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.557+0000 7f12e1e13800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:21:10.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.557+0000 7f12e1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.557+0000 7f12e1e13800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:21:10.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.557+0000 7f12e1e13800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:21:10.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.557+0000 7f12e1e13800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:21:10.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.557+0000 7f12e1e13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 : miss 2024-09-12T00:21:10.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.557+0000 7f12e1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.558+0000 7f12e1e13800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:21:10.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.558+0000 7f12e1e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:21:10.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.558+0000 7f12e1e13800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:21:10.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.558+0000 7f12e1e13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:21:10.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.558+0000 7f12e1e13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:10.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.558+0000 7f12e1e13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 2024-09-12T00:21:10.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.562+0000 7f12e1e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:21:10.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.562+0000 7f12e1e13800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:21:10.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.562+0000 7f12e1e13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:10.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.562+0000 7f12e1e13800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32, ofs0, ns] 2024-09-12T00:21:10.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.562+0000 7f11c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562439 cookie 94518059167600 notifier 7407 bl.length()=931 2024-09-12T00:21:10.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.562+0000 7f11c0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:21:10.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.562+0000 7f11c0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:21:10.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.562+0000 7f11c0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:10.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.563+0000 7f12e1e13800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_sources= new_sources= 2024-09-12T00:21:10.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.563+0000 7f12e1e13800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential sources added=[] removed=[] 2024-09-12T00:21:10.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.563+0000 7f12e1e13800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_dests= new_dests= 2024-09-12T00:21:10.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.563+0000 7f12e1e13800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential dests added=[] removed=[] 2024-09-12T00:21:10.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.566+0000 7f12e1e13800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.0 2024-09-12T00:21:10.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.566+0000 7f12e1e13800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.0 2024-09-12T00:21:10.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.566+0000 7f12e1e13800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.1 2024-09-12T00:21:10.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.566+0000 7f12e1e13800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.1.1 2024-09-12T00:21:10.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.566+0000 7f12e1e13800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.0 2024-09-12T00:21:10.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.568+0000 7f12e1e13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:21:10.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.568+0000 7f12e1e13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 2024-09-12T00:21:10.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.570+0000 7f12e1e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:21:10.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.570+0000 7f12e1e13800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:21:10.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.570+0000 7f12e1e13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:10.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.570+0000 7f12e1e13800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32, ofs0, ns] 2024-09-12T00:21:10.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.570+0000 7f11c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562440 cookie 94518059167600 notifier 7407 bl.length()=931 2024-09-12T00:21:10.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.570+0000 7f11c0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:21:10.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.570+0000 7f11c0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:21:10.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.570+0000 7f11c0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:10.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.570+0000 7f12e1e13800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_sources= new_sources= 2024-09-12T00:21:10.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.570+0000 7f12e1e13800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential sources added=[] removed=[] 2024-09-12T00:21:10.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.570+0000 7f12e1e13800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_dests= new_dests= 2024-09-12T00:21:10.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.570+0000 7f12e1e13800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential dests added=[] removed=[] 2024-09-12T00:21:10.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.572+0000 7f12e1e13800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32.0 2024-09-12T00:21:10.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.572+0000 7f12e1e13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:21:10.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.572+0000 7f12e1e13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 2024-09-12T00:21:10.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.573+0000 7f12e1e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:21:10.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.573+0000 7f12e1e13800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:21:10.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.573+0000 7f12e1e13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:10.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.573+0000 7f12e1e13800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32, ofs0, ns] 2024-09-12T00:21:10.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.574+0000 7f11affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562441 cookie 94518059167600 notifier 7407 bl.length()=899 2024-09-12T00:21:10.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.574+0000 7f11affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 info.flags=0x17 2024-09-12T00:21:10.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.574+0000 7f11affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 to cache LRU end 2024-09-12T00:21:10.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.574+0000 7f11affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:10.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.574+0000 7f12e1e13800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_sources= new_sources= 2024-09-12T00:21:10.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.574+0000 7f12e1e13800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential sources added=[] removed=[] 2024-09-12T00:21:10.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.574+0000 7f12e1e13800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): orig_dests= new_dests= 2024-09-12T00:21:10.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.574+0000 7f12e1e13800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32]): potential dests added=[] removed=[] 2024-09-12T00:21:10.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.575+0000 7f12e1e13800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:21:10.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.577+0000 7f1193fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:10.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.580+0000 7f12e1e13800 20 remove_watcher() i=0 2024-09-12T00:21:10.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.580+0000 7f12e1e13800 2 removed watcher, disabling cache 2024-09-12T00:21:10.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.581+0000 7f12e1e13800 20 remove_watcher() i=1 2024-09-12T00:21:10.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.582+0000 7f12e1e13800 20 remove_watcher() i=2 2024-09-12T00:21:10.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.583+0000 7f12e1e13800 20 remove_watcher() i=3 2024-09-12T00:21:10.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.585+0000 7f12e1e13800 20 remove_watcher() i=4 2024-09-12T00:21:10.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.586+0000 7f12e1e13800 20 remove_watcher() i=5 2024-09-12T00:21:10.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.587+0000 7f12e1e13800 20 remove_watcher() i=6 2024-09-12T00:21:10.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.588+0000 7f12e1e13800 20 remove_watcher() i=7 2024-09-12T00:21:10.600 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:21:10.630 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:10.630 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:10.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.672+0000 7f8f2612e800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.674+0000 7f8f2612e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:10.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.674+0000 7f8f2612e800 20 realm 2024-09-12T00:21:10.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.674+0000 7f8f2612e800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.674+0000 7f8f2612e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:10.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.674+0000 7f8f2612e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:10.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.674+0000 7f8f2612e800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.674+0000 7f8f2612e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:10.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.674+0000 7f8f2612e800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.675+0000 7f8f2612e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:10.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.675+0000 7f8f2612e800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.676+0000 7f8f2612e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:10.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.676+0000 7f8f2612e800 20 searching for the correct realm 2024-09-12T00:21:10.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.678+0000 7f8f21edd640 0 -- 172.21.15.67:0/3011649527 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f8f1408fcb0 msgr2=0x7f8f1404ca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:10.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.682+0000 7f8f21edd640 0 -- 172.21.15.67:0/3011649527 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x55f59eef2760 msgr2=0x7f8f1c02f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:10.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.889+0000 7f8f2612e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:10.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.889+0000 7f8f2612e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:10.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.889+0000 7f8f2612e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:10.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.889+0000 7f8f2612e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:10.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.889+0000 7f8f2612e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:10.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.889+0000 7f8f2612e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:10.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.889+0000 7f8f2612e800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.889+0000 7f8f2612e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:10.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.889+0000 7f8f2612e800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.890+0000 7f8f2612e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:10.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.890+0000 7f8f2612e800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.890+0000 7f8f2612e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:10.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.890+0000 7f8f2612e800 20 zone default found 2024-09-12T00:21:10.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.890+0000 7f8f2612e800 4 Realm: () 2024-09-12T00:21:10.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.890+0000 7f8f2612e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:10.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.890+0000 7f8f2612e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:10.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.890+0000 7f8f2612e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:10.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.890+0000 7f8f2612e800 20 zonegroup default 2024-09-12T00:21:10.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.890+0000 7f8f2612e800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.890+0000 7f8f2612e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:10.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.891+0000 7f8f2612e800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.891+0000 7f8f2612e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:10.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.891+0000 7f8f2612e800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.891+0000 7f8f2612e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:10.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.891+0000 7f8f2612e800 20 started sync module instance, tier type = 2024-09-12T00:21:10.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.891+0000 7f8f2612e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:10.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.901+0000 7f8f2612e800 20 add_watcher() i=0 2024-09-12T00:21:10.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.901+0000 7f8f2612e800 20 add_watcher() i=1 2024-09-12T00:21:10.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.901+0000 7f8f2612e800 20 add_watcher() i=2 2024-09-12T00:21:10.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.901+0000 7f8f2612e800 20 add_watcher() i=3 2024-09-12T00:21:10.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.901+0000 7f8f2612e800 20 add_watcher() i=4 2024-09-12T00:21:10.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.901+0000 7f8f2612e800 20 add_watcher() i=5 2024-09-12T00:21:10.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.901+0000 7f8f2612e800 20 add_watcher() i=6 2024-09-12T00:21:10.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.902+0000 7f8f2612e800 20 add_watcher() i=7 2024-09-12T00:21:10.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.902+0000 7f8f2612e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:10.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.904+0000 7f8dd7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:10.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.905+0000 7f8f2612e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:10.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.905+0000 7f8f2612e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:10.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.905+0000 7f8f2612e800 5 note: GC not initialized 2024-09-12T00:21:10.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.905+0000 7f8dd6fe5640 20 reqs_thread_entry: start 2024-09-12T00:21:10.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.905+0000 7f8f2612e800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:10.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.905+0000 7f8f2612e800 20 Filter name: none 2024-09-12T00:21:10.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.905+0000 7f8dd4fe1640 20 reqs_thread_entry: start 2024-09-12T00:21:10.904 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.905+0000 7f8f2612e800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.906+0000 7f8f2612e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:21:10.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.906+0000 7f8f2612e800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.906+0000 7f8f2612e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:21:10.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.906+0000 7f8f2612e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:10.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.906+0000 7f8f2612e800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.905 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.907+0000 7f8f2612e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:21:10.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.907+0000 7f8f2612e800 20 rados->read ofs=0 len=0 2024-09-12T00:21:10.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.907+0000 7f8f2612e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:21:10.906 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.907+0000 7f8f2612e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:10.907 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.909+0000 7f8dd7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:10.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.911+0000 7f8f2612e800 20 remove_watcher() i=0 2024-09-12T00:21:10.909 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.911+0000 7f8f2612e800 2 removed watcher, disabling cache 2024-09-12T00:21:10.910 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.912+0000 7f8f2612e800 20 remove_watcher() i=1 2024-09-12T00:21:10.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.913+0000 7f8f2612e800 20 remove_watcher() i=2 2024-09-12T00:21:10.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.914+0000 7f8f2612e800 20 remove_watcher() i=3 2024-09-12T00:21:10.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.915+0000 7f8f2612e800 20 remove_watcher() i=4 2024-09-12T00:21:10.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.917+0000 7f8f2612e800 20 remove_watcher() i=5 2024-09-12T00:21:10.916 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.918+0000 7f8f2612e800 20 remove_watcher() i=6 2024-09-12T00:21:10.917 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:10.919+0000 7f8f2612e800 20 remove_watcher() i=7 2024-09-12T00:21:10.928 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:10.928 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:21:10.928 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-commit-target-layout id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:21:10.928 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:10.992 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T00:21:10.992 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:11.213 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:21:11.243 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:11.243 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:11.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.285+0000 7fa93160f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.288+0000 7fa93160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.288+0000 7fa93160f800 20 realm 2024-09-12T00:21:11.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.288+0000 7fa93160f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.288+0000 7fa93160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.288+0000 7fa93160f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:11.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.288+0000 7fa93160f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.288+0000 7fa93160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.288+0000 7fa93160f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.289+0000 7fa93160f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:11.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.289+0000 7fa93160f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.290+0000 7fa93160f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:11.288 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.290+0000 7fa93160f800 20 searching for the correct realm 2024-09-12T00:21:11.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.293+0000 7fa92cd22640 0 -- 172.21.15.67:0/748483950 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7fa91c049430 msgr2=0x7fa91c049890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:21:11.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.297+0000 7fa92cd22640 0 -- 172.21.15.67:0/748483950 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fa92407a070 msgr2=0x7fa924087ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:11.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.300+0000 7fa93160f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:11.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.300+0000 7fa93160f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:11.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.300+0000 7fa93160f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:11.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.300+0000 7fa93160f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:11.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.300+0000 7fa93160f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:11.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.300+0000 7fa93160f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:11.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.300+0000 7fa93160f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.299 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.301+0000 7fa93160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.301+0000 7fa93160f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.301+0000 7fa93160f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:11.300 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.301+0000 7fa93160f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.301+0000 7fa93160f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:11.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.301+0000 7fa93160f800 20 zone default found 2024-09-12T00:21:11.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.301+0000 7fa93160f800 4 Realm: () 2024-09-12T00:21:11.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.301+0000 7fa93160f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:11.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.301+0000 7fa93160f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:11.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.301+0000 7fa93160f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:11.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.301+0000 7fa93160f800 20 zonegroup default 2024-09-12T00:21:11.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.301+0000 7fa93160f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.302+0000 7fa93160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.302+0000 7fa93160f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.302+0000 7fa93160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.302+0000 7fa93160f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.302+0000 7fa93160f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.302+0000 7fa93160f800 20 started sync module instance, tier type = 2024-09-12T00:21:11.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.302+0000 7fa93160f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:11.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.310+0000 7fa93160f800 20 add_watcher() i=0 2024-09-12T00:21:11.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.310+0000 7fa93160f800 20 add_watcher() i=1 2024-09-12T00:21:11.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.310+0000 7fa93160f800 20 add_watcher() i=2 2024-09-12T00:21:11.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.310+0000 7fa93160f800 20 add_watcher() i=3 2024-09-12T00:21:11.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.310+0000 7fa93160f800 20 add_watcher() i=4 2024-09-12T00:21:11.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.310+0000 7fa93160f800 20 add_watcher() i=5 2024-09-12T00:21:11.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.311+0000 7fa93160f800 20 add_watcher() i=6 2024-09-12T00:21:11.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.311+0000 7fa93160f800 20 add_watcher() i=7 2024-09-12T00:21:11.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.311+0000 7fa93160f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:11.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.313+0000 7fa7e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:11.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.313+0000 7fa93160f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:11.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.313+0000 7fa93160f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:11.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.313+0000 7fa93160f800 5 note: GC not initialized 2024-09-12T00:21:11.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.314+0000 7fa7e1fe3640 20 reqs_thread_entry: start 2024-09-12T00:21:11.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.314+0000 7fa93160f800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:11.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.314+0000 7fa93160f800 20 Filter name: none 2024-09-12T00:21:11.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.314+0000 7fa7537fe640 20 reqs_thread_entry: start 2024-09-12T00:21:11.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.314+0000 7fa93160f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.314+0000 7fa93160f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:11.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.314+0000 7fa93160f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.315+0000 7fa93160f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:21:11.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.315+0000 7fa93160f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:11.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.315+0000 7fa93160f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.315+0000 7fa93160f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:11.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.315+0000 7fa93160f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.316+0000 7fa93160f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:21:11.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.316+0000 7fa93160f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:11.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.317+0000 7fa7e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:11.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.319+0000 7fa93160f800 20 remove_watcher() i=0 2024-09-12T00:21:11.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.319+0000 7fa93160f800 2 removed watcher, disabling cache 2024-09-12T00:21:11.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.320+0000 7fa93160f800 20 remove_watcher() i=1 2024-09-12T00:21:11.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.321+0000 7fa93160f800 20 remove_watcher() i=2 2024-09-12T00:21:11.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.322+0000 7fa93160f800 20 remove_watcher() i=3 2024-09-12T00:21:11.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.323+0000 7fa93160f800 20 remove_watcher() i=4 2024-09-12T00:21:11.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.324+0000 7fa93160f800 20 remove_watcher() i=5 2024-09-12T00:21:11.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.325+0000 7fa93160f800 20 remove_watcher() i=6 2024-09-12T00:21:11.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.326+0000 7fa93160f800 20 remove_watcher() i=7 2024-09-12T00:21:11.335 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:11.335 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:21:11.335 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-do-reshard id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:21:11.335 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:11.337 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T00:21:11.371 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:11.371 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:11.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.412+0000 7f36c893a800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.414+0000 7f36c893a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.414+0000 7f36c893a800 20 realm 2024-09-12T00:21:11.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.414+0000 7f36c893a800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.414+0000 7f36c893a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.414+0000 7f36c893a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:11.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.414+0000 7f36c893a800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.415+0000 7f36c893a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.415+0000 7f36c893a800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.415+0000 7f36c893a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:11.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.415+0000 7f36c893a800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.416+0000 7f36c893a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:11.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.416+0000 7f36c893a800 20 searching for the correct realm 2024-09-12T00:21:11.417 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.419+0000 7f36c3e80640 0 -- 172.21.15.67:0/1883851089 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f36b8037940 msgr2=0x7f36b8027400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:11.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.624+0000 7f36c3e80640 0 -- 172.21.15.67:0/1883851089 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x56001e476c40 msgr2=0x56001e4790a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:11.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.628+0000 7f36c893a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:11.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.628+0000 7f36c893a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:11.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.628+0000 7f36c893a800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:11.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.628+0000 7f36c893a800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:11.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.628+0000 7f36c893a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:11.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.628+0000 7f36c893a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:11.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.628+0000 7f36c893a800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.628+0000 7f36c893a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.628+0000 7f36c893a800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.628+0000 7f36c893a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:11.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.628+0000 7f36c893a800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.629+0000 7f36c893a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:11.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.629+0000 7f36c893a800 20 zone default found 2024-09-12T00:21:11.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.629+0000 7f36c893a800 4 Realm: () 2024-09-12T00:21:11.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.629+0000 7f36c893a800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:11.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.629+0000 7f36c893a800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:11.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.629+0000 7f36c893a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:11.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.629+0000 7f36c893a800 20 zonegroup default 2024-09-12T00:21:11.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.629+0000 7f36c893a800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.629+0000 7f36c893a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.629+0000 7f36c893a800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.629+0000 7f36c893a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.629+0000 7f36c893a800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.630+0000 7f36c893a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.630+0000 7f36c893a800 20 started sync module instance, tier type = 2024-09-12T00:21:11.630 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.630+0000 7f36c893a800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:11.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.638+0000 7f36c893a800 20 add_watcher() i=0 2024-09-12T00:21:11.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.638+0000 7f36c893a800 20 add_watcher() i=1 2024-09-12T00:21:11.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.638+0000 7f36c893a800 20 add_watcher() i=2 2024-09-12T00:21:11.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.638+0000 7f36c893a800 20 add_watcher() i=3 2024-09-12T00:21:11.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.638+0000 7f36c893a800 20 add_watcher() i=4 2024-09-12T00:21:11.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.638+0000 7f36c893a800 20 add_watcher() i=5 2024-09-12T00:21:11.637 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.638+0000 7f36c893a800 20 add_watcher() i=6 2024-09-12T00:21:11.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.639+0000 7f36c893a800 20 add_watcher() i=7 2024-09-12T00:21:11.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.639+0000 7f36c893a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:11.639 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.641+0000 7f357afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.642+0000 7f36c893a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.642+0000 7f36c893a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.642+0000 7f36c893a800 5 note: GC not initialized 2024-09-12T00:21:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.642+0000 7f3579fdb640 20 reqs_thread_entry: start 2024-09-12T00:21:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.642+0000 7f36c893a800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.642+0000 7f36c893a800 20 Filter name: none 2024-09-12T00:21:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.642+0000 7f34eb7fe640 20 reqs_thread_entry: start 2024-09-12T00:21:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.642+0000 7f36c893a800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:21:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.642+0000 7f36c893a800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.643+0000 7f36c893a800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:11.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.643+0000 7f36c893a800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:21:11.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.643+0000 7f36c893a800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:21:11.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.643+0000 7f36c893a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 : miss 2024-09-12T00:21:11.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.643+0000 7f36c893a800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.643+0000 7f36c893a800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:21:11.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.643+0000 7f36c893a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 info.flags=0x17 2024-09-12T00:21:11.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.643+0000 7f36c893a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 to cache LRU end 2024-09-12T00:21:11.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.643+0000 7f36c893a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:21:11.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.643+0000 7f36c893a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:11.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.643+0000 7f36c893a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 2024-09-12T00:21:11.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.647+0000 7f36c893a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 info.flags=0x17 2024-09-12T00:21:11.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.647+0000 7f36c893a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 to cache LRU end 2024-09-12T00:21:11.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.647+0000 7f36c893a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:11.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.647+0000 7f36c893a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33, ofs0, ns] 2024-09-12T00:21:11.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.647+0000 7f359b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562499 cookie 94558508044688 notifier 6989 bl.length()=911 2024-09-12T00:21:11.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.647+0000 7f359b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 info.flags=0x17 2024-09-12T00:21:11.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.647+0000 7f359b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 to cache LRU end 2024-09-12T00:21:11.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.647+0000 7f359b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:11.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.648+0000 7f36c893a800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): orig_sources= new_sources= 2024-09-12T00:21:11.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.648+0000 7f36c893a800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): potential sources added=[] removed=[] 2024-09-12T00:21:11.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.648+0000 7f36c893a800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): orig_dests= new_dests= 2024-09-12T00:21:11.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.648+0000 7f36c893a800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): potential dests added=[] removed=[] 2024-09-12T00:21:11.648 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.650+0000 7f36c893a800 -1 Injecting error=-5 at location=do_reshard 2024-09-12T00:21:11.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.653+0000 7f36c893a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:21:11.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.653+0000 7f36c893a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 2024-09-12T00:21:11.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.654+0000 7f36c893a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 info.flags=0x17 2024-09-12T00:21:11.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.654+0000 7f36c893a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 to cache LRU end 2024-09-12T00:21:11.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.654+0000 7f36c893a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:11.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.654+0000 7f36c893a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33, ofs0, ns] 2024-09-12T00:21:11.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.654+0000 7f359b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562500 cookie 94558508044688 notifier 6989 bl.length()=879 2024-09-12T00:21:11.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.654+0000 7f359b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 info.flags=0x17 2024-09-12T00:21:11.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.654+0000 7f359b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 to cache LRU end 2024-09-12T00:21:11.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.654+0000 7f359b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:11.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.655+0000 7f36c893a800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): orig_sources= new_sources= 2024-09-12T00:21:11.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.655+0000 7f36c893a800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): potential sources added=[] removed=[] 2024-09-12T00:21:11.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.655+0000 7f36c893a800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): orig_dests= new_dests= 2024-09-12T00:21:11.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.655+0000 7f36c893a800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): potential dests added=[] removed=[] 2024-09-12T00:21:11.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.655+0000 7f36c893a800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T00:21:11.655 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.656+0000 7f357afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:11.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.658+0000 7f36c893a800 20 remove_watcher() i=0 2024-09-12T00:21:11.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.658+0000 7f36c893a800 2 removed watcher, disabling cache 2024-09-12T00:21:11.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.660+0000 7f36c893a800 20 remove_watcher() i=1 2024-09-12T00:21:11.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.661+0000 7f36c893a800 20 remove_watcher() i=2 2024-09-12T00:21:11.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.662+0000 7f36c893a800 20 remove_watcher() i=3 2024-09-12T00:21:11.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.662+0000 7f36c893a800 20 remove_watcher() i=4 2024-09-12T00:21:11.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.663+0000 7f36c893a800 20 remove_watcher() i=5 2024-09-12T00:21:11.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.664+0000 7f36c893a800 20 remove_watcher() i=6 2024-09-12T00:21:11.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.665+0000 7f36c893a800 20 remove_watcher() i=7 2024-09-12T00:21:11.676 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:21:11.705 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:11.705 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:11.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.747+0000 7f0c8c7a9800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.749+0000 7f0c8c7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.749+0000 7f0c8c7a9800 20 realm 2024-09-12T00:21:11.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.749+0000 7f0c8c7a9800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.749+0000 7f0c8c7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.749+0000 7f0c8c7a9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:11.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.749+0000 7f0c8c7a9800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.750+0000 7f0c8c7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.750+0000 7f0c8c7a9800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.750+0000 7f0c8c7a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:11.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.750+0000 7f0c8c7a9800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.751+0000 7f0c8c7a9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:11.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.751+0000 7f0c8c7a9800 20 searching for the correct realm 2024-09-12T00:21:11.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.754+0000 7f0c8aa94640 0 -- 172.21.15.67:0/2157268506 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7f0c80032060 msgr2=0x7f0c80089a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:11.756 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.758+0000 7f0c8a293640 0 -- 172.21.15.67:0/2157268506 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f0c8406a040 msgr2=0x7f0c84003410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:11.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.761+0000 7f0c8c7a9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:11.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.761+0000 7f0c8c7a9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:11.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.761+0000 7f0c8c7a9800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:11.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.761+0000 7f0c8c7a9800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:11.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.761+0000 7f0c8c7a9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:11.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.761+0000 7f0c8c7a9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:11.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.761+0000 7f0c8c7a9800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.761+0000 7f0c8c7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.761+0000 7f0c8c7a9800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.761+0000 7f0c8c7a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:11.760 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.761+0000 7f0c8c7a9800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.762+0000 7f0c8c7a9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:11.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.762+0000 7f0c8c7a9800 20 zone default found 2024-09-12T00:21:11.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.762+0000 7f0c8c7a9800 4 Realm: () 2024-09-12T00:21:11.761 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.762+0000 7f0c8c7a9800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:11.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.762+0000 7f0c8c7a9800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:11.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.762+0000 7f0c8c7a9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:11.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.762+0000 7f0c8c7a9800 20 zonegroup default 2024-09-12T00:21:11.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.762+0000 7f0c8c7a9800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.762+0000 7f0c8c7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.762+0000 7f0c8c7a9800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.762+0000 7f0c8c7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.762+0000 7f0c8c7a9800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.763+0000 7f0c8c7a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.763+0000 7f0c8c7a9800 20 started sync module instance, tier type = 2024-09-12T00:21:11.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.763+0000 7f0c8c7a9800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:11.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.771+0000 7f0c8c7a9800 20 add_watcher() i=0 2024-09-12T00:21:11.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.771+0000 7f0c8c7a9800 20 add_watcher() i=1 2024-09-12T00:21:11.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.771+0000 7f0c8c7a9800 20 add_watcher() i=2 2024-09-12T00:21:11.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.771+0000 7f0c8c7a9800 20 add_watcher() i=3 2024-09-12T00:21:11.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.771+0000 7f0c8c7a9800 20 add_watcher() i=4 2024-09-12T00:21:11.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.771+0000 7f0c8c7a9800 20 add_watcher() i=5 2024-09-12T00:21:11.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.771+0000 7f0c8c7a9800 20 add_watcher() i=6 2024-09-12T00:21:11.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.772+0000 7f0c8c7a9800 20 add_watcher() i=7 2024-09-12T00:21:11.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.772+0000 7f0c8c7a9800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:11.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.774+0000 7f0b40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:11.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.774+0000 7f0c8c7a9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:11.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.774+0000 7f0c8c7a9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:11.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.774+0000 7f0c8c7a9800 5 note: GC not initialized 2024-09-12T00:21:11.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.775+0000 7f0abb7fe640 20 reqs_thread_entry: start 2024-09-12T00:21:11.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.775+0000 7f0c8c7a9800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:11.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.775+0000 7f0c8c7a9800 20 Filter name: none 2024-09-12T00:21:11.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.775+0000 7f0ab97fa640 20 reqs_thread_entry: start 2024-09-12T00:21:11.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.775+0000 7f0c8c7a9800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.775+0000 7f0c8c7a9800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:11.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.775+0000 7f0c8c7a9800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.776+0000 7f0c8c7a9800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:21:11.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.776+0000 7f0c8c7a9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:11.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.776+0000 7f0c8c7a9800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.776+0000 7f0c8c7a9800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:11.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.776+0000 7f0c8c7a9800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.777+0000 7f0c8c7a9800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:21:11.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.777+0000 7f0c8c7a9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:11.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.778+0000 7f0b40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:11.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.780+0000 7f0c8c7a9800 20 remove_watcher() i=0 2024-09-12T00:21:11.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.780+0000 7f0c8c7a9800 2 removed watcher, disabling cache 2024-09-12T00:21:11.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.781+0000 7f0c8c7a9800 20 remove_watcher() i=1 2024-09-12T00:21:11.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.782+0000 7f0c8c7a9800 20 remove_watcher() i=2 2024-09-12T00:21:11.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.783+0000 7f0c8c7a9800 20 remove_watcher() i=3 2024-09-12T00:21:11.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.784+0000 7f0c8c7a9800 20 remove_watcher() i=4 2024-09-12T00:21:11.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.785+0000 7f0c8c7a9800 20 remove_watcher() i=5 2024-09-12T00:21:11.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.786+0000 7f0c8c7a9800 20 remove_watcher() i=6 2024-09-12T00:21:11.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.787+0000 7f0c8c7a9800 20 remove_watcher() i=7 2024-09-12T00:21:11.796 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:11.796 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:21:11.796 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-do-reshard id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:21:11.796 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:11.849 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:21:11.881 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:11.882 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:11.920 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.922+0000 7f6663098800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.924+0000 7f6663098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.922 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.924+0000 7f6663098800 20 realm 2024-09-12T00:21:11.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.924+0000 7f6663098800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.924+0000 7f6663098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.924+0000 7f6663098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:11.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.924+0000 7f6663098800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.924+0000 7f6663098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:11.923 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.924+0000 7f6663098800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.925+0000 7f6663098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:11.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.925+0000 7f6663098800 20 rados->read ofs=0 len=0 2024-09-12T00:21:11.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.926+0000 7f6663098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:11.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.926+0000 7f6663098800 20 searching for the correct realm 2024-09-12T00:21:11.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:11.929+0000 7f6660381640 0 -- 172.21.15.67:0/3149204254 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f66540480b0 msgr2=0x7f6654061030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:12.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.134+0000 7f6661383640 0 -- 172.21.15.67:0/3149204254 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55c345eaef20 msgr2=0x55c345eb1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.139+0000 7f6663098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.139+0000 7f6663098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.139+0000 7f6663098800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.139+0000 7f6663098800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.139+0000 7f6663098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.139+0000 7f6663098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:12.137 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.139+0000 7f6663098800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.139+0000 7f6663098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.139+0000 7f6663098800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.139+0000 7f6663098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:12.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.139+0000 7f6663098800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.140+0000 7f6663098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:12.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.140+0000 7f6663098800 20 zone default found 2024-09-12T00:21:12.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.140+0000 7f6663098800 4 Realm: () 2024-09-12T00:21:12.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.140+0000 7f6663098800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:12.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.140+0000 7f6663098800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:12.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.140+0000 7f6663098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:12.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.140+0000 7f6663098800 20 zonegroup default 2024-09-12T00:21:12.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.140+0000 7f6663098800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.140+0000 7f6663098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.140+0000 7f6663098800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.140+0000 7f6663098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.140+0000 7f6663098800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.141+0000 7f6663098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.141+0000 7f6663098800 20 started sync module instance, tier type = 2024-09-12T00:21:12.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.141+0000 7f6663098800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:12.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.151+0000 7f6663098800 20 add_watcher() i=0 2024-09-12T00:21:12.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.151+0000 7f6663098800 20 add_watcher() i=1 2024-09-12T00:21:12.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.151+0000 7f6663098800 20 add_watcher() i=2 2024-09-12T00:21:12.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.151+0000 7f6663098800 20 add_watcher() i=3 2024-09-12T00:21:12.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.151+0000 7f6663098800 20 add_watcher() i=4 2024-09-12T00:21:12.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.151+0000 7f6663098800 20 add_watcher() i=5 2024-09-12T00:21:12.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.151+0000 7f6663098800 20 add_watcher() i=6 2024-09-12T00:21:12.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.153+0000 7f6663098800 20 add_watcher() i=7 2024-09-12T00:21:12.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.153+0000 7f6663098800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:12.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.155+0000 7f65177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:12.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.155+0000 7f6663098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:12.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.155+0000 7f6663098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:12.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.155+0000 7f6663098800 5 note: GC not initialized 2024-09-12T00:21:12.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.156+0000 7f65167e4640 20 reqs_thread_entry: start 2024-09-12T00:21:12.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.156+0000 7f6663098800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:12.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.156+0000 7f6663098800 20 Filter name: none 2024-09-12T00:21:12.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.156+0000 7f650ffff640 20 reqs_thread_entry: start 2024-09-12T00:21:12.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.156+0000 7f6663098800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:21:12.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.156+0000 7f6663098800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.156+0000 7f6663098800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:12.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.156+0000 7f6663098800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:21:12.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.156+0000 7f6663098800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:21:12.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.156+0000 7f6663098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 : miss 2024-09-12T00:21:12.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.156+0000 7f6663098800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.157+0000 7f6663098800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:21:12.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.157+0000 7f6663098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 info.flags=0x17 2024-09-12T00:21:12.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.157+0000 7f6663098800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 to cache LRU end 2024-09-12T00:21:12.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.157+0000 7f6663098800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:21:12.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.157+0000 7f6663098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:12.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.157+0000 7f6663098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 2024-09-12T00:21:12.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.161+0000 7f6663098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 info.flags=0x17 2024-09-12T00:21:12.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.161+0000 7f6663098800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 to cache LRU end 2024-09-12T00:21:12.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.161+0000 7f6663098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:12.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.161+0000 7f6663098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33, ofs0, ns] 2024-09-12T00:21:12.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.161+0000 7f65377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562501 cookie 94297180068480 notifier 7500 bl.length()=911 2024-09-12T00:21:12.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.161+0000 7f65377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 info.flags=0x17 2024-09-12T00:21:12.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.161+0000 7f65377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 to cache LRU end 2024-09-12T00:21:12.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.161+0000 7f65377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:12.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.161+0000 7f6663098800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): orig_sources= new_sources= 2024-09-12T00:21:12.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.161+0000 7f6663098800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): potential sources added=[] removed=[] 2024-09-12T00:21:12.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.161+0000 7f6663098800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): orig_dests= new_dests= 2024-09-12T00:21:12.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.161+0000 7f6663098800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): potential dests added=[] removed=[] 2024-09-12T00:21:12.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.163+0000 7f6663098800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33.1.0 2024-09-12T00:21:12.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.163+0000 7f6663098800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33.1.0 2024-09-12T00:21:12.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.163+0000 7f6663098800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33.1.1 2024-09-12T00:21:12.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.163+0000 7f6663098800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33.1.1 2024-09-12T00:21:12.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.163+0000 7f6663098800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33.0 2024-09-12T00:21:12.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.166+0000 7f6663098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:21:12.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.166+0000 7f6663098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 2024-09-12T00:21:12.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.167+0000 7f6663098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 info.flags=0x17 2024-09-12T00:21:12.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.167+0000 7f6663098800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 to cache LRU end 2024-09-12T00:21:12.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.167+0000 7f6663098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:12.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.167+0000 7f6663098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33, ofs0, ns] 2024-09-12T00:21:12.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.167+0000 7f65377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562502 cookie 94297180068480 notifier 7500 bl.length()=911 2024-09-12T00:21:12.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.167+0000 7f65377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 info.flags=0x17 2024-09-12T00:21:12.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.167+0000 7f65377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 to cache LRU end 2024-09-12T00:21:12.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.167+0000 7f65377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:12.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.168+0000 7f6663098800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): orig_sources= new_sources= 2024-09-12T00:21:12.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.168+0000 7f6663098800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): potential sources added=[] removed=[] 2024-09-12T00:21:12.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.168+0000 7f6663098800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): orig_dests= new_dests= 2024-09-12T00:21:12.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.168+0000 7f6663098800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): potential dests added=[] removed=[] 2024-09-12T00:21:12.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.169+0000 7f6663098800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33.0 2024-09-12T00:21:12.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.169+0000 7f6663098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:21:12.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.169+0000 7f6663098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 2024-09-12T00:21:12.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.170+0000 7f6663098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 info.flags=0x17 2024-09-12T00:21:12.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.170+0000 7f6663098800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 to cache LRU end 2024-09-12T00:21:12.168 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.170+0000 7f6663098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:12.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.170+0000 7f6663098800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33, ofs0, ns] 2024-09-12T00:21:12.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.170+0000 7f6537fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562503 cookie 94297180068480 notifier 7500 bl.length()=879 2024-09-12T00:21:12.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.170+0000 7f6537fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 info.flags=0x17 2024-09-12T00:21:12.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.170+0000 7f6537fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 to cache LRU end 2024-09-12T00:21:12.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.170+0000 7f6537fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:12.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.171+0000 7f6663098800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): orig_sources= new_sources= 2024-09-12T00:21:12.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.171+0000 7f6663098800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): potential sources added=[] removed=[] 2024-09-12T00:21:12.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.171+0000 7f6663098800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): orig_dests= new_dests= 2024-09-12T00:21:12.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.171+0000 7f6663098800 20 handle_bi_update(): bucket=:error-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33]): potential dests added=[] removed=[] 2024-09-12T00:21:12.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.172+0000 7f6663098800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T00:21:12.171 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.173+0000 7f65177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:12.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.176+0000 7f6663098800 20 remove_watcher() i=0 2024-09-12T00:21:12.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.176+0000 7f6663098800 2 removed watcher, disabling cache 2024-09-12T00:21:12.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.177+0000 7f6663098800 20 remove_watcher() i=1 2024-09-12T00:21:12.176 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.178+0000 7f6663098800 20 remove_watcher() i=2 2024-09-12T00:21:12.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.179+0000 7f6663098800 20 remove_watcher() i=3 2024-09-12T00:21:12.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.180+0000 7f6663098800 20 remove_watcher() i=4 2024-09-12T00:21:12.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.182+0000 7f6663098800 20 remove_watcher() i=5 2024-09-12T00:21:12.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.183+0000 7f6663098800 20 remove_watcher() i=6 2024-09-12T00:21:12.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.183+0000 7f6663098800 20 remove_watcher() i=7 2024-09-12T00:21:12.195 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:21:12.223 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:12.224 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:12.264 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.266+0000 7fba6d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.268+0000 7fba6d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.268+0000 7fba6d62f800 20 realm 2024-09-12T00:21:12.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.268+0000 7fba6d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.268+0000 7fba6d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.268+0000 7fba6d62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:12.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.268+0000 7fba6d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.268+0000 7fba6d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.267 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.268+0000 7fba6d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.269+0000 7fba6d62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:12.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.269+0000 7fba6d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.270+0000 7fba6d62f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:12.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.270+0000 7fba6d62f800 20 searching for the correct realm 2024-09-12T00:21:12.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.272+0000 7fba6a918640 0 -- 172.21.15.67:0/3685096370 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fba54058020 msgr2=0x7fba5409e9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:21:12.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.477+0000 7fba6b91a640 0 -- 172.21.15.67:0/3685096370 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55e2e1ac0030 msgr2=0x55e2e1ac2420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:12.479 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.481+0000 7fba6d62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:12.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.481+0000 7fba6d62f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:12.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.481+0000 7fba6d62f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:12.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.481+0000 7fba6d62f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:12.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.481+0000 7fba6d62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:12.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.481+0000 7fba6d62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:12.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.481+0000 7fba6d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.481+0000 7fba6d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.481+0000 7fba6d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.481+0000 7fba6d62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:12.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.481+0000 7fba6d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.482+0000 7fba6d62f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:12.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.482+0000 7fba6d62f800 20 zone default found 2024-09-12T00:21:12.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.482+0000 7fba6d62f800 4 Realm: () 2024-09-12T00:21:12.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.482+0000 7fba6d62f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:12.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.482+0000 7fba6d62f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:12.481 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.482+0000 7fba6d62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:12.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.482+0000 7fba6d62f800 20 zonegroup default 2024-09-12T00:21:12.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.482+0000 7fba6d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.482+0000 7fba6d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.482+0000 7fba6d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.482+0000 7fba6d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.482+0000 7fba6d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.483+0000 7fba6d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.483+0000 7fba6d62f800 20 started sync module instance, tier type = 2024-09-12T00:21:12.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.483+0000 7fba6d62f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:12.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.492+0000 7fba6d62f800 20 add_watcher() i=0 2024-09-12T00:21:12.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.492+0000 7fba6d62f800 20 add_watcher() i=1 2024-09-12T00:21:12.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.492+0000 7fba6d62f800 20 add_watcher() i=2 2024-09-12T00:21:12.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.492+0000 7fba6d62f800 20 add_watcher() i=3 2024-09-12T00:21:12.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.492+0000 7fba6d62f800 20 add_watcher() i=4 2024-09-12T00:21:12.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.492+0000 7fba6d62f800 20 add_watcher() i=5 2024-09-12T00:21:12.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.492+0000 7fba6d62f800 20 add_watcher() i=6 2024-09-12T00:21:12.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.493+0000 7fba6d62f800 20 add_watcher() i=7 2024-09-12T00:21:12.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.493+0000 7fba6d62f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:12.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.496+0000 7fb921fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:12.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.496+0000 7fba6d62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:12.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.496+0000 7fba6d62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:12.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.496+0000 7fba6d62f800 5 note: GC not initialized 2024-09-12T00:21:12.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.497+0000 7fb920fe1640 20 reqs_thread_entry: start 2024-09-12T00:21:12.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.497+0000 7fba6d62f800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:12.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.497+0000 7fba6d62f800 20 Filter name: none 2024-09-12T00:21:12.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.497+0000 7fb89a7fc640 20 reqs_thread_entry: start 2024-09-12T00:21:12.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.497+0000 7fba6d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.497+0000 7fba6d62f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:12.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.497+0000 7fba6d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.498+0000 7fba6d62f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:21:12.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.498+0000 7fba6d62f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:12.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.498+0000 7fba6d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.498+0000 7fba6d62f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:12.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.498+0000 7fba6d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.499+0000 7fba6d62f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:21:12.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.499+0000 7fba6d62f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:12.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.500+0000 7fb921fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:12.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.502+0000 7fba6d62f800 20 remove_watcher() i=0 2024-09-12T00:21:12.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.502+0000 7fba6d62f800 2 removed watcher, disabling cache 2024-09-12T00:21:12.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.503+0000 7fba6d62f800 20 remove_watcher() i=1 2024-09-12T00:21:12.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.504+0000 7fba6d62f800 20 remove_watcher() i=2 2024-09-12T00:21:12.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.505+0000 7fba6d62f800 20 remove_watcher() i=3 2024-09-12T00:21:12.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.506+0000 7fba6d62f800 20 remove_watcher() i=4 2024-09-12T00:21:12.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.507+0000 7fba6d62f800 20 remove_watcher() i=5 2024-09-12T00:21:12.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.508+0000 7fba6d62f800 20 remove_watcher() i=6 2024-09-12T00:21:12.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.509+0000 7fba6d62f800 20 remove_watcher() i=7 2024-09-12T00:21:12.518 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:12.518 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:21:12.518 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-do-reshard id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:21:12.518 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:12.580 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T00:21:12.580 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:12.829 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:21:12.858 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:12.858 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:12.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.899+0000 7fd021123800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.901+0000 7fd021123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.901+0000 7fd021123800 20 realm 2024-09-12T00:21:12.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.901+0000 7fd021123800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.901+0000 7fd021123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.901+0000 7fd021123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:12.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.901+0000 7fd021123800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.901+0000 7fd021123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:12.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.901+0000 7fd021123800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.902+0000 7fd021123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:12.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.902+0000 7fd021123800 20 rados->read ofs=0 len=0 2024-09-12T00:21:12.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.903+0000 7fd021123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:12.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.903+0000 7fd021123800 20 searching for the correct realm 2024-09-12T00:21:12.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:12.905+0000 7fd017fff640 0 -- 172.21.15.67:0/2109087358 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fd008079440 msgr2=0x7fd0080798c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:21:13.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.110+0000 7fd017fff640 0 -- 172.21.15.67:0/2109087358 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55e98620f210 msgr2=0x55e986211680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.114+0000 7fd021123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.114+0000 7fd021123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.114+0000 7fd021123800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.114+0000 7fd021123800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.114+0000 7fd021123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:13.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.114+0000 7fd021123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.114+0000 7fd021123800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.115+0000 7fd021123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.115+0000 7fd021123800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.115+0000 7fd021123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:13.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.115+0000 7fd021123800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.115+0000 7fd021123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:13.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.115+0000 7fd021123800 20 zone default found 2024-09-12T00:21:13.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.115+0000 7fd021123800 4 Realm: () 2024-09-12T00:21:13.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.115+0000 7fd021123800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.115+0000 7fd021123800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.115+0000 7fd021123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.115+0000 7fd021123800 20 zonegroup default 2024-09-12T00:21:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.115+0000 7fd021123800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.116+0000 7fd021123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.116+0000 7fd021123800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.116+0000 7fd021123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.116+0000 7fd021123800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.116+0000 7fd021123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.116+0000 7fd021123800 20 started sync module instance, tier type = 2024-09-12T00:21:13.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.116+0000 7fd021123800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:13.123 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.125+0000 7fd021123800 20 add_watcher() i=0 2024-09-12T00:21:13.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.125+0000 7fd021123800 20 add_watcher() i=1 2024-09-12T00:21:13.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.125+0000 7fd021123800 20 add_watcher() i=2 2024-09-12T00:21:13.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.125+0000 7fd021123800 20 add_watcher() i=3 2024-09-12T00:21:13.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.125+0000 7fd021123800 20 add_watcher() i=4 2024-09-12T00:21:13.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.125+0000 7fd021123800 20 add_watcher() i=5 2024-09-12T00:21:13.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.125+0000 7fd021123800 20 add_watcher() i=6 2024-09-12T00:21:13.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.126+0000 7fd021123800 20 add_watcher() i=7 2024-09-12T00:21:13.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.126+0000 7fd021123800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.127+0000 7fced2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:13.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.128+0000 7fd021123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:13.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.128+0000 7fd021123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:13.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.128+0000 7fd021123800 5 note: GC not initialized 2024-09-12T00:21:13.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.128+0000 7fced1fe3640 20 reqs_thread_entry: start 2024-09-12T00:21:13.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.128+0000 7fd021123800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:13.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.128+0000 7fd021123800 20 Filter name: none 2024-09-12T00:21:13.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.128+0000 7fce437fe640 20 reqs_thread_entry: start 2024-09-12T00:21:13.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.128+0000 7fd021123800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.129+0000 7fd021123800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:13.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.129+0000 7fd021123800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.129+0000 7fd021123800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:21:13.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.129+0000 7fd021123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:13.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.129+0000 7fd021123800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.130+0000 7fd021123800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:13.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.130+0000 7fd021123800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.128 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.130+0000 7fd021123800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:21:13.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.130+0000 7fd021123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:13.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.131+0000 7fced2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:13.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.134+0000 7fd021123800 20 remove_watcher() i=0 2024-09-12T00:21:13.132 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.134+0000 7fd021123800 2 removed watcher, disabling cache 2024-09-12T00:21:13.133 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.135+0000 7fd021123800 20 remove_watcher() i=1 2024-09-12T00:21:13.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.136+0000 7fd021123800 20 remove_watcher() i=2 2024-09-12T00:21:13.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.137+0000 7fd021123800 20 remove_watcher() i=3 2024-09-12T00:21:13.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.138+0000 7fd021123800 20 remove_watcher() i=4 2024-09-12T00:21:13.138 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.140+0000 7fd021123800 20 remove_watcher() i=5 2024-09-12T00:21:13.139 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.141+0000 7fd021123800 20 remove_watcher() i=6 2024-09-12T00:21:13.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.143+0000 7fd021123800 20 remove_watcher() i=7 2024-09-12T00:21:13.152 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.152 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:21:13.152 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-do-reshard id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:21:13.152 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.154 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:21:13.190 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:13.190 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:13.229 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.231+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.232+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.232+0000 7f41a4b1f800 20 realm 2024-09-12T00:21:13.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.232+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.233+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.233+0000 7f41a4b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:13.231 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.233+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.233+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.233+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.233+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:13.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.234+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.234+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:13.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.234+0000 7f41a4b1f800 20 searching for the correct realm 2024-09-12T00:21:13.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.237+0000 7f41a00a1640 0 -- 172.21.15.67:0/1835061712 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f4194021940 msgr2=0x7f4194008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:13.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.443+0000 7f41a10a3640 0 -- 172.21.15.67:0/1835061712 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55ad9ad7f300 msgr2=0x55ad9ad81770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:13.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:13.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:13.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:13.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:13.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:13.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:13.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:13.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:13.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 zone default found 2024-09-12T00:21:13.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 4 Realm: () 2024-09-12T00:21:13.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:13.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:13.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:13.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 zonegroup default 2024-09-12T00:21:13.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 started sync module instance, tier type = 2024-09-12T00:21:13.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:13.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=0 2024-09-12T00:21:13.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=1 2024-09-12T00:21:13.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=2 2024-09-12T00:21:13.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=3 2024-09-12T00:21:13.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=4 2024-09-12T00:21:13.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=5 2024-09-12T00:21:13.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=6 2024-09-12T00:21:13.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.459+0000 7f41a4b1f800 20 add_watcher() i=7 2024-09-12T00:21:13.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.459+0000 7f41a4b1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:13.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.460+0000 7f4056fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:13.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.461+0000 7f41a4b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:13.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.461+0000 7f41a4b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:13.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 note: GC not initialized 2024-09-12T00:21:13.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.461+0000 7f4055fe3640 20 reqs_thread_entry: start 2024-09-12T00:21:13.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.461+0000 7f41a4b1f800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:13.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.461+0000 7f41a4b1f800 20 Filter name: none 2024-09-12T00:21:13.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.461+0000 7f3fc77fe640 20 reqs_thread_entry: start 2024-09-12T00:21:13.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.461+0000 7f41a4b1f800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:21:13.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.461+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.462+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:13.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:21:13.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:21:13.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 : miss 2024-09-12T00:21:13.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.462+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.462+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:21:13.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:13.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:13.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:21:13.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:13.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 2024-09-12T00:21:13.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.465+0000 7f41a4b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:13.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.465+0000 7f41a4b1f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:13.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.465+0000 7f41a4b1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:13.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.465+0000 7f41a4b1f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34, ofs0, ns] 2024-09-12T00:21:13.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.466+0000 7f4077fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562391 cookie 94204115599056 notifier 7076 bl.length()=911 2024-09-12T00:21:13.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.466+0000 7f4077fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:13.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.466+0000 7f4077fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:13.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.466+0000 7f4077fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:13.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.466+0000 7f41a4b1f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): orig_sources= new_sources= 2024-09-12T00:21:13.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.466+0000 7f41a4b1f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): potential sources added=[] removed=[] 2024-09-12T00:21:13.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.466+0000 7f41a4b1f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): orig_dests= new_dests= 2024-09-12T00:21:13.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.466+0000 7f41a4b1f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): potential dests added=[] removed=[] 2024-09-12T00:21:13.467 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f41a4b1f800 time 2024-09-12T00:21:13.469551+0000 2024-09-12T00:21:13.467 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:21:13.467 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:13.468 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f41a638c71a] 2024-09-12T00:21:13.468 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f41a638c8d8] 2024-09-12T00:21:13.468 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ad981a5641] 2024-09-12T00:21:13.468 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ad981b538a] 2024-09-12T00:21:13.468 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:21:13.468 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f41a5029590] 2024-09-12T00:21:13.468 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:21:13.468 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:21:13.468 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:21:13.468 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f41a4b1f800 thread_name:radosgw-admin 2024-09-12T00:21:13.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.469+0000 7f41a4b1f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f41a4b1f800 time 2024-09-12T00:21:13.469551+0000 2024-09-12T00:21:13.468 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:21:13.469 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.469 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:13.469 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f41a638c71a] 2024-09-12T00:21:13.469 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f41a638c8d8] 2024-09-12T00:21:13.469 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ad981a5641] 2024-09-12T00:21:13.469 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ad981b538a] 2024-09-12T00:21:13.469 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:21:13.469 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f41a5029590] 2024-09-12T00:21:13.469 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:21:13.469 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:21:13.469 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.487 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:13.487 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f41a503e6f0] 2024-09-12T00:21:13.487 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f41a508b99c] 2024-09-12T00:21:13.487 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:21:13.487 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:21:13.487 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f41a638c774] 2024-09-12T00:21:13.487 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f41a638c8d8] 2024-09-12T00:21:13.488 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ad981a5641] 2024-09-12T00:21:13.488 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ad981b538a] 2024-09-12T00:21:13.488 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:21:13.488 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f41a5029590] 2024-09-12T00:21:13.488 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:21:13.488 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:21:13.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.470+0000 7f41a4b1f800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:21:13.488 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f41a4b1f800 thread_name:radosgw-admin 2024-09-12T00:21:13.488 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.488 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:13.488 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f41a503e6f0] 2024-09-12T00:21:13.488 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f41a508b99c] 2024-09-12T00:21:13.488 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:21:13.489 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:21:13.489 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f41a638c774] 2024-09-12T00:21:13.489 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f41a638c8d8] 2024-09-12T00:21:13.489 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ad981a5641] 2024-09-12T00:21:13.489 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ad981b538a] 2024-09-12T00:21:13.489 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:21:13.489 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f41a5029590] 2024-09-12T00:21:13.489 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:21:13.489 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:21:13.489 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:21:13.489 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.489 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:21:13.489 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:21:13.213+0000 7f408ee0d640 10 monclient: _finish_auth 0 2024-09-12T00:21:13.490 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:21:13.213+0000 7f408ee0d640 10 monclient: _check_auth_tickets 2024-09-12T00:21:13.490 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:21:13.213+0000 7f408ee0d640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:13.490 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:21:13.213+0000 7f41a4b1f800 5 monclient: authenticate success, global_id 7064 2024-09-12T00:21:13.490 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:21:13.213+0000 7f41a4b1f800 10 monclient: get_monmap_and_config success 2024-09-12T00:21:13.490 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:21:13.213+0000 7f41a4b1f800 4 set_mon_vals no callback set 2024-09-12T00:21:13.490 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:21:13.213+0000 7f408ee0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.490 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:21:13.213+0000 7f408ee0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:13.490 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:21:13.213+0000 7f408ee0d640 10 monclient: dump: 2024-09-12T00:21:13.490 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.490 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.490 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.490 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.490 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.491 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.491 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.491 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.491 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.491 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.491 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 10 monclient: shutdown 2024-09-12T00:21:13.491 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) unregister_commands rotate-key 2024-09-12T00:21:13.491 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 10 monclient: build_initial_monmap 2024-09-12T00:21:13.491 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 1 build_initial for_mkfs: 0 2024-09-12T00:21:13.491 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 10 monclient: monmap: 2024-09-12T00:21:13.491 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:13.491 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:13.491 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:13.491 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:13.492 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:13.492 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.492 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:13.492 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:13.492 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:13.492 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.492 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding auth protocol: cephx 2024-09-12T00:21:13.492 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding auth protocol: cephx 2024-09-12T00:21:13.492 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding auth protocol: cephx 2024-09-12T00:21:13.492 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: secure 2024-09-12T00:21:13.492 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: crc 2024-09-12T00:21:13.492 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: secure 2024-09-12T00:21:13.492 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: crc 2024-09-12T00:21:13.492 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: secure 2024-09-12T00:21:13.492 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: crc 2024-09-12T00:21:13.493 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: crc 2024-09-12T00:21:13.493 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: secure 2024-09-12T00:21:13.493 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: crc 2024-09-12T00:21:13.493 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: secure 2024-09-12T00:21:13.493 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: crc 2024-09-12T00:21:13.493 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: secure 2024-09-12T00:21:13.493 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.493 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 1 librados: starting msgr at 2024-09-12T00:21:13.493 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 1 librados: starting objecter 2024-09-12T00:21:13.493 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command objecter_requests hook 0x55ad9ac99020 2024-09-12T00:21:13.493 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 1 librados: setting wanted keys 2024-09-12T00:21:13.493 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 1 librados: calling monclient init 2024-09-12T00:21:13.493 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 10 monclient: init 2024-09-12T00:21:13.493 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding auth protocol: cephx 2024-09-12T00:21:13.493 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding auth protocol: cephx 2024-09-12T00:21:13.494 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding auth protocol: cephx 2024-09-12T00:21:13.494 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: secure 2024-09-12T00:21:13.494 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: crc 2024-09-12T00:21:13.494 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: secure 2024-09-12T00:21:13.494 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: crc 2024-09-12T00:21:13.494 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: secure 2024-09-12T00:21:13.494 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: crc 2024-09-12T00:21:13.494 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: crc 2024-09-12T00:21:13.494 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: secure 2024-09-12T00:21:13.494 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: crc 2024-09-12T00:21:13.494 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: secure 2024-09-12T00:21:13.494 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: crc 2024-09-12T00:21:13.495 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: secure 2024-09-12T00:21:13.495 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.495 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.495 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command rotate-key hook 0x55ad9ac939a8 2024-09-12T00:21:13.495 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:13.495 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:21:13.495 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-a con 0x55ad9ab4b9d0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:13.495 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-b con 0x55ad9abd6e60 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:13.495 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-c con 0x55ad9abd9c10 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:13.495 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.495 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.495 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.496 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:13.496 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): authenticate will time out at 1950.471230s 2024-09-12T00:21:13.496 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:21:13.215+0000 7f41a08a2640 10 monclient(hunting): get_auth_request con 0x55ad9ab4b9d0 auth_method 0 2024-09-12T00:21:13.496 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:21:13.215+0000 7f41a08a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.496 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:21:13.215+0000 7f41a08a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.496 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:21:13.215+0000 7f41a08a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.496 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): get_auth_request con 0x55ad9abd9c10 auth_method 0 2024-09-12T00:21:13.496 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.496 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.496 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.496 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:21:13.215+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.496 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:21:13.215+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.496 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:21:13.215+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.497 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.497 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.497 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.497 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:21:13.215+0000 7f41a00a1640 10 monclient(hunting): get_auth_request con 0x55ad9abd6e60 auth_method 0 2024-09-12T00:21:13.497 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:21:13.215+0000 7f41a00a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.497 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:21:13.215+0000 7f41a00a1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.497 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:21:13.215+0000 7f41a00a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.497 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): handle_auth_done global_id 7067 payload 824 2024-09-12T00:21:13.497 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient: _finish_hunting 0 2024-09-12T00:21:13.497 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:21:13.215+0000 7f41a10a3640 1 monclient: found mon.noname-c 2024-09-12T00:21:13.497 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.497 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.497 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:13.497 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: dump: 2024-09-12T00:21:13.498 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.498 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.498 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.498 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.498 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.498 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.498 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.498 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.498 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.498 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.498 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: _finish_auth 0 2024-09-12T00:21:13.498 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: _check_auth_tickets 2024-09-12T00:21:13.499 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:13.499 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.499 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:13.499 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: dump: 2024-09-12T00:21:13.499 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.499 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.499 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.499 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.499 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.499 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.499 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.499 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.499 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.499 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.500 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 5 monclient: authenticate success, global_id 7067 2024-09-12T00:21:13.500 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient: _renew_subs 2024-09-12T00:21:13.500 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.500 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:21:13.215+0000 7f408ee0d640 4 set_mon_vals no callback set 2024-09-12T00:21:13.500 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:21:13.216+0000 7f41a4b1f800 10 monclient: _renew_subs 2024-09-12T00:21:13.500 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:21:13.216+0000 7f41a4b1f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.500 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:21:13.216+0000 7f41a4b1f800 1 librados: init done 2024-09-12T00:21:13.500 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:21:13.217+0000 7f408d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:21:13.500 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:21:13.217+0000 7f408d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:13.500 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:21:13.217+0000 7f408d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:13.500 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:21:13.217+0000 7f41a08a2640 10 monclient: get_auth_request con 0x7f40880764a0 auth_method 0 2024-09-12T00:21:13.500 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:21:13.218+0000 7f41a00a1640 10 monclient: get_auth_request con 0x55ad9acbc510 auth_method 0 2024-09-12T00:21:13.500 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:21:13.219+0000 7f41a08a2640 10 monclient: get_auth_request con 0x55ad9acdff80 auth_method 0 2024-09-12T00:21:13.500 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:21:13.220+0000 7f41a00a1640 10 monclient: get_auth_request con 0x55ad9ace4390 auth_method 0 2024-09-12T00:21:13.500 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 10 monclient: build_initial_monmap 2024-09-12T00:21:13.501 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 1 build_initial for_mkfs: 0 2024-09-12T00:21:13.501 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 10 monclient: monmap: 2024-09-12T00:21:13.501 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:13.501 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:13.501 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:13.501 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:13.501 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:13.501 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.501 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:13.501 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:13.501 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:13.501 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.501 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding auth protocol: cephx 2024-09-12T00:21:13.501 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding auth protocol: cephx 2024-09-12T00:21:13.502 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding auth protocol: cephx 2024-09-12T00:21:13.502 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: secure 2024-09-12T00:21:13.502 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: crc 2024-09-12T00:21:13.502 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: secure 2024-09-12T00:21:13.502 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: crc 2024-09-12T00:21:13.502 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: secure 2024-09-12T00:21:13.502 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: crc 2024-09-12T00:21:13.502 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: crc 2024-09-12T00:21:13.502 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: secure 2024-09-12T00:21:13.502 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: crc 2024-09-12T00:21:13.502 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: secure 2024-09-12T00:21:13.503 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: crc 2024-09-12T00:21:13.503 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: secure 2024-09-12T00:21:13.503 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.503 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command objecter_requests cmddesc objecter_requests hook 0x55ad9acecc10 EEXIST 2024-09-12T00:21:13.503 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 10 monclient: init 2024-09-12T00:21:13.503 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding auth protocol: cephx 2024-09-12T00:21:13.503 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding auth protocol: cephx 2024-09-12T00:21:13.503 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding auth protocol: cephx 2024-09-12T00:21:13.503 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: secure 2024-09-12T00:21:13.503 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: crc 2024-09-12T00:21:13.503 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: secure 2024-09-12T00:21:13.504 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: crc 2024-09-12T00:21:13.504 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: secure 2024-09-12T00:21:13.504 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: crc 2024-09-12T00:21:13.504 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: crc 2024-09-12T00:21:13.504 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: secure 2024-09-12T00:21:13.504 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: crc 2024-09-12T00:21:13.504 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: secure 2024-09-12T00:21:13.504 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: crc 2024-09-12T00:21:13.504 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: secure 2024-09-12T00:21:13.504 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.504 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.504 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command rotate-key cmddesc rotate-key hook 0x55ad9ace7a70 EEXIST 2024-09-12T00:21:13.504 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:13.504 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:21:13.504 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-b con 0x55ad9ad10900 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:13.505 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-a con 0x55ad9ad12bd0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:13.505 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-c con 0x55ad9ad0f0d0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:13.505 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.505 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.505 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.505 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:13.505 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): authenticate will time out at 1950.478457s 2024-09-12T00:21:13.505 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:21:13.222+0000 7f41a00a1640 10 monclient(hunting): get_auth_request con 0x55ad9ad12bd0 auth_method 0 2024-09-12T00:21:13.505 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:21:13.222+0000 7f41a00a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.505 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:21:13.222+0000 7f41a00a1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.505 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:21:13.222+0000 7f41a00a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.505 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): get_auth_request con 0x55ad9ad0f0d0 auth_method 0 2024-09-12T00:21:13.505 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.505 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.506 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.506 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:21:13.222+0000 7f41a08a2640 10 monclient(hunting): get_auth_request con 0x55ad9ad10900 auth_method 0 2024-09-12T00:21:13.506 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:21:13.222+0000 7f41a08a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.506 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:21:13.222+0000 7f41a08a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.506 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:21:13.222+0000 7f41a08a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.506 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.506 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.506 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.506 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:21:13.222+0000 7f41a00a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.506 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:21:13.222+0000 7f41a00a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.506 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:21:13.222+0000 7f41a00a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.506 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:21:13.222+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.506 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:21:13.222+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.507 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:21:13.222+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.507 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): handle_auth_done global_id 7070 payload 824 2024-09-12T00:21:13.507 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient: _finish_hunting 0 2024-09-12T00:21:13.507 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:21:13.222+0000 7f41a10a3640 1 monclient: found mon.noname-c 2024-09-12T00:21:13.507 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.507 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.507 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:13.507 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: dump: 2024-09-12T00:21:13.507 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.507 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.507 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.507 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.507 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.508 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.508 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.508 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.508 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.508 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.508 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: _finish_auth 0 2024-09-12T00:21:13.508 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: _check_auth_tickets 2024-09-12T00:21:13.508 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:13.508 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.508 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:13.508 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: dump: 2024-09-12T00:21:13.508 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.508 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.508 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.509 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.509 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.509 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.509 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.509 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.509 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.509 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.509 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:21:13.223+0000 7f41a18a4640 4 set_mon_vals no callback set 2024-09-12T00:21:13.509 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:21:13.223+0000 7f41a4b1f800 5 monclient: authenticate success, global_id 7070 2024-09-12T00:21:13.509 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:21:13.223+0000 7f41a4b1f800 10 monclient: _renew_subs 2024-09-12T00:21:13.509 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:21:13.223+0000 7f41a4b1f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.509 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:21:13.223+0000 7f41a4b1f800 10 monclient: _renew_subs 2024-09-12T00:21:13.509 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:21:13.223+0000 7f41a4b1f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.510 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:21:13.224+0000 7f40867fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:21:13.510 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:21:13.224+0000 7f40867fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:13.510 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:21:13.224+0000 7f40867fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:13.510 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:21:13.224+0000 7f41a08a2640 10 monclient: get_auth_request con 0x7f4078076380 auth_method 0 2024-09-12T00:21:13.510 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 10 monclient: get_monmap_and_config 2024-09-12T00:21:13.510 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 10 monclient: build_initial_monmap 2024-09-12T00:21:13.510 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 1 build_initial for_mkfs: 0 2024-09-12T00:21:13.510 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 10 monclient: monmap: 2024-09-12T00:21:13.510 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:13.510 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:13.510 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:13.510 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:13.510 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:13.510 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.510 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:13.511 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:13.511 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:13.511 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.511 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding auth protocol: cephx 2024-09-12T00:21:13.511 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding auth protocol: cephx 2024-09-12T00:21:13.511 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding auth protocol: cephx 2024-09-12T00:21:13.511 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: secure 2024-09-12T00:21:13.511 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: crc 2024-09-12T00:21:13.511 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: secure 2024-09-12T00:21:13.511 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: crc 2024-09-12T00:21:13.511 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: secure 2024-09-12T00:21:13.511 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: crc 2024-09-12T00:21:13.511 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: crc 2024-09-12T00:21:13.511 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: secure 2024-09-12T00:21:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: crc 2024-09-12T00:21:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: secure 2024-09-12T00:21:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: crc 2024-09-12T00:21:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: secure 2024-09-12T00:21:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 10 monclient: init 2024-09-12T00:21:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding auth protocol: cephx 2024-09-12T00:21:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding auth protocol: cephx 2024-09-12T00:21:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding auth protocol: cephx 2024-09-12T00:21:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: secure 2024-09-12T00:21:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: crc 2024-09-12T00:21:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: secure 2024-09-12T00:21:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: crc 2024-09-12T00:21:13.512 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: secure 2024-09-12T00:21:13.513 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: crc 2024-09-12T00:21:13.513 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: crc 2024-09-12T00:21:13.513 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: secure 2024-09-12T00:21:13.513 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: crc 2024-09-12T00:21:13.513 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: secure 2024-09-12T00:21:13.513 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: crc 2024-09-12T00:21:13.513 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: secure 2024-09-12T00:21:13.513 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.513 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.513 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command rotate-key cmddesc rotate-key hook 0x7ffdbca91a18 EEXIST 2024-09-12T00:21:13.513 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:13.513 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:21:13.513 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-c con 0x55ad9ad64c30 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:13.514 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-b con 0x55ad9ad55580 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:13.514 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-a con 0x55ad9ad60060 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:13.514 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.514 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.514 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.514 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:13.514 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): authenticate will time out at 1950.482214s 2024-09-12T00:21:13.514 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): get_auth_request con 0x55ad9ad64c30 auth_method 0 2024-09-12T00:21:13.514 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.514 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.514 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.514 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:21:13.226+0000 7f41a10a3640 10 monclient(hunting): get_auth_request con 0x55ad9ad60060 auth_method 0 2024-09-12T00:21:13.515 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:21:13.226+0000 7f41a10a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.515 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:21:13.226+0000 7f41a10a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.515 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:21:13.226+0000 7f41a10a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.515 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.515 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.515 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.515 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:21:13.226+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.515 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:21:13.226+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.515 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:21:13.226+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.515 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:21:13.226+0000 7f41a00a1640 10 monclient(hunting): get_auth_request con 0x55ad9ad55580 auth_method 0 2024-09-12T00:21:13.515 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:21:13.226+0000 7f41a00a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.515 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:21:13.226+0000 7f41a00a1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.515 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:21:13.226+0000 7f41a00a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.516 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): handle_auth_done global_id 7073 payload 274 2024-09-12T00:21:13.516 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient: _finish_hunting 0 2024-09-12T00:21:13.516 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:21:13.226+0000 7f41a08a2640 1 monclient: found mon.noname-c 2024-09-12T00:21:13.516 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.516 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.516 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:13.516 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: dump: 2024-09-12T00:21:13.516 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.516 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.516 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.516 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.516 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.517 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.517 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.517 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.517 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.517 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.517 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: _finish_auth 0 2024-09-12T00:21:13.517 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: _check_auth_tickets 2024-09-12T00:21:13.517 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 5 monclient: authenticate success, global_id 7073 2024-09-12T00:21:13.517 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:13.518 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient: get_monmap_and_config success 2024-09-12T00:21:13.518 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 4 set_mon_vals no callback set 2024-09-12T00:21:13.518 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.518 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:13.518 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: dump: 2024-09-12T00:21:13.518 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.518 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.518 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.518 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.518 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.518 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.518 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.518 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.519 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.519 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.519 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 10 monclient: shutdown 2024-09-12T00:21:13.519 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 10 monclient: build_initial_monmap 2024-09-12T00:21:13.519 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 1 build_initial for_mkfs: 0 2024-09-12T00:21:13.519 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 10 monclient: monmap: 2024-09-12T00:21:13.519 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:13.519 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:13.519 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:13.519 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:13.519 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:13.519 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.519 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:13.520 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:13.520 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:13.520 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.520 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding auth protocol: cephx 2024-09-12T00:21:13.520 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding auth protocol: cephx 2024-09-12T00:21:13.520 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding auth protocol: cephx 2024-09-12T00:21:13.520 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: secure 2024-09-12T00:21:13.520 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: crc 2024-09-12T00:21:13.520 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: secure 2024-09-12T00:21:13.520 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: crc 2024-09-12T00:21:13.520 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: secure 2024-09-12T00:21:13.520 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: crc 2024-09-12T00:21:13.521 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: crc 2024-09-12T00:21:13.521 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: secure 2024-09-12T00:21:13.521 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: crc 2024-09-12T00:21:13.521 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: secure 2024-09-12T00:21:13.521 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: crc 2024-09-12T00:21:13.521 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: secure 2024-09-12T00:21:13.521 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.521 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 1 librados: starting msgr at 2024-09-12T00:21:13.521 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 1 librados: starting objecter 2024-09-12T00:21:13.521 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command objecter_requests cmddesc objecter_requests hook 0x55ad9ad10f80 EEXIST 2024-09-12T00:21:13.521 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 1 librados: setting wanted keys 2024-09-12T00:21:13.521 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 1 librados: calling monclient init 2024-09-12T00:21:13.521 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient: init 2024-09-12T00:21:13.521 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding auth protocol: cephx 2024-09-12T00:21:13.522 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding auth protocol: cephx 2024-09-12T00:21:13.522 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding auth protocol: cephx 2024-09-12T00:21:13.522 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: secure 2024-09-12T00:21:13.522 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: crc 2024-09-12T00:21:13.522 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: secure 2024-09-12T00:21:13.522 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: crc 2024-09-12T00:21:13.522 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: secure 2024-09-12T00:21:13.522 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: crc 2024-09-12T00:21:13.522 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: crc 2024-09-12T00:21:13.522 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: secure 2024-09-12T00:21:13.522 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: crc 2024-09-12T00:21:13.522 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: secure 2024-09-12T00:21:13.522 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: crc 2024-09-12T00:21:13.522 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: secure 2024-09-12T00:21:13.523 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.523 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.523 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command rotate-key cmddesc rotate-key hook 0x55ad9ad287f8 EEXIST 2024-09-12T00:21:13.523 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:13.523 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:21:13.523 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-c con 0x55ad9ad55580 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:13.523 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-b con 0x55ad9ad60060 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:13.523 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-a con 0x55ad9ad64c30 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:13.523 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.523 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.523 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.523 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:13.523 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): authenticate will time out at 1950.484578s 2024-09-12T00:21:13.524 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): get_auth_request con 0x55ad9ad55580 auth_method 0 2024-09-12T00:21:13.524 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.524 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.524 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.524 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:21:13.228+0000 7f41a10a3640 10 monclient(hunting): get_auth_request con 0x55ad9ad64c30 auth_method 0 2024-09-12T00:21:13.524 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:21:13.228+0000 7f41a10a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.524 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:21:13.228+0000 7f41a10a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.524 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:21:13.228+0000 7f41a10a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.524 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.524 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.524 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.524 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:21:13.228+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.524 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:21:13.228+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.525 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:21:13.228+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.525 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): handle_auth_done global_id 7076 payload 824 2024-09-12T00:21:13.525 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient: _finish_hunting 0 2024-09-12T00:21:13.525 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:21:13.228+0000 7f41a08a2640 1 monclient: found mon.noname-c 2024-09-12T00:21:13.525 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.525 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.525 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:13.525 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: dump: 2024-09-12T00:21:13.525 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.525 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.525 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.525 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.525 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.526 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.526 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.526 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.526 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.526 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.526 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: _finish_auth 0 2024-09-12T00:21:13.526 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: _check_auth_tickets 2024-09-12T00:21:13.526 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:13.526 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.526 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:13.526 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: dump: 2024-09-12T00:21:13.526 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.526 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.526 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.527 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.527 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.527 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.527 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.527 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.527 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.527 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.527 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:21:13.229+0000 7f41a4b1f800 5 monclient: authenticate success, global_id 7076 2024-09-12T00:21:13.528 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:21:13.229+0000 7f41a4b1f800 10 monclient: _renew_subs 2024-09-12T00:21:13.528 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:21:13.229+0000 7f4077fff640 4 set_mon_vals no callback set 2024-09-12T00:21:13.528 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:21:13.229+0000 7f41a4b1f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.528 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:21:13.229+0000 7f41a4b1f800 10 monclient: _renew_subs 2024-09-12T00:21:13.528 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:21:13.229+0000 7f41a4b1f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.528 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:21:13.229+0000 7f41a4b1f800 1 librados: init done 2024-09-12T00:21:13.528 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:21:13.229+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command cr dump hook 0x55ad9ad55478 2024-09-12T00:21:13.528 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:21:13.231+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.528 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:21:13.231+0000 7f40767fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:21:13.528 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:21:13.231+0000 7f40767fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:13.528 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:21:13.231+0000 7f40767fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:13.529 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:21:13.232+0000 7f41a00a1640 10 monclient: get_auth_request con 0x7f406c076470 auth_method 0 2024-09-12T00:21:13.529 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:21:13.232+0000 7f41a10a3640 10 monclient: get_auth_request con 0x55ad9ad7f300 auth_method 0 2024-09-12T00:21:13.529 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:21:13.232+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.529 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:21:13.232+0000 7f41a4b1f800 20 realm 2024-09-12T00:21:13.529 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:21:13.232+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.529 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:21:13.233+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.529 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:21:13.233+0000 7f41a4b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:13.529 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:21:13.233+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.529 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:21:13.233+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.529 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:21:13.233+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.529 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:21:13.233+0000 7f41a08a2640 10 monclient: get_auth_request con 0x55ad9ad83520 auth_method 0 2024-09-12T00:21:13.529 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:21:13.233+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:13.529 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:21:13.234+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.530 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:21:13.234+0000 7f41a00a1640 10 monclient: get_auth_request con 0x55ad9ad86d80 auth_method 0 2024-09-12T00:21:13.530 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:21:13.234+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:13.530 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:21:13.234+0000 7f41a4b1f800 20 searching for the correct realm 2024-09-12T00:21:13.530 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:21:13.235+0000 7f41a10a3640 10 monclient: get_auth_request con 0x7f419403cb00 auth_method 0 2024-09-12T00:21:13.530 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:21:13.236+0000 7f41a08a2640 10 monclient: get_auth_request con 0x7f41900a0060 auth_method 0 2024-09-12T00:21:13.530 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:21:13.237+0000 7f41a00a1640 10 monclient: get_auth_request con 0x7f4194021940 auth_method 0 2024-09-12T00:21:13.530 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:21:13.237+0000 7f41a00a1640 0 -- 172.21.15.67:0/1835061712 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f4194021940 msgr2=0x7f4194008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:13.530 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:21:13.439+0000 7f41a00a1640 10 monclient: get_auth_request con 0x7f4194021940 auth_method 0 2024-09-12T00:21:13.530 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:21:13.441+0000 7f41a10a3640 10 monclient: get_auth_request con 0x7f4190096070 auth_method 0 2024-09-12T00:21:13.530 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:21:13.442+0000 7f41a08a2640 10 monclient: get_auth_request con 0x7f4198089ed0 auth_method 0 2024-09-12T00:21:13.530 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:21:13.443+0000 7f41a10a3640 0 -- 172.21.15.67:0/1835061712 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55ad9ad7f300 msgr2=0x55ad9ad81770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:13.530 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:21:13.443+0000 7f40767fc640 1 client.7076.objecter ms_handle_reset 0x55ad9ad7f300 session 0x55ad9ad7ec30 osd.6 2024-09-12T00:21:13.531 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:21:13.443+0000 7f40767fc640 10 monclient: _renew_subs 2024-09-12T00:21:13.531 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:21:13.443+0000 7f40767fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.531 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:21:13.443+0000 7f41a10a3640 10 monclient: get_auth_request con 0x7f406c086790 auth_method 0 2024-09-12T00:21:13.531 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:13.531 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:13.531 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:13.531 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:13.531 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:13.531 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:13.531 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.531 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.531 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.531 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:13.532 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.532 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:13.532 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 zone default found 2024-09-12T00:21:13.532 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 4 Realm: () 2024-09-12T00:21:13.532 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:13.532 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:13.532 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:13.532 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 zonegroup default 2024-09-12T00:21:13.532 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.532 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.532 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.532 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.533 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.533 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.533 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 started sync module instance, tier type = 2024-09-12T00:21:13.533 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:13.533 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=0 2024-09-12T00:21:13.533 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=1 2024-09-12T00:21:13.533 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=2 2024-09-12T00:21:13.533 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=3 2024-09-12T00:21:13.533 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=4 2024-09-12T00:21:13.533 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=5 2024-09-12T00:21:13.533 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=6 2024-09-12T00:21:13.533 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:21:13.459+0000 7f41a4b1f800 20 add_watcher() i=7 2024-09-12T00:21:13.533 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:21:13.459+0000 7f41a4b1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:13.534 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding auth protocol: cephx 2024-09-12T00:21:13.534 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding auth protocol: cephx 2024-09-12T00:21:13.534 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding auth protocol: cephx 2024-09-12T00:21:13.534 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: secure 2024-09-12T00:21:13.534 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: crc 2024-09-12T00:21:13.534 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: secure 2024-09-12T00:21:13.534 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: crc 2024-09-12T00:21:13.534 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: secure 2024-09-12T00:21:13.534 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: crc 2024-09-12T00:21:13.534 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: crc 2024-09-12T00:21:13.534 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: secure 2024-09-12T00:21:13.534 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: crc 2024-09-12T00:21:13.534 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: secure 2024-09-12T00:21:13.535 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: crc 2024-09-12T00:21:13.535 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: secure 2024-09-12T00:21:13.535 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:21:13.460+0000 7f4056fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:13.535 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.535 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:13.535 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:13.535 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command cache list hook 0x55ad9ad720c0 2024-09-12T00:21:13.535 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command cache inspect hook 0x55ad9ad720c0 2024-09-12T00:21:13.535 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command cache erase hook 0x55ad9ad720c0 2024-09-12T00:21:13.535 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command cache zap hook 0x55ad9ad720c0 2024-09-12T00:21:13.535 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 note: GC not initialized 2024-09-12T00:21:13.535 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:21:13.461+0000 7f4055fe3640 20 reqs_thread_entry: start 2024-09-12T00:21:13.535 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command sync trace show hook 0x7f4190058f00 2024-09-12T00:21:13.536 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command sync trace history hook 0x7f4190058f00 2024-09-12T00:21:13.536 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command sync trace active hook 0x7f4190058f00 2024-09-12T00:21:13.536 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command sync trace active_short hook 0x7f4190058f00 2024-09-12T00:21:13.536 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:13.536 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 20 Filter name: none 2024-09-12T00:21:13.536 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:21:13.461+0000 7f3fc77fe640 20 reqs_thread_entry: start 2024-09-12T00:21:13.536 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:21:13.536 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.536 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:13.536 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:21:13.536 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:21:13.537 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 : miss 2024-09-12T00:21:13.537 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.537 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:21:13.537 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:13.537 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:13.537 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:21:13.537 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:13.537 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 2024-09-12T00:21:13.537 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:21:13.465+0000 7f41a4b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:13.537 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:21:13.465+0000 7f41a4b1f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:13.537 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:21:13.465+0000 7f41a4b1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:13.537 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:21:13.465+0000 7f41a4b1f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34, ofs0, ns] 2024-09-12T00:21:13.538 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:21:13.466+0000 7f4077fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562391 cookie 94204115599056 notifier 7076 bl.length()=911 2024-09-12T00:21:13.538 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:21:13.466+0000 7f4077fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:13.538 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:21:13.466+0000 7f4077fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:13.538 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:21:13.466+0000 7f4077fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:13.538 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:21:13.466+0000 7f41a4b1f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): orig_sources= new_sources= 2024-09-12T00:21:13.538 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:21:13.466+0000 7f41a4b1f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): potential sources added=[] removed=[] 2024-09-12T00:21:13.538 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:21:13.466+0000 7f41a4b1f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): orig_dests= new_dests= 2024-09-12T00:21:13.538 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:21:13.466+0000 7f41a4b1f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): potential dests added=[] removed=[] 2024-09-12T00:21:13.538 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:21:13.469+0000 7f41a4b1f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f41a4b1f800 time 2024-09-12T00:21:13.469551+0000 2024-09-12T00:21:13.538 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:21:13.538 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.539 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:13.539 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f41a638c71a] 2024-09-12T00:21:13.539 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f41a638c8d8] 2024-09-12T00:21:13.539 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ad981a5641] 2024-09-12T00:21:13.539 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ad981b538a] 2024-09-12T00:21:13.539 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:21:13.539 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f41a5029590] 2024-09-12T00:21:13.539 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:21:13.539 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:21:13.539 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.539 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:21:13.470+0000 7f41a4b1f800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:21:13.539 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f41a4b1f800 thread_name:radosgw-admin 2024-09-12T00:21:13.539 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.540 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:13.540 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f41a503e6f0] 2024-09-12T00:21:13.540 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f41a508b99c] 2024-09-12T00:21:13.540 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:21:13.540 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:21:13.540 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f41a638c774] 2024-09-12T00:21:13.540 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f41a638c8d8] 2024-09-12T00:21:13.540 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ad981a5641] 2024-09-12T00:21:13.540 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ad981b538a] 2024-09-12T00:21:13.540 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:21:13.540 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f41a5029590] 2024-09-12T00:21:13.540 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:21:13.541 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:21:13.541 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:21:13.541 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.541 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:21:13.541 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:21:13.541 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:21:13.541 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:21:13.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:21:13.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:21:13.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:21:13.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:21:13.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:21:13.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:21:13.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:21:13.542 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:21:13.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:21:13.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:21:13.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:21:13.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:21:13.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:21:13.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:21:13.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:21:13.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:21:13.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:21:13.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:21:13.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:21:13.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:21:13.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:21:13.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:21:13.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:21:13.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:21:13.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:21:13.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:21:13.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:21:13.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:21:13.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:21:13.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:21:13.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:21:13.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:21:13.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:21:13.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:21:13.544 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:21:13.544 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:21:13.544 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:21:13.544 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:21:13.544 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:21:13.544 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:21:13.544 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:21:13.544 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:21:13.544 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:21:13.544 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:21:13.544 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:21:13.544 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:21:13.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:21:13.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:21:13.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:21:13.545 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:21:13.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:21:13.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:21:13.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:21:13.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:21:13.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:21:13.545 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:21:13.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:21:13.545 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:21:13.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:21:13.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:21:13.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:21:13.546 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:21:13.546 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:21:13.546 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:21:13.546 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:21:13.546 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:21:13.546 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:21:13.546 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:21:13.546 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:21:13.546 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:21:13.546 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:21:13.546 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:21:13.546 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:21:13.546 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:21:13.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:21:13.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:21:13.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:21:13.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:21:13.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:21:13.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:21:13.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:21:13.547 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:21:13.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:21:13.547 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:21:13.547 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:21:13.547 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:21:13.547 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:21:13.547 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:21:13.548 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:21:13.548 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:21:13.548 INFO:tasks.workunit.client.0.smithi067.stderr: 7f3fc77fe640 / http_manager 2024-09-12T00:21:13.548 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4055fe3640 / http_manager 2024-09-12T00:21:13.548 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4056fe5640 / rgw_dt_lg_renew 2024-09-12T00:21:13.548 INFO:tasks.workunit.client.0.smithi067.stderr: 7f40767fc640 / ms_dispatch 2024-09-12T00:21:13.548 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4077fff640 / io_context_pool 2024-09-12T00:21:13.548 INFO:tasks.workunit.client.0.smithi067.stderr: 7f40867fc640 / ms_dispatch 2024-09-12T00:21:13.548 INFO:tasks.workunit.client.0.smithi067.stderr: 7f408d60a640 / ms_dispatch 2024-09-12T00:21:13.548 INFO:tasks.workunit.client.0.smithi067.stderr: 7f408ee0d640 / io_context_pool 2024-09-12T00:21:13.548 INFO:tasks.workunit.client.0.smithi067.stderr: 7f41a00a1640 / msgr-worker-2 2024-09-12T00:21:13.548 INFO:tasks.workunit.client.0.smithi067.stderr: 7f41a08a2640 / msgr-worker-1 2024-09-12T00:21:13.548 INFO:tasks.workunit.client.0.smithi067.stderr: 7f41a10a3640 / msgr-worker-0 2024-09-12T00:21:13.549 INFO:tasks.workunit.client.0.smithi067.stderr: 7f41a18a4640 / io_context_pool 2024-09-12T00:21:13.549 INFO:tasks.workunit.client.0.smithi067.stderr: 7f41a4b1f800 / radosgw-admin 2024-09-12T00:21:13.549 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:21:13.549 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:21:13.549 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.127603.log 2024-09-12T00:21:13.549 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:21:13.549 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:21:13.549 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:21:13.213+0000 7f408ee0d640 10 monclient: _finish_auth 0 2024-09-12T00:21:13.549 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:21:13.213+0000 7f408ee0d640 10 monclient: _check_auth_tickets 2024-09-12T00:21:13.549 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:21:13.213+0000 7f408ee0d640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:13.549 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:21:13.213+0000 7f41a4b1f800 5 monclient: authenticate success, global_id 7064 2024-09-12T00:21:13.549 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:21:13.213+0000 7f41a4b1f800 10 monclient: get_monmap_and_config success 2024-09-12T00:21:13.549 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:21:13.213+0000 7f41a4b1f800 4 set_mon_vals no callback set 2024-09-12T00:21:13.549 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:21:13.213+0000 7f408ee0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.550 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:21:13.213+0000 7f408ee0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:13.550 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:21:13.213+0000 7f408ee0d640 10 monclient: dump: 2024-09-12T00:21:13.550 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.550 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.550 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.550 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.550 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.550 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.550 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.550 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.550 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.550 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.551 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 10 monclient: shutdown 2024-09-12T00:21:13.551 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) unregister_commands rotate-key 2024-09-12T00:21:13.551 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 10 monclient: build_initial_monmap 2024-09-12T00:21:13.551 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 1 build_initial for_mkfs: 0 2024-09-12T00:21:13.551 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 10 monclient: monmap: 2024-09-12T00:21:13.551 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:13.551 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:13.551 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:13.551 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:13.551 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:13.551 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.552 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:13.552 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:13.552 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:13.552 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.552 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding auth protocol: cephx 2024-09-12T00:21:13.552 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding auth protocol: cephx 2024-09-12T00:21:13.552 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding auth protocol: cephx 2024-09-12T00:21:13.552 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: secure 2024-09-12T00:21:13.552 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: crc 2024-09-12T00:21:13.552 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: secure 2024-09-12T00:21:13.552 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: crc 2024-09-12T00:21:13.553 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: secure 2024-09-12T00:21:13.553 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: crc 2024-09-12T00:21:13.553 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: crc 2024-09-12T00:21:13.553 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: secure 2024-09-12T00:21:13.553 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: crc 2024-09-12T00:21:13.553 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: secure 2024-09-12T00:21:13.553 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: crc 2024-09-12T00:21:13.553 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac994d0) adding con mode: secure 2024-09-12T00:21:13.553 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.553 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 1 librados: starting msgr at 2024-09-12T00:21:13.553 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 1 librados: starting objecter 2024-09-12T00:21:13.553 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command objecter_requests hook 0x55ad9ac99020 2024-09-12T00:21:13.553 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 1 librados: setting wanted keys 2024-09-12T00:21:13.554 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 1 librados: calling monclient init 2024-09-12T00:21:13.554 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 10 monclient: init 2024-09-12T00:21:13.554 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding auth protocol: cephx 2024-09-12T00:21:13.554 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding auth protocol: cephx 2024-09-12T00:21:13.554 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding auth protocol: cephx 2024-09-12T00:21:13.554 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: secure 2024-09-12T00:21:13.554 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: crc 2024-09-12T00:21:13.554 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: secure 2024-09-12T00:21:13.554 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: crc 2024-09-12T00:21:13.554 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: secure 2024-09-12T00:21:13.554 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: crc 2024-09-12T00:21:13.554 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: crc 2024-09-12T00:21:13.555 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: secure 2024-09-12T00:21:13.555 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: crc 2024-09-12T00:21:13.555 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: secure 2024-09-12T00:21:13.555 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: crc 2024-09-12T00:21:13.555 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ac93860) adding con mode: secure 2024-09-12T00:21:13.555 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:21:13.214+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.555 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.555 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command rotate-key hook 0x55ad9ac939a8 2024-09-12T00:21:13.555 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:13.555 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:21:13.555 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-a con 0x55ad9ab4b9d0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:13.555 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-b con 0x55ad9abd6e60 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:13.555 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-c con 0x55ad9abd9c10 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:13.556 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.556 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.556 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.556 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:13.556 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient(hunting): authenticate will time out at 1950.471230s 2024-09-12T00:21:13.556 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:21:13.215+0000 7f41a08a2640 10 monclient(hunting): get_auth_request con 0x55ad9ab4b9d0 auth_method 0 2024-09-12T00:21:13.556 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:21:13.215+0000 7f41a08a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.556 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:21:13.215+0000 7f41a08a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.556 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:21:13.215+0000 7f41a08a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.556 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): get_auth_request con 0x55ad9abd9c10 auth_method 0 2024-09-12T00:21:13.556 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.556 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.556 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.557 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:21:13.215+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.557 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:21:13.215+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.557 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:21:13.215+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.557 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.557 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.557 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.557 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:21:13.215+0000 7f41a00a1640 10 monclient(hunting): get_auth_request con 0x55ad9abd6e60 auth_method 0 2024-09-12T00:21:13.557 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:21:13.215+0000 7f41a00a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.557 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:21:13.215+0000 7f41a00a1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.557 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:21:13.215+0000 7f41a00a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.557 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient(hunting): handle_auth_done global_id 7067 payload 824 2024-09-12T00:21:13.557 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient: _finish_hunting 0 2024-09-12T00:21:13.557 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:21:13.215+0000 7f41a10a3640 1 monclient: found mon.noname-c 2024-09-12T00:21:13.557 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:21:13.215+0000 7f41a10a3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.558 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.558 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:13.558 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: dump: 2024-09-12T00:21:13.558 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.558 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.558 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.558 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.558 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.558 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.558 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.558 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.558 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.558 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.559 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: _finish_auth 0 2024-09-12T00:21:13.559 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: _check_auth_tickets 2024-09-12T00:21:13.559 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:13.559 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.559 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:13.559 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:21:13.215+0000 7f408d60a640 10 monclient: dump: 2024-09-12T00:21:13.559 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.559 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.559 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.559 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.559 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.559 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.559 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.559 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.560 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.560 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.560 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 5 monclient: authenticate success, global_id 7067 2024-09-12T00:21:13.560 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient: _renew_subs 2024-09-12T00:21:13.560 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:21:13.215+0000 7f41a4b1f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.560 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:21:13.215+0000 7f408ee0d640 4 set_mon_vals no callback set 2024-09-12T00:21:13.560 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:21:13.216+0000 7f41a4b1f800 10 monclient: _renew_subs 2024-09-12T00:21:13.560 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:21:13.216+0000 7f41a4b1f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.560 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:21:13.216+0000 7f41a4b1f800 1 librados: init done 2024-09-12T00:21:13.560 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:21:13.217+0000 7f408d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:21:13.560 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:21:13.217+0000 7f408d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:13.560 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:21:13.217+0000 7f408d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:13.560 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:21:13.217+0000 7f41a08a2640 10 monclient: get_auth_request con 0x7f40880764a0 auth_method 0 2024-09-12T00:21:13.560 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:21:13.218+0000 7f41a00a1640 10 monclient: get_auth_request con 0x55ad9acbc510 auth_method 0 2024-09-12T00:21:13.560 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:21:13.219+0000 7f41a08a2640 10 monclient: get_auth_request con 0x55ad9acdff80 auth_method 0 2024-09-12T00:21:13.561 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:21:13.220+0000 7f41a00a1640 10 monclient: get_auth_request con 0x55ad9ace4390 auth_method 0 2024-09-12T00:21:13.561 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 10 monclient: build_initial_monmap 2024-09-12T00:21:13.561 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 1 build_initial for_mkfs: 0 2024-09-12T00:21:13.561 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 10 monclient: monmap: 2024-09-12T00:21:13.561 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:13.561 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:13.561 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:13.561 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:13.561 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:13.561 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.561 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:13.561 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:13.562 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:13.562 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.562 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding auth protocol: cephx 2024-09-12T00:21:13.562 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding auth protocol: cephx 2024-09-12T00:21:13.562 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding auth protocol: cephx 2024-09-12T00:21:13.562 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: secure 2024-09-12T00:21:13.562 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: crc 2024-09-12T00:21:13.562 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: secure 2024-09-12T00:21:13.562 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: crc 2024-09-12T00:21:13.562 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: secure 2024-09-12T00:21:13.562 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: crc 2024-09-12T00:21:13.562 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: crc 2024-09-12T00:21:13.562 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: secure 2024-09-12T00:21:13.563 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: crc 2024-09-12T00:21:13.563 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: secure 2024-09-12T00:21:13.563 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: crc 2024-09-12T00:21:13.563 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace9200) adding con mode: secure 2024-09-12T00:21:13.563 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.563 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command objecter_requests cmddesc objecter_requests hook 0x55ad9acecc10 EEXIST 2024-09-12T00:21:13.563 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 10 monclient: init 2024-09-12T00:21:13.563 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding auth protocol: cephx 2024-09-12T00:21:13.563 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding auth protocol: cephx 2024-09-12T00:21:13.563 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding auth protocol: cephx 2024-09-12T00:21:13.563 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: secure 2024-09-12T00:21:13.563 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: crc 2024-09-12T00:21:13.564 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: secure 2024-09-12T00:21:13.564 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: crc 2024-09-12T00:21:13.564 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: secure 2024-09-12T00:21:13.564 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: crc 2024-09-12T00:21:13.564 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: crc 2024-09-12T00:21:13.564 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: secure 2024-09-12T00:21:13.564 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: crc 2024-09-12T00:21:13.564 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: secure 2024-09-12T00:21:13.564 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: crc 2024-09-12T00:21:13.564 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:21:13.221+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ace7928) adding con mode: secure 2024-09-12T00:21:13.565 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.565 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.565 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command rotate-key cmddesc rotate-key hook 0x55ad9ace7a70 EEXIST 2024-09-12T00:21:13.565 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:13.565 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:21:13.565 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-b con 0x55ad9ad10900 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:13.565 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-a con 0x55ad9ad12bd0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:13.565 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-c con 0x55ad9ad0f0d0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:13.565 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.565 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.565 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.565 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:13.566 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:21:13.222+0000 7f41a4b1f800 10 monclient(hunting): authenticate will time out at 1950.478457s 2024-09-12T00:21:13.566 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:21:13.222+0000 7f41a00a1640 10 monclient(hunting): get_auth_request con 0x55ad9ad12bd0 auth_method 0 2024-09-12T00:21:13.566 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:21:13.222+0000 7f41a00a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.566 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:21:13.222+0000 7f41a00a1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.566 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:21:13.222+0000 7f41a00a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.566 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): get_auth_request con 0x55ad9ad0f0d0 auth_method 0 2024-09-12T00:21:13.566 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.566 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.566 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.566 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:21:13.222+0000 7f41a08a2640 10 monclient(hunting): get_auth_request con 0x55ad9ad10900 auth_method 0 2024-09-12T00:21:13.566 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:21:13.222+0000 7f41a08a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.566 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:21:13.222+0000 7f41a08a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.566 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:21:13.222+0000 7f41a08a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.566 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.567 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.567 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.567 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:21:13.222+0000 7f41a00a1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.567 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:21:13.222+0000 7f41a00a1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.567 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:21:13.222+0000 7f41a00a1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.567 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:21:13.222+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.567 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:21:13.222+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.567 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:21:13.222+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.567 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient(hunting): handle_auth_done global_id 7070 payload 824 2024-09-12T00:21:13.567 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient: _finish_hunting 0 2024-09-12T00:21:13.567 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:21:13.222+0000 7f41a10a3640 1 monclient: found mon.noname-c 2024-09-12T00:21:13.567 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:21:13.222+0000 7f41a10a3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.567 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.568 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:13.568 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: dump: 2024-09-12T00:21:13.568 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.568 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.568 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.568 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.568 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.568 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.568 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.568 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.568 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.569 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.569 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: _finish_auth 0 2024-09-12T00:21:13.569 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: _check_auth_tickets 2024-09-12T00:21:13.569 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:13.569 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.569 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:13.569 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:21:13.223+0000 7f40867fc640 10 monclient: dump: 2024-09-12T00:21:13.569 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.569 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.569 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.569 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.569 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.569 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.570 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.570 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.570 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.570 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.570 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:21:13.223+0000 7f41a18a4640 4 set_mon_vals no callback set 2024-09-12T00:21:13.570 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:21:13.223+0000 7f41a4b1f800 5 monclient: authenticate success, global_id 7070 2024-09-12T00:21:13.570 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:21:13.223+0000 7f41a4b1f800 10 monclient: _renew_subs 2024-09-12T00:21:13.570 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:21:13.223+0000 7f41a4b1f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.570 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:21:13.223+0000 7f41a4b1f800 10 monclient: _renew_subs 2024-09-12T00:21:13.570 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:21:13.223+0000 7f41a4b1f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.570 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:21:13.224+0000 7f40867fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:21:13.570 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:21:13.224+0000 7f40867fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:13.570 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:21:13.224+0000 7f40867fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:13.571 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:21:13.224+0000 7f41a08a2640 10 monclient: get_auth_request con 0x7f4078076380 auth_method 0 2024-09-12T00:21:13.571 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 10 monclient: get_monmap_and_config 2024-09-12T00:21:13.571 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 10 monclient: build_initial_monmap 2024-09-12T00:21:13.571 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 1 build_initial for_mkfs: 0 2024-09-12T00:21:13.571 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 10 monclient: monmap: 2024-09-12T00:21:13.571 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:13.571 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:13.571 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:13.571 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:13.571 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:13.571 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.571 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:13.571 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:13.571 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:13.572 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.572 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding auth protocol: cephx 2024-09-12T00:21:13.572 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding auth protocol: cephx 2024-09-12T00:21:13.572 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding auth protocol: cephx 2024-09-12T00:21:13.572 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: secure 2024-09-12T00:21:13.572 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: crc 2024-09-12T00:21:13.572 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: secure 2024-09-12T00:21:13.572 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: crc 2024-09-12T00:21:13.572 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: secure 2024-09-12T00:21:13.572 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: crc 2024-09-12T00:21:13.572 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: crc 2024-09-12T00:21:13.572 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: secure 2024-09-12T00:21:13.572 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: crc 2024-09-12T00:21:13.573 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: secure 2024-09-12T00:21:13.573 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: crc 2024-09-12T00:21:13.573 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad30630) adding con mode: secure 2024-09-12T00:21:13.573 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.573 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 10 monclient: init 2024-09-12T00:21:13.573 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding auth protocol: cephx 2024-09-12T00:21:13.573 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding auth protocol: cephx 2024-09-12T00:21:13.573 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding auth protocol: cephx 2024-09-12T00:21:13.573 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: secure 2024-09-12T00:21:13.573 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: crc 2024-09-12T00:21:13.573 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: secure 2024-09-12T00:21:13.573 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: crc 2024-09-12T00:21:13.573 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: secure 2024-09-12T00:21:13.573 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: crc 2024-09-12T00:21:13.574 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: crc 2024-09-12T00:21:13.574 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: secure 2024-09-12T00:21:13.574 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: crc 2024-09-12T00:21:13.574 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: secure 2024-09-12T00:21:13.574 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: crc 2024-09-12T00:21:13.574 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca918d0) adding con mode: secure 2024-09-12T00:21:13.574 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:21:13.225+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.574 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.574 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command rotate-key cmddesc rotate-key hook 0x7ffdbca91a18 EEXIST 2024-09-12T00:21:13.574 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:13.574 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:21:13.574 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-c con 0x55ad9ad64c30 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:13.575 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-b con 0x55ad9ad55580 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:13.575 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-a con 0x55ad9ad60060 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:13.575 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.575 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.575 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.575 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:13.575 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient(hunting): authenticate will time out at 1950.482214s 2024-09-12T00:21:13.575 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): get_auth_request con 0x55ad9ad64c30 auth_method 0 2024-09-12T00:21:13.575 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.575 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.575 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.575 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:21:13.226+0000 7f41a10a3640 10 monclient(hunting): get_auth_request con 0x55ad9ad60060 auth_method 0 2024-09-12T00:21:13.576 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:21:13.226+0000 7f41a10a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.576 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:21:13.226+0000 7f41a10a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.576 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:21:13.226+0000 7f41a10a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.576 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.576 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.576 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.576 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:21:13.226+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.576 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:21:13.226+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.576 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:21:13.226+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.576 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:21:13.226+0000 7f41a00a1640 10 monclient(hunting): get_auth_request con 0x55ad9ad55580 auth_method 0 2024-09-12T00:21:13.576 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:21:13.226+0000 7f41a00a1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.576 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:21:13.226+0000 7f41a00a1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.577 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:21:13.226+0000 7f41a00a1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.577 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient(hunting): handle_auth_done global_id 7073 payload 274 2024-09-12T00:21:13.577 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient: _finish_hunting 0 2024-09-12T00:21:13.577 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:21:13.226+0000 7f41a08a2640 1 monclient: found mon.noname-c 2024-09-12T00:21:13.577 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:21:13.226+0000 7f41a08a2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.577 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.577 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:13.577 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: dump: 2024-09-12T00:21:13.577 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.577 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.577 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.577 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.578 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.578 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.578 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.578 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.578 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.578 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.578 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: _finish_auth 0 2024-09-12T00:21:13.578 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: _check_auth_tickets 2024-09-12T00:21:13.578 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 5 monclient: authenticate success, global_id 7073 2024-09-12T00:21:13.578 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:13.578 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 10 monclient: get_monmap_and_config success 2024-09-12T00:21:13.578 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:21:13.226+0000 7f41a4b1f800 4 set_mon_vals no callback set 2024-09-12T00:21:13.578 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.579 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:13.579 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:21:13.226+0000 7f4077fff640 10 monclient: dump: 2024-09-12T00:21:13.579 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.579 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.579 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.579 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.579 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.579 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.579 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.579 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.579 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.579 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.579 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 10 monclient: shutdown 2024-09-12T00:21:13.580 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 10 monclient: build_initial_monmap 2024-09-12T00:21:13.580 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 1 build_initial for_mkfs: 0 2024-09-12T00:21:13.580 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 10 monclient: monmap: 2024-09-12T00:21:13.580 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:13.580 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:13.580 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:13.580 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:13.580 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:13.580 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.580 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:13.580 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:13.580 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:13.581 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.581 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding auth protocol: cephx 2024-09-12T00:21:13.581 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding auth protocol: cephx 2024-09-12T00:21:13.581 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding auth protocol: cephx 2024-09-12T00:21:13.581 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: secure 2024-09-12T00:21:13.581 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: crc 2024-09-12T00:21:13.581 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: secure 2024-09-12T00:21:13.581 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: crc 2024-09-12T00:21:13.581 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: secure 2024-09-12T00:21:13.581 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: crc 2024-09-12T00:21:13.581 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: crc 2024-09-12T00:21:13.581 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: secure 2024-09-12T00:21:13.581 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: crc 2024-09-12T00:21:13.582 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: secure 2024-09-12T00:21:13.582 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: crc 2024-09-12T00:21:13.582 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad34190) adding con mode: secure 2024-09-12T00:21:13.582 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.582 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 1 librados: starting msgr at 2024-09-12T00:21:13.582 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 1 librados: starting objecter 2024-09-12T00:21:13.582 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:21:13.227+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command objecter_requests cmddesc objecter_requests hook 0x55ad9ad10f80 EEXIST 2024-09-12T00:21:13.582 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 1 librados: setting wanted keys 2024-09-12T00:21:13.582 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 1 librados: calling monclient init 2024-09-12T00:21:13.582 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient: init 2024-09-12T00:21:13.582 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding auth protocol: cephx 2024-09-12T00:21:13.582 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding auth protocol: cephx 2024-09-12T00:21:13.582 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding auth protocol: cephx 2024-09-12T00:21:13.582 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: secure 2024-09-12T00:21:13.583 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: crc 2024-09-12T00:21:13.583 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: secure 2024-09-12T00:21:13.583 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: crc 2024-09-12T00:21:13.583 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: secure 2024-09-12T00:21:13.583 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: crc 2024-09-12T00:21:13.583 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: crc 2024-09-12T00:21:13.583 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: secure 2024-09-12T00:21:13.583 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: crc 2024-09-12T00:21:13.583 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: secure 2024-09-12T00:21:13.583 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: crc 2024-09-12T00:21:13.583 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 AuthRegistry(0x55ad9ad286b0) adding con mode: secure 2024-09-12T00:21:13.583 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.583 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.583 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command rotate-key cmddesc rotate-key hook 0x55ad9ad287f8 EEXIST 2024-09-12T00:21:13.584 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:13.584 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:21:13.584 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-c con 0x55ad9ad55580 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:13.584 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-b con 0x55ad9ad60060 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:13.584 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): picked mon.noname-a con 0x55ad9ad64c30 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:13.584 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.584 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.584 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:13.584 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:13.584 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:21:13.228+0000 7f41a4b1f800 10 monclient(hunting): authenticate will time out at 1950.484578s 2024-09-12T00:21:13.584 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): get_auth_request con 0x55ad9ad55580 auth_method 0 2024-09-12T00:21:13.584 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.584 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.585 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.585 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:21:13.228+0000 7f41a10a3640 10 monclient(hunting): get_auth_request con 0x55ad9ad64c30 auth_method 0 2024-09-12T00:21:13.585 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:21:13.228+0000 7f41a10a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:13.585 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:21:13.228+0000 7f41a10a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:13.585 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:21:13.228+0000 7f41a10a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:13.585 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.585 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.585 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.585 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:21:13.228+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:13.585 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:21:13.228+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:13.585 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:21:13.228+0000 7f41a10a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:13.585 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient(hunting): handle_auth_done global_id 7076 payload 824 2024-09-12T00:21:13.585 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient: _finish_hunting 0 2024-09-12T00:21:13.585 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:21:13.228+0000 7f41a08a2640 1 monclient: found mon.noname-c 2024-09-12T00:21:13.585 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:21:13.228+0000 7f41a08a2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.586 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.586 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:13.586 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: dump: 2024-09-12T00:21:13.586 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.586 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.586 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.586 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.586 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.586 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.586 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.586 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.586 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.587 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.587 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: _finish_auth 0 2024-09-12T00:21:13.587 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: _check_auth_tickets 2024-09-12T00:21:13.587 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:13.587 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:13.587 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:13.587 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:21:13.229+0000 7f40767fc640 10 monclient: dump: 2024-09-12T00:21:13.587 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:13.587 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:13.587 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.587 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:13.587 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:13.587 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:13.588 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:13.588 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:13.588 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:13.588 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.588 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:21:13.229+0000 7f41a4b1f800 5 monclient: authenticate success, global_id 7076 2024-09-12T00:21:13.588 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:21:13.229+0000 7f41a4b1f800 10 monclient: _renew_subs 2024-09-12T00:21:13.588 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:21:13.229+0000 7f4077fff640 4 set_mon_vals no callback set 2024-09-12T00:21:13.588 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:21:13.229+0000 7f41a4b1f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.588 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:21:13.229+0000 7f41a4b1f800 10 monclient: _renew_subs 2024-09-12T00:21:13.588 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:21:13.229+0000 7f41a4b1f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.588 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:21:13.229+0000 7f41a4b1f800 1 librados: init done 2024-09-12T00:21:13.588 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:21:13.229+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command cr dump hook 0x55ad9ad55478 2024-09-12T00:21:13.589 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:21:13.231+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.589 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:21:13.231+0000 7f40767fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:21:13.589 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:21:13.231+0000 7f40767fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:13.589 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:21:13.231+0000 7f40767fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:13.589 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:21:13.232+0000 7f41a00a1640 10 monclient: get_auth_request con 0x7f406c076470 auth_method 0 2024-09-12T00:21:13.589 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:21:13.232+0000 7f41a10a3640 10 monclient: get_auth_request con 0x55ad9ad7f300 auth_method 0 2024-09-12T00:21:13.589 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:21:13.232+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.589 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:21:13.232+0000 7f41a4b1f800 20 realm 2024-09-12T00:21:13.589 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:21:13.232+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.589 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:21:13.233+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.589 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:21:13.233+0000 7f41a4b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:13.589 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:21:13.233+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.589 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:21:13.233+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.590 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:21:13.233+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.590 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:21:13.233+0000 7f41a08a2640 10 monclient: get_auth_request con 0x55ad9ad83520 auth_method 0 2024-09-12T00:21:13.590 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:21:13.233+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:13.590 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:21:13.234+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.590 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:21:13.234+0000 7f41a00a1640 10 monclient: get_auth_request con 0x55ad9ad86d80 auth_method 0 2024-09-12T00:21:13.590 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:21:13.234+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:13.590 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:21:13.234+0000 7f41a4b1f800 20 searching for the correct realm 2024-09-12T00:21:13.590 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:21:13.235+0000 7f41a10a3640 10 monclient: get_auth_request con 0x7f419403cb00 auth_method 0 2024-09-12T00:21:13.590 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:21:13.236+0000 7f41a08a2640 10 monclient: get_auth_request con 0x7f41900a0060 auth_method 0 2024-09-12T00:21:13.590 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:21:13.237+0000 7f41a00a1640 10 monclient: get_auth_request con 0x7f4194021940 auth_method 0 2024-09-12T00:21:13.590 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:21:13.237+0000 7f41a00a1640 0 -- 172.21.15.67:0/1835061712 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f4194021940 msgr2=0x7f4194008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:13.590 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:21:13.439+0000 7f41a00a1640 10 monclient: get_auth_request con 0x7f4194021940 auth_method 0 2024-09-12T00:21:13.590 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:21:13.441+0000 7f41a10a3640 10 monclient: get_auth_request con 0x7f4190096070 auth_method 0 2024-09-12T00:21:13.590 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:21:13.442+0000 7f41a08a2640 10 monclient: get_auth_request con 0x7f4198089ed0 auth_method 0 2024-09-12T00:21:13.591 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:21:13.443+0000 7f41a10a3640 0 -- 172.21.15.67:0/1835061712 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55ad9ad7f300 msgr2=0x55ad9ad81770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:13.591 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:21:13.443+0000 7f40767fc640 1 client.7076.objecter ms_handle_reset 0x55ad9ad7f300 session 0x55ad9ad7ec30 osd.6 2024-09-12T00:21:13.591 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:21:13.443+0000 7f40767fc640 10 monclient: _renew_subs 2024-09-12T00:21:13.591 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:21:13.443+0000 7f40767fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:13.591 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:21:13.443+0000 7f41a10a3640 10 monclient: get_auth_request con 0x7f406c086790 auth_method 0 2024-09-12T00:21:13.591 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:13.591 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:13.591 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:13.591 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:13.591 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:13.591 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:13.591 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.591 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.591 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.592 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:13.592 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.592 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:13.592 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 zone default found 2024-09-12T00:21:13.592 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 4 Realm: () 2024-09-12T00:21:13.592 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:13.592 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:13.592 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:13.592 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 zonegroup default 2024-09-12T00:21:13.592 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:21:13.447+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.592 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.592 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.592 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.593 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.593 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.593 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 started sync module instance, tier type = 2024-09-12T00:21:13.593 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:21:13.448+0000 7f41a4b1f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:13.593 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=0 2024-09-12T00:21:13.593 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=1 2024-09-12T00:21:13.593 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=2 2024-09-12T00:21:13.593 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=3 2024-09-12T00:21:13.593 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=4 2024-09-12T00:21:13.593 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=5 2024-09-12T00:21:13.593 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:21:13.458+0000 7f41a4b1f800 20 add_watcher() i=6 2024-09-12T00:21:13.593 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:21:13.459+0000 7f41a4b1f800 20 add_watcher() i=7 2024-09-12T00:21:13.593 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:21:13.459+0000 7f41a4b1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:13.593 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding auth protocol: cephx 2024-09-12T00:21:13.593 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding auth protocol: cephx 2024-09-12T00:21:13.594 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding auth protocol: cephx 2024-09-12T00:21:13.594 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: secure 2024-09-12T00:21:13.594 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: crc 2024-09-12T00:21:13.594 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: secure 2024-09-12T00:21:13.594 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: crc 2024-09-12T00:21:13.594 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: secure 2024-09-12T00:21:13.594 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: crc 2024-09-12T00:21:13.594 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: crc 2024-09-12T00:21:13.594 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: secure 2024-09-12T00:21:13.594 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: crc 2024-09-12T00:21:13.594 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: secure 2024-09-12T00:21:13.594 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: crc 2024-09-12T00:21:13.594 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:21:13.460+0000 7f41a4b1f800 5 AuthRegistry(0x7ffdbca91db0) adding con mode: secure 2024-09-12T00:21:13.594 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:21:13.460+0000 7f4056fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:13.594 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:13.595 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:13.595 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:13.595 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command cache list hook 0x55ad9ad720c0 2024-09-12T00:21:13.595 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command cache inspect hook 0x55ad9ad720c0 2024-09-12T00:21:13.595 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command cache erase hook 0x55ad9ad720c0 2024-09-12T00:21:13.595 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command cache zap hook 0x55ad9ad720c0 2024-09-12T00:21:13.595 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 note: GC not initialized 2024-09-12T00:21:13.595 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:21:13.461+0000 7f4055fe3640 20 reqs_thread_entry: start 2024-09-12T00:21:13.595 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command sync trace show hook 0x7f4190058f00 2024-09-12T00:21:13.595 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command sync trace history hook 0x7f4190058f00 2024-09-12T00:21:13.595 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command sync trace active hook 0x7f4190058f00 2024-09-12T00:21:13.595 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 5 asok(0x55ad9aa74630) register_command sync trace active_short hook 0x7f4190058f00 2024-09-12T00:21:13.595 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:13.595 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 20 Filter name: none 2024-09-12T00:21:13.595 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:21:13.461+0000 7f3fc77fe640 20 reqs_thread_entry: start 2024-09-12T00:21:13.596 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:21:13.596 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:21:13.461+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.596 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:13.596 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:21:13.596 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:21:13.596 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 : miss 2024-09-12T00:21:13.596 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.596 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:21:13.596 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:13.596 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:13.596 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:21:13.596 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:13.596 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:21:13.462+0000 7f41a4b1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 2024-09-12T00:21:13.596 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:21:13.465+0000 7f41a4b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:13.597 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:21:13.465+0000 7f41a4b1f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:13.597 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:21:13.465+0000 7f41a4b1f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:13.597 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:21:13.465+0000 7f41a4b1f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34, ofs0, ns] 2024-09-12T00:21:13.597 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:21:13.466+0000 7f4077fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562391 cookie 94204115599056 notifier 7076 bl.length()=911 2024-09-12T00:21:13.597 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:21:13.466+0000 7f4077fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:13.597 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:21:13.466+0000 7f4077fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:13.597 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:21:13.466+0000 7f4077fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:13.597 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:21:13.466+0000 7f41a4b1f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): orig_sources= new_sources= 2024-09-12T00:21:13.597 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:21:13.466+0000 7f41a4b1f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): potential sources added=[] removed=[] 2024-09-12T00:21:13.597 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:21:13.466+0000 7f41a4b1f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): orig_dests= new_dests= 2024-09-12T00:21:13.597 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:21:13.466+0000 7f41a4b1f800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): potential dests added=[] removed=[] 2024-09-12T00:21:13.597 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:21:13.469+0000 7f41a4b1f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f41a4b1f800 time 2024-09-12T00:21:13.469551+0000 2024-09-12T00:21:13.597 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:21:13.598 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.598 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:13.598 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f41a638c71a] 2024-09-12T00:21:13.598 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f41a638c8d8] 2024-09-12T00:21:13.598 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ad981a5641] 2024-09-12T00:21:13.598 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ad981b538a] 2024-09-12T00:21:13.598 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:21:13.598 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f41a5029590] 2024-09-12T00:21:13.598 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:21:13.598 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:21:13.598 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.598 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:21:13.470+0000 7f41a4b1f800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:21:13.599 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f41a4b1f800 thread_name:radosgw-admin 2024-09-12T00:21:13.599 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.599 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:13.599 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f41a503e6f0] 2024-09-12T00:21:13.599 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f41a508b99c] 2024-09-12T00:21:13.599 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:21:13.599 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:21:13.599 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f41a638c774] 2024-09-12T00:21:13.599 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f41a638c8d8] 2024-09-12T00:21:13.599 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ad981a5641] 2024-09-12T00:21:13.599 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ad981b538a] 2024-09-12T00:21:13.599 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:21:13.599 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f41a5029590] 2024-09-12T00:21:13.599 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:21:13.599 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:21:13.600 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:21:13.600 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.600 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:21:13.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:21:13.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:21:13.600 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:21:13.600 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:21:13.600 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:21:13.600 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:21:13.600 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:21:13.600 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:21:13.600 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:21:13.600 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:21:13.600 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:21:13.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:21:13.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:21:13.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:21:13.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:21:13.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:21:13.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:21:13.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:21:13.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:21:13.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:21:13.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:21:13.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:21:13.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:21:13.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:21:13.601 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:21:13.601 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:21:13.602 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:21:13.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:21:13.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:21:13.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:21:13.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:21:13.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:21:13.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:21:13.603 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:21:13.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:21:13.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:21:13.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:21:13.603 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:21:13.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:21:13.603 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:21:13.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:21:13.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:21:13.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:21:13.604 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:21:13.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:21:13.604 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:21:13.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:21:13.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:21:13.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:21:13.604 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:21:13.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:21:13.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:21:13.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:21:13.604 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:21:13.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:21:13.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:21:13.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:21:13.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:21:13.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:21:13.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:21:13.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:21:13.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:21:13.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:21:13.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:21:13.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:21:13.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:21:13.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:21:13.605 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:21:13.606 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:21:13.606 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:21:13.606 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:21:13.606 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:21:13.606 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:21:13.606 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:21:13.606 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:21:13.606 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:21:13.606 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:21:13.606 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:21:13.606 INFO:tasks.workunit.client.0.smithi067.stderr: 7f3fc77fe640 / http_manager 2024-09-12T00:21:13.606 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4055fe3640 / http_manager 2024-09-12T00:21:13.606 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4056fe5640 / rgw_dt_lg_renew 2024-09-12T00:21:13.606 INFO:tasks.workunit.client.0.smithi067.stderr: 7f40767fc640 / ms_dispatch 2024-09-12T00:21:13.607 INFO:tasks.workunit.client.0.smithi067.stderr: 7f4077fff640 / io_context_pool 2024-09-12T00:21:13.607 INFO:tasks.workunit.client.0.smithi067.stderr: 7f40867fc640 / ms_dispatch 2024-09-12T00:21:13.607 INFO:tasks.workunit.client.0.smithi067.stderr: 7f408d60a640 / ms_dispatch 2024-09-12T00:21:13.607 INFO:tasks.workunit.client.0.smithi067.stderr: 7f408ee0d640 / io_context_pool 2024-09-12T00:21:13.607 INFO:tasks.workunit.client.0.smithi067.stderr: 7f41a00a1640 / msgr-worker-2 2024-09-12T00:21:13.607 INFO:tasks.workunit.client.0.smithi067.stderr: 7f41a08a2640 / msgr-worker-1 2024-09-12T00:21:13.607 INFO:tasks.workunit.client.0.smithi067.stderr: 7f41a10a3640 / msgr-worker-0 2024-09-12T00:21:13.607 INFO:tasks.workunit.client.0.smithi067.stderr: 7f41a18a4640 / io_context_pool 2024-09-12T00:21:13.607 INFO:tasks.workunit.client.0.smithi067.stderr: 7f41a4b1f800 / radosgw-admin 2024-09-12T00:21:13.607 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:21:13.607 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:21:13.607 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:21:13.470935Z_30e10a44-ff4f-4d22-800f-7c405e3c182e/log 2024-09-12T00:21:13.608 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:21:13.608 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:21:13.609 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:13.609 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:13.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.548+0000 7f244bebb800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.550+0000 7f244bebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.550+0000 7f244bebb800 20 realm 2024-09-12T00:21:13.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.550+0000 7f244bebb800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.550+0000 7f244bebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.550+0000 7f244bebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:13.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.550+0000 7f244bebb800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.550+0000 7f244bebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.550+0000 7f244bebb800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.551+0000 7f244bebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:13.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.551+0000 7f244bebb800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.552+0000 7f244bebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:13.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.552+0000 7f244bebb800 20 searching for the correct realm 2024-09-12T00:21:13.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.554+0000 7f24491a4640 0 -- 172.21.15.67:0/1352012306 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f24400693c0 msgr2=0x7f244007e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:13.758 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.759+0000 7f244a1a6640 0 -- 172.21.15.67:0/1352012306 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55cc9fe057b0 msgr2=0x55cc9fe07c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:13.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.763+0000 7f244bebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:13.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.763+0000 7f244bebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:13.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.763+0000 7f244bebb800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:13.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.763+0000 7f244bebb800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:13.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.763+0000 7f244bebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:13.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.763+0000 7f244bebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:13.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.763+0000 7f244bebb800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.764+0000 7f244bebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.762 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.764+0000 7f244bebb800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.764+0000 7f244bebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:13.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.764+0000 7f244bebb800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.764+0000 7f244bebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:13.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.764+0000 7f244bebb800 20 zone default found 2024-09-12T00:21:13.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.764+0000 7f244bebb800 4 Realm: () 2024-09-12T00:21:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.764+0000 7f244bebb800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.764+0000 7f244bebb800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.764+0000 7f244bebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.764+0000 7f244bebb800 20 zonegroup default 2024-09-12T00:21:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.764+0000 7f244bebb800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.765+0000 7f244bebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.765+0000 7f244bebb800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.765+0000 7f244bebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.765+0000 7f244bebb800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.765+0000 7f244bebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.765+0000 7f244bebb800 20 started sync module instance, tier type = 2024-09-12T00:21:13.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.765+0000 7f244bebb800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:13.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.774+0000 7f244bebb800 20 add_watcher() i=0 2024-09-12T00:21:13.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.774+0000 7f244bebb800 20 add_watcher() i=1 2024-09-12T00:21:13.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.774+0000 7f244bebb800 20 add_watcher() i=2 2024-09-12T00:21:13.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.774+0000 7f244bebb800 20 add_watcher() i=3 2024-09-12T00:21:13.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.774+0000 7f244bebb800 20 add_watcher() i=4 2024-09-12T00:21:13.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.774+0000 7f244bebb800 20 add_watcher() i=5 2024-09-12T00:21:13.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.774+0000 7f244bebb800 20 add_watcher() i=6 2024-09-12T00:21:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.775+0000 7f244bebb800 20 add_watcher() i=7 2024-09-12T00:21:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.775+0000 7f244bebb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.776+0000 7f22fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.777+0000 7f244bebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.777+0000 7f244bebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.777+0000 7f244bebb800 5 note: GC not initialized 2024-09-12T00:21:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.777+0000 7f22fa7fc640 20 reqs_thread_entry: start 2024-09-12T00:21:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.777+0000 7f244bebb800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.777+0000 7f244bebb800 20 Filter name: none 2024-09-12T00:21:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.777+0000 7f226bfff640 20 reqs_thread_entry: start 2024-09-12T00:21:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.777+0000 7f244bebb800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.778+0000 7f244bebb800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.778+0000 7f244bebb800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.778+0000 7f244bebb800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:21:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.778+0000 7f244bebb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.778+0000 7f244bebb800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.778+0000 7f244bebb800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:13.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.779+0000 7f244bebb800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.779+0000 7f244bebb800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:21:13.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.779+0000 7f244bebb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:13.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.780+0000 7f22fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:13.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.782+0000 7f244bebb800 20 remove_watcher() i=0 2024-09-12T00:21:13.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.782+0000 7f244bebb800 2 removed watcher, disabling cache 2024-09-12T00:21:13.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.783+0000 7f244bebb800 20 remove_watcher() i=1 2024-09-12T00:21:13.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.784+0000 7f244bebb800 20 remove_watcher() i=2 2024-09-12T00:21:13.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.786+0000 7f244bebb800 20 remove_watcher() i=3 2024-09-12T00:21:13.785 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.787+0000 7f244bebb800 20 remove_watcher() i=4 2024-09-12T00:21:13.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.788+0000 7f244bebb800 20 remove_watcher() i=5 2024-09-12T00:21:13.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.789+0000 7f244bebb800 20 remove_watcher() i=6 2024-09-12T00:21:13.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.790+0000 7f244bebb800 20 remove_watcher() i=7 2024-09-12T00:21:13.799 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.800 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:21:13.800 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-do-reshard id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:21:13.800 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:13.852 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:21:13.885 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:13.885 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:13.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.925+0000 7f1cd3336800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.927+0000 7f1cd3336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.927+0000 7f1cd3336800 20 realm 2024-09-12T00:21:13.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.927+0000 7f1cd3336800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.927+0000 7f1cd3336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.927+0000 7f1cd3336800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:13.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.927+0000 7f1cd3336800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.927+0000 7f1cd3336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:13.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.927+0000 7f1cd3336800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.928+0000 7f1cd3336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:13.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.928+0000 7f1cd3336800 20 rados->read ofs=0 len=0 2024-09-12T00:21:13.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.929+0000 7f1cd3336800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:13.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.929+0000 7f1cd3336800 20 searching for the correct realm 2024-09-12T00:21:13.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:13.932+0000 7f1cce8b6640 0 -- 172.21.15.67:0/2937384921 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f1cc407b950 msgr2=0x7f1cc4064440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:14.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.137+0000 7f1ccf8b8640 0 -- 172.21.15.67:0/2937384921 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55ee0b9fff20 msgr2=0x55ee0ba023e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:14.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.141+0000 7f1cd3336800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:14.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.141+0000 7f1cd3336800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:14.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.141+0000 7f1cd3336800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:14.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.141+0000 7f1cd3336800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:14.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.141+0000 7f1cd3336800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:14.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.141+0000 7f1cd3336800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:14.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.141+0000 7f1cd3336800 20 rados->read ofs=0 len=0 2024-09-12T00:21:14.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.142+0000 7f1cd3336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:14.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.142+0000 7f1cd3336800 20 rados->read ofs=0 len=0 2024-09-12T00:21:14.141 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.142+0000 7f1cd3336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:14.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.142+0000 7f1cd3336800 20 rados->read ofs=0 len=0 2024-09-12T00:21:14.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.142+0000 7f1cd3336800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:14.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.142+0000 7f1cd3336800 20 zone default found 2024-09-12T00:21:14.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.142+0000 7f1cd3336800 4 Realm: () 2024-09-12T00:21:14.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.142+0000 7f1cd3336800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:14.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.142+0000 7f1cd3336800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:14.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.142+0000 7f1cd3336800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:14.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.142+0000 7f1cd3336800 20 zonegroup default 2024-09-12T00:21:14.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.142+0000 7f1cd3336800 20 rados->read ofs=0 len=0 2024-09-12T00:21:14.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.142+0000 7f1cd3336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:14.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.142+0000 7f1cd3336800 20 rados->read ofs=0 len=0 2024-09-12T00:21:14.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.143+0000 7f1cd3336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:14.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.143+0000 7f1cd3336800 20 rados->read ofs=0 len=0 2024-09-12T00:21:14.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.143+0000 7f1cd3336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:14.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.143+0000 7f1cd3336800 20 started sync module instance, tier type = 2024-09-12T00:21:14.143 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.143+0000 7f1cd3336800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:14.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.152+0000 7f1cd3336800 20 add_watcher() i=0 2024-09-12T00:21:14.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.152+0000 7f1cd3336800 20 add_watcher() i=1 2024-09-12T00:21:14.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.152+0000 7f1cd3336800 20 add_watcher() i=2 2024-09-12T00:21:14.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.152+0000 7f1cd3336800 20 add_watcher() i=3 2024-09-12T00:21:14.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.152+0000 7f1cd3336800 20 add_watcher() i=4 2024-09-12T00:21:14.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.152+0000 7f1cd3336800 20 add_watcher() i=5 2024-09-12T00:21:14.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.152+0000 7f1cd3336800 20 add_watcher() i=6 2024-09-12T00:21:14.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.153+0000 7f1cd3336800 20 add_watcher() i=7 2024-09-12T00:21:14.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.153+0000 7f1cd3336800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:14.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.155+0000 7f1b85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.155+0000 7f1cd3336800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:14.155 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.155+0000 7f1cd3336800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:14.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.155+0000 7f1cd3336800 5 note: GC not initialized 2024-09-12T00:21:14.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.156+0000 7f1b84fe1640 20 reqs_thread_entry: start 2024-09-12T00:21:14.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.156+0000 7f1cd3336800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:14.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.156+0000 7f1cd3336800 20 Filter name: none 2024-09-12T00:21:14.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.156+0000 7f1afe7fc640 20 reqs_thread_entry: start 2024-09-12T00:21:14.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.156+0000 7f1cd3336800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:21:14.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.156+0000 7f1cd3336800 20 rados->read ofs=0 len=0 2024-09-12T00:21:14.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.156+0000 7f1cd3336800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:14.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.156+0000 7f1cd3336800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:21:14.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.156+0000 7f1cd3336800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:21:14.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.156+0000 7f1cd3336800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 : miss 2024-09-12T00:21:14.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.156+0000 7f1cd3336800 20 rados->read ofs=0 len=0 2024-09-12T00:21:14.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.157+0000 7f1cd3336800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:21:14.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.157+0000 7f1cd3336800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:14.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.157+0000 7f1cd3336800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:14.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.157+0000 7f1cd3336800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:21:14.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.157+0000 7f1cd3336800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:14.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.157+0000 7f1cd3336800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 2024-09-12T00:21:14.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.158+0000 7f1cd3336800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to be held by another RGW process; skipping for now 2024-09-12T00:21:14.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.159+0000 7f1b85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:14.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.161+0000 7f1cd3336800 20 remove_watcher() i=0 2024-09-12T00:21:14.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.161+0000 7f1cd3336800 2 removed watcher, disabling cache 2024-09-12T00:21:14.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.162+0000 7f1cd3336800 20 remove_watcher() i=1 2024-09-12T00:21:14.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.163+0000 7f1cd3336800 20 remove_watcher() i=2 2024-09-12T00:21:14.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.164+0000 7f1cd3336800 20 remove_watcher() i=3 2024-09-12T00:21:14.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.165+0000 7f1cd3336800 20 remove_watcher() i=4 2024-09-12T00:21:14.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.166+0000 7f1cd3336800 20 remove_watcher() i=5 2024-09-12T00:21:14.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.167+0000 7f1cd3336800 20 remove_watcher() i=6 2024-09-12T00:21:14.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:14.168+0000 7f1cd3336800 20 remove_watcher() i=7 2024-09-12T00:21:14.177 INFO:tasks.workunit.client.0.smithi067.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:21:44.211 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:21:44.247 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:44.247 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:44.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.293+0000 7f022c498800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.295+0000 7f022c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:44.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.295+0000 7f022c498800 20 realm 2024-09-12T00:21:44.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.295+0000 7f022c498800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.295+0000 7f022c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:44.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.295+0000 7f022c498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:44.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.295+0000 7f022c498800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.296+0000 7f022c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:44.295 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.296+0000 7f022c498800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.296+0000 7f022c498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:44.296 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.296+0000 7f022c498800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.298+0000 7f022c498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:44.297 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.298+0000 7f022c498800 20 searching for the correct realm 2024-09-12T00:21:44.301 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.302+0000 7f0229f82640 0 -- 172.21.15.67:0/3740218271 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f021c038060 msgr2=0x7f021c067400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:44.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.306+0000 7f0229f82640 0 -- 172.21.15.67:0/3740218271 >> [v2:172.21.15.67:6800/2522402523,v1:172.21.15.67:6801/2522402523] conn(0x5603be11a0f0 msgr2=0x5603be11c520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:44.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.309+0000 7f022c498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:44.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.309+0000 7f022c498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:44.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.309+0000 7f022c498800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:44.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.309+0000 7f022c498800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:44.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.309+0000 7f022c498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:44.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.309+0000 7f022c498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:44.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.309+0000 7f022c498800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.310+0000 7f022c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:44.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.310+0000 7f022c498800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.310+0000 7f022c498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:44.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.310+0000 7f022c498800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.310+0000 7f022c498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:44.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.310+0000 7f022c498800 20 zone default found 2024-09-12T00:21:44.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.310+0000 7f022c498800 4 Realm: () 2024-09-12T00:21:44.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.310+0000 7f022c498800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:44.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.310+0000 7f022c498800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:44.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.310+0000 7f022c498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:44.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.310+0000 7f022c498800 20 zonegroup default 2024-09-12T00:21:44.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.310+0000 7f022c498800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.311+0000 7f022c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:44.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.311+0000 7f022c498800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.311+0000 7f022c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:44.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.311+0000 7f022c498800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.312+0000 7f022c498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:44.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.312+0000 7f022c498800 20 started sync module instance, tier type = 2024-09-12T00:21:44.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.312+0000 7f022c498800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:44.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.322+0000 7f022c498800 20 add_watcher() i=0 2024-09-12T00:21:44.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.322+0000 7f022c498800 20 add_watcher() i=1 2024-09-12T00:21:44.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.322+0000 7f022c498800 20 add_watcher() i=2 2024-09-12T00:21:44.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.322+0000 7f022c498800 20 add_watcher() i=3 2024-09-12T00:21:44.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.322+0000 7f022c498800 20 add_watcher() i=4 2024-09-12T00:21:44.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.322+0000 7f022c498800 20 add_watcher() i=5 2024-09-12T00:21:44.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.322+0000 7f022c498800 20 add_watcher() i=6 2024-09-12T00:21:44.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.323+0000 7f022c498800 20 add_watcher() i=7 2024-09-12T00:21:44.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.323+0000 7f022c498800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:44.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.326+0000 7f00db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:44.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.327+0000 7f022c498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:44.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.327+0000 7f022c498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:44.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.327+0000 7f022c498800 5 note: GC not initialized 2024-09-12T00:21:44.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.327+0000 7f00da7fc640 20 reqs_thread_entry: start 2024-09-12T00:21:44.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.327+0000 7f022c498800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:44.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.327+0000 7f022c498800 20 Filter name: none 2024-09-12T00:21:44.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.327+0000 7f004bfff640 20 reqs_thread_entry: start 2024-09-12T00:21:44.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.327+0000 7f022c498800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:21:44.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.327+0000 7f022c498800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.328+0000 7f022c498800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:44.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.328+0000 7f022c498800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:21:44.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.328+0000 7f022c498800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:21:44.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.328+0000 7f022c498800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 : miss 2024-09-12T00:21:44.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.328+0000 7f022c498800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.328+0000 7f022c498800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:21:44.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.328+0000 7f022c498800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:44.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.328+0000 7f022c498800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:44.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.328+0000 7f022c498800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:21:44.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.328+0000 7f022c498800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:44.329 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.328+0000 7f022c498800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 2024-09-12T00:21:44.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.330+0000 7f022c498800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:21:44.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.334+0000 7f022c498800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:44.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.334+0000 7f022c498800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:44.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.334+0000 7f022c498800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:44.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.334+0000 7f022c498800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34, ofs0, ns] 2024-09-12T00:21:44.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.334+0000 7f010d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562392 cookie 94574073752480 notifier 7127 bl.length()=911 2024-09-12T00:21:44.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.334+0000 7f010d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:44.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.334+0000 7f010d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:44.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.334+0000 7f010d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:44.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.335+0000 7f022c498800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): orig_sources= new_sources= 2024-09-12T00:21:44.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.335+0000 7f022c498800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): potential sources added=[] removed=[] 2024-09-12T00:21:44.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.335+0000 7f022c498800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): orig_dests= new_dests= 2024-09-12T00:21:44.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.335+0000 7f022c498800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): potential dests added=[] removed=[] 2024-09-12T00:21:44.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.339+0000 7f022c498800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34.2.0 2024-09-12T00:21:44.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.339+0000 7f022c498800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34.2.0 2024-09-12T00:21:44.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.339+0000 7f022c498800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34.2.1 2024-09-12T00:21:44.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.339+0000 7f022c498800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34.2.1 2024-09-12T00:21:44.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.339+0000 7f022c498800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34.0 2024-09-12T00:21:44.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.342+0000 7f022c498800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:21:44.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.342+0000 7f022c498800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 2024-09-12T00:21:44.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.343+0000 7f022c498800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:44.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.343+0000 7f022c498800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:44.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.343+0000 7f022c498800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:44.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.343+0000 7f022c498800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34, ofs0, ns] 2024-09-12T00:21:44.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.343+0000 7f010cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562393 cookie 94574073752480 notifier 7127 bl.length()=911 2024-09-12T00:21:44.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.343+0000 7f010cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:44.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.343+0000 7f010cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:44.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.343+0000 7f010cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:44.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.344+0000 7f022c498800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): orig_sources= new_sources= 2024-09-12T00:21:44.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.344+0000 7f022c498800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): potential sources added=[] removed=[] 2024-09-12T00:21:44.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.344+0000 7f022c498800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): orig_dests= new_dests= 2024-09-12T00:21:44.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.344+0000 7f022c498800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): potential dests added=[] removed=[] 2024-09-12T00:21:44.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.345+0000 7f022c498800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34.0 2024-09-12T00:21:44.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.345+0000 7f022c498800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:21:44.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.345+0000 7f022c498800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 2024-09-12T00:21:44.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.347+0000 7f022c498800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:44.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.347+0000 7f022c498800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:44.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.347+0000 7f022c498800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:44.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.347+0000 7f022c498800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34, ofs0, ns] 2024-09-12T00:21:44.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.347+0000 7f010d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562394 cookie 94574073752480 notifier 7127 bl.length()=879 2024-09-12T00:21:44.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.347+0000 7f010d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 info.flags=0x17 2024-09-12T00:21:44.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.347+0000 7f010d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 to cache LRU end 2024-09-12T00:21:44.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.347+0000 7f010d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:44.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.347+0000 7f022c498800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): orig_sources= new_sources= 2024-09-12T00:21:44.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.347+0000 7f022c498800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): potential sources added=[] removed=[] 2024-09-12T00:21:44.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.347+0000 7f022c498800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): orig_dests= new_dests= 2024-09-12T00:21:44.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.347+0000 7f022c498800 20 handle_bi_update(): bucket=:abort-at-do-reshard[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34]): potential dests added=[] removed=[] 2024-09-12T00:21:44.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.349+0000 7f022c498800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T00:21:44.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.351+0000 7f00db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:44.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.353+0000 7f022c498800 20 remove_watcher() i=0 2024-09-12T00:21:44.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.353+0000 7f022c498800 2 removed watcher, disabling cache 2024-09-12T00:21:44.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.354+0000 7f022c498800 20 remove_watcher() i=1 2024-09-12T00:21:44.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.355+0000 7f022c498800 20 remove_watcher() i=2 2024-09-12T00:21:44.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.356+0000 7f022c498800 20 remove_watcher() i=3 2024-09-12T00:21:44.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.357+0000 7f022c498800 20 remove_watcher() i=4 2024-09-12T00:21:44.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.358+0000 7f022c498800 20 remove_watcher() i=5 2024-09-12T00:21:44.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.359+0000 7f022c498800 20 remove_watcher() i=6 2024-09-12T00:21:44.360 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.361+0000 7f022c498800 20 remove_watcher() i=7 2024-09-12T00:21:44.373 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:21:44.402 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:44.403 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:44.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.442+0000 7f66dad39800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.444+0000 7f66dad39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:44.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.444+0000 7f66dad39800 20 realm 2024-09-12T00:21:44.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.444+0000 7f66dad39800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.445+0000 7f66dad39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:44.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.445+0000 7f66dad39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:44.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.445+0000 7f66dad39800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.445+0000 7f66dad39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:44.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.445+0000 7f66dad39800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.446+0000 7f66dad39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:44.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.446+0000 7f66dad39800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.447+0000 7f66dad39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:44.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.447+0000 7f66dad39800 20 searching for the correct realm 2024-09-12T00:21:44.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.449+0000 7f66ce1c6640 0 -- 172.21.15.67:0/399205131 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f66c006c410 msgr2=0x7f66c006c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:44.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.655+0000 7f66ce1c6640 0 -- 172.21.15.67:0/399205131 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x564a5262ff00 msgr2=0x564a52632390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:44.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.660+0000 7f66dad39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:44.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.660+0000 7f66dad39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:44.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.660+0000 7f66dad39800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:44.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.660+0000 7f66dad39800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:44.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.660+0000 7f66dad39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:44.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.660+0000 7f66dad39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:44.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.660+0000 7f66dad39800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.660+0000 7f66dad39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:44.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.660+0000 7f66dad39800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.660+0000 7f66dad39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:44.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.661+0000 7f66dad39800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.661+0000 7f66dad39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:44.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.661+0000 7f66dad39800 20 zone default found 2024-09-12T00:21:44.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.661+0000 7f66dad39800 4 Realm: () 2024-09-12T00:21:44.661 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.661+0000 7f66dad39800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:44.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.661+0000 7f66dad39800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:44.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.661+0000 7f66dad39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:44.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.661+0000 7f66dad39800 20 zonegroup default 2024-09-12T00:21:44.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.661+0000 7f66dad39800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.661+0000 7f66dad39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:44.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.661+0000 7f66dad39800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.661+0000 7f66dad39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:44.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.661+0000 7f66dad39800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.662+0000 7f66dad39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:44.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.662+0000 7f66dad39800 20 started sync module instance, tier type = 2024-09-12T00:21:44.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.662+0000 7f66dad39800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:44.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.673+0000 7f66dad39800 20 add_watcher() i=0 2024-09-12T00:21:44.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.673+0000 7f66dad39800 20 add_watcher() i=1 2024-09-12T00:21:44.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.673+0000 7f66dad39800 20 add_watcher() i=2 2024-09-12T00:21:44.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.673+0000 7f66dad39800 20 add_watcher() i=3 2024-09-12T00:21:44.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.673+0000 7f66dad39800 20 add_watcher() i=4 2024-09-12T00:21:44.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.673+0000 7f66dad39800 20 add_watcher() i=5 2024-09-12T00:21:44.672 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.673+0000 7f66dad39800 20 add_watcher() i=6 2024-09-12T00:21:44.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.674+0000 7f66dad39800 20 add_watcher() i=7 2024-09-12T00:21:44.673 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.674+0000 7f66dad39800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:44.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.676+0000 7f658d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:44.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.676+0000 7f66dad39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:44.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.676+0000 7f66dad39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:44.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.676+0000 7f66dad39800 5 note: GC not initialized 2024-09-12T00:21:44.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.676+0000 7f6507fff640 20 reqs_thread_entry: start 2024-09-12T00:21:44.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.676+0000 7f66dad39800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:44.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.677+0000 7f66dad39800 20 Filter name: none 2024-09-12T00:21:44.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.677+0000 7f6505ffb640 20 reqs_thread_entry: start 2024-09-12T00:21:44.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.677+0000 7f66dad39800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.677+0000 7f66dad39800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:44.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.677+0000 7f66dad39800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.678+0000 7f66dad39800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:21:44.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.678+0000 7f66dad39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:44.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.678+0000 7f66dad39800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.678+0000 7f66dad39800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:21:44.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.678+0000 7f66dad39800 20 rados->read ofs=0 len=0 2024-09-12T00:21:44.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.678+0000 7f66dad39800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:21:44.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.678+0000 7f66dad39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:44.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.680+0000 7f658d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:44.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.682+0000 7f66dad39800 20 remove_watcher() i=0 2024-09-12T00:21:44.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.682+0000 7f66dad39800 2 removed watcher, disabling cache 2024-09-12T00:21:44.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.683+0000 7f66dad39800 20 remove_watcher() i=1 2024-09-12T00:21:44.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.684+0000 7f66dad39800 20 remove_watcher() i=2 2024-09-12T00:21:44.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.685+0000 7f66dad39800 20 remove_watcher() i=3 2024-09-12T00:21:44.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.686+0000 7f66dad39800 20 remove_watcher() i=4 2024-09-12T00:21:44.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.687+0000 7f66dad39800 20 remove_watcher() i=5 2024-09-12T00:21:44.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.688+0000 7f66dad39800 20 remove_watcher() i=6 2024-09-12T00:21:44.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:44.689+0000 7f66dad39800 20 remove_watcher() i=7 2024-09-12T00:21:44.700 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:44.700 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:21:44.700 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-do-reshard id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:21:44.700 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:44.765 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T00:21:44.765 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:44.983 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:21:45.011 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:45.011 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:45.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.051+0000 7f2953b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.053+0000 7f2953b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.053+0000 7f2953b2c800 20 realm 2024-09-12T00:21:45.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.053+0000 7f2953b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.053+0000 7f2953b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.053+0000 7f2953b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:45.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.053+0000 7f2953b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.054+0000 7f2953b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.054+0000 7f2953b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.054+0000 7f2953b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:45.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.054+0000 7f2953b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.055+0000 7f2953b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:45.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.055+0000 7f2953b2c800 20 searching for the correct realm 2024-09-12T00:21:45.057 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.058+0000 7f294f055640 0 -- 172.21.15.67:0/2850489024 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f294402f0a0 msgr2=0x7f2944003090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:45.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.061+0000 7f294f856640 0 -- 172.21.15.67:0/2850489024 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f294807a3f0 msgr2=0x7f294807a850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:45.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.066+0000 7f2953b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:45.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.066+0000 7f2953b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:45.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.066+0000 7f2953b2c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:45.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.066+0000 7f2953b2c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:45.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.066+0000 7f2953b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:45.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.066+0000 7f2953b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:45.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.066+0000 7f2953b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.066+0000 7f2953b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.066+0000 7f2953b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.067+0000 7f2953b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:45.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.067+0000 7f2953b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.067+0000 7f2953b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:45.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.067+0000 7f2953b2c800 20 zone default found 2024-09-12T00:21:45.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.067+0000 7f2953b2c800 4 Realm: () 2024-09-12T00:21:45.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.067+0000 7f2953b2c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:45.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.067+0000 7f2953b2c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:45.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.067+0000 7f2953b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:45.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.067+0000 7f2953b2c800 20 zonegroup default 2024-09-12T00:21:45.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.067+0000 7f2953b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.067+0000 7f2953b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.067+0000 7f2953b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.068+0000 7f2953b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.068+0000 7f2953b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.068+0000 7f2953b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.068+0000 7f2953b2c800 20 started sync module instance, tier type = 2024-09-12T00:21:45.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.068+0000 7f2953b2c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:45.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.076+0000 7f2953b2c800 20 add_watcher() i=0 2024-09-12T00:21:45.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.076+0000 7f2953b2c800 20 add_watcher() i=1 2024-09-12T00:21:45.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.076+0000 7f2953b2c800 20 add_watcher() i=2 2024-09-12T00:21:45.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.076+0000 7f2953b2c800 20 add_watcher() i=3 2024-09-12T00:21:45.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.076+0000 7f2953b2c800 20 add_watcher() i=4 2024-09-12T00:21:45.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.076+0000 7f2953b2c800 20 add_watcher() i=5 2024-09-12T00:21:45.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.076+0000 7f2953b2c800 20 add_watcher() i=6 2024-09-12T00:21:45.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.077+0000 7f2953b2c800 20 add_watcher() i=7 2024-09-12T00:21:45.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.077+0000 7f2953b2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:45.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.079+0000 7f2805fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:45.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.080+0000 7f2953b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:45.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.080+0000 7f2953b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:45.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.080+0000 7f2953b2c800 5 note: GC not initialized 2024-09-12T00:21:45.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.080+0000 7f2804fe1640 20 reqs_thread_entry: start 2024-09-12T00:21:45.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.080+0000 7f2953b2c800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:45.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.080+0000 7f2953b2c800 20 Filter name: none 2024-09-12T00:21:45.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.080+0000 7f277e7fc640 20 reqs_thread_entry: start 2024-09-12T00:21:45.080 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.080+0000 7f2953b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.081+0000 7f2953b2c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:45.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.081+0000 7f2953b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.081+0000 7f2953b2c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:21:45.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.081+0000 7f2953b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:45.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.081+0000 7f2953b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.081+0000 7f2953b2c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:45.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.081+0000 7f2953b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.082+0000 7f2953b2c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:21:45.081 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.082+0000 7f2953b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:45.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.083+0000 7f2805fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:45.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.085+0000 7f2953b2c800 20 remove_watcher() i=0 2024-09-12T00:21:45.084 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.085+0000 7f2953b2c800 2 removed watcher, disabling cache 2024-09-12T00:21:45.085 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.086+0000 7f2953b2c800 20 remove_watcher() i=1 2024-09-12T00:21:45.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.087+0000 7f2953b2c800 20 remove_watcher() i=2 2024-09-12T00:21:45.087 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.088+0000 7f2953b2c800 20 remove_watcher() i=3 2024-09-12T00:21:45.088 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.089+0000 7f2953b2c800 20 remove_watcher() i=4 2024-09-12T00:21:45.089 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.090+0000 7f2953b2c800 20 remove_watcher() i=5 2024-09-12T00:21:45.090 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.091+0000 7f2953b2c800 20 remove_watcher() i=6 2024-09-12T00:21:45.091 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.092+0000 7f2953b2c800 20 remove_watcher() i=7 2024-09-12T00:21:45.102 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:45.102 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:21:45.102 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-logrecord-writes id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:21:45.102 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:45.104 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T00:21:45.138 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:45.139 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:45.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.178+0000 7faf0cd2b800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.179+0000 7faf0cd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.179+0000 7faf0cd2b800 20 realm 2024-09-12T00:21:45.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.179+0000 7faf0cd2b800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.180+0000 7faf0cd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.180+0000 7faf0cd2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:45.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.180+0000 7faf0cd2b800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.180+0000 7faf0cd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.180+0000 7faf0cd2b800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.181+0000 7faf0cd2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:45.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.181+0000 7faf0cd2b800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.181+0000 7faf0cd2b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:45.181 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.181+0000 7faf0cd2b800 20 searching for the correct realm 2024-09-12T00:21:45.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.185+0000 7faf08272640 0 -- 172.21.15.67:0/1406508777 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7faefc01c040 msgr2=0x7faefc01b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:45.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.188+0000 7faf09274640 0 -- 172.21.15.67:0/1406508777 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55942e788330 msgr2=0x55942e78a780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:45.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.192+0000 7faf0cd2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:45.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.192+0000 7faf0cd2b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:45.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.192+0000 7faf0cd2b800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:45.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.192+0000 7faf0cd2b800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:45.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.192+0000 7faf0cd2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:45.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.192+0000 7faf0cd2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:45.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.192+0000 7faf0cd2b800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.192+0000 7faf0cd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.193 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.192+0000 7faf0cd2b800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.192+0000 7faf0cd2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:45.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.192+0000 7faf0cd2b800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.193+0000 7faf0cd2b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:45.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.193+0000 7faf0cd2b800 20 zone default found 2024-09-12T00:21:45.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.193+0000 7faf0cd2b800 4 Realm: () 2024-09-12T00:21:45.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.193+0000 7faf0cd2b800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:45.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.193+0000 7faf0cd2b800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:45.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.193+0000 7faf0cd2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:45.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.193+0000 7faf0cd2b800 20 zonegroup default 2024-09-12T00:21:45.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.193+0000 7faf0cd2b800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.193+0000 7faf0cd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.193+0000 7faf0cd2b800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.193+0000 7faf0cd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.193+0000 7faf0cd2b800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.193+0000 7faf0cd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.193+0000 7faf0cd2b800 20 started sync module instance, tier type = 2024-09-12T00:21:45.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.193+0000 7faf0cd2b800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:45.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.202+0000 7faf0cd2b800 20 add_watcher() i=0 2024-09-12T00:21:45.201 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.202+0000 7faf0cd2b800 20 add_watcher() i=1 2024-09-12T00:21:45.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.202+0000 7faf0cd2b800 20 add_watcher() i=2 2024-09-12T00:21:45.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.202+0000 7faf0cd2b800 20 add_watcher() i=3 2024-09-12T00:21:45.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.202+0000 7faf0cd2b800 20 add_watcher() i=4 2024-09-12T00:21:45.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.202+0000 7faf0cd2b800 20 add_watcher() i=5 2024-09-12T00:21:45.202 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.202+0000 7faf0cd2b800 20 add_watcher() i=6 2024-09-12T00:21:45.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.203+0000 7faf0cd2b800 20 add_watcher() i=7 2024-09-12T00:21:45.203 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.203+0000 7faf0cd2b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:45.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.205+0000 7fadbefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:45.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.205+0000 7faf0cd2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:45.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.205+0000 7faf0cd2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:45.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.206+0000 7faf0cd2b800 5 note: GC not initialized 2024-09-12T00:21:45.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.206+0000 7fadbdfe3640 20 reqs_thread_entry: start 2024-09-12T00:21:45.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.206+0000 7faf0cd2b800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:45.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.206+0000 7faf0cd2b800 20 Filter name: none 2024-09-12T00:21:45.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.206+0000 7fad2f7fe640 20 reqs_thread_entry: start 2024-09-12T00:21:45.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.206+0000 7faf0cd2b800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:21:45.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.206+0000 7faf0cd2b800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.206+0000 7faf0cd2b800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:45.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.206+0000 7faf0cd2b800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:21:45.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.206+0000 7faf0cd2b800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:21:45.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.206+0000 7faf0cd2b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 : miss 2024-09-12T00:21:45.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.206+0000 7faf0cd2b800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.207+0000 7faf0cd2b800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:21:45.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.207+0000 7faf0cd2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 info.flags=0x17 2024-09-12T00:21:45.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.207+0000 7faf0cd2b800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 to cache LRU end 2024-09-12T00:21:45.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.207+0000 7faf0cd2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:21:45.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.207+0000 7faf0cd2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:45.208 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.207+0000 7faf0cd2b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 2024-09-12T00:21:45.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.211+0000 7faf0cd2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 info.flags=0x17 2024-09-12T00:21:45.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.211+0000 7faf0cd2b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 to cache LRU end 2024-09-12T00:21:45.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.211+0000 7faf0cd2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:45.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.211+0000 7faf0cd2b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35, ofs0, ns] 2024-09-12T00:21:45.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.211+0000 7faddffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562446 cookie 94094923240576 notifier 7178 bl.length()=923 2024-09-12T00:21:45.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.211+0000 7faddffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 info.flags=0x17 2024-09-12T00:21:45.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.211+0000 7faddffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 to cache LRU end 2024-09-12T00:21:45.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.211+0000 7faddffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:45.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.212+0000 7faf0cd2b800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): orig_sources= new_sources= 2024-09-12T00:21:45.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.212+0000 7faf0cd2b800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): potential sources added=[] removed=[] 2024-09-12T00:21:45.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.212+0000 7faf0cd2b800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): orig_dests= new_dests= 2024-09-12T00:21:45.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.212+0000 7faf0cd2b800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): potential dests added=[] removed=[] 2024-09-12T00:21:45.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.213+0000 7faf0cd2b800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T00:21:45.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.213+0000 7faf0cd2b800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:21:45.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.215+0000 7faf0cd2b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:21:45.214 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.215+0000 7faf0cd2b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 2024-09-12T00:21:45.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.216+0000 7faf0cd2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 info.flags=0x17 2024-09-12T00:21:45.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.216+0000 7faf0cd2b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 to cache LRU end 2024-09-12T00:21:45.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.216+0000 7faf0cd2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:45.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.216+0000 7faf0cd2b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35, ofs0, ns] 2024-09-12T00:21:45.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.218+0000 7faddf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562447 cookie 94094923240576 notifier 7178 bl.length()=891 2024-09-12T00:21:45.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.218+0000 7faddf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 info.flags=0x17 2024-09-12T00:21:45.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.218+0000 7faddf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 to cache LRU end 2024-09-12T00:21:45.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.218+0000 7faddf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:45.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.218+0000 7faf0cd2b800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): orig_sources= new_sources= 2024-09-12T00:21:45.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.218+0000 7faf0cd2b800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): potential sources added=[] removed=[] 2024-09-12T00:21:45.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.218+0000 7faf0cd2b800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): orig_dests= new_dests= 2024-09-12T00:21:45.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.218+0000 7faf0cd2b800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): potential dests added=[] removed=[] 2024-09-12T00:21:45.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.220+0000 7fadbefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:45.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.222+0000 7faf0cd2b800 20 remove_watcher() i=0 2024-09-12T00:21:45.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.222+0000 7faf0cd2b800 2 removed watcher, disabling cache 2024-09-12T00:21:45.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.223+0000 7faf0cd2b800 20 remove_watcher() i=1 2024-09-12T00:21:45.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.224+0000 7faf0cd2b800 20 remove_watcher() i=2 2024-09-12T00:21:45.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.225+0000 7faf0cd2b800 20 remove_watcher() i=3 2024-09-12T00:21:45.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.226+0000 7faf0cd2b800 20 remove_watcher() i=4 2024-09-12T00:21:45.226 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.227+0000 7faf0cd2b800 20 remove_watcher() i=5 2024-09-12T00:21:45.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.228+0000 7faf0cd2b800 20 remove_watcher() i=6 2024-09-12T00:21:45.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.229+0000 7faf0cd2b800 20 remove_watcher() i=7 2024-09-12T00:21:45.240 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:21:45.269 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:45.270 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:45.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.309+0000 7f3513322800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.311+0000 7f3513322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.311+0000 7f3513322800 20 realm 2024-09-12T00:21:45.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.311+0000 7f3513322800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.311+0000 7f3513322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.311+0000 7f3513322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:45.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.311+0000 7f3513322800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.311+0000 7f3513322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.311+0000 7f3513322800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.312+0000 7f3513322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:45.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.312+0000 7f3513322800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.313+0000 7f3513322800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:45.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.313+0000 7f3513322800 20 searching for the correct realm 2024-09-12T00:21:45.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.317+0000 7f350e867640 0 -- 172.21.15.67:0/916347339 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x555c7384eee0 msgr2=0x555c73851330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:45.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.320+0000 7f350f068640 0 -- 172.21.15.67:0/916347339 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x555c7384eee0 msgr2=0x7f33d808b910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:45.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.325+0000 7f3513322800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:45.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.325+0000 7f3513322800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:45.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.325+0000 7f3513322800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:45.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.325+0000 7f3513322800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:45.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.325+0000 7f3513322800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:45.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.325+0000 7f3513322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:45.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.325+0000 7f3513322800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.325+0000 7f3513322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.325 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.325+0000 7f3513322800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.325+0000 7f3513322800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:45.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.325+0000 7f3513322800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.326+0000 7f3513322800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:45.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.326+0000 7f3513322800 20 zone default found 2024-09-12T00:21:45.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.326+0000 7f3513322800 4 Realm: () 2024-09-12T00:21:45.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.326+0000 7f3513322800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:45.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.326+0000 7f3513322800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:45.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.326+0000 7f3513322800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:45.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.326+0000 7f3513322800 20 zonegroup default 2024-09-12T00:21:45.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.326+0000 7f3513322800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.326+0000 7f3513322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.326+0000 7f3513322800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.326+0000 7f3513322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.326+0000 7f3513322800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.327+0000 7f3513322800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.327+0000 7f3513322800 20 started sync module instance, tier type = 2024-09-12T00:21:45.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.327+0000 7f3513322800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:45.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.335+0000 7f3513322800 20 add_watcher() i=0 2024-09-12T00:21:45.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.335+0000 7f3513322800 20 add_watcher() i=1 2024-09-12T00:21:45.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.335+0000 7f3513322800 20 add_watcher() i=2 2024-09-12T00:21:45.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.335+0000 7f3513322800 20 add_watcher() i=3 2024-09-12T00:21:45.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.335+0000 7f3513322800 20 add_watcher() i=4 2024-09-12T00:21:45.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.335+0000 7f3513322800 20 add_watcher() i=5 2024-09-12T00:21:45.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.335+0000 7f3513322800 20 add_watcher() i=6 2024-09-12T00:21:45.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.336+0000 7f3513322800 20 add_watcher() i=7 2024-09-12T00:21:45.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.336+0000 7f3513322800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:45.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.338+0000 7f33c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:45.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.338+0000 7f3513322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:45.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.338+0000 7f3513322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:45.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.338+0000 7f3513322800 5 note: GC not initialized 2024-09-12T00:21:45.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.338+0000 7f33c4fe1640 20 reqs_thread_entry: start 2024-09-12T00:21:45.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.338+0000 7f3513322800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:45.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.338+0000 7f3513322800 20 Filter name: none 2024-09-12T00:21:45.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.339+0000 7f333e7fc640 20 reqs_thread_entry: start 2024-09-12T00:21:45.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.339+0000 7f3513322800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.339+0000 7f3513322800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:45.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.339+0000 7f3513322800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.339+0000 7f3513322800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:21:45.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.339+0000 7f3513322800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:45.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.339+0000 7f3513322800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.340+0000 7f3513322800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:45.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.340+0000 7f3513322800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.340+0000 7f3513322800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:21:45.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.340+0000 7f3513322800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:45.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.341+0000 7f33c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:45.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.344+0000 7f3513322800 20 remove_watcher() i=0 2024-09-12T00:21:45.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.344+0000 7f3513322800 2 removed watcher, disabling cache 2024-09-12T00:21:45.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.345+0000 7f3513322800 20 remove_watcher() i=1 2024-09-12T00:21:45.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.346+0000 7f3513322800 20 remove_watcher() i=2 2024-09-12T00:21:45.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.347+0000 7f3513322800 20 remove_watcher() i=3 2024-09-12T00:21:45.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.348+0000 7f3513322800 20 remove_watcher() i=4 2024-09-12T00:21:45.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.349+0000 7f3513322800 20 remove_watcher() i=5 2024-09-12T00:21:45.349 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.350+0000 7f3513322800 20 remove_watcher() i=6 2024-09-12T00:21:45.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.351+0000 7f3513322800 20 remove_watcher() i=7 2024-09-12T00:21:45.361 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:45.361 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:21:45.362 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-logrecord-writes id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:21:45.362 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:45.415 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:21:45.447 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:45.447 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:45.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.492+0000 7fd0a3b23800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.494+0000 7fd0a3b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.494+0000 7fd0a3b23800 20 realm 2024-09-12T00:21:45.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.494+0000 7fd0a3b23800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.494+0000 7fd0a3b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.494+0000 7fd0a3b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:45.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.494+0000 7fd0a3b23800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.495+0000 7fd0a3b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.494 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.495+0000 7fd0a3b23800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.495+0000 7fd0a3b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:45.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.495+0000 7fd0a3b23800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.496+0000 7fd0a3b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:45.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.496+0000 7fd0a3b23800 20 searching for the correct realm 2024-09-12T00:21:45.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.500+0000 7fd09f813640 0 -- 172.21.15.67:0/1710146736 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7fd09004e030 msgr2=0x7fd090075ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:45.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.503+0000 7fd09f813640 0 -- 172.21.15.67:0/1710146736 >> [v2:172.21.15.67:6800/2522402523,v1:172.21.15.67:6801/2522402523] conn(0x560fd9a986e0 msgr2=0x560fd9a9aaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:45.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.506+0000 7fd0a3b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:45.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.506+0000 7fd0a3b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:45.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.506+0000 7fd0a3b23800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:45.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.506+0000 7fd0a3b23800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:45.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.506+0000 7fd0a3b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:45.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.506+0000 7fd0a3b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:45.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.506+0000 7fd0a3b23800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.507+0000 7fd0a3b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.507+0000 7fd0a3b23800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.507+0000 7fd0a3b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:45.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.507+0000 7fd0a3b23800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.507+0000 7fd0a3b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:45.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.507+0000 7fd0a3b23800 20 zone default found 2024-09-12T00:21:45.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.507+0000 7fd0a3b23800 4 Realm: () 2024-09-12T00:21:45.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.507+0000 7fd0a3b23800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:45.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.507+0000 7fd0a3b23800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:45.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.507+0000 7fd0a3b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:45.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.507+0000 7fd0a3b23800 20 zonegroup default 2024-09-12T00:21:45.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.507+0000 7fd0a3b23800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.507+0000 7fd0a3b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.507+0000 7fd0a3b23800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.508+0000 7fd0a3b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.508+0000 7fd0a3b23800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.508+0000 7fd0a3b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.508+0000 7fd0a3b23800 20 started sync module instance, tier type = 2024-09-12T00:21:45.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.508+0000 7fd0a3b23800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:45.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.516+0000 7fd0a3b23800 20 add_watcher() i=0 2024-09-12T00:21:45.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.516+0000 7fd0a3b23800 20 add_watcher() i=1 2024-09-12T00:21:45.515 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.516+0000 7fd0a3b23800 20 add_watcher() i=2 2024-09-12T00:21:45.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.516+0000 7fd0a3b23800 20 add_watcher() i=3 2024-09-12T00:21:45.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.516+0000 7fd0a3b23800 20 add_watcher() i=4 2024-09-12T00:21:45.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.516+0000 7fd0a3b23800 20 add_watcher() i=5 2024-09-12T00:21:45.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.516+0000 7fd0a3b23800 20 add_watcher() i=6 2024-09-12T00:21:45.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.517+0000 7fd0a3b23800 20 add_watcher() i=7 2024-09-12T00:21:45.516 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.517+0000 7fd0a3b23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:45.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.519+0000 7fcf55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:45.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.519+0000 7fd0a3b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:45.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.519+0000 7fd0a3b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:45.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.519+0000 7fd0a3b23800 5 note: GC not initialized 2024-09-12T00:21:45.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.519+0000 7fcf54fe1640 20 reqs_thread_entry: start 2024-09-12T00:21:45.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.520+0000 7fd0a3b23800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:45.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.520+0000 7fd0a3b23800 20 Filter name: none 2024-09-12T00:21:45.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.520+0000 7fcece7fc640 20 reqs_thread_entry: start 2024-09-12T00:21:45.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.520+0000 7fd0a3b23800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:21:45.519 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.520+0000 7fd0a3b23800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.520+0000 7fd0a3b23800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:45.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.520+0000 7fd0a3b23800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:21:45.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.520+0000 7fd0a3b23800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:21:45.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.520+0000 7fd0a3b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 : miss 2024-09-12T00:21:45.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.520+0000 7fd0a3b23800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.521+0000 7fd0a3b23800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:21:45.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.521+0000 7fd0a3b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 info.flags=0x17 2024-09-12T00:21:45.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.521+0000 7fd0a3b23800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 to cache LRU end 2024-09-12T00:21:45.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.521+0000 7fd0a3b23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:21:45.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.521+0000 7fd0a3b23800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:45.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.521+0000 7fd0a3b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 2024-09-12T00:21:45.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.524+0000 7fd0a3b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 info.flags=0x17 2024-09-12T00:21:45.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.524+0000 7fd0a3b23800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 to cache LRU end 2024-09-12T00:21:45.524 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.524+0000 7fd0a3b23800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:45.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.524+0000 7fd0a3b23800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35, ofs0, ns] 2024-09-12T00:21:45.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.525+0000 7fcf7effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562448 cookie 94626076319344 notifier 7704 bl.length()=923 2024-09-12T00:21:45.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.525+0000 7fcf7effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 info.flags=0x17 2024-09-12T00:21:45.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.525+0000 7fcf7effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 to cache LRU end 2024-09-12T00:21:45.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.525+0000 7fcf7effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:45.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.525+0000 7fd0a3b23800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): orig_sources= new_sources= 2024-09-12T00:21:45.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.525+0000 7fd0a3b23800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): potential sources added=[] removed=[] 2024-09-12T00:21:45.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.525+0000 7fd0a3b23800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): orig_dests= new_dests= 2024-09-12T00:21:45.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.525+0000 7fd0a3b23800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): potential dests added=[] removed=[] 2024-09-12T00:21:45.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.528+0000 7fd0a3b23800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35.1.0 2024-09-12T00:21:45.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.528+0000 7fd0a3b23800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35.1.0 2024-09-12T00:21:45.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.528+0000 7fd0a3b23800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35.1.1 2024-09-12T00:21:45.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.528+0000 7fd0a3b23800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35.1.1 2024-09-12T00:21:45.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.528+0000 7fd0a3b23800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35.0 2024-09-12T00:21:45.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.530+0000 7fd0a3b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:21:45.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.530+0000 7fd0a3b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 2024-09-12T00:21:45.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.532+0000 7fd0a3b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 info.flags=0x17 2024-09-12T00:21:45.531 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.532+0000 7fd0a3b23800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 to cache LRU end 2024-09-12T00:21:45.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.532+0000 7fd0a3b23800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:45.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.532+0000 7fd0a3b23800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35, ofs0, ns] 2024-09-12T00:21:45.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.532+0000 7fcf7effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562449 cookie 94626076319344 notifier 7704 bl.length()=923 2024-09-12T00:21:45.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.532+0000 7fcf7effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 info.flags=0x17 2024-09-12T00:21:45.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.532+0000 7fcf7effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 to cache LRU end 2024-09-12T00:21:45.532 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.532+0000 7fcf7effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:45.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.532+0000 7fd0a3b23800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): orig_sources= new_sources= 2024-09-12T00:21:45.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.532+0000 7fd0a3b23800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): potential sources added=[] removed=[] 2024-09-12T00:21:45.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.532+0000 7fd0a3b23800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): orig_dests= new_dests= 2024-09-12T00:21:45.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.532+0000 7fd0a3b23800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): potential dests added=[] removed=[] 2024-09-12T00:21:45.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.533+0000 7fd0a3b23800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35.0 2024-09-12T00:21:45.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.534+0000 7fd0a3b23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:21:45.533 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.534+0000 7fd0a3b23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 2024-09-12T00:21:45.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.535+0000 7fd0a3b23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 info.flags=0x17 2024-09-12T00:21:45.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.535+0000 7fd0a3b23800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 to cache LRU end 2024-09-12T00:21:45.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.535+0000 7fd0a3b23800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:45.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.535+0000 7fd0a3b23800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35, ofs0, ns] 2024-09-12T00:21:45.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.535+0000 7fcf7e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562450 cookie 94626076319344 notifier 7704 bl.length()=891 2024-09-12T00:21:45.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.535+0000 7fcf7e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 info.flags=0x17 2024-09-12T00:21:45.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.535+0000 7fcf7e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 to cache LRU end 2024-09-12T00:21:45.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.535+0000 7fcf7e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:45.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.536+0000 7fd0a3b23800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): orig_sources= new_sources= 2024-09-12T00:21:45.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.536+0000 7fd0a3b23800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): potential sources added=[] removed=[] 2024-09-12T00:21:45.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.536+0000 7fd0a3b23800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): orig_dests= new_dests= 2024-09-12T00:21:45.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.536+0000 7fd0a3b23800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35]): potential dests added=[] removed=[] 2024-09-12T00:21:45.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.537+0000 7fd0a3b23800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:21:45.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.538+0000 7fcf55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:45.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.541+0000 7fd0a3b23800 20 remove_watcher() i=0 2024-09-12T00:21:45.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.541+0000 7fd0a3b23800 2 removed watcher, disabling cache 2024-09-12T00:21:45.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.542+0000 7fd0a3b23800 20 remove_watcher() i=1 2024-09-12T00:21:45.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.543+0000 7fd0a3b23800 20 remove_watcher() i=2 2024-09-12T00:21:45.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.545+0000 7fd0a3b23800 20 remove_watcher() i=3 2024-09-12T00:21:45.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.546+0000 7fd0a3b23800 20 remove_watcher() i=4 2024-09-12T00:21:45.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.547+0000 7fd0a3b23800 20 remove_watcher() i=5 2024-09-12T00:21:45.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.547+0000 7fd0a3b23800 20 remove_watcher() i=6 2024-09-12T00:21:45.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.549+0000 7fd0a3b23800 20 remove_watcher() i=7 2024-09-12T00:21:45.560 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:21:45.592 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:45.593 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:45.629 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.630+0000 7fc7c21ad800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.632+0000 7fc7c21ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.632+0000 7fc7c21ad800 20 realm 2024-09-12T00:21:45.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.632+0000 7fc7c21ad800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.632+0000 7fc7c21ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.632+0000 7fc7c21ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:45.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.632+0000 7fc7c21ad800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.633+0000 7fc7c21ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.632 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.633+0000 7fc7c21ad800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.633+0000 7fc7c21ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:45.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.633+0000 7fc7c21ad800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.634+0000 7fc7c21ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:45.633 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.634+0000 7fc7c21ad800 20 searching for the correct realm 2024-09-12T00:21:45.636 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.637+0000 7fc7c0498640 0 -- 172.21.15.67:0/2222625142 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7fc7a800b040 msgr2=0x7fc7a8066d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:45.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.640+0000 7fc7bfc97640 0 -- 172.21.15.67:0/2222625142 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fc7b8066b70 msgr2=0x7fc7b805fe40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:45.643 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.644+0000 7fc7c21ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:45.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.644+0000 7fc7c21ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:45.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.644+0000 7fc7c21ad800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:45.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.644+0000 7fc7c21ad800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:45.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.644+0000 7fc7c21ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:45.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.644+0000 7fc7c21ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:45.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.644+0000 7fc7c21ad800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.644+0000 7fc7c21ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.644+0000 7fc7c21ad800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.644+0000 7fc7c21ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:45.644 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.644+0000 7fc7c21ad800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.645+0000 7fc7c21ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:45.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.645+0000 7fc7c21ad800 20 zone default found 2024-09-12T00:21:45.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.645+0000 7fc7c21ad800 4 Realm: () 2024-09-12T00:21:45.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.645+0000 7fc7c21ad800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:45.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.645+0000 7fc7c21ad800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:45.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.645+0000 7fc7c21ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:45.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.645+0000 7fc7c21ad800 20 zonegroup default 2024-09-12T00:21:45.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.645+0000 7fc7c21ad800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.645+0000 7fc7c21ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.645+0000 7fc7c21ad800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.645+0000 7fc7c21ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.645+0000 7fc7c21ad800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.646+0000 7fc7c21ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:45.646 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.646+0000 7fc7c21ad800 20 started sync module instance, tier type = 2024-09-12T00:21:45.647 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.646+0000 7fc7c21ad800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:45.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.654+0000 7fc7c21ad800 20 add_watcher() i=0 2024-09-12T00:21:45.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.654+0000 7fc7c21ad800 20 add_watcher() i=1 2024-09-12T00:21:45.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.654+0000 7fc7c21ad800 20 add_watcher() i=2 2024-09-12T00:21:45.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.654+0000 7fc7c21ad800 20 add_watcher() i=3 2024-09-12T00:21:45.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.654+0000 7fc7c21ad800 20 add_watcher() i=4 2024-09-12T00:21:45.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.654+0000 7fc7c21ad800 20 add_watcher() i=5 2024-09-12T00:21:45.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.654+0000 7fc7c21ad800 20 add_watcher() i=6 2024-09-12T00:21:45.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.655+0000 7fc7c21ad800 20 add_watcher() i=7 2024-09-12T00:21:45.654 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.655+0000 7fc7c21ad800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:45.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.656+0000 7fc675fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:45.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.657+0000 7fc7c21ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:45.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.657+0000 7fc7c21ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:45.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.657+0000 7fc7c21ad800 5 note: GC not initialized 2024-09-12T00:21:45.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.657+0000 7fc674fe1640 20 reqs_thread_entry: start 2024-09-12T00:21:45.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.657+0000 7fc7c21ad800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:45.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.657+0000 7fc7c21ad800 20 Filter name: none 2024-09-12T00:21:45.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.657+0000 7fc5ee7fc640 20 reqs_thread_entry: start 2024-09-12T00:21:45.657 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.657+0000 7fc7c21ad800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.658+0000 7fc7c21ad800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:45.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.658+0000 7fc7c21ad800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.658+0000 7fc7c21ad800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:21:45.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.658+0000 7fc7c21ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:45.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.658+0000 7fc7c21ad800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.659+0000 7fc7c21ad800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:45.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.659+0000 7fc7c21ad800 20 rados->read ofs=0 len=0 2024-09-12T00:21:45.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.659+0000 7fc7c21ad800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:21:45.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.659+0000 7fc7c21ad800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:45.660 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.661+0000 7fc675fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:45.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.663+0000 7fc7c21ad800 20 remove_watcher() i=0 2024-09-12T00:21:45.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.663+0000 7fc7c21ad800 2 removed watcher, disabling cache 2024-09-12T00:21:45.663 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.664+0000 7fc7c21ad800 20 remove_watcher() i=1 2024-09-12T00:21:45.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.665+0000 7fc7c21ad800 20 remove_watcher() i=2 2024-09-12T00:21:45.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.666+0000 7fc7c21ad800 20 remove_watcher() i=3 2024-09-12T00:21:45.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.667+0000 7fc7c21ad800 20 remove_watcher() i=4 2024-09-12T00:21:45.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.668+0000 7fc7c21ad800 20 remove_watcher() i=5 2024-09-12T00:21:45.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.669+0000 7fc7c21ad800 20 remove_watcher() i=6 2024-09-12T00:21:45.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:45.670+0000 7fc7c21ad800 20 remove_watcher() i=7 2024-09-12T00:21:45.680 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:45.680 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:21:45.680 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-logrecord-writes id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:21:45.680 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:45.742 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T00:21:45.742 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:45.963 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:21:45.991 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:45.992 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:46.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.031+0000 7f886152c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.033+0000 7f886152c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.033+0000 7f886152c800 20 realm 2024-09-12T00:21:46.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.033+0000 7f886152c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.033+0000 7f886152c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.033+0000 7f886152c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:46.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.033+0000 7f886152c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.033+0000 7f886152c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.034+0000 7f886152c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.034+0000 7f886152c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:46.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.034+0000 7f886152c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.035+0000 7f886152c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:46.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.035+0000 7f886152c800 20 searching for the correct realm 2024-09-12T00:21:46.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.042+0000 7f885da50640 0 -- 172.21.15.67:0/3262343297 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7f885407e070 msgr2=0x7f8854049eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:21:46.047 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.048+0000 7f885d24f640 0 -- 172.21.15.67:0/3262343297 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f8858026040 msgr2=0x7f885809cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:46.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.052+0000 7f886152c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:46.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.052+0000 7f886152c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:46.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.052+0000 7f886152c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:46.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.052+0000 7f886152c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:46.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.052+0000 7f886152c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:46.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.052+0000 7f886152c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:46.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.052+0000 7f886152c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.052+0000 7f886152c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.052+0000 7f886152c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.052+0000 7f886152c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:46.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.052+0000 7f886152c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.053+0000 7f886152c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:46.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.053+0000 7f886152c800 20 zone default found 2024-09-12T00:21:46.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.053+0000 7f886152c800 4 Realm: () 2024-09-12T00:21:46.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.053+0000 7f886152c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:46.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.053+0000 7f886152c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:46.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.053+0000 7f886152c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:46.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.053+0000 7f886152c800 20 zonegroup default 2024-09-12T00:21:46.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.053+0000 7f886152c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.053+0000 7f886152c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.053+0000 7f886152c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.053+0000 7f886152c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.053+0000 7f886152c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.053+0000 7f886152c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.053+0000 7f886152c800 20 started sync module instance, tier type = 2024-09-12T00:21:46.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.053+0000 7f886152c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:46.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.061+0000 7f886152c800 20 add_watcher() i=0 2024-09-12T00:21:46.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.061+0000 7f886152c800 20 add_watcher() i=1 2024-09-12T00:21:46.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.061+0000 7f886152c800 20 add_watcher() i=2 2024-09-12T00:21:46.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.061+0000 7f886152c800 20 add_watcher() i=3 2024-09-12T00:21:46.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.061+0000 7f886152c800 20 add_watcher() i=4 2024-09-12T00:21:46.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.061+0000 7f886152c800 20 add_watcher() i=5 2024-09-12T00:21:46.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.061+0000 7f886152c800 20 add_watcher() i=6 2024-09-12T00:21:46.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.062+0000 7f886152c800 20 add_watcher() i=7 2024-09-12T00:21:46.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.062+0000 7f886152c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:46.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.064+0000 7f87137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:46.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.064+0000 7f886152c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:46.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.064+0000 7f886152c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:46.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.064+0000 7f886152c800 5 note: GC not initialized 2024-09-12T00:21:46.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.065+0000 7f87127e4640 20 reqs_thread_entry: start 2024-09-12T00:21:46.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.065+0000 7f886152c800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:46.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.065+0000 7f886152c800 20 Filter name: none 2024-09-12T00:21:46.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.065+0000 7f8683fff640 20 reqs_thread_entry: start 2024-09-12T00:21:46.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.065+0000 7f886152c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.065+0000 7f886152c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:46.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.065+0000 7f886152c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.066+0000 7f886152c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:21:46.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.066+0000 7f886152c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:46.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.066+0000 7f886152c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.066+0000 7f886152c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:46.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.066+0000 7f886152c800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.067+0000 7f886152c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:21:46.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.067+0000 7f886152c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:46.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.068+0000 7f87137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:46.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.070+0000 7f886152c800 20 remove_watcher() i=0 2024-09-12T00:21:46.069 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.070+0000 7f886152c800 2 removed watcher, disabling cache 2024-09-12T00:21:46.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.071+0000 7f886152c800 20 remove_watcher() i=1 2024-09-12T00:21:46.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.072+0000 7f886152c800 20 remove_watcher() i=2 2024-09-12T00:21:46.072 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.073+0000 7f886152c800 20 remove_watcher() i=3 2024-09-12T00:21:46.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.074+0000 7f886152c800 20 remove_watcher() i=4 2024-09-12T00:21:46.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.075+0000 7f886152c800 20 remove_watcher() i=5 2024-09-12T00:21:46.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.076+0000 7f886152c800 20 remove_watcher() i=6 2024-09-12T00:21:46.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.077+0000 7f886152c800 20 remove_watcher() i=7 2024-09-12T00:21:46.087 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.087 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:21:46.087 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-logrecord-writes id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:21:46.087 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.089 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:21:46.123 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:46.123 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:46.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.163+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.165+0000 7f18d3726800 20 realm 2024-09-12T00:21:46.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.164 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.165+0000 7f18d3726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:46.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.166+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:46.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.166+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.167+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:46.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.167+0000 7f18d3726800 20 searching for the correct realm 2024-09-12T00:21:46.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.170+0000 7f18cebd8640 0 -- 172.21.15.67:0/1245695438 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f18c40443c0 msgr2=0x7f18c4044820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:46.375 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.376+0000 7f18cfbda640 0 -- 172.21.15.67:0/1245695438 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x556ce756a6b0 msgr2=0x556ce756cb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:46.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:46.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:46.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:46.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:46.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:46.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:46.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.381+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.381+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.381+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:46.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:46.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.382+0000 7f18d3726800 20 zone default found 2024-09-12T00:21:46.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.382+0000 7f18d3726800 4 Realm: () 2024-09-12T00:21:46.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.382+0000 7f18d3726800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:46.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.382+0000 7f18d3726800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:46.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.382+0000 7f18d3726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:46.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.382+0000 7f18d3726800 20 zonegroup default 2024-09-12T00:21:46.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.383+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.383+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.383+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.383+0000 7f18d3726800 20 started sync module instance, tier type = 2024-09-12T00:21:46.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.383+0000 7f18d3726800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:46.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=0 2024-09-12T00:21:46.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=1 2024-09-12T00:21:46.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=2 2024-09-12T00:21:46.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=3 2024-09-12T00:21:46.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=4 2024-09-12T00:21:46.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=5 2024-09-12T00:21:46.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=6 2024-09-12T00:21:46.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.393+0000 7f18d3726800 20 add_watcher() i=7 2024-09-12T00:21:46.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.393+0000 7f18d3726800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:46.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.395+0000 7f1785fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:46.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.395+0000 7f18d3726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:46.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.395+0000 7f18d3726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:46.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.395+0000 7f18d3726800 5 note: GC not initialized 2024-09-12T00:21:46.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.395+0000 7f1784fe1640 20 reqs_thread_entry: start 2024-09-12T00:21:46.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.395+0000 7f18d3726800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:46.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.396+0000 7f18d3726800 20 Filter name: none 2024-09-12T00:21:46.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.396+0000 7f16fe7fc640 20 reqs_thread_entry: start 2024-09-12T00:21:46.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.396+0000 7f18d3726800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:21:46.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.396+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.396+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:46.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.396+0000 7f18d3726800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:21:46.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.396+0000 7f18d3726800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:21:46.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.396+0000 7f18d3726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 : miss 2024-09-12T00:21:46.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.396+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.397+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:21:46.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.397+0000 7f18d3726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:21:46.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.397+0000 7f18d3726800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:21:46.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.397+0000 7f18d3726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:21:46.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.397+0000 7f18d3726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:46.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.397+0000 7f18d3726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 2024-09-12T00:21:46.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.400+0000 7f18d3726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:21:46.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.400+0000 7f18d3726800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:21:46.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.400+0000 7f18d3726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:46.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.400+0000 7f18d3726800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36, ofs0, ns] 2024-09-12T00:21:46.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.401+0000 7f17b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562454 cookie 93926226114176 notifier 7259 bl.length()=923 2024-09-12T00:21:46.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.401+0000 7f17b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:21:46.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.401+0000 7f17b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:21:46.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.401+0000 7f17b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:46.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.401+0000 7f18d3726800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): orig_sources= new_sources= 2024-09-12T00:21:46.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.401+0000 7f18d3726800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): potential sources added=[] removed=[] 2024-09-12T00:21:46.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.401+0000 7f18d3726800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): orig_dests= new_dests= 2024-09-12T00:21:46.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.401+0000 7f18d3726800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): potential dests added=[] removed=[] 2024-09-12T00:21:46.401 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f18d3726800 time 2024-09-12T00:21:46.404258+0000 2024-09-12T00:21:46.401 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:21:46.402 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:46.402 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f18d4d8c71a] 2024-09-12T00:21:46.402 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f18d4d8c8d8] 2024-09-12T00:21:46.403 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ce4b51641] 2024-09-12T00:21:46.403 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd8854c) [0x556ce506454c] 2024-09-12T00:21:46.403 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ce4b6131d] 2024-09-12T00:21:46.403 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:21:46.403 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f18d3a29590] 2024-09-12T00:21:46.403 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:21:46.403 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:21:46.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.403+0000 7f18d3726800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f18d3726800 time 2024-09-12T00:21:46.404258+0000 2024-09-12T00:21:46.403 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:21:46.403 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.403 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:46.403 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f18d4d8c71a] 2024-09-12T00:21:46.404 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f18d4d8c8d8] 2024-09-12T00:21:46.404 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ce4b51641] 2024-09-12T00:21:46.404 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd8854c) [0x556ce506454c] 2024-09-12T00:21:46.404 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ce4b6131d] 2024-09-12T00:21:46.404 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:21:46.404 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f18d3a29590] 2024-09-12T00:21:46.404 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:21:46.404 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:21:46.404 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.404 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:21:46.404 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f18d3726800 thread_name:radosgw-admin 2024-09-12T00:21:46.423 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:46.423 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f18d3a3e6f0] 2024-09-12T00:21:46.423 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f18d3a8b99c] 2024-09-12T00:21:46.423 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:21:46.423 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:21:46.423 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f18d4d8c774] 2024-09-12T00:21:46.423 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f18d4d8c8d8] 2024-09-12T00:21:46.423 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ce4b51641] 2024-09-12T00:21:46.423 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd8854c) [0x556ce506454c] 2024-09-12T00:21:46.423 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ce4b6131d] 2024-09-12T00:21:46.424 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:21:46.424 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f18d3a29590] 2024-09-12T00:21:46.424 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:21:46.424 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:21:46.424 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.404+0000 7f18d3726800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:21:46.424 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f18d3726800 thread_name:radosgw-admin 2024-09-12T00:21:46.424 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.424 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:46.424 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f18d3a3e6f0] 2024-09-12T00:21:46.424 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f18d3a8b99c] 2024-09-12T00:21:46.424 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:21:46.424 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:21:46.424 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f18d4d8c774] 2024-09-12T00:21:46.425 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f18d4d8c8d8] 2024-09-12T00:21:46.425 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ce4b51641] 2024-09-12T00:21:46.425 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd8854c) [0x556ce506454c] 2024-09-12T00:21:46.425 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ce4b6131d] 2024-09-12T00:21:46.425 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:21:46.425 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f18d3a29590] 2024-09-12T00:21:46.425 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:21:46.425 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:21:46.425 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:21:46.425 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.425 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:21:46.425 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.425 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:21:46.426 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: dump: 2024-09-12T00:21:46.426 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.426 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.426 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.426 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.426 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.426 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.426 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.426 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.426 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.426 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.426 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: _finish_auth 0 2024-09-12T00:21:46.426 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: _check_auth_tickets 2024-09-12T00:21:46.427 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:46.427 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.427 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:21:46.427 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: dump: 2024-09-12T00:21:46.427 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.427 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.427 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.427 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.427 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.427 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.427 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.427 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.427 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.428 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.428 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 monclient: authenticate success, global_id 7743 2024-09-12T00:21:46.428 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:21:46.146+0000 7f18d3726800 10 monclient: get_monmap_and_config success 2024-09-12T00:21:46.428 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:21:46.146+0000 7f18d3726800 4 set_mon_vals no callback set 2024-09-12T00:21:46.428 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:21:46.146+0000 7f18d3726800 10 monclient: shutdown 2024-09-12T00:21:46.428 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 asok(0x556ce725e630) unregister_commands rotate-key 2024-09-12T00:21:46.428 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:21:46.146+0000 7f18d3726800 10 monclient: build_initial_monmap 2024-09-12T00:21:46.428 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:21:46.146+0000 7f18d3726800 1 build_initial for_mkfs: 0 2024-09-12T00:21:46.428 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:21:46.146+0000 7f18d3726800 10 monclient: monmap: 2024-09-12T00:21:46.428 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:46.428 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:46.428 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:46.428 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:46.429 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:46.429 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.429 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:46.429 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:46.429 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:46.429 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.429 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding auth protocol: cephx 2024-09-12T00:21:46.429 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding auth protocol: cephx 2024-09-12T00:21:46.429 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding auth protocol: cephx 2024-09-12T00:21:46.429 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: secure 2024-09-12T00:21:46.429 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: crc 2024-09-12T00:21:46.429 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: secure 2024-09-12T00:21:46.429 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: crc 2024-09-12T00:21:46.430 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: secure 2024-09-12T00:21:46.430 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: crc 2024-09-12T00:21:46.430 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: crc 2024-09-12T00:21:46.430 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: secure 2024-09-12T00:21:46.430 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: crc 2024-09-12T00:21:46.430 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: secure 2024-09-12T00:21:46.430 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: crc 2024-09-12T00:21:46.430 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: secure 2024-09-12T00:21:46.430 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:21:46.147+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.430 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:21:46.147+0000 7f18d3726800 1 librados: starting msgr at 2024-09-12T00:21:46.430 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:21:46.147+0000 7f18d3726800 1 librados: starting objecter 2024-09-12T00:21:46.430 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 asok(0x556ce725e630) register_command objecter_requests hook 0x556ce7484bf0 2024-09-12T00:21:46.431 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:21:46.147+0000 7f18d3726800 1 librados: setting wanted keys 2024-09-12T00:21:46.431 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:21:46.147+0000 7f18d3726800 1 librados: calling monclient init 2024-09-12T00:21:46.431 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient: init 2024-09-12T00:21:46.431 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding auth protocol: cephx 2024-09-12T00:21:46.431 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding auth protocol: cephx 2024-09-12T00:21:46.431 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding auth protocol: cephx 2024-09-12T00:21:46.431 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: secure 2024-09-12T00:21:46.431 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: crc 2024-09-12T00:21:46.431 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: secure 2024-09-12T00:21:46.431 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: crc 2024-09-12T00:21:46.431 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: secure 2024-09-12T00:21:46.431 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: crc 2024-09-12T00:21:46.432 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: crc 2024-09-12T00:21:46.432 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: secure 2024-09-12T00:21:46.432 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: crc 2024-09-12T00:21:46.432 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: secure 2024-09-12T00:21:46.432 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: crc 2024-09-12T00:21:46.432 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: secure 2024-09-12T00:21:46.432 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:21:46.147+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.432 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:21:46.147+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.432 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 asok(0x556ce725e630) register_command rotate-key hook 0x556ce747d558 2024-09-12T00:21:46.432 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:46.432 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:21:46.432 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-c con 0x556ce7336d20 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:46.433 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-a con 0x556ce73c0870 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:46.433 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-b con 0x556ce73c71d0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:46.433 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.433 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.433 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.433 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:46.433 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): authenticate will time out at 1983.404780s 2024-09-12T00:21:46.433 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:21:46.147+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request con 0x556ce7336d20 auth_method 0 2024-09-12T00:21:46.433 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:21:46.147+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.433 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:21:46.147+0000 7f18cf3d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.433 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:21:46.147+0000 7f18cf3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.434 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:21:46.147+0000 7f18cebd8640 10 monclient(hunting): get_auth_request con 0x556ce73c0870 auth_method 0 2024-09-12T00:21:46.434 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:21:46.147+0000 7f18cebd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.434 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:21:46.147+0000 7f18cebd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.434 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:21:46.147+0000 7f18cebd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.434 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:21:46.147+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.434 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:21:46.147+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.434 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:21:46.147+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.434 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:21:46.147+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.434 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:21:46.147+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.434 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:21:46.148+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.434 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:21:46.148+0000 7f18cfbda640 10 monclient(hunting): get_auth_request con 0x556ce73c71d0 auth_method 0 2024-09-12T00:21:46.434 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:21:46.148+0000 7f18cfbda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.434 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:21:46.148+0000 7f18cfbda640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.435 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:21:46.148+0000 7f18cfbda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.435 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:21:46.148+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_done global_id 7250 payload 824 2024-09-12T00:21:46.435 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:21:46.148+0000 7f18cf3d9640 10 monclient: _finish_hunting 0 2024-09-12T00:21:46.435 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:21:46.148+0000 7f18cf3d9640 1 monclient: found mon.noname-c 2024-09-12T00:21:46.435 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:21:46.148+0000 7f18cf3d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.435 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.435 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:46.435 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: dump: 2024-09-12T00:21:46.435 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.435 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.435 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.435 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.435 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.436 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.436 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.436 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.436 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.436 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.436 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: _finish_auth 0 2024-09-12T00:21:46.436 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: _check_auth_tickets 2024-09-12T00:21:46.436 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:46.436 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.436 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:46.436 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: dump: 2024-09-12T00:21:46.436 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.436 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.437 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.437 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.437 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.437 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.437 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.437 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.437 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.437 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.437 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:21:46.148+0000 7f18d3726800 5 monclient: authenticate success, global_id 7250 2024-09-12T00:21:46.437 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:21:46.148+0000 7f18d3726800 10 monclient: _renew_subs 2024-09-12T00:21:46.437 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:21:46.148+0000 7f18d3726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.437 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:21:46.148+0000 7f17bd60a640 4 set_mon_vals no callback set 2024-09-12T00:21:46.438 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:21:46.148+0000 7f18d3726800 10 monclient: _renew_subs 2024-09-12T00:21:46.438 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:21:46.148+0000 7f18d3726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.438 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:21:46.148+0000 7f18d3726800 1 librados: init done 2024-09-12T00:21:46.438 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:21:46.150+0000 7f17bbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:21:46.438 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:21:46.150+0000 7f17bbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:46.438 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:21:46.150+0000 7f17bbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:46.438 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:21:46.150+0000 7f18cebd8640 10 monclient: get_auth_request con 0x7f17b40764a0 auth_method 0 2024-09-12T00:21:46.438 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:21:46.151+0000 7f18cfbda640 10 monclient: get_auth_request con 0x556ce74c8f80 auth_method 0 2024-09-12T00:21:46.438 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:21:46.151+0000 7f18cf3d9640 10 monclient: get_auth_request con 0x556ce74cc160 auth_method 0 2024-09-12T00:21:46.438 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:21:46.152+0000 7f18cebd8640 10 monclient: get_auth_request con 0x556ce74d0350 auth_method 0 2024-09-12T00:21:46.438 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:21:46.153+0000 7f18d3726800 10 monclient: build_initial_monmap 2024-09-12T00:21:46.438 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:21:46.153+0000 7f18d3726800 1 build_initial for_mkfs: 0 2024-09-12T00:21:46.439 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:21:46.153+0000 7f18d3726800 10 monclient: monmap: 2024-09-12T00:21:46.439 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:46.439 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:46.439 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:46.439 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:46.439 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:46.439 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.439 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:46.439 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:46.439 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:46.439 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.439 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding auth protocol: cephx 2024-09-12T00:21:46.439 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding auth protocol: cephx 2024-09-12T00:21:46.439 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding auth protocol: cephx 2024-09-12T00:21:46.440 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: secure 2024-09-12T00:21:46.440 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: crc 2024-09-12T00:21:46.440 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: secure 2024-09-12T00:21:46.440 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: crc 2024-09-12T00:21:46.440 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: secure 2024-09-12T00:21:46.440 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: crc 2024-09-12T00:21:46.440 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: crc 2024-09-12T00:21:46.440 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: secure 2024-09-12T00:21:46.440 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: crc 2024-09-12T00:21:46.440 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: secure 2024-09-12T00:21:46.440 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: crc 2024-09-12T00:21:46.440 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: secure 2024-09-12T00:21:46.440 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:21:46.154+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.441 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 asok(0x556ce725e630) register_command objecter_requests cmddesc objecter_requests hook 0x556ce74d8520 EEXIST 2024-09-12T00:21:46.441 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient: init 2024-09-12T00:21:46.441 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding auth protocol: cephx 2024-09-12T00:21:46.441 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding auth protocol: cephx 2024-09-12T00:21:46.441 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding auth protocol: cephx 2024-09-12T00:21:46.441 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: secure 2024-09-12T00:21:46.441 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: crc 2024-09-12T00:21:46.441 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: secure 2024-09-12T00:21:46.441 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: crc 2024-09-12T00:21:46.441 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: secure 2024-09-12T00:21:46.441 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: crc 2024-09-12T00:21:46.441 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: crc 2024-09-12T00:21:46.441 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: secure 2024-09-12T00:21:46.442 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: crc 2024-09-12T00:21:46.442 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: secure 2024-09-12T00:21:46.442 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: crc 2024-09-12T00:21:46.442 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: secure 2024-09-12T00:21:46.442 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:21:46.154+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.442 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:21:46.154+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.442 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 asok(0x556ce725e630) register_command rotate-key cmddesc rotate-key hook 0x556ce74d3880 EEXIST 2024-09-12T00:21:46.442 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:46.442 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:21:46.442 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-c con 0x556ce74fc840 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:46.442 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-b con 0x556ce74fcc20 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:46.442 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-a con 0x556ce74fb550 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:46.442 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.443 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.443 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.443 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:46.443 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): authenticate will time out at 1983.411963s 2024-09-12T00:21:46.443 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request con 0x556ce74fc840 auth_method 0 2024-09-12T00:21:46.443 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.443 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.443 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.443 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:21:46.155+0000 7f18cfbda640 10 monclient(hunting): get_auth_request con 0x556ce74fb550 auth_method 0 2024-09-12T00:21:46.443 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:21:46.155+0000 7f18cfbda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.444 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:21:46.155+0000 7f18cfbda640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.444 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:21:46.155+0000 7f18cfbda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.444 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.444 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.444 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.444 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:21:46.155+0000 7f18cfbda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.444 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:21:46.155+0000 7f18cfbda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.444 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:21:46.155+0000 7f18cfbda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.444 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:21:46.155+0000 7f18cebd8640 10 monclient(hunting): get_auth_request con 0x556ce74fcc20 auth_method 0 2024-09-12T00:21:46.444 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:21:46.155+0000 7f18cebd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.444 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:21:46.155+0000 7f18cebd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.444 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:21:46.155+0000 7f18cebd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.444 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:21:46.155+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.445 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:21:46.155+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.445 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:21:46.155+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.445 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_done global_id 7253 payload 824 2024-09-12T00:21:46.445 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient: _finish_hunting 0 2024-09-12T00:21:46.445 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 1 monclient: found mon.noname-c 2024-09-12T00:21:46.445 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.445 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.445 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:46.445 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: dump: 2024-09-12T00:21:46.445 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.445 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.445 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.446 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.446 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.446 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.446 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.446 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.446 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.446 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.446 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: _finish_auth 0 2024-09-12T00:21:46.446 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: _check_auth_tickets 2024-09-12T00:21:46.446 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:46.446 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.446 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:46.446 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: dump: 2024-09-12T00:21:46.447 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.447 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.447 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.447 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.447 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.447 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.447 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.447 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.447 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.447 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.447 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:21:46.155+0000 7f18d3726800 5 monclient: authenticate success, global_id 7253 2024-09-12T00:21:46.447 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:21:46.155+0000 7f18d3726800 10 monclient: _renew_subs 2024-09-12T00:21:46.448 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:21:46.155+0000 7f18d3726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.448 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:21:46.155+0000 7f18d03db640 4 set_mon_vals no callback set 2024-09-12T00:21:46.448 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:21:46.155+0000 7f18d3726800 10 monclient: _renew_subs 2024-09-12T00:21:46.448 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:21:46.155+0000 7f18d3726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.448 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:21:46.157+0000 7f17b9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:21:46.448 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:21:46.157+0000 7f17b9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:46.448 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:21:46.157+0000 7f17b9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:46.448 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:21:46.157+0000 7f18cebd8640 10 monclient: get_auth_request con 0x7f17a8076380 auth_method 0 2024-09-12T00:21:46.448 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:21:46.157+0000 7f18d3726800 10 monclient: get_monmap_and_config 2024-09-12T00:21:46.448 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:21:46.157+0000 7f18d3726800 10 monclient: build_initial_monmap 2024-09-12T00:21:46.448 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:21:46.157+0000 7f18d3726800 1 build_initial for_mkfs: 0 2024-09-12T00:21:46.448 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:21:46.157+0000 7f18d3726800 10 monclient: monmap: 2024-09-12T00:21:46.448 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:46.449 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:46.449 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.449 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding auth protocol: cephx 2024-09-12T00:21:46.449 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding auth protocol: cephx 2024-09-12T00:21:46.449 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding auth protocol: cephx 2024-09-12T00:21:46.449 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: secure 2024-09-12T00:21:46.450 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: crc 2024-09-12T00:21:46.450 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: secure 2024-09-12T00:21:46.450 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: crc 2024-09-12T00:21:46.450 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: secure 2024-09-12T00:21:46.450 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: crc 2024-09-12T00:21:46.450 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: crc 2024-09-12T00:21:46.450 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: secure 2024-09-12T00:21:46.450 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: crc 2024-09-12T00:21:46.450 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: secure 2024-09-12T00:21:46.450 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: crc 2024-09-12T00:21:46.450 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: secure 2024-09-12T00:21:46.450 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:21:46.157+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.450 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient: init 2024-09-12T00:21:46.451 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding auth protocol: cephx 2024-09-12T00:21:46.451 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding auth protocol: cephx 2024-09-12T00:21:46.451 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding auth protocol: cephx 2024-09-12T00:21:46.451 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: secure 2024-09-12T00:21:46.451 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: crc 2024-09-12T00:21:46.451 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: secure 2024-09-12T00:21:46.451 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: crc 2024-09-12T00:21:46.451 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: secure 2024-09-12T00:21:46.451 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: crc 2024-09-12T00:21:46.451 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: crc 2024-09-12T00:21:46.451 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: secure 2024-09-12T00:21:46.451 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: crc 2024-09-12T00:21:46.451 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: secure 2024-09-12T00:21:46.452 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: crc 2024-09-12T00:21:46.452 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: secure 2024-09-12T00:21:46.452 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:21:46.158+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.452 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:21:46.158+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.452 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 asok(0x556ce725e630) register_command rotate-key cmddesc rotate-key hook 0x7ffcfdf47cd8 EEXIST 2024-09-12T00:21:46.452 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:46.452 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:21:46.452 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-c con 0x556ce7550d50 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:46.452 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-a con 0x556ce7520b60 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:46.452 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-b con 0x556ce754c110 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:46.452 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.452 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.453 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.453 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:46.453 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): authenticate will time out at 1983.415614s 2024-09-12T00:21:46.453 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request con 0x556ce7550d50 auth_method 0 2024-09-12T00:21:46.453 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.453 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.453 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.453 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:21:46.158+0000 7f18cebd8640 10 monclient(hunting): get_auth_request con 0x556ce7520b60 auth_method 0 2024-09-12T00:21:46.453 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:21:46.158+0000 7f18cebd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.453 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:21:46.158+0000 7f18cebd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.453 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:21:46.158+0000 7f18cebd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.453 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.453 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.453 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.454 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:21:46.158+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.454 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:21:46.158+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.454 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:21:46.158+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.454 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_done global_id 7256 payload 274 2024-09-12T00:21:46.454 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient: _finish_hunting 0 2024-09-12T00:21:46.454 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 1 monclient: found mon.noname-c 2024-09-12T00:21:46.454 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.454 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.454 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:46.454 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: dump: 2024-09-12T00:21:46.454 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.454 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.455 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.455 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.455 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.455 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.455 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.455 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.455 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.455 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.455 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:21:46.455 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:21:46.455 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:46.455 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.455 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:46.455 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: dump: 2024-09-12T00:21:46.456 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.456 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.456 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.456 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.456 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.456 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.456 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.456 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.457 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.457 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.457 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 monclient: authenticate success, global_id 7256 2024-09-12T00:21:46.457 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:21:46.159+0000 7f18d3726800 10 monclient: get_monmap_and_config success 2024-09-12T00:21:46.457 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:21:46.159+0000 7f18d3726800 4 set_mon_vals no callback set 2024-09-12T00:21:46.457 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:21:46.159+0000 7f18d3726800 10 monclient: shutdown 2024-09-12T00:21:46.457 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:21:46.159+0000 7f18d3726800 10 monclient: build_initial_monmap 2024-09-12T00:21:46.457 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:21:46.159+0000 7f18d3726800 1 build_initial for_mkfs: 0 2024-09-12T00:21:46.457 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:21:46.159+0000 7f18d3726800 10 monclient: monmap: 2024-09-12T00:21:46.457 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:46.457 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:46.457 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:46.457 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:46.458 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:46.458 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.458 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:46.458 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:46.458 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:46.458 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.458 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding auth protocol: cephx 2024-09-12T00:21:46.458 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding auth protocol: cephx 2024-09-12T00:21:46.458 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding auth protocol: cephx 2024-09-12T00:21:46.458 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: secure 2024-09-12T00:21:46.458 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: crc 2024-09-12T00:21:46.458 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: secure 2024-09-12T00:21:46.458 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: crc 2024-09-12T00:21:46.459 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: secure 2024-09-12T00:21:46.459 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: crc 2024-09-12T00:21:46.459 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: crc 2024-09-12T00:21:46.459 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: secure 2024-09-12T00:21:46.459 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: crc 2024-09-12T00:21:46.459 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: secure 2024-09-12T00:21:46.459 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: crc 2024-09-12T00:21:46.459 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: secure 2024-09-12T00:21:46.459 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:21:46.160+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.459 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:21:46.160+0000 7f18d3726800 1 librados: starting msgr at 2024-09-12T00:21:46.459 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:21:46.160+0000 7f18d3726800 1 librados: starting objecter 2024-09-12T00:21:46.459 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 asok(0x556ce725e630) register_command objecter_requests cmddesc objecter_requests hook 0x556ce7522210 EEXIST 2024-09-12T00:21:46.460 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:21:46.160+0000 7f18d3726800 1 librados: setting wanted keys 2024-09-12T00:21:46.460 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:21:46.160+0000 7f18d3726800 1 librados: calling monclient init 2024-09-12T00:21:46.460 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient: init 2024-09-12T00:21:46.460 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding auth protocol: cephx 2024-09-12T00:21:46.460 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding auth protocol: cephx 2024-09-12T00:21:46.460 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding auth protocol: cephx 2024-09-12T00:21:46.460 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: secure 2024-09-12T00:21:46.460 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: crc 2024-09-12T00:21:46.460 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: secure 2024-09-12T00:21:46.460 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: crc 2024-09-12T00:21:46.460 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: secure 2024-09-12T00:21:46.460 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: crc 2024-09-12T00:21:46.460 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: crc 2024-09-12T00:21:46.461 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: secure 2024-09-12T00:21:46.461 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: crc 2024-09-12T00:21:46.461 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: secure 2024-09-12T00:21:46.461 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: crc 2024-09-12T00:21:46.461 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: secure 2024-09-12T00:21:46.461 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:21:46.160+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.461 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:21:46.160+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.461 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 asok(0x556ce725e630) register_command rotate-key cmddesc rotate-key hook 0x556ce7511248 EEXIST 2024-09-12T00:21:46.461 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:46.461 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:21:46.461 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-c con 0x556ce7520b60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:46.461 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-a con 0x556ce754c110 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:46.461 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-b con 0x556ce7550d50 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:46.462 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.462 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.462 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.462 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:46.462 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): authenticate will time out at 1983.417810s 2024-09-12T00:21:46.462 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:21:46.160+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request con 0x556ce7520b60 auth_method 0 2024-09-12T00:21:46.462 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:21:46.160+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.462 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:21:46.160+0000 7f18cf3d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.462 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:21:46.160+0000 7f18cf3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.462 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:21:46.160+0000 7f18cebd8640 10 monclient(hunting): get_auth_request con 0x556ce754c110 auth_method 0 2024-09-12T00:21:46.462 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:21:46.160+0000 7f18cebd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.462 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:21:46.160+0000 7f18cebd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.462 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:21:46.160+0000 7f18cebd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.463 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:21:46.160+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.463 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:21:46.160+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.463 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:21:46.160+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.463 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:21:46.160+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.463 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:21:46.160+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.463 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:21:46.161+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.463 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:21:46.161+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_done global_id 7259 payload 824 2024-09-12T00:21:46.463 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:21:46.161+0000 7f18cf3d9640 10 monclient: _finish_hunting 0 2024-09-12T00:21:46.463 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:21:46.161+0000 7f18cf3d9640 1 monclient: found mon.noname-c 2024-09-12T00:21:46.463 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:21:46.161+0000 7f18cf3d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.463 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:21:46.161+0000 7f18cfbda640 10 monclient: get_auth_request con 0x556ce7550d50 auth_method 0 2024-09-12T00:21:46.463 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.463 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:46.463 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: dump: 2024-09-12T00:21:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.464 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.464 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.464 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: _finish_auth 0 2024-09-12T00:21:46.464 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: _check_auth_tickets 2024-09-12T00:21:46.465 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:46.465 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.465 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:46.465 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: dump: 2024-09-12T00:21:46.465 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.465 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.465 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.465 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.465 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.465 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.465 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.465 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.466 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.466 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.466 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:21:46.161+0000 7f18d3726800 5 monclient: authenticate success, global_id 7259 2024-09-12T00:21:46.466 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:21:46.161+0000 7f17b2ffd640 4 set_mon_vals no callback set 2024-09-12T00:21:46.466 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:21:46.161+0000 7f18d3726800 10 monclient: _renew_subs 2024-09-12T00:21:46.466 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:21:46.161+0000 7f18d3726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.466 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:21:46.161+0000 7f18d3726800 10 monclient: _renew_subs 2024-09-12T00:21:46.466 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:21:46.161+0000 7f18d3726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.466 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:21:46.161+0000 7f18d3726800 1 librados: init done 2024-09-12T00:21:46.466 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:21:46.161+0000 7f18d3726800 5 asok(0x556ce725e630) register_command cr dump hook 0x556ce7546f08 2024-09-12T00:21:46.466 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:21:46.163+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.466 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:21:46.163+0000 7f17b17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:21:46.466 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:21:46.163+0000 7f17b17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:46.467 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:21:46.163+0000 7f17b17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:46.467 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:21:46.164+0000 7f18cebd8640 10 monclient: get_auth_request con 0x7f1798076470 auth_method 0 2024-09-12T00:21:46.467 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:21:46.164+0000 7f18cfbda640 10 monclient: get_auth_request con 0x556ce756a6b0 auth_method 0 2024-09-12T00:21:46.467 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.467 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:21:46.165+0000 7f18d3726800 20 realm 2024-09-12T00:21:46.467 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.467 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.467 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:21:46.165+0000 7f18d3726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:46.467 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.467 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.467 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.467 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:21:46.165+0000 7f18cf3d9640 10 monclient: get_auth_request con 0x556ce756e910 auth_method 0 2024-09-12T00:21:46.467 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:21:46.166+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:46.468 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:21:46.166+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.468 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:21:46.166+0000 7f18cebd8640 10 monclient: get_auth_request con 0x556ce7572170 auth_method 0 2024-09-12T00:21:46.468 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:21:46.167+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:46.468 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:21:46.167+0000 7f18d3726800 20 searching for the correct realm 2024-09-12T00:21:46.468 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:21:46.167+0000 7f18cfbda640 10 monclient: get_auth_request con 0x7f18c403a950 auth_method 0 2024-09-12T00:21:46.468 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:21:46.168+0000 7f18cf3d9640 10 monclient: get_auth_request con 0x7f18c006b070 auth_method 0 2024-09-12T00:21:46.468 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:21:46.170+0000 7f18cebd8640 10 monclient: get_auth_request con 0x7f18c40443c0 auth_method 0 2024-09-12T00:21:46.468 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:21:46.170+0000 7f18cebd8640 0 -- 172.21.15.67:0/1245695438 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f18c40443c0 msgr2=0x7f18c4044820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:46.468 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:21:46.372+0000 7f18cebd8640 10 monclient: get_auth_request con 0x7f18c40443c0 auth_method 0 2024-09-12T00:21:46.468 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:21:46.374+0000 7f18cfbda640 10 monclient: get_auth_request con 0x7f18c00655e0 auth_method 0 2024-09-12T00:21:46.468 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:21:46.375+0000 7f18cf3d9640 10 monclient: get_auth_request con 0x7f18c8028930 auth_method 0 2024-09-12T00:21:46.468 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:21:46.376+0000 7f18cfbda640 0 -- 172.21.15.67:0/1245695438 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x556ce756a6b0 msgr2=0x556ce756cb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:46.469 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:21:46.376+0000 7f17b17fa640 1 client.7259.objecter ms_handle_reset 0x556ce756a6b0 session 0x556ce756a030 osd.6 2024-09-12T00:21:46.469 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:21:46.376+0000 7f17b17fa640 10 monclient: _renew_subs 2024-09-12T00:21:46.469 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:21:46.376+0000 7f17b17fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.469 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:21:46.376+0000 7f18cfbda640 10 monclient: get_auth_request con 0x7f1798086790 auth_method 0 2024-09-12T00:21:46.469 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:46.469 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:46.469 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:46.469 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:46.469 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:46.469 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:46.469 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.469 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.470 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.470 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:46.470 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.470 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:46.470 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 zone default found 2024-09-12T00:21:46.470 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:21:46.382+0000 7f18d3726800 4 Realm: () 2024-09-12T00:21:46.470 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:21:46.382+0000 7f18d3726800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:46.470 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:21:46.382+0000 7f18d3726800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:46.470 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:21:46.382+0000 7f18d3726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:46.470 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 zonegroup default 2024-09-12T00:21:46.470 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.470 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.470 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.470 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:21:46.383+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.471 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:21:46.383+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.471 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:21:46.383+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.471 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:21:46.383+0000 7f18d3726800 20 started sync module instance, tier type = 2024-09-12T00:21:46.471 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:21:46.383+0000 7f18d3726800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:46.471 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=0 2024-09-12T00:21:46.471 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=1 2024-09-12T00:21:46.471 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=2 2024-09-12T00:21:46.471 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=3 2024-09-12T00:21:46.471 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=4 2024-09-12T00:21:46.471 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=5 2024-09-12T00:21:46.471 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=6 2024-09-12T00:21:46.471 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:21:46.393+0000 7f18d3726800 20 add_watcher() i=7 2024-09-12T00:21:46.471 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:21:46.393+0000 7f18d3726800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:46.472 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding auth protocol: cephx 2024-09-12T00:21:46.472 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding auth protocol: cephx 2024-09-12T00:21:46.472 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding auth protocol: cephx 2024-09-12T00:21:46.472 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: secure 2024-09-12T00:21:46.472 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: crc 2024-09-12T00:21:46.472 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: secure 2024-09-12T00:21:46.472 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: crc 2024-09-12T00:21:46.472 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: secure 2024-09-12T00:21:46.472 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: crc 2024-09-12T00:21:46.472 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: crc 2024-09-12T00:21:46.472 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: secure 2024-09-12T00:21:46.472 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:21:46.395+0000 7f1785fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:46.472 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: crc 2024-09-12T00:21:46.473 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: secure 2024-09-12T00:21:46.473 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: crc 2024-09-12T00:21:46.473 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: secure 2024-09-12T00:21:46.473 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:21:46.395+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.473 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:21:46.395+0000 7f18d3726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:46.473 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:21:46.395+0000 7f18d3726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:46.473 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command cache list hook 0x556ce7546db0 2024-09-12T00:21:46.473 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command cache inspect hook 0x556ce7546db0 2024-09-12T00:21:46.473 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command cache erase hook 0x556ce7546db0 2024-09-12T00:21:46.473 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command cache zap hook 0x556ce7546db0 2024-09-12T00:21:46.473 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 note: GC not initialized 2024-09-12T00:21:46.473 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:21:46.395+0000 7f1784fe1640 20 reqs_thread_entry: start 2024-09-12T00:21:46.473 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command sync trace show hook 0x7f18c4001410 2024-09-12T00:21:46.474 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command sync trace history hook 0x7f18c4001410 2024-09-12T00:21:46.474 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command sync trace active hook 0x7f18c4001410 2024-09-12T00:21:46.474 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command sync trace active_short hook 0x7f18c4001410 2024-09-12T00:21:46.474 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:21:46.395+0000 7f18d3726800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:46.474 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:21:46.396+0000 7f18d3726800 20 Filter name: none 2024-09-12T00:21:46.474 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:21:46.396+0000 7f16fe7fc640 20 reqs_thread_entry: start 2024-09-12T00:21:46.474 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:21:46.396+0000 7f18d3726800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:21:46.474 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:21:46.396+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.474 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:21:46.396+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:46.474 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:21:46.396+0000 7f18d3726800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:21:46.474 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:21:46.396+0000 7f18d3726800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:21:46.474 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:21:46.396+0000 7f18d3726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 : miss 2024-09-12T00:21:46.474 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:21:46.396+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.475 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:21:46.397+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:21:46.475 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:21:46.397+0000 7f18d3726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:21:46.475 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:21:46.397+0000 7f18d3726800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:21:46.475 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:21:46.397+0000 7f18d3726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:21:46.475 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:21:46.397+0000 7f18d3726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:46.475 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:21:46.397+0000 7f18d3726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 2024-09-12T00:21:46.475 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:21:46.400+0000 7f18d3726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:21:46.475 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:21:46.400+0000 7f18d3726800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:21:46.475 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:21:46.400+0000 7f18d3726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:46.475 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:21:46.400+0000 7f18d3726800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36, ofs0, ns] 2024-09-12T00:21:46.475 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:21:46.401+0000 7f17b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562454 cookie 93926226114176 notifier 7259 bl.length()=923 2024-09-12T00:21:46.475 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:21:46.401+0000 7f17b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:21:46.475 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:21:46.401+0000 7f17b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:21:46.476 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:21:46.401+0000 7f17b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:46.476 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:21:46.401+0000 7f18d3726800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): orig_sources= new_sources= 2024-09-12T00:21:46.476 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:21:46.401+0000 7f18d3726800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): potential sources added=[] removed=[] 2024-09-12T00:21:46.476 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:21:46.401+0000 7f18d3726800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): orig_dests= new_dests= 2024-09-12T00:21:46.476 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:21:46.401+0000 7f18d3726800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): potential dests added=[] removed=[] 2024-09-12T00:21:46.476 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:21:46.403+0000 7f18d3726800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f18d3726800 time 2024-09-12T00:21:46.404258+0000 2024-09-12T00:21:46.476 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:21:46.476 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.476 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:46.476 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f18d4d8c71a] 2024-09-12T00:21:46.476 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f18d4d8c8d8] 2024-09-12T00:21:46.476 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ce4b51641] 2024-09-12T00:21:46.476 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd8854c) [0x556ce506454c] 2024-09-12T00:21:46.477 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ce4b6131d] 2024-09-12T00:21:46.477 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:21:46.477 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f18d3a29590] 2024-09-12T00:21:46.477 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:21:46.477 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:21:46.477 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.477 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:21:46.404+0000 7f18d3726800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:21:46.477 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f18d3726800 thread_name:radosgw-admin 2024-09-12T00:21:46.477 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.477 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:46.477 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f18d3a3e6f0] 2024-09-12T00:21:46.477 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f18d3a8b99c] 2024-09-12T00:21:46.477 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:21:46.478 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:21:46.478 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f18d4d8c774] 2024-09-12T00:21:46.478 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f18d4d8c8d8] 2024-09-12T00:21:46.478 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ce4b51641] 2024-09-12T00:21:46.478 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd8854c) [0x556ce506454c] 2024-09-12T00:21:46.478 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ce4b6131d] 2024-09-12T00:21:46.478 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:21:46.478 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f18d3a29590] 2024-09-12T00:21:46.478 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:21:46.478 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:21:46.478 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:21:46.478 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.478 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:21:46.479 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:21:46.479 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:21:46.479 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:21:46.479 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:21:46.479 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:21:46.479 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:21:46.479 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:21:46.479 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:21:46.479 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:21:46.479 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:21:46.479 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:21:46.479 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:21:46.479 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:21:46.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:21:46.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:21:46.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:21:46.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:21:46.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:21:46.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:21:46.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:21:46.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:21:46.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:21:46.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:21:46.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:21:46.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:21:46.480 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:21:46.480 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:21:46.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:21:46.481 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:21:46.481 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:21:46.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:21:46.481 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:21:46.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:21:46.481 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:21:46.481 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:21:46.481 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:21:46.481 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:21:46.481 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:21:46.481 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:21:46.481 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:21:46.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:21:46.482 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:21:46.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:21:46.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:21:46.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:21:46.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:21:46.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:21:46.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:21:46.482 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:21:46.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:21:46.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:21:46.482 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:21:46.483 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:21:46.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:21:46.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:21:46.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:21:46.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:21:46.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:21:46.483 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:21:46.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:21:46.483 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:21:46.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:21:46.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:21:46.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:21:46.483 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:21:46.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:21:46.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:21:46.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:21:46.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:21:46.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:21:46.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:21:46.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:21:46.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:21:46.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:21:46.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:21:46.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:21:46.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:21:46.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:21:46.484 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:21:46.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:21:46.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:21:46.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:21:46.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:21:46.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:21:46.485 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:21:46.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:21:46.485 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:21:46.485 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:21:46.485 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:21:46.485 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:21:46.485 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:21:46.485 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:21:46.485 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:21:46.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f16fe7fc640 / http_manager 2024-09-12T00:21:46.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1784fe1640 / http_manager 2024-09-12T00:21:46.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1785fe3640 / rgw_dt_lg_renew 2024-09-12T00:21:46.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f17b17fa640 / ms_dispatch 2024-09-12T00:21:46.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f17b2ffd640 / io_context_pool 2024-09-12T00:21:46.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f17b9602640 / ms_dispatch 2024-09-12T00:21:46.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f17bbe07640 / ms_dispatch 2024-09-12T00:21:46.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f17bd60a640 / io_context_pool 2024-09-12T00:21:46.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f18cebd8640 / msgr-worker-2 2024-09-12T00:21:46.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f18cf3d9640 / msgr-worker-1 2024-09-12T00:21:46.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f18cfbda640 / msgr-worker-0 2024-09-12T00:21:46.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f18d03db640 / io_context_pool 2024-09-12T00:21:46.486 INFO:tasks.workunit.client.0.smithi067.stderr: 7f18d3726800 / radosgw-admin 2024-09-12T00:21:46.487 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:21:46.487 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:21:46.487 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.134082.log 2024-09-12T00:21:46.487 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:21:46.487 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:21:46.487 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.487 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:21:46.487 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: dump: 2024-09-12T00:21:46.487 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.487 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.487 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.487 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.488 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.488 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.488 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.488 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.488 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.488 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.488 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: _finish_auth 0 2024-09-12T00:21:46.488 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: _check_auth_tickets 2024-09-12T00:21:46.488 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:46.488 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.488 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:21:46.488 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:21:46.145+0000 7f17bd60a640 10 monclient: dump: 2024-09-12T00:21:46.488 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.488 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.489 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.489 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.489 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.489 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.489 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.489 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.489 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.489 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.489 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 monclient: authenticate success, global_id 7743 2024-09-12T00:21:46.489 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:21:46.146+0000 7f18d3726800 10 monclient: get_monmap_and_config success 2024-09-12T00:21:46.489 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:21:46.146+0000 7f18d3726800 4 set_mon_vals no callback set 2024-09-12T00:21:46.489 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:21:46.146+0000 7f18d3726800 10 monclient: shutdown 2024-09-12T00:21:46.489 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 asok(0x556ce725e630) unregister_commands rotate-key 2024-09-12T00:21:46.490 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:21:46.146+0000 7f18d3726800 10 monclient: build_initial_monmap 2024-09-12T00:21:46.490 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:21:46.146+0000 7f18d3726800 1 build_initial for_mkfs: 0 2024-09-12T00:21:46.490 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:21:46.146+0000 7f18d3726800 10 monclient: monmap: 2024-09-12T00:21:46.490 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:46.490 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:46.490 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:46.490 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:46.490 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:46.490 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.490 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:46.490 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:46.490 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:46.490 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.491 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding auth protocol: cephx 2024-09-12T00:21:46.491 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding auth protocol: cephx 2024-09-12T00:21:46.491 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding auth protocol: cephx 2024-09-12T00:21:46.491 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: secure 2024-09-12T00:21:46.491 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: crc 2024-09-12T00:21:46.491 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: secure 2024-09-12T00:21:46.491 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: crc 2024-09-12T00:21:46.491 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: secure 2024-09-12T00:21:46.491 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: crc 2024-09-12T00:21:46.491 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: crc 2024-09-12T00:21:46.491 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: secure 2024-09-12T00:21:46.491 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: crc 2024-09-12T00:21:46.491 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: secure 2024-09-12T00:21:46.492 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: crc 2024-09-12T00:21:46.492 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:21:46.146+0000 7f18d3726800 5 AuthRegistry(0x556ce7483130) adding con mode: secure 2024-09-12T00:21:46.492 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:21:46.147+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.492 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:21:46.147+0000 7f18d3726800 1 librados: starting msgr at 2024-09-12T00:21:46.492 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:21:46.147+0000 7f18d3726800 1 librados: starting objecter 2024-09-12T00:21:46.492 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 asok(0x556ce725e630) register_command objecter_requests hook 0x556ce7484bf0 2024-09-12T00:21:46.492 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:21:46.147+0000 7f18d3726800 1 librados: setting wanted keys 2024-09-12T00:21:46.492 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:21:46.147+0000 7f18d3726800 1 librados: calling monclient init 2024-09-12T00:21:46.492 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient: init 2024-09-12T00:21:46.492 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding auth protocol: cephx 2024-09-12T00:21:46.492 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding auth protocol: cephx 2024-09-12T00:21:46.492 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding auth protocol: cephx 2024-09-12T00:21:46.492 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: secure 2024-09-12T00:21:46.493 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: crc 2024-09-12T00:21:46.493 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: secure 2024-09-12T00:21:46.493 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: crc 2024-09-12T00:21:46.493 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: secure 2024-09-12T00:21:46.493 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: crc 2024-09-12T00:21:46.493 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: crc 2024-09-12T00:21:46.493 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: secure 2024-09-12T00:21:46.493 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: crc 2024-09-12T00:21:46.493 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: secure 2024-09-12T00:21:46.493 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: crc 2024-09-12T00:21:46.493 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 AuthRegistry(0x556ce747d410) adding con mode: secure 2024-09-12T00:21:46.493 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:21:46.147+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.493 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:21:46.147+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.494 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:21:46.147+0000 7f18d3726800 5 asok(0x556ce725e630) register_command rotate-key hook 0x556ce747d558 2024-09-12T00:21:46.494 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:46.494 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:21:46.494 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-c con 0x556ce7336d20 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:46.494 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-a con 0x556ce73c0870 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:46.494 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-b con 0x556ce73c71d0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:46.494 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.494 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.494 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.494 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:46.494 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:21:46.147+0000 7f18d3726800 10 monclient(hunting): authenticate will time out at 1983.404780s 2024-09-12T00:21:46.494 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:21:46.147+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request con 0x556ce7336d20 auth_method 0 2024-09-12T00:21:46.494 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:21:46.147+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.494 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:21:46.147+0000 7f18cf3d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.495 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:21:46.147+0000 7f18cf3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.495 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:21:46.147+0000 7f18cebd8640 10 monclient(hunting): get_auth_request con 0x556ce73c0870 auth_method 0 2024-09-12T00:21:46.495 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:21:46.147+0000 7f18cebd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.495 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:21:46.147+0000 7f18cebd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.495 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:21:46.147+0000 7f18cebd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.495 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:21:46.147+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.495 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:21:46.147+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.495 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:21:46.147+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.495 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:21:46.147+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.495 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:21:46.147+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.495 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:21:46.148+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.495 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:21:46.148+0000 7f18cfbda640 10 monclient(hunting): get_auth_request con 0x556ce73c71d0 auth_method 0 2024-09-12T00:21:46.495 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:21:46.148+0000 7f18cfbda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.496 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:21:46.148+0000 7f18cfbda640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.496 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:21:46.148+0000 7f18cfbda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.496 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:21:46.148+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_done global_id 7250 payload 824 2024-09-12T00:21:46.496 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:21:46.148+0000 7f18cf3d9640 10 monclient: _finish_hunting 0 2024-09-12T00:21:46.496 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:21:46.148+0000 7f18cf3d9640 1 monclient: found mon.noname-c 2024-09-12T00:21:46.496 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:21:46.148+0000 7f18cf3d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.496 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.496 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:46.496 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: dump: 2024-09-12T00:21:46.496 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.496 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.496 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.496 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.497 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.497 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.497 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.497 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.497 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.497 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.497 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: _finish_auth 0 2024-09-12T00:21:46.497 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: _check_auth_tickets 2024-09-12T00:21:46.497 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:46.497 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.497 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:46.497 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:21:46.148+0000 7f17bbe07640 10 monclient: dump: 2024-09-12T00:21:46.497 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.497 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.498 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.498 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.498 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.498 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.498 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.498 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.498 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.498 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.498 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:21:46.148+0000 7f18d3726800 5 monclient: authenticate success, global_id 7250 2024-09-12T00:21:46.498 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:21:46.148+0000 7f18d3726800 10 monclient: _renew_subs 2024-09-12T00:21:46.498 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:21:46.148+0000 7f18d3726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.498 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:21:46.148+0000 7f17bd60a640 4 set_mon_vals no callback set 2024-09-12T00:21:46.498 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:21:46.148+0000 7f18d3726800 10 monclient: _renew_subs 2024-09-12T00:21:46.499 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:21:46.148+0000 7f18d3726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.499 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:21:46.148+0000 7f18d3726800 1 librados: init done 2024-09-12T00:21:46.499 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:21:46.150+0000 7f17bbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:21:46.499 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:21:46.150+0000 7f17bbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:46.499 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:21:46.150+0000 7f17bbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:46.499 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:21:46.150+0000 7f18cebd8640 10 monclient: get_auth_request con 0x7f17b40764a0 auth_method 0 2024-09-12T00:21:46.499 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:21:46.151+0000 7f18cfbda640 10 monclient: get_auth_request con 0x556ce74c8f80 auth_method 0 2024-09-12T00:21:46.499 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:21:46.151+0000 7f18cf3d9640 10 monclient: get_auth_request con 0x556ce74cc160 auth_method 0 2024-09-12T00:21:46.499 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:21:46.152+0000 7f18cebd8640 10 monclient: get_auth_request con 0x556ce74d0350 auth_method 0 2024-09-12T00:21:46.499 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:21:46.153+0000 7f18d3726800 10 monclient: build_initial_monmap 2024-09-12T00:21:46.499 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:21:46.153+0000 7f18d3726800 1 build_initial for_mkfs: 0 2024-09-12T00:21:46.499 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:21:46.153+0000 7f18d3726800 10 monclient: monmap: 2024-09-12T00:21:46.500 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:46.500 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:46.500 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:46.500 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:46.500 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:46.500 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.500 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:46.500 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:46.500 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:46.500 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.500 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding auth protocol: cephx 2024-09-12T00:21:46.500 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding auth protocol: cephx 2024-09-12T00:21:46.501 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding auth protocol: cephx 2024-09-12T00:21:46.501 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: secure 2024-09-12T00:21:46.501 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: crc 2024-09-12T00:21:46.501 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: secure 2024-09-12T00:21:46.501 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: crc 2024-09-12T00:21:46.501 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: secure 2024-09-12T00:21:46.501 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: crc 2024-09-12T00:21:46.501 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: crc 2024-09-12T00:21:46.501 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: secure 2024-09-12T00:21:46.501 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: crc 2024-09-12T00:21:46.501 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: secure 2024-09-12T00:21:46.501 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: crc 2024-09-12T00:21:46.501 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:21:46.153+0000 7f18d3726800 5 AuthRegistry(0x556ce74d5010) adding con mode: secure 2024-09-12T00:21:46.502 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:21:46.154+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.502 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 asok(0x556ce725e630) register_command objecter_requests cmddesc objecter_requests hook 0x556ce74d8520 EEXIST 2024-09-12T00:21:46.502 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient: init 2024-09-12T00:21:46.502 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding auth protocol: cephx 2024-09-12T00:21:46.502 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding auth protocol: cephx 2024-09-12T00:21:46.502 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding auth protocol: cephx 2024-09-12T00:21:46.502 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: secure 2024-09-12T00:21:46.502 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: crc 2024-09-12T00:21:46.502 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: secure 2024-09-12T00:21:46.502 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: crc 2024-09-12T00:21:46.502 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: secure 2024-09-12T00:21:46.502 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: crc 2024-09-12T00:21:46.502 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: crc 2024-09-12T00:21:46.503 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: secure 2024-09-12T00:21:46.503 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: crc 2024-09-12T00:21:46.503 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: secure 2024-09-12T00:21:46.503 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: crc 2024-09-12T00:21:46.503 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 AuthRegistry(0x556ce74d3738) adding con mode: secure 2024-09-12T00:21:46.503 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:21:46.154+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.503 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:21:46.154+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.503 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:21:46.154+0000 7f18d3726800 5 asok(0x556ce725e630) register_command rotate-key cmddesc rotate-key hook 0x556ce74d3880 EEXIST 2024-09-12T00:21:46.503 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:46.503 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:21:46.503 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-c con 0x556ce74fc840 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:46.503 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-b con 0x556ce74fcc20 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:46.503 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-a con 0x556ce74fb550 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:46.504 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.504 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.504 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.504 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:46.504 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:21:46.154+0000 7f18d3726800 10 monclient(hunting): authenticate will time out at 1983.411963s 2024-09-12T00:21:46.504 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request con 0x556ce74fc840 auth_method 0 2024-09-12T00:21:46.504 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.504 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.504 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.504 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:21:46.155+0000 7f18cfbda640 10 monclient(hunting): get_auth_request con 0x556ce74fb550 auth_method 0 2024-09-12T00:21:46.504 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:21:46.155+0000 7f18cfbda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.504 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:21:46.155+0000 7f18cfbda640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.504 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:21:46.155+0000 7f18cfbda640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.505 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.505 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.505 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.505 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:21:46.155+0000 7f18cfbda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.505 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:21:46.155+0000 7f18cfbda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.505 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:21:46.155+0000 7f18cfbda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.505 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:21:46.155+0000 7f18cebd8640 10 monclient(hunting): get_auth_request con 0x556ce74fcc20 auth_method 0 2024-09-12T00:21:46.505 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:21:46.155+0000 7f18cebd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.505 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:21:46.155+0000 7f18cebd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.505 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:21:46.155+0000 7f18cebd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.505 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:21:46.155+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.505 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:21:46.155+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.505 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:21:46.155+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.506 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_done global_id 7253 payload 824 2024-09-12T00:21:46.506 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient: _finish_hunting 0 2024-09-12T00:21:46.506 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 1 monclient: found mon.noname-c 2024-09-12T00:21:46.506 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:21:46.155+0000 7f18cf3d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.506 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.506 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:46.506 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: dump: 2024-09-12T00:21:46.506 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.506 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.506 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.506 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.506 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.506 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.506 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.507 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.507 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.507 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.507 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: _finish_auth 0 2024-09-12T00:21:46.507 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: _check_auth_tickets 2024-09-12T00:21:46.507 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:46.507 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.507 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:46.507 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:21:46.155+0000 7f17b9602640 10 monclient: dump: 2024-09-12T00:21:46.507 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.507 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.507 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.508 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.508 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.508 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.508 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.508 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.508 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.508 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.508 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:21:46.155+0000 7f18d3726800 5 monclient: authenticate success, global_id 7253 2024-09-12T00:21:46.508 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:21:46.155+0000 7f18d3726800 10 monclient: _renew_subs 2024-09-12T00:21:46.508 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:21:46.155+0000 7f18d3726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.508 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:21:46.155+0000 7f18d03db640 4 set_mon_vals no callback set 2024-09-12T00:21:46.508 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:21:46.155+0000 7f18d3726800 10 monclient: _renew_subs 2024-09-12T00:21:46.509 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:21:46.155+0000 7f18d3726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.509 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:21:46.157+0000 7f17b9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:21:46.509 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:21:46.157+0000 7f17b9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:46.509 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:21:46.157+0000 7f17b9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:46.509 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:21:46.157+0000 7f18cebd8640 10 monclient: get_auth_request con 0x7f17a8076380 auth_method 0 2024-09-12T00:21:46.509 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:21:46.157+0000 7f18d3726800 10 monclient: get_monmap_and_config 2024-09-12T00:21:46.509 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:21:46.157+0000 7f18d3726800 10 monclient: build_initial_monmap 2024-09-12T00:21:46.509 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:21:46.157+0000 7f18d3726800 1 build_initial for_mkfs: 0 2024-09-12T00:21:46.509 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:21:46.157+0000 7f18d3726800 10 monclient: monmap: 2024-09-12T00:21:46.509 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:46.509 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:46.509 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:46.509 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:46.510 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:46.510 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.510 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:46.510 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:46.510 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:46.510 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.510 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding auth protocol: cephx 2024-09-12T00:21:46.510 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding auth protocol: cephx 2024-09-12T00:21:46.510 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding auth protocol: cephx 2024-09-12T00:21:46.510 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: secure 2024-09-12T00:21:46.510 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: crc 2024-09-12T00:21:46.510 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: secure 2024-09-12T00:21:46.510 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: crc 2024-09-12T00:21:46.511 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: secure 2024-09-12T00:21:46.511 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: crc 2024-09-12T00:21:46.511 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: crc 2024-09-12T00:21:46.511 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: secure 2024-09-12T00:21:46.511 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: crc 2024-09-12T00:21:46.511 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: secure 2024-09-12T00:21:46.511 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: crc 2024-09-12T00:21:46.511 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:21:46.157+0000 7f18d3726800 5 AuthRegistry(0x556ce751c6b0) adding con mode: secure 2024-09-12T00:21:46.511 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:21:46.157+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.511 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient: init 2024-09-12T00:21:46.511 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding auth protocol: cephx 2024-09-12T00:21:46.511 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding auth protocol: cephx 2024-09-12T00:21:46.512 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding auth protocol: cephx 2024-09-12T00:21:46.512 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: secure 2024-09-12T00:21:46.512 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: crc 2024-09-12T00:21:46.512 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: secure 2024-09-12T00:21:46.512 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: crc 2024-09-12T00:21:46.512 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: secure 2024-09-12T00:21:46.512 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: crc 2024-09-12T00:21:46.512 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: crc 2024-09-12T00:21:46.512 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: secure 2024-09-12T00:21:46.512 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: crc 2024-09-12T00:21:46.512 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: secure 2024-09-12T00:21:46.512 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: crc 2024-09-12T00:21:46.512 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf47b90) adding con mode: secure 2024-09-12T00:21:46.512 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:21:46.158+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.513 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:21:46.158+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.513 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:21:46.158+0000 7f18d3726800 5 asok(0x556ce725e630) register_command rotate-key cmddesc rotate-key hook 0x7ffcfdf47cd8 EEXIST 2024-09-12T00:21:46.513 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:46.513 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:21:46.513 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-c con 0x556ce7550d50 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:46.513 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-a con 0x556ce7520b60 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:46.513 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-b con 0x556ce754c110 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:46.513 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.513 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.513 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.513 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:46.513 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:21:46.158+0000 7f18d3726800 10 monclient(hunting): authenticate will time out at 1983.415614s 2024-09-12T00:21:46.513 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request con 0x556ce7550d50 auth_method 0 2024-09-12T00:21:46.514 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.514 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.514 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.514 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:21:46.158+0000 7f18cebd8640 10 monclient(hunting): get_auth_request con 0x556ce7520b60 auth_method 0 2024-09-12T00:21:46.514 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:21:46.158+0000 7f18cebd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.514 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:21:46.158+0000 7f18cebd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.514 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:21:46.158+0000 7f18cebd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.514 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.514 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.514 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.514 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:21:46.158+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.514 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:21:46.158+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.515 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:21:46.158+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.515 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_done global_id 7256 payload 274 2024-09-12T00:21:46.515 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient: _finish_hunting 0 2024-09-12T00:21:46.515 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 1 monclient: found mon.noname-c 2024-09-12T00:21:46.515 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:21:46.158+0000 7f18cf3d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.515 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.515 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:46.515 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: dump: 2024-09-12T00:21:46.515 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.515 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.515 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.515 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.515 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.516 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.516 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.516 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.516 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.516 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.516 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:21:46.516 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:21:46.516 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:46.516 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.516 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:46.516 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:21:46.159+0000 7f17b2ffd640 10 monclient: dump: 2024-09-12T00:21:46.516 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.516 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.517 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.517 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.517 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.517 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.517 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.517 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.517 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.517 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.517 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 monclient: authenticate success, global_id 7256 2024-09-12T00:21:46.517 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:21:46.159+0000 7f18d3726800 10 monclient: get_monmap_and_config success 2024-09-12T00:21:46.517 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:21:46.159+0000 7f18d3726800 4 set_mon_vals no callback set 2024-09-12T00:21:46.517 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:21:46.159+0000 7f18d3726800 10 monclient: shutdown 2024-09-12T00:21:46.518 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:21:46.159+0000 7f18d3726800 10 monclient: build_initial_monmap 2024-09-12T00:21:46.518 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:21:46.159+0000 7f18d3726800 1 build_initial for_mkfs: 0 2024-09-12T00:21:46.518 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:21:46.159+0000 7f18d3726800 10 monclient: monmap: 2024-09-12T00:21:46.518 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:21:46.518 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:21:46.518 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:21:46.518 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:21:46.518 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:21:46.518 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.518 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:21:46.518 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:21:46.518 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:21:46.518 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.518 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding auth protocol: cephx 2024-09-12T00:21:46.519 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding auth protocol: cephx 2024-09-12T00:21:46.519 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding auth protocol: cephx 2024-09-12T00:21:46.519 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: secure 2024-09-12T00:21:46.519 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: crc 2024-09-12T00:21:46.519 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: secure 2024-09-12T00:21:46.519 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: crc 2024-09-12T00:21:46.519 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: secure 2024-09-12T00:21:46.519 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: crc 2024-09-12T00:21:46.519 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: crc 2024-09-12T00:21:46.519 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: secure 2024-09-12T00:21:46.519 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: crc 2024-09-12T00:21:46.519 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: secure 2024-09-12T00:21:46.519 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: crc 2024-09-12T00:21:46.520 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:21:46.159+0000 7f18d3726800 5 AuthRegistry(0x556ce7542fe0) adding con mode: secure 2024-09-12T00:21:46.520 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:21:46.160+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.520 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:21:46.160+0000 7f18d3726800 1 librados: starting msgr at 2024-09-12T00:21:46.520 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:21:46.160+0000 7f18d3726800 1 librados: starting objecter 2024-09-12T00:21:46.520 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 asok(0x556ce725e630) register_command objecter_requests cmddesc objecter_requests hook 0x556ce7522210 EEXIST 2024-09-12T00:21:46.520 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:21:46.160+0000 7f18d3726800 1 librados: setting wanted keys 2024-09-12T00:21:46.520 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:21:46.160+0000 7f18d3726800 1 librados: calling monclient init 2024-09-12T00:21:46.520 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient: init 2024-09-12T00:21:46.520 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding auth protocol: cephx 2024-09-12T00:21:46.520 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding auth protocol: cephx 2024-09-12T00:21:46.520 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding auth protocol: cephx 2024-09-12T00:21:46.520 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: secure 2024-09-12T00:21:46.521 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: crc 2024-09-12T00:21:46.521 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: secure 2024-09-12T00:21:46.521 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: crc 2024-09-12T00:21:46.521 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: secure 2024-09-12T00:21:46.521 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: crc 2024-09-12T00:21:46.521 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: crc 2024-09-12T00:21:46.521 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: secure 2024-09-12T00:21:46.521 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: crc 2024-09-12T00:21:46.521 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: secure 2024-09-12T00:21:46.521 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: crc 2024-09-12T00:21:46.521 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 AuthRegistry(0x556ce7511100) adding con mode: secure 2024-09-12T00:21:46.521 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:21:46.160+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.521 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:21:46.160+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.522 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:21:46.160+0000 7f18d3726800 5 asok(0x556ce725e630) register_command rotate-key cmddesc rotate-key hook 0x556ce7511248 EEXIST 2024-09-12T00:21:46.522 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient: _reopen_session rank -1 2024-09-12T00:21:46.522 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:21:46.522 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-c con 0x556ce7520b60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:21:46.522 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-a con 0x556ce754c110 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:21:46.522 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): picked mon.noname-b con 0x556ce7550d50 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:21:46.522 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.522 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.522 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): start opening mon connection 2024-09-12T00:21:46.522 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): _renew_subs 2024-09-12T00:21:46.522 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:21:46.160+0000 7f18d3726800 10 monclient(hunting): authenticate will time out at 1983.417810s 2024-09-12T00:21:46.522 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:21:46.160+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request con 0x556ce7520b60 auth_method 0 2024-09-12T00:21:46.522 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:21:46.160+0000 7f18cf3d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.522 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:21:46.160+0000 7f18cf3d9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.523 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:21:46.160+0000 7f18cf3d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.523 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:21:46.160+0000 7f18cebd8640 10 monclient(hunting): get_auth_request con 0x556ce754c110 auth_method 0 2024-09-12T00:21:46.523 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:21:46.160+0000 7f18cebd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:21:46.523 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:21:46.160+0000 7f18cebd8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:21:46.523 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:21:46.160+0000 7f18cebd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:21:46.523 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:21:46.160+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.523 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:21:46.160+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.523 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:21:46.160+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.523 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:21:46.160+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:21:46.523 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:21:46.160+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:21:46.523 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:21:46.161+0000 7f18cebd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:21:46.523 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:21:46.161+0000 7f18cf3d9640 10 monclient(hunting): handle_auth_done global_id 7259 payload 824 2024-09-12T00:21:46.523 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:21:46.161+0000 7f18cf3d9640 10 monclient: _finish_hunting 0 2024-09-12T00:21:46.524 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:21:46.161+0000 7f18cf3d9640 1 monclient: found mon.noname-c 2024-09-12T00:21:46.524 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:21:46.161+0000 7f18cf3d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.524 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:21:46.161+0000 7f18cfbda640 10 monclient: get_auth_request con 0x556ce7550d50 auth_method 0 2024-09-12T00:21:46.524 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.524 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:21:46.524 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: dump: 2024-09-12T00:21:46.524 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.524 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.524 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.524 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.524 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.524 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.524 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.525 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.525 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.525 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.525 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: _finish_auth 0 2024-09-12T00:21:46.525 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: _check_auth_tickets 2024-09-12T00:21:46.525 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:21:46.525 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:21:46.525 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:21:46.525 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:21:46.161+0000 7f17b17fa640 10 monclient: dump: 2024-09-12T00:21:46.525 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:21:46.525 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:21:46.525 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.525 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:21:46.525 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:21:46.526 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:21:46.526 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:21:46.526 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:21:46.526 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:21:46.526 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.526 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:21:46.161+0000 7f18d3726800 5 monclient: authenticate success, global_id 7259 2024-09-12T00:21:46.526 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:21:46.161+0000 7f17b2ffd640 4 set_mon_vals no callback set 2024-09-12T00:21:46.526 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:21:46.161+0000 7f18d3726800 10 monclient: _renew_subs 2024-09-12T00:21:46.526 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:21:46.161+0000 7f18d3726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.526 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:21:46.161+0000 7f18d3726800 10 monclient: _renew_subs 2024-09-12T00:21:46.526 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:21:46.161+0000 7f18d3726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.526 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:21:46.161+0000 7f18d3726800 1 librados: init done 2024-09-12T00:21:46.526 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:21:46.161+0000 7f18d3726800 5 asok(0x556ce725e630) register_command cr dump hook 0x556ce7546f08 2024-09-12T00:21:46.527 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:21:46.163+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.527 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:21:46.163+0000 7f17b17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:21:46.527 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:21:46.163+0000 7f17b17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:46.527 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:21:46.163+0000 7f17b17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:21:46.527 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:21:46.164+0000 7f18cebd8640 10 monclient: get_auth_request con 0x7f1798076470 auth_method 0 2024-09-12T00:21:46.527 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:21:46.164+0000 7f18cfbda640 10 monclient: get_auth_request con 0x556ce756a6b0 auth_method 0 2024-09-12T00:21:46.527 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.527 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:21:46.165+0000 7f18d3726800 20 realm 2024-09-12T00:21:46.527 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.527 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.527 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:21:46.165+0000 7f18d3726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:46.527 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.527 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.528 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:21:46.165+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.528 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:21:46.165+0000 7f18cf3d9640 10 monclient: get_auth_request con 0x556ce756e910 auth_method 0 2024-09-12T00:21:46.528 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:21:46.166+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:46.528 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:21:46.166+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.528 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:21:46.166+0000 7f18cebd8640 10 monclient: get_auth_request con 0x556ce7572170 auth_method 0 2024-09-12T00:21:46.528 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:21:46.167+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:46.528 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:21:46.167+0000 7f18d3726800 20 searching for the correct realm 2024-09-12T00:21:46.528 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:21:46.167+0000 7f18cfbda640 10 monclient: get_auth_request con 0x7f18c403a950 auth_method 0 2024-09-12T00:21:46.528 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:21:46.168+0000 7f18cf3d9640 10 monclient: get_auth_request con 0x7f18c006b070 auth_method 0 2024-09-12T00:21:46.528 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:21:46.170+0000 7f18cebd8640 10 monclient: get_auth_request con 0x7f18c40443c0 auth_method 0 2024-09-12T00:21:46.528 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:21:46.170+0000 7f18cebd8640 0 -- 172.21.15.67:0/1245695438 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f18c40443c0 msgr2=0x7f18c4044820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:46.528 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:21:46.372+0000 7f18cebd8640 10 monclient: get_auth_request con 0x7f18c40443c0 auth_method 0 2024-09-12T00:21:46.528 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:21:46.374+0000 7f18cfbda640 10 monclient: get_auth_request con 0x7f18c00655e0 auth_method 0 2024-09-12T00:21:46.529 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:21:46.375+0000 7f18cf3d9640 10 monclient: get_auth_request con 0x7f18c8028930 auth_method 0 2024-09-12T00:21:46.529 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:21:46.376+0000 7f18cfbda640 0 -- 172.21.15.67:0/1245695438 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x556ce756a6b0 msgr2=0x556ce756cb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:46.529 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:21:46.376+0000 7f17b17fa640 1 client.7259.objecter ms_handle_reset 0x556ce756a6b0 session 0x556ce756a030 osd.6 2024-09-12T00:21:46.529 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:21:46.376+0000 7f17b17fa640 10 monclient: _renew_subs 2024-09-12T00:21:46.529 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:21:46.376+0000 7f17b17fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:21:46.529 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:21:46.376+0000 7f18cfbda640 10 monclient: get_auth_request con 0x7f1798086790 auth_method 0 2024-09-12T00:21:46.529 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:46.529 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:46.529 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:46.529 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:46.529 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:46.529 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:46.529 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.530 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.530 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:21:46.381+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.530 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:46.530 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.530 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:46.530 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 zone default found 2024-09-12T00:21:46.530 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:21:46.382+0000 7f18d3726800 4 Realm: () 2024-09-12T00:21:46.530 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:21:46.382+0000 7f18d3726800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:46.530 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:21:46.382+0000 7f18d3726800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:46.530 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:21:46.382+0000 7f18d3726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:46.530 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 zonegroup default 2024-09-12T00:21:46.530 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.530 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.531 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:21:46.382+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.531 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:21:46.383+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.531 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:21:46.383+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.531 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:21:46.383+0000 7f18d3726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.531 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:21:46.383+0000 7f18d3726800 20 started sync module instance, tier type = 2024-09-12T00:21:46.531 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:21:46.383+0000 7f18d3726800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:46.531 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=0 2024-09-12T00:21:46.531 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=1 2024-09-12T00:21:46.531 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=2 2024-09-12T00:21:46.531 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=3 2024-09-12T00:21:46.531 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=4 2024-09-12T00:21:46.531 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=5 2024-09-12T00:21:46.531 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:21:46.392+0000 7f18d3726800 20 add_watcher() i=6 2024-09-12T00:21:46.532 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:21:46.393+0000 7f18d3726800 20 add_watcher() i=7 2024-09-12T00:21:46.532 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:21:46.393+0000 7f18d3726800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:46.532 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding auth protocol: cephx 2024-09-12T00:21:46.532 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding auth protocol: cephx 2024-09-12T00:21:46.532 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding auth protocol: cephx 2024-09-12T00:21:46.532 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: secure 2024-09-12T00:21:46.532 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: crc 2024-09-12T00:21:46.532 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: secure 2024-09-12T00:21:46.532 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: crc 2024-09-12T00:21:46.532 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: secure 2024-09-12T00:21:46.532 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: crc 2024-09-12T00:21:46.532 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: crc 2024-09-12T00:21:46.532 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: secure 2024-09-12T00:21:46.533 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:21:46.395+0000 7f1785fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:46.533 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: crc 2024-09-12T00:21:46.533 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: secure 2024-09-12T00:21:46.533 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: crc 2024-09-12T00:21:46.533 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 AuthRegistry(0x7ffcfdf48070) adding con mode: secure 2024-09-12T00:21:46.533 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:21:46.395+0000 7f18d3726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:21:46.533 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:21:46.395+0000 7f18d3726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:46.533 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:21:46.395+0000 7f18d3726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:46.533 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command cache list hook 0x556ce7546db0 2024-09-12T00:21:46.533 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command cache inspect hook 0x556ce7546db0 2024-09-12T00:21:46.533 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command cache erase hook 0x556ce7546db0 2024-09-12T00:21:46.533 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command cache zap hook 0x556ce7546db0 2024-09-12T00:21:46.533 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 note: GC not initialized 2024-09-12T00:21:46.534 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:21:46.395+0000 7f1784fe1640 20 reqs_thread_entry: start 2024-09-12T00:21:46.534 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command sync trace show hook 0x7f18c4001410 2024-09-12T00:21:46.534 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command sync trace history hook 0x7f18c4001410 2024-09-12T00:21:46.534 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command sync trace active hook 0x7f18c4001410 2024-09-12T00:21:46.534 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:21:46.395+0000 7f18d3726800 5 asok(0x556ce725e630) register_command sync trace active_short hook 0x7f18c4001410 2024-09-12T00:21:46.534 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:21:46.395+0000 7f18d3726800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:46.534 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:21:46.396+0000 7f18d3726800 20 Filter name: none 2024-09-12T00:21:46.534 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:21:46.396+0000 7f16fe7fc640 20 reqs_thread_entry: start 2024-09-12T00:21:46.534 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:21:46.396+0000 7f18d3726800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:21:46.534 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:21:46.396+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.534 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:21:46.396+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:46.534 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:21:46.396+0000 7f18d3726800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:21:46.534 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:21:46.396+0000 7f18d3726800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:21:46.534 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:21:46.396+0000 7f18d3726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 : miss 2024-09-12T00:21:46.535 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:21:46.396+0000 7f18d3726800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.535 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:21:46.397+0000 7f18d3726800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:21:46.535 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:21:46.397+0000 7f18d3726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:21:46.535 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:21:46.397+0000 7f18d3726800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:21:46.535 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:21:46.397+0000 7f18d3726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:21:46.535 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:21:46.397+0000 7f18d3726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:46.535 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:21:46.397+0000 7f18d3726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 2024-09-12T00:21:46.535 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:21:46.400+0000 7f18d3726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:21:46.535 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:21:46.400+0000 7f18d3726800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:21:46.535 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:21:46.400+0000 7f18d3726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:46.535 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:21:46.400+0000 7f18d3726800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36, ofs0, ns] 2024-09-12T00:21:46.535 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:21:46.401+0000 7f17b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562454 cookie 93926226114176 notifier 7259 bl.length()=923 2024-09-12T00:21:46.535 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:21:46.401+0000 7f17b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:21:46.536 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:21:46.401+0000 7f17b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:21:46.536 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:21:46.401+0000 7f17b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:46.536 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:21:46.401+0000 7f18d3726800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): orig_sources= new_sources= 2024-09-12T00:21:46.536 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:21:46.401+0000 7f18d3726800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): potential sources added=[] removed=[] 2024-09-12T00:21:46.536 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:21:46.401+0000 7f18d3726800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): orig_dests= new_dests= 2024-09-12T00:21:46.536 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:21:46.401+0000 7f18d3726800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): potential dests added=[] removed=[] 2024-09-12T00:21:46.536 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:21:46.403+0000 7f18d3726800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f18d3726800 time 2024-09-12T00:21:46.404258+0000 2024-09-12T00:21:46.536 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:21:46.536 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.536 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:46.536 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f18d4d8c71a] 2024-09-12T00:21:46.536 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f18d4d8c8d8] 2024-09-12T00:21:46.536 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ce4b51641] 2024-09-12T00:21:46.537 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd8854c) [0x556ce506454c] 2024-09-12T00:21:46.537 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ce4b6131d] 2024-09-12T00:21:46.537 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:21:46.537 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f18d3a29590] 2024-09-12T00:21:46.537 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:21:46.537 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:21:46.537 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.537 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:21:46.404+0000 7f18d3726800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:21:46.537 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f18d3726800 thread_name:radosgw-admin 2024-09-12T00:21:46.537 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.537 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:21:46.537 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f18d3a3e6f0] 2024-09-12T00:21:46.537 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f18d3a8b99c] 2024-09-12T00:21:46.537 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:21:46.538 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:21:46.538 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f18d4d8c774] 2024-09-12T00:21:46.538 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f18d4d8c8d8] 2024-09-12T00:21:46.538 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556ce4b51641] 2024-09-12T00:21:46.538 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd8854c) [0x556ce506454c] 2024-09-12T00:21:46.538 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x556ce4b6131d] 2024-09-12T00:21:46.538 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:21:46.538 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f18d3a29590] 2024-09-12T00:21:46.538 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:21:46.538 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:21:46.538 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:21:46.538 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.538 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:21:46.539 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:21:46.539 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:21:46.539 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:21:46.539 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:21:46.539 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:21:46.539 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:21:46.539 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:21:46.539 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:21:46.539 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:21:46.539 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:21:46.539 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:21:46.539 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:21:46.539 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:21:46.539 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:21:46.540 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:21:46.540 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:21:46.540 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:21:46.540 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:21:46.540 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:21:46.540 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:21:46.540 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:21:46.540 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:21:46.540 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:21:46.540 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:21:46.540 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:21:46.540 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:21:46.540 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:21:46.541 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:21:46.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:21:46.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:21:46.541 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:21:46.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:21:46.541 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:21:46.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:21:46.541 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:21:46.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:21:46.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:21:46.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:21:46.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:21:46.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:21:46.541 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:21:46.542 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:21:46.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:21:46.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:21:46.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:21:46.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:21:46.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:21:46.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:21:46.542 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:21:46.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:21:46.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:21:46.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:21:46.542 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:21:46.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:21:46.542 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:21:46.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:21:46.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:21:46.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:21:46.543 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:21:46.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:21:46.543 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:21:46.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:21:46.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:21:46.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:21:46.543 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:21:46.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:21:46.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:21:46.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:21:46.543 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:21:46.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:21:46.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:21:46.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:21:46.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:21:46.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:21:46.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:21:46.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:21:46.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:21:46.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:21:46.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:21:46.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:21:46.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:21:46.544 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:21:46.545 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:21:46.545 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:21:46.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:21:46.545 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:21:46.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:21:46.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:21:46.545 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:21:46.545 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:21:46.545 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:21:46.545 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:21:46.545 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:21:46.545 INFO:tasks.workunit.client.0.smithi067.stderr: 7f16fe7fc640 / http_manager 2024-09-12T00:21:46.545 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1784fe1640 / http_manager 2024-09-12T00:21:46.545 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1785fe3640 / rgw_dt_lg_renew 2024-09-12T00:21:46.546 INFO:tasks.workunit.client.0.smithi067.stderr: 7f17b17fa640 / ms_dispatch 2024-09-12T00:21:46.546 INFO:tasks.workunit.client.0.smithi067.stderr: 7f17b2ffd640 / io_context_pool 2024-09-12T00:21:46.546 INFO:tasks.workunit.client.0.smithi067.stderr: 7f17b9602640 / ms_dispatch 2024-09-12T00:21:46.546 INFO:tasks.workunit.client.0.smithi067.stderr: 7f17bbe07640 / ms_dispatch 2024-09-12T00:21:46.546 INFO:tasks.workunit.client.0.smithi067.stderr: 7f17bd60a640 / io_context_pool 2024-09-12T00:21:46.546 INFO:tasks.workunit.client.0.smithi067.stderr: 7f18cebd8640 / msgr-worker-2 2024-09-12T00:21:46.546 INFO:tasks.workunit.client.0.smithi067.stderr: 7f18cf3d9640 / msgr-worker-1 2024-09-12T00:21:46.546 INFO:tasks.workunit.client.0.smithi067.stderr: 7f18cfbda640 / msgr-worker-0 2024-09-12T00:21:46.546 INFO:tasks.workunit.client.0.smithi067.stderr: 7f18d03db640 / io_context_pool 2024-09-12T00:21:46.546 INFO:tasks.workunit.client.0.smithi067.stderr: 7f18d3726800 / radosgw-admin 2024-09-12T00:21:46.546 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:21:46.546 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:21:46.546 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:21:46.405928Z_dfaa6d39-dd89-4bc7-b8e0-b41c3b9cbe62/log 2024-09-12T00:21:46.546 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:21:46.547 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:21:46.548 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:46.548 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:46.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.482+0000 7f74fdbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.484+0000 7f74fdbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.484+0000 7f74fdbaf800 20 realm 2024-09-12T00:21:46.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.484+0000 7f74fdbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.484+0000 7f74fdbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.484+0000 7f74fdbaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:46.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.484+0000 7f74fdbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.484+0000 7f74fdbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.484+0000 7f74fdbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.485+0000 7f74fdbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:46.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.485+0000 7f74fdbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.486+0000 7f74fdbaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:46.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.486+0000 7f74fdbaf800 20 searching for the correct realm 2024-09-12T00:21:46.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.488+0000 7f74fae98640 0 -- 172.21.15.67:0/1365297245 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f74f001f940 msgr2=0x7f74f001d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:46.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.693+0000 7f74fae98640 0 -- 172.21.15.67:0/1365297245 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55584858c350 msgr2=0x55584858e810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:46.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.697+0000 7f74fdbaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:46.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.697+0000 7f74fdbaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:46.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.697+0000 7f74fdbaf800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:46.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.697+0000 7f74fdbaf800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:46.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.697+0000 7f74fdbaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:46.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.697+0000 7f74fdbaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:46.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.697+0000 7f74fdbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.697+0000 7f74fdbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.697+0000 7f74fdbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.698+0000 7f74fdbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:46.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.698+0000 7f74fdbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.698+0000 7f74fdbaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:46.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.698+0000 7f74fdbaf800 20 zone default found 2024-09-12T00:21:46.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.698+0000 7f74fdbaf800 4 Realm: () 2024-09-12T00:21:46.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.698+0000 7f74fdbaf800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:46.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.698+0000 7f74fdbaf800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:46.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.698+0000 7f74fdbaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:46.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.698+0000 7f74fdbaf800 20 zonegroup default 2024-09-12T00:21:46.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.698+0000 7f74fdbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.698+0000 7f74fdbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.698+0000 7f74fdbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.699+0000 7f74fdbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.699+0000 7f74fdbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.699+0000 7f74fdbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.699+0000 7f74fdbaf800 20 started sync module instance, tier type = 2024-09-12T00:21:46.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.699+0000 7f74fdbaf800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:46.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.707+0000 7f74fdbaf800 20 add_watcher() i=0 2024-09-12T00:21:46.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.707+0000 7f74fdbaf800 20 add_watcher() i=1 2024-09-12T00:21:46.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.707+0000 7f74fdbaf800 20 add_watcher() i=2 2024-09-12T00:21:46.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.707+0000 7f74fdbaf800 20 add_watcher() i=3 2024-09-12T00:21:46.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.707+0000 7f74fdbaf800 20 add_watcher() i=4 2024-09-12T00:21:46.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.707+0000 7f74fdbaf800 20 add_watcher() i=5 2024-09-12T00:21:46.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.707+0000 7f74fdbaf800 20 add_watcher() i=6 2024-09-12T00:21:46.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.708+0000 7f74fdbaf800 20 add_watcher() i=7 2024-09-12T00:21:46.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.708+0000 7f74fdbaf800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:46.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.710+0000 7f73b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:46.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.711+0000 7f74fdbaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:46.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.711+0000 7f74fdbaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:46.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.711+0000 7f74fdbaf800 5 note: GC not initialized 2024-09-12T00:21:46.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.711+0000 7f73b0fe1640 20 reqs_thread_entry: start 2024-09-12T00:21:46.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.711+0000 7f74fdbaf800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:46.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.711+0000 7f74fdbaf800 20 Filter name: none 2024-09-12T00:21:46.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.711+0000 7f732a7fc640 20 reqs_thread_entry: start 2024-09-12T00:21:46.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.711+0000 7f74fdbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.711+0000 7f74fdbaf800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:46.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.711+0000 7f74fdbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.712+0000 7f74fdbaf800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:21:46.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.712+0000 7f74fdbaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:46.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.712+0000 7f74fdbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.712+0000 7f74fdbaf800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:46.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.712+0000 7f74fdbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.713+0000 7f74fdbaf800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:21:46.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.713+0000 7f74fdbaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:21:46.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.714+0000 7f73b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:46.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.716+0000 7f74fdbaf800 20 remove_watcher() i=0 2024-09-12T00:21:46.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.716+0000 7f74fdbaf800 2 removed watcher, disabling cache 2024-09-12T00:21:46.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.717+0000 7f74fdbaf800 20 remove_watcher() i=1 2024-09-12T00:21:46.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.718+0000 7f74fdbaf800 20 remove_watcher() i=2 2024-09-12T00:21:46.718 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.719+0000 7f74fdbaf800 20 remove_watcher() i=3 2024-09-12T00:21:46.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.720+0000 7f74fdbaf800 20 remove_watcher() i=4 2024-09-12T00:21:46.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.721+0000 7f74fdbaf800 20 remove_watcher() i=5 2024-09-12T00:21:46.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.722+0000 7f74fdbaf800 20 remove_watcher() i=6 2024-09-12T00:21:46.722 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.723+0000 7f74fdbaf800 20 remove_watcher() i=7 2024-09-12T00:21:46.733 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.733 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:21:46.733 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-logrecord-writes id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:21:46.733 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:21:46.786 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:21:46.819 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:46.819 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:46.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.859+0000 7efed5a98800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.861+0000 7efed5a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.861+0000 7efed5a98800 20 realm 2024-09-12T00:21:46.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.861+0000 7efed5a98800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.861+0000 7efed5a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.861+0000 7efed5a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:21:46.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.861+0000 7efed5a98800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.861+0000 7efed5a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.861+0000 7efed5a98800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.862+0000 7efed5a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:46.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.862+0000 7efed5a98800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.863+0000 7efed5a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:21:46.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.863+0000 7efed5a98800 20 searching for the correct realm 2024-09-12T00:21:46.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.866+0000 7efed3d83640 0 -- 172.21.15.67:0/3172122937 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7efec809f030 msgr2=0x7efec806cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:46.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.869+0000 7efed3582640 0 -- 172.21.15.67:0/3172122937 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7efecc023040 msgr2=0x7efecc024430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:21:46.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.872+0000 7efed5a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:21:46.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.872+0000 7efed5a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:21:46.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.872+0000 7efed5a98800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:21:46.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.872+0000 7efed5a98800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:21:46.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.872+0000 7efed5a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:21:46.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.872+0000 7efed5a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:21:46.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.872+0000 7efed5a98800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.873+0000 7efed5a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.873+0000 7efed5a98800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.873+0000 7efed5a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:21:46.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.873+0000 7efed5a98800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.873+0000 7efed5a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:21:46.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.873+0000 7efed5a98800 20 zone default found 2024-09-12T00:21:46.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.873+0000 7efed5a98800 4 Realm: () 2024-09-12T00:21:46.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.873+0000 7efed5a98800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:21:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.873+0000 7efed5a98800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:21:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.873+0000 7efed5a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:21:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.873+0000 7efed5a98800 20 zonegroup default 2024-09-12T00:21:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.873+0000 7efed5a98800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.874+0000 7efed5a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.874+0000 7efed5a98800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.874+0000 7efed5a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.874+0000 7efed5a98800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.874+0000 7efed5a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:21:46.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.874+0000 7efed5a98800 20 started sync module instance, tier type = 2024-09-12T00:21:46.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.874+0000 7efed5a98800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:21:46.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.882+0000 7efed5a98800 20 add_watcher() i=0 2024-09-12T00:21:46.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.882+0000 7efed5a98800 20 add_watcher() i=1 2024-09-12T00:21:46.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.882+0000 7efed5a98800 20 add_watcher() i=2 2024-09-12T00:21:46.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.882+0000 7efed5a98800 20 add_watcher() i=3 2024-09-12T00:21:46.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.882+0000 7efed5a98800 20 add_watcher() i=4 2024-09-12T00:21:46.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.882+0000 7efed5a98800 20 add_watcher() i=5 2024-09-12T00:21:46.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.882+0000 7efed5a98800 20 add_watcher() i=6 2024-09-12T00:21:46.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.883+0000 7efed5a98800 20 add_watcher() i=7 2024-09-12T00:21:46.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.883+0000 7efed5a98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:21:46.884 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.885+0000 7efd89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:46.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.885+0000 7efed5a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:21:46.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.885+0000 7efed5a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:21:46.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.885+0000 7efed5a98800 5 note: GC not initialized 2024-09-12T00:21:46.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.886+0000 7efd88fe1640 20 reqs_thread_entry: start 2024-09-12T00:21:46.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.886+0000 7efed5a98800 20 init_complete bucket index max shards: 1 2024-09-12T00:21:46.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.886+0000 7efed5a98800 20 Filter name: none 2024-09-12T00:21:46.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.886+0000 7efd027fc640 20 reqs_thread_entry: start 2024-09-12T00:21:46.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.886+0000 7efed5a98800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:21:46.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.886+0000 7efed5a98800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.886+0000 7efed5a98800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:21:46.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.886+0000 7efed5a98800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:21:46.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.886+0000 7efed5a98800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:21:46.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.886+0000 7efed5a98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 : miss 2024-09-12T00:21:46.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.886+0000 7efed5a98800 20 rados->read ofs=0 len=0 2024-09-12T00:21:46.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.887+0000 7efed5a98800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:21:46.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.887+0000 7efed5a98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:21:46.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.887+0000 7efed5a98800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:21:46.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.887+0000 7efed5a98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:21:46.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.887+0000 7efed5a98800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:21:46.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.887+0000 7efed5a98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 2024-09-12T00:21:46.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.888+0000 7efed5a98800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to be held by another RGW process; skipping for now 2024-09-12T00:21:46.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.889+0000 7efd89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:21:46.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.891+0000 7efed5a98800 20 remove_watcher() i=0 2024-09-12T00:21:46.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.891+0000 7efed5a98800 2 removed watcher, disabling cache 2024-09-12T00:21:46.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.892+0000 7efed5a98800 20 remove_watcher() i=1 2024-09-12T00:21:46.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.893+0000 7efed5a98800 20 remove_watcher() i=2 2024-09-12T00:21:46.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.894+0000 7efed5a98800 20 remove_watcher() i=3 2024-09-12T00:21:46.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.895+0000 7efed5a98800 20 remove_watcher() i=4 2024-09-12T00:21:46.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.896+0000 7efed5a98800 20 remove_watcher() i=5 2024-09-12T00:21:46.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.897+0000 7efed5a98800 20 remove_watcher() i=6 2024-09-12T00:21:46.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:21:46.898+0000 7efed5a98800 20 remove_watcher() i=7 2024-09-12T00:21:46.908 INFO:tasks.workunit.client.0.smithi067.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:22:16.937 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:22:16.973 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:16.974 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:17.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.019+0000 7f3ad3933800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.021+0000 7f3ad3933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.020 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.021+0000 7f3ad3933800 20 realm 2024-09-12T00:22:17.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.021+0000 7f3ad3933800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.021+0000 7f3ad3933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.021+0000 7f3ad3933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:17.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.021+0000 7f3ad3933800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.021+0000 7f3ad3933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.021 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.021+0000 7f3ad3933800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.224+0000 7f3ad3933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:17.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.224+0000 7f3ad3933800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.224 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.225+0000 7f3ad3933800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:17.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.225+0000 7f3ad3933800 20 searching for the correct realm 2024-09-12T00:22:17.227 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.228+0000 7f3acf61a640 0 -- 172.21.15.67:0/3727271676 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f3ac0029ba0 msgr2=0x7f3ac003a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:17.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.233+0000 7f3acf61a640 0 -- 172.21.15.67:0/3727271676 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f3ac8025040 msgr2=0x7f3ac80653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.441+0000 7f3ad3933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.441+0000 7f3ad3933800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.441+0000 7f3ad3933800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.441+0000 7f3ad3933800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.441+0000 7f3ad3933800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.441+0000 7f3ad3933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.441+0000 7f3ad3933800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.441+0000 7f3ad3933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.441+0000 7f3ad3933800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.442+0000 7f3ad3933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:17.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.442+0000 7f3ad3933800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.442+0000 7f3ad3933800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:17.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.442+0000 7f3ad3933800 20 zone default found 2024-09-12T00:22:17.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.442+0000 7f3ad3933800 4 Realm: () 2024-09-12T00:22:17.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.442+0000 7f3ad3933800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:17.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.442+0000 7f3ad3933800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:17.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.442+0000 7f3ad3933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:17.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.442+0000 7f3ad3933800 20 zonegroup default 2024-09-12T00:22:17.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.442+0000 7f3ad3933800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.442+0000 7f3ad3933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.442+0000 7f3ad3933800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.443+0000 7f3ad3933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.443+0000 7f3ad3933800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.443+0000 7f3ad3933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.443+0000 7f3ad3933800 20 started sync module instance, tier type = 2024-09-12T00:22:17.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.443+0000 7f3ad3933800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:17.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.454+0000 7f3ad3933800 20 add_watcher() i=0 2024-09-12T00:22:17.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.454+0000 7f3ad3933800 20 add_watcher() i=1 2024-09-12T00:22:17.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.454+0000 7f3ad3933800 20 add_watcher() i=2 2024-09-12T00:22:17.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.454+0000 7f3ad3933800 20 add_watcher() i=3 2024-09-12T00:22:17.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.454+0000 7f3ad3933800 20 add_watcher() i=4 2024-09-12T00:22:17.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.454+0000 7f3ad3933800 20 add_watcher() i=5 2024-09-12T00:22:17.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.454+0000 7f3ad3933800 20 add_watcher() i=6 2024-09-12T00:22:17.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.455+0000 7f3ad3933800 20 add_watcher() i=7 2024-09-12T00:22:17.455 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.455+0000 7f3ad3933800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:17.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.457+0000 7f3985fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:17.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.458+0000 7f3ad3933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:17.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.458+0000 7f3ad3933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:17.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.458+0000 7f3ad3933800 5 note: GC not initialized 2024-09-12T00:22:17.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.458+0000 7f3984fe1640 20 reqs_thread_entry: start 2024-09-12T00:22:17.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.458+0000 7f3ad3933800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:17.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.458+0000 7f3ad3933800 20 Filter name: none 2024-09-12T00:22:17.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.458+0000 7f38fe7fc640 20 reqs_thread_entry: start 2024-09-12T00:22:17.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.459+0000 7f3ad3933800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:22:17.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.459+0000 7f3ad3933800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.459+0000 7f3ad3933800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:22:17.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.459+0000 7f3ad3933800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:22:17.462 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.459+0000 7f3ad3933800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:22:17.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.459+0000 7f3ad3933800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 : miss 2024-09-12T00:22:17.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.459+0000 7f3ad3933800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.460+0000 7f3ad3933800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:22:17.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.460+0000 7f3ad3933800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:22:17.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.460+0000 7f3ad3933800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:22:17.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.460+0000 7f3ad3933800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:22:17.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.460+0000 7f3ad3933800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:17.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.460+0000 7f3ad3933800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 2024-09-12T00:22:17.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.461+0000 7f3ad3933800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:22:17.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.466+0000 7f3ad3933800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:22:17.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.466+0000 7f3ad3933800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:22:17.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.466+0000 7f3ad3933800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:17.466 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.466+0000 7f3ad3933800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36, ofs0, ns] 2024-09-12T00:22:17.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.466+0000 7f39b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562455 cookie 94455242748576 notifier 7815 bl.length()=923 2024-09-12T00:22:17.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.466+0000 7f39b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:22:17.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.466+0000 7f39b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:22:17.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.466+0000 7f39b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:17.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.467+0000 7f3ad3933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): orig_sources= new_sources= 2024-09-12T00:22:17.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.467+0000 7f3ad3933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): potential sources added=[] removed=[] 2024-09-12T00:22:17.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.467+0000 7f3ad3933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): orig_dests= new_dests= 2024-09-12T00:22:17.468 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.467+0000 7f3ad3933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): potential dests added=[] removed=[] 2024-09-12T00:22:17.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.469+0000 7f3ad3933800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36.2.0 2024-09-12T00:22:17.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.469+0000 7f3ad3933800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36.2.0 2024-09-12T00:22:17.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.469+0000 7f3ad3933800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36.2.1 2024-09-12T00:22:17.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.469+0000 7f3ad3933800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36.2.1 2024-09-12T00:22:17.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.469+0000 7f3ad3933800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36.0 2024-09-12T00:22:17.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.472+0000 7f3ad3933800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:22:17.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.472+0000 7f3ad3933800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 2024-09-12T00:22:17.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.474+0000 7f3ad3933800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:22:17.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.474+0000 7f3ad3933800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:22:17.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.474+0000 7f3ad3933800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:17.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.474+0000 7f3ad3933800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36, ofs0, ns] 2024-09-12T00:22:17.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.474+0000 7f39b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562456 cookie 94455242748576 notifier 7815 bl.length()=923 2024-09-12T00:22:17.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.474+0000 7f39b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:22:17.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.474+0000 7f39b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:22:17.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.474+0000 7f39b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:17.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.474+0000 7f3ad3933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): orig_sources= new_sources= 2024-09-12T00:22:17.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.474+0000 7f3ad3933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): potential sources added=[] removed=[] 2024-09-12T00:22:17.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.474+0000 7f3ad3933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): orig_dests= new_dests= 2024-09-12T00:22:17.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.474+0000 7f3ad3933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): potential dests added=[] removed=[] 2024-09-12T00:22:17.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.476+0000 7f3ad3933800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36.0 2024-09-12T00:22:17.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.476+0000 7f3ad3933800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:22:17.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.476+0000 7f3ad3933800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 2024-09-12T00:22:17.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.477+0000 7f3ad3933800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:22:17.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.477+0000 7f3ad3933800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:22:17.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.477+0000 7f3ad3933800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:17.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.477+0000 7f3ad3933800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36, ofs0, ns] 2024-09-12T00:22:17.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.477+0000 7f39b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562457 cookie 94455242748576 notifier 7815 bl.length()=891 2024-09-12T00:22:17.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.478+0000 7f39b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 info.flags=0x17 2024-09-12T00:22:17.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.478+0000 7f39b27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 to cache LRU end 2024-09-12T00:22:17.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.478+0000 7f39b27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:17.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.478+0000 7f3ad3933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): orig_sources= new_sources= 2024-09-12T00:22:17.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.478+0000 7f3ad3933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): potential sources added=[] removed=[] 2024-09-12T00:22:17.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.478+0000 7f3ad3933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): orig_dests= new_dests= 2024-09-12T00:22:17.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.478+0000 7f3ad3933800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36]): potential dests added=[] removed=[] 2024-09-12T00:22:17.478 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.479+0000 7f3ad3933800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:22:17.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.481+0000 7f3985fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:17.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.484+0000 7f3ad3933800 20 remove_watcher() i=0 2024-09-12T00:22:17.483 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.484+0000 7f3ad3933800 2 removed watcher, disabling cache 2024-09-12T00:22:17.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.485+0000 7f3ad3933800 20 remove_watcher() i=1 2024-09-12T00:22:17.485 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.486+0000 7f3ad3933800 20 remove_watcher() i=2 2024-09-12T00:22:17.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.487+0000 7f3ad3933800 20 remove_watcher() i=3 2024-09-12T00:22:17.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.488+0000 7f3ad3933800 20 remove_watcher() i=4 2024-09-12T00:22:17.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.489+0000 7f3ad3933800 20 remove_watcher() i=5 2024-09-12T00:22:17.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.490+0000 7f3ad3933800 20 remove_watcher() i=6 2024-09-12T00:22:17.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.491+0000 7f3ad3933800 20 remove_watcher() i=7 2024-09-12T00:22:17.505 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:22:17.535 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:17.535 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:17.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.577+0000 7f0cf6331800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.579+0000 7f0cf6331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.579+0000 7f0cf6331800 20 realm 2024-09-12T00:22:17.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.580+0000 7f0cf6331800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.580+0000 7f0cf6331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.580+0000 7f0cf6331800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:17.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.580+0000 7f0cf6331800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.580+0000 7f0cf6331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.580+0000 7f0cf6331800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.581+0000 7f0cf6331800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:17.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.581+0000 7f0cf6331800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.582+0000 7f0cf6331800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:17.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.582+0000 7f0cf6331800 20 searching for the correct realm 2024-09-12T00:22:17.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.585+0000 7f0cf1875640 0 -- 172.21.15.67:0/2383419293 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f0ce8076bd0 msgr2=0x7f0ce804f100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:17.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.588+0000 7f0cf2076640 0 -- 172.21.15.67:0/2383419293 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f0cec01a040 msgr2=0x7f0cec0054d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:17.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.592+0000 7f0cf6331800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:17.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.592+0000 7f0cf6331800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:17.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.592+0000 7f0cf6331800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:17.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.592+0000 7f0cf6331800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:17.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.592+0000 7f0cf6331800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:17.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.592+0000 7f0cf6331800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:17.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.592+0000 7f0cf6331800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.593+0000 7f0cf6331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.593+0000 7f0cf6331800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.593+0000 7f0cf6331800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:17.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.593+0000 7f0cf6331800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.593+0000 7f0cf6331800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:17.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.593+0000 7f0cf6331800 20 zone default found 2024-09-12T00:22:17.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.593+0000 7f0cf6331800 4 Realm: () 2024-09-12T00:22:17.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.593+0000 7f0cf6331800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:17.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.593+0000 7f0cf6331800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:17.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.593+0000 7f0cf6331800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:17.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.593+0000 7f0cf6331800 20 zonegroup default 2024-09-12T00:22:17.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.593+0000 7f0cf6331800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.594+0000 7f0cf6331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.594+0000 7f0cf6331800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.594+0000 7f0cf6331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.594+0000 7f0cf6331800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.594+0000 7f0cf6331800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.594+0000 7f0cf6331800 20 started sync module instance, tier type = 2024-09-12T00:22:17.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.594+0000 7f0cf6331800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:17.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.604+0000 7f0cf6331800 20 add_watcher() i=0 2024-09-12T00:22:17.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.604+0000 7f0cf6331800 20 add_watcher() i=1 2024-09-12T00:22:17.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.604+0000 7f0cf6331800 20 add_watcher() i=2 2024-09-12T00:22:17.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.604+0000 7f0cf6331800 20 add_watcher() i=3 2024-09-12T00:22:17.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.604+0000 7f0cf6331800 20 add_watcher() i=4 2024-09-12T00:22:17.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.604+0000 7f0cf6331800 20 add_watcher() i=5 2024-09-12T00:22:17.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.604+0000 7f0cf6331800 20 add_watcher() i=6 2024-09-12T00:22:17.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.605+0000 7f0cf6331800 20 add_watcher() i=7 2024-09-12T00:22:17.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.605+0000 7f0cf6331800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:17.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.607+0000 7f0ba8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:17.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.607+0000 7f0cf6331800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:17.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.607+0000 7f0cf6331800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:17.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.607+0000 7f0cf6331800 5 note: GC not initialized 2024-09-12T00:22:17.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.607+0000 7f0b237fe640 20 reqs_thread_entry: start 2024-09-12T00:22:17.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.608+0000 7f0cf6331800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:17.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.608+0000 7f0cf6331800 20 Filter name: none 2024-09-12T00:22:17.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.608+0000 7f0b217fa640 20 reqs_thread_entry: start 2024-09-12T00:22:17.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.608+0000 7f0cf6331800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.608+0000 7f0cf6331800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:22:17.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.608+0000 7f0cf6331800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.609+0000 7f0cf6331800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:22:17.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.609+0000 7f0cf6331800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:17.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.609+0000 7f0cf6331800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.609+0000 7f0cf6331800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:22:17.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.609+0000 7f0cf6331800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.610+0000 7f0cf6331800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:22:17.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.610+0000 7f0cf6331800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:17.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.611+0000 7f0ba8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:17.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.613+0000 7f0cf6331800 20 remove_watcher() i=0 2024-09-12T00:22:17.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.613+0000 7f0cf6331800 2 removed watcher, disabling cache 2024-09-12T00:22:17.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.614+0000 7f0cf6331800 20 remove_watcher() i=1 2024-09-12T00:22:17.614 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.615+0000 7f0cf6331800 20 remove_watcher() i=2 2024-09-12T00:22:17.615 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.616+0000 7f0cf6331800 20 remove_watcher() i=3 2024-09-12T00:22:17.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.617+0000 7f0cf6331800 20 remove_watcher() i=4 2024-09-12T00:22:17.618 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.619+0000 7f0cf6331800 20 remove_watcher() i=5 2024-09-12T00:22:17.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.620+0000 7f0cf6331800 20 remove_watcher() i=6 2024-09-12T00:22:17.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.621+0000 7f0cf6331800 20 remove_watcher() i=7 2024-09-12T00:22:17.631 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:17.632 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:22:17.632 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-logrecord-writes id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:22:17.633 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:17.697 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T00:22:17.697 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:17.910 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:22:17.940 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:17.940 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:17.980 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.980+0000 7f9bb6e15800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.982+0000 7f9bb6e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.982+0000 7f9bb6e15800 20 realm 2024-09-12T00:22:17.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.982+0000 7f9bb6e15800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.982+0000 7f9bb6e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.982+0000 7f9bb6e15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:17.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.982+0000 7f9bb6e15800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.983+0000 7f9bb6e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:17.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.983+0000 7f9bb6e15800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.983+0000 7f9bb6e15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:17.983 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.983+0000 7f9bb6e15800 20 rados->read ofs=0 len=0 2024-09-12T00:22:17.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.984+0000 7f9bb6e15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:17.984 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.984+0000 7f9bb6e15800 20 searching for the correct realm 2024-09-12T00:22:17.986 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:17.987+0000 7f9bb1d91640 0 -- 172.21.15.67:0/3561813582 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f9ba802a030 msgr2=0x7f9ba8081040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:18.191 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.192+0000 7f9bb2d93640 0 -- 172.21.15.67:0/3561813582 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5635ed4f5920 msgr2=0x5635ed4f7da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:18.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.196+0000 7f9bb6e15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:18.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.196+0000 7f9bb6e15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:18.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.196+0000 7f9bb6e15800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:18.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.196+0000 7f9bb6e15800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:18.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.196+0000 7f9bb6e15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:18.195 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.196+0000 7f9bb6e15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:18.196 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.196+0000 7f9bb6e15800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.196+0000 7f9bb6e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.196+0000 7f9bb6e15800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.197+0000 7f9bb6e15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:18.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.197+0000 7f9bb6e15800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.197+0000 7f9bb6e15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:18.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.197+0000 7f9bb6e15800 20 zone default found 2024-09-12T00:22:18.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.197+0000 7f9bb6e15800 4 Realm: () 2024-09-12T00:22:18.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.197+0000 7f9bb6e15800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:18.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.197+0000 7f9bb6e15800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:18.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.197+0000 7f9bb6e15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:18.197 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.197+0000 7f9bb6e15800 20 zonegroup default 2024-09-12T00:22:18.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.197+0000 7f9bb6e15800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.197+0000 7f9bb6e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.197+0000 7f9bb6e15800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.198+0000 7f9bb6e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.198+0000 7f9bb6e15800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.198+0000 7f9bb6e15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.198+0000 7f9bb6e15800 20 started sync module instance, tier type = 2024-09-12T00:22:18.198 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.198+0000 7f9bb6e15800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:18.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.206+0000 7f9bb6e15800 20 add_watcher() i=0 2024-09-12T00:22:18.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.206+0000 7f9bb6e15800 20 add_watcher() i=1 2024-09-12T00:22:18.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.206+0000 7f9bb6e15800 20 add_watcher() i=2 2024-09-12T00:22:18.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.206+0000 7f9bb6e15800 20 add_watcher() i=3 2024-09-12T00:22:18.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.206+0000 7f9bb6e15800 20 add_watcher() i=4 2024-09-12T00:22:18.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.206+0000 7f9bb6e15800 20 add_watcher() i=5 2024-09-12T00:22:18.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.206+0000 7f9bb6e15800 20 add_watcher() i=6 2024-09-12T00:22:18.206 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.207+0000 7f9bb6e15800 20 add_watcher() i=7 2024-09-12T00:22:18.207 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.207+0000 7f9bb6e15800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:18.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.209+0000 7f9a68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:18.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.210+0000 7f9bb6e15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:18.209 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.210+0000 7f9bb6e15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:18.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.210+0000 7f9bb6e15800 5 note: GC not initialized 2024-09-12T00:22:18.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.210+0000 7f99e37fe640 20 reqs_thread_entry: start 2024-09-12T00:22:18.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.210+0000 7f9bb6e15800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:18.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.210+0000 7f9bb6e15800 20 Filter name: none 2024-09-12T00:22:18.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.210+0000 7f99e17fa640 20 reqs_thread_entry: start 2024-09-12T00:22:18.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.210+0000 7f9bb6e15800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.211+0000 7f9bb6e15800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:18.210 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.211+0000 7f9bb6e15800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.211+0000 7f9bb6e15800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:18.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.211+0000 7f9bb6e15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:18.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.211+0000 7f9bb6e15800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.212+0000 7f9bb6e15800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:18.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.212+0000 7f9bb6e15800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.211 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.212+0000 7f9bb6e15800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:18.212 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.212+0000 7f9bb6e15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:18.213 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.214+0000 7f9a68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:18.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.216+0000 7f9bb6e15800 20 remove_watcher() i=0 2024-09-12T00:22:18.215 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.216+0000 7f9bb6e15800 2 removed watcher, disabling cache 2024-09-12T00:22:18.216 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.217+0000 7f9bb6e15800 20 remove_watcher() i=1 2024-09-12T00:22:18.217 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.218+0000 7f9bb6e15800 20 remove_watcher() i=2 2024-09-12T00:22:18.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.219+0000 7f9bb6e15800 20 remove_watcher() i=3 2024-09-12T00:22:18.219 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.220+0000 7f9bb6e15800 20 remove_watcher() i=4 2024-09-12T00:22:18.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.221+0000 7f9bb6e15800 20 remove_watcher() i=5 2024-09-12T00:22:18.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.222+0000 7f9bb6e15800 20 remove_watcher() i=6 2024-09-12T00:22:18.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.224+0000 7f9bb6e15800 20 remove_watcher() i=7 2024-09-12T00:22:18.234 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:18.234 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:22:18.234 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-change-reshard-state id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:22:18.234 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:18.236 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T00:22:18.271 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:18.271 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:18.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.311+0000 7f395d72e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.313+0000 7f395d72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.313+0000 7f395d72e800 20 realm 2024-09-12T00:22:18.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.313+0000 7f395d72e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.313+0000 7f395d72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.313+0000 7f395d72e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:18.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.313+0000 7f395d72e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.313+0000 7f395d72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.313+0000 7f395d72e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.314+0000 7f395d72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:18.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.314+0000 7f395d72e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.315+0000 7f395d72e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:18.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.315+0000 7f395d72e800 20 searching for the correct realm 2024-09-12T00:22:18.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.317+0000 7f3958cdc640 0 -- 172.21.15.67:0/2272790515 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f39500363e0 msgr2=0x7f3950036840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:18.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.522+0000 7f3959cde640 0 -- 172.21.15.67:0/2272790515 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55fe00553450 msgr2=0x55fe005558d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:18.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.527+0000 7f395d72e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:18.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.527+0000 7f395d72e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:18.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.527+0000 7f395d72e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:18.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.527+0000 7f395d72e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:18.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.527+0000 7f395d72e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:18.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.527+0000 7f395d72e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:18.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.527+0000 7f395d72e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.527+0000 7f395d72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.527+0000 7f395d72e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.527+0000 7f395d72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:18.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.527+0000 7f395d72e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.528+0000 7f395d72e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:18.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.528+0000 7f395d72e800 20 zone default found 2024-09-12T00:22:18.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.528+0000 7f395d72e800 4 Realm: () 2024-09-12T00:22:18.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.528+0000 7f395d72e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:18.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.528+0000 7f395d72e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:18.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.528+0000 7f395d72e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:18.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.528+0000 7f395d72e800 20 zonegroup default 2024-09-12T00:22:18.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.528+0000 7f395d72e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.528+0000 7f395d72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.528+0000 7f395d72e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.528+0000 7f395d72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.528+0000 7f395d72e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.529+0000 7f395d72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.529+0000 7f395d72e800 20 started sync module instance, tier type = 2024-09-12T00:22:18.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.529+0000 7f395d72e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:18.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.537+0000 7f395d72e800 20 add_watcher() i=0 2024-09-12T00:22:18.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.537+0000 7f395d72e800 20 add_watcher() i=1 2024-09-12T00:22:18.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.537+0000 7f395d72e800 20 add_watcher() i=2 2024-09-12T00:22:18.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.537+0000 7f395d72e800 20 add_watcher() i=3 2024-09-12T00:22:18.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.537+0000 7f395d72e800 20 add_watcher() i=4 2024-09-12T00:22:18.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.537+0000 7f395d72e800 20 add_watcher() i=5 2024-09-12T00:22:18.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.537+0000 7f395d72e800 20 add_watcher() i=6 2024-09-12T00:22:18.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.538+0000 7f395d72e800 20 add_watcher() i=7 2024-09-12T00:22:18.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.538+0000 7f395d72e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:18.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.540+0000 7f380ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:18.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.540+0000 7f395d72e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:18.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.540+0000 7f395d72e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:18.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.540+0000 7f395d72e800 5 note: GC not initialized 2024-09-12T00:22:18.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.540+0000 7f380efe5640 20 reqs_thread_entry: start 2024-09-12T00:22:18.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.541+0000 7f395d72e800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:18.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.541+0000 7f395d72e800 20 Filter name: none 2024-09-12T00:22:18.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.541+0000 7f380cfe1640 20 reqs_thread_entry: start 2024-09-12T00:22:18.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.541+0000 7f395d72e800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:22:18.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.541+0000 7f395d72e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.541+0000 7f395d72e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:18.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.541+0000 7f395d72e800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:22:18.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.541+0000 7f395d72e800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:22:18.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.541+0000 7f395d72e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 : miss 2024-09-12T00:22:18.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.541+0000 7f395d72e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.542+0000 7f395d72e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:18.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.542+0000 7f395d72e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 info.flags=0x17 2024-09-12T00:22:18.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.542+0000 7f395d72e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 to cache LRU end 2024-09-12T00:22:18.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.542+0000 7f395d72e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:22:18.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.542+0000 7f395d72e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:18.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.542+0000 7f395d72e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 2024-09-12T00:22:18.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.546+0000 7f395d72e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 info.flags=0x17 2024-09-12T00:22:18.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.546+0000 7f395d72e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 to cache LRU end 2024-09-12T00:22:18.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.546+0000 7f395d72e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:18.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.546+0000 7f395d72e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37, ofs0, ns] 2024-09-12T00:22:18.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.546+0000 7f383cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562461 cookie 94549415704512 notifier 7352 bl.length()=931 2024-09-12T00:22:18.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.546+0000 7f383cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 info.flags=0x17 2024-09-12T00:22:18.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.546+0000 7f383cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 to cache LRU end 2024-09-12T00:22:18.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.546+0000 7f383cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:18.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.547+0000 7f395d72e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): orig_sources= new_sources= 2024-09-12T00:22:18.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.547+0000 7f395d72e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): potential sources added=[] removed=[] 2024-09-12T00:22:18.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.547+0000 7f395d72e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): orig_dests= new_dests= 2024-09-12T00:22:18.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.547+0000 7f395d72e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): potential dests added=[] removed=[] 2024-09-12T00:22:18.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.549+0000 7f395d72e800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37.1.0 2024-09-12T00:22:18.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.549+0000 7f395d72e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37.1.0 2024-09-12T00:22:18.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.549+0000 7f395d72e800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37.1.1 2024-09-12T00:22:18.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.549+0000 7f395d72e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37.1.1 2024-09-12T00:22:18.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.549+0000 7f395d72e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37.0 2024-09-12T00:22:18.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.551+0000 7f395d72e800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T00:22:18.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.551+0000 7f395d72e800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T00:22:18.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.555+0000 7f395d72e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:22:18.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.555+0000 7f395d72e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 2024-09-12T00:22:18.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.556+0000 7f395d72e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 info.flags=0x17 2024-09-12T00:22:18.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.556+0000 7f395d72e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 to cache LRU end 2024-09-12T00:22:18.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.556+0000 7f395d72e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:18.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.556+0000 7f395d72e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37, ofs0, ns] 2024-09-12T00:22:18.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.557+0000 7f382bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562462 cookie 94549415704512 notifier 7352 bl.length()=899 2024-09-12T00:22:18.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.557+0000 7f382bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 info.flags=0x17 2024-09-12T00:22:18.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.557+0000 7f382bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 to cache LRU end 2024-09-12T00:22:18.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.557+0000 7f382bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:18.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.557+0000 7f395d72e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): orig_sources= new_sources= 2024-09-12T00:22:18.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.557+0000 7f395d72e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): potential sources added=[] removed=[] 2024-09-12T00:22:18.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.557+0000 7f395d72e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): orig_dests= new_dests= 2024-09-12T00:22:18.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.557+0000 7f395d72e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): potential dests added=[] removed=[] 2024-09-12T00:22:18.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.557+0000 7f395d72e800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T00:22:18.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.559+0000 7f380ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:18.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.561+0000 7f395d72e800 20 remove_watcher() i=0 2024-09-12T00:22:18.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.561+0000 7f395d72e800 2 removed watcher, disabling cache 2024-09-12T00:22:18.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.562+0000 7f395d72e800 20 remove_watcher() i=1 2024-09-12T00:22:18.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.563+0000 7f395d72e800 20 remove_watcher() i=2 2024-09-12T00:22:18.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.564+0000 7f395d72e800 20 remove_watcher() i=3 2024-09-12T00:22:18.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.565+0000 7f395d72e800 20 remove_watcher() i=4 2024-09-12T00:22:18.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.566+0000 7f395d72e800 20 remove_watcher() i=5 2024-09-12T00:22:18.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.567+0000 7f395d72e800 20 remove_watcher() i=6 2024-09-12T00:22:18.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.568+0000 7f395d72e800 20 remove_watcher() i=7 2024-09-12T00:22:18.580 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:22:18.610 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:18.610 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:18.649 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.650+0000 7f004b80e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.651+0000 7f004b80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.651+0000 7f004b80e800 20 realm 2024-09-12T00:22:18.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.651+0000 7f004b80e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.651 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.652+0000 7f004b80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.652+0000 7f004b80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:18.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.652+0000 7f004b80e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.652+0000 7f004b80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.652 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.652+0000 7f004b80e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.653+0000 7f004b80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:18.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.653+0000 7f004b80e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.653+0000 7f004b80e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:18.653 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.653+0000 7f004b80e800 20 searching for the correct realm 2024-09-12T00:22:18.656 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.657+0000 7f004777b640 0 -- 172.21.15.67:0/528090460 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7f003c045040 msgr2=0x7f003c047950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:22:18.659 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.660+0000 7f0046f7a640 0 -- 172.21.15.67:0/528090460 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f0040069030 msgr2=0x7f00400a3530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:18.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:18.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:18.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:18.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:18.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:18.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:18.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.664 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:18.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:18.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 20 zone default found 2024-09-12T00:22:18.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 4 Realm: () 2024-09-12T00:22:18.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:18.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:18.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:18.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 20 zonegroup default 2024-09-12T00:22:18.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.665+0000 7f004b80e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.666+0000 7f004b80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.666+0000 7f004b80e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.666+0000 7f004b80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.666+0000 7f004b80e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.667+0000 7f004b80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.667+0000 7f004b80e800 20 started sync module instance, tier type = 2024-09-12T00:22:18.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.667+0000 7f004b80e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:18.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.675+0000 7f004b80e800 20 add_watcher() i=0 2024-09-12T00:22:18.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.675+0000 7f004b80e800 20 add_watcher() i=1 2024-09-12T00:22:18.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.675+0000 7f004b80e800 20 add_watcher() i=2 2024-09-12T00:22:18.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.675+0000 7f004b80e800 20 add_watcher() i=3 2024-09-12T00:22:18.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.675+0000 7f004b80e800 20 add_watcher() i=4 2024-09-12T00:22:18.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.675+0000 7f004b80e800 20 add_watcher() i=5 2024-09-12T00:22:18.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.675+0000 7f004b80e800 20 add_watcher() i=6 2024-09-12T00:22:18.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.675+0000 7f004b80e800 20 add_watcher() i=7 2024-09-12T00:22:18.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.675+0000 7f004b80e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:18.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.677+0000 7efefd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:18.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.677+0000 7f004b80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:18.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.677+0000 7f004b80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:18.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.677+0000 7f004b80e800 5 note: GC not initialized 2024-09-12T00:22:18.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.677+0000 7efe77fff640 20 reqs_thread_entry: start 2024-09-12T00:22:18.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.678+0000 7f004b80e800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:18.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.678+0000 7f004b80e800 20 Filter name: none 2024-09-12T00:22:18.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.678+0000 7efe75ffb640 20 reqs_thread_entry: start 2024-09-12T00:22:18.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.678+0000 7f004b80e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.678+0000 7f004b80e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:18.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.678+0000 7f004b80e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.679+0000 7f004b80e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:18.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.679+0000 7f004b80e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:18.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.679+0000 7f004b80e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.679+0000 7f004b80e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:18.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.679+0000 7f004b80e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.679+0000 7f004b80e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:18.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.679+0000 7f004b80e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:18.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.681+0000 7efefd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:18.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.683+0000 7f004b80e800 20 remove_watcher() i=0 2024-09-12T00:22:18.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.683+0000 7f004b80e800 2 removed watcher, disabling cache 2024-09-12T00:22:18.683 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.684+0000 7f004b80e800 20 remove_watcher() i=1 2024-09-12T00:22:18.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.685+0000 7f004b80e800 20 remove_watcher() i=2 2024-09-12T00:22:18.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.686+0000 7f004b80e800 20 remove_watcher() i=3 2024-09-12T00:22:18.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.687+0000 7f004b80e800 20 remove_watcher() i=4 2024-09-12T00:22:18.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.688+0000 7f004b80e800 20 remove_watcher() i=5 2024-09-12T00:22:18.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.688+0000 7f004b80e800 20 remove_watcher() i=6 2024-09-12T00:22:18.689 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.689+0000 7f004b80e800 20 remove_watcher() i=7 2024-09-12T00:22:18.699 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:18.699 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:22:18.699 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-change-reshard-state id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:22:18.699 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:18.752 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:22:18.785 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:18.785 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:18.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.826+0000 7feaaeb25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.828+0000 7feaaeb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.828+0000 7feaaeb25800 20 realm 2024-09-12T00:22:18.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.828+0000 7feaaeb25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.828+0000 7feaaeb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.828+0000 7feaaeb25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:18.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.828+0000 7feaaeb25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.828+0000 7feaaeb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:18.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.828+0000 7feaaeb25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:18.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.829+0000 7feaaeb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:18.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:18.829+0000 7feaaeb25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.031+0000 7feaaeb25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:19.030 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.031+0000 7feaaeb25800 20 searching for the correct realm 2024-09-12T00:22:19.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.034+0000 7feaa3fff640 0 -- 172.21.15.67:0/3249137420 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fea940b4000 msgr2=0x7fea940af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:22:19.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.238+0000 7feaaafb6640 0 -- 172.21.15.67:0/3249137420 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x56015bc80010 msgr2=0x56015bc824d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:19.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.243+0000 7feaaeb25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:19.242 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.243+0000 7feaaeb25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:19.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.243+0000 7feaaeb25800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:19.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.243+0000 7feaaeb25800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:19.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.243+0000 7feaaeb25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:19.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.243+0000 7feaaeb25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:19.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.243+0000 7feaaeb25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.243+0000 7feaaeb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.243+0000 7feaaeb25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.243+0000 7feaaeb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:19.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.244+0000 7feaaeb25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.244+0000 7feaaeb25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:19.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.244+0000 7feaaeb25800 20 zone default found 2024-09-12T00:22:19.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.244+0000 7feaaeb25800 4 Realm: () 2024-09-12T00:22:19.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.244+0000 7feaaeb25800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:19.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.244+0000 7feaaeb25800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:19.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.244+0000 7feaaeb25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:19.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.244+0000 7feaaeb25800 20 zonegroup default 2024-09-12T00:22:19.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.244+0000 7feaaeb25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.244+0000 7feaaeb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.244+0000 7feaaeb25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.244+0000 7feaaeb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.244+0000 7feaaeb25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.245+0000 7feaaeb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.245+0000 7feaaeb25800 20 started sync module instance, tier type = 2024-09-12T00:22:19.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.245+0000 7feaaeb25800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:19.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.254+0000 7feaaeb25800 20 add_watcher() i=0 2024-09-12T00:22:19.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.254+0000 7feaaeb25800 20 add_watcher() i=1 2024-09-12T00:22:19.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.254+0000 7feaaeb25800 20 add_watcher() i=2 2024-09-12T00:22:19.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.254+0000 7feaaeb25800 20 add_watcher() i=3 2024-09-12T00:22:19.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.254+0000 7feaaeb25800 20 add_watcher() i=4 2024-09-12T00:22:19.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.254+0000 7feaaeb25800 20 add_watcher() i=5 2024-09-12T00:22:19.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.254+0000 7feaaeb25800 20 add_watcher() i=6 2024-09-12T00:22:19.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.254+0000 7feaaeb25800 20 add_watcher() i=7 2024-09-12T00:22:19.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.254+0000 7feaaeb25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:19.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.257+0000 7fe960fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:19.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.257+0000 7feaaeb25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:19.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.257+0000 7feaaeb25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:19.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.257+0000 7feaaeb25800 5 note: GC not initialized 2024-09-12T00:22:19.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.257+0000 7fe8db7fe640 20 reqs_thread_entry: start 2024-09-12T00:22:19.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.257+0000 7feaaeb25800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:19.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.257+0000 7feaaeb25800 20 Filter name: none 2024-09-12T00:22:19.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.258+0000 7fe8d97fa640 20 reqs_thread_entry: start 2024-09-12T00:22:19.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.258+0000 7feaaeb25800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:22:19.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.258+0000 7feaaeb25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.258+0000 7feaaeb25800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:19.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.258+0000 7feaaeb25800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:22:19.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.258+0000 7feaaeb25800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:22:19.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.258+0000 7feaaeb25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 : miss 2024-09-12T00:22:19.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.258+0000 7feaaeb25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.258+0000 7feaaeb25800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:19.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.258+0000 7feaaeb25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 info.flags=0x17 2024-09-12T00:22:19.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.258+0000 7feaaeb25800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 to cache LRU end 2024-09-12T00:22:19.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.258+0000 7feaaeb25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:22:19.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.258+0000 7feaaeb25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:19.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.258+0000 7feaaeb25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 2024-09-12T00:22:19.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.262+0000 7feaaeb25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 info.flags=0x17 2024-09-12T00:22:19.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.262+0000 7feaaeb25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 to cache LRU end 2024-09-12T00:22:19.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.262+0000 7feaaeb25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:19.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.262+0000 7feaaeb25800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37, ofs0, ns] 2024-09-12T00:22:19.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.263+0000 7fe98d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562463 cookie 94563834860096 notifier 7385 bl.length()=931 2024-09-12T00:22:19.262 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.263+0000 7fe98d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 info.flags=0x17 2024-09-12T00:22:19.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.263+0000 7fe98d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 to cache LRU end 2024-09-12T00:22:19.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.263+0000 7fe98d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:19.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.264+0000 7feaaeb25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): orig_sources= new_sources= 2024-09-12T00:22:19.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.264+0000 7feaaeb25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): potential sources added=[] removed=[] 2024-09-12T00:22:19.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.264+0000 7feaaeb25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): orig_dests= new_dests= 2024-09-12T00:22:19.263 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.264+0000 7feaaeb25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): potential dests added=[] removed=[] 2024-09-12T00:22:19.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.266+0000 7feaaeb25800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37.1.0 2024-09-12T00:22:19.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.266+0000 7feaaeb25800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37.1.0 2024-09-12T00:22:19.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.266+0000 7feaaeb25800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37.1.1 2024-09-12T00:22:19.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.266+0000 7feaaeb25800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37.1.1 2024-09-12T00:22:19.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.266+0000 7feaaeb25800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37.0 2024-09-12T00:22:19.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.269+0000 7feaaeb25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:22:19.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.269+0000 7feaaeb25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 2024-09-12T00:22:19.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.270+0000 7feaaeb25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 info.flags=0x17 2024-09-12T00:22:19.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.270+0000 7feaaeb25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 to cache LRU end 2024-09-12T00:22:19.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.270+0000 7feaaeb25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:19.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.270+0000 7feaaeb25800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37, ofs0, ns] 2024-09-12T00:22:19.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.271+0000 7fe98d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562464 cookie 94563834860096 notifier 7385 bl.length()=931 2024-09-12T00:22:19.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.271+0000 7fe98d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 info.flags=0x17 2024-09-12T00:22:19.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.271+0000 7fe98d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 to cache LRU end 2024-09-12T00:22:19.270 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.271+0000 7fe98d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:19.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.271+0000 7feaaeb25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): orig_sources= new_sources= 2024-09-12T00:22:19.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.271+0000 7feaaeb25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): potential sources added=[] removed=[] 2024-09-12T00:22:19.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.271+0000 7feaaeb25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): orig_dests= new_dests= 2024-09-12T00:22:19.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.271+0000 7feaaeb25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): potential dests added=[] removed=[] 2024-09-12T00:22:19.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.272+0000 7feaaeb25800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37.0 2024-09-12T00:22:19.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.273+0000 7feaaeb25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:22:19.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.273+0000 7feaaeb25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 2024-09-12T00:22:19.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.274+0000 7feaaeb25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 info.flags=0x17 2024-09-12T00:22:19.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.274+0000 7feaaeb25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 to cache LRU end 2024-09-12T00:22:19.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.274+0000 7feaaeb25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:19.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.274+0000 7feaaeb25800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37, ofs0, ns] 2024-09-12T00:22:19.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.274+0000 7fe98d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562465 cookie 94563834860096 notifier 7385 bl.length()=899 2024-09-12T00:22:19.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.274+0000 7fe98d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 info.flags=0x17 2024-09-12T00:22:19.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.274+0000 7fe98d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 to cache LRU end 2024-09-12T00:22:19.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.274+0000 7fe98d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:19.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.275+0000 7feaaeb25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): orig_sources= new_sources= 2024-09-12T00:22:19.274 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.275+0000 7feaaeb25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): potential sources added=[] removed=[] 2024-09-12T00:22:19.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.275+0000 7feaaeb25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): orig_dests= new_dests= 2024-09-12T00:22:19.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.275+0000 7feaaeb25800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37]): potential dests added=[] removed=[] 2024-09-12T00:22:19.275 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.276+0000 7feaaeb25800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:22:19.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.278+0000 7fe960fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:19.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.280+0000 7feaaeb25800 20 remove_watcher() i=0 2024-09-12T00:22:19.279 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.280+0000 7feaaeb25800 2 removed watcher, disabling cache 2024-09-12T00:22:19.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.281+0000 7feaaeb25800 20 remove_watcher() i=1 2024-09-12T00:22:19.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.282+0000 7feaaeb25800 20 remove_watcher() i=2 2024-09-12T00:22:19.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.283+0000 7feaaeb25800 20 remove_watcher() i=3 2024-09-12T00:22:19.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.285+0000 7feaaeb25800 20 remove_watcher() i=4 2024-09-12T00:22:19.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.286+0000 7feaaeb25800 20 remove_watcher() i=5 2024-09-12T00:22:19.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.286+0000 7feaaeb25800 20 remove_watcher() i=6 2024-09-12T00:22:19.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.287+0000 7feaaeb25800 20 remove_watcher() i=7 2024-09-12T00:22:19.300 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:22:19.329 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:19.329 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:19.374 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.375+0000 7f231eb19800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.377+0000 7f231eb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.377+0000 7f231eb19800 20 realm 2024-09-12T00:22:19.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.377+0000 7f231eb19800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.377+0000 7f231eb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.377+0000 7f231eb19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:19.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.377+0000 7f231eb19800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.377+0000 7f231eb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.377+0000 7f231eb19800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.378+0000 7f231eb19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:19.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.378+0000 7f231eb19800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.379+0000 7f231eb19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:19.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.379+0000 7f231eb19800 20 searching for the correct realm 2024-09-12T00:22:19.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.382+0000 7f231be09640 0 -- 172.21.15.67:0/3605717194 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f2310062a90 msgr2=0x7f2310061500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:19.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.385+0000 7f231c60a640 0 -- 172.21.15.67:0/3605717194 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f23140076b0 msgr2=0x7f23140afac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:19.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.389+0000 7f231eb19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:19.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.389+0000 7f231eb19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:19.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.389+0000 7f231eb19800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:19.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.389+0000 7f231eb19800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:19.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.389+0000 7f231eb19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:19.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.389+0000 7f231eb19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:19.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.389+0000 7f231eb19800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.390+0000 7f231eb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.390+0000 7f231eb19800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.390+0000 7f231eb19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:19.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.390+0000 7f231eb19800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.390+0000 7f231eb19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:19.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.390+0000 7f231eb19800 20 zone default found 2024-09-12T00:22:19.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.390+0000 7f231eb19800 4 Realm: () 2024-09-12T00:22:19.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.390+0000 7f231eb19800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:19.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.390+0000 7f231eb19800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:19.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.390+0000 7f231eb19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:19.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.390+0000 7f231eb19800 20 zonegroup default 2024-09-12T00:22:19.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.390+0000 7f231eb19800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.391+0000 7f231eb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.391+0000 7f231eb19800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.391+0000 7f231eb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.391+0000 7f231eb19800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.391+0000 7f231eb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.391+0000 7f231eb19800 20 started sync module instance, tier type = 2024-09-12T00:22:19.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.391+0000 7f231eb19800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:19.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.400+0000 7f231eb19800 20 add_watcher() i=0 2024-09-12T00:22:19.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.400+0000 7f231eb19800 20 add_watcher() i=1 2024-09-12T00:22:19.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.400+0000 7f231eb19800 20 add_watcher() i=2 2024-09-12T00:22:19.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.400+0000 7f231eb19800 20 add_watcher() i=3 2024-09-12T00:22:19.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.400+0000 7f231eb19800 20 add_watcher() i=4 2024-09-12T00:22:19.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.400+0000 7f231eb19800 20 add_watcher() i=5 2024-09-12T00:22:19.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.400+0000 7f231eb19800 20 add_watcher() i=6 2024-09-12T00:22:19.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.401+0000 7f231eb19800 20 add_watcher() i=7 2024-09-12T00:22:19.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.401+0000 7f231eb19800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:19.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.403+0000 7f21d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:19.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.403+0000 7f231eb19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:19.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.403+0000 7f231eb19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:19.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.403+0000 7f231eb19800 5 note: GC not initialized 2024-09-12T00:22:19.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.403+0000 7f21d1fdb640 20 reqs_thread_entry: start 2024-09-12T00:22:19.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.403+0000 7f231eb19800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:19.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.403+0000 7f231eb19800 20 Filter name: none 2024-09-12T00:22:19.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.403+0000 7f21437fe640 20 reqs_thread_entry: start 2024-09-12T00:22:19.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.403+0000 7f231eb19800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.404+0000 7f231eb19800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:19.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.404+0000 7f231eb19800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.404+0000 7f231eb19800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:19.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.404+0000 7f231eb19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:19.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.404+0000 7f231eb19800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.405+0000 7f231eb19800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:19.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.405+0000 7f231eb19800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.405+0000 7f231eb19800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:19.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.405+0000 7f231eb19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:19.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.406+0000 7f21d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:19.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.408+0000 7f231eb19800 20 remove_watcher() i=0 2024-09-12T00:22:19.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.408+0000 7f231eb19800 2 removed watcher, disabling cache 2024-09-12T00:22:19.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.409+0000 7f231eb19800 20 remove_watcher() i=1 2024-09-12T00:22:19.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.410+0000 7f231eb19800 20 remove_watcher() i=2 2024-09-12T00:22:19.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.412+0000 7f231eb19800 20 remove_watcher() i=3 2024-09-12T00:22:19.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.413+0000 7f231eb19800 20 remove_watcher() i=4 2024-09-12T00:22:19.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.414+0000 7f231eb19800 20 remove_watcher() i=5 2024-09-12T00:22:19.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.414+0000 7f231eb19800 20 remove_watcher() i=6 2024-09-12T00:22:19.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.415+0000 7f231eb19800 20 remove_watcher() i=7 2024-09-12T00:22:19.425 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:19.426 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:22:19.426 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-change-reshard-state id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:22:19.426 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:19.488 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T00:22:19.488 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:19.752 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:22:19.781 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:19.781 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:19.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.821+0000 7f73b6935800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.823+0000 7f73b6935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.823+0000 7f73b6935800 20 realm 2024-09-12T00:22:19.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.823+0000 7f73b6935800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.824+0000 7f73b6935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.824+0000 7f73b6935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:19.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.824+0000 7f73b6935800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.824+0000 7f73b6935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.824+0000 7f73b6935800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.825+0000 7f73b6935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:19.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.825+0000 7f73b6935800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.825+0000 7f73b6935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:19.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.825+0000 7f73b6935800 20 searching for the correct realm 2024-09-12T00:22:19.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.829+0000 7f73b1ee3640 0 -- 172.21.15.67:0/1678619187 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f73a80253a0 msgr2=0x7f73a8025820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:19.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.832+0000 7f73b2ee5640 0 -- 172.21.15.67:0/1678619187 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5601d4ed8510 msgr2=0x5601d4eda900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:19.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.836+0000 7f73b6935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:19.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.836+0000 7f73b6935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:19.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.836+0000 7f73b6935800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:19.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.836+0000 7f73b6935800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:19.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.836+0000 7f73b6935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:19.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.836+0000 7f73b6935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:19.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.836+0000 7f73b6935800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.836+0000 7f73b6935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.836+0000 7f73b6935800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.837+0000 7f73b6935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:19.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.837+0000 7f73b6935800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.837+0000 7f73b6935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.837+0000 7f73b6935800 20 zone default found 2024-09-12T00:22:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.837+0000 7f73b6935800 4 Realm: () 2024-09-12T00:22:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.837+0000 7f73b6935800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.837+0000 7f73b6935800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.837+0000 7f73b6935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.837+0000 7f73b6935800 20 zonegroup default 2024-09-12T00:22:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.837+0000 7f73b6935800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.837+0000 7f73b6935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.837+0000 7f73b6935800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.837+0000 7f73b6935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.838+0000 7f73b6935800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.838+0000 7f73b6935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.838+0000 7f73b6935800 20 started sync module instance, tier type = 2024-09-12T00:22:19.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.838+0000 7f73b6935800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:19.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.848+0000 7f73b6935800 20 add_watcher() i=0 2024-09-12T00:22:19.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.848+0000 7f73b6935800 20 add_watcher() i=1 2024-09-12T00:22:19.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.848+0000 7f73b6935800 20 add_watcher() i=2 2024-09-12T00:22:19.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.848+0000 7f73b6935800 20 add_watcher() i=3 2024-09-12T00:22:19.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.848+0000 7f73b6935800 20 add_watcher() i=4 2024-09-12T00:22:19.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.848+0000 7f73b6935800 20 add_watcher() i=5 2024-09-12T00:22:19.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.848+0000 7f73b6935800 20 add_watcher() i=6 2024-09-12T00:22:19.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.849+0000 7f73b6935800 20 add_watcher() i=7 2024-09-12T00:22:19.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.849+0000 7f73b6935800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:19.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.851+0000 7f7268fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:19.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.851+0000 7f73b6935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:19.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.851+0000 7f73b6935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:19.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.851+0000 7f73b6935800 5 note: GC not initialized 2024-09-12T00:22:19.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.852+0000 7f71e37fe640 20 reqs_thread_entry: start 2024-09-12T00:22:19.851 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.852+0000 7f73b6935800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:19.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.852+0000 7f73b6935800 20 Filter name: none 2024-09-12T00:22:19.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.852+0000 7f71e17fa640 20 reqs_thread_entry: start 2024-09-12T00:22:19.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.852+0000 7f73b6935800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.853+0000 7f73b6935800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:19.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.853+0000 7f73b6935800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.853+0000 7f73b6935800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:19.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.853+0000 7f73b6935800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:19.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.853+0000 7f73b6935800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.853+0000 7f73b6935800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:19.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.853+0000 7f73b6935800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.854+0000 7f73b6935800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:19.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.854+0000 7f73b6935800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:19.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.855+0000 7f7268fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:19.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.857+0000 7f73b6935800 20 remove_watcher() i=0 2024-09-12T00:22:19.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.857+0000 7f73b6935800 2 removed watcher, disabling cache 2024-09-12T00:22:19.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.858+0000 7f73b6935800 20 remove_watcher() i=1 2024-09-12T00:22:19.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.859+0000 7f73b6935800 20 remove_watcher() i=2 2024-09-12T00:22:19.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.860+0000 7f73b6935800 20 remove_watcher() i=3 2024-09-12T00:22:19.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.861+0000 7f73b6935800 20 remove_watcher() i=4 2024-09-12T00:22:19.861 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.862+0000 7f73b6935800 20 remove_watcher() i=5 2024-09-12T00:22:19.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.863+0000 7f73b6935800 20 remove_watcher() i=6 2024-09-12T00:22:19.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.864+0000 7f73b6935800 20 remove_watcher() i=7 2024-09-12T00:22:19.874 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:19.874 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:22:19.874 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-change-reshard-state id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:22:19.874 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:19.875 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T00:22:19.913 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:19.913 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:19.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.953+0000 7fd5fd546800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.954+0000 7fd5fd546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.954+0000 7fd5fd546800 20 realm 2024-09-12T00:22:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.954+0000 7fd5fd546800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.955+0000 7fd5fd546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.955+0000 7fd5fd546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.955+0000 7fd5fd546800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.955+0000 7fd5fd546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:19.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.955+0000 7fd5fd546800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.956+0000 7fd5fd546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:19.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.956+0000 7fd5fd546800 20 rados->read ofs=0 len=0 2024-09-12T00:22:19.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.956+0000 7fd5fd546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:19.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.956+0000 7fd5fd546800 20 searching for the correct realm 2024-09-12T00:22:19.958 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:19.959+0000 7fd5fa836640 0 -- 172.21.15.67:0/1333184079 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fd5f006ea10 msgr2=0x7fd5f001a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:20.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.567+0000 7fd5fb037640 0 -- 172.21.15.67:0/1333184079 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fd5f406a040 msgr2=0x7fd5f4055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:20.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.573+0000 7fd5fd546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:20.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.573+0000 7fd5fd546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:20.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.573+0000 7fd5fd546800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:20.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.573+0000 7fd5fd546800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:20.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.573+0000 7fd5fd546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:20.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.573+0000 7fd5fd546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:20.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.573+0000 7fd5fd546800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.573+0000 7fd5fd546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:20.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.573+0000 7fd5fd546800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.573+0000 7fd5fd546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:20.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.573+0000 7fd5fd546800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.574+0000 7fd5fd546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:20.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.574+0000 7fd5fd546800 20 zone default found 2024-09-12T00:22:20.574 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.574+0000 7fd5fd546800 4 Realm: () 2024-09-12T00:22:20.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.574+0000 7fd5fd546800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:20.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.574+0000 7fd5fd546800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:20.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.574+0000 7fd5fd546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:20.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.574+0000 7fd5fd546800 20 zonegroup default 2024-09-12T00:22:20.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.574+0000 7fd5fd546800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.574+0000 7fd5fd546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:20.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.574+0000 7fd5fd546800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.575+0000 7fd5fd546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:20.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.575+0000 7fd5fd546800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.575+0000 7fd5fd546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:20.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.575+0000 7fd5fd546800 20 started sync module instance, tier type = 2024-09-12T00:22:20.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.575+0000 7fd5fd546800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:20.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.586+0000 7fd5fd546800 20 add_watcher() i=0 2024-09-12T00:22:20.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.586+0000 7fd5fd546800 20 add_watcher() i=1 2024-09-12T00:22:20.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.586+0000 7fd5fd546800 20 add_watcher() i=2 2024-09-12T00:22:20.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.586+0000 7fd5fd546800 20 add_watcher() i=3 2024-09-12T00:22:20.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.586+0000 7fd5fd546800 20 add_watcher() i=4 2024-09-12T00:22:20.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.586+0000 7fd5fd546800 20 add_watcher() i=5 2024-09-12T00:22:20.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.586+0000 7fd5fd546800 20 add_watcher() i=6 2024-09-12T00:22:20.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.587+0000 7fd5fd546800 20 add_watcher() i=7 2024-09-12T00:22:20.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.587+0000 7fd5fd546800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:20.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.590+0000 7fd4b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:20.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.590+0000 7fd5fd546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:20.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.590+0000 7fd5fd546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:20.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.590+0000 7fd5fd546800 5 note: GC not initialized 2024-09-12T00:22:20.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.590+0000 7fd4b0fe1640 20 reqs_thread_entry: start 2024-09-12T00:22:20.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.590+0000 7fd5fd546800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:20.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.590+0000 7fd5fd546800 20 Filter name: none 2024-09-12T00:22:20.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.591+0000 7fd42a7fc640 20 reqs_thread_entry: start 2024-09-12T00:22:20.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.591+0000 7fd5fd546800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:22:20.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.591+0000 7fd5fd546800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.591+0000 7fd5fd546800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:20.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.591+0000 7fd5fd546800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:22:20.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.591+0000 7fd5fd546800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:22:20.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.591+0000 7fd5fd546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 : miss 2024-09-12T00:22:20.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.591+0000 7fd5fd546800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.592+0000 7fd5fd546800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:20.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.592+0000 7fd5fd546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 info.flags=0x17 2024-09-12T00:22:20.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.592+0000 7fd5fd546800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 to cache LRU end 2024-09-12T00:22:20.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.592+0000 7fd5fd546800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:22:20.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.592+0000 7fd5fd546800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:20.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.592+0000 7fd5fd546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 2024-09-12T00:22:20.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.596+0000 7fd5fd546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 info.flags=0x17 2024-09-12T00:22:20.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.596+0000 7fd5fd546800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 to cache LRU end 2024-09-12T00:22:20.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.596+0000 7fd5fd546800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:20.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.596+0000 7fd5fd546800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38, ofs0, ns] 2024-09-12T00:22:20.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.597+0000 7fd4deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562468 cookie 94191211506400 notifier 7433 bl.length()=931 2024-09-12T00:22:20.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.597+0000 7fd4deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 info.flags=0x17 2024-09-12T00:22:20.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.597+0000 7fd4deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 to cache LRU end 2024-09-12T00:22:20.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.597+0000 7fd4deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:20.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.597+0000 7fd5fd546800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38]): orig_sources= new_sources= 2024-09-12T00:22:20.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.597+0000 7fd5fd546800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38]): potential sources added=[] removed=[] 2024-09-12T00:22:20.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.597+0000 7fd5fd546800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38]): orig_dests= new_dests= 2024-09-12T00:22:20.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.597+0000 7fd5fd546800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38]): potential dests added=[] removed=[] 2024-09-12T00:22:20.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.600+0000 7fd5fd546800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38.1.0 2024-09-12T00:22:20.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.600+0000 7fd5fd546800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38.1.0 2024-09-12T00:22:20.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.600+0000 7fd5fd546800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38.1.1 2024-09-12T00:22:20.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.600+0000 7fd5fd546800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38.1.1 2024-09-12T00:22:20.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.600+0000 7fd5fd546800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38.0 2024-09-12T00:22:20.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.604+0000 7fd5fd546800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T00:22:20.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.604+0000 7fd5fd546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:22:20.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.604+0000 7fd5fd546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 2024-09-12T00:22:20.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.605+0000 7fd5fd546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 info.flags=0x17 2024-09-12T00:22:20.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.605+0000 7fd5fd546800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 to cache LRU end 2024-09-12T00:22:20.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.605+0000 7fd5fd546800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:20.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.605+0000 7fd5fd546800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38, ofs0, ns] 2024-09-12T00:22:20.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.606+0000 7fd4deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562469 cookie 94191211506400 notifier 7433 bl.length()=931 2024-09-12T00:22:20.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.606+0000 7fd4deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 info.flags=0x17 2024-09-12T00:22:20.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.606+0000 7fd4deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 to cache LRU end 2024-09-12T00:22:20.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.606+0000 7fd4deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:20.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.606+0000 7fd5fd546800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38]): orig_sources= new_sources= 2024-09-12T00:22:20.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.606+0000 7fd5fd546800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38]): potential sources added=[] removed=[] 2024-09-12T00:22:20.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.606+0000 7fd5fd546800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38]): orig_dests= new_dests= 2024-09-12T00:22:20.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.606+0000 7fd5fd546800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38]): potential dests added=[] removed=[] 2024-09-12T00:22:20.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.607+0000 7fd5fd546800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38.0 2024-09-12T00:22:20.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.608+0000 7fd5fd546800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:22:20.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.608+0000 7fd5fd546800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 2024-09-12T00:22:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.609+0000 7fd5fd546800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 info.flags=0x17 2024-09-12T00:22:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.609+0000 7fd5fd546800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 to cache LRU end 2024-09-12T00:22:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.609+0000 7fd5fd546800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:20.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.609+0000 7fd5fd546800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38, ofs0, ns] 2024-09-12T00:22:20.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.610+0000 7fd4deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562470 cookie 94191211506400 notifier 7433 bl.length()=899 2024-09-12T00:22:20.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.610+0000 7fd4deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 info.flags=0x17 2024-09-12T00:22:20.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.610+0000 7fd4deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 to cache LRU end 2024-09-12T00:22:20.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.610+0000 7fd4deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:20.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.611+0000 7fd5fd546800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38]): orig_sources= new_sources= 2024-09-12T00:22:20.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.611+0000 7fd5fd546800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38]): potential sources added=[] removed=[] 2024-09-12T00:22:20.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.611+0000 7fd5fd546800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38]): orig_dests= new_dests= 2024-09-12T00:22:20.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.611+0000 7fd5fd546800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38]): potential dests added=[] removed=[] 2024-09-12T00:22:20.611 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.612+0000 7fd5fd546800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:22:20.613 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.614+0000 7fd4b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:20.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.617+0000 7fd5fd546800 20 remove_watcher() i=0 2024-09-12T00:22:20.616 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.617+0000 7fd5fd546800 2 removed watcher, disabling cache 2024-09-12T00:22:20.617 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.618+0000 7fd5fd546800 20 remove_watcher() i=1 2024-09-12T00:22:20.619 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.620+0000 7fd5fd546800 20 remove_watcher() i=2 2024-09-12T00:22:20.620 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.621+0000 7fd5fd546800 20 remove_watcher() i=3 2024-09-12T00:22:20.621 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.622+0000 7fd5fd546800 20 remove_watcher() i=4 2024-09-12T00:22:20.622 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.623+0000 7fd5fd546800 20 remove_watcher() i=5 2024-09-12T00:22:20.623 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.624+0000 7fd5fd546800 20 remove_watcher() i=6 2024-09-12T00:22:20.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.625+0000 7fd5fd546800 20 remove_watcher() i=7 2024-09-12T00:22:20.639 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:22:20.670 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:20.670 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:20.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.713+0000 7fec50321800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.715+0000 7fec50321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:20.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.715+0000 7fec50321800 20 realm 2024-09-12T00:22:20.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.715+0000 7fec50321800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.715+0000 7fec50321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:20.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.715+0000 7fec50321800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:20.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.715+0000 7fec50321800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.715+0000 7fec50321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:20.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.715+0000 7fec50321800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.716+0000 7fec50321800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:20.715 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.716+0000 7fec50321800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.717+0000 7fec50321800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:20.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.717+0000 7fec50321800 20 searching for the correct realm 2024-09-12T00:22:20.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.720+0000 7fec4b80b640 0 -- 172.21.15.67:0/2518078870 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fec40072db0 msgr2=0x7fec40081ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:22:20.723 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.724+0000 7fec4c80d640 0 -- 172.21.15.67:0/2518078870 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x558c20adee10 msgr2=0x558c20ae1200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:20.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:20.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:20.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:20.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:20.728 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:20.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:20.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:20.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:20.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:20.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 20 zone default found 2024-09-12T00:22:20.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 4 Realm: () 2024-09-12T00:22:20.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:20.729 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:20.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:20.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 20 zonegroup default 2024-09-12T00:22:20.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.728+0000 7fec50321800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.729+0000 7fec50321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:20.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.729+0000 7fec50321800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.729+0000 7fec50321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:20.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.729+0000 7fec50321800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.730 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.730+0000 7fec50321800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:20.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.730+0000 7fec50321800 20 started sync module instance, tier type = 2024-09-12T00:22:20.731 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.730+0000 7fec50321800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:20.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.739+0000 7fec50321800 20 add_watcher() i=0 2024-09-12T00:22:20.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.739+0000 7fec50321800 20 add_watcher() i=1 2024-09-12T00:22:20.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.739+0000 7fec50321800 20 add_watcher() i=2 2024-09-12T00:22:20.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.739+0000 7fec50321800 20 add_watcher() i=3 2024-09-12T00:22:20.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.739+0000 7fec50321800 20 add_watcher() i=4 2024-09-12T00:22:20.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.739+0000 7fec50321800 20 add_watcher() i=5 2024-09-12T00:22:20.738 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.739+0000 7fec50321800 20 add_watcher() i=6 2024-09-12T00:22:20.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.740+0000 7fec50321800 20 add_watcher() i=7 2024-09-12T00:22:20.739 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.740+0000 7fec50321800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:20.741 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.742+0000 7feb02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:20.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.742+0000 7fec50321800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:20.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.742+0000 7fec50321800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:20.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.742+0000 7fec50321800 5 note: GC not initialized 2024-09-12T00:22:20.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.742+0000 7feb01fdb640 20 reqs_thread_entry: start 2024-09-12T00:22:20.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.742+0000 7fec50321800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:20.744 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.742+0000 7fec50321800 20 Filter name: none 2024-09-12T00:22:20.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.742+0000 7fea737fe640 20 reqs_thread_entry: start 2024-09-12T00:22:20.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.742+0000 7fec50321800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.743+0000 7fec50321800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:20.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.743+0000 7fec50321800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.743+0000 7fec50321800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:20.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.743+0000 7fec50321800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:20.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.743+0000 7fec50321800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.745 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.744+0000 7fec50321800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:20.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.744+0000 7fec50321800 20 rados->read ofs=0 len=0 2024-09-12T00:22:20.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.744+0000 7fec50321800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:20.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.744+0000 7fec50321800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:20.746 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.746+0000 7feb02fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:20.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.748+0000 7fec50321800 20 remove_watcher() i=0 2024-09-12T00:22:20.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.748+0000 7fec50321800 2 removed watcher, disabling cache 2024-09-12T00:22:20.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.749+0000 7fec50321800 20 remove_watcher() i=1 2024-09-12T00:22:20.749 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.750+0000 7fec50321800 20 remove_watcher() i=2 2024-09-12T00:22:20.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.751+0000 7fec50321800 20 remove_watcher() i=3 2024-09-12T00:22:20.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.752+0000 7fec50321800 20 remove_watcher() i=4 2024-09-12T00:22:20.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.753+0000 7fec50321800 20 remove_watcher() i=5 2024-09-12T00:22:20.753 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.754+0000 7fec50321800 20 remove_watcher() i=6 2024-09-12T00:22:20.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:20.755+0000 7fec50321800 20 remove_watcher() i=7 2024-09-12T00:22:20.766 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:20.766 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:22:20.766 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: error-at-change-reshard-state id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:22:20.766 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:20.828 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T00:22:20.828 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.045 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:22:21.074 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:21.074 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:21.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.114+0000 7fc1ca728800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.116+0000 7fc1ca728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.116+0000 7fc1ca728800 20 realm 2024-09-12T00:22:21.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.116+0000 7fc1ca728800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.116+0000 7fc1ca728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.116+0000 7fc1ca728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:21.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.116+0000 7fc1ca728800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.116+0000 7fc1ca728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.116+0000 7fc1ca728800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.116 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.117+0000 7fc1ca728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:21.117 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.117+0000 7fc1ca728800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.118+0000 7fc1ca728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:21.118 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.118+0000 7fc1ca728800 20 searching for the correct realm 2024-09-12T00:22:21.120 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.121+0000 7fc1c5c6e640 0 -- 172.21.15.67:0/2740927301 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fc1bc0b4db0 msgr2=0x7fc1bc0b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:22:21.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.327+0000 7fc1c6c70640 0 -- 172.21.15.67:0/2740927301 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5570eb657a50 msgr2=0x5570eb659ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:21.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.331+0000 7fc1ca728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:21.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.331+0000 7fc1ca728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:21.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.331+0000 7fc1ca728800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:21.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.331+0000 7fc1ca728800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:21.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.331+0000 7fc1ca728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:21.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.331+0000 7fc1ca728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:21.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.331+0000 7fc1ca728800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.332+0000 7fc1ca728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.332+0000 7fc1ca728800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.332+0000 7fc1ca728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:21.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.332+0000 7fc1ca728800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.332+0000 7fc1ca728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:21.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.332+0000 7fc1ca728800 20 zone default found 2024-09-12T00:22:21.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.332+0000 7fc1ca728800 4 Realm: () 2024-09-12T00:22:21.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.332+0000 7fc1ca728800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:21.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.332+0000 7fc1ca728800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:21.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.332+0000 7fc1ca728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:21.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.332+0000 7fc1ca728800 20 zonegroup default 2024-09-12T00:22:21.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.332+0000 7fc1ca728800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.333+0000 7fc1ca728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.333+0000 7fc1ca728800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.333+0000 7fc1ca728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.333+0000 7fc1ca728800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.333+0000 7fc1ca728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.333+0000 7fc1ca728800 20 started sync module instance, tier type = 2024-09-12T00:22:21.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.333+0000 7fc1ca728800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.342+0000 7fc1ca728800 20 add_watcher() i=0 2024-09-12T00:22:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.342+0000 7fc1ca728800 20 add_watcher() i=1 2024-09-12T00:22:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.342+0000 7fc1ca728800 20 add_watcher() i=2 2024-09-12T00:22:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.342+0000 7fc1ca728800 20 add_watcher() i=3 2024-09-12T00:22:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.342+0000 7fc1ca728800 20 add_watcher() i=4 2024-09-12T00:22:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.342+0000 7fc1ca728800 20 add_watcher() i=5 2024-09-12T00:22:21.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.342+0000 7fc1ca728800 20 add_watcher() i=6 2024-09-12T00:22:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.343+0000 7fc1ca728800 20 add_watcher() i=7 2024-09-12T00:22:21.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.343+0000 7fc1ca728800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:21.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.344+0000 7fc07cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:21.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.345+0000 7fc1ca728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:21.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.345+0000 7fc1ca728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:21.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.345+0000 7fc1ca728800 5 note: GC not initialized 2024-09-12T00:22:21.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.345+0000 7fbff77fe640 20 reqs_thread_entry: start 2024-09-12T00:22:21.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.345+0000 7fc1ca728800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:21.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.345+0000 7fc1ca728800 20 Filter name: none 2024-09-12T00:22:21.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.345+0000 7fbff57fa640 20 reqs_thread_entry: start 2024-09-12T00:22:21.345 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.345+0000 7fc1ca728800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.346+0000 7fc1ca728800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:21.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.346+0000 7fc1ca728800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.346+0000 7fc1ca728800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:21.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.346+0000 7fc1ca728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:21.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.346+0000 7fc1ca728800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.347+0000 7fc1ca728800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:21.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.347+0000 7fc1ca728800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.347+0000 7fc1ca728800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:21.347 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.347+0000 7fc1ca728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:21.348 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.349+0000 7fc07cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:21.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.351+0000 7fc1ca728800 20 remove_watcher() i=0 2024-09-12T00:22:21.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.351+0000 7fc1ca728800 2 removed watcher, disabling cache 2024-09-12T00:22:21.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.352+0000 7fc1ca728800 20 remove_watcher() i=1 2024-09-12T00:22:21.351 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.352+0000 7fc1ca728800 20 remove_watcher() i=2 2024-09-12T00:22:21.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.354+0000 7fc1ca728800 20 remove_watcher() i=3 2024-09-12T00:22:21.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.355+0000 7fc1ca728800 20 remove_watcher() i=4 2024-09-12T00:22:21.355 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.356+0000 7fc1ca728800 20 remove_watcher() i=5 2024-09-12T00:22:21.356 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.357+0000 7fc1ca728800 20 remove_watcher() i=6 2024-09-12T00:22:21.357 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.358+0000 7fc1ca728800 20 remove_watcher() i=7 2024-09-12T00:22:21.369 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.369 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:22:21.369 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-change-reshard-state id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:22:21.369 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.371 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:22:21.405 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:21.405 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:21.451 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.451+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.452 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 realm 2024-09-12T00:22:21.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.453+0000 7fbd89b3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:21.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.453 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.454+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:21.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.454+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.455+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:21.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.455+0000 7fbd89b3e800 20 searching for the correct realm 2024-09-12T00:22:21.658 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.659+0000 7fbd85085640 0 -- 172.21.15.67:0/2872341321 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fbd7c028910 msgr2=0x7fbd7c01b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:21.662 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.663+0000 7fbd86087640 0 -- 172.21.15.67:0/2872341321 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55a2a7821a00 msgr2=0x55a2a7823e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:21.666 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:21.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:21.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:21.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:21.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:21.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:21.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:21.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:21.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 zone default found 2024-09-12T00:22:21.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.668+0000 7fbd89b3e800 4 Realm: () 2024-09-12T00:22:21.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.668+0000 7fbd89b3e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:21.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.668+0000 7fbd89b3e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:21.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.668+0000 7fbd89b3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:21.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 zonegroup default 2024-09-12T00:22:21.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.669+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.669+0000 7fbd89b3e800 20 started sync module instance, tier type = 2024-09-12T00:22:21.670 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.669+0000 7fbd89b3e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:21.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=0 2024-09-12T00:22:21.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=1 2024-09-12T00:22:21.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=2 2024-09-12T00:22:21.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=3 2024-09-12T00:22:21.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=4 2024-09-12T00:22:21.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=5 2024-09-12T00:22:21.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=6 2024-09-12T00:22:21.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.678+0000 7fbd89b3e800 20 add_watcher() i=7 2024-09-12T00:22:21.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.678+0000 7fbd89b3e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:21.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.679+0000 7fbc37fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:21.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.680+0000 7fbd89b3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:21.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.680+0000 7fbd89b3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:21.679 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 note: GC not initialized 2024-09-12T00:22:21.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.680+0000 7fbc36ffd640 20 reqs_thread_entry: start 2024-09-12T00:22:21.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.680+0000 7fbd89b3e800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:21.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.680+0000 7fbd89b3e800 20 Filter name: none 2024-09-12T00:22:21.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.680+0000 7fbc34ff9640 20 reqs_thread_entry: start 2024-09-12T00:22:21.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.680+0000 7fbd89b3e800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:22:21.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.680+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.681+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:21.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:22:21.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:22:21.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 : miss 2024-09-12T00:22:21.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.681+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.681+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:21.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:21.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:21.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:22:21.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:21.682 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 2024-09-12T00:22:21.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.685+0000 7fbd89b3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:21.684 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.685+0000 7fbd89b3e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:21.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.685+0000 7fbd89b3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:21.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.685+0000 7fbd89b3e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39, ofs0, ns] 2024-09-12T00:22:21.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.686+0000 7fbc697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562474 cookie 94157083451792 notifier 8028 bl.length()=931 2024-09-12T00:22:21.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.686+0000 7fbc697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:21.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.686+0000 7fbc697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:21.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.686+0000 7fbc697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:21.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.686+0000 7fbd89b3e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): orig_sources= new_sources= 2024-09-12T00:22:21.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.686+0000 7fbd89b3e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): potential sources added=[] removed=[] 2024-09-12T00:22:21.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.686+0000 7fbd89b3e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): orig_dests= new_dests= 2024-09-12T00:22:21.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.686+0000 7fbd89b3e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): potential dests added=[] removed=[] 2024-09-12T00:22:21.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.689+0000 7fbd89b3e800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.1.0 2024-09-12T00:22:21.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.689+0000 7fbd89b3e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.1.0 2024-09-12T00:22:21.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.689+0000 7fbd89b3e800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.1.1 2024-09-12T00:22:21.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.689+0000 7fbd89b3e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.1.1 2024-09-12T00:22:21.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.689+0000 7fbd89b3e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.0 2024-09-12T00:22:21.690 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbd89b3e800 time 2024-09-12T00:22:21.693089+0000 2024-09-12T00:22:21.690 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:22:21.691 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:21.691 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbd8b38c71a] 2024-09-12T00:22:21.691 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbd8b38c8d8] 2024-09-12T00:22:21.691 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a2a57ed641] 2024-09-12T00:22:21.691 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55a2a57fc51b] 2024-09-12T00:22:21.691 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a2a57fd3e4] 2024-09-12T00:22:21.692 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:22:21.692 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbd8a029590] 2024-09-12T00:22:21.692 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:22:21.692 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:22:21.692 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.692+0000 7fbd89b3e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbd89b3e800 time 2024-09-12T00:22:21.693089+0000 2024-09-12T00:22:21.692 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:22:21.692 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.692 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:21.692 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbd8b38c71a] 2024-09-12T00:22:21.692 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbd8b38c8d8] 2024-09-12T00:22:21.692 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a2a57ed641] 2024-09-12T00:22:21.692 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55a2a57fc51b] 2024-09-12T00:22:21.692 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a2a57fd3e4] 2024-09-12T00:22:21.693 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:22:21.693 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbd8a029590] 2024-09-12T00:22:21.693 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:22:21.693 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:22:21.693 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.693 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:22:21.693 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fbd89b3e800 thread_name:radosgw-admin 2024-09-12T00:22:21.712 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:21.712 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbd8a03e6f0] 2024-09-12T00:22:21.712 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbd8a08b99c] 2024-09-12T00:22:21.712 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:22:21.712 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:22:21.712 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbd8b38c774] 2024-09-12T00:22:21.712 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbd8b38c8d8] 2024-09-12T00:22:21.712 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a2a57ed641] 2024-09-12T00:22:21.712 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55a2a57fc51b] 2024-09-12T00:22:21.712 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a2a57fd3e4] 2024-09-12T00:22:21.712 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:22:21.713 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbd8a029590] 2024-09-12T00:22:21.713 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:22:21.713 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:22:21.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.693+0000 7fbd89b3e800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:22:21.713 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fbd89b3e800 thread_name:radosgw-admin 2024-09-12T00:22:21.713 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.713 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:21.713 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbd8a03e6f0] 2024-09-12T00:22:21.713 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbd8a08b99c] 2024-09-12T00:22:21.713 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:22:21.713 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:22:21.713 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbd8b38c774] 2024-09-12T00:22:21.713 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbd8b38c8d8] 2024-09-12T00:22:21.714 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a2a57ed641] 2024-09-12T00:22:21.714 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55a2a57fc51b] 2024-09-12T00:22:21.714 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a2a57fd3e4] 2024-09-12T00:22:21.714 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:22:21.714 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbd8a029590] 2024-09-12T00:22:21.714 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:22:21.714 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:22:21.714 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:22:21.714 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.714 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:22:21.714 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:22:21.714 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: dump: 2024-09-12T00:22:21.714 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.714 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.715 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.715 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.715 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.715 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.715 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.715 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.715 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.715 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.715 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: _finish_auth 0 2024-09-12T00:22:21.715 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: _check_auth_tickets 2024-09-12T00:22:21.715 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:21.715 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 monclient: authenticate success, global_id 8016 2024-09-12T00:22:21.715 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 10 monclient: get_monmap_and_config success 2024-09-12T00:22:21.715 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 4 set_mon_vals no callback set 2024-09-12T00:22:21.715 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.716 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:22:21.716 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: dump: 2024-09-12T00:22:21.716 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.716 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.716 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.716 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.716 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.716 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.716 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.716 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.716 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.716 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.716 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 10 monclient: shutdown 2024-09-12T00:22:21.716 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 asok(0x55a2a7517630) unregister_commands rotate-key 2024-09-12T00:22:21.716 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 10 monclient: build_initial_monmap 2024-09-12T00:22:21.717 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 1 build_initial for_mkfs: 0 2024-09-12T00:22:21.717 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 10 monclient: monmap: 2024-09-12T00:22:21.717 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:22:21.717 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:22:21.717 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:22:21.717 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:22:21.717 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:22:21.717 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.717 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:22:21.717 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:22:21.717 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:22:21.717 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.717 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding auth protocol: cephx 2024-09-12T00:22:21.717 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding auth protocol: cephx 2024-09-12T00:22:21.717 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding auth protocol: cephx 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: secure 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: crc 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: secure 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: crc 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: secure 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: crc 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: crc 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: secure 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: crc 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: secure 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: crc 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: secure 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 1 librados: starting msgr at 2024-09-12T00:22:21.719 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 1 librados: starting objecter 2024-09-12T00:22:21.719 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command objecter_requests hook 0x55a2a773cdd0 2024-09-12T00:22:21.719 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 1 librados: setting wanted keys 2024-09-12T00:22:21.719 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 1 librados: calling monclient init 2024-09-12T00:22:21.719 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient: init 2024-09-12T00:22:21.719 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding auth protocol: cephx 2024-09-12T00:22:21.719 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding auth protocol: cephx 2024-09-12T00:22:21.719 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding auth protocol: cephx 2024-09-12T00:22:21.719 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: secure 2024-09-12T00:22:21.719 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: crc 2024-09-12T00:22:21.719 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: secure 2024-09-12T00:22:21.719 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: crc 2024-09-12T00:22:21.719 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: secure 2024-09-12T00:22:21.719 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: crc 2024-09-12T00:22:21.720 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: crc 2024-09-12T00:22:21.720 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: secure 2024-09-12T00:22:21.720 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: crc 2024-09-12T00:22:21.720 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: secure 2024-09-12T00:22:21.720 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: crc 2024-09-12T00:22:21.720 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: secure 2024-09-12T00:22:21.720 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.720 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.720 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command rotate-key hook 0x55a2a7737b28 2024-09-12T00:22:21.720 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:21.720 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:22:21.720 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-a con 0x55a2a75e50d0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:21.721 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-b con 0x55a2a767a930 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:21.721 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-c con 0x55a2a7681380 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:21.721 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.721 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.721 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.721 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:21.721 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): authenticate will time out at 2018.686873s 2024-09-12T00:22:21.721 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:22:21.429+0000 7fbd85886640 10 monclient(hunting): get_auth_request con 0x55a2a75e50d0 auth_method 0 2024-09-12T00:22:21.721 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:22:21.429+0000 7fbd85886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.721 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:22:21.429+0000 7fbd85886640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.721 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:22:21.429+0000 7fbd85886640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.721 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:22:21.429+0000 7fbd86087640 10 monclient(hunting): get_auth_request con 0x55a2a7681380 auth_method 0 2024-09-12T00:22:21.721 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:22:21.429+0000 7fbd86087640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.722 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:22:21.429+0000 7fbd86087640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.722 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:22:21.429+0000 7fbd86087640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.722 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:22:21.430+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.722 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:22:21.430+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.722 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:22:21.430+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.722 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:22:21.430+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.722 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:22:21.430+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.722 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:22:21.430+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.722 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:22:21.430+0000 7fbd85085640 10 monclient(hunting): get_auth_request con 0x55a2a767a930 auth_method 0 2024-09-12T00:22:21.722 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:22:21.430+0000 7fbd85085640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.722 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:22:21.430+0000 7fbd85085640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.722 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:22:21.430+0000 7fbd85085640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.722 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:22:21.430+0000 7fbd85886640 10 monclient(hunting): handle_auth_done global_id 8019 payload 824 2024-09-12T00:22:21.722 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:22:21.430+0000 7fbd85886640 10 monclient: _finish_hunting 0 2024-09-12T00:22:21.723 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:22:21.430+0000 7fbd85886640 1 monclient: found mon.noname-a 2024-09-12T00:22:21.723 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:22:21.430+0000 7fbd85886640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:22:21.723 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.723 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:22:21.723 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: dump: 2024-09-12T00:22:21.723 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.723 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.723 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.723 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.723 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.723 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.723 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.723 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.723 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.723 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.724 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: _finish_auth 0 2024-09-12T00:22:21.724 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: _check_auth_tickets 2024-09-12T00:22:21.724 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:21.724 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.724 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:22:21.724 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: dump: 2024-09-12T00:22:21.724 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.724 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.724 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.724 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.724 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.724 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.724 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.724 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.724 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.725 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.725 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:22:21.430+0000 7fbd89b3e800 5 monclient: authenticate success, global_id 8019 2024-09-12T00:22:21.725 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:22:21.430+0000 7fbd89b3e800 10 monclient: _renew_subs 2024-09-12T00:22:21.725 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:22:21.430+0000 7fbc73e07640 4 set_mon_vals no callback set 2024-09-12T00:22:21.725 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:22:21.430+0000 7fbd89b3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:21.725 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:22:21.430+0000 7fbd89b3e800 10 monclient: _renew_subs 2024-09-12T00:22:21.725 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:22:21.430+0000 7fbd89b3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:21.725 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:22:21.430+0000 7fbd89b3e800 1 librados: init done 2024-09-12T00:22:21.725 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:22:21.432+0000 7fbc72604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:22:21.725 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:22:21.432+0000 7fbc72604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:21.725 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:22:21.432+0000 7fbc72604640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:21.725 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:22:21.432+0000 7fbd85085640 10 monclient: get_auth_request con 0x7fbc6c076470 auth_method 0 2024-09-12T00:22:21.725 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:22:21.433+0000 7fbd86087640 10 monclient: get_auth_request con 0x55a2a7760a60 auth_method 0 2024-09-12T00:22:21.725 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:22:21.436+0000 7fbd85886640 10 monclient: get_auth_request con 0x55a2a7783630 auth_method 0 2024-09-12T00:22:21.725 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:22:21.438+0000 7fbd85085640 10 monclient: get_auth_request con 0x55a2a7787820 auth_method 0 2024-09-12T00:22:21.726 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 10 monclient: build_initial_monmap 2024-09-12T00:22:21.726 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 1 build_initial for_mkfs: 0 2024-09-12T00:22:21.726 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 10 monclient: monmap: 2024-09-12T00:22:21.726 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:22:21.726 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:22:21.726 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:22:21.726 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:22:21.726 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:22:21.726 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.726 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:22:21.726 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:22:21.726 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:22:21.726 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.726 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding auth protocol: cephx 2024-09-12T00:22:21.727 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding auth protocol: cephx 2024-09-12T00:22:21.727 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding auth protocol: cephx 2024-09-12T00:22:21.727 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: secure 2024-09-12T00:22:21.727 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: crc 2024-09-12T00:22:21.727 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: secure 2024-09-12T00:22:21.727 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: crc 2024-09-12T00:22:21.727 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: secure 2024-09-12T00:22:21.727 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: crc 2024-09-12T00:22:21.727 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: crc 2024-09-12T00:22:21.727 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: secure 2024-09-12T00:22:21.727 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: crc 2024-09-12T00:22:21.727 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: secure 2024-09-12T00:22:21.727 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: crc 2024-09-12T00:22:21.727 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: secure 2024-09-12T00:22:21.728 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.728 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command objecter_requests cmddesc objecter_requests hook 0x55a2a778ff60 EEXIST 2024-09-12T00:22:21.728 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 10 monclient: init 2024-09-12T00:22:21.728 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding auth protocol: cephx 2024-09-12T00:22:21.728 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding auth protocol: cephx 2024-09-12T00:22:21.728 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding auth protocol: cephx 2024-09-12T00:22:21.728 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: secure 2024-09-12T00:22:21.728 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: crc 2024-09-12T00:22:21.728 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: secure 2024-09-12T00:22:21.728 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: crc 2024-09-12T00:22:21.728 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: secure 2024-09-12T00:22:21.728 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: crc 2024-09-12T00:22:21.728 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: crc 2024-09-12T00:22:21.728 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: secure 2024-09-12T00:22:21.728 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: crc 2024-09-12T00:22:21.729 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: secure 2024-09-12T00:22:21.729 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: crc 2024-09-12T00:22:21.729 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: secure 2024-09-12T00:22:21.729 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.729 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.729 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command rotate-key cmddesc rotate-key hook 0x55a2a778ad90 EEXIST 2024-09-12T00:22:21.729 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:21.729 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:22:21.729 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-c con 0x55a2a77b3c50 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:21.729 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-b con 0x55a2a77b5f20 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:21.729 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-a con 0x55a2a77b2420 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:21.729 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.729 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.729 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.729 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): authenticate will time out at 2018.700483s 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): get_auth_request con 0x55a2a77b3c50 auth_method 0 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:22:21.443+0000 7fbd86087640 10 monclient(hunting): get_auth_request con 0x55a2a77b2420 auth_method 0 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:22:21.443+0000 7fbd86087640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:22:21.443+0000 7fbd86087640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:22:21.443+0000 7fbd86087640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:22:21.443+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:22:21.443+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:22:21.443+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.730 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): handle_auth_done global_id 7472 payload 824 2024-09-12T00:22:21.731 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient: _finish_hunting 0 2024-09-12T00:22:21.731 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:22:21.443+0000 7fbd85886640 1 monclient: found mon.noname-c 2024-09-12T00:22:21.731 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:22:21.731 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.731 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:22:21.731 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: dump: 2024-09-12T00:22:21.731 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.731 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.731 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.731 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.731 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.731 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.731 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.732 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.732 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.732 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.732 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:22:21.732 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:22:21.732 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:21.732 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.732 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:22:21.732 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: dump: 2024-09-12T00:22:21.732 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.732 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.732 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.732 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.733 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.733 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.733 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.733 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.733 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.733 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.733 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:22:21.444+0000 7fbd89b3e800 5 monclient: authenticate success, global_id 7472 2024-09-12T00:22:21.733 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:22:21.444+0000 7fbd89b3e800 10 monclient: _renew_subs 2024-09-12T00:22:21.733 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:22:21.444+0000 7fbd89b3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:22:21.733 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:22:21.444+0000 7fbd86888640 4 set_mon_vals no callback set 2024-09-12T00:22:21.733 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:22:21.444+0000 7fbd89b3e800 10 monclient: _renew_subs 2024-09-12T00:22:21.733 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:22:21.444+0000 7fbd89b3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:22:21.733 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:22:21.445+0000 7fbc6b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:22:21.733 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:22:21.446+0000 7fbc6b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:21.734 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:22:21.446+0000 7fbc6b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:21.734 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:22:21.446+0000 7fbd85085640 10 monclient: get_auth_request con 0x7fbc60076380 auth_method 0 2024-09-12T00:22:21.734 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 10 monclient: get_monmap_and_config 2024-09-12T00:22:21.734 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 10 monclient: build_initial_monmap 2024-09-12T00:22:21.734 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 1 build_initial for_mkfs: 0 2024-09-12T00:22:21.734 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 10 monclient: monmap: 2024-09-12T00:22:21.734 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:22:21.734 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:22:21.734 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:22:21.734 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:22:21.734 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:22:21.734 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.734 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:22:21.734 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:22:21.735 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:22:21.735 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.735 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding auth protocol: cephx 2024-09-12T00:22:21.735 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding auth protocol: cephx 2024-09-12T00:22:21.735 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding auth protocol: cephx 2024-09-12T00:22:21.735 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: secure 2024-09-12T00:22:21.735 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: crc 2024-09-12T00:22:21.735 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: secure 2024-09-12T00:22:21.735 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: crc 2024-09-12T00:22:21.735 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: secure 2024-09-12T00:22:21.735 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: crc 2024-09-12T00:22:21.735 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: crc 2024-09-12T00:22:21.735 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: secure 2024-09-12T00:22:21.736 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: crc 2024-09-12T00:22:21.736 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: secure 2024-09-12T00:22:21.736 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: crc 2024-09-12T00:22:21.736 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: secure 2024-09-12T00:22:21.736 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.736 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 10 monclient: init 2024-09-12T00:22:21.736 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding auth protocol: cephx 2024-09-12T00:22:21.736 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding auth protocol: cephx 2024-09-12T00:22:21.736 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding auth protocol: cephx 2024-09-12T00:22:21.736 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: secure 2024-09-12T00:22:21.736 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: crc 2024-09-12T00:22:21.736 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: secure 2024-09-12T00:22:21.736 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: crc 2024-09-12T00:22:21.736 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: secure 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: crc 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: crc 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: secure 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: crc 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: secure 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: crc 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: secure 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command rotate-key cmddesc rotate-key hook 0x7ffd85bed1f8 EEXIST 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-c con 0x55a2a77d79c0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-a con 0x55a2a77d5c10 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:21.738 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-b con 0x55a2a78080c0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:21.738 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.738 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.738 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.738 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:21.738 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): authenticate will time out at 2018.704300s 2024-09-12T00:22:21.738 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): get_auth_request con 0x55a2a77d79c0 auth_method 0 2024-09-12T00:22:21.738 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.738 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.738 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.738 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:22:21.447+0000 7fbd85085640 10 monclient(hunting): get_auth_request con 0x55a2a77d5c10 auth_method 0 2024-09-12T00:22:21.738 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:22:21.447+0000 7fbd85085640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.738 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:22:21.447+0000 7fbd85085640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.738 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:22:21.447+0000 7fbd85085640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.738 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.739 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.739 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.739 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:22:21.447+0000 7fbd85085640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.739 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:22:21.447+0000 7fbd85085640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.739 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:22:21.447+0000 7fbd85085640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.739 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): handle_auth_done global_id 7475 payload 274 2024-09-12T00:22:21.739 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient: _finish_hunting 0 2024-09-12T00:22:21.739 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:22:21.447+0000 7fbd85886640 1 monclient: found mon.noname-c 2024-09-12T00:22:21.739 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:22:21.739 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:22:21.447+0000 7fbd86087640 10 monclient: get_auth_request con 0x55a2a78080c0 auth_method 0 2024-09-12T00:22:21.739 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.739 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:22:21.739 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: dump: 2024-09-12T00:22:21.739 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.740 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.740 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.740 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.740 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.740 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.740 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.740 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.740 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.740 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.740 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: _finish_auth 0 2024-09-12T00:22:21.740 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: _check_auth_tickets 2024-09-12T00:22:21.740 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 5 monclient: authenticate success, global_id 7475 2024-09-12T00:22:21.740 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:21.741 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient: get_monmap_and_config success 2024-09-12T00:22:21.741 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 4 set_mon_vals no callback set 2024-09-12T00:22:21.741 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.741 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:22:21.741 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: dump: 2024-09-12T00:22:21.741 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.741 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.741 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.741 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.741 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.741 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.741 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.741 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.741 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.742 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.742 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 10 monclient: shutdown 2024-09-12T00:22:21.742 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 10 monclient: build_initial_monmap 2024-09-12T00:22:21.742 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 1 build_initial for_mkfs: 0 2024-09-12T00:22:21.742 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 10 monclient: monmap: 2024-09-12T00:22:21.742 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:22:21.742 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:22:21.742 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:22:21.742 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:22:21.742 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:22:21.742 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.742 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:22:21.742 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:22:21.742 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding auth protocol: cephx 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding auth protocol: cephx 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding auth protocol: cephx 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: secure 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: crc 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: secure 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: crc 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: secure 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: crc 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: crc 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: secure 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: crc 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: secure 2024-09-12T00:22:21.744 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: crc 2024-09-12T00:22:21.744 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: secure 2024-09-12T00:22:21.744 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.744 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 1 librados: starting msgr at 2024-09-12T00:22:21.744 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 1 librados: starting objecter 2024-09-12T00:22:21.744 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command objecter_requests cmddesc objecter_requests hook 0x55a2a77d7450 EEXIST 2024-09-12T00:22:21.744 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 1 librados: setting wanted keys 2024-09-12T00:22:21.744 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 1 librados: calling monclient init 2024-09-12T00:22:21.744 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient: init 2024-09-12T00:22:21.744 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding auth protocol: cephx 2024-09-12T00:22:21.744 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding auth protocol: cephx 2024-09-12T00:22:21.744 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding auth protocol: cephx 2024-09-12T00:22:21.744 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: secure 2024-09-12T00:22:21.745 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: crc 2024-09-12T00:22:21.745 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: secure 2024-09-12T00:22:21.745 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: crc 2024-09-12T00:22:21.745 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: secure 2024-09-12T00:22:21.745 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: crc 2024-09-12T00:22:21.745 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: crc 2024-09-12T00:22:21.745 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: secure 2024-09-12T00:22:21.745 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: crc 2024-09-12T00:22:21.745 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: secure 2024-09-12T00:22:21.745 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: crc 2024-09-12T00:22:21.745 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: secure 2024-09-12T00:22:21.745 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.745 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.745 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command rotate-key cmddesc rotate-key hook 0x55a2a77cbb48 EEXIST 2024-09-12T00:22:21.746 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:21.746 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:22:21.746 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-a con 0x55a2a77d5c10 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:21.746 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-b con 0x55a2a77d79c0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:21.746 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-c con 0x55a2a78080c0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:21.746 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.746 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.746 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.746 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:21.746 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): authenticate will time out at 2018.706620s 2024-09-12T00:22:21.746 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): get_auth_request con 0x55a2a77d5c10 auth_method 0 2024-09-12T00:22:21.746 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.746 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.746 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.747 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:22:21.449+0000 7fbd86087640 10 monclient(hunting): get_auth_request con 0x55a2a78080c0 auth_method 0 2024-09-12T00:22:21.747 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:22:21.449+0000 7fbd86087640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.747 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:22:21.449+0000 7fbd86087640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.747 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:22:21.449+0000 7fbd86087640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.747 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.747 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.747 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.747 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:22:21.449+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.747 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:22:21.449+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.747 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:22:21.449+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.747 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): handle_auth_done global_id 8028 payload 824 2024-09-12T00:22:21.747 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient: _finish_hunting 0 2024-09-12T00:22:21.747 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:22:21.449+0000 7fbd85886640 1 monclient: found mon.noname-a 2024-09-12T00:22:21.747 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:22:21.747 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:22:21.449+0000 7fbd85085640 10 monclient: get_auth_request con 0x55a2a77d79c0 auth_method 0 2024-09-12T00:22:21.748 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.748 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:22:21.748 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: dump: 2024-09-12T00:22:21.748 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.748 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.748 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.748 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.748 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.748 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.748 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.748 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.748 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.748 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.749 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: _finish_auth 0 2024-09-12T00:22:21.749 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: _check_auth_tickets 2024-09-12T00:22:21.749 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:21.749 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.749 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:22:21.749 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: dump: 2024-09-12T00:22:21.749 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.749 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.749 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.749 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.749 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.749 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.749 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.749 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.749 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:22:21.450+0000 7fbd89b3e800 5 monclient: authenticate success, global_id 8028 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:22:21.450+0000 7fbd89b3e800 10 monclient: _renew_subs 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:22:21.450+0000 7fbc697fa640 4 set_mon_vals no callback set 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:22:21.450+0000 7fbd89b3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:22:21.450+0000 7fbd89b3e800 10 monclient: _renew_subs 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:22:21.450+0000 7fbd89b3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:22:21.450+0000 7fbd89b3e800 1 librados: init done 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:22:21.450+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command cr dump hook 0x55a2a7807338 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:22:21.451+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:22:21.452+0000 7fbc577fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:22:21.452+0000 7fbc577fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:22:21.452+0000 7fbc577fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:22:21.452+0000 7fbd85085640 10 monclient: get_auth_request con 0x7fbc50076470 auth_method 0 2024-09-12T00:22:21.751 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:22:21.452+0000 7fbd86087640 10 monclient: get_auth_request con 0x55a2a7821a00 auth_method 0 2024-09-12T00:22:21.751 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.751 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 realm 2024-09-12T00:22:21.751 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.751 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.751 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:21.751 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.751 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.751 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.751 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:22:21.454+0000 7fbd85886640 10 monclient: get_auth_request con 0x55a2a7825d60 auth_method 0 2024-09-12T00:22:21.751 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:22:21.454+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:21.751 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:22:21.454+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.751 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:22:21.454+0000 7fbd85085640 10 monclient: get_auth_request con 0x55a2a7829430 auth_method 0 2024-09-12T00:22:21.751 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:22:21.455+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:21.752 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:22:21.455+0000 7fbd89b3e800 20 searching for the correct realm 2024-09-12T00:22:21.752 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:22:21.456+0000 7fbd86087640 10 monclient: get_auth_request con 0x7fbd7c041b90 auth_method 0 2024-09-12T00:22:21.752 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:22:21.657+0000 7fbd86087640 10 monclient: get_auth_request con 0x7fbd7c041b90 auth_method 0 2024-09-12T00:22:21.752 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:22:21.658+0000 7fbd85886640 10 monclient: get_auth_request con 0x7fbd78092250 auth_method 0 2024-09-12T00:22:21.752 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:22:21.659+0000 7fbd85085640 10 monclient: get_auth_request con 0x7fbd7c028910 auth_method 0 2024-09-12T00:22:21.752 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:22:21.659+0000 7fbd85085640 0 -- 172.21.15.67:0/2872341321 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fbd7c028910 msgr2=0x7fbd7c01b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:21.752 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:22:21.659+0000 7fbc577fe640 1 client.8028.objecter ms_handle_reset 0x7fbd7c028910 session 0x7fbd7c0412a0 osd.5 2024-09-12T00:22:21.752 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:22:21.659+0000 7fbc577fe640 10 monclient: _renew_subs 2024-09-12T00:22:21.752 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:22:21.659+0000 7fbc577fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:21.752 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:22:21.659+0000 7fbd85085640 10 monclient: get_auth_request con 0x7fbc50086790 auth_method 0 2024-09-12T00:22:21.752 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:22:21.661+0000 7fbd86087640 10 monclient: get_auth_request con 0x7fbd78066570 auth_method 0 2024-09-12T00:22:21.752 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:22:21.662+0000 7fbd85886640 10 monclient: get_auth_request con 0x7fbd80061040 auth_method 0 2024-09-12T00:22:21.752 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:22:21.663+0000 7fbd86087640 0 -- 172.21.15.67:0/2872341321 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55a2a7821a00 msgr2=0x55a2a7823e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:21.753 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:22:21.663+0000 7fbc577fe640 1 client.8028.objecter ms_handle_reset 0x55a2a7821a00 session 0x55a2a7821330 osd.6 2024-09-12T00:22:21.753 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:22:21.663+0000 7fbd86087640 10 monclient: get_auth_request con 0x7fbd7c028910 auth_method 0 2024-09-12T00:22:21.753 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:21.753 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:21.753 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:21.753 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:21.753 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:21.753 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:21.753 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.753 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.753 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.753 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:21.753 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.754 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:21.754 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 zone default found 2024-09-12T00:22:21.754 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 4 Realm: () 2024-09-12T00:22:21.754 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:21.754 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:21.754 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:21.754 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 zonegroup default 2024-09-12T00:22:21.754 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.754 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.754 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.754 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.754 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.755 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:22:21.669+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.755 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:22:21.669+0000 7fbd89b3e800 20 started sync module instance, tier type = 2024-09-12T00:22:21.755 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:22:21.669+0000 7fbd89b3e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:21.755 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=0 2024-09-12T00:22:21.755 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=1 2024-09-12T00:22:21.755 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=2 2024-09-12T00:22:21.755 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=3 2024-09-12T00:22:21.755 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=4 2024-09-12T00:22:21.755 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=5 2024-09-12T00:22:21.755 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=6 2024-09-12T00:22:21.755 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:22:21.678+0000 7fbd89b3e800 20 add_watcher() i=7 2024-09-12T00:22:21.756 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:22:21.678+0000 7fbd89b3e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:21.756 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding auth protocol: cephx 2024-09-12T00:22:21.756 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding auth protocol: cephx 2024-09-12T00:22:21.756 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding auth protocol: cephx 2024-09-12T00:22:21.756 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: secure 2024-09-12T00:22:21.756 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: crc 2024-09-12T00:22:21.756 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: secure 2024-09-12T00:22:21.756 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: crc 2024-09-12T00:22:21.756 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:22:21.679+0000 7fbc37fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:21.756 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: secure 2024-09-12T00:22:21.756 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: crc 2024-09-12T00:22:21.756 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: crc 2024-09-12T00:22:21.757 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: secure 2024-09-12T00:22:21.757 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: crc 2024-09-12T00:22:21.757 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: secure 2024-09-12T00:22:21.757 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: crc 2024-09-12T00:22:21.757 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: secure 2024-09-12T00:22:21.757 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.757 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:21.757 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:21.757 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command cache list hook 0x55a2a780b620 2024-09-12T00:22:21.757 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command cache inspect hook 0x55a2a780b620 2024-09-12T00:22:21.757 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command cache erase hook 0x55a2a780b620 2024-09-12T00:22:21.757 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command cache zap hook 0x55a2a780b620 2024-09-12T00:22:21.757 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 note: GC not initialized 2024-09-12T00:22:21.757 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:22:21.680+0000 7fbc36ffd640 20 reqs_thread_entry: start 2024-09-12T00:22:21.758 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command sync trace show hook 0x7fbd8004d690 2024-09-12T00:22:21.758 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command sync trace history hook 0x7fbd8004d690 2024-09-12T00:22:21.758 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command sync trace active hook 0x7fbd8004d690 2024-09-12T00:22:21.758 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command sync trace active_short hook 0x7fbd8004d690 2024-09-12T00:22:21.758 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:21.758 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 20 Filter name: none 2024-09-12T00:22:21.758 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:22:21.680+0000 7fbc34ff9640 20 reqs_thread_entry: start 2024-09-12T00:22:21.758 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:22:21.758 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.758 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:21.758 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:22:21.758 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:22:21.759 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 : miss 2024-09-12T00:22:21.759 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.759 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:21.759 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:21.759 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:21.759 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:22:21.759 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:21.759 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 2024-09-12T00:22:21.759 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:22:21.685+0000 7fbd89b3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:21.759 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:22:21.685+0000 7fbd89b3e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:21.759 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:22:21.685+0000 7fbd89b3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:21.759 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:22:21.685+0000 7fbd89b3e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39, ofs0, ns] 2024-09-12T00:22:21.759 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:22:21.686+0000 7fbc697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562474 cookie 94157083451792 notifier 8028 bl.length()=931 2024-09-12T00:22:21.760 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:22:21.686+0000 7fbc697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:21.760 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:22:21.686+0000 7fbc697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:21.760 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:22:21.686+0000 7fbc697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:21.760 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:22:21.686+0000 7fbd89b3e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): orig_sources= new_sources= 2024-09-12T00:22:21.760 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:22:21.686+0000 7fbd89b3e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): potential sources added=[] removed=[] 2024-09-12T00:22:21.760 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:22:21.686+0000 7fbd89b3e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): orig_dests= new_dests= 2024-09-12T00:22:21.760 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:22:21.686+0000 7fbd89b3e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): potential dests added=[] removed=[] 2024-09-12T00:22:21.760 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:22:21.689+0000 7fbd89b3e800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.1.0 2024-09-12T00:22:21.760 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:22:21.689+0000 7fbd89b3e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.1.0 2024-09-12T00:22:21.760 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:22:21.689+0000 7fbd89b3e800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.1.1 2024-09-12T00:22:21.760 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:22:21.689+0000 7fbd89b3e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.1.1 2024-09-12T00:22:21.760 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:22:21.689+0000 7fbd89b3e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.0 2024-09-12T00:22:21.760 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:22:21.692+0000 7fbd89b3e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbd89b3e800 time 2024-09-12T00:22:21.693089+0000 2024-09-12T00:22:21.761 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:22:21.761 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.761 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:21.761 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbd8b38c71a] 2024-09-12T00:22:21.761 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbd8b38c8d8] 2024-09-12T00:22:21.761 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a2a57ed641] 2024-09-12T00:22:21.761 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55a2a57fc51b] 2024-09-12T00:22:21.761 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a2a57fd3e4] 2024-09-12T00:22:21.761 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:22:21.761 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbd8a029590] 2024-09-12T00:22:21.761 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:22:21.761 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:22:21.761 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.761 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:22:21.693+0000 7fbd89b3e800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:22:21.762 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fbd89b3e800 thread_name:radosgw-admin 2024-09-12T00:22:21.762 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.762 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:21.762 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbd8a03e6f0] 2024-09-12T00:22:21.762 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbd8a08b99c] 2024-09-12T00:22:21.762 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:22:21.762 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:22:21.762 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbd8b38c774] 2024-09-12T00:22:21.762 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbd8b38c8d8] 2024-09-12T00:22:21.762 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a2a57ed641] 2024-09-12T00:22:21.762 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55a2a57fc51b] 2024-09-12T00:22:21.762 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a2a57fd3e4] 2024-09-12T00:22:21.762 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:22:21.763 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbd8a029590] 2024-09-12T00:22:21.763 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:22:21.763 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:22:21.763 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:22:21.763 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.763 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:22:21.763 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:22:21.763 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:22:21.763 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:22:21.763 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:22:21.763 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:22:21.763 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:22:21.763 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:22:21.764 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:22:21.764 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:22:21.764 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:22:21.764 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:22:21.764 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:22:21.764 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:22:21.764 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:22:21.764 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:22:21.764 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:22:21.764 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:22:21.764 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:22:21.764 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:22:21.764 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:22:21.765 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:22:21.765 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:22:21.765 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:22:21.765 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:22:21.765 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:22:21.765 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:22:21.765 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:22:21.765 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:22:21.765 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:22:21.765 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:22:21.765 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:22:21.765 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:22:21.765 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:22:21.765 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:22:21.766 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:22:21.766 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:22:21.766 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:22:21.766 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:22:21.766 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:22:21.766 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:22:21.766 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:22:21.766 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:22:21.766 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:22:21.766 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:22:21.766 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:22:21.766 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:22:21.766 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:22:21.766 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:22:21.767 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:22:21.767 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:22:21.767 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:22:21.767 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:22:21.767 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:22:21.767 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:22:21.767 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:22:21.767 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:22:21.767 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:22:21.767 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:22:21.767 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:22:21.767 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:22:21.767 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:22:21.767 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:22:21.768 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:22:21.768 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:22:21.768 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:22:21.768 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:22:21.768 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:22:21.768 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:22:21.768 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:22:21.768 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:22:21.768 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:22:21.768 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:22:21.768 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:22:21.768 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:22:21.768 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:22:21.769 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:22:21.769 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:22:21.769 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:22:21.769 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:22:21.769 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:22:21.769 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:22:21.769 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:22:21.769 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:22:21.769 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:22:21.769 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:22:21.769 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:22:21.769 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:22:21.769 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:22:21.769 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:22:21.770 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:22:21.770 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:22:21.770 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:22:21.770 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:22:21.770 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc34ff9640 / http_manager 2024-09-12T00:22:21.770 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc36ffd640 / http_manager 2024-09-12T00:22:21.770 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc37fff640 / rgw_dt_lg_renew 2024-09-12T00:22:21.770 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc577fe640 / ms_dispatch 2024-09-12T00:22:21.770 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc697fa640 / io_context_pool 2024-09-12T00:22:21.770 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc6b7fe640 / ms_dispatch 2024-09-12T00:22:21.770 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc72604640 / ms_dispatch 2024-09-12T00:22:21.770 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc73e07640 / io_context_pool 2024-09-12T00:22:21.770 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbd85085640 / msgr-worker-2 2024-09-12T00:22:21.771 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbd85886640 / msgr-worker-1 2024-09-12T00:22:21.771 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbd86087640 / msgr-worker-0 2024-09-12T00:22:21.771 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbd86888640 / io_context_pool 2024-09-12T00:22:21.771 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbd89b3e800 / radosgw-admin 2024-09-12T00:22:21.771 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:22:21.771 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:22:21.771 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.142330.log 2024-09-12T00:22:21.771 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:22:21.771 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:22:21.771 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:22:21.771 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: dump: 2024-09-12T00:22:21.771 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.771 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.771 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.772 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.772 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.772 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.772 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.772 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.772 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.772 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.772 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: _finish_auth 0 2024-09-12T00:22:21.772 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: _check_auth_tickets 2024-09-12T00:22:21.772 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:21.772 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 monclient: authenticate success, global_id 8016 2024-09-12T00:22:21.772 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 10 monclient: get_monmap_and_config success 2024-09-12T00:22:21.772 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 4 set_mon_vals no callback set 2024-09-12T00:22:21.773 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.773 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:22:21.773 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:22:21.428+0000 7fbc73e07640 10 monclient: dump: 2024-09-12T00:22:21.773 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.773 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.773 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.773 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.773 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.773 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.773 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.773 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.773 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.773 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.774 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 10 monclient: shutdown 2024-09-12T00:22:21.774 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 asok(0x55a2a7517630) unregister_commands rotate-key 2024-09-12T00:22:21.774 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 10 monclient: build_initial_monmap 2024-09-12T00:22:21.774 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 1 build_initial for_mkfs: 0 2024-09-12T00:22:21.774 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 10 monclient: monmap: 2024-09-12T00:22:21.774 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:22:21.774 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:22:21.774 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:22:21.774 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:22:21.774 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:22:21.774 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.774 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:22:21.774 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:22:21.774 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:22:21.775 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.775 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding auth protocol: cephx 2024-09-12T00:22:21.775 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding auth protocol: cephx 2024-09-12T00:22:21.775 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding auth protocol: cephx 2024-09-12T00:22:21.775 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: secure 2024-09-12T00:22:21.775 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: crc 2024-09-12T00:22:21.775 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: secure 2024-09-12T00:22:21.775 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: crc 2024-09-12T00:22:21.775 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: secure 2024-09-12T00:22:21.775 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: crc 2024-09-12T00:22:21.775 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: crc 2024-09-12T00:22:21.775 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: secure 2024-09-12T00:22:21.775 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: crc 2024-09-12T00:22:21.776 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: secure 2024-09-12T00:22:21.776 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: crc 2024-09-12T00:22:21.776 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:22:21.428+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a773d650) adding con mode: secure 2024-09-12T00:22:21.776 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.776 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 1 librados: starting msgr at 2024-09-12T00:22:21.776 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 1 librados: starting objecter 2024-09-12T00:22:21.776 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command objecter_requests hook 0x55a2a773cdd0 2024-09-12T00:22:21.776 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 1 librados: setting wanted keys 2024-09-12T00:22:21.776 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 1 librados: calling monclient init 2024-09-12T00:22:21.776 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient: init 2024-09-12T00:22:21.776 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding auth protocol: cephx 2024-09-12T00:22:21.776 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding auth protocol: cephx 2024-09-12T00:22:21.776 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding auth protocol: cephx 2024-09-12T00:22:21.776 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: secure 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: crc 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: secure 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: crc 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: secure 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: crc 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: crc 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: secure 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: crc 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: secure 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: crc 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77379e0) adding con mode: secure 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command rotate-key hook 0x55a2a7737b28 2024-09-12T00:22:21.778 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:21.778 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:22:21.778 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-a con 0x55a2a75e50d0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:21.778 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-b con 0x55a2a767a930 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:21.778 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-c con 0x55a2a7681380 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:21.778 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.778 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.778 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.778 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:21.779 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:22:21.429+0000 7fbd89b3e800 10 monclient(hunting): authenticate will time out at 2018.686873s 2024-09-12T00:22:21.779 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:22:21.429+0000 7fbd85886640 10 monclient(hunting): get_auth_request con 0x55a2a75e50d0 auth_method 0 2024-09-12T00:22:21.779 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:22:21.429+0000 7fbd85886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.779 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:22:21.429+0000 7fbd85886640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.779 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:22:21.429+0000 7fbd85886640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.779 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:22:21.429+0000 7fbd86087640 10 monclient(hunting): get_auth_request con 0x55a2a7681380 auth_method 0 2024-09-12T00:22:21.779 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:22:21.429+0000 7fbd86087640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.779 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:22:21.429+0000 7fbd86087640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.779 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:22:21.429+0000 7fbd86087640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.779 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:22:21.430+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.779 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:22:21.430+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.779 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:22:21.430+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.779 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:22:21.430+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.779 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:22:21.430+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.780 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:22:21.430+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.780 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:22:21.430+0000 7fbd85085640 10 monclient(hunting): get_auth_request con 0x55a2a767a930 auth_method 0 2024-09-12T00:22:21.780 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:22:21.430+0000 7fbd85085640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.780 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:22:21.430+0000 7fbd85085640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.780 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:22:21.430+0000 7fbd85085640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.780 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:22:21.430+0000 7fbd85886640 10 monclient(hunting): handle_auth_done global_id 8019 payload 824 2024-09-12T00:22:21.780 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:22:21.430+0000 7fbd85886640 10 monclient: _finish_hunting 0 2024-09-12T00:22:21.780 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:22:21.430+0000 7fbd85886640 1 monclient: found mon.noname-a 2024-09-12T00:22:21.780 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:22:21.430+0000 7fbd85886640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:22:21.780 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.780 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:22:21.780 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: dump: 2024-09-12T00:22:21.780 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.780 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.780 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.781 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.781 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.781 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.781 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.781 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.781 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.781 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.781 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: _finish_auth 0 2024-09-12T00:22:21.781 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: _check_auth_tickets 2024-09-12T00:22:21.781 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:21.781 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.781 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:22:21.781 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:22:21.430+0000 7fbc72604640 10 monclient: dump: 2024-09-12T00:22:21.781 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.782 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.782 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.782 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.782 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.782 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.782 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.782 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.782 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.782 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.782 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:22:21.430+0000 7fbd89b3e800 5 monclient: authenticate success, global_id 8019 2024-09-12T00:22:21.782 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:22:21.430+0000 7fbd89b3e800 10 monclient: _renew_subs 2024-09-12T00:22:21.782 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:22:21.430+0000 7fbc73e07640 4 set_mon_vals no callback set 2024-09-12T00:22:21.782 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:22:21.430+0000 7fbd89b3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:21.782 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:22:21.430+0000 7fbd89b3e800 10 monclient: _renew_subs 2024-09-12T00:22:21.782 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:22:21.430+0000 7fbd89b3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:21.783 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:22:21.430+0000 7fbd89b3e800 1 librados: init done 2024-09-12T00:22:21.783 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:22:21.432+0000 7fbc72604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:22:21.783 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:22:21.432+0000 7fbc72604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:21.783 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:22:21.432+0000 7fbc72604640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:21.783 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:22:21.432+0000 7fbd85085640 10 monclient: get_auth_request con 0x7fbc6c076470 auth_method 0 2024-09-12T00:22:21.783 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:22:21.433+0000 7fbd86087640 10 monclient: get_auth_request con 0x55a2a7760a60 auth_method 0 2024-09-12T00:22:21.783 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:22:21.436+0000 7fbd85886640 10 monclient: get_auth_request con 0x55a2a7783630 auth_method 0 2024-09-12T00:22:21.783 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:22:21.438+0000 7fbd85085640 10 monclient: get_auth_request con 0x55a2a7787820 auth_method 0 2024-09-12T00:22:21.783 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 10 monclient: build_initial_monmap 2024-09-12T00:22:21.783 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 1 build_initial for_mkfs: 0 2024-09-12T00:22:21.783 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 10 monclient: monmap: 2024-09-12T00:22:21.783 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:22:21.783 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:22:21.783 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:22:21.783 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:22:21.784 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:22:21.784 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.784 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:22:21.784 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:22:21.784 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:22:21.784 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.784 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding auth protocol: cephx 2024-09-12T00:22:21.784 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding auth protocol: cephx 2024-09-12T00:22:21.784 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding auth protocol: cephx 2024-09-12T00:22:21.784 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: secure 2024-09-12T00:22:21.784 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: crc 2024-09-12T00:22:21.784 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: secure 2024-09-12T00:22:21.784 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: crc 2024-09-12T00:22:21.784 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: secure 2024-09-12T00:22:21.785 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: crc 2024-09-12T00:22:21.785 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: crc 2024-09-12T00:22:21.785 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: secure 2024-09-12T00:22:21.785 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: crc 2024-09-12T00:22:21.785 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: secure 2024-09-12T00:22:21.785 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: crc 2024-09-12T00:22:21.785 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778c570) adding con mode: secure 2024-09-12T00:22:21.785 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.785 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command objecter_requests cmddesc objecter_requests hook 0x55a2a778ff60 EEXIST 2024-09-12T00:22:21.785 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 10 monclient: init 2024-09-12T00:22:21.785 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding auth protocol: cephx 2024-09-12T00:22:21.785 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding auth protocol: cephx 2024-09-12T00:22:21.785 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding auth protocol: cephx 2024-09-12T00:22:21.785 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: secure 2024-09-12T00:22:21.786 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: crc 2024-09-12T00:22:21.786 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: secure 2024-09-12T00:22:21.786 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: crc 2024-09-12T00:22:21.786 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: secure 2024-09-12T00:22:21.786 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: crc 2024-09-12T00:22:21.786 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: crc 2024-09-12T00:22:21.786 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: secure 2024-09-12T00:22:21.786 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: crc 2024-09-12T00:22:21.786 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: secure 2024-09-12T00:22:21.786 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: crc 2024-09-12T00:22:21.786 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:22:21.442+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a778ac48) adding con mode: secure 2024-09-12T00:22:21.786 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.786 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.786 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command rotate-key cmddesc rotate-key hook 0x55a2a778ad90 EEXIST 2024-09-12T00:22:21.787 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:21.787 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:22:21.787 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-c con 0x55a2a77b3c50 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:21.787 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-b con 0x55a2a77b5f20 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:21.787 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-a con 0x55a2a77b2420 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:21.787 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.787 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.787 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.787 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:21.787 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:22:21.443+0000 7fbd89b3e800 10 monclient(hunting): authenticate will time out at 2018.700483s 2024-09-12T00:22:21.787 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): get_auth_request con 0x55a2a77b3c50 auth_method 0 2024-09-12T00:22:21.787 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.787 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.788 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.788 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:22:21.443+0000 7fbd86087640 10 monclient(hunting): get_auth_request con 0x55a2a77b2420 auth_method 0 2024-09-12T00:22:21.788 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:22:21.443+0000 7fbd86087640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.788 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:22:21.443+0000 7fbd86087640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.788 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:22:21.443+0000 7fbd86087640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.788 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.788 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.788 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.788 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:22:21.443+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.788 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:22:21.443+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.788 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:22:21.443+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.788 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient(hunting): handle_auth_done global_id 7472 payload 824 2024-09-12T00:22:21.788 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient: _finish_hunting 0 2024-09-12T00:22:21.788 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:22:21.443+0000 7fbd85886640 1 monclient: found mon.noname-c 2024-09-12T00:22:21.789 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:22:21.443+0000 7fbd85886640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:22:21.789 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.789 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:22:21.789 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: dump: 2024-09-12T00:22:21.789 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.789 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.789 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.789 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.789 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.789 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.789 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.789 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.789 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.789 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.790 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:22:21.790 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:22:21.790 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:21.790 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.790 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:22:21.790 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:22:21.444+0000 7fbc6b7fe640 10 monclient: dump: 2024-09-12T00:22:21.790 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.790 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.790 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.790 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.790 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.790 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.790 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.791 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.791 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.791 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.791 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:22:21.444+0000 7fbd89b3e800 5 monclient: authenticate success, global_id 7472 2024-09-12T00:22:21.791 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:22:21.444+0000 7fbd89b3e800 10 monclient: _renew_subs 2024-09-12T00:22:21.791 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:22:21.444+0000 7fbd89b3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:22:21.791 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:22:21.444+0000 7fbd86888640 4 set_mon_vals no callback set 2024-09-12T00:22:21.791 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:22:21.444+0000 7fbd89b3e800 10 monclient: _renew_subs 2024-09-12T00:22:21.791 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:22:21.444+0000 7fbd89b3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:22:21.791 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:22:21.445+0000 7fbc6b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:22:21.791 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:22:21.446+0000 7fbc6b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:21.791 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:22:21.446+0000 7fbc6b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:21.791 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:22:21.446+0000 7fbd85085640 10 monclient: get_auth_request con 0x7fbc60076380 auth_method 0 2024-09-12T00:22:21.791 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 10 monclient: get_monmap_and_config 2024-09-12T00:22:21.792 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 10 monclient: build_initial_monmap 2024-09-12T00:22:21.792 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 1 build_initial for_mkfs: 0 2024-09-12T00:22:21.792 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 10 monclient: monmap: 2024-09-12T00:22:21.792 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:22:21.792 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:22:21.792 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:22:21.792 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:22:21.792 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:22:21.792 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.792 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:22:21.792 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:22:21.792 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:22:21.792 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.792 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding auth protocol: cephx 2024-09-12T00:22:21.793 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding auth protocol: cephx 2024-09-12T00:22:21.793 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding auth protocol: cephx 2024-09-12T00:22:21.793 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: secure 2024-09-12T00:22:21.793 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: crc 2024-09-12T00:22:21.793 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: secure 2024-09-12T00:22:21.793 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: crc 2024-09-12T00:22:21.793 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: secure 2024-09-12T00:22:21.793 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: crc 2024-09-12T00:22:21.793 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: crc 2024-09-12T00:22:21.793 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: secure 2024-09-12T00:22:21.793 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: crc 2024-09-12T00:22:21.793 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: secure 2024-09-12T00:22:21.793 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: crc 2024-09-12T00:22:21.793 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77d3850) adding con mode: secure 2024-09-12T00:22:21.794 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.794 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 10 monclient: init 2024-09-12T00:22:21.794 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding auth protocol: cephx 2024-09-12T00:22:21.794 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding auth protocol: cephx 2024-09-12T00:22:21.794 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding auth protocol: cephx 2024-09-12T00:22:21.794 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: secure 2024-09-12T00:22:21.794 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: crc 2024-09-12T00:22:21.794 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: secure 2024-09-12T00:22:21.794 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: crc 2024-09-12T00:22:21.794 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: secure 2024-09-12T00:22:21.794 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: crc 2024-09-12T00:22:21.794 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: crc 2024-09-12T00:22:21.794 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: secure 2024-09-12T00:22:21.794 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: crc 2024-09-12T00:22:21.795 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: secure 2024-09-12T00:22:21.795 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: crc 2024-09-12T00:22:21.795 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed0b0) adding con mode: secure 2024-09-12T00:22:21.795 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:22:21.446+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.795 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.795 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command rotate-key cmddesc rotate-key hook 0x7ffd85bed1f8 EEXIST 2024-09-12T00:22:21.795 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:21.795 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:22:21.795 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-c con 0x55a2a77d79c0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:21.795 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-a con 0x55a2a77d5c10 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:21.795 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-b con 0x55a2a78080c0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:21.795 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.795 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.796 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.796 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:21.796 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient(hunting): authenticate will time out at 2018.704300s 2024-09-12T00:22:21.796 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): get_auth_request con 0x55a2a77d79c0 auth_method 0 2024-09-12T00:22:21.796 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.796 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.796 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.796 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:22:21.447+0000 7fbd85085640 10 monclient(hunting): get_auth_request con 0x55a2a77d5c10 auth_method 0 2024-09-12T00:22:21.796 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:22:21.447+0000 7fbd85085640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.796 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:22:21.447+0000 7fbd85085640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.796 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:22:21.447+0000 7fbd85085640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.796 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.796 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.796 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.797 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:22:21.447+0000 7fbd85085640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.797 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:22:21.447+0000 7fbd85085640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.797 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:22:21.447+0000 7fbd85085640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.797 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient(hunting): handle_auth_done global_id 7475 payload 274 2024-09-12T00:22:21.797 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient: _finish_hunting 0 2024-09-12T00:22:21.797 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:22:21.447+0000 7fbd85886640 1 monclient: found mon.noname-c 2024-09-12T00:22:21.797 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:22:21.447+0000 7fbd85886640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:22:21.797 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:22:21.447+0000 7fbd86087640 10 monclient: get_auth_request con 0x55a2a78080c0 auth_method 0 2024-09-12T00:22:21.797 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.797 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:22:21.797 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: dump: 2024-09-12T00:22:21.797 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.797 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.798 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.798 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.798 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.798 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.798 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.798 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.798 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.798 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.798 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: _finish_auth 0 2024-09-12T00:22:21.798 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: _check_auth_tickets 2024-09-12T00:22:21.798 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 5 monclient: authenticate success, global_id 7475 2024-09-12T00:22:21.798 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:21.798 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 10 monclient: get_monmap_and_config success 2024-09-12T00:22:21.798 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:22:21.447+0000 7fbd89b3e800 4 set_mon_vals no callback set 2024-09-12T00:22:21.798 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.799 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:22:21.799 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:22:21.447+0000 7fbc697fa640 10 monclient: dump: 2024-09-12T00:22:21.799 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.799 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.799 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.799 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.799 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.799 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.799 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.799 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.799 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.799 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.799 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 10 monclient: shutdown 2024-09-12T00:22:21.799 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 10 monclient: build_initial_monmap 2024-09-12T00:22:21.799 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 1 build_initial for_mkfs: 0 2024-09-12T00:22:21.800 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 10 monclient: monmap: 2024-09-12T00:22:21.800 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:22:21.800 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:22:21.800 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:22:21.800 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:22:21.800 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:22:21.800 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.800 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:22:21.800 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:22:21.800 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:22:21.800 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.800 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding auth protocol: cephx 2024-09-12T00:22:21.800 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding auth protocol: cephx 2024-09-12T00:22:21.800 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding auth protocol: cephx 2024-09-12T00:22:21.800 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: secure 2024-09-12T00:22:21.801 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: crc 2024-09-12T00:22:21.801 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: secure 2024-09-12T00:22:21.801 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: crc 2024-09-12T00:22:21.801 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: secure 2024-09-12T00:22:21.801 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: crc 2024-09-12T00:22:21.801 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: crc 2024-09-12T00:22:21.801 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: secure 2024-09-12T00:22:21.801 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: crc 2024-09-12T00:22:21.801 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: secure 2024-09-12T00:22:21.801 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: crc 2024-09-12T00:22:21.801 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a7802150) adding con mode: secure 2024-09-12T00:22:21.801 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.801 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 1 librados: starting msgr at 2024-09-12T00:22:21.801 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 1 librados: starting objecter 2024-09-12T00:22:21.802 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:22:21.448+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command objecter_requests cmddesc objecter_requests hook 0x55a2a77d7450 EEXIST 2024-09-12T00:22:21.802 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 1 librados: setting wanted keys 2024-09-12T00:22:21.802 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 1 librados: calling monclient init 2024-09-12T00:22:21.802 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient: init 2024-09-12T00:22:21.802 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding auth protocol: cephx 2024-09-12T00:22:21.802 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding auth protocol: cephx 2024-09-12T00:22:21.802 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding auth protocol: cephx 2024-09-12T00:22:21.802 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: secure 2024-09-12T00:22:21.802 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: crc 2024-09-12T00:22:21.802 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: secure 2024-09-12T00:22:21.802 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: crc 2024-09-12T00:22:21.802 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: secure 2024-09-12T00:22:21.802 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: crc 2024-09-12T00:22:21.802 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: crc 2024-09-12T00:22:21.802 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: secure 2024-09-12T00:22:21.803 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: crc 2024-09-12T00:22:21.803 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: secure 2024-09-12T00:22:21.803 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: crc 2024-09-12T00:22:21.803 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 AuthRegistry(0x55a2a77cba00) adding con mode: secure 2024-09-12T00:22:21.803 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.803 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.803 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command rotate-key cmddesc rotate-key hook 0x55a2a77cbb48 EEXIST 2024-09-12T00:22:21.803 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:21.803 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:22:21.803 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-a con 0x55a2a77d5c10 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:21.803 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-b con 0x55a2a77d79c0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:21.803 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): picked mon.noname-c con 0x55a2a78080c0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:21.803 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.803 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.804 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:21.804 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:21.804 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:22:21.449+0000 7fbd89b3e800 10 monclient(hunting): authenticate will time out at 2018.706620s 2024-09-12T00:22:21.804 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): get_auth_request con 0x55a2a77d5c10 auth_method 0 2024-09-12T00:22:21.804 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.804 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.804 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.804 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:22:21.449+0000 7fbd86087640 10 monclient(hunting): get_auth_request con 0x55a2a78080c0 auth_method 0 2024-09-12T00:22:21.804 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:22:21.449+0000 7fbd86087640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:21.804 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:22:21.449+0000 7fbd86087640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:21.804 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:22:21.449+0000 7fbd86087640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:21.804 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.804 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.804 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.805 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:22:21.449+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:21.805 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:22:21.449+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:21.805 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:22:21.449+0000 7fbd86087640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:21.805 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient(hunting): handle_auth_done global_id 8028 payload 824 2024-09-12T00:22:21.805 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient: _finish_hunting 0 2024-09-12T00:22:21.805 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:22:21.449+0000 7fbd85886640 1 monclient: found mon.noname-a 2024-09-12T00:22:21.805 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:22:21.449+0000 7fbd85886640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:22:21.805 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:22:21.449+0000 7fbd85085640 10 monclient: get_auth_request con 0x55a2a77d79c0 auth_method 0 2024-09-12T00:22:21.805 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.805 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:22:21.805 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: dump: 2024-09-12T00:22:21.805 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.805 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.806 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.806 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.806 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.806 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.806 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.806 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.806 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.806 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.806 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: _finish_auth 0 2024-09-12T00:22:21.806 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: _check_auth_tickets 2024-09-12T00:22:21.806 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:21.806 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:21.806 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:22:21.806 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:22:21.450+0000 7fbc577fe640 10 monclient: dump: 2024-09-12T00:22:21.806 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:22:21.450+0000 7fbd89b3e800 5 monclient: authenticate success, global_id 8028 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:22:21.450+0000 7fbd89b3e800 10 monclient: _renew_subs 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:22:21.450+0000 7fbc697fa640 4 set_mon_vals no callback set 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:22:21.450+0000 7fbd89b3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:22:21.450+0000 7fbd89b3e800 10 monclient: _renew_subs 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:22:21.450+0000 7fbd89b3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:21.807 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:22:21.450+0000 7fbd89b3e800 1 librados: init done 2024-09-12T00:22:21.808 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:22:21.450+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command cr dump hook 0x55a2a7807338 2024-09-12T00:22:21.808 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:22:21.451+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.808 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:22:21.452+0000 7fbc577fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:22:21.808 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:22:21.452+0000 7fbc577fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:21.808 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:22:21.452+0000 7fbc577fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:21.808 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:22:21.452+0000 7fbd85085640 10 monclient: get_auth_request con 0x7fbc50076470 auth_method 0 2024-09-12T00:22:21.808 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:22:21.452+0000 7fbd86087640 10 monclient: get_auth_request con 0x55a2a7821a00 auth_method 0 2024-09-12T00:22:21.808 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.808 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 realm 2024-09-12T00:22:21.808 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.808 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.808 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:21.808 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.808 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.808 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:22:21.453+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.809 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:22:21.454+0000 7fbd85886640 10 monclient: get_auth_request con 0x55a2a7825d60 auth_method 0 2024-09-12T00:22:21.809 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:22:21.454+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:21.809 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:22:21.454+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.809 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:22:21.454+0000 7fbd85085640 10 monclient: get_auth_request con 0x55a2a7829430 auth_method 0 2024-09-12T00:22:21.809 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:22:21.455+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:21.809 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:22:21.455+0000 7fbd89b3e800 20 searching for the correct realm 2024-09-12T00:22:21.809 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:22:21.456+0000 7fbd86087640 10 monclient: get_auth_request con 0x7fbd7c041b90 auth_method 0 2024-09-12T00:22:21.809 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:22:21.657+0000 7fbd86087640 10 monclient: get_auth_request con 0x7fbd7c041b90 auth_method 0 2024-09-12T00:22:21.809 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:22:21.658+0000 7fbd85886640 10 monclient: get_auth_request con 0x7fbd78092250 auth_method 0 2024-09-12T00:22:21.809 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:22:21.659+0000 7fbd85085640 10 monclient: get_auth_request con 0x7fbd7c028910 auth_method 0 2024-09-12T00:22:21.809 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:22:21.659+0000 7fbd85085640 0 -- 172.21.15.67:0/2872341321 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fbd7c028910 msgr2=0x7fbd7c01b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:21.809 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:22:21.659+0000 7fbc577fe640 1 client.8028.objecter ms_handle_reset 0x7fbd7c028910 session 0x7fbd7c0412a0 osd.5 2024-09-12T00:22:21.809 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:22:21.659+0000 7fbc577fe640 10 monclient: _renew_subs 2024-09-12T00:22:21.809 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:22:21.659+0000 7fbc577fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:21.810 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:22:21.659+0000 7fbd85085640 10 monclient: get_auth_request con 0x7fbc50086790 auth_method 0 2024-09-12T00:22:21.810 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:22:21.661+0000 7fbd86087640 10 monclient: get_auth_request con 0x7fbd78066570 auth_method 0 2024-09-12T00:22:21.810 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:22:21.662+0000 7fbd85886640 10 monclient: get_auth_request con 0x7fbd80061040 auth_method 0 2024-09-12T00:22:21.810 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:22:21.663+0000 7fbd86087640 0 -- 172.21.15.67:0/2872341321 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55a2a7821a00 msgr2=0x55a2a7823e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:21.810 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:22:21.663+0000 7fbc577fe640 1 client.8028.objecter ms_handle_reset 0x55a2a7821a00 session 0x55a2a7821330 osd.6 2024-09-12T00:22:21.810 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:22:21.663+0000 7fbd86087640 10 monclient: get_auth_request con 0x7fbd7c028910 auth_method 0 2024-09-12T00:22:21.810 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:21.810 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:21.810 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:21.810 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:21.810 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:21.810 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:21.810 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.810 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.810 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:22:21.667+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 zone default found 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 4 Realm: () 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 zonegroup default 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:22:21.668+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:22:21.669+0000 7fbd89b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.811 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:22:21.669+0000 7fbd89b3e800 20 started sync module instance, tier type = 2024-09-12T00:22:21.812 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:22:21.669+0000 7fbd89b3e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:21.812 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=0 2024-09-12T00:22:21.812 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=1 2024-09-12T00:22:21.812 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=2 2024-09-12T00:22:21.812 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=3 2024-09-12T00:22:21.812 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=4 2024-09-12T00:22:21.812 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=5 2024-09-12T00:22:21.812 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:22:21.677+0000 7fbd89b3e800 20 add_watcher() i=6 2024-09-12T00:22:21.812 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:22:21.678+0000 7fbd89b3e800 20 add_watcher() i=7 2024-09-12T00:22:21.812 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:22:21.678+0000 7fbd89b3e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:21.812 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding auth protocol: cephx 2024-09-12T00:22:21.812 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding auth protocol: cephx 2024-09-12T00:22:21.812 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding auth protocol: cephx 2024-09-12T00:22:21.812 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: secure 2024-09-12T00:22:21.813 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: crc 2024-09-12T00:22:21.813 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: secure 2024-09-12T00:22:21.813 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: crc 2024-09-12T00:22:21.813 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:22:21.679+0000 7fbc37fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:21.813 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: secure 2024-09-12T00:22:21.813 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: crc 2024-09-12T00:22:21.813 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: crc 2024-09-12T00:22:21.813 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: secure 2024-09-12T00:22:21.813 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: crc 2024-09-12T00:22:21.813 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: secure 2024-09-12T00:22:21.813 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: crc 2024-09-12T00:22:21.813 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:22:21.679+0000 7fbd89b3e800 5 AuthRegistry(0x7ffd85bed590) adding con mode: secure 2024-09-12T00:22:21.813 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:21.813 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:21.814 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:21.814 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command cache list hook 0x55a2a780b620 2024-09-12T00:22:21.814 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command cache inspect hook 0x55a2a780b620 2024-09-12T00:22:21.814 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command cache erase hook 0x55a2a780b620 2024-09-12T00:22:21.814 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command cache zap hook 0x55a2a780b620 2024-09-12T00:22:21.814 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 note: GC not initialized 2024-09-12T00:22:21.814 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:22:21.680+0000 7fbc36ffd640 20 reqs_thread_entry: start 2024-09-12T00:22:21.814 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command sync trace show hook 0x7fbd8004d690 2024-09-12T00:22:21.814 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command sync trace history hook 0x7fbd8004d690 2024-09-12T00:22:21.814 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command sync trace active hook 0x7fbd8004d690 2024-09-12T00:22:21.814 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 5 asok(0x55a2a7517630) register_command sync trace active_short hook 0x7fbd8004d690 2024-09-12T00:22:21.814 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:21.814 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 20 Filter name: none 2024-09-12T00:22:21.814 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:22:21.680+0000 7fbc34ff9640 20 reqs_thread_entry: start 2024-09-12T00:22:21.814 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:22:21.815 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:22:21.680+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.815 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:21.815 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:22:21.815 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:22:21.815 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 : miss 2024-09-12T00:22:21.815 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.815 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:21.815 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:21.815 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:21.815 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:22:21.815 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:21.815 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:22:21.681+0000 7fbd89b3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 2024-09-12T00:22:21.815 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:22:21.685+0000 7fbd89b3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:21.815 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:22:21.685+0000 7fbd89b3e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:21.815 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:22:21.685+0000 7fbd89b3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:21.816 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:22:21.685+0000 7fbd89b3e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39, ofs0, ns] 2024-09-12T00:22:21.816 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:22:21.686+0000 7fbc697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562474 cookie 94157083451792 notifier 8028 bl.length()=931 2024-09-12T00:22:21.816 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:22:21.686+0000 7fbc697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:21.816 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:22:21.686+0000 7fbc697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:21.816 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:22:21.686+0000 7fbc697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:21.816 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:22:21.686+0000 7fbd89b3e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): orig_sources= new_sources= 2024-09-12T00:22:21.816 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:22:21.686+0000 7fbd89b3e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): potential sources added=[] removed=[] 2024-09-12T00:22:21.816 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:22:21.686+0000 7fbd89b3e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): orig_dests= new_dests= 2024-09-12T00:22:21.816 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:22:21.686+0000 7fbd89b3e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): potential dests added=[] removed=[] 2024-09-12T00:22:21.816 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:22:21.689+0000 7fbd89b3e800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.1.0 2024-09-12T00:22:21.816 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:22:21.689+0000 7fbd89b3e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.1.0 2024-09-12T00:22:21.816 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:22:21.689+0000 7fbd89b3e800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.1.1 2024-09-12T00:22:21.816 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:22:21.689+0000 7fbd89b3e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.1.1 2024-09-12T00:22:21.816 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:22:21.689+0000 7fbd89b3e800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.0 2024-09-12T00:22:21.816 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:22:21.692+0000 7fbd89b3e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbd89b3e800 time 2024-09-12T00:22:21.693089+0000 2024-09-12T00:22:21.817 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:22:21.817 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.817 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:21.817 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbd8b38c71a] 2024-09-12T00:22:21.817 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbd8b38c8d8] 2024-09-12T00:22:21.817 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a2a57ed641] 2024-09-12T00:22:21.817 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55a2a57fc51b] 2024-09-12T00:22:21.817 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a2a57fd3e4] 2024-09-12T00:22:21.817 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:22:21.817 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbd8a029590] 2024-09-12T00:22:21.817 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:22:21.817 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:22:21.817 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.818 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:22:21.693+0000 7fbd89b3e800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:22:21.818 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fbd89b3e800 thread_name:radosgw-admin 2024-09-12T00:22:21.818 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.818 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:21.818 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbd8a03e6f0] 2024-09-12T00:22:21.818 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbd8a08b99c] 2024-09-12T00:22:21.818 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:22:21.818 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:22:21.818 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbd8b38c774] 2024-09-12T00:22:21.818 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbd8b38c8d8] 2024-09-12T00:22:21.818 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a2a57ed641] 2024-09-12T00:22:21.818 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55a2a57fc51b] 2024-09-12T00:22:21.818 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55a2a57fd3e4] 2024-09-12T00:22:21.818 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:22:21.819 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbd8a029590] 2024-09-12T00:22:21.819 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:22:21.819 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:22:21.819 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:22:21.819 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.819 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:22:21.819 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:22:21.819 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:22:21.819 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:22:21.819 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:22:21.819 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:22:21.819 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:22:21.819 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:22:21.820 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:22:21.820 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:22:21.820 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:22:21.820 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:22:21.820 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:22:21.820 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:22:21.820 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:22:21.820 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:22:21.820 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:22:21.820 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:22:21.820 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:22:21.820 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:22:21.820 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:22:21.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:22:21.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:22:21.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:22:21.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:22:21.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:22:21.821 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:22:21.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:22:21.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:22:21.821 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:22:21.821 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:22:21.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:22:21.821 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:22:21.821 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:22:21.821 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:22:21.822 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:22:21.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:22:21.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:22:21.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:22:21.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:22:21.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:22:21.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:22:21.822 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:22:21.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:22:21.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:22:21.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:22:21.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:22:21.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:22:21.822 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:22:21.822 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:22:21.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:22:21.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:22:21.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:22:21.823 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:22:21.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:22:21.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:22:21.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:22:21.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:22:21.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:22:21.823 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:22:21.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:22:21.823 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:22:21.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:22:21.823 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:22:21.824 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:22:21.824 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:22:21.824 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:22:21.824 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:22:21.824 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:22:21.824 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:22:21.824 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:22:21.824 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:22:21.824 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:22:21.824 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:22:21.824 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:22:21.824 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:22:21.824 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:22:21.824 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:22:21.824 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:22:21.825 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:22:21.825 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:22:21.825 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:22:21.825 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:22:21.825 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:22:21.825 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:22:21.825 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:22:21.825 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:22:21.825 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:22:21.825 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:22:21.825 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:22:21.825 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:22:21.825 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:22:21.825 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:22:21.825 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:22:21.826 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc34ff9640 / http_manager 2024-09-12T00:22:21.826 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc36ffd640 / http_manager 2024-09-12T00:22:21.826 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc37fff640 / rgw_dt_lg_renew 2024-09-12T00:22:21.826 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc577fe640 / ms_dispatch 2024-09-12T00:22:21.826 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc697fa640 / io_context_pool 2024-09-12T00:22:21.826 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc6b7fe640 / ms_dispatch 2024-09-12T00:22:21.826 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc72604640 / ms_dispatch 2024-09-12T00:22:21.826 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbc73e07640 / io_context_pool 2024-09-12T00:22:21.826 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbd85085640 / msgr-worker-2 2024-09-12T00:22:21.826 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbd85886640 / msgr-worker-1 2024-09-12T00:22:21.826 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbd86087640 / msgr-worker-0 2024-09-12T00:22:21.826 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbd86888640 / io_context_pool 2024-09-12T00:22:21.826 INFO:tasks.workunit.client.0.smithi067.stderr: 7fbd89b3e800 / radosgw-admin 2024-09-12T00:22:21.827 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:22:21.827 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:22:21.827 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:22:21.694727Z_99827d3d-ec37-49f3-91b4-dd099c82cd34/log 2024-09-12T00:22:21.827 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:22:21.827 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:22:21.832 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:21.832 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:21.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.770+0000 7fe3ff575800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.772+0000 7fe3ff575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.772+0000 7fe3ff575800 20 realm 2024-09-12T00:22:21.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.772+0000 7fe3ff575800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.772+0000 7fe3ff575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.772+0000 7fe3ff575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:21.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.772+0000 7fe3ff575800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.772+0000 7fe3ff575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.772+0000 7fe3ff575800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.773+0000 7fe3ff575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:21.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.773+0000 7fe3ff575800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.775+0000 7fe3ff575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:21.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.775+0000 7fe3ff575800 20 searching for the correct realm 2024-09-12T00:22:21.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.779+0000 7fe3fd05f640 0 -- 172.21.15.67:0/3449092091 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7fe3f00af800 msgr2=0x7fe3f00a50a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:21.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.785+0000 7fe3fd05f640 0 -- 172.21.15.67:0/3449092091 >> [v2:172.21.15.67:6800/2522402523,v1:172.21.15.67:6801/2522402523] conn(0x562eedd9da60 msgr2=0x562eedd9fe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:21.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.788+0000 7fe3ff575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:21.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.788+0000 7fe3ff575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:21.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.788+0000 7fe3ff575800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:21.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.788+0000 7fe3ff575800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:21.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.788+0000 7fe3ff575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:21.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.788+0000 7fe3ff575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:21.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.788+0000 7fe3ff575800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.788+0000 7fe3ff575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.788+0000 7fe3ff575800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.788+0000 7fe3ff575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:21.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.788+0000 7fe3ff575800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.789+0000 7fe3ff575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:21.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.789+0000 7fe3ff575800 20 zone default found 2024-09-12T00:22:21.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.789+0000 7fe3ff575800 4 Realm: () 2024-09-12T00:22:21.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.789+0000 7fe3ff575800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:21.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.789+0000 7fe3ff575800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:21.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.789+0000 7fe3ff575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:21.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.789+0000 7fe3ff575800 20 zonegroup default 2024-09-12T00:22:21.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.789+0000 7fe3ff575800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.789+0000 7fe3ff575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.789+0000 7fe3ff575800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.789+0000 7fe3ff575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.789+0000 7fe3ff575800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.789+0000 7fe3ff575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.789+0000 7fe3ff575800 20 started sync module instance, tier type = 2024-09-12T00:22:21.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.789+0000 7fe3ff575800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:21.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.798+0000 7fe3ff575800 20 add_watcher() i=0 2024-09-12T00:22:21.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.798+0000 7fe3ff575800 20 add_watcher() i=1 2024-09-12T00:22:21.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.798+0000 7fe3ff575800 20 add_watcher() i=2 2024-09-12T00:22:21.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.798+0000 7fe3ff575800 20 add_watcher() i=3 2024-09-12T00:22:21.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.798+0000 7fe3ff575800 20 add_watcher() i=4 2024-09-12T00:22:21.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.798+0000 7fe3ff575800 20 add_watcher() i=5 2024-09-12T00:22:21.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.798+0000 7fe3ff575800 20 add_watcher() i=6 2024-09-12T00:22:21.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.799+0000 7fe3ff575800 20 add_watcher() i=7 2024-09-12T00:22:21.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.799+0000 7fe3ff575800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:21.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.800+0000 7fe2b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:21.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.800+0000 7fe3ff575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:21.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.800+0000 7fe3ff575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:21.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.801+0000 7fe3ff575800 5 note: GC not initialized 2024-09-12T00:22:21.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.801+0000 7fe2b27e4640 20 reqs_thread_entry: start 2024-09-12T00:22:21.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.801+0000 7fe3ff575800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:21.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.801+0000 7fe3ff575800 20 Filter name: none 2024-09-12T00:22:21.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.801+0000 7fe223fff640 20 reqs_thread_entry: start 2024-09-12T00:22:21.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.801+0000 7fe3ff575800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.801+0000 7fe3ff575800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:21.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.801+0000 7fe3ff575800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.802+0000 7fe3ff575800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:22:21.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.802+0000 7fe3ff575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:21.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.802+0000 7fe3ff575800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.802+0000 7fe3ff575800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:21.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.802+0000 7fe3ff575800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.803+0000 7fe3ff575800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:22:21.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.803+0000 7fe3ff575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:21.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.804+0000 7fe2b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:21.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.806+0000 7fe3ff575800 20 remove_watcher() i=0 2024-09-12T00:22:21.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.806+0000 7fe3ff575800 2 removed watcher, disabling cache 2024-09-12T00:22:21.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.807+0000 7fe3ff575800 20 remove_watcher() i=1 2024-09-12T00:22:21.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.808+0000 7fe3ff575800 20 remove_watcher() i=2 2024-09-12T00:22:21.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.809+0000 7fe3ff575800 20 remove_watcher() i=3 2024-09-12T00:22:21.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.810+0000 7fe3ff575800 20 remove_watcher() i=4 2024-09-12T00:22:21.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.811+0000 7fe3ff575800 20 remove_watcher() i=5 2024-09-12T00:22:21.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.812+0000 7fe3ff575800 20 remove_watcher() i=6 2024-09-12T00:22:21.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.813+0000 7fe3ff575800 20 remove_watcher() i=7 2024-09-12T00:22:21.840 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.840 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:22:21.840 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-change-reshard-state id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:22:21.840 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:21.876 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:22:21.908 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:21.909 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:21.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.949+0000 7f3ae6b31800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.951+0000 7f3ae6b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.951+0000 7f3ae6b31800 20 realm 2024-09-12T00:22:21.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.951+0000 7f3ae6b31800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.952+0000 7f3ae6b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.952+0000 7f3ae6b31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:21.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.952+0000 7f3ae6b31800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.952+0000 7f3ae6b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:21.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.952+0000 7f3ae6b31800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.953+0000 7f3ae6b31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:21.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.953+0000 7f3ae6b31800 20 rados->read ofs=0 len=0 2024-09-12T00:22:21.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.953+0000 7f3ae6b31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:21.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.953+0000 7f3ae6b31800 20 searching for the correct realm 2024-09-12T00:22:21.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:21.955+0000 7f3ae2876640 0 -- 172.21.15.67:0/3749026619 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f3ad4045070 msgr2=0x7f3ad406b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:22:22.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.160+0000 7f3ae2876640 0 -- 172.21.15.67:0/3749026619 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x55d4738019c0 msgr2=0x7f3adc016400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:22.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.366+0000 7f3ae6b31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:22.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.366+0000 7f3ae6b31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:22.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.366+0000 7f3ae6b31800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:22.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.366+0000 7f3ae6b31800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:22.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.366+0000 7f3ae6b31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:22.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.366+0000 7f3ae6b31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:22.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.366+0000 7f3ae6b31800 20 rados->read ofs=0 len=0 2024-09-12T00:22:22.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.367+0000 7f3ae6b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:22.366 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.367+0000 7f3ae6b31800 20 rados->read ofs=0 len=0 2024-09-12T00:22:22.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.367+0000 7f3ae6b31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:22.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.367+0000 7f3ae6b31800 20 rados->read ofs=0 len=0 2024-09-12T00:22:22.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.367+0000 7f3ae6b31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:22.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.367+0000 7f3ae6b31800 20 zone default found 2024-09-12T00:22:22.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.367+0000 7f3ae6b31800 4 Realm: () 2024-09-12T00:22:22.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.367+0000 7f3ae6b31800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:22.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.367+0000 7f3ae6b31800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:22.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.367+0000 7f3ae6b31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:22.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.367+0000 7f3ae6b31800 20 zonegroup default 2024-09-12T00:22:22.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.367+0000 7f3ae6b31800 20 rados->read ofs=0 len=0 2024-09-12T00:22:22.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.368+0000 7f3ae6b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:22.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.368+0000 7f3ae6b31800 20 rados->read ofs=0 len=0 2024-09-12T00:22:22.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.368+0000 7f3ae6b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:22.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.368+0000 7f3ae6b31800 20 rados->read ofs=0 len=0 2024-09-12T00:22:22.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.368+0000 7f3ae6b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:22.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.368+0000 7f3ae6b31800 20 started sync module instance, tier type = 2024-09-12T00:22:22.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.368+0000 7f3ae6b31800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:22.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.378+0000 7f3ae6b31800 20 add_watcher() i=0 2024-09-12T00:22:22.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.378+0000 7f3ae6b31800 20 add_watcher() i=1 2024-09-12T00:22:22.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.378+0000 7f3ae6b31800 20 add_watcher() i=2 2024-09-12T00:22:22.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.378+0000 7f3ae6b31800 20 add_watcher() i=3 2024-09-12T00:22:22.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.378+0000 7f3ae6b31800 20 add_watcher() i=4 2024-09-12T00:22:22.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.378+0000 7f3ae6b31800 20 add_watcher() i=5 2024-09-12T00:22:22.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.378+0000 7f3ae6b31800 20 add_watcher() i=6 2024-09-12T00:22:22.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.379+0000 7f3ae6b31800 20 add_watcher() i=7 2024-09-12T00:22:22.378 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.379+0000 7f3ae6b31800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:22.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.381+0000 7f39997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:22.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.381+0000 7f3ae6b31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:22.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.381+0000 7f3ae6b31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:22.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.381+0000 7f3ae6b31800 5 note: GC not initialized 2024-09-12T00:22:22.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.381+0000 7f3913fff640 20 reqs_thread_entry: start 2024-09-12T00:22:22.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.381+0000 7f3ae6b31800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:22.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.382+0000 7f3ae6b31800 20 Filter name: none 2024-09-12T00:22:22.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.382+0000 7f3911ffb640 20 reqs_thread_entry: start 2024-09-12T00:22:22.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.382+0000 7f3ae6b31800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:22:22.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.382+0000 7f3ae6b31800 20 rados->read ofs=0 len=0 2024-09-12T00:22:22.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.382+0000 7f3ae6b31800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:22.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.382+0000 7f3ae6b31800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:22:22.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.382+0000 7f3ae6b31800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:22:22.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.382+0000 7f3ae6b31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 : miss 2024-09-12T00:22:22.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.382+0000 7f3ae6b31800 20 rados->read ofs=0 len=0 2024-09-12T00:22:22.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.383+0000 7f3ae6b31800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:22:22.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.383+0000 7f3ae6b31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:22.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.383+0000 7f3ae6b31800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:22.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.383+0000 7f3ae6b31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:22:22.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.383+0000 7f3ae6b31800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:22.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.383+0000 7f3ae6b31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 2024-09-12T00:22:22.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.384+0000 7f3ae6b31800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to be held by another RGW process; skipping for now 2024-09-12T00:22:22.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.385+0000 7f39997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:22.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.388+0000 7f3ae6b31800 20 remove_watcher() i=0 2024-09-12T00:22:22.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.388+0000 7f3ae6b31800 2 removed watcher, disabling cache 2024-09-12T00:22:22.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.389+0000 7f3ae6b31800 20 remove_watcher() i=1 2024-09-12T00:22:22.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.390+0000 7f3ae6b31800 20 remove_watcher() i=2 2024-09-12T00:22:22.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.392+0000 7f3ae6b31800 20 remove_watcher() i=3 2024-09-12T00:22:22.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.393+0000 7f3ae6b31800 20 remove_watcher() i=4 2024-09-12T00:22:22.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.394+0000 7f3ae6b31800 20 remove_watcher() i=5 2024-09-12T00:22:22.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.395+0000 7f3ae6b31800 20 remove_watcher() i=6 2024-09-12T00:22:22.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:22.396+0000 7f3ae6b31800 20 remove_watcher() i=7 2024-09-12T00:22:22.407 INFO:tasks.workunit.client.0.smithi067.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:22:52.436 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:22:52.472 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:52.472 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:52.518 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.520+0000 7fa6c0130800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.521+0000 7fa6c0130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:52.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.521+0000 7fa6c0130800 20 realm 2024-09-12T00:22:52.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.521+0000 7fa6c0130800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.521+0000 7fa6c0130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:52.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.521+0000 7fa6c0130800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:52.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.521+0000 7fa6c0130800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.522+0000 7fa6c0130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:52.520 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.522+0000 7fa6c0130800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.522+0000 7fa6c0130800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:52.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.522+0000 7fa6c0130800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.521 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.523+0000 7fa6c0130800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:52.522 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.523+0000 7fa6c0130800 20 searching for the correct realm 2024-09-12T00:22:52.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.527+0000 7fa6bb6af640 0 -- 172.21.15.67:0/600642552 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fa6b0078260 msgr2=0x7fa6b0069850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:52.529 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.531+0000 7fa6bbeb0640 0 -- 172.21.15.67:0/600642552 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fa6b401e040 msgr2=0x7fa6b402b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:52.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.536+0000 7fa6c0130800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:52.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.536+0000 7fa6c0130800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:52.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.536+0000 7fa6c0130800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:52.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.536+0000 7fa6c0130800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:52.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.536+0000 7fa6c0130800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:52.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.536+0000 7fa6c0130800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:52.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.537+0000 7fa6c0130800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.537+0000 7fa6c0130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:52.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.537+0000 7fa6c0130800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.537+0000 7fa6c0130800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:52.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.537+0000 7fa6c0130800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.537+0000 7fa6c0130800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:52.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.537+0000 7fa6c0130800 20 zone default found 2024-09-12T00:22:52.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.537+0000 7fa6c0130800 4 Realm: () 2024-09-12T00:22:52.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.537+0000 7fa6c0130800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:52.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.537+0000 7fa6c0130800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:52.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.537+0000 7fa6c0130800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:52.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.537+0000 7fa6c0130800 20 zonegroup default 2024-09-12T00:22:52.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.537+0000 7fa6c0130800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.538+0000 7fa6c0130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:52.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.538+0000 7fa6c0130800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.538+0000 7fa6c0130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:52.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.538+0000 7fa6c0130800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.538+0000 7fa6c0130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:52.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.538+0000 7fa6c0130800 20 started sync module instance, tier type = 2024-09-12T00:22:52.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.538+0000 7fa6c0130800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:52.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.548+0000 7fa6c0130800 20 add_watcher() i=0 2024-09-12T00:22:52.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.548+0000 7fa6c0130800 20 add_watcher() i=1 2024-09-12T00:22:52.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.548+0000 7fa6c0130800 20 add_watcher() i=2 2024-09-12T00:22:52.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.548+0000 7fa6c0130800 20 add_watcher() i=3 2024-09-12T00:22:52.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.548+0000 7fa6c0130800 20 add_watcher() i=4 2024-09-12T00:22:52.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.548+0000 7fa6c0130800 20 add_watcher() i=5 2024-09-12T00:22:52.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.548+0000 7fa6c0130800 20 add_watcher() i=6 2024-09-12T00:22:52.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.549+0000 7fa6c0130800 20 add_watcher() i=7 2024-09-12T00:22:52.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.549+0000 7fa6c0130800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:52.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.552+0000 7fa571fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:52.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.552+0000 7fa6c0130800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:52.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.552+0000 7fa6c0130800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:52.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.552+0000 7fa6c0130800 5 note: GC not initialized 2024-09-12T00:22:52.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.553+0000 7fa570fe1640 20 reqs_thread_entry: start 2024-09-12T00:22:52.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.553+0000 7fa6c0130800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:52.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.553+0000 7fa6c0130800 20 Filter name: none 2024-09-12T00:22:52.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.553+0000 7fa4ea7fc640 20 reqs_thread_entry: start 2024-09-12T00:22:52.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.553+0000 7fa6c0130800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:22:52.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.553+0000 7fa6c0130800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.554+0000 7fa6c0130800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:52.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.554+0000 7fa6c0130800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:22:52.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.554+0000 7fa6c0130800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:22:52.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.554+0000 7fa6c0130800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 : miss 2024-09-12T00:22:52.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.554+0000 7fa6c0130800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.554+0000 7fa6c0130800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:22:52.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.554+0000 7fa6c0130800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:52.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.554+0000 7fa6c0130800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:52.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.554+0000 7fa6c0130800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:22:52.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.554+0000 7fa6c0130800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:52.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.554+0000 7fa6c0130800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 2024-09-12T00:22:52.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.555+0000 7fa6c0130800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:22:52.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.559+0000 7fa6c0130800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:52.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.559+0000 7fa6c0130800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:52.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.559+0000 7fa6c0130800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:52.557 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.559+0000 7fa6c0130800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39, ofs0, ns] 2024-09-12T00:22:52.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.560+0000 7fa59affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562475 cookie 94797887016384 notifier 8079 bl.length()=931 2024-09-12T00:22:52.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.560+0000 7fa59affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:52.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.560+0000 7fa59affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:52.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.560+0000 7fa59affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:52.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.560+0000 7fa6c0130800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): orig_sources= new_sources= 2024-09-12T00:22:52.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.560+0000 7fa6c0130800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): potential sources added=[] removed=[] 2024-09-12T00:22:52.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.560+0000 7fa6c0130800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): orig_dests= new_dests= 2024-09-12T00:22:52.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.560+0000 7fa6c0130800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): potential dests added=[] removed=[] 2024-09-12T00:22:52.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.563+0000 7fa6c0130800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.2.0 2024-09-12T00:22:52.561 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.563+0000 7fa6c0130800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.2.0 2024-09-12T00:22:52.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.563+0000 7fa6c0130800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.2.1 2024-09-12T00:22:52.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.563+0000 7fa6c0130800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.2.1 2024-09-12T00:22:52.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.563+0000 7fa6c0130800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.0 2024-09-12T00:22:52.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.566+0000 7fa6c0130800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:22:52.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.566+0000 7fa6c0130800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 2024-09-12T00:22:52.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.567+0000 7fa6c0130800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:52.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.567+0000 7fa6c0130800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:52.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.567+0000 7fa6c0130800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:52.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.567+0000 7fa6c0130800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39, ofs0, ns] 2024-09-12T00:22:52.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.567+0000 7fa59a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562476 cookie 94797887016384 notifier 8079 bl.length()=931 2024-09-12T00:22:52.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.567+0000 7fa59a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:52.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.567+0000 7fa59a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:52.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.567+0000 7fa59a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:52.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.568+0000 7fa6c0130800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): orig_sources= new_sources= 2024-09-12T00:22:52.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.568+0000 7fa6c0130800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): potential sources added=[] removed=[] 2024-09-12T00:22:52.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.568+0000 7fa6c0130800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): orig_dests= new_dests= 2024-09-12T00:22:52.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.568+0000 7fa6c0130800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): potential dests added=[] removed=[] 2024-09-12T00:22:52.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.569+0000 7fa6c0130800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39.0 2024-09-12T00:22:52.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.570+0000 7fa6c0130800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:22:52.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.570+0000 7fa6c0130800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 2024-09-12T00:22:52.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.571+0000 7fa6c0130800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:52.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.571+0000 7fa6c0130800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:52.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.571+0000 7fa6c0130800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:52.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.571+0000 7fa6c0130800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39, ofs0, ns] 2024-09-12T00:22:52.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.571+0000 7fa59a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562477 cookie 94797887016384 notifier 8079 bl.length()=899 2024-09-12T00:22:52.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.571+0000 7fa59a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 info.flags=0x17 2024-09-12T00:22:52.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.571+0000 7fa59a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 to cache LRU end 2024-09-12T00:22:52.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.571+0000 7fa59a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:22:52.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.572+0000 7fa6c0130800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): orig_sources= new_sources= 2024-09-12T00:22:52.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.572+0000 7fa6c0130800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): potential sources added=[] removed=[] 2024-09-12T00:22:52.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.572+0000 7fa6c0130800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): orig_dests= new_dests= 2024-09-12T00:22:52.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.572+0000 7fa6c0130800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39]): potential dests added=[] removed=[] 2024-09-12T00:22:52.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.573+0000 7fa6c0130800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:22:52.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.575+0000 7fa571fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:52.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.577+0000 7fa6c0130800 20 remove_watcher() i=0 2024-09-12T00:22:52.575 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.577+0000 7fa6c0130800 2 removed watcher, disabling cache 2024-09-12T00:22:52.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.578+0000 7fa6c0130800 20 remove_watcher() i=1 2024-09-12T00:22:52.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.579+0000 7fa6c0130800 20 remove_watcher() i=2 2024-09-12T00:22:52.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.581+0000 7fa6c0130800 20 remove_watcher() i=3 2024-09-12T00:22:52.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.582+0000 7fa6c0130800 20 remove_watcher() i=4 2024-09-12T00:22:52.581 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.583+0000 7fa6c0130800 20 remove_watcher() i=5 2024-09-12T00:22:52.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.584+0000 7fa6c0130800 20 remove_watcher() i=6 2024-09-12T00:22:52.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.585+0000 7fa6c0130800 20 remove_watcher() i=7 2024-09-12T00:22:52.596 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:22:52.625 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:52.626 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:52.665 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.666+0000 7fed1052c800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.668+0000 7fed1052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:52.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.668+0000 7fed1052c800 20 realm 2024-09-12T00:22:52.667 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.668+0000 7fed1052c800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.669+0000 7fed1052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:52.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.669+0000 7fed1052c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:52.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.669+0000 7fed1052c800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.669+0000 7fed1052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:52.668 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.669+0000 7fed1052c800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.669+0000 7fed1052c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:52.669 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.669+0000 7fed1052c800 20 rados->read ofs=0 len=0 2024-09-12T00:22:52.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.675+0000 7fed1052c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:52.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.675+0000 7fed1052c800 20 searching for the correct realm 2024-09-12T00:22:52.676 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.678+0000 7fed0c24f640 0 -- 172.21.15.67:0/1909102157 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7fecfc09b940 msgr2=0x7fecfc083460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:22:52.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:52.682+0000 7fed0c24f640 0 -- 172.21.15.67:0/1909102157 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fed0408a830 msgr2=0x7fed04085370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:53.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.292+0000 7fed1052c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:53.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.292+0000 7fed1052c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:53.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.292+0000 7fed1052c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:53.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.292+0000 7fed1052c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:53.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.292+0000 7fed1052c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:53.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.292+0000 7fed1052c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:53.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.292+0000 7fed1052c800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.292+0000 7fed1052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.292+0000 7fed1052c800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.292+0000 7fed1052c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:53.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.292+0000 7fed1052c800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.293+0000 7fed1052c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:53.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.293+0000 7fed1052c800 20 zone default found 2024-09-12T00:22:53.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.293+0000 7fed1052c800 4 Realm: () 2024-09-12T00:22:53.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.293+0000 7fed1052c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:53.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.293+0000 7fed1052c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:53.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.293+0000 7fed1052c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:53.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.293+0000 7fed1052c800 20 zonegroup default 2024-09-12T00:22:53.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.293+0000 7fed1052c800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.293+0000 7fed1052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.293+0000 7fed1052c800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.293+0000 7fed1052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.293+0000 7fed1052c800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.294+0000 7fed1052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.294+0000 7fed1052c800 20 started sync module instance, tier type = 2024-09-12T00:22:53.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.294+0000 7fed1052c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:53.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.305+0000 7fed1052c800 20 add_watcher() i=0 2024-09-12T00:22:53.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.305+0000 7fed1052c800 20 add_watcher() i=1 2024-09-12T00:22:53.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.305+0000 7fed1052c800 20 add_watcher() i=2 2024-09-12T00:22:53.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.305+0000 7fed1052c800 20 add_watcher() i=3 2024-09-12T00:22:53.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.305+0000 7fed1052c800 20 add_watcher() i=4 2024-09-12T00:22:53.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.305+0000 7fed1052c800 20 add_watcher() i=5 2024-09-12T00:22:53.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.305+0000 7fed1052c800 20 add_watcher() i=6 2024-09-12T00:22:53.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.306+0000 7fed1052c800 20 add_watcher() i=7 2024-09-12T00:22:53.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.306+0000 7fed1052c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:53.306 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.308+0000 7febc2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:53.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.309+0000 7fed1052c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:53.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.309+0000 7fed1052c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:53.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.309+0000 7fed1052c800 5 note: GC not initialized 2024-09-12T00:22:53.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.309+0000 7febc1fdb640 20 reqs_thread_entry: start 2024-09-12T00:22:53.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.309+0000 7fed1052c800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:53.307 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.309+0000 7fed1052c800 20 Filter name: none 2024-09-12T00:22:53.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.309+0000 7feb337fe640 20 reqs_thread_entry: start 2024-09-12T00:22:53.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.309+0000 7fed1052c800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.310+0000 7fed1052c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:53.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.310+0000 7fed1052c800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.311+0000 7fed1052c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:53.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.311+0000 7fed1052c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:53.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.311+0000 7fed1052c800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.311+0000 7fed1052c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:22:53.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.311+0000 7fed1052c800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.311+0000 7fed1052c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:22:53.310 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.311+0000 7fed1052c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:53.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.313+0000 7febc2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:53.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.315+0000 7fed1052c800 20 remove_watcher() i=0 2024-09-12T00:22:53.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.315+0000 7fed1052c800 2 removed watcher, disabling cache 2024-09-12T00:22:53.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.317+0000 7fed1052c800 20 remove_watcher() i=1 2024-09-12T00:22:53.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.318+0000 7fed1052c800 20 remove_watcher() i=2 2024-09-12T00:22:53.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.319+0000 7fed1052c800 20 remove_watcher() i=3 2024-09-12T00:22:53.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.320+0000 7fed1052c800 20 remove_watcher() i=4 2024-09-12T00:22:53.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.321+0000 7fed1052c800 20 remove_watcher() i=5 2024-09-12T00:22:53.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.323+0000 7fed1052c800 20 remove_watcher() i=6 2024-09-12T00:22:53.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.324+0000 7fed1052c800 20 remove_watcher() i=7 2024-09-12T00:22:53.334 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:53.334 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:22:53.334 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: abort-at-change-reshard-state id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:22:53.334 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:53.399 INFO:tasks.workunit.client.0.smithi067.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T00:22:53.401 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:22:53.431 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:53.432 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:53.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.474+0000 7f4c51b25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.476+0000 7f4c51b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.476+0000 7f4c51b25800 20 realm 2024-09-12T00:22:53.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.476+0000 7f4c51b25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.477+0000 7f4c51b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.477+0000 7f4c51b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:53.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.477+0000 7f4c51b25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.477+0000 7f4c51b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.477+0000 7f4c51b25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.478+0000 7f4c51b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:53.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.478+0000 7f4c51b25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.478+0000 7f4c51b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:53.477 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.478+0000 7f4c51b25800 20 searching for the correct realm 2024-09-12T00:22:53.480 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.482+0000 7f4c4d7ae640 0 -- 172.21.15.67:0/2045986392 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f4c40043c20 msgr2=0x7f4c4004f670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:53.484 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.486+0000 7f4c4d7ae640 0 -- 172.21.15.67:0/2045986392 >> [v2:172.21.15.67:6800/2522402523,v1:172.21.15.67:6801/2522402523] conn(0x560330a45eb0 msgr2=0x560330a482a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:53.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.489+0000 7f4c51b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:53.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.489+0000 7f4c51b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:53.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.489+0000 7f4c51b25800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:53.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.489+0000 7f4c51b25800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:53.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.489+0000 7f4c51b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:53.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.489+0000 7f4c51b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:53.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.489+0000 7f4c51b25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.489+0000 7f4c51b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.489+0000 7f4c51b25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.489+0000 7f4c51b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:53.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.489+0000 7f4c51b25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.490+0000 7f4c51b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:53.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.490+0000 7f4c51b25800 20 zone default found 2024-09-12T00:22:53.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.490+0000 7f4c51b25800 4 Realm: () 2024-09-12T00:22:53.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.490+0000 7f4c51b25800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:53.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.490+0000 7f4c51b25800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:53.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.490+0000 7f4c51b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:53.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.490+0000 7f4c51b25800 20 zonegroup default 2024-09-12T00:22:53.490 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.490+0000 7f4c51b25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.490+0000 7f4c51b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.490+0000 7f4c51b25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.490+0000 7f4c51b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.490+0000 7f4c51b25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.491+0000 7f4c51b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.491+0000 7f4c51b25800 20 started sync module instance, tier type = 2024-09-12T00:22:53.491 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.491+0000 7f4c51b25800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:53.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.499+0000 7f4c51b25800 20 add_watcher() i=0 2024-09-12T00:22:53.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.499+0000 7f4c51b25800 20 add_watcher() i=1 2024-09-12T00:22:53.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.499+0000 7f4c51b25800 20 add_watcher() i=2 2024-09-12T00:22:53.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.499+0000 7f4c51b25800 20 add_watcher() i=3 2024-09-12T00:22:53.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.499+0000 7f4c51b25800 20 add_watcher() i=4 2024-09-12T00:22:53.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.499+0000 7f4c51b25800 20 add_watcher() i=5 2024-09-12T00:22:53.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.499+0000 7f4c51b25800 20 add_watcher() i=6 2024-09-12T00:22:53.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.500+0000 7f4c51b25800 20 add_watcher() i=7 2024-09-12T00:22:53.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.500+0000 7f4c51b25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:53.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.502+0000 7f4b037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:53.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.502+0000 7f4c51b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:53.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.502+0000 7f4c51b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:53.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.502+0000 7f4c51b25800 5 note: GC not initialized 2024-09-12T00:22:53.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.502+0000 7f4b027e4640 20 reqs_thread_entry: start 2024-09-12T00:22:53.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.502+0000 7f4c51b25800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:53.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.502+0000 7f4c51b25800 20 Filter name: none 2024-09-12T00:22:53.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.502+0000 7f4a73fff640 20 reqs_thread_entry: start 2024-09-12T00:22:53.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.503+0000 7f4c51b25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.503+0000 7f4c51b25800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:22:53.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.503+0000 7f4c51b25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.503+0000 7f4c51b25800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:22:53.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.503+0000 7f4c51b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:53.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.503+0000 7f4c51b25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.504+0000 7f4c51b25800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:22:53.503 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.504+0000 7f4c51b25800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.504+0000 7f4c51b25800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:22:53.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.504+0000 7f4c51b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:53.504 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.505+0000 7f4b037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:53.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.508+0000 7f4c51b25800 20 remove_watcher() i=0 2024-09-12T00:22:53.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.508+0000 7f4c51b25800 2 removed watcher, disabling cache 2024-09-12T00:22:53.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.509+0000 7f4c51b25800 20 remove_watcher() i=1 2024-09-12T00:22:53.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.510+0000 7f4c51b25800 20 remove_watcher() i=2 2024-09-12T00:22:53.509 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.511+0000 7f4c51b25800 20 remove_watcher() i=3 2024-09-12T00:22:53.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.512+0000 7f4c51b25800 20 remove_watcher() i=4 2024-09-12T00:22:53.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.513+0000 7f4c51b25800 20 remove_watcher() i=5 2024-09-12T00:22:53.513 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.515+0000 7f4c51b25800 20 remove_watcher() i=6 2024-09-12T00:22:53.514 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.516+0000 7f4c51b25800 20 remove_watcher() i=7 2024-09-12T00:22:53.525 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:53.525 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:22:53.525 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T00:22:53.525 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:53.526 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:22:53.556 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:53.556 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:53.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.596+0000 7fa622520800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.598+0000 7fa622520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.598+0000 7fa622520800 20 realm 2024-09-12T00:22:53.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.598+0000 7fa622520800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.598+0000 7fa622520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.598+0000 7fa622520800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:53.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.598+0000 7fa622520800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.598+0000 7fa622520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.598+0000 7fa622520800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.599+0000 7fa622520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:53.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.599+0000 7fa622520800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.600+0000 7fa622520800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:53.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.600+0000 7fa622520800 20 searching for the correct realm 2024-09-12T00:22:53.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.603+0000 7fa61d901640 0 -- 172.21.15.67:0/356375176 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fa614063070 msgr2=0x7fa614063450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:22:53.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.808+0000 7fa61e903640 0 -- 172.21.15.67:0/356375176 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55e7076794c0 msgr2=0x55e70767b980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:53.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.813+0000 7fa622520800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:53.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.813+0000 7fa622520800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:53.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.813+0000 7fa622520800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:53.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.813+0000 7fa622520800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:53.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.813+0000 7fa622520800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:53.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.813+0000 7fa622520800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:53.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.813+0000 7fa622520800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.813+0000 7fa622520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.812 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.813+0000 7fa622520800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.813+0000 7fa622520800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:53.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.813+0000 7fa622520800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.814+0000 7fa622520800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:53.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.814+0000 7fa622520800 20 zone default found 2024-09-12T00:22:53.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.814+0000 7fa622520800 4 Realm: () 2024-09-12T00:22:53.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.814+0000 7fa622520800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:53.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.814+0000 7fa622520800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:53.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.814+0000 7fa622520800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:53.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.814+0000 7fa622520800 20 zonegroup default 2024-09-12T00:22:53.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.814+0000 7fa622520800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.814+0000 7fa622520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.814+0000 7fa622520800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.814+0000 7fa622520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.814+0000 7fa622520800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.815+0000 7fa622520800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.815+0000 7fa622520800 20 started sync module instance, tier type = 2024-09-12T00:22:53.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.815+0000 7fa622520800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:53.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.824+0000 7fa622520800 20 add_watcher() i=0 2024-09-12T00:22:53.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.824+0000 7fa622520800 20 add_watcher() i=1 2024-09-12T00:22:53.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.824+0000 7fa622520800 20 add_watcher() i=2 2024-09-12T00:22:53.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.824+0000 7fa622520800 20 add_watcher() i=3 2024-09-12T00:22:53.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.824+0000 7fa622520800 20 add_watcher() i=4 2024-09-12T00:22:53.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.824+0000 7fa622520800 20 add_watcher() i=5 2024-09-12T00:22:53.822 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.824+0000 7fa622520800 20 add_watcher() i=6 2024-09-12T00:22:53.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.825+0000 7fa622520800 20 add_watcher() i=7 2024-09-12T00:22:53.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.825+0000 7fa622520800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:53.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.826+0000 7fa4d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:53.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.827+0000 7fa622520800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:53.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.827+0000 7fa622520800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:53.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.827+0000 7fa622520800 5 note: GC not initialized 2024-09-12T00:22:53.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.827+0000 7fa44f7fe640 20 reqs_thread_entry: start 2024-09-12T00:22:53.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.827+0000 7fa622520800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:53.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.827+0000 7fa622520800 20 Filter name: none 2024-09-12T00:22:53.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.827+0000 7fa44d7fa640 20 reqs_thread_entry: start 2024-09-12T00:22:53.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.828+0000 7fa622520800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.828+0000 7fa622520800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:22:53.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.828+0000 7fa622520800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.828+0000 7fa622520800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:22:53.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.828+0000 7fa622520800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:53.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.828+0000 7fa622520800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.829+0000 7fa622520800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:22:53.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.829+0000 7fa622520800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.829+0000 7fa622520800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:22:53.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.829+0000 7fa622520800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:53.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.830+0000 7fa4d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:53.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.834+0000 7fa622520800 20 remove_watcher() i=0 2024-09-12T00:22:53.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.834+0000 7fa622520800 2 removed watcher, disabling cache 2024-09-12T00:22:53.834 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.836+0000 7fa622520800 20 remove_watcher() i=1 2024-09-12T00:22:53.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.838+0000 7fa622520800 20 remove_watcher() i=2 2024-09-12T00:22:53.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.840+0000 7fa622520800 20 remove_watcher() i=3 2024-09-12T00:22:53.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.841+0000 7fa622520800 20 remove_watcher() i=4 2024-09-12T00:22:53.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.843+0000 7fa622520800 20 remove_watcher() i=5 2024-09-12T00:22:53.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.844+0000 7fa622520800 20 remove_watcher() i=6 2024-09-12T00:22:53.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.845+0000 7fa622520800 20 remove_watcher() i=7 2024-09-12T00:22:53.855 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:22:53.890 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:53.890 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:53.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.931+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.933+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.933+0000 7fde8051f800 20 realm 2024-09-12T00:22:53.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.933+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.933+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.933+0000 7fde8051f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:53.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.934+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.934+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:53.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.934+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.934+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:53.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.934+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:53.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.936+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:53.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.936+0000 7fde8051f800 20 searching for the correct realm 2024-09-12T00:22:53.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:53.939+0000 7fde7baa1640 0 -- 172.21.15.67:0/3801209938 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fde70015070 msgr2=0x7fde70037940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:22:54.142 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.144+0000 7fde7baa1640 0 -- 172.21.15.67:0/3801209938 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55da5848c7e0 msgr2=0x55da5848ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:54.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:54.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:54.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:54.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:54.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:54.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:54.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.148+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.147 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:54.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:54.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.149+0000 7fde8051f800 20 zone default found 2024-09-12T00:22:54.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.149+0000 7fde8051f800 4 Realm: () 2024-09-12T00:22:54.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.149+0000 7fde8051f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:54.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.149+0000 7fde8051f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:54.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.149+0000 7fde8051f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:54.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.149+0000 7fde8051f800 20 zonegroup default 2024-09-12T00:22:54.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.150+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.150+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.150+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.150+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.150+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.150+0000 7fde8051f800 20 started sync module instance, tier type = 2024-09-12T00:22:54.150 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.150+0000 7fde8051f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:54.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=0 2024-09-12T00:22:54.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=1 2024-09-12T00:22:54.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=2 2024-09-12T00:22:54.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=3 2024-09-12T00:22:54.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=4 2024-09-12T00:22:54.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=5 2024-09-12T00:22:54.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=6 2024-09-12T00:22:54.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.160+0000 7fde8051f800 20 add_watcher() i=7 2024-09-12T00:22:54.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.160+0000 7fde8051f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:54.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.162+0000 7fdd32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:54.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.162+0000 7fde8051f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:54.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.162+0000 7fde8051f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:54.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.162+0000 7fde8051f800 5 note: GC not initialized 2024-09-12T00:22:54.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.162+0000 7fdd31fdb640 20 reqs_thread_entry: start 2024-09-12T00:22:54.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.163+0000 7fde8051f800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:54.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.163+0000 7fde8051f800 20 Filter name: none 2024-09-12T00:22:54.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.163+0000 7fdca37fe640 20 reqs_thread_entry: start 2024-09-12T00:22:54.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.163+0000 7fde8051f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:22:54.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.163+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.163+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:22:54.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.163+0000 7fde8051f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:22:54.162 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.163+0000 7fde8051f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:22:54.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.163+0000 7fde8051f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:22:54.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.163+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.164+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:22:54.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.164+0000 7fde8051f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:22:54.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.164+0000 7fde8051f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:22:54.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.164+0000 7fde8051f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:22:54.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.164+0000 7fde8051f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:22:54.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.164+0000 7fde8051f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:22:54.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.167+0000 7fde8051f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:22:54.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.168+0000 7fde8051f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:22:54.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.168+0000 7fde8051f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:22:54.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.168+0000 7fde8051f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:22:54.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.168+0000 7fdd537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562480 cookie 94396272464336 notifier 8151 bl.length()=827 2024-09-12T00:22:54.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.168+0000 7fdd537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:22:54.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.168+0000 7fdd537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:22:54.166 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.168+0000 7fdd537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:22:54.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.168+0000 7fde8051f800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:22:54.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.168+0000 7fde8051f800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:22:54.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.168+0000 7fde8051f800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:22:54.167 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.168+0000 7fde8051f800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:22:54.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.0 2024-09-12T00:22:54.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.0 2024-09-12T00:22:54.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.1 2024-09-12T00:22:54.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.1 2024-09-12T00:22:54.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.2 2024-09-12T00:22:54.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.2 2024-09-12T00:22:54.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.3 2024-09-12T00:22:54.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.3 2024-09-12T00:22:54.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:22:54.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:22:54.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:22:54.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:22:54.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.172+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:22:54.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.172+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:22:54.171 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde8051f800 time 2024-09-12T00:22:54.174349+0000 2024-09-12T00:22:54.171 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:22:54.172 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:54.172 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde81d8c71a] 2024-09-12T00:22:54.173 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde81d8c8d8] 2024-09-12T00:22:54.173 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da56ee5641] 2024-09-12T00:22:54.173 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55da56ef451b] 2024-09-12T00:22:54.173 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55da56ef53e4] 2024-09-12T00:22:54.173 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:22:54.173 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fde80a29590] 2024-09-12T00:22:54.173 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:22:54.173 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:22:54.173 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:22:54.173 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fde8051f800 thread_name:radosgw-admin 2024-09-12T00:22:54.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.174+0000 7fde8051f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde8051f800 time 2024-09-12T00:22:54.174349+0000 2024-09-12T00:22:54.173 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:22:54.173 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.174 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:54.174 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde81d8c71a] 2024-09-12T00:22:54.174 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde81d8c8d8] 2024-09-12T00:22:54.174 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da56ee5641] 2024-09-12T00:22:54.174 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55da56ef451b] 2024-09-12T00:22:54.174 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55da56ef53e4] 2024-09-12T00:22:54.174 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:22:54.174 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fde80a29590] 2024-09-12T00:22:54.174 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:22:54.174 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:22:54.174 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.193 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:54.193 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde80a3e6f0] 2024-09-12T00:22:54.193 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde80a8b99c] 2024-09-12T00:22:54.193 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:22:54.194 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:22:54.194 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde81d8c774] 2024-09-12T00:22:54.194 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde81d8c8d8] 2024-09-12T00:22:54.194 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da56ee5641] 2024-09-12T00:22:54.194 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55da56ef451b] 2024-09-12T00:22:54.194 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55da56ef53e4] 2024-09-12T00:22:54.194 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:22:54.194 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fde80a29590] 2024-09-12T00:22:54.194 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:22:54.194 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:22:54.194 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.175+0000 7fde8051f800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:22:54.194 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fde8051f800 thread_name:radosgw-admin 2024-09-12T00:22:54.194 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.195 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:54.195 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde80a3e6f0] 2024-09-12T00:22:54.195 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde80a8b99c] 2024-09-12T00:22:54.195 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:22:54.195 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:22:54.195 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde81d8c774] 2024-09-12T00:22:54.195 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde81d8c8d8] 2024-09-12T00:22:54.195 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da56ee5641] 2024-09-12T00:22:54.195 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55da56ef451b] 2024-09-12T00:22:54.195 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55da56ef53e4] 2024-09-12T00:22:54.195 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:22:54.195 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fde80a29590] 2024-09-12T00:22:54.195 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:22:54.196 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:22:54.196 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:22:54.196 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.196 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:22:54.196 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a72a0) adding con mode: secure 2024-09-12T00:22:54.196 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a72a0) adding con mode: crc 2024-09-12T00:22:54.196 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a72a0) adding con mode: secure 2024-09-12T00:22:54.196 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a72a0) adding con mode: crc 2024-09-12T00:22:54.196 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a72a0) adding con mode: secure 2024-09-12T00:22:54.196 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:22:53.915+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.196 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:22:53.915+0000 7fde8051f800 1 librados: starting msgr at 2024-09-12T00:22:54.196 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:22:53.915+0000 7fde8051f800 1 librados: starting objecter 2024-09-12T00:22:54.196 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 asok(0x55da58181630) register_command objecter_requests hook 0x55da583cc050 2024-09-12T00:22:54.196 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:22:53.915+0000 7fde8051f800 1 librados: setting wanted keys 2024-09-12T00:22:54.197 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:22:53.915+0000 7fde8051f800 1 librados: calling monclient init 2024-09-12T00:22:54.197 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:22:53.915+0000 7fde8051f800 10 monclient: init 2024-09-12T00:22:54.197 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding auth protocol: cephx 2024-09-12T00:22:54.197 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding auth protocol: cephx 2024-09-12T00:22:54.197 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding auth protocol: cephx 2024-09-12T00:22:54.197 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: secure 2024-09-12T00:22:54.197 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: crc 2024-09-12T00:22:54.197 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: secure 2024-09-12T00:22:54.197 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: crc 2024-09-12T00:22:54.197 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: secure 2024-09-12T00:22:54.197 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: crc 2024-09-12T00:22:54.197 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: crc 2024-09-12T00:22:54.197 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: secure 2024-09-12T00:22:54.197 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: crc 2024-09-12T00:22:54.198 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: secure 2024-09-12T00:22:54.198 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: crc 2024-09-12T00:22:54.198 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: secure 2024-09-12T00:22:54.198 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:22:53.915+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.198 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:22:53.915+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.198 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:22:53.916+0000 7fde8051f800 5 asok(0x55da58181630) register_command rotate-key hook 0x55da583a1798 2024-09-12T00:22:54.198 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:54.198 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:22:54.198 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-a con 0x55da5822bdb0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:54.198 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-c con 0x55da58259a80 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:54.199 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-b con 0x55da583d35c0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:54.199 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.199 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.199 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.199 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:54.199 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): authenticate will time out at 2051.172077s 2024-09-12T00:22:54.199 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request con 0x55da5822bdb0 auth_method 0 2024-09-12T00:22:54.199 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.199 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.199 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.200 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:22:53.916+0000 7fde7baa1640 10 monclient(hunting): get_auth_request con 0x55da58259a80 auth_method 0 2024-09-12T00:22:54.200 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:22:53.916+0000 7fde7baa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.200 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:22:53.916+0000 7fde7baa1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.200 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:22:53.916+0000 7fde7baa1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.200 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.200 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.200 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.200 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:22:53.916+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.200 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:22:53.916+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.200 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:22:53.916+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.200 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:22:53.916+0000 7fde7caa3640 10 monclient(hunting): get_auth_request con 0x55da583d35c0 auth_method 0 2024-09-12T00:22:54.200 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:22:53.916+0000 7fde7caa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.201 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:22:53.916+0000 7fde7caa3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.201 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:22:53.916+0000 7fde7caa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.201 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:22:53.916+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.201 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:22:53.916+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.201 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:22:53.916+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.201 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_done global_id 8142 payload 824 2024-09-12T00:22:54.201 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient: _finish_hunting 0 2024-09-12T00:22:54.201 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 1 monclient: found mon.noname-a 2024-09-12T00:22:54.201 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.201 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.201 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:22:54.201 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: dump: 2024-09-12T00:22:54.201 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.201 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.202 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.202 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.202 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.202 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.202 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.202 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.202 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.202 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.202 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: _finish_auth 0 2024-09-12T00:22:54.202 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: _check_auth_tickets 2024-09-12T00:22:54.202 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:54.202 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.202 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:22:54.202 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: dump: 2024-09-12T00:22:54.203 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.203 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.203 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.203 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.203 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.203 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.203 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.203 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.203 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.203 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.203 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:22:53.916+0000 7fde8051f800 5 monclient: authenticate success, global_id 8142 2024-09-12T00:22:54.203 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:22:53.916+0000 7fdd6a60c640 4 set_mon_vals no callback set 2024-09-12T00:22:54.203 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient: _renew_subs 2024-09-12T00:22:54.204 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.204 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient: _renew_subs 2024-09-12T00:22:54.204 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.204 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:22:53.916+0000 7fde8051f800 1 librados: init done 2024-09-12T00:22:54.204 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:22:53.918+0000 7fdd68e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:22:54.204 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:22:53.918+0000 7fdd68e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:54.204 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:22:53.918+0000 7fdd68e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:54.204 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:22:53.919+0000 7fde7baa1640 10 monclient: get_auth_request con 0x7fdd64076470 auth_method 0 2024-09-12T00:22:54.204 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:22:53.919+0000 7fde7caa3640 10 monclient: get_auth_request con 0x55da583ca730 auth_method 0 2024-09-12T00:22:54.204 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:22:53.920+0000 7fde7c2a2640 10 monclient: get_auth_request con 0x55da583ed050 auth_method 0 2024-09-12T00:22:54.204 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:22:53.921+0000 7fde7baa1640 10 monclient: get_auth_request con 0x55da583f16f0 auth_method 0 2024-09-12T00:22:54.204 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:22:53.922+0000 7fde8051f800 10 monclient: build_initial_monmap 2024-09-12T00:22:54.204 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:22:53.922+0000 7fde8051f800 1 build_initial for_mkfs: 0 2024-09-12T00:22:54.205 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:22:53.922+0000 7fde8051f800 10 monclient: monmap: 2024-09-12T00:22:54.205 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:22:54.205 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:22:54.205 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:22:54.205 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:22:54.205 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:22:54.205 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.205 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:22:54.205 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:22:54.205 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:22:54.205 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.205 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding auth protocol: cephx 2024-09-12T00:22:54.205 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding auth protocol: cephx 2024-09-12T00:22:54.205 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding auth protocol: cephx 2024-09-12T00:22:54.206 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: secure 2024-09-12T00:22:54.206 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: crc 2024-09-12T00:22:54.206 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: secure 2024-09-12T00:22:54.206 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: crc 2024-09-12T00:22:54.206 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: secure 2024-09-12T00:22:54.206 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: crc 2024-09-12T00:22:54.206 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: crc 2024-09-12T00:22:54.206 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: secure 2024-09-12T00:22:54.206 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: crc 2024-09-12T00:22:54.206 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: secure 2024-09-12T00:22:54.206 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: crc 2024-09-12T00:22:54.206 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: secure 2024-09-12T00:22:54.206 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:22:53.922+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.206 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 asok(0x55da58181630) register_command objecter_requests cmddesc objecter_requests hook 0x55da583f9860 EEXIST 2024-09-12T00:22:54.207 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient: init 2024-09-12T00:22:54.207 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding auth protocol: cephx 2024-09-12T00:22:54.207 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding auth protocol: cephx 2024-09-12T00:22:54.207 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding auth protocol: cephx 2024-09-12T00:22:54.207 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: secure 2024-09-12T00:22:54.207 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: crc 2024-09-12T00:22:54.207 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: secure 2024-09-12T00:22:54.207 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: crc 2024-09-12T00:22:54.207 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: secure 2024-09-12T00:22:54.207 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: crc 2024-09-12T00:22:54.207 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: crc 2024-09-12T00:22:54.207 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: secure 2024-09-12T00:22:54.207 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: crc 2024-09-12T00:22:54.207 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: secure 2024-09-12T00:22:54.208 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: crc 2024-09-12T00:22:54.208 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: secure 2024-09-12T00:22:54.208 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:22:53.923+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.208 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:22:53.923+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.208 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 asok(0x55da58181630) register_command rotate-key cmddesc rotate-key hook 0x55da583f4be0 EEXIST 2024-09-12T00:22:54.208 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:54.208 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:22:54.208 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-a con 0x55da5841db80 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:54.208 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-c con 0x55da5841df60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:54.208 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-b con 0x55da5841c890 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:54.208 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.208 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.208 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.209 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:54.209 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): authenticate will time out at 2051.179679s 2024-09-12T00:22:54.209 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request con 0x55da5841db80 auth_method 0 2024-09-12T00:22:54.209 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.209 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.209 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.209 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:22:53.923+0000 7fde7baa1640 10 monclient(hunting): get_auth_request con 0x55da5841df60 auth_method 0 2024-09-12T00:22:54.209 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:22:53.923+0000 7fde7baa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.209 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:22:53.923+0000 7fde7baa1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.209 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:22:53.923+0000 7fde7baa1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.209 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.209 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.209 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.209 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:22:53.923+0000 7fde7caa3640 10 monclient(hunting): get_auth_request con 0x55da5841c890 auth_method 0 2024-09-12T00:22:54.210 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:22:53.923+0000 7fde7caa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.210 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:22:53.923+0000 7fde7caa3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.210 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:22:53.923+0000 7fde7caa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.210 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:22:53.923+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.210 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:22:53.923+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.210 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:22:53.923+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.210 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:22:53.923+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.210 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:22:53.923+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.210 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:22:53.923+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.210 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_done global_id 8145 payload 824 2024-09-12T00:22:54.210 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:22:53.924+0000 7fde7c2a2640 10 monclient: _finish_hunting 0 2024-09-12T00:22:54.210 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:22:53.924+0000 7fde7c2a2640 1 monclient: found mon.noname-a 2024-09-12T00:22:54.210 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:22:53.924+0000 7fde7c2a2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.210 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.211 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:22:54.211 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: dump: 2024-09-12T00:22:54.211 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.211 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.211 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.211 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.211 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.211 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.211 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.211 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.211 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.211 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.211 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: _finish_auth 0 2024-09-12T00:22:54.212 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:22:54.212 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:54.212 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.212 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:22:54.212 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: dump: 2024-09-12T00:22:54.212 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.212 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.212 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.212 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.212 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.212 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.212 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.212 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.212 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.213 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.213 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:22:53.924+0000 7fde8051f800 5 monclient: authenticate success, global_id 8145 2024-09-12T00:22:54.213 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:22:53.924+0000 7fde8051f800 10 monclient: _renew_subs 2024-09-12T00:22:54.213 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:22:53.924+0000 7fde8051f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.213 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:22:53.924+0000 7fde7d2a4640 4 set_mon_vals no callback set 2024-09-12T00:22:54.213 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:22:53.924+0000 7fde8051f800 10 monclient: _renew_subs 2024-09-12T00:22:54.213 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:22:53.924+0000 7fde8051f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.213 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:22:53.926+0000 7fdd61ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:22:54.213 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:22:53.926+0000 7fdd61ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:54.213 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:22:53.926+0000 7fdd61ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:54.213 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:22:53.926+0000 7fde7baa1640 10 monclient: get_auth_request con 0x7fdd54076380 auth_method 0 2024-09-12T00:22:54.213 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:22:53.926+0000 7fde8051f800 10 monclient: get_monmap_and_config 2024-09-12T00:22:54.213 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:22:53.926+0000 7fde8051f800 10 monclient: build_initial_monmap 2024-09-12T00:22:54.213 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:22:53.926+0000 7fde8051f800 1 build_initial for_mkfs: 0 2024-09-12T00:22:54.214 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:22:53.926+0000 7fde8051f800 10 monclient: monmap: 2024-09-12T00:22:54.214 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:22:54.214 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:22:54.214 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:22:54.214 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:22:54.214 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:22:54.214 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.214 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:22:54.214 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:22:54.214 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:22:54.214 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.214 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding auth protocol: cephx 2024-09-12T00:22:54.214 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding auth protocol: cephx 2024-09-12T00:22:54.214 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding auth protocol: cephx 2024-09-12T00:22:54.215 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: secure 2024-09-12T00:22:54.215 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: crc 2024-09-12T00:22:54.215 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: secure 2024-09-12T00:22:54.215 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: crc 2024-09-12T00:22:54.215 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: secure 2024-09-12T00:22:54.215 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: crc 2024-09-12T00:22:54.215 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: crc 2024-09-12T00:22:54.215 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: secure 2024-09-12T00:22:54.215 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: crc 2024-09-12T00:22:54.215 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: secure 2024-09-12T00:22:54.215 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: crc 2024-09-12T00:22:54.215 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: secure 2024-09-12T00:22:54.215 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:22:53.926+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.215 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:22:53.926+0000 7fde8051f800 10 monclient: init 2024-09-12T00:22:54.216 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding auth protocol: cephx 2024-09-12T00:22:54.216 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding auth protocol: cephx 2024-09-12T00:22:54.216 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding auth protocol: cephx 2024-09-12T00:22:54.216 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: secure 2024-09-12T00:22:54.216 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: crc 2024-09-12T00:22:54.216 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: secure 2024-09-12T00:22:54.216 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: crc 2024-09-12T00:22:54.216 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: secure 2024-09-12T00:22:54.216 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: crc 2024-09-12T00:22:54.216 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: crc 2024-09-12T00:22:54.216 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: secure 2024-09-12T00:22:54.216 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: crc 2024-09-12T00:22:54.216 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: secure 2024-09-12T00:22:54.216 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: crc 2024-09-12T00:22:54.217 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: secure 2024-09-12T00:22:54.217 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:22:53.927+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.217 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:22:53.927+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.217 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:22:53.927+0000 7fde8051f800 5 asok(0x55da58181630) register_command rotate-key cmddesc rotate-key hook 0x7ffdea3d8cd8 EEXIST 2024-09-12T00:22:54.217 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:54.217 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:22:54.217 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-c con 0x55da58441700 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:54.217 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-b con 0x55da5846c170 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:54.217 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-a con 0x55da5846d520 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:54.217 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.217 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.217 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.217 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:54.217 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): authenticate will time out at 2051.183330s 2024-09-12T00:22:54.218 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request con 0x55da58441700 auth_method 0 2024-09-12T00:22:54.218 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.218 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.218 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.218 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:22:53.927+0000 7fde7caa3640 10 monclient(hunting): get_auth_request con 0x55da5846d520 auth_method 0 2024-09-12T00:22:54.218 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:22:53.927+0000 7fde7caa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.218 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:22:53.927+0000 7fde7caa3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.218 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:22:53.927+0000 7fde7caa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.218 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.218 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.218 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.218 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:22:53.927+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.218 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:22:53.927+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.218 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:22:53.927+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.219 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:22:53.927+0000 7fde7baa1640 10 monclient(hunting): get_auth_request con 0x55da5846c170 auth_method 0 2024-09-12T00:22:54.219 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:22:53.927+0000 7fde7baa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.219 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:22:53.927+0000 7fde7baa1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.219 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:22:53.927+0000 7fde7baa1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.219 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_done global_id 7592 payload 274 2024-09-12T00:22:54.219 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient: _finish_hunting 0 2024-09-12T00:22:54.219 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 1 monclient: found mon.noname-c 2024-09-12T00:22:54.219 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:22:54.219 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.219 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:22:54.219 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: dump: 2024-09-12T00:22:54.219 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.219 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.219 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.220 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.220 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.220 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.220 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.220 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.220 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.220 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.220 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: _finish_auth 0 2024-09-12T00:22:54.220 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: _check_auth_tickets 2024-09-12T00:22:54.220 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:54.220 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.220 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:22:54.220 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: dump: 2024-09-12T00:22:54.221 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.221 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.221 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.221 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.221 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.221 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.221 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.221 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.221 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.221 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.221 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:22:53.927+0000 7fde8051f800 5 monclient: authenticate success, global_id 7592 2024-09-12T00:22:54.221 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient: get_monmap_and_config success 2024-09-12T00:22:54.221 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:22:53.927+0000 7fde8051f800 4 set_mon_vals no callback set 2024-09-12T00:22:54.221 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:22:53.928+0000 7fde8051f800 10 monclient: shutdown 2024-09-12T00:22:54.222 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:22:53.928+0000 7fde8051f800 10 monclient: build_initial_monmap 2024-09-12T00:22:54.222 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:22:53.928+0000 7fde8051f800 1 build_initial for_mkfs: 0 2024-09-12T00:22:54.222 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:22:53.928+0000 7fde8051f800 10 monclient: monmap: 2024-09-12T00:22:54.222 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:22:54.222 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:22:54.222 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:22:54.222 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:22:54.222 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:22:54.222 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.222 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:22:54.222 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:22:54.222 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:22:54.222 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.222 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding auth protocol: cephx 2024-09-12T00:22:54.223 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding auth protocol: cephx 2024-09-12T00:22:54.223 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding auth protocol: cephx 2024-09-12T00:22:54.223 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: secure 2024-09-12T00:22:54.223 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: crc 2024-09-12T00:22:54.223 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: secure 2024-09-12T00:22:54.223 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: crc 2024-09-12T00:22:54.223 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: secure 2024-09-12T00:22:54.223 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: crc 2024-09-12T00:22:54.223 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: crc 2024-09-12T00:22:54.223 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: secure 2024-09-12T00:22:54.223 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: crc 2024-09-12T00:22:54.223 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: secure 2024-09-12T00:22:54.223 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: crc 2024-09-12T00:22:54.224 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: secure 2024-09-12T00:22:54.224 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:22:53.928+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.224 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:22:53.928+0000 7fde8051f800 1 librados: starting msgr at 2024-09-12T00:22:54.224 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:22:53.928+0000 7fde8051f800 1 librados: starting objecter 2024-09-12T00:22:54.224 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 asok(0x55da58181630) register_command objecter_requests cmddesc objecter_requests hook 0x55da584437f0 EEXIST 2024-09-12T00:22:54.224 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:22:53.929+0000 7fde8051f800 1 librados: setting wanted keys 2024-09-12T00:22:54.224 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:22:53.929+0000 7fde8051f800 1 librados: calling monclient init 2024-09-12T00:22:54.224 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient: init 2024-09-12T00:22:54.224 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding auth protocol: cephx 2024-09-12T00:22:54.224 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding auth protocol: cephx 2024-09-12T00:22:54.224 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding auth protocol: cephx 2024-09-12T00:22:54.224 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: secure 2024-09-12T00:22:54.224 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: crc 2024-09-12T00:22:54.224 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: secure 2024-09-12T00:22:54.225 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: crc 2024-09-12T00:22:54.225 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: secure 2024-09-12T00:22:54.225 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: crc 2024-09-12T00:22:54.225 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: crc 2024-09-12T00:22:54.225 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: secure 2024-09-12T00:22:54.225 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: crc 2024-09-12T00:22:54.225 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: secure 2024-09-12T00:22:54.225 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: crc 2024-09-12T00:22:54.225 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: secure 2024-09-12T00:22:54.225 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:22:53.929+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.225 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:22:53.929+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.225 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 asok(0x55da58181630) register_command rotate-key cmddesc rotate-key hook 0x55da58432588 EEXIST 2024-09-12T00:22:54.225 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:54.225 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:22:54.226 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-b con 0x55da58441700 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:54.226 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-c con 0x55da5846d520 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:54.226 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-a con 0x55da58469d70 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:54.226 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.226 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.226 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.226 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:54.226 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): authenticate will time out at 2051.185554s 2024-09-12T00:22:54.226 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): get_auth_request con 0x55da58469d70 auth_method 0 2024-09-12T00:22:54.226 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.226 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.226 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.226 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:22:53.929+0000 7fde7baa1640 10 monclient(hunting): get_auth_request con 0x55da5846d520 auth_method 0 2024-09-12T00:22:54.227 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:22:53.929+0000 7fde7baa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.227 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:22:53.929+0000 7fde7baa1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.227 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:22:53.929+0000 7fde7baa1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.227 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:22:53.929+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request con 0x55da58441700 auth_method 0 2024-09-12T00:22:54.227 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:22:53.929+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.227 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:22:53.929+0000 7fde7c2a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.227 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:22:53.929+0000 7fde7c2a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.227 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.227 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.227 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.227 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:22:53.929+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.227 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:22:53.929+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.227 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:22:53.929+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.227 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:22:53.929+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.228 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:22:53.929+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.228 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:22:53.929+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.228 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): handle_auth_done global_id 8151 payload 824 2024-09-12T00:22:54.228 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient: _finish_hunting 0 2024-09-12T00:22:54.228 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:22:53.929+0000 7fde7caa3640 1 monclient: found mon.noname-a 2024-09-12T00:22:54.228 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.228 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.228 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:22:54.228 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: dump: 2024-09-12T00:22:54.228 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.228 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.228 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.228 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.229 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.229 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.229 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.229 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.229 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.229 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.229 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: _finish_auth 0 2024-09-12T00:22:54.229 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:22:54.229 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:54.229 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.229 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:22:54.229 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: dump: 2024-09-12T00:22:54.229 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.229 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.230 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.230 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.230 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.230 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.230 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.230 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.230 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.230 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.230 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:22:53.930+0000 7fde8051f800 5 monclient: authenticate success, global_id 8151 2024-09-12T00:22:54.230 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:22:53.930+0000 7fdd537fe640 4 set_mon_vals no callback set 2024-09-12T00:22:54.230 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:22:53.930+0000 7fde8051f800 10 monclient: _renew_subs 2024-09-12T00:22:54.230 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:22:53.930+0000 7fde8051f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.230 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:22:53.930+0000 7fde8051f800 10 monclient: _renew_subs 2024-09-12T00:22:54.230 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:22:53.930+0000 7fde8051f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.231 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:22:53.930+0000 7fde8051f800 1 librados: init done 2024-09-12T00:22:54.231 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:22:53.930+0000 7fde8051f800 5 asok(0x55da58181630) register_command cr dump hook 0x55da58468ff8 2024-09-12T00:22:54.231 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:22:53.931+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.231 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:22:53.932+0000 7fdd51ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:22:54.231 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:22:53.932+0000 7fdd51ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:54.231 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:22:53.932+0000 7fdd51ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:54.231 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:22:53.932+0000 7fde7c2a2640 10 monclient: get_auth_request con 0x7fdd44076470 auth_method 0 2024-09-12T00:22:54.231 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:22:53.933+0000 7fde7baa1640 10 monclient: get_auth_request con 0x55da5848c7e0 auth_method 0 2024-09-12T00:22:54.231 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:22:53.933+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.231 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:22:53.933+0000 7fde8051f800 20 realm 2024-09-12T00:22:54.231 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:22:53.933+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.231 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:22:53.933+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.231 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:22:53.933+0000 7fde8051f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:54.231 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:22:53.934+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.232 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:22:53.934+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.232 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:22:53.934+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.232 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:22:53.934+0000 7fde7c2a2640 10 monclient: get_auth_request con 0x55da584909c0 auth_method 0 2024-09-12T00:22:54.232 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:22:53.934+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:54.232 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:22:53.934+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.232 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:22:53.935+0000 7fde7baa1640 10 monclient: get_auth_request con 0x55da58494220 auth_method 0 2024-09-12T00:22:54.232 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:22:53.936+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:54.232 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:22:53.936+0000 7fde8051f800 20 searching for the correct realm 2024-09-12T00:22:54.232 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:22:53.936+0000 7fde7caa3640 10 monclient: get_auth_request con 0x7fde70036070 auth_method 0 2024-09-12T00:22:54.232 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:22:53.937+0000 7fde7c2a2640 10 monclient: get_auth_request con 0x7fde6c0bec20 auth_method 0 2024-09-12T00:22:54.232 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:22:53.938+0000 7fde7baa1640 10 monclient: get_auth_request con 0x7fde70015070 auth_method 0 2024-09-12T00:22:54.232 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:22:53.939+0000 7fde7baa1640 0 -- 172.21.15.67:0/3801209938 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fde70015070 msgr2=0x7fde70037940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:22:54.232 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:22:54.140+0000 7fde7baa1640 10 monclient: get_auth_request con 0x7fde70015070 auth_method 0 2024-09-12T00:22:54.233 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:22:54.142+0000 7fde7caa3640 10 monclient: get_auth_request con 0x7fde6c0b7070 auth_method 0 2024-09-12T00:22:54.233 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:22:54.143+0000 7fde7c2a2640 10 monclient: get_auth_request con 0x7fde7406c0b0 auth_method 0 2024-09-12T00:22:54.233 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:22:54.144+0000 7fde7baa1640 0 -- 172.21.15.67:0/3801209938 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55da5848c7e0 msgr2=0x55da5848ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:54.233 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:22:54.144+0000 7fdd51ffb640 1 client.8151.objecter ms_handle_reset 0x55da5848c7e0 session 0x55da5848c0d0 osd.6 2024-09-12T00:22:54.233 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:22:54.144+0000 7fdd51ffb640 10 monclient: _renew_subs 2024-09-12T00:22:54.233 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:22:54.144+0000 7fdd51ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.233 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:22:54.144+0000 7fde7baa1640 10 monclient: get_auth_request con 0x7fdd44086790 auth_method 0 2024-09-12T00:22:54.233 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:54.233 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:54.233 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:54.233 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:54.233 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:54.233 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:54.234 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:22:54.148+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.234 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.234 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.234 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:54.234 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.234 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:54.234 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 zone default found 2024-09-12T00:22:54.234 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:22:54.149+0000 7fde8051f800 4 Realm: () 2024-09-12T00:22:54.234 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:22:54.149+0000 7fde8051f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:54.234 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:22:54.149+0000 7fde8051f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:54.234 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:22:54.149+0000 7fde8051f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:54.234 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 zonegroup default 2024-09-12T00:22:54.234 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.234 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:22:54.150+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.235 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:22:54.150+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.235 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:22:54.150+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.235 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:22:54.150+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.235 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:22:54.150+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.235 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:22:54.150+0000 7fde8051f800 20 started sync module instance, tier type = 2024-09-12T00:22:54.235 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:22:54.150+0000 7fde8051f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:54.235 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=0 2024-09-12T00:22:54.235 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=1 2024-09-12T00:22:54.235 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=2 2024-09-12T00:22:54.235 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=3 2024-09-12T00:22:54.235 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=4 2024-09-12T00:22:54.235 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=5 2024-09-12T00:22:54.236 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=6 2024-09-12T00:22:54.236 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:22:54.160+0000 7fde8051f800 20 add_watcher() i=7 2024-09-12T00:22:54.236 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:22:54.160+0000 7fde8051f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:54.236 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding auth protocol: cephx 2024-09-12T00:22:54.236 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding auth protocol: cephx 2024-09-12T00:22:54.236 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding auth protocol: cephx 2024-09-12T00:22:54.236 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: secure 2024-09-12T00:22:54.236 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: crc 2024-09-12T00:22:54.236 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: secure 2024-09-12T00:22:54.236 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: crc 2024-09-12T00:22:54.236 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: secure 2024-09-12T00:22:54.236 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: crc 2024-09-12T00:22:54.236 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: crc 2024-09-12T00:22:54.236 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: secure 2024-09-12T00:22:54.237 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: crc 2024-09-12T00:22:54.237 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: secure 2024-09-12T00:22:54.237 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: crc 2024-09-12T00:22:54.237 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: secure 2024-09-12T00:22:54.237 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:22:54.162+0000 7fdd32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:54.237 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:22:54.162+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.237 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:22:54.162+0000 7fde8051f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:54.237 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:22:54.162+0000 7fde8051f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:54.237 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 asok(0x55da58181630) register_command cache list hook 0x55da58475210 2024-09-12T00:22:54.237 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 asok(0x55da58181630) register_command cache inspect hook 0x55da58475210 2024-09-12T00:22:54.237 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 asok(0x55da58181630) register_command cache erase hook 0x55da58475210 2024-09-12T00:22:54.237 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 asok(0x55da58181630) register_command cache zap hook 0x55da58475210 2024-09-12T00:22:54.237 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 note: GC not initialized 2024-09-12T00:22:54.238 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:22:54.162+0000 7fdd31fdb640 20 reqs_thread_entry: start 2024-09-12T00:22:54.238 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:22:54.163+0000 7fde8051f800 5 asok(0x55da58181630) register_command sync trace show hook 0x7fde6c0ba020 2024-09-12T00:22:54.238 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:22:54.163+0000 7fde8051f800 5 asok(0x55da58181630) register_command sync trace history hook 0x7fde6c0ba020 2024-09-12T00:22:54.238 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:22:54.163+0000 7fde8051f800 5 asok(0x55da58181630) register_command sync trace active hook 0x7fde6c0ba020 2024-09-12T00:22:54.238 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:22:54.163+0000 7fde8051f800 5 asok(0x55da58181630) register_command sync trace active_short hook 0x7fde6c0ba020 2024-09-12T00:22:54.238 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:22:54.163+0000 7fde8051f800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:54.238 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:22:54.163+0000 7fde8051f800 20 Filter name: none 2024-09-12T00:22:54.238 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:22:54.163+0000 7fdca37fe640 20 reqs_thread_entry: start 2024-09-12T00:22:54.238 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:22:54.163+0000 7fde8051f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:22:54.238 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:22:54.163+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.238 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:22:54.163+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:22:54.238 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:22:54.163+0000 7fde8051f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:22:54.238 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:22:54.163+0000 7fde8051f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:22:54.238 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:22:54.163+0000 7fde8051f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:22:54.238 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:22:54.163+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.239 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:22:54.164+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:22:54.239 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:22:54.164+0000 7fde8051f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:22:54.239 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:22:54.164+0000 7fde8051f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:22:54.239 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:22:54.164+0000 7fde8051f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:22:54.239 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:22:54.164+0000 7fde8051f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:22:54.239 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:22:54.164+0000 7fde8051f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:22:54.239 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:22:54.167+0000 7fde8051f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:22:54.239 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:22:54.168+0000 7fde8051f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:22:54.239 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:22:54.168+0000 7fde8051f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:22:54.239 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:22:54.168+0000 7fde8051f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:22:54.239 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:22:54.168+0000 7fdd537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562480 cookie 94396272464336 notifier 8151 bl.length()=827 2024-09-12T00:22:54.239 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:22:54.168+0000 7fdd537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:22:54.239 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:22:54.168+0000 7fdd537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:22:54.240 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:22:54.168+0000 7fdd537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:22:54.240 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:22:54.168+0000 7fde8051f800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:22:54.240 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:22:54.168+0000 7fde8051f800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:22:54.240 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:22:54.168+0000 7fde8051f800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:22:54.240 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:22:54.168+0000 7fde8051f800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:22:54.240 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.0 2024-09-12T00:22:54.240 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.0 2024-09-12T00:22:54.240 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.1 2024-09-12T00:22:54.240 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.1 2024-09-12T00:22:54.240 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.2 2024-09-12T00:22:54.240 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.2 2024-09-12T00:22:54.240 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.3 2024-09-12T00:22:54.240 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.3 2024-09-12T00:22:54.241 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:22:54.241 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:22:54.241 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:22:54.241 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:22:54.241 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:22:54.172+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:22:54.241 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:22:54.172+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:22:54.241 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:22:54.174+0000 7fde8051f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde8051f800 time 2024-09-12T00:22:54.174349+0000 2024-09-12T00:22:54.241 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:22:54.241 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.241 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:54.241 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde81d8c71a] 2024-09-12T00:22:54.241 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde81d8c8d8] 2024-09-12T00:22:54.241 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da56ee5641] 2024-09-12T00:22:54.242 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55da56ef451b] 2024-09-12T00:22:54.242 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55da56ef53e4] 2024-09-12T00:22:54.242 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:22:54.242 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fde80a29590] 2024-09-12T00:22:54.242 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:22:54.242 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:22:54.242 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.242 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:22:54.175+0000 7fde8051f800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:22:54.242 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fde8051f800 thread_name:radosgw-admin 2024-09-12T00:22:54.242 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.242 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:54.242 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde80a3e6f0] 2024-09-12T00:22:54.242 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde80a8b99c] 2024-09-12T00:22:54.242 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:22:54.243 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:22:54.243 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde81d8c774] 2024-09-12T00:22:54.243 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde81d8c8d8] 2024-09-12T00:22:54.243 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da56ee5641] 2024-09-12T00:22:54.243 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55da56ef451b] 2024-09-12T00:22:54.243 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55da56ef53e4] 2024-09-12T00:22:54.243 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:22:54.243 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fde80a29590] 2024-09-12T00:22:54.243 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:22:54.243 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:22:54.243 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:22:54.243 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.243 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:22:54.244 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:22:54.244 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:22:54.244 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:22:54.244 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:22:54.244 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:22:54.244 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:22:54.244 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:22:54.244 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:22:54.244 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:22:54.244 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:22:54.244 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:22:54.244 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:22:54.244 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:22:54.245 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:22:54.245 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:22:54.245 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:22:54.245 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:22:54.245 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:22:54.245 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:22:54.245 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:22:54.245 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:22:54.245 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:22:54.245 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:22:54.245 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:22:54.245 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:22:54.245 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:22:54.245 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:22:54.246 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:22:54.246 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:22:54.246 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:22:54.246 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:22:54.246 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:22:54.246 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:22:54.246 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:22:54.246 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:22:54.246 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:22:54.246 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:22:54.246 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:22:54.246 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:22:54.246 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:22:54.246 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:22:54.246 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:22:54.247 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:22:54.247 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:22:54.247 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:22:54.247 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:22:54.247 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:22:54.247 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:22:54.247 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:22:54.247 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:22:54.247 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:22:54.247 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:22:54.247 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:22:54.247 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:22:54.247 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:22:54.247 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:22:54.248 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:22:54.248 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:22:54.248 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:22:54.248 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:22:54.248 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:22:54.248 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:22:54.248 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:22:54.248 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:22:54.248 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:22:54.248 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:22:54.248 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:22:54.248 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:22:54.248 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:22:54.248 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:22:54.249 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:22:54.249 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:22:54.249 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:22:54.249 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:22:54.249 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:22:54.249 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:22:54.249 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:22:54.249 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:22:54.249 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:22:54.249 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:22:54.249 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:22:54.249 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:22:54.249 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:22:54.249 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:22:54.250 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:22:54.250 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:22:54.250 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:22:54.250 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:22:54.250 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:22:54.250 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:22:54.250 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:22:54.250 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:22:54.250 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:22:54.250 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdca37fe640 / http_manager 2024-09-12T00:22:54.250 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdd31fdb640 / http_manager 2024-09-12T00:22:54.250 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdd32fdd640 / rgw_dt_lg_renew 2024-09-12T00:22:54.250 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdd51ffb640 / ms_dispatch 2024-09-12T00:22:54.250 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdd537fe640 / io_context_pool 2024-09-12T00:22:54.251 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdd61ffb640 / ms_dispatch 2024-09-12T00:22:54.251 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdd68e09640 / ms_dispatch 2024-09-12T00:22:54.251 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdd6a60c640 / io_context_pool 2024-09-12T00:22:54.251 INFO:tasks.workunit.client.0.smithi067.stderr: 7fde7baa1640 / msgr-worker-2 2024-09-12T00:22:54.251 INFO:tasks.workunit.client.0.smithi067.stderr: 7fde7c2a2640 / msgr-worker-1 2024-09-12T00:22:54.251 INFO:tasks.workunit.client.0.smithi067.stderr: 7fde7caa3640 / msgr-worker-0 2024-09-12T00:22:54.251 INFO:tasks.workunit.client.0.smithi067.stderr: 7fde7d2a4640 / io_context_pool 2024-09-12T00:22:54.251 INFO:tasks.workunit.client.0.smithi067.stderr: 7fde8051f800 / radosgw-admin 2024-09-12T00:22:54.251 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:22:54.251 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:22:54.251 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.146453.log 2024-09-12T00:22:54.251 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:22:54.251 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:22:54.251 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a72a0) adding con mode: secure 2024-09-12T00:22:54.252 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a72a0) adding con mode: crc 2024-09-12T00:22:54.252 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a72a0) adding con mode: secure 2024-09-12T00:22:54.252 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a72a0) adding con mode: crc 2024-09-12T00:22:54.252 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a72a0) adding con mode: secure 2024-09-12T00:22:54.252 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:22:53.915+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.252 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:22:53.915+0000 7fde8051f800 1 librados: starting msgr at 2024-09-12T00:22:54.252 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:22:53.915+0000 7fde8051f800 1 librados: starting objecter 2024-09-12T00:22:54.252 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 asok(0x55da58181630) register_command objecter_requests hook 0x55da583cc050 2024-09-12T00:22:54.252 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:22:53.915+0000 7fde8051f800 1 librados: setting wanted keys 2024-09-12T00:22:54.252 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:22:53.915+0000 7fde8051f800 1 librados: calling monclient init 2024-09-12T00:22:54.252 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:22:53.915+0000 7fde8051f800 10 monclient: init 2024-09-12T00:22:54.252 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding auth protocol: cephx 2024-09-12T00:22:54.252 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding auth protocol: cephx 2024-09-12T00:22:54.252 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding auth protocol: cephx 2024-09-12T00:22:54.253 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: secure 2024-09-12T00:22:54.253 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: crc 2024-09-12T00:22:54.253 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: secure 2024-09-12T00:22:54.253 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: crc 2024-09-12T00:22:54.253 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: secure 2024-09-12T00:22:54.253 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: crc 2024-09-12T00:22:54.253 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: crc 2024-09-12T00:22:54.253 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: secure 2024-09-12T00:22:54.253 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: crc 2024-09-12T00:22:54.253 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: secure 2024-09-12T00:22:54.253 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: crc 2024-09-12T00:22:54.253 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:22:53.915+0000 7fde8051f800 5 AuthRegistry(0x55da583a1650) adding con mode: secure 2024-09-12T00:22:54.253 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:22:53.915+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.253 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:22:53.915+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.254 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:22:53.916+0000 7fde8051f800 5 asok(0x55da58181630) register_command rotate-key hook 0x55da583a1798 2024-09-12T00:22:54.254 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:54.254 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:22:54.254 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-a con 0x55da5822bdb0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:54.254 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-c con 0x55da58259a80 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:54.254 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-b con 0x55da583d35c0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:54.254 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.254 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.254 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.254 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:54.254 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient(hunting): authenticate will time out at 2051.172077s 2024-09-12T00:22:54.254 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request con 0x55da5822bdb0 auth_method 0 2024-09-12T00:22:54.254 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.254 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.255 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.255 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:22:53.916+0000 7fde7baa1640 10 monclient(hunting): get_auth_request con 0x55da58259a80 auth_method 0 2024-09-12T00:22:54.255 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:22:53.916+0000 7fde7baa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.255 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:22:53.916+0000 7fde7baa1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.255 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:22:53.916+0000 7fde7baa1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.255 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.255 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.255 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.255 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:22:53.916+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.255 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:22:53.916+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.255 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:22:53.916+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.255 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:22:53.916+0000 7fde7caa3640 10 monclient(hunting): get_auth_request con 0x55da583d35c0 auth_method 0 2024-09-12T00:22:54.255 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:22:53.916+0000 7fde7caa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.255 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:22:53.916+0000 7fde7caa3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.256 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:22:53.916+0000 7fde7caa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.256 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:22:53.916+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.256 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:22:53.916+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.256 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:22:53.916+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.256 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_done global_id 8142 payload 824 2024-09-12T00:22:54.256 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient: _finish_hunting 0 2024-09-12T00:22:54.256 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 1 monclient: found mon.noname-a 2024-09-12T00:22:54.256 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:22:53.916+0000 7fde7c2a2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.257 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.257 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:22:54.257 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: dump: 2024-09-12T00:22:54.257 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.257 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.257 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.257 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.257 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.257 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.257 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.257 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.257 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.257 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.257 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: _finish_auth 0 2024-09-12T00:22:54.258 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: _check_auth_tickets 2024-09-12T00:22:54.258 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:54.258 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.258 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:22:54.258 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:22:53.916+0000 7fdd68e09640 10 monclient: dump: 2024-09-12T00:22:54.258 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.258 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.258 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.258 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.258 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.258 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.258 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.258 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.259 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.259 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.259 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:22:53.916+0000 7fde8051f800 5 monclient: authenticate success, global_id 8142 2024-09-12T00:22:54.259 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:22:53.916+0000 7fdd6a60c640 4 set_mon_vals no callback set 2024-09-12T00:22:54.259 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient: _renew_subs 2024-09-12T00:22:54.259 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.259 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient: _renew_subs 2024-09-12T00:22:54.259 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:22:53.916+0000 7fde8051f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.259 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:22:53.916+0000 7fde8051f800 1 librados: init done 2024-09-12T00:22:54.259 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:22:53.918+0000 7fdd68e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:22:54.259 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:22:53.918+0000 7fdd68e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:54.259 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:22:53.918+0000 7fdd68e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:54.259 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:22:53.919+0000 7fde7baa1640 10 monclient: get_auth_request con 0x7fdd64076470 auth_method 0 2024-09-12T00:22:54.259 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:22:53.919+0000 7fde7caa3640 10 monclient: get_auth_request con 0x55da583ca730 auth_method 0 2024-09-12T00:22:54.260 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:22:53.920+0000 7fde7c2a2640 10 monclient: get_auth_request con 0x55da583ed050 auth_method 0 2024-09-12T00:22:54.260 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:22:53.921+0000 7fde7baa1640 10 monclient: get_auth_request con 0x55da583f16f0 auth_method 0 2024-09-12T00:22:54.260 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:22:53.922+0000 7fde8051f800 10 monclient: build_initial_monmap 2024-09-12T00:22:54.260 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:22:53.922+0000 7fde8051f800 1 build_initial for_mkfs: 0 2024-09-12T00:22:54.260 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:22:53.922+0000 7fde8051f800 10 monclient: monmap: 2024-09-12T00:22:54.260 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:22:54.260 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:22:54.260 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:22:54.260 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:22:54.260 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:22:54.260 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.260 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:22:54.260 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:22:54.260 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:22:54.261 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.261 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding auth protocol: cephx 2024-09-12T00:22:54.261 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding auth protocol: cephx 2024-09-12T00:22:54.261 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding auth protocol: cephx 2024-09-12T00:22:54.261 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: secure 2024-09-12T00:22:54.261 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: crc 2024-09-12T00:22:54.261 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: secure 2024-09-12T00:22:54.261 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: crc 2024-09-12T00:22:54.261 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: secure 2024-09-12T00:22:54.261 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: crc 2024-09-12T00:22:54.261 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: crc 2024-09-12T00:22:54.261 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: secure 2024-09-12T00:22:54.261 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: crc 2024-09-12T00:22:54.262 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: secure 2024-09-12T00:22:54.262 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: crc 2024-09-12T00:22:54.262 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:22:53.922+0000 7fde8051f800 5 AuthRegistry(0x55da583f63c0) adding con mode: secure 2024-09-12T00:22:54.262 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:22:53.922+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.262 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 asok(0x55da58181630) register_command objecter_requests cmddesc objecter_requests hook 0x55da583f9860 EEXIST 2024-09-12T00:22:54.262 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient: init 2024-09-12T00:22:54.262 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding auth protocol: cephx 2024-09-12T00:22:54.262 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding auth protocol: cephx 2024-09-12T00:22:54.262 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding auth protocol: cephx 2024-09-12T00:22:54.262 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: secure 2024-09-12T00:22:54.262 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: crc 2024-09-12T00:22:54.262 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: secure 2024-09-12T00:22:54.262 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: crc 2024-09-12T00:22:54.262 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: secure 2024-09-12T00:22:54.263 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: crc 2024-09-12T00:22:54.263 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: crc 2024-09-12T00:22:54.263 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: secure 2024-09-12T00:22:54.263 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: crc 2024-09-12T00:22:54.263 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: secure 2024-09-12T00:22:54.263 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: crc 2024-09-12T00:22:54.263 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 AuthRegistry(0x55da583f4a98) adding con mode: secure 2024-09-12T00:22:54.263 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:22:53.923+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.263 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:22:53.923+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.263 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:22:53.923+0000 7fde8051f800 5 asok(0x55da58181630) register_command rotate-key cmddesc rotate-key hook 0x55da583f4be0 EEXIST 2024-09-12T00:22:54.263 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:54.263 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:22:54.263 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-a con 0x55da5841db80 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:54.264 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-c con 0x55da5841df60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:54.264 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-b con 0x55da5841c890 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:54.264 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.264 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.264 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.264 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:54.264 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:22:53.923+0000 7fde8051f800 10 monclient(hunting): authenticate will time out at 2051.179679s 2024-09-12T00:22:54.264 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request con 0x55da5841db80 auth_method 0 2024-09-12T00:22:54.264 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.264 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.264 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.264 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:22:53.923+0000 7fde7baa1640 10 monclient(hunting): get_auth_request con 0x55da5841df60 auth_method 0 2024-09-12T00:22:54.264 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:22:53.923+0000 7fde7baa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.264 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:22:53.923+0000 7fde7baa1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.265 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:22:53.923+0000 7fde7baa1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.265 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.265 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.265 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.265 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:22:53.923+0000 7fde7caa3640 10 monclient(hunting): get_auth_request con 0x55da5841c890 auth_method 0 2024-09-12T00:22:54.265 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:22:53.923+0000 7fde7caa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.265 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:22:53.923+0000 7fde7caa3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.265 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:22:53.923+0000 7fde7caa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.265 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:22:53.923+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.265 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:22:53.923+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.265 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:22:53.923+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.265 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:22:53.923+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.265 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:22:53.923+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.265 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:22:53.923+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.266 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:22:53.923+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_done global_id 8145 payload 824 2024-09-12T00:22:54.266 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:22:53.924+0000 7fde7c2a2640 10 monclient: _finish_hunting 0 2024-09-12T00:22:54.266 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:22:53.924+0000 7fde7c2a2640 1 monclient: found mon.noname-a 2024-09-12T00:22:54.266 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:22:53.924+0000 7fde7c2a2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.266 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.266 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:22:54.266 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: dump: 2024-09-12T00:22:54.266 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.266 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.266 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.266 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.266 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.266 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.266 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.267 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.267 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.267 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.267 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: _finish_auth 0 2024-09-12T00:22:54.267 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:22:54.267 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:54.267 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.267 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:22:54.267 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:22:53.924+0000 7fdd61ffb640 10 monclient: dump: 2024-09-12T00:22:54.267 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.267 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.267 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.267 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.268 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.268 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.268 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.268 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.268 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.268 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.268 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:22:53.924+0000 7fde8051f800 5 monclient: authenticate success, global_id 8145 2024-09-12T00:22:54.268 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:22:53.924+0000 7fde8051f800 10 monclient: _renew_subs 2024-09-12T00:22:54.268 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:22:53.924+0000 7fde8051f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.268 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:22:53.924+0000 7fde7d2a4640 4 set_mon_vals no callback set 2024-09-12T00:22:54.268 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:22:53.924+0000 7fde8051f800 10 monclient: _renew_subs 2024-09-12T00:22:54.268 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:22:53.924+0000 7fde8051f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.268 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:22:53.926+0000 7fdd61ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:22:54.269 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:22:53.926+0000 7fdd61ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:54.269 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:22:53.926+0000 7fdd61ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:54.269 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:22:53.926+0000 7fde7baa1640 10 monclient: get_auth_request con 0x7fdd54076380 auth_method 0 2024-09-12T00:22:54.269 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:22:53.926+0000 7fde8051f800 10 monclient: get_monmap_and_config 2024-09-12T00:22:54.269 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:22:53.926+0000 7fde8051f800 10 monclient: build_initial_monmap 2024-09-12T00:22:54.269 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:22:53.926+0000 7fde8051f800 1 build_initial for_mkfs: 0 2024-09-12T00:22:54.269 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:22:53.926+0000 7fde8051f800 10 monclient: monmap: 2024-09-12T00:22:54.269 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:22:54.269 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:22:54.269 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:22:54.269 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:22:54.269 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:22:54.269 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.269 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:22:54.269 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:22:54.270 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:22:54.270 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.270 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding auth protocol: cephx 2024-09-12T00:22:54.270 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding auth protocol: cephx 2024-09-12T00:22:54.270 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding auth protocol: cephx 2024-09-12T00:22:54.270 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: secure 2024-09-12T00:22:54.270 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: crc 2024-09-12T00:22:54.270 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: secure 2024-09-12T00:22:54.270 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: crc 2024-09-12T00:22:54.270 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: secure 2024-09-12T00:22:54.270 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: crc 2024-09-12T00:22:54.270 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: crc 2024-09-12T00:22:54.270 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: secure 2024-09-12T00:22:54.271 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: crc 2024-09-12T00:22:54.271 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: secure 2024-09-12T00:22:54.271 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: crc 2024-09-12T00:22:54.271 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x55da5843d590) adding con mode: secure 2024-09-12T00:22:54.271 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:22:53.926+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.271 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:22:53.926+0000 7fde8051f800 10 monclient: init 2024-09-12T00:22:54.271 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding auth protocol: cephx 2024-09-12T00:22:54.271 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding auth protocol: cephx 2024-09-12T00:22:54.271 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding auth protocol: cephx 2024-09-12T00:22:54.271 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: secure 2024-09-12T00:22:54.271 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: crc 2024-09-12T00:22:54.271 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: secure 2024-09-12T00:22:54.271 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: crc 2024-09-12T00:22:54.271 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: secure 2024-09-12T00:22:54.271 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: crc 2024-09-12T00:22:54.272 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: crc 2024-09-12T00:22:54.272 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: secure 2024-09-12T00:22:54.272 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: crc 2024-09-12T00:22:54.272 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: secure 2024-09-12T00:22:54.272 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: crc 2024-09-12T00:22:54.272 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:22:53.926+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d8b90) adding con mode: secure 2024-09-12T00:22:54.272 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:22:53.927+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.272 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:22:53.927+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.272 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:22:53.927+0000 7fde8051f800 5 asok(0x55da58181630) register_command rotate-key cmddesc rotate-key hook 0x7ffdea3d8cd8 EEXIST 2024-09-12T00:22:54.272 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:54.272 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:22:54.272 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-c con 0x55da58441700 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:54.272 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-b con 0x55da5846c170 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:54.273 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-a con 0x55da5846d520 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:54.273 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.273 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.273 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.273 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:54.273 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient(hunting): authenticate will time out at 2051.183330s 2024-09-12T00:22:54.273 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request con 0x55da58441700 auth_method 0 2024-09-12T00:22:54.273 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.273 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.273 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.273 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:22:53.927+0000 7fde7caa3640 10 monclient(hunting): get_auth_request con 0x55da5846d520 auth_method 0 2024-09-12T00:22:54.273 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:22:53.927+0000 7fde7caa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.273 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:22:53.927+0000 7fde7caa3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.273 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:22:53.927+0000 7fde7caa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.274 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.274 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.274 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.274 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:22:53.927+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.274 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:22:53.927+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.274 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:22:53.927+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.274 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:22:53.927+0000 7fde7baa1640 10 monclient(hunting): get_auth_request con 0x55da5846c170 auth_method 0 2024-09-12T00:22:54.274 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:22:53.927+0000 7fde7baa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.274 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:22:53.927+0000 7fde7baa1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.274 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:22:53.927+0000 7fde7baa1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.274 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_done global_id 7592 payload 274 2024-09-12T00:22:54.274 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient: _finish_hunting 0 2024-09-12T00:22:54.274 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 1 monclient: found mon.noname-c 2024-09-12T00:22:54.275 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:22:53.927+0000 7fde7c2a2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:22:54.275 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.275 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:22:54.275 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: dump: 2024-09-12T00:22:54.275 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.275 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.275 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.275 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.275 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.275 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.275 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.275 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.275 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.275 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.275 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: _finish_auth 0 2024-09-12T00:22:54.276 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: _check_auth_tickets 2024-09-12T00:22:54.276 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:54.276 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.276 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:22:54.276 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:22:53.927+0000 7fdd537fe640 10 monclient: dump: 2024-09-12T00:22:54.276 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.276 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.276 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.276 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.276 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.276 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.276 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.276 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.277 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.277 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.277 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:22:53.927+0000 7fde8051f800 5 monclient: authenticate success, global_id 7592 2024-09-12T00:22:54.277 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:22:53.927+0000 7fde8051f800 10 monclient: get_monmap_and_config success 2024-09-12T00:22:54.277 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:22:53.927+0000 7fde8051f800 4 set_mon_vals no callback set 2024-09-12T00:22:54.277 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:22:53.928+0000 7fde8051f800 10 monclient: shutdown 2024-09-12T00:22:54.277 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:22:53.928+0000 7fde8051f800 10 monclient: build_initial_monmap 2024-09-12T00:22:54.277 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:22:53.928+0000 7fde8051f800 1 build_initial for_mkfs: 0 2024-09-12T00:22:54.277 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:22:53.928+0000 7fde8051f800 10 monclient: monmap: 2024-09-12T00:22:54.277 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:22:54.277 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:22:54.277 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:22:54.277 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:22:54.277 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:22:54.278 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.278 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:22:54.278 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:22:54.278 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:22:54.278 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.278 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding auth protocol: cephx 2024-09-12T00:22:54.278 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding auth protocol: cephx 2024-09-12T00:22:54.278 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding auth protocol: cephx 2024-09-12T00:22:54.278 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: secure 2024-09-12T00:22:54.278 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: crc 2024-09-12T00:22:54.278 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: secure 2024-09-12T00:22:54.278 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: crc 2024-09-12T00:22:54.278 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: secure 2024-09-12T00:22:54.279 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: crc 2024-09-12T00:22:54.279 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: crc 2024-09-12T00:22:54.279 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: secure 2024-09-12T00:22:54.279 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: crc 2024-09-12T00:22:54.279 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: secure 2024-09-12T00:22:54.279 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: crc 2024-09-12T00:22:54.279 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 AuthRegistry(0x55da584422e0) adding con mode: secure 2024-09-12T00:22:54.279 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:22:53.928+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.279 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:22:53.928+0000 7fde8051f800 1 librados: starting msgr at 2024-09-12T00:22:54.279 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:22:53.928+0000 7fde8051f800 1 librados: starting objecter 2024-09-12T00:22:54.279 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:22:53.928+0000 7fde8051f800 5 asok(0x55da58181630) register_command objecter_requests cmddesc objecter_requests hook 0x55da584437f0 EEXIST 2024-09-12T00:22:54.279 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:22:53.929+0000 7fde8051f800 1 librados: setting wanted keys 2024-09-12T00:22:54.279 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:22:53.929+0000 7fde8051f800 1 librados: calling monclient init 2024-09-12T00:22:54.280 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient: init 2024-09-12T00:22:54.280 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding auth protocol: cephx 2024-09-12T00:22:54.280 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding auth protocol: cephx 2024-09-12T00:22:54.280 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding auth protocol: cephx 2024-09-12T00:22:54.280 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: secure 2024-09-12T00:22:54.280 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: crc 2024-09-12T00:22:54.280 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: secure 2024-09-12T00:22:54.280 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: crc 2024-09-12T00:22:54.280 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: secure 2024-09-12T00:22:54.280 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: crc 2024-09-12T00:22:54.280 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: crc 2024-09-12T00:22:54.280 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: secure 2024-09-12T00:22:54.280 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: crc 2024-09-12T00:22:54.281 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: secure 2024-09-12T00:22:54.281 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: crc 2024-09-12T00:22:54.281 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 AuthRegistry(0x55da58432440) adding con mode: secure 2024-09-12T00:22:54.281 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:22:53.929+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.281 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:22:53.929+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.281 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:22:53.929+0000 7fde8051f800 5 asok(0x55da58181630) register_command rotate-key cmddesc rotate-key hook 0x55da58432588 EEXIST 2024-09-12T00:22:54.281 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient: _reopen_session rank -1 2024-09-12T00:22:54.281 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:22:54.281 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-b con 0x55da58441700 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:22:54.281 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-c con 0x55da5846d520 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:22:54.281 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): picked mon.noname-a con 0x55da58469d70 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:22:54.281 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.281 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.281 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:22:54.282 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): _renew_subs 2024-09-12T00:22:54.282 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:22:53.929+0000 7fde8051f800 10 monclient(hunting): authenticate will time out at 2051.185554s 2024-09-12T00:22:54.282 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): get_auth_request con 0x55da58469d70 auth_method 0 2024-09-12T00:22:54.282 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.282 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.282 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.282 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:22:53.929+0000 7fde7baa1640 10 monclient(hunting): get_auth_request con 0x55da5846d520 auth_method 0 2024-09-12T00:22:54.282 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:22:53.929+0000 7fde7baa1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.282 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:22:53.929+0000 7fde7baa1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.282 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:22:53.929+0000 7fde7baa1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.282 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:22:53.929+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request con 0x55da58441700 auth_method 0 2024-09-12T00:22:54.282 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:22:53.929+0000 7fde7c2a2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:22:54.282 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:22:53.929+0000 7fde7c2a2640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:22:54.282 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:22:53.929+0000 7fde7c2a2640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:22:54.283 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.283 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.283 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.283 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:22:53.929+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.283 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:22:53.929+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.283 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:22:53.929+0000 7fde7baa1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.283 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:22:53.929+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:22:54.283 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:22:53.929+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:22:54.283 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:22:53.929+0000 7fde7c2a2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:22:54.283 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient(hunting): handle_auth_done global_id 8151 payload 824 2024-09-12T00:22:54.283 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient: _finish_hunting 0 2024-09-12T00:22:54.283 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:22:53.929+0000 7fde7caa3640 1 monclient: found mon.noname-a 2024-09-12T00:22:54.283 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:22:53.929+0000 7fde7caa3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.284 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.284 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:22:54.284 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: dump: 2024-09-12T00:22:54.284 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.284 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.284 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.284 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.284 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.284 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.284 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.284 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.284 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.284 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.284 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: _finish_auth 0 2024-09-12T00:22:54.285 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:22:54.285 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:22:54.285 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:22:54.285 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:22:54.285 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:22:53.930+0000 7fdd51ffb640 10 monclient: dump: 2024-09-12T00:22:54.285 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:22:54.285 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:22:54.285 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.285 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:22:54.285 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:22:54.285 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:22:54.285 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:22:54.285 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:22:54.286 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:22:54.286 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.286 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:22:53.930+0000 7fde8051f800 5 monclient: authenticate success, global_id 8151 2024-09-12T00:22:54.286 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:22:53.930+0000 7fdd537fe640 4 set_mon_vals no callback set 2024-09-12T00:22:54.286 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:22:53.930+0000 7fde8051f800 10 monclient: _renew_subs 2024-09-12T00:22:54.286 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:22:53.930+0000 7fde8051f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.286 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:22:53.930+0000 7fde8051f800 10 monclient: _renew_subs 2024-09-12T00:22:54.286 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:22:53.930+0000 7fde8051f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.286 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:22:53.930+0000 7fde8051f800 1 librados: init done 2024-09-12T00:22:54.286 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:22:53.930+0000 7fde8051f800 5 asok(0x55da58181630) register_command cr dump hook 0x55da58468ff8 2024-09-12T00:22:54.286 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:22:53.931+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.286 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:22:53.932+0000 7fdd51ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:22:54.286 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:22:53.932+0000 7fdd51ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:54.286 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:22:53.932+0000 7fdd51ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:22:54.287 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:22:53.932+0000 7fde7c2a2640 10 monclient: get_auth_request con 0x7fdd44076470 auth_method 0 2024-09-12T00:22:54.287 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:22:53.933+0000 7fde7baa1640 10 monclient: get_auth_request con 0x55da5848c7e0 auth_method 0 2024-09-12T00:22:54.287 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:22:53.933+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.287 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:22:53.933+0000 7fde8051f800 20 realm 2024-09-12T00:22:54.287 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:22:53.933+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.287 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:22:53.933+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.287 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:22:53.933+0000 7fde8051f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:54.287 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:22:53.934+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.287 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:22:53.934+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.287 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:22:53.934+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.287 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:22:53.934+0000 7fde7c2a2640 10 monclient: get_auth_request con 0x55da584909c0 auth_method 0 2024-09-12T00:22:54.287 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:22:53.934+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:54.287 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:22:53.934+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.288 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:22:53.935+0000 7fde7baa1640 10 monclient: get_auth_request con 0x55da58494220 auth_method 0 2024-09-12T00:22:54.288 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:22:53.936+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:54.288 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:22:53.936+0000 7fde8051f800 20 searching for the correct realm 2024-09-12T00:22:54.288 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:22:53.936+0000 7fde7caa3640 10 monclient: get_auth_request con 0x7fde70036070 auth_method 0 2024-09-12T00:22:54.288 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:22:53.937+0000 7fde7c2a2640 10 monclient: get_auth_request con 0x7fde6c0bec20 auth_method 0 2024-09-12T00:22:54.288 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:22:53.938+0000 7fde7baa1640 10 monclient: get_auth_request con 0x7fde70015070 auth_method 0 2024-09-12T00:22:54.288 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:22:53.939+0000 7fde7baa1640 0 -- 172.21.15.67:0/3801209938 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fde70015070 msgr2=0x7fde70037940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:22:54.288 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:22:54.140+0000 7fde7baa1640 10 monclient: get_auth_request con 0x7fde70015070 auth_method 0 2024-09-12T00:22:54.288 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:22:54.142+0000 7fde7caa3640 10 monclient: get_auth_request con 0x7fde6c0b7070 auth_method 0 2024-09-12T00:22:54.288 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:22:54.143+0000 7fde7c2a2640 10 monclient: get_auth_request con 0x7fde7406c0b0 auth_method 0 2024-09-12T00:22:54.288 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:22:54.144+0000 7fde7baa1640 0 -- 172.21.15.67:0/3801209938 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55da5848c7e0 msgr2=0x55da5848ec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:54.288 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:22:54.144+0000 7fdd51ffb640 1 client.8151.objecter ms_handle_reset 0x55da5848c7e0 session 0x55da5848c0d0 osd.6 2024-09-12T00:22:54.288 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:22:54.144+0000 7fdd51ffb640 10 monclient: _renew_subs 2024-09-12T00:22:54.288 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:22:54.144+0000 7fdd51ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:22:54.289 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:22:54.144+0000 7fde7baa1640 10 monclient: get_auth_request con 0x7fdd44086790 auth_method 0 2024-09-12T00:22:54.289 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:54.289 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:54.289 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:54.289 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:54.289 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:54.289 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:22:54.148+0000 7fde8051f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:54.289 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:22:54.148+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.289 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.289 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.289 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:54.289 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.289 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:54.289 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 zone default found 2024-09-12T00:22:54.290 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:22:54.149+0000 7fde8051f800 4 Realm: () 2024-09-12T00:22:54.290 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:22:54.149+0000 7fde8051f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:54.290 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:22:54.149+0000 7fde8051f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:54.290 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:22:54.149+0000 7fde8051f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:54.290 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 zonegroup default 2024-09-12T00:22:54.290 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:22:54.149+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.290 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:22:54.150+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.290 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:22:54.150+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.290 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:22:54.150+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.290 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:22:54.150+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.290 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:22:54.150+0000 7fde8051f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.290 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:22:54.150+0000 7fde8051f800 20 started sync module instance, tier type = 2024-09-12T00:22:54.290 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:22:54.150+0000 7fde8051f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:54.291 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=0 2024-09-12T00:22:54.291 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=1 2024-09-12T00:22:54.291 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=2 2024-09-12T00:22:54.291 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=3 2024-09-12T00:22:54.291 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=4 2024-09-12T00:22:54.291 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=5 2024-09-12T00:22:54.291 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:22:54.159+0000 7fde8051f800 20 add_watcher() i=6 2024-09-12T00:22:54.291 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:22:54.160+0000 7fde8051f800 20 add_watcher() i=7 2024-09-12T00:22:54.291 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:22:54.160+0000 7fde8051f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:54.291 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding auth protocol: cephx 2024-09-12T00:22:54.291 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding auth protocol: cephx 2024-09-12T00:22:54.291 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding auth protocol: cephx 2024-09-12T00:22:54.291 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: secure 2024-09-12T00:22:54.291 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: crc 2024-09-12T00:22:54.292 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: secure 2024-09-12T00:22:54.292 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: crc 2024-09-12T00:22:54.292 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: secure 2024-09-12T00:22:54.292 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: crc 2024-09-12T00:22:54.292 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: crc 2024-09-12T00:22:54.292 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: secure 2024-09-12T00:22:54.292 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: crc 2024-09-12T00:22:54.292 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: secure 2024-09-12T00:22:54.292 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: crc 2024-09-12T00:22:54.292 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 AuthRegistry(0x7ffdea3d9070) adding con mode: secure 2024-09-12T00:22:54.292 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:22:54.162+0000 7fdd32fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:54.292 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:22:54.162+0000 7fde8051f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:22:54.292 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:22:54.162+0000 7fde8051f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:54.292 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:22:54.162+0000 7fde8051f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:54.293 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 asok(0x55da58181630) register_command cache list hook 0x55da58475210 2024-09-12T00:22:54.293 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 asok(0x55da58181630) register_command cache inspect hook 0x55da58475210 2024-09-12T00:22:54.293 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 asok(0x55da58181630) register_command cache erase hook 0x55da58475210 2024-09-12T00:22:54.293 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 asok(0x55da58181630) register_command cache zap hook 0x55da58475210 2024-09-12T00:22:54.293 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:22:54.162+0000 7fde8051f800 5 note: GC not initialized 2024-09-12T00:22:54.293 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:22:54.162+0000 7fdd31fdb640 20 reqs_thread_entry: start 2024-09-12T00:22:54.293 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:22:54.163+0000 7fde8051f800 5 asok(0x55da58181630) register_command sync trace show hook 0x7fde6c0ba020 2024-09-12T00:22:54.293 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:22:54.163+0000 7fde8051f800 5 asok(0x55da58181630) register_command sync trace history hook 0x7fde6c0ba020 2024-09-12T00:22:54.293 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:22:54.163+0000 7fde8051f800 5 asok(0x55da58181630) register_command sync trace active hook 0x7fde6c0ba020 2024-09-12T00:22:54.293 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:22:54.163+0000 7fde8051f800 5 asok(0x55da58181630) register_command sync trace active_short hook 0x7fde6c0ba020 2024-09-12T00:22:54.293 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:22:54.163+0000 7fde8051f800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:54.293 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:22:54.163+0000 7fde8051f800 20 Filter name: none 2024-09-12T00:22:54.293 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:22:54.163+0000 7fdca37fe640 20 reqs_thread_entry: start 2024-09-12T00:22:54.293 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:22:54.163+0000 7fde8051f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:22:54.294 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:22:54.163+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.294 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:22:54.163+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:22:54.294 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:22:54.163+0000 7fde8051f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:22:54.294 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:22:54.163+0000 7fde8051f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:22:54.294 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:22:54.163+0000 7fde8051f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:22:54.294 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:22:54.163+0000 7fde8051f800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.294 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:22:54.164+0000 7fde8051f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:22:54.294 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:22:54.164+0000 7fde8051f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:22:54.294 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:22:54.164+0000 7fde8051f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:22:54.294 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:22:54.164+0000 7fde8051f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:22:54.294 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:22:54.164+0000 7fde8051f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:22:54.294 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:22:54.164+0000 7fde8051f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:22:54.294 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:22:54.167+0000 7fde8051f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:22:54.294 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:22:54.168+0000 7fde8051f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:22:54.295 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:22:54.168+0000 7fde8051f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:22:54.295 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:22:54.168+0000 7fde8051f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:22:54.295 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:22:54.168+0000 7fdd537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562480 cookie 94396272464336 notifier 8151 bl.length()=827 2024-09-12T00:22:54.295 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:22:54.168+0000 7fdd537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:22:54.295 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:22:54.168+0000 7fdd537fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:22:54.295 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:22:54.168+0000 7fdd537fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:22:54.295 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:22:54.168+0000 7fde8051f800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:22:54.295 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:22:54.168+0000 7fde8051f800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:22:54.295 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:22:54.168+0000 7fde8051f800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:22:54.295 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:22:54.168+0000 7fde8051f800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:22:54.295 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.0 2024-09-12T00:22:54.295 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.0 2024-09-12T00:22:54.295 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.1 2024-09-12T00:22:54.295 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.1 2024-09-12T00:22:54.296 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.2 2024-09-12T00:22:54.296 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.2 2024-09-12T00:22:54.296 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.3 2024-09-12T00:22:54.296 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.3 2024-09-12T00:22:54.296 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:22:54.296 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:22:54.296 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:22:54.171+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:22:54.296 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:22:54.171+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:22:54.296 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:22:54.172+0000 7fde8051f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:22:54.296 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:22:54.172+0000 7fde8051f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:22:54.296 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:22:54.174+0000 7fde8051f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde8051f800 time 2024-09-12T00:22:54.174349+0000 2024-09-12T00:22:54.296 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:22:54.296 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.296 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:54.297 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde81d8c71a] 2024-09-12T00:22:54.297 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde81d8c8d8] 2024-09-12T00:22:54.297 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da56ee5641] 2024-09-12T00:22:54.297 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55da56ef451b] 2024-09-12T00:22:54.297 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55da56ef53e4] 2024-09-12T00:22:54.297 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:22:54.297 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fde80a29590] 2024-09-12T00:22:54.297 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:22:54.297 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:22:54.297 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.297 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:22:54.175+0000 7fde8051f800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:22:54.297 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fde8051f800 thread_name:radosgw-admin 2024-09-12T00:22:54.297 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.298 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:22:54.298 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde80a3e6f0] 2024-09-12T00:22:54.298 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde80a8b99c] 2024-09-12T00:22:54.298 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:22:54.298 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:22:54.298 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde81d8c774] 2024-09-12T00:22:54.298 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde81d8c8d8] 2024-09-12T00:22:54.298 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55da56ee5641] 2024-09-12T00:22:54.298 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55da56ef451b] 2024-09-12T00:22:54.298 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55da56ef53e4] 2024-09-12T00:22:54.298 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:22:54.298 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fde80a29590] 2024-09-12T00:22:54.298 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:22:54.298 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:22:54.299 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:22:54.299 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:22:54.299 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:22:54.299 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:22:54.299 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:22:54.299 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:22:54.299 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:22:54.299 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:22:54.299 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:22:54.299 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:22:54.299 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:22:54.299 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:22:54.299 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:22:54.299 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:22:54.299 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:22:54.300 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:22:54.300 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:22:54.300 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:22:54.300 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:22:54.300 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:22:54.300 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:22:54.300 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:22:54.300 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:22:54.300 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:22:54.300 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:22:54.300 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:22:54.300 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:22:54.300 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:22:54.301 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:22:54.301 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:22:54.301 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:22:54.301 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:22:54.301 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:22:54.301 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:22:54.301 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:22:54.301 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:22:54.301 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:22:54.301 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:22:54.301 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:22:54.301 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:22:54.301 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:22:54.301 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:22:54.301 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:22:54.302 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:22:54.302 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:22:54.302 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:22:54.302 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:22:54.302 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:22:54.302 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:22:54.302 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:22:54.302 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:22:54.302 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:22:54.302 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:22:54.302 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:22:54.302 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:22:54.302 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:22:54.302 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:22:54.303 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:22:54.303 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:22:54.303 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:22:54.303 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:22:54.303 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:22:54.303 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:22:54.303 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:22:54.303 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:22:54.303 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:22:54.303 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:22:54.303 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:22:54.303 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:22:54.303 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:22:54.303 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:22:54.303 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:22:54.304 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:22:54.304 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:22:54.304 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:22:54.304 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:22:54.304 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:22:54.304 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:22:54.304 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:22:54.304 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:22:54.304 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:22:54.304 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:22:54.304 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:22:54.304 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:22:54.304 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:22:54.304 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:22:54.305 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:22:54.305 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:22:54.305 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:22:54.305 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:22:54.305 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:22:54.305 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:22:54.305 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:22:54.305 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:22:54.305 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:22:54.305 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:22:54.305 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdca37fe640 / http_manager 2024-09-12T00:22:54.305 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdd31fdb640 / http_manager 2024-09-12T00:22:54.305 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdd32fdd640 / rgw_dt_lg_renew 2024-09-12T00:22:54.305 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdd51ffb640 / ms_dispatch 2024-09-12T00:22:54.306 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdd537fe640 / io_context_pool 2024-09-12T00:22:54.306 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdd61ffb640 / ms_dispatch 2024-09-12T00:22:54.306 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdd68e09640 / ms_dispatch 2024-09-12T00:22:54.306 INFO:tasks.workunit.client.0.smithi067.stderr: 7fdd6a60c640 / io_context_pool 2024-09-12T00:22:54.306 INFO:tasks.workunit.client.0.smithi067.stderr: 7fde7baa1640 / msgr-worker-2 2024-09-12T00:22:54.306 INFO:tasks.workunit.client.0.smithi067.stderr: 7fde7c2a2640 / msgr-worker-1 2024-09-12T00:22:54.306 INFO:tasks.workunit.client.0.smithi067.stderr: 7fde7caa3640 / msgr-worker-0 2024-09-12T00:22:54.306 INFO:tasks.workunit.client.0.smithi067.stderr: 7fde7d2a4640 / io_context_pool 2024-09-12T00:22:54.306 INFO:tasks.workunit.client.0.smithi067.stderr: 7fde8051f800 / radosgw-admin 2024-09-12T00:22:54.306 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:22:54.306 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:22:54.306 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:22:54.175995Z_984e0e32-d9df-47b6-a5e7-5f5b9791c88e/log 2024-09-12T00:22:54.306 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:22:54.306 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:22:54.307 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:54.307 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:54.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.440+0000 7f0a63a5a640 0 --2- 172.21.15.67:0/3742562970 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55d38ef22cd0 0x55d38ef26140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:22:54.454 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.456+0000 7f0a67c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.458+0000 7f0a67c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.456 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.458+0000 7f0a67c0e800 20 realm 2024-09-12T00:22:54.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.458+0000 7f0a67c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.458+0000 7f0a67c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.458+0000 7f0a67c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:54.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.458+0000 7f0a67c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.458+0000 7f0a67c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.458+0000 7f0a67c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.457 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.459+0000 7f0a67c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:54.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.459+0000 7f0a67c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.460+0000 7f0a67c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:54.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.460+0000 7f0a67c0e800 20 searching for the correct realm 2024-09-12T00:22:54.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.462+0000 7f0a63259640 0 -- 172.21.15.67:0/2288465784 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f0a5401a020 msgr2=0x7f0a5408c0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:22:54.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.469+0000 7f0a63259640 0 -- 172.21.15.67:0/2288465784 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f0a5c083040 msgr2=0x7f0a5c060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:22:54.674 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.676+0000 7f0a67c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:54.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.676+0000 7f0a67c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:54.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.676+0000 7f0a67c0e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:54.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.676+0000 7f0a67c0e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:54.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.676+0000 7f0a67c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:54.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.676+0000 7f0a67c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:54.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.676+0000 7f0a67c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.676+0000 7f0a67c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.676+0000 7f0a67c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.676+0000 7f0a67c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:54.675 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.676+0000 7f0a67c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.677+0000 7f0a67c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:54.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.677+0000 7f0a67c0e800 20 zone default found 2024-09-12T00:22:54.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.677+0000 7f0a67c0e800 4 Realm: () 2024-09-12T00:22:54.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.677+0000 7f0a67c0e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:54.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.677+0000 7f0a67c0e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:54.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.677+0000 7f0a67c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:54.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.677+0000 7f0a67c0e800 20 zonegroup default 2024-09-12T00:22:54.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.677+0000 7f0a67c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.677 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.677+0000 7f0a67c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.677+0000 7f0a67c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.677+0000 7f0a67c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.677+0000 7f0a67c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.678+0000 7f0a67c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.678+0000 7f0a67c0e800 20 started sync module instance, tier type = 2024-09-12T00:22:54.678 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.678+0000 7f0a67c0e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:54.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.691+0000 7f0a67c0e800 20 add_watcher() i=0 2024-09-12T00:22:54.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.691+0000 7f0a67c0e800 20 add_watcher() i=1 2024-09-12T00:22:54.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.691+0000 7f0a67c0e800 20 add_watcher() i=2 2024-09-12T00:22:54.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.691+0000 7f0a67c0e800 20 add_watcher() i=3 2024-09-12T00:22:54.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.691+0000 7f0a67c0e800 20 add_watcher() i=4 2024-09-12T00:22:54.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.691+0000 7f0a67c0e800 20 add_watcher() i=5 2024-09-12T00:22:54.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.691+0000 7f0a67c0e800 20 add_watcher() i=6 2024-09-12T00:22:54.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.693+0000 7f0a67c0e800 20 add_watcher() i=7 2024-09-12T00:22:54.691 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.693+0000 7f0a67c0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:54.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.694+0000 7f0919fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:54.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.695+0000 7f0a67c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:54.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.695+0000 7f0a67c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:54.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.695+0000 7f0a67c0e800 5 note: GC not initialized 2024-09-12T00:22:54.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.695+0000 7f0918fe1640 20 reqs_thread_entry: start 2024-09-12T00:22:54.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.695+0000 7f0a67c0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:54.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.695+0000 7f0a67c0e800 20 Filter name: none 2024-09-12T00:22:54.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.695+0000 7f08927fc640 20 reqs_thread_entry: start 2024-09-12T00:22:54.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.695+0000 7f0a67c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.696+0000 7f0a67c0e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:22:54.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.696+0000 7f0a67c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.696+0000 7f0a67c0e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:22:54.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.696+0000 7f0a67c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:54.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.696+0000 7f0a67c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.697+0000 7f0a67c0e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:22:54.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.697+0000 7f0a67c0e800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.697+0000 7f0a67c0e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:22:54.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.697+0000 7f0a67c0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:22:54.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.698+0000 7f0919fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:54.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.701+0000 7f0a67c0e800 20 remove_watcher() i=0 2024-09-12T00:22:54.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.701+0000 7f0a67c0e800 2 removed watcher, disabling cache 2024-09-12T00:22:54.700 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.702+0000 7f0a67c0e800 20 remove_watcher() i=1 2024-09-12T00:22:54.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.703+0000 7f0a67c0e800 20 remove_watcher() i=2 2024-09-12T00:22:54.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.705+0000 7f0a67c0e800 20 remove_watcher() i=3 2024-09-12T00:22:54.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.706+0000 7f0a67c0e800 20 remove_watcher() i=4 2024-09-12T00:22:54.705 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.707+0000 7f0a67c0e800 20 remove_watcher() i=5 2024-09-12T00:22:54.706 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.708+0000 7f0a67c0e800 20 remove_watcher() i=6 2024-09-12T00:22:54.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.709+0000 7f0a67c0e800 20 remove_watcher() i=7 2024-09-12T00:22:54.732 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:22:54.761 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:54.761 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:54.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.803+0000 7fd170f23800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.805+0000 7fd170f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.805+0000 7fd170f23800 20 realm 2024-09-12T00:22:54.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.805+0000 7fd170f23800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.805+0000 7fd170f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.805+0000 7fd170f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:22:54.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.805+0000 7fd170f23800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.805+0000 7fd170f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:54.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.805+0000 7fd170f23800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.806+0000 7fd170f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:54.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.806+0000 7fd170f23800 20 rados->read ofs=0 len=0 2024-09-12T00:22:54.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.807+0000 7fd170f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:22:54.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.807+0000 7fd170f23800 20 searching for the correct realm 2024-09-12T00:22:54.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:54.809+0000 7fd16cc13640 0 -- 172.21.15.67:0/2501072541 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7fd15c01d040 msgr2=0x7fd15c0a3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:55.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.015+0000 7fd16cc13640 0 -- 172.21.15.67:0/2501072541 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x565543a51f60 msgr2=0x7fd1640a6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:22:55.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.222+0000 7fd170f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:22:55.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.222+0000 7fd170f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:22:55.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.222+0000 7fd170f23800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:22:55.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.222+0000 7fd170f23800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:22:55.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.222+0000 7fd170f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:22:55.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.222+0000 7fd170f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:22:55.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.222+0000 7fd170f23800 20 rados->read ofs=0 len=0 2024-09-12T00:22:55.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.222+0000 7fd170f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:55.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.222+0000 7fd170f23800 20 rados->read ofs=0 len=0 2024-09-12T00:22:55.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.222+0000 7fd170f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:22:55.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.222+0000 7fd170f23800 20 rados->read ofs=0 len=0 2024-09-12T00:22:55.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.223+0000 7fd170f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:22:55.222 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.223+0000 7fd170f23800 20 zone default found 2024-09-12T00:22:55.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.223+0000 7fd170f23800 4 Realm: () 2024-09-12T00:22:55.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.223+0000 7fd170f23800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:22:55.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.223+0000 7fd170f23800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:22:55.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.223+0000 7fd170f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:22:55.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.223+0000 7fd170f23800 20 zonegroup default 2024-09-12T00:22:55.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.223+0000 7fd170f23800 20 rados->read ofs=0 len=0 2024-09-12T00:22:55.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.223+0000 7fd170f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:55.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.223+0000 7fd170f23800 20 rados->read ofs=0 len=0 2024-09-12T00:22:55.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.223+0000 7fd170f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:55.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.223+0000 7fd170f23800 20 rados->read ofs=0 len=0 2024-09-12T00:22:55.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.224+0000 7fd170f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:22:55.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.224+0000 7fd170f23800 20 started sync module instance, tier type = 2024-09-12T00:22:55.223 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.224+0000 7fd170f23800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:22:55.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.234+0000 7fd170f23800 20 add_watcher() i=0 2024-09-12T00:22:55.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.234+0000 7fd170f23800 20 add_watcher() i=1 2024-09-12T00:22:55.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.234+0000 7fd170f23800 20 add_watcher() i=2 2024-09-12T00:22:55.232 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.234+0000 7fd170f23800 20 add_watcher() i=3 2024-09-12T00:22:55.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.234+0000 7fd170f23800 20 add_watcher() i=4 2024-09-12T00:22:55.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.234+0000 7fd170f23800 20 add_watcher() i=5 2024-09-12T00:22:55.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.234+0000 7fd170f23800 20 add_watcher() i=6 2024-09-12T00:22:55.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.235+0000 7fd170f23800 20 add_watcher() i=7 2024-09-12T00:22:55.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.235+0000 7fd170f23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:22:55.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.237+0000 7fd0237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:55.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.237+0000 7fd170f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:22:55.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.237+0000 7fd170f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:22:55.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.237+0000 7fd170f23800 5 note: GC not initialized 2024-09-12T00:22:55.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.238+0000 7fd0227e4640 20 reqs_thread_entry: start 2024-09-12T00:22:55.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.238+0000 7fd170f23800 20 init_complete bucket index max shards: 1 2024-09-12T00:22:55.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.238+0000 7fd170f23800 20 Filter name: none 2024-09-12T00:22:55.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.238+0000 7fd01bfff640 20 reqs_thread_entry: start 2024-09-12T00:22:55.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.238+0000 7fd170f23800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:22:55.237 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.238+0000 7fd170f23800 20 rados->read ofs=0 len=0 2024-09-12T00:22:55.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.238+0000 7fd170f23800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:22:55.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.238+0000 7fd170f23800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:22:55.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.238+0000 7fd170f23800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:22:55.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.238+0000 7fd170f23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:22:55.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.238+0000 7fd170f23800 20 rados->read ofs=0 len=0 2024-09-12T00:22:55.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.239+0000 7fd170f23800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:22:55.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.239+0000 7fd170f23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:22:55.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.239+0000 7fd170f23800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:22:55.238 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.239+0000 7fd170f23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:22:55.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.239+0000 7fd170f23800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:22:55.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.239+0000 7fd170f23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:22:55.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.239+0000 7fd170f23800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:22:55.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.239+0000 7fd170f23800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:22:55.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.239+0000 7fd170f23800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:22:55.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.239+0000 7fd170f23800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:22:55.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.240+0000 7fd170f23800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:22:55.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.240+0000 7fd170f23800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:22:55.239 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.241+0000 7fd0237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:22:55.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.243+0000 7fd170f23800 20 remove_watcher() i=0 2024-09-12T00:22:55.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.243+0000 7fd170f23800 2 removed watcher, disabling cache 2024-09-12T00:22:55.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.244+0000 7fd170f23800 20 remove_watcher() i=1 2024-09-12T00:22:55.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.245+0000 7fd170f23800 20 remove_watcher() i=2 2024-09-12T00:22:55.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.246+0000 7fd170f23800 20 remove_watcher() i=3 2024-09-12T00:22:55.245 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.247+0000 7fd170f23800 20 remove_watcher() i=4 2024-09-12T00:22:55.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.248+0000 7fd170f23800 20 remove_watcher() i=5 2024-09-12T00:22:55.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.249+0000 7fd170f23800 20 remove_watcher() i=6 2024-09-12T00:22:55.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:22:55.250+0000 7fd170f23800 20 remove_watcher() i=7 2024-09-12T00:23:25.271 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:23:25.304 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:25.304 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:25.350 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.351+0000 7f2a83725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.354+0000 7f2a83725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.352 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.354+0000 7f2a83725800 20 realm 2024-09-12T00:23:25.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.354+0000 7f2a83725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.354+0000 7f2a83725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.354+0000 7f2a83725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:25.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.354+0000 7f2a83725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.354+0000 7f2a83725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.354+0000 7f2a83725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.355+0000 7f2a83725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:25.353 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.355+0000 7f2a83725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.356+0000 7f2a83725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:25.354 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.356+0000 7f2a83725800 20 searching for the correct realm 2024-09-12T00:23:25.358 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.360+0000 7f2a7ebb4640 0 -- 172.21.15.67:0/2049223972 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f2a7406b2f0 msgr2=0x7f2a7409a520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:25.362 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.364+0000 7f2a7f3b5640 0 -- 172.21.15.67:0/2049223972 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f2a780a90a0 msgr2=0x7f2a780a7b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:25.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.368+0000 7f2a83725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:25.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.368+0000 7f2a83725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:25.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.368+0000 7f2a83725800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:23:25.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.368+0000 7f2a83725800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:23:25.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.368+0000 7f2a83725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:25.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.368+0000 7f2a83725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:25.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.368+0000 7f2a83725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.369+0000 7f2a83725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.367 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.369+0000 7f2a83725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.369+0000 7f2a83725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:25.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.369+0000 7f2a83725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.369+0000 7f2a83725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:25.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.369+0000 7f2a83725800 20 zone default found 2024-09-12T00:23:25.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.369+0000 7f2a83725800 4 Realm: () 2024-09-12T00:23:25.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.369+0000 7f2a83725800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:23:25.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.369+0000 7f2a83725800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:23:25.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.369+0000 7f2a83725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:25.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.369+0000 7f2a83725800 20 zonegroup default 2024-09-12T00:23:25.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.369+0000 7f2a83725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.369 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.370+0000 7f2a83725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.370+0000 7f2a83725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.370+0000 7f2a83725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.370+0000 7f2a83725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.370+0000 7f2a83725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.370+0000 7f2a83725800 20 started sync module instance, tier type = 2024-09-12T00:23:25.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.370+0000 7f2a83725800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:23:25.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.381+0000 7f2a83725800 20 add_watcher() i=0 2024-09-12T00:23:25.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.381+0000 7f2a83725800 20 add_watcher() i=1 2024-09-12T00:23:25.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.381+0000 7f2a83725800 20 add_watcher() i=2 2024-09-12T00:23:25.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.381+0000 7f2a83725800 20 add_watcher() i=3 2024-09-12T00:23:25.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.381+0000 7f2a83725800 20 add_watcher() i=4 2024-09-12T00:23:25.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.381+0000 7f2a83725800 20 add_watcher() i=5 2024-09-12T00:23:25.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.381+0000 7f2a83725800 20 add_watcher() i=6 2024-09-12T00:23:25.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.382+0000 7f2a83725800 20 add_watcher() i=7 2024-09-12T00:23:25.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.382+0000 7f2a83725800 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:25.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.384+0000 7f2935fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:25.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.384+0000 7f2a83725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:25.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.384+0000 7f2a83725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:25.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.384+0000 7f2a83725800 5 note: GC not initialized 2024-09-12T00:23:25.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.385+0000 7f2934fe1640 20 reqs_thread_entry: start 2024-09-12T00:23:25.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.385+0000 7f2a83725800 20 init_complete bucket index max shards: 1 2024-09-12T00:23:25.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.385+0000 7f2a83725800 20 Filter name: none 2024-09-12T00:23:25.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.385+0000 7f28ae7fc640 20 reqs_thread_entry: start 2024-09-12T00:23:25.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.385+0000 7f2a83725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.385+0000 7f2a83725800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:25.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.385+0000 7f2a83725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.386+0000 7f2a83725800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:23:25.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.386+0000 7f2a83725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:25.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.386+0000 7f2a83725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.386+0000 7f2a83725800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:25.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.386+0000 7f2a83725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.387+0000 7f2a83725800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:23:25.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.387+0000 7f2a83725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:25.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.388+0000 7f2935fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:25.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.390+0000 7f2a83725800 20 remove_watcher() i=0 2024-09-12T00:23:25.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.390+0000 7f2a83725800 2 removed watcher, disabling cache 2024-09-12T00:23:25.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.391+0000 7f2a83725800 20 remove_watcher() i=1 2024-09-12T00:23:25.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.392+0000 7f2a83725800 20 remove_watcher() i=2 2024-09-12T00:23:25.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.393+0000 7f2a83725800 20 remove_watcher() i=3 2024-09-12T00:23:25.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.394+0000 7f2a83725800 20 remove_watcher() i=4 2024-09-12T00:23:25.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.395+0000 7f2a83725800 20 remove_watcher() i=5 2024-09-12T00:23:25.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.397+0000 7f2a83725800 20 remove_watcher() i=6 2024-09-12T00:23:25.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.398+0000 7f2a83725800 20 remove_watcher() i=7 2024-09-12T00:23:25.432 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:23:25.462 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:25.462 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:25.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.503+0000 7f9dc8b75800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.505+0000 7f9dc8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.505+0000 7f9dc8b75800 20 realm 2024-09-12T00:23:25.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.505+0000 7f9dc8b75800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.505+0000 7f9dc8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.505+0000 7f9dc8b75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:25.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.505+0000 7f9dc8b75800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.505+0000 7f9dc8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.505+0000 7f9dc8b75800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.506+0000 7f9dc8b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:25.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.506+0000 7f9dc8b75800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.507+0000 7f9dc8b75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:25.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.507+0000 7f9dc8b75800 20 searching for the correct realm 2024-09-12T00:23:25.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.510+0000 7f9dc5e5e640 0 -- 172.21.15.67:0/1867343466 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f9dbc090470 msgr2=0x7f9dbc008ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:25.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.514+0000 7f9dc6e60640 0 -- 172.21.15.67:0/1867343466 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x556ae70e8520 msgr2=0x556ae70ea940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:25.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.518+0000 7f9dc8b75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:25.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.518+0000 7f9dc8b75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:25.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.518+0000 7f9dc8b75800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:23:25.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.518+0000 7f9dc8b75800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:23:25.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.518+0000 7f9dc8b75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:25.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.518+0000 7f9dc8b75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:25.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.518+0000 7f9dc8b75800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.519+0000 7f9dc8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.519+0000 7f9dc8b75800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.519+0000 7f9dc8b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:25.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.519+0000 7f9dc8b75800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.519+0000 7f9dc8b75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:25.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.519+0000 7f9dc8b75800 20 zone default found 2024-09-12T00:23:25.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.519+0000 7f9dc8b75800 4 Realm: () 2024-09-12T00:23:25.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.519+0000 7f9dc8b75800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:23:25.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.519+0000 7f9dc8b75800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:23:25.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.519+0000 7f9dc8b75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:25.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.519+0000 7f9dc8b75800 20 zonegroup default 2024-09-12T00:23:25.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.519+0000 7f9dc8b75800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.520+0000 7f9dc8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.520+0000 7f9dc8b75800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.520+0000 7f9dc8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.520+0000 7f9dc8b75800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.520+0000 7f9dc8b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.520+0000 7f9dc8b75800 20 started sync module instance, tier type = 2024-09-12T00:23:25.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.520+0000 7f9dc8b75800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:23:25.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.529+0000 7f9dc8b75800 20 add_watcher() i=0 2024-09-12T00:23:25.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.529+0000 7f9dc8b75800 20 add_watcher() i=1 2024-09-12T00:23:25.543 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.529+0000 7f9dc8b75800 20 add_watcher() i=2 2024-09-12T00:23:25.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.529+0000 7f9dc8b75800 20 add_watcher() i=3 2024-09-12T00:23:25.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.529+0000 7f9dc8b75800 20 add_watcher() i=4 2024-09-12T00:23:25.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.529+0000 7f9dc8b75800 20 add_watcher() i=5 2024-09-12T00:23:25.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.529+0000 7f9dc8b75800 20 add_watcher() i=6 2024-09-12T00:23:25.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.530+0000 7f9dc8b75800 20 add_watcher() i=7 2024-09-12T00:23:25.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.530+0000 7f9dc8b75800 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:25.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.532+0000 7f9c7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:25.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.532+0000 7f9dc8b75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:25.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.532+0000 7f9dc8b75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:25.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.532+0000 7f9dc8b75800 5 note: GC not initialized 2024-09-12T00:23:25.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.532+0000 7f9bf77fe640 20 reqs_thread_entry: start 2024-09-12T00:23:25.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.533+0000 7f9dc8b75800 20 init_complete bucket index max shards: 1 2024-09-12T00:23:25.544 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.533+0000 7f9dc8b75800 20 Filter name: none 2024-09-12T00:23:25.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.533+0000 7f9bf57fa640 20 reqs_thread_entry: start 2024-09-12T00:23:25.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.533+0000 7f9dc8b75800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:23:25.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.533+0000 7f9dc8b75800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.533+0000 7f9dc8b75800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:25.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.533+0000 7f9dc8b75800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:23:25.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.533+0000 7f9dc8b75800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:23:25.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.533+0000 7f9dc8b75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:23:25.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.533+0000 7f9dc8b75800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.534+0000 7f9dc8b75800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:23:25.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.534+0000 7f9dc8b75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:25.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.534+0000 7f9dc8b75800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:25.545 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.534+0000 7f9dc8b75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:25.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.534+0000 7f9dc8b75800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:25.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.534+0000 7f9dc8b75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:23:25.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.534+0000 7f9dc8b75800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:23:25.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.534+0000 7f9dc8b75800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:23:25.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.534+0000 7f9dc8b75800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:23:25.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.534+0000 7f9dc8b75800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:23:25.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.534+0000 7f9dc8b75800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:23:25.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.534+0000 7f9dc8b75800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:23:25.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.536+0000 7f9c7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:25.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.538+0000 7f9dc8b75800 20 remove_watcher() i=0 2024-09-12T00:23:25.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.538+0000 7f9dc8b75800 2 removed watcher, disabling cache 2024-09-12T00:23:25.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.539+0000 7f9dc8b75800 20 remove_watcher() i=1 2024-09-12T00:23:25.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.540+0000 7f9dc8b75800 20 remove_watcher() i=2 2024-09-12T00:23:25.547 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.541+0000 7f9dc8b75800 20 remove_watcher() i=3 2024-09-12T00:23:25.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.542+0000 7f9dc8b75800 20 remove_watcher() i=4 2024-09-12T00:23:25.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.542+0000 7f9dc8b75800 20 remove_watcher() i=5 2024-09-12T00:23:25.548 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.543+0000 7f9dc8b75800 20 remove_watcher() i=6 2024-09-12T00:23:25.549 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.544+0000 7f9dc8b75800 20 remove_watcher() i=7 2024-09-12T00:23:25.555 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:23:25.584 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:25.585 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:25.624 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.625+0000 7efeb1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.628+0000 7efeb1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.628+0000 7efeb1e13800 20 realm 2024-09-12T00:23:25.626 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.628+0000 7efeb1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.628+0000 7efeb1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.628+0000 7efeb1e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:25.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.628+0000 7efeb1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.628+0000 7efeb1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.628+0000 7efeb1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.629+0000 7efeb1e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:25.627 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.629+0000 7efeb1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.630+0000 7efeb1e13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:25.628 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.630+0000 7efeb1e13800 20 searching for the correct realm 2024-09-12T00:23:25.631 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.633+0000 7efeacd47640 0 -- 172.21.15.67:0/2809914003 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7efea4044420 msgr2=0x7efea40448a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:25.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.840+0000 7efeacd47640 0 -- 172.21.15.67:0/2809914003 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55c69add50c0 msgr2=0x55c69add7550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:25.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.845+0000 7efeb1e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:25.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.845+0000 7efeb1e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:25.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.845+0000 7efeb1e13800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:23:25.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.845+0000 7efeb1e13800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:23:25.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.845+0000 7efeb1e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:25.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.845+0000 7efeb1e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:25.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.845+0000 7efeb1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.845+0000 7efeb1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.845+0000 7efeb1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.846+0000 7efeb1e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:25.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.846+0000 7efeb1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.846+0000 7efeb1e13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:25.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.846+0000 7efeb1e13800 20 zone default found 2024-09-12T00:23:25.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.846+0000 7efeb1e13800 4 Realm: () 2024-09-12T00:23:25.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.846+0000 7efeb1e13800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:23:25.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.846+0000 7efeb1e13800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:23:25.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.846+0000 7efeb1e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:25.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.846+0000 7efeb1e13800 20 zonegroup default 2024-09-12T00:23:25.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.846+0000 7efeb1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.846+0000 7efeb1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.846+0000 7efeb1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.846+0000 7efeb1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.847+0000 7efeb1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.847+0000 7efeb1e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.847+0000 7efeb1e13800 20 started sync module instance, tier type = 2024-09-12T00:23:25.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.847+0000 7efeb1e13800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:23:25.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.856+0000 7efeb1e13800 20 add_watcher() i=0 2024-09-12T00:23:25.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.856+0000 7efeb1e13800 20 add_watcher() i=1 2024-09-12T00:23:25.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.856+0000 7efeb1e13800 20 add_watcher() i=2 2024-09-12T00:23:25.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.856+0000 7efeb1e13800 20 add_watcher() i=3 2024-09-12T00:23:25.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.856+0000 7efeb1e13800 20 add_watcher() i=4 2024-09-12T00:23:25.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.856+0000 7efeb1e13800 20 add_watcher() i=5 2024-09-12T00:23:25.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.856+0000 7efeb1e13800 20 add_watcher() i=6 2024-09-12T00:23:25.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.857+0000 7efeb1e13800 20 add_watcher() i=7 2024-09-12T00:23:25.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.857+0000 7efeb1e13800 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:25.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.858+0000 7efd637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:25.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.859+0000 7efeb1e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:25.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.859+0000 7efeb1e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:25.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.859+0000 7efeb1e13800 5 note: GC not initialized 2024-09-12T00:23:25.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.859+0000 7efd627e4640 20 reqs_thread_entry: start 2024-09-12T00:23:25.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.859+0000 7efeb1e13800 20 init_complete bucket index max shards: 1 2024-09-12T00:23:25.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.859+0000 7efeb1e13800 20 Filter name: none 2024-09-12T00:23:25.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.859+0000 7efcd3fff640 20 reqs_thread_entry: start 2024-09-12T00:23:25.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.859+0000 7efeb1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.860+0000 7efeb1e13800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:25.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.860+0000 7efeb1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.860+0000 7efeb1e13800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:23:25.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.860+0000 7efeb1e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:25.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.860+0000 7efeb1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.860+0000 7efeb1e13800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:25.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.860+0000 7efeb1e13800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.861+0000 7efeb1e13800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:23:25.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.861+0000 7efeb1e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:25.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.862+0000 7efd637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:25.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.864+0000 7efeb1e13800 20 remove_watcher() i=0 2024-09-12T00:23:25.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.864+0000 7efeb1e13800 2 removed watcher, disabling cache 2024-09-12T00:23:25.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.865+0000 7efeb1e13800 20 remove_watcher() i=1 2024-09-12T00:23:25.864 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.866+0000 7efeb1e13800 20 remove_watcher() i=2 2024-09-12T00:23:25.866 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.868+0000 7efeb1e13800 20 remove_watcher() i=3 2024-09-12T00:23:25.867 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.869+0000 7efeb1e13800 20 remove_watcher() i=4 2024-09-12T00:23:25.868 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.870+0000 7efeb1e13800 20 remove_watcher() i=5 2024-09-12T00:23:25.869 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.871+0000 7efeb1e13800 20 remove_watcher() i=6 2024-09-12T00:23:25.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.872+0000 7efeb1e13800 20 remove_watcher() i=7 2024-09-12T00:23:25.881 INFO:tasks.workunit.client.0.smithi067.stderr: test: duplicated entries should be purged before reshard 2024-09-12T00:23:25.883 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:23:25.912 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:25.912 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:25.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.953+0000 7f658e413800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.955+0000 7f658e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.955+0000 7f658e413800 20 realm 2024-09-12T00:23:25.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.955+0000 7f658e413800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.956+0000 7f658e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.956+0000 7f658e413800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:25.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.956+0000 7f658e413800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.956+0000 7f658e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:25.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.956+0000 7f658e413800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.957+0000 7f658e413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:25.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.957+0000 7f658e413800 20 rados->read ofs=0 len=0 2024-09-12T00:23:25.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.958+0000 7f658e413800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:25.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.958+0000 7f658e413800 20 searching for the correct realm 2024-09-12T00:23:25.957 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:25.959+0000 7f6589b48640 0 -- 172.21.15.67:0/2483334411 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f657c084b90 msgr2=0x7f657c0b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:26.163 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.164+0000 7f6589b48640 0 -- 172.21.15.67:0/2483334411 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f6584020060 msgr2=0x7f658405f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:23:26.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.371+0000 7f658e413800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:26.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.371+0000 7f658e413800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:26.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.371+0000 7f658e413800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:23:26.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.371+0000 7f658e413800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:23:26.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.371+0000 7f658e413800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:26.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.371+0000 7f658e413800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:26.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.371+0000 7f658e413800 20 rados->read ofs=0 len=0 2024-09-12T00:23:26.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.371+0000 7f658e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:26.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.371+0000 7f658e413800 20 rados->read ofs=0 len=0 2024-09-12T00:23:26.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.372+0000 7f658e413800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:26.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.372+0000 7f658e413800 20 rados->read ofs=0 len=0 2024-09-12T00:23:26.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.372+0000 7f658e413800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:26.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.372+0000 7f658e413800 20 zone default found 2024-09-12T00:23:26.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.372+0000 7f658e413800 4 Realm: () 2024-09-12T00:23:26.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.372+0000 7f658e413800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:23:26.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.372+0000 7f658e413800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:23:26.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.372+0000 7f658e413800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:26.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.372+0000 7f658e413800 20 zonegroup default 2024-09-12T00:23:26.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.372+0000 7f658e413800 20 rados->read ofs=0 len=0 2024-09-12T00:23:26.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.372+0000 7f658e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:26.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.372+0000 7f658e413800 20 rados->read ofs=0 len=0 2024-09-12T00:23:26.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.373+0000 7f658e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:26.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.373+0000 7f658e413800 20 rados->read ofs=0 len=0 2024-09-12T00:23:26.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.373+0000 7f658e413800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:26.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.373+0000 7f658e413800 20 started sync module instance, tier type = 2024-09-12T00:23:26.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.373+0000 7f658e413800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:23:26.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.384+0000 7f658e413800 20 add_watcher() i=0 2024-09-12T00:23:26.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.384+0000 7f658e413800 20 add_watcher() i=1 2024-09-12T00:23:26.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.384+0000 7f658e413800 20 add_watcher() i=2 2024-09-12T00:23:26.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.384+0000 7f658e413800 20 add_watcher() i=3 2024-09-12T00:23:26.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.384+0000 7f658e413800 20 add_watcher() i=4 2024-09-12T00:23:26.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.384+0000 7f658e413800 20 add_watcher() i=5 2024-09-12T00:23:26.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.384+0000 7f658e413800 20 add_watcher() i=6 2024-09-12T00:23:26.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.385+0000 7f658e413800 20 add_watcher() i=7 2024-09-12T00:23:26.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.385+0000 7f658e413800 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:26.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.388+0000 7f643b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:26.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.388+0000 7f658e413800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:26.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.388+0000 7f658e413800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:26.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.388+0000 7f658e413800 5 note: GC not initialized 2024-09-12T00:23:26.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.389+0000 7f643a7fc640 20 reqs_thread_entry: start 2024-09-12T00:23:26.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.389+0000 7f658e413800 20 init_complete bucket index max shards: 1 2024-09-12T00:23:26.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.389+0000 7f658e413800 20 Filter name: none 2024-09-12T00:23:26.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.389+0000 7f63abfff640 20 reqs_thread_entry: start 2024-09-12T00:23:26.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.389+0000 7f658e413800 20 rados->read ofs=0 len=0 2024-09-12T00:23:26.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.389+0000 7f658e413800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:26.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.389+0000 7f658e413800 20 rados->read ofs=0 len=0 2024-09-12T00:23:26.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.390+0000 7f658e413800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:23:26.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.390+0000 7f658e413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:26.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.390+0000 7f658e413800 20 rados->read ofs=0 len=0 2024-09-12T00:23:26.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.390+0000 7f658e413800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:26.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.390+0000 7f658e413800 20 rados->read ofs=0 len=0 2024-09-12T00:23:26.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.391+0000 7f658e413800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:23:26.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.391+0000 7f658e413800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:26.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.392+0000 7f643b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:26.392 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.394+0000 7f658e413800 20 remove_watcher() i=0 2024-09-12T00:23:26.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.394+0000 7f658e413800 2 removed watcher, disabling cache 2024-09-12T00:23:26.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.396+0000 7f658e413800 20 remove_watcher() i=1 2024-09-12T00:23:26.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.397+0000 7f658e413800 20 remove_watcher() i=2 2024-09-12T00:23:26.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.398+0000 7f658e413800 20 remove_watcher() i=3 2024-09-12T00:23:26.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.399+0000 7f658e413800 20 remove_watcher() i=4 2024-09-12T00:23:26.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.400+0000 7f658e413800 20 remove_watcher() i=5 2024-09-12T00:23:26.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.401+0000 7f658e413800 20 remove_watcher() i=6 2024-09-12T00:23:26.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.402+0000 7f658e413800 20 remove_watcher() i=7 2024-09-12T00:23:26.411 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:26.412 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:23:26.412 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 num_objects: 10 size_kb: 1 num_shards: 3 2024-09-12T00:23:26.412 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:26.413 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:23:26.448 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:26.448 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:26.681 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.683+0000 7fa0c4d03640 0 --2- 172.21.15.67:0/3555390146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55e1ca363f70 0x55e1ca364370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:23:26.690 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.692+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:26.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:26.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.694+0000 7fa0c8920800 20 realm 2024-09-12T00:23:26.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:26.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:26.693 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.694+0000 7fa0c8920800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:26.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:26.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:26.694 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:26.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.695+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:26.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.695+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:26.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.696+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:26.695 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.696+0000 7fa0c8920800 20 searching for the correct realm 2024-09-12T00:23:26.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.698+0000 7fa0c4502640 0 -- 172.21.15.67:0/2700414496 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7fa0b4061c20 msgr2=0x7fa0b4087d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:23:26.903 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:26.904+0000 7fa0c4502640 0 -- 172.21.15.67:0/2700414496 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fa0bc055410 msgr2=0x7fa0bc055890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:27.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:27.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:27.111 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:23:27.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:23:27.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:27.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:27.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.113+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.113+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.112 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.113+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.114+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:27.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.114+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.114+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:27.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.114+0000 7fa0c8920800 20 zone default found 2024-09-12T00:23:27.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.114+0000 7fa0c8920800 4 Realm: () 2024-09-12T00:23:27.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.114+0000 7fa0c8920800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:23:27.113 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.114+0000 7fa0c8920800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:23:27.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.114+0000 7fa0c8920800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:27.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.114+0000 7fa0c8920800 20 zonegroup default 2024-09-12T00:23:27.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.114+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.115+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.115+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.114 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.115+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.115+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.115+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.115+0000 7fa0c8920800 20 started sync module instance, tier type = 2024-09-12T00:23:27.115 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.115+0000 7fa0c8920800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:23:27.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=0 2024-09-12T00:23:27.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=1 2024-09-12T00:23:27.124 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=2 2024-09-12T00:23:27.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=3 2024-09-12T00:23:27.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=4 2024-09-12T00:23:27.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=5 2024-09-12T00:23:27.125 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=6 2024-09-12T00:23:27.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.127+0000 7fa0c8920800 20 add_watcher() i=7 2024-09-12T00:23:27.126 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.127+0000 7fa0c8920800 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:27.127 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.129+0000 7f9f7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:27.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.129+0000 7fa0c8920800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:27.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.129+0000 7fa0c8920800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:27.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.130+0000 7fa0c8920800 5 note: GC not initialized 2024-09-12T00:23:27.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.130+0000 7f9f79fdb640 20 reqs_thread_entry: start 2024-09-12T00:23:27.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.130+0000 7fa0c8920800 20 init_complete bucket index max shards: 1 2024-09-12T00:23:27.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.130+0000 7fa0c8920800 20 Filter name: none 2024-09-12T00:23:27.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.130+0000 7f9eeb7fe640 20 reqs_thread_entry: start 2024-09-12T00:23:27.129 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.130+0000 7fa0c8920800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:23:27.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.130+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.131+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:27.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.131+0000 7fa0c8920800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:23:27.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.131+0000 7fa0c8920800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:23:27.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.131+0000 7fa0c8920800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:23:27.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.131+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.131+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:23:27.130 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.131+0000 7fa0c8920800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:27.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.131+0000 7fa0c8920800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:27.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.131+0000 7fa0c8920800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:27.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.131+0000 7fa0c8920800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:27.131 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.131+0000 7fa0c8920800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:23:27.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.136+0000 7fa0c8920800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:27.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.136+0000 7fa0c8920800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:27.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.136+0000 7fa0c8920800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:27.134 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.136+0000 7fa0c8920800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:23:27.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.137+0000 7f9f9b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562482 cookie 94428249066144 notifier 7709 bl.length()=827 2024-09-12T00:23:27.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.137+0000 7f9f9b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:27.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.137+0000 7f9f9b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:27.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.137+0000 7f9f9b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:27.135 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.138+0000 7fa0c8920800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:23:27.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.138+0000 7fa0c8920800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:23:27.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.138+0000 7fa0c8920800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:23:27.136 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.138+0000 7fa0c8920800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:23:27.139 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa0c8920800 time 2024-09-12T00:23:27.141644+0000 2024-09-12T00:23:27.139 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:23:27.139 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:27.139 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa0c9f8c71a] 2024-09-12T00:23:27.140 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa0c9f8c8d8] 2024-09-12T00:23:27.140 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1c8177641] 2024-09-12T00:23:27.140 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e1c818738a] 2024-09-12T00:23:27.140 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:23:27.140 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa0c8c29590] 2024-09-12T00:23:27.140 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:23:27.140 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:23:27.140 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.141+0000 7fa0c8920800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa0c8920800 time 2024-09-12T00:23:27.141644+0000 2024-09-12T00:23:27.140 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:23:27.140 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.141 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:27.141 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa0c9f8c71a] 2024-09-12T00:23:27.141 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa0c9f8c8d8] 2024-09-12T00:23:27.141 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1c8177641] 2024-09-12T00:23:27.141 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e1c818738a] 2024-09-12T00:23:27.141 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:23:27.141 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa0c8c29590] 2024-09-12T00:23:27.141 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:23:27.141 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:23:27.141 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.141 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:23:27.141 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fa0c8920800 thread_name:radosgw-admin 2024-09-12T00:23:27.155 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:27.155 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa0c8c3e6f0] 2024-09-12T00:23:27.155 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa0c8c8b99c] 2024-09-12T00:23:27.155 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:23:27.156 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:23:27.156 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa0c9f8c774] 2024-09-12T00:23:27.156 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa0c9f8c8d8] 2024-09-12T00:23:27.156 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1c8177641] 2024-09-12T00:23:27.156 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e1c818738a] 2024-09-12T00:23:27.156 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:23:27.156 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa0c8c29590] 2024-09-12T00:23:27.156 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:23:27.156 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:23:27.156 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.142+0000 7fa0c8920800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:23:27.156 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fa0c8920800 thread_name:radosgw-admin 2024-09-12T00:23:27.156 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.157 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:27.157 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa0c8c3e6f0] 2024-09-12T00:23:27.157 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa0c8c8b99c] 2024-09-12T00:23:27.157 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:23:27.157 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:23:27.157 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa0c9f8c774] 2024-09-12T00:23:27.157 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa0c9f8c8d8] 2024-09-12T00:23:27.157 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1c8177641] 2024-09-12T00:23:27.157 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e1c818738a] 2024-09-12T00:23:27.157 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:23:27.157 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa0c8c29590] 2024-09-12T00:23:27.157 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:23:27.157 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:23:27.158 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:23:27.158 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.158 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:23:27.158 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:23:26.473+0000 7fa0c8920800 1 librados: calling monclient init 2024-09-12T00:23:27.158 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:23:26.473+0000 7fa0c8920800 10 monclient: init 2024-09-12T00:23:27.158 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding auth protocol: cephx 2024-09-12T00:23:27.158 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding auth protocol: cephx 2024-09-12T00:23:27.158 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding auth protocol: cephx 2024-09-12T00:23:27.158 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: secure 2024-09-12T00:23:27.158 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: crc 2024-09-12T00:23:27.158 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: secure 2024-09-12T00:23:27.158 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: crc 2024-09-12T00:23:27.158 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: secure 2024-09-12T00:23:27.158 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: crc 2024-09-12T00:23:27.159 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: crc 2024-09-12T00:23:27.159 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: secure 2024-09-12T00:23:27.159 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: crc 2024-09-12T00:23:27.159 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: secure 2024-09-12T00:23:27.159 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: crc 2024-09-12T00:23:27.159 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: secure 2024-09-12T00:23:27.159 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:23:26.474+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.159 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:23:26.474+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.159 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:23:26.474+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command rotate-key hook 0x55e1ca2e98b8 2024-09-12T00:23:27.159 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:27.159 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:23:27.159 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-c con 0x55e1ca161f90 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:27.159 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-b con 0x55e1ca196db0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:27.160 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-a con 0x55e1ca230250 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:27.160 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.160 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.160 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.160 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:27.160 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): authenticate will time out at 2083.730381s 2024-09-12T00:23:27.160 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): get_auth_request con 0x55e1ca161f90 auth_method 0 2024-09-12T00:23:27.160 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.160 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.160 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.160 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:23:26.474+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request con 0x55e1ca230250 auth_method 0 2024-09-12T00:23:27.160 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:23:26.474+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.160 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:23:26.474+0000 7fa0c4d03640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.161 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:23:26.474+0000 7fa0c4d03640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.161 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.161 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.161 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.161 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:23:26.474+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.161 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:23:26.474+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.161 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:23:26.474+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.161 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:23:26.474+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request con 0x55e1ca196db0 auth_method 0 2024-09-12T00:23:27.161 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:23:26.474+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.161 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:23:26.474+0000 7fa0c3d01640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.161 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:23:26.474+0000 7fa0c3d01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.161 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:23:26.474+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.162 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:23:26.474+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.162 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:23:26.474+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.162 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): handle_auth_done global_id 7700 payload 824 2024-09-12T00:23:27.162 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient: _finish_hunting 0 2024-09-12T00:23:27.162 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:23:26.474+0000 7fa0c4502640 1 monclient: found mon.noname-c 2024-09-12T00:23:27.162 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.162 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.162 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:23:27.162 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: dump: 2024-09-12T00:23:27.162 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.162 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.162 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.162 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.163 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.163 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.163 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.163 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.163 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.163 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.163 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: _finish_auth 0 2024-09-12T00:23:27.163 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: _check_auth_tickets 2024-09-12T00:23:27.163 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:27.163 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.163 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:23:27.163 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: dump: 2024-09-12T00:23:27.163 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.164 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.164 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.164 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.164 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.164 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.164 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.164 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.164 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.164 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.164 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:23:26.475+0000 7fa0c8920800 5 monclient: authenticate success, global_id 7700 2024-09-12T00:23:27.164 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:23:26.475+0000 7fa0c8920800 10 monclient: _renew_subs 2024-09-12T00:23:27.164 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:23:26.475+0000 7fa0c8920800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.165 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:23:26.475+0000 7f9fb260c640 4 set_mon_vals no callback set 2024-09-12T00:23:27.165 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:23:26.475+0000 7fa0c8920800 10 monclient: _renew_subs 2024-09-12T00:23:27.165 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:23:26.475+0000 7fa0c8920800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.165 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:23:26.475+0000 7fa0c8920800 1 librados: init done 2024-09-12T00:23:27.165 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:23:26.477+0000 7f9fb0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:23:27.165 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:23:26.477+0000 7f9fb0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:27.165 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:23:26.477+0000 7f9fb0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:27.165 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:23:26.477+0000 7fa0c3d01640 10 monclient: get_auth_request con 0x7f9fac076470 auth_method 0 2024-09-12T00:23:27.165 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:23:26.477+0000 7fa0c4d03640 10 monclient: get_auth_request con 0x55e1ca311e70 auth_method 0 2024-09-12T00:23:27.165 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:23:26.478+0000 7fa0c4502640 10 monclient: get_auth_request con 0x55e1ca335080 auth_method 0 2024-09-12T00:23:27.165 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:23:26.479+0000 7fa0c3d01640 10 monclient: get_auth_request con 0x55e1ca339300 auth_method 0 2024-09-12T00:23:27.165 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:23:26.481+0000 7fa0c8920800 10 monclient: build_initial_monmap 2024-09-12T00:23:27.165 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:23:26.481+0000 7fa0c8920800 1 build_initial for_mkfs: 0 2024-09-12T00:23:27.166 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:23:26.481+0000 7fa0c8920800 10 monclient: monmap: 2024-09-12T00:23:27.166 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:23:27.166 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:23:27.166 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:23:27.166 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:23:27.166 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:23:27.166 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.166 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:23:27.166 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:23:27.166 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:23:27.166 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.166 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding auth protocol: cephx 2024-09-12T00:23:27.166 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding auth protocol: cephx 2024-09-12T00:23:27.166 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding auth protocol: cephx 2024-09-12T00:23:27.167 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: secure 2024-09-12T00:23:27.167 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: crc 2024-09-12T00:23:27.167 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: secure 2024-09-12T00:23:27.167 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: crc 2024-09-12T00:23:27.167 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: secure 2024-09-12T00:23:27.167 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: crc 2024-09-12T00:23:27.167 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: crc 2024-09-12T00:23:27.167 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: secure 2024-09-12T00:23:27.167 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: crc 2024-09-12T00:23:27.167 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: secure 2024-09-12T00:23:27.167 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: crc 2024-09-12T00:23:27.167 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: secure 2024-09-12T00:23:27.167 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:23:26.481+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.167 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command objecter_requests cmddesc objecter_requests hook 0x55e1ca341ab0 EEXIST 2024-09-12T00:23:27.168 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:23:26.481+0000 7fa0c8920800 10 monclient: init 2024-09-12T00:23:27.168 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding auth protocol: cephx 2024-09-12T00:23:27.168 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding auth protocol: cephx 2024-09-12T00:23:27.168 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding auth protocol: cephx 2024-09-12T00:23:27.168 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: secure 2024-09-12T00:23:27.168 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: crc 2024-09-12T00:23:27.168 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: secure 2024-09-12T00:23:27.168 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: crc 2024-09-12T00:23:27.168 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: secure 2024-09-12T00:23:27.168 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: crc 2024-09-12T00:23:27.168 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: crc 2024-09-12T00:23:27.168 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: secure 2024-09-12T00:23:27.168 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: crc 2024-09-12T00:23:27.169 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: secure 2024-09-12T00:23:27.169 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: crc 2024-09-12T00:23:27.169 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: secure 2024-09-12T00:23:27.169 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:23:26.481+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.169 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:23:26.482+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.169 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:23:26.482+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command rotate-key cmddesc rotate-key hook 0x55e1ca33c9b0 EEXIST 2024-09-12T00:23:27.169 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:27.169 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:23:27.169 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-b con 0x55e1ca3657a0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:27.169 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-a con 0x55e1ca367a70 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:27.169 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-c con 0x55e1ca363f70 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:27.169 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.169 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.170 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.170 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:27.170 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): authenticate will time out at 2083.738330s 2024-09-12T00:23:27.170 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request con 0x55e1ca363f70 auth_method 0 2024-09-12T00:23:27.170 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.170 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.170 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.170 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:23:26.482+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request con 0x55e1ca367a70 auth_method 0 2024-09-12T00:23:27.170 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:23:26.482+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.170 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:23:26.482+0000 7fa0c3d01640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.170 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:23:26.482+0000 7fa0c3d01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.170 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:23:26.482+0000 7fa0c4502640 10 monclient(hunting): get_auth_request con 0x55e1ca3657a0 auth_method 0 2024-09-12T00:23:27.170 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:23:26.482+0000 7fa0c4502640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.170 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:23:26.482+0000 7fa0c4502640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.171 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:23:26.482+0000 7fa0c4502640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.171 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.171 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.171 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.171 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:23:26.482+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.171 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:23:26.482+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.171 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:23:26.482+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.171 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:23:26.482+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.171 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:23:26.482+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.171 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:23:26.482+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.171 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_done global_id 7703 payload 824 2024-09-12T00:23:27.171 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient: _finish_hunting 0 2024-09-12T00:23:27.171 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 1 monclient: found mon.noname-c 2024-09-12T00:23:27.172 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.172 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient: get_auth_request con 0x55e1ca363f70 auth_method 0 2024-09-12T00:23:27.172 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 0 --2- 172.21.15.67:0/3555390146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55e1ca363f70 0x55e1ca364370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:23:27.172 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient: ms_handle_reset current mon [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:27.172 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient: _reopen_session rank -1 2024-09-12T00:23:27.172 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:23:27.172 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient(hunting): picked mon.noname-a con 0x55e1ca367a70 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:27.172 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient(hunting): picked mon.noname-b con 0x55e1ca3657a0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:27.172 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f9f9c0072b0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:27.172 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.172 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.172 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.172 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient(hunting): _renew_subs 2024-09-12T00:23:27.172 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): get_auth_request con 0x55e1ca367a70 auth_method 0 2024-09-12T00:23:27.173 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.173 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.173 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T00:23:27.173 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request con 0x7f9f9c0072b0 auth_method 0 2024-09-12T00:23:27.173 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.173 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.173 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T00:23:27.173 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.173 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.173 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T00:23:27.173 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.173 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.173 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T00:23:27.174 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): handle_auth_done global_id 7703 payload 293 2024-09-12T00:23:27.174 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient: _finish_hunting 0 2024-09-12T00:23:27.176 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:23:26.683+0000 7fa0c4502640 1 monclient: found mon.noname-a 2024-09-12T00:23:27.176 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:23:27.176 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.176 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:23:27.176 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: dump: 2024-09-12T00:23:27.176 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.176 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.176 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.176 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.176 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.176 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.177 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.177 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.177 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.177 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.177 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:23:27.177 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:23:27.177 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:27.177 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.177 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:23:27.177 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: dump: 2024-09-12T00:23:27.177 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.177 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.178 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.178 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.178 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.178 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.178 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.178 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.178 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.178 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.178 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:23:26.684+0000 7fa0c8920800 5 monclient: authenticate success, global_id 7703 2024-09-12T00:23:27.178 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:23:26.684+0000 7fa0c8920800 10 monclient: _renew_subs 2024-09-12T00:23:27.178 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:23:26.684+0000 7fa0c8920800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:23:27.178 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:23:26.684+0000 7fa0c5504640 4 set_mon_vals no callback set 2024-09-12T00:23:27.178 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:23:26.684+0000 7fa0c8920800 10 monclient: _renew_subs 2024-09-12T00:23:27.179 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:23:26.684+0000 7fa0c8920800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:23:27.179 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:23:26.686+0000 7f9fa9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:23:27.179 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:23:26.686+0000 7f9fa9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:27.179 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:23:26.686+0000 7f9fa9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:27.179 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:23:26.686+0000 7fa0c3d01640 10 monclient: get_auth_request con 0x55e1ca363f70 auth_method 0 2024-09-12T00:23:27.179 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:23:26.686+0000 7fa0c8920800 10 monclient: get_monmap_and_config 2024-09-12T00:23:27.179 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:23:26.686+0000 7fa0c8920800 10 monclient: build_initial_monmap 2024-09-12T00:23:27.179 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:23:26.686+0000 7fa0c8920800 1 build_initial for_mkfs: 0 2024-09-12T00:23:27.179 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:23:26.686+0000 7fa0c8920800 10 monclient: monmap: 2024-09-12T00:23:27.179 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:23:27.179 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:23:27.179 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:23:27.179 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:23:27.180 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:23:27.180 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.180 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:23:27.180 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:23:27.180 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:23:27.180 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.180 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding auth protocol: cephx 2024-09-12T00:23:27.180 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding auth protocol: cephx 2024-09-12T00:23:27.180 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding auth protocol: cephx 2024-09-12T00:23:27.180 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: secure 2024-09-12T00:23:27.180 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: crc 2024-09-12T00:23:27.180 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: secure 2024-09-12T00:23:27.180 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: crc 2024-09-12T00:23:27.181 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: secure 2024-09-12T00:23:27.181 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: crc 2024-09-12T00:23:27.181 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: crc 2024-09-12T00:23:27.181 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: secure 2024-09-12T00:23:27.181 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: crc 2024-09-12T00:23:27.181 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: secure 2024-09-12T00:23:27.181 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: crc 2024-09-12T00:23:27.181 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: secure 2024-09-12T00:23:27.181 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:23:26.686+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.181 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:23:26.686+0000 7fa0c8920800 10 monclient: init 2024-09-12T00:23:27.181 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding auth protocol: cephx 2024-09-12T00:23:27.181 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding auth protocol: cephx 2024-09-12T00:23:27.182 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding auth protocol: cephx 2024-09-12T00:23:27.182 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: secure 2024-09-12T00:23:27.182 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: crc 2024-09-12T00:23:27.182 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: secure 2024-09-12T00:23:27.182 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: crc 2024-09-12T00:23:27.182 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: secure 2024-09-12T00:23:27.182 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: crc 2024-09-12T00:23:27.182 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: crc 2024-09-12T00:23:27.182 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: secure 2024-09-12T00:23:27.182 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: crc 2024-09-12T00:23:27.182 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: secure 2024-09-12T00:23:27.182 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: crc 2024-09-12T00:23:27.182 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: secure 2024-09-12T00:23:27.183 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:23:26.687+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.183 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:23:26.687+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.183 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:23:26.687+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command rotate-key cmddesc rotate-key hook 0x7fff3176c1f8 EEXIST 2024-09-12T00:23:27.183 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:27.183 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:23:27.183 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-b con 0x55e1ca3b2aa0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:27.183 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-a con 0x55e1ca3828b0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:27.183 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-c con 0x55e1ca3ade60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:27.183 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.183 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.183 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.183 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:27.184 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): authenticate will time out at 2083.943474s 2024-09-12T00:23:27.184 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request con 0x55e1ca3ade60 auth_method 0 2024-09-12T00:23:27.184 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.184 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.184 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.184 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:23:26.687+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request con 0x55e1ca3828b0 auth_method 0 2024-09-12T00:23:27.184 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:23:26.687+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.184 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:23:26.687+0000 7fa0c3d01640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.184 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:23:26.687+0000 7fa0c3d01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.184 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.184 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.184 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.184 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:23:26.687+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.185 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:23:26.687+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.185 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:23:26.687+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.185 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_done global_id 7706 payload 274 2024-09-12T00:23:27.185 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient: _finish_hunting 0 2024-09-12T00:23:27.185 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 1 monclient: found mon.noname-c 2024-09-12T00:23:27.185 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.185 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:23:26.687+0000 7fa0c4502640 10 monclient: get_auth_request con 0x55e1ca3b2aa0 auth_method 0 2024-09-12T00:23:27.185 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.185 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:23:27.185 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: dump: 2024-09-12T00:23:27.185 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.185 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.185 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.186 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.186 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.186 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.186 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.186 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.186 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.186 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.186 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:23:27.186 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:23:27.186 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:27.186 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.186 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:23:27.186 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: dump: 2024-09-12T00:23:27.187 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.187 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.187 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.187 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.187 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.187 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.187 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.187 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.187 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.187 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.187 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 monclient: authenticate success, global_id 7706 2024-09-12T00:23:27.187 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:23:26.688+0000 7fa0c8920800 10 monclient: get_monmap_and_config success 2024-09-12T00:23:27.187 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:23:26.688+0000 7fa0c8920800 4 set_mon_vals no callback set 2024-09-12T00:23:27.187 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:23:26.688+0000 7fa0c8920800 10 monclient: shutdown 2024-09-12T00:23:27.188 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:23:26.688+0000 7fa0c8920800 10 monclient: build_initial_monmap 2024-09-12T00:23:27.188 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:23:26.688+0000 7fa0c8920800 1 build_initial for_mkfs: 0 2024-09-12T00:23:27.188 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:23:26.688+0000 7fa0c8920800 10 monclient: monmap: 2024-09-12T00:23:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:23:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:23:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:23:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:23:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:23:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:23:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:23:27.188 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:23:27.189 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.189 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding auth protocol: cephx 2024-09-12T00:23:27.189 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding auth protocol: cephx 2024-09-12T00:23:27.189 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding auth protocol: cephx 2024-09-12T00:23:27.189 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: secure 2024-09-12T00:23:27.189 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: crc 2024-09-12T00:23:27.189 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: secure 2024-09-12T00:23:27.189 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: crc 2024-09-12T00:23:27.189 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: secure 2024-09-12T00:23:27.189 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: crc 2024-09-12T00:23:27.189 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: crc 2024-09-12T00:23:27.189 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: secure 2024-09-12T00:23:27.189 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: crc 2024-09-12T00:23:27.190 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: secure 2024-09-12T00:23:27.190 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: crc 2024-09-12T00:23:27.190 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: secure 2024-09-12T00:23:27.190 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:23:26.689+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.190 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:23:26.689+0000 7fa0c8920800 1 librados: starting msgr at 2024-09-12T00:23:27.190 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:23:26.689+0000 7fa0c8920800 1 librados: starting objecter 2024-09-12T00:23:27.190 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command objecter_requests cmddesc objecter_requests hook 0x55e1ca380e10 EEXIST 2024-09-12T00:23:27.190 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:23:26.689+0000 7fa0c8920800 1 librados: setting wanted keys 2024-09-12T00:23:27.190 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:23:26.689+0000 7fa0c8920800 1 librados: calling monclient init 2024-09-12T00:23:27.190 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient: init 2024-09-12T00:23:27.190 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding auth protocol: cephx 2024-09-12T00:23:27.190 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding auth protocol: cephx 2024-09-12T00:23:27.190 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding auth protocol: cephx 2024-09-12T00:23:27.190 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: secure 2024-09-12T00:23:27.191 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: crc 2024-09-12T00:23:27.191 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: secure 2024-09-12T00:23:27.191 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: crc 2024-09-12T00:23:27.191 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: secure 2024-09-12T00:23:27.191 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: crc 2024-09-12T00:23:27.191 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: crc 2024-09-12T00:23:27.191 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: secure 2024-09-12T00:23:27.191 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: crc 2024-09-12T00:23:27.191 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: secure 2024-09-12T00:23:27.191 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: crc 2024-09-12T00:23:27.191 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: secure 2024-09-12T00:23:27.191 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:23:26.689+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.191 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:23:26.689+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.192 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command rotate-key cmddesc rotate-key hook 0x55e1ca37d698 EEXIST 2024-09-12T00:23:27.192 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:27.192 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:23:27.192 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-a con 0x55e1ca3828b0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:27.192 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-c con 0x55e1ca3ade60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:27.192 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-b con 0x55e1ca3b2aa0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:27.192 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.192 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.192 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.192 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:27.192 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): authenticate will time out at 2083.945983s 2024-09-12T00:23:27.192 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request con 0x55e1ca3ade60 auth_method 0 2024-09-12T00:23:27.192 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.193 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.193 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.193 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:23:26.690+0000 7fa0c4502640 10 monclient(hunting): get_auth_request con 0x55e1ca3828b0 auth_method 0 2024-09-12T00:23:27.193 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:23:26.690+0000 7fa0c4502640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.193 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:23:26.690+0000 7fa0c4502640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.193 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:23:26.690+0000 7fa0c4502640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.193 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.193 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.193 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.193 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:23:26.690+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.193 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:23:26.690+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.193 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:23:26.690+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.193 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:23:26.690+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request con 0x55e1ca3b2aa0 auth_method 0 2024-09-12T00:23:27.194 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:23:26.690+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.194 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:23:26.690+0000 7fa0c4d03640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.194 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:23:26.690+0000 7fa0c4d03640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.194 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:23:26.690+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.194 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:23:26.690+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.194 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:23:26.690+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.194 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_done global_id 7709 payload 824 2024-09-12T00:23:27.194 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient: _finish_hunting 0 2024-09-12T00:23:27.194 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 1 monclient: found mon.noname-c 2024-09-12T00:23:27.194 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.194 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.194 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:23:27.194 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: dump: 2024-09-12T00:23:27.195 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.195 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.195 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.195 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.195 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.195 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.195 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.195 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.195 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.195 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.195 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: _finish_auth 0 2024-09-12T00:23:27.195 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:23:27.195 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:27.195 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.196 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:23:27.196 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: dump: 2024-09-12T00:23:27.196 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.196 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.196 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.196 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.196 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.196 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.196 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.196 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.196 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.196 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.196 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:23:26.690+0000 7fa0c8920800 5 monclient: authenticate success, global_id 7709 2024-09-12T00:23:27.197 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:23:26.690+0000 7fa0c8920800 10 monclient: _renew_subs 2024-09-12T00:23:27.197 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:23:26.690+0000 7f9f9b7fe640 4 set_mon_vals no callback set 2024-09-12T00:23:27.197 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:23:26.690+0000 7fa0c8920800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.197 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:23:26.690+0000 7fa0c8920800 10 monclient: _renew_subs 2024-09-12T00:23:27.197 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:23:26.690+0000 7fa0c8920800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.197 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:23:26.690+0000 7fa0c8920800 1 librados: init done 2024-09-12T00:23:27.197 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:23:26.690+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command cr dump hook 0x55e1ca3a9ec8 2024-09-12T00:23:27.197 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:23:26.692+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.197 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:23:26.692+0000 7f9f99ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:23:27.197 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:23:26.692+0000 7f9f99ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:27.197 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:23:26.692+0000 7f9f99ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:27.197 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:23:26.693+0000 7fa0c4502640 10 monclient: get_auth_request con 0x7f9f8c076470 auth_method 0 2024-09-12T00:23:27.197 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:23:26.693+0000 7fa0c4d03640 10 monclient: get_auth_request con 0x55e1ca3cc960 auth_method 0 2024-09-12T00:23:27.198 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.198 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:23:26.694+0000 7fa0c8920800 20 realm 2024-09-12T00:23:27.198 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.198 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.198 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:23:26.694+0000 7fa0c8920800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:27.198 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.198 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.198 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.198 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:23:26.694+0000 7fa0c4502640 10 monclient: get_auth_request con 0x55e1ca3d0c40 auth_method 0 2024-09-12T00:23:27.198 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:23:26.695+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:27.198 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:23:26.695+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.198 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:23:26.695+0000 7fa0c3d01640 10 monclient: get_auth_request con 0x55e1ca3d4360 auth_method 0 2024-09-12T00:23:27.198 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:23:26.696+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:27.198 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:23:26.696+0000 7fa0c8920800 20 searching for the correct realm 2024-09-12T00:23:27.199 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:23:26.696+0000 7fa0c4d03640 10 monclient: get_auth_request con 0x7fa0b804e060 auth_method 0 2024-09-12T00:23:27.199 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:23:26.698+0000 7fa0c4502640 10 monclient: get_auth_request con 0x7fa0b4061c20 auth_method 0 2024-09-12T00:23:27.199 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:23:26.698+0000 7fa0c4502640 0 -- 172.21.15.67:0/2700414496 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7fa0b4061c20 msgr2=0x7fa0b4087d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:23:27.199 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:23:26.900+0000 7fa0c4502640 10 monclient: get_auth_request con 0x7fa0b4061c20 auth_method 0 2024-09-12T00:23:27.199 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:23:26.901+0000 7fa0c3d01640 10 monclient: get_auth_request con 0x7fa0b801f070 auth_method 0 2024-09-12T00:23:27.199 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:23:26.903+0000 7fa0c4d03640 10 monclient: get_auth_request con 0x7fa0b401f060 auth_method 0 2024-09-12T00:23:27.199 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:23:26.904+0000 7fa0c4502640 0 -- 172.21.15.67:0/2700414496 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fa0bc055410 msgr2=0x7fa0bc055890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:27.199 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:23:26.904+0000 7fa0c4502640 10 monclient: get_auth_request con 0x7fa0bc055410 auth_method 0 2024-09-12T00:23:27.199 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:23:27.106+0000 7fa0c4502640 10 monclient: get_auth_request con 0x7fa0bc055410 auth_method 0 2024-09-12T00:23:27.199 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:27.199 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:27.199 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:23:27.199 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:23:27.200 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:27.200 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:27.200 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.200 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.200 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.200 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:23:27.114+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:27.200 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:23:27.114+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.200 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:23:27.114+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:27.200 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:23:27.114+0000 7fa0c8920800 20 zone default found 2024-09-12T00:23:27.200 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:23:27.114+0000 7fa0c8920800 4 Realm: () 2024-09-12T00:23:27.200 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:23:27.114+0000 7fa0c8920800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:23:27.200 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:23:27.114+0000 7fa0c8920800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:23:27.200 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:23:27.114+0000 7fa0c8920800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:27.201 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:23:27.114+0000 7fa0c8920800 20 zonegroup default 2024-09-12T00:23:27.201 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:23:27.114+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.201 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:23:27.115+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.201 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:23:27.115+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.201 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:23:27.115+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.201 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:23:27.115+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.201 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:23:27.115+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.201 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:23:27.115+0000 7fa0c8920800 20 started sync module instance, tier type = 2024-09-12T00:23:27.201 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:23:27.115+0000 7fa0c8920800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:23:27.201 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=0 2024-09-12T00:23:27.201 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=1 2024-09-12T00:23:27.201 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=2 2024-09-12T00:23:27.201 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=3 2024-09-12T00:23:27.202 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=4 2024-09-12T00:23:27.202 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=5 2024-09-12T00:23:27.202 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=6 2024-09-12T00:23:27.202 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:23:27.127+0000 7fa0c8920800 20 add_watcher() i=7 2024-09-12T00:23:27.202 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:23:27.127+0000 7fa0c8920800 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:27.202 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding auth protocol: cephx 2024-09-12T00:23:27.202 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding auth protocol: cephx 2024-09-12T00:23:27.202 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding auth protocol: cephx 2024-09-12T00:23:27.202 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: secure 2024-09-12T00:23:27.202 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: crc 2024-09-12T00:23:27.202 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: secure 2024-09-12T00:23:27.202 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: crc 2024-09-12T00:23:27.202 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: secure 2024-09-12T00:23:27.202 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: crc 2024-09-12T00:23:27.203 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: crc 2024-09-12T00:23:27.203 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: secure 2024-09-12T00:23:27.203 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: crc 2024-09-12T00:23:27.203 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: secure 2024-09-12T00:23:27.203 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: crc 2024-09-12T00:23:27.203 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: secure 2024-09-12T00:23:27.203 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:23:27.129+0000 7f9f7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:27.203 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:23:27.129+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.203 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:23:27.129+0000 7fa0c8920800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:27.203 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:23:27.129+0000 7fa0c8920800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:27.203 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command cache list hook 0x55e1ca3a72f0 2024-09-12T00:23:27.203 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command cache inspect hook 0x55e1ca3a72f0 2024-09-12T00:23:27.203 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command cache erase hook 0x55e1ca3a72f0 2024-09-12T00:23:27.204 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command cache zap hook 0x55e1ca3a72f0 2024-09-12T00:23:27.204 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:23:27.130+0000 7fa0c8920800 5 note: GC not initialized 2024-09-12T00:23:27.204 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:23:27.130+0000 7f9f79fdb640 20 reqs_thread_entry: start 2024-09-12T00:23:27.204 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:23:27.130+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command sync trace show hook 0x7fa0b40043a0 2024-09-12T00:23:27.204 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:23:27.130+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command sync trace history hook 0x7fa0b40043a0 2024-09-12T00:23:27.204 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:23:27.130+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command sync trace active hook 0x7fa0b40043a0 2024-09-12T00:23:27.204 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:23:27.130+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command sync trace active_short hook 0x7fa0b40043a0 2024-09-12T00:23:27.204 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:23:27.130+0000 7fa0c8920800 20 init_complete bucket index max shards: 1 2024-09-12T00:23:27.204 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:23:27.130+0000 7fa0c8920800 20 Filter name: none 2024-09-12T00:23:27.204 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:23:27.130+0000 7f9eeb7fe640 20 reqs_thread_entry: start 2024-09-12T00:23:27.204 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:23:27.130+0000 7fa0c8920800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:23:27.204 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:23:27.130+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.204 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:23:27.131+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:27.204 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:23:27.205 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:23:27.205 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:23:27.205 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:23:27.131+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.205 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:23:27.131+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:23:27.205 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:27.205 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:27.205 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:27.205 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:27.205 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:23:27.205 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:23:27.136+0000 7fa0c8920800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:27.205 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:23:27.136+0000 7fa0c8920800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:27.205 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:23:27.136+0000 7fa0c8920800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:27.205 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:23:27.136+0000 7fa0c8920800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:23:27.205 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:23:27.137+0000 7f9f9b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562482 cookie 94428249066144 notifier 7709 bl.length()=827 2024-09-12T00:23:27.206 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:23:27.137+0000 7f9f9b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:27.206 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:23:27.137+0000 7f9f9b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:27.206 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:23:27.137+0000 7f9f9b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:27.206 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:23:27.138+0000 7fa0c8920800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:23:27.206 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:23:27.138+0000 7fa0c8920800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:23:27.206 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:23:27.138+0000 7fa0c8920800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:23:27.206 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:23:27.138+0000 7fa0c8920800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:23:27.206 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:23:27.141+0000 7fa0c8920800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa0c8920800 time 2024-09-12T00:23:27.141644+0000 2024-09-12T00:23:27.206 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:23:27.206 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.206 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:27.206 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa0c9f8c71a] 2024-09-12T00:23:27.206 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa0c9f8c8d8] 2024-09-12T00:23:27.206 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1c8177641] 2024-09-12T00:23:27.207 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e1c818738a] 2024-09-12T00:23:27.207 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:23:27.207 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa0c8c29590] 2024-09-12T00:23:27.207 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:23:27.207 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:23:27.207 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.207 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:23:27.142+0000 7fa0c8920800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:23:27.207 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fa0c8920800 thread_name:radosgw-admin 2024-09-12T00:23:27.207 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.207 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:27.207 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa0c8c3e6f0] 2024-09-12T00:23:27.207 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa0c8c8b99c] 2024-09-12T00:23:27.207 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:23:27.208 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:23:27.208 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa0c9f8c774] 2024-09-12T00:23:27.208 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa0c9f8c8d8] 2024-09-12T00:23:27.208 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1c8177641] 2024-09-12T00:23:27.208 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e1c818738a] 2024-09-12T00:23:27.208 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:23:27.208 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa0c8c29590] 2024-09-12T00:23:27.208 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:23:27.208 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:23:27.208 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:23:27.208 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.208 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:23:27.208 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:23:27.209 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:23:27.209 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:23:27.209 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:23:27.209 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:23:27.209 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:23:27.209 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:23:27.209 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:23:27.209 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:23:27.209 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:23:27.209 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:23:27.209 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:23:27.209 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:23:27.209 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:23:27.209 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:23:27.210 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:23:27.210 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:23:27.210 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:23:27.210 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:23:27.210 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:23:27.210 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:23:27.210 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:23:27.210 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:23:27.210 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:23:27.210 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:23:27.210 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:23:27.210 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:23:27.210 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:23:27.211 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:23:27.211 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:23:27.211 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:23:27.211 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:23:27.211 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:23:27.211 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:23:27.211 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:23:27.211 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:23:27.211 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:23:27.211 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:23:27.211 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:23:27.211 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:23:27.211 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:23:27.211 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:23:27.212 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:23:27.212 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:23:27.212 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:23:27.212 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:23:27.212 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:23:27.212 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:23:27.212 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:23:27.212 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:23:27.212 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:23:27.212 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:23:27.212 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:23:27.212 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:23:27.212 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:23:27.212 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:23:27.213 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:23:27.213 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:23:27.213 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:23:27.213 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:23:27.213 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:23:27.213 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:23:27.213 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:23:27.213 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:23:27.213 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:23:27.213 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:23:27.213 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:23:27.213 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:23:27.213 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:23:27.214 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:23:27.214 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:23:27.214 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:23:27.214 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:23:27.214 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:23:27.214 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:23:27.214 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:23:27.214 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:23:27.214 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:23:27.214 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:23:27.214 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:23:27.214 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:23:27.214 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:23:27.214 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:23:27.215 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:23:27.215 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:23:27.215 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:23:27.215 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:23:27.215 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:23:27.215 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:23:27.215 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:23:27.215 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:23:27.215 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:23:27.215 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:23:27.215 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9eeb7fe640 / http_manager 2024-09-12T00:23:27.215 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9f79fdb640 / http_manager 2024-09-12T00:23:27.216 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9f7afdd640 / rgw_dt_lg_renew 2024-09-12T00:23:27.216 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9f99ffb640 / ms_dispatch 2024-09-12T00:23:27.216 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9f9b7fe640 / io_context_pool 2024-09-12T00:23:27.216 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9fa9ffb640 / ms_dispatch 2024-09-12T00:23:27.216 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9fb0e09640 / ms_dispatch 2024-09-12T00:23:27.216 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9fb260c640 / io_context_pool 2024-09-12T00:23:27.216 INFO:tasks.workunit.client.0.smithi067.stderr: 7fa0c3d01640 / msgr-worker-2 2024-09-12T00:23:27.216 INFO:tasks.workunit.client.0.smithi067.stderr: 7fa0c4502640 / msgr-worker-1 2024-09-12T00:23:27.216 INFO:tasks.workunit.client.0.smithi067.stderr: 7fa0c4d03640 / msgr-worker-0 2024-09-12T00:23:27.216 INFO:tasks.workunit.client.0.smithi067.stderr: 7fa0c5504640 / io_context_pool 2024-09-12T00:23:27.216 INFO:tasks.workunit.client.0.smithi067.stderr: 7fa0c8920800 / radosgw-admin 2024-09-12T00:23:27.216 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:23:27.217 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:23:27.217 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.150576.log 2024-09-12T00:23:27.217 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:23:27.217 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:23:27.217 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:23:26.473+0000 7fa0c8920800 1 librados: calling monclient init 2024-09-12T00:23:27.217 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:23:26.473+0000 7fa0c8920800 10 monclient: init 2024-09-12T00:23:27.217 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding auth protocol: cephx 2024-09-12T00:23:27.217 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding auth protocol: cephx 2024-09-12T00:23:27.217 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding auth protocol: cephx 2024-09-12T00:23:27.217 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: secure 2024-09-12T00:23:27.217 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: crc 2024-09-12T00:23:27.217 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: secure 2024-09-12T00:23:27.217 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: crc 2024-09-12T00:23:27.217 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: secure 2024-09-12T00:23:27.218 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: crc 2024-09-12T00:23:27.218 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: crc 2024-09-12T00:23:27.218 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: secure 2024-09-12T00:23:27.218 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: crc 2024-09-12T00:23:27.218 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: secure 2024-09-12T00:23:27.218 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: crc 2024-09-12T00:23:27.218 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:23:26.473+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca2e9770) adding con mode: secure 2024-09-12T00:23:27.218 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:23:26.474+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.218 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:23:26.474+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.218 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:23:26.474+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command rotate-key hook 0x55e1ca2e98b8 2024-09-12T00:23:27.218 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:27.218 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:23:27.218 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-c con 0x55e1ca161f90 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:27.219 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-b con 0x55e1ca196db0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:27.219 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-a con 0x55e1ca230250 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:27.219 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.219 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.219 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.219 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:27.219 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:23:26.474+0000 7fa0c8920800 10 monclient(hunting): authenticate will time out at 2083.730381s 2024-09-12T00:23:27.219 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): get_auth_request con 0x55e1ca161f90 auth_method 0 2024-09-12T00:23:27.219 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.219 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.219 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.219 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:23:26.474+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request con 0x55e1ca230250 auth_method 0 2024-09-12T00:23:27.219 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:23:26.474+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.220 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:23:26.474+0000 7fa0c4d03640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.220 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:23:26.474+0000 7fa0c4d03640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.220 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.220 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.220 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.220 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:23:26.474+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.220 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:23:26.474+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.220 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:23:26.474+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.220 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:23:26.474+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request con 0x55e1ca196db0 auth_method 0 2024-09-12T00:23:27.221 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:23:26.474+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.221 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:23:26.474+0000 7fa0c3d01640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.221 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:23:26.474+0000 7fa0c3d01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.221 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:23:26.474+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.221 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:23:26.474+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.221 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:23:26.474+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.221 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient(hunting): handle_auth_done global_id 7700 payload 824 2024-09-12T00:23:27.221 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient: _finish_hunting 0 2024-09-12T00:23:27.221 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:23:26.474+0000 7fa0c4502640 1 monclient: found mon.noname-c 2024-09-12T00:23:27.221 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:23:26.474+0000 7fa0c4502640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.221 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.221 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:23:27.221 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: dump: 2024-09-12T00:23:27.222 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.222 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.222 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.222 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.222 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.222 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.222 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.222 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.222 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.222 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.222 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: _finish_auth 0 2024-09-12T00:23:27.222 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: _check_auth_tickets 2024-09-12T00:23:27.222 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:27.223 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.223 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:23:27.223 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:23:26.475+0000 7f9fb0e09640 10 monclient: dump: 2024-09-12T00:23:27.223 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.223 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.223 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.223 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.223 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.223 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.223 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.223 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.223 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.224 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.224 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:23:26.475+0000 7fa0c8920800 5 monclient: authenticate success, global_id 7700 2024-09-12T00:23:27.224 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:23:26.475+0000 7fa0c8920800 10 monclient: _renew_subs 2024-09-12T00:23:27.224 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:23:26.475+0000 7fa0c8920800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.224 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:23:26.475+0000 7f9fb260c640 4 set_mon_vals no callback set 2024-09-12T00:23:27.224 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:23:26.475+0000 7fa0c8920800 10 monclient: _renew_subs 2024-09-12T00:23:27.224 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:23:26.475+0000 7fa0c8920800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.224 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:23:26.475+0000 7fa0c8920800 1 librados: init done 2024-09-12T00:23:27.224 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:23:26.477+0000 7f9fb0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:23:27.224 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:23:26.477+0000 7f9fb0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:27.224 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:23:26.477+0000 7f9fb0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:27.224 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:23:26.477+0000 7fa0c3d01640 10 monclient: get_auth_request con 0x7f9fac076470 auth_method 0 2024-09-12T00:23:27.224 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:23:26.477+0000 7fa0c4d03640 10 monclient: get_auth_request con 0x55e1ca311e70 auth_method 0 2024-09-12T00:23:27.225 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:23:26.478+0000 7fa0c4502640 10 monclient: get_auth_request con 0x55e1ca335080 auth_method 0 2024-09-12T00:23:27.225 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:23:26.479+0000 7fa0c3d01640 10 monclient: get_auth_request con 0x55e1ca339300 auth_method 0 2024-09-12T00:23:27.225 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:23:26.481+0000 7fa0c8920800 10 monclient: build_initial_monmap 2024-09-12T00:23:27.225 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:23:26.481+0000 7fa0c8920800 1 build_initial for_mkfs: 0 2024-09-12T00:23:27.225 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:23:26.481+0000 7fa0c8920800 10 monclient: monmap: 2024-09-12T00:23:27.225 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:23:27.225 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:23:27.225 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:23:27.225 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:23:27.225 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:23:27.225 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.225 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:23:27.225 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:23:27.226 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:23:27.226 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.226 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding auth protocol: cephx 2024-09-12T00:23:27.226 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding auth protocol: cephx 2024-09-12T00:23:27.226 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding auth protocol: cephx 2024-09-12T00:23:27.226 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: secure 2024-09-12T00:23:27.226 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: crc 2024-09-12T00:23:27.226 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: secure 2024-09-12T00:23:27.226 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: crc 2024-09-12T00:23:27.226 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: secure 2024-09-12T00:23:27.226 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: crc 2024-09-12T00:23:27.226 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: crc 2024-09-12T00:23:27.226 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: secure 2024-09-12T00:23:27.227 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: crc 2024-09-12T00:23:27.227 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: secure 2024-09-12T00:23:27.227 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: crc 2024-09-12T00:23:27.227 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33e0f0) adding con mode: secure 2024-09-12T00:23:27.227 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:23:26.481+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.227 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command objecter_requests cmddesc objecter_requests hook 0x55e1ca341ab0 EEXIST 2024-09-12T00:23:27.227 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:23:26.481+0000 7fa0c8920800 10 monclient: init 2024-09-12T00:23:27.227 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding auth protocol: cephx 2024-09-12T00:23:27.227 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding auth protocol: cephx 2024-09-12T00:23:27.227 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding auth protocol: cephx 2024-09-12T00:23:27.227 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: secure 2024-09-12T00:23:27.227 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: crc 2024-09-12T00:23:27.227 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: secure 2024-09-12T00:23:27.228 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: crc 2024-09-12T00:23:27.228 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: secure 2024-09-12T00:23:27.228 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: crc 2024-09-12T00:23:27.228 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: crc 2024-09-12T00:23:27.228 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: secure 2024-09-12T00:23:27.228 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: crc 2024-09-12T00:23:27.228 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: secure 2024-09-12T00:23:27.228 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: crc 2024-09-12T00:23:27.228 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:23:26.481+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca33c868) adding con mode: secure 2024-09-12T00:23:27.228 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:23:26.481+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.228 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:23:26.482+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.228 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:23:26.482+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command rotate-key cmddesc rotate-key hook 0x55e1ca33c9b0 EEXIST 2024-09-12T00:23:27.228 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:27.229 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:23:27.229 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-b con 0x55e1ca3657a0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:27.229 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-a con 0x55e1ca367a70 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:27.229 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-c con 0x55e1ca363f70 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:27.229 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.229 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.229 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.229 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:27.229 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:23:26.482+0000 7fa0c8920800 10 monclient(hunting): authenticate will time out at 2083.738330s 2024-09-12T00:23:27.229 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request con 0x55e1ca363f70 auth_method 0 2024-09-12T00:23:27.229 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.229 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.229 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.230 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:23:26.482+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request con 0x55e1ca367a70 auth_method 0 2024-09-12T00:23:27.230 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:23:26.482+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.230 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:23:26.482+0000 7fa0c3d01640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.230 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:23:26.482+0000 7fa0c3d01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.230 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:23:26.482+0000 7fa0c4502640 10 monclient(hunting): get_auth_request con 0x55e1ca3657a0 auth_method 0 2024-09-12T00:23:27.230 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:23:26.482+0000 7fa0c4502640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.230 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:23:26.482+0000 7fa0c4502640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.230 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:23:26.482+0000 7fa0c4502640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.230 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.230 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.230 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.230 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:23:26.482+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.230 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:23:26.482+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.231 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:23:26.482+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.231 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:23:26.482+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.231 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:23:26.482+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.231 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:23:26.482+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.231 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_done global_id 7703 payload 824 2024-09-12T00:23:27.231 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient: _finish_hunting 0 2024-09-12T00:23:27.231 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 1 monclient: found mon.noname-c 2024-09-12T00:23:27.231 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:23:26.482+0000 7fa0c4d03640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.231 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient: get_auth_request con 0x55e1ca363f70 auth_method 0 2024-09-12T00:23:27.231 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 0 --2- 172.21.15.67:0/3555390146 >> [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] conn(0x55e1ca363f70 0x55e1ca364370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:23:27.231 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient: ms_handle_reset current mon [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:27.231 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient: _reopen_session rank -1 2024-09-12T00:23:27.231 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:23:27.232 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient(hunting): picked mon.noname-a con 0x55e1ca367a70 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:27.232 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient(hunting): picked mon.noname-b con 0x55e1ca3657a0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:27.232 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f9f9c0072b0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:27.232 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.232 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.232 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.232 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:23:26.683+0000 7f9fa9ffb640 10 monclient(hunting): _renew_subs 2024-09-12T00:23:27.232 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): get_auth_request con 0x55e1ca367a70 auth_method 0 2024-09-12T00:23:27.232 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.232 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.232 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T00:23:27.232 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request con 0x7f9f9c0072b0 auth_method 0 2024-09-12T00:23:27.232 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.233 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.233 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T00:23:27.233 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.233 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.233 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T00:23:27.233 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.233 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.233 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:23:26.683+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T00:23:27.233 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient(hunting): handle_auth_done global_id 7703 payload 293 2024-09-12T00:23:27.233 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient: _finish_hunting 0 2024-09-12T00:23:27.233 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:23:26.683+0000 7fa0c4502640 1 monclient: found mon.noname-a 2024-09-12T00:23:27.233 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:23:26.683+0000 7fa0c4502640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:23:27.234 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.234 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:23:27.234 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: dump: 2024-09-12T00:23:27.234 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.234 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.234 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.234 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.234 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.234 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.234 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.234 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.234 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.234 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.235 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:23:27.235 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:23:27.235 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:27.235 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.235 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:23:27.235 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:23:26.684+0000 7f9fa9ffb640 10 monclient: dump: 2024-09-12T00:23:27.235 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.235 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.235 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.235 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.235 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.235 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.236 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.236 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.236 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.236 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.236 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:23:26.684+0000 7fa0c8920800 5 monclient: authenticate success, global_id 7703 2024-09-12T00:23:27.236 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:23:26.684+0000 7fa0c8920800 10 monclient: _renew_subs 2024-09-12T00:23:27.236 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:23:26.684+0000 7fa0c8920800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:23:27.236 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:23:26.684+0000 7fa0c5504640 4 set_mon_vals no callback set 2024-09-12T00:23:27.236 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:23:26.684+0000 7fa0c8920800 10 monclient: _renew_subs 2024-09-12T00:23:27.236 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:23:26.684+0000 7fa0c8920800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:23:27.236 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:23:26.686+0000 7f9fa9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:23:27.236 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:23:26.686+0000 7f9fa9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:27.236 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:23:26.686+0000 7f9fa9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:27.237 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:23:26.686+0000 7fa0c3d01640 10 monclient: get_auth_request con 0x55e1ca363f70 auth_method 0 2024-09-12T00:23:27.237 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:23:26.686+0000 7fa0c8920800 10 monclient: get_monmap_and_config 2024-09-12T00:23:27.237 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:23:26.686+0000 7fa0c8920800 10 monclient: build_initial_monmap 2024-09-12T00:23:27.237 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:23:26.686+0000 7fa0c8920800 1 build_initial for_mkfs: 0 2024-09-12T00:23:27.237 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:23:26.686+0000 7fa0c8920800 10 monclient: monmap: 2024-09-12T00:23:27.237 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:23:27.237 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:23:27.237 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:23:27.237 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:23:27.237 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:23:27.237 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.237 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:23:27.237 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:23:27.238 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:23:27.238 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.238 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding auth protocol: cephx 2024-09-12T00:23:27.238 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding auth protocol: cephx 2024-09-12T00:23:27.238 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding auth protocol: cephx 2024-09-12T00:23:27.238 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: secure 2024-09-12T00:23:27.238 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: crc 2024-09-12T00:23:27.238 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: secure 2024-09-12T00:23:27.238 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: crc 2024-09-12T00:23:27.238 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: secure 2024-09-12T00:23:27.238 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: crc 2024-09-12T00:23:27.238 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: crc 2024-09-12T00:23:27.238 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: secure 2024-09-12T00:23:27.239 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: crc 2024-09-12T00:23:27.239 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: secure 2024-09-12T00:23:27.239 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: crc 2024-09-12T00:23:27.239 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37e8a0) adding con mode: secure 2024-09-12T00:23:27.239 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:23:26.686+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.239 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:23:26.686+0000 7fa0c8920800 10 monclient: init 2024-09-12T00:23:27.239 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding auth protocol: cephx 2024-09-12T00:23:27.239 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding auth protocol: cephx 2024-09-12T00:23:27.239 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding auth protocol: cephx 2024-09-12T00:23:27.239 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: secure 2024-09-12T00:23:27.239 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: crc 2024-09-12T00:23:27.239 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: secure 2024-09-12T00:23:27.239 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: crc 2024-09-12T00:23:27.239 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: secure 2024-09-12T00:23:27.240 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: crc 2024-09-12T00:23:27.240 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: crc 2024-09-12T00:23:27.240 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: secure 2024-09-12T00:23:27.240 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: crc 2024-09-12T00:23:27.240 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: secure 2024-09-12T00:23:27.240 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: crc 2024-09-12T00:23:27.240 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:23:26.686+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c0b0) adding con mode: secure 2024-09-12T00:23:27.240 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:23:26.687+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.240 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:23:26.687+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.240 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:23:26.687+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command rotate-key cmddesc rotate-key hook 0x7fff3176c1f8 EEXIST 2024-09-12T00:23:27.240 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:27.240 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:23:27.240 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-b con 0x55e1ca3b2aa0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:27.241 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-a con 0x55e1ca3828b0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:27.241 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-c con 0x55e1ca3ade60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:27.241 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.241 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.241 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.241 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:27.241 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:23:26.687+0000 7fa0c8920800 10 monclient(hunting): authenticate will time out at 2083.943474s 2024-09-12T00:23:27.241 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request con 0x55e1ca3ade60 auth_method 0 2024-09-12T00:23:27.241 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.241 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.241 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.241 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:23:26.687+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request con 0x55e1ca3828b0 auth_method 0 2024-09-12T00:23:27.241 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:23:26.687+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.242 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:23:26.687+0000 7fa0c3d01640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.242 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:23:26.687+0000 7fa0c3d01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.242 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.242 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.242 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.242 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:23:26.687+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.242 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:23:26.687+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.242 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:23:26.687+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.242 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_done global_id 7706 payload 274 2024-09-12T00:23:27.242 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient: _finish_hunting 0 2024-09-12T00:23:27.242 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 1 monclient: found mon.noname-c 2024-09-12T00:23:27.242 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:23:26.687+0000 7fa0c4d03640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.242 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:23:26.687+0000 7fa0c4502640 10 monclient: get_auth_request con 0x55e1ca3b2aa0 auth_method 0 2024-09-12T00:23:27.242 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.243 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:23:27.243 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: dump: 2024-09-12T00:23:27.243 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.243 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.243 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.243 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.243 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.243 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.243 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.243 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.243 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.243 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.243 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:23:27.244 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:23:27.244 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:27.244 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.244 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:23:27.244 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:23:26.688+0000 7f9f9b7fe640 10 monclient: dump: 2024-09-12T00:23:27.244 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.244 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.244 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.244 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.244 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.244 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.244 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.244 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.244 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.245 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.245 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 monclient: authenticate success, global_id 7706 2024-09-12T00:23:27.245 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:23:26.688+0000 7fa0c8920800 10 monclient: get_monmap_and_config success 2024-09-12T00:23:27.245 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:23:26.688+0000 7fa0c8920800 4 set_mon_vals no callback set 2024-09-12T00:23:27.245 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:23:26.688+0000 7fa0c8920800 10 monclient: shutdown 2024-09-12T00:23:27.245 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:23:26.688+0000 7fa0c8920800 10 monclient: build_initial_monmap 2024-09-12T00:23:27.245 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:23:26.688+0000 7fa0c8920800 1 build_initial for_mkfs: 0 2024-09-12T00:23:27.245 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:23:26.688+0000 7fa0c8920800 10 monclient: monmap: 2024-09-12T00:23:27.245 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:23:27.245 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:23:27.245 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:23:27.245 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:23:27.245 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:23:27.245 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.246 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:23:27.246 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:23:27.246 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:23:27.246 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.246 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding auth protocol: cephx 2024-09-12T00:23:27.246 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding auth protocol: cephx 2024-09-12T00:23:27.246 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding auth protocol: cephx 2024-09-12T00:23:27.246 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: secure 2024-09-12T00:23:27.246 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: crc 2024-09-12T00:23:27.246 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: secure 2024-09-12T00:23:27.246 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: crc 2024-09-12T00:23:27.246 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: secure 2024-09-12T00:23:27.246 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: crc 2024-09-12T00:23:27.247 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: crc 2024-09-12T00:23:27.247 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: secure 2024-09-12T00:23:27.247 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: crc 2024-09-12T00:23:27.247 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: secure 2024-09-12T00:23:27.247 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: crc 2024-09-12T00:23:27.247 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:23:26.688+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca3836f0) adding con mode: secure 2024-09-12T00:23:27.247 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:23:26.689+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.247 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:23:26.689+0000 7fa0c8920800 1 librados: starting msgr at 2024-09-12T00:23:27.247 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:23:26.689+0000 7fa0c8920800 1 librados: starting objecter 2024-09-12T00:23:27.247 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command objecter_requests cmddesc objecter_requests hook 0x55e1ca380e10 EEXIST 2024-09-12T00:23:27.247 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:23:26.689+0000 7fa0c8920800 1 librados: setting wanted keys 2024-09-12T00:23:27.247 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:23:26.689+0000 7fa0c8920800 1 librados: calling monclient init 2024-09-12T00:23:27.247 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient: init 2024-09-12T00:23:27.247 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding auth protocol: cephx 2024-09-12T00:23:27.248 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding auth protocol: cephx 2024-09-12T00:23:27.248 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding auth protocol: cephx 2024-09-12T00:23:27.248 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: secure 2024-09-12T00:23:27.248 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: crc 2024-09-12T00:23:27.248 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: secure 2024-09-12T00:23:27.248 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: crc 2024-09-12T00:23:27.248 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: secure 2024-09-12T00:23:27.248 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: crc 2024-09-12T00:23:27.248 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: crc 2024-09-12T00:23:27.248 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: secure 2024-09-12T00:23:27.248 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: crc 2024-09-12T00:23:27.248 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: secure 2024-09-12T00:23:27.248 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: crc 2024-09-12T00:23:27.249 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 AuthRegistry(0x55e1ca37d550) adding con mode: secure 2024-09-12T00:23:27.249 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:23:26.689+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.249 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:23:26.689+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.249 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:23:26.689+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command rotate-key cmddesc rotate-key hook 0x55e1ca37d698 EEXIST 2024-09-12T00:23:27.249 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:27.249 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:23:27.249 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-a con 0x55e1ca3828b0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:27.249 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-c con 0x55e1ca3ade60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:27.249 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): picked mon.noname-b con 0x55e1ca3b2aa0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:27.249 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.249 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.249 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:27.249 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:27.250 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:23:26.689+0000 7fa0c8920800 10 monclient(hunting): authenticate will time out at 2083.945983s 2024-09-12T00:23:27.250 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request con 0x55e1ca3ade60 auth_method 0 2024-09-12T00:23:27.250 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.250 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.250 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.250 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:23:26.690+0000 7fa0c4502640 10 monclient(hunting): get_auth_request con 0x55e1ca3828b0 auth_method 0 2024-09-12T00:23:27.250 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:23:26.690+0000 7fa0c4502640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.250 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:23:26.690+0000 7fa0c4502640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.250 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:23:26.690+0000 7fa0c4502640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.250 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.250 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.250 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.250 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:23:26.690+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.251 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:23:26.690+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.251 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:23:26.690+0000 7fa0c4502640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.251 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:23:26.690+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request con 0x55e1ca3b2aa0 auth_method 0 2024-09-12T00:23:27.251 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:23:26.690+0000 7fa0c4d03640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:27.251 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:23:26.690+0000 7fa0c4d03640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:27.251 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:23:26.690+0000 7fa0c4d03640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:27.251 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:23:26.690+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:27.251 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:23:26.690+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:27.251 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:23:26.690+0000 7fa0c4d03640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:27.251 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient(hunting): handle_auth_done global_id 7709 payload 824 2024-09-12T00:23:27.251 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient: _finish_hunting 0 2024-09-12T00:23:27.251 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 1 monclient: found mon.noname-c 2024-09-12T00:23:27.251 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:23:26.690+0000 7fa0c3d01640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.251 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.252 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:23:27.252 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: dump: 2024-09-12T00:23:27.252 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.252 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.252 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.252 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.252 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.252 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.252 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.252 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.252 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.252 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.252 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: _finish_auth 0 2024-09-12T00:23:27.253 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:23:27.253 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:27.253 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:27.253 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:23:27.253 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:23:26.690+0000 7f9f99ffb640 10 monclient: dump: 2024-09-12T00:23:27.253 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:27.253 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:27.253 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.253 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:27.253 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:27.253 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:27.253 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:27.253 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:27.254 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:27.254 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.254 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:23:26.690+0000 7fa0c8920800 5 monclient: authenticate success, global_id 7709 2024-09-12T00:23:27.254 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:23:26.690+0000 7fa0c8920800 10 monclient: _renew_subs 2024-09-12T00:23:27.254 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:23:26.690+0000 7f9f9b7fe640 4 set_mon_vals no callback set 2024-09-12T00:23:27.254 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:23:26.690+0000 7fa0c8920800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.254 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:23:26.690+0000 7fa0c8920800 10 monclient: _renew_subs 2024-09-12T00:23:27.254 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:23:26.690+0000 7fa0c8920800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:27.254 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:23:26.690+0000 7fa0c8920800 1 librados: init done 2024-09-12T00:23:27.254 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:23:26.690+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command cr dump hook 0x55e1ca3a9ec8 2024-09-12T00:23:27.254 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:23:26.692+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.254 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:23:26.692+0000 7f9f99ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:23:27.254 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:23:26.692+0000 7f9f99ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:27.255 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:23:26.692+0000 7f9f99ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:27.255 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:23:26.693+0000 7fa0c4502640 10 monclient: get_auth_request con 0x7f9f8c076470 auth_method 0 2024-09-12T00:23:27.255 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:23:26.693+0000 7fa0c4d03640 10 monclient: get_auth_request con 0x55e1ca3cc960 auth_method 0 2024-09-12T00:23:27.255 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.255 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:23:26.694+0000 7fa0c8920800 20 realm 2024-09-12T00:23:27.255 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.255 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.255 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:23:26.694+0000 7fa0c8920800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:27.255 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.255 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.255 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:23:26.694+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.255 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:23:26.694+0000 7fa0c4502640 10 monclient: get_auth_request con 0x55e1ca3d0c40 auth_method 0 2024-09-12T00:23:27.255 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:23:26.695+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:27.255 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:23:26.695+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.256 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:23:26.695+0000 7fa0c3d01640 10 monclient: get_auth_request con 0x55e1ca3d4360 auth_method 0 2024-09-12T00:23:27.256 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:23:26.696+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:27.256 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:23:26.696+0000 7fa0c8920800 20 searching for the correct realm 2024-09-12T00:23:27.256 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:23:26.696+0000 7fa0c4d03640 10 monclient: get_auth_request con 0x7fa0b804e060 auth_method 0 2024-09-12T00:23:27.256 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:23:26.698+0000 7fa0c4502640 10 monclient: get_auth_request con 0x7fa0b4061c20 auth_method 0 2024-09-12T00:23:27.256 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:23:26.698+0000 7fa0c4502640 0 -- 172.21.15.67:0/2700414496 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7fa0b4061c20 msgr2=0x7fa0b4087d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:23:27.256 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:23:26.900+0000 7fa0c4502640 10 monclient: get_auth_request con 0x7fa0b4061c20 auth_method 0 2024-09-12T00:23:27.256 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:23:26.901+0000 7fa0c3d01640 10 monclient: get_auth_request con 0x7fa0b801f070 auth_method 0 2024-09-12T00:23:27.256 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:23:26.903+0000 7fa0c4d03640 10 monclient: get_auth_request con 0x7fa0b401f060 auth_method 0 2024-09-12T00:23:27.256 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:23:26.904+0000 7fa0c4502640 0 -- 172.21.15.67:0/2700414496 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fa0bc055410 msgr2=0x7fa0bc055890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:27.256 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:23:26.904+0000 7fa0c4502640 10 monclient: get_auth_request con 0x7fa0bc055410 auth_method 0 2024-09-12T00:23:27.256 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:23:27.106+0000 7fa0c4502640 10 monclient: get_auth_request con 0x7fa0bc055410 auth_method 0 2024-09-12T00:23:27.256 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:27.257 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:27.257 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:23:27.257 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:23:27.257 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:27.257 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:27.257 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.257 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.257 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:23:27.113+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.257 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:23:27.114+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:27.257 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:23:27.114+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.257 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:23:27.114+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:27.257 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:23:27.114+0000 7fa0c8920800 20 zone default found 2024-09-12T00:23:27.258 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:23:27.114+0000 7fa0c8920800 4 Realm: () 2024-09-12T00:23:27.258 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:23:27.114+0000 7fa0c8920800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:23:27.258 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:23:27.114+0000 7fa0c8920800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:23:27.258 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:23:27.114+0000 7fa0c8920800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:27.258 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:23:27.114+0000 7fa0c8920800 20 zonegroup default 2024-09-12T00:23:27.258 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:23:27.114+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.258 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:23:27.115+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.258 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:23:27.115+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.258 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:23:27.115+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.258 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:23:27.115+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.258 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:23:27.115+0000 7fa0c8920800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.258 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:23:27.115+0000 7fa0c8920800 20 started sync module instance, tier type = 2024-09-12T00:23:27.258 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:23:27.115+0000 7fa0c8920800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:23:27.259 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=0 2024-09-12T00:23:27.259 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=1 2024-09-12T00:23:27.259 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=2 2024-09-12T00:23:27.259 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=3 2024-09-12T00:23:27.259 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=4 2024-09-12T00:23:27.259 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=5 2024-09-12T00:23:27.259 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:23:27.126+0000 7fa0c8920800 20 add_watcher() i=6 2024-09-12T00:23:27.259 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:23:27.127+0000 7fa0c8920800 20 add_watcher() i=7 2024-09-12T00:23:27.259 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:23:27.127+0000 7fa0c8920800 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:27.259 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding auth protocol: cephx 2024-09-12T00:23:27.259 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding auth protocol: cephx 2024-09-12T00:23:27.259 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding auth protocol: cephx 2024-09-12T00:23:27.259 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: secure 2024-09-12T00:23:27.259 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: crc 2024-09-12T00:23:27.260 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: secure 2024-09-12T00:23:27.260 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: crc 2024-09-12T00:23:27.260 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: secure 2024-09-12T00:23:27.260 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: crc 2024-09-12T00:23:27.260 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: crc 2024-09-12T00:23:27.260 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: secure 2024-09-12T00:23:27.260 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: crc 2024-09-12T00:23:27.260 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: secure 2024-09-12T00:23:27.260 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: crc 2024-09-12T00:23:27.260 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 AuthRegistry(0x7fff3176c590) adding con mode: secure 2024-09-12T00:23:27.260 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:23:27.129+0000 7f9f7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:27.260 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:23:27.129+0000 7fa0c8920800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:27.260 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:23:27.129+0000 7fa0c8920800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:27.260 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:23:27.129+0000 7fa0c8920800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:27.261 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command cache list hook 0x55e1ca3a72f0 2024-09-12T00:23:27.261 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command cache inspect hook 0x55e1ca3a72f0 2024-09-12T00:23:27.261 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command cache erase hook 0x55e1ca3a72f0 2024-09-12T00:23:27.261 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:23:27.129+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command cache zap hook 0x55e1ca3a72f0 2024-09-12T00:23:27.261 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:23:27.130+0000 7fa0c8920800 5 note: GC not initialized 2024-09-12T00:23:27.261 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:23:27.130+0000 7f9f79fdb640 20 reqs_thread_entry: start 2024-09-12T00:23:27.261 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:23:27.130+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command sync trace show hook 0x7fa0b40043a0 2024-09-12T00:23:27.261 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:23:27.130+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command sync trace history hook 0x7fa0b40043a0 2024-09-12T00:23:27.261 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:23:27.130+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command sync trace active hook 0x7fa0b40043a0 2024-09-12T00:23:27.261 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:23:27.130+0000 7fa0c8920800 5 asok(0x55e1ca0c9630) register_command sync trace active_short hook 0x7fa0b40043a0 2024-09-12T00:23:27.261 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:23:27.130+0000 7fa0c8920800 20 init_complete bucket index max shards: 1 2024-09-12T00:23:27.261 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:23:27.130+0000 7fa0c8920800 20 Filter name: none 2024-09-12T00:23:27.262 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:23:27.130+0000 7f9eeb7fe640 20 reqs_thread_entry: start 2024-09-12T00:23:27.262 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:23:27.130+0000 7fa0c8920800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:23:27.262 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:23:27.130+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.262 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:23:27.131+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:27.262 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:23:27.262 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:23:27.262 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:23:27.262 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:23:27.131+0000 7fa0c8920800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.262 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:23:27.131+0000 7fa0c8920800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:23:27.262 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:27.262 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:27.262 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:27.262 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:27.262 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:23:27.131+0000 7fa0c8920800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:23:27.262 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:23:27.136+0000 7fa0c8920800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:27.263 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:23:27.136+0000 7fa0c8920800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:27.263 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:23:27.136+0000 7fa0c8920800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:27.263 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:23:27.136+0000 7fa0c8920800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:23:27.263 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:23:27.137+0000 7f9f9b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562482 cookie 94428249066144 notifier 7709 bl.length()=827 2024-09-12T00:23:27.263 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:23:27.137+0000 7f9f9b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:27.263 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:23:27.137+0000 7f9f9b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:27.263 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:23:27.137+0000 7f9f9b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:27.263 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:23:27.138+0000 7fa0c8920800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:23:27.263 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:23:27.138+0000 7fa0c8920800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:23:27.263 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:23:27.138+0000 7fa0c8920800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:23:27.263 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:23:27.138+0000 7fa0c8920800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:23:27.263 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:23:27.141+0000 7fa0c8920800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa0c8920800 time 2024-09-12T00:23:27.141644+0000 2024-09-12T00:23:27.264 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:23:27.264 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.264 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:27.264 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa0c9f8c71a] 2024-09-12T00:23:27.264 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa0c9f8c8d8] 2024-09-12T00:23:27.264 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1c8177641] 2024-09-12T00:23:27.264 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e1c818738a] 2024-09-12T00:23:27.264 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:23:27.264 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa0c8c29590] 2024-09-12T00:23:27.264 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:23:27.264 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:23:27.264 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.264 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:23:27.142+0000 7fa0c8920800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:23:27.265 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fa0c8920800 thread_name:radosgw-admin 2024-09-12T00:23:27.265 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.265 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:27.265 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa0c8c3e6f0] 2024-09-12T00:23:27.265 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa0c8c8b99c] 2024-09-12T00:23:27.265 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:23:27.265 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:23:27.265 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa0c9f8c774] 2024-09-12T00:23:27.265 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa0c9f8c8d8] 2024-09-12T00:23:27.265 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e1c8177641] 2024-09-12T00:23:27.265 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55e1c818738a] 2024-09-12T00:23:27.265 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:23:27.265 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa0c8c29590] 2024-09-12T00:23:27.265 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:23:27.266 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:23:27.266 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:23:27.266 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:27.266 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:23:27.266 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:23:27.266 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:23:27.266 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:23:27.266 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:23:27.266 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:23:27.266 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:23:27.266 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:23:27.266 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:23:27.266 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:23:27.267 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:23:27.267 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:23:27.267 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:23:27.267 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:23:27.267 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:23:27.267 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:23:27.267 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:23:27.267 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:23:27.267 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:23:27.267 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:23:27.267 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:23:27.267 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:23:27.267 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:23:27.267 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:23:27.267 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:23:27.268 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:23:27.268 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:23:27.268 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:23:27.268 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:23:27.268 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:23:27.268 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:23:27.268 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:23:27.268 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:23:27.268 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:23:27.268 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:23:27.268 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:23:27.268 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:23:27.268 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:23:27.268 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:23:27.269 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:23:27.269 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:23:27.269 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:23:27.269 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:23:27.269 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:23:27.269 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:23:27.269 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:23:27.269 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:23:27.269 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:23:27.269 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:23:27.269 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:23:27.269 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:23:27.270 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:23:27.270 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:23:27.270 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:23:27.270 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:23:27.270 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:23:27.270 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:23:27.270 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:23:27.270 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:23:27.270 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:23:27.270 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:23:27.270 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:23:27.270 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:23:27.270 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:23:27.271 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:23:27.271 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:23:27.271 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:23:27.271 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:23:27.271 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:23:27.271 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:23:27.271 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:23:27.271 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:23:27.271 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:23:27.271 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:23:27.271 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:23:27.271 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:23:27.271 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:23:27.272 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:23:27.272 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:23:27.272 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:23:27.272 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:23:27.272 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:23:27.272 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:23:27.272 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:23:27.272 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:23:27.272 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:23:27.272 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:23:27.272 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:23:27.272 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:23:27.273 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:23:27.273 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:23:27.273 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:23:27.273 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:23:27.273 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:23:27.273 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9eeb7fe640 / http_manager 2024-09-12T00:23:27.273 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9f79fdb640 / http_manager 2024-09-12T00:23:27.273 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9f7afdd640 / rgw_dt_lg_renew 2024-09-12T00:23:27.273 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9f99ffb640 / ms_dispatch 2024-09-12T00:23:27.273 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9f9b7fe640 / io_context_pool 2024-09-12T00:23:27.273 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9fa9ffb640 / ms_dispatch 2024-09-12T00:23:27.273 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9fb0e09640 / ms_dispatch 2024-09-12T00:23:27.273 INFO:tasks.workunit.client.0.smithi067.stderr: 7f9fb260c640 / io_context_pool 2024-09-12T00:23:27.274 INFO:tasks.workunit.client.0.smithi067.stderr: 7fa0c3d01640 / msgr-worker-2 2024-09-12T00:23:27.274 INFO:tasks.workunit.client.0.smithi067.stderr: 7fa0c4502640 / msgr-worker-1 2024-09-12T00:23:27.274 INFO:tasks.workunit.client.0.smithi067.stderr: 7fa0c4d03640 / msgr-worker-0 2024-09-12T00:23:27.274 INFO:tasks.workunit.client.0.smithi067.stderr: 7fa0c5504640 / io_context_pool 2024-09-12T00:23:27.274 INFO:tasks.workunit.client.0.smithi067.stderr: 7fa0c8920800 / radosgw-admin 2024-09-12T00:23:27.274 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:23:27.274 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:23:27.274 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:23:27.143072Z_c53f3eaf-83da-4057-9796-ca0e9c74f4bc/log 2024-09-12T00:23:27.274 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:23:27.274 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:23:27.276 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:27.276 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:27.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.230+0000 7f235f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.233+0000 7f235f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.233+0000 7f235f80f800 20 realm 2024-09-12T00:23:27.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.233+0000 7f235f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.233+0000 7f235f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.233+0000 7f235f80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:27.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.233+0000 7f235f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.234+0000 7f235f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.234+0000 7f235f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.234+0000 7f235f80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:27.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.234+0000 7f235f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.235+0000 7f235f80f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:27.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.235+0000 7f235f80f800 20 searching for the correct realm 2024-09-12T00:23:27.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.237+0000 7f235d2f9640 0 -- 172.21.15.67:0/1068327257 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f2350088060 msgr2=0x7f235006ba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:27.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.241+0000 7f235d2f9640 0 -- 172.21.15.67:0/1068327257 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f235800f940 msgr2=0x7f2358035420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:27.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.448+0000 7f235f80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:27.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.448+0000 7f235f80f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:27.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.448+0000 7f235f80f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:23:27.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.448+0000 7f235f80f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:23:27.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.448+0000 7f235f80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:27.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.448+0000 7f235f80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:27.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.448+0000 7f235f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.448+0000 7f235f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.448+0000 7f235f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.449+0000 7f235f80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:27.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.449+0000 7f235f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.449+0000 7f235f80f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:27.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.449+0000 7f235f80f800 20 zone default found 2024-09-12T00:23:27.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.449+0000 7f235f80f800 4 Realm: () 2024-09-12T00:23:27.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.449+0000 7f235f80f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:23:27.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.449+0000 7f235f80f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:23:27.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.449+0000 7f235f80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:27.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.449+0000 7f235f80f800 20 zonegroup default 2024-09-12T00:23:27.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.449+0000 7f235f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.449+0000 7f235f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.449+0000 7f235f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.450+0000 7f235f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.450+0000 7f235f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.450+0000 7f235f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.450+0000 7f235f80f800 20 started sync module instance, tier type = 2024-09-12T00:23:27.450 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.450+0000 7f235f80f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:23:27.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.460+0000 7f235f80f800 20 add_watcher() i=0 2024-09-12T00:23:27.458 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.460+0000 7f235f80f800 20 add_watcher() i=1 2024-09-12T00:23:27.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.460+0000 7f235f80f800 20 add_watcher() i=2 2024-09-12T00:23:27.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.460+0000 7f235f80f800 20 add_watcher() i=3 2024-09-12T00:23:27.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.460+0000 7f235f80f800 20 add_watcher() i=4 2024-09-12T00:23:27.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.460+0000 7f235f80f800 20 add_watcher() i=5 2024-09-12T00:23:27.459 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.460+0000 7f235f80f800 20 add_watcher() i=6 2024-09-12T00:23:27.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.461+0000 7f235f80f800 20 add_watcher() i=7 2024-09-12T00:23:27.460 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.461+0000 7f235f80f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:27.461 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.463+0000 7f22137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:27.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.464+0000 7f235f80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:27.463 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.464+0000 7f235f80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:27.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.464+0000 7f235f80f800 5 note: GC not initialized 2024-09-12T00:23:27.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.464+0000 7f22127e4640 20 reqs_thread_entry: start 2024-09-12T00:23:27.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.464+0000 7f235f80f800 20 init_complete bucket index max shards: 1 2024-09-12T00:23:27.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.464+0000 7f235f80f800 20 Filter name: none 2024-09-12T00:23:27.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.464+0000 7f2183fff640 20 reqs_thread_entry: start 2024-09-12T00:23:27.464 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.464+0000 7f235f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.465+0000 7f235f80f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:27.465 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.465+0000 7f235f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.466+0000 7f235f80f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:23:27.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.466+0000 7f235f80f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:27.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.466+0000 7f235f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.466+0000 7f235f80f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:27.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.466+0000 7f235f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.466+0000 7f235f80f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:23:27.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.466+0000 7f235f80f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:23:27.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.468+0000 7f22137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:27.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.470+0000 7f235f80f800 20 remove_watcher() i=0 2024-09-12T00:23:27.469 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.470+0000 7f235f80f800 2 removed watcher, disabling cache 2024-09-12T00:23:27.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.471+0000 7f235f80f800 20 remove_watcher() i=1 2024-09-12T00:23:27.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.472+0000 7f235f80f800 20 remove_watcher() i=2 2024-09-12T00:23:27.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.473+0000 7f235f80f800 20 remove_watcher() i=3 2024-09-12T00:23:27.473 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.475+0000 7f235f80f800 20 remove_watcher() i=4 2024-09-12T00:23:27.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.476+0000 7f235f80f800 20 remove_watcher() i=5 2024-09-12T00:23:27.475 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.477+0000 7f235f80f800 20 remove_watcher() i=6 2024-09-12T00:23:27.476 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.478+0000 7f235f80f800 20 remove_watcher() i=7 2024-09-12T00:23:27.501 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:23:27.530 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:27.530 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:27.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.572+0000 7f114773c800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.573+0000 7f114773c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.573+0000 7f114773c800 20 realm 2024-09-12T00:23:27.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.573+0000 7f114773c800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.573+0000 7f114773c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.573+0000 7f114773c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:27.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.573+0000 7f114773c800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.574+0000 7f114773c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.574+0000 7f114773c800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.574+0000 7f114773c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:27.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.574+0000 7f114773c800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.575+0000 7f114773c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:27.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.575+0000 7f114773c800 20 searching for the correct realm 2024-09-12T00:23:27.577 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.579+0000 7f1143c82640 0 -- 172.21.15.67:0/1950686565 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7f1138082b60 msgr2=0x7f1138064430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:27.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.582+0000 7f1143481640 0 -- 172.21.15.67:0/1950686565 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f113c017070 msgr2=0x7f113c064d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:23:27.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:27.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:27.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:23:27.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:23:27.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:27.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:27.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:27.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:27.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 20 zone default found 2024-09-12T00:23:27.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 4 Realm: () 2024-09-12T00:23:27.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:23:27.586 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:23:27.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:27.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 20 zonegroup default 2024-09-12T00:23:27.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.586+0000 7f114773c800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.587+0000 7f114773c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.587+0000 7f114773c800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.587+0000 7f114773c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.587+0000 7f114773c800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.587+0000 7f114773c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:27.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.587+0000 7f114773c800 20 started sync module instance, tier type = 2024-09-12T00:23:27.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.587+0000 7f114773c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:23:27.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.596+0000 7f114773c800 20 add_watcher() i=0 2024-09-12T00:23:27.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.596+0000 7f114773c800 20 add_watcher() i=1 2024-09-12T00:23:27.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.596+0000 7f114773c800 20 add_watcher() i=2 2024-09-12T00:23:27.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.596+0000 7f114773c800 20 add_watcher() i=3 2024-09-12T00:23:27.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.596+0000 7f114773c800 20 add_watcher() i=4 2024-09-12T00:23:27.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.596+0000 7f114773c800 20 add_watcher() i=5 2024-09-12T00:23:27.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.596+0000 7f114773c800 20 add_watcher() i=6 2024-09-12T00:23:27.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.597+0000 7f114773c800 20 add_watcher() i=7 2024-09-12T00:23:27.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.597+0000 7f114773c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:27.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.598+0000 7f0ff9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:27.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.599+0000 7f114773c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:27.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.599+0000 7f114773c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:27.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.599+0000 7f114773c800 5 note: GC not initialized 2024-09-12T00:23:27.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.599+0000 7f0ff8fe1640 20 reqs_thread_entry: start 2024-09-12T00:23:27.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.599+0000 7f114773c800 20 init_complete bucket index max shards: 1 2024-09-12T00:23:27.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.599+0000 7f114773c800 20 Filter name: none 2024-09-12T00:23:27.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.599+0000 7f0f727fc640 20 reqs_thread_entry: start 2024-09-12T00:23:27.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.599+0000 7f114773c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:23:27.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.599+0000 7f114773c800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.600+0000 7f114773c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:27.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.600+0000 7f114773c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:23:27.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.600+0000 7f114773c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:23:27.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.600+0000 7f114773c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:23:27.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.600+0000 7f114773c800 20 rados->read ofs=0 len=0 2024-09-12T00:23:27.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.600+0000 7f114773c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:23:27.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.600+0000 7f114773c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:27.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.600+0000 7f114773c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:27.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.600+0000 7f114773c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:27.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.600+0000 7f114773c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:27.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.600+0000 7f114773c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:23:27.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.600+0000 7f114773c800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:23:27.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.600+0000 7f114773c800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:23:27.600 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.600+0000 7f114773c800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:23:27.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.600+0000 7f114773c800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:23:27.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.601+0000 7f114773c800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:23:27.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.601+0000 7f114773c800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:23:27.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.602+0000 7f0ff9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:27.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.604+0000 7f114773c800 20 remove_watcher() i=0 2024-09-12T00:23:27.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.604+0000 7f114773c800 2 removed watcher, disabling cache 2024-09-12T00:23:27.603 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.605+0000 7f114773c800 20 remove_watcher() i=1 2024-09-12T00:23:27.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.606+0000 7f114773c800 20 remove_watcher() i=2 2024-09-12T00:23:27.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.607+0000 7f114773c800 20 remove_watcher() i=3 2024-09-12T00:23:27.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.608+0000 7f114773c800 20 remove_watcher() i=4 2024-09-12T00:23:27.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.609+0000 7f114773c800 20 remove_watcher() i=5 2024-09-12T00:23:27.608 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.610+0000 7f114773c800 20 remove_watcher() i=6 2024-09-12T00:23:27.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:27.611+0000 7f114773c800 20 remove_watcher() i=7 2024-09-12T00:23:57.633 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:23:57.671 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:57.672 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:57.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.718+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:57.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:57.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.720+0000 7fc7e912e800 20 realm 2024-09-12T00:23:57.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:57.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:57.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.720+0000 7fc7e912e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:57.719 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:57.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:57.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:57.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.721+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:57.720 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.721+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:57.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.722+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:57.721 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.722+0000 7fc7e912e800 20 searching for the correct realm 2024-09-12T00:23:57.724 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.725+0000 7fc7e46dc640 0 -- 172.21.15.67:0/3373398851 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fc7d8048b70 msgr2=0x7fc7d8041410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:23:57.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.931+0000 7fc7e46dc640 0 -- 172.21.15.67:0/3373398851 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5620edfdb550 msgr2=0x5620edfdd9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:57.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:57.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:57.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:23:57.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:23:57.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:57.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:57.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.937+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:57.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.937+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:57.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.937+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:57.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.937+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:57.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.937+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:57.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:57.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.938+0000 7fc7e912e800 20 zone default found 2024-09-12T00:23:57.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.938+0000 7fc7e912e800 4 Realm: () 2024-09-12T00:23:57.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.938+0000 7fc7e912e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:23:57.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.938+0000 7fc7e912e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:23:57.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.938+0000 7fc7e912e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:57.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.938+0000 7fc7e912e800 20 zonegroup default 2024-09-12T00:23:57.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:57.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:57.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:57.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:57.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:57.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.939+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:57.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.939+0000 7fc7e912e800 20 started sync module instance, tier type = 2024-09-12T00:23:57.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.939+0000 7fc7e912e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:23:57.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=0 2024-09-12T00:23:57.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=1 2024-09-12T00:23:57.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=2 2024-09-12T00:23:57.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=3 2024-09-12T00:23:57.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=4 2024-09-12T00:23:57.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=5 2024-09-12T00:23:57.949 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=6 2024-09-12T00:23:57.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.951+0000 7fc7e912e800 20 add_watcher() i=7 2024-09-12T00:23:57.950 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.951+0000 7fc7e912e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:57.952 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.953+0000 7fc69afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:57.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.953+0000 7fc7e912e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:57.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.953+0000 7fc7e912e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:57.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.953+0000 7fc7e912e800 5 note: GC not initialized 2024-09-12T00:23:57.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.954+0000 7fc699fe3640 20 reqs_thread_entry: start 2024-09-12T00:23:57.953 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.954+0000 7fc7e912e800 20 init_complete bucket index max shards: 1 2024-09-12T00:23:57.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.954+0000 7fc7e912e800 20 Filter name: none 2024-09-12T00:23:57.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.954+0000 7fc60b7fe640 20 reqs_thread_entry: start 2024-09-12T00:23:57.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.954+0000 7fc7e912e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:23:57.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.954+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:57.954 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.954+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:57.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.954+0000 7fc7e912e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:23:57.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.954+0000 7fc7e912e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:23:57.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.954+0000 7fc7e912e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:23:57.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.954+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:57.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.955+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:23:57.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.955+0000 7fc7e912e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:57.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.955+0000 7fc7e912e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:57.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.955+0000 7fc7e912e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:57.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.955+0000 7fc7e912e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:57.955 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.955+0000 7fc7e912e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:23:57.956 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.956+0000 7fc7e912e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:23:57.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.961+0000 7fc7e912e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:57.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.961+0000 7fc7e912e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:57.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.961+0000 7fc7e912e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:57.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.961+0000 7fc7e912e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:23:57.960 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.961+0000 7fc6bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562483 cookie 94699431835584 notifier 8337 bl.length()=827 2024-09-12T00:23:57.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.961+0000 7fc6bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:57.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.961+0000 7fc6bbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:57.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.961+0000 7fc6bbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:57.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.961+0000 7fc7e912e800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:23:57.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.961+0000 7fc7e912e800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:23:57.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.961+0000 7fc7e912e800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:23:57.961 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.961+0000 7fc7e912e800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:23:57.963 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc7e912e800 time 2024-09-12T00:23:57.966259+0000 2024-09-12T00:23:57.963 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:23:57.964 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:57.964 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc7ea98c71a] 2024-09-12T00:23:57.964 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc7ea98c8d8] 2024-09-12T00:23:57.965 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5620ebd25641] 2024-09-12T00:23:57.965 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd8854c) [0x5620ec23854c] 2024-09-12T00:23:57.965 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5620ebd3531d] 2024-09-12T00:23:57.965 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:23:57.965 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc7e9629590] 2024-09-12T00:23:57.965 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:23:57.965 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:23:57.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.965+0000 7fc7e912e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc7e912e800 time 2024-09-12T00:23:57.966259+0000 2024-09-12T00:23:57.965 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:23:57.965 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:57.965 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:57.965 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc7ea98c71a] 2024-09-12T00:23:57.965 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc7ea98c8d8] 2024-09-12T00:23:57.966 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5620ebd25641] 2024-09-12T00:23:57.966 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd8854c) [0x5620ec23854c] 2024-09-12T00:23:57.966 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5620ebd3531d] 2024-09-12T00:23:57.966 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:23:57.966 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc7e9629590] 2024-09-12T00:23:57.966 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:23:57.966 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:23:57.966 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:57.966 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:23:57.966 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fc7e912e800 thread_name:radosgw-admin 2024-09-12T00:23:57.980 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:57.981 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc7e963e6f0] 2024-09-12T00:23:57.981 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc7e968b99c] 2024-09-12T00:23:57.981 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:23:57.981 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:23:57.981 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc7ea98c774] 2024-09-12T00:23:57.981 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc7ea98c8d8] 2024-09-12T00:23:57.981 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5620ebd25641] 2024-09-12T00:23:57.981 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd8854c) [0x5620ec23854c] 2024-09-12T00:23:57.981 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5620ebd3531d] 2024-09-12T00:23:57.981 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:23:57.981 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc7e9629590] 2024-09-12T00:23:57.981 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:23:57.982 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:23:57.982 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:57.966+0000 7fc7e912e800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:23:57.982 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fc7e912e800 thread_name:radosgw-admin 2024-09-12T00:23:57.982 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:57.982 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:57.982 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc7e963e6f0] 2024-09-12T00:23:57.982 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc7e968b99c] 2024-09-12T00:23:57.982 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:23:57.982 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:23:57.982 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc7ea98c774] 2024-09-12T00:23:57.982 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc7ea98c8d8] 2024-09-12T00:23:57.982 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5620ebd25641] 2024-09-12T00:23:57.983 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd8854c) [0x5620ec23854c] 2024-09-12T00:23:57.983 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5620ebd3531d] 2024-09-12T00:23:57.983 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:23:57.983 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc7e9629590] 2024-09-12T00:23:57.983 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:23:57.983 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:23:57.983 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:23:57.983 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:57.983 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:23:57.983 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:23:57.698+0000 7fc7e912e800 10 monclient: get_monmap_and_config success 2024-09-12T00:23:57.983 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:23:57.698+0000 7fc7e912e800 4 set_mon_vals no callback set 2024-09-12T00:23:57.983 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:23:57.698+0000 7fc6d2e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:57.983 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:23:57.698+0000 7fc6d2e0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:23:57.984 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:23:57.698+0000 7fc6d2e0d640 10 monclient: dump: 2024-09-12T00:23:57.984 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:57.984 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:57.984 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:57.984 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:57.984 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:57.984 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:57.984 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:57.984 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:57.984 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:57.984 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:57.984 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:23:57.698+0000 7fc7e912e800 10 monclient: shutdown 2024-09-12T00:23:57.985 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:23:57.698+0000 7fc7e912e800 5 asok(0x5620edcd0630) unregister_commands rotate-key 2024-09-12T00:23:57.985 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:23:57.699+0000 7fc7e912e800 10 monclient: build_initial_monmap 2024-09-12T00:23:57.985 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:23:57.699+0000 7fc7e912e800 1 build_initial for_mkfs: 0 2024-09-12T00:23:57.985 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:23:57.699+0000 7fc7e912e800 10 monclient: monmap: 2024-09-12T00:23:57.985 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:23:57.985 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:23:57.985 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:23:57.985 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:23:57.985 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:23:57.985 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:57.985 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:23:57.985 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:23:57.985 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:23:57.985 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:57.986 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding auth protocol: cephx 2024-09-12T00:23:57.986 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding auth protocol: cephx 2024-09-12T00:23:57.986 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding auth protocol: cephx 2024-09-12T00:23:57.986 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: secure 2024-09-12T00:23:57.986 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: crc 2024-09-12T00:23:57.986 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: secure 2024-09-12T00:23:57.986 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: crc 2024-09-12T00:23:57.986 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: secure 2024-09-12T00:23:57.986 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: crc 2024-09-12T00:23:57.986 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: crc 2024-09-12T00:23:57.986 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: secure 2024-09-12T00:23:57.986 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: crc 2024-09-12T00:23:57.986 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: secure 2024-09-12T00:23:57.987 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: crc 2024-09-12T00:23:57.987 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: secure 2024-09-12T00:23:57.987 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:23:57.699+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:57.987 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:23:57.699+0000 7fc7e912e800 1 librados: starting msgr at 2024-09-12T00:23:57.987 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:23:57.699+0000 7fc7e912e800 1 librados: starting objecter 2024-09-12T00:23:57.987 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command objecter_requests hook 0x5620edef4bc0 2024-09-12T00:23:57.987 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:23:57.699+0000 7fc7e912e800 1 librados: setting wanted keys 2024-09-12T00:23:57.987 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:23:57.699+0000 7fc7e912e800 1 librados: calling monclient init 2024-09-12T00:23:57.987 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:23:57.699+0000 7fc7e912e800 10 monclient: init 2024-09-12T00:23:57.987 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding auth protocol: cephx 2024-09-12T00:23:57.987 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding auth protocol: cephx 2024-09-12T00:23:57.987 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding auth protocol: cephx 2024-09-12T00:23:57.987 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: secure 2024-09-12T00:23:57.987 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: crc 2024-09-12T00:23:57.988 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: secure 2024-09-12T00:23:57.988 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: crc 2024-09-12T00:23:57.988 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: secure 2024-09-12T00:23:57.988 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: crc 2024-09-12T00:23:57.988 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: crc 2024-09-12T00:23:57.988 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: secure 2024-09-12T00:23:57.988 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: crc 2024-09-12T00:23:57.988 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: secure 2024-09-12T00:23:57.988 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: crc 2024-09-12T00:23:57.989 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: secure 2024-09-12T00:23:57.989 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:23:57.699+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:57.989 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:23:57.700+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:57.989 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:23:57.700+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command rotate-key hook 0x5620edef0b68 2024-09-12T00:23:57.989 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:57.989 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:23:57.989 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-a con 0x5620edd9e220 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:57.989 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-b con 0x5620ede39ba0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:57.989 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-c con 0x5620ede39fc0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:57.989 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:57.989 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:57.989 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:57.989 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:57.989 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): authenticate will time out at 2114.957312s 2024-09-12T00:23:57.990 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:23:57.700+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request con 0x5620edd9e220 auth_method 0 2024-09-12T00:23:57.990 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:23:57.700+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:57.990 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:23:57.700+0000 7fc7e4edd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:57.990 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:23:57.700+0000 7fc7e4edd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:57.990 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): get_auth_request con 0x5620ede39fc0 auth_method 0 2024-09-12T00:23:57.990 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:57.990 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:57.990 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:57.990 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:23:57.700+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:57.991 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:23:57.700+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:57.991 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:23:57.700+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:57.991 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:57.991 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:57.991 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:57.991 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:23:57.700+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request con 0x5620ede39ba0 auth_method 0 2024-09-12T00:23:57.991 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:23:57.700+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:57.991 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:23:57.700+0000 7fc7e46dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:57.991 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:23:57.700+0000 7fc7e46dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:57.991 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): handle_auth_done global_id 7751 payload 824 2024-09-12T00:23:57.991 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient: _finish_hunting 0 2024-09-12T00:23:57.992 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:23:57.700+0000 7fc7e56de640 1 monclient: found mon.noname-c 2024-09-12T00:23:57.992 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:23:57.992 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:57.992 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:23:57.992 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: dump: 2024-09-12T00:23:57.992 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:57.992 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:57.992 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:57.992 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:57.992 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:57.992 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:57.992 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:57.992 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:57.993 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:57.993 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:57.993 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: _finish_auth 0 2024-09-12T00:23:57.993 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: _check_auth_tickets 2024-09-12T00:23:57.993 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:57.993 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:57.993 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:23:57.993 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: dump: 2024-09-12T00:23:57.993 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:57.993 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:57.993 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:57.993 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:57.993 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:57.993 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:57.994 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:57.994 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:57.994 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:57.994 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:57.994 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:23:57.701+0000 7fc7e912e800 5 monclient: authenticate success, global_id 7751 2024-09-12T00:23:57.994 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:23:57.701+0000 7fc7e912e800 10 monclient: _renew_subs 2024-09-12T00:23:57.994 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:23:57.701+0000 7fc7e912e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:57.994 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:23:57.701+0000 7fc6d2e0d640 4 set_mon_vals no callback set 2024-09-12T00:23:57.994 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:23:57.701+0000 7fc7e912e800 10 monclient: _renew_subs 2024-09-12T00:23:57.994 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:23:57.701+0000 7fc7e912e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:57.994 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:23:57.701+0000 7fc7e912e800 1 librados: init done 2024-09-12T00:23:57.994 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:23:57.703+0000 7fc6d160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:23:57.994 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:23:57.703+0000 7fc6d160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:57.995 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:23:57.703+0000 7fc6d160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:57.995 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:23:57.703+0000 7fc7e4edd640 10 monclient: get_auth_request con 0x7fc6cc0764a0 auth_method 0 2024-09-12T00:23:57.995 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:23:57.704+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x5620edf39380 auth_method 0 2024-09-12T00:23:57.995 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:23:57.704+0000 7fc7e4edd640 10 monclient: get_auth_request con 0x5620edf3c560 auth_method 0 2024-09-12T00:23:57.995 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:23:57.705+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x5620edf40750 auth_method 0 2024-09-12T00:23:57.995 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:23:57.707+0000 7fc7e912e800 10 monclient: build_initial_monmap 2024-09-12T00:23:57.995 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:23:57.707+0000 7fc7e912e800 1 build_initial for_mkfs: 0 2024-09-12T00:23:57.995 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:23:57.707+0000 7fc7e912e800 10 monclient: monmap: 2024-09-12T00:23:57.995 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:23:57.995 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:23:57.995 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:23:57.995 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:23:57.995 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:23:57.996 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:57.996 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:23:57.996 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:23:57.996 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:23:57.996 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:57.996 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding auth protocol: cephx 2024-09-12T00:23:57.996 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding auth protocol: cephx 2024-09-12T00:23:57.996 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding auth protocol: cephx 2024-09-12T00:23:57.996 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: secure 2024-09-12T00:23:57.996 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: crc 2024-09-12T00:23:57.997 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: secure 2024-09-12T00:23:57.997 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: crc 2024-09-12T00:23:57.997 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: secure 2024-09-12T00:23:57.997 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: crc 2024-09-12T00:23:57.997 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: crc 2024-09-12T00:23:57.997 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: secure 2024-09-12T00:23:57.997 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: crc 2024-09-12T00:23:57.997 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: secure 2024-09-12T00:23:57.997 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: crc 2024-09-12T00:23:57.997 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: secure 2024-09-12T00:23:57.997 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:23:57.707+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:57.997 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command objecter_requests cmddesc objecter_requests hook 0x5620edf48e90 EEXIST 2024-09-12T00:23:57.997 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient: init 2024-09-12T00:23:57.998 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding auth protocol: cephx 2024-09-12T00:23:57.998 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding auth protocol: cephx 2024-09-12T00:23:57.998 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding auth protocol: cephx 2024-09-12T00:23:57.998 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: secure 2024-09-12T00:23:57.998 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: crc 2024-09-12T00:23:57.998 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: secure 2024-09-12T00:23:57.998 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: crc 2024-09-12T00:23:57.998 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: secure 2024-09-12T00:23:57.998 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: crc 2024-09-12T00:23:57.998 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: crc 2024-09-12T00:23:57.998 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: secure 2024-09-12T00:23:57.998 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: crc 2024-09-12T00:23:57.998 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: secure 2024-09-12T00:23:57.999 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: crc 2024-09-12T00:23:57.999 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: secure 2024-09-12T00:23:57.999 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:23:57.708+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:57.999 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:23:57.708+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:57.999 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command rotate-key cmddesc rotate-key hook 0x5620edf43d80 EEXIST 2024-09-12T00:23:57.999 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:57.999 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:23:57.999 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-c con 0x5620edf6cb80 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:57.999 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-a con 0x5620edf6ee50 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:57.999 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-b con 0x5620edf6b350 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:57.999 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:57.999 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:57.999 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.000 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:58.000 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): authenticate will time out at 2114.965684s 2024-09-12T00:23:58.000 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:23:57.708+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request con 0x5620edf6cb80 auth_method 0 2024-09-12T00:23:58.000 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:23:57.708+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.000 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:23:57.708+0000 7fc7e4edd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.000 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:23:57.708+0000 7fc7e4edd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.000 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:23:57.708+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request con 0x5620edf6ee50 auth_method 0 2024-09-12T00:23:58.000 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:23:57.708+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.000 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:23:57.708+0000 7fc7e46dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.000 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:23:57.708+0000 7fc7e46dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.000 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:23:57.708+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.000 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:23:57.708+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.000 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:23:57.708+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.001 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:23:57.708+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.001 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:23:57.708+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.001 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:23:57.708+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.001 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:23:57.708+0000 7fc7e56de640 10 monclient(hunting): get_auth_request con 0x5620edf6b350 auth_method 0 2024-09-12T00:23:58.001 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:23:57.708+0000 7fc7e56de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.001 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:23:57.708+0000 7fc7e56de640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.001 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:23:57.708+0000 7fc7e56de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.001 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:23:57.709+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.001 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:23:57.709+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.001 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:23:57.709+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.001 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:23:57.709+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_done global_id 7754 payload 824 2024-09-12T00:23:58.001 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:23:57.709+0000 7fc7e4edd640 10 monclient: _finish_hunting 0 2024-09-12T00:23:58.001 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:23:57.709+0000 7fc7e4edd640 1 monclient: found mon.noname-c 2024-09-12T00:23:58.001 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:23:57.709+0000 7fc7e4edd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:23:58.002 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:58.002 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:23:58.002 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: dump: 2024-09-12T00:23:58.002 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:58.002 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:58.002 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.002 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.002 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:58.002 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.002 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:58.002 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:58.002 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:58.002 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.003 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: _finish_auth 0 2024-09-12T00:23:58.003 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:23:58.003 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:58.003 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:58.003 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:23:58.003 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: dump: 2024-09-12T00:23:58.003 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:58.003 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:58.003 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.003 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.003 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:58.003 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.003 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:58.004 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:58.004 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:58.004 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.004 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:23:57.709+0000 7fc7e5edf640 4 set_mon_vals no callback set 2024-09-12T00:23:58.004 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:23:57.709+0000 7fc7e912e800 5 monclient: authenticate success, global_id 7754 2024-09-12T00:23:58.004 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:23:57.709+0000 7fc7e912e800 10 monclient: _renew_subs 2024-09-12T00:23:58.004 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:23:57.709+0000 7fc7e912e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:58.004 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:23:57.709+0000 7fc7e912e800 10 monclient: _renew_subs 2024-09-12T00:23:58.004 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:23:57.709+0000 7fc7e912e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:58.004 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:23:57.711+0000 7fc6ca7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:23:58.004 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:23:57.711+0000 7fc6ca7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:58.004 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:23:57.711+0000 7fc6ca7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:58.004 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:23:57.711+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x7fc6bc076380 auth_method 0 2024-09-12T00:23:58.005 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:23:57.712+0000 7fc7e912e800 10 monclient: get_monmap_and_config 2024-09-12T00:23:58.005 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:23:57.712+0000 7fc7e912e800 10 monclient: build_initial_monmap 2024-09-12T00:23:58.005 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:23:57.712+0000 7fc7e912e800 1 build_initial for_mkfs: 0 2024-09-12T00:23:58.005 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:23:57.712+0000 7fc7e912e800 10 monclient: monmap: 2024-09-12T00:23:58.005 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:23:58.005 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:23:58.005 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:23:58.005 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:23:58.005 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:23:58.005 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.005 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:23:58.005 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:23:58.005 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:23:58.006 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.006 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding auth protocol: cephx 2024-09-12T00:23:58.006 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding auth protocol: cephx 2024-09-12T00:23:58.006 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding auth protocol: cephx 2024-09-12T00:23:58.006 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: secure 2024-09-12T00:23:58.006 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: crc 2024-09-12T00:23:58.006 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: secure 2024-09-12T00:23:58.006 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: crc 2024-09-12T00:23:58.006 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: secure 2024-09-12T00:23:58.006 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: crc 2024-09-12T00:23:58.006 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: crc 2024-09-12T00:23:58.006 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: secure 2024-09-12T00:23:58.006 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: crc 2024-09-12T00:23:58.007 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: secure 2024-09-12T00:23:58.007 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: crc 2024-09-12T00:23:58.007 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: secure 2024-09-12T00:23:58.007 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:23:57.712+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.007 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:23:57.712+0000 7fc7e912e800 10 monclient: init 2024-09-12T00:23:58.007 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding auth protocol: cephx 2024-09-12T00:23:58.007 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding auth protocol: cephx 2024-09-12T00:23:58.007 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding auth protocol: cephx 2024-09-12T00:23:58.007 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: secure 2024-09-12T00:23:58.008 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: crc 2024-09-12T00:23:58.008 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: secure 2024-09-12T00:23:58.008 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: crc 2024-09-12T00:23:58.008 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: secure 2024-09-12T00:23:58.008 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: crc 2024-09-12T00:23:58.008 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: crc 2024-09-12T00:23:58.008 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: secure 2024-09-12T00:23:58.008 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: crc 2024-09-12T00:23:58.008 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: secure 2024-09-12T00:23:58.008 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: crc 2024-09-12T00:23:58.008 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: secure 2024-09-12T00:23:58.008 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:23:57.712+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.008 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:23:57.712+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.009 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:23:57.713+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command rotate-key cmddesc rotate-key hook 0x7fff7e89b268 EEXIST 2024-09-12T00:23:58.009 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:58.009 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:23:58.009 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-c con 0x5620edfc10c0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:58.009 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-a con 0x5620edf92010 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:58.009 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-b con 0x5620edfbc960 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:58.009 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.009 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.009 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.009 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:58.009 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): authenticate will time out at 2114.970117s 2024-09-12T00:23:58.009 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request con 0x5620edfc10c0 auth_method 0 2024-09-12T00:23:58.010 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.010 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.010 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.010 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:23:57.713+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request con 0x5620edf92010 auth_method 0 2024-09-12T00:23:58.010 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:23:57.713+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.010 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:23:57.713+0000 7fc7e46dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.010 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:23:57.713+0000 7fc7e46dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.010 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.010 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.010 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.010 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:23:57.713+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.010 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:23:57.713+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.011 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:23:57.713+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.011 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_done global_id 7757 payload 274 2024-09-12T00:23:58.011 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient: _finish_hunting 0 2024-09-12T00:23:58.011 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 1 monclient: found mon.noname-c 2024-09-12T00:23:58.011 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:23:58.011 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:58.011 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:23:58.011 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: dump: 2024-09-12T00:23:58.011 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:58.011 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:58.011 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.011 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.011 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:58.012 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.012 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:58.012 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:58.012 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:58.012 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.012 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: _finish_auth 0 2024-09-12T00:23:58.012 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: _check_auth_tickets 2024-09-12T00:23:58.012 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:58.012 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:58.012 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:23:58.012 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: dump: 2024-09-12T00:23:58.012 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:58.013 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:58.013 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.013 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.013 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:58.013 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.013 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:58.013 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:58.013 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:58.013 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.013 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:23:57.713+0000 7fc7e912e800 5 monclient: authenticate success, global_id 7757 2024-09-12T00:23:58.013 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient: get_monmap_and_config success 2024-09-12T00:23:58.013 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:23:57.713+0000 7fc7e912e800 4 set_mon_vals no callback set 2024-09-12T00:23:58.013 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:23:57.714+0000 7fc7e912e800 10 monclient: shutdown 2024-09-12T00:23:58.014 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:23:57.714+0000 7fc7e912e800 10 monclient: build_initial_monmap 2024-09-12T00:23:58.014 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:23:57.714+0000 7fc7e912e800 1 build_initial for_mkfs: 0 2024-09-12T00:23:58.014 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:23:57.714+0000 7fc7e912e800 10 monclient: monmap: 2024-09-12T00:23:58.014 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:23:58.014 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:23:58.014 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:23:58.014 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:23:58.014 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:23:58.014 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.014 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:23:58.014 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:23:58.014 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:23:58.014 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.015 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding auth protocol: cephx 2024-09-12T00:23:58.015 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding auth protocol: cephx 2024-09-12T00:23:58.015 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding auth protocol: cephx 2024-09-12T00:23:58.015 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: secure 2024-09-12T00:23:58.015 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: crc 2024-09-12T00:23:58.015 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: secure 2024-09-12T00:23:58.015 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: crc 2024-09-12T00:23:58.015 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: secure 2024-09-12T00:23:58.015 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: crc 2024-09-12T00:23:58.015 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: crc 2024-09-12T00:23:58.015 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: secure 2024-09-12T00:23:58.015 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: crc 2024-09-12T00:23:58.015 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: secure 2024-09-12T00:23:58.015 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: crc 2024-09-12T00:23:58.016 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: secure 2024-09-12T00:23:58.016 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:23:57.714+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.016 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:23:57.714+0000 7fc7e912e800 1 librados: starting msgr at 2024-09-12T00:23:58.016 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:23:57.714+0000 7fc7e912e800 1 librados: starting objecter 2024-09-12T00:23:58.016 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command objecter_requests cmddesc objecter_requests hook 0x5620edf8f4b0 EEXIST 2024-09-12T00:23:58.016 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:23:57.715+0000 7fc7e912e800 1 librados: setting wanted keys 2024-09-12T00:23:58.016 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:23:57.715+0000 7fc7e912e800 1 librados: calling monclient init 2024-09-12T00:23:58.016 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient: init 2024-09-12T00:23:58.016 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding auth protocol: cephx 2024-09-12T00:23:58.016 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding auth protocol: cephx 2024-09-12T00:23:58.016 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding auth protocol: cephx 2024-09-12T00:23:58.016 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: secure 2024-09-12T00:23:58.016 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: crc 2024-09-12T00:23:58.017 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: secure 2024-09-12T00:23:58.017 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: crc 2024-09-12T00:23:58.017 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: secure 2024-09-12T00:23:58.017 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: crc 2024-09-12T00:23:58.017 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: crc 2024-09-12T00:23:58.017 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: secure 2024-09-12T00:23:58.017 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: crc 2024-09-12T00:23:58.017 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: secure 2024-09-12T00:23:58.017 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: crc 2024-09-12T00:23:58.017 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: secure 2024-09-12T00:23:58.017 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:23:57.715+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.017 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:23:57.715+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.017 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command rotate-key cmddesc rotate-key hook 0x5620edf84a78 EEXIST 2024-09-12T00:23:58.018 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:58.018 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:23:58.018 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-c con 0x5620edf92010 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:58.018 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-b con 0x5620edfbc960 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:58.018 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-a con 0x5620edfc10c0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:58.018 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.018 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.018 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.018 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:58.018 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): authenticate will time out at 2114.972595s 2024-09-12T00:23:58.018 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:23:57.715+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request con 0x5620edf92010 auth_method 0 2024-09-12T00:23:58.018 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:23:57.715+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.018 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:23:57.715+0000 7fc7e4edd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.018 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:23:57.715+0000 7fc7e4edd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.019 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): get_auth_request con 0x5620edfc10c0 auth_method 0 2024-09-12T00:23:58.019 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.019 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.019 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.019 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:23:57.715+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.019 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:23:57.715+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.019 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:23:57.715+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.019 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.019 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.019 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.019 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:23:57.715+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request con 0x5620edfbc960 auth_method 0 2024-09-12T00:23:58.019 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:23:57.715+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.019 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:23:57.715+0000 7fc7e46dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.020 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:23:57.715+0000 7fc7e46dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.020 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:23:57.715+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.020 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:23:57.715+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.020 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:23:57.715+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.020 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): handle_auth_done global_id 8337 payload 824 2024-09-12T00:23:58.020 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient: _finish_hunting 0 2024-09-12T00:23:58.020 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:23:57.715+0000 7fc7e56de640 1 monclient: found mon.noname-a 2024-09-12T00:23:58.020 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:23:58.020 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:58.021 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:23:58.021 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: dump: 2024-09-12T00:23:58.021 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:58.021 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:58.021 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.021 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.021 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:58.021 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.021 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:58.021 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:58.021 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:58.021 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.021 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: _finish_auth 0 2024-09-12T00:23:58.022 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:23:58.022 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:58.022 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:58.022 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:23:58.022 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: dump: 2024-09-12T00:23:58.022 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:58.022 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:58.022 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.022 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.022 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:58.022 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.022 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:58.022 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:58.023 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:58.023 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.023 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:23:57.716+0000 7fc7e912e800 5 monclient: authenticate success, global_id 8337 2024-09-12T00:23:58.023 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:23:57.716+0000 7fc7e912e800 10 monclient: _renew_subs 2024-09-12T00:23:58.023 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:23:57.716+0000 7fc6bbfff640 4 set_mon_vals no callback set 2024-09-12T00:23:58.023 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:23:57.716+0000 7fc7e912e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:23:58.023 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:23:57.716+0000 7fc7e912e800 10 monclient: _renew_subs 2024-09-12T00:23:58.023 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:23:57.716+0000 7fc7e912e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:23:58.023 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:23:57.716+0000 7fc7e912e800 1 librados: init done 2024-09-12T00:23:58.023 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:23:57.716+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command cr dump hook 0x5620edfce978 2024-09-12T00:23:58.023 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:23:57.718+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.023 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:23:57.718+0000 7fc6ba7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:23:58.023 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:23:57.718+0000 7fc6ba7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:58.023 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:23:57.718+0000 7fc6ba7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:58.024 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:23:57.718+0000 7fc7e4edd640 10 monclient: get_auth_request con 0x7fc6b00764a0 auth_method 0 2024-09-12T00:23:58.024 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:23:57.719+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x5620edfdb550 auth_method 0 2024-09-12T00:23:58.024 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.024 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:23:57.720+0000 7fc7e912e800 20 realm 2024-09-12T00:23:58.024 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.024 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.024 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:23:57.720+0000 7fc7e912e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:58.024 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.024 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.024 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.024 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:23:57.720+0000 7fc7e4edd640 10 monclient: get_auth_request con 0x5620edfdf760 auth_method 0 2024-09-12T00:23:58.024 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:23:57.721+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:58.024 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:23:57.721+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.025 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:23:57.721+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x5620edfe2fc0 auth_method 0 2024-09-12T00:23:58.025 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:23:57.722+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:58.025 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:23:57.722+0000 7fc7e912e800 20 searching for the correct realm 2024-09-12T00:23:58.025 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:23:57.723+0000 7fc7e56de640 10 monclient: get_auth_request con 0x7fc7d8024040 auth_method 0 2024-09-12T00:23:58.025 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:23:57.724+0000 7fc7e4edd640 10 monclient: get_auth_request con 0x7fc7d40a88e0 auth_method 0 2024-09-12T00:23:58.025 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:23:57.725+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x7fc7d8048b70 auth_method 0 2024-09-12T00:23:58.025 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:23:57.725+0000 7fc7e46dc640 0 -- 172.21.15.67:0/3373398851 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fc7d8048b70 msgr2=0x7fc7d8041410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:23:58.025 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:23:57.927+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x7fc7d8048b70 auth_method 0 2024-09-12T00:23:58.025 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:23:57.929+0000 7fc7e56de640 10 monclient: get_auth_request con 0x7fc7d40b8040 auth_method 0 2024-09-12T00:23:58.025 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:23:57.930+0000 7fc7e4edd640 10 monclient: get_auth_request con 0x7fc7dc089ad0 auth_method 0 2024-09-12T00:23:58.025 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:23:57.931+0000 7fc7e46dc640 0 -- 172.21.15.67:0/3373398851 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5620edfdb550 msgr2=0x5620edfdd9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:58.025 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:23:57.931+0000 7fc6ba7fc640 1 client.8337.objecter ms_handle_reset 0x5620edfdb550 session 0x5620edfdae80 osd.6 2024-09-12T00:23:58.025 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:23:57.931+0000 7fc6ba7fc640 10 monclient: _renew_subs 2024-09-12T00:23:58.026 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:23:57.931+0000 7fc6ba7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:23:58.026 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:23:57.931+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x7fc6b0086820 auth_method 0 2024-09-12T00:23:58.026 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:58.026 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:58.026 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:23:58.026 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:23:58.026 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:58.026 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:58.026 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:23:57.937+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.026 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:23:57.937+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.026 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:23:57.937+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.026 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:23:57.937+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:58.026 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:23:57.937+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.027 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:58.027 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 zone default found 2024-09-12T00:23:58.027 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:23:57.938+0000 7fc7e912e800 4 Realm: () 2024-09-12T00:23:58.027 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:23:57.938+0000 7fc7e912e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:23:58.027 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:23:57.938+0000 7fc7e912e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:23:58.027 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:23:57.938+0000 7fc7e912e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:58.027 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 zonegroup default 2024-09-12T00:23:58.027 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.027 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.027 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.027 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.027 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.027 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:23:57.939+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.028 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:23:57.939+0000 7fc7e912e800 20 started sync module instance, tier type = 2024-09-12T00:23:58.028 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:23:57.939+0000 7fc7e912e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:23:58.028 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=0 2024-09-12T00:23:58.028 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=1 2024-09-12T00:23:58.028 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=2 2024-09-12T00:23:58.028 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=3 2024-09-12T00:23:58.028 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=4 2024-09-12T00:23:58.028 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=5 2024-09-12T00:23:58.028 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=6 2024-09-12T00:23:58.028 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:23:57.951+0000 7fc7e912e800 20 add_watcher() i=7 2024-09-12T00:23:58.028 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:23:57.951+0000 7fc7e912e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:58.028 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding auth protocol: cephx 2024-09-12T00:23:58.028 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding auth protocol: cephx 2024-09-12T00:23:58.028 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding auth protocol: cephx 2024-09-12T00:23:58.029 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: secure 2024-09-12T00:23:58.029 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: crc 2024-09-12T00:23:58.029 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: secure 2024-09-12T00:23:58.029 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: crc 2024-09-12T00:23:58.029 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: secure 2024-09-12T00:23:58.029 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: crc 2024-09-12T00:23:58.029 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: crc 2024-09-12T00:23:58.029 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: secure 2024-09-12T00:23:58.029 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: crc 2024-09-12T00:23:58.029 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: secure 2024-09-12T00:23:58.029 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: crc 2024-09-12T00:23:58.029 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: secure 2024-09-12T00:23:58.029 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:23:57.953+0000 7fc69afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:58.030 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:23:57.953+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.030 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:23:57.953+0000 7fc7e912e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:58.030 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:23:57.953+0000 7fc7e912e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:58.030 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command cache list hook 0x5620edfa8310 2024-09-12T00:23:58.030 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command cache inspect hook 0x5620edfa8310 2024-09-12T00:23:58.030 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command cache erase hook 0x5620edfa8310 2024-09-12T00:23:58.030 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command cache zap hook 0x5620edfa8310 2024-09-12T00:23:58.030 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 note: GC not initialized 2024-09-12T00:23:58.030 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:23:57.954+0000 7fc699fe3640 20 reqs_thread_entry: start 2024-09-12T00:23:58.030 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:23:57.954+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command sync trace show hook 0x7fc7d80043a0 2024-09-12T00:23:58.030 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:23:57.954+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command sync trace history hook 0x7fc7d80043a0 2024-09-12T00:23:58.030 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:23:57.954+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command sync trace active hook 0x7fc7d80043a0 2024-09-12T00:23:58.030 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:23:57.954+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command sync trace active_short hook 0x7fc7d80043a0 2024-09-12T00:23:58.031 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:23:57.954+0000 7fc7e912e800 20 init_complete bucket index max shards: 1 2024-09-12T00:23:58.031 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:23:57.954+0000 7fc7e912e800 20 Filter name: none 2024-09-12T00:23:58.031 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:23:57.954+0000 7fc60b7fe640 20 reqs_thread_entry: start 2024-09-12T00:23:58.031 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:23:57.954+0000 7fc7e912e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:23:58.031 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:23:57.954+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.031 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:23:57.954+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:58.031 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:23:57.954+0000 7fc7e912e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:23:58.031 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:23:57.954+0000 7fc7e912e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:23:58.031 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:23:57.954+0000 7fc7e912e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:23:58.031 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:23:57.954+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.031 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:23:57.955+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:23:58.031 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:23:57.955+0000 7fc7e912e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:58.031 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:23:57.955+0000 7fc7e912e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:58.032 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:23:57.955+0000 7fc7e912e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:58.032 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:23:57.955+0000 7fc7e912e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:58.032 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:23:57.955+0000 7fc7e912e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:23:58.032 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:23:57.956+0000 7fc7e912e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:23:58.032 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:23:57.961+0000 7fc7e912e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:58.032 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:23:57.961+0000 7fc7e912e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:58.032 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:23:57.961+0000 7fc7e912e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:58.032 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:23:57.961+0000 7fc7e912e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:23:58.032 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:23:57.961+0000 7fc6bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562483 cookie 94699431835584 notifier 8337 bl.length()=827 2024-09-12T00:23:58.032 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:23:57.961+0000 7fc6bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:58.032 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:23:57.961+0000 7fc6bbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:58.032 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:23:57.961+0000 7fc6bbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:58.032 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:23:57.961+0000 7fc7e912e800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:23:58.033 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:23:57.961+0000 7fc7e912e800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:23:58.033 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:23:57.961+0000 7fc7e912e800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:23:58.033 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:23:57.961+0000 7fc7e912e800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:23:58.033 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:23:57.965+0000 7fc7e912e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc7e912e800 time 2024-09-12T00:23:57.966259+0000 2024-09-12T00:23:58.033 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:23:58.033 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.033 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:58.033 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc7ea98c71a] 2024-09-12T00:23:58.033 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc7ea98c8d8] 2024-09-12T00:23:58.033 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5620ebd25641] 2024-09-12T00:23:58.033 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd8854c) [0x5620ec23854c] 2024-09-12T00:23:58.033 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5620ebd3531d] 2024-09-12T00:23:58.033 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:23:58.034 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc7e9629590] 2024-09-12T00:23:58.034 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:23:58.034 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:23:58.034 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.034 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:23:57.966+0000 7fc7e912e800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:23:58.034 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fc7e912e800 thread_name:radosgw-admin 2024-09-12T00:23:58.034 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.034 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:58.034 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc7e963e6f0] 2024-09-12T00:23:58.034 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc7e968b99c] 2024-09-12T00:23:58.035 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:23:58.035 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:23:58.035 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc7ea98c774] 2024-09-12T00:23:58.035 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc7ea98c8d8] 2024-09-12T00:23:58.035 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5620ebd25641] 2024-09-12T00:23:58.035 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd8854c) [0x5620ec23854c] 2024-09-12T00:23:58.035 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5620ebd3531d] 2024-09-12T00:23:58.035 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:23:58.035 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc7e9629590] 2024-09-12T00:23:58.035 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:23:58.035 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:23:58.036 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:23:58.036 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.036 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:23:58.036 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:23:58.036 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:23:58.036 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:23:58.036 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:23:58.036 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:23:58.036 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:23:58.036 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:23:58.036 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:23:58.036 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:23:58.036 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:23:58.036 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:23:58.037 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:23:58.037 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:23:58.037 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:23:58.037 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:23:58.037 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:23:58.037 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:23:58.037 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:23:58.037 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:23:58.037 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:23:58.037 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:23:58.037 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:23:58.037 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:23:58.037 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:23:58.038 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:23:58.038 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:23:58.038 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:23:58.038 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:23:58.038 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:23:58.038 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:23:58.038 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:23:58.038 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:23:58.038 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:23:58.038 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:23:58.038 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:23:58.038 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:23:58.038 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:23:58.039 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:23:58.039 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:23:58.039 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:23:58.039 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:23:58.039 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:23:58.039 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:23:58.039 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:23:58.039 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:23:58.039 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:23:58.039 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:23:58.039 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:23:58.039 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:23:58.040 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:23:58.040 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:23:58.040 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:23:58.040 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:23:58.040 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:23:58.040 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:23:58.040 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:23:58.041 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:23:58.041 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:23:58.041 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:23:58.041 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:23:58.041 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:23:58.041 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:23:58.042 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:23:58.042 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:23:58.042 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:23:58.042 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:23:58.042 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:23:58.042 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:23:58.042 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:23:58.042 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:23:58.042 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:23:58.042 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:23:58.042 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:23:58.042 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:23:58.042 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:23:58.043 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:23:58.043 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:23:58.043 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:23:58.043 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:23:58.043 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:23:58.043 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:23:58.043 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:23:58.043 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:23:58.043 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:23:58.043 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:23:58.043 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:23:58.043 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:23:58.043 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:23:58.044 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:23:58.044 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:23:58.044 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:23:58.044 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:23:58.044 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:23:58.044 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc60b7fe640 / http_manager 2024-09-12T00:23:58.044 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc699fe3640 / http_manager 2024-09-12T00:23:58.044 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc69afe5640 / rgw_dt_lg_renew 2024-09-12T00:23:58.044 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc6ba7fc640 / ms_dispatch 2024-09-12T00:23:58.045 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc6bbfff640 / io_context_pool 2024-09-12T00:23:58.045 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc6ca7fc640 / ms_dispatch 2024-09-12T00:23:58.045 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc6d160a640 / ms_dispatch 2024-09-12T00:23:58.045 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc6d2e0d640 / io_context_pool 2024-09-12T00:23:58.045 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc7e46dc640 / msgr-worker-2 2024-09-12T00:23:58.045 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc7e4edd640 / msgr-worker-1 2024-09-12T00:23:58.045 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc7e56de640 / msgr-worker-0 2024-09-12T00:23:58.045 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc7e5edf640 / io_context_pool 2024-09-12T00:23:58.045 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc7e912e800 / radosgw-admin 2024-09-12T00:23:58.045 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:23:58.045 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:23:58.045 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.152345.log 2024-09-12T00:23:58.046 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:23:58.046 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:23:58.046 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:23:57.698+0000 7fc7e912e800 10 monclient: get_monmap_and_config success 2024-09-12T00:23:58.046 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:23:57.698+0000 7fc7e912e800 4 set_mon_vals no callback set 2024-09-12T00:23:58.046 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:23:57.698+0000 7fc6d2e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:58.046 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:23:57.698+0000 7fc6d2e0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:23:58.046 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:23:57.698+0000 7fc6d2e0d640 10 monclient: dump: 2024-09-12T00:23:58.046 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:58.046 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:58.046 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.046 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.046 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:58.046 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.047 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:58.047 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:58.047 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:58.047 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.047 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:23:57.698+0000 7fc7e912e800 10 monclient: shutdown 2024-09-12T00:23:58.047 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:23:57.698+0000 7fc7e912e800 5 asok(0x5620edcd0630) unregister_commands rotate-key 2024-09-12T00:23:58.047 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:23:57.699+0000 7fc7e912e800 10 monclient: build_initial_monmap 2024-09-12T00:23:58.047 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:23:57.699+0000 7fc7e912e800 1 build_initial for_mkfs: 0 2024-09-12T00:23:58.047 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:23:57.699+0000 7fc7e912e800 10 monclient: monmap: 2024-09-12T00:23:58.047 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:23:58.047 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:23:58.047 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:23:58.047 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:23:58.048 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:23:58.048 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.048 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:23:58.048 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:23:58.048 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:23:58.048 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.048 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding auth protocol: cephx 2024-09-12T00:23:58.048 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding auth protocol: cephx 2024-09-12T00:23:58.048 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding auth protocol: cephx 2024-09-12T00:23:58.048 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: secure 2024-09-12T00:23:58.048 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: crc 2024-09-12T00:23:58.048 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: secure 2024-09-12T00:23:58.048 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: crc 2024-09-12T00:23:58.049 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: secure 2024-09-12T00:23:58.049 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: crc 2024-09-12T00:23:58.049 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: crc 2024-09-12T00:23:58.049 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: secure 2024-09-12T00:23:58.049 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: crc 2024-09-12T00:23:58.049 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: secure 2024-09-12T00:23:58.049 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: crc 2024-09-12T00:23:58.049 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef6680) adding con mode: secure 2024-09-12T00:23:58.049 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:23:57.699+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.049 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:23:57.699+0000 7fc7e912e800 1 librados: starting msgr at 2024-09-12T00:23:58.049 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:23:57.699+0000 7fc7e912e800 1 librados: starting objecter 2024-09-12T00:23:58.049 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command objecter_requests hook 0x5620edef4bc0 2024-09-12T00:23:58.050 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:23:57.699+0000 7fc7e912e800 1 librados: setting wanted keys 2024-09-12T00:23:58.050 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:23:57.699+0000 7fc7e912e800 1 librados: calling monclient init 2024-09-12T00:23:58.050 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:23:57.699+0000 7fc7e912e800 10 monclient: init 2024-09-12T00:23:58.050 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding auth protocol: cephx 2024-09-12T00:23:58.050 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding auth protocol: cephx 2024-09-12T00:23:58.050 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding auth protocol: cephx 2024-09-12T00:23:58.050 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: secure 2024-09-12T00:23:58.050 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: crc 2024-09-12T00:23:58.050 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: secure 2024-09-12T00:23:58.050 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: crc 2024-09-12T00:23:58.050 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: secure 2024-09-12T00:23:58.050 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: crc 2024-09-12T00:23:58.050 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: crc 2024-09-12T00:23:58.051 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: secure 2024-09-12T00:23:58.051 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: crc 2024-09-12T00:23:58.051 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: secure 2024-09-12T00:23:58.051 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: crc 2024-09-12T00:23:58.051 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:23:57.699+0000 7fc7e912e800 5 AuthRegistry(0x5620edef0a20) adding con mode: secure 2024-09-12T00:23:58.051 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:23:57.699+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.051 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:23:57.700+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.051 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:23:57.700+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command rotate-key hook 0x5620edef0b68 2024-09-12T00:23:58.051 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:58.051 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:23:58.051 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-a con 0x5620edd9e220 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:58.052 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-b con 0x5620ede39ba0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:58.052 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-c con 0x5620ede39fc0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:58.052 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.052 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.052 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.052 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:58.052 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:23:57.700+0000 7fc7e912e800 10 monclient(hunting): authenticate will time out at 2114.957312s 2024-09-12T00:23:58.052 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:23:57.700+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request con 0x5620edd9e220 auth_method 0 2024-09-12T00:23:58.052 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:23:57.700+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.052 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:23:57.700+0000 7fc7e4edd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.052 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:23:57.700+0000 7fc7e4edd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.053 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): get_auth_request con 0x5620ede39fc0 auth_method 0 2024-09-12T00:23:58.053 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.053 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.053 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.053 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:23:57.700+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.053 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:23:57.700+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.053 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:23:57.700+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.053 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.053 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.053 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.054 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:23:57.700+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request con 0x5620ede39ba0 auth_method 0 2024-09-12T00:23:58.054 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:23:57.700+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.054 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:23:57.700+0000 7fc7e46dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.054 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:23:57.700+0000 7fc7e46dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.054 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient(hunting): handle_auth_done global_id 7751 payload 824 2024-09-12T00:23:58.054 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient: _finish_hunting 0 2024-09-12T00:23:58.054 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:23:57.700+0000 7fc7e56de640 1 monclient: found mon.noname-c 2024-09-12T00:23:58.054 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:23:57.700+0000 7fc7e56de640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:23:58.054 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:58.054 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:23:58.055 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: dump: 2024-09-12T00:23:58.055 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:58.055 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:58.055 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.055 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.055 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:58.055 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.055 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:58.055 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:58.055 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:58.055 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.055 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: _finish_auth 0 2024-09-12T00:23:58.055 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: _check_auth_tickets 2024-09-12T00:23:58.056 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:58.056 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:58.056 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:23:58.056 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:23:57.701+0000 7fc6d160a640 10 monclient: dump: 2024-09-12T00:23:58.056 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:58.056 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:58.056 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.056 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.056 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:58.056 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.056 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:58.056 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:58.057 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:58.057 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.057 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:23:57.701+0000 7fc7e912e800 5 monclient: authenticate success, global_id 7751 2024-09-12T00:23:58.057 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:23:57.701+0000 7fc7e912e800 10 monclient: _renew_subs 2024-09-12T00:23:58.057 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:23:57.701+0000 7fc7e912e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:58.057 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:23:57.701+0000 7fc6d2e0d640 4 set_mon_vals no callback set 2024-09-12T00:23:58.057 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:23:57.701+0000 7fc7e912e800 10 monclient: _renew_subs 2024-09-12T00:23:58.057 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:23:57.701+0000 7fc7e912e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:58.057 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:23:57.701+0000 7fc7e912e800 1 librados: init done 2024-09-12T00:23:58.057 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:23:57.703+0000 7fc6d160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:23:58.057 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:23:57.703+0000 7fc6d160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:58.057 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:23:57.703+0000 7fc6d160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:58.057 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:23:57.703+0000 7fc7e4edd640 10 monclient: get_auth_request con 0x7fc6cc0764a0 auth_method 0 2024-09-12T00:23:58.058 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:23:57.704+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x5620edf39380 auth_method 0 2024-09-12T00:23:58.058 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:23:57.704+0000 7fc7e4edd640 10 monclient: get_auth_request con 0x5620edf3c560 auth_method 0 2024-09-12T00:23:58.058 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:23:57.705+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x5620edf40750 auth_method 0 2024-09-12T00:23:58.058 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:23:57.707+0000 7fc7e912e800 10 monclient: build_initial_monmap 2024-09-12T00:23:58.058 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:23:57.707+0000 7fc7e912e800 1 build_initial for_mkfs: 0 2024-09-12T00:23:58.058 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:23:57.707+0000 7fc7e912e800 10 monclient: monmap: 2024-09-12T00:23:58.058 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:23:58.058 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:23:58.058 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:23:58.058 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:23:58.058 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:23:58.058 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.059 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:23:58.059 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:23:58.059 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:23:58.059 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.059 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding auth protocol: cephx 2024-09-12T00:23:58.059 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding auth protocol: cephx 2024-09-12T00:23:58.059 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding auth protocol: cephx 2024-09-12T00:23:58.059 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: secure 2024-09-12T00:23:58.059 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: crc 2024-09-12T00:23:58.059 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: secure 2024-09-12T00:23:58.059 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: crc 2024-09-12T00:23:58.059 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: secure 2024-09-12T00:23:58.059 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: crc 2024-09-12T00:23:58.059 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: crc 2024-09-12T00:23:58.060 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: secure 2024-09-12T00:23:58.060 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: crc 2024-09-12T00:23:58.060 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: secure 2024-09-12T00:23:58.060 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: crc 2024-09-12T00:23:58.060 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 AuthRegistry(0x5620edf454d0) adding con mode: secure 2024-09-12T00:23:58.060 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:23:57.707+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.060 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:23:57.707+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command objecter_requests cmddesc objecter_requests hook 0x5620edf48e90 EEXIST 2024-09-12T00:23:58.060 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient: init 2024-09-12T00:23:58.060 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding auth protocol: cephx 2024-09-12T00:23:58.060 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding auth protocol: cephx 2024-09-12T00:23:58.060 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding auth protocol: cephx 2024-09-12T00:23:58.060 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: secure 2024-09-12T00:23:58.061 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: crc 2024-09-12T00:23:58.061 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: secure 2024-09-12T00:23:58.061 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: crc 2024-09-12T00:23:58.061 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: secure 2024-09-12T00:23:58.061 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: crc 2024-09-12T00:23:58.061 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: crc 2024-09-12T00:23:58.061 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: secure 2024-09-12T00:23:58.061 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: crc 2024-09-12T00:23:58.061 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: secure 2024-09-12T00:23:58.061 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: crc 2024-09-12T00:23:58.061 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 AuthRegistry(0x5620edf43c38) adding con mode: secure 2024-09-12T00:23:58.061 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:23:57.708+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.061 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:23:57.708+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.062 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:23:57.708+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command rotate-key cmddesc rotate-key hook 0x5620edf43d80 EEXIST 2024-09-12T00:23:58.062 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:58.062 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:23:58.062 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-c con 0x5620edf6cb80 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:58.062 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-a con 0x5620edf6ee50 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:58.062 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-b con 0x5620edf6b350 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:58.062 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.062 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.062 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.062 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:58.062 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:23:57.708+0000 7fc7e912e800 10 monclient(hunting): authenticate will time out at 2114.965684s 2024-09-12T00:23:58.062 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:23:57.708+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request con 0x5620edf6cb80 auth_method 0 2024-09-12T00:23:58.062 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:23:57.708+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.063 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:23:57.708+0000 7fc7e4edd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.063 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:23:57.708+0000 7fc7e4edd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.063 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:23:57.708+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request con 0x5620edf6ee50 auth_method 0 2024-09-12T00:23:58.063 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:23:57.708+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.063 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:23:57.708+0000 7fc7e46dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.063 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:23:57.708+0000 7fc7e46dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.063 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:23:57.708+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.063 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:23:57.708+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.063 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:23:57.708+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.063 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:23:57.708+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.063 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:23:57.708+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.063 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:23:57.708+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.063 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:23:57.708+0000 7fc7e56de640 10 monclient(hunting): get_auth_request con 0x5620edf6b350 auth_method 0 2024-09-12T00:23:58.064 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:23:57.708+0000 7fc7e56de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.064 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:23:57.708+0000 7fc7e56de640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.064 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:23:57.708+0000 7fc7e56de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.064 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:23:57.709+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.064 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:23:57.709+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.064 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:23:57.709+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.064 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:23:57.709+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_done global_id 7754 payload 824 2024-09-12T00:23:58.064 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:23:57.709+0000 7fc7e4edd640 10 monclient: _finish_hunting 0 2024-09-12T00:23:58.064 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:23:57.709+0000 7fc7e4edd640 1 monclient: found mon.noname-c 2024-09-12T00:23:58.064 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:23:57.709+0000 7fc7e4edd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:23:58.064 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:58.064 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:23:58.064 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: dump: 2024-09-12T00:23:58.065 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:58.065 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:58.065 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.065 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.065 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:58.065 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.065 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:58.065 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:58.065 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:58.065 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.065 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: _finish_auth 0 2024-09-12T00:23:58.065 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:23:58.065 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:58.065 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:58.066 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:23:58.066 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:23:57.709+0000 7fc6ca7fc640 10 monclient: dump: 2024-09-12T00:23:58.066 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:58.066 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:58.066 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.066 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.066 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:58.066 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.066 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:58.066 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:58.066 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:58.066 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.066 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:23:57.709+0000 7fc7e5edf640 4 set_mon_vals no callback set 2024-09-12T00:23:58.067 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:23:57.709+0000 7fc7e912e800 5 monclient: authenticate success, global_id 7754 2024-09-12T00:23:58.067 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:23:57.709+0000 7fc7e912e800 10 monclient: _renew_subs 2024-09-12T00:23:58.067 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:23:57.709+0000 7fc7e912e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:58.067 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:23:57.709+0000 7fc7e912e800 10 monclient: _renew_subs 2024-09-12T00:23:58.067 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:23:57.709+0000 7fc7e912e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:23:58.067 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:23:57.711+0000 7fc6ca7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:23:58.067 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:23:57.711+0000 7fc6ca7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:58.067 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:23:57.711+0000 7fc6ca7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:58.067 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:23:57.711+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x7fc6bc076380 auth_method 0 2024-09-12T00:23:58.067 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:23:57.712+0000 7fc7e912e800 10 monclient: get_monmap_and_config 2024-09-12T00:23:58.067 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:23:57.712+0000 7fc7e912e800 10 monclient: build_initial_monmap 2024-09-12T00:23:58.067 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:23:57.712+0000 7fc7e912e800 1 build_initial for_mkfs: 0 2024-09-12T00:23:58.067 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:23:57.712+0000 7fc7e912e800 10 monclient: monmap: 2024-09-12T00:23:58.068 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:23:58.068 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:23:58.068 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:23:58.068 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:23:58.068 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:23:58.068 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.068 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:23:58.068 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:23:58.068 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:23:58.068 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.068 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding auth protocol: cephx 2024-09-12T00:23:58.068 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding auth protocol: cephx 2024-09-12T00:23:58.068 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding auth protocol: cephx 2024-09-12T00:23:58.068 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: secure 2024-09-12T00:23:58.069 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: crc 2024-09-12T00:23:58.069 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: secure 2024-09-12T00:23:58.069 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: crc 2024-09-12T00:23:58.069 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: secure 2024-09-12T00:23:58.069 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: crc 2024-09-12T00:23:58.069 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: crc 2024-09-12T00:23:58.069 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: secure 2024-09-12T00:23:58.069 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: crc 2024-09-12T00:23:58.069 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: secure 2024-09-12T00:23:58.069 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: crc 2024-09-12T00:23:58.069 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x5620edf8ca10) adding con mode: secure 2024-09-12T00:23:58.069 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:23:57.712+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.070 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:23:57.712+0000 7fc7e912e800 10 monclient: init 2024-09-12T00:23:58.070 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding auth protocol: cephx 2024-09-12T00:23:58.070 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding auth protocol: cephx 2024-09-12T00:23:58.070 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding auth protocol: cephx 2024-09-12T00:23:58.070 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: secure 2024-09-12T00:23:58.070 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: crc 2024-09-12T00:23:58.070 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: secure 2024-09-12T00:23:58.070 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: crc 2024-09-12T00:23:58.070 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: secure 2024-09-12T00:23:58.070 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: crc 2024-09-12T00:23:58.070 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: crc 2024-09-12T00:23:58.070 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: secure 2024-09-12T00:23:58.070 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: crc 2024-09-12T00:23:58.071 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: secure 2024-09-12T00:23:58.071 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: crc 2024-09-12T00:23:58.071 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:23:57.712+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b120) adding con mode: secure 2024-09-12T00:23:58.071 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:23:57.712+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.071 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:23:57.712+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.071 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:23:57.713+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command rotate-key cmddesc rotate-key hook 0x7fff7e89b268 EEXIST 2024-09-12T00:23:58.071 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:58.071 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:23:58.071 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-c con 0x5620edfc10c0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:58.071 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-a con 0x5620edf92010 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:58.071 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-b con 0x5620edfbc960 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:58.071 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.071 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.071 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.072 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:58.072 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient(hunting): authenticate will time out at 2114.970117s 2024-09-12T00:23:58.072 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request con 0x5620edfc10c0 auth_method 0 2024-09-12T00:23:58.072 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.072 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.072 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.072 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:23:57.713+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request con 0x5620edf92010 auth_method 0 2024-09-12T00:23:58.072 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:23:57.713+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.072 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:23:57.713+0000 7fc7e46dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.072 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:23:57.713+0000 7fc7e46dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.072 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.072 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.072 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.073 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:23:57.713+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.073 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:23:57.713+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.073 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:23:57.713+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.073 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_done global_id 7757 payload 274 2024-09-12T00:23:58.073 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient: _finish_hunting 0 2024-09-12T00:23:58.073 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 1 monclient: found mon.noname-c 2024-09-12T00:23:58.073 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:23:57.713+0000 7fc7e4edd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:23:58.073 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:58.073 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:23:58.073 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: dump: 2024-09-12T00:23:58.073 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:58.073 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:58.073 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.074 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.074 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:58.074 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.074 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:58.074 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:58.074 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:58.074 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.074 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: _finish_auth 0 2024-09-12T00:23:58.074 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: _check_auth_tickets 2024-09-12T00:23:58.074 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:58.074 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:58.074 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:23:58.074 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:23:57.713+0000 7fc6bbfff640 10 monclient: dump: 2024-09-12T00:23:58.074 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:58.075 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:58.075 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.075 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.075 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:58.075 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.075 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:58.075 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:58.075 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:58.075 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.075 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:23:57.713+0000 7fc7e912e800 5 monclient: authenticate success, global_id 7757 2024-09-12T00:23:58.075 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:23:57.713+0000 7fc7e912e800 10 monclient: get_monmap_and_config success 2024-09-12T00:23:58.075 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:23:57.713+0000 7fc7e912e800 4 set_mon_vals no callback set 2024-09-12T00:23:58.075 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:23:57.714+0000 7fc7e912e800 10 monclient: shutdown 2024-09-12T00:23:58.075 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:23:57.714+0000 7fc7e912e800 10 monclient: build_initial_monmap 2024-09-12T00:23:58.076 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:23:57.714+0000 7fc7e912e800 1 build_initial for_mkfs: 0 2024-09-12T00:23:58.076 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:23:57.714+0000 7fc7e912e800 10 monclient: monmap: 2024-09-12T00:23:58.076 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:23:58.076 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:23:58.076 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:23:58.076 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:23:58.076 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:23:58.076 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.076 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:23:58.076 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:23:58.076 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:23:58.076 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.076 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding auth protocol: cephx 2024-09-12T00:23:58.077 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding auth protocol: cephx 2024-09-12T00:23:58.077 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding auth protocol: cephx 2024-09-12T00:23:58.077 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: secure 2024-09-12T00:23:58.077 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: crc 2024-09-12T00:23:58.077 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: secure 2024-09-12T00:23:58.077 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: crc 2024-09-12T00:23:58.077 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: secure 2024-09-12T00:23:58.077 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: crc 2024-09-12T00:23:58.077 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: crc 2024-09-12T00:23:58.077 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: secure 2024-09-12T00:23:58.077 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: crc 2024-09-12T00:23:58.077 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: secure 2024-09-12T00:23:58.077 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: crc 2024-09-12T00:23:58.078 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 AuthRegistry(0x5620edfb2c90) adding con mode: secure 2024-09-12T00:23:58.078 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:23:57.714+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.078 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:23:57.714+0000 7fc7e912e800 1 librados: starting msgr at 2024-09-12T00:23:58.078 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:23:57.714+0000 7fc7e912e800 1 librados: starting objecter 2024-09-12T00:23:58.078 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:23:57.714+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command objecter_requests cmddesc objecter_requests hook 0x5620edf8f4b0 EEXIST 2024-09-12T00:23:58.078 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:23:57.715+0000 7fc7e912e800 1 librados: setting wanted keys 2024-09-12T00:23:58.078 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:23:57.715+0000 7fc7e912e800 1 librados: calling monclient init 2024-09-12T00:23:58.078 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient: init 2024-09-12T00:23:58.078 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding auth protocol: cephx 2024-09-12T00:23:58.078 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding auth protocol: cephx 2024-09-12T00:23:58.078 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding auth protocol: cephx 2024-09-12T00:23:58.078 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: secure 2024-09-12T00:23:58.078 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: crc 2024-09-12T00:23:58.078 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: secure 2024-09-12T00:23:58.079 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: crc 2024-09-12T00:23:58.079 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: secure 2024-09-12T00:23:58.079 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: crc 2024-09-12T00:23:58.079 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: crc 2024-09-12T00:23:58.079 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: secure 2024-09-12T00:23:58.079 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: crc 2024-09-12T00:23:58.079 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: secure 2024-09-12T00:23:58.079 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: crc 2024-09-12T00:23:58.079 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 AuthRegistry(0x5620edf84930) adding con mode: secure 2024-09-12T00:23:58.079 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:23:57.715+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.079 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:23:57.715+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.079 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:23:57.715+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command rotate-key cmddesc rotate-key hook 0x5620edf84a78 EEXIST 2024-09-12T00:23:58.079 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient: _reopen_session rank -1 2024-09-12T00:23:58.080 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:23:58.080 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-c con 0x5620edf92010 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:23:58.080 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-b con 0x5620edfbc960 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:23:58.080 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): picked mon.noname-a con 0x5620edfc10c0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:23:58.080 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.080 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.080 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:23:58.080 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): _renew_subs 2024-09-12T00:23:58.080 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:23:57.715+0000 7fc7e912e800 10 monclient(hunting): authenticate will time out at 2114.972595s 2024-09-12T00:23:58.080 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:23:57.715+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request con 0x5620edf92010 auth_method 0 2024-09-12T00:23:58.080 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:23:57.715+0000 7fc7e4edd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.080 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:23:57.715+0000 7fc7e4edd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.080 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:23:57.715+0000 7fc7e4edd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.080 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): get_auth_request con 0x5620edfc10c0 auth_method 0 2024-09-12T00:23:58.081 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.081 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.081 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.081 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:23:57.715+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.081 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:23:57.715+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.081 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:23:57.715+0000 7fc7e4edd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.081 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.081 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.081 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.081 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:23:57.715+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request con 0x5620edfbc960 auth_method 0 2024-09-12T00:23:58.081 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:23:57.715+0000 7fc7e46dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:23:58.081 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:23:57.715+0000 7fc7e46dc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:23:58.081 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:23:57.715+0000 7fc7e46dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:23:58.082 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:23:57.715+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:23:58.082 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:23:57.715+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:23:58.082 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:23:57.715+0000 7fc7e46dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:23:58.082 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient(hunting): handle_auth_done global_id 8337 payload 824 2024-09-12T00:23:58.082 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient: _finish_hunting 0 2024-09-12T00:23:58.082 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:23:57.715+0000 7fc7e56de640 1 monclient: found mon.noname-a 2024-09-12T00:23:58.082 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:23:57.715+0000 7fc7e56de640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:23:58.082 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:58.082 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:23:58.082 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: dump: 2024-09-12T00:23:58.082 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:58.082 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:58.082 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.082 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.083 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:58.083 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.083 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:58.083 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:58.083 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:58.083 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.083 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: _finish_auth 0 2024-09-12T00:23:58.083 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:23:58.083 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:23:58.083 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:23:58.083 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:23:58.083 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:23:57.716+0000 7fc6ba7fc640 10 monclient: dump: 2024-09-12T00:23:58.083 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:23:58.083 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:23:58.083 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.084 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:23:58.084 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:23:58.084 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:23:58.084 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:23:58.084 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:23:58.084 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:23:58.084 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.084 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:23:57.716+0000 7fc7e912e800 5 monclient: authenticate success, global_id 8337 2024-09-12T00:23:58.084 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:23:57.716+0000 7fc7e912e800 10 monclient: _renew_subs 2024-09-12T00:23:58.084 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:23:57.716+0000 7fc6bbfff640 4 set_mon_vals no callback set 2024-09-12T00:23:58.084 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:23:57.716+0000 7fc7e912e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:23:58.084 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:23:57.716+0000 7fc7e912e800 10 monclient: _renew_subs 2024-09-12T00:23:58.084 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:23:57.716+0000 7fc7e912e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:23:58.084 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:23:57.716+0000 7fc7e912e800 1 librados: init done 2024-09-12T00:23:58.085 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:23:57.716+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command cr dump hook 0x5620edfce978 2024-09-12T00:23:58.085 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:23:57.718+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.085 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:23:57.718+0000 7fc6ba7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:23:58.085 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:23:57.718+0000 7fc6ba7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:58.085 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:23:57.718+0000 7fc6ba7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:23:58.085 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:23:57.718+0000 7fc7e4edd640 10 monclient: get_auth_request con 0x7fc6b00764a0 auth_method 0 2024-09-12T00:23:58.085 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:23:57.719+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x5620edfdb550 auth_method 0 2024-09-12T00:23:58.085 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.085 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:23:57.720+0000 7fc7e912e800 20 realm 2024-09-12T00:23:58.085 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.085 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.085 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:23:57.720+0000 7fc7e912e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:58.085 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.086 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.086 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:23:57.720+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.086 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:23:57.720+0000 7fc7e4edd640 10 monclient: get_auth_request con 0x5620edfdf760 auth_method 0 2024-09-12T00:23:58.086 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:23:57.721+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:58.086 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:23:57.721+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.086 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:23:57.721+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x5620edfe2fc0 auth_method 0 2024-09-12T00:23:58.086 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:23:57.722+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:58.086 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:23:57.722+0000 7fc7e912e800 20 searching for the correct realm 2024-09-12T00:23:58.086 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:23:57.723+0000 7fc7e56de640 10 monclient: get_auth_request con 0x7fc7d8024040 auth_method 0 2024-09-12T00:23:58.086 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:23:57.724+0000 7fc7e4edd640 10 monclient: get_auth_request con 0x7fc7d40a88e0 auth_method 0 2024-09-12T00:23:58.086 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:23:57.725+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x7fc7d8048b70 auth_method 0 2024-09-12T00:23:58.086 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:23:57.725+0000 7fc7e46dc640 0 -- 172.21.15.67:0/3373398851 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fc7d8048b70 msgr2=0x7fc7d8041410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:23:58.086 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:23:57.927+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x7fc7d8048b70 auth_method 0 2024-09-12T00:23:58.087 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:23:57.929+0000 7fc7e56de640 10 monclient: get_auth_request con 0x7fc7d40b8040 auth_method 0 2024-09-12T00:23:58.087 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:23:57.930+0000 7fc7e4edd640 10 monclient: get_auth_request con 0x7fc7dc089ad0 auth_method 0 2024-09-12T00:23:58.087 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:23:57.931+0000 7fc7e46dc640 0 -- 172.21.15.67:0/3373398851 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5620edfdb550 msgr2=0x5620edfdd9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:58.087 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:23:57.931+0000 7fc6ba7fc640 1 client.8337.objecter ms_handle_reset 0x5620edfdb550 session 0x5620edfdae80 osd.6 2024-09-12T00:23:58.087 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:23:57.931+0000 7fc6ba7fc640 10 monclient: _renew_subs 2024-09-12T00:23:58.087 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:23:57.931+0000 7fc6ba7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:23:58.087 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:23:57.931+0000 7fc7e46dc640 10 monclient: get_auth_request con 0x7fc6b0086820 auth_method 0 2024-09-12T00:23:58.087 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:58.087 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:58.087 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:23:58.087 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:23:58.087 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:58.087 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:23:57.936+0000 7fc7e912e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:58.087 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:23:57.937+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.088 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:23:57.937+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.088 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:23:57.937+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.088 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:23:57.937+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:58.088 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:23:57.937+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.088 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:58.088 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 zone default found 2024-09-12T00:23:58.088 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:23:57.938+0000 7fc7e912e800 4 Realm: () 2024-09-12T00:23:58.088 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:23:57.938+0000 7fc7e912e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:23:58.088 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:23:57.938+0000 7fc7e912e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:23:58.088 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:23:57.938+0000 7fc7e912e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:58.088 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 zonegroup default 2024-09-12T00:23:58.088 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.088 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.089 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.089 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.089 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:23:57.938+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.089 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:23:57.939+0000 7fc7e912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.089 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:23:57.939+0000 7fc7e912e800 20 started sync module instance, tier type = 2024-09-12T00:23:58.089 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:23:57.939+0000 7fc7e912e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:23:58.089 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=0 2024-09-12T00:23:58.089 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=1 2024-09-12T00:23:58.089 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=2 2024-09-12T00:23:58.089 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=3 2024-09-12T00:23:58.089 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=4 2024-09-12T00:23:58.089 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=5 2024-09-12T00:23:58.090 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:23:57.950+0000 7fc7e912e800 20 add_watcher() i=6 2024-09-12T00:23:58.090 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:23:57.951+0000 7fc7e912e800 20 add_watcher() i=7 2024-09-12T00:23:58.090 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:23:57.951+0000 7fc7e912e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:58.090 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding auth protocol: cephx 2024-09-12T00:23:58.090 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding auth protocol: cephx 2024-09-12T00:23:58.090 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding auth protocol: cephx 2024-09-12T00:23:58.090 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: secure 2024-09-12T00:23:58.090 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: crc 2024-09-12T00:23:58.090 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: secure 2024-09-12T00:23:58.090 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: crc 2024-09-12T00:23:58.090 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: secure 2024-09-12T00:23:58.090 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: crc 2024-09-12T00:23:58.090 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: crc 2024-09-12T00:23:58.091 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: secure 2024-09-12T00:23:58.091 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: crc 2024-09-12T00:23:58.091 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: secure 2024-09-12T00:23:58.091 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: crc 2024-09-12T00:23:58.091 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 AuthRegistry(0x7fff7e89b600) adding con mode: secure 2024-09-12T00:23:58.091 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:23:57.953+0000 7fc69afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:58.091 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:23:57.953+0000 7fc7e912e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:23:58.091 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:23:57.953+0000 7fc7e912e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:58.091 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:23:57.953+0000 7fc7e912e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:58.091 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command cache list hook 0x5620edfa8310 2024-09-12T00:23:58.091 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command cache inspect hook 0x5620edfa8310 2024-09-12T00:23:58.091 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command cache erase hook 0x5620edfa8310 2024-09-12T00:23:58.092 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command cache zap hook 0x5620edfa8310 2024-09-12T00:23:58.092 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:23:57.953+0000 7fc7e912e800 5 note: GC not initialized 2024-09-12T00:23:58.092 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:23:57.954+0000 7fc699fe3640 20 reqs_thread_entry: start 2024-09-12T00:23:58.092 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:23:57.954+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command sync trace show hook 0x7fc7d80043a0 2024-09-12T00:23:58.092 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:23:57.954+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command sync trace history hook 0x7fc7d80043a0 2024-09-12T00:23:58.092 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:23:57.954+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command sync trace active hook 0x7fc7d80043a0 2024-09-12T00:23:58.092 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:23:57.954+0000 7fc7e912e800 5 asok(0x5620edcd0630) register_command sync trace active_short hook 0x7fc7d80043a0 2024-09-12T00:23:58.092 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:23:57.954+0000 7fc7e912e800 20 init_complete bucket index max shards: 1 2024-09-12T00:23:58.092 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:23:57.954+0000 7fc7e912e800 20 Filter name: none 2024-09-12T00:23:58.092 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:23:57.954+0000 7fc60b7fe640 20 reqs_thread_entry: start 2024-09-12T00:23:58.092 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:23:57.954+0000 7fc7e912e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:23:58.092 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:23:57.954+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.092 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:23:57.954+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:58.092 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:23:57.954+0000 7fc7e912e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:23:58.093 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:23:57.954+0000 7fc7e912e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:23:58.093 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:23:57.954+0000 7fc7e912e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:23:58.093 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:23:57.954+0000 7fc7e912e800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.093 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:23:57.955+0000 7fc7e912e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:23:58.093 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:23:57.955+0000 7fc7e912e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:58.093 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:23:57.955+0000 7fc7e912e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:58.093 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:23:57.955+0000 7fc7e912e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:58.093 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:23:57.955+0000 7fc7e912e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:58.093 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:23:57.955+0000 7fc7e912e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:23:58.093 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:23:57.956+0000 7fc7e912e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:23:58.093 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:23:57.961+0000 7fc7e912e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:58.093 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:23:57.961+0000 7fc7e912e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:58.094 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:23:57.961+0000 7fc7e912e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:58.094 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:23:57.961+0000 7fc7e912e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:23:58.094 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:23:57.961+0000 7fc6bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562483 cookie 94699431835584 notifier 8337 bl.length()=827 2024-09-12T00:23:58.094 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:23:57.961+0000 7fc6bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:58.094 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:23:57.961+0000 7fc6bbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:58.094 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:23:57.961+0000 7fc6bbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:58.094 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:23:57.961+0000 7fc7e912e800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:23:58.094 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:23:57.961+0000 7fc7e912e800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:23:58.094 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:23:57.961+0000 7fc7e912e800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:23:58.094 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:23:57.961+0000 7fc7e912e800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:23:58.094 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:23:57.965+0000 7fc7e912e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc7e912e800 time 2024-09-12T00:23:57.966259+0000 2024-09-12T00:23:58.094 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:23:58.095 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.095 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:58.095 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc7ea98c71a] 2024-09-12T00:23:58.095 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc7ea98c8d8] 2024-09-12T00:23:58.095 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5620ebd25641] 2024-09-12T00:23:58.095 INFO:tasks.workunit.client.0.smithi067.stderr: 4: radosgw-admin(+0xd8854c) [0x5620ec23854c] 2024-09-12T00:23:58.095 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5620ebd3531d] 2024-09-12T00:23:58.095 INFO:tasks.workunit.client.0.smithi067.stderr: 6: main() 2024-09-12T00:23:58.095 INFO:tasks.workunit.client.0.smithi067.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc7e9629590] 2024-09-12T00:23:58.095 INFO:tasks.workunit.client.0.smithi067.stderr: 8: __libc_start_main() 2024-09-12T00:23:58.095 INFO:tasks.workunit.client.0.smithi067.stderr: 9: _start() 2024-09-12T00:23:58.095 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.095 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:23:57.966+0000 7fc7e912e800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:23:58.095 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7fc7e912e800 thread_name:radosgw-admin 2024-09-12T00:23:58.096 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.096 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:23:58.096 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc7e963e6f0] 2024-09-12T00:23:58.096 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc7e968b99c] 2024-09-12T00:23:58.096 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:23:58.096 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:23:58.096 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc7ea98c774] 2024-09-12T00:23:58.096 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc7ea98c8d8] 2024-09-12T00:23:58.096 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5620ebd25641] 2024-09-12T00:23:58.096 INFO:tasks.workunit.client.0.smithi067.stderr: 8: radosgw-admin(+0xd8854c) [0x5620ec23854c] 2024-09-12T00:23:58.096 INFO:tasks.workunit.client.0.smithi067.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5620ebd3531d] 2024-09-12T00:23:58.096 INFO:tasks.workunit.client.0.smithi067.stderr: 10: main() 2024-09-12T00:23:58.096 INFO:tasks.workunit.client.0.smithi067.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc7e9629590] 2024-09-12T00:23:58.097 INFO:tasks.workunit.client.0.smithi067.stderr: 12: __libc_start_main() 2024-09-12T00:23:58.097 INFO:tasks.workunit.client.0.smithi067.stderr: 13: _start() 2024-09-12T00:23:58.097 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:23:58.097 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:23:58.097 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:23:58.097 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:23:58.097 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:23:58.097 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:23:58.097 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:23:58.097 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:23:58.097 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:23:58.097 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:23:58.097 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:23:58.098 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:23:58.098 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:23:58.098 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:23:58.098 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:23:58.098 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:23:58.098 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:23:58.098 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:23:58.098 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:23:58.098 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:23:58.098 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:23:58.098 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:23:58.098 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:23:58.098 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:23:58.099 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:23:58.099 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:23:58.099 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:23:58.099 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:23:58.099 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:23:58.099 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:23:58.099 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:23:58.099 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:23:58.099 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:23:58.099 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:23:58.099 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:23:58.099 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:23:58.099 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:23:58.100 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:23:58.100 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:23:58.100 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:23:58.100 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:23:58.100 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:23:58.100 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:23:58.100 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:23:58.100 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:23:58.100 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:23:58.100 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:23:58.100 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:23:58.100 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:23:58.101 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:23:58.101 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:23:58.101 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:23:58.101 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:23:58.101 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:23:58.101 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:23:58.101 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:23:58.101 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:23:58.101 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:23:58.101 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:23:58.101 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:23:58.101 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:23:58.101 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:23:58.102 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:23:58.102 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:23:58.102 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:23:58.102 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:23:58.102 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:23:58.102 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:23:58.102 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:23:58.102 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:23:58.102 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:23:58.102 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:23:58.102 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:23:58.102 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:23:58.102 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:23:58.103 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:23:58.103 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:23:58.103 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:23:58.103 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:23:58.103 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:23:58.103 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:23:58.103 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:23:58.103 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:23:58.103 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:23:58.103 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:23:58.103 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:23:58.103 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:23:58.103 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:23:58.104 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:23:58.104 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:23:58.104 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:23:58.104 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:23:58.104 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:23:58.104 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:23:58.104 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:23:58.104 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:23:58.104 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc60b7fe640 / http_manager 2024-09-12T00:23:58.104 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc699fe3640 / http_manager 2024-09-12T00:23:58.104 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc69afe5640 / rgw_dt_lg_renew 2024-09-12T00:23:58.104 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc6ba7fc640 / ms_dispatch 2024-09-12T00:23:58.104 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc6bbfff640 / io_context_pool 2024-09-12T00:23:58.105 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc6ca7fc640 / ms_dispatch 2024-09-12T00:23:58.105 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc6d160a640 / ms_dispatch 2024-09-12T00:23:58.105 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc6d2e0d640 / io_context_pool 2024-09-12T00:23:58.105 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc7e46dc640 / msgr-worker-2 2024-09-12T00:23:58.105 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc7e4edd640 / msgr-worker-1 2024-09-12T00:23:58.105 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc7e56de640 / msgr-worker-0 2024-09-12T00:23:58.105 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc7e5edf640 / io_context_pool 2024-09-12T00:23:58.105 INFO:tasks.workunit.client.0.smithi067.stderr: 7fc7e912e800 / radosgw-admin 2024-09-12T00:23:58.105 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:23:58.105 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:23:58.105 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:23:57.967958Z_7565f3b3-02c4-4a44-8378-a164baf7f721/log 2024-09-12T00:23:58.105 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:23:58.105 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:23:58.107 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:58.107 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:58.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.049+0000 7f3dca725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.050+0000 7f3dca725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.050+0000 7f3dca725800 20 realm 2024-09-12T00:23:58.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.050+0000 7f3dca725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.051+0000 7f3dca725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.051+0000 7f3dca725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:23:58.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.051+0000 7f3dca725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.051+0000 7f3dca725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.051+0000 7f3dca725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.052+0000 7f3dca725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:58.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.052+0000 7f3dca725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.053+0000 7f3dca725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:23:58.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.053+0000 7f3dca725800 20 searching for the correct realm 2024-09-12T00:23:58.108 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.056+0000 7f3dc5b32640 0 -- 172.21.15.67:0/1189430532 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f3dbc041b00 msgr2=0x7f3dbc038930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:58.261 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.261+0000 7f3dc6b34640 0 -- 172.21.15.67:0/1189430532 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55a501349ae0 msgr2=0x55a50134bf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:23:58.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.266+0000 7f3dca725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:23:58.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.266+0000 7f3dca725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:23:58.265 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.266+0000 7f3dca725800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:23:58.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.266+0000 7f3dca725800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:23:58.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.266+0000 7f3dca725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:23:58.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.266+0000 7f3dca725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:23:58.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.266+0000 7f3dca725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.266+0000 7f3dca725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.266 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.266+0000 7f3dca725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.266+0000 7f3dca725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:23:58.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.267+0000 7f3dca725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.267+0000 7f3dca725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:23:58.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.267+0000 7f3dca725800 20 zone default found 2024-09-12T00:23:58.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.267+0000 7f3dca725800 4 Realm: () 2024-09-12T00:23:58.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.267+0000 7f3dca725800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:23:58.268 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.267+0000 7f3dca725800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.267+0000 7f3dca725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.267+0000 7f3dca725800 20 zonegroup default 2024-09-12T00:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.267+0000 7f3dca725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.267+0000 7f3dca725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.267+0000 7f3dca725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.267+0000 7f3dca725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.267+0000 7f3dca725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.268+0000 7f3dca725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.268+0000 7f3dca725800 20 started sync module instance, tier type = 2024-09-12T00:23:58.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.268+0000 7f3dca725800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:23:58.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.278+0000 7f3dca725800 20 add_watcher() i=0 2024-09-12T00:23:58.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.278+0000 7f3dca725800 20 add_watcher() i=1 2024-09-12T00:23:58.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.278+0000 7f3dca725800 20 add_watcher() i=2 2024-09-12T00:23:58.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.278+0000 7f3dca725800 20 add_watcher() i=3 2024-09-12T00:23:58.277 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.278+0000 7f3dca725800 20 add_watcher() i=4 2024-09-12T00:23:58.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.278+0000 7f3dca725800 20 add_watcher() i=5 2024-09-12T00:23:58.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.278+0000 7f3dca725800 20 add_watcher() i=6 2024-09-12T00:23:58.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.279+0000 7f3dca725800 20 add_watcher() i=7 2024-09-12T00:23:58.278 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.279+0000 7f3dca725800 2 all 8 watchers are set, enabling cache 2024-09-12T00:23:58.280 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.281+0000 7f3c7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:58.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.281+0000 7f3dca725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:23:58.281 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.281+0000 7f3dca725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.281+0000 7f3dca725800 5 note: GC not initialized 2024-09-12T00:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.281+0000 7f3bf77fe640 20 reqs_thread_entry: start 2024-09-12T00:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.282+0000 7f3dca725800 20 init_complete bucket index max shards: 1 2024-09-12T00:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.282+0000 7f3dca725800 20 Filter name: none 2024-09-12T00:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.282+0000 7f3bf57fa640 20 reqs_thread_entry: start 2024-09-12T00:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.282+0000 7f3dca725800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.282+0000 7f3dca725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.282+0000 7f3dca725800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:23:58.282 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.282+0000 7f3dca725800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:23:58.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.282+0000 7f3dca725800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:23:58.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.282+0000 7f3dca725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:23:58.283 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.282+0000 7f3dca725800 20 rados->read ofs=0 len=0 2024-09-12T00:23:58.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.283+0000 7f3dca725800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:23:58.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.283+0000 7f3dca725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:23:58.284 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.283+0000 7f3dca725800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:23:58.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.283+0000 7f3dca725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:23:58.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.283+0000 7f3dca725800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:23:58.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.283+0000 7f3dca725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:23:58.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.283+0000 7f3dca725800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:23:58.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.283+0000 7f3dca725800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:23:58.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.283+0000 7f3dca725800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:23:58.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.283+0000 7f3dca725800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:23:58.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.284+0000 7f3dca725800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:23:58.285 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.284+0000 7f3dca725800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:23:58.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.285+0000 7f3c7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:23:58.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.287+0000 7f3dca725800 20 remove_watcher() i=0 2024-09-12T00:23:58.286 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.287+0000 7f3dca725800 2 removed watcher, disabling cache 2024-09-12T00:23:58.287 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.288+0000 7f3dca725800 20 remove_watcher() i=1 2024-09-12T00:23:58.289 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.289+0000 7f3dca725800 20 remove_watcher() i=2 2024-09-12T00:23:58.290 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.291+0000 7f3dca725800 20 remove_watcher() i=3 2024-09-12T00:23:58.291 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.292+0000 7f3dca725800 20 remove_watcher() i=4 2024-09-12T00:23:58.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.293+0000 7f3dca725800 20 remove_watcher() i=5 2024-09-12T00:23:58.293 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.294+0000 7f3dca725800 20 remove_watcher() i=6 2024-09-12T00:23:58.294 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:23:58.295+0000 7f3dca725800 20 remove_watcher() i=7 2024-09-12T00:23:58.305 INFO:tasks.workunit.client.0.smithi067.stderr: test: duplicated entries can be purged manually 2024-09-12T00:24:28.321 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:24:28.355 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:28.356 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:28.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.402+0000 7f3147015800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.404+0000 7f3147015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.404+0000 7f3147015800 20 realm 2024-09-12T00:24:28.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.404+0000 7f3147015800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.404+0000 7f3147015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.404+0000 7f3147015800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:28.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.404+0000 7f3147015800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.405+0000 7f3147015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.405+0000 7f3147015800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.405+0000 7f3147015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:28.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.405+0000 7f3147015800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.406+0000 7f3147015800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:28.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.406+0000 7f3147015800 20 searching for the correct realm 2024-09-12T00:24:28.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.410+0000 7f3141f91640 0 -- 172.21.15.67:0/2675976980 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f313808f140 msgr2=0x7f3138069a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:28.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.414+0000 7f3142f93640 0 -- 172.21.15.67:0/2675976980 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55beed9361c0 msgr2=0x55beed938640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:28.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.419+0000 7f3147015800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:28.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.419+0000 7f3147015800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:28.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.419+0000 7f3147015800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:24:28.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.419+0000 7f3147015800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:24:28.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.419+0000 7f3147015800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:28.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.419+0000 7f3147015800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:28.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.419+0000 7f3147015800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.419+0000 7f3147015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.419 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.419+0000 7f3147015800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.419+0000 7f3147015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:28.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.419+0000 7f3147015800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.420+0000 7f3147015800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:28.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.420+0000 7f3147015800 20 zone default found 2024-09-12T00:24:28.420 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.420+0000 7f3147015800 4 Realm: () 2024-09-12T00:24:28.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.420+0000 7f3147015800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:24:28.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.420+0000 7f3147015800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:24:28.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.420+0000 7f3147015800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:28.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.420+0000 7f3147015800 20 zonegroup default 2024-09-12T00:24:28.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.420+0000 7f3147015800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.420+0000 7f3147015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.420+0000 7f3147015800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.420+0000 7f3147015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.420+0000 7f3147015800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.421+0000 7f3147015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.421+0000 7f3147015800 20 started sync module instance, tier type = 2024-09-12T00:24:28.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.421+0000 7f3147015800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:24:28.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.430+0000 7f3147015800 20 add_watcher() i=0 2024-09-12T00:24:28.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.430+0000 7f3147015800 20 add_watcher() i=1 2024-09-12T00:24:28.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.430+0000 7f3147015800 20 add_watcher() i=2 2024-09-12T00:24:28.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.430+0000 7f3147015800 20 add_watcher() i=3 2024-09-12T00:24:28.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.430+0000 7f3147015800 20 add_watcher() i=4 2024-09-12T00:24:28.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.430+0000 7f3147015800 20 add_watcher() i=5 2024-09-12T00:24:28.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.430+0000 7f3147015800 20 add_watcher() i=6 2024-09-12T00:24:28.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.431+0000 7f3147015800 20 add_watcher() i=7 2024-09-12T00:24:28.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.431+0000 7f3147015800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:28.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.432+0000 7f2ff8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:28.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.433+0000 7f3147015800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:28.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.433+0000 7f3147015800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:28.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.433+0000 7f3147015800 5 note: GC not initialized 2024-09-12T00:24:28.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.433+0000 7f2f737fe640 20 reqs_thread_entry: start 2024-09-12T00:24:28.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.433+0000 7f3147015800 20 init_complete bucket index max shards: 1 2024-09-12T00:24:28.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.433+0000 7f3147015800 20 Filter name: none 2024-09-12T00:24:28.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.433+0000 7f2f717fa640 20 reqs_thread_entry: start 2024-09-12T00:24:28.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.434+0000 7f3147015800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.434+0000 7f3147015800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:24:28.434 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.434+0000 7f3147015800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.434+0000 7f3147015800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:24:28.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.434+0000 7f3147015800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:28.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.434+0000 7f3147015800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.435+0000 7f3147015800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:24:28.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.435+0000 7f3147015800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.435+0000 7f3147015800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:24:28.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.435+0000 7f3147015800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:28.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.437+0000 7f2ff8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:28.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.440+0000 7f3147015800 20 remove_watcher() i=0 2024-09-12T00:24:28.439 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.440+0000 7f3147015800 2 removed watcher, disabling cache 2024-09-12T00:24:28.440 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.441+0000 7f3147015800 20 remove_watcher() i=1 2024-09-12T00:24:28.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.442+0000 7f3147015800 20 remove_watcher() i=2 2024-09-12T00:24:28.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.443+0000 7f3147015800 20 remove_watcher() i=3 2024-09-12T00:24:28.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.445+0000 7f3147015800 20 remove_watcher() i=4 2024-09-12T00:24:28.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.446+0000 7f3147015800 20 remove_watcher() i=5 2024-09-12T00:24:28.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.447+0000 7f3147015800 20 remove_watcher() i=6 2024-09-12T00:24:28.447 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.448+0000 7f3147015800 20 remove_watcher() i=7 2024-09-12T00:24:28.458 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.458 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:24:28.459 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 num_objects: 11 size_kb: 1 num_shards: 3 2024-09-12T00:24:28.459 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.460 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:24:28.496 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:28.496 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:28.535 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.536+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.537 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.538+0000 7f1f88840800 20 realm 2024-09-12T00:24:28.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.538+0000 7f1f88840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:28.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.539+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:28.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.539+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.540+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:28.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.540+0000 7f1f88840800 20 searching for the correct realm 2024-09-12T00:24:28.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.543+0000 7f1f85b29640 0 -- 172.21.15.67:0/1810663864 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f1f7c074bb0 msgr2=0x7f1f7c073910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:28.546 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.547+0000 7f1f86b2b640 0 -- 172.21.15.67:0/1810663864 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x56457c8b6de0 msgr2=0x56457c8b91d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:28.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:28.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:28.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:24:28.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:24:28.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:28.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:28.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.551+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:28.552 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:28.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.552+0000 7f1f88840800 20 zone default found 2024-09-12T00:24:28.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.552+0000 7f1f88840800 4 Realm: () 2024-09-12T00:24:28.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.552+0000 7f1f88840800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:24:28.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.552+0000 7f1f88840800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:24:28.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.552+0000 7f1f88840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:28.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.552+0000 7f1f88840800 20 zonegroup default 2024-09-12T00:24:28.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.553+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.553+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.553+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.553+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.553+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.553+0000 7f1f88840800 20 started sync module instance, tier type = 2024-09-12T00:24:28.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.553+0000 7f1f88840800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:24:28.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=0 2024-09-12T00:24:28.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=1 2024-09-12T00:24:28.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=2 2024-09-12T00:24:28.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=3 2024-09-12T00:24:28.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=4 2024-09-12T00:24:28.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=5 2024-09-12T00:24:28.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=6 2024-09-12T00:24:28.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=7 2024-09-12T00:24:28.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.563+0000 7f1f88840800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:28.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.565+0000 7f1e3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:28.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.565+0000 7f1f88840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:28.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.565+0000 7f1f88840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:28.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.565+0000 7f1f88840800 5 note: GC not initialized 2024-09-12T00:24:28.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.566+0000 7f1db77fe640 20 reqs_thread_entry: start 2024-09-12T00:24:28.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.566+0000 7f1f88840800 20 init_complete bucket index max shards: 1 2024-09-12T00:24:28.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.566+0000 7f1f88840800 20 Filter name: none 2024-09-12T00:24:28.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.566+0000 7f1db57fa640 20 reqs_thread_entry: start 2024-09-12T00:24:28.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.566+0000 7f1f88840800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:24:28.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.566+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.566+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:24:28.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.566+0000 7f1f88840800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:24:28.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.566+0000 7f1f88840800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:24:28.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.566+0000 7f1f88840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:24:28.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.566+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.567+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:24:28.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.567+0000 7f1f88840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:24:28.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.567+0000 7f1f88840800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:24:28.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.567+0000 7f1f88840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:28.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.567+0000 7f1f88840800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:24:28.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.567+0000 7f1f88840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:24:28.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.568+0000 7f1f88840800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:24:28.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.572+0000 7f1f88840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:24:28.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.572+0000 7f1f88840800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:24:28.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.572+0000 7f1f88840800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:24:28.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.572+0000 7f1f88840800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:24:28.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.572+0000 7f1e69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562484 cookie 94856442313888 notifier 7811 bl.length()=827 2024-09-12T00:24:28.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.572+0000 7f1e69ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:24:28.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.572+0000 7f1e69ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:24:28.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.572+0000 7f1e69ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:24:28.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.573+0000 7f1f88840800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:24:28.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.573+0000 7f1f88840800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:24:28.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.573+0000 7f1f88840800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:24:28.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.573+0000 7f1f88840800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:24:28.574 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1f88840800 time 2024-09-12T00:24:28.577197+0000 2024-09-12T00:24:28.574 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:24:28.575 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:28.575 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f8bd8c71a] 2024-09-12T00:24:28.575 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f8bd8c8d8] 2024-09-12T00:24:28.575 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56457a312641] 2024-09-12T00:24:28.575 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56457a32238a] 2024-09-12T00:24:28.575 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:24:28.575 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f1f8aa29590] 2024-09-12T00:24:28.576 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:24:28.576 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:24:28.576 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.576+0000 7f1f88840800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1f88840800 time 2024-09-12T00:24:28.577197+0000 2024-09-12T00:24:28.576 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:24:28.576 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.576 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:28.576 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f8bd8c71a] 2024-09-12T00:24:28.576 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f8bd8c8d8] 2024-09-12T00:24:28.576 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56457a312641] 2024-09-12T00:24:28.576 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56457a32238a] 2024-09-12T00:24:28.576 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:24:28.576 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f1f8aa29590] 2024-09-12T00:24:28.576 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:24:28.577 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:24:28.577 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.577 INFO:tasks.workunit.client.0.smithi067.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:24:28.577 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f1f88840800 thread_name:radosgw-admin 2024-09-12T00:24:28.597 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:28.597 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1f8aa3e6f0] 2024-09-12T00:24:28.597 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1f8aa8b99c] 2024-09-12T00:24:28.597 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:24:28.597 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:24:28.597 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f8bd8c774] 2024-09-12T00:24:28.597 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f8bd8c8d8] 2024-09-12T00:24:28.597 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56457a312641] 2024-09-12T00:24:28.598 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56457a32238a] 2024-09-12T00:24:28.598 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:24:28.598 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f1f8aa29590] 2024-09-12T00:24:28.598 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:24:28.598 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:24:28.598 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.577+0000 7f1f88840800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:24:28.598 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f1f88840800 thread_name:radosgw-admin 2024-09-12T00:24:28.598 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.598 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:28.598 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1f8aa3e6f0] 2024-09-12T00:24:28.598 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1f8aa8b99c] 2024-09-12T00:24:28.598 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:24:28.598 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:24:28.599 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f8bd8c774] 2024-09-12T00:24:28.599 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f8bd8c8d8] 2024-09-12T00:24:28.599 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56457a312641] 2024-09-12T00:24:28.599 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56457a32238a] 2024-09-12T00:24:28.599 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:24:28.599 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f1f8aa29590] 2024-09-12T00:24:28.599 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:24:28.599 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:24:28.599 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:24:28.599 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.599 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:24:28.599 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:24:28.518+0000 7f1e74608640 10 monclient: dump: 2024-09-12T00:24:28.600 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.600 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.600 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.600 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.600 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.600 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.600 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.600 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.600 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.600 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.600 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:24:28.518+0000 7f1e74608640 10 monclient: _finish_auth 0 2024-09-12T00:24:28.600 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:24:28.518+0000 7f1e74608640 10 monclient: _check_auth_tickets 2024-09-12T00:24:28.601 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:24:28.518+0000 7f1e74608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:28.601 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:24:28.518+0000 7f1f88840800 5 monclient: authenticate success, global_id 7799 2024-09-12T00:24:28.601 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:24:28.518+0000 7f1f88840800 10 monclient: get_monmap_and_config success 2024-09-12T00:24:28.601 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:24:28.518+0000 7f1f88840800 4 set_mon_vals no callback set 2024-09-12T00:24:28.601 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:24:28.518+0000 7f1e74608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.601 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:24:28.518+0000 7f1e74608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:24:28.601 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:24:28.518+0000 7f1e74608640 10 monclient: dump: 2024-09-12T00:24:28.601 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.601 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.601 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.601 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.601 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.601 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.602 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.602 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.602 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.602 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.602 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:24:28.519+0000 7f1f88840800 10 monclient: shutdown 2024-09-12T00:24:28.602 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 asok(0x56457c5ac630) unregister_commands rotate-key 2024-09-12T00:24:28.602 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:24:28.519+0000 7f1f88840800 10 monclient: build_initial_monmap 2024-09-12T00:24:28.602 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:24:28.519+0000 7f1f88840800 1 build_initial for_mkfs: 0 2024-09-12T00:24:28.602 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:24:28.519+0000 7f1f88840800 10 monclient: monmap: 2024-09-12T00:24:28.602 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:24:28.602 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:28.602 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:24:28.602 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:24:28.602 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:28.603 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.603 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:24:28.603 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:24:28.603 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:24:28.603 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.603 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding auth protocol: cephx 2024-09-12T00:24:28.603 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding auth protocol: cephx 2024-09-12T00:24:28.603 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding auth protocol: cephx 2024-09-12T00:24:28.603 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: secure 2024-09-12T00:24:28.603 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: crc 2024-09-12T00:24:28.603 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: secure 2024-09-12T00:24:28.603 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: crc 2024-09-12T00:24:28.603 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: secure 2024-09-12T00:24:28.603 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: crc 2024-09-12T00:24:28.604 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: crc 2024-09-12T00:24:28.604 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: secure 2024-09-12T00:24:28.604 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: crc 2024-09-12T00:24:28.604 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: secure 2024-09-12T00:24:28.604 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: crc 2024-09-12T00:24:28.604 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: secure 2024-09-12T00:24:28.604 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:24:28.519+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.604 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:24:28.519+0000 7f1f88840800 1 librados: starting msgr at 2024-09-12T00:24:28.604 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:24:28.519+0000 7f1f88840800 1 librados: starting objecter 2024-09-12T00:24:28.604 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command objecter_requests hook 0x56457c658750 2024-09-12T00:24:28.604 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:24:28.520+0000 7f1f88840800 1 librados: setting wanted keys 2024-09-12T00:24:28.604 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:24:28.520+0000 7f1f88840800 1 librados: calling monclient init 2024-09-12T00:24:28.604 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient: init 2024-09-12T00:24:28.605 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding auth protocol: cephx 2024-09-12T00:24:28.605 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding auth protocol: cephx 2024-09-12T00:24:28.605 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding auth protocol: cephx 2024-09-12T00:24:28.605 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: secure 2024-09-12T00:24:28.605 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: crc 2024-09-12T00:24:28.605 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: secure 2024-09-12T00:24:28.605 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: crc 2024-09-12T00:24:28.605 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: secure 2024-09-12T00:24:28.605 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: crc 2024-09-12T00:24:28.605 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: crc 2024-09-12T00:24:28.605 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: secure 2024-09-12T00:24:28.605 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: crc 2024-09-12T00:24:28.605 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: secure 2024-09-12T00:24:28.606 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: crc 2024-09-12T00:24:28.606 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: secure 2024-09-12T00:24:28.606 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:24:28.520+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.606 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:24:28.520+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.606 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command rotate-key hook 0x56457c7cc958 2024-09-12T00:24:28.606 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:28.606 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:24:28.606 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-a con 0x56457c67a020 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:24:28.606 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-b con 0x56457c683f10 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:24:28.606 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-c con 0x56457c70fe70 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:24:28.606 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.606 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.606 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.607 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:28.607 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): authenticate will time out at 2145.777659s 2024-09-12T00:24:28.607 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:24:28.520+0000 7f1f8632a640 10 monclient(hunting): get_auth_request con 0x56457c67a020 auth_method 0 2024-09-12T00:24:28.607 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:24:28.520+0000 7f1f8632a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.607 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:24:28.520+0000 7f1f8632a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.607 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:24:28.520+0000 7f1f8632a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.607 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:24:28.520+0000 7f1f86b2b640 10 monclient(hunting): get_auth_request con 0x56457c70fe70 auth_method 0 2024-09-12T00:24:28.607 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:24:28.520+0000 7f1f86b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.607 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:24:28.520+0000 7f1f86b2b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.607 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:24:28.520+0000 7f1f86b2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.607 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:24:28.520+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.607 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:24:28.520+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.608 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:24:28.520+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.608 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:24:28.520+0000 7f1f86b2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.608 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:24:28.520+0000 7f1f86b2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.608 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:24:28.520+0000 7f1f86b2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.608 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:24:28.520+0000 7f1f85b29640 10 monclient(hunting): get_auth_request con 0x56457c683f10 auth_method 0 2024-09-12T00:24:28.608 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:24:28.520+0000 7f1f85b29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.608 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:24:28.520+0000 7f1f85b29640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.608 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:24:28.520+0000 7f1f85b29640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.608 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:24:28.520+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.608 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:24:28.520+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.608 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:24:28.520+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.608 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:24:28.521+0000 7f1f8632a640 10 monclient(hunting): handle_auth_done global_id 8382 payload 824 2024-09-12T00:24:28.608 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:24:28.521+0000 7f1f8632a640 10 monclient: _finish_hunting 0 2024-09-12T00:24:28.608 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:24:28.521+0000 7f1f8632a640 1 monclient: found mon.noname-a 2024-09-12T00:24:28.609 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:24:28.521+0000 7f1f8632a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:24:28.609 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.609 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:24:28.609 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: dump: 2024-09-12T00:24:28.609 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.609 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.609 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.609 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.609 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.609 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.609 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.609 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.609 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.609 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.610 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: _finish_auth 0 2024-09-12T00:24:28.610 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: _check_auth_tickets 2024-09-12T00:24:28.610 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:28.610 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.610 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:24:28.610 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: dump: 2024-09-12T00:24:28.610 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.610 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.610 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.610 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.610 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.610 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.610 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.611 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.611 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.611 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.611 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:24:28.521+0000 7f1f88840800 5 monclient: authenticate success, global_id 8382 2024-09-12T00:24:28.611 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:24:28.521+0000 7f1e74608640 4 set_mon_vals no callback set 2024-09-12T00:24:28.611 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:24:28.521+0000 7f1f88840800 10 monclient: _renew_subs 2024-09-12T00:24:28.611 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:24:28.521+0000 7f1f88840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:24:28.611 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:24:28.521+0000 7f1f88840800 10 monclient: _renew_subs 2024-09-12T00:24:28.611 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:24:28.521+0000 7f1f88840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:24:28.611 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:24:28.521+0000 7f1f88840800 1 librados: init done 2024-09-12T00:24:28.611 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:24:28.523+0000 7f1e72e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:24:28.611 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:24:28.523+0000 7f1e72e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:24:28.611 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:24:28.523+0000 7f1e72e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:24:28.611 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:24:28.523+0000 7f1f85b29640 10 monclient: get_auth_request con 0x7f1e6c076470 auth_method 0 2024-09-12T00:24:28.612 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:24:28.523+0000 7f1f86b2b640 10 monclient: get_auth_request con 0x56457c7f5840 auth_method 0 2024-09-12T00:24:28.612 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:24:28.524+0000 7f1f8632a640 10 monclient: get_auth_request con 0x56457c817fd0 auth_method 0 2024-09-12T00:24:28.612 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:24:28.525+0000 7f1f85b29640 10 monclient: get_auth_request con 0x56457c81c3e0 auth_method 0 2024-09-12T00:24:28.612 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:24:28.526+0000 7f1f88840800 10 monclient: build_initial_monmap 2024-09-12T00:24:28.612 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:24:28.526+0000 7f1f88840800 1 build_initial for_mkfs: 0 2024-09-12T00:24:28.612 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:24:28.526+0000 7f1f88840800 10 monclient: monmap: 2024-09-12T00:24:28.612 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:24:28.612 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:28.612 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:24:28.612 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:24:28.612 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:28.612 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.612 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:24:28.613 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:24:28.613 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:24:28.613 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.613 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding auth protocol: cephx 2024-09-12T00:24:28.613 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding auth protocol: cephx 2024-09-12T00:24:28.613 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding auth protocol: cephx 2024-09-12T00:24:28.613 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: secure 2024-09-12T00:24:28.613 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: crc 2024-09-12T00:24:28.613 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: secure 2024-09-12T00:24:28.613 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: crc 2024-09-12T00:24:28.613 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: secure 2024-09-12T00:24:28.613 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: crc 2024-09-12T00:24:28.613 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: crc 2024-09-12T00:24:28.613 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: secure 2024-09-12T00:24:28.614 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: crc 2024-09-12T00:24:28.614 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: secure 2024-09-12T00:24:28.614 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: crc 2024-09-12T00:24:28.614 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: secure 2024-09-12T00:24:28.614 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:24:28.527+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.614 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command objecter_requests cmddesc objecter_requests hook 0x56457c824c50 EEXIST 2024-09-12T00:24:28.614 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:24:28.527+0000 7f1f88840800 10 monclient: init 2024-09-12T00:24:28.614 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding auth protocol: cephx 2024-09-12T00:24:28.614 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding auth protocol: cephx 2024-09-12T00:24:28.614 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding auth protocol: cephx 2024-09-12T00:24:28.614 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: secure 2024-09-12T00:24:28.614 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: crc 2024-09-12T00:24:28.614 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: secure 2024-09-12T00:24:28.615 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: crc 2024-09-12T00:24:28.615 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: secure 2024-09-12T00:24:28.615 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: crc 2024-09-12T00:24:28.615 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: crc 2024-09-12T00:24:28.615 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: secure 2024-09-12T00:24:28.615 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: crc 2024-09-12T00:24:28.615 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: secure 2024-09-12T00:24:28.615 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: crc 2024-09-12T00:24:28.615 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: secure 2024-09-12T00:24:28.615 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:24:28.527+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.615 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:24:28.527+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.615 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command rotate-key cmddesc rotate-key hook 0x56457c81fa90 EEXIST 2024-09-12T00:24:28.615 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:24:28.527+0000 7f1f88840800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:28.616 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:24:28.527+0000 7f1f88840800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:24:28.616 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:24:28.527+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-a con 0x56457c848940 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:24:28.616 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-b con 0x56457c84ac10 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:24:28.616 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-c con 0x56457c847110 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:24:28.616 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.616 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.616 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.616 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:28.616 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient(hunting): authenticate will time out at 2145.785031s 2024-09-12T00:24:28.616 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): get_auth_request con 0x56457c848940 auth_method 0 2024-09-12T00:24:28.616 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.616 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.616 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.617 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:24:28.528+0000 7f1f86b2b640 10 monclient(hunting): get_auth_request con 0x56457c847110 auth_method 0 2024-09-12T00:24:28.617 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:24:28.528+0000 7f1f86b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.617 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:24:28.528+0000 7f1f86b2b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.617 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:24:28.528+0000 7f1f86b2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.617 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.617 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.617 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.617 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:24:28.528+0000 7f1f86b2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.617 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:24:28.528+0000 7f1f86b2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.617 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:24:28.528+0000 7f1f86b2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.617 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): handle_auth_done global_id 8385 payload 824 2024-09-12T00:24:28.617 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient: _finish_hunting 0 2024-09-12T00:24:28.617 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:24:28.528+0000 7f1f8632a640 1 monclient: found mon.noname-a 2024-09-12T00:24:28.618 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:24:28.618 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:24:28.528+0000 7f1f85b29640 10 monclient: get_auth_request con 0x56457c84ac10 auth_method 0 2024-09-12T00:24:28.618 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.618 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:24:28.618 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: dump: 2024-09-12T00:24:28.618 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.618 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.618 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.618 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.618 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.618 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.618 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.618 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.618 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.619 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.619 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: _finish_auth 0 2024-09-12T00:24:28.619 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:24:28.619 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:24:28.528+0000 7f1f88840800 5 monclient: authenticate success, global_id 8385 2024-09-12T00:24:28.619 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient: _renew_subs 2024-09-12T00:24:28.619 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:24:28.619 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:28.619 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.619 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:24:28.619 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: dump: 2024-09-12T00:24:28.619 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.619 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.619 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.620 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.620 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.620 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.620 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.620 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.620 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.620 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.620 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:24:28.528+0000 7f1f8732c640 4 set_mon_vals no callback set 2024-09-12T00:24:28.620 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient: _renew_subs 2024-09-12T00:24:28.620 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:24:28.620 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:24:28.530+0000 7f1e6bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:24:28.620 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:24:28.530+0000 7f1e6bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:24:28.620 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:24:28.530+0000 7f1e6bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:24:28.621 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:24:28.530+0000 7f1f85b29640 10 monclient: get_auth_request con 0x7f1e60076380 auth_method 0 2024-09-12T00:24:28.621 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:24:28.530+0000 7f1f88840800 10 monclient: get_monmap_and_config 2024-09-12T00:24:28.621 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:24:28.530+0000 7f1f88840800 10 monclient: build_initial_monmap 2024-09-12T00:24:28.621 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:24:28.530+0000 7f1f88840800 1 build_initial for_mkfs: 0 2024-09-12T00:24:28.621 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:24:28.530+0000 7f1f88840800 10 monclient: monmap: 2024-09-12T00:24:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:24:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:24:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:24:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:24:28.621 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:24:28.622 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:24:28.622 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.622 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding auth protocol: cephx 2024-09-12T00:24:28.622 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding auth protocol: cephx 2024-09-12T00:24:28.622 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding auth protocol: cephx 2024-09-12T00:24:28.622 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: secure 2024-09-12T00:24:28.622 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: crc 2024-09-12T00:24:28.622 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: secure 2024-09-12T00:24:28.622 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: crc 2024-09-12T00:24:28.622 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: secure 2024-09-12T00:24:28.622 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: crc 2024-09-12T00:24:28.622 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: crc 2024-09-12T00:24:28.622 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: secure 2024-09-12T00:24:28.622 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: crc 2024-09-12T00:24:28.623 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: secure 2024-09-12T00:24:28.623 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: crc 2024-09-12T00:24:28.623 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: secure 2024-09-12T00:24:28.623 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:24:28.531+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.623 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient: init 2024-09-12T00:24:28.623 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding auth protocol: cephx 2024-09-12T00:24:28.623 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding auth protocol: cephx 2024-09-12T00:24:28.623 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding auth protocol: cephx 2024-09-12T00:24:28.623 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: secure 2024-09-12T00:24:28.623 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: crc 2024-09-12T00:24:28.623 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: secure 2024-09-12T00:24:28.623 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: crc 2024-09-12T00:24:28.623 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: secure 2024-09-12T00:24:28.624 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: crc 2024-09-12T00:24:28.624 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: crc 2024-09-12T00:24:28.624 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: secure 2024-09-12T00:24:28.624 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: crc 2024-09-12T00:24:28.624 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: secure 2024-09-12T00:24:28.624 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: crc 2024-09-12T00:24:28.624 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: secure 2024-09-12T00:24:28.624 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:24:28.531+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.624 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:24:28.531+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.624 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command rotate-key cmddesc rotate-key hook 0x7ffcb4462ac8 EEXIST 2024-09-12T00:24:28.624 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:28.624 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:24:28.624 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-a con 0x56457c896b60 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:24:28.625 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-c con 0x56457c8a22e0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:24:28.625 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-b con 0x56457c8695b0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:24:28.625 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.625 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.625 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.625 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:28.625 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): authenticate will time out at 2145.788706s 2024-09-12T00:24:28.625 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:24:28.531+0000 7f1f85b29640 10 monclient(hunting): get_auth_request con 0x56457c8a22e0 auth_method 0 2024-09-12T00:24:28.625 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:24:28.531+0000 7f1f85b29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.625 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:24:28.531+0000 7f1f85b29640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.625 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:24:28.531+0000 7f1f85b29640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.625 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): get_auth_request con 0x56457c896b60 auth_method 0 2024-09-12T00:24:28.625 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.626 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.626 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.626 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.626 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.626 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.626 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:24:28.531+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.626 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:24:28.531+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.626 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:24:28.531+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.626 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): handle_auth_done global_id 8388 payload 274 2024-09-12T00:24:28.626 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient: _finish_hunting 0 2024-09-12T00:24:28.626 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:24:28.531+0000 7f1f8632a640 1 monclient: found mon.noname-a 2024-09-12T00:24:28.626 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:24:28.626 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.627 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:24:28.627 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: dump: 2024-09-12T00:24:28.627 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.627 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.627 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.627 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.627 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.627 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.627 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.627 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.627 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.627 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.628 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: _finish_auth 0 2024-09-12T00:24:28.628 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:24:28.628 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:28.628 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 monclient: authenticate success, global_id 8388 2024-09-12T00:24:28.628 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:24:28.532+0000 7f1f88840800 10 monclient: get_monmap_and_config success 2024-09-12T00:24:28.628 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:24:28.532+0000 7f1f88840800 4 set_mon_vals no callback set 2024-09-12T00:24:28.628 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.628 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:24:28.628 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: dump: 2024-09-12T00:24:28.628 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.628 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.628 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.628 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.629 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.629 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.629 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.629 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.629 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.629 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.629 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:24:28.532+0000 7f1f88840800 10 monclient: shutdown 2024-09-12T00:24:28.629 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:24:28.532+0000 7f1f88840800 10 monclient: build_initial_monmap 2024-09-12T00:24:28.629 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:24:28.532+0000 7f1f88840800 1 build_initial for_mkfs: 0 2024-09-12T00:24:28.629 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:24:28.532+0000 7f1f88840800 10 monclient: monmap: 2024-09-12T00:24:28.629 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:24:28.629 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:28.629 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:24:28.629 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:24:28.630 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:28.630 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.630 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:24:28.630 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:24:28.630 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:24:28.630 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.630 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding auth protocol: cephx 2024-09-12T00:24:28.630 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding auth protocol: cephx 2024-09-12T00:24:28.630 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding auth protocol: cephx 2024-09-12T00:24:28.630 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: secure 2024-09-12T00:24:28.630 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: crc 2024-09-12T00:24:28.630 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: secure 2024-09-12T00:24:28.630 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: crc 2024-09-12T00:24:28.630 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: secure 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: crc 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: crc 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: secure 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: crc 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: secure 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: crc 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: secure 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:24:28.533+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:24:28.533+0000 7f1f88840800 1 librados: starting msgr at 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:24:28.533+0000 7f1f88840800 1 librados: starting objecter 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command objecter_requests cmddesc objecter_requests hook 0x56457c7fa7d0 EEXIST 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:24:28.533+0000 7f1f88840800 1 librados: setting wanted keys 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:24:28.533+0000 7f1f88840800 1 librados: calling monclient init 2024-09-12T00:24:28.631 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient: init 2024-09-12T00:24:28.632 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding auth protocol: cephx 2024-09-12T00:24:28.632 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding auth protocol: cephx 2024-09-12T00:24:28.632 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding auth protocol: cephx 2024-09-12T00:24:28.632 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: secure 2024-09-12T00:24:28.632 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: crc 2024-09-12T00:24:28.632 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: secure 2024-09-12T00:24:28.632 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: crc 2024-09-12T00:24:28.632 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: secure 2024-09-12T00:24:28.632 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: crc 2024-09-12T00:24:28.632 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: crc 2024-09-12T00:24:28.632 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: secure 2024-09-12T00:24:28.632 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: crc 2024-09-12T00:24:28.632 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: secure 2024-09-12T00:24:28.632 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: crc 2024-09-12T00:24:28.633 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: secure 2024-09-12T00:24:28.633 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:24:28.533+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.633 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:24:28.533+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.633 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command rotate-key cmddesc rotate-key hook 0x56457c860838 EEXIST 2024-09-12T00:24:28.633 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:28.633 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:24:28.633 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-a con 0x56457c8695b0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:24:28.633 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-c con 0x56457c896b60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:24:28.633 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-b con 0x56457c8a22e0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:24:28.633 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.633 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.633 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.633 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:28.634 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): authenticate will time out at 2145.790858s 2024-09-12T00:24:28.634 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:24:28.533+0000 7f1f8632a640 10 monclient(hunting): get_auth_request con 0x56457c8695b0 auth_method 0 2024-09-12T00:24:28.634 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:24:28.533+0000 7f1f8632a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.634 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:24:28.533+0000 7f1f8632a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.634 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:24:28.533+0000 7f1f8632a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.634 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:24:28.533+0000 7f1f85b29640 10 monclient(hunting): get_auth_request con 0x56457c896b60 auth_method 0 2024-09-12T00:24:28.634 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:24:28.533+0000 7f1f85b29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.634 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:24:28.533+0000 7f1f85b29640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.634 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:24:28.533+0000 7f1f85b29640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.634 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:24:28.534+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.634 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:24:28.534+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.634 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:24:28.534+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.634 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:24:28.534+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.634 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:24:28.534+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.635 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:24:28.534+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.635 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:24:28.534+0000 7f1f86b2b640 10 monclient(hunting): get_auth_request con 0x56457c8a22e0 auth_method 0 2024-09-12T00:24:28.635 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:24:28.534+0000 7f1f86b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.635 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:24:28.534+0000 7f1f86b2b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.635 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:24:28.534+0000 7f1f86b2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.635 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:24:28.534+0000 7f1f85b29640 10 monclient(hunting): handle_auth_done global_id 7811 payload 824 2024-09-12T00:24:28.635 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:24:28.534+0000 7f1f85b29640 10 monclient: _finish_hunting 0 2024-09-12T00:24:28.635 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:24:28.534+0000 7f1f85b29640 1 monclient: found mon.noname-c 2024-09-12T00:24:28.635 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:24:28.534+0000 7f1f85b29640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:24:28.635 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.635 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:24:28.635 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: dump: 2024-09-12T00:24:28.635 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.635 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.635 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.636 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.636 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.636 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.636 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.636 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.636 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.636 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.636 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: _finish_auth 0 2024-09-12T00:24:28.636 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: _check_auth_tickets 2024-09-12T00:24:28.636 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:28.636 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.636 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:24:28.636 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: dump: 2024-09-12T00:24:28.637 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.637 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.637 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.637 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.637 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.637 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.637 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.637 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.637 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.637 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.637 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:24:28.534+0000 7f1f88840800 5 monclient: authenticate success, global_id 7811 2024-09-12T00:24:28.637 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:24:28.534+0000 7f1f88840800 10 monclient: _renew_subs 2024-09-12T00:24:28.637 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:24:28.534+0000 7f1f88840800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:24:28.637 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:24:28.534+0000 7f1e69ffb640 4 set_mon_vals no callback set 2024-09-12T00:24:28.638 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:24:28.534+0000 7f1f88840800 10 monclient: _renew_subs 2024-09-12T00:24:28.638 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:24:28.534+0000 7f1f88840800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:24:28.638 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:24:28.534+0000 7f1f88840800 1 librados: init done 2024-09-12T00:24:28.638 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:24:28.534+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command cr dump hook 0x56457c8a0ae8 2024-09-12T00:24:28.638 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:24:28.536+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.638 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:24:28.537+0000 7f1e57fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:24:28.638 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:24:28.537+0000 7f1e57fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:24:28.638 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:24:28.537+0000 7f1e57fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:24:28.638 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:24:28.537+0000 7f1f8632a640 10 monclient: get_auth_request con 0x7f1e50076470 auth_method 0 2024-09-12T00:24:28.638 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:24:28.537+0000 7f1f86b2b640 10 monclient: get_auth_request con 0x56457c8b6de0 auth_method 0 2024-09-12T00:24:28.638 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.638 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:24:28.538+0000 7f1f88840800 20 realm 2024-09-12T00:24:28.638 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.639 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.639 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:24:28.538+0000 7f1f88840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:28.639 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.639 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.639 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.639 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:24:28.539+0000 7f1f8632a640 10 monclient: get_auth_request con 0x56457c8baf90 auth_method 0 2024-09-12T00:24:28.639 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:24:28.539+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:28.639 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:24:28.539+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.639 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:24:28.539+0000 7f1f85b29640 10 monclient: get_auth_request con 0x56457c8be7f0 auth_method 0 2024-09-12T00:24:28.639 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:24:28.540+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:28.639 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:24:28.540+0000 7f1f88840800 20 searching for the correct realm 2024-09-12T00:24:28.639 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:24:28.540+0000 7f1f86b2b640 10 monclient: get_auth_request con 0x7f1f7c06c010 auth_method 0 2024-09-12T00:24:28.639 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:24:28.542+0000 7f1f8632a640 10 monclient: get_auth_request con 0x7f1f78098a50 auth_method 0 2024-09-12T00:24:28.639 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:24:28.543+0000 7f1f85b29640 10 monclient: get_auth_request con 0x7f1f7c074bb0 auth_method 0 2024-09-12T00:24:28.640 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:24:28.543+0000 7f1f85b29640 0 -- 172.21.15.67:0/1810663864 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f1f7c074bb0 msgr2=0x7f1f7c073910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:28.640 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:24:28.543+0000 7f1e57fff640 1 client.7811.objecter ms_handle_reset 0x7f1f7c074bb0 session 0x7f1f7c06b8c0 osd.5 2024-09-12T00:24:28.640 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:24:28.543+0000 7f1e57fff640 10 monclient: _renew_subs 2024-09-12T00:24:28.640 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:24:28.543+0000 7f1e57fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:24:28.640 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:24:28.543+0000 7f1f85b29640 10 monclient: get_auth_request con 0x7f1e50086790 auth_method 0 2024-09-12T00:24:28.640 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:24:28.545+0000 7f1f86b2b640 10 monclient: get_auth_request con 0x7f1f780510b0 auth_method 0 2024-09-12T00:24:28.640 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:24:28.546+0000 7f1f8632a640 10 monclient: get_auth_request con 0x7f1f80061040 auth_method 0 2024-09-12T00:24:28.640 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:24:28.547+0000 7f1f86b2b640 0 -- 172.21.15.67:0/1810663864 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x56457c8b6de0 msgr2=0x56457c8b91d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:28.641 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:24:28.547+0000 7f1e57fff640 1 client.7811.objecter ms_handle_reset 0x56457c8b6de0 session 0x56457c8b6710 osd.6 2024-09-12T00:24:28.641 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:24:28.547+0000 7f1f86b2b640 10 monclient: get_auth_request con 0x7f1f7c074bb0 auth_method 0 2024-09-12T00:24:28.641 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:28.641 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:28.641 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:24:28.641 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:24:28.641 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:28.641 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:28.641 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:24:28.551+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.641 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.641 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.641 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:28.641 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.641 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:28.642 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 zone default found 2024-09-12T00:24:28.642 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:24:28.552+0000 7f1f88840800 4 Realm: () 2024-09-12T00:24:28.642 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:24:28.552+0000 7f1f88840800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:24:28.642 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:24:28.552+0000 7f1f88840800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:24:28.642 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:24:28.552+0000 7f1f88840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:28.642 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 zonegroup default 2024-09-12T00:24:28.642 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.642 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:24:28.553+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.642 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:24:28.553+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.642 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:24:28.553+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.642 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:24:28.553+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.642 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:24:28.553+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.642 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:24:28.553+0000 7f1f88840800 20 started sync module instance, tier type = 2024-09-12T00:24:28.642 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:24:28.553+0000 7f1f88840800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:24:28.643 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=0 2024-09-12T00:24:28.643 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=1 2024-09-12T00:24:28.643 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=2 2024-09-12T00:24:28.643 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=3 2024-09-12T00:24:28.643 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=4 2024-09-12T00:24:28.643 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=5 2024-09-12T00:24:28.643 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=6 2024-09-12T00:24:28.643 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=7 2024-09-12T00:24:28.643 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:24:28.563+0000 7f1f88840800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:28.643 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding auth protocol: cephx 2024-09-12T00:24:28.643 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding auth protocol: cephx 2024-09-12T00:24:28.643 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding auth protocol: cephx 2024-09-12T00:24:28.643 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: secure 2024-09-12T00:24:28.643 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: crc 2024-09-12T00:24:28.644 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: secure 2024-09-12T00:24:28.644 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: crc 2024-09-12T00:24:28.644 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: secure 2024-09-12T00:24:28.644 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: crc 2024-09-12T00:24:28.644 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: crc 2024-09-12T00:24:28.644 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: secure 2024-09-12T00:24:28.644 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: crc 2024-09-12T00:24:28.644 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: secure 2024-09-12T00:24:28.644 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: crc 2024-09-12T00:24:28.644 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:24:28.565+0000 7f1e3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:28.644 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: secure 2024-09-12T00:24:28.644 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:24:28.565+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.644 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:24:28.565+0000 7f1f88840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:28.645 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:24:28.565+0000 7f1f88840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:28.645 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command cache list hook 0x56457c89b6d0 2024-09-12T00:24:28.645 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command cache inspect hook 0x56457c89b6d0 2024-09-12T00:24:28.645 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command cache erase hook 0x56457c89b6d0 2024-09-12T00:24:28.645 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command cache zap hook 0x56457c89b6d0 2024-09-12T00:24:28.645 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 note: GC not initialized 2024-09-12T00:24:28.645 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:24:28.566+0000 7f1db77fe640 20 reqs_thread_entry: start 2024-09-12T00:24:28.645 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:24:28.566+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command sync trace show hook 0x7f1f78087070 2024-09-12T00:24:28.645 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:24:28.566+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command sync trace history hook 0x7f1f78087070 2024-09-12T00:24:28.645 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:24:28.566+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command sync trace active hook 0x7f1f78087070 2024-09-12T00:24:28.645 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:24:28.566+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command sync trace active_short hook 0x7f1f78087070 2024-09-12T00:24:28.645 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:24:28.566+0000 7f1f88840800 20 init_complete bucket index max shards: 1 2024-09-12T00:24:28.645 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:24:28.566+0000 7f1f88840800 20 Filter name: none 2024-09-12T00:24:28.645 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:24:28.566+0000 7f1db57fa640 20 reqs_thread_entry: start 2024-09-12T00:24:28.646 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:24:28.566+0000 7f1f88840800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:24:28.646 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:24:28.566+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.646 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:24:28.566+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:24:28.646 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:24:28.566+0000 7f1f88840800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:24:28.646 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:24:28.566+0000 7f1f88840800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:24:28.646 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:24:28.566+0000 7f1f88840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:24:28.646 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:24:28.566+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.646 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:24:28.567+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:24:28.646 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:24:28.567+0000 7f1f88840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:24:28.646 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:24:28.567+0000 7f1f88840800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:24:28.646 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:24:28.567+0000 7f1f88840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:28.646 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:24:28.567+0000 7f1f88840800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:24:28.646 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:24:28.567+0000 7f1f88840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:24:28.646 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:24:28.568+0000 7f1f88840800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:24:28.647 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:24:28.572+0000 7f1f88840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:24:28.647 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:24:28.572+0000 7f1f88840800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:24:28.647 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:24:28.572+0000 7f1f88840800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:24:28.647 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:24:28.572+0000 7f1f88840800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:24:28.647 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:24:28.572+0000 7f1e69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562484 cookie 94856442313888 notifier 7811 bl.length()=827 2024-09-12T00:24:28.647 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:24:28.572+0000 7f1e69ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:24:28.647 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:24:28.572+0000 7f1e69ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:24:28.647 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:24:28.572+0000 7f1e69ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:24:28.647 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:24:28.573+0000 7f1f88840800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:24:28.647 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:24:28.573+0000 7f1f88840800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:24:28.647 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:24:28.573+0000 7f1f88840800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:24:28.647 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:24:28.573+0000 7f1f88840800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:24:28.647 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:24:28.576+0000 7f1f88840800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1f88840800 time 2024-09-12T00:24:28.577197+0000 2024-09-12T00:24:28.648 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:24:28.648 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.648 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:28.648 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f8bd8c71a] 2024-09-12T00:24:28.648 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f8bd8c8d8] 2024-09-12T00:24:28.648 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56457a312641] 2024-09-12T00:24:28.648 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56457a32238a] 2024-09-12T00:24:28.648 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:24:28.648 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f1f8aa29590] 2024-09-12T00:24:28.648 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:24:28.648 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:24:28.648 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.648 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:24:28.577+0000 7f1f88840800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:24:28.649 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f1f88840800 thread_name:radosgw-admin 2024-09-12T00:24:28.649 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.649 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:28.649 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1f8aa3e6f0] 2024-09-12T00:24:28.649 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1f8aa8b99c] 2024-09-12T00:24:28.649 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:24:28.649 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:24:28.649 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f8bd8c774] 2024-09-12T00:24:28.649 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f8bd8c8d8] 2024-09-12T00:24:28.649 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56457a312641] 2024-09-12T00:24:28.649 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56457a32238a] 2024-09-12T00:24:28.649 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:24:28.649 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f1f8aa29590] 2024-09-12T00:24:28.649 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:24:28.650 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:24:28.650 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:24:28.650 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.650 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:24:28.650 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:24:28.650 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:24:28.650 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:24:28.650 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:24:28.650 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:24:28.650 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:24:28.650 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:24:28.650 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:24:28.650 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:24:28.650 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:24:28.651 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:24:28.652 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:24:28.652 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:24:28.652 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:24:28.652 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:24:28.652 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:24:28.652 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:24:28.652 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:24:28.652 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:24:28.652 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:24:28.652 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:24:28.652 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:24:28.652 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:24:28.652 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:24:28.652 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:24:28.653 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:24:28.653 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:24:28.653 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:24:28.653 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:24:28.653 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:24:28.653 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:24:28.653 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:24:28.653 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:24:28.653 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:24:28.654 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:24:28.654 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:24:28.654 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:24:28.654 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:24:28.654 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:24:28.654 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:24:28.654 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:24:28.654 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:24:28.654 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:24:28.654 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:24:28.654 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:24:28.654 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:24:28.654 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:24:28.654 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:24:28.655 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:24:28.655 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:24:28.655 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:24:28.655 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:24:28.655 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:24:28.655 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:24:28.655 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:24:28.655 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:24:28.655 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:24:28.655 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:24:28.655 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:24:28.655 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:24:28.655 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:24:28.655 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:24:28.656 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:24:28.656 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:24:28.656 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:24:28.656 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:24:28.656 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:24:28.656 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:24:28.656 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:24:28.656 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:24:28.656 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:24:28.656 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:24:28.656 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:24:28.656 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:24:28.656 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:24:28.656 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:24:28.657 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:24:28.657 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:24:28.657 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:24:28.657 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1db57fa640 / http_manager 2024-09-12T00:24:28.657 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1db77fe640 / http_manager 2024-09-12T00:24:28.657 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1e3cfe1640 / rgw_dt_lg_renew 2024-09-12T00:24:28.657 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1e57fff640 / ms_dispatch 2024-09-12T00:24:28.657 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1e69ffb640 / io_context_pool 2024-09-12T00:24:28.657 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1e6bfff640 / ms_dispatch 2024-09-12T00:24:28.657 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1e72e05640 / ms_dispatch 2024-09-12T00:24:28.657 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1e74608640 / io_context_pool 2024-09-12T00:24:28.657 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1f85b29640 / msgr-worker-2 2024-09-12T00:24:28.657 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1f8632a640 / msgr-worker-1 2024-09-12T00:24:28.658 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1f86b2b640 / msgr-worker-0 2024-09-12T00:24:28.658 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1f8732c640 / io_context_pool 2024-09-12T00:24:28.658 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1f88840800 / radosgw-admin 2024-09-12T00:24:28.658 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:24:28.658 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:24:28.658 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/log/ceph/ceph-client.admin.154113.log 2024-09-12T00:24:28.658 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:24:28.658 INFO:tasks.workunit.client.0.smithi067.stderr:--- begin dump of recent events --- 2024-09-12T00:24:28.658 INFO:tasks.workunit.client.0.smithi067.stderr: -499> 2024-09-12T00:24:28.518+0000 7f1e74608640 10 monclient: dump: 2024-09-12T00:24:28.658 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.658 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.658 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.658 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.658 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.659 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.659 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.659 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.659 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.659 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.659 INFO:tasks.workunit.client.0.smithi067.stderr: -498> 2024-09-12T00:24:28.518+0000 7f1e74608640 10 monclient: _finish_auth 0 2024-09-12T00:24:28.659 INFO:tasks.workunit.client.0.smithi067.stderr: -497> 2024-09-12T00:24:28.518+0000 7f1e74608640 10 monclient: _check_auth_tickets 2024-09-12T00:24:28.659 INFO:tasks.workunit.client.0.smithi067.stderr: -496> 2024-09-12T00:24:28.518+0000 7f1e74608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:28.659 INFO:tasks.workunit.client.0.smithi067.stderr: -495> 2024-09-12T00:24:28.518+0000 7f1f88840800 5 monclient: authenticate success, global_id 7799 2024-09-12T00:24:28.659 INFO:tasks.workunit.client.0.smithi067.stderr: -494> 2024-09-12T00:24:28.518+0000 7f1f88840800 10 monclient: get_monmap_and_config success 2024-09-12T00:24:28.659 INFO:tasks.workunit.client.0.smithi067.stderr: -493> 2024-09-12T00:24:28.518+0000 7f1f88840800 4 set_mon_vals no callback set 2024-09-12T00:24:28.659 INFO:tasks.workunit.client.0.smithi067.stderr: -492> 2024-09-12T00:24:28.518+0000 7f1e74608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.659 INFO:tasks.workunit.client.0.smithi067.stderr: -491> 2024-09-12T00:24:28.518+0000 7f1e74608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:24:28.659 INFO:tasks.workunit.client.0.smithi067.stderr: -490> 2024-09-12T00:24:28.518+0000 7f1e74608640 10 monclient: dump: 2024-09-12T00:24:28.660 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.660 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.660 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.660 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.660 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.660 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.660 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.660 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.660 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.660 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.660 INFO:tasks.workunit.client.0.smithi067.stderr: -489> 2024-09-12T00:24:28.519+0000 7f1f88840800 10 monclient: shutdown 2024-09-12T00:24:28.660 INFO:tasks.workunit.client.0.smithi067.stderr: -488> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 asok(0x56457c5ac630) unregister_commands rotate-key 2024-09-12T00:24:28.660 INFO:tasks.workunit.client.0.smithi067.stderr: -487> 2024-09-12T00:24:28.519+0000 7f1f88840800 10 monclient: build_initial_monmap 2024-09-12T00:24:28.661 INFO:tasks.workunit.client.0.smithi067.stderr: -486> 2024-09-12T00:24:28.519+0000 7f1f88840800 1 build_initial for_mkfs: 0 2024-09-12T00:24:28.661 INFO:tasks.workunit.client.0.smithi067.stderr: -485> 2024-09-12T00:24:28.519+0000 7f1f88840800 10 monclient: monmap: 2024-09-12T00:24:28.661 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:24:28.661 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:28.661 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:24:28.661 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:24:28.661 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:28.661 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.661 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:24:28.661 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:24:28.661 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:24:28.661 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.661 INFO:tasks.workunit.client.0.smithi067.stderr: -484> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding auth protocol: cephx 2024-09-12T00:24:28.661 INFO:tasks.workunit.client.0.smithi067.stderr: -483> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding auth protocol: cephx 2024-09-12T00:24:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: -482> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding auth protocol: cephx 2024-09-12T00:24:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: -481> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: secure 2024-09-12T00:24:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: -480> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: crc 2024-09-12T00:24:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: -479> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: secure 2024-09-12T00:24:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: -478> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: crc 2024-09-12T00:24:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: -477> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: secure 2024-09-12T00:24:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: -476> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: crc 2024-09-12T00:24:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: -475> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: crc 2024-09-12T00:24:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: -474> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: secure 2024-09-12T00:24:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: -473> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: crc 2024-09-12T00:24:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: -472> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: secure 2024-09-12T00:24:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: -471> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: crc 2024-09-12T00:24:28.662 INFO:tasks.workunit.client.0.smithi067.stderr: -470> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 AuthRegistry(0x56457c7d2460) adding con mode: secure 2024-09-12T00:24:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: -469> 2024-09-12T00:24:28.519+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: -468> 2024-09-12T00:24:28.519+0000 7f1f88840800 1 librados: starting msgr at 2024-09-12T00:24:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: -467> 2024-09-12T00:24:28.519+0000 7f1f88840800 1 librados: starting objecter 2024-09-12T00:24:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: -466> 2024-09-12T00:24:28.519+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command objecter_requests hook 0x56457c658750 2024-09-12T00:24:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: -465> 2024-09-12T00:24:28.520+0000 7f1f88840800 1 librados: setting wanted keys 2024-09-12T00:24:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: -464> 2024-09-12T00:24:28.520+0000 7f1f88840800 1 librados: calling monclient init 2024-09-12T00:24:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: -463> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient: init 2024-09-12T00:24:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: -462> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding auth protocol: cephx 2024-09-12T00:24:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: -461> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding auth protocol: cephx 2024-09-12T00:24:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: -460> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding auth protocol: cephx 2024-09-12T00:24:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: -459> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: secure 2024-09-12T00:24:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: -458> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: crc 2024-09-12T00:24:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: -457> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: secure 2024-09-12T00:24:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: -456> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: crc 2024-09-12T00:24:28.663 INFO:tasks.workunit.client.0.smithi067.stderr: -455> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: secure 2024-09-12T00:24:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: -454> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: crc 2024-09-12T00:24:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: -453> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: crc 2024-09-12T00:24:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: -452> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: secure 2024-09-12T00:24:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: -451> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: crc 2024-09-12T00:24:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: -450> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: secure 2024-09-12T00:24:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: -449> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: crc 2024-09-12T00:24:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: -448> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 AuthRegistry(0x56457c7cc810) adding con mode: secure 2024-09-12T00:24:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: -447> 2024-09-12T00:24:28.520+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: -446> 2024-09-12T00:24:28.520+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: -445> 2024-09-12T00:24:28.520+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command rotate-key hook 0x56457c7cc958 2024-09-12T00:24:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: -444> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: -443> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:24:28.664 INFO:tasks.workunit.client.0.smithi067.stderr: -442> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-a con 0x56457c67a020 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:24:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: -441> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-b con 0x56457c683f10 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:24:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: -440> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-c con 0x56457c70fe70 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:24:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: -439> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: -438> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: -437> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: -436> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: -435> 2024-09-12T00:24:28.520+0000 7f1f88840800 10 monclient(hunting): authenticate will time out at 2145.777659s 2024-09-12T00:24:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: -434> 2024-09-12T00:24:28.520+0000 7f1f8632a640 10 monclient(hunting): get_auth_request con 0x56457c67a020 auth_method 0 2024-09-12T00:24:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: -433> 2024-09-12T00:24:28.520+0000 7f1f8632a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: -432> 2024-09-12T00:24:28.520+0000 7f1f8632a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: -431> 2024-09-12T00:24:28.520+0000 7f1f8632a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: -430> 2024-09-12T00:24:28.520+0000 7f1f86b2b640 10 monclient(hunting): get_auth_request con 0x56457c70fe70 auth_method 0 2024-09-12T00:24:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: -429> 2024-09-12T00:24:28.520+0000 7f1f86b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.665 INFO:tasks.workunit.client.0.smithi067.stderr: -428> 2024-09-12T00:24:28.520+0000 7f1f86b2b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: -427> 2024-09-12T00:24:28.520+0000 7f1f86b2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: -426> 2024-09-12T00:24:28.520+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: -425> 2024-09-12T00:24:28.520+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: -424> 2024-09-12T00:24:28.520+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: -423> 2024-09-12T00:24:28.520+0000 7f1f86b2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: -422> 2024-09-12T00:24:28.520+0000 7f1f86b2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: -421> 2024-09-12T00:24:28.520+0000 7f1f86b2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: -420> 2024-09-12T00:24:28.520+0000 7f1f85b29640 10 monclient(hunting): get_auth_request con 0x56457c683f10 auth_method 0 2024-09-12T00:24:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: -419> 2024-09-12T00:24:28.520+0000 7f1f85b29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: -418> 2024-09-12T00:24:28.520+0000 7f1f85b29640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: -417> 2024-09-12T00:24:28.520+0000 7f1f85b29640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: -416> 2024-09-12T00:24:28.520+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.666 INFO:tasks.workunit.client.0.smithi067.stderr: -415> 2024-09-12T00:24:28.520+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.667 INFO:tasks.workunit.client.0.smithi067.stderr: -414> 2024-09-12T00:24:28.520+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.667 INFO:tasks.workunit.client.0.smithi067.stderr: -413> 2024-09-12T00:24:28.521+0000 7f1f8632a640 10 monclient(hunting): handle_auth_done global_id 8382 payload 824 2024-09-12T00:24:28.667 INFO:tasks.workunit.client.0.smithi067.stderr: -412> 2024-09-12T00:24:28.521+0000 7f1f8632a640 10 monclient: _finish_hunting 0 2024-09-12T00:24:28.667 INFO:tasks.workunit.client.0.smithi067.stderr: -411> 2024-09-12T00:24:28.521+0000 7f1f8632a640 1 monclient: found mon.noname-a 2024-09-12T00:24:28.667 INFO:tasks.workunit.client.0.smithi067.stderr: -410> 2024-09-12T00:24:28.521+0000 7f1f8632a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:24:28.667 INFO:tasks.workunit.client.0.smithi067.stderr: -409> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.667 INFO:tasks.workunit.client.0.smithi067.stderr: -408> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:24:28.667 INFO:tasks.workunit.client.0.smithi067.stderr: -407> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: dump: 2024-09-12T00:24:28.667 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.667 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.667 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.667 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.667 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.667 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.668 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.668 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.668 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.668 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.668 INFO:tasks.workunit.client.0.smithi067.stderr: -406> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: _finish_auth 0 2024-09-12T00:24:28.668 INFO:tasks.workunit.client.0.smithi067.stderr: -405> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: _check_auth_tickets 2024-09-12T00:24:28.668 INFO:tasks.workunit.client.0.smithi067.stderr: -404> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:28.668 INFO:tasks.workunit.client.0.smithi067.stderr: -403> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.668 INFO:tasks.workunit.client.0.smithi067.stderr: -402> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:24:28.668 INFO:tasks.workunit.client.0.smithi067.stderr: -401> 2024-09-12T00:24:28.521+0000 7f1e72e05640 10 monclient: dump: 2024-09-12T00:24:28.668 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.668 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.668 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.669 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.669 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.669 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.669 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.669 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.669 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.669 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.669 INFO:tasks.workunit.client.0.smithi067.stderr: -400> 2024-09-12T00:24:28.521+0000 7f1f88840800 5 monclient: authenticate success, global_id 8382 2024-09-12T00:24:28.669 INFO:tasks.workunit.client.0.smithi067.stderr: -399> 2024-09-12T00:24:28.521+0000 7f1e74608640 4 set_mon_vals no callback set 2024-09-12T00:24:28.669 INFO:tasks.workunit.client.0.smithi067.stderr: -398> 2024-09-12T00:24:28.521+0000 7f1f88840800 10 monclient: _renew_subs 2024-09-12T00:24:28.669 INFO:tasks.workunit.client.0.smithi067.stderr: -397> 2024-09-12T00:24:28.521+0000 7f1f88840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:24:28.669 INFO:tasks.workunit.client.0.smithi067.stderr: -396> 2024-09-12T00:24:28.521+0000 7f1f88840800 10 monclient: _renew_subs 2024-09-12T00:24:28.669 INFO:tasks.workunit.client.0.smithi067.stderr: -395> 2024-09-12T00:24:28.521+0000 7f1f88840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:24:28.669 INFO:tasks.workunit.client.0.smithi067.stderr: -394> 2024-09-12T00:24:28.521+0000 7f1f88840800 1 librados: init done 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -393> 2024-09-12T00:24:28.523+0000 7f1e72e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -392> 2024-09-12T00:24:28.523+0000 7f1e72e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -391> 2024-09-12T00:24:28.523+0000 7f1e72e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -390> 2024-09-12T00:24:28.523+0000 7f1f85b29640 10 monclient: get_auth_request con 0x7f1e6c076470 auth_method 0 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -389> 2024-09-12T00:24:28.523+0000 7f1f86b2b640 10 monclient: get_auth_request con 0x56457c7f5840 auth_method 0 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -388> 2024-09-12T00:24:28.524+0000 7f1f8632a640 10 monclient: get_auth_request con 0x56457c817fd0 auth_method 0 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -387> 2024-09-12T00:24:28.525+0000 7f1f85b29640 10 monclient: get_auth_request con 0x56457c81c3e0 auth_method 0 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -386> 2024-09-12T00:24:28.526+0000 7f1f88840800 10 monclient: build_initial_monmap 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -385> 2024-09-12T00:24:28.526+0000 7f1f88840800 1 build_initial for_mkfs: 0 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi067.stderr: -384> 2024-09-12T00:24:28.526+0000 7f1f88840800 10 monclient: monmap: 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:24:28.670 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:28.671 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.671 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:24:28.671 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:24:28.671 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:24:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -383> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding auth protocol: cephx 2024-09-12T00:24:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -382> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding auth protocol: cephx 2024-09-12T00:24:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -381> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding auth protocol: cephx 2024-09-12T00:24:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -380> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: secure 2024-09-12T00:24:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -379> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: crc 2024-09-12T00:24:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -378> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: secure 2024-09-12T00:24:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -377> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: crc 2024-09-12T00:24:28.671 INFO:tasks.workunit.client.0.smithi067.stderr: -376> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: secure 2024-09-12T00:24:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -375> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: crc 2024-09-12T00:24:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -374> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: crc 2024-09-12T00:24:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -373> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: secure 2024-09-12T00:24:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -372> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: crc 2024-09-12T00:24:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -371> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: secure 2024-09-12T00:24:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -370> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: crc 2024-09-12T00:24:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -369> 2024-09-12T00:24:28.526+0000 7f1f88840800 5 AuthRegistry(0x56457c821220) adding con mode: secure 2024-09-12T00:24:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -368> 2024-09-12T00:24:28.527+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -367> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command objecter_requests cmddesc objecter_requests hook 0x56457c824c50 EEXIST 2024-09-12T00:24:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -366> 2024-09-12T00:24:28.527+0000 7f1f88840800 10 monclient: init 2024-09-12T00:24:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -365> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding auth protocol: cephx 2024-09-12T00:24:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -364> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding auth protocol: cephx 2024-09-12T00:24:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -363> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding auth protocol: cephx 2024-09-12T00:24:28.672 INFO:tasks.workunit.client.0.smithi067.stderr: -362> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: secure 2024-09-12T00:24:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -361> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: crc 2024-09-12T00:24:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -360> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: secure 2024-09-12T00:24:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -359> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: crc 2024-09-12T00:24:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -358> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: secure 2024-09-12T00:24:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -357> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: crc 2024-09-12T00:24:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -356> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: crc 2024-09-12T00:24:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -355> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: secure 2024-09-12T00:24:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -354> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: crc 2024-09-12T00:24:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -353> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: secure 2024-09-12T00:24:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -352> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: crc 2024-09-12T00:24:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -351> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 AuthRegistry(0x56457c81f948) adding con mode: secure 2024-09-12T00:24:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -350> 2024-09-12T00:24:28.527+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -349> 2024-09-12T00:24:28.527+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.673 INFO:tasks.workunit.client.0.smithi067.stderr: -348> 2024-09-12T00:24:28.527+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command rotate-key cmddesc rotate-key hook 0x56457c81fa90 EEXIST 2024-09-12T00:24:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -347> 2024-09-12T00:24:28.527+0000 7f1f88840800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -346> 2024-09-12T00:24:28.527+0000 7f1f88840800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:24:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -345> 2024-09-12T00:24:28.527+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-a con 0x56457c848940 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:24:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -344> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-b con 0x56457c84ac10 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:24:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -343> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-c con 0x56457c847110 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:24:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -342> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -341> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -340> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -339> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -338> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient(hunting): authenticate will time out at 2145.785031s 2024-09-12T00:24:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -337> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): get_auth_request con 0x56457c848940 auth_method 0 2024-09-12T00:24:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -336> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.674 INFO:tasks.workunit.client.0.smithi067.stderr: -335> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -334> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -333> 2024-09-12T00:24:28.528+0000 7f1f86b2b640 10 monclient(hunting): get_auth_request con 0x56457c847110 auth_method 0 2024-09-12T00:24:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -332> 2024-09-12T00:24:28.528+0000 7f1f86b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -331> 2024-09-12T00:24:28.528+0000 7f1f86b2b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -330> 2024-09-12T00:24:28.528+0000 7f1f86b2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -329> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -328> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -327> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -326> 2024-09-12T00:24:28.528+0000 7f1f86b2b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -325> 2024-09-12T00:24:28.528+0000 7f1f86b2b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -324> 2024-09-12T00:24:28.528+0000 7f1f86b2b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -323> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient(hunting): handle_auth_done global_id 8385 payload 824 2024-09-12T00:24:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -322> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient: _finish_hunting 0 2024-09-12T00:24:28.675 INFO:tasks.workunit.client.0.smithi067.stderr: -321> 2024-09-12T00:24:28.528+0000 7f1f8632a640 1 monclient: found mon.noname-a 2024-09-12T00:24:28.676 INFO:tasks.workunit.client.0.smithi067.stderr: -320> 2024-09-12T00:24:28.528+0000 7f1f8632a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:24:28.676 INFO:tasks.workunit.client.0.smithi067.stderr: -319> 2024-09-12T00:24:28.528+0000 7f1f85b29640 10 monclient: get_auth_request con 0x56457c84ac10 auth_method 0 2024-09-12T00:24:28.676 INFO:tasks.workunit.client.0.smithi067.stderr: -318> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.676 INFO:tasks.workunit.client.0.smithi067.stderr: -317> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:24:28.676 INFO:tasks.workunit.client.0.smithi067.stderr: -316> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: dump: 2024-09-12T00:24:28.676 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.676 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.676 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.676 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.676 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.676 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.676 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.676 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.677 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: -315> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: _finish_auth 0 2024-09-12T00:24:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: -314> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:24:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: -313> 2024-09-12T00:24:28.528+0000 7f1f88840800 5 monclient: authenticate success, global_id 8385 2024-09-12T00:24:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: -312> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient: _renew_subs 2024-09-12T00:24:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: -311> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:24:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: -310> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: -309> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: -308> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:24:28.677 INFO:tasks.workunit.client.0.smithi067.stderr: -307> 2024-09-12T00:24:28.528+0000 7f1e6bfff640 10 monclient: dump: 2024-09-12T00:24:28.677 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.677 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.677 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.678 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.678 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.678 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.678 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.678 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.678 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.678 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.678 INFO:tasks.workunit.client.0.smithi067.stderr: -306> 2024-09-12T00:24:28.528+0000 7f1f8732c640 4 set_mon_vals no callback set 2024-09-12T00:24:28.678 INFO:tasks.workunit.client.0.smithi067.stderr: -305> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient: _renew_subs 2024-09-12T00:24:28.678 INFO:tasks.workunit.client.0.smithi067.stderr: -304> 2024-09-12T00:24:28.528+0000 7f1f88840800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.67:3300/0 2024-09-12T00:24:28.678 INFO:tasks.workunit.client.0.smithi067.stderr: -303> 2024-09-12T00:24:28.530+0000 7f1e6bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:24:28.678 INFO:tasks.workunit.client.0.smithi067.stderr: -302> 2024-09-12T00:24:28.530+0000 7f1e6bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:24:28.678 INFO:tasks.workunit.client.0.smithi067.stderr: -301> 2024-09-12T00:24:28.530+0000 7f1e6bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:24:28.678 INFO:tasks.workunit.client.0.smithi067.stderr: -300> 2024-09-12T00:24:28.530+0000 7f1f85b29640 10 monclient: get_auth_request con 0x7f1e60076380 auth_method 0 2024-09-12T00:24:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: -299> 2024-09-12T00:24:28.530+0000 7f1f88840800 10 monclient: get_monmap_and_config 2024-09-12T00:24:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: -298> 2024-09-12T00:24:28.530+0000 7f1f88840800 10 monclient: build_initial_monmap 2024-09-12T00:24:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: -297> 2024-09-12T00:24:28.530+0000 7f1f88840800 1 build_initial for_mkfs: 0 2024-09-12T00:24:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: -296> 2024-09-12T00:24:28.530+0000 7f1f88840800 10 monclient: monmap: 2024-09-12T00:24:28.679 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:24:28.679 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:28.679 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:24:28.679 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:24:28.679 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:28.679 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.679 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:24:28.679 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:24:28.679 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:24:28.679 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -295> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding auth protocol: cephx 2024-09-12T00:24:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -294> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding auth protocol: cephx 2024-09-12T00:24:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -293> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding auth protocol: cephx 2024-09-12T00:24:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -292> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: secure 2024-09-12T00:24:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -291> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: crc 2024-09-12T00:24:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -290> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: secure 2024-09-12T00:24:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -289> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: crc 2024-09-12T00:24:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -288> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: secure 2024-09-12T00:24:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -287> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: crc 2024-09-12T00:24:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -286> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: crc 2024-09-12T00:24:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -285> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: secure 2024-09-12T00:24:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -284> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: crc 2024-09-12T00:24:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -283> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: secure 2024-09-12T00:24:28.680 INFO:tasks.workunit.client.0.smithi067.stderr: -282> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: crc 2024-09-12T00:24:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -281> 2024-09-12T00:24:28.530+0000 7f1f88840800 5 AuthRegistry(0x56457c868540) adding con mode: secure 2024-09-12T00:24:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -280> 2024-09-12T00:24:28.531+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -279> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient: init 2024-09-12T00:24:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -278> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding auth protocol: cephx 2024-09-12T00:24:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -277> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding auth protocol: cephx 2024-09-12T00:24:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -276> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding auth protocol: cephx 2024-09-12T00:24:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -275> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: secure 2024-09-12T00:24:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -274> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: crc 2024-09-12T00:24:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -273> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: secure 2024-09-12T00:24:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -272> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: crc 2024-09-12T00:24:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -271> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: secure 2024-09-12T00:24:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -270> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: crc 2024-09-12T00:24:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -269> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: crc 2024-09-12T00:24:28.681 INFO:tasks.workunit.client.0.smithi067.stderr: -268> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: secure 2024-09-12T00:24:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -267> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: crc 2024-09-12T00:24:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -266> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: secure 2024-09-12T00:24:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -265> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: crc 2024-09-12T00:24:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -264> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462980) adding con mode: secure 2024-09-12T00:24:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -263> 2024-09-12T00:24:28.531+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -262> 2024-09-12T00:24:28.531+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -261> 2024-09-12T00:24:28.531+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command rotate-key cmddesc rotate-key hook 0x7ffcb4462ac8 EEXIST 2024-09-12T00:24:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -260> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -259> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:24:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -258> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-a con 0x56457c896b60 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:24:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -257> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-c con 0x56457c8a22e0 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:24:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -256> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-b con 0x56457c8695b0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:24:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -255> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.682 INFO:tasks.workunit.client.0.smithi067.stderr: -254> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -253> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -252> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -251> 2024-09-12T00:24:28.531+0000 7f1f88840800 10 monclient(hunting): authenticate will time out at 2145.788706s 2024-09-12T00:24:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -250> 2024-09-12T00:24:28.531+0000 7f1f85b29640 10 monclient(hunting): get_auth_request con 0x56457c8a22e0 auth_method 0 2024-09-12T00:24:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -249> 2024-09-12T00:24:28.531+0000 7f1f85b29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -248> 2024-09-12T00:24:28.531+0000 7f1f85b29640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -247> 2024-09-12T00:24:28.531+0000 7f1f85b29640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -246> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): get_auth_request con 0x56457c896b60 auth_method 0 2024-09-12T00:24:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -245> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -244> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -243> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -242> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -241> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.683 INFO:tasks.workunit.client.0.smithi067.stderr: -240> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -239> 2024-09-12T00:24:28.531+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -238> 2024-09-12T00:24:28.531+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -237> 2024-09-12T00:24:28.531+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -236> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient(hunting): handle_auth_done global_id 8388 payload 274 2024-09-12T00:24:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -235> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient: _finish_hunting 0 2024-09-12T00:24:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -234> 2024-09-12T00:24:28.531+0000 7f1f8632a640 1 monclient: found mon.noname-a 2024-09-12T00:24:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -233> 2024-09-12T00:24:28.531+0000 7f1f8632a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.67:3300/0 2024-09-12T00:24:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -232> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -231> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:24:28.684 INFO:tasks.workunit.client.0.smithi067.stderr: -230> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: dump: 2024-09-12T00:24:28.684 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.684 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.684 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.685 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.685 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.685 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.685 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.685 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.685 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -229> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: _finish_auth 0 2024-09-12T00:24:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -228> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:24:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -227> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -226> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 monclient: authenticate success, global_id 8388 2024-09-12T00:24:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -225> 2024-09-12T00:24:28.532+0000 7f1f88840800 10 monclient: get_monmap_and_config success 2024-09-12T00:24:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -224> 2024-09-12T00:24:28.532+0000 7f1f88840800 4 set_mon_vals no callback set 2024-09-12T00:24:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -223> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.685 INFO:tasks.workunit.client.0.smithi067.stderr: -222> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:24:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -221> 2024-09-12T00:24:28.532+0000 7f1e69ffb640 10 monclient: dump: 2024-09-12T00:24:28.686 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.686 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.686 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.686 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.686 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.686 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.686 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.686 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.686 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -220> 2024-09-12T00:24:28.532+0000 7f1f88840800 10 monclient: shutdown 2024-09-12T00:24:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -219> 2024-09-12T00:24:28.532+0000 7f1f88840800 10 monclient: build_initial_monmap 2024-09-12T00:24:28.686 INFO:tasks.workunit.client.0.smithi067.stderr: -218> 2024-09-12T00:24:28.532+0000 7f1f88840800 1 build_initial for_mkfs: 0 2024-09-12T00:24:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: -217> 2024-09-12T00:24:28.532+0000 7f1f88840800 10 monclient: monmap: 2024-09-12T00:24:28.687 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 0 2024-09-12T00:24:28.687 INFO:tasks.workunit.client.0.smithi067.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:24:28.687 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 0.000000 2024-09-12T00:24:28.687 INFO:tasks.workunit.client.0.smithi067.stderr:created 0.000000 2024-09-12T00:24:28.687 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 0 (unknown) 2024-09-12T00:24:28.687 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.687 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.noname-a 2024-09-12T00:24:28.687 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.noname-b 2024-09-12T00:24:28.687 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.noname-c 2024-09-12T00:24:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: -216> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding auth protocol: cephx 2024-09-12T00:24:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: -215> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding auth protocol: cephx 2024-09-12T00:24:28.687 INFO:tasks.workunit.client.0.smithi067.stderr: -214> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding auth protocol: cephx 2024-09-12T00:24:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -213> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: secure 2024-09-12T00:24:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -212> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: crc 2024-09-12T00:24:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -211> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: secure 2024-09-12T00:24:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -210> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: crc 2024-09-12T00:24:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -209> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: secure 2024-09-12T00:24:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -208> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: crc 2024-09-12T00:24:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -207> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: crc 2024-09-12T00:24:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -206> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: secure 2024-09-12T00:24:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -205> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: crc 2024-09-12T00:24:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -204> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: secure 2024-09-12T00:24:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -203> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: crc 2024-09-12T00:24:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -202> 2024-09-12T00:24:28.532+0000 7f1f88840800 5 AuthRegistry(0x56457c89c290) adding con mode: secure 2024-09-12T00:24:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -201> 2024-09-12T00:24:28.533+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.688 INFO:tasks.workunit.client.0.smithi067.stderr: -200> 2024-09-12T00:24:28.533+0000 7f1f88840800 1 librados: starting msgr at 2024-09-12T00:24:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -199> 2024-09-12T00:24:28.533+0000 7f1f88840800 1 librados: starting objecter 2024-09-12T00:24:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -198> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command objecter_requests cmddesc objecter_requests hook 0x56457c7fa7d0 EEXIST 2024-09-12T00:24:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -197> 2024-09-12T00:24:28.533+0000 7f1f88840800 1 librados: setting wanted keys 2024-09-12T00:24:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -196> 2024-09-12T00:24:28.533+0000 7f1f88840800 1 librados: calling monclient init 2024-09-12T00:24:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -195> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient: init 2024-09-12T00:24:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -194> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding auth protocol: cephx 2024-09-12T00:24:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -193> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding auth protocol: cephx 2024-09-12T00:24:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -192> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding auth protocol: cephx 2024-09-12T00:24:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -191> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: secure 2024-09-12T00:24:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -190> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: crc 2024-09-12T00:24:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -189> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: secure 2024-09-12T00:24:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -188> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: crc 2024-09-12T00:24:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -187> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: secure 2024-09-12T00:24:28.689 INFO:tasks.workunit.client.0.smithi067.stderr: -186> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: crc 2024-09-12T00:24:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -185> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: crc 2024-09-12T00:24:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -184> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: secure 2024-09-12T00:24:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -183> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: crc 2024-09-12T00:24:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -182> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: secure 2024-09-12T00:24:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -181> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: crc 2024-09-12T00:24:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -180> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 AuthRegistry(0x56457c8606f0) adding con mode: secure 2024-09-12T00:24:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -179> 2024-09-12T00:24:28.533+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -178> 2024-09-12T00:24:28.533+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -177> 2024-09-12T00:24:28.533+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command rotate-key cmddesc rotate-key hook 0x56457c860838 EEXIST 2024-09-12T00:24:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -176> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient: _reopen_session rank -1 2024-09-12T00:24:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -175> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:24:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -174> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-a con 0x56457c8695b0 addr [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2024-09-12T00:24:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -173> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-c con 0x56457c896b60 addr [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] 2024-09-12T00:24:28.690 INFO:tasks.workunit.client.0.smithi067.stderr: -172> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): picked mon.noname-b con 0x56457c8a22e0 addr [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] 2024-09-12T00:24:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -171> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -170> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -169> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): start opening mon connection 2024-09-12T00:24:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -168> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): _renew_subs 2024-09-12T00:24:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -167> 2024-09-12T00:24:28.533+0000 7f1f88840800 10 monclient(hunting): authenticate will time out at 2145.790858s 2024-09-12T00:24:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -166> 2024-09-12T00:24:28.533+0000 7f1f8632a640 10 monclient(hunting): get_auth_request con 0x56457c8695b0 auth_method 0 2024-09-12T00:24:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -165> 2024-09-12T00:24:28.533+0000 7f1f8632a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -164> 2024-09-12T00:24:28.533+0000 7f1f8632a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -163> 2024-09-12T00:24:28.533+0000 7f1f8632a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -162> 2024-09-12T00:24:28.533+0000 7f1f85b29640 10 monclient(hunting): get_auth_request con 0x56457c896b60 auth_method 0 2024-09-12T00:24:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -161> 2024-09-12T00:24:28.533+0000 7f1f85b29640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -160> 2024-09-12T00:24:28.533+0000 7f1f85b29640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -159> 2024-09-12T00:24:28.533+0000 7f1f85b29640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.691 INFO:tasks.workunit.client.0.smithi067.stderr: -158> 2024-09-12T00:24:28.534+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.692 INFO:tasks.workunit.client.0.smithi067.stderr: -157> 2024-09-12T00:24:28.534+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.692 INFO:tasks.workunit.client.0.smithi067.stderr: -156> 2024-09-12T00:24:28.534+0000 7f1f8632a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.692 INFO:tasks.workunit.client.0.smithi067.stderr: -155> 2024-09-12T00:24:28.534+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:24:28.692 INFO:tasks.workunit.client.0.smithi067.stderr: -154> 2024-09-12T00:24:28.534+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:24:28.692 INFO:tasks.workunit.client.0.smithi067.stderr: -153> 2024-09-12T00:24:28.534+0000 7f1f85b29640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:24:28.692 INFO:tasks.workunit.client.0.smithi067.stderr: -152> 2024-09-12T00:24:28.534+0000 7f1f86b2b640 10 monclient(hunting): get_auth_request con 0x56457c8a22e0 auth_method 0 2024-09-12T00:24:28.692 INFO:tasks.workunit.client.0.smithi067.stderr: -151> 2024-09-12T00:24:28.534+0000 7f1f86b2b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:24:28.692 INFO:tasks.workunit.client.0.smithi067.stderr: -150> 2024-09-12T00:24:28.534+0000 7f1f86b2b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:24:28.692 INFO:tasks.workunit.client.0.smithi067.stderr: -149> 2024-09-12T00:24:28.534+0000 7f1f86b2b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:24:28.692 INFO:tasks.workunit.client.0.smithi067.stderr: -148> 2024-09-12T00:24:28.534+0000 7f1f85b29640 10 monclient(hunting): handle_auth_done global_id 7811 payload 824 2024-09-12T00:24:28.692 INFO:tasks.workunit.client.0.smithi067.stderr: -147> 2024-09-12T00:24:28.534+0000 7f1f85b29640 10 monclient: _finish_hunting 0 2024-09-12T00:24:28.692 INFO:tasks.workunit.client.0.smithi067.stderr: -146> 2024-09-12T00:24:28.534+0000 7f1f85b29640 1 monclient: found mon.noname-c 2024-09-12T00:24:28.692 INFO:tasks.workunit.client.0.smithi067.stderr: -145> 2024-09-12T00:24:28.534+0000 7f1f85b29640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.67:3301/0 2024-09-12T00:24:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -144> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -143> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:24:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -142> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: dump: 2024-09-12T00:24:28.693 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.693 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.693 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.693 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.693 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.693 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.693 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.693 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.693 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.693 INFO:tasks.workunit.client.0.smithi067.stderr: -141> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: _finish_auth 0 2024-09-12T00:24:28.694 INFO:tasks.workunit.client.0.smithi067.stderr: -140> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: _check_auth_tickets 2024-09-12T00:24:28.694 INFO:tasks.workunit.client.0.smithi067.stderr: -139> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:24:28.694 INFO:tasks.workunit.client.0.smithi067.stderr: -138> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:24:28.694 INFO:tasks.workunit.client.0.smithi067.stderr: -137> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:24:28.694 INFO:tasks.workunit.client.0.smithi067.stderr: -136> 2024-09-12T00:24:28.534+0000 7f1e57fff640 10 monclient: dump: 2024-09-12T00:24:28.694 INFO:tasks.workunit.client.0.smithi067.stderr:epoch 1 2024-09-12T00:24:28.694 INFO:tasks.workunit.client.0.smithi067.stderr:fsid e5cff671-9fc3-4411-a3b0-24fb92477a76 2024-09-12T00:24:28.694 INFO:tasks.workunit.client.0.smithi067.stderr:last_changed 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.694 INFO:tasks.workunit.client.0.smithi067.stderr:created 2024-09-12T00:00:46.679876+0000 2024-09-12T00:24:28.694 INFO:tasks.workunit.client.0.smithi067.stderr:min_mon_release 19 (squid) 2024-09-12T00:24:28.694 INFO:tasks.workunit.client.0.smithi067.stderr:election_strategy: 1 2024-09-12T00:24:28.694 INFO:tasks.workunit.client.0.smithi067.stderr:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2024-09-12T00:24:28.694 INFO:tasks.workunit.client.0.smithi067.stderr:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-09-12T00:24:28.694 INFO:tasks.workunit.client.0.smithi067.stderr:2: [v2:172.21.15.67:3301/0,v1:172.21.15.67:6790/0] mon.c 2024-09-12T00:24:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -135> 2024-09-12T00:24:28.534+0000 7f1f88840800 5 monclient: authenticate success, global_id 7811 2024-09-12T00:24:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -134> 2024-09-12T00:24:28.534+0000 7f1f88840800 10 monclient: _renew_subs 2024-09-12T00:24:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -133> 2024-09-12T00:24:28.534+0000 7f1f88840800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:24:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -132> 2024-09-12T00:24:28.534+0000 7f1e69ffb640 4 set_mon_vals no callback set 2024-09-12T00:24:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -131> 2024-09-12T00:24:28.534+0000 7f1f88840800 10 monclient: _renew_subs 2024-09-12T00:24:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -130> 2024-09-12T00:24:28.534+0000 7f1f88840800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:24:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -129> 2024-09-12T00:24:28.534+0000 7f1f88840800 1 librados: init done 2024-09-12T00:24:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -128> 2024-09-12T00:24:28.534+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command cr dump hook 0x56457c8a0ae8 2024-09-12T00:24:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -127> 2024-09-12T00:24:28.536+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -126> 2024-09-12T00:24:28.537+0000 7f1e57fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:24:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -125> 2024-09-12T00:24:28.537+0000 7f1e57fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:24:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -124> 2024-09-12T00:24:28.537+0000 7f1e57fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.67:6832/593991103,v1:172.21.15.67:6833/593991103] 2024-09-12T00:24:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -123> 2024-09-12T00:24:28.537+0000 7f1f8632a640 10 monclient: get_auth_request con 0x7f1e50076470 auth_method 0 2024-09-12T00:24:28.695 INFO:tasks.workunit.client.0.smithi067.stderr: -122> 2024-09-12T00:24:28.537+0000 7f1f86b2b640 10 monclient: get_auth_request con 0x56457c8b6de0 auth_method 0 2024-09-12T00:24:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -121> 2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -120> 2024-09-12T00:24:28.538+0000 7f1f88840800 20 realm 2024-09-12T00:24:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -119> 2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -118> 2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -117> 2024-09-12T00:24:28.538+0000 7f1f88840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -116> 2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -115> 2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -114> 2024-09-12T00:24:28.538+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -113> 2024-09-12T00:24:28.539+0000 7f1f8632a640 10 monclient: get_auth_request con 0x56457c8baf90 auth_method 0 2024-09-12T00:24:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -112> 2024-09-12T00:24:28.539+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -111> 2024-09-12T00:24:28.539+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -110> 2024-09-12T00:24:28.539+0000 7f1f85b29640 10 monclient: get_auth_request con 0x56457c8be7f0 auth_method 0 2024-09-12T00:24:28.696 INFO:tasks.workunit.client.0.smithi067.stderr: -109> 2024-09-12T00:24:28.540+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -108> 2024-09-12T00:24:28.540+0000 7f1f88840800 20 searching for the correct realm 2024-09-12T00:24:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -107> 2024-09-12T00:24:28.540+0000 7f1f86b2b640 10 monclient: get_auth_request con 0x7f1f7c06c010 auth_method 0 2024-09-12T00:24:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -106> 2024-09-12T00:24:28.542+0000 7f1f8632a640 10 monclient: get_auth_request con 0x7f1f78098a50 auth_method 0 2024-09-12T00:24:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -105> 2024-09-12T00:24:28.543+0000 7f1f85b29640 10 monclient: get_auth_request con 0x7f1f7c074bb0 auth_method 0 2024-09-12T00:24:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -104> 2024-09-12T00:24:28.543+0000 7f1f85b29640 0 -- 172.21.15.67:0/1810663864 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f1f7c074bb0 msgr2=0x7f1f7c073910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -103> 2024-09-12T00:24:28.543+0000 7f1e57fff640 1 client.7811.objecter ms_handle_reset 0x7f1f7c074bb0 session 0x7f1f7c06b8c0 osd.5 2024-09-12T00:24:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -102> 2024-09-12T00:24:28.543+0000 7f1e57fff640 10 monclient: _renew_subs 2024-09-12T00:24:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -101> 2024-09-12T00:24:28.543+0000 7f1e57fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.67:3301/0 2024-09-12T00:24:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -100> 2024-09-12T00:24:28.543+0000 7f1f85b29640 10 monclient: get_auth_request con 0x7f1e50086790 auth_method 0 2024-09-12T00:24:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -99> 2024-09-12T00:24:28.545+0000 7f1f86b2b640 10 monclient: get_auth_request con 0x7f1f780510b0 auth_method 0 2024-09-12T00:24:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -98> 2024-09-12T00:24:28.546+0000 7f1f8632a640 10 monclient: get_auth_request con 0x7f1f80061040 auth_method 0 2024-09-12T00:24:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -97> 2024-09-12T00:24:28.547+0000 7f1f86b2b640 0 -- 172.21.15.67:0/1810663864 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x56457c8b6de0 msgr2=0x56457c8b91d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -96> 2024-09-12T00:24:28.547+0000 7f1e57fff640 1 client.7811.objecter ms_handle_reset 0x56457c8b6de0 session 0x56457c8b6710 osd.6 2024-09-12T00:24:28.697 INFO:tasks.workunit.client.0.smithi067.stderr: -95> 2024-09-12T00:24:28.547+0000 7f1f86b2b640 10 monclient: get_auth_request con 0x7f1f7c074bb0 auth_method 0 2024-09-12T00:24:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -94> 2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -93> 2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -92> 2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:24:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -91> 2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:24:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -90> 2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -89> 2024-09-12T00:24:28.551+0000 7f1f88840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -88> 2024-09-12T00:24:28.551+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -87> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -86> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -85> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -84> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -83> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -82> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 zone default found 2024-09-12T00:24:28.698 INFO:tasks.workunit.client.0.smithi067.stderr: -81> 2024-09-12T00:24:28.552+0000 7f1f88840800 4 Realm: () 2024-09-12T00:24:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -80> 2024-09-12T00:24:28.552+0000 7f1f88840800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:24:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -79> 2024-09-12T00:24:28.552+0000 7f1f88840800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:24:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -78> 2024-09-12T00:24:28.552+0000 7f1f88840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -77> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 zonegroup default 2024-09-12T00:24:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -76> 2024-09-12T00:24:28.552+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -75> 2024-09-12T00:24:28.553+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -74> 2024-09-12T00:24:28.553+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -73> 2024-09-12T00:24:28.553+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -72> 2024-09-12T00:24:28.553+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -71> 2024-09-12T00:24:28.553+0000 7f1f88840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -70> 2024-09-12T00:24:28.553+0000 7f1f88840800 20 started sync module instance, tier type = 2024-09-12T00:24:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -69> 2024-09-12T00:24:28.553+0000 7f1f88840800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:24:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -68> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=0 2024-09-12T00:24:28.699 INFO:tasks.workunit.client.0.smithi067.stderr: -67> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=1 2024-09-12T00:24:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -66> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=2 2024-09-12T00:24:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -65> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=3 2024-09-12T00:24:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -64> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=4 2024-09-12T00:24:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -63> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=5 2024-09-12T00:24:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -62> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=6 2024-09-12T00:24:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -61> 2024-09-12T00:24:28.563+0000 7f1f88840800 20 add_watcher() i=7 2024-09-12T00:24:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -60> 2024-09-12T00:24:28.563+0000 7f1f88840800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -59> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding auth protocol: cephx 2024-09-12T00:24:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -58> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding auth protocol: cephx 2024-09-12T00:24:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -57> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding auth protocol: cephx 2024-09-12T00:24:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -56> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: secure 2024-09-12T00:24:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -55> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: crc 2024-09-12T00:24:28.700 INFO:tasks.workunit.client.0.smithi067.stderr: -54> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: secure 2024-09-12T00:24:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -53> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: crc 2024-09-12T00:24:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -52> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: secure 2024-09-12T00:24:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -51> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: crc 2024-09-12T00:24:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -50> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: crc 2024-09-12T00:24:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -49> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: secure 2024-09-12T00:24:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -48> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: crc 2024-09-12T00:24:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -47> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: secure 2024-09-12T00:24:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -46> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: crc 2024-09-12T00:24:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -45> 2024-09-12T00:24:28.565+0000 7f1e3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -44> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 AuthRegistry(0x7ffcb4462e60) adding con mode: secure 2024-09-12T00:24:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -43> 2024-09-12T00:24:28.565+0000 7f1f88840800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:24:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -42> 2024-09-12T00:24:28.565+0000 7f1f88840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -41> 2024-09-12T00:24:28.565+0000 7f1f88840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:28.701 INFO:tasks.workunit.client.0.smithi067.stderr: -40> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command cache list hook 0x56457c89b6d0 2024-09-12T00:24:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -39> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command cache inspect hook 0x56457c89b6d0 2024-09-12T00:24:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -38> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command cache erase hook 0x56457c89b6d0 2024-09-12T00:24:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -37> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command cache zap hook 0x56457c89b6d0 2024-09-12T00:24:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -36> 2024-09-12T00:24:28.565+0000 7f1f88840800 5 note: GC not initialized 2024-09-12T00:24:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -35> 2024-09-12T00:24:28.566+0000 7f1db77fe640 20 reqs_thread_entry: start 2024-09-12T00:24:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -34> 2024-09-12T00:24:28.566+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command sync trace show hook 0x7f1f78087070 2024-09-12T00:24:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -33> 2024-09-12T00:24:28.566+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command sync trace history hook 0x7f1f78087070 2024-09-12T00:24:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -32> 2024-09-12T00:24:28.566+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command sync trace active hook 0x7f1f78087070 2024-09-12T00:24:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -31> 2024-09-12T00:24:28.566+0000 7f1f88840800 5 asok(0x56457c5ac630) register_command sync trace active_short hook 0x7f1f78087070 2024-09-12T00:24:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -30> 2024-09-12T00:24:28.566+0000 7f1f88840800 20 init_complete bucket index max shards: 1 2024-09-12T00:24:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -29> 2024-09-12T00:24:28.566+0000 7f1f88840800 20 Filter name: none 2024-09-12T00:24:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -28> 2024-09-12T00:24:28.566+0000 7f1db57fa640 20 reqs_thread_entry: start 2024-09-12T00:24:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -27> 2024-09-12T00:24:28.566+0000 7f1f88840800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:24:28.702 INFO:tasks.workunit.client.0.smithi067.stderr: -26> 2024-09-12T00:24:28.566+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -25> 2024-09-12T00:24:28.566+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:24:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -24> 2024-09-12T00:24:28.566+0000 7f1f88840800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:24:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -23> 2024-09-12T00:24:28.566+0000 7f1f88840800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:24:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -22> 2024-09-12T00:24:28.566+0000 7f1f88840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:24:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -21> 2024-09-12T00:24:28.566+0000 7f1f88840800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -20> 2024-09-12T00:24:28.567+0000 7f1f88840800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:24:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -19> 2024-09-12T00:24:28.567+0000 7f1f88840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:24:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -18> 2024-09-12T00:24:28.567+0000 7f1f88840800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:24:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -17> 2024-09-12T00:24:28.567+0000 7f1f88840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -16> 2024-09-12T00:24:28.567+0000 7f1f88840800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:24:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -15> 2024-09-12T00:24:28.567+0000 7f1f88840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:24:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -14> 2024-09-12T00:24:28.568+0000 7f1f88840800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:24:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -13> 2024-09-12T00:24:28.572+0000 7f1f88840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:24:28.703 INFO:tasks.workunit.client.0.smithi067.stderr: -12> 2024-09-12T00:24:28.572+0000 7f1f88840800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:24:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -11> 2024-09-12T00:24:28.572+0000 7f1f88840800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:24:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -10> 2024-09-12T00:24:28.572+0000 7f1f88840800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:24:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -9> 2024-09-12T00:24:28.572+0000 7f1e69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562484 cookie 94856442313888 notifier 7811 bl.length()=827 2024-09-12T00:24:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -8> 2024-09-12T00:24:28.572+0000 7f1e69ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:24:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -7> 2024-09-12T00:24:28.572+0000 7f1e69ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:24:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -6> 2024-09-12T00:24:28.572+0000 7f1e69ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:24:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -5> 2024-09-12T00:24:28.573+0000 7f1f88840800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:24:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -4> 2024-09-12T00:24:28.573+0000 7f1f88840800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:24:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -3> 2024-09-12T00:24:28.573+0000 7f1f88840800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:24:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -2> 2024-09-12T00:24:28.573+0000 7f1f88840800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:24:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: -1> 2024-09-12T00:24:28.576+0000 7f1f88840800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1f88840800 time 2024-09-12T00:24:28.577197+0000 2024-09-12T00:24:28.704 INFO:tasks.workunit.client.0.smithi067.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:24:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.704 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f1f8bd8c71a] 2024-09-12T00:24:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f8bd8c8d8] 2024-09-12T00:24:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56457a312641] 2024-09-12T00:24:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56457a32238a] 2024-09-12T00:24:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: 5: main() 2024-09-12T00:24:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f1f8aa29590] 2024-09-12T00:24:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: 7: __libc_start_main() 2024-09-12T00:24:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: 8: _start() 2024-09-12T00:24:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: 0> 2024-09-12T00:24:28.577+0000 7f1f88840800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:24:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: in thread 7f1f88840800 thread_name:radosgw-admin 2024-09-12T00:24:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.705 INFO:tasks.workunit.client.0.smithi067.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:24:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f1f8aa3e6f0] 2024-09-12T00:24:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f1f8aa8b99c] 2024-09-12T00:24:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: 3: raise() 2024-09-12T00:24:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: 4: abort() 2024-09-12T00:24:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f1f8bd8c774] 2024-09-12T00:24:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f1f8bd8c8d8] 2024-09-12T00:24:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56457a312641] 2024-09-12T00:24:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56457a32238a] 2024-09-12T00:24:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: 9: main() 2024-09-12T00:24:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f1f8aa29590] 2024-09-12T00:24:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: 11: __libc_start_main() 2024-09-12T00:24:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: 12: _start() 2024-09-12T00:24:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:24:28.706 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi067.stderr:--- logging levels --- 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 none 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 lockdep 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 context 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 crush 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_balancer 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_locker 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_log_expire 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mds_migrator 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: 3/ 5 mds_quiesce 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 buffer 2024-09-12T00:24:28.707 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 timer 2024-09-12T00:24:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 filer 2024-09-12T00:24:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 striper 2024-09-12T00:24:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 1 objecter 2024-09-12T00:24:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rados 2024-09-12T00:24:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd 2024-09-12T00:24:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_mirror 2024-09-12T00:24:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_replay 2024-09-12T00:24:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 rbd_pwl 2024-09-12T00:24:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 journaler 2024-09-12T00:24:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objectcacher 2024-09-12T00:24:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:24:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 client 2024-09-12T00:24:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 osd 2024-09-12T00:24:28.708 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 optracker 2024-09-12T00:24:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 objclass 2024-09-12T00:24:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 filestore 2024-09-12T00:24:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 journal 2024-09-12T00:24:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 ms 2024-09-12T00:24:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mon 2024-09-12T00:24:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: 0/10 monc 2024-09-12T00:24:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 paxos 2024-09-12T00:24:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 tp 2024-09-12T00:24:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 auth 2024-09-12T00:24:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 crypto 2024-09-12T00:24:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 finisher 2024-09-12T00:24:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 reserver 2024-09-12T00:24:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 heartbeatmap 2024-09-12T00:24:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 perfcounter 2024-09-12T00:24:28.709 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw 2024-09-12T00:24:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_sync 2024-09-12T00:24:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_datacache 2024-09-12T00:24:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_access 2024-09-12T00:24:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:24:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_flight 2024-09-12T00:24:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:24:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: 20/20 rgw_notification 2024-09-12T00:24:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 javaclient 2024-09-12T00:24:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 asok 2024-09-12T00:24:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 1 throttle 2024-09-12T00:24:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 0 refs 2024-09-12T00:24:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 compressor 2024-09-12T00:24:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluestore 2024-09-12T00:24:28.710 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 bluefs 2024-09-12T00:24:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 3 bdev 2024-09-12T00:24:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 kstore 2024-09-12T00:24:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: 4/ 5 rocksdb 2024-09-12T00:24:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 fuse 2024-09-12T00:24:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: 2/ 5 mgr 2024-09-12T00:24:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mgrc 2024-09-12T00:24:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 dpdk 2024-09-12T00:24:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 eventtrace 2024-09-12T00:24:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 prioritycache 2024-09-12T00:24:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 test 2024-09-12T00:24:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:24:28.711 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cephsqlite 2024-09-12T00:24:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:24:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore 2024-09-12T00:24:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_onode 2024-09-12T00:24:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_odata 2024-09-12T00:24:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_omap 2024-09-12T00:24:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_tm 2024-09-12T00:24:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_t 2024-09-12T00:24:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:24:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_epm 2024-09-12T00:24:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_lba 2024-09-12T00:24:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:24:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_cache 2024-09-12T00:24:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_journal 2024-09-12T00:24:28.712 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_device 2024-09-12T00:24:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 seastore_backref 2024-09-12T00:24:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 alienstore 2024-09-12T00:24:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 mclock 2024-09-12T00:24:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 cyanstore 2024-09-12T00:24:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 ceph_exporter 2024-09-12T00:24:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 memstore 2024-09-12T00:24:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: 1/ 5 trace 2024-09-12T00:24:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: 0/ 5 ceph_dedup 2024-09-12T00:24:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: -2/-2 (syslog threshold) 2024-09-12T00:24:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: 99/99 (stderr threshold) 2024-09-12T00:24:28.713 INFO:tasks.workunit.client.0.smithi067.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:24:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1db57fa640 / http_manager 2024-09-12T00:24:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1db77fe640 / http_manager 2024-09-12T00:24:28.713 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1e3cfe1640 / rgw_dt_lg_renew 2024-09-12T00:24:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1e57fff640 / ms_dispatch 2024-09-12T00:24:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1e69ffb640 / io_context_pool 2024-09-12T00:24:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1e6bfff640 / ms_dispatch 2024-09-12T00:24:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1e72e05640 / ms_dispatch 2024-09-12T00:24:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1e74608640 / io_context_pool 2024-09-12T00:24:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1f85b29640 / msgr-worker-2 2024-09-12T00:24:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1f8632a640 / msgr-worker-1 2024-09-12T00:24:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1f86b2b640 / msgr-worker-0 2024-09-12T00:24:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1f8732c640 / io_context_pool 2024-09-12T00:24:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: 7f1f88840800 / radosgw-admin 2024-09-12T00:24:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: max_recent 500 2024-09-12T00:24:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: max_new 1000 2024-09-12T00:24:28.714 INFO:tasks.workunit.client.0.smithi067.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:24:28.578598Z_21e25710-5ff9-4991-8992-752dcf036f7c/log 2024-09-12T00:24:28.714 INFO:tasks.workunit.client.0.smithi067.stderr:--- end dump of recent events --- 2024-09-12T00:24:28.714 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:24:28.716 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:28.716 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:28.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.657+0000 7f0fba92c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.659+0000 7f0fba92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.659+0000 7f0fba92c800 20 realm 2024-09-12T00:24:28.716 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.659+0000 7f0fba92c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.659+0000 7f0fba92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.659+0000 7f0fba92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:28.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.659+0000 7f0fba92c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.659+0000 7f0fba92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.659+0000 7f0fba92c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.660+0000 7f0fba92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:28.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.660+0000 7f0fba92c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.661+0000 7f0fba92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:28.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.661+0000 7f0fba92c800 20 searching for the correct realm 2024-09-12T00:24:28.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.662+0000 7f0fb6d46640 0 -- 172.21.15.67:0/3206524732 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55d649130320 msgr2=0x55d649132790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:28.717 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.666+0000 7f0fb6d46640 0 -- 172.21.15.67:0/3206524732 >> [v2:172.21.15.170:6824/783534599,v1:172.21.15.170:6825/783534599] conn(0x7f0fa809f1a0 msgr2=0x7f0fa8087130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:24:28.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.874+0000 7f0fba92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:28.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.874+0000 7f0fba92c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:28.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.874+0000 7f0fba92c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:24:28.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.874+0000 7f0fba92c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:24:28.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.874+0000 7f0fba92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:28.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.874+0000 7f0fba92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:28.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.874+0000 7f0fba92c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.875+0000 7f0fba92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.875+0000 7f0fba92c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.875+0000 7f0fba92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:28.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.875+0000 7f0fba92c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.875+0000 7f0fba92c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:28.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.875+0000 7f0fba92c800 20 zone default found 2024-09-12T00:24:28.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.875+0000 7f0fba92c800 4 Realm: () 2024-09-12T00:24:28.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.875+0000 7f0fba92c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:24:28.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.875+0000 7f0fba92c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:24:28.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.875+0000 7f0fba92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:28.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.875+0000 7f0fba92c800 20 zonegroup default 2024-09-12T00:24:28.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.875+0000 7f0fba92c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.876+0000 7f0fba92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.876+0000 7f0fba92c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.876+0000 7f0fba92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.876+0000 7f0fba92c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.877+0000 7f0fba92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.877+0000 7f0fba92c800 20 started sync module instance, tier type = 2024-09-12T00:24:28.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.877+0000 7f0fba92c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:24:28.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.886+0000 7f0fba92c800 20 add_watcher() i=0 2024-09-12T00:24:28.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.886+0000 7f0fba92c800 20 add_watcher() i=1 2024-09-12T00:24:28.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.886+0000 7f0fba92c800 20 add_watcher() i=2 2024-09-12T00:24:28.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.886+0000 7f0fba92c800 20 add_watcher() i=3 2024-09-12T00:24:28.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.886+0000 7f0fba92c800 20 add_watcher() i=4 2024-09-12T00:24:28.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.886+0000 7f0fba92c800 20 add_watcher() i=5 2024-09-12T00:24:28.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.886+0000 7f0fba92c800 20 add_watcher() i=6 2024-09-12T00:24:28.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.887+0000 7f0fba92c800 20 add_watcher() i=7 2024-09-12T00:24:28.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.887+0000 7f0fba92c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:28.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.889+0000 7f0e68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:28.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.889+0000 7f0fba92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:28.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.889+0000 7f0fba92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:28.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.889+0000 7f0fba92c800 5 note: GC not initialized 2024-09-12T00:24:28.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.889+0000 7f0de37fe640 20 reqs_thread_entry: start 2024-09-12T00:24:28.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.890+0000 7f0fba92c800 20 init_complete bucket index max shards: 1 2024-09-12T00:24:28.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.890+0000 7f0fba92c800 20 Filter name: none 2024-09-12T00:24:28.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.890+0000 7f0de17fa640 20 reqs_thread_entry: start 2024-09-12T00:24:28.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.890+0000 7f0fba92c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.890+0000 7f0fba92c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:24:28.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.890+0000 7f0fba92c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.891+0000 7f0fba92c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:24:28.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.891+0000 7f0fba92c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:28.890 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.891+0000 7f0fba92c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.891+0000 7f0fba92c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:24:28.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.891+0000 7f0fba92c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.891+0000 7f0fba92c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:24:28.891 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.892+0000 7f0fba92c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:24:28.892 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.893+0000 7f0e68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:28.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.895+0000 7f0fba92c800 20 remove_watcher() i=0 2024-09-12T00:24:28.894 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.895+0000 7f0fba92c800 2 removed watcher, disabling cache 2024-09-12T00:24:28.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.896+0000 7f0fba92c800 20 remove_watcher() i=1 2024-09-12T00:24:28.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.897+0000 7f0fba92c800 20 remove_watcher() i=2 2024-09-12T00:24:28.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.898+0000 7f0fba92c800 20 remove_watcher() i=3 2024-09-12T00:24:28.898 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.899+0000 7f0fba92c800 20 remove_watcher() i=4 2024-09-12T00:24:28.899 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.900+0000 7f0fba92c800 20 remove_watcher() i=5 2024-09-12T00:24:28.900 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.901+0000 7f0fba92c800 20 remove_watcher() i=6 2024-09-12T00:24:28.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.902+0000 7f0fba92c800 20 remove_watcher() i=7 2024-09-12T00:24:28.925 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:24:28.954 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:28.954 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:28.994 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.995+0000 7f5724d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.996+0000 7f5724d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.996+0000 7f5724d3d800 20 realm 2024-09-12T00:24:28.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.996+0000 7f5724d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.996+0000 7f5724d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.996+0000 7f5724d3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:28.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.996+0000 7f5724d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.997+0000 7f5724d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:28.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.997+0000 7f5724d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.996 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.997+0000 7f5724d3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:28.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.997+0000 7f5724d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:24:28.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.998+0000 7f5724d3d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:28.997 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:28.998+0000 7f5724d3d800 20 searching for the correct realm 2024-09-12T00:24:29.001 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.002+0000 7f571bfff640 0 -- 172.21.15.67:0/576264418 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f570c0a1040 msgr2=0x7f570c068910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:29.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.005+0000 7f5720a2a640 0 -- 172.21.15.67:0/576264418 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f571c061040 msgr2=0x7f571c07c960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:29.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.009+0000 7f5724d3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:29.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.009+0000 7f5724d3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:29.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.009+0000 7f5724d3d800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:24:29.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.009+0000 7f5724d3d800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:24:29.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.009+0000 7f5724d3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:29.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.009+0000 7f5724d3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:29.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.009+0000 7f5724d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:24:29.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.009+0000 7f5724d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:29.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.009+0000 7f5724d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:24:29.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.009+0000 7f5724d3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:29.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.009+0000 7f5724d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:24:29.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.010+0000 7f5724d3d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:29.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.010+0000 7f5724d3d800 20 zone default found 2024-09-12T00:24:29.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.010+0000 7f5724d3d800 4 Realm: () 2024-09-12T00:24:29.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.010+0000 7f5724d3d800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:24:29.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.010+0000 7f5724d3d800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:24:29.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.010+0000 7f5724d3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:29.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.010+0000 7f5724d3d800 20 zonegroup default 2024-09-12T00:24:29.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.010+0000 7f5724d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:24:29.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.010+0000 7f5724d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:29.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.010+0000 7f5724d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:24:29.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.010+0000 7f5724d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:29.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.010+0000 7f5724d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:24:29.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.011+0000 7f5724d3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:29.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.011+0000 7f5724d3d800 20 started sync module instance, tier type = 2024-09-12T00:24:29.017 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.011+0000 7f5724d3d800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:24:29.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.019+0000 7f5724d3d800 20 add_watcher() i=0 2024-09-12T00:24:29.018 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.019+0000 7f5724d3d800 20 add_watcher() i=1 2024-09-12T00:24:29.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.019+0000 7f5724d3d800 20 add_watcher() i=2 2024-09-12T00:24:29.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.019+0000 7f5724d3d800 20 add_watcher() i=3 2024-09-12T00:24:29.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.019+0000 7f5724d3d800 20 add_watcher() i=4 2024-09-12T00:24:29.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.019+0000 7f5724d3d800 20 add_watcher() i=5 2024-09-12T00:24:29.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.019+0000 7f5724d3d800 20 add_watcher() i=6 2024-09-12T00:24:29.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.020+0000 7f5724d3d800 20 add_watcher() i=7 2024-09-12T00:24:29.019 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.020+0000 7f5724d3d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:29.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.021+0000 7f55d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:29.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.022+0000 7f5724d3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:29.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.022+0000 7f5724d3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:29.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.022+0000 7f5724d3d800 5 note: GC not initialized 2024-09-12T00:24:29.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.022+0000 7f55d5fe3640 20 reqs_thread_entry: start 2024-09-12T00:24:29.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.022+0000 7f5724d3d800 20 init_complete bucket index max shards: 1 2024-09-12T00:24:29.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.022+0000 7f5724d3d800 20 Filter name: none 2024-09-12T00:24:29.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.022+0000 7f55477fe640 20 reqs_thread_entry: start 2024-09-12T00:24:29.022 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.022+0000 7f5724d3d800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:24:29.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.022+0000 7f5724d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:24:29.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.023+0000 7f5724d3d800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:24:29.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.023+0000 7f5724d3d800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:24:29.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.023+0000 7f5724d3d800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:24:29.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.023+0000 7f5724d3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:24:29.023 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.023+0000 7f5724d3d800 20 rados->read ofs=0 len=0 2024-09-12T00:24:29.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.023+0000 7f5724d3d800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:24:29.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.023+0000 7f5724d3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:24:29.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.023+0000 7f5724d3d800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:24:29.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.023+0000 7f5724d3d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:29.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.023+0000 7f5724d3d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:24:29.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.023+0000 7f5724d3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:24:29.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.023+0000 7f5724d3d800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:24:29.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.023+0000 7f5724d3d800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:24:29.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.024+0000 7f5724d3d800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:24:29.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.024+0000 7f5724d3d800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:24:29.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.024+0000 7f5724d3d800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:24:29.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.024+0000 7f5724d3d800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:24:29.025 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.025+0000 7f55d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:29.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.028+0000 7f5724d3d800 20 remove_watcher() i=0 2024-09-12T00:24:29.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.028+0000 7f5724d3d800 2 removed watcher, disabling cache 2024-09-12T00:24:29.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.029+0000 7f5724d3d800 20 remove_watcher() i=1 2024-09-12T00:24:29.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.029+0000 7f5724d3d800 20 remove_watcher() i=2 2024-09-12T00:24:29.029 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.030+0000 7f5724d3d800 20 remove_watcher() i=3 2024-09-12T00:24:29.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.031+0000 7f5724d3d800 20 remove_watcher() i=4 2024-09-12T00:24:29.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.032+0000 7f5724d3d800 20 remove_watcher() i=5 2024-09-12T00:24:29.032 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.033+0000 7f5724d3d800 20 remove_watcher() i=6 2024-09-12T00:24:29.033 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:29.034+0000 7f5724d3d800 20 remove_watcher() i=7 2024-09-12T00:24:59.078 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T00:24:59.111 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:59.111 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:59.157 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.159+0000 7f62c4b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.161+0000 7f62c4b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.161+0000 7f62c4b2c800 20 realm 2024-09-12T00:24:59.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.161+0000 7f62c4b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.161+0000 7f62c4b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.161+0000 7f62c4b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:59.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.161+0000 7f62c4b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.161+0000 7f62c4b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.161+0000 7f62c4b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.162+0000 7f62c4b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:59.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.162+0000 7f62c4b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.163+0000 7f62c4b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:59.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.163+0000 7f62c4b2c800 20 searching for the correct realm 2024-09-12T00:24:59.165 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.167+0000 7f62bff3d640 0 -- 172.21.15.67:0/1878063986 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f62b4056850 msgr2=0x7f62b4064410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:59.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.373+0000 7f62c0f3f640 0 -- 172.21.15.67:0/1878063986 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x564707ca4050 msgr2=0x564707ca64b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:59.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.378+0000 7f62c4b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:59.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.378+0000 7f62c4b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:59.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.378+0000 7f62c4b2c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:24:59.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.378+0000 7f62c4b2c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:24:59.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.378+0000 7f62c4b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:59.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.378+0000 7f62c4b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:59.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.378+0000 7f62c4b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.379+0000 7f62c4b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.377 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.379+0000 7f62c4b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.379+0000 7f62c4b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:59.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.379+0000 7f62c4b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.379+0000 7f62c4b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:59.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.379+0000 7f62c4b2c800 20 zone default found 2024-09-12T00:24:59.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.379+0000 7f62c4b2c800 4 Realm: () 2024-09-12T00:24:59.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.379+0000 7f62c4b2c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:24:59.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.379+0000 7f62c4b2c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:24:59.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.379+0000 7f62c4b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:59.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.379+0000 7f62c4b2c800 20 zonegroup default 2024-09-12T00:24:59.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.379+0000 7f62c4b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.380+0000 7f62c4b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.379 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.380+0000 7f62c4b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.380+0000 7f62c4b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.380+0000 7f62c4b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.380+0000 7f62c4b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.380+0000 7f62c4b2c800 20 started sync module instance, tier type = 2024-09-12T00:24:59.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.380+0000 7f62c4b2c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:24:59.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.390+0000 7f62c4b2c800 20 add_watcher() i=0 2024-09-12T00:24:59.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.390+0000 7f62c4b2c800 20 add_watcher() i=1 2024-09-12T00:24:59.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.390+0000 7f62c4b2c800 20 add_watcher() i=2 2024-09-12T00:24:59.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.390+0000 7f62c4b2c800 20 add_watcher() i=3 2024-09-12T00:24:59.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.390+0000 7f62c4b2c800 20 add_watcher() i=4 2024-09-12T00:24:59.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.390+0000 7f62c4b2c800 20 add_watcher() i=5 2024-09-12T00:24:59.389 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.390+0000 7f62c4b2c800 20 add_watcher() i=6 2024-09-12T00:24:59.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.392+0000 7f62c4b2c800 20 add_watcher() i=7 2024-09-12T00:24:59.390 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.392+0000 7f62c4b2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:59.391 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.393+0000 7f6176fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:59.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.394+0000 7f62c4b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:59.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.394+0000 7f62c4b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:59.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.394+0000 7f62c4b2c800 5 note: GC not initialized 2024-09-12T00:24:59.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.394+0000 7f6175fdb640 20 reqs_thread_entry: start 2024-09-12T00:24:59.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.394+0000 7f62c4b2c800 20 init_complete bucket index max shards: 1 2024-09-12T00:24:59.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.394+0000 7f62c4b2c800 20 Filter name: none 2024-09-12T00:24:59.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.394+0000 7f60e77fe640 20 reqs_thread_entry: start 2024-09-12T00:24:59.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.394+0000 7f62c4b2c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:24:59.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.394+0000 7f62c4b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.395+0000 7f62c4b2c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:24:59.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.395+0000 7f62c4b2c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:24:59.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.395+0000 7f62c4b2c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:24:59.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.395+0000 7f62c4b2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:24:59.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.395+0000 7f62c4b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.394 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.395+0000 7f62c4b2c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:24:59.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.395+0000 7f62c4b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:24:59.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.395+0000 7f62c4b2c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:24:59.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.395+0000 7f62c4b2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:59.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.395+0000 7f62c4b2c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:24:59.395 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.395+0000 7f62c4b2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:24:59.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.399+0000 7f6176fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:59.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.401+0000 7f62c4b2c800 20 remove_watcher() i=0 2024-09-12T00:24:59.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.401+0000 7f62c4b2c800 2 removed watcher, disabling cache 2024-09-12T00:24:59.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.403+0000 7f62c4b2c800 20 remove_watcher() i=1 2024-09-12T00:24:59.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.404+0000 7f62c4b2c800 20 remove_watcher() i=2 2024-09-12T00:24:59.403 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.405+0000 7f62c4b2c800 20 remove_watcher() i=3 2024-09-12T00:24:59.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.406+0000 7f62c4b2c800 20 remove_watcher() i=4 2024-09-12T00:24:59.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.407+0000 7f62c4b2c800 20 remove_watcher() i=5 2024-09-12T00:24:59.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.408+0000 7f62c4b2c800 20 remove_watcher() i=6 2024-09-12T00:24:59.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.409+0000 7f62c4b2c800 20 remove_watcher() i=7 2024-09-12T00:24:59.421 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:24:59.452 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:59.452 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:59.492 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.494+0000 7f244a930800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.496+0000 7f244a930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.496+0000 7f244a930800 20 realm 2024-09-12T00:24:59.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.496+0000 7f244a930800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.496+0000 7f244a930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.496+0000 7f244a930800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:59.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.496+0000 7f244a930800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.497+0000 7f244a930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.495 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.497+0000 7f244a930800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.497+0000 7f244a930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:59.496 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.497+0000 7f244a930800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.498+0000 7f244a930800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:59.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.498+0000 7f244a930800 20 searching for the correct realm 2024-09-12T00:24:59.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.501+0000 7f2445eaf640 0 -- 172.21.15.67:0/4129262245 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f243c02f070 msgr2=0x7f243c0a37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:59.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.706+0000 7f24466b0640 0 -- 172.21.15.67:0/4129262245 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f2440034040 msgr2=0x7f244000f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:24:59.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.914+0000 7f244a930800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:59.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.914+0000 7f244a930800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:59.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.914+0000 7f244a930800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:24:59.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.914+0000 7f244a930800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:24:59.912 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.914+0000 7f244a930800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:59.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.914+0000 7f244a930800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:59.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.914+0000 7f244a930800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.914+0000 7f244a930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.913 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.914+0000 7f244a930800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.914+0000 7f244a930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.914+0000 7f244a930800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.915+0000 7f244a930800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.915+0000 7f244a930800 20 zone default found 2024-09-12T00:24:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.915+0000 7f244a930800 4 Realm: () 2024-09-12T00:24:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.915+0000 7f244a930800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:24:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.915+0000 7f244a930800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:24:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.915+0000 7f244a930800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.915+0000 7f244a930800 20 zonegroup default 2024-09-12T00:24:59.914 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.915+0000 7f244a930800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.915+0000 7f244a930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.915+0000 7f244a930800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.916+0000 7f244a930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.916+0000 7f244a930800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.916+0000 7f244a930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:59.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.916+0000 7f244a930800 20 started sync module instance, tier type = 2024-09-12T00:24:59.915 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.916+0000 7f244a930800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:24:59.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.926+0000 7f244a930800 20 add_watcher() i=0 2024-09-12T00:24:59.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.926+0000 7f244a930800 20 add_watcher() i=1 2024-09-12T00:24:59.924 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.926+0000 7f244a930800 20 add_watcher() i=2 2024-09-12T00:24:59.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.926+0000 7f244a930800 20 add_watcher() i=3 2024-09-12T00:24:59.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.926+0000 7f244a930800 20 add_watcher() i=4 2024-09-12T00:24:59.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.926+0000 7f244a930800 20 add_watcher() i=5 2024-09-12T00:24:59.925 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.926+0000 7f244a930800 20 add_watcher() i=6 2024-09-12T00:24:59.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.927+0000 7f244a930800 20 add_watcher() i=7 2024-09-12T00:24:59.926 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.927+0000 7f244a930800 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:59.927 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.929+0000 7f22fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:59.930 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.930+0000 7f244a930800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:59.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.930+0000 7f244a930800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:59.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.930+0000 7f244a930800 5 note: GC not initialized 2024-09-12T00:24:59.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.930+0000 7f22777fe640 20 reqs_thread_entry: start 2024-09-12T00:24:59.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.930+0000 7f244a930800 20 init_complete bucket index max shards: 1 2024-09-12T00:24:59.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.930+0000 7f244a930800 20 Filter name: none 2024-09-12T00:24:59.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.930+0000 7f22757fa640 20 reqs_thread_entry: start 2024-09-12T00:24:59.931 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.930+0000 7f244a930800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:24:59.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.930+0000 7f244a930800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.931+0000 7f244a930800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:24:59.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.931+0000 7f244a930800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:24:59.932 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.931+0000 7f244a930800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:24:59.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.931+0000 7f244a930800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:24:59.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.931+0000 7f244a930800 20 rados->read ofs=0 len=0 2024-09-12T00:24:59.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.931+0000 7f244a930800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:24:59.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.931+0000 7f244a930800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:24:59.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.931+0000 7f244a930800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:24:59.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.931+0000 7f244a930800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:24:59.933 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.931+0000 7f244a930800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:24:59.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.931+0000 7f244a930800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:24:59.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.931+0000 7f244a930800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:24:59.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.931+0000 7f244a930800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:24:59.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.932+0000 7f244a930800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:24:59.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.932+0000 7f244a930800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:24:59.934 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.932+0000 7f244a930800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:24:59.935 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.932+0000 7f244a930800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:24:59.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.933+0000 7f22fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:59.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.935+0000 7f244a930800 20 remove_watcher() i=0 2024-09-12T00:24:59.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.935+0000 7f244a930800 2 removed watcher, disabling cache 2024-09-12T00:24:59.936 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.936+0000 7f244a930800 20 remove_watcher() i=1 2024-09-12T00:24:59.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.937+0000 7f244a930800 20 remove_watcher() i=2 2024-09-12T00:24:59.937 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.939+0000 7f244a930800 20 remove_watcher() i=3 2024-09-12T00:24:59.938 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.940+0000 7f244a930800 20 remove_watcher() i=4 2024-09-12T00:24:59.939 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.941+0000 7f244a930800 20 remove_watcher() i=5 2024-09-12T00:24:59.940 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.942+0000 7f244a930800 20 remove_watcher() i=6 2024-09-12T00:24:59.941 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:24:59.943+0000 7f244a930800 20 remove_watcher() i=7 2024-09-12T00:24:59.953 INFO:tasks.workunit.client.0.smithi067.stderr:check reshard logrecord successfully 2024-09-12T00:24:59.953 INFO:tasks.workunit.client.0.smithi067.stderr: test: reshard versioned bucket 2024-09-12T00:24:59.954 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:24:59.984 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:59.984 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:00.024 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.025+0000 7ff89aa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.028+0000 7ff89aa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.028+0000 7ff89aa0f800 20 realm 2024-09-12T00:25:00.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.028+0000 7ff89aa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.028+0000 7ff89aa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.026 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.028+0000 7ff89aa0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:00.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.028+0000 7ff89aa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.028+0000 7ff89aa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.028+0000 7ff89aa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.029+0000 7ff89aa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:00.027 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.029+0000 7ff89aa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.030+0000 7ff89aa0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:00.028 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.030+0000 7ff89aa0f800 20 searching for the correct realm 2024-09-12T00:25:00.031 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.033+0000 7ff896993640 0 -- 172.21.15.67:0/723612294 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7ff88c018070 msgr2=0x7ff88c07a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:00.035 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.036+0000 7ff896192640 0 -- 172.21.15.67:0/723612294 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7ff89007e060 msgr2=0x7ff8900a7630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:00.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.040+0000 7ff89aa0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:00.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.040+0000 7ff89aa0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:00.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.040+0000 7ff89aa0f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:00.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.040+0000 7ff89aa0f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:00.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.040+0000 7ff89aa0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:00.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.040+0000 7ff89aa0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:00.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.040+0000 7ff89aa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.039 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.040+0000 7ff89aa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.040+0000 7ff89aa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.041+0000 7ff89aa0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:00.040 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.041+0000 7ff89aa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.041+0000 7ff89aa0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:00.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.041+0000 7ff89aa0f800 20 zone default found 2024-09-12T00:25:00.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.041+0000 7ff89aa0f800 4 Realm: () 2024-09-12T00:25:00.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.041+0000 7ff89aa0f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:00.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.041+0000 7ff89aa0f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:00.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.041+0000 7ff89aa0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:00.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.041+0000 7ff89aa0f800 20 zonegroup default 2024-09-12T00:25:00.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.041+0000 7ff89aa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.041+0000 7ff89aa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.041+0000 7ff89aa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.042+0000 7ff89aa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.042+0000 7ff89aa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.042+0000 7ff89aa0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.042+0000 7ff89aa0f800 20 started sync module instance, tier type = 2024-09-12T00:25:00.042 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.042+0000 7ff89aa0f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:00.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.051+0000 7ff89aa0f800 20 add_watcher() i=0 2024-09-12T00:25:00.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.051+0000 7ff89aa0f800 20 add_watcher() i=1 2024-09-12T00:25:00.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.051+0000 7ff89aa0f800 20 add_watcher() i=2 2024-09-12T00:25:00.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.051+0000 7ff89aa0f800 20 add_watcher() i=3 2024-09-12T00:25:00.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.051+0000 7ff89aa0f800 20 add_watcher() i=4 2024-09-12T00:25:00.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.051+0000 7ff89aa0f800 20 add_watcher() i=5 2024-09-12T00:25:00.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.051+0000 7ff89aa0f800 20 add_watcher() i=6 2024-09-12T00:25:00.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.052+0000 7ff89aa0f800 20 add_watcher() i=7 2024-09-12T00:25:00.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.052+0000 7ff89aa0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:00.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.054+0000 7ff74cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:00.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.054+0000 7ff89aa0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:00.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.054+0000 7ff89aa0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:00.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.054+0000 7ff89aa0f800 5 note: GC not initialized 2024-09-12T00:25:00.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.055+0000 7ff6c77fe640 20 reqs_thread_entry: start 2024-09-12T00:25:00.053 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.055+0000 7ff89aa0f800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:00.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.055+0000 7ff89aa0f800 20 Filter name: none 2024-09-12T00:25:00.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.055+0000 7ff6c57fa640 20 reqs_thread_entry: start 2024-09-12T00:25:00.054 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.055+0000 7ff89aa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.055+0000 7ff89aa0f800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:25:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.055+0000 7ff89aa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.056+0000 7ff89aa0f800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:25:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.056+0000 7ff89aa0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.056+0000 7ff89aa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.056+0000 7ff89aa0f800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:25:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.056+0000 7ff89aa0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.057+0000 7ff89aa0f800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:25:00.055 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.057+0000 7ff89aa0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:00.056 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.058+0000 7ff74cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:00.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.060+0000 7ff89aa0f800 20 remove_watcher() i=0 2024-09-12T00:25:00.058 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.060+0000 7ff89aa0f800 2 removed watcher, disabling cache 2024-09-12T00:25:00.059 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.061+0000 7ff89aa0f800 20 remove_watcher() i=1 2024-09-12T00:25:00.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.062+0000 7ff89aa0f800 20 remove_watcher() i=2 2024-09-12T00:25:00.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.063+0000 7ff89aa0f800 20 remove_watcher() i=3 2024-09-12T00:25:00.062 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.064+0000 7ff89aa0f800 20 remove_watcher() i=4 2024-09-12T00:25:00.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.065+0000 7ff89aa0f800 20 remove_watcher() i=5 2024-09-12T00:25:00.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.066+0000 7ff89aa0f800 20 remove_watcher() i=6 2024-09-12T00:25:00.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.067+0000 7ff89aa0f800 20 remove_watcher() i=7 2024-09-12T00:25:00.076 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:25:00.076 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:25:00.076 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: myver id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T00:25:00.077 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:25:00.078 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-09-12T00:25:00.109 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:00.109 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:00.149 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.150+0000 7f5a9d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.152+0000 7f5a9d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.152+0000 7f5a9d62f800 20 realm 2024-09-12T00:25:00.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.152+0000 7f5a9d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.152+0000 7f5a9d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.152+0000 7f5a9d62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:00.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.152+0000 7f5a9d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.153+0000 7f5a9d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.151 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.153+0000 7f5a9d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.153+0000 7f5a9d62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:00.152 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.153+0000 7f5a9d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.154+0000 7f5a9d62f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:00.153 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.154+0000 7f5a9d62f800 20 searching for the correct realm 2024-09-12T00:25:00.154 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.156+0000 7f5a9b119640 0 -- 172.21.15.67:0/482595868 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f5a8c050070 msgr2=0x7f5a8c050960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:00.359 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.361+0000 7f5a9b119640 0 -- 172.21.15.67:0/482595868 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x55987e8e4620 msgr2=0x7f5a94070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:00.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.568+0000 7f5a9d62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:00.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.568+0000 7f5a9d62f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:00.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.568+0000 7f5a9d62f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:00.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.568+0000 7f5a9d62f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:00.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.568+0000 7f5a9d62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:00.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.568+0000 7f5a9d62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:00.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.568+0000 7f5a9d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.568+0000 7f5a9d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.567 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.568+0000 7f5a9d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.569+0000 7f5a9d62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:00.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.569+0000 7f5a9d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.569+0000 7f5a9d62f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:00.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.569+0000 7f5a9d62f800 20 zone default found 2024-09-12T00:25:00.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.569+0000 7f5a9d62f800 4 Realm: () 2024-09-12T00:25:00.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.569+0000 7f5a9d62f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:00.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.569+0000 7f5a9d62f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:00.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.569+0000 7f5a9d62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:00.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.569+0000 7f5a9d62f800 20 zonegroup default 2024-09-12T00:25:00.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.569+0000 7f5a9d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.569+0000 7f5a9d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.569+0000 7f5a9d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.569+0000 7f5a9d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.569+0000 7f5a9d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.569 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.570+0000 7f5a9d62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.570+0000 7f5a9d62f800 20 started sync module instance, tier type = 2024-09-12T00:25:00.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.570+0000 7f5a9d62f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:00.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.580+0000 7f5a9d62f800 20 add_watcher() i=0 2024-09-12T00:25:00.578 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.580+0000 7f5a9d62f800 20 add_watcher() i=1 2024-09-12T00:25:00.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.580+0000 7f5a9d62f800 20 add_watcher() i=2 2024-09-12T00:25:00.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.580+0000 7f5a9d62f800 20 add_watcher() i=3 2024-09-12T00:25:00.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.580+0000 7f5a9d62f800 20 add_watcher() i=4 2024-09-12T00:25:00.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.580+0000 7f5a9d62f800 20 add_watcher() i=5 2024-09-12T00:25:00.579 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.580+0000 7f5a9d62f800 20 add_watcher() i=6 2024-09-12T00:25:00.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.581+0000 7f5a9d62f800 20 add_watcher() i=7 2024-09-12T00:25:00.580 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.581+0000 7f5a9d62f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:00.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.583+0000 7f5951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:00.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.583+0000 7f5a9d62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:00.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.583+0000 7f5a9d62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:00.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.583+0000 7f5a9d62f800 5 note: GC not initialized 2024-09-12T00:25:00.582 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.584+0000 7f5950fe1640 20 reqs_thread_entry: start 2024-09-12T00:25:00.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.584+0000 7f5a9d62f800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:00.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.584+0000 7f5a9d62f800 20 Filter name: none 2024-09-12T00:25:00.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.584+0000 7f58ca7fc640 20 reqs_thread_entry: start 2024-09-12T00:25:00.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.584+0000 7f5a9d62f800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:25:00.583 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.584+0000 7f5a9d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.584+0000 7f5a9d62f800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:25:00.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.584+0000 7f5a9d62f800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:25:00.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.584+0000 7f5a9d62f800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:25:00.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.584+0000 7f5a9d62f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 : miss 2024-09-12T00:25:00.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.584+0000 7f5a9d62f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.585+0000 7f5a9d62f800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:25:00.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.585+0000 7f5a9d62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:00.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.585+0000 7f5a9d62f800 10 adding default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:00.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.585+0000 7f5a9d62f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:00.584 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.585+0000 7f5a9d62f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:00.585 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.585+0000 7f5a9d62f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 2024-09-12T00:25:00.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.589+0000 7f5a9d62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:00.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.589+0000 7f5a9d62f800 10 moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:00.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.589+0000 7f5a9d62f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:00.587 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.589+0000 7f5a9d62f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18, ofs0, ns] 2024-09-12T00:25:00.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.589+0000 7f597effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562451 cookie 94113449009200 notifier 8493 bl.length()=821 2024-09-12T00:25:00.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.589+0000 7f597effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:00.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.589+0000 7f597effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:00.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.589+0000 7f597effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:00.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.590+0000 7f5a9d62f800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_sources= new_sources= 2024-09-12T00:25:00.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.590+0000 7f5a9d62f800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential sources added=[] removed=[] 2024-09-12T00:25:00.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.590+0000 7f5a9d62f800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_dests= new_dests= 2024-09-12T00:25:00.588 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.590+0000 7f5a9d62f800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential dests added=[] removed=[] 2024-09-12T00:25:00.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.592+0000 7f5a9d62f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.1.0 2024-09-12T00:25:00.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.592+0000 7f5a9d62f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.1.0 2024-09-12T00:25:00.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.592+0000 7f5a9d62f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.1.1 2024-09-12T00:25:00.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.592+0000 7f5a9d62f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.1.1 2024-09-12T00:25:00.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.592+0000 7f5a9d62f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.0 2024-09-12T00:25:00.590 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.592+0000 7f5a9d62f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:00.591 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.592+0000 7f5a9d62f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 2024-09-12T00:25:00.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.594+0000 7f5a9d62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:00.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.594+0000 7f5a9d62f800 10 moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:00.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.594+0000 7f5a9d62f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:00.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.594+0000 7f5a9d62f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18, ofs0, ns] 2024-09-12T00:25:00.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.594+0000 7f597effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562452 cookie 94113449009200 notifier 8493 bl.length()=821 2024-09-12T00:25:00.592 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.594+0000 7f597effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:00.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.594+0000 7f597effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:00.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.594+0000 7f597effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:00.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.594+0000 7f5a9d62f800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_sources= new_sources= 2024-09-12T00:25:00.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.594+0000 7f5a9d62f800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential sources added=[] removed=[] 2024-09-12T00:25:00.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.594+0000 7f5a9d62f800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_dests= new_dests= 2024-09-12T00:25:00.593 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.594+0000 7f5a9d62f800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential dests added=[] removed=[] 2024-09-12T00:25:00.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.595+0000 7f5a9d62f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.0 2024-09-12T00:25:00.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.595+0000 7f5a9d62f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:00.594 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.595+0000 7f5a9d62f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 2024-09-12T00:25:00.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.597+0000 7f5a9d62f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:00.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.597+0000 7f5a9d62f800 10 moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:00.595 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.597+0000 7f5a9d62f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:00.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.597+0000 7f5a9d62f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18, ofs0, ns] 2024-09-12T00:25:00.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.597+0000 7f597e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562453 cookie 94113449009200 notifier 8493 bl.length()=789 2024-09-12T00:25:00.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.597+0000 7f597e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:00.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.597+0000 7f597e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:00.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.597+0000 7f597e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:00.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.598+0000 7f5a9d62f800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_sources= new_sources= 2024-09-12T00:25:00.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.598+0000 7f5a9d62f800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential sources added=[] removed=[] 2024-09-12T00:25:00.596 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.598+0000 7f5a9d62f800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_dests= new_dests= 2024-09-12T00:25:00.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.598+0000 7f5a9d62f800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential dests added=[] removed=[] 2024-09-12T00:25:00.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.599+0000 7f5a9d62f800 1 execute INFO: reshard of bucket "myver" from 1 shards to 2 shards completed successfully 2024-09-12T00:25:00.599 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.601+0000 7f5951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:00.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.603+0000 7f5a9d62f800 20 remove_watcher() i=0 2024-09-12T00:25:00.601 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.603+0000 7f5a9d62f800 2 removed watcher, disabling cache 2024-09-12T00:25:00.602 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.604+0000 7f5a9d62f800 20 remove_watcher() i=1 2024-09-12T00:25:00.604 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.605+0000 7f5a9d62f800 20 remove_watcher() i=2 2024-09-12T00:25:00.605 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.607+0000 7f5a9d62f800 20 remove_watcher() i=3 2024-09-12T00:25:00.606 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.608+0000 7f5a9d62f800 20 remove_watcher() i=4 2024-09-12T00:25:00.607 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.609+0000 7f5a9d62f800 20 remove_watcher() i=5 2024-09-12T00:25:00.609 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.610+0000 7f5a9d62f800 20 remove_watcher() i=6 2024-09-12T00:25:00.610 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.612+0000 7f5a9d62f800 20 remove_watcher() i=7 2024-09-12T00:25:00.622 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:25:00.651 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:00.651 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:00.893 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.895+0000 7f15a8535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.897+0000 7f15a8535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.897+0000 7f15a8535800 20 realm 2024-09-12T00:25:00.895 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.897+0000 7f15a8535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.898+0000 7f15a8535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.898+0000 7f15a8535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:00.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.898+0000 7f15a8535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.898+0000 7f15a8535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:00.896 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.898+0000 7f15a8535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.898+0000 7f15a8535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:00.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.898+0000 7f15a8535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:00.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.899+0000 7f15a8535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:00.897 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.900+0000 7f15a8535800 20 searching for the correct realm 2024-09-12T00:25:00.901 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:00.903+0000 7f15a3ae3640 0 -- 172.21.15.67:0/647098229 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f15980e06e0 msgr2=0x7f15980e64c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:01.107 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.108+0000 7f15a42e4640 0 -- 172.21.15.67:0/647098229 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f159c039040 msgr2=0x7f159c038920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:01.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.316+0000 7f15a8535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:01.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.316+0000 7f15a8535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:01.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.316+0000 7f15a8535800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:01.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.316+0000 7f15a8535800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:01.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.316+0000 7f15a8535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:01.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.316+0000 7f15a8535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:01.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.316+0000 7f15a8535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.316+0000 7f15a8535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.316+0000 7f15a8535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.317+0000 7f15a8535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:01.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.317+0000 7f15a8535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.317+0000 7f15a8535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:01.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.317+0000 7f15a8535800 20 zone default found 2024-09-12T00:25:01.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.317+0000 7f15a8535800 4 Realm: () 2024-09-12T00:25:01.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.317+0000 7f15a8535800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:01.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.317+0000 7f15a8535800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:01.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.317+0000 7f15a8535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:01.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.317+0000 7f15a8535800 20 zonegroup default 2024-09-12T00:25:01.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.317+0000 7f15a8535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.317+0000 7f15a8535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.317+0000 7f15a8535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.317+0000 7f15a8535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.317+0000 7f15a8535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.318+0000 7f15a8535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.318+0000 7f15a8535800 20 started sync module instance, tier type = 2024-09-12T00:25:01.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.318+0000 7f15a8535800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:01.326 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.328+0000 7f15a8535800 20 add_watcher() i=0 2024-09-12T00:25:01.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.328+0000 7f15a8535800 20 add_watcher() i=1 2024-09-12T00:25:01.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.328+0000 7f15a8535800 20 add_watcher() i=2 2024-09-12T00:25:01.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.328+0000 7f15a8535800 20 add_watcher() i=3 2024-09-12T00:25:01.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.328+0000 7f15a8535800 20 add_watcher() i=4 2024-09-12T00:25:01.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.328+0000 7f15a8535800 20 add_watcher() i=5 2024-09-12T00:25:01.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.328+0000 7f15a8535800 20 add_watcher() i=6 2024-09-12T00:25:01.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.329+0000 7f15a8535800 20 add_watcher() i=7 2024-09-12T00:25:01.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.329+0000 7f15a8535800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:01.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.332+0000 7f145afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:01.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.332+0000 7f15a8535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:01.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.332+0000 7f15a8535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:01.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.332+0000 7f15a8535800 5 note: GC not initialized 2024-09-12T00:25:01.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.333+0000 7f1459fdb640 20 reqs_thread_entry: start 2024-09-12T00:25:01.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.333+0000 7f15a8535800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:01.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.333+0000 7f15a8535800 20 Filter name: none 2024-09-12T00:25:01.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.333+0000 7f13cb7fe640 20 reqs_thread_entry: start 2024-09-12T00:25:01.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.333+0000 7f15a8535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.333+0000 7f15a8535800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:25:01.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.333+0000 7f15a8535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.334+0000 7f15a8535800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:25:01.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.334+0000 7f15a8535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:01.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.334+0000 7f15a8535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.335+0000 7f15a8535800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:25:01.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.335+0000 7f15a8535800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.335+0000 7f15a8535800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:25:01.334 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.335+0000 7f15a8535800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:01.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.337+0000 7f145afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:01.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.340+0000 7f15a8535800 20 remove_watcher() i=0 2024-09-12T00:25:01.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.340+0000 7f15a8535800 2 removed watcher, disabling cache 2024-09-12T00:25:01.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.341+0000 7f15a8535800 20 remove_watcher() i=1 2024-09-12T00:25:01.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.342+0000 7f15a8535800 20 remove_watcher() i=2 2024-09-12T00:25:01.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.343+0000 7f15a8535800 20 remove_watcher() i=3 2024-09-12T00:25:01.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.344+0000 7f15a8535800 20 remove_watcher() i=4 2024-09-12T00:25:01.343 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.345+0000 7f15a8535800 20 remove_watcher() i=5 2024-09-12T00:25:01.344 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.346+0000 7f15a8535800 20 remove_watcher() i=6 2024-09-12T00:25:01.346 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.347+0000 7f15a8535800 20 remove_watcher() i=7 2024-09-12T00:25:01.357 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:25:01.357 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:25:01.357 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: myver id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:25:01.357 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:25:01.405 INFO:tasks.workunit.client.0.smithi067.stderr: test: reshard removes olh entries with empty name 2024-09-12T00:25:01.499 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:25:01.528 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:01.528 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:01.568 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.570+0000 7f6b3ba15800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.572+0000 7f6b3ba15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.572+0000 7f6b3ba15800 20 realm 2024-09-12T00:25:01.570 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.572+0000 7f6b3ba15800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.572+0000 7f6b3ba15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.572+0000 7f6b3ba15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:01.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.572+0000 7f6b3ba15800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.572+0000 7f6b3ba15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.572+0000 7f6b3ba15800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.573+0000 7f6b3ba15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:01.571 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.573+0000 7f6b3ba15800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.574+0000 7f6b3ba15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:01.572 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.574+0000 7f6b3ba15800 20 searching for the correct realm 2024-09-12T00:25:01.573 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.575+0000 7f6b37192640 0 -- 172.21.15.67:0/3518021141 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f6b28048910 msgr2=0x7f6b280463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:01.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.781+0000 7f6b37192640 0 -- 172.21.15.67:0/3518021141 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f6b30074040 msgr2=0x7f6b30055410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:01.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.989+0000 7f6b3ba15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:01.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.989+0000 7f6b3ba15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:01.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.989+0000 7f6b3ba15800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:01.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.989+0000 7f6b3ba15800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:01.987 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.989+0000 7f6b3ba15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:01.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.989+0000 7f6b3ba15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:01.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.989+0000 7f6b3ba15800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.989+0000 7f6b3ba15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.988 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.989+0000 7f6b3ba15800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.989+0000 7f6b3ba15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:01.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.989+0000 7f6b3ba15800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.990+0000 7f6b3ba15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:01.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.990+0000 7f6b3ba15800 20 zone default found 2024-09-12T00:25:01.989 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.990+0000 7f6b3ba15800 4 Realm: () 2024-09-12T00:25:01.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.990+0000 7f6b3ba15800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:01.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.990+0000 7f6b3ba15800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:01.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.990+0000 7f6b3ba15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:01.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.990+0000 7f6b3ba15800 20 zonegroup default 2024-09-12T00:25:01.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.990+0000 7f6b3ba15800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.990+0000 7f6b3ba15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.990+0000 7f6b3ba15800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.991+0000 7f6b3ba15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.991+0000 7f6b3ba15800 20 rados->read ofs=0 len=0 2024-09-12T00:25:01.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.991+0000 7f6b3ba15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:01.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.991+0000 7f6b3ba15800 20 started sync module instance, tier type = 2024-09-12T00:25:01.990 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:01.991+0000 7f6b3ba15800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:01.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.001+0000 7f6b3ba15800 20 add_watcher() i=0 2024-09-12T00:25:01.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.001+0000 7f6b3ba15800 20 add_watcher() i=1 2024-09-12T00:25:01.999 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.001+0000 7f6b3ba15800 20 add_watcher() i=2 2024-09-12T00:25:02.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.001+0000 7f6b3ba15800 20 add_watcher() i=3 2024-09-12T00:25:02.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.001+0000 7f6b3ba15800 20 add_watcher() i=4 2024-09-12T00:25:02.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.001+0000 7f6b3ba15800 20 add_watcher() i=5 2024-09-12T00:25:02.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.001+0000 7f6b3ba15800 20 add_watcher() i=6 2024-09-12T00:25:02.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.002+0000 7f6b3ba15800 20 add_watcher() i=7 2024-09-12T00:25:02.000 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.002+0000 7f6b3ba15800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:02.002 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.004+0000 7f69edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:02.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.004+0000 7f6b3ba15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:02.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.004+0000 7f6b3ba15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:02.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.004+0000 7f6b3ba15800 5 note: GC not initialized 2024-09-12T00:25:02.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.005+0000 7f69ecfe1640 20 reqs_thread_entry: start 2024-09-12T00:25:02.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.005+0000 7f6b3ba15800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:02.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.005+0000 7f6b3ba15800 20 Filter name: none 2024-09-12T00:25:02.003 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.005+0000 7f69667fc640 20 reqs_thread_entry: start 2024-09-12T00:25:02.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.005+0000 7f6b3ba15800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.005+0000 7f6b3ba15800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:25:02.004 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.005+0000 7f6b3ba15800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.006+0000 7f6b3ba15800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:25:02.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.006+0000 7f6b3ba15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:02.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.006+0000 7f6b3ba15800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.006+0000 7f6b3ba15800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:25:02.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.006+0000 7f6b3ba15800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.007+0000 7f6b3ba15800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:25:02.005 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.007+0000 7f6b3ba15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:02.006 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.008+0000 7f69edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:02.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.011+0000 7f6b3ba15800 20 remove_watcher() i=0 2024-09-12T00:25:02.009 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.011+0000 7f6b3ba15800 2 removed watcher, disabling cache 2024-09-12T00:25:02.010 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.012+0000 7f6b3ba15800 20 remove_watcher() i=1 2024-09-12T00:25:02.011 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.013+0000 7f6b3ba15800 20 remove_watcher() i=2 2024-09-12T00:25:02.012 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.014+0000 7f6b3ba15800 20 remove_watcher() i=3 2024-09-12T00:25:02.013 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.015+0000 7f6b3ba15800 20 remove_watcher() i=4 2024-09-12T00:25:02.014 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.016+0000 7f6b3ba15800 20 remove_watcher() i=5 2024-09-12T00:25:02.015 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.017+0000 7f6b3ba15800 20 remove_watcher() i=6 2024-09-12T00:25:02.016 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.018+0000 7f6b3ba15800 20 remove_watcher() i=7 2024-09-12T00:25:02.027 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:25:02.027 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:25:02.027 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: a-bucket id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 num_objects: 0 size_kb: 0 num_shards: 3 2024-09-12T00:25:02.027 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:25:02.029 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T00:25:02.059 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:02.059 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:02.098 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.100+0000 7f5716728800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.102+0000 7f5716728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.102+0000 7f5716728800 20 realm 2024-09-12T00:25:02.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.102+0000 7f5716728800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.102+0000 7f5716728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.102+0000 7f5716728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:02.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.102+0000 7f5716728800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.103+0000 7f5716728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.101 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.103+0000 7f5716728800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.103+0000 7f5716728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:02.102 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.103+0000 7f5716728800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.104+0000 7f5716728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:02.103 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.104+0000 7f5716728800 20 searching for the correct realm 2024-09-12T00:25:02.105 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.107+0000 7f5711c6e640 0 -- 172.21.15.67:0/730545138 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f570806b680 msgr2=0x7f57080697f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:02.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.313+0000 7f5712c70640 0 -- 172.21.15.67:0/730545138 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55a46561c930 msgr2=0x55a46561ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:02.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.317+0000 7f5716728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:02.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.317+0000 7f5716728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:02.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.317+0000 7f5716728800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:02.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.317+0000 7f5716728800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:02.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.317+0000 7f5716728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:02.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.317+0000 7f5716728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:02.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.317+0000 7f5716728800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.317+0000 7f5716728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.316 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.317+0000 7f5716728800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.317+0000 7f5716728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:02.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.317+0000 7f5716728800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.318+0000 7f5716728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:02.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.318+0000 7f5716728800 20 zone default found 2024-09-12T00:25:02.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.318+0000 7f5716728800 4 Realm: () 2024-09-12T00:25:02.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.318+0000 7f5716728800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:02.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.318+0000 7f5716728800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:02.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.318+0000 7f5716728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:02.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.318+0000 7f5716728800 20 zonegroup default 2024-09-12T00:25:02.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.318+0000 7f5716728800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.318+0000 7f5716728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.318+0000 7f5716728800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.318+0000 7f5716728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.318+0000 7f5716728800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.319+0000 7f5716728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.319+0000 7f5716728800 20 started sync module instance, tier type = 2024-09-12T00:25:02.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.319+0000 7f5716728800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:02.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.329+0000 7f5716728800 20 add_watcher() i=0 2024-09-12T00:25:02.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.329+0000 7f5716728800 20 add_watcher() i=1 2024-09-12T00:25:02.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.329+0000 7f5716728800 20 add_watcher() i=2 2024-09-12T00:25:02.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.329+0000 7f5716728800 20 add_watcher() i=3 2024-09-12T00:25:02.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.329+0000 7f5716728800 20 add_watcher() i=4 2024-09-12T00:25:02.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.329+0000 7f5716728800 20 add_watcher() i=5 2024-09-12T00:25:02.327 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.329+0000 7f5716728800 20 add_watcher() i=6 2024-09-12T00:25:02.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.330+0000 7f5716728800 20 add_watcher() i=7 2024-09-12T00:25:02.328 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.330+0000 7f5716728800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:02.330 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.332+0000 7f55c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:02.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.332+0000 7f5716728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:02.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.332+0000 7f5716728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:02.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.332+0000 7f5716728800 5 note: GC not initialized 2024-09-12T00:25:02.331 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.332+0000 7f55437fe640 20 reqs_thread_entry: start 2024-09-12T00:25:02.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.333+0000 7f5716728800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:02.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.333+0000 7f5716728800 20 Filter name: none 2024-09-12T00:25:02.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.333+0000 7f55417fa640 20 reqs_thread_entry: start 2024-09-12T00:25:02.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.333+0000 7f5716728800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.333+0000 7f5716728800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:25:02.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.333+0000 7f5716728800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.332 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.334+0000 7f5716728800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:25:02.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.334+0000 7f5716728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:02.333 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.334+0000 7f55c8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:02.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.337+0000 7f5716728800 20 remove_watcher() i=0 2024-09-12T00:25:02.335 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.337+0000 7f5716728800 2 removed watcher, disabling cache 2024-09-12T00:25:02.336 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.338+0000 7f5716728800 20 remove_watcher() i=1 2024-09-12T00:25:02.337 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.339+0000 7f5716728800 20 remove_watcher() i=2 2024-09-12T00:25:02.338 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.340+0000 7f5716728800 20 remove_watcher() i=3 2024-09-12T00:25:02.339 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.341+0000 7f5716728800 20 remove_watcher() i=4 2024-09-12T00:25:02.340 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.342+0000 7f5716728800 20 remove_watcher() i=5 2024-09-12T00:25:02.341 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.343+0000 7f5716728800 20 remove_watcher() i=6 2024-09-12T00:25:02.342 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.344+0000 7f5716728800 20 remove_watcher() i=7 2024-09-12T00:25:02.355 INFO:tasks.workunit.client.0.smithi067.stderr:rados -p default.rgw.buckets.index setomapval .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T00:25:02.381 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:02.381 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:02.399 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:25:02.428 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:02.428 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:02.467 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.469+0000 7fb08dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.471+0000 7fb08dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.471+0000 7fb08dbaf800 20 realm 2024-09-12T00:25:02.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.471+0000 7fb08dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.472+0000 7fb08dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.472+0000 7fb08dbaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:02.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.472+0000 7fb08dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.472+0000 7fb08dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.470 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.472+0000 7fb08dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.472+0000 7fb08dbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:02.471 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.472+0000 7fb08dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.474+0000 7fb08dbaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:02.472 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.474+0000 7fb08dbaf800 20 searching for the correct realm 2024-09-12T00:25:02.474 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.476+0000 7fb08ae98640 0 -- 172.21.15.67:0/962717677 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fb0800af960 msgr2=0x7fb0800dc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:02.680 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.682+0000 7fb08be9a640 0 -- 172.21.15.67:0/962717677 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55b573a68860 msgr2=0x55b573a6ac50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:02.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.686+0000 7fb08dbaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:02.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.686+0000 7fb08dbaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:02.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.686+0000 7fb08dbaf800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:02.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.686+0000 7fb08dbaf800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:02.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.686+0000 7fb08dbaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:02.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.686+0000 7fb08dbaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:02.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.686+0000 7fb08dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.685 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.687+0000 7fb08dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.686 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.687+0000 7fb08dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.687+0000 7fb08dbaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:02.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.687+0000 7fb08dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.687+0000 7fb08dbaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:02.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.687+0000 7fb08dbaf800 20 zone default found 2024-09-12T00:25:02.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.687+0000 7fb08dbaf800 4 Realm: () 2024-09-12T00:25:02.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.687+0000 7fb08dbaf800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:02.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.687+0000 7fb08dbaf800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:02.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.687+0000 7fb08dbaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:02.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.687+0000 7fb08dbaf800 20 zonegroup default 2024-09-12T00:25:02.687 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.687+0000 7fb08dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.688+0000 7fb08dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.688+0000 7fb08dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.688+0000 7fb08dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.688+0000 7fb08dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.688+0000 7fb08dbaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.688+0000 7fb08dbaf800 20 started sync module instance, tier type = 2024-09-12T00:25:02.688 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.688+0000 7fb08dbaf800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:02.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.698+0000 7fb08dbaf800 20 add_watcher() i=0 2024-09-12T00:25:02.696 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.698+0000 7fb08dbaf800 20 add_watcher() i=1 2024-09-12T00:25:02.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.698+0000 7fb08dbaf800 20 add_watcher() i=2 2024-09-12T00:25:02.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.698+0000 7fb08dbaf800 20 add_watcher() i=3 2024-09-12T00:25:02.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.698+0000 7fb08dbaf800 20 add_watcher() i=4 2024-09-12T00:25:02.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.698+0000 7fb08dbaf800 20 add_watcher() i=5 2024-09-12T00:25:02.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.698+0000 7fb08dbaf800 20 add_watcher() i=6 2024-09-12T00:25:02.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.699+0000 7fb08dbaf800 20 add_watcher() i=7 2024-09-12T00:25:02.697 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.699+0000 7fb08dbaf800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:02.699 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.701+0000 7faf41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:02.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.702+0000 7fb08dbaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:02.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.702+0000 7fb08dbaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:02.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.702+0000 7fb08dbaf800 5 note: GC not initialized 2024-09-12T00:25:02.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.702+0000 7faf40fe1640 20 reqs_thread_entry: start 2024-09-12T00:25:02.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.702+0000 7fb08dbaf800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:02.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.702+0000 7fb08dbaf800 20 Filter name: none 2024-09-12T00:25:02.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.702+0000 7faeba7fc640 20 reqs_thread_entry: start 2024-09-12T00:25:02.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.702+0000 7fb08dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.703+0000 7fb08dbaf800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:25:02.701 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.703+0000 7fb08dbaf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.703+0000 7fb08dbaf800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:25:02.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.703+0000 7fb08dbaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:02.702 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.703+0000 7fb08dbaf800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:25:02.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.703+0000 7fb08dbaf800 20 INFO: main: starting shard=0 2024-09-12T00:25:02.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.703+0000 7fb08dbaf800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:25:02.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.703+0000 7fb08dbaf800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:25:02.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.704+0000 7fb08dbaf800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:25:02.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.704+0000 7fb08dbaf800 20 INFO: main: starting shard=1 2024-09-12T00:25:02.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.704+0000 7fb08dbaf800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:25:02.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.704+0000 7fb08dbaf800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:25:02.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.704+0000 7fb08dbaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:25:02.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.704+0000 7fb08dbaf800 20 INFO: main: starting shard=2 2024-09-12T00:25:02.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.704+0000 7fb08dbaf800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:25:02.703 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.704+0000 7fb08dbaf800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:25:02.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.705+0000 7fb08dbaf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:25:02.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.705+0000 7fb08dbaf800 20 INFO: main: done 2024-09-12T00:25:02.704 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.706+0000 7faf41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:02.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.709+0000 7fb08dbaf800 20 remove_watcher() i=0 2024-09-12T00:25:02.707 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.709+0000 7fb08dbaf800 2 removed watcher, disabling cache 2024-09-12T00:25:02.708 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.710+0000 7fb08dbaf800 20 remove_watcher() i=1 2024-09-12T00:25:02.709 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.711+0000 7fb08dbaf800 20 remove_watcher() i=2 2024-09-12T00:25:02.710 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.712+0000 7fb08dbaf800 20 remove_watcher() i=3 2024-09-12T00:25:02.711 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.713+0000 7fb08dbaf800 20 remove_watcher() i=4 2024-09-12T00:25:02.712 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.714+0000 7fb08dbaf800 20 remove_watcher() i=5 2024-09-12T00:25:02.713 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.715+0000 7fb08dbaf800 20 remove_watcher() i=6 2024-09-12T00:25:02.714 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.716+0000 7fb08dbaf800 20 remove_watcher() i=7 2024-09-12T00:25:02.728 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T00:25:02.760 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:02.760 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:02.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.802+0000 7fc635232800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.804+0000 7fc635232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.804+0000 7fc635232800 20 realm 2024-09-12T00:25:02.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.804+0000 7fc635232800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.804+0000 7fc635232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.804+0000 7fc635232800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:02.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.804+0000 7fc635232800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.803 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.804+0000 7fc635232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.804+0000 7fc635232800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.805+0000 7fc635232800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:02.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.805+0000 7fc635232800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.806+0000 7fc635232800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:02.804 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.806+0000 7fc635232800 20 searching for the correct realm 2024-09-12T00:25:02.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.810+0000 7fc62fdcb640 0 -- 172.21.15.67:0/668221078 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fc6240ba0f0 msgr2=0x7fc624091f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:02.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.813+0000 7fc630dcd640 0 -- 172.21.15.67:0/668221078 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5607391a0550 msgr2=0x5607391a2980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:02.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.817+0000 7fc635232800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:02.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.817+0000 7fc635232800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:02.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.817+0000 7fc635232800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:02.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.817+0000 7fc635232800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:02.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.817+0000 7fc635232800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:02.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.817+0000 7fc635232800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:02.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.817+0000 7fc635232800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.818+0000 7fc635232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.818+0000 7fc635232800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.818+0000 7fc635232800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:02.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.818+0000 7fc635232800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.818+0000 7fc635232800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:02.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.818+0000 7fc635232800 20 zone default found 2024-09-12T00:25:02.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.818+0000 7fc635232800 4 Realm: () 2024-09-12T00:25:02.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.818+0000 7fc635232800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:02.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.818+0000 7fc635232800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:02.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.818+0000 7fc635232800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:02.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.818+0000 7fc635232800 20 zonegroup default 2024-09-12T00:25:02.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.818+0000 7fc635232800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.818 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.819+0000 7fc635232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.819+0000 7fc635232800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.819+0000 7fc635232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.819+0000 7fc635232800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.819+0000 7fc635232800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.819+0000 7fc635232800 20 started sync module instance, tier type = 2024-09-12T00:25:02.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.819+0000 7fc635232800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:02.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.829+0000 7fc635232800 20 add_watcher() i=0 2024-09-12T00:25:02.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.829+0000 7fc635232800 20 add_watcher() i=1 2024-09-12T00:25:02.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.829+0000 7fc635232800 20 add_watcher() i=2 2024-09-12T00:25:02.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.829+0000 7fc635232800 20 add_watcher() i=3 2024-09-12T00:25:02.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.829+0000 7fc635232800 20 add_watcher() i=4 2024-09-12T00:25:02.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.829+0000 7fc635232800 20 add_watcher() i=5 2024-09-12T00:25:02.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.829+0000 7fc635232800 20 add_watcher() i=6 2024-09-12T00:25:02.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.830+0000 7fc635232800 20 add_watcher() i=7 2024-09-12T00:25:02.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.830+0000 7fc635232800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:02.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.831+0000 7fc4e6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:02.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.832+0000 7fc635232800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:02.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.832+0000 7fc635232800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:02.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.832+0000 7fc635232800 5 note: GC not initialized 2024-09-12T00:25:02.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.832+0000 7fc4e5fdb640 20 reqs_thread_entry: start 2024-09-12T00:25:02.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.832+0000 7fc635232800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:02.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.832+0000 7fc635232800 20 Filter name: none 2024-09-12T00:25:02.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.832+0000 7fc4577fe640 20 reqs_thread_entry: start 2024-09-12T00:25:02.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.832+0000 7fc635232800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:25:02.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.832+0000 7fc635232800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.833+0000 7fc635232800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:25:02.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.833+0000 7fc635232800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:25:02.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.833+0000 7fc635232800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:25:02.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.833+0000 7fc635232800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : miss 2024-09-12T00:25:02.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.833+0000 7fc635232800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.833+0000 7fc635232800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:25:02.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.833+0000 7fc635232800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:25:02.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.833+0000 7fc635232800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:25:02.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.833+0000 7fc635232800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:02.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.833+0000 7fc635232800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:02.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.833+0000 7fc635232800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:25:02.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.837+0000 7fc635232800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:25:02.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.837+0000 7fc635232800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:25:02.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.837+0000 7fc635232800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:02.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.837+0000 7fc635232800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:25:02.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.838+0000 7fc506ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562486 cookie 94589022835744 notifier 8006 bl.length()=827 2024-09-12T00:25:02.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.838+0000 7fc506ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:25:02.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.838+0000 7fc506ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:25:02.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.838+0000 7fc506ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:02.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.838+0000 7fc635232800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:25:02.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.838+0000 7fc635232800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:25:02.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.838+0000 7fc635232800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:25:02.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.838+0000 7fc635232800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:25:02.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.841+0000 7fc635232800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.0 2024-09-12T00:25:02.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.841+0000 7fc635232800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.0 2024-09-12T00:25:02.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.841+0000 7fc635232800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:25:02.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.841+0000 7fc635232800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:25:02.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.841+0000 7fc635232800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T00:25:02.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.841+0000 7fc635232800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:25:02.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.841+0000 7fc635232800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:25:02.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.842+0000 7fc635232800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:25:02.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.842+0000 7fc635232800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:25:02.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.842+0000 7fc635232800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:02.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.842+0000 7fc635232800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:25:02.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.844+0000 7fc635232800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:25:02.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.844+0000 7fc635232800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:25:02.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.844+0000 7fc635232800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:02.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.844+0000 7fc635232800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:25:02.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.844+0000 7fc506ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562487 cookie 94589022835744 notifier 8006 bl.length()=827 2024-09-12T00:25:02.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.844+0000 7fc506ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:25:02.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.844+0000 7fc506ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:25:02.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.844+0000 7fc506ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:02.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.844+0000 7fc635232800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:25:02.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.844+0000 7fc635232800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:25:02.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.844+0000 7fc635232800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:25:02.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.844+0000 7fc635232800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:25:02.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.846+0000 7fc635232800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:25:02.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.846+0000 7fc635232800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.0 2024-09-12T00:25:02.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.846+0000 7fc635232800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:25:02.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.846+0000 7fc635232800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.1 2024-09-12T00:25:02.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.846+0000 7fc635232800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:25:02.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.846+0000 7fc635232800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.2.2 2024-09-12T00:25:02.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.847+0000 7fc635232800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:02.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.847+0000 7fc635232800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 2024-09-12T00:25:02.846 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.848+0000 7fc635232800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:25:02.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.848+0000 7fc635232800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:25:02.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.848+0000 7fc635232800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:02.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.848+0000 7fc635232800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17, ofs0, ns] 2024-09-12T00:25:02.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.849+0000 7fc5077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562488 cookie 94589022835744 notifier 8006 bl.length()=795 2024-09-12T00:25:02.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.849+0000 7fc5077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 info.flags=0x17 2024-09-12T00:25:02.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.849+0000 7fc5077fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17 to cache LRU end 2024-09-12T00:25:02.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.849+0000 7fc5077fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:02.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.849+0000 7fc635232800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_sources= new_sources= 2024-09-12T00:25:02.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.849+0000 7fc635232800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential sources added=[] removed=[] 2024-09-12T00:25:02.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.849+0000 7fc635232800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): orig_dests= new_dests= 2024-09-12T00:25:02.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.849+0000 7fc635232800 20 handle_bi_update(): bucket=:a-bucket[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17]): potential dests added=[] removed=[] 2024-09-12T00:25:02.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.850+0000 7fc635232800 1 execute INFO: reshard of bucket "a-bucket" from 3 shards to 1 shards completed successfully 2024-09-12T00:25:02.850 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.852+0000 7fc4e6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:02.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.854+0000 7fc635232800 20 remove_watcher() i=0 2024-09-12T00:25:02.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.854+0000 7fc635232800 2 removed watcher, disabling cache 2024-09-12T00:25:02.853 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.855+0000 7fc635232800 20 remove_watcher() i=1 2024-09-12T00:25:02.854 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.856+0000 7fc635232800 20 remove_watcher() i=2 2024-09-12T00:25:02.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.858+0000 7fc635232800 20 remove_watcher() i=3 2024-09-12T00:25:02.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.859+0000 7fc635232800 20 remove_watcher() i=4 2024-09-12T00:25:02.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.860+0000 7fc635232800 20 remove_watcher() i=5 2024-09-12T00:25:02.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.861+0000 7fc635232800 20 remove_watcher() i=6 2024-09-12T00:25:02.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.862+0000 7fc635232800 20 remove_watcher() i=7 2024-09-12T00:25:02.873 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:25:02.902 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:02.902 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:02.942 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.943+0000 7f434f298800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.943 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.945+0000 7f434f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.945+0000 7f434f298800 20 realm 2024-09-12T00:25:02.944 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.945+0000 7f434f298800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.946+0000 7f434f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.945 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.946+0000 7f434f298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:02.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.946+0000 7f434f298800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.946+0000 7f434f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:02.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.946+0000 7f434f298800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.947+0000 7f434f298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:02.946 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.947+0000 7f434f298800 20 rados->read ofs=0 len=0 2024-09-12T00:25:02.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.948+0000 7f434f298800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:02.947 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.948+0000 7f434f298800 20 searching for the correct realm 2024-09-12T00:25:02.948 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.950+0000 7f434cd89640 0 -- 172.21.15.67:0/3215030172 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f433c044020 msgr2=0x7f433c0a49c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:02.951 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:02.953+0000 7f434cd89640 0 -- 172.21.15.67:0/3215030172 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f4344083040 msgr2=0x7f4344064420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:03.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.159+0000 7f434f298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:03.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.159+0000 7f434f298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:03.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.159+0000 7f434f298800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:03.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.159+0000 7f434f298800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:03.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.159+0000 7f434f298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:03.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.159+0000 7f434f298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:03.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.159+0000 7f434f298800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.160+0000 7f434f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.158 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.160+0000 7f434f298800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.159 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.160+0000 7f434f298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:03.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.160+0000 7f434f298800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.160+0000 7f434f298800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:03.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.160+0000 7f434f298800 20 zone default found 2024-09-12T00:25:03.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.160+0000 7f434f298800 4 Realm: () 2024-09-12T00:25:03.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.160+0000 7f434f298800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:03.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.160+0000 7f434f298800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:03.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.160+0000 7f434f298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:03.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.160+0000 7f434f298800 20 zonegroup default 2024-09-12T00:25:03.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.160+0000 7f434f298800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.161+0000 7f434f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.161+0000 7f434f298800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.160 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.161+0000 7f434f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.161+0000 7f434f298800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.162+0000 7f434f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.162+0000 7f434f298800 20 started sync module instance, tier type = 2024-09-12T00:25:03.161 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.162+0000 7f434f298800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:03.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.171+0000 7f434f298800 20 add_watcher() i=0 2024-09-12T00:25:03.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.171+0000 7f434f298800 20 add_watcher() i=1 2024-09-12T00:25:03.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.171+0000 7f434f298800 20 add_watcher() i=2 2024-09-12T00:25:03.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.171+0000 7f434f298800 20 add_watcher() i=3 2024-09-12T00:25:03.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.171+0000 7f434f298800 20 add_watcher() i=4 2024-09-12T00:25:03.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.171+0000 7f434f298800 20 add_watcher() i=5 2024-09-12T00:25:03.169 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.171+0000 7f434f298800 20 add_watcher() i=6 2024-09-12T00:25:03.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.172+0000 7f434f298800 20 add_watcher() i=7 2024-09-12T00:25:03.170 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.172+0000 7f434f298800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:03.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.174+0000 7f42037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:03.172 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.174+0000 7f434f298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:03.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.174+0000 7f434f298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:03.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.174+0000 7f434f298800 5 note: GC not initialized 2024-09-12T00:25:03.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.174+0000 7f42027e4640 20 reqs_thread_entry: start 2024-09-12T00:25:03.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.174+0000 7f434f298800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:03.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.174+0000 7f434f298800 20 Filter name: none 2024-09-12T00:25:03.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.174+0000 7f41fbfff640 20 reqs_thread_entry: start 2024-09-12T00:25:03.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.174+0000 7f434f298800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.175+0000 7f434f298800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:25:03.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.175+0000 7f434f298800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.175+0000 7f434f298800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:25:03.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.175+0000 7f434f298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:03.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.175+0000 7f434f298800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T00:25:03.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.175+0000 7f434f298800 20 INFO: main: starting shard=0 2024-09-12T00:25:03.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.175+0000 7f434f298800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.0 2024-09-12T00:25:03.174 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.175+0000 7f434f298800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17.3.0 2024-09-12T00:25:03.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.176+0000 7f434f298800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:25:03.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.176+0000 7f434f298800 20 INFO: main: done 2024-09-12T00:25:03.175 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.177+0000 7f42037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:03.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.179+0000 7f434f298800 20 remove_watcher() i=0 2024-09-12T00:25:03.177 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.179+0000 7f434f298800 2 removed watcher, disabling cache 2024-09-12T00:25:03.178 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.180+0000 7f434f298800 20 remove_watcher() i=1 2024-09-12T00:25:03.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.181+0000 7f434f298800 20 remove_watcher() i=2 2024-09-12T00:25:03.180 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.182+0000 7f434f298800 20 remove_watcher() i=3 2024-09-12T00:25:03.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.184+0000 7f434f298800 20 remove_watcher() i=4 2024-09-12T00:25:03.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.185+0000 7f434f298800 20 remove_watcher() i=5 2024-09-12T00:25:03.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.186+0000 7f434f298800 20 remove_watcher() i=6 2024-09-12T00:25:03.186 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.187+0000 7f434f298800 20 remove_watcher() i=7 2024-09-12T00:25:03.197 INFO:tasks.workunit.client.0.smithi067.stderr: test: PUT succeeds during reshard 2024-09-12T00:25:03.198 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:25:03.230 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:03.230 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:03.269 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.271+0000 7fc028c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.273+0000 7fc028c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.273+0000 7fc028c2f800 20 realm 2024-09-12T00:25:03.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.273+0000 7fc028c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.273+0000 7fc028c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.273+0000 7fc028c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:03.271 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.273+0000 7fc028c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.273+0000 7fc028c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.273+0000 7fc028c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.274+0000 7fc028c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:03.272 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.274+0000 7fc028c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.275+0000 7fc028c2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:03.273 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.275+0000 7fc028c2f800 20 searching for the correct realm 2024-09-12T00:25:03.276 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.278+0000 7fc025f1f640 0 -- 172.21.15.67:0/3610410018 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fc01c058820 msgr2=0x7fc01c0223f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:03.482 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.484+0000 7fc025f1f640 0 -- 172.21.15.67:0/3610410018 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x561eba40d140 msgr2=0x561eba40f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:03.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.488+0000 7fc028c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:03.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.488+0000 7fc028c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:03.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.488+0000 7fc028c2f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:03.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.488+0000 7fc028c2f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:03.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.488+0000 7fc028c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:03.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.488+0000 7fc028c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:03.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.488+0000 7fc028c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.486 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.488+0000 7fc028c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.487 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.488+0000 7fc028c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.488+0000 7fc028c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:03.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.488+0000 7fc028c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.488+0000 7fc028c2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:03.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.489+0000 7fc028c2f800 20 zone default found 2024-09-12T00:25:03.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.489+0000 7fc028c2f800 4 Realm: () 2024-09-12T00:25:03.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.489+0000 7fc028c2f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:03.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.489+0000 7fc028c2f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:03.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.489+0000 7fc028c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:03.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.489+0000 7fc028c2f800 20 zonegroup default 2024-09-12T00:25:03.488 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.489+0000 7fc028c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.489+0000 7fc028c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.489+0000 7fc028c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.489+0000 7fc028c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.489+0000 7fc028c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.489+0000 7fc028c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.489+0000 7fc028c2f800 20 started sync module instance, tier type = 2024-09-12T00:25:03.489 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.489+0000 7fc028c2f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:03.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.498+0000 7fc028c2f800 20 add_watcher() i=0 2024-09-12T00:25:03.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.498+0000 7fc028c2f800 20 add_watcher() i=1 2024-09-12T00:25:03.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.498+0000 7fc028c2f800 20 add_watcher() i=2 2024-09-12T00:25:03.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.498+0000 7fc028c2f800 20 add_watcher() i=3 2024-09-12T00:25:03.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.498+0000 7fc028c2f800 20 add_watcher() i=4 2024-09-12T00:25:03.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.498+0000 7fc028c2f800 20 add_watcher() i=5 2024-09-12T00:25:03.497 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.498+0000 7fc028c2f800 20 add_watcher() i=6 2024-09-12T00:25:03.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.499+0000 7fc028c2f800 20 add_watcher() i=7 2024-09-12T00:25:03.498 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.499+0000 7fc028c2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:03.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.501+0000 7fbedcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:03.499 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.501+0000 7fc028c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:03.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.501+0000 7fc028c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:03.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.501+0000 7fc028c2f800 5 note: GC not initialized 2024-09-12T00:25:03.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.501+0000 7fbe577fe640 20 reqs_thread_entry: start 2024-09-12T00:25:03.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.501+0000 7fc028c2f800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:03.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.501+0000 7fc028c2f800 20 Filter name: none 2024-09-12T00:25:03.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.501+0000 7fbe557fa640 20 reqs_thread_entry: start 2024-09-12T00:25:03.500 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.501+0000 7fc028c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.502+0000 7fc028c2f800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:25:03.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.502+0000 7fc028c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.502+0000 7fc028c2f800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:25:03.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.502+0000 7fc028c2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:03.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.502+0000 7fc028c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.501 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.503+0000 7fc028c2f800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:25:03.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.503+0000 7fc028c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.503+0000 7fc028c2f800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:25:03.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.503+0000 7fc028c2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:03.502 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.504+0000 7fbedcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:03.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.507+0000 7fc028c2f800 20 remove_watcher() i=0 2024-09-12T00:25:03.505 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.507+0000 7fc028c2f800 2 removed watcher, disabling cache 2024-09-12T00:25:03.506 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.508+0000 7fc028c2f800 20 remove_watcher() i=1 2024-09-12T00:25:03.507 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.509+0000 7fc028c2f800 20 remove_watcher() i=2 2024-09-12T00:25:03.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.510+0000 7fc028c2f800 20 remove_watcher() i=3 2024-09-12T00:25:03.508 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.511+0000 7fc028c2f800 20 remove_watcher() i=4 2024-09-12T00:25:03.510 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.512+0000 7fc028c2f800 20 remove_watcher() i=5 2024-09-12T00:25:03.511 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.513+0000 7fc028c2f800 20 remove_watcher() i=6 2024-09-12T00:25:03.512 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.513+0000 7fc028c2f800 20 remove_watcher() i=7 2024-09-12T00:25:03.523 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:25:03.523 INFO:tasks.workunit.client.0.smithi067.stderr:BUCKET_STATS: 2024-09-12T00:25:03.523 INFO:tasks.workunit.client.0.smithi067.stderr:bucket: myver id: ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:25:03.523 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:25:03.525 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-09-12T00:25:03.558 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:03.558 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:03.597 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.599+0000 7f0f68daf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.802+0000 7f0f68daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.802+0000 7f0f68daf800 20 realm 2024-09-12T00:25:03.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.802+0000 7f0f68daf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.802+0000 7f0f68daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.802+0000 7f0f68daf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:03.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.802+0000 7f0f68daf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.802+0000 7f0f68daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.802+0000 7f0f68daf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.803+0000 7f0f68daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:03.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.803+0000 7f0f68daf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.804+0000 7f0f68daf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:03.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.804+0000 7f0f68daf800 20 searching for the correct realm 2024-09-12T00:25:03.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.808+0000 7f0f66899640 0 -- 172.21.15.67:0/3068235750 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f0f580039c0 msgr2=0x7f0f5808c9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:03.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.811+0000 7f0f66899640 0 -- 172.21.15.67:0/3068235750 >> [v2:172.21.15.67:6800/2522402523,v1:172.21.15.67:6801/2522402523] conn(0x5590fe71b1d0 msgr2=0x5590fe71d5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:03.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.815+0000 7f0f68daf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:03.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.815+0000 7f0f68daf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:03.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.815+0000 7f0f68daf800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:03.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.815+0000 7f0f68daf800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:03.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.815+0000 7f0f68daf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:03.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.815+0000 7f0f68daf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:03.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.815+0000 7f0f68daf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.815+0000 7f0f68daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.815+0000 7f0f68daf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.815+0000 7f0f68daf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:03.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.815+0000 7f0f68daf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.816+0000 7f0f68daf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:03.815 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.816+0000 7f0f68daf800 20 zone default found 2024-09-12T00:25:03.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.816+0000 7f0f68daf800 4 Realm: () 2024-09-12T00:25:03.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.816+0000 7f0f68daf800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:03.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.816+0000 7f0f68daf800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:03.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.816+0000 7f0f68daf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:03.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.816+0000 7f0f68daf800 20 zonegroup default 2024-09-12T00:25:03.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.816+0000 7f0f68daf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.816+0000 7f0f68daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.816+0000 7f0f68daf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.816+0000 7f0f68daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.816+0000 7f0f68daf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.817+0000 7f0f68daf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:03.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.817+0000 7f0f68daf800 20 started sync module instance, tier type = 2024-09-12T00:25:03.817 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.817+0000 7f0f68daf800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:03.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.825+0000 7f0f68daf800 20 add_watcher() i=0 2024-09-12T00:25:03.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.825+0000 7f0f68daf800 20 add_watcher() i=1 2024-09-12T00:25:03.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.825+0000 7f0f68daf800 20 add_watcher() i=2 2024-09-12T00:25:03.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.825+0000 7f0f68daf800 20 add_watcher() i=3 2024-09-12T00:25:03.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.825+0000 7f0f68daf800 20 add_watcher() i=4 2024-09-12T00:25:03.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.825+0000 7f0f68daf800 20 add_watcher() i=5 2024-09-12T00:25:03.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.825+0000 7f0f68daf800 20 add_watcher() i=6 2024-09-12T00:25:03.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.826+0000 7f0f68daf800 20 add_watcher() i=7 2024-09-12T00:25:03.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.826+0000 7f0f68daf800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:03.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.828+0000 7f0e1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:03.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.829+0000 7f0f68daf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:03.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.829+0000 7f0f68daf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:03.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.829+0000 7f0f68daf800 5 note: GC not initialized 2024-09-12T00:25:03.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.829+0000 7f0d97fff640 20 reqs_thread_entry: start 2024-09-12T00:25:03.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.829+0000 7f0f68daf800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:03.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.829+0000 7f0f68daf800 20 Filter name: none 2024-09-12T00:25:03.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.829+0000 7f0d95ffb640 20 reqs_thread_entry: start 2024-09-12T00:25:03.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.829+0000 7f0f68daf800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:25:03.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.829+0000 7f0f68daf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.830+0000 7f0f68daf800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:25:03.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.830+0000 7f0f68daf800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:25:03.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.830+0000 7f0f68daf800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:25:03.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.830+0000 7f0f68daf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 : miss 2024-09-12T00:25:03.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.830+0000 7f0f68daf800 20 rados->read ofs=0 len=0 2024-09-12T00:25:03.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.830+0000 7f0f68daf800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:25:03.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.830+0000 7f0f68daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:03.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.830+0000 7f0f68daf800 10 adding default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:03.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.830+0000 7f0f68daf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:03.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.830+0000 7f0f68daf800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:03.829 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.830+0000 7f0f68daf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 2024-09-12T00:25:03.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.834+0000 7f0f68daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:03.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.834+0000 7f0f68daf800 10 moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:03.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.834+0000 7f0f68daf800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:03.832 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.834+0000 7f0f68daf800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18, ofs0, ns] 2024-09-12T00:25:03.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.834+0000 7f0e4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562454 cookie 94081232521312 notifier 8643 bl.length()=821 2024-09-12T00:25:03.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.834+0000 7f0e4a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:03.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.834+0000 7f0e4a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:03.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.834+0000 7f0e4a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:03.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.835+0000 7f0f68daf800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_sources= new_sources= 2024-09-12T00:25:03.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.835+0000 7f0f68daf800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential sources added=[] removed=[] 2024-09-12T00:25:03.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.835+0000 7f0f68daf800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_dests= new_dests= 2024-09-12T00:25:03.833 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.835+0000 7f0f68daf800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential dests added=[] removed=[] 2024-09-12T00:25:03.835 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:03.837+0000 7f0f68daf800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T00:25:04.549 INFO:tasks.workunit.client.0.smithi067.stderr:put object successful 2024-09-12T00:25:08.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.836+0000 7f0f68daf800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.0 2024-09-12T00:25:08.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.836+0000 7f0f68daf800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.0 2024-09-12T00:25:08.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.836+0000 7f0f68daf800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.1 2024-09-12T00:25:08.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.836+0000 7f0f68daf800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.1 2024-09-12T00:25:08.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.836+0000 7f0f68daf800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.2 2024-09-12T00:25:08.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.836+0000 7f0f68daf800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.2 2024-09-12T00:25:08.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.836+0000 7f0f68daf800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.1.0 2024-09-12T00:25:08.836 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.836+0000 7f0f68daf800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.1.0 2024-09-12T00:25:08.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.837+0000 7f0f68daf800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.1.1 2024-09-12T00:25:08.837 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.837+0000 7f0f68daf800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.1.1 2024-09-12T00:25:08.838 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.839+0000 7f0f68daf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:08.839 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.839+0000 7f0f68daf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 2024-09-12T00:25:08.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.841+0000 7f0f68daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:08.840 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.841+0000 7f0f68daf800 10 moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:08.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.841+0000 7f0f68daf800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:08.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.841+0000 7f0f68daf800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18, ofs0, ns] 2024-09-12T00:25:08.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.842+0000 7f0e4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562455 cookie 94081232521312 notifier 8643 bl.length()=821 2024-09-12T00:25:08.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.842+0000 7f0e4a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:08.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.842+0000 7f0e4a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:08.841 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.842+0000 7f0e4a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:08.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.842+0000 7f0f68daf800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_sources= new_sources= 2024-09-12T00:25:08.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.842+0000 7f0f68daf800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential sources added=[] removed=[] 2024-09-12T00:25:08.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.842+0000 7f0f68daf800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_dests= new_dests= 2024-09-12T00:25:08.842 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.842+0000 7f0f68daf800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential dests added=[] removed=[] 2024-09-12T00:25:08.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.844+0000 7f0f68daf800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.1.0 2024-09-12T00:25:08.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.844+0000 7f0f68daf800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.1.0 2024-09-12T00:25:08.843 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.844+0000 7f0f68daf800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.1.1 2024-09-12T00:25:08.844 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.844+0000 7f0f68daf800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.1.1 2024-09-12T00:25:08.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.846+0000 7f0f68daf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:08.845 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.846+0000 7f0f68daf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 2024-09-12T00:25:08.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.848+0000 7f0f68daf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:08.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.848+0000 7f0f68daf800 10 moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:08.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.848+0000 7f0f68daf800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:08.847 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.848+0000 7f0f68daf800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18, ofs0, ns] 2024-09-12T00:25:08.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.848+0000 7f0e4a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562456 cookie 94081232521312 notifier 8643 bl.length()=789 2024-09-12T00:25:08.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.848+0000 7f0e4a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:08.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.848+0000 7f0e4a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:08.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.848+0000 7f0e4a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:08.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.849+0000 7f0f68daf800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_sources= new_sources= 2024-09-12T00:25:08.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.849+0000 7f0f68daf800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential sources added=[] removed=[] 2024-09-12T00:25:08.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.849+0000 7f0f68daf800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_dests= new_dests= 2024-09-12T00:25:08.848 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.849+0000 7f0f68daf800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential dests added=[] removed=[] 2024-09-12T00:25:08.849 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.850+0000 7f0f68daf800 1 execute INFO: reshard of bucket "myver" from 2 shards to 3 shards completed successfully 2024-09-12T00:25:08.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.853+0000 7f0e1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:08.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.855+0000 7f0f68daf800 20 remove_watcher() i=0 2024-09-12T00:25:08.855 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.856+0000 7f0f68daf800 2 removed watcher, disabling cache 2024-09-12T00:25:08.856 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.857+0000 7f0f68daf800 20 remove_watcher() i=1 2024-09-12T00:25:08.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.859+0000 7f0f68daf800 20 remove_watcher() i=2 2024-09-12T00:25:08.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.860+0000 7f0f68daf800 20 remove_watcher() i=3 2024-09-12T00:25:08.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.861+0000 7f0f68daf800 20 remove_watcher() i=4 2024-09-12T00:25:08.862 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.863+0000 7f0f68daf800 20 remove_watcher() i=5 2024-09-12T00:25:08.863 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.864+0000 7f0f68daf800 20 remove_watcher() i=6 2024-09-12T00:25:08.865 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:08.866+0000 7f0f68daf800 20 remove_watcher() i=7 2024-09-12T00:25:09.555 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T00:25:09.555 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:25:09.671 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:25:10.083 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:25:11.556 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:25:11.558 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T00:25:11.594 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:11.594 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:11.638 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.639+0000 7f218b487800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.641+0000 7f218b487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:11.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.641+0000 7f218b487800 20 realm 2024-09-12T00:25:11.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.641+0000 7f218b487800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.640 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.641+0000 7f218b487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.641+0000 7f218b487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.641+0000 7f218b487800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.641+0000 7f218b487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.641+0000 7f218b487800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.642+0000 7f218b487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:11.641 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.642+0000 7f218b487800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.643+0000 7f218b487800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:11.642 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.643+0000 7f218b487800 20 searching for the correct realm 2024-09-12T00:25:11.645 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.646+0000 7f2188770640 0 -- 172.21.15.67:0/1969894368 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f217c0a4960 msgr2=0x7f217c087020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:11.852 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.853+0000 7f2189772640 0 -- 172.21.15.67:0/1969894368 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x556cff9c7620 msgr2=0x556cff9c9a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:11.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.858+0000 7f218b487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:11.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.858+0000 7f218b487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:11.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.858+0000 7f218b487800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:11.857 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.858+0000 7f218b487800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:11.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.858+0000 7f218b487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:11.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.858+0000 7f218b487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:11.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.858+0000 7f218b487800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.858+0000 7f218b487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:11.858 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.858+0000 7f218b487800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.859+0000 7f218b487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:11.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.859+0000 7f218b487800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.859+0000 7f218b487800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:11.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.859+0000 7f218b487800 20 zone default found 2024-09-12T00:25:11.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.859+0000 7f218b487800 4 Realm: () 2024-09-12T00:25:11.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.859+0000 7f218b487800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:11.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.859+0000 7f218b487800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:11.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.859+0000 7f218b487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:11.859 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.859+0000 7f218b487800 20 zonegroup default 2024-09-12T00:25:11.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.859+0000 7f218b487800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.859+0000 7f218b487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:11.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.859+0000 7f218b487800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.860+0000 7f218b487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:11.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.860+0000 7f218b487800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.860+0000 7f218b487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:11.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.860+0000 7f218b487800 20 started sync module instance, tier type = 2024-09-12T00:25:11.860 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.860+0000 7f218b487800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:11.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.870+0000 7f218b487800 20 add_watcher() i=0 2024-09-12T00:25:11.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.870+0000 7f218b487800 20 add_watcher() i=1 2024-09-12T00:25:11.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.870+0000 7f218b487800 20 add_watcher() i=2 2024-09-12T00:25:11.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.870+0000 7f218b487800 20 add_watcher() i=3 2024-09-12T00:25:11.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.870+0000 7f218b487800 20 add_watcher() i=4 2024-09-12T00:25:11.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.870+0000 7f218b487800 20 add_watcher() i=5 2024-09-12T00:25:11.870 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.871+0000 7f218b487800 20 add_watcher() i=6 2024-09-12T00:25:11.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.872+0000 7f218b487800 20 add_watcher() i=7 2024-09-12T00:25:11.871 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.872+0000 7f218b487800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:11.873 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.874+0000 7f203f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:11.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.874+0000 7f218b487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:11.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.874+0000 7f218b487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:11.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.874+0000 7f218b487800 5 note: GC not initialized 2024-09-12T00:25:11.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.875+0000 7f203e7e4640 20 reqs_thread_entry: start 2024-09-12T00:25:11.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.875+0000 7f218b487800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:11.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.875+0000 7f218b487800 20 Filter name: none 2024-09-12T00:25:11.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.875+0000 7f2037fff640 20 reqs_thread_entry: start 2024-09-12T00:25:11.874 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.875+0000 7f218b487800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.875+0000 7f218b487800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:25:11.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.875+0000 7f218b487800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.876+0000 7f218b487800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:25:11.875 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.876+0000 7f218b487800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:11.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.876+0000 7f218b487800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:25:11.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.876+0000 7f218b487800 20 INFO: main: starting shard=0 2024-09-12T00:25:11.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.876+0000 7f218b487800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.0 2024-09-12T00:25:11.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.876+0000 7f218b487800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.0 2024-09-12T00:25:11.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.877+0000 7f218b487800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:25:11.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.877+0000 7f218b487800 20 INFO: main: starting shard=1 2024-09-12T00:25:11.876 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.877+0000 7f218b487800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.1 2024-09-12T00:25:11.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.877+0000 7f218b487800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.1 2024-09-12T00:25:11.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.877+0000 7f218b487800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:25:11.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.878+0000 7f218b487800 20 INFO: main: starting shard=2 2024-09-12T00:25:11.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.878+0000 7f218b487800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.2 2024-09-12T00:25:11.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.878+0000 7f218b487800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.2 2024-09-12T00:25:11.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.878+0000 7f218b487800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:25:11.877 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.878+0000 7f218b487800 20 INFO: main: done 2024-09-12T00:25:11.878 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.879+0000 7f203f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:11.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.882+0000 7f218b487800 20 remove_watcher() i=0 2024-09-12T00:25:11.881 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.882+0000 7f218b487800 2 removed watcher, disabling cache 2024-09-12T00:25:11.882 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.883+0000 7f218b487800 20 remove_watcher() i=1 2024-09-12T00:25:11.883 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.884+0000 7f218b487800 20 remove_watcher() i=2 2024-09-12T00:25:11.885 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.885+0000 7f218b487800 20 remove_watcher() i=3 2024-09-12T00:25:11.886 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.887+0000 7f218b487800 20 remove_watcher() i=4 2024-09-12T00:25:11.887 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.888+0000 7f218b487800 20 remove_watcher() i=5 2024-09-12T00:25:11.888 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.889+0000 7f218b487800 20 remove_watcher() i=6 2024-09-12T00:25:11.889 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:11.890+0000 7f218b487800 20 remove_watcher() i=7 2024-09-12T00:25:11.959 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:25:11.961 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T00:25:11.993 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:11.994 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:12.034 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.034+0000 7fbb2852c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.036+0000 7fbb2852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.036+0000 7fbb2852c800 20 realm 2024-09-12T00:25:12.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.036+0000 7fbb2852c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.037+0000 7fbb2852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.037+0000 7fbb2852c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:12.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.037+0000 7fbb2852c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.037+0000 7fbb2852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.036 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.037+0000 7fbb2852c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.038+0000 7fbb2852c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:12.037 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.038+0000 7fbb2852c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.039+0000 7fbb2852c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:12.038 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.039+0000 7fbb2852c800 20 searching for the correct realm 2024-09-12T00:25:12.041 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.042+0000 7fbb24a50640 0 -- 172.21.15.67:0/2616917625 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7fbb1807a040 msgr2=0x7fbb1807a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:12.045 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.046+0000 7fbb2424f640 0 -- 172.21.15.67:0/2616917625 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fbb1c03c060 msgr2=0x7fbb1c0651b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:12.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.050+0000 7fbb2852c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:12.049 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.050+0000 7fbb2852c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:12.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.050+0000 7fbb2852c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:12.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.050+0000 7fbb2852c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:12.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.050+0000 7fbb2852c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:12.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.050+0000 7fbb2852c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:12.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.050+0000 7fbb2852c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.050+0000 7fbb2852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.050 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.050+0000 7fbb2852c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.051+0000 7fbb2852c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:12.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.051+0000 7fbb2852c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.051+0000 7fbb2852c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:12.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.051+0000 7fbb2852c800 20 zone default found 2024-09-12T00:25:12.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.051+0000 7fbb2852c800 4 Realm: () 2024-09-12T00:25:12.051 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.051+0000 7fbb2852c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:12.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.051+0000 7fbb2852c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:12.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.051+0000 7fbb2852c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:12.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.051+0000 7fbb2852c800 20 zonegroup default 2024-09-12T00:25:12.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.051+0000 7fbb2852c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.051+0000 7fbb2852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.051+0000 7fbb2852c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.052+0000 7fbb2852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.052+0000 7fbb2852c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.052+0000 7fbb2852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.052+0000 7fbb2852c800 20 started sync module instance, tier type = 2024-09-12T00:25:12.052 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.052+0000 7fbb2852c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:12.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.061+0000 7fbb2852c800 20 add_watcher() i=0 2024-09-12T00:25:12.060 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.061+0000 7fbb2852c800 20 add_watcher() i=1 2024-09-12T00:25:12.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.061+0000 7fbb2852c800 20 add_watcher() i=2 2024-09-12T00:25:12.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.061+0000 7fbb2852c800 20 add_watcher() i=3 2024-09-12T00:25:12.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.061+0000 7fbb2852c800 20 add_watcher() i=4 2024-09-12T00:25:12.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.061+0000 7fbb2852c800 20 add_watcher() i=5 2024-09-12T00:25:12.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.061+0000 7fbb2852c800 20 add_watcher() i=6 2024-09-12T00:25:12.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.062+0000 7fbb2852c800 20 add_watcher() i=7 2024-09-12T00:25:12.061 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.062+0000 7fbb2852c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:12.063 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.064+0000 7fb9dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:12.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.064+0000 7fbb2852c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:12.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.064+0000 7fbb2852c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:12.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.064+0000 7fbb2852c800 5 note: GC not initialized 2024-09-12T00:25:12.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.065+0000 7fb9d9fdb640 20 reqs_thread_entry: start 2024-09-12T00:25:12.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.065+0000 7fbb2852c800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:12.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.065+0000 7fbb2852c800 20 Filter name: none 2024-09-12T00:25:12.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.065+0000 7fb94b7fe640 20 reqs_thread_entry: start 2024-09-12T00:25:12.064 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.065+0000 7fbb2852c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.065+0000 7fbb2852c800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:25:12.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.065+0000 7fbb2852c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.066+0000 7fbb2852c800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:25:12.065 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.066+0000 7fbb2852c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:12.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.066+0000 7fbb2852c800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:25:12.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.066+0000 7fbb2852c800 20 INFO: main: starting shard=0 2024-09-12T00:25:12.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.066+0000 7fbb2852c800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.0 2024-09-12T00:25:12.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.066+0000 7fbb2852c800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.0 2024-09-12T00:25:12.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.067+0000 7fbb2852c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:25:12.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.067+0000 7fbb2852c800 20 INFO: main: starting shard=1 2024-09-12T00:25:12.066 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.067+0000 7fbb2852c800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.1 2024-09-12T00:25:12.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.067+0000 7fbb2852c800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.1 2024-09-12T00:25:12.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.067+0000 7fbb2852c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:25:12.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.067+0000 7fbb2852c800 20 INFO: main: starting shard=2 2024-09-12T00:25:12.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.067+0000 7fbb2852c800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.2 2024-09-12T00:25:12.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.067+0000 7fbb2852c800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.2 2024-09-12T00:25:12.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.068+0000 7fbb2852c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:25:12.067 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.068+0000 7fbb2852c800 20 INFO: main: done 2024-09-12T00:25:12.068 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.069+0000 7fb9dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:12.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.071+0000 7fbb2852c800 20 remove_watcher() i=0 2024-09-12T00:25:12.070 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.071+0000 7fbb2852c800 2 removed watcher, disabling cache 2024-09-12T00:25:12.071 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.072+0000 7fbb2852c800 20 remove_watcher() i=1 2024-09-12T00:25:12.073 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.074+0000 7fbb2852c800 20 remove_watcher() i=2 2024-09-12T00:25:12.074 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.075+0000 7fbb2852c800 20 remove_watcher() i=3 2024-09-12T00:25:12.075 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.076+0000 7fbb2852c800 20 remove_watcher() i=4 2024-09-12T00:25:12.076 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.077+0000 7fbb2852c800 20 remove_watcher() i=5 2024-09-12T00:25:12.077 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.078+0000 7fbb2852c800 20 remove_watcher() i=6 2024-09-12T00:25:12.078 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.079+0000 7fbb2852c800 20 remove_watcher() i=7 2024-09-12T00:25:12.145 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:25:12.147 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T00:25:12.178 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:12.178 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:12.218 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.218+0000 7f954e60f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.220+0000 7f954e60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.220+0000 7f954e60f800 20 realm 2024-09-12T00:25:12.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.220+0000 7f954e60f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.221+0000 7f954e60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.221+0000 7f954e60f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:12.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.221+0000 7f954e60f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.221+0000 7f954e60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.220 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.221+0000 7f954e60f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.222+0000 7f954e60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:12.221 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.222+0000 7f954e60f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.222+0000 7f954e60f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:12.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.222+0000 7f954e60f800 20 searching for the correct realm 2024-09-12T00:25:12.225 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.225+0000 7f954b8f8640 0 -- 172.21.15.67:0/3986876170 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f9540097280 msgr2=0x7f95400870d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:12.228 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.229+0000 7f954c8fa640 0 -- 172.21.15.67:0/3986876170 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x564c746a2810 msgr2=0x564c746a4ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:12.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.233+0000 7f954e60f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:12.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.233+0000 7f954e60f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:12.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.233+0000 7f954e60f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:12.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.233+0000 7f954e60f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:12.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.233+0000 7f954e60f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:12.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.233+0000 7f954e60f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:12.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.233+0000 7f954e60f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.234+0000 7f954e60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.233 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.234+0000 7f954e60f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.234+0000 7f954e60f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:12.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.234+0000 7f954e60f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.234+0000 7f954e60f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:12.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.234+0000 7f954e60f800 20 zone default found 2024-09-12T00:25:12.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.234+0000 7f954e60f800 4 Realm: () 2024-09-12T00:25:12.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.234+0000 7f954e60f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:12.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.234+0000 7f954e60f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:12.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.234+0000 7f954e60f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:12.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.234+0000 7f954e60f800 20 zonegroup default 2024-09-12T00:25:12.235 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.234+0000 7f954e60f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.235+0000 7f954e60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.235+0000 7f954e60f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.235+0000 7f954e60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.235+0000 7f954e60f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.235+0000 7f954e60f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.235+0000 7f954e60f800 20 started sync module instance, tier type = 2024-09-12T00:25:12.236 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.235+0000 7f954e60f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:12.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.244+0000 7f954e60f800 20 add_watcher() i=0 2024-09-12T00:25:12.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.244+0000 7f954e60f800 20 add_watcher() i=1 2024-09-12T00:25:12.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.244+0000 7f954e60f800 20 add_watcher() i=2 2024-09-12T00:25:12.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.244+0000 7f954e60f800 20 add_watcher() i=3 2024-09-12T00:25:12.243 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.244+0000 7f954e60f800 20 add_watcher() i=4 2024-09-12T00:25:12.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.244+0000 7f954e60f800 20 add_watcher() i=5 2024-09-12T00:25:12.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.244+0000 7f954e60f800 20 add_watcher() i=6 2024-09-12T00:25:12.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.245+0000 7f954e60f800 20 add_watcher() i=7 2024-09-12T00:25:12.244 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.245+0000 7f954e60f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:12.246 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.247+0000 7f9402fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:12.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.247+0000 7f954e60f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:12.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.247+0000 7f954e60f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:12.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.247+0000 7f954e60f800 5 note: GC not initialized 2024-09-12T00:25:12.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.247+0000 7f9401fdb640 20 reqs_thread_entry: start 2024-09-12T00:25:12.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.247+0000 7f954e60f800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:12.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.247+0000 7f954e60f800 20 Filter name: none 2024-09-12T00:25:12.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.248+0000 7f93737fe640 20 reqs_thread_entry: start 2024-09-12T00:25:12.247 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.248+0000 7f954e60f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.248+0000 7f954e60f800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:25:12.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.248+0000 7f954e60f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.249+0000 7f954e60f800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:25:12.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.249+0000 7f954e60f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:12.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.249+0000 7f954e60f800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:25:12.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.249+0000 7f954e60f800 20 INFO: main: starting shard=0 2024-09-12T00:25:12.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.249+0000 7f954e60f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.0 2024-09-12T00:25:12.248 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.249+0000 7f954e60f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.0 2024-09-12T00:25:12.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.249+0000 7f954e60f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:25:12.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.249+0000 7f954e60f800 20 INFO: main: starting shard=1 2024-09-12T00:25:12.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.249+0000 7f954e60f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.1 2024-09-12T00:25:12.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.249+0000 7f954e60f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.1 2024-09-12T00:25:12.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.250+0000 7f954e60f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:25:12.249 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.250+0000 7f954e60f800 20 INFO: main: starting shard=2 2024-09-12T00:25:12.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.250+0000 7f954e60f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.2 2024-09-12T00:25:12.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.250+0000 7f954e60f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.2 2024-09-12T00:25:12.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.250+0000 7f954e60f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:25:12.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.251+0000 7f954e60f800 20 INFO: main: done 2024-09-12T00:25:12.250 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.252+0000 7f9402fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:12.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.254+0000 7f954e60f800 20 remove_watcher() i=0 2024-09-12T00:25:12.253 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.254+0000 7f954e60f800 2 removed watcher, disabling cache 2024-09-12T00:25:12.254 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.255+0000 7f954e60f800 20 remove_watcher() i=1 2024-09-12T00:25:12.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.256+0000 7f954e60f800 20 remove_watcher() i=2 2024-09-12T00:25:12.256 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.257+0000 7f954e60f800 20 remove_watcher() i=3 2024-09-12T00:25:12.257 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.258+0000 7f954e60f800 20 remove_watcher() i=4 2024-09-12T00:25:12.258 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.259+0000 7f954e60f800 20 remove_watcher() i=5 2024-09-12T00:25:12.259 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.260+0000 7f954e60f800 20 remove_watcher() i=6 2024-09-12T00:25:12.260 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:12.261+0000 7f954e60f800 20 remove_watcher() i=7 2024-09-12T00:25:12.277 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:25:12.692 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:25:13.107 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T00:25:13.139 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:13.139 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:13.179 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.180+0000 7fda9bf19800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.182+0000 7fda9bf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.182 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.182+0000 7fda9bf19800 20 realm 2024-09-12T00:25:13.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.182+0000 7fda9bf19800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.183+0000 7fda9bf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.183+0000 7fda9bf19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:13.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.183+0000 7fda9bf19800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.183+0000 7fda9bf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.183 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.183+0000 7fda9bf19800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.183+0000 7fda9bf19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:13.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.184+0000 7fda9bf19800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.185+0000 7fda9bf19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:13.184 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.185+0000 7fda9bf19800 20 searching for the correct realm 2024-09-12T00:25:13.187 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.188+0000 7fda99202640 0 -- 172.21.15.67:0/880725229 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fda90035070 msgr2=0x7fda9000d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:13.393 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.394+0000 7fda9a204640 0 -- 172.21.15.67:0/880725229 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55afadcef070 msgr2=0x55afadcf1500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:13.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:13.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:13.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:13.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:13.398 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:13.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:13.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:13.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:13.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 20 zone default found 2024-09-12T00:25:13.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 4 Realm: () 2024-09-12T00:25:13.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:13.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:13.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:13.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 20 zonegroup default 2024-09-12T00:25:13.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.399+0000 7fda9bf19800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.400+0000 7fda9bf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.400+0000 7fda9bf19800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.400+0000 7fda9bf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.400+0000 7fda9bf19800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.401+0000 7fda9bf19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.401+0000 7fda9bf19800 20 started sync module instance, tier type = 2024-09-12T00:25:13.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.401+0000 7fda9bf19800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:13.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.410+0000 7fda9bf19800 20 add_watcher() i=0 2024-09-12T00:25:13.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.410+0000 7fda9bf19800 20 add_watcher() i=1 2024-09-12T00:25:13.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.410+0000 7fda9bf19800 20 add_watcher() i=2 2024-09-12T00:25:13.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.410+0000 7fda9bf19800 20 add_watcher() i=3 2024-09-12T00:25:13.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.410+0000 7fda9bf19800 20 add_watcher() i=4 2024-09-12T00:25:13.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.410+0000 7fda9bf19800 20 add_watcher() i=5 2024-09-12T00:25:13.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.410+0000 7fda9bf19800 20 add_watcher() i=6 2024-09-12T00:25:13.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.411+0000 7fda9bf19800 20 add_watcher() i=7 2024-09-12T00:25:13.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.411+0000 7fda9bf19800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:13.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.413+0000 7fd94b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:13.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.414+0000 7fda9bf19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:13.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.414+0000 7fda9bf19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:13.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.414+0000 7fda9bf19800 5 note: GC not initialized 2024-09-12T00:25:13.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.414+0000 7fd94a7fc640 20 reqs_thread_entry: start 2024-09-12T00:25:13.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.414+0000 7fda9bf19800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:13.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.414+0000 7fda9bf19800 20 Filter name: none 2024-09-12T00:25:13.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.414+0000 7fd8bbfff640 20 reqs_thread_entry: start 2024-09-12T00:25:13.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.414+0000 7fda9bf19800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:25:13.414 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.414+0000 7fda9bf19800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.415+0000 7fda9bf19800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:25:13.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.415+0000 7fda9bf19800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:25:13.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.415+0000 7fda9bf19800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:25:13.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.415+0000 7fda9bf19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 : miss 2024-09-12T00:25:13.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.415+0000 7fda9bf19800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.415+0000 7fda9bf19800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:25:13.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.415+0000 7fda9bf19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:13.415 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.415+0000 7fda9bf19800 10 adding default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:13.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.415+0000 7fda9bf19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:13.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.415+0000 7fda9bf19800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:13.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.415+0000 7fda9bf19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 2024-09-12T00:25:13.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.422+0000 7fda9bf19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:13.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.422+0000 7fda9bf19800 10 moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:13.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.422+0000 7fda9bf19800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:13.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.422+0000 7fda9bf19800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18, ofs0, ns] 2024-09-12T00:25:13.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.422+0000 7fd97d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562457 cookie 94213023666464 notifier 8150 bl.length()=821 2024-09-12T00:25:13.421 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.422+0000 7fd97d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:13.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.422+0000 7fd97d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:13.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.422+0000 7fd97d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:13.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.422+0000 7fda9bf19800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_sources= new_sources= 2024-09-12T00:25:13.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.422+0000 7fda9bf19800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential sources added=[] removed=[] 2024-09-12T00:25:13.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.422+0000 7fda9bf19800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_dests= new_dests= 2024-09-12T00:25:13.422 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.422+0000 7fda9bf19800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential dests added=[] removed=[] 2024-09-12T00:25:13.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.0 2024-09-12T00:25:13.425 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.0 2024-09-12T00:25:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.1 2024-09-12T00:25:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.1 2024-09-12T00:25:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.2 2024-09-12T00:25:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.2 2024-09-12T00:25:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.3 2024-09-12T00:25:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.3 2024-09-12T00:25:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.4 2024-09-12T00:25:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.4 2024-09-12T00:25:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.5 2024-09-12T00:25:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.5 2024-09-12T00:25:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.6 2024-09-12T00:25:13.426 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.6 2024-09-12T00:25:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.7 2024-09-12T00:25:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.7 2024-09-12T00:25:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.8 2024-09-12T00:25:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.8 2024-09-12T00:25:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.425+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.10 2024-09-12T00:25:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.10 2024-09-12T00:25:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.11 2024-09-12T00:25:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.11 2024-09-12T00:25:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.12 2024-09-12T00:25:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.12 2024-09-12T00:25:13.427 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.13 2024-09-12T00:25:13.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.13 2024-09-12T00:25:13.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.14 2024-09-12T00:25:13.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.14 2024-09-12T00:25:13.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.15 2024-09-12T00:25:13.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.15 2024-09-12T00:25:13.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.16 2024-09-12T00:25:13.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.16 2024-09-12T00:25:13.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.0 2024-09-12T00:25:13.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.0 2024-09-12T00:25:13.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.1 2024-09-12T00:25:13.428 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.426+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.1 2024-09-12T00:25:13.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.427+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.2 2024-09-12T00:25:13.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.427+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.2 2024-09-12T00:25:13.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.429+0000 7fda9bf19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:13.429 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.429+0000 7fda9bf19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 2024-09-12T00:25:13.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.430+0000 7fda9bf19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:13.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.430+0000 7fda9bf19800 10 moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:13.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.430+0000 7fda9bf19800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:13.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.430+0000 7fda9bf19800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18, ofs0, ns] 2024-09-12T00:25:13.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.431+0000 7fd97d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562458 cookie 94213023666464 notifier 8150 bl.length()=821 2024-09-12T00:25:13.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.431+0000 7fd97d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:13.430 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.431+0000 7fd97d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:13.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.431+0000 7fd97d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:13.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.431+0000 7fda9bf19800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_sources= new_sources= 2024-09-12T00:25:13.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.431+0000 7fda9bf19800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential sources added=[] removed=[] 2024-09-12T00:25:13.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.431+0000 7fda9bf19800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_dests= new_dests= 2024-09-12T00:25:13.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.431+0000 7fda9bf19800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential dests added=[] removed=[] 2024-09-12T00:25:13.431 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.433+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.0 2024-09-12T00:25:13.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.433+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.0 2024-09-12T00:25:13.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.433+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.1 2024-09-12T00:25:13.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.433+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.1 2024-09-12T00:25:13.432 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.433+0000 7fda9bf19800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.2 2024-09-12T00:25:13.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.433+0000 7fda9bf19800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.2.2 2024-09-12T00:25:13.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.434+0000 7fda9bf19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:25:13.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.434+0000 7fda9bf19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 2024-09-12T00:25:13.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.436+0000 7fda9bf19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:13.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.436+0000 7fda9bf19800 10 moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:13.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.436+0000 7fda9bf19800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:13.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.436+0000 7fda9bf19800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18, ofs0, ns] 2024-09-12T00:25:13.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.436+0000 7fd97cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562459 cookie 94213023666464 notifier 8150 bl.length()=789 2024-09-12T00:25:13.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.436+0000 7fd97cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:13.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.436+0000 7fd97cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:13.435 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.436+0000 7fd97cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:13.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.436+0000 7fda9bf19800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_sources= new_sources= 2024-09-12T00:25:13.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.436+0000 7fda9bf19800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential sources added=[] removed=[] 2024-09-12T00:25:13.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.436+0000 7fda9bf19800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): orig_dests= new_dests= 2024-09-12T00:25:13.436 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.436+0000 7fda9bf19800 20 handle_bi_update(): bucket=:myver[ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18]): potential dests added=[] removed=[] 2024-09-12T00:25:13.437 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.438+0000 7fda9bf19800 1 execute INFO: reshard of bucket "myver" from 3 shards to 17 shards completed successfully 2024-09-12T00:25:13.438 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.439+0000 7fd94b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:13.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.442+0000 7fda9bf19800 20 remove_watcher() i=0 2024-09-12T00:25:13.441 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.442+0000 7fda9bf19800 2 removed watcher, disabling cache 2024-09-12T00:25:13.442 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.443+0000 7fda9bf19800 20 remove_watcher() i=1 2024-09-12T00:25:13.443 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.444+0000 7fda9bf19800 20 remove_watcher() i=2 2024-09-12T00:25:13.444 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.445+0000 7fda9bf19800 20 remove_watcher() i=3 2024-09-12T00:25:13.445 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.446+0000 7fda9bf19800 20 remove_watcher() i=4 2024-09-12T00:25:13.446 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.447+0000 7fda9bf19800 20 remove_watcher() i=5 2024-09-12T00:25:13.448 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.449+0000 7fda9bf19800 20 remove_watcher() i=6 2024-09-12T00:25:13.449 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.450+0000 7fda9bf19800 20 remove_watcher() i=7 2024-09-12T00:25:13.461 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:25:13.497 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:13.497 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:13.536 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.537+0000 7ff120e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.539+0000 7ff120e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.539+0000 7ff120e0f800 20 realm 2024-09-12T00:25:13.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.539+0000 7ff120e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.539+0000 7ff120e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.539+0000 7ff120e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:13.538 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.539+0000 7ff120e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.539+0000 7ff120e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.539+0000 7ff120e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.540+0000 7ff120e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:13.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.540+0000 7ff120e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.541+0000 7ff120e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:13.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.541+0000 7ff120e0f800 20 searching for the correct realm 2024-09-12T00:25:13.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.543+0000 7ff11bd91640 0 -- 172.21.15.67:0/804637436 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7ff104075c50 msgr2=0x7ff104068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:13.747 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.748+0000 7ff11cd93640 0 -- 172.21.15.67:0/804637436 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55daab47a110 msgr2=0x55daab47c590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:13.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.752+0000 7ff120e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:13.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.752+0000 7ff120e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:13.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.752+0000 7ff120e0f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:13.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.752+0000 7ff120e0f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:13.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.752+0000 7ff120e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:13.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.752+0000 7ff120e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:13.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.752+0000 7ff120e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.753+0000 7ff120e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.753+0000 7ff120e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.753+0000 7ff120e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:13.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.753+0000 7ff120e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.754+0000 7ff120e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:13.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.754+0000 7ff120e0f800 20 zone default found 2024-09-12T00:25:13.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.754+0000 7ff120e0f800 4 Realm: () 2024-09-12T00:25:13.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.754+0000 7ff120e0f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:13.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.754+0000 7ff120e0f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:13.754 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.754+0000 7ff120e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.754+0000 7ff120e0f800 20 zonegroup default 2024-09-12T00:25:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.754+0000 7ff120e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.754+0000 7ff120e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.754+0000 7ff120e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.754+0000 7ff120e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.754+0000 7ff120e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.755+0000 7ff120e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.755+0000 7ff120e0f800 20 started sync module instance, tier type = 2024-09-12T00:25:13.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.755+0000 7ff120e0f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.765+0000 7ff120e0f800 20 add_watcher() i=0 2024-09-12T00:25:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.765+0000 7ff120e0f800 20 add_watcher() i=1 2024-09-12T00:25:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.765+0000 7ff120e0f800 20 add_watcher() i=2 2024-09-12T00:25:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.765+0000 7ff120e0f800 20 add_watcher() i=3 2024-09-12T00:25:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.765+0000 7ff120e0f800 20 add_watcher() i=4 2024-09-12T00:25:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.765+0000 7ff120e0f800 20 add_watcher() i=5 2024-09-12T00:25:13.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.765+0000 7ff120e0f800 20 add_watcher() i=6 2024-09-12T00:25:13.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.766+0000 7ff120e0f800 20 add_watcher() i=7 2024-09-12T00:25:13.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.766+0000 7ff120e0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:13.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.767+0000 7fefd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.768+0000 7ff120e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.768+0000 7ff120e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.768+0000 7ff120e0f800 5 note: GC not initialized 2024-09-12T00:25:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.768+0000 7fefd1fdb640 20 reqs_thread_entry: start 2024-09-12T00:25:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.768+0000 7ff120e0f800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.768+0000 7ff120e0f800 20 Filter name: none 2024-09-12T00:25:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.768+0000 7fef437fe640 20 reqs_thread_entry: start 2024-09-12T00:25:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.768+0000 7ff120e0f800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:25:13.768 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.768+0000 7ff120e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.769+0000 7ff120e0f800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:25:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.769+0000 7ff120e0f800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:25:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.769+0000 7ff120e0f800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:25:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.769+0000 7ff120e0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 : miss 2024-09-12T00:25:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.769+0000 7ff120e0f800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.769 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.769+0000 7ff120e0f800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:25:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.769+0000 7ff120e0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 info.flags=0x17 2024-09-12T00:25:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.769+0000 7ff120e0f800 10 adding default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 to cache LRU end 2024-09-12T00:25:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.769+0000 7ff120e0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:25:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.769+0000 7ff120e0f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:25:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.770+0000 7ff120e0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18 2024-09-12T00:25:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.770+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.0 2024-09-12T00:25:13.770 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.770+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.0 2024-09-12T00:25:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.770+0000 7ff120e0f800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:25:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.770+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.1 2024-09-12T00:25:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.770+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.1 2024-09-12T00:25:13.771 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.771+0000 7ff120e0f800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:25:13.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.771+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.2 2024-09-12T00:25:13.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.771+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.2 2024-09-12T00:25:13.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.771+0000 7ff120e0f800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:25:13.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.771+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.3 2024-09-12T00:25:13.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.771+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.3 2024-09-12T00:25:13.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.772+0000 7ff120e0f800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:25:13.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.772+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.4 2024-09-12T00:25:13.772 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.772+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.4 2024-09-12T00:25:13.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.773+0000 7ff120e0f800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:25:13.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.773+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.5 2024-09-12T00:25:13.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.773+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.5 2024-09-12T00:25:13.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.773+0000 7ff120e0f800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T00:25:13.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.773+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.6 2024-09-12T00:25:13.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.773+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.6 2024-09-12T00:25:13.773 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.773+0000 7ff120e0f800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:25:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.773+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.7 2024-09-12T00:25:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.773+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.7 2024-09-12T00:25:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.774+0000 7ff120e0f800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:25:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.774+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.8 2024-09-12T00:25:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.774+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.8 2024-09-12T00:25:13.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.775+0000 7ff120e0f800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T00:25:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.775+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.775+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.775+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.10 2024-09-12T00:25:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.775+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.10 2024-09-12T00:25:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.776+0000 7ff120e0f800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:25:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.776+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.11 2024-09-12T00:25:13.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.776+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.11 2024-09-12T00:25:13.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.776+0000 7ff120e0f800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T00:25:13.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.776+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.12 2024-09-12T00:25:13.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.776+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.12 2024-09-12T00:25:13.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.777+0000 7ff120e0f800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T00:25:13.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.777+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.13 2024-09-12T00:25:13.776 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.777+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.13 2024-09-12T00:25:13.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.777+0000 7ff120e0f800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T00:25:13.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.777+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.14 2024-09-12T00:25:13.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.777+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.14 2024-09-12T00:25:13.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.778+0000 7ff120e0f800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T00:25:13.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.778+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.15 2024-09-12T00:25:13.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.778+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.15 2024-09-12T00:25:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.778+0000 7ff120e0f800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T00:25:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.778+0000 7ff120e0f800 10 bucket_obj is .dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.16 2024-09-12T00:25:13.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.778+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.16 2024-09-12T00:25:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.779+0000 7ff120e0f800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T00:25:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.779+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.780+0000 7ff120e0f800 20 get_obj_state: octx=0x55daab206d80 obj=myver:x state=0x55daab4b7ad8 s->prefetch_data=0 2024-09-12T00:25:13.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.780+0000 7ff120e0f800 20 get_obj_state: setting s->obj_tag to quew4zncr2d34l19npbrwaydjbbqz62r 2024-09-12T00:25:13.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.780+0000 7ff120e0f800 20 get_obj_state_impl: setting s->olh_tag to 0bx6fxkp8xyjt00psm10yzs3obestdds 2024-09-12T00:25:13.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.780+0000 7ff120e0f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0bx6fxkp8xyjt00psm10yzs3obestdds 2024-09-12T00:25:13.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.782+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.783+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.784+0000 7ff120e0f800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T00:25:13.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.784+0000 7ff120e0f800 20 olh_log_entry: epoch=2 op=3 key=x[U2GQERcjUyYI2Wqsz57n3Zy5qKv.NLQ] 2024-09-12T00:25:13.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.784+0000 7ff120e0f800 20 get_obj_state: octx=0x55daab206d80 obj=myver:_:U2GQERcjUyYI2Wqsz57n3Zy5qKv.NLQ_x state=0x55daab4f55b8 s->prefetch_data=0 2024-09-12T00:25:13.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.784+0000 7ff120e0f800 10 manifest: total_size = 11 2024-09-12T00:25:13.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.784+0000 7ff120e0f800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17689624071344337603 2024-09-12T00:25:13.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.784+0000 7ff120e0f800 20 get_obj_state: octx=0x55daab206d80 obj=myver:_:U2GQERcjUyYI2Wqsz57n3Zy5qKv.NLQ_x state=0x55daab4f55b8 s->prefetch_data=0 2024-09-12T00:25:13.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.784+0000 7ff120e0f800 20 prepare_atomic_modification: state is not atomic. state=0x55daab4f55b8 2024-09-12T00:25:13.784 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.784+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.787+0000 7ff120e0f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:25:13.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.787+0000 7ff120e0f800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:25:13.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.787+0000 7ff120e0f800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:25:13.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.787+0000 7ff120e0f800 5 delete_objs_inline: removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18__shadow:U2GQERcjUyYI2Wqsz57n3Zy5qKv.NLQ_.ewiQBfzBNALco-eIGqXI93FEuLhbhc1_0 2024-09-12T00:25:13.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.788+0000 7feff37fe640 20 handle_completion(): completion ok for obj=x[U2GQERcjUyYI2Wqsz57n3Zy5qKv.NLQ] 2024-09-12T00:25:13.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.788+0000 7ff120e0f800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:25:13.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.789+0000 7ff120e0f800 20 get_obj_state: octx=0x55daab206d80 obj=myver:x state=0x55daab4b7ad8 s->prefetch_data=0 2024-09-12T00:25:13.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.789+0000 7ff120e0f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0bx6fxkp8xyjt00psm10yzs3obestdds 2024-09-12T00:25:13.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.792+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.793+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.794+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.794+0000 7ff120e0f800 20 get_obj_state: octx=0x55daab206d80 obj=myver:y state=0x55daab4f9c38 s->prefetch_data=0 2024-09-12T00:25:13.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.794+0000 7ff120e0f800 20 get_obj_state: setting s->obj_tag to 2dalac1oe8ga77yqppi4i0xouo2gc4or 2024-09-12T00:25:13.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.794+0000 7ff120e0f800 20 get_obj_state_impl: setting s->olh_tag to vn0lhyrntrh7yl5dppin7mr6n795shil 2024-09-12T00:25:13.794 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.794+0000 7ff120e0f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vn0lhyrntrh7yl5dppin7mr6n795shil 2024-09-12T00:25:13.795 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.796+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.796 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.797+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.797+0000 7ff120e0f800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T00:25:13.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.797+0000 7ff120e0f800 20 olh_log_entry: epoch=2 op=3 key=y[-GeDL5SFmZ1GXLu.clzbEugeYfpSU5T] 2024-09-12T00:25:13.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.798+0000 7ff120e0f800 20 get_obj_state: octx=0x55daab206d80 obj=myver:_:-GeDL5SFmZ1GXLu.clzbEugeYfpSU5T_y state=0x55daab4b8ae8 s->prefetch_data=0 2024-09-12T00:25:13.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.798+0000 7ff120e0f800 10 manifest: total_size = 12 2024-09-12T00:25:13.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.798+0000 7ff120e0f800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17922886758131233212 2024-09-12T00:25:13.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.798+0000 7ff120e0f800 20 get_obj_state: octx=0x55daab206d80 obj=myver:_:-GeDL5SFmZ1GXLu.clzbEugeYfpSU5T_y state=0x55daab4b8ae8 s->prefetch_data=0 2024-09-12T00:25:13.797 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.798+0000 7ff120e0f800 20 prepare_atomic_modification: state is not atomic. state=0x55daab4b8ae8 2024-09-12T00:25:13.798 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.798+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.800+0000 7ff120e0f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:25:13.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.800+0000 7ff120e0f800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:25:13.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.800+0000 7ff120e0f800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:25:13.800 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.800+0000 7ff120e0f800 5 delete_objs_inline: removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18__shadow:-GeDL5SFmZ1GXLu.clzbEugeYfpSU5T_.uJtfDo-zcuYxSV2Pig3fDNDGyxI3wmw_0 2024-09-12T00:25:13.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.802+0000 7feff37fe640 20 handle_completion(): completion ok for obj=y[-GeDL5SFmZ1GXLu.clzbEugeYfpSU5T] 2024-09-12T00:25:13.801 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.802+0000 7ff120e0f800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:25:13.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.803+0000 7ff120e0f800 20 get_obj_state: octx=0x55daab206d80 obj=myver:y state=0x55daab4f9c38 s->prefetch_data=0 2024-09-12T00:25:13.802 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.803+0000 7ff120e0f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vn0lhyrntrh7yl5dppin7mr6n795shil 2024-09-12T00:25:13.805 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.806+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.806 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.807+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.808+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.808+0000 7ff120e0f800 20 get_obj_state: octx=0x55daab206d80 obj=myver:z state=0x55daab4f9c38 s->prefetch_data=0 2024-09-12T00:25:13.807 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.808+0000 7ff120e0f800 20 get_obj_state: setting s->obj_tag to gkvslpfxxd901run6x1m8qtbfazkifh5 2024-09-12T00:25:13.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.808+0000 7ff120e0f800 20 get_obj_state_impl: setting s->olh_tag to 6zbq1p1kssteyqn85vtpl3m9aszr5o1d 2024-09-12T00:25:13.808 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.808+0000 7ff120e0f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6zbq1p1kssteyqn85vtpl3m9aszr5o1d 2024-09-12T00:25:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.810+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.811+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.811+0000 7ff120e0f800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T00:25:13.810 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.811+0000 7ff120e0f800 20 olh_log_entry: epoch=2 op=3 key=z[UiEJZcP5Sq.8lTg0uHQtpdgUMLkf.Q2] 2024-09-12T00:25:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.811+0000 7ff120e0f800 20 get_obj_state: octx=0x55daab206d80 obj=myver:_:UiEJZcP5Sq.8lTg0uHQtpdgUMLkf.Q2_z state=0x55daab4b8ae8 s->prefetch_data=0 2024-09-12T00:25:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.812+0000 7ff120e0f800 10 manifest: total_size = 22 2024-09-12T00:25:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.812+0000 7ff120e0f800 20 get_obj_state: setting s->obj_tag to ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6247207483501796857 2024-09-12T00:25:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.812+0000 7ff120e0f800 20 get_obj_state: octx=0x55daab206d80 obj=myver:_:UiEJZcP5Sq.8lTg0uHQtpdgUMLkf.Q2_z state=0x55daab4b8ae8 s->prefetch_data=0 2024-09-12T00:25:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.812+0000 7ff120e0f800 20 prepare_atomic_modification: state is not atomic. state=0x55daab4b8ae8 2024-09-12T00:25:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.812+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.814+0000 7ff120e0f800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:25:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.814+0000 7ff120e0f800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:25:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.814+0000 7ff120e0f800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:25:13.813 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.814+0000 7ff120e0f800 5 delete_objs_inline: removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18__shadow:UiEJZcP5Sq.8lTg0uHQtpdgUMLkf.Q2_.TJcOv5OigieOgbj21DaLjDyH5v5OIzx_0 2024-09-12T00:25:13.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.815+0000 7feff37fe640 20 handle_completion(): completion ok for obj=z[UiEJZcP5Sq.8lTg0uHQtpdgUMLkf.Q2] 2024-09-12T00:25:13.814 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.815+0000 7ff120e0f800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:25:13.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.817+0000 7ff120e0f800 20 get_obj_state: octx=0x55daab206d80 obj=myver:z state=0x55daab4f9c38 s->prefetch_data=0 2024-09-12T00:25:13.816 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.817+0000 7ff120e0f800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6zbq1p1kssteyqn85vtpl3m9aszr5o1d 2024-09-12T00:25:13.819 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.820+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.821+0000 7ff120e0f800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18.3.9 2024-09-12T00:25:13.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.821+0000 7ff120e0f800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T00:25:13.820 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.821+0000 7ff120e0f800 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T00:25:13.821 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.822+0000 7fefd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:13.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.824+0000 7ff120e0f800 20 remove_watcher() i=0 2024-09-12T00:25:13.823 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.824+0000 7ff120e0f800 2 removed watcher, disabling cache 2024-09-12T00:25:13.824 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.825+0000 7ff120e0f800 20 remove_watcher() i=1 2024-09-12T00:25:13.825 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.826+0000 7ff120e0f800 20 remove_watcher() i=2 2024-09-12T00:25:13.826 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.827+0000 7ff120e0f800 20 remove_watcher() i=3 2024-09-12T00:25:13.827 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.828+0000 7ff120e0f800 20 remove_watcher() i=4 2024-09-12T00:25:13.828 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.829+0000 7ff120e0f800 20 remove_watcher() i=5 2024-09-12T00:25:13.830 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.831+0000 7ff120e0f800 20 remove_watcher() i=6 2024-09-12T00:25:13.831 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.832+0000 7ff120e0f800 20 remove_watcher() i=7 2024-09-12T00:25:13.893 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:25:13.922 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:13.922 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:13.962 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.962+0000 7fc59b144800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.963 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.964+0000 7fc59b144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.964+0000 7fc59b144800 20 realm 2024-09-12T00:25:13.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.964+0000 7fc59b144800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.964+0000 7fc59b144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.964+0000 7fc59b144800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:13.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.964+0000 7fc59b144800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.965+0000 7fc59b144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:13.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.965+0000 7fc59b144800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.964 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.965+0000 7fc59b144800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:13.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.965+0000 7fc59b144800 20 rados->read ofs=0 len=0 2024-09-12T00:25:13.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.966+0000 7fc59b144800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:13.965 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.966+0000 7fc59b144800 20 searching for the correct realm 2024-09-12T00:25:13.967 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:13.968+0000 7fc596ef4640 0 -- 172.21.15.67:0/3405933267 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7fc588048040 msgr2=0x7fc588039400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:14.173 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.174+0000 7fc596ef4640 0 -- 172.21.15.67:0/3405933267 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fc590061030 msgr2=0x7fc5900850b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:14.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.381+0000 7fc59b144800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.381+0000 7fc59b144800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.381+0000 7fc59b144800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.381+0000 7fc59b144800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.381+0000 7fc59b144800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.381+0000 7fc59b144800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.381+0000 7fc59b144800 20 rados->read ofs=0 len=0 2024-09-12T00:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.381+0000 7fc59b144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:14.381 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.381+0000 7fc59b144800 20 rados->read ofs=0 len=0 2024-09-12T00:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.382+0000 7fc59b144800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.382+0000 7fc59b144800 20 rados->read ofs=0 len=0 2024-09-12T00:25:14.382 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.382+0000 7fc59b144800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.382+0000 7fc59b144800 20 zone default found 2024-09-12T00:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.382+0000 7fc59b144800 4 Realm: () 2024-09-12T00:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.382+0000 7fc59b144800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.382+0000 7fc59b144800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.382+0000 7fc59b144800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.382+0000 7fc59b144800 20 zonegroup default 2024-09-12T00:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.382+0000 7fc59b144800 20 rados->read ofs=0 len=0 2024-09-12T00:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.382+0000 7fc59b144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.382+0000 7fc59b144800 20 rados->read ofs=0 len=0 2024-09-12T00:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.383+0000 7fc59b144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.383+0000 7fc59b144800 20 rados->read ofs=0 len=0 2024-09-12T00:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.383+0000 7fc59b144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:14.383 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.383+0000 7fc59b144800 20 started sync module instance, tier type = 2024-09-12T00:25:14.384 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.383+0000 7fc59b144800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.396+0000 7fc59b144800 20 add_watcher() i=0 2024-09-12T00:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.396+0000 7fc59b144800 20 add_watcher() i=1 2024-09-12T00:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.396+0000 7fc59b144800 20 add_watcher() i=2 2024-09-12T00:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.396+0000 7fc59b144800 20 add_watcher() i=3 2024-09-12T00:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.396+0000 7fc59b144800 20 add_watcher() i=4 2024-09-12T00:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.396+0000 7fc59b144800 20 add_watcher() i=5 2024-09-12T00:25:14.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.396+0000 7fc59b144800 20 add_watcher() i=6 2024-09-12T00:25:14.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.398+0000 7fc59b144800 20 add_watcher() i=7 2024-09-12T00:25:14.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.398+0000 7fc59b144800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.400+0000 7fc44d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.400+0000 7fc59b144800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.400+0000 7fc59b144800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:14.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.400+0000 7fc59b144800 5 note: GC not initialized 2024-09-12T00:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.400+0000 7fc3c7fff640 20 reqs_thread_entry: start 2024-09-12T00:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.401+0000 7fc59b144800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.401+0000 7fc59b144800 20 Filter name: none 2024-09-12T00:25:14.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.401+0000 7fc3c5ffb640 20 reqs_thread_entry: start 2024-09-12T00:25:14.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.401+0000 7fc59b144800 20 rados->read ofs=0 len=0 2024-09-12T00:25:14.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.401+0000 7fc59b144800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.401+0000 7fc59b144800 20 rados->read ofs=0 len=0 2024-09-12T00:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.402+0000 7fc59b144800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.402+0000 7fc59b144800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.402+0000 7fc59b144800 20 rados->read ofs=0 len=0 2024-09-12T00:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.402+0000 7fc59b144800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.402+0000 7fc59b144800 20 rados->read ofs=0 len=0 2024-09-12T00:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.403+0000 7fc59b144800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:25:14.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.403+0000 7fc59b144800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:25:14.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.405+0000 7fc44d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:14.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.407+0000 7fc59b144800 20 remove_watcher() i=0 2024-09-12T00:25:14.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.407+0000 7fc59b144800 2 removed watcher, disabling cache 2024-09-12T00:25:14.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.409+0000 7fc59b144800 20 remove_watcher() i=1 2024-09-12T00:25:14.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.410+0000 7fc59b144800 20 remove_watcher() i=2 2024-09-12T00:25:14.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.411+0000 7fc59b144800 20 remove_watcher() i=3 2024-09-12T00:25:14.411 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.412+0000 7fc59b144800 20 remove_watcher() i=4 2024-09-12T00:25:14.413 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.414+0000 7fc59b144800 20 remove_watcher() i=5 2024-09-12T00:25:14.416 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.417+0000 7fc59b144800 20 remove_watcher() i=6 2024-09-12T00:25:14.418 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:25:14.419+0000 7fc59b144800 20 remove_watcher() i=7 2024-09-12T00:25:14.431 INFO:tasks.workunit.client.0.smithi067.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:25:14.432 INFO:tasks.workunit.client.0.smithi067.stderr:Deleting bucket a-bucket 2024-09-12T00:25:14.453 INFO:tasks.workunit.client.0.smithi067.stderr:Deleting bucket myver 2024-09-12T00:25:14.538 INFO:tasks.workunit.client.0.smithi067.stderr:Completed resharding tests 2024-09-12T00:25:14.538 INFO:tasks.workunit.client.0.smithi067.stdout:connected to http://localhost:80 2024-09-12T00:25:14.619 INFO:tasks.workunit.client.0.smithi067.stderr:+ deactivate 2024-09-12T00:25:14.619 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:25:14.619 INFO:tasks.workunit.client.0.smithi067.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:25:14.619 INFO:tasks.workunit.client.0.smithi067.stderr:+ export PATH 2024-09-12T00:25:14.619 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:25:14.619 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n '' ']' 2024-09-12T00:25:14.620 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:25:14.620 INFO:tasks.workunit.client.0.smithi067.stderr:+ hash -r 2024-09-12T00:25:14.620 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n '' ']' 2024-09-12T00:25:14.620 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:25:14.620 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:25:14.620 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset -f deactivate 2024-09-12T00:25:14.620 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo OK. 2024-09-12T00:25:14.621 INFO:tasks.workunit.client.0.smithi067.stdout:OK. 2024-09-12T00:25:14.621 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:25:14.622 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:25:14.702 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T00:25:14.702 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:25:15.146 DEBUG:teuthology.parallel:result is None 2024-09-12T00:25:15.147 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:25:15.187 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:25:15.187 DEBUG:teuthology.orchestra.run.smithi067:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:25:15.257 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:25:15.257 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T00:25:15.288 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T00:25:15.289 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T00:25:15.289 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T00:25:15.289 DEBUG:teuthology.orchestra.run.smithi067:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T00:25:15.327 INFO:teuthology.orchestra.run.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T00:25:20.105 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T00:25:20.105 DEBUG:teuthology.orchestra.run.smithi067:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T00:25:22.234 INFO:teuthology.orchestra.run.smithi067.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-12T00:25:22.826 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:26:37 ago on Wed 11 Sep 2024 11:58:45 PM UTC. 2024-09-12T00:25:22.975 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2024-09-12T00:25:22.976 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-09-12T00:25:22.976 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2024-09-12T00:25:22.976 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-09-12T00:25:22.976 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2024-09-12T00:25:22.976 INFO:teuthology.orchestra.run.smithi067.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-12T00:25:22.976 INFO:teuthology.orchestra.run.smithi067.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-12T00:25:22.976 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2024-09-12T00:25:22.976 INFO:teuthology.orchestra.run.smithi067.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-12T00:25:22.976 INFO:teuthology.orchestra.run.smithi067.stdout:Installing weak dependencies: 2024-09-12T00:25:22.976 INFO:teuthology.orchestra.run.smithi067.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-12T00:25:22.977 INFO:teuthology.orchestra.run.smithi067.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-12T00:25:22.977 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:25:22.977 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2024-09-12T00:25:22.977 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2024-09-12T00:25:22.977 INFO:teuthology.orchestra.run.smithi067.stdout:Install 5 Packages 2024-09-12T00:25:22.977 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:25:22.978 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 46 M 2024-09-12T00:25:22.978 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 166 M 2024-09-12T00:25:22.978 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2024-09-12T00:25:23.514 INFO:teuthology.orchestra.run.smithi067.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.6 MB/s | 426 kB 00:00 2024-09-12T00:25:23.706 INFO:teuthology.orchestra.run.smithi067.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 7.8 MB/s | 3.5 MB 00:00 2024-09-12T00:25:23.881 INFO:teuthology.orchestra.run.smithi067.stdout:(3/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 15 MB/s | 9.3 MB 00:00 2024-09-12T00:25:23.906 INFO:teuthology.orchestra.run.smithi067.stdout:(4/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 129 kB/s | 26 kB 00:00 2024-09-12T00:25:24.482 INFO:teuthology.orchestra.run.smithi067.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 33 MB/s | 32 MB 00:00 2024-09-12T00:25:24.482 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:25:24.482 INFO:teuthology.orchestra.run.smithi067.stdout:Total 30 MB/s | 46 MB 00:01 2024-09-12T00:25:24.921 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2024-09-12T00:25:24.945 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2024-09-12T00:25:24.945 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2024-09-12T00:25:25.453 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2024-09-12T00:25:25.453 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2024-09-12T00:25:25.987 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-12T00:25:26.144 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2024-09-12T00:25:26.349 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-12T00:25:26.994 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-12T00:25:27.035 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T00:25:27.281 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T00:25:27.319 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T00:25:27.561 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T00:25:27.607 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:25:27.615 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:25:27.624 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-12T00:25:27.667 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-12T00:25:30.275 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:25:30.275 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-12T00:25:30.275 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-12T00:25:30.275 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-12T00:25:30.275 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-12T00:25:30.712 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-12T00:25:30.713 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:25:30.713 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2024-09-12T00:25:30.713 INFO:teuthology.orchestra.run.smithi067.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-12T00:25:30.713 INFO:teuthology.orchestra.run.smithi067.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:25:30.713 INFO:teuthology.orchestra.run.smithi067.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:25:30.713 INFO:teuthology.orchestra.run.smithi067.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:25:30.713 INFO:teuthology.orchestra.run.smithi067.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-12T00:25:30.713 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:25:30.713 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2024-09-12T00:25:31.142 INFO:teuthology.orchestra.run.smithi067.stdout: Gradle will be installed under /opt/gradle 2024-09-12T00:25:31.209 INFO:teuthology.orchestra.run.smithi067.stderr:--2024-09-12 00:25:31-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T00:25:31.574 INFO:teuthology.orchestra.run.smithi067.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-12T00:25:31.583 INFO:teuthology.orchestra.run.smithi067.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-12T00:25:31.675 INFO:teuthology.orchestra.run.smithi067.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T00:25:31.675 INFO:teuthology.orchestra.run.smithi067.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T00:25:31.675 INFO:teuthology.orchestra.run.smithi067.stderr:--2024-09-12 00:25:31-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T00:25:31.693 INFO:teuthology.orchestra.run.smithi067.stderr:Resolving github.com (github.com)... 140.82.114.4 2024-09-12T00:25:31.704 INFO:teuthology.orchestra.run.smithi067.stderr:Connecting to github.com (github.com)|140.82.114.4|:443... connected. 2024-09-12T00:25:31.854 INFO:teuthology.orchestra.run.smithi067.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T00:25:31.854 INFO:teuthology.orchestra.run.smithi067.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T002531Z&X-Amz-Expires=300&X-Amz-Signature=402a10026e58e52968fe50df8efda7bae0de8f3c91f223724e0b1c0c52af52ca&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T00:25:31.854 INFO:teuthology.orchestra.run.smithi067.stderr:--2024-09-12 00:25:31-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T002531Z&X-Amz-Expires=300&X-Amz-Signature=402a10026e58e52968fe50df8efda7bae0de8f3c91f223724e0b1c0c52af52ca&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T00:25:31.869 INFO:teuthology.orchestra.run.smithi067.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.111.133, 185.199.110.133, ... 2024-09-12T00:25:31.882 INFO:teuthology.orchestra.run.smithi067.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-09-12T00:25:31.973 INFO:teuthology.orchestra.run.smithi067.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T00:25:31.973 INFO:teuthology.orchestra.run.smithi067.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T00:25:31.973 INFO:teuthology.orchestra.run.smithi067.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-12T00:25:31.974 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T00:25:31.990 INFO:teuthology.orchestra.run.smithi067.stderr: 0K .......... .......... .......... .......... .......... 0% 2.90M 31s 2024-09-12T00:25:32.002 INFO:teuthology.orchestra.run.smithi067.stderr: 50K .......... .......... .......... .......... .......... 0% 3.76M 28s 2024-09-12T00:25:32.011 INFO:teuthology.orchestra.run.smithi067.stderr: 100K .......... .......... .......... .......... .......... 0% 5.18M 24s 2024-09-12T00:25:32.014 INFO:teuthology.orchestra.run.smithi067.stderr: 150K .......... .......... .......... .......... .......... 0% 20.7M 19s 2024-09-12T00:25:32.016 INFO:teuthology.orchestra.run.smithi067.stderr: 200K .......... .......... .......... .......... .......... 0% 22.7M 16s 2024-09-12T00:25:32.024 INFO:teuthology.orchestra.run.smithi067.stderr: 250K .......... .......... .......... .......... .......... 0% 35.2M 14s 2024-09-12T00:25:32.025 INFO:teuthology.orchestra.run.smithi067.stderr: 300K .......... .......... .......... .......... .......... 0% 7.09M 14s 2024-09-12T00:25:32.026 INFO:teuthology.orchestra.run.smithi067.stderr: 350K .......... .......... .......... .......... .......... 0% 30.7M 12s 2024-09-12T00:25:32.027 INFO:teuthology.orchestra.run.smithi067.stderr: 400K .......... .......... .......... .......... .......... 0% 46.0M 11s 2024-09-12T00:25:32.029 INFO:teuthology.orchestra.run.smithi067.stderr: 450K .......... .......... .......... .......... .......... 0% 41.9M 10s 2024-09-12T00:25:32.030 INFO:teuthology.orchestra.run.smithi067.stderr: 500K .......... .......... .......... .......... .......... 0% 40.2M 10s 2024-09-12T00:25:32.045 INFO:teuthology.orchestra.run.smithi067.stderr: 550K .......... .......... .......... .......... .......... 0% 8.21M 10s 2024-09-12T00:25:32.046 INFO:teuthology.orchestra.run.smithi067.stderr: 600K .......... .......... .......... .......... .......... 0% 80.0M 9s 2024-09-12T00:25:32.046 INFO:teuthology.orchestra.run.smithi067.stderr: 650K .......... .......... .......... .......... .......... 0% 77.7M 8s 2024-09-12T00:25:32.046 INFO:teuthology.orchestra.run.smithi067.stderr: 700K .......... .......... .......... .......... .......... 0% 45.8M 8s 2024-09-12T00:25:32.046 INFO:teuthology.orchestra.run.smithi067.stderr: 750K .......... .......... .......... .......... .......... 0% 82.0M 8s 2024-09-12T00:25:32.047 INFO:teuthology.orchestra.run.smithi067.stderr: 800K .......... .......... .......... .......... .......... 0% 78.4M 7s 2024-09-12T00:25:32.047 INFO:teuthology.orchestra.run.smithi067.stderr: 850K .......... .......... .......... .......... .......... 0% 306M 7s 2024-09-12T00:25:32.047 INFO:teuthology.orchestra.run.smithi067.stderr: 900K .......... .......... .......... .......... .......... 1% 33.2M 7s 2024-09-12T00:25:32.047 INFO:teuthology.orchestra.run.smithi067.stderr: 950K .......... .......... .......... .......... .......... 1% 196M 6s 2024-09-12T00:25:32.047 INFO:teuthology.orchestra.run.smithi067.stderr: 1000K .......... .......... .......... .......... .......... 1% 58.7M 6s 2024-09-12T00:25:32.047 INFO:teuthology.orchestra.run.smithi067.stderr: 1050K .......... .......... .......... .......... .......... 1% 234M 6s 2024-09-12T00:25:32.047 INFO:teuthology.orchestra.run.smithi067.stderr: 1100K .......... .......... .......... .......... .......... 1% 105M 6s 2024-09-12T00:25:33.566 INFO:teuthology.orchestra.run.smithi067.stderr: 1150K .......... .......... .......... .......... .......... 1% 8.86M 6s 2024-09-12T00:25:33.566 INFO:teuthology.orchestra.run.smithi067.stderr: 1200K .......... .......... .......... .......... .......... 1% 282M 6s 2024-09-12T00:25:33.567 INFO:teuthology.orchestra.run.smithi067.stderr: 1250K .......... .......... .......... .......... .......... 1% 70.1M 5s 2024-09-12T00:25:33.567 INFO:teuthology.orchestra.run.smithi067.stderr: 1300K .......... .......... .......... .......... .......... 1% 181M 5s 2024-09-12T00:25:33.567 INFO:teuthology.orchestra.run.smithi067.stderr: 1350K .......... .......... .......... .......... .......... 1% 306M 5s 2024-09-12T00:25:33.567 INFO:teuthology.orchestra.run.smithi067.stderr: 1400K .......... .......... .......... .......... .......... 1% 76.8M 5s 2024-09-12T00:25:33.567 INFO:teuthology.orchestra.run.smithi067.stderr: 1450K .......... .......... .......... .......... .......... 1% 227M 5s 2024-09-12T00:25:33.567 INFO:teuthology.orchestra.run.smithi067.stderr: 1500K .......... .......... .......... .......... .......... 1% 110M 5s 2024-09-12T00:25:33.567 INFO:teuthology.orchestra.run.smithi067.stderr: 1550K .......... .......... .......... .......... .......... 1% 270M 4s 2024-09-12T00:25:33.567 INFO:teuthology.orchestra.run.smithi067.stderr: 1600K .......... .......... .......... .......... .......... 1% 135M 4s 2024-09-12T00:25:33.567 INFO:teuthology.orchestra.run.smithi067.stderr: 1650K .......... .......... .......... .......... .......... 1% 85.1M 4s 2024-09-12T00:25:33.567 INFO:teuthology.orchestra.run.smithi067.stderr: 1700K .......... .......... .......... .......... .......... 1% 220M 4s 2024-09-12T00:25:33.567 INFO:teuthology.orchestra.run.smithi067.stderr: 1750K .......... .......... .......... .......... .......... 1% 297M 4s 2024-09-12T00:25:33.567 INFO:teuthology.orchestra.run.smithi067.stderr: 1800K .......... .......... .......... .......... .......... 1% 77.6M 4s 2024-09-12T00:25:33.568 INFO:teuthology.orchestra.run.smithi067.stderr: 1850K .......... .......... .......... .......... .......... 2% 229M 4s 2024-09-12T00:25:33.568 INFO:teuthology.orchestra.run.smithi067.stderr: 1900K .......... .......... .......... .......... .......... 2% 137M 4s 2024-09-12T00:25:33.568 INFO:teuthology.orchestra.run.smithi067.stderr: 1950K .......... .......... .......... .......... .......... 2% 161M 4s 2024-09-12T00:25:33.568 INFO:teuthology.orchestra.run.smithi067.stderr: 2000K .......... .......... .......... .......... .......... 2% 313M 4s 2024-09-12T00:25:33.568 INFO:teuthology.orchestra.run.smithi067.stderr: 2050K .......... .......... .......... .......... .......... 2% 148M 4s 2024-09-12T00:25:33.568 INFO:teuthology.orchestra.run.smithi067.stderr: 2100K .......... .......... .......... .......... .......... 2% 151M 3s 2024-09-12T00:25:33.568 INFO:teuthology.orchestra.run.smithi067.stderr: 2150K .......... .......... .......... .......... .......... 2% 103M 3s 2024-09-12T00:25:33.568 INFO:teuthology.orchestra.run.smithi067.stderr: 2200K .......... .......... .......... .......... .......... 2% 252M 3s 2024-09-12T00:25:33.568 INFO:teuthology.orchestra.run.smithi067.stderr: 2250K .......... .......... .......... .......... .......... 2% 319M 3s 2024-09-12T00:25:33.568 INFO:teuthology.orchestra.run.smithi067.stderr: 2300K .......... .......... .......... .......... .......... 2% 9.76M 3s 2024-09-12T00:25:33.568 INFO:teuthology.orchestra.run.smithi067.stderr: 2350K .......... .......... .......... .......... .......... 2% 311M 3s 2024-09-12T00:25:33.568 INFO:teuthology.orchestra.run.smithi067.stderr: 2400K .......... .......... .......... .......... .......... 2% 277M 3s 2024-09-12T00:25:33.568 INFO:teuthology.orchestra.run.smithi067.stderr: 2450K .......... .......... .......... .......... .......... 2% 273M 3s 2024-09-12T00:25:33.569 INFO:teuthology.orchestra.run.smithi067.stderr: 2500K .......... .......... .......... .......... .......... 2% 236M 3s 2024-09-12T00:25:33.569 INFO:teuthology.orchestra.run.smithi067.stderr: 2550K .......... .......... .......... .......... .......... 2% 117M 3s 2024-09-12T00:25:33.569 INFO:teuthology.orchestra.run.smithi067.stderr: 2600K .......... .......... .......... .......... .......... 2% 268M 3s 2024-09-12T00:25:33.569 INFO:teuthology.orchestra.run.smithi067.stderr: 2650K .......... .......... .......... .......... .......... 2% 301M 3s 2024-09-12T00:25:33.569 INFO:teuthology.orchestra.run.smithi067.stderr: 2700K .......... .......... .......... .......... .......... 2% 226M 3s 2024-09-12T00:25:33.569 INFO:teuthology.orchestra.run.smithi067.stderr: 2750K .......... .......... .......... .......... .......... 3% 224M 3s 2024-09-12T00:25:33.569 INFO:teuthology.orchestra.run.smithi067.stderr: 2800K .......... .......... .......... .......... .......... 3% 100M 3s 2024-09-12T00:25:33.569 INFO:teuthology.orchestra.run.smithi067.stderr: 2850K .......... .......... .......... .......... .......... 3% 294M 3s 2024-09-12T00:25:33.569 INFO:teuthology.orchestra.run.smithi067.stderr: 2900K .......... .......... .......... .......... .......... 3% 237M 3s 2024-09-12T00:25:33.569 INFO:teuthology.orchestra.run.smithi067.stderr: 2950K .......... .......... .......... .......... .......... 3% 311M 3s 2024-09-12T00:25:33.569 INFO:teuthology.orchestra.run.smithi067.stderr: 3000K .......... .......... .......... .......... .......... 3% 300M 3s 2024-09-12T00:25:33.569 INFO:teuthology.orchestra.run.smithi067.stderr: 3050K .......... .......... .......... .......... .......... 3% 306M 3s 2024-09-12T00:25:33.569 INFO:teuthology.orchestra.run.smithi067.stderr: 3100K .......... .......... .......... .......... .......... 3% 260M 3s 2024-09-12T00:25:33.570 INFO:teuthology.orchestra.run.smithi067.stderr: 3150K .......... .......... .......... .......... .......... 3% 124M 3s 2024-09-12T00:25:33.570 INFO:teuthology.orchestra.run.smithi067.stderr: 3200K .......... .......... .......... .......... .......... 3% 275M 3s 2024-09-12T00:25:33.570 INFO:teuthology.orchestra.run.smithi067.stderr: 3250K .......... .......... .......... .......... .......... 3% 229M 2s 2024-09-12T00:25:33.570 INFO:teuthology.orchestra.run.smithi067.stderr: 3300K .......... .......... .......... .......... .......... 3% 288M 2s 2024-09-12T00:25:33.570 INFO:teuthology.orchestra.run.smithi067.stderr: 3350K .......... .......... .......... .......... .......... 3% 323M 2s 2024-09-12T00:25:33.570 INFO:teuthology.orchestra.run.smithi067.stderr: 3400K .......... .......... .......... .......... .......... 3% 355M 2s 2024-09-12T00:25:33.570 INFO:teuthology.orchestra.run.smithi067.stderr: 3450K .......... .......... .......... .......... .......... 3% 207M 2s 2024-09-12T00:25:33.570 INFO:teuthology.orchestra.run.smithi067.stderr: 3500K .......... .......... .......... .......... .......... 3% 224M 2s 2024-09-12T00:25:33.570 INFO:teuthology.orchestra.run.smithi067.stderr: 3550K .......... .......... .......... .......... .......... 3% 244M 2s 2024-09-12T00:25:33.570 INFO:teuthology.orchestra.run.smithi067.stderr: 3600K .......... .......... .......... .......... .......... 3% 170M 2s 2024-09-12T00:25:33.570 INFO:teuthology.orchestra.run.smithi067.stderr: 3650K .......... .......... .......... .......... .......... 3% 256M 2s 2024-09-12T00:25:33.570 INFO:teuthology.orchestra.run.smithi067.stderr: 3700K .......... .......... .......... .......... .......... 4% 264M 2s 2024-09-12T00:25:33.570 INFO:teuthology.orchestra.run.smithi067.stderr: 3750K .......... .......... .......... .......... .......... 4% 254M 2s 2024-09-12T00:25:33.570 INFO:teuthology.orchestra.run.smithi067.stderr: 3800K .......... .......... .......... .......... .......... 4% 285M 2s 2024-09-12T00:25:33.570 INFO:teuthology.orchestra.run.smithi067.stderr: 3850K .......... .......... .......... .......... .......... 4% 307M 2s 2024-09-12T00:25:33.571 INFO:teuthology.orchestra.run.smithi067.stderr: 3900K .......... .......... .......... .......... .......... 4% 130M 2s 2024-09-12T00:25:33.571 INFO:teuthology.orchestra.run.smithi067.stderr: 3950K .......... .......... .......... .......... .......... 4% 304M 2s 2024-09-12T00:25:33.571 INFO:teuthology.orchestra.run.smithi067.stderr: 4000K .......... .......... .......... .......... .......... 4% 285M 2s 2024-09-12T00:25:33.571 INFO:teuthology.orchestra.run.smithi067.stderr: 4050K .......... .......... .......... .......... .......... 4% 303M 2s 2024-09-12T00:25:33.571 INFO:teuthology.orchestra.run.smithi067.stderr: 4100K .......... .......... .......... .......... .......... 4% 299M 2s 2024-09-12T00:25:33.571 INFO:teuthology.orchestra.run.smithi067.stderr: 4150K .......... .......... .......... .......... .......... 4% 250M 2s 2024-09-12T00:25:33.571 INFO:teuthology.orchestra.run.smithi067.stderr: 4200K .......... .......... .......... .......... .......... 4% 256M 2s 2024-09-12T00:25:33.571 INFO:teuthology.orchestra.run.smithi067.stderr: 4250K .......... .......... .......... .......... .......... 4% 301M 2s 2024-09-12T00:25:33.571 INFO:teuthology.orchestra.run.smithi067.stderr: 4300K .......... .......... .......... .......... .......... 4% 289M 2s 2024-09-12T00:25:33.571 INFO:teuthology.orchestra.run.smithi067.stderr: 4350K .......... .......... .......... .......... .......... 4% 194M 2s 2024-09-12T00:25:33.571 INFO:teuthology.orchestra.run.smithi067.stderr: 4400K .......... .......... .......... .......... .......... 4% 274M 2s 2024-09-12T00:25:33.571 INFO:teuthology.orchestra.run.smithi067.stderr: 4450K .......... .......... .......... .......... .......... 4% 314M 2s 2024-09-12T00:25:33.571 INFO:teuthology.orchestra.run.smithi067.stderr: 4500K .......... .......... .......... .......... .......... 4% 323M 2s 2024-09-12T00:25:33.572 INFO:teuthology.orchestra.run.smithi067.stderr: 4550K .......... .......... .......... .......... .......... 4% 301M 2s 2024-09-12T00:25:33.572 INFO:teuthology.orchestra.run.smithi067.stderr: 4600K .......... .......... .......... .......... .......... 5% 14.5M 2s 2024-09-12T00:25:33.572 INFO:teuthology.orchestra.run.smithi067.stderr: 4650K .......... .......... .......... .......... .......... 5% 308M 2s 2024-09-12T00:25:33.572 INFO:teuthology.orchestra.run.smithi067.stderr: 4700K .......... .......... .......... .......... .......... 5% 249M 2s 2024-09-12T00:25:33.572 INFO:teuthology.orchestra.run.smithi067.stderr: 4750K .......... .......... .......... .......... .......... 5% 324M 2s 2024-09-12T00:25:33.572 INFO:teuthology.orchestra.run.smithi067.stderr: 4800K .......... .......... .......... .......... .......... 5% 329M 2s 2024-09-12T00:25:33.572 INFO:teuthology.orchestra.run.smithi067.stderr: 4850K .......... .......... .......... .......... .......... 5% 246M 2s 2024-09-12T00:25:33.572 INFO:teuthology.orchestra.run.smithi067.stderr: 4900K .......... .......... .......... .......... .......... 5% 250M 2s 2024-09-12T00:25:33.572 INFO:teuthology.orchestra.run.smithi067.stderr: 4950K .......... .......... .......... .......... .......... 5% 243M 2s 2024-09-12T00:25:33.572 INFO:teuthology.orchestra.run.smithi067.stderr: 5000K .......... .......... .......... .......... .......... 5% 312M 2s 2024-09-12T00:25:33.572 INFO:teuthology.orchestra.run.smithi067.stderr: 5050K .......... .......... .......... .......... .......... 5% 357M 2s 2024-09-12T00:25:33.572 INFO:teuthology.orchestra.run.smithi067.stderr: 5100K .......... .......... .......... .......... .......... 5% 271M 2s 2024-09-12T00:25:33.572 INFO:teuthology.orchestra.run.smithi067.stderr: 5150K .......... .......... .......... .......... .......... 5% 274M 2s 2024-09-12T00:25:33.572 INFO:teuthology.orchestra.run.smithi067.stderr: 5200K .......... .......... .......... .......... .......... 5% 274M 2s 2024-09-12T00:25:33.573 INFO:teuthology.orchestra.run.smithi067.stderr: 5250K .......... .......... .......... .......... .......... 5% 271M 2s 2024-09-12T00:25:33.573 INFO:teuthology.orchestra.run.smithi067.stderr: 5300K .......... .......... .......... .......... .......... 5% 261M 2s 2024-09-12T00:25:33.573 INFO:teuthology.orchestra.run.smithi067.stderr: 5350K .......... .......... .......... .......... .......... 5% 300M 2s 2024-09-12T00:25:33.573 INFO:teuthology.orchestra.run.smithi067.stderr: 5400K .......... .......... .......... .......... .......... 5% 271M 2s 2024-09-12T00:25:33.573 INFO:teuthology.orchestra.run.smithi067.stderr: 5450K .......... .......... .......... .......... .......... 5% 288M 2s 2024-09-12T00:25:33.573 INFO:teuthology.orchestra.run.smithi067.stderr: 5500K .......... .......... .......... .......... .......... 5% 240M 2s 2024-09-12T00:25:33.573 INFO:teuthology.orchestra.run.smithi067.stderr: 5550K .......... .......... .......... .......... .......... 6% 241M 2s 2024-09-12T00:25:33.573 INFO:teuthology.orchestra.run.smithi067.stderr: 5600K .......... .......... .......... .......... .......... 6% 281M 2s 2024-09-12T00:25:33.573 INFO:teuthology.orchestra.run.smithi067.stderr: 5650K .......... .......... .......... .......... .......... 6% 277M 2s 2024-09-12T00:25:33.573 INFO:teuthology.orchestra.run.smithi067.stderr: 5700K .......... .......... .......... .......... .......... 6% 238M 2s 2024-09-12T00:25:33.573 INFO:teuthology.orchestra.run.smithi067.stderr: 5750K .......... .......... .......... .......... .......... 6% 283M 2s 2024-09-12T00:25:33.573 INFO:teuthology.orchestra.run.smithi067.stderr: 5800K .......... .......... .......... .......... .......... 6% 278M 2s 2024-09-12T00:25:33.573 INFO:teuthology.orchestra.run.smithi067.stderr: 5850K .......... .......... .......... .......... .......... 6% 330M 2s 2024-09-12T00:25:33.573 INFO:teuthology.orchestra.run.smithi067.stderr: 5900K .......... .......... .......... .......... .......... 6% 240M 2s 2024-09-12T00:25:33.574 INFO:teuthology.orchestra.run.smithi067.stderr: 5950K .......... .......... .......... .......... .......... 6% 315M 2s 2024-09-12T00:25:33.574 INFO:teuthology.orchestra.run.smithi067.stderr: 6000K .......... .......... .......... .......... .......... 6% 333M 2s 2024-09-12T00:25:33.574 INFO:teuthology.orchestra.run.smithi067.stderr: 6050K .......... .......... .......... .......... .......... 6% 305M 1s 2024-09-12T00:25:33.574 INFO:teuthology.orchestra.run.smithi067.stderr: 6100K .......... .......... .......... .......... .......... 6% 281M 1s 2024-09-12T00:25:33.574 INFO:teuthology.orchestra.run.smithi067.stderr: 6150K .......... .......... .......... .......... .......... 6% 362M 1s 2024-09-12T00:25:33.574 INFO:teuthology.orchestra.run.smithi067.stderr: 6200K .......... .......... .......... .......... .......... 6% 315M 1s 2024-09-12T00:25:33.574 INFO:teuthology.orchestra.run.smithi067.stderr: 6250K .......... .......... .......... .......... .......... 6% 339M 1s 2024-09-12T00:25:33.574 INFO:teuthology.orchestra.run.smithi067.stderr: 6300K .......... .......... .......... .......... .......... 6% 287M 1s 2024-09-12T00:25:33.574 INFO:teuthology.orchestra.run.smithi067.stderr: 6350K .......... .......... .......... .......... .......... 6% 320M 1s 2024-09-12T00:25:33.574 INFO:teuthology.orchestra.run.smithi067.stderr: 6400K .......... .......... .......... .......... .......... 6% 299M 1s 2024-09-12T00:25:33.574 INFO:teuthology.orchestra.run.smithi067.stderr: 6450K .......... .......... .......... .......... .......... 6% 337M 1s 2024-09-12T00:25:33.574 INFO:teuthology.orchestra.run.smithi067.stderr: 6500K .......... .......... .......... .......... .......... 7% 295M 1s 2024-09-12T00:25:33.574 INFO:teuthology.orchestra.run.smithi067.stderr: 6550K .......... .......... .......... .......... .......... 7% 326M 1s 2024-09-12T00:25:33.574 INFO:teuthology.orchestra.run.smithi067.stderr: 6600K .......... .......... .......... .......... .......... 7% 345M 1s 2024-09-12T00:25:33.575 INFO:teuthology.orchestra.run.smithi067.stderr: 6650K .......... .......... .......... .......... .......... 7% 274M 1s 2024-09-12T00:25:33.575 INFO:teuthology.orchestra.run.smithi067.stderr: 6700K .......... .......... .......... .......... .......... 7% 117M 1s 2024-09-12T00:25:33.575 INFO:teuthology.orchestra.run.smithi067.stderr: 6750K .......... .......... .......... .......... .......... 7% 320M 1s 2024-09-12T00:25:33.575 INFO:teuthology.orchestra.run.smithi067.stderr: 6800K .......... .......... .......... .......... .......... 7% 317M 1s 2024-09-12T00:25:33.575 INFO:teuthology.orchestra.run.smithi067.stderr: 6850K .......... .......... .......... .......... .......... 7% 188M 1s 2024-09-12T00:25:33.575 INFO:teuthology.orchestra.run.smithi067.stderr: 6900K .......... .......... .......... .......... .......... 7% 214M 1s 2024-09-12T00:25:33.575 INFO:teuthology.orchestra.run.smithi067.stderr: 6950K .......... .......... .......... .......... .......... 7% 72.9M 1s 2024-09-12T00:25:33.575 INFO:teuthology.orchestra.run.smithi067.stderr: 7000K .......... .......... .......... .......... .......... 7% 220M 1s 2024-09-12T00:25:33.575 INFO:teuthology.orchestra.run.smithi067.stderr: 7050K .......... .......... .......... .......... .......... 7% 305M 1s 2024-09-12T00:25:33.575 INFO:teuthology.orchestra.run.smithi067.stderr: 7100K .......... .......... .......... .......... .......... 7% 268M 1s 2024-09-12T00:25:33.575 INFO:teuthology.orchestra.run.smithi067.stderr: 7150K .......... .......... .......... .......... .......... 7% 277M 1s 2024-09-12T00:25:33.575 INFO:teuthology.orchestra.run.smithi067.stderr: 7200K .......... .......... .......... .......... .......... 7% 350M 1s 2024-09-12T00:25:33.575 INFO:teuthology.orchestra.run.smithi067.stderr: 7250K .......... .......... .......... .......... .......... 7% 300M 1s 2024-09-12T00:25:33.575 INFO:teuthology.orchestra.run.smithi067.stderr: 7300K .......... .......... .......... .......... .......... 7% 279M 1s 2024-09-12T00:25:33.576 INFO:teuthology.orchestra.run.smithi067.stderr: 7350K .......... .......... .......... .......... .......... 7% 304M 1s 2024-09-12T00:25:33.576 INFO:teuthology.orchestra.run.smithi067.stderr: 7400K .......... .......... .......... .......... .......... 8% 321M 1s 2024-09-12T00:25:33.576 INFO:teuthology.orchestra.run.smithi067.stderr: 7450K .......... .......... .......... .......... .......... 8% 347M 1s 2024-09-12T00:25:33.576 INFO:teuthology.orchestra.run.smithi067.stderr: 7500K .......... .......... .......... .......... .......... 8% 279M 1s 2024-09-12T00:25:33.576 INFO:teuthology.orchestra.run.smithi067.stderr: 7550K .......... .......... .......... .......... .......... 8% 32.8M 1s 2024-09-12T00:25:33.576 INFO:teuthology.orchestra.run.smithi067.stderr: 7600K .......... .......... .......... .......... .......... 8% 292M 1s 2024-09-12T00:25:33.576 INFO:teuthology.orchestra.run.smithi067.stderr: 7650K .......... .......... .......... .......... .......... 8% 330M 1s 2024-09-12T00:25:33.576 INFO:teuthology.orchestra.run.smithi067.stderr: 7700K .......... .......... .......... .......... .......... 8% 160M 1s 2024-09-12T00:25:33.576 INFO:teuthology.orchestra.run.smithi067.stderr: 7750K .......... .......... .......... .......... .......... 8% 232M 1s 2024-09-12T00:25:33.576 INFO:teuthology.orchestra.run.smithi067.stderr: 7800K .......... .......... .......... .......... .......... 8% 257M 1s 2024-09-12T00:25:33.576 INFO:teuthology.orchestra.run.smithi067.stderr: 7850K .......... .......... .......... .......... .......... 8% 304M 1s 2024-09-12T00:25:33.576 INFO:teuthology.orchestra.run.smithi067.stderr: 7900K .......... .......... .......... .......... .......... 8% 264M 1s 2024-09-12T00:25:33.576 INFO:teuthology.orchestra.run.smithi067.stderr: 7950K .......... .......... .......... .......... .......... 8% 290M 1s 2024-09-12T00:25:33.576 INFO:teuthology.orchestra.run.smithi067.stderr: 8000K .......... .......... .......... .......... .......... 8% 256M 1s 2024-09-12T00:25:33.577 INFO:teuthology.orchestra.run.smithi067.stderr: 8050K .......... .......... .......... .......... .......... 8% 104M 1s 2024-09-12T00:25:33.577 INFO:teuthology.orchestra.run.smithi067.stderr: 8100K .......... .......... .......... .......... .......... 8% 262M 1s 2024-09-12T00:25:33.577 INFO:teuthology.orchestra.run.smithi067.stderr: 8150K .......... .......... .......... .......... .......... 8% 267M 1s 2024-09-12T00:25:33.577 INFO:teuthology.orchestra.run.smithi067.stderr: 8200K .......... .......... .......... .......... .......... 8% 355M 1s 2024-09-12T00:25:33.577 INFO:teuthology.orchestra.run.smithi067.stderr: 8250K .......... .......... .......... .......... .......... 8% 267M 1s 2024-09-12T00:25:33.577 INFO:teuthology.orchestra.run.smithi067.stderr: 8300K .......... .......... .......... .......... .......... 8% 99.9M 1s 2024-09-12T00:25:33.577 INFO:teuthology.orchestra.run.smithi067.stderr: 8350K .......... .......... .......... .......... .......... 9% 278M 1s 2024-09-12T00:25:33.577 INFO:teuthology.orchestra.run.smithi067.stderr: 8400K .......... .......... .......... .......... .......... 9% 305M 1s 2024-09-12T00:25:33.577 INFO:teuthology.orchestra.run.smithi067.stderr: 8450K .......... .......... .......... .......... .......... 9% 217M 1s 2024-09-12T00:25:33.577 INFO:teuthology.orchestra.run.smithi067.stderr: 8500K .......... .......... .......... .......... .......... 9% 244M 1s 2024-09-12T00:25:33.577 INFO:teuthology.orchestra.run.smithi067.stderr: 8550K .......... .......... .......... .......... .......... 9% 291M 1s 2024-09-12T00:25:33.577 INFO:teuthology.orchestra.run.smithi067.stderr: 8600K .......... .......... .......... .......... .......... 9% 303M 1s 2024-09-12T00:25:33.577 INFO:teuthology.orchestra.run.smithi067.stderr: 8650K .......... .......... .......... .......... .......... 9% 356M 1s 2024-09-12T00:25:33.577 INFO:teuthology.orchestra.run.smithi067.stderr: 8700K .......... .......... .......... .......... .......... 9% 103M 1s 2024-09-12T00:25:33.578 INFO:teuthology.orchestra.run.smithi067.stderr: 8750K .......... .......... .......... .......... .......... 9% 268M 1s 2024-09-12T00:25:33.578 INFO:teuthology.orchestra.run.smithi067.stderr: 8800K .......... .......... .......... .......... .......... 9% 266M 1s 2024-09-12T00:25:33.578 INFO:teuthology.orchestra.run.smithi067.stderr: 8850K .......... .......... .......... .......... .......... 9% 281M 1s 2024-09-12T00:25:33.578 INFO:teuthology.orchestra.run.smithi067.stderr: 8900K .......... .......... .......... .......... .......... 9% 269M 1s 2024-09-12T00:25:33.578 INFO:teuthology.orchestra.run.smithi067.stderr: 8950K .......... .......... .......... .......... .......... 9% 270M 1s 2024-09-12T00:25:33.578 INFO:teuthology.orchestra.run.smithi067.stderr: 9000K .......... .......... .......... .......... .......... 9% 316M 1s 2024-09-12T00:25:33.578 INFO:teuthology.orchestra.run.smithi067.stderr: 9050K .......... .......... .......... .......... .......... 9% 331M 1s 2024-09-12T00:25:33.578 INFO:teuthology.orchestra.run.smithi067.stderr: 9100K .......... .......... .......... .......... .......... 9% 225M 1s 2024-09-12T00:25:33.578 INFO:teuthology.orchestra.run.smithi067.stderr: 9150K .......... .......... .......... .......... .......... 9% 216M 1s 2024-09-12T00:25:33.578 INFO:teuthology.orchestra.run.smithi067.stderr: 9200K .......... .......... .......... .......... .......... 9% 186M 1s 2024-09-12T00:25:33.578 INFO:teuthology.orchestra.run.smithi067.stderr: 9250K .......... .......... .......... .......... .......... 10% 261M 1s 2024-09-12T00:25:33.578 INFO:teuthology.orchestra.run.smithi067.stderr: 9300K .......... .......... .......... .......... .......... 10% 290M 1s 2024-09-12T00:25:33.578 INFO:teuthology.orchestra.run.smithi067.stderr: 9350K .......... .......... .......... .......... .......... 10% 295M 1s 2024-09-12T00:25:33.578 INFO:teuthology.orchestra.run.smithi067.stderr: 9400K .......... .......... .......... .......... .......... 10% 125M 1s 2024-09-12T00:25:33.579 INFO:teuthology.orchestra.run.smithi067.stderr: 9450K .......... .......... .......... .......... .......... 10% 276M 1s 2024-09-12T00:25:33.579 INFO:teuthology.orchestra.run.smithi067.stderr: 9500K .......... .......... .......... .......... .......... 10% 243M 1s 2024-09-12T00:25:33.579 INFO:teuthology.orchestra.run.smithi067.stderr: 9550K .......... .......... .......... .......... .......... 10% 313M 1s 2024-09-12T00:25:33.579 INFO:teuthology.orchestra.run.smithi067.stderr: 9600K .......... .......... .......... .......... .......... 10% 322M 1s 2024-09-12T00:25:33.579 INFO:teuthology.orchestra.run.smithi067.stderr: 9650K .......... .......... .......... .......... .......... 10% 294M 1s 2024-09-12T00:25:33.579 INFO:teuthology.orchestra.run.smithi067.stderr: 9700K .......... .......... .......... .......... .......... 10% 288M 1s 2024-09-12T00:25:33.579 INFO:teuthology.orchestra.run.smithi067.stderr: 9750K .......... .......... .......... .......... .......... 10% 63.3M 1s 2024-09-12T00:25:33.579 INFO:teuthology.orchestra.run.smithi067.stderr: 9800K .......... .......... .......... .......... .......... 10% 281M 1s 2024-09-12T00:25:33.579 INFO:teuthology.orchestra.run.smithi067.stderr: 9850K .......... .......... .......... .......... .......... 10% 138M 1s 2024-09-12T00:25:33.579 INFO:teuthology.orchestra.run.smithi067.stderr: 9900K .......... .......... .......... .......... .......... 10% 197M 1s 2024-09-12T00:25:33.579 INFO:teuthology.orchestra.run.smithi067.stderr: 9950K .......... .......... .......... .......... .......... 10% 341M 1s 2024-09-12T00:25:33.579 INFO:teuthology.orchestra.run.smithi067.stderr: 10000K .......... .......... .......... .......... .......... 10% 223M 1s 2024-09-12T00:25:33.579 INFO:teuthology.orchestra.run.smithi067.stderr: 10050K .......... .......... .......... .......... .......... 10% 261M 1s 2024-09-12T00:25:33.579 INFO:teuthology.orchestra.run.smithi067.stderr: 10100K .......... .......... .......... .......... .......... 10% 215M 1s 2024-09-12T00:25:33.580 INFO:teuthology.orchestra.run.smithi067.stderr: 10150K .......... .......... .......... .......... .......... 10% 286M 1s 2024-09-12T00:25:33.580 INFO:teuthology.orchestra.run.smithi067.stderr: 10200K .......... .......... .......... .......... .......... 11% 257M 1s 2024-09-12T00:25:33.580 INFO:teuthology.orchestra.run.smithi067.stderr: 10250K .......... .......... .......... .......... .......... 11% 319M 1s 2024-09-12T00:25:33.580 INFO:teuthology.orchestra.run.smithi067.stderr: 10300K .......... .......... .......... .......... .......... 11% 274M 1s 2024-09-12T00:25:33.580 INFO:teuthology.orchestra.run.smithi067.stderr: 10350K .......... .......... .......... .......... .......... 11% 283M 1s 2024-09-12T00:25:33.580 INFO:teuthology.orchestra.run.smithi067.stderr: 10400K .......... .......... .......... .......... .......... 11% 267M 1s 2024-09-12T00:25:33.580 INFO:teuthology.orchestra.run.smithi067.stderr: 10450K .......... .......... .......... .......... .......... 11% 363M 1s 2024-09-12T00:25:33.580 INFO:teuthology.orchestra.run.smithi067.stderr: 10500K .......... .......... .......... .......... .......... 11% 110M 1s 2024-09-12T00:25:33.580 INFO:teuthology.orchestra.run.smithi067.stderr: 10550K .......... .......... .......... .......... .......... 11% 276M 1s 2024-09-12T00:25:33.580 INFO:teuthology.orchestra.run.smithi067.stderr: 10600K .......... .......... .......... .......... .......... 11% 366M 1s 2024-09-12T00:25:33.580 INFO:teuthology.orchestra.run.smithi067.stderr: 10650K .......... .......... .......... .......... .......... 11% 378M 1s 2024-09-12T00:25:33.580 INFO:teuthology.orchestra.run.smithi067.stderr: 10700K .......... .......... .......... .......... .......... 11% 130M 1s 2024-09-12T00:25:33.580 INFO:teuthology.orchestra.run.smithi067.stderr: 10750K .......... .......... .......... .......... .......... 11% 231M 1s 2024-09-12T00:25:33.581 INFO:teuthology.orchestra.run.smithi067.stderr: 10800K .......... .......... .......... .......... .......... 11% 308M 1s 2024-09-12T00:25:33.581 INFO:teuthology.orchestra.run.smithi067.stderr: 10850K .......... .......... .......... .......... .......... 11% 324M 1s 2024-09-12T00:25:33.581 INFO:teuthology.orchestra.run.smithi067.stderr: 10900K .......... .......... .......... .......... .......... 11% 308M 1s 2024-09-12T00:25:33.581 INFO:teuthology.orchestra.run.smithi067.stderr: 10950K .......... .......... .......... .......... .......... 11% 352M 1s 2024-09-12T00:25:33.581 INFO:teuthology.orchestra.run.smithi067.stderr: 11000K .......... .......... .......... .......... .......... 11% 262M 1s 2024-09-12T00:25:33.581 INFO:teuthology.orchestra.run.smithi067.stderr: 11050K .......... .......... .......... .......... .......... 11% 292M 1s 2024-09-12T00:25:33.581 INFO:teuthology.orchestra.run.smithi067.stderr: 11100K .......... .......... .......... .......... .......... 12% 373M 1s 2024-09-12T00:25:33.581 INFO:teuthology.orchestra.run.smithi067.stderr: 11150K .......... .......... .......... .......... .......... 12% 109M 1s 2024-09-12T00:25:33.581 INFO:teuthology.orchestra.run.smithi067.stderr: 11200K .......... .......... .......... .......... .......... 12% 154M 1s 2024-09-12T00:25:33.581 INFO:teuthology.orchestra.run.smithi067.stderr: 11250K .......... .......... .......... .......... .......... 12% 325M 1s 2024-09-12T00:25:33.581 INFO:teuthology.orchestra.run.smithi067.stderr: 11300K .......... .......... .......... .......... .......... 12% 112M 1s 2024-09-12T00:25:33.581 INFO:teuthology.orchestra.run.smithi067.stderr: 11350K .......... .......... .......... .......... .......... 12% 317M 1s 2024-09-12T00:25:33.581 INFO:teuthology.orchestra.run.smithi067.stderr: 11400K .......... .......... .......... .......... .......... 12% 223M 1s 2024-09-12T00:25:33.581 INFO:teuthology.orchestra.run.smithi067.stderr: 11450K .......... .......... .......... .......... .......... 12% 344M 1s 2024-09-12T00:25:33.581 INFO:teuthology.orchestra.run.smithi067.stderr: 11500K .......... .......... .......... .......... .......... 12% 317M 1s 2024-09-12T00:25:33.582 INFO:teuthology.orchestra.run.smithi067.stderr: 11550K .......... .......... .......... .......... .......... 12% 289M 1s 2024-09-12T00:25:33.582 INFO:teuthology.orchestra.run.smithi067.stderr: 11600K .......... .......... .......... .......... .......... 12% 311M 1s 2024-09-12T00:25:33.582 INFO:teuthology.orchestra.run.smithi067.stderr: 11650K .......... .......... .......... .......... .......... 12% 257M 1s 2024-09-12T00:25:33.582 INFO:teuthology.orchestra.run.smithi067.stderr: 11700K .......... .......... .......... .......... .......... 12% 103M 1s 2024-09-12T00:25:33.582 INFO:teuthology.orchestra.run.smithi067.stderr: 11750K .......... .......... .......... .......... .......... 12% 243M 1s 2024-09-12T00:25:33.582 INFO:teuthology.orchestra.run.smithi067.stderr: 11800K .......... .......... .......... .......... .......... 12% 350M 1s 2024-09-12T00:25:33.582 INFO:teuthology.orchestra.run.smithi067.stderr: 11850K .......... .......... .......... .......... .......... 12% 135M 1s 2024-09-12T00:25:33.582 INFO:teuthology.orchestra.run.smithi067.stderr: 11900K .......... .......... .......... .......... .......... 12% 294M 1s 2024-09-12T00:25:33.582 INFO:teuthology.orchestra.run.smithi067.stderr: 11950K .......... .......... .......... .......... .......... 12% 293M 1s 2024-09-12T00:25:33.582 INFO:teuthology.orchestra.run.smithi067.stderr: 12000K .......... .......... .......... .......... .......... 12% 324M 1s 2024-09-12T00:25:33.582 INFO:teuthology.orchestra.run.smithi067.stderr: 12050K .......... .......... .......... .......... .......... 13% 327M 1s 2024-09-12T00:25:33.582 INFO:teuthology.orchestra.run.smithi067.stderr: 12100K .......... .......... .......... .......... .......... 13% 267M 1s 2024-09-12T00:25:33.582 INFO:teuthology.orchestra.run.smithi067.stderr: 12150K .......... .......... .......... .......... .......... 13% 309M 1s 2024-09-12T00:25:33.583 INFO:teuthology.orchestra.run.smithi067.stderr: 12200K .......... .......... .......... .......... .......... 13% 273M 1s 2024-09-12T00:25:33.583 INFO:teuthology.orchestra.run.smithi067.stderr: 12250K .......... .......... .......... .......... .......... 13% 192M 1s 2024-09-12T00:25:33.583 INFO:teuthology.orchestra.run.smithi067.stderr: 12300K .......... .......... .......... .......... .......... 13% 303M 1s 2024-09-12T00:25:33.583 INFO:teuthology.orchestra.run.smithi067.stderr: 12350K .......... .......... .......... .......... .......... 13% 273M 1s 2024-09-12T00:25:33.583 INFO:teuthology.orchestra.run.smithi067.stderr: 12400K .......... .......... .......... .......... .......... 13% 163M 1s 2024-09-12T00:25:33.583 INFO:teuthology.orchestra.run.smithi067.stderr: 12450K .......... .......... .......... .......... .......... 13% 347M 1s 2024-09-12T00:25:33.583 INFO:teuthology.orchestra.run.smithi067.stderr: 12500K .......... .......... .......... .......... .......... 13% 254M 1s 2024-09-12T00:25:33.583 INFO:teuthology.orchestra.run.smithi067.stderr: 12550K .......... .......... .......... .......... .......... 13% 367M 1s 2024-09-12T00:25:33.583 INFO:teuthology.orchestra.run.smithi067.stderr: 12600K .......... .......... .......... .......... .......... 13% 356M 1s 2024-09-12T00:25:33.583 INFO:teuthology.orchestra.run.smithi067.stderr: 12650K .......... .......... .......... .......... .......... 13% 305M 1s 2024-09-12T00:25:33.583 INFO:teuthology.orchestra.run.smithi067.stderr: 12700K .......... .......... .......... .......... .......... 13% 47.2M 1s 2024-09-12T00:25:33.583 INFO:teuthology.orchestra.run.smithi067.stderr: 12750K .......... .......... .......... .......... .......... 13% 257M 1s 2024-09-12T00:25:33.583 INFO:teuthology.orchestra.run.smithi067.stderr: 12800K .......... .......... .......... .......... .......... 13% 290M 1s 2024-09-12T00:25:33.583 INFO:teuthology.orchestra.run.smithi067.stderr: 12850K .......... .......... .......... .......... .......... 13% 333M 1s 2024-09-12T00:25:33.584 INFO:teuthology.orchestra.run.smithi067.stderr: 12900K .......... .......... .......... .......... .......... 13% 278M 1s 2024-09-12T00:25:33.584 INFO:teuthology.orchestra.run.smithi067.stderr: 12950K .......... .......... .......... .......... .......... 13% 287M 1s 2024-09-12T00:25:33.584 INFO:teuthology.orchestra.run.smithi067.stderr: 13000K .......... .......... .......... .......... .......... 14% 346M 1s 2024-09-12T00:25:33.584 INFO:teuthology.orchestra.run.smithi067.stderr: 13050K .......... .......... .......... .......... .......... 14% 94.0M 1s 2024-09-12T00:25:33.584 INFO:teuthology.orchestra.run.smithi067.stderr: 13100K .......... .......... .......... .......... .......... 14% 131M 1s 2024-09-12T00:25:33.584 INFO:teuthology.orchestra.run.smithi067.stderr: 13150K .......... .......... .......... .......... .......... 14% 308M 1s 2024-09-12T00:25:33.584 INFO:teuthology.orchestra.run.smithi067.stderr: 13200K .......... .......... .......... .......... .......... 14% 332M 1s 2024-09-12T00:25:33.584 INFO:teuthology.orchestra.run.smithi067.stderr: 13250K .......... .......... .......... .......... .......... 14% 245M 1s 2024-09-12T00:25:33.584 INFO:teuthology.orchestra.run.smithi067.stderr: 13300K .......... .......... .......... .......... .......... 14% 228M 1s 2024-09-12T00:25:33.584 INFO:teuthology.orchestra.run.smithi067.stderr: 13350K .......... .......... .......... .......... .......... 14% 288M 1s 2024-09-12T00:25:33.584 INFO:teuthology.orchestra.run.smithi067.stderr: 13400K .......... .......... .......... .......... .......... 14% 363M 1s 2024-09-12T00:25:33.584 INFO:teuthology.orchestra.run.smithi067.stderr: 13450K .......... .......... .......... .......... .......... 14% 353M 1s 2024-09-12T00:25:33.584 INFO:teuthology.orchestra.run.smithi067.stderr: 13500K .......... .......... .......... .......... .......... 14% 300M 1s 2024-09-12T00:25:33.584 INFO:teuthology.orchestra.run.smithi067.stderr: 13550K .......... .......... .......... .......... .......... 14% 256M 1s 2024-09-12T00:25:33.585 INFO:teuthology.orchestra.run.smithi067.stderr: 13600K .......... .......... .......... .......... .......... 14% 143M 1s 2024-09-12T00:25:33.585 INFO:teuthology.orchestra.run.smithi067.stderr: 13650K .......... .......... .......... .......... .......... 14% 275M 1s 2024-09-12T00:25:33.585 INFO:teuthology.orchestra.run.smithi067.stderr: 13700K .......... .......... .......... .......... .......... 14% 267M 1s 2024-09-12T00:25:33.585 INFO:teuthology.orchestra.run.smithi067.stderr: 13750K .......... .......... .......... .......... .......... 14% 282M 1s 2024-09-12T00:25:33.585 INFO:teuthology.orchestra.run.smithi067.stderr: 13800K .......... .......... .......... .......... .......... 14% 287M 1s 2024-09-12T00:25:33.585 INFO:teuthology.orchestra.run.smithi067.stderr: 13850K .......... .......... .......... .......... .......... 14% 267M 1s 2024-09-12T00:25:33.585 INFO:teuthology.orchestra.run.smithi067.stderr: 13900K .......... .......... .......... .......... .......... 15% 221M 1s 2024-09-12T00:25:33.585 INFO:teuthology.orchestra.run.smithi067.stderr: 13950K .......... .......... .......... .......... .......... 15% 301M 1s 2024-09-12T00:25:33.585 INFO:teuthology.orchestra.run.smithi067.stderr: 14000K .......... .......... .......... .......... .......... 15% 294M 1s 2024-09-12T00:25:33.585 INFO:teuthology.orchestra.run.smithi067.stderr: 14050K .......... .......... .......... .......... .......... 15% 297M 1s 2024-09-12T00:25:33.585 INFO:teuthology.orchestra.run.smithi067.stderr: 14100K .......... .......... .......... .......... .......... 15% 322M 1s 2024-09-12T00:25:33.585 INFO:teuthology.orchestra.run.smithi067.stderr: 14150K .......... .......... .......... .......... .......... 15% 334M 1s 2024-09-12T00:25:33.585 INFO:teuthology.orchestra.run.smithi067.stderr: 14200K .......... .......... .......... .......... .......... 15% 204M 1s 2024-09-12T00:25:33.586 INFO:teuthology.orchestra.run.smithi067.stderr: 14250K .......... .......... .......... .......... .......... 15% 279M 1s 2024-09-12T00:25:33.586 INFO:teuthology.orchestra.run.smithi067.stderr: 14300K .......... .......... .......... .......... .......... 15% 53.5M 1s 2024-09-12T00:25:33.586 INFO:teuthology.orchestra.run.smithi067.stderr: 14350K .......... .......... .......... .......... .......... 15% 311M 1s 2024-09-12T00:25:33.586 INFO:teuthology.orchestra.run.smithi067.stderr: 14400K .......... .......... .......... .......... .......... 15% 323M 1s 2024-09-12T00:25:33.586 INFO:teuthology.orchestra.run.smithi067.stderr: 14450K .......... .......... .......... .......... .......... 15% 280M 1s 2024-09-12T00:25:33.586 INFO:teuthology.orchestra.run.smithi067.stderr: 14500K .......... .......... .......... .......... .......... 15% 222M 1s 2024-09-12T00:25:33.586 INFO:teuthology.orchestra.run.smithi067.stderr: 14550K .......... .......... .......... .......... .......... 15% 286M 1s 2024-09-12T00:25:33.586 INFO:teuthology.orchestra.run.smithi067.stderr: 14600K .......... .......... .......... .......... .......... 15% 307M 1s 2024-09-12T00:25:33.586 INFO:teuthology.orchestra.run.smithi067.stderr: 14650K .......... .......... .......... .......... .......... 15% 371M 1s 2024-09-12T00:25:33.586 INFO:teuthology.orchestra.run.smithi067.stderr: 14700K .......... .......... .......... .......... .......... 15% 271M 1s 2024-09-12T00:25:33.586 INFO:teuthology.orchestra.run.smithi067.stderr: 14750K .......... .......... .......... .......... .......... 15% 337M 1s 2024-09-12T00:25:33.586 INFO:teuthology.orchestra.run.smithi067.stderr: 14800K .......... .......... .......... .......... .......... 15% 219M 1s 2024-09-12T00:25:33.586 INFO:teuthology.orchestra.run.smithi067.stderr: 14850K .......... .......... .......... .......... .......... 16% 277M 1s 2024-09-12T00:25:33.586 INFO:teuthology.orchestra.run.smithi067.stderr: 14900K .......... .......... .......... .......... .......... 16% 308M 1s 2024-09-12T00:25:33.587 INFO:teuthology.orchestra.run.smithi067.stderr: 14950K .......... .......... .......... .......... .......... 16% 350M 1s 2024-09-12T00:25:33.587 INFO:teuthology.orchestra.run.smithi067.stderr: 15000K .......... .......... .......... .......... .......... 16% 320M 1s 2024-09-12T00:25:33.587 INFO:teuthology.orchestra.run.smithi067.stderr: 15050K .......... .......... .......... .......... .......... 16% 320M 1s 2024-09-12T00:25:33.587 INFO:teuthology.orchestra.run.smithi067.stderr: 15100K .......... .......... .......... .......... .......... 16% 269M 1s 2024-09-12T00:25:33.587 INFO:teuthology.orchestra.run.smithi067.stderr: 15150K .......... .......... .......... .......... .......... 16% 315M 1s 2024-09-12T00:25:33.587 INFO:teuthology.orchestra.run.smithi067.stderr: 15200K .......... .......... .......... .......... .......... 16% 323M 1s 2024-09-12T00:25:33.587 INFO:teuthology.orchestra.run.smithi067.stderr: 15250K .......... .......... .......... .......... .......... 16% 331M 1s 2024-09-12T00:25:33.587 INFO:teuthology.orchestra.run.smithi067.stderr: 15300K .......... .......... .......... .......... .......... 16% 285M 1s 2024-09-12T00:25:33.587 INFO:teuthology.orchestra.run.smithi067.stderr: 15350K .......... .......... .......... .......... .......... 16% 309M 1s 2024-09-12T00:25:33.587 INFO:teuthology.orchestra.run.smithi067.stderr: 15400K .......... .......... .......... .......... .......... 16% 311M 1s 2024-09-12T00:25:33.587 INFO:teuthology.orchestra.run.smithi067.stderr: 15450K .......... .......... .......... .......... .......... 16% 360M 1s 2024-09-12T00:25:33.587 INFO:teuthology.orchestra.run.smithi067.stderr: 15500K .......... .......... .......... .......... .......... 16% 269M 1s 2024-09-12T00:25:33.587 INFO:teuthology.orchestra.run.smithi067.stderr: 15550K .......... .......... .......... .......... .......... 16% 275M 1s 2024-09-12T00:25:33.587 INFO:teuthology.orchestra.run.smithi067.stderr: 15600K .......... .......... .......... .......... .......... 16% 297M 1s 2024-09-12T00:25:33.588 INFO:teuthology.orchestra.run.smithi067.stderr: 15650K .......... .......... .......... .......... .......... 16% 305M 1s 2024-09-12T00:25:33.588 INFO:teuthology.orchestra.run.smithi067.stderr: 15700K .......... .......... .......... .......... .......... 16% 301M 1s 2024-09-12T00:25:33.588 INFO:teuthology.orchestra.run.smithi067.stderr: 15750K .......... .......... .......... .......... .......... 17% 75.7M 1s 2024-09-12T00:25:33.588 INFO:teuthology.orchestra.run.smithi067.stderr: 15800K .......... .......... .......... .......... .......... 17% 269M 1s 2024-09-12T00:25:33.588 INFO:teuthology.orchestra.run.smithi067.stderr: 15850K .......... .......... .......... .......... .......... 17% 324M 1s 2024-09-12T00:25:33.588 INFO:teuthology.orchestra.run.smithi067.stderr: 15900K .......... .......... .......... .......... .......... 17% 134M 1s 2024-09-12T00:25:33.588 INFO:teuthology.orchestra.run.smithi067.stderr: 15950K .......... .......... .......... .......... .......... 17% 288M 1s 2024-09-12T00:25:33.588 INFO:teuthology.orchestra.run.smithi067.stderr: 16000K .......... .......... .......... .......... .......... 17% 323M 1s 2024-09-12T00:25:33.588 INFO:teuthology.orchestra.run.smithi067.stderr: 16050K .......... .......... .......... .......... .......... 17% 333M 1s 2024-09-12T00:25:33.588 INFO:teuthology.orchestra.run.smithi067.stderr: 16100K .......... .......... .......... .......... .......... 17% 265M 1s 2024-09-12T00:25:33.588 INFO:teuthology.orchestra.run.smithi067.stderr: 16150K .......... .......... .......... .......... .......... 17% 105M 1s 2024-09-12T00:25:33.588 INFO:teuthology.orchestra.run.smithi067.stderr: 16200K .......... .......... .......... .......... .......... 17% 303M 1s 2024-09-12T00:25:33.588 INFO:teuthology.orchestra.run.smithi067.stderr: 16250K .......... .......... .......... .......... .......... 17% 322M 1s 2024-09-12T00:25:33.589 INFO:teuthology.orchestra.run.smithi067.stderr: 16300K .......... .......... .......... .......... .......... 17% 127M 1s 2024-09-12T00:25:33.589 INFO:teuthology.orchestra.run.smithi067.stderr: 16350K .......... .......... .......... .......... .......... 17% 299M 1s 2024-09-12T00:25:33.589 INFO:teuthology.orchestra.run.smithi067.stderr: 16400K .......... .......... .......... .......... .......... 17% 224M 1s 2024-09-12T00:25:33.589 INFO:teuthology.orchestra.run.smithi067.stderr: 16450K .......... .......... .......... .......... .......... 17% 170M 1s 2024-09-12T00:25:33.589 INFO:teuthology.orchestra.run.smithi067.stderr: 16500K .......... .......... .......... .......... .......... 17% 245M 1s 2024-09-12T00:25:33.589 INFO:teuthology.orchestra.run.smithi067.stderr: 16550K .......... .......... .......... .......... .......... 17% 294M 1s 2024-09-12T00:25:33.589 INFO:teuthology.orchestra.run.smithi067.stderr: 16600K .......... .......... .......... .......... .......... 17% 352M 1s 2024-09-12T00:25:33.589 INFO:teuthology.orchestra.run.smithi067.stderr: 16650K .......... .......... .......... .......... .......... 17% 311M 1s 2024-09-12T00:25:33.589 INFO:teuthology.orchestra.run.smithi067.stderr: 16700K .......... .......... .......... .......... .......... 18% 251M 1s 2024-09-12T00:25:33.589 INFO:teuthology.orchestra.run.smithi067.stderr: 16750K .......... .......... .......... .......... .......... 18% 292M 1s 2024-09-12T00:25:33.589 INFO:teuthology.orchestra.run.smithi067.stderr: 16800K .......... .......... .......... .......... .......... 18% 292M 1s 2024-09-12T00:25:33.589 INFO:teuthology.orchestra.run.smithi067.stderr: 16850K .......... .......... .......... .......... .......... 18% 326M 1s 2024-09-12T00:25:33.589 INFO:teuthology.orchestra.run.smithi067.stderr: 16900K .......... .......... .......... .......... .......... 18% 132M 1s 2024-09-12T00:25:33.589 INFO:teuthology.orchestra.run.smithi067.stderr: 16950K .......... .......... .......... .......... .......... 18% 306M 1s 2024-09-12T00:25:33.590 INFO:teuthology.orchestra.run.smithi067.stderr: 17000K .......... .......... .......... .......... .......... 18% 244M 1s 2024-09-12T00:25:33.590 INFO:teuthology.orchestra.run.smithi067.stderr: 17050K .......... .......... .......... .......... .......... 18% 284M 1s 2024-09-12T00:25:33.590 INFO:teuthology.orchestra.run.smithi067.stderr: 17100K .......... .......... .......... .......... .......... 18% 300M 1s 2024-09-12T00:25:33.590 INFO:teuthology.orchestra.run.smithi067.stderr: 17150K .......... .......... .......... .......... .......... 18% 337M 1s 2024-09-12T00:25:33.590 INFO:teuthology.orchestra.run.smithi067.stderr: 17200K .......... .......... .......... .......... .......... 18% 237M 1s 2024-09-12T00:25:33.590 INFO:teuthology.orchestra.run.smithi067.stderr: 17250K .......... .......... .......... .......... .......... 18% 340M 1s 2024-09-12T00:25:33.590 INFO:teuthology.orchestra.run.smithi067.stderr: 17300K .......... .......... .......... .......... .......... 18% 279M 1s 2024-09-12T00:25:33.590 INFO:teuthology.orchestra.run.smithi067.stderr: 17350K .......... .......... .......... .......... .......... 18% 79.8M 1s 2024-09-12T00:25:33.590 INFO:teuthology.orchestra.run.smithi067.stderr: 17400K .......... .......... .......... .......... .......... 18% 251M 1s 2024-09-12T00:25:33.590 INFO:teuthology.orchestra.run.smithi067.stderr: 17450K .......... .......... .......... .......... .......... 18% 316M 1s 2024-09-12T00:25:33.590 INFO:teuthology.orchestra.run.smithi067.stderr: 17500K .......... .......... .......... .......... .......... 18% 139M 1s 2024-09-12T00:25:33.590 INFO:teuthology.orchestra.run.smithi067.stderr: 17550K .......... .......... .......... .......... .......... 18% 318M 1s 2024-09-12T00:25:33.590 INFO:teuthology.orchestra.run.smithi067.stderr: 17600K .......... .......... .......... .......... .......... 18% 331M 1s 2024-09-12T00:25:33.591 INFO:teuthology.orchestra.run.smithi067.stderr: 17650K .......... .......... .......... .......... .......... 19% 361M 1s 2024-09-12T00:25:33.591 INFO:teuthology.orchestra.run.smithi067.stderr: 17700K .......... .......... .......... .......... .......... 19% 107M 1s 2024-09-12T00:25:33.591 INFO:teuthology.orchestra.run.smithi067.stderr: 17750K .......... .......... .......... .......... .......... 19% 323M 1s 2024-09-12T00:25:33.591 INFO:teuthology.orchestra.run.smithi067.stderr: 17800K .......... .......... .......... .......... .......... 19% 184M 1s 2024-09-12T00:25:33.591 INFO:teuthology.orchestra.run.smithi067.stderr: 17850K .......... .......... .......... .......... .......... 19% 306M 1s 2024-09-12T00:25:33.591 INFO:teuthology.orchestra.run.smithi067.stderr: 17900K .......... .......... .......... .......... .......... 19% 312M 1s 2024-09-12T00:25:33.591 INFO:teuthology.orchestra.run.smithi067.stderr: 17950K .......... .......... .......... .......... .......... 19% 321M 1s 2024-09-12T00:25:33.591 INFO:teuthology.orchestra.run.smithi067.stderr: 18000K .......... .......... .......... .......... .......... 19% 341M 1s 2024-09-12T00:25:33.591 INFO:teuthology.orchestra.run.smithi067.stderr: 18050K .......... .......... .......... .......... .......... 19% 357M 1s 2024-09-12T00:25:33.591 INFO:teuthology.orchestra.run.smithi067.stderr: 18100K .......... .......... .......... .......... .......... 19% 219M 1s 2024-09-12T00:25:33.591 INFO:teuthology.orchestra.run.smithi067.stderr: 18150K .......... .......... .......... .......... .......... 19% 331M 1s 2024-09-12T00:25:33.591 INFO:teuthology.orchestra.run.smithi067.stderr: 18200K .......... .......... .......... .......... .......... 19% 336M 1s 2024-09-12T00:25:33.591 INFO:teuthology.orchestra.run.smithi067.stderr: 18250K .......... .......... .......... .......... .......... 19% 287M 1s 2024-09-12T00:25:33.591 INFO:teuthology.orchestra.run.smithi067.stderr: 18300K .......... .......... .......... .......... .......... 19% 288M 1s 2024-09-12T00:25:33.592 INFO:teuthology.orchestra.run.smithi067.stderr: 18350K .......... .......... .......... .......... .......... 19% 338M 1s 2024-09-12T00:25:33.592 INFO:teuthology.orchestra.run.smithi067.stderr: 18400K .......... .......... .......... .......... .......... 19% 279M 1s 2024-09-12T00:25:33.592 INFO:teuthology.orchestra.run.smithi067.stderr: 18450K .......... .......... .......... .......... .......... 19% 333M 1s 2024-09-12T00:25:33.592 INFO:teuthology.orchestra.run.smithi067.stderr: 18500K .......... .......... .......... .......... .......... 19% 270M 1s 2024-09-12T00:25:33.592 INFO:teuthology.orchestra.run.smithi067.stderr: 18550K .......... .......... .......... .......... .......... 20% 316M 1s 2024-09-12T00:25:33.592 INFO:teuthology.orchestra.run.smithi067.stderr: 18600K .......... .......... .......... .......... .......... 20% 359M 1s 2024-09-12T00:25:33.592 INFO:teuthology.orchestra.run.smithi067.stderr: 18650K .......... .......... .......... .......... .......... 20% 198M 1s 2024-09-12T00:25:33.592 INFO:teuthology.orchestra.run.smithi067.stderr: 18700K .......... .......... .......... .......... .......... 20% 308M 1s 2024-09-12T00:25:33.592 INFO:teuthology.orchestra.run.smithi067.stderr: 18750K .......... .......... .......... .......... .......... 20% 122M 1s 2024-09-12T00:25:33.592 INFO:teuthology.orchestra.run.smithi067.stderr: 18800K .......... .......... .......... .......... .......... 20% 313M 1s 2024-09-12T00:25:33.592 INFO:teuthology.orchestra.run.smithi067.stderr: 18850K .......... .......... .......... .......... .......... 20% 330M 1s 2024-09-12T00:25:33.592 INFO:teuthology.orchestra.run.smithi067.stderr: 18900K .......... .......... .......... .......... .......... 20% 258M 1s 2024-09-12T00:25:33.592 INFO:teuthology.orchestra.run.smithi067.stderr: 18950K .......... .......... .......... .......... .......... 20% 320M 1s 2024-09-12T00:25:33.593 INFO:teuthology.orchestra.run.smithi067.stderr: 19000K .......... .......... .......... .......... .......... 20% 187M 1s 2024-09-12T00:25:33.593 INFO:teuthology.orchestra.run.smithi067.stderr: 19050K .......... .......... .......... .......... .......... 20% 329M 1s 2024-09-12T00:25:33.593 INFO:teuthology.orchestra.run.smithi067.stderr: 19100K .......... .......... .......... .......... .......... 20% 290M 1s 2024-09-12T00:25:33.593 INFO:teuthology.orchestra.run.smithi067.stderr: 19150K .......... .......... .......... .......... .......... 20% 346M 1s 2024-09-12T00:25:33.593 INFO:teuthology.orchestra.run.smithi067.stderr: 19200K .......... .......... .......... .......... .......... 20% 74.6M 1s 2024-09-12T00:25:33.593 INFO:teuthology.orchestra.run.smithi067.stderr: 19250K .......... .......... .......... .......... .......... 20% 301M 1s 2024-09-12T00:25:33.593 INFO:teuthology.orchestra.run.smithi067.stderr: 19300K .......... .......... .......... .......... .......... 20% 241M 1s 2024-09-12T00:25:33.593 INFO:teuthology.orchestra.run.smithi067.stderr: 19350K .......... .......... .......... .......... .......... 20% 346M 1s 2024-09-12T00:25:33.593 INFO:teuthology.orchestra.run.smithi067.stderr: 19400K .......... .......... .......... .......... .......... 20% 206M 1s 2024-09-12T00:25:33.593 INFO:teuthology.orchestra.run.smithi067.stderr: 19450K .......... .......... .......... .......... .......... 20% 234M 1s 2024-09-12T00:25:33.593 INFO:teuthology.orchestra.run.smithi067.stderr: 19500K .......... .......... .......... .......... .......... 21% 243M 1s 2024-09-12T00:25:33.593 INFO:teuthology.orchestra.run.smithi067.stderr: 19550K .......... .......... .......... .......... .......... 21% 298M 1s 2024-09-12T00:25:33.593 INFO:teuthology.orchestra.run.smithi067.stderr: 19600K .......... .......... .......... .......... .......... 21% 205M 1s 2024-09-12T00:25:33.594 INFO:teuthology.orchestra.run.smithi067.stderr: 19650K .......... .......... .......... .......... .......... 21% 213M 1s 2024-09-12T00:25:33.594 INFO:teuthology.orchestra.run.smithi067.stderr: 19700K .......... .......... .......... .......... .......... 21% 246M 1s 2024-09-12T00:25:33.594 INFO:teuthology.orchestra.run.smithi067.stderr: 19750K .......... .......... .......... .......... .......... 21% 286M 1s 2024-09-12T00:25:33.594 INFO:teuthology.orchestra.run.smithi067.stderr: 19800K .......... .......... .......... .......... .......... 21% 319M 1s 2024-09-12T00:25:33.594 INFO:teuthology.orchestra.run.smithi067.stderr: 19850K .......... .......... .......... .......... .......... 21% 300M 1s 2024-09-12T00:25:33.594 INFO:teuthology.orchestra.run.smithi067.stderr: 19900K .......... .......... .......... .......... .......... 21% 251M 1s 2024-09-12T00:25:33.594 INFO:teuthology.orchestra.run.smithi067.stderr: 19950K .......... .......... .......... .......... .......... 21% 151M 1s 2024-09-12T00:25:33.594 INFO:teuthology.orchestra.run.smithi067.stderr: 20000K .......... .......... .......... .......... .......... 21% 334M 1s 2024-09-12T00:25:33.594 INFO:teuthology.orchestra.run.smithi067.stderr: 20050K .......... .......... .......... .......... .......... 21% 321M 1s 2024-09-12T00:25:33.594 INFO:teuthology.orchestra.run.smithi067.stderr: 20100K .......... .......... .......... .......... .......... 21% 197M 1s 2024-09-12T00:25:33.594 INFO:teuthology.orchestra.run.smithi067.stderr: 20150K .......... .......... .......... .......... .......... 21% 308M 1s 2024-09-12T00:25:33.594 INFO:teuthology.orchestra.run.smithi067.stderr: 20200K .......... .......... .......... .......... .......... 21% 349M 1s 2024-09-12T00:25:33.594 INFO:teuthology.orchestra.run.smithi067.stderr: 20250K .......... .......... .......... .......... .......... 21% 146M 1s 2024-09-12T00:25:33.594 INFO:teuthology.orchestra.run.smithi067.stderr: 20300K .......... .......... .......... .......... .......... 21% 299M 1s 2024-09-12T00:25:33.595 INFO:teuthology.orchestra.run.smithi067.stderr: 20350K .......... .......... .......... .......... .......... 21% 92.3M 1s 2024-09-12T00:25:33.595 INFO:teuthology.orchestra.run.smithi067.stderr: 20400K .......... .......... .......... .......... .......... 22% 276M 1s 2024-09-12T00:25:33.595 INFO:teuthology.orchestra.run.smithi067.stderr: 20450K .......... .......... .......... .......... .......... 22% 253M 1s 2024-09-12T00:25:33.595 INFO:teuthology.orchestra.run.smithi067.stderr: 20500K .......... .......... .......... .......... .......... 22% 345M 1s 2024-09-12T00:25:33.595 INFO:teuthology.orchestra.run.smithi067.stderr: 20550K .......... .......... .......... .......... .......... 22% 101M 1s 2024-09-12T00:25:33.595 INFO:teuthology.orchestra.run.smithi067.stderr: 20600K .......... .......... .......... .......... .......... 22% 314M 1s 2024-09-12T00:25:33.595 INFO:teuthology.orchestra.run.smithi067.stderr: 20650K .......... .......... .......... .......... .......... 22% 359M 1s 2024-09-12T00:25:33.595 INFO:teuthology.orchestra.run.smithi067.stderr: 20700K .......... .......... .......... .......... .......... 22% 127M 1s 2024-09-12T00:25:33.595 INFO:teuthology.orchestra.run.smithi067.stderr: 20750K .......... .......... .......... .......... .......... 22% 320M 1s 2024-09-12T00:25:33.595 INFO:teuthology.orchestra.run.smithi067.stderr: 20800K .......... .......... .......... .......... .......... 22% 334M 1s 2024-09-12T00:25:33.595 INFO:teuthology.orchestra.run.smithi067.stderr: 20850K .......... .......... .......... .......... .......... 22% 148M 1s 2024-09-12T00:25:33.595 INFO:teuthology.orchestra.run.smithi067.stderr: 20900K .......... .......... .......... .......... .......... 22% 310M 1s 2024-09-12T00:25:33.595 INFO:teuthology.orchestra.run.smithi067.stderr: 20950K .......... .......... .......... .......... .......... 22% 200M 1s 2024-09-12T00:25:33.595 INFO:teuthology.orchestra.run.smithi067.stderr: 21000K .......... .......... .......... .......... .......... 22% 330M 1s 2024-09-12T00:25:33.596 INFO:teuthology.orchestra.run.smithi067.stderr: 21050K .......... .......... .......... .......... .......... 22% 317M 1s 2024-09-12T00:25:33.596 INFO:teuthology.orchestra.run.smithi067.stderr: 21100K .......... .......... .......... .......... .......... 22% 131M 1s 2024-09-12T00:25:33.596 INFO:teuthology.orchestra.run.smithi067.stderr: 21150K .......... .......... .......... .......... .......... 22% 193M 1s 2024-09-12T00:25:33.596 INFO:teuthology.orchestra.run.smithi067.stderr: 21200K .......... .......... .......... .......... .......... 22% 312M 1s 2024-09-12T00:25:33.596 INFO:teuthology.orchestra.run.smithi067.stderr: 21250K .......... .......... .......... .......... .......... 22% 323M 1s 2024-09-12T00:25:33.596 INFO:teuthology.orchestra.run.smithi067.stderr: 21300K .......... .......... .......... .......... .......... 22% 293M 1s 2024-09-12T00:25:33.596 INFO:teuthology.orchestra.run.smithi067.stderr: 21350K .......... .......... .......... .......... .......... 23% 299M 1s 2024-09-12T00:25:33.596 INFO:teuthology.orchestra.run.smithi067.stderr: 21400K .......... .......... .......... .......... .......... 23% 309M 1s 2024-09-12T00:25:33.596 INFO:teuthology.orchestra.run.smithi067.stderr: 21450K .......... .......... .......... .......... .......... 23% 227M 1s 2024-09-12T00:25:33.596 INFO:teuthology.orchestra.run.smithi067.stderr: 21500K .......... .......... .......... .......... .......... 23% 308M 1s 2024-09-12T00:25:33.596 INFO:teuthology.orchestra.run.smithi067.stderr: 21550K .......... .......... .......... .......... .......... 23% 322M 1s 2024-09-12T00:25:33.596 INFO:teuthology.orchestra.run.smithi067.stderr: 21600K .......... .......... .......... .......... .......... 23% 284M 1s 2024-09-12T00:25:33.596 INFO:teuthology.orchestra.run.smithi067.stderr: 21650K .......... .......... .......... .......... .......... 23% 241M 1s 2024-09-12T00:25:33.596 INFO:teuthology.orchestra.run.smithi067.stderr: 21700K .......... .......... .......... .......... .......... 23% 273M 1s 2024-09-12T00:25:33.597 INFO:teuthology.orchestra.run.smithi067.stderr: 21750K .......... .......... .......... .......... .......... 23% 288M 1s 2024-09-12T00:25:33.597 INFO:teuthology.orchestra.run.smithi067.stderr: 21800K .......... .......... .......... .......... .......... 23% 287M 1s 2024-09-12T00:25:33.597 INFO:teuthology.orchestra.run.smithi067.stderr: 21850K .......... .......... .......... .......... .......... 23% 318M 1s 2024-09-12T00:25:33.597 INFO:teuthology.orchestra.run.smithi067.stderr: 21900K .......... .......... .......... .......... .......... 23% 300M 1s 2024-09-12T00:25:33.597 INFO:teuthology.orchestra.run.smithi067.stderr: 21950K .......... .......... .......... .......... .......... 23% 305M 1s 2024-09-12T00:25:33.597 INFO:teuthology.orchestra.run.smithi067.stderr: 22000K .......... .......... .......... .......... .......... 23% 165M 1s 2024-09-12T00:25:33.597 INFO:teuthology.orchestra.run.smithi067.stderr: 22050K .......... .......... .......... .......... .......... 23% 310M 1s 2024-09-12T00:25:33.597 INFO:teuthology.orchestra.run.smithi067.stderr: 22100K .......... .......... .......... .......... .......... 23% 374M 1s 2024-09-12T00:25:33.597 INFO:teuthology.orchestra.run.smithi067.stderr: 22150K .......... .......... .......... .......... .......... 23% 193M 1s 2024-09-12T00:25:33.597 INFO:teuthology.orchestra.run.smithi067.stderr: 22200K .......... .......... .......... .......... .......... 23% 301M 1s 2024-09-12T00:25:33.597 INFO:teuthology.orchestra.run.smithi067.stderr: 22250K .......... .......... .......... .......... .......... 24% 71.1M 1s 2024-09-12T00:25:33.597 INFO:teuthology.orchestra.run.smithi067.stderr: 22300K .......... .......... .......... .......... .......... 24% 234M 1s 2024-09-12T00:25:33.597 INFO:teuthology.orchestra.run.smithi067.stderr: 22350K .......... .......... .......... .......... .......... 24% 344M 1s 2024-09-12T00:25:33.597 INFO:teuthology.orchestra.run.smithi067.stderr: 22400K .......... .......... .......... .......... .......... 24% 162M 1s 2024-09-12T00:25:33.598 INFO:teuthology.orchestra.run.smithi067.stderr: 22450K .......... .......... .......... .......... .......... 24% 324M 1s 2024-09-12T00:25:33.598 INFO:teuthology.orchestra.run.smithi067.stderr: 22500K .......... .......... .......... .......... .......... 24% 288M 1s 2024-09-12T00:25:33.598 INFO:teuthology.orchestra.run.smithi067.stderr: 22550K .......... .......... .......... .......... .......... 24% 332M 1s 2024-09-12T00:25:33.598 INFO:teuthology.orchestra.run.smithi067.stderr: 22600K .......... .......... .......... .......... .......... 24% 286M 1s 2024-09-12T00:25:33.598 INFO:teuthology.orchestra.run.smithi067.stderr: 22650K .......... .......... .......... .......... .......... 24% 353M 1s 2024-09-12T00:25:33.598 INFO:teuthology.orchestra.run.smithi067.stderr: 22700K .......... .......... .......... .......... .......... 24% 160M 1s 2024-09-12T00:25:33.598 INFO:teuthology.orchestra.run.smithi067.stderr: 22750K .......... .......... .......... .......... .......... 24% 81.8M 1s 2024-09-12T00:25:33.598 INFO:teuthology.orchestra.run.smithi067.stderr: 22800K .......... .......... .......... .......... .......... 24% 323M 1s 2024-09-12T00:25:33.598 INFO:teuthology.orchestra.run.smithi067.stderr: 22850K .......... .......... .......... .......... .......... 24% 323M 1s 2024-09-12T00:25:33.598 INFO:teuthology.orchestra.run.smithi067.stderr: 22900K .......... .......... .......... .......... .......... 24% 258M 1s 2024-09-12T00:25:33.598 INFO:teuthology.orchestra.run.smithi067.stderr: 22950K .......... .......... .......... .......... .......... 24% 357M 1s 2024-09-12T00:25:33.598 INFO:teuthology.orchestra.run.smithi067.stderr: 23000K .......... .......... .......... .......... .......... 24% 339M 1s 2024-09-12T00:25:33.598 INFO:teuthology.orchestra.run.smithi067.stderr: 23050K .......... .......... .......... .......... .......... 24% 275M 1s 2024-09-12T00:25:33.598 INFO:teuthology.orchestra.run.smithi067.stderr: 23100K .......... .......... .......... .......... .......... 24% 134M 1s 2024-09-12T00:25:33.599 INFO:teuthology.orchestra.run.smithi067.stderr: 23150K .......... .......... .......... .......... .......... 24% 187M 1s 2024-09-12T00:25:33.599 INFO:teuthology.orchestra.run.smithi067.stderr: 23200K .......... .......... .......... .......... .......... 25% 232M 1s 2024-09-12T00:25:33.599 INFO:teuthology.orchestra.run.smithi067.stderr: 23250K .......... .......... .......... .......... .......... 25% 311M 1s 2024-09-12T00:25:33.599 INFO:teuthology.orchestra.run.smithi067.stderr: 23300K .......... .......... .......... .......... .......... 25% 305M 1s 2024-09-12T00:25:33.599 INFO:teuthology.orchestra.run.smithi067.stderr: 23350K .......... .......... .......... .......... .......... 25% 180M 1s 2024-09-12T00:25:33.599 INFO:teuthology.orchestra.run.smithi067.stderr: 23400K .......... .......... .......... .......... .......... 25% 329M 1s 2024-09-12T00:25:33.599 INFO:teuthology.orchestra.run.smithi067.stderr: 23450K .......... .......... .......... .......... .......... 25% 326M 1s 2024-09-12T00:25:33.599 INFO:teuthology.orchestra.run.smithi067.stderr: 23500K .......... .......... .......... .......... .......... 25% 201M 1s 2024-09-12T00:25:33.599 INFO:teuthology.orchestra.run.smithi067.stderr: 23550K .......... .......... .......... .......... .......... 25% 61.6M 1s 2024-09-12T00:25:33.599 INFO:teuthology.orchestra.run.smithi067.stderr: 23600K .......... .......... .......... .......... .......... 25% 270M 1s 2024-09-12T00:25:33.599 INFO:teuthology.orchestra.run.smithi067.stderr: 23650K .......... .......... .......... .......... .......... 25% 318M 1s 2024-09-12T00:25:33.599 INFO:teuthology.orchestra.run.smithi067.stderr: 23700K .......... .......... .......... .......... .......... 25% 288M 1s 2024-09-12T00:25:33.599 INFO:teuthology.orchestra.run.smithi067.stderr: 23750K .......... .......... .......... .......... .......... 25% 365M 1s 2024-09-12T00:25:33.600 INFO:teuthology.orchestra.run.smithi067.stderr: 23800K .......... .......... .......... .......... .......... 25% 171M 1s 2024-09-12T00:25:33.600 INFO:teuthology.orchestra.run.smithi067.stderr: 23850K .......... .......... .......... .......... .......... 25% 129M 1s 2024-09-12T00:25:33.600 INFO:teuthology.orchestra.run.smithi067.stderr: 23900K .......... .......... .......... .......... .......... 25% 217M 1s 2024-09-12T00:25:33.600 INFO:teuthology.orchestra.run.smithi067.stderr: 23950K .......... .......... .......... .......... .......... 25% 153M 1s 2024-09-12T00:25:33.600 INFO:teuthology.orchestra.run.smithi067.stderr: 24000K .......... .......... .......... .......... .......... 25% 280M 1s 2024-09-12T00:25:33.600 INFO:teuthology.orchestra.run.smithi067.stderr: 24050K .......... .......... .......... .......... .......... 25% 330M 1s 2024-09-12T00:25:33.600 INFO:teuthology.orchestra.run.smithi067.stderr: 24100K .......... .......... .......... .......... .......... 25% 85.3M 1s 2024-09-12T00:25:33.600 INFO:teuthology.orchestra.run.smithi067.stderr: 24150K .......... .......... .......... .......... .......... 26% 340M 1s 2024-09-12T00:25:33.600 INFO:teuthology.orchestra.run.smithi067.stderr: 24200K .......... .......... .......... .......... .......... 26% 335M 1s 2024-09-12T00:25:33.600 INFO:teuthology.orchestra.run.smithi067.stderr: 24250K .......... .......... .......... .......... .......... 26% 315M 1s 2024-09-12T00:25:33.600 INFO:teuthology.orchestra.run.smithi067.stderr: 24300K .......... .......... .......... .......... .......... 26% 152M 1s 2024-09-12T00:25:33.600 INFO:teuthology.orchestra.run.smithi067.stderr: 24350K .......... .......... .......... .......... .......... 26% 103M 1s 2024-09-12T00:25:33.600 INFO:teuthology.orchestra.run.smithi067.stderr: 24400K .......... .......... .......... .......... .......... 26% 304M 1s 2024-09-12T00:25:33.600 INFO:teuthology.orchestra.run.smithi067.stderr: 24450K .......... .......... .......... .......... .......... 26% 340M 1s 2024-09-12T00:25:33.601 INFO:teuthology.orchestra.run.smithi067.stderr: 24500K .......... .......... .......... .......... .......... 26% 308M 1s 2024-09-12T00:25:33.601 INFO:teuthology.orchestra.run.smithi067.stderr: 24550K .......... .......... .......... .......... .......... 26% 319M 1s 2024-09-12T00:25:33.601 INFO:teuthology.orchestra.run.smithi067.stderr: 24600K .......... .......... .......... .......... .......... 26% 123M 1s 2024-09-12T00:25:33.601 INFO:teuthology.orchestra.run.smithi067.stderr: 24650K .......... .......... .......... .......... .......... 26% 313M 1s 2024-09-12T00:25:33.601 INFO:teuthology.orchestra.run.smithi067.stderr: 24700K .......... .......... .......... .......... .......... 26% 233M 1s 2024-09-12T00:25:33.601 INFO:teuthology.orchestra.run.smithi067.stderr: 24750K .......... .......... .......... .......... .......... 26% 319M 1s 2024-09-12T00:25:33.601 INFO:teuthology.orchestra.run.smithi067.stderr: 24800K .......... .......... .......... .......... .......... 26% 345M 1s 2024-09-12T00:25:33.601 INFO:teuthology.orchestra.run.smithi067.stderr: 24850K .......... .......... .......... .......... .......... 26% 306M 1s 2024-09-12T00:25:33.601 INFO:teuthology.orchestra.run.smithi067.stderr: 24900K .......... .......... .......... .......... .......... 26% 309M 1s 2024-09-12T00:25:33.601 INFO:teuthology.orchestra.run.smithi067.stderr: 24950K .......... .......... .......... .......... .......... 26% 201M 1s 2024-09-12T00:25:33.601 INFO:teuthology.orchestra.run.smithi067.stderr: 25000K .......... .......... .......... .......... .......... 26% 297M 1s 2024-09-12T00:25:33.601 INFO:teuthology.orchestra.run.smithi067.stderr: 25050K .......... .......... .......... .......... .......... 27% 246M 1s 2024-09-12T00:25:33.601 INFO:teuthology.orchestra.run.smithi067.stderr: 25100K .......... .......... .......... .......... .......... 27% 168M 1s 2024-09-12T00:25:33.602 INFO:teuthology.orchestra.run.smithi067.stderr: 25150K .......... .......... .......... .......... .......... 27% 260M 1s 2024-09-12T00:25:33.602 INFO:teuthology.orchestra.run.smithi067.stderr: 25200K .......... .......... .......... .......... .......... 27% 286M 1s 2024-09-12T00:25:33.602 INFO:teuthology.orchestra.run.smithi067.stderr: 25250K .......... .......... .......... .......... .......... 27% 246M 1s 2024-09-12T00:25:33.602 INFO:teuthology.orchestra.run.smithi067.stderr: 25300K .......... .......... .......... .......... .......... 27% 67.3M 1s 2024-09-12T00:25:33.602 INFO:teuthology.orchestra.run.smithi067.stderr: 25350K .......... .......... .......... .......... .......... 27% 288M 1s 2024-09-12T00:25:33.602 INFO:teuthology.orchestra.run.smithi067.stderr: 25400K .......... .......... .......... .......... .......... 27% 93.7M 1s 2024-09-12T00:25:33.602 INFO:teuthology.orchestra.run.smithi067.stderr: 25450K .......... .......... .......... .......... .......... 27% 293M 1s 2024-09-12T00:25:33.602 INFO:teuthology.orchestra.run.smithi067.stderr: 25500K .......... .......... .......... .......... .......... 27% 235M 0s 2024-09-12T00:25:33.602 INFO:teuthology.orchestra.run.smithi067.stderr: 25550K .......... .......... .......... .......... .......... 27% 323M 0s 2024-09-12T00:25:33.602 INFO:teuthology.orchestra.run.smithi067.stderr: 25600K .......... .......... .......... .......... .......... 27% 318M 0s 2024-09-12T00:25:33.602 INFO:teuthology.orchestra.run.smithi067.stderr: 25650K .......... .......... .......... .......... .......... 27% 257M 0s 2024-09-12T00:25:33.602 INFO:teuthology.orchestra.run.smithi067.stderr: 25700K .......... .......... .......... .......... .......... 27% 271M 0s 2024-09-12T00:25:33.602 INFO:teuthology.orchestra.run.smithi067.stderr: 25750K .......... .......... .......... .......... .......... 27% 235M 0s 2024-09-12T00:25:33.602 INFO:teuthology.orchestra.run.smithi067.stderr: 25800K .......... .......... .......... .......... .......... 27% 321M 0s 2024-09-12T00:25:33.603 INFO:teuthology.orchestra.run.smithi067.stderr: 25850K .......... .......... .......... .......... .......... 27% 59.2M 0s 2024-09-12T00:25:33.603 INFO:teuthology.orchestra.run.smithi067.stderr: 25900K .......... .......... .......... .......... .......... 27% 117M 0s 2024-09-12T00:25:33.603 INFO:teuthology.orchestra.run.smithi067.stderr: 25950K .......... .......... .......... .......... .......... 27% 64.8M 0s 2024-09-12T00:25:33.603 INFO:teuthology.orchestra.run.smithi067.stderr: 26000K .......... .......... .......... .......... .......... 28% 298M 0s 2024-09-12T00:25:33.603 INFO:teuthology.orchestra.run.smithi067.stderr: 26050K .......... .......... .......... .......... .......... 28% 292M 0s 2024-09-12T00:25:33.603 INFO:teuthology.orchestra.run.smithi067.stderr: 26100K .......... .......... .......... .......... .......... 28% 285M 0s 2024-09-12T00:25:33.603 INFO:teuthology.orchestra.run.smithi067.stderr: 26150K .......... .......... .......... .......... .......... 28% 326M 0s 2024-09-12T00:25:33.603 INFO:teuthology.orchestra.run.smithi067.stderr: 26200K .......... .......... .......... .......... .......... 28% 318M 0s 2024-09-12T00:25:33.603 INFO:teuthology.orchestra.run.smithi067.stderr: 26250K .......... .......... .......... .......... .......... 28% 325M 0s 2024-09-12T00:25:33.603 INFO:teuthology.orchestra.run.smithi067.stderr: 26300K .......... .......... .......... .......... .......... 28% 276M 0s 2024-09-12T00:25:33.603 INFO:teuthology.orchestra.run.smithi067.stderr: 26350K .......... .......... .......... .......... .......... 28% 70.1M 0s 2024-09-12T00:25:33.603 INFO:teuthology.orchestra.run.smithi067.stderr: 26400K .......... .......... .......... .......... .......... 28% 219M 0s 2024-09-12T00:25:33.603 INFO:teuthology.orchestra.run.smithi067.stderr: 26450K .......... .......... .......... .......... .......... 28% 305M 0s 2024-09-12T00:25:33.603 INFO:teuthology.orchestra.run.smithi067.stderr: 26500K .......... .......... .......... .......... .......... 28% 268M 0s 2024-09-12T00:25:33.603 INFO:teuthology.orchestra.run.smithi067.stderr: 26550K .......... .......... .......... .......... .......... 28% 343M 0s 2024-09-12T00:25:33.604 INFO:teuthology.orchestra.run.smithi067.stderr: 26600K .......... .......... .......... .......... .......... 28% 67.7M 0s 2024-09-12T00:25:33.604 INFO:teuthology.orchestra.run.smithi067.stderr: 26650K .......... .......... .......... .......... .......... 28% 127M 0s 2024-09-12T00:25:33.604 INFO:teuthology.orchestra.run.smithi067.stderr: 26700K .......... .......... .......... .......... .......... 28% 251M 0s 2024-09-12T00:25:33.604 INFO:teuthology.orchestra.run.smithi067.stderr: 26750K .......... .......... .......... .......... .......... 28% 128M 0s 2024-09-12T00:25:33.604 INFO:teuthology.orchestra.run.smithi067.stderr: 26800K .......... .......... .......... .......... .......... 28% 315M 0s 2024-09-12T00:25:33.604 INFO:teuthology.orchestra.run.smithi067.stderr: 26850K .......... .......... .......... .......... .......... 28% 69.6M 0s 2024-09-12T00:25:33.604 INFO:teuthology.orchestra.run.smithi067.stderr: 26900K .......... .......... .......... .......... .......... 29% 276M 0s 2024-09-12T00:25:33.604 INFO:teuthology.orchestra.run.smithi067.stderr: 26950K .......... .......... .......... .......... .......... 29% 274M 0s 2024-09-12T00:25:33.604 INFO:teuthology.orchestra.run.smithi067.stderr: 27000K .......... .......... .......... .......... .......... 29% 314M 0s 2024-09-12T00:25:33.604 INFO:teuthology.orchestra.run.smithi067.stderr: 27050K .......... .......... .......... .......... .......... 29% 324M 0s 2024-09-12T00:25:33.604 INFO:teuthology.orchestra.run.smithi067.stderr: 27100K .......... .......... .......... .......... .......... 29% 298M 0s 2024-09-12T00:25:33.604 INFO:teuthology.orchestra.run.smithi067.stderr: 27150K .......... .......... .......... .......... .......... 29% 82.2M 0s 2024-09-12T00:25:33.604 INFO:teuthology.orchestra.run.smithi067.stderr: 27200K .......... .......... .......... .......... .......... 29% 274M 0s 2024-09-12T00:25:33.605 INFO:teuthology.orchestra.run.smithi067.stderr: 27250K .......... .......... .......... .......... .......... 29% 326M 0s 2024-09-12T00:25:33.605 INFO:teuthology.orchestra.run.smithi067.stderr: 27300K .......... .......... .......... .......... .......... 29% 86.8M 0s 2024-09-12T00:25:33.605 INFO:teuthology.orchestra.run.smithi067.stderr: 27350K .......... .......... .......... .......... .......... 29% 285M 0s 2024-09-12T00:25:33.605 INFO:teuthology.orchestra.run.smithi067.stderr: 27400K .......... .......... .......... .......... .......... 29% 89.8M 0s 2024-09-12T00:25:33.605 INFO:teuthology.orchestra.run.smithi067.stderr: 27450K .......... .......... .......... .......... .......... 29% 197M 0s 2024-09-12T00:25:33.605 INFO:teuthology.orchestra.run.smithi067.stderr: 27500K .......... .......... .......... .......... .......... 29% 187M 0s 2024-09-12T00:25:33.605 INFO:teuthology.orchestra.run.smithi067.stderr: 27550K .......... .......... .......... .......... .......... 29% 272M 0s 2024-09-12T00:25:33.605 INFO:teuthology.orchestra.run.smithi067.stderr: 27600K .......... .......... .......... .......... .......... 29% 327M 0s 2024-09-12T00:25:33.605 INFO:teuthology.orchestra.run.smithi067.stderr: 27650K .......... .......... .......... .......... .......... 29% 128M 0s 2024-09-12T00:25:33.605 INFO:teuthology.orchestra.run.smithi067.stderr: 27700K .......... .......... .......... .......... .......... 29% 251M 0s 2024-09-12T00:25:33.605 INFO:teuthology.orchestra.run.smithi067.stderr: 27750K .......... .......... .......... .......... .......... 29% 83.5M 0s 2024-09-12T00:25:33.605 INFO:teuthology.orchestra.run.smithi067.stderr: 27800K .......... .......... .......... .......... .......... 29% 100M 0s 2024-09-12T00:25:33.605 INFO:teuthology.orchestra.run.smithi067.stderr: 27850K .......... .......... .......... .......... .......... 30% 199M 0s 2024-09-12T00:25:33.605 INFO:teuthology.orchestra.run.smithi067.stderr: 27900K .......... .......... .......... .......... .......... 30% 195M 0s 2024-09-12T00:25:33.606 INFO:teuthology.orchestra.run.smithi067.stderr: 27950K .......... .......... .......... .......... .......... 30% 293M 0s 2024-09-12T00:25:33.606 INFO:teuthology.orchestra.run.smithi067.stderr: 28000K .......... .......... .......... .......... .......... 30% 194M 0s 2024-09-12T00:25:33.606 INFO:teuthology.orchestra.run.smithi067.stderr: 28050K .......... .......... .......... .......... .......... 30% 178M 0s 2024-09-12T00:25:33.606 INFO:teuthology.orchestra.run.smithi067.stderr: 28100K .......... .......... .......... .......... .......... 30% 175M 0s 2024-09-12T00:25:33.606 INFO:teuthology.orchestra.run.smithi067.stderr: 28150K .......... .......... .......... .......... .......... 30% 320M 0s 2024-09-12T00:25:33.606 INFO:teuthology.orchestra.run.smithi067.stderr: 28200K .......... .......... .......... .......... .......... 30% 183M 0s 2024-09-12T00:25:33.606 INFO:teuthology.orchestra.run.smithi067.stderr: 28250K .......... .......... .......... .......... .......... 30% 177M 0s 2024-09-12T00:25:33.606 INFO:teuthology.orchestra.run.smithi067.stderr: 28300K .......... .......... .......... .......... .......... 30% 252M 0s 2024-09-12T00:25:33.606 INFO:teuthology.orchestra.run.smithi067.stderr: 28350K .......... .......... .......... .......... .......... 30% 60.3M 0s 2024-09-12T00:25:33.606 INFO:teuthology.orchestra.run.smithi067.stderr: 28400K .......... .......... .......... .......... .......... 30% 311M 0s 2024-09-12T00:25:33.606 INFO:teuthology.orchestra.run.smithi067.stderr: 28450K .......... .......... .......... .......... .......... 30% 176M 0s 2024-09-12T00:25:33.606 INFO:teuthology.orchestra.run.smithi067.stderr: 28500K .......... .......... .......... .......... .......... 30% 124M 0s 2024-09-12T00:25:33.606 INFO:teuthology.orchestra.run.smithi067.stderr: 28550K .......... .......... .......... .......... .......... 30% 131M 0s 2024-09-12T00:25:33.606 INFO:teuthology.orchestra.run.smithi067.stderr: 28600K .......... .......... .......... .......... .......... 30% 335M 0s 2024-09-12T00:25:33.607 INFO:teuthology.orchestra.run.smithi067.stderr: 28650K .......... .......... .......... .......... .......... 30% 297M 0s 2024-09-12T00:25:33.607 INFO:teuthology.orchestra.run.smithi067.stderr: 28700K .......... .......... .......... .......... .......... 30% 139M 0s 2024-09-12T00:25:33.607 INFO:teuthology.orchestra.run.smithi067.stderr: 28750K .......... .......... .......... .......... .......... 31% 312M 0s 2024-09-12T00:25:33.607 INFO:teuthology.orchestra.run.smithi067.stderr: 28800K .......... .......... .......... .......... .......... 31% 311M 0s 2024-09-12T00:25:33.607 INFO:teuthology.orchestra.run.smithi067.stderr: 28850K .......... .......... .......... .......... .......... 31% 320M 0s 2024-09-12T00:25:33.607 INFO:teuthology.orchestra.run.smithi067.stderr: 28900K .......... .......... .......... .......... .......... 31% 52.8M 0s 2024-09-12T00:25:33.607 INFO:teuthology.orchestra.run.smithi067.stderr: 28950K .......... .......... .......... .......... .......... 31% 111M 0s 2024-09-12T00:25:33.607 INFO:teuthology.orchestra.run.smithi067.stderr: 29000K .......... .......... .......... .......... .......... 31% 75.1M 0s 2024-09-12T00:25:33.607 INFO:teuthology.orchestra.run.smithi067.stderr: 29050K .......... .......... .......... .......... .......... 31% 122M 0s 2024-09-12T00:25:33.607 INFO:teuthology.orchestra.run.smithi067.stderr: 29100K .......... .......... .......... .......... .......... 31% 153M 0s 2024-09-12T00:25:33.607 INFO:teuthology.orchestra.run.smithi067.stderr: 29150K .......... .......... .......... .......... .......... 31% 279M 0s 2024-09-12T00:25:33.607 INFO:teuthology.orchestra.run.smithi067.stderr: 29200K .......... .......... .......... .......... .......... 31% 247M 0s 2024-09-12T00:25:33.607 INFO:teuthology.orchestra.run.smithi067.stderr: 29250K .......... .......... .......... .......... .......... 31% 258M 0s 2024-09-12T00:25:33.607 INFO:teuthology.orchestra.run.smithi067.stderr: 29300K .......... .......... .......... .......... .......... 31% 309M 0s 2024-09-12T00:25:33.607 INFO:teuthology.orchestra.run.smithi067.stderr: 29350K .......... .......... .......... .......... .......... 31% 355M 0s 2024-09-12T00:25:33.608 INFO:teuthology.orchestra.run.smithi067.stderr: 29400K .......... .......... .......... .......... .......... 31% 79.8M 0s 2024-09-12T00:25:33.608 INFO:teuthology.orchestra.run.smithi067.stderr: 29450K .......... .......... .......... .......... .......... 31% 306M 0s 2024-09-12T00:25:33.608 INFO:teuthology.orchestra.run.smithi067.stderr: 29500K .......... .......... .......... .......... .......... 31% 231M 0s 2024-09-12T00:25:33.608 INFO:teuthology.orchestra.run.smithi067.stderr: 29550K .......... .......... .......... .......... .......... 31% 70.4M 0s 2024-09-12T00:25:33.608 INFO:teuthology.orchestra.run.smithi067.stderr: 29600K .......... .......... .......... .......... .......... 31% 312M 0s 2024-09-12T00:25:33.608 INFO:teuthology.orchestra.run.smithi067.stderr: 29650K .......... .......... .......... .......... .......... 31% 110M 0s 2024-09-12T00:25:33.608 INFO:teuthology.orchestra.run.smithi067.stderr: 29700K .......... .......... .......... .......... .......... 32% 195M 0s 2024-09-12T00:25:33.608 INFO:teuthology.orchestra.run.smithi067.stderr: 29750K .......... .......... .......... .......... .......... 32% 323M 0s 2024-09-12T00:25:33.608 INFO:teuthology.orchestra.run.smithi067.stderr: 29800K .......... .......... .......... .......... .......... 32% 195M 0s 2024-09-12T00:25:33.608 INFO:teuthology.orchestra.run.smithi067.stderr: 29850K .......... .......... .......... .......... .......... 32% 84.8M 0s 2024-09-12T00:25:33.608 INFO:teuthology.orchestra.run.smithi067.stderr: 29900K .......... .......... .......... .......... .......... 32% 101M 0s 2024-09-12T00:25:33.608 INFO:teuthology.orchestra.run.smithi067.stderr: 29950K .......... .......... .......... .......... .......... 32% 92.5M 0s 2024-09-12T00:25:33.608 INFO:teuthology.orchestra.run.smithi067.stderr: 30000K .......... .......... .......... .......... .......... 32% 133M 0s 2024-09-12T00:25:33.608 INFO:teuthology.orchestra.run.smithi067.stderr: 30050K .......... .......... .......... .......... .......... 32% 206M 0s 2024-09-12T00:25:33.609 INFO:teuthology.orchestra.run.smithi067.stderr: 30100K .......... .......... .......... .......... .......... 32% 81.1M 0s 2024-09-12T00:25:33.609 INFO:teuthology.orchestra.run.smithi067.stderr: 30150K .......... .......... .......... .......... .......... 32% 86.4M 0s 2024-09-12T00:25:33.609 INFO:teuthology.orchestra.run.smithi067.stderr: 30200K .......... .......... .......... .......... .......... 32% 249M 0s 2024-09-12T00:25:33.609 INFO:teuthology.orchestra.run.smithi067.stderr: 30250K .......... .......... .......... .......... .......... 32% 342M 0s 2024-09-12T00:25:33.609 INFO:teuthology.orchestra.run.smithi067.stderr: 30300K .......... .......... .......... .......... .......... 32% 202M 0s 2024-09-12T00:25:33.609 INFO:teuthology.orchestra.run.smithi067.stderr: 30350K .......... .......... .......... .......... .......... 32% 88.3M 0s 2024-09-12T00:25:33.609 INFO:teuthology.orchestra.run.smithi067.stderr: 30400K .......... .......... .......... .......... .......... 32% 74.1M 0s 2024-09-12T00:25:33.609 INFO:teuthology.orchestra.run.smithi067.stderr: 30450K .......... .......... .......... .......... .......... 32% 195M 0s 2024-09-12T00:25:33.609 INFO:teuthology.orchestra.run.smithi067.stderr: 30500K .......... .......... .......... .......... .......... 32% 315M 0s 2024-09-12T00:25:33.609 INFO:teuthology.orchestra.run.smithi067.stderr: 30550K .......... .......... .......... .......... .......... 32% 132M 0s 2024-09-12T00:25:33.609 INFO:teuthology.orchestra.run.smithi067.stderr: 30600K .......... .......... .......... .......... .......... 32% 272M 0s 2024-09-12T00:25:33.609 INFO:teuthology.orchestra.run.smithi067.stderr: 30650K .......... .......... .......... .......... .......... 33% 241M 0s 2024-09-12T00:25:33.609 INFO:teuthology.orchestra.run.smithi067.stderr: 30700K .......... .......... .......... .......... .......... 33% 294M 0s 2024-09-12T00:25:33.609 INFO:teuthology.orchestra.run.smithi067.stderr: 30750K .......... .......... .......... .......... .......... 33% 310M 0s 2024-09-12T00:25:33.610 INFO:teuthology.orchestra.run.smithi067.stderr: 30800K .......... .......... .......... .......... .......... 33% 113M 0s 2024-09-12T00:25:33.610 INFO:teuthology.orchestra.run.smithi067.stderr: 30850K .......... .......... .......... .......... .......... 33% 167M 0s 2024-09-12T00:25:33.610 INFO:teuthology.orchestra.run.smithi067.stderr: 30900K .......... .......... .......... .......... .......... 33% 63.9M 0s 2024-09-12T00:25:33.610 INFO:teuthology.orchestra.run.smithi067.stderr: 30950K .......... .......... .......... .......... .......... 33% 280M 0s 2024-09-12T00:25:33.610 INFO:teuthology.orchestra.run.smithi067.stderr: 31000K .......... .......... .......... .......... .......... 33% 177M 0s 2024-09-12T00:25:33.610 INFO:teuthology.orchestra.run.smithi067.stderr: 31050K .......... .......... .......... .......... .......... 33% 150M 0s 2024-09-12T00:25:33.610 INFO:teuthology.orchestra.run.smithi067.stderr: 31100K .......... .......... .......... .......... .......... 33% 319M 0s 2024-09-12T00:25:33.610 INFO:teuthology.orchestra.run.smithi067.stderr: 31150K .......... .......... .......... .......... .......... 33% 200M 0s 2024-09-12T00:25:33.610 INFO:teuthology.orchestra.run.smithi067.stderr: 31200K .......... .......... .......... .......... .......... 33% 321M 0s 2024-09-12T00:25:33.610 INFO:teuthology.orchestra.run.smithi067.stderr: 31250K .......... .......... .......... .......... .......... 33% 307M 0s 2024-09-12T00:25:33.610 INFO:teuthology.orchestra.run.smithi067.stderr: 31300K .......... .......... .......... .......... .......... 33% 353M 0s 2024-09-12T00:25:33.610 INFO:teuthology.orchestra.run.smithi067.stderr: 31350K .......... .......... .......... .......... .......... 33% 234M 0s 2024-09-12T00:25:33.610 INFO:teuthology.orchestra.run.smithi067.stderr: 31400K .......... .......... .......... .......... .......... 33% 291M 0s 2024-09-12T00:25:33.610 INFO:teuthology.orchestra.run.smithi067.stderr: 31450K .......... .......... .......... .......... .......... 33% 261M 0s 2024-09-12T00:25:33.611 INFO:teuthology.orchestra.run.smithi067.stderr: 31500K .......... .......... .......... .......... .......... 33% 376M 0s 2024-09-12T00:25:33.611 INFO:teuthology.orchestra.run.smithi067.stderr: 31550K .......... .......... .......... .......... .......... 34% 324M 0s 2024-09-12T00:25:33.611 INFO:teuthology.orchestra.run.smithi067.stderr: 31600K .......... .......... .......... .......... .......... 34% 338M 0s 2024-09-12T00:25:33.611 INFO:teuthology.orchestra.run.smithi067.stderr: 31650K .......... .......... .......... .......... .......... 34% 262M 0s 2024-09-12T00:25:33.611 INFO:teuthology.orchestra.run.smithi067.stderr: 31700K .......... .......... .......... .......... .......... 34% 314M 0s 2024-09-12T00:25:33.611 INFO:teuthology.orchestra.run.smithi067.stderr: 31750K .......... .......... .......... .......... .......... 34% 303M 0s 2024-09-12T00:25:33.611 INFO:teuthology.orchestra.run.smithi067.stderr: 31800K .......... .......... .......... .......... .......... 34% 300M 0s 2024-09-12T00:25:33.611 INFO:teuthology.orchestra.run.smithi067.stderr: 31850K .......... .......... .......... .......... .......... 34% 342M 0s 2024-09-12T00:25:33.611 INFO:teuthology.orchestra.run.smithi067.stderr: 31900K .......... .......... .......... .......... .......... 34% 334M 0s 2024-09-12T00:25:33.611 INFO:teuthology.orchestra.run.smithi067.stderr: 31950K .......... .......... .......... .......... .......... 34% 286M 0s 2024-09-12T00:25:33.611 INFO:teuthology.orchestra.run.smithi067.stderr: 32000K .......... .......... .......... .......... .......... 34% 337M 0s 2024-09-12T00:25:33.611 INFO:teuthology.orchestra.run.smithi067.stderr: 32050K .......... .......... .......... .......... .......... 34% 183M 0s 2024-09-12T00:25:33.611 INFO:teuthology.orchestra.run.smithi067.stderr: 32100K .......... .......... .......... .......... .......... 34% 290M 0s 2024-09-12T00:25:33.611 INFO:teuthology.orchestra.run.smithi067.stderr: 32150K .......... .......... .......... .......... .......... 34% 297M 0s 2024-09-12T00:25:33.612 INFO:teuthology.orchestra.run.smithi067.stderr: 32200K .......... .......... .......... .......... .......... 34% 118M 0s 2024-09-12T00:25:33.612 INFO:teuthology.orchestra.run.smithi067.stderr: 32250K .......... .......... .......... .......... .......... 34% 101M 0s 2024-09-12T00:25:33.612 INFO:teuthology.orchestra.run.smithi067.stderr: 32300K .......... .......... .......... .......... .......... 34% 216M 0s 2024-09-12T00:25:33.612 INFO:teuthology.orchestra.run.smithi067.stderr: 32350K .......... .......... .......... .......... .......... 34% 58.8M 0s 2024-09-12T00:25:33.612 INFO:teuthology.orchestra.run.smithi067.stderr: 32400K .......... .......... .......... .......... .......... 34% 285M 0s 2024-09-12T00:25:33.612 INFO:teuthology.orchestra.run.smithi067.stderr: 32450K .......... .......... .......... .......... .......... 34% 334M 0s 2024-09-12T00:25:33.612 INFO:teuthology.orchestra.run.smithi067.stderr: 32500K .......... .......... .......... .......... .......... 35% 330M 0s 2024-09-12T00:25:33.612 INFO:teuthology.orchestra.run.smithi067.stderr: 32550K .......... .......... .......... .......... .......... 35% 278M 0s 2024-09-12T00:25:33.612 INFO:teuthology.orchestra.run.smithi067.stderr: 32600K .......... .......... .......... .......... .......... 35% 352M 0s 2024-09-12T00:25:33.612 INFO:teuthology.orchestra.run.smithi067.stderr: 32650K .......... .......... .......... .......... .......... 35% 33.1M 0s 2024-09-12T00:25:33.612 INFO:teuthology.orchestra.run.smithi067.stderr: 32700K .......... .......... .......... .......... .......... 35% 335M 0s 2024-09-12T00:25:33.612 INFO:teuthology.orchestra.run.smithi067.stderr: 32750K .......... .......... .......... .......... .......... 35% 138M 0s 2024-09-12T00:25:33.612 INFO:teuthology.orchestra.run.smithi067.stderr: 32800K .......... .......... .......... .......... .......... 35% 279M 0s 2024-09-12T00:25:33.612 INFO:teuthology.orchestra.run.smithi067.stderr: 32850K .......... .......... .......... .......... .......... 35% 288M 0s 2024-09-12T00:25:33.613 INFO:teuthology.orchestra.run.smithi067.stderr: 32900K .......... .......... .......... .......... .......... 35% 289M 0s 2024-09-12T00:25:33.613 INFO:teuthology.orchestra.run.smithi067.stderr: 32950K .......... .......... .......... .......... .......... 35% 304M 0s 2024-09-12T00:25:33.613 INFO:teuthology.orchestra.run.smithi067.stderr: 33000K .......... .......... .......... .......... .......... 35% 86.9M 0s 2024-09-12T00:25:33.613 INFO:teuthology.orchestra.run.smithi067.stderr: 33050K .......... .......... .......... .......... .......... 35% 247M 0s 2024-09-12T00:25:33.613 INFO:teuthology.orchestra.run.smithi067.stderr: 33100K .......... .......... .......... .......... .......... 35% 126M 0s 2024-09-12T00:25:33.613 INFO:teuthology.orchestra.run.smithi067.stderr: 33150K .......... .......... .......... .......... .......... 35% 91.7M 0s 2024-09-12T00:25:33.613 INFO:teuthology.orchestra.run.smithi067.stderr: 33200K .......... .......... .......... .......... .......... 35% 269M 0s 2024-09-12T00:25:33.613 INFO:teuthology.orchestra.run.smithi067.stderr: 33250K .......... .......... .......... .......... .......... 35% 87.1M 0s 2024-09-12T00:25:33.613 INFO:teuthology.orchestra.run.smithi067.stderr: 33300K .......... .......... .......... .......... .......... 35% 324M 0s 2024-09-12T00:25:33.613 INFO:teuthology.orchestra.run.smithi067.stderr: 33350K .......... .......... .......... .......... .......... 35% 297M 0s 2024-09-12T00:25:33.613 INFO:teuthology.orchestra.run.smithi067.stderr: 33400K .......... .......... .......... .......... .......... 36% 287M 0s 2024-09-12T00:25:33.613 INFO:teuthology.orchestra.run.smithi067.stderr: 33450K .......... .......... .......... .......... .......... 36% 126M 0s 2024-09-12T00:25:33.613 INFO:teuthology.orchestra.run.smithi067.stderr: 33500K .......... .......... .......... .......... .......... 36% 368M 0s 2024-09-12T00:25:33.614 INFO:teuthology.orchestra.run.smithi067.stderr: 33550K .......... .......... .......... .......... .......... 36% 199M 0s 2024-09-12T00:25:33.614 INFO:teuthology.orchestra.run.smithi067.stderr: 33600K .......... .......... .......... .......... .......... 36% 309M 0s 2024-09-12T00:25:33.614 INFO:teuthology.orchestra.run.smithi067.stderr: 33650K .......... .......... .......... .......... .......... 36% 338M 0s 2024-09-12T00:25:33.614 INFO:teuthology.orchestra.run.smithi067.stderr: 33700K .......... .......... .......... .......... .......... 36% 332M 0s 2024-09-12T00:25:33.614 INFO:teuthology.orchestra.run.smithi067.stderr: 33750K .......... .......... .......... .......... .......... 36% 304M 0s 2024-09-12T00:25:33.614 INFO:teuthology.orchestra.run.smithi067.stderr: 33800K .......... .......... .......... .......... .......... 36% 312M 0s 2024-09-12T00:25:33.614 INFO:teuthology.orchestra.run.smithi067.stderr: 33850K .......... .......... .......... .......... .......... 36% 383M 0s 2024-09-12T00:25:33.614 INFO:teuthology.orchestra.run.smithi067.stderr: 33900K .......... .......... .......... .......... .......... 36% 374M 0s 2024-09-12T00:25:33.614 INFO:teuthology.orchestra.run.smithi067.stderr: 33950K .......... .......... .......... .......... .......... 36% 299M 0s 2024-09-12T00:25:33.614 INFO:teuthology.orchestra.run.smithi067.stderr: 34000K .......... .......... .......... .......... .......... 36% 354M 0s 2024-09-12T00:25:33.614 INFO:teuthology.orchestra.run.smithi067.stderr: 34050K .......... .......... .......... .......... .......... 36% 376M 0s 2024-09-12T00:25:33.614 INFO:teuthology.orchestra.run.smithi067.stderr: 34100K .......... .......... .......... .......... .......... 36% 326M 0s 2024-09-12T00:25:33.614 INFO:teuthology.orchestra.run.smithi067.stderr: 34150K .......... .......... .......... .......... .......... 36% 208M 0s 2024-09-12T00:25:33.614 INFO:teuthology.orchestra.run.smithi067.stderr: 34200K .......... .......... .......... .......... .......... 36% 349M 0s 2024-09-12T00:25:33.615 INFO:teuthology.orchestra.run.smithi067.stderr: 34250K .......... .......... .......... .......... .......... 36% 352M 0s 2024-09-12T00:25:33.615 INFO:teuthology.orchestra.run.smithi067.stderr: 34300K .......... .......... .......... .......... .......... 36% 370M 0s 2024-09-12T00:25:33.615 INFO:teuthology.orchestra.run.smithi067.stderr: 34350K .......... .......... .......... .......... .......... 37% 281M 0s 2024-09-12T00:25:33.615 INFO:teuthology.orchestra.run.smithi067.stderr: 34400K .......... .......... .......... .......... .......... 37% 359M 0s 2024-09-12T00:25:33.615 INFO:teuthology.orchestra.run.smithi067.stderr: 34450K .......... .......... .......... .......... .......... 37% 273M 0s 2024-09-12T00:25:33.615 INFO:teuthology.orchestra.run.smithi067.stderr: 34500K .......... .......... .......... .......... .......... 37% 355M 0s 2024-09-12T00:25:33.615 INFO:teuthology.orchestra.run.smithi067.stderr: 34550K .......... .......... .......... .......... .......... 37% 364M 0s 2024-09-12T00:25:33.615 INFO:teuthology.orchestra.run.smithi067.stderr: 34600K .......... .......... .......... .......... .......... 37% 346M 0s 2024-09-12T00:25:33.615 INFO:teuthology.orchestra.run.smithi067.stderr: 34650K .......... .......... .......... .......... .......... 37% 295M 0s 2024-09-12T00:25:33.615 INFO:teuthology.orchestra.run.smithi067.stderr: 34700K .......... .......... .......... .......... .......... 37% 316M 0s 2024-09-12T00:25:33.615 INFO:teuthology.orchestra.run.smithi067.stderr: 34750K .......... .......... .......... .......... .......... 37% 319M 0s 2024-09-12T00:25:33.615 INFO:teuthology.orchestra.run.smithi067.stderr: 34800K .......... .......... .......... .......... .......... 37% 317M 0s 2024-09-12T00:25:33.615 INFO:teuthology.orchestra.run.smithi067.stderr: 34850K .......... .......... .......... .......... .......... 37% 320M 0s 2024-09-12T00:25:33.616 INFO:teuthology.orchestra.run.smithi067.stderr: 34900K .......... .......... .......... .......... .......... 37% 320M 0s 2024-09-12T00:25:33.616 INFO:teuthology.orchestra.run.smithi067.stderr: 34950K .......... .......... .......... .......... .......... 37% 322M 0s 2024-09-12T00:25:33.616 INFO:teuthology.orchestra.run.smithi067.stderr: 35000K .......... .......... .......... .......... .......... 37% 365M 0s 2024-09-12T00:25:33.616 INFO:teuthology.orchestra.run.smithi067.stderr: 35050K .......... .......... .......... .......... .......... 37% 358M 0s 2024-09-12T00:25:33.616 INFO:teuthology.orchestra.run.smithi067.stderr: 35100K .......... .......... .......... .......... .......... 37% 345M 0s 2024-09-12T00:25:33.616 INFO:teuthology.orchestra.run.smithi067.stderr: 35150K .......... .......... .......... .......... .......... 37% 306M 0s 2024-09-12T00:25:33.616 INFO:teuthology.orchestra.run.smithi067.stderr: 35200K .......... .......... .......... .......... .......... 37% 361M 0s 2024-09-12T00:25:33.616 INFO:teuthology.orchestra.run.smithi067.stderr: 35250K .......... .......... .......... .......... .......... 37% 358M 0s 2024-09-12T00:25:33.616 INFO:teuthology.orchestra.run.smithi067.stderr: 35300K .......... .......... .......... .......... .......... 38% 374M 0s 2024-09-12T00:25:33.616 INFO:teuthology.orchestra.run.smithi067.stderr: 35350K .......... .......... .......... .......... .......... 38% 327M 0s 2024-09-12T00:25:33.616 INFO:teuthology.orchestra.run.smithi067.stderr: 35400K .......... .......... .......... .......... .......... 38% 327M 0s 2024-09-12T00:25:33.616 INFO:teuthology.orchestra.run.smithi067.stderr: 35450K .......... .......... .......... .......... .......... 38% 44.5M 0s 2024-09-12T00:25:33.616 INFO:teuthology.orchestra.run.smithi067.stderr: 35500K .......... .......... .......... .......... .......... 38% 182M 0s 2024-09-12T00:25:33.616 INFO:teuthology.orchestra.run.smithi067.stderr: 35550K .......... .......... .......... .......... .......... 38% 82.7M 0s 2024-09-12T00:25:33.617 INFO:teuthology.orchestra.run.smithi067.stderr: 35600K .......... .......... .......... .......... .......... 38% 207M 0s 2024-09-12T00:25:33.617 INFO:teuthology.orchestra.run.smithi067.stderr: 35650K .......... .......... .......... .......... .......... 38% 311M 0s 2024-09-12T00:25:33.617 INFO:teuthology.orchestra.run.smithi067.stderr: 35700K .......... .......... .......... .......... .......... 38% 57.4M 0s 2024-09-12T00:25:33.617 INFO:teuthology.orchestra.run.smithi067.stderr: 35750K .......... .......... .......... .......... .......... 38% 289M 0s 2024-09-12T00:25:33.617 INFO:teuthology.orchestra.run.smithi067.stderr: 35800K .......... .......... .......... .......... .......... 38% 142M 0s 2024-09-12T00:25:33.617 INFO:teuthology.orchestra.run.smithi067.stderr: 35850K .......... .......... .......... .......... .......... 38% 290M 0s 2024-09-12T00:25:33.617 INFO:teuthology.orchestra.run.smithi067.stderr: 35900K .......... .......... .......... .......... .......... 38% 109M 0s 2024-09-12T00:25:33.617 INFO:teuthology.orchestra.run.smithi067.stderr: 35950K .......... .......... .......... .......... .......... 38% 131M 0s 2024-09-12T00:25:33.617 INFO:teuthology.orchestra.run.smithi067.stderr: 36000K .......... .......... .......... .......... .......... 38% 333M 0s 2024-09-12T00:25:33.617 INFO:teuthology.orchestra.run.smithi067.stderr: 36050K .......... .......... .......... .......... .......... 38% 271M 0s 2024-09-12T00:25:33.617 INFO:teuthology.orchestra.run.smithi067.stderr: 36100K .......... .......... .......... .......... .......... 38% 294M 0s 2024-09-12T00:25:33.617 INFO:teuthology.orchestra.run.smithi067.stderr: 36150K .......... .......... .......... .......... .......... 38% 109M 0s 2024-09-12T00:25:33.617 INFO:teuthology.orchestra.run.smithi067.stderr: 36200K .......... .......... .......... .......... .......... 39% 229M 0s 2024-09-12T00:25:33.617 INFO:teuthology.orchestra.run.smithi067.stderr: 36250K .......... .......... .......... .......... .......... 39% 255M 0s 2024-09-12T00:25:33.618 INFO:teuthology.orchestra.run.smithi067.stderr: 36300K .......... .......... .......... .......... .......... 39% 357M 0s 2024-09-12T00:25:33.618 INFO:teuthology.orchestra.run.smithi067.stderr: 36350K .......... .......... .......... .......... .......... 39% 67.8M 0s 2024-09-12T00:25:33.618 INFO:teuthology.orchestra.run.smithi067.stderr: 36400K .......... .......... .......... .......... .......... 39% 283M 0s 2024-09-12T00:25:33.618 INFO:teuthology.orchestra.run.smithi067.stderr: 36450K .......... .......... .......... .......... .......... 39% 217M 0s 2024-09-12T00:25:33.618 INFO:teuthology.orchestra.run.smithi067.stderr: 36500K .......... .......... .......... .......... .......... 39% 148M 0s 2024-09-12T00:25:33.618 INFO:teuthology.orchestra.run.smithi067.stderr: 36550K .......... .......... .......... .......... .......... 39% 283M 0s 2024-09-12T00:25:33.618 INFO:teuthology.orchestra.run.smithi067.stderr: 36600K .......... .......... .......... .......... .......... 39% 278M 0s 2024-09-12T00:25:33.618 INFO:teuthology.orchestra.run.smithi067.stderr: 36650K .......... .......... .......... .......... .......... 39% 328M 0s 2024-09-12T00:25:33.618 INFO:teuthology.orchestra.run.smithi067.stderr: 36700K .......... .......... .......... .......... .......... 39% 278M 0s 2024-09-12T00:25:33.618 INFO:teuthology.orchestra.run.smithi067.stderr: 36750K .......... .......... .......... .......... .......... 39% 215M 0s 2024-09-12T00:25:33.618 INFO:teuthology.orchestra.run.smithi067.stderr: 36800K .......... .......... .......... .......... .......... 39% 298M 0s 2024-09-12T00:25:33.618 INFO:teuthology.orchestra.run.smithi067.stderr: 36850K .......... .......... .......... .......... .......... 39% 293M 0s 2024-09-12T00:25:33.618 INFO:teuthology.orchestra.run.smithi067.stderr: 36900K .......... .......... .......... .......... .......... 39% 239M 0s 2024-09-12T00:25:33.618 INFO:teuthology.orchestra.run.smithi067.stderr: 36950K .......... .......... .......... .......... .......... 39% 275M 0s 2024-09-12T00:25:33.618 INFO:teuthology.orchestra.run.smithi067.stderr: 37000K .......... .......... .......... .......... .......... 39% 347M 0s 2024-09-12T00:25:33.619 INFO:teuthology.orchestra.run.smithi067.stderr: 37050K .......... .......... .......... .......... .......... 39% 316M 0s 2024-09-12T00:25:33.619 INFO:teuthology.orchestra.run.smithi067.stderr: 37100K .......... .......... .......... .......... .......... 39% 354M 0s 2024-09-12T00:25:33.619 INFO:teuthology.orchestra.run.smithi067.stderr: 37150K .......... .......... .......... .......... .......... 40% 285M 0s 2024-09-12T00:25:33.619 INFO:teuthology.orchestra.run.smithi067.stderr: 37200K .......... .......... .......... .......... .......... 40% 375M 0s 2024-09-12T00:25:33.619 INFO:teuthology.orchestra.run.smithi067.stderr: 37250K .......... .......... .......... .......... .......... 40% 343M 0s 2024-09-12T00:25:33.619 INFO:teuthology.orchestra.run.smithi067.stderr: 37300K .......... .......... .......... .......... .......... 40% 322M 0s 2024-09-12T00:25:33.619 INFO:teuthology.orchestra.run.smithi067.stderr: 37350K .......... .......... .......... .......... .......... 40% 308M 0s 2024-09-12T00:25:33.619 INFO:teuthology.orchestra.run.smithi067.stderr: 37400K .......... .......... .......... .......... .......... 40% 313M 0s 2024-09-12T00:25:33.619 INFO:teuthology.orchestra.run.smithi067.stderr: 37450K .......... .......... .......... .......... .......... 40% 344M 0s 2024-09-12T00:25:33.619 INFO:teuthology.orchestra.run.smithi067.stderr: 37500K .......... .......... .......... .......... .......... 40% 354M 0s 2024-09-12T00:25:33.619 INFO:teuthology.orchestra.run.smithi067.stderr: 37550K .......... .......... .......... .......... .......... 40% 289M 0s 2024-09-12T00:25:33.619 INFO:teuthology.orchestra.run.smithi067.stderr: 37600K .......... .......... .......... .......... .......... 40% 338M 0s 2024-09-12T00:25:33.619 INFO:teuthology.orchestra.run.smithi067.stderr: 37650K .......... .......... .......... .......... .......... 40% 348M 0s 2024-09-12T00:25:33.619 INFO:teuthology.orchestra.run.smithi067.stderr: 37700K .......... .......... .......... .......... .......... 40% 328M 0s 2024-09-12T00:25:33.620 INFO:teuthology.orchestra.run.smithi067.stderr: 37750K .......... .......... .......... .......... .......... 40% 297M 0s 2024-09-12T00:25:33.620 INFO:teuthology.orchestra.run.smithi067.stderr: 37800K .......... .......... .......... .......... .......... 40% 336M 0s 2024-09-12T00:25:33.620 INFO:teuthology.orchestra.run.smithi067.stderr: 37850K .......... .......... .......... .......... .......... 40% 327M 0s 2024-09-12T00:25:33.620 INFO:teuthology.orchestra.run.smithi067.stderr: 37900K .......... .......... .......... .......... .......... 40% 344M 0s 2024-09-12T00:25:33.620 INFO:teuthology.orchestra.run.smithi067.stderr: 37950K .......... .......... .......... .......... .......... 40% 274M 0s 2024-09-12T00:25:33.620 INFO:teuthology.orchestra.run.smithi067.stderr: 38000K .......... .......... .......... .......... .......... 40% 331M 0s 2024-09-12T00:25:33.620 INFO:teuthology.orchestra.run.smithi067.stderr: 38050K .......... .......... .......... .......... .......... 41% 356M 0s 2024-09-12T00:25:33.620 INFO:teuthology.orchestra.run.smithi067.stderr: 38100K .......... .......... .......... .......... .......... 41% 347M 0s 2024-09-12T00:25:33.620 INFO:teuthology.orchestra.run.smithi067.stderr: 38150K .......... .......... .......... .......... .......... 41% 293M 0s 2024-09-12T00:25:33.620 INFO:teuthology.orchestra.run.smithi067.stderr: 38200K .......... .......... .......... .......... .......... 41% 366M 0s 2024-09-12T00:25:33.620 INFO:teuthology.orchestra.run.smithi067.stderr: 38250K .......... .......... .......... .......... .......... 41% 362M 0s 2024-09-12T00:25:33.620 INFO:teuthology.orchestra.run.smithi067.stderr: 38300K .......... .......... .......... .......... .......... 41% 317M 0s 2024-09-12T00:25:33.620 INFO:teuthology.orchestra.run.smithi067.stderr: 38350K .......... .......... .......... .......... .......... 41% 288M 0s 2024-09-12T00:25:33.620 INFO:teuthology.orchestra.run.smithi067.stderr: 38400K .......... .......... .......... .......... .......... 41% 364M 0s 2024-09-12T00:25:33.621 INFO:teuthology.orchestra.run.smithi067.stderr: 38450K .......... .......... .......... .......... .......... 41% 355M 0s 2024-09-12T00:25:33.621 INFO:teuthology.orchestra.run.smithi067.stderr: 38500K .......... .......... .......... .......... .......... 41% 394M 0s 2024-09-12T00:25:33.621 INFO:teuthology.orchestra.run.smithi067.stderr: 38550K .......... .......... .......... .......... .......... 41% 351M 0s 2024-09-12T00:25:33.621 INFO:teuthology.orchestra.run.smithi067.stderr: 38600K .......... .......... .......... .......... .......... 41% 139M 0s 2024-09-12T00:25:33.621 INFO:teuthology.orchestra.run.smithi067.stderr: 38650K .......... .......... .......... .......... .......... 41% 360M 0s 2024-09-12T00:25:33.621 INFO:teuthology.orchestra.run.smithi067.stderr: 38700K .......... .......... .......... .......... .......... 41% 111M 0s 2024-09-12T00:25:33.621 INFO:teuthology.orchestra.run.smithi067.stderr: 38750K .......... .......... .......... .......... .......... 41% 70.5M 0s 2024-09-12T00:25:33.621 INFO:teuthology.orchestra.run.smithi067.stderr: 38800K .......... .......... .......... .......... .......... 41% 131M 0s 2024-09-12T00:25:33.621 INFO:teuthology.orchestra.run.smithi067.stderr: 38850K .......... .......... .......... .......... .......... 41% 216M 0s 2024-09-12T00:25:33.621 INFO:teuthology.orchestra.run.smithi067.stderr: 38900K .......... .......... .......... .......... .......... 41% 277M 0s 2024-09-12T00:25:33.621 INFO:teuthology.orchestra.run.smithi067.stderr: 38950K .......... .......... .......... .......... .......... 41% 65.7M 0s 2024-09-12T00:25:33.621 INFO:teuthology.orchestra.run.smithi067.stderr: 39000K .......... .......... .......... .......... .......... 42% 143M 0s 2024-09-12T00:25:33.621 INFO:teuthology.orchestra.run.smithi067.stderr: 39050K .......... .......... .......... .......... .......... 42% 246M 0s 2024-09-12T00:25:33.621 INFO:teuthology.orchestra.run.smithi067.stderr: 39100K .......... .......... .......... .......... .......... 42% 374M 0s 2024-09-12T00:25:33.622 INFO:teuthology.orchestra.run.smithi067.stderr: 39150K .......... .......... .......... .......... .......... 42% 125M 0s 2024-09-12T00:25:33.622 INFO:teuthology.orchestra.run.smithi067.stderr: 39200K .......... .......... .......... .......... .......... 42% 284M 0s 2024-09-12T00:25:33.622 INFO:teuthology.orchestra.run.smithi067.stderr: 39250K .......... .......... .......... .......... .......... 42% 322M 0s 2024-09-12T00:25:33.622 INFO:teuthology.orchestra.run.smithi067.stderr: 39300K .......... .......... .......... .......... .......... 42% 80.7M 0s 2024-09-12T00:25:33.622 INFO:teuthology.orchestra.run.smithi067.stderr: 39350K .......... .......... .......... .......... .......... 42% 45.1M 0s 2024-09-12T00:25:33.622 INFO:teuthology.orchestra.run.smithi067.stderr: 39400K .......... .......... .......... .......... .......... 42% 338M 0s 2024-09-12T00:25:33.622 INFO:teuthology.orchestra.run.smithi067.stderr: 39450K .......... .......... .......... .......... .......... 42% 189M 0s 2024-09-12T00:25:33.622 INFO:teuthology.orchestra.run.smithi067.stderr: 39500K .......... .......... .......... .......... .......... 42% 161M 0s 2024-09-12T00:25:33.622 INFO:teuthology.orchestra.run.smithi067.stderr: 39550K .......... .......... .......... .......... .......... 42% 196M 0s 2024-09-12T00:25:33.622 INFO:teuthology.orchestra.run.smithi067.stderr: 39600K .......... .......... .......... .......... .......... 42% 255M 0s 2024-09-12T00:25:33.622 INFO:teuthology.orchestra.run.smithi067.stderr: 39650K .......... .......... .......... .......... .......... 42% 267M 0s 2024-09-12T00:25:33.622 INFO:teuthology.orchestra.run.smithi067.stderr: 39700K .......... .......... .......... .......... .......... 42% 151M 0s 2024-09-12T00:25:33.622 INFO:teuthology.orchestra.run.smithi067.stderr: 39750K .......... .......... .......... .......... .......... 42% 307M 0s 2024-09-12T00:25:33.622 INFO:teuthology.orchestra.run.smithi067.stderr: 39800K .......... .......... .......... .......... .......... 42% 238M 0s 2024-09-12T00:25:33.623 INFO:teuthology.orchestra.run.smithi067.stderr: 39850K .......... .......... .......... .......... .......... 42% 332M 0s 2024-09-12T00:25:33.623 INFO:teuthology.orchestra.run.smithi067.stderr: 39900K .......... .......... .......... .......... .......... 43% 253M 0s 2024-09-12T00:25:33.623 INFO:teuthology.orchestra.run.smithi067.stderr: 39950K .......... .......... .......... .......... .......... 43% 277M 0s 2024-09-12T00:25:33.623 INFO:teuthology.orchestra.run.smithi067.stderr: 40000K .......... .......... .......... .......... .......... 43% 290M 0s 2024-09-12T00:25:33.623 INFO:teuthology.orchestra.run.smithi067.stderr: 40050K .......... .......... .......... .......... .......... 43% 341M 0s 2024-09-12T00:25:33.623 INFO:teuthology.orchestra.run.smithi067.stderr: 40100K .......... .......... .......... .......... .......... 43% 308M 0s 2024-09-12T00:25:33.623 INFO:teuthology.orchestra.run.smithi067.stderr: 40150K .......... .......... .......... .......... .......... 43% 122M 0s 2024-09-12T00:25:33.623 INFO:teuthology.orchestra.run.smithi067.stderr: 40200K .......... .......... .......... .......... .......... 43% 240M 0s 2024-09-12T00:25:33.623 INFO:teuthology.orchestra.run.smithi067.stderr: 40250K .......... .......... .......... .......... .......... 43% 316M 0s 2024-09-12T00:25:33.623 INFO:teuthology.orchestra.run.smithi067.stderr: 40300K .......... .......... .......... .......... .......... 43% 324M 0s 2024-09-12T00:25:33.623 INFO:teuthology.orchestra.run.smithi067.stderr: 40350K .......... .......... .......... .......... .......... 43% 292M 0s 2024-09-12T00:25:33.623 INFO:teuthology.orchestra.run.smithi067.stderr: 40400K .......... .......... .......... .......... .......... 43% 265M 0s 2024-09-12T00:25:33.623 INFO:teuthology.orchestra.run.smithi067.stderr: 40450K .......... .......... .......... .......... .......... 43% 363M 0s 2024-09-12T00:25:33.623 INFO:teuthology.orchestra.run.smithi067.stderr: 40500K .......... .......... .......... .......... .......... 43% 368M 0s 2024-09-12T00:25:33.624 INFO:teuthology.orchestra.run.smithi067.stderr: 40550K .......... .......... .......... .......... .......... 43% 326M 0s 2024-09-12T00:25:33.624 INFO:teuthology.orchestra.run.smithi067.stderr: 40600K .......... .......... .......... .......... .......... 43% 167M 0s 2024-09-12T00:25:33.624 INFO:teuthology.orchestra.run.smithi067.stderr: 40650K .......... .......... .......... .......... .......... 43% 341M 0s 2024-09-12T00:25:33.624 INFO:teuthology.orchestra.run.smithi067.stderr: 40700K .......... .......... .......... .......... .......... 43% 291M 0s 2024-09-12T00:25:33.624 INFO:teuthology.orchestra.run.smithi067.stderr: 40750K .......... .......... .......... .......... .......... 43% 242M 0s 2024-09-12T00:25:33.624 INFO:teuthology.orchestra.run.smithi067.stderr: 40800K .......... .......... .......... .......... .......... 43% 304M 0s 2024-09-12T00:25:33.624 INFO:teuthology.orchestra.run.smithi067.stderr: 40850K .......... .......... .......... .......... .......... 44% 309M 0s 2024-09-12T00:25:33.624 INFO:teuthology.orchestra.run.smithi067.stderr: 40900K .......... .......... .......... .......... .......... 44% 381M 0s 2024-09-12T00:25:33.624 INFO:teuthology.orchestra.run.smithi067.stderr: 40950K .......... .......... .......... .......... .......... 44% 289M 0s 2024-09-12T00:25:33.624 INFO:teuthology.orchestra.run.smithi067.stderr: 41000K .......... .......... .......... .......... .......... 44% 257M 0s 2024-09-12T00:25:33.624 INFO:teuthology.orchestra.run.smithi067.stderr: 41050K .......... .......... .......... .......... .......... 44% 303M 0s 2024-09-12T00:25:33.624 INFO:teuthology.orchestra.run.smithi067.stderr: 41100K .......... .......... .......... .......... .......... 44% 314M 0s 2024-09-12T00:25:33.624 INFO:teuthology.orchestra.run.smithi067.stderr: 41150K .......... .......... .......... .......... .......... 44% 244M 0s 2024-09-12T00:25:33.624 INFO:teuthology.orchestra.run.smithi067.stderr: 41200K .......... .......... .......... .......... .......... 44% 341M 0s 2024-09-12T00:25:33.625 INFO:teuthology.orchestra.run.smithi067.stderr: 41250K .......... .......... .......... .......... .......... 44% 366M 0s 2024-09-12T00:25:33.625 INFO:teuthology.orchestra.run.smithi067.stderr: 41300K .......... .......... .......... .......... .......... 44% 342M 0s 2024-09-12T00:25:33.625 INFO:teuthology.orchestra.run.smithi067.stderr: 41350K .......... .......... .......... .......... .......... 44% 310M 0s 2024-09-12T00:25:33.625 INFO:teuthology.orchestra.run.smithi067.stderr: 41400K .......... .......... .......... .......... .......... 44% 345M 0s 2024-09-12T00:25:33.625 INFO:teuthology.orchestra.run.smithi067.stderr: 41450K .......... .......... .......... .......... .......... 44% 380M 0s 2024-09-12T00:25:33.625 INFO:teuthology.orchestra.run.smithi067.stderr: 41500K .......... .......... .......... .......... .......... 44% 210M 0s 2024-09-12T00:25:33.625 INFO:teuthology.orchestra.run.smithi067.stderr: 41550K .......... .......... .......... .......... .......... 44% 233M 0s 2024-09-12T00:25:33.625 INFO:teuthology.orchestra.run.smithi067.stderr: 41600K .......... .......... .......... .......... .......... 44% 316M 0s 2024-09-12T00:25:33.625 INFO:teuthology.orchestra.run.smithi067.stderr: 41650K .......... .......... .......... .......... .......... 44% 374M 0s 2024-09-12T00:25:33.625 INFO:teuthology.orchestra.run.smithi067.stderr: 41700K .......... .......... .......... .......... .......... 44% 334M 0s 2024-09-12T00:25:33.625 INFO:teuthology.orchestra.run.smithi067.stderr: 41750K .......... .......... .......... .......... .......... 44% 322M 0s 2024-09-12T00:25:33.625 INFO:teuthology.orchestra.run.smithi067.stderr: 41800K .......... .......... .......... .......... .......... 45% 113M 0s 2024-09-12T00:25:33.625 INFO:teuthology.orchestra.run.smithi067.stderr: 41850K .......... .......... .......... .......... .......... 45% 313M 0s 2024-09-12T00:25:33.625 INFO:teuthology.orchestra.run.smithi067.stderr: 41900K .......... .......... .......... .......... .......... 45% 342M 0s 2024-09-12T00:25:33.626 INFO:teuthology.orchestra.run.smithi067.stderr: 41950K .......... .......... .......... .......... .......... 45% 110M 0s 2024-09-12T00:25:33.626 INFO:teuthology.orchestra.run.smithi067.stderr: 42000K .......... .......... .......... .......... .......... 45% 87.4M 0s 2024-09-12T00:25:33.626 INFO:teuthology.orchestra.run.smithi067.stderr: 42050K .......... .......... .......... .......... .......... 45% 97.2M 0s 2024-09-12T00:25:33.626 INFO:teuthology.orchestra.run.smithi067.stderr: 42100K .......... .......... .......... .......... .......... 45% 185M 0s 2024-09-12T00:25:33.626 INFO:teuthology.orchestra.run.smithi067.stderr: 42150K .......... .......... .......... .......... .......... 45% 286M 0s 2024-09-12T00:25:33.626 INFO:teuthology.orchestra.run.smithi067.stderr: 42200K .......... .......... .......... .......... .......... 45% 373M 0s 2024-09-12T00:25:33.626 INFO:teuthology.orchestra.run.smithi067.stderr: 42250K .......... .......... .......... .......... .......... 45% 82.5M 0s 2024-09-12T00:25:33.626 INFO:teuthology.orchestra.run.smithi067.stderr: 42300K .......... .......... .......... .......... .......... 45% 329M 0s 2024-09-12T00:25:33.626 INFO:teuthology.orchestra.run.smithi067.stderr: 42350K .......... .......... .......... .......... .......... 45% 138M 0s 2024-09-12T00:25:33.626 INFO:teuthology.orchestra.run.smithi067.stderr: 42400K .......... .......... .......... .......... .......... 45% 330M 0s 2024-09-12T00:25:33.626 INFO:teuthology.orchestra.run.smithi067.stderr: 42450K .......... .......... .......... .......... .......... 45% 51.2M 0s 2024-09-12T00:25:33.626 INFO:teuthology.orchestra.run.smithi067.stderr: 42500K .......... .......... .......... .......... .......... 45% 327M 0s 2024-09-12T00:25:33.626 INFO:teuthology.orchestra.run.smithi067.stderr: 42550K .......... .......... .......... .......... .......... 45% 351M 0s 2024-09-12T00:25:33.627 INFO:teuthology.orchestra.run.smithi067.stderr: 42600K .......... .......... .......... .......... .......... 45% 325M 0s 2024-09-12T00:25:33.627 INFO:teuthology.orchestra.run.smithi067.stderr: 42650K .......... .......... .......... .......... .......... 45% 178M 0s 2024-09-12T00:25:33.627 INFO:teuthology.orchestra.run.smithi067.stderr: 42700K .......... .......... .......... .......... .......... 46% 238M 0s 2024-09-12T00:25:33.627 INFO:teuthology.orchestra.run.smithi067.stderr: 42750K .......... .......... .......... .......... .......... 46% 242M 0s 2024-09-12T00:25:33.627 INFO:teuthology.orchestra.run.smithi067.stderr: 42800K .......... .......... .......... .......... .......... 46% 104M 0s 2024-09-12T00:25:33.627 INFO:teuthology.orchestra.run.smithi067.stderr: 42850K .......... .......... .......... .......... .......... 46% 224M 0s 2024-09-12T00:25:33.627 INFO:teuthology.orchestra.run.smithi067.stderr: 42900K .......... .......... .......... .......... .......... 46% 223M 0s 2024-09-12T00:25:33.627 INFO:teuthology.orchestra.run.smithi067.stderr: 42950K .......... .......... .......... .......... .......... 46% 273M 0s 2024-09-12T00:25:33.627 INFO:teuthology.orchestra.run.smithi067.stderr: 43000K .......... .......... .......... .......... .......... 46% 324M 0s 2024-09-12T00:25:33.627 INFO:teuthology.orchestra.run.smithi067.stderr: 43050K .......... .......... .......... .......... .......... 46% 315M 0s 2024-09-12T00:25:33.627 INFO:teuthology.orchestra.run.smithi067.stderr: 43100K .......... .......... .......... .......... .......... 46% 333M 0s 2024-09-12T00:25:33.627 INFO:teuthology.orchestra.run.smithi067.stderr: 43150K .......... .......... .......... .......... .......... 46% 313M 0s 2024-09-12T00:25:33.627 INFO:teuthology.orchestra.run.smithi067.stderr: 43200K .......... .......... .......... .......... .......... 46% 343M 0s 2024-09-12T00:25:33.627 INFO:teuthology.orchestra.run.smithi067.stderr: 43250K .......... .......... .......... .......... .......... 46% 272M 0s 2024-09-12T00:25:33.628 INFO:teuthology.orchestra.run.smithi067.stderr: 43300K .......... .......... .......... .......... .......... 46% 307M 0s 2024-09-12T00:25:33.628 INFO:teuthology.orchestra.run.smithi067.stderr: 43350K .......... .......... .......... .......... .......... 46% 304M 0s 2024-09-12T00:25:33.628 INFO:teuthology.orchestra.run.smithi067.stderr: 43400K .......... .......... .......... .......... .......... 46% 177M 0s 2024-09-12T00:25:33.628 INFO:teuthology.orchestra.run.smithi067.stderr: 43450K .......... .......... .......... .......... .......... 46% 323M 0s 2024-09-12T00:25:33.628 INFO:teuthology.orchestra.run.smithi067.stderr: 43500K .......... .......... .......... .......... .......... 46% 84.0M 0s 2024-09-12T00:25:33.628 INFO:teuthology.orchestra.run.smithi067.stderr: 43550K .......... .......... .......... .......... .......... 46% 222M 0s 2024-09-12T00:25:33.628 INFO:teuthology.orchestra.run.smithi067.stderr: 43600K .......... .......... .......... .......... .......... 46% 363M 0s 2024-09-12T00:25:33.628 INFO:teuthology.orchestra.run.smithi067.stderr: 43650K .......... .......... .......... .......... .......... 47% 166M 0s 2024-09-12T00:25:33.628 INFO:teuthology.orchestra.run.smithi067.stderr: 43700K .......... .......... .......... .......... .......... 47% 56.8M 0s 2024-09-12T00:25:33.628 INFO:teuthology.orchestra.run.smithi067.stderr: 43750K .......... .......... .......... .......... .......... 47% 285M 0s 2024-09-12T00:25:33.628 INFO:teuthology.orchestra.run.smithi067.stderr: 43800K .......... .......... .......... .......... .......... 47% 351M 0s 2024-09-12T00:25:33.628 INFO:teuthology.orchestra.run.smithi067.stderr: 43850K .......... .......... .......... .......... .......... 47% 330M 0s 2024-09-12T00:25:33.628 INFO:teuthology.orchestra.run.smithi067.stderr: 43900K .......... .......... .......... .......... .......... 47% 361M 0s 2024-09-12T00:25:33.629 INFO:teuthology.orchestra.run.smithi067.stderr: 43950K .......... .......... .......... .......... .......... 47% 306M 0s 2024-09-12T00:25:33.629 INFO:teuthology.orchestra.run.smithi067.stderr: 44000K .......... .......... .......... .......... .......... 47% 350M 0s 2024-09-12T00:25:33.629 INFO:teuthology.orchestra.run.smithi067.stderr: 44050K .......... .......... .......... .......... .......... 47% 349M 0s 2024-09-12T00:25:33.629 INFO:teuthology.orchestra.run.smithi067.stderr: 44100K .......... .......... .......... .......... .......... 47% 317M 0s 2024-09-12T00:25:33.629 INFO:teuthology.orchestra.run.smithi067.stderr: 44150K .......... .......... .......... .......... .......... 47% 324M 0s 2024-09-12T00:25:33.629 INFO:teuthology.orchestra.run.smithi067.stderr: 44200K .......... .......... .......... .......... .......... 47% 325M 0s 2024-09-12T00:25:33.629 INFO:teuthology.orchestra.run.smithi067.stderr: 44250K .......... .......... .......... .......... .......... 47% 323M 0s 2024-09-12T00:25:33.629 INFO:teuthology.orchestra.run.smithi067.stderr: 44300K .......... .......... .......... .......... .......... 47% 342M 0s 2024-09-12T00:25:33.629 INFO:teuthology.orchestra.run.smithi067.stderr: 44350K .......... .......... .......... .......... .......... 47% 276M 0s 2024-09-12T00:25:33.629 INFO:teuthology.orchestra.run.smithi067.stderr: 44400K .......... .......... .......... .......... .......... 47% 337M 0s 2024-09-12T00:25:33.629 INFO:teuthology.orchestra.run.smithi067.stderr: 44450K .......... .......... .......... .......... .......... 47% 340M 0s 2024-09-12T00:25:33.629 INFO:teuthology.orchestra.run.smithi067.stderr: 44500K .......... .......... .......... .......... .......... 47% 330M 0s 2024-09-12T00:25:33.629 INFO:teuthology.orchestra.run.smithi067.stderr: 44550K .......... .......... .......... .......... .......... 48% 312M 0s 2024-09-12T00:25:33.629 INFO:teuthology.orchestra.run.smithi067.stderr: 44600K .......... .......... .......... .......... .......... 48% 353M 0s 2024-09-12T00:25:33.630 INFO:teuthology.orchestra.run.smithi067.stderr: 44650K .......... .......... .......... .......... .......... 48% 348M 0s 2024-09-12T00:25:33.630 INFO:teuthology.orchestra.run.smithi067.stderr: 44700K .......... .......... .......... .......... .......... 48% 352M 0s 2024-09-12T00:25:33.630 INFO:teuthology.orchestra.run.smithi067.stderr: 44750K .......... .......... .......... .......... .......... 48% 300M 0s 2024-09-12T00:25:33.630 INFO:teuthology.orchestra.run.smithi067.stderr: 44800K .......... .......... .......... .......... .......... 48% 367M 0s 2024-09-12T00:25:33.630 INFO:teuthology.orchestra.run.smithi067.stderr: 44850K .......... .......... .......... .......... .......... 48% 372M 0s 2024-09-12T00:25:33.630 INFO:teuthology.orchestra.run.smithi067.stderr: 44900K .......... .......... .......... .......... .......... 48% 124M 0s 2024-09-12T00:25:33.630 INFO:teuthology.orchestra.run.smithi067.stderr: 44950K .......... .......... .......... .......... .......... 48% 277M 0s 2024-09-12T00:25:33.630 INFO:teuthology.orchestra.run.smithi067.stderr: 45000K .......... .......... .......... .......... .......... 48% 390M 0s 2024-09-12T00:25:33.630 INFO:teuthology.orchestra.run.smithi067.stderr: 45050K .......... .......... .......... .......... .......... 48% 66.3M 0s 2024-09-12T00:25:33.630 INFO:teuthology.orchestra.run.smithi067.stderr: 45100K .......... .......... .......... .......... .......... 48% 244M 0s 2024-09-12T00:25:33.630 INFO:teuthology.orchestra.run.smithi067.stderr: 45150K .......... .......... .......... .......... .......... 48% 252M 0s 2024-09-12T00:25:33.630 INFO:teuthology.orchestra.run.smithi067.stderr: 45200K .......... .......... .......... .......... .......... 48% 284M 0s 2024-09-12T00:25:33.630 INFO:teuthology.orchestra.run.smithi067.stderr: 45250K .......... .......... .......... .......... .......... 48% 300M 0s 2024-09-12T00:25:33.630 INFO:teuthology.orchestra.run.smithi067.stderr: 45300K .......... .......... .......... .......... .......... 48% 306M 0s 2024-09-12T00:25:33.631 INFO:teuthology.orchestra.run.smithi067.stderr: 45350K .......... .......... .......... .......... .......... 48% 336M 0s 2024-09-12T00:25:33.631 INFO:teuthology.orchestra.run.smithi067.stderr: 45400K .......... .......... .......... .......... .......... 48% 93.7M 0s 2024-09-12T00:25:33.631 INFO:teuthology.orchestra.run.smithi067.stderr: 45450K .......... .......... .......... .......... .......... 48% 322M 0s 2024-09-12T00:25:33.631 INFO:teuthology.orchestra.run.smithi067.stderr: 45500K .......... .......... .......... .......... .......... 49% 110M 0s 2024-09-12T00:25:33.631 INFO:teuthology.orchestra.run.smithi067.stderr: 45550K .......... .......... .......... .......... .......... 49% 114M 0s 2024-09-12T00:25:33.631 INFO:teuthology.orchestra.run.smithi067.stderr: 45600K .......... .......... .......... .......... .......... 49% 157M 0s 2024-09-12T00:25:33.631 INFO:teuthology.orchestra.run.smithi067.stderr: 45650K .......... .......... .......... .......... .......... 49% 356M 0s 2024-09-12T00:25:33.631 INFO:teuthology.orchestra.run.smithi067.stderr: 45700K .......... .......... .......... .......... .......... 49% 225M 0s 2024-09-12T00:25:33.631 INFO:teuthology.orchestra.run.smithi067.stderr: 45750K .......... .......... .......... .......... .......... 49% 315M 0s 2024-09-12T00:25:33.631 INFO:teuthology.orchestra.run.smithi067.stderr: 45800K .......... .......... .......... .......... .......... 49% 302M 0s 2024-09-12T00:25:33.631 INFO:teuthology.orchestra.run.smithi067.stderr: 45850K .......... .......... .......... .......... .......... 49% 314M 0s 2024-09-12T00:25:33.631 INFO:teuthology.orchestra.run.smithi067.stderr: 45900K .......... .......... .......... .......... .......... 49% 379M 0s 2024-09-12T00:25:33.631 INFO:teuthology.orchestra.run.smithi067.stderr: 45950K .......... .......... .......... .......... .......... 49% 112M 0s 2024-09-12T00:25:33.631 INFO:teuthology.orchestra.run.smithi067.stderr: 46000K .......... .......... .......... .......... .......... 49% 343M 0s 2024-09-12T00:25:33.632 INFO:teuthology.orchestra.run.smithi067.stderr: 46050K .......... .......... .......... .......... .......... 49% 299M 0s 2024-09-12T00:25:33.632 INFO:teuthology.orchestra.run.smithi067.stderr: 46100K .......... .......... .......... .......... .......... 49% 347M 0s 2024-09-12T00:25:33.632 INFO:teuthology.orchestra.run.smithi067.stderr: 46150K .......... .......... .......... .......... .......... 49% 282M 0s 2024-09-12T00:25:33.632 INFO:teuthology.orchestra.run.smithi067.stderr: 46200K .......... .......... .......... .......... .......... 49% 324M 0s 2024-09-12T00:25:33.632 INFO:teuthology.orchestra.run.smithi067.stderr: 46250K .......... .......... .......... .......... .......... 49% 345M 0s 2024-09-12T00:25:33.632 INFO:teuthology.orchestra.run.smithi067.stderr: 46300K .......... .......... .......... .......... .......... 49% 374M 0s 2024-09-12T00:25:33.632 INFO:teuthology.orchestra.run.smithi067.stderr: 46350K .......... .......... .......... .......... .......... 49% 311M 0s 2024-09-12T00:25:33.632 INFO:teuthology.orchestra.run.smithi067.stderr: 46400K .......... .......... .......... .......... .......... 49% 387M 0s 2024-09-12T00:25:33.632 INFO:teuthology.orchestra.run.smithi067.stderr: 46450K .......... .......... .......... .......... .......... 50% 393M 0s 2024-09-12T00:25:33.632 INFO:teuthology.orchestra.run.smithi067.stderr: 46500K .......... .......... .......... .......... .......... 50% 211M 0s 2024-09-12T00:25:33.632 INFO:teuthology.orchestra.run.smithi067.stderr: 46550K .......... .......... .......... .......... .......... 50% 237M 0s 2024-09-12T00:25:33.632 INFO:teuthology.orchestra.run.smithi067.stderr: 46600K .......... .......... .......... .......... .......... 50% 326M 0s 2024-09-12T00:25:33.632 INFO:teuthology.orchestra.run.smithi067.stderr: 46650K .......... .......... .......... .......... .......... 50% 300M 0s 2024-09-12T00:25:33.632 INFO:teuthology.orchestra.run.smithi067.stderr: 46700K .......... .......... .......... .......... .......... 50% 349M 0s 2024-09-12T00:25:33.632 INFO:teuthology.orchestra.run.smithi067.stderr: 46750K .......... .......... .......... .......... .......... 50% 75.6M 0s 2024-09-12T00:25:33.633 INFO:teuthology.orchestra.run.smithi067.stderr: 46800K .......... .......... .......... .......... .......... 50% 147M 0s 2024-09-12T00:25:33.633 INFO:teuthology.orchestra.run.smithi067.stderr: 46850K .......... .......... .......... .......... .......... 50% 276M 0s 2024-09-12T00:25:33.633 INFO:teuthology.orchestra.run.smithi067.stderr: 46900K .......... .......... .......... .......... .......... 50% 345M 0s 2024-09-12T00:25:33.633 INFO:teuthology.orchestra.run.smithi067.stderr: 46950K .......... .......... .......... .......... .......... 50% 138M 0s 2024-09-12T00:25:33.633 INFO:teuthology.orchestra.run.smithi067.stderr: 47000K .......... .......... .......... .......... .......... 50% 210M 0s 2024-09-12T00:25:33.633 INFO:teuthology.orchestra.run.smithi067.stderr: 47050K .......... .......... .......... .......... .......... 50% 319M 0s 2024-09-12T00:25:33.633 INFO:teuthology.orchestra.run.smithi067.stderr: 47100K .......... .......... .......... .......... .......... 50% 381M 0s 2024-09-12T00:25:33.633 INFO:teuthology.orchestra.run.smithi067.stderr: 47150K .......... .......... .......... .......... .......... 50% 267M 0s 2024-09-12T00:25:33.633 INFO:teuthology.orchestra.run.smithi067.stderr: 47200K .......... .......... .......... .......... .......... 50% 292M 0s 2024-09-12T00:25:33.633 INFO:teuthology.orchestra.run.smithi067.stderr: 47250K .......... .......... .......... .......... .......... 50% 343M 0s 2024-09-12T00:25:33.633 INFO:teuthology.orchestra.run.smithi067.stderr: 47300K .......... .......... .......... .......... .......... 50% 326M 0s 2024-09-12T00:25:33.633 INFO:teuthology.orchestra.run.smithi067.stderr: 47350K .......... .......... .......... .......... .......... 51% 311M 0s 2024-09-12T00:25:33.633 INFO:teuthology.orchestra.run.smithi067.stderr: 47400K .......... .......... .......... .......... .......... 51% 352M 0s 2024-09-12T00:25:33.633 INFO:teuthology.orchestra.run.smithi067.stderr: 47450K .......... .......... .......... .......... .......... 51% 379M 0s 2024-09-12T00:25:33.634 INFO:teuthology.orchestra.run.smithi067.stderr: 47500K .......... .......... .......... .......... .......... 51% 317M 0s 2024-09-12T00:25:33.634 INFO:teuthology.orchestra.run.smithi067.stderr: 47550K .......... .......... .......... .......... .......... 51% 260M 0s 2024-09-12T00:25:33.634 INFO:teuthology.orchestra.run.smithi067.stderr: 47600K .......... .......... .......... .......... .......... 51% 314M 0s 2024-09-12T00:25:33.634 INFO:teuthology.orchestra.run.smithi067.stderr: 47650K .......... .......... .......... .......... .......... 51% 318M 0s 2024-09-12T00:25:33.634 INFO:teuthology.orchestra.run.smithi067.stderr: 47700K .......... .......... .......... .......... .......... 51% 193M 0s 2024-09-12T00:25:33.634 INFO:teuthology.orchestra.run.smithi067.stderr: 47750K .......... .......... .......... .......... .......... 51% 279M 0s 2024-09-12T00:25:33.634 INFO:teuthology.orchestra.run.smithi067.stderr: 47800K .......... .......... .......... .......... .......... 51% 312M 0s 2024-09-12T00:25:33.634 INFO:teuthology.orchestra.run.smithi067.stderr: 47850K .......... .......... .......... .......... .......... 51% 332M 0s 2024-09-12T00:25:33.634 INFO:teuthology.orchestra.run.smithi067.stderr: 47900K .......... .......... .......... .......... .......... 51% 298M 0s 2024-09-12T00:25:33.634 INFO:teuthology.orchestra.run.smithi067.stderr: 47950K .......... .......... .......... .......... .......... 51% 275M 0s 2024-09-12T00:25:33.634 INFO:teuthology.orchestra.run.smithi067.stderr: 48000K .......... .......... .......... .......... .......... 51% 73.4M 0s 2024-09-12T00:25:33.634 INFO:teuthology.orchestra.run.smithi067.stderr: 48050K .......... .......... .......... .......... .......... 51% 290M 0s 2024-09-12T00:25:33.634 INFO:teuthology.orchestra.run.smithi067.stderr: 48100K .......... .......... .......... .......... .......... 51% 282M 0s 2024-09-12T00:25:33.634 INFO:teuthology.orchestra.run.smithi067.stderr: 48150K .......... .......... .......... .......... .......... 51% 342M 0s 2024-09-12T00:25:33.635 INFO:teuthology.orchestra.run.smithi067.stderr: 48200K .......... .......... .......... .......... .......... 51% 317M 0s 2024-09-12T00:25:33.635 INFO:teuthology.orchestra.run.smithi067.stderr: 48250K .......... .......... .......... .......... .......... 51% 327M 0s 2024-09-12T00:25:33.635 INFO:teuthology.orchestra.run.smithi067.stderr: 48300K .......... .......... .......... .......... .......... 52% 318M 0s 2024-09-12T00:25:33.635 INFO:teuthology.orchestra.run.smithi067.stderr: 48350K .......... .......... .......... .......... .......... 52% 320M 0s 2024-09-12T00:25:33.635 INFO:teuthology.orchestra.run.smithi067.stderr: 48400K .......... .......... .......... .......... .......... 52% 111M 0s 2024-09-12T00:25:33.635 INFO:teuthology.orchestra.run.smithi067.stderr: 48450K .......... .......... .......... .......... .......... 52% 245M 0s 2024-09-12T00:25:33.635 INFO:teuthology.orchestra.run.smithi067.stderr: 48500K .......... .......... .......... .......... .......... 52% 340M 0s 2024-09-12T00:25:33.635 INFO:teuthology.orchestra.run.smithi067.stderr: 48550K .......... .......... .......... .......... .......... 52% 186M 0s 2024-09-12T00:25:33.635 INFO:teuthology.orchestra.run.smithi067.stderr: 48600K .......... .......... .......... .......... .......... 52% 179M 0s 2024-09-12T00:25:33.635 INFO:teuthology.orchestra.run.smithi067.stderr: 48650K .......... .......... .......... .......... .......... 52% 93.7M 0s 2024-09-12T00:25:33.635 INFO:teuthology.orchestra.run.smithi067.stderr: 48700K .......... .......... .......... .......... .......... 52% 215M 0s 2024-09-12T00:25:33.635 INFO:teuthology.orchestra.run.smithi067.stderr: 48750K .......... .......... .......... .......... .......... 52% 146M 0s 2024-09-12T00:25:33.635 INFO:teuthology.orchestra.run.smithi067.stderr: 48800K .......... .......... .......... .......... .......... 52% 328M 0s 2024-09-12T00:25:33.635 INFO:teuthology.orchestra.run.smithi067.stderr: 48850K .......... .......... .......... .......... .......... 52% 334M 0s 2024-09-12T00:25:33.635 INFO:teuthology.orchestra.run.smithi067.stderr: 48900K .......... .......... .......... .......... .......... 52% 381M 0s 2024-09-12T00:25:33.636 INFO:teuthology.orchestra.run.smithi067.stderr: 48950K .......... .......... .......... .......... .......... 52% 355M 0s 2024-09-12T00:25:33.636 INFO:teuthology.orchestra.run.smithi067.stderr: 49000K .......... .......... .......... .......... .......... 52% 106M 0s 2024-09-12T00:25:33.636 INFO:teuthology.orchestra.run.smithi067.stderr: 49050K .......... .......... .......... .......... .......... 52% 348M 0s 2024-09-12T00:25:33.636 INFO:teuthology.orchestra.run.smithi067.stderr: 49100K .......... .......... .......... .......... .......... 52% 324M 0s 2024-09-12T00:25:33.636 INFO:teuthology.orchestra.run.smithi067.stderr: 49150K .......... .......... .......... .......... .......... 52% 285M 0s 2024-09-12T00:25:33.636 INFO:teuthology.orchestra.run.smithi067.stderr: 49200K .......... .......... .......... .......... .......... 53% 345M 0s 2024-09-12T00:25:33.636 INFO:teuthology.orchestra.run.smithi067.stderr: 49250K .......... .......... .......... .......... .......... 53% 345M 0s 2024-09-12T00:25:33.636 INFO:teuthology.orchestra.run.smithi067.stderr: 49300K .......... .......... .......... .......... .......... 53% 342M 0s 2024-09-12T00:25:33.636 INFO:teuthology.orchestra.run.smithi067.stderr: 49350K .......... .......... .......... .......... .......... 53% 52.5M 0s 2024-09-12T00:25:33.636 INFO:teuthology.orchestra.run.smithi067.stderr: 49400K .......... .......... .......... .......... .......... 53% 319M 0s 2024-09-12T00:25:33.636 INFO:teuthology.orchestra.run.smithi067.stderr: 49450K .......... .......... .......... .......... .......... 53% 334M 0s 2024-09-12T00:25:33.636 INFO:teuthology.orchestra.run.smithi067.stderr: 49500K .......... .......... .......... .......... .......... 53% 314M 0s 2024-09-12T00:25:33.636 INFO:teuthology.orchestra.run.smithi067.stderr: 49550K .......... .......... .......... .......... .......... 53% 282M 0s 2024-09-12T00:25:33.636 INFO:teuthology.orchestra.run.smithi067.stderr: 49600K .......... .......... .......... .......... .......... 53% 339M 0s 2024-09-12T00:25:33.637 INFO:teuthology.orchestra.run.smithi067.stderr: 49650K .......... .......... .......... .......... .......... 53% 317M 0s 2024-09-12T00:25:33.637 INFO:teuthology.orchestra.run.smithi067.stderr: 49700K .......... .......... .......... .......... .......... 53% 363M 0s 2024-09-12T00:25:33.637 INFO:teuthology.orchestra.run.smithi067.stderr: 49750K .......... .......... .......... .......... .......... 53% 248M 0s 2024-09-12T00:25:33.637 INFO:teuthology.orchestra.run.smithi067.stderr: 49800K .......... .......... .......... .......... .......... 53% 328M 0s 2024-09-12T00:25:33.637 INFO:teuthology.orchestra.run.smithi067.stderr: 49850K .......... .......... .......... .......... .......... 53% 347M 0s 2024-09-12T00:25:33.637 INFO:teuthology.orchestra.run.smithi067.stderr: 49900K .......... .......... .......... .......... .......... 53% 294M 0s 2024-09-12T00:25:33.637 INFO:teuthology.orchestra.run.smithi067.stderr: 49950K .......... .......... .......... .......... .......... 53% 304M 0s 2024-09-12T00:25:33.637 INFO:teuthology.orchestra.run.smithi067.stderr: 50000K .......... .......... .......... .......... .......... 53% 218M 0s 2024-09-12T00:25:33.637 INFO:teuthology.orchestra.run.smithi067.stderr: 50050K .......... .......... .......... .......... .......... 53% 371M 0s 2024-09-12T00:25:33.637 INFO:teuthology.orchestra.run.smithi067.stderr: 50100K .......... .......... .......... .......... .......... 53% 124M 0s 2024-09-12T00:25:33.637 INFO:teuthology.orchestra.run.smithi067.stderr: 50150K .......... .......... .......... .......... .......... 54% 222M 0s 2024-09-12T00:25:33.637 INFO:teuthology.orchestra.run.smithi067.stderr: 50200K .......... .......... .......... .......... .......... 54% 348M 0s 2024-09-12T00:25:33.637 INFO:teuthology.orchestra.run.smithi067.stderr: 50250K .......... .......... .......... .......... .......... 54% 153M 0s 2024-09-12T00:25:33.637 INFO:teuthology.orchestra.run.smithi067.stderr: 50300K .......... .......... .......... .......... .......... 54% 254M 0s 2024-09-12T00:25:33.638 INFO:teuthology.orchestra.run.smithi067.stderr: 50350K .......... .......... .......... .......... .......... 54% 295M 0s 2024-09-12T00:25:33.638 INFO:teuthology.orchestra.run.smithi067.stderr: 50400K .......... .......... .......... .......... .......... 54% 335M 0s 2024-09-12T00:25:33.638 INFO:teuthology.orchestra.run.smithi067.stderr: 50450K .......... .......... .......... .......... .......... 54% 359M 0s 2024-09-12T00:25:33.638 INFO:teuthology.orchestra.run.smithi067.stderr: 50500K .......... .......... .......... .......... .......... 54% 370M 0s 2024-09-12T00:25:33.638 INFO:teuthology.orchestra.run.smithi067.stderr: 50550K .......... .......... .......... .......... .......... 54% 324M 0s 2024-09-12T00:25:33.638 INFO:teuthology.orchestra.run.smithi067.stderr: 50600K .......... .......... .......... .......... .......... 54% 307M 0s 2024-09-12T00:25:33.638 INFO:teuthology.orchestra.run.smithi067.stderr: 50650K .......... .......... .......... .......... .......... 54% 315M 0s 2024-09-12T00:25:33.638 INFO:teuthology.orchestra.run.smithi067.stderr: 50700K .......... .......... .......... .......... .......... 54% 317M 0s 2024-09-12T00:25:33.638 INFO:teuthology.orchestra.run.smithi067.stderr: 50750K .......... .......... .......... .......... .......... 54% 272M 0s 2024-09-12T00:25:33.638 INFO:teuthology.orchestra.run.smithi067.stderr: 50800K .......... .......... .......... .......... .......... 54% 328M 0s 2024-09-12T00:25:33.638 INFO:teuthology.orchestra.run.smithi067.stderr: 50850K .......... .......... .......... .......... .......... 54% 330M 0s 2024-09-12T00:25:33.638 INFO:teuthology.orchestra.run.smithi067.stderr: 50900K .......... .......... .......... .......... .......... 54% 335M 0s 2024-09-12T00:25:33.638 INFO:teuthology.orchestra.run.smithi067.stderr: 50950K .......... .......... .......... .......... .......... 54% 238M 0s 2024-09-12T00:25:33.638 INFO:teuthology.orchestra.run.smithi067.stderr: 51000K .......... .......... .......... .......... .......... 54% 113M 0s 2024-09-12T00:25:33.639 INFO:teuthology.orchestra.run.smithi067.stderr: 51050K .......... .......... .......... .......... .......... 55% 308M 0s 2024-09-12T00:25:33.639 INFO:teuthology.orchestra.run.smithi067.stderr: 51100K .......... .......... .......... .......... .......... 55% 308M 0s 2024-09-12T00:25:33.639 INFO:teuthology.orchestra.run.smithi067.stderr: 51150K .......... .......... .......... .......... .......... 55% 335M 0s 2024-09-12T00:25:33.639 INFO:teuthology.orchestra.run.smithi067.stderr: 51200K .......... .......... .......... .......... .......... 55% 89.7M 0s 2024-09-12T00:25:33.639 INFO:teuthology.orchestra.run.smithi067.stderr: 51250K .......... .......... .......... .......... .......... 55% 326M 0s 2024-09-12T00:25:33.639 INFO:teuthology.orchestra.run.smithi067.stderr: 51300K .......... .......... .......... .......... .......... 55% 304M 0s 2024-09-12T00:25:33.639 INFO:teuthology.orchestra.run.smithi067.stderr: 51350K .......... .......... .......... .......... .......... 55% 370M 0s 2024-09-12T00:25:33.639 INFO:teuthology.orchestra.run.smithi067.stderr: 51400K .......... .......... .......... .......... .......... 55% 296M 0s 2024-09-12T00:25:33.639 INFO:teuthology.orchestra.run.smithi067.stderr: 51450K .......... .......... .......... .......... .......... 55% 215M 0s 2024-09-12T00:25:33.639 INFO:teuthology.orchestra.run.smithi067.stderr: 51500K .......... .......... .......... .......... .......... 55% 264M 0s 2024-09-12T00:25:33.639 INFO:teuthology.orchestra.run.smithi067.stderr: 51550K .......... .......... .......... .......... .......... 55% 384M 0s 2024-09-12T00:25:33.639 INFO:teuthology.orchestra.run.smithi067.stderr: 51600K .......... .......... .......... .......... .......... 55% 340M 0s 2024-09-12T00:25:33.639 INFO:teuthology.orchestra.run.smithi067.stderr: 51650K .......... .......... .......... .......... .......... 55% 287M 0s 2024-09-12T00:25:33.639 INFO:teuthology.orchestra.run.smithi067.stderr: 51700K .......... .......... .......... .......... .......... 55% 107M 0s 2024-09-12T00:25:33.639 INFO:teuthology.orchestra.run.smithi067.stderr: 51750K .......... .......... .......... .......... .......... 55% 308M 0s 2024-09-12T00:25:33.640 INFO:teuthology.orchestra.run.smithi067.stderr: 51800K .......... .......... .......... .......... .......... 55% 131M 0s 2024-09-12T00:25:33.640 INFO:teuthology.orchestra.run.smithi067.stderr: 51850K .......... .......... .......... .......... .......... 55% 340M 0s 2024-09-12T00:25:33.640 INFO:teuthology.orchestra.run.smithi067.stderr: 51900K .......... .......... .......... .......... .......... 55% 279M 0s 2024-09-12T00:25:33.640 INFO:teuthology.orchestra.run.smithi067.stderr: 51950K .......... .......... .......... .......... .......... 55% 110M 0s 2024-09-12T00:25:33.640 INFO:teuthology.orchestra.run.smithi067.stderr: 52000K .......... .......... .......... .......... .......... 56% 335M 0s 2024-09-12T00:25:33.640 INFO:teuthology.orchestra.run.smithi067.stderr: 52050K .......... .......... .......... .......... .......... 56% 326M 0s 2024-09-12T00:25:33.640 INFO:teuthology.orchestra.run.smithi067.stderr: 52100K .......... .......... .......... .......... .......... 56% 292M 0s 2024-09-12T00:25:33.640 INFO:teuthology.orchestra.run.smithi067.stderr: 52150K .......... .......... .......... .......... .......... 56% 290M 0s 2024-09-12T00:25:33.640 INFO:teuthology.orchestra.run.smithi067.stderr: 52200K .......... .......... .......... .......... .......... 56% 352M 0s 2024-09-12T00:25:33.640 INFO:teuthology.orchestra.run.smithi067.stderr: 52250K .......... .......... .......... .......... .......... 56% 381M 0s 2024-09-12T00:25:33.640 INFO:teuthology.orchestra.run.smithi067.stderr: 52300K .......... .......... .......... .......... .......... 56% 199M 0s 2024-09-12T00:25:33.640 INFO:teuthology.orchestra.run.smithi067.stderr: 52350K .......... .......... .......... .......... .......... 56% 45.8M 0s 2024-09-12T00:25:33.640 INFO:teuthology.orchestra.run.smithi067.stderr: 52400K .......... .......... .......... .......... .......... 56% 326M 0s 2024-09-12T00:25:33.641 INFO:teuthology.orchestra.run.smithi067.stderr: 52450K .......... .......... .......... .......... .......... 56% 361M 0s 2024-09-12T00:25:33.641 INFO:teuthology.orchestra.run.smithi067.stderr: 52500K .......... .......... .......... .......... .......... 56% 59.5M 0s 2024-09-12T00:25:33.641 INFO:teuthology.orchestra.run.smithi067.stderr: 52550K .......... .......... .......... .......... .......... 56% 328M 0s 2024-09-12T00:25:33.641 INFO:teuthology.orchestra.run.smithi067.stderr: 52600K .......... .......... .......... .......... .......... 56% 299M 0s 2024-09-12T00:25:33.641 INFO:teuthology.orchestra.run.smithi067.stderr: 52650K .......... .......... .......... .......... .......... 56% 281M 0s 2024-09-12T00:25:33.641 INFO:teuthology.orchestra.run.smithi067.stderr: 52700K .......... .......... .......... .......... .......... 56% 276M 0s 2024-09-12T00:25:33.641 INFO:teuthology.orchestra.run.smithi067.stderr: 52750K .......... .......... .......... .......... .......... 56% 321M 0s 2024-09-12T00:25:33.641 INFO:teuthology.orchestra.run.smithi067.stderr: 52800K .......... .......... .......... .......... .......... 56% 328M 0s 2024-09-12T00:25:33.641 INFO:teuthology.orchestra.run.smithi067.stderr: 52850K .......... .......... .......... .......... .......... 56% 297M 0s 2024-09-12T00:25:33.641 INFO:teuthology.orchestra.run.smithi067.stderr: 52900K .......... .......... .......... .......... .......... 56% 292M 0s 2024-09-12T00:25:33.641 INFO:teuthology.orchestra.run.smithi067.stderr: 52950K .......... .......... .......... .......... .......... 57% 312M 0s 2024-09-12T00:25:33.641 INFO:teuthology.orchestra.run.smithi067.stderr: 53000K .......... .......... .......... .......... .......... 57% 324M 0s 2024-09-12T00:25:33.641 INFO:teuthology.orchestra.run.smithi067.stderr: 53050K .......... .......... .......... .......... .......... 57% 352M 0s 2024-09-12T00:25:33.641 INFO:teuthology.orchestra.run.smithi067.stderr: 53100K .......... .......... .......... .......... .......... 57% 306M 0s 2024-09-12T00:25:33.641 INFO:teuthology.orchestra.run.smithi067.stderr: 53150K .......... .......... .......... .......... .......... 57% 334M 0s 2024-09-12T00:25:33.642 INFO:teuthology.orchestra.run.smithi067.stderr: 53200K .......... .......... .......... .......... .......... 57% 327M 0s 2024-09-12T00:25:33.642 INFO:teuthology.orchestra.run.smithi067.stderr: 53250K .......... .......... .......... .......... .......... 57% 311M 0s 2024-09-12T00:25:33.642 INFO:teuthology.orchestra.run.smithi067.stderr: 53300K .......... .......... .......... .......... .......... 57% 277M 0s 2024-09-12T00:25:33.642 INFO:teuthology.orchestra.run.smithi067.stderr: 53350K .......... .......... .......... .......... .......... 57% 387M 0s 2024-09-12T00:25:33.642 INFO:teuthology.orchestra.run.smithi067.stderr: 53400K .......... .......... .......... .......... .......... 57% 350M 0s 2024-09-12T00:25:33.642 INFO:teuthology.orchestra.run.smithi067.stderr: 53450K .......... .......... .......... .......... .......... 57% 386M 0s 2024-09-12T00:25:33.642 INFO:teuthology.orchestra.run.smithi067.stderr: 53500K .......... .......... .......... .......... .......... 57% 319M 0s 2024-09-12T00:25:33.642 INFO:teuthology.orchestra.run.smithi067.stderr: 53550K .......... .......... .......... .......... .......... 57% 320M 0s 2024-09-12T00:25:33.642 INFO:teuthology.orchestra.run.smithi067.stderr: 53600K .......... .......... .......... .......... .......... 57% 312M 0s 2024-09-12T00:25:33.642 INFO:teuthology.orchestra.run.smithi067.stderr: 53650K .......... .......... .......... .......... .......... 57% 333M 0s 2024-09-12T00:25:33.642 INFO:teuthology.orchestra.run.smithi067.stderr: 53700K .......... .......... .......... .......... .......... 57% 322M 0s 2024-09-12T00:25:33.642 INFO:teuthology.orchestra.run.smithi067.stderr: 53750K .......... .......... .......... .......... .......... 57% 380M 0s 2024-09-12T00:25:33.642 INFO:teuthology.orchestra.run.smithi067.stderr: 53800K .......... .......... .......... .......... .......... 57% 346M 0s 2024-09-12T00:25:33.642 INFO:teuthology.orchestra.run.smithi067.stderr: 53850K .......... .......... .......... .......... .......... 58% 351M 0s 2024-09-12T00:25:33.643 INFO:teuthology.orchestra.run.smithi067.stderr: 53900K .......... .......... .......... .......... .......... 58% 260M 0s 2024-09-12T00:25:33.643 INFO:teuthology.orchestra.run.smithi067.stderr: 53950K .......... .......... .......... .......... .......... 58% 331M 0s 2024-09-12T00:25:33.643 INFO:teuthology.orchestra.run.smithi067.stderr: 54000K .......... .......... .......... .......... .......... 58% 341M 0s 2024-09-12T00:25:33.643 INFO:teuthology.orchestra.run.smithi067.stderr: 54050K .......... .......... .......... .......... .......... 58% 304M 0s 2024-09-12T00:25:33.643 INFO:teuthology.orchestra.run.smithi067.stderr: 54100K .......... .......... .......... .......... .......... 58% 324M 0s 2024-09-12T00:25:33.643 INFO:teuthology.orchestra.run.smithi067.stderr: 54150K .......... .......... .......... .......... .......... 58% 317M 0s 2024-09-12T00:25:33.643 INFO:teuthology.orchestra.run.smithi067.stderr: 54200K .......... .......... .......... .......... .......... 58% 104M 0s 2024-09-12T00:25:33.643 INFO:teuthology.orchestra.run.smithi067.stderr: 54250K .......... .......... .......... .......... .......... 58% 346M 0s 2024-09-12T00:25:33.643 INFO:teuthology.orchestra.run.smithi067.stderr: 54300K .......... .......... .......... .......... .......... 58% 222M 0s 2024-09-12T00:25:33.643 INFO:teuthology.orchestra.run.smithi067.stderr: 54350K .......... .......... .......... .......... .......... 58% 352M 0s 2024-09-12T00:25:33.643 INFO:teuthology.orchestra.run.smithi067.stderr: 54400K .......... .......... .......... .......... .......... 58% 283M 0s 2024-09-12T00:25:33.643 INFO:teuthology.orchestra.run.smithi067.stderr: 54450K .......... .......... .......... .......... .......... 58% 361M 0s 2024-09-12T00:25:33.643 INFO:teuthology.orchestra.run.smithi067.stderr: 54500K .......... .......... .......... .......... .......... 58% 295M 0s 2024-09-12T00:25:33.643 INFO:teuthology.orchestra.run.smithi067.stderr: 54550K .......... .......... .......... .......... .......... 58% 294M 0s 2024-09-12T00:25:33.643 INFO:teuthology.orchestra.run.smithi067.stderr: 54600K .......... .......... .......... .......... .......... 58% 314M 0s 2024-09-12T00:25:33.644 INFO:teuthology.orchestra.run.smithi067.stderr: 54650K .......... .......... .......... .......... .......... 58% 338M 0s 2024-09-12T00:25:33.644 INFO:teuthology.orchestra.run.smithi067.stderr: 54700K .......... .......... .......... .......... .......... 58% 86.5M 0s 2024-09-12T00:25:33.644 INFO:teuthology.orchestra.run.smithi067.stderr: 54750K .......... .......... .......... .......... .......... 58% 294M 0s 2024-09-12T00:25:33.644 INFO:teuthology.orchestra.run.smithi067.stderr: 54800K .......... .......... .......... .......... .......... 59% 375M 0s 2024-09-12T00:25:33.644 INFO:teuthology.orchestra.run.smithi067.stderr: 54850K .......... .......... .......... .......... .......... 59% 110M 0s 2024-09-12T00:25:33.644 INFO:teuthology.orchestra.run.smithi067.stderr: 54900K .......... .......... .......... .......... .......... 59% 254M 0s 2024-09-12T00:25:33.644 INFO:teuthology.orchestra.run.smithi067.stderr: 54950K .......... .......... .......... .......... .......... 59% 326M 0s 2024-09-12T00:25:33.644 INFO:teuthology.orchestra.run.smithi067.stderr: 55000K .......... .......... .......... .......... .......... 59% 345M 0s 2024-09-12T00:25:33.644 INFO:teuthology.orchestra.run.smithi067.stderr: 55050K .......... .......... .......... .......... .......... 59% 348M 0s 2024-09-12T00:25:33.644 INFO:teuthology.orchestra.run.smithi067.stderr: 55100K .......... .......... .......... .......... .......... 59% 131M 0s 2024-09-12T00:25:33.644 INFO:teuthology.orchestra.run.smithi067.stderr: 55150K .......... .......... .......... .......... .......... 59% 321M 0s 2024-09-12T00:25:33.644 INFO:teuthology.orchestra.run.smithi067.stderr: 55200K .......... .......... .......... .......... .......... 59% 317M 0s 2024-09-12T00:25:33.644 INFO:teuthology.orchestra.run.smithi067.stderr: 55250K .......... .......... .......... .......... .......... 59% 356M 0s 2024-09-12T00:25:33.645 INFO:teuthology.orchestra.run.smithi067.stderr: 55300K .......... .......... .......... .......... .......... 59% 207M 0s 2024-09-12T00:25:33.645 INFO:teuthology.orchestra.run.smithi067.stderr: 55350K .......... .......... .......... .......... .......... 59% 370M 0s 2024-09-12T00:25:33.645 INFO:teuthology.orchestra.run.smithi067.stderr: 55400K .......... .......... .......... .......... .......... 59% 58.7M 0s 2024-09-12T00:25:33.645 INFO:teuthology.orchestra.run.smithi067.stderr: 55450K .......... .......... .......... .......... .......... 59% 320M 0s 2024-09-12T00:25:33.645 INFO:teuthology.orchestra.run.smithi067.stderr: 55500K .......... .......... .......... .......... .......... 59% 162M 0s 2024-09-12T00:25:33.645 INFO:teuthology.orchestra.run.smithi067.stderr: 55550K .......... .......... .......... .......... .......... 59% 70.2M 0s 2024-09-12T00:25:33.645 INFO:teuthology.orchestra.run.smithi067.stderr: 55600K .......... .......... .......... .......... .......... 59% 102M 0s 2024-09-12T00:25:33.645 INFO:teuthology.orchestra.run.smithi067.stderr: 55650K .......... .......... .......... .......... .......... 59% 320M 0s 2024-09-12T00:25:33.645 INFO:teuthology.orchestra.run.smithi067.stderr: 55700K .......... .......... .......... .......... .......... 60% 336M 0s 2024-09-12T00:25:33.645 INFO:teuthology.orchestra.run.smithi067.stderr: 55750K .......... .......... .......... .......... .......... 60% 180M 0s 2024-09-12T00:25:33.645 INFO:teuthology.orchestra.run.smithi067.stderr: 55800K .......... .......... .......... .......... .......... 60% 311M 0s 2024-09-12T00:25:33.645 INFO:teuthology.orchestra.run.smithi067.stderr: 55850K .......... .......... .......... .......... .......... 60% 345M 0s 2024-09-12T00:25:33.645 INFO:teuthology.orchestra.run.smithi067.stderr: 55900K .......... .......... .......... .......... .......... 60% 280M 0s 2024-09-12T00:25:33.645 INFO:teuthology.orchestra.run.smithi067.stderr: 55950K .......... .......... .......... .......... .......... 60% 381M 0s 2024-09-12T00:25:33.646 INFO:teuthology.orchestra.run.smithi067.stderr: 56000K .......... .......... .......... .......... .......... 60% 372M 0s 2024-09-12T00:25:33.646 INFO:teuthology.orchestra.run.smithi067.stderr: 56050K .......... .......... .......... .......... .......... 60% 370M 0s 2024-09-12T00:25:33.646 INFO:teuthology.orchestra.run.smithi067.stderr: 56100K .......... .......... .......... .......... .......... 60% 272M 0s 2024-09-12T00:25:33.646 INFO:teuthology.orchestra.run.smithi067.stderr: 56150K .......... .......... .......... .......... .......... 60% 350M 0s 2024-09-12T00:25:33.646 INFO:teuthology.orchestra.run.smithi067.stderr: 56200K .......... .......... .......... .......... .......... 60% 326M 0s 2024-09-12T00:25:33.646 INFO:teuthology.orchestra.run.smithi067.stderr: 56250K .......... .......... .......... .......... .......... 60% 322M 0s 2024-09-12T00:25:33.646 INFO:teuthology.orchestra.run.smithi067.stderr: 56300K .......... .......... .......... .......... .......... 60% 276M 0s 2024-09-12T00:25:33.646 INFO:teuthology.orchestra.run.smithi067.stderr: 56350K .......... .......... .......... .......... .......... 60% 377M 0s 2024-09-12T00:25:33.646 INFO:teuthology.orchestra.run.smithi067.stderr: 56400K .......... .......... .......... .......... .......... 60% 178M 0s 2024-09-12T00:25:33.646 INFO:teuthology.orchestra.run.smithi067.stderr: 56450K .......... .......... .......... .......... .......... 60% 225M 0s 2024-09-12T00:25:33.646 INFO:teuthology.orchestra.run.smithi067.stderr: 56500K .......... .......... .......... .......... .......... 60% 267M 0s 2024-09-12T00:25:33.646 INFO:teuthology.orchestra.run.smithi067.stderr: 56550K .......... .......... .......... .......... .......... 60% 303M 0s 2024-09-12T00:25:33.646 INFO:teuthology.orchestra.run.smithi067.stderr: 56600K .......... .......... .......... .......... .......... 60% 332M 0s 2024-09-12T00:25:33.647 INFO:teuthology.orchestra.run.smithi067.stderr: 56650K .......... .......... .......... .......... .......... 61% 365M 0s 2024-09-12T00:25:33.647 INFO:teuthology.orchestra.run.smithi067.stderr: 56700K .......... .......... .......... .......... .......... 61% 320M 0s 2024-09-12T00:25:33.647 INFO:teuthology.orchestra.run.smithi067.stderr: 56750K .......... .......... .......... .......... .......... 61% 360M 0s 2024-09-12T00:25:33.647 INFO:teuthology.orchestra.run.smithi067.stderr: 56800K .......... .......... .......... .......... .......... 61% 289M 0s 2024-09-12T00:25:33.647 INFO:teuthology.orchestra.run.smithi067.stderr: 56850K .......... .......... .......... .......... .......... 61% 358M 0s 2024-09-12T00:25:33.647 INFO:teuthology.orchestra.run.smithi067.stderr: 56900K .......... .......... .......... .......... .......... 61% 283M 0s 2024-09-12T00:25:33.647 INFO:teuthology.orchestra.run.smithi067.stderr: 56950K .......... .......... .......... .......... .......... 61% 315M 0s 2024-09-12T00:25:33.647 INFO:teuthology.orchestra.run.smithi067.stderr: 57000K .......... .......... .......... .......... .......... 61% 334M 0s 2024-09-12T00:25:33.647 INFO:teuthology.orchestra.run.smithi067.stderr: 57050K .......... .......... .......... .......... .......... 61% 330M 0s 2024-09-12T00:25:33.647 INFO:teuthology.orchestra.run.smithi067.stderr: 57100K .......... .......... .......... .......... .......... 61% 265M 0s 2024-09-12T00:25:33.647 INFO:teuthology.orchestra.run.smithi067.stderr: 57150K .......... .......... .......... .......... .......... 61% 325M 0s 2024-09-12T00:25:33.647 INFO:teuthology.orchestra.run.smithi067.stderr: 57200K .......... .......... .......... .......... .......... 61% 366M 0s 2024-09-12T00:25:33.647 INFO:teuthology.orchestra.run.smithi067.stderr: 57250K .......... .......... .......... .......... .......... 61% 386M 0s 2024-09-12T00:25:33.647 INFO:teuthology.orchestra.run.smithi067.stderr: 57300K .......... .......... .......... .......... .......... 61% 210M 0s 2024-09-12T00:25:33.647 INFO:teuthology.orchestra.run.smithi067.stderr: 57350K .......... .......... .......... .......... .......... 61% 295M 0s 2024-09-12T00:25:33.648 INFO:teuthology.orchestra.run.smithi067.stderr: 57400K .......... .......... .......... .......... .......... 61% 380M 0s 2024-09-12T00:25:33.648 INFO:teuthology.orchestra.run.smithi067.stderr: 57450K .......... .......... .......... .......... .......... 61% 189M 0s 2024-09-12T00:25:33.648 INFO:teuthology.orchestra.run.smithi067.stderr: 57500K .......... .......... .......... .......... .......... 61% 251M 0s 2024-09-12T00:25:33.648 INFO:teuthology.orchestra.run.smithi067.stderr: 57550K .......... .......... .......... .......... .......... 62% 285M 0s 2024-09-12T00:25:33.648 INFO:teuthology.orchestra.run.smithi067.stderr: 57600K .......... .......... .......... .......... .......... 62% 304M 0s 2024-09-12T00:25:33.648 INFO:teuthology.orchestra.run.smithi067.stderr: 57650K .......... .......... .......... .......... .......... 62% 339M 0s 2024-09-12T00:25:33.648 INFO:teuthology.orchestra.run.smithi067.stderr: 57700K .......... .......... .......... .......... .......... 62% 334M 0s 2024-09-12T00:25:33.648 INFO:teuthology.orchestra.run.smithi067.stderr: 57750K .......... .......... .......... .......... .......... 62% 282M 0s 2024-09-12T00:25:33.648 INFO:teuthology.orchestra.run.smithi067.stderr: 57800K .......... .......... .......... .......... .......... 62% 158M 0s 2024-09-12T00:25:33.648 INFO:teuthology.orchestra.run.smithi067.stderr: 57850K .......... .......... .......... .......... .......... 62% 308M 0s 2024-09-12T00:25:33.648 INFO:teuthology.orchestra.run.smithi067.stderr: 57900K .......... .......... .......... .......... .......... 62% 161M 0s 2024-09-12T00:25:33.648 INFO:teuthology.orchestra.run.smithi067.stderr: 57950K .......... .......... .......... .......... .......... 62% 310M 0s 2024-09-12T00:25:33.648 INFO:teuthology.orchestra.run.smithi067.stderr: 58000K .......... .......... .......... .......... .......... 62% 178M 0s 2024-09-12T00:25:33.649 INFO:teuthology.orchestra.run.smithi067.stderr: 58050K .......... .......... .......... .......... .......... 62% 342M 0s 2024-09-12T00:25:33.649 INFO:teuthology.orchestra.run.smithi067.stderr: 58100K .......... .......... .......... .......... .......... 62% 121M 0s 2024-09-12T00:25:33.649 INFO:teuthology.orchestra.run.smithi067.stderr: 58150K .......... .......... .......... .......... .......... 62% 335M 0s 2024-09-12T00:25:33.649 INFO:teuthology.orchestra.run.smithi067.stderr: 58200K .......... .......... .......... .......... .......... 62% 252M 0s 2024-09-12T00:25:33.649 INFO:teuthology.orchestra.run.smithi067.stderr: 58250K .......... .......... .......... .......... .......... 62% 339M 0s 2024-09-12T00:25:33.649 INFO:teuthology.orchestra.run.smithi067.stderr: 58300K .......... .......... .......... .......... .......... 62% 349M 0s 2024-09-12T00:25:33.649 INFO:teuthology.orchestra.run.smithi067.stderr: 58350K .......... .......... .......... .......... .......... 62% 164M 0s 2024-09-12T00:25:33.649 INFO:teuthology.orchestra.run.smithi067.stderr: 58400K .......... .......... .......... .......... .......... 62% 43.2M 0s 2024-09-12T00:25:33.649 INFO:teuthology.orchestra.run.smithi067.stderr: 58450K .......... .......... .......... .......... .......... 62% 305M 0s 2024-09-12T00:25:33.649 INFO:teuthology.orchestra.run.smithi067.stderr: 58500K .......... .......... .......... .......... .......... 63% 359M 0s 2024-09-12T00:25:33.649 INFO:teuthology.orchestra.run.smithi067.stderr: 58550K .......... .......... .......... .......... .......... 63% 376M 0s 2024-09-12T00:25:33.649 INFO:teuthology.orchestra.run.smithi067.stderr: 58600K .......... .......... .......... .......... .......... 63% 201M 0s 2024-09-12T00:25:33.649 INFO:teuthology.orchestra.run.smithi067.stderr: 58650K .......... .......... .......... .......... .......... 63% 56.4M 0s 2024-09-12T00:25:33.649 INFO:teuthology.orchestra.run.smithi067.stderr: 58700K .......... .......... .......... .......... .......... 63% 326M 0s 2024-09-12T00:25:33.650 INFO:teuthology.orchestra.run.smithi067.stderr: 58750K .......... .......... .......... .......... .......... 63% 305M 0s 2024-09-12T00:25:33.650 INFO:teuthology.orchestra.run.smithi067.stderr: 58800K .......... .......... .......... .......... .......... 63% 311M 0s 2024-09-12T00:25:33.650 INFO:teuthology.orchestra.run.smithi067.stderr: 58850K .......... .......... .......... .......... .......... 63% 229M 0s 2024-09-12T00:25:33.650 INFO:teuthology.orchestra.run.smithi067.stderr: 58900K .......... .......... .......... .......... .......... 63% 337M 0s 2024-09-12T00:25:33.650 INFO:teuthology.orchestra.run.smithi067.stderr: 58950K .......... .......... .......... .......... .......... 63% 276M 0s 2024-09-12T00:25:33.650 INFO:teuthology.orchestra.run.smithi067.stderr: 59000K .......... .......... .......... .......... .......... 63% 215M 0s 2024-09-12T00:25:33.650 INFO:teuthology.orchestra.run.smithi067.stderr: 59050K .......... .......... .......... .......... .......... 63% 344M 0s 2024-09-12T00:25:33.650 INFO:teuthology.orchestra.run.smithi067.stderr: 59100K .......... .......... .......... .......... .......... 63% 259M 0s 2024-09-12T00:25:33.650 INFO:teuthology.orchestra.run.smithi067.stderr: 59150K .......... .......... .......... .......... .......... 63% 375M 0s 2024-09-12T00:25:33.650 INFO:teuthology.orchestra.run.smithi067.stderr: 59200K .......... .......... .......... .......... .......... 63% 322M 0s 2024-09-12T00:25:33.650 INFO:teuthology.orchestra.run.smithi067.stderr: 59250K .......... .......... .......... .......... .......... 63% 358M 0s 2024-09-12T00:25:33.650 INFO:teuthology.orchestra.run.smithi067.stderr: 59300K .......... .......... .......... .......... .......... 63% 315M 0s 2024-09-12T00:25:33.650 INFO:teuthology.orchestra.run.smithi067.stderr: 59350K .......... .......... .......... .......... .......... 63% 170M 0s 2024-09-12T00:25:33.650 INFO:teuthology.orchestra.run.smithi067.stderr: 59400K .......... .......... .......... .......... .......... 63% 329M 0s 2024-09-12T00:25:33.651 INFO:teuthology.orchestra.run.smithi067.stderr: 59450K .......... .......... .......... .......... .......... 64% 337M 0s 2024-09-12T00:25:33.651 INFO:teuthology.orchestra.run.smithi067.stderr: 59500K .......... .......... .......... .......... .......... 64% 304M 0s 2024-09-12T00:25:33.651 INFO:teuthology.orchestra.run.smithi067.stderr: 59550K .......... .......... .......... .......... .......... 64% 382M 0s 2024-09-12T00:25:33.651 INFO:teuthology.orchestra.run.smithi067.stderr: 59600K .......... .......... .......... .......... .......... 64% 364M 0s 2024-09-12T00:25:33.651 INFO:teuthology.orchestra.run.smithi067.stderr: 59650K .......... .......... .......... .......... .......... 64% 116M 0s 2024-09-12T00:25:33.651 INFO:teuthology.orchestra.run.smithi067.stderr: 59700K .......... .......... .......... .......... .......... 64% 325M 0s 2024-09-12T00:25:33.651 INFO:teuthology.orchestra.run.smithi067.stderr: 59750K .......... .......... .......... .......... .......... 64% 343M 0s 2024-09-12T00:25:33.651 INFO:teuthology.orchestra.run.smithi067.stderr: 59800K .......... .......... .......... .......... .......... 64% 334M 0s 2024-09-12T00:25:33.651 INFO:teuthology.orchestra.run.smithi067.stderr: 59850K .......... .......... .......... .......... .......... 64% 304M 0s 2024-09-12T00:25:33.651 INFO:teuthology.orchestra.run.smithi067.stderr: 59900K .......... .......... .......... .......... .......... 64% 285M 0s 2024-09-12T00:25:33.651 INFO:teuthology.orchestra.run.smithi067.stderr: 59950K .......... .......... .......... .......... .......... 64% 348M 0s 2024-09-12T00:25:33.651 INFO:teuthology.orchestra.run.smithi067.stderr: 60000K .......... .......... .......... .......... .......... 64% 362M 0s 2024-09-12T00:25:33.651 INFO:teuthology.orchestra.run.smithi067.stderr: 60050K .......... .......... .......... .......... .......... 64% 383M 0s 2024-09-12T00:25:33.651 INFO:teuthology.orchestra.run.smithi067.stderr: 60100K .......... .......... .......... .......... .......... 64% 190M 0s 2024-09-12T00:25:33.652 INFO:teuthology.orchestra.run.smithi067.stderr: 60150K .......... .......... .......... .......... .......... 64% 283M 0s 2024-09-12T00:25:33.652 INFO:teuthology.orchestra.run.smithi067.stderr: 60200K .......... .......... .......... .......... .......... 64% 286M 0s 2024-09-12T00:25:33.652 INFO:teuthology.orchestra.run.smithi067.stderr: 60250K .......... .......... .......... .......... .......... 64% 299M 0s 2024-09-12T00:25:33.652 INFO:teuthology.orchestra.run.smithi067.stderr: 60300K .......... .......... .......... .......... .......... 64% 316M 0s 2024-09-12T00:25:33.652 INFO:teuthology.orchestra.run.smithi067.stderr: 60350K .......... .......... .......... .......... .......... 65% 388M 0s 2024-09-12T00:25:33.652 INFO:teuthology.orchestra.run.smithi067.stderr: 60400K .......... .......... .......... .......... .......... 65% 361M 0s 2024-09-12T00:25:33.652 INFO:teuthology.orchestra.run.smithi067.stderr: 60450K .......... .......... .......... .......... .......... 65% 320M 0s 2024-09-12T00:25:33.652 INFO:teuthology.orchestra.run.smithi067.stderr: 60500K .......... .......... .......... .......... .......... 65% 282M 0s 2024-09-12T00:25:33.652 INFO:teuthology.orchestra.run.smithi067.stderr: 60550K .......... .......... .......... .......... .......... 65% 326M 0s 2024-09-12T00:25:33.652 INFO:teuthology.orchestra.run.smithi067.stderr: 60600K .......... .......... .......... .......... .......... 65% 319M 0s 2024-09-12T00:25:33.652 INFO:teuthology.orchestra.run.smithi067.stderr: 60650K .......... .......... .......... .......... .......... 65% 379M 0s 2024-09-12T00:25:33.652 INFO:teuthology.orchestra.run.smithi067.stderr: 60700K .......... .......... .......... .......... .......... 65% 321M 0s 2024-09-12T00:25:33.652 INFO:teuthology.orchestra.run.smithi067.stderr: 60750K .......... .......... .......... .......... .......... 65% 189M 0s 2024-09-12T00:25:33.653 INFO:teuthology.orchestra.run.smithi067.stderr: 60800K .......... .......... .......... .......... .......... 65% 312M 0s 2024-09-12T00:25:33.653 INFO:teuthology.orchestra.run.smithi067.stderr: 60850K .......... .......... .......... .......... .......... 65% 359M 0s 2024-09-12T00:25:33.653 INFO:teuthology.orchestra.run.smithi067.stderr: 60900K .......... .......... .......... .......... .......... 65% 319M 0s 2024-09-12T00:25:33.653 INFO:teuthology.orchestra.run.smithi067.stderr: 60950K .......... .......... .......... .......... .......... 65% 315M 0s 2024-09-12T00:25:33.653 INFO:teuthology.orchestra.run.smithi067.stderr: 61000K .......... .......... .......... .......... .......... 65% 344M 0s 2024-09-12T00:25:33.653 INFO:teuthology.orchestra.run.smithi067.stderr: 61050K .......... .......... .......... .......... .......... 65% 380M 0s 2024-09-12T00:25:33.653 INFO:teuthology.orchestra.run.smithi067.stderr: 61100K .......... .......... .......... .......... .......... 65% 180M 0s 2024-09-12T00:25:33.653 INFO:teuthology.orchestra.run.smithi067.stderr: 61150K .......... .......... .......... .......... .......... 65% 167M 0s 2024-09-12T00:25:33.653 INFO:teuthology.orchestra.run.smithi067.stderr: 61200K .......... .......... .......... .......... .......... 65% 87.9M 0s 2024-09-12T00:25:33.653 INFO:teuthology.orchestra.run.smithi067.stderr: 61250K .......... .......... .......... .......... .......... 65% 347M 0s 2024-09-12T00:25:33.653 INFO:teuthology.orchestra.run.smithi067.stderr: 61300K .......... .......... .......... .......... .......... 66% 327M 0s 2024-09-12T00:25:33.653 INFO:teuthology.orchestra.run.smithi067.stderr: 61350K .......... .......... .......... .......... .......... 66% 362M 0s 2024-09-12T00:25:33.653 INFO:teuthology.orchestra.run.smithi067.stderr: 61400K .......... .......... .......... .......... .......... 66% 350M 0s 2024-09-12T00:25:33.654 INFO:teuthology.orchestra.run.smithi067.stderr: 61450K .......... .......... .......... .......... .......... 66% 53.0M 0s 2024-09-12T00:25:33.654 INFO:teuthology.orchestra.run.smithi067.stderr: 61500K .......... .......... .......... .......... .......... 66% 220M 0s 2024-09-12T00:25:33.654 INFO:teuthology.orchestra.run.smithi067.stderr: 61550K .......... .......... .......... .......... .......... 66% 274M 0s 2024-09-12T00:25:33.654 INFO:teuthology.orchestra.run.smithi067.stderr: 61600K .......... .......... .......... .......... .......... 66% 326M 0s 2024-09-12T00:25:33.654 INFO:teuthology.orchestra.run.smithi067.stderr: 61650K .......... .......... .......... .......... .......... 66% 323M 0s 2024-09-12T00:25:33.654 INFO:teuthology.orchestra.run.smithi067.stderr: 61700K .......... .......... .......... .......... .......... 66% 58.5M 0s 2024-09-12T00:25:33.654 INFO:teuthology.orchestra.run.smithi067.stderr: 61750K .......... .......... .......... .......... .......... 66% 226M 0s 2024-09-12T00:25:33.654 INFO:teuthology.orchestra.run.smithi067.stderr: 61800K .......... .......... .......... .......... .......... 66% 339M 0s 2024-09-12T00:25:33.654 INFO:teuthology.orchestra.run.smithi067.stderr: 61850K .......... .......... .......... .......... .......... 66% 89.2M 0s 2024-09-12T00:25:33.654 INFO:teuthology.orchestra.run.smithi067.stderr: 61900K .......... .......... .......... .......... .......... 66% 266M 0s 2024-09-12T00:25:33.654 INFO:teuthology.orchestra.run.smithi067.stderr: 61950K .......... .......... .......... .......... .......... 66% 264M 0s 2024-09-12T00:25:33.654 INFO:teuthology.orchestra.run.smithi067.stderr: 62000K .......... .......... .......... .......... .......... 66% 319M 0s 2024-09-12T00:25:33.654 INFO:teuthology.orchestra.run.smithi067.stderr: 62050K .......... .......... .......... .......... .......... 66% 325M 0s 2024-09-12T00:25:33.655 INFO:teuthology.orchestra.run.smithi067.stderr: 62100K .......... .......... .......... .......... .......... 66% 305M 0s 2024-09-12T00:25:33.655 INFO:teuthology.orchestra.run.smithi067.stderr: 62150K .......... .......... .......... .......... .......... 66% 282M 0s 2024-09-12T00:25:33.655 INFO:teuthology.orchestra.run.smithi067.stderr: 62200K .......... .......... .......... .......... .......... 67% 335M 0s 2024-09-12T00:25:33.655 INFO:teuthology.orchestra.run.smithi067.stderr: 62250K .......... .......... .......... .......... .......... 67% 355M 0s 2024-09-12T00:25:33.655 INFO:teuthology.orchestra.run.smithi067.stderr: 62300K .......... .......... .......... .......... .......... 67% 368M 0s 2024-09-12T00:25:33.655 INFO:teuthology.orchestra.run.smithi067.stderr: 62350K .......... .......... .......... .......... .......... 67% 257M 0s 2024-09-12T00:25:33.655 INFO:teuthology.orchestra.run.smithi067.stderr: 62400K .......... .......... .......... .......... .......... 67% 340M 0s 2024-09-12T00:25:33.655 INFO:teuthology.orchestra.run.smithi067.stderr: 62450K .......... .......... .......... .......... .......... 67% 321M 0s 2024-09-12T00:25:33.655 INFO:teuthology.orchestra.run.smithi067.stderr: 62500K .......... .......... .......... .......... .......... 67% 359M 0s 2024-09-12T00:25:33.655 INFO:teuthology.orchestra.run.smithi067.stderr: 62550K .......... .......... .......... .......... .......... 67% 161M 0s 2024-09-12T00:25:33.655 INFO:teuthology.orchestra.run.smithi067.stderr: 62600K .......... .......... .......... .......... .......... 67% 304M 0s 2024-09-12T00:25:33.655 INFO:teuthology.orchestra.run.smithi067.stderr: 62650K .......... .......... .......... .......... .......... 67% 195M 0s 2024-09-12T00:25:33.655 INFO:teuthology.orchestra.run.smithi067.stderr: 62700K .......... .......... .......... .......... .......... 67% 282M 0s 2024-09-12T00:25:33.656 INFO:teuthology.orchestra.run.smithi067.stderr: 62750K .......... .......... .......... .......... .......... 67% 335M 0s 2024-09-12T00:25:33.656 INFO:teuthology.orchestra.run.smithi067.stderr: 62800K .......... .......... .......... .......... .......... 67% 307M 0s 2024-09-12T00:25:33.656 INFO:teuthology.orchestra.run.smithi067.stderr: 62850K .......... .......... .......... .......... .......... 67% 339M 0s 2024-09-12T00:25:33.656 INFO:teuthology.orchestra.run.smithi067.stderr: 62900K .......... .......... .......... .......... .......... 67% 290M 0s 2024-09-12T00:25:33.656 INFO:teuthology.orchestra.run.smithi067.stderr: 62950K .......... .......... .......... .......... .......... 67% 332M 0s 2024-09-12T00:25:33.656 INFO:teuthology.orchestra.run.smithi067.stderr: 63000K .......... .......... .......... .......... .......... 67% 353M 0s 2024-09-12T00:25:33.656 INFO:teuthology.orchestra.run.smithi067.stderr: 63050K .......... .......... .......... .......... .......... 67% 123M 0s 2024-09-12T00:25:33.656 INFO:teuthology.orchestra.run.smithi067.stderr: 63100K .......... .......... .......... .......... .......... 67% 336M 0s 2024-09-12T00:25:33.656 INFO:teuthology.orchestra.run.smithi067.stderr: 63150K .......... .......... .......... .......... .......... 68% 276M 0s 2024-09-12T00:25:33.656 INFO:teuthology.orchestra.run.smithi067.stderr: 63200K .......... .......... .......... .......... .......... 68% 344M 0s 2024-09-12T00:25:33.656 INFO:teuthology.orchestra.run.smithi067.stderr: 63250K .......... .......... .......... .......... .......... 68% 362M 0s 2024-09-12T00:25:33.656 INFO:teuthology.orchestra.run.smithi067.stderr: 63300K .......... .......... .......... .......... .......... 68% 389M 0s 2024-09-12T00:25:33.656 INFO:teuthology.orchestra.run.smithi067.stderr: 63350K .......... .......... .......... .......... .......... 68% 193M 0s 2024-09-12T00:25:33.656 INFO:teuthology.orchestra.run.smithi067.stderr: 63400K .......... .......... .......... .......... .......... 68% 340M 0s 2024-09-12T00:25:33.657 INFO:teuthology.orchestra.run.smithi067.stderr: 63450K .......... .......... .......... .......... .......... 68% 325M 0s 2024-09-12T00:25:33.657 INFO:teuthology.orchestra.run.smithi067.stderr: 63500K .......... .......... .......... .......... .......... 68% 372M 0s 2024-09-12T00:25:33.657 INFO:teuthology.orchestra.run.smithi067.stderr: 63550K .......... .......... .......... .......... .......... 68% 189M 0s 2024-09-12T00:25:33.657 INFO:teuthology.orchestra.run.smithi067.stderr: 63600K .......... .......... .......... .......... .......... 68% 279M 0s 2024-09-12T00:25:33.657 INFO:teuthology.orchestra.run.smithi067.stderr: 63650K .......... .......... .......... .......... .......... 68% 323M 0s 2024-09-12T00:25:33.657 INFO:teuthology.orchestra.run.smithi067.stderr: 63700K .......... .......... .......... .......... .......... 68% 307M 0s 2024-09-12T00:25:33.657 INFO:teuthology.orchestra.run.smithi067.stderr: 63750K .......... .......... .......... .......... .......... 68% 288M 0s 2024-09-12T00:25:33.657 INFO:teuthology.orchestra.run.smithi067.stderr: 63800K .......... .......... .......... .......... .......... 68% 353M 0s 2024-09-12T00:25:33.657 INFO:teuthology.orchestra.run.smithi067.stderr: 63850K .......... .......... .......... .......... .......... 68% 387M 0s 2024-09-12T00:25:33.657 INFO:teuthology.orchestra.run.smithi067.stderr: 63900K .......... .......... .......... .......... .......... 68% 334M 0s 2024-09-12T00:25:33.657 INFO:teuthology.orchestra.run.smithi067.stderr: 63950K .......... .......... .......... .......... .......... 68% 132M 0s 2024-09-12T00:25:33.657 INFO:teuthology.orchestra.run.smithi067.stderr: 64000K .......... .......... .......... .......... .......... 68% 322M 0s 2024-09-12T00:25:33.657 INFO:teuthology.orchestra.run.smithi067.stderr: 64050K .......... .......... .......... .......... .......... 68% 275M 0s 2024-09-12T00:25:33.657 INFO:teuthology.orchestra.run.smithi067.stderr: 64100K .......... .......... .......... .......... .......... 69% 338M 0s 2024-09-12T00:25:33.658 INFO:teuthology.orchestra.run.smithi067.stderr: 64150K .......... .......... .......... .......... .......... 69% 353M 0s 2024-09-12T00:25:33.658 INFO:teuthology.orchestra.run.smithi067.stderr: 64200K .......... .......... .......... .......... .......... 69% 336M 0s 2024-09-12T00:25:33.658 INFO:teuthology.orchestra.run.smithi067.stderr: 64250K .......... .......... .......... .......... .......... 69% 311M 0s 2024-09-12T00:25:33.658 INFO:teuthology.orchestra.run.smithi067.stderr: 64300K .......... .......... .......... .......... .......... 69% 327M 0s 2024-09-12T00:25:33.658 INFO:teuthology.orchestra.run.smithi067.stderr: 64350K .......... .......... .......... .......... .......... 69% 256M 0s 2024-09-12T00:25:33.658 INFO:teuthology.orchestra.run.smithi067.stderr: 64400K .......... .......... .......... .......... .......... 69% 316M 0s 2024-09-12T00:25:33.658 INFO:teuthology.orchestra.run.smithi067.stderr: 64450K .......... .......... .......... .......... .......... 69% 55.9M 0s 2024-09-12T00:25:33.658 INFO:teuthology.orchestra.run.smithi067.stderr: 64500K .......... .......... .......... .......... .......... 69% 311M 0s 2024-09-12T00:25:33.658 INFO:teuthology.orchestra.run.smithi067.stderr: 64550K .......... .......... .......... .......... .......... 69% 209M 0s 2024-09-12T00:25:33.658 INFO:teuthology.orchestra.run.smithi067.stderr: 64600K .......... .......... .......... .......... .......... 69% 339M 0s 2024-09-12T00:25:33.658 INFO:teuthology.orchestra.run.smithi067.stderr: 64650K .......... .......... .......... .......... .......... 69% 274M 0s 2024-09-12T00:25:33.658 INFO:teuthology.orchestra.run.smithi067.stderr: 64700K .......... .......... .......... .......... .......... 69% 267M 0s 2024-09-12T00:25:33.658 INFO:teuthology.orchestra.run.smithi067.stderr: 64750K .......... .......... .......... .......... .......... 69% 78.2M 0s 2024-09-12T00:25:33.659 INFO:teuthology.orchestra.run.smithi067.stderr: 64800K .......... .......... .......... .......... .......... 69% 176M 0s 2024-09-12T00:25:33.659 INFO:teuthology.orchestra.run.smithi067.stderr: 64850K .......... .......... .......... .......... .......... 69% 322M 0s 2024-09-12T00:25:33.659 INFO:teuthology.orchestra.run.smithi067.stderr: 64900K .......... .......... .......... .......... .......... 69% 78.8M 0s 2024-09-12T00:25:33.659 INFO:teuthology.orchestra.run.smithi067.stderr: 64950K .......... .......... .......... .......... .......... 69% 134M 0s 2024-09-12T00:25:33.659 INFO:teuthology.orchestra.run.smithi067.stderr: 65000K .......... .......... .......... .......... .......... 70% 332M 0s 2024-09-12T00:25:33.659 INFO:teuthology.orchestra.run.smithi067.stderr: 65050K .......... .......... .......... .......... .......... 70% 333M 0s 2024-09-12T00:25:33.659 INFO:teuthology.orchestra.run.smithi067.stderr: 65100K .......... .......... .......... .......... .......... 70% 355M 0s 2024-09-12T00:25:33.659 INFO:teuthology.orchestra.run.smithi067.stderr: 65150K .......... .......... .......... .......... .......... 70% 271M 0s 2024-09-12T00:25:33.659 INFO:teuthology.orchestra.run.smithi067.stderr: 65200K .......... .......... .......... .......... .......... 70% 368M 0s 2024-09-12T00:25:33.659 INFO:teuthology.orchestra.run.smithi067.stderr: 65250K .......... .......... .......... .......... .......... 70% 188M 0s 2024-09-12T00:25:33.659 INFO:teuthology.orchestra.run.smithi067.stderr: 65300K .......... .......... .......... .......... .......... 70% 333M 0s 2024-09-12T00:25:33.659 INFO:teuthology.orchestra.run.smithi067.stderr: 65350K .......... .......... .......... .......... .......... 70% 315M 0s 2024-09-12T00:25:33.659 INFO:teuthology.orchestra.run.smithi067.stderr: 65400K .......... .......... .......... .......... .......... 70% 306M 0s 2024-09-12T00:25:33.659 INFO:teuthology.orchestra.run.smithi067.stderr: 65450K .......... .......... .......... .......... .......... 70% 354M 0s 2024-09-12T00:25:33.659 INFO:teuthology.orchestra.run.smithi067.stderr: 65500K .......... .......... .......... .......... .......... 70% 238M 0s 2024-09-12T00:25:33.660 INFO:teuthology.orchestra.run.smithi067.stderr: 65550K .......... .......... .......... .......... .......... 70% 254M 0s 2024-09-12T00:25:33.660 INFO:teuthology.orchestra.run.smithi067.stderr: 65600K .......... .......... .......... .......... .......... 70% 335M 0s 2024-09-12T00:25:33.660 INFO:teuthology.orchestra.run.smithi067.stderr: 65650K .......... .......... .......... .......... .......... 70% 173M 0s 2024-09-12T00:25:33.660 INFO:teuthology.orchestra.run.smithi067.stderr: 65700K .......... .......... .......... .......... .......... 70% 307M 0s 2024-09-12T00:25:33.660 INFO:teuthology.orchestra.run.smithi067.stderr: 65750K .......... .......... .......... .......... .......... 70% 283M 0s 2024-09-12T00:25:33.660 INFO:teuthology.orchestra.run.smithi067.stderr: 65800K .......... .......... .......... .......... .......... 70% 342M 0s 2024-09-12T00:25:33.660 INFO:teuthology.orchestra.run.smithi067.stderr: 65850K .......... .......... .......... .......... .......... 70% 93.3M 0s 2024-09-12T00:25:33.660 INFO:teuthology.orchestra.run.smithi067.stderr: 65900K .......... .......... .......... .......... .......... 70% 329M 0s 2024-09-12T00:25:33.660 INFO:teuthology.orchestra.run.smithi067.stderr: 65950K .......... .......... .......... .......... .......... 71% 235M 0s 2024-09-12T00:25:33.660 INFO:teuthology.orchestra.run.smithi067.stderr: 66000K .......... .......... .......... .......... .......... 71% 357M 0s 2024-09-12T00:25:33.660 INFO:teuthology.orchestra.run.smithi067.stderr: 66050K .......... .......... .......... .......... .......... 71% 114M 0s 2024-09-12T00:25:33.660 INFO:teuthology.orchestra.run.smithi067.stderr: 66100K .......... .......... .......... .......... .......... 71% 290M 0s 2024-09-12T00:25:33.660 INFO:teuthology.orchestra.run.smithi067.stderr: 66150K .......... .......... .......... .......... .......... 71% 286M 0s 2024-09-12T00:25:33.661 INFO:teuthology.orchestra.run.smithi067.stderr: 66200K .......... .......... .......... .......... .......... 71% 326M 0s 2024-09-12T00:25:33.661 INFO:teuthology.orchestra.run.smithi067.stderr: 66250K .......... .......... .......... .......... .......... 71% 315M 0s 2024-09-12T00:25:33.661 INFO:teuthology.orchestra.run.smithi067.stderr: 66300K .......... .......... .......... .......... .......... 71% 347M 0s 2024-09-12T00:25:33.661 INFO:teuthology.orchestra.run.smithi067.stderr: 66350K .......... .......... .......... .......... .......... 71% 292M 0s 2024-09-12T00:25:33.661 INFO:teuthology.orchestra.run.smithi067.stderr: 66400K .......... .......... .......... .......... .......... 71% 377M 0s 2024-09-12T00:25:33.661 INFO:teuthology.orchestra.run.smithi067.stderr: 66450K .......... .......... .......... .......... .......... 71% 372M 0s 2024-09-12T00:25:33.661 INFO:teuthology.orchestra.run.smithi067.stderr: 66500K .......... .......... .......... .......... .......... 71% 379M 0s 2024-09-12T00:25:33.661 INFO:teuthology.orchestra.run.smithi067.stderr: 66550K .......... .......... .......... .......... .......... 71% 345M 0s 2024-09-12T00:25:33.661 INFO:teuthology.orchestra.run.smithi067.stderr: 66600K .......... .......... .......... .......... .......... 71% 354M 0s 2024-09-12T00:25:33.661 INFO:teuthology.orchestra.run.smithi067.stderr: 66650K .......... .......... .......... .......... .......... 71% 357M 0s 2024-09-12T00:25:33.661 INFO:teuthology.orchestra.run.smithi067.stderr: 66700K .......... .......... .......... .......... .......... 71% 370M 0s 2024-09-12T00:25:33.661 INFO:teuthology.orchestra.run.smithi067.stderr: 66750K .......... .......... .......... .......... .......... 71% 300M 0s 2024-09-12T00:25:33.661 INFO:teuthology.orchestra.run.smithi067.stderr: 66800K .......... .......... .......... .......... .......... 71% 382M 0s 2024-09-12T00:25:33.662 INFO:teuthology.orchestra.run.smithi067.stderr: 66850K .......... .......... .......... .......... .......... 72% 126M 0s 2024-09-12T00:25:33.662 INFO:teuthology.orchestra.run.smithi067.stderr: 66900K .......... .......... .......... .......... .......... 72% 340M 0s 2024-09-12T00:25:33.662 INFO:teuthology.orchestra.run.smithi067.stderr: 66950K .......... .......... .......... .......... .......... 72% 291M 0s 2024-09-12T00:25:33.662 INFO:teuthology.orchestra.run.smithi067.stderr: 67000K .......... .......... .......... .......... .......... 72% 336M 0s 2024-09-12T00:25:33.662 INFO:teuthology.orchestra.run.smithi067.stderr: 67050K .......... .......... .......... .......... .......... 72% 287M 0s 2024-09-12T00:25:33.662 INFO:teuthology.orchestra.run.smithi067.stderr: 67100K .......... .......... .......... .......... .......... 72% 323M 0s 2024-09-12T00:25:33.662 INFO:teuthology.orchestra.run.smithi067.stderr: 67150K .......... .......... .......... .......... .......... 72% 253M 0s 2024-09-12T00:25:33.662 INFO:teuthology.orchestra.run.smithi067.stderr: 67200K .......... .......... .......... .......... .......... 72% 307M 0s 2024-09-12T00:25:33.662 INFO:teuthology.orchestra.run.smithi067.stderr: 67250K .......... .......... .......... .......... .......... 72% 315M 0s 2024-09-12T00:25:33.662 INFO:teuthology.orchestra.run.smithi067.stderr: 67300K .......... .......... .......... .......... .......... 72% 312M 0s 2024-09-12T00:25:33.662 INFO:teuthology.orchestra.run.smithi067.stderr: 67350K .......... .......... .......... .......... .......... 72% 349M 0s 2024-09-12T00:25:33.662 INFO:teuthology.orchestra.run.smithi067.stderr: 67400K .......... .......... .......... .......... .......... 72% 387M 0s 2024-09-12T00:25:33.662 INFO:teuthology.orchestra.run.smithi067.stderr: 67450K .......... .......... .......... .......... .......... 72% 357M 0s 2024-09-12T00:25:33.662 INFO:teuthology.orchestra.run.smithi067.stderr: 67500K .......... .......... .......... .......... .......... 72% 132M 0s 2024-09-12T00:25:33.663 INFO:teuthology.orchestra.run.smithi067.stderr: 67550K .......... .......... .......... .......... .......... 72% 133M 0s 2024-09-12T00:25:33.663 INFO:teuthology.orchestra.run.smithi067.stderr: 67600K .......... .......... .......... .......... .......... 72% 321M 0s 2024-09-12T00:25:33.663 INFO:teuthology.orchestra.run.smithi067.stderr: 67650K .......... .......... .......... .......... .......... 72% 333M 0s 2024-09-12T00:25:33.663 INFO:teuthology.orchestra.run.smithi067.stderr: 67700K .......... .......... .......... .......... .......... 72% 350M 0s 2024-09-12T00:25:33.663 INFO:teuthology.orchestra.run.smithi067.stderr: 67750K .......... .......... .......... .......... .......... 72% 214M 0s 2024-09-12T00:25:33.663 INFO:teuthology.orchestra.run.smithi067.stderr: 67800K .......... .......... .......... .......... .......... 73% 67.9M 0s 2024-09-12T00:25:33.663 INFO:teuthology.orchestra.run.smithi067.stderr: 67850K .......... .......... .......... .......... .......... 73% 271M 0s 2024-09-12T00:25:33.663 INFO:teuthology.orchestra.run.smithi067.stderr: 67900K .......... .......... .......... .......... .......... 73% 377M 0s 2024-09-12T00:25:33.663 INFO:teuthology.orchestra.run.smithi067.stderr: 67950K .......... .......... .......... .......... .......... 73% 80.4M 0s 2024-09-12T00:25:33.663 INFO:teuthology.orchestra.run.smithi067.stderr: 68000K .......... .......... .......... .......... .......... 73% 150M 0s 2024-09-12T00:25:33.663 INFO:teuthology.orchestra.run.smithi067.stderr: 68050K .......... .......... .......... .......... .......... 73% 209M 0s 2024-09-12T00:25:33.663 INFO:teuthology.orchestra.run.smithi067.stderr: 68100K .......... .......... .......... .......... .......... 73% 317M 0s 2024-09-12T00:25:33.663 INFO:teuthology.orchestra.run.smithi067.stderr: 68150K .......... .......... .......... .......... .......... 73% 309M 0s 2024-09-12T00:25:33.663 INFO:teuthology.orchestra.run.smithi067.stderr: 68200K .......... .......... .......... .......... .......... 73% 346M 0s 2024-09-12T00:25:33.664 INFO:teuthology.orchestra.run.smithi067.stderr: 68250K .......... .......... .......... .......... .......... 73% 62.6M 0s 2024-09-12T00:25:33.664 INFO:teuthology.orchestra.run.smithi067.stderr: 68300K .......... .......... .......... .......... .......... 73% 354M 0s 2024-09-12T00:25:33.664 INFO:teuthology.orchestra.run.smithi067.stderr: 68350K .......... .......... .......... .......... .......... 73% 255M 0s 2024-09-12T00:25:33.664 INFO:teuthology.orchestra.run.smithi067.stderr: 68400K .......... .......... .......... .......... .......... 73% 341M 0s 2024-09-12T00:25:33.664 INFO:teuthology.orchestra.run.smithi067.stderr: 68450K .......... .......... .......... .......... .......... 73% 348M 0s 2024-09-12T00:25:33.664 INFO:teuthology.orchestra.run.smithi067.stderr: 68500K .......... .......... .......... .......... .......... 73% 315M 0s 2024-09-12T00:25:33.664 INFO:teuthology.orchestra.run.smithi067.stderr: 68550K .......... .......... .......... .......... .......... 73% 291M 0s 2024-09-12T00:25:33.664 INFO:teuthology.orchestra.run.smithi067.stderr: 68600K .......... .......... .......... .......... .......... 73% 356M 0s 2024-09-12T00:25:33.664 INFO:teuthology.orchestra.run.smithi067.stderr: 68650K .......... .......... .......... .......... .......... 73% 338M 0s 2024-09-12T00:25:33.664 INFO:teuthology.orchestra.run.smithi067.stderr: 68700K .......... .......... .......... .......... .......... 74% 356M 0s 2024-09-12T00:25:33.664 INFO:teuthology.orchestra.run.smithi067.stderr: 68750K .......... .......... .......... .......... .......... 74% 209M 0s 2024-09-12T00:25:33.664 INFO:teuthology.orchestra.run.smithi067.stderr: 68800K .......... .......... .......... .......... .......... 74% 74.7M 0s 2024-09-12T00:25:33.664 INFO:teuthology.orchestra.run.smithi067.stderr: 68850K .......... .......... .......... .......... .......... 74% 271M 0s 2024-09-12T00:25:33.664 INFO:teuthology.orchestra.run.smithi067.stderr: 68900K .......... .......... .......... .......... .......... 74% 348M 0s 2024-09-12T00:25:33.665 INFO:teuthology.orchestra.run.smithi067.stderr: 68950K .......... .......... .......... .......... .......... 74% 301M 0s 2024-09-12T00:25:33.665 INFO:teuthology.orchestra.run.smithi067.stderr: 69000K .......... .......... .......... .......... .......... 74% 335M 0s 2024-09-12T00:25:33.665 INFO:teuthology.orchestra.run.smithi067.stderr: 69050K .......... .......... .......... .......... .......... 74% 336M 0s 2024-09-12T00:25:33.665 INFO:teuthology.orchestra.run.smithi067.stderr: 69100K .......... .......... .......... .......... .......... 74% 165M 0s 2024-09-12T00:25:33.665 INFO:teuthology.orchestra.run.smithi067.stderr: 69150K .......... .......... .......... .......... .......... 74% 198M 0s 2024-09-12T00:25:33.665 INFO:teuthology.orchestra.run.smithi067.stderr: 69200K .......... .......... .......... .......... .......... 74% 333M 0s 2024-09-12T00:25:33.665 INFO:teuthology.orchestra.run.smithi067.stderr: 69250K .......... .......... .......... .......... .......... 74% 310M 0s 2024-09-12T00:25:33.665 INFO:teuthology.orchestra.run.smithi067.stderr: 69300K .......... .......... .......... .......... .......... 74% 332M 0s 2024-09-12T00:25:33.665 INFO:teuthology.orchestra.run.smithi067.stderr: 69350K .......... .......... .......... .......... .......... 74% 348M 0s 2024-09-12T00:25:33.665 INFO:teuthology.orchestra.run.smithi067.stderr: 69400K .......... .......... .......... .......... .......... 74% 360M 0s 2024-09-12T00:25:33.665 INFO:teuthology.orchestra.run.smithi067.stderr: 69450K .......... .......... .......... .......... .......... 74% 251M 0s 2024-09-12T00:25:33.665 INFO:teuthology.orchestra.run.smithi067.stderr: 69500K .......... .......... .......... .......... .......... 74% 219M 0s 2024-09-12T00:25:33.665 INFO:teuthology.orchestra.run.smithi067.stderr: 69550K .......... .......... .......... .......... .......... 74% 314M 0s 2024-09-12T00:25:33.665 INFO:teuthology.orchestra.run.smithi067.stderr: 69600K .......... .......... .......... .......... .......... 74% 364M 0s 2024-09-12T00:25:33.666 INFO:teuthology.orchestra.run.smithi067.stderr: 69650K .......... .......... .......... .......... .......... 75% 372M 0s 2024-09-12T00:25:33.666 INFO:teuthology.orchestra.run.smithi067.stderr: 69700K .......... .......... .......... .......... .......... 75% 358M 0s 2024-09-12T00:25:33.666 INFO:teuthology.orchestra.run.smithi067.stderr: 69750K .......... .......... .......... .......... .......... 75% 309M 0s 2024-09-12T00:25:33.666 INFO:teuthology.orchestra.run.smithi067.stderr: 69800K .......... .......... .......... .......... .......... 75% 330M 0s 2024-09-12T00:25:33.666 INFO:teuthology.orchestra.run.smithi067.stderr: 69850K .......... .......... .......... .......... .......... 75% 375M 0s 2024-09-12T00:25:33.666 INFO:teuthology.orchestra.run.smithi067.stderr: 69900K .......... .......... .......... .......... .......... 75% 381M 0s 2024-09-12T00:25:33.666 INFO:teuthology.orchestra.run.smithi067.stderr: 69950K .......... .......... .......... .......... .......... 75% 249M 0s 2024-09-12T00:25:33.666 INFO:teuthology.orchestra.run.smithi067.stderr: 70000K .......... .......... .......... .......... .......... 75% 296M 0s 2024-09-12T00:25:33.666 INFO:teuthology.orchestra.run.smithi067.stderr: 70050K .......... .......... .......... .......... .......... 75% 288M 0s 2024-09-12T00:25:33.666 INFO:teuthology.orchestra.run.smithi067.stderr: 70100K .......... .......... .......... .......... .......... 75% 240M 0s 2024-09-12T00:25:33.666 INFO:teuthology.orchestra.run.smithi067.stderr: 70150K .......... .......... .......... .......... .......... 75% 349M 0s 2024-09-12T00:25:33.666 INFO:teuthology.orchestra.run.smithi067.stderr: 70200K .......... .......... .......... .......... .......... 75% 389M 0s 2024-09-12T00:25:33.666 INFO:teuthology.orchestra.run.smithi067.stderr: 70250K .......... .......... .......... .......... .......... 75% 122M 0s 2024-09-12T00:25:33.666 INFO:teuthology.orchestra.run.smithi067.stderr: 70300K .......... .......... .......... .......... .......... 75% 343M 0s 2024-09-12T00:25:33.666 INFO:teuthology.orchestra.run.smithi067.stderr: 70350K .......... .......... .......... .......... .......... 75% 277M 0s 2024-09-12T00:25:33.667 INFO:teuthology.orchestra.run.smithi067.stderr: 70400K .......... .......... .......... .......... .......... 75% 282M 0s 2024-09-12T00:25:33.667 INFO:teuthology.orchestra.run.smithi067.stderr: 70450K .......... .......... .......... .......... .......... 75% 291M 0s 2024-09-12T00:25:33.667 INFO:teuthology.orchestra.run.smithi067.stderr: 70500K .......... .......... .......... .......... .......... 75% 331M 0s 2024-09-12T00:25:33.667 INFO:teuthology.orchestra.run.smithi067.stderr: 70550K .......... .......... .......... .......... .......... 75% 276M 0s 2024-09-12T00:25:33.667 INFO:teuthology.orchestra.run.smithi067.stderr: 70600K .......... .......... .......... .......... .......... 76% 352M 0s 2024-09-12T00:25:33.667 INFO:teuthology.orchestra.run.smithi067.stderr: 70650K .......... .......... .......... .......... .......... 76% 360M 0s 2024-09-12T00:25:33.667 INFO:teuthology.orchestra.run.smithi067.stderr: 70700K .......... .......... .......... .......... .......... 76% 377M 0s 2024-09-12T00:25:33.667 INFO:teuthology.orchestra.run.smithi067.stderr: 70750K .......... .......... .......... .......... .......... 76% 95.2M 0s 2024-09-12T00:25:33.667 INFO:teuthology.orchestra.run.smithi067.stderr: 70800K .......... .......... .......... .......... .......... 76% 365M 0s 2024-09-12T00:25:33.667 INFO:teuthology.orchestra.run.smithi067.stderr: 70850K .......... .......... .......... .......... .......... 76% 304M 0s 2024-09-12T00:25:33.667 INFO:teuthology.orchestra.run.smithi067.stderr: 70900K .......... .......... .......... .......... .......... 76% 241M 0s 2024-09-12T00:25:33.667 INFO:teuthology.orchestra.run.smithi067.stderr: 70950K .......... .......... .......... .......... .......... 76% 166M 0s 2024-09-12T00:25:33.667 INFO:teuthology.orchestra.run.smithi067.stderr: 71000K .......... .......... .......... .......... .......... 76% 114M 0s 2024-09-12T00:25:33.668 INFO:teuthology.orchestra.run.smithi067.stderr: 71050K .......... .......... .......... .......... .......... 76% 124M 0s 2024-09-12T00:25:33.668 INFO:teuthology.orchestra.run.smithi067.stderr: 71100K .......... .......... .......... .......... .......... 76% 346M 0s 2024-09-12T00:25:33.668 INFO:teuthology.orchestra.run.smithi067.stderr: 71150K .......... .......... .......... .......... .......... 76% 253M 0s 2024-09-12T00:25:33.668 INFO:teuthology.orchestra.run.smithi067.stderr: 71200K .......... .......... .......... .......... .......... 76% 317M 0s 2024-09-12T00:25:33.668 INFO:teuthology.orchestra.run.smithi067.stderr: 71250K .......... .......... .......... .......... .......... 76% 58.8M 0s 2024-09-12T00:25:33.668 INFO:teuthology.orchestra.run.smithi067.stderr: 71300K .......... .......... .......... .......... .......... 76% 335M 0s 2024-09-12T00:25:33.668 INFO:teuthology.orchestra.run.smithi067.stderr: 71350K .......... .......... .......... .......... .......... 76% 344M 0s 2024-09-12T00:25:33.668 INFO:teuthology.orchestra.run.smithi067.stderr: 71400K .......... .......... .......... .......... .......... 76% 346M 0s 2024-09-12T00:25:33.668 INFO:teuthology.orchestra.run.smithi067.stderr: 71450K .......... .......... .......... .......... .......... 76% 388M 0s 2024-09-12T00:25:33.668 INFO:teuthology.orchestra.run.smithi067.stderr: 71500K .......... .......... .......... .......... .......... 77% 357M 0s 2024-09-12T00:25:33.668 INFO:teuthology.orchestra.run.smithi067.stderr: 71550K .......... .......... .......... .......... .......... 77% 236M 0s 2024-09-12T00:25:33.668 INFO:teuthology.orchestra.run.smithi067.stderr: 71600K .......... .......... .......... .......... .......... 77% 320M 0s 2024-09-12T00:25:33.668 INFO:teuthology.orchestra.run.smithi067.stderr: 71650K .......... .......... .......... .......... .......... 77% 367M 0s 2024-09-12T00:25:33.668 INFO:teuthology.orchestra.run.smithi067.stderr: 71700K .......... .......... .......... .......... .......... 77% 191M 0s 2024-09-12T00:25:33.669 INFO:teuthology.orchestra.run.smithi067.stderr: 71750K .......... .......... .......... .......... .......... 77% 98.8M 0s 2024-09-12T00:25:33.669 INFO:teuthology.orchestra.run.smithi067.stderr: 71800K .......... .......... .......... .......... .......... 77% 291M 0s 2024-09-12T00:25:33.669 INFO:teuthology.orchestra.run.smithi067.stderr: 71850K .......... .......... .......... .......... .......... 77% 329M 0s 2024-09-12T00:25:33.669 INFO:teuthology.orchestra.run.smithi067.stderr: 71900K .......... .......... .......... .......... .......... 77% 272M 0s 2024-09-12T00:25:33.669 INFO:teuthology.orchestra.run.smithi067.stderr: 71950K .......... .......... .......... .......... .......... 77% 78.9M 0s 2024-09-12T00:25:33.669 INFO:teuthology.orchestra.run.smithi067.stderr: 72000K .......... .......... .......... .......... .......... 77% 277M 0s 2024-09-12T00:25:33.669 INFO:teuthology.orchestra.run.smithi067.stderr: 72050K .......... .......... .......... .......... .......... 77% 305M 0s 2024-09-12T00:25:33.669 INFO:teuthology.orchestra.run.smithi067.stderr: 72100K .......... .......... .......... .......... .......... 77% 324M 0s 2024-09-12T00:25:33.669 INFO:teuthology.orchestra.run.smithi067.stderr: 72150K .......... .......... .......... .......... .......... 77% 326M 0s 2024-09-12T00:25:33.669 INFO:teuthology.orchestra.run.smithi067.stderr: 72200K .......... .......... .......... .......... .......... 77% 351M 0s 2024-09-12T00:25:33.669 INFO:teuthology.orchestra.run.smithi067.stderr: 72250K .......... .......... .......... .......... .......... 77% 323M 0s 2024-09-12T00:25:33.669 INFO:teuthology.orchestra.run.smithi067.stderr: 72300K .......... .......... .......... .......... .......... 77% 345M 0s 2024-09-12T00:25:33.669 INFO:teuthology.orchestra.run.smithi067.stderr: 72350K .......... .......... .......... .......... .......... 77% 270M 0s 2024-09-12T00:25:33.670 INFO:teuthology.orchestra.run.smithi067.stderr: 72400K .......... .......... .......... .......... .......... 77% 342M 0s 2024-09-12T00:25:33.670 INFO:teuthology.orchestra.run.smithi067.stderr: 72450K .......... .......... .......... .......... .......... 78% 322M 0s 2024-09-12T00:25:33.670 INFO:teuthology.orchestra.run.smithi067.stderr: 72500K .......... .......... .......... .......... .......... 78% 101M 0s 2024-09-12T00:25:33.670 INFO:teuthology.orchestra.run.smithi067.stderr: 72550K .......... .......... .......... .......... .......... 78% 283M 0s 2024-09-12T00:25:33.670 INFO:teuthology.orchestra.run.smithi067.stderr: 72600K .......... .......... .......... .......... .......... 78% 302M 0s 2024-09-12T00:25:33.670 INFO:teuthology.orchestra.run.smithi067.stderr: 72650K .......... .......... .......... .......... .......... 78% 340M 0s 2024-09-12T00:25:33.670 INFO:teuthology.orchestra.run.smithi067.stderr: 72700K .......... .......... .......... .......... .......... 78% 349M 0s 2024-09-12T00:25:33.670 INFO:teuthology.orchestra.run.smithi067.stderr: 72750K .......... .......... .......... .......... .......... 78% 276M 0s 2024-09-12T00:25:33.670 INFO:teuthology.orchestra.run.smithi067.stderr: 72800K .......... .......... .......... .......... .......... 78% 264M 0s 2024-09-12T00:25:33.670 INFO:teuthology.orchestra.run.smithi067.stderr: 72850K .......... .......... .......... .......... .......... 78% 217M 0s 2024-09-12T00:25:33.670 INFO:teuthology.orchestra.run.smithi067.stderr: 72900K .......... .......... .......... .......... .......... 78% 320M 0s 2024-09-12T00:25:33.670 INFO:teuthology.orchestra.run.smithi067.stderr: 72950K .......... .......... .......... .......... .......... 78% 323M 0s 2024-09-12T00:25:33.670 INFO:teuthology.orchestra.run.smithi067.stderr: 73000K .......... .......... .......... .......... .......... 78% 363M 0s 2024-09-12T00:25:33.670 INFO:teuthology.orchestra.run.smithi067.stderr: 73050K .......... .......... .......... .......... .......... 78% 346M 0s 2024-09-12T00:25:33.671 INFO:teuthology.orchestra.run.smithi067.stderr: 73100K .......... .......... .......... .......... .......... 78% 335M 0s 2024-09-12T00:25:33.671 INFO:teuthology.orchestra.run.smithi067.stderr: 73150K .......... .......... .......... .......... .......... 78% 322M 0s 2024-09-12T00:25:33.671 INFO:teuthology.orchestra.run.smithi067.stderr: 73200K .......... .......... .......... .......... .......... 78% 304M 0s 2024-09-12T00:25:33.671 INFO:teuthology.orchestra.run.smithi067.stderr: 73250K .......... .......... .......... .......... .......... 78% 377M 0s 2024-09-12T00:25:33.671 INFO:teuthology.orchestra.run.smithi067.stderr: 73300K .......... .......... .......... .......... .......... 78% 372M 0s 2024-09-12T00:25:33.671 INFO:teuthology.orchestra.run.smithi067.stderr: 73350K .......... .......... .......... .......... .......... 79% 330M 0s 2024-09-12T00:25:33.671 INFO:teuthology.orchestra.run.smithi067.stderr: 73400K .......... .......... .......... .......... .......... 79% 364M 0s 2024-09-12T00:25:33.671 INFO:teuthology.orchestra.run.smithi067.stderr: 73450K .......... .......... .......... .......... .......... 79% 350M 0s 2024-09-12T00:25:33.671 INFO:teuthology.orchestra.run.smithi067.stderr: 73500K .......... .......... .......... .......... .......... 79% 378M 0s 2024-09-12T00:25:33.671 INFO:teuthology.orchestra.run.smithi067.stderr: 73550K .......... .......... .......... .......... .......... 79% 308M 0s 2024-09-12T00:25:33.671 INFO:teuthology.orchestra.run.smithi067.stderr: 73600K .......... .......... .......... .......... .......... 79% 352M 0s 2024-09-12T00:25:33.671 INFO:teuthology.orchestra.run.smithi067.stderr: 73650K .......... .......... .......... .......... .......... 79% 339M 0s 2024-09-12T00:25:33.671 INFO:teuthology.orchestra.run.smithi067.stderr: 73700K .......... .......... .......... .......... .......... 79% 383M 0s 2024-09-12T00:25:33.672 INFO:teuthology.orchestra.run.smithi067.stderr: 73750K .......... .......... .......... .......... .......... 79% 96.9M 0s 2024-09-12T00:25:33.672 INFO:teuthology.orchestra.run.smithi067.stderr: 73800K .......... .......... .......... .......... .......... 79% 299M 0s 2024-09-12T00:25:33.672 INFO:teuthology.orchestra.run.smithi067.stderr: 73850K .......... .......... .......... .......... .......... 79% 250M 0s 2024-09-12T00:25:33.672 INFO:teuthology.orchestra.run.smithi067.stderr: 73900K .......... .......... .......... .......... .......... 79% 356M 0s 2024-09-12T00:25:33.672 INFO:teuthology.orchestra.run.smithi067.stderr: 73950K .......... .......... .......... .......... .......... 79% 312M 0s 2024-09-12T00:25:33.672 INFO:teuthology.orchestra.run.smithi067.stderr: 74000K .......... .......... .......... .......... .......... 79% 238M 0s 2024-09-12T00:25:33.672 INFO:teuthology.orchestra.run.smithi067.stderr: 74050K .......... .......... .......... .......... .......... 79% 85.0M 0s 2024-09-12T00:25:33.672 INFO:teuthology.orchestra.run.smithi067.stderr: 74100K .......... .......... .......... .......... .......... 79% 261M 0s 2024-09-12T00:25:33.672 INFO:teuthology.orchestra.run.smithi067.stderr: 74150K .......... .......... .......... .......... .......... 79% 208M 0s 2024-09-12T00:25:33.672 INFO:teuthology.orchestra.run.smithi067.stderr: 74200K .......... .......... .......... .......... .......... 79% 332M 0s 2024-09-12T00:25:33.672 INFO:teuthology.orchestra.run.smithi067.stderr: 74250K .......... .......... .......... .......... .......... 79% 343M 0s 2024-09-12T00:25:33.672 INFO:teuthology.orchestra.run.smithi067.stderr: 74300K .......... .......... .......... .......... .......... 80% 78.6M 0s 2024-09-12T00:25:33.672 INFO:teuthology.orchestra.run.smithi067.stderr: 74350K .......... .......... .......... .......... .......... 80% 108M 0s 2024-09-12T00:25:33.672 INFO:teuthology.orchestra.run.smithi067.stderr: 74400K .......... .......... .......... .......... .......... 80% 229M 0s 2024-09-12T00:25:33.673 INFO:teuthology.orchestra.run.smithi067.stderr: 74450K .......... .......... .......... .......... .......... 80% 366M 0s 2024-09-12T00:25:33.673 INFO:teuthology.orchestra.run.smithi067.stderr: 74500K .......... .......... .......... .......... .......... 80% 241M 0s 2024-09-12T00:25:33.673 INFO:teuthology.orchestra.run.smithi067.stderr: 74550K .......... .......... .......... .......... .......... 80% 305M 0s 2024-09-12T00:25:33.673 INFO:teuthology.orchestra.run.smithi067.stderr: 74600K .......... .......... .......... .......... .......... 80% 377M 0s 2024-09-12T00:25:33.673 INFO:teuthology.orchestra.run.smithi067.stderr: 74650K .......... .......... .......... .......... .......... 80% 372M 0s 2024-09-12T00:25:33.673 INFO:teuthology.orchestra.run.smithi067.stderr: 74700K .......... .......... .......... .......... .......... 80% 330M 0s 2024-09-12T00:25:33.673 INFO:teuthology.orchestra.run.smithi067.stderr: 74750K .......... .......... .......... .......... .......... 80% 286M 0s 2024-09-12T00:25:33.673 INFO:teuthology.orchestra.run.smithi067.stderr: 74800K .......... .......... .......... .......... .......... 80% 153M 0s 2024-09-12T00:25:33.673 INFO:teuthology.orchestra.run.smithi067.stderr: 74850K .......... .......... .......... .......... .......... 80% 165M 0s 2024-09-12T00:25:33.673 INFO:teuthology.orchestra.run.smithi067.stderr: 74900K .......... .......... .......... .......... .......... 80% 276M 0s 2024-09-12T00:25:33.673 INFO:teuthology.orchestra.run.smithi067.stderr: 74950K .......... .......... .......... .......... .......... 80% 319M 0s 2024-09-12T00:25:33.673 INFO:teuthology.orchestra.run.smithi067.stderr: 75000K .......... .......... .......... .......... .......... 80% 101M 0s 2024-09-12T00:25:33.673 INFO:teuthology.orchestra.run.smithi067.stderr: 75050K .......... .......... .......... .......... .......... 80% 77.4M 0s 2024-09-12T00:25:33.673 INFO:teuthology.orchestra.run.smithi067.stderr: 75100K .......... .......... .......... .......... .......... 80% 291M 0s 2024-09-12T00:25:33.674 INFO:teuthology.orchestra.run.smithi067.stderr: 75150K .......... .......... .......... .......... .......... 80% 249M 0s 2024-09-12T00:25:33.674 INFO:teuthology.orchestra.run.smithi067.stderr: 75200K .......... .......... .......... .......... .......... 81% 280M 0s 2024-09-12T00:25:33.674 INFO:teuthology.orchestra.run.smithi067.stderr: 75250K .......... .......... .......... .......... .......... 81% 312M 0s 2024-09-12T00:25:33.674 INFO:teuthology.orchestra.run.smithi067.stderr: 75300K .......... .......... .......... .......... .......... 81% 325M 0s 2024-09-12T00:25:33.674 INFO:teuthology.orchestra.run.smithi067.stderr: 75350K .......... .......... .......... .......... .......... 81% 293M 0s 2024-09-12T00:25:33.674 INFO:teuthology.orchestra.run.smithi067.stderr: 75400K .......... .......... .......... .......... .......... 81% 333M 0s 2024-09-12T00:25:33.674 INFO:teuthology.orchestra.run.smithi067.stderr: 75450K .......... .......... .......... .......... .......... 81% 350M 0s 2024-09-12T00:25:33.674 INFO:teuthology.orchestra.run.smithi067.stderr: 75500K .......... .......... .......... .......... .......... 81% 303M 0s 2024-09-12T00:25:33.674 INFO:teuthology.orchestra.run.smithi067.stderr: 75550K .......... .......... .......... .......... .......... 81% 243M 0s 2024-09-12T00:25:33.674 INFO:teuthology.orchestra.run.smithi067.stderr: 75600K .......... .......... .......... .......... .......... 81% 350M 0s 2024-09-12T00:25:33.674 INFO:teuthology.orchestra.run.smithi067.stderr: 75650K .......... .......... .......... .......... .......... 81% 177M 0s 2024-09-12T00:25:33.674 INFO:teuthology.orchestra.run.smithi067.stderr: 75700K .......... .......... .......... .......... .......... 81% 311M 0s 2024-09-12T00:25:33.674 INFO:teuthology.orchestra.run.smithi067.stderr: 75750K .......... .......... .......... .......... .......... 81% 304M 0s 2024-09-12T00:25:33.674 INFO:teuthology.orchestra.run.smithi067.stderr: 75800K .......... .......... .......... .......... .......... 81% 330M 0s 2024-09-12T00:25:33.674 INFO:teuthology.orchestra.run.smithi067.stderr: 75850K .......... .......... .......... .......... .......... 81% 327M 0s 2024-09-12T00:25:33.675 INFO:teuthology.orchestra.run.smithi067.stderr: 75900K .......... .......... .......... .......... .......... 81% 376M 0s 2024-09-12T00:25:33.675 INFO:teuthology.orchestra.run.smithi067.stderr: 75950K .......... .......... .......... .......... .......... 81% 230M 0s 2024-09-12T00:25:33.675 INFO:teuthology.orchestra.run.smithi067.stderr: 76000K .......... .......... .......... .......... .......... 81% 312M 0s 2024-09-12T00:25:33.675 INFO:teuthology.orchestra.run.smithi067.stderr: 76050K .......... .......... .......... .......... .......... 81% 314M 0s 2024-09-12T00:25:33.675 INFO:teuthology.orchestra.run.smithi067.stderr: 76100K .......... .......... .......... .......... .......... 81% 342M 0s 2024-09-12T00:25:33.675 INFO:teuthology.orchestra.run.smithi067.stderr: 76150K .......... .......... .......... .......... .......... 82% 283M 0s 2024-09-12T00:25:33.675 INFO:teuthology.orchestra.run.smithi067.stderr: 76200K .......... .......... .......... .......... .......... 82% 342M 0s 2024-09-12T00:25:33.675 INFO:teuthology.orchestra.run.smithi067.stderr: 76250K .......... .......... .......... .......... .......... 82% 313M 0s 2024-09-12T00:25:33.675 INFO:teuthology.orchestra.run.smithi067.stderr: 76300K .......... .......... .......... .......... .......... 82% 298M 0s 2024-09-12T00:25:33.675 INFO:teuthology.orchestra.run.smithi067.stderr: 76350K .......... .......... .......... .......... .......... 82% 301M 0s 2024-09-12T00:25:33.675 INFO:teuthology.orchestra.run.smithi067.stderr: 76400K .......... .......... .......... .......... .......... 82% 340M 0s 2024-09-12T00:25:33.675 INFO:teuthology.orchestra.run.smithi067.stderr: 76450K .......... .......... .......... .......... .......... 82% 308M 0s 2024-09-12T00:25:33.675 INFO:teuthology.orchestra.run.smithi067.stderr: 76500K .......... .......... .......... .......... .......... 82% 314M 0s 2024-09-12T00:25:33.676 INFO:teuthology.orchestra.run.smithi067.stderr: 76550K .......... .......... .......... .......... .......... 82% 316M 0s 2024-09-12T00:25:33.676 INFO:teuthology.orchestra.run.smithi067.stderr: 76600K .......... .......... .......... .......... .......... 82% 365M 0s 2024-09-12T00:25:33.676 INFO:teuthology.orchestra.run.smithi067.stderr: 76650K .......... .......... .......... .......... .......... 82% 348M 0s 2024-09-12T00:25:33.676 INFO:teuthology.orchestra.run.smithi067.stderr: 76700K .......... .......... .......... .......... .......... 82% 358M 0s 2024-09-12T00:25:33.676 INFO:teuthology.orchestra.run.smithi067.stderr: 76750K .......... .......... .......... .......... .......... 82% 206M 0s 2024-09-12T00:25:33.676 INFO:teuthology.orchestra.run.smithi067.stderr: 76800K .......... .......... .......... .......... .......... 82% 243M 0s 2024-09-12T00:25:33.676 INFO:teuthology.orchestra.run.smithi067.stderr: 76850K .......... .......... .......... .......... .......... 82% 205M 0s 2024-09-12T00:25:33.676 INFO:teuthology.orchestra.run.smithi067.stderr: 76900K .......... .......... .......... .......... .......... 82% 360M 0s 2024-09-12T00:25:33.676 INFO:teuthology.orchestra.run.smithi067.stderr: 76950K .......... .......... .......... .......... .......... 82% 223M 0s 2024-09-12T00:25:33.676 INFO:teuthology.orchestra.run.smithi067.stderr: 77000K .......... .......... .......... .......... .......... 82% 341M 0s 2024-09-12T00:25:33.676 INFO:teuthology.orchestra.run.smithi067.stderr: 77050K .......... .......... .......... .......... .......... 82% 367M 0s 2024-09-12T00:25:33.676 INFO:teuthology.orchestra.run.smithi067.stderr: 77100K .......... .......... .......... .......... .......... 83% 149M 0s 2024-09-12T00:25:33.676 INFO:teuthology.orchestra.run.smithi067.stderr: 77150K .......... .......... .......... .......... .......... 83% 226M 0s 2024-09-12T00:25:33.677 INFO:teuthology.orchestra.run.smithi067.stderr: 77200K .......... .......... .......... .......... .......... 83% 204M 0s 2024-09-12T00:25:33.677 INFO:teuthology.orchestra.run.smithi067.stderr: 77250K .......... .......... .......... .......... .......... 83% 190M 0s 2024-09-12T00:25:33.677 INFO:teuthology.orchestra.run.smithi067.stderr: 77300K .......... .......... .......... .......... .......... 83% 377M 0s 2024-09-12T00:25:33.677 INFO:teuthology.orchestra.run.smithi067.stderr: 77350K .......... .......... .......... .......... .......... 83% 96.6M 0s 2024-09-12T00:25:33.677 INFO:teuthology.orchestra.run.smithi067.stderr: 77400K .......... .......... .......... .......... .......... 83% 102M 0s 2024-09-12T00:25:33.677 INFO:teuthology.orchestra.run.smithi067.stderr: 77450K .......... .......... .......... .......... .......... 83% 342M 0s 2024-09-12T00:25:33.677 INFO:teuthology.orchestra.run.smithi067.stderr: 77500K .......... .......... .......... .......... .......... 83% 145M 0s 2024-09-12T00:25:33.677 INFO:teuthology.orchestra.run.smithi067.stderr: 77550K .......... .......... .......... .......... .......... 83% 221M 0s 2024-09-12T00:25:33.677 INFO:teuthology.orchestra.run.smithi067.stderr: 77600K .......... .......... .......... .......... .......... 83% 326M 0s 2024-09-12T00:25:33.677 INFO:teuthology.orchestra.run.smithi067.stderr: 77650K .......... .......... .......... .......... .......... 83% 235M 0s 2024-09-12T00:25:33.677 INFO:teuthology.orchestra.run.smithi067.stderr: 77700K .......... .......... .......... .......... .......... 83% 284M 0s 2024-09-12T00:25:33.677 INFO:teuthology.orchestra.run.smithi067.stderr: 77750K .......... .......... .......... .......... .......... 83% 278M 0s 2024-09-12T00:25:33.677 INFO:teuthology.orchestra.run.smithi067.stderr: 77800K .......... .......... .......... .......... .......... 83% 346M 0s 2024-09-12T00:25:33.677 INFO:teuthology.orchestra.run.smithi067.stderr: 77850K .......... .......... .......... .......... .......... 83% 194M 0s 2024-09-12T00:25:33.677 INFO:teuthology.orchestra.run.smithi067.stderr: 77900K .......... .......... .......... .......... .......... 83% 344M 0s 2024-09-12T00:25:33.678 INFO:teuthology.orchestra.run.smithi067.stderr: 77950K .......... .......... .......... .......... .......... 83% 133M 0s 2024-09-12T00:25:33.678 INFO:teuthology.orchestra.run.smithi067.stderr: 78000K .......... .......... .......... .......... .......... 84% 136M 0s 2024-09-12T00:25:33.678 INFO:teuthology.orchestra.run.smithi067.stderr: 78050K .......... .......... .......... .......... .......... 84% 311M 0s 2024-09-12T00:25:33.678 INFO:teuthology.orchestra.run.smithi067.stderr: 78100K .......... .......... .......... .......... .......... 84% 114M 0s 2024-09-12T00:25:33.678 INFO:teuthology.orchestra.run.smithi067.stderr: 78150K .......... .......... .......... .......... .......... 84% 259M 0s 2024-09-12T00:25:33.678 INFO:teuthology.orchestra.run.smithi067.stderr: 78200K .......... .......... .......... .......... .......... 84% 291M 0s 2024-09-12T00:25:33.678 INFO:teuthology.orchestra.run.smithi067.stderr: 78250K .......... .......... .......... .......... .......... 84% 82.3M 0s 2024-09-12T00:25:33.678 INFO:teuthology.orchestra.run.smithi067.stderr: 78300K .......... .......... .......... .......... .......... 84% 319M 0s 2024-09-12T00:25:33.678 INFO:teuthology.orchestra.run.smithi067.stderr: 78350K .......... .......... .......... .......... .......... 84% 250M 0s 2024-09-12T00:25:33.678 INFO:teuthology.orchestra.run.smithi067.stderr: 78400K .......... .......... .......... .......... .......... 84% 231M 0s 2024-09-12T00:25:33.678 INFO:teuthology.orchestra.run.smithi067.stderr: 78450K .......... .......... .......... .......... .......... 84% 343M 0s 2024-09-12T00:25:33.678 INFO:teuthology.orchestra.run.smithi067.stderr: 78500K .......... .......... .......... .......... .......... 84% 180M 0s 2024-09-12T00:25:33.678 INFO:teuthology.orchestra.run.smithi067.stderr: 78550K .......... .......... .......... .......... .......... 84% 285M 0s 2024-09-12T00:25:33.678 INFO:teuthology.orchestra.run.smithi067.stderr: 78600K .......... .......... .......... .......... .......... 84% 324M 0s 2024-09-12T00:25:33.679 INFO:teuthology.orchestra.run.smithi067.stderr: 78650K .......... .......... .......... .......... .......... 84% 349M 0s 2024-09-12T00:25:33.679 INFO:teuthology.orchestra.run.smithi067.stderr: 78700K .......... .......... .......... .......... .......... 84% 366M 0s 2024-09-12T00:25:33.679 INFO:teuthology.orchestra.run.smithi067.stderr: 78750K .......... .......... .......... .......... .......... 84% 324M 0s 2024-09-12T00:25:33.679 INFO:teuthology.orchestra.run.smithi067.stderr: 78800K .......... .......... .......... .......... .......... 84% 331M 0s 2024-09-12T00:25:33.679 INFO:teuthology.orchestra.run.smithi067.stderr: 78850K .......... .......... .......... .......... .......... 84% 369M 0s 2024-09-12T00:25:33.679 INFO:teuthology.orchestra.run.smithi067.stderr: 78900K .......... .......... .......... .......... .......... 84% 340M 0s 2024-09-12T00:25:33.679 INFO:teuthology.orchestra.run.smithi067.stderr: 78950K .......... .......... .......... .......... .......... 85% 307M 0s 2024-09-12T00:25:33.679 INFO:teuthology.orchestra.run.smithi067.stderr: 79000K .......... .......... .......... .......... .......... 85% 354M 0s 2024-09-12T00:25:33.679 INFO:teuthology.orchestra.run.smithi067.stderr: 79050K .......... .......... .......... .......... .......... 85% 199M 0s 2024-09-12T00:25:33.679 INFO:teuthology.orchestra.run.smithi067.stderr: 79100K .......... .......... .......... .......... .......... 85% 356M 0s 2024-09-12T00:25:33.679 INFO:teuthology.orchestra.run.smithi067.stderr: 79150K .......... .......... .......... .......... .......... 85% 232M 0s 2024-09-12T00:25:33.679 INFO:teuthology.orchestra.run.smithi067.stderr: 79200K .......... .......... .......... .......... .......... 85% 332M 0s 2024-09-12T00:25:33.679 INFO:teuthology.orchestra.run.smithi067.stderr: 79250K .......... .......... .......... .......... .......... 85% 263M 0s 2024-09-12T00:25:33.679 INFO:teuthology.orchestra.run.smithi067.stderr: 79300K .......... .......... .......... .......... .......... 85% 283M 0s 2024-09-12T00:25:33.679 INFO:teuthology.orchestra.run.smithi067.stderr: 79350K .......... .......... .......... .......... .......... 85% 257M 0s 2024-09-12T00:25:33.680 INFO:teuthology.orchestra.run.smithi067.stderr: 79400K .......... .......... .......... .......... .......... 85% 353M 0s 2024-09-12T00:25:33.680 INFO:teuthology.orchestra.run.smithi067.stderr: 79450K .......... .......... .......... .......... .......... 85% 318M 0s 2024-09-12T00:25:33.680 INFO:teuthology.orchestra.run.smithi067.stderr: 79500K .......... .......... .......... .......... .......... 85% 317M 0s 2024-09-12T00:25:33.680 INFO:teuthology.orchestra.run.smithi067.stderr: 79550K .......... .......... .......... .......... .......... 85% 263M 0s 2024-09-12T00:25:33.680 INFO:teuthology.orchestra.run.smithi067.stderr: 79600K .......... .......... .......... .......... .......... 85% 315M 0s 2024-09-12T00:25:33.680 INFO:teuthology.orchestra.run.smithi067.stderr: 79650K .......... .......... .......... .......... .......... 85% 334M 0s 2024-09-12T00:25:33.680 INFO:teuthology.orchestra.run.smithi067.stderr: 79700K .......... .......... .......... .......... .......... 85% 299M 0s 2024-09-12T00:25:33.680 INFO:teuthology.orchestra.run.smithi067.stderr: 79750K .......... .......... .......... .......... .......... 85% 272M 0s 2024-09-12T00:25:33.680 INFO:teuthology.orchestra.run.smithi067.stderr: 79800K .......... .......... .......... .......... .......... 85% 314M 0s 2024-09-12T00:25:33.680 INFO:teuthology.orchestra.run.smithi067.stderr: 79850K .......... .......... .......... .......... .......... 86% 312M 0s 2024-09-12T00:25:33.680 INFO:teuthology.orchestra.run.smithi067.stderr: 79900K .......... .......... .......... .......... .......... 86% 310M 0s 2024-09-12T00:25:33.680 INFO:teuthology.orchestra.run.smithi067.stderr: 79950K .......... .......... .......... .......... .......... 86% 269M 0s 2024-09-12T00:25:33.680 INFO:teuthology.orchestra.run.smithi067.stderr: 80000K .......... .......... .......... .......... .......... 86% 329M 0s 2024-09-12T00:25:33.681 INFO:teuthology.orchestra.run.smithi067.stderr: 80050K .......... .......... .......... .......... .......... 86% 384M 0s 2024-09-12T00:25:33.681 INFO:teuthology.orchestra.run.smithi067.stderr: 80100K .......... .......... .......... .......... .......... 86% 117M 0s 2024-09-12T00:25:33.681 INFO:teuthology.orchestra.run.smithi067.stderr: 80150K .......... .......... .......... .......... .......... 86% 337M 0s 2024-09-12T00:25:33.681 INFO:teuthology.orchestra.run.smithi067.stderr: 80200K .......... .......... .......... .......... .......... 86% 330M 0s 2024-09-12T00:25:33.681 INFO:teuthology.orchestra.run.smithi067.stderr: 80250K .......... .......... .......... .......... .......... 86% 352M 0s 2024-09-12T00:25:33.681 INFO:teuthology.orchestra.run.smithi067.stderr: 80300K .......... .......... .......... .......... .......... 86% 347M 0s 2024-09-12T00:25:33.681 INFO:teuthology.orchestra.run.smithi067.stderr: 80350K .......... .......... .......... .......... .......... 86% 102M 0s 2024-09-12T00:25:33.681 INFO:teuthology.orchestra.run.smithi067.stderr: 80400K .......... .......... .......... .......... .......... 86% 243M 0s 2024-09-12T00:25:33.681 INFO:teuthology.orchestra.run.smithi067.stderr: 80450K .......... .......... .......... .......... .......... 86% 144M 0s 2024-09-12T00:25:33.681 INFO:teuthology.orchestra.run.smithi067.stderr: 80500K .......... .......... .......... .......... .......... 86% 286M 0s 2024-09-12T00:25:33.681 INFO:teuthology.orchestra.run.smithi067.stderr: 80550K .......... .......... .......... .......... .......... 86% 113M 0s 2024-09-12T00:25:33.681 INFO:teuthology.orchestra.run.smithi067.stderr: 80600K .......... .......... .......... .......... .......... 86% 88.7M 0s 2024-09-12T00:25:33.681 INFO:teuthology.orchestra.run.smithi067.stderr: 80650K .......... .......... .......... .......... .......... 86% 286M 0s 2024-09-12T00:25:33.681 INFO:teuthology.orchestra.run.smithi067.stderr: 80700K .......... .......... .......... .......... .......... 86% 298M 0s 2024-09-12T00:25:33.681 INFO:teuthology.orchestra.run.smithi067.stderr: 80750K .......... .......... .......... .......... .......... 86% 289M 0s 2024-09-12T00:25:33.682 INFO:teuthology.orchestra.run.smithi067.stderr: 80800K .......... .......... .......... .......... .......... 87% 335M 0s 2024-09-12T00:25:33.682 INFO:teuthology.orchestra.run.smithi067.stderr: 80850K .......... .......... .......... .......... .......... 87% 325M 0s 2024-09-12T00:25:33.682 INFO:teuthology.orchestra.run.smithi067.stderr: 80900K .......... .......... .......... .......... .......... 87% 349M 0s 2024-09-12T00:25:33.682 INFO:teuthology.orchestra.run.smithi067.stderr: 80950K .......... .......... .......... .......... .......... 87% 345M 0s 2024-09-12T00:25:33.682 INFO:teuthology.orchestra.run.smithi067.stderr: 81000K .......... .......... .......... .......... .......... 87% 342M 0s 2024-09-12T00:25:33.682 INFO:teuthology.orchestra.run.smithi067.stderr: 81050K .......... .......... .......... .......... .......... 87% 202M 0s 2024-09-12T00:25:33.682 INFO:teuthology.orchestra.run.smithi067.stderr: 81100K .......... .......... .......... .......... .......... 87% 76.6M 0s 2024-09-12T00:25:33.682 INFO:teuthology.orchestra.run.smithi067.stderr: 81150K .......... .......... .......... .......... .......... 87% 266M 0s 2024-09-12T00:25:33.682 INFO:teuthology.orchestra.run.smithi067.stderr: 81200K .......... .......... .......... .......... .......... 87% 346M 0s 2024-09-12T00:25:33.682 INFO:teuthology.orchestra.run.smithi067.stderr: 81250K .......... .......... .......... .......... .......... 87% 329M 0s 2024-09-12T00:25:33.682 INFO:teuthology.orchestra.run.smithi067.stderr: 81300K .......... .......... .......... .......... .......... 87% 88.2M 0s 2024-09-12T00:25:33.682 INFO:teuthology.orchestra.run.smithi067.stderr: 81350K .......... .......... .......... .......... .......... 87% 145M 0s 2024-09-12T00:25:33.682 INFO:teuthology.orchestra.run.smithi067.stderr: 81400K .......... .......... .......... .......... .......... 87% 334M 0s 2024-09-12T00:25:33.682 INFO:teuthology.orchestra.run.smithi067.stderr: 81450K .......... .......... .......... .......... .......... 87% 257M 0s 2024-09-12T00:25:33.683 INFO:teuthology.orchestra.run.smithi067.stderr: 81500K .......... .......... .......... .......... .......... 87% 111M 0s 2024-09-12T00:25:33.683 INFO:teuthology.orchestra.run.smithi067.stderr: 81550K .......... .......... .......... .......... .......... 87% 255M 0s 2024-09-12T00:25:33.683 INFO:teuthology.orchestra.run.smithi067.stderr: 81600K .......... .......... .......... .......... .......... 87% 330M 0s 2024-09-12T00:25:33.683 INFO:teuthology.orchestra.run.smithi067.stderr: 81650K .......... .......... .......... .......... .......... 87% 277M 0s 2024-09-12T00:25:33.683 INFO:teuthology.orchestra.run.smithi067.stderr: 81700K .......... .......... .......... .......... .......... 87% 356M 0s 2024-09-12T00:25:33.683 INFO:teuthology.orchestra.run.smithi067.stderr: 81750K .......... .......... .......... .......... .......... 88% 344M 0s 2024-09-12T00:25:33.683 INFO:teuthology.orchestra.run.smithi067.stderr: 81800K .......... .......... .......... .......... .......... 88% 363M 0s 2024-09-12T00:25:33.683 INFO:teuthology.orchestra.run.smithi067.stderr: 81850K .......... .......... .......... .......... .......... 88% 340M 0s 2024-09-12T00:25:33.683 INFO:teuthology.orchestra.run.smithi067.stderr: 81900K .......... .......... .......... .......... .......... 88% 276M 0s 2024-09-12T00:25:33.683 INFO:teuthology.orchestra.run.smithi067.stderr: 81950K .......... .......... .......... .......... .......... 88% 261M 0s 2024-09-12T00:25:33.683 INFO:teuthology.orchestra.run.smithi067.stderr: 82000K .......... .......... .......... .......... .......... 88% 306M 0s 2024-09-12T00:25:33.683 INFO:teuthology.orchestra.run.smithi067.stderr: 82050K .......... .......... .......... .......... .......... 88% 266M 0s 2024-09-12T00:25:33.683 INFO:teuthology.orchestra.run.smithi067.stderr: 82100K .......... .......... .......... .......... .......... 88% 284M 0s 2024-09-12T00:25:33.683 INFO:teuthology.orchestra.run.smithi067.stderr: 82150K .......... .......... .......... .......... .......... 88% 238M 0s 2024-09-12T00:25:33.684 INFO:teuthology.orchestra.run.smithi067.stderr: 82200K .......... .......... .......... .......... .......... 88% 182M 0s 2024-09-12T00:25:33.684 INFO:teuthology.orchestra.run.smithi067.stderr: 82250K .......... .......... .......... .......... .......... 88% 176M 0s 2024-09-12T00:25:33.684 INFO:teuthology.orchestra.run.smithi067.stderr: 82300K .......... .......... .......... .......... .......... 88% 245M 0s 2024-09-12T00:25:33.684 INFO:teuthology.orchestra.run.smithi067.stderr: 82350K .......... .......... .......... .......... .......... 88% 261M 0s 2024-09-12T00:25:33.684 INFO:teuthology.orchestra.run.smithi067.stderr: 82400K .......... .......... .......... .......... .......... 88% 313M 0s 2024-09-12T00:25:33.684 INFO:teuthology.orchestra.run.smithi067.stderr: 82450K .......... .......... .......... .......... .......... 88% 340M 0s 2024-09-12T00:25:33.684 INFO:teuthology.orchestra.run.smithi067.stderr: 82500K .......... .......... .......... .......... .......... 88% 316M 0s 2024-09-12T00:25:33.684 INFO:teuthology.orchestra.run.smithi067.stderr: 82550K .......... .......... .......... .......... .......... 88% 293M 0s 2024-09-12T00:25:33.684 INFO:teuthology.orchestra.run.smithi067.stderr: 82600K .......... .......... .......... .......... .......... 88% 341M 0s 2024-09-12T00:25:33.684 INFO:teuthology.orchestra.run.smithi067.stderr: 82650K .......... .......... .......... .......... .......... 89% 373M 0s 2024-09-12T00:25:33.684 INFO:teuthology.orchestra.run.smithi067.stderr: 82700K .......... .......... .......... .......... .......... 89% 333M 0s 2024-09-12T00:25:33.684 INFO:teuthology.orchestra.run.smithi067.stderr: 82750K .......... .......... .......... .......... .......... 89% 210M 0s 2024-09-12T00:25:33.684 INFO:teuthology.orchestra.run.smithi067.stderr: 82800K .......... .......... .......... .......... .......... 89% 352M 0s 2024-09-12T00:25:33.685 INFO:teuthology.orchestra.run.smithi067.stderr: 82850K .......... .......... .......... .......... .......... 89% 344M 0s 2024-09-12T00:25:33.685 INFO:teuthology.orchestra.run.smithi067.stderr: 82900K .......... .......... .......... .......... .......... 89% 326M 0s 2024-09-12T00:25:33.685 INFO:teuthology.orchestra.run.smithi067.stderr: 82950K .......... .......... .......... .......... .......... 89% 263M 0s 2024-09-12T00:25:33.685 INFO:teuthology.orchestra.run.smithi067.stderr: 83000K .......... .......... .......... .......... .......... 89% 332M 0s 2024-09-12T00:25:33.685 INFO:teuthology.orchestra.run.smithi067.stderr: 83050K .......... .......... .......... .......... .......... 89% 284M 0s 2024-09-12T00:25:33.685 INFO:teuthology.orchestra.run.smithi067.stderr: 83100K .......... .......... .......... .......... .......... 89% 165M 0s 2024-09-12T00:25:33.685 INFO:teuthology.orchestra.run.smithi067.stderr: 83150K .......... .......... .......... .......... .......... 89% 271M 0s 2024-09-12T00:25:33.685 INFO:teuthology.orchestra.run.smithi067.stderr: 83200K .......... .......... .......... .......... .......... 89% 320M 0s 2024-09-12T00:25:33.685 INFO:teuthology.orchestra.run.smithi067.stderr: 83250K .......... .......... .......... .......... .......... 89% 338M 0s 2024-09-12T00:25:33.685 INFO:teuthology.orchestra.run.smithi067.stderr: 83300K .......... .......... .......... .......... .......... 89% 294M 0s 2024-09-12T00:25:33.685 INFO:teuthology.orchestra.run.smithi067.stderr: 83350K .......... .......... .......... .......... .......... 89% 307M 0s 2024-09-12T00:25:33.685 INFO:teuthology.orchestra.run.smithi067.stderr: 83400K .......... .......... .......... .......... .......... 89% 194M 0s 2024-09-12T00:25:33.685 INFO:teuthology.orchestra.run.smithi067.stderr: 83450K .......... .......... .......... .......... .......... 89% 340M 0s 2024-09-12T00:25:33.685 INFO:teuthology.orchestra.run.smithi067.stderr: 83500K .......... .......... .......... .......... .......... 89% 308M 0s 2024-09-12T00:25:33.686 INFO:teuthology.orchestra.run.smithi067.stderr: 83550K .......... .......... .......... .......... .......... 89% 155M 0s 2024-09-12T00:25:33.686 INFO:teuthology.orchestra.run.smithi067.stderr: 83600K .......... .......... .......... .......... .......... 90% 162M 0s 2024-09-12T00:25:33.686 INFO:teuthology.orchestra.run.smithi067.stderr: 83650K .......... .......... .......... .......... .......... 90% 136M 0s 2024-09-12T00:25:33.686 INFO:teuthology.orchestra.run.smithi067.stderr: 83700K .......... .......... .......... .......... .......... 90% 149M 0s 2024-09-12T00:25:33.686 INFO:teuthology.orchestra.run.smithi067.stderr: 83750K .......... .......... .......... .......... .......... 90% 268M 0s 2024-09-12T00:25:33.686 INFO:teuthology.orchestra.run.smithi067.stderr: 83800K .......... .......... .......... .......... .......... 90% 298M 0s 2024-09-12T00:25:33.686 INFO:teuthology.orchestra.run.smithi067.stderr: 83850K .......... .......... .......... .......... .......... 90% 338M 0s 2024-09-12T00:25:33.686 INFO:teuthology.orchestra.run.smithi067.stderr: 83900K .......... .......... .......... .......... .......... 90% 212M 0s 2024-09-12T00:25:33.686 INFO:teuthology.orchestra.run.smithi067.stderr: 83950K .......... .......... .......... .......... .......... 90% 242M 0s 2024-09-12T00:25:33.686 INFO:teuthology.orchestra.run.smithi067.stderr: 84000K .......... .......... .......... .......... .......... 90% 309M 0s 2024-09-12T00:25:33.686 INFO:teuthology.orchestra.run.smithi067.stderr: 84050K .......... .......... .......... .......... .......... 90% 315M 0s 2024-09-12T00:25:33.686 INFO:teuthology.orchestra.run.smithi067.stderr: 84100K .......... .......... .......... .......... .......... 90% 337M 0s 2024-09-12T00:25:33.686 INFO:teuthology.orchestra.run.smithi067.stderr: 84150K .......... .......... .......... .......... .......... 90% 92.2M 0s 2024-09-12T00:25:33.686 INFO:teuthology.orchestra.run.smithi067.stderr: 84200K .......... .......... .......... .......... .......... 90% 303M 0s 2024-09-12T00:25:33.687 INFO:teuthology.orchestra.run.smithi067.stderr: 84250K .......... .......... .......... .......... .......... 90% 209M 0s 2024-09-12T00:25:33.687 INFO:teuthology.orchestra.run.smithi067.stderr: 84300K .......... .......... .......... .......... .......... 90% 344M 0s 2024-09-12T00:25:33.687 INFO:teuthology.orchestra.run.smithi067.stderr: 84350K .......... .......... .......... .......... .......... 90% 99.5M 0s 2024-09-12T00:25:33.687 INFO:teuthology.orchestra.run.smithi067.stderr: 84400K .......... .......... .......... .......... .......... 90% 170M 0s 2024-09-12T00:25:33.687 INFO:teuthology.orchestra.run.smithi067.stderr: 84450K .......... .......... .......... .......... .......... 90% 248M 0s 2024-09-12T00:25:33.687 INFO:teuthology.orchestra.run.smithi067.stderr: 84500K .......... .......... .......... .......... .......... 91% 369M 0s 2024-09-12T00:25:33.687 INFO:teuthology.orchestra.run.smithi067.stderr: 84550K .......... .......... .......... .......... .......... 91% 131M 0s 2024-09-12T00:25:33.687 INFO:teuthology.orchestra.run.smithi067.stderr: 84600K .......... .......... .......... .......... .......... 91% 113M 0s 2024-09-12T00:25:33.687 INFO:teuthology.orchestra.run.smithi067.stderr: 84650K .......... .......... .......... .......... .......... 91% 259M 0s 2024-09-12T00:25:33.687 INFO:teuthology.orchestra.run.smithi067.stderr: 84700K .......... .......... .......... .......... .......... 91% 343M 0s 2024-09-12T00:25:33.687 INFO:teuthology.orchestra.run.smithi067.stderr: 84750K .......... .......... .......... .......... .......... 91% 270M 0s 2024-09-12T00:25:33.687 INFO:teuthology.orchestra.run.smithi067.stderr: 84800K .......... .......... .......... .......... .......... 91% 302M 0s 2024-09-12T00:25:33.687 INFO:teuthology.orchestra.run.smithi067.stderr: 84850K .......... .......... .......... .......... .......... 91% 317M 0s 2024-09-12T00:25:33.687 INFO:teuthology.orchestra.run.smithi067.stderr: 84900K .......... .......... .......... .......... .......... 91% 301M 0s 2024-09-12T00:25:33.688 INFO:teuthology.orchestra.run.smithi067.stderr: 84950K .......... .......... .......... .......... .......... 91% 318M 0s 2024-09-12T00:25:33.688 INFO:teuthology.orchestra.run.smithi067.stderr: 85000K .......... .......... .......... .......... .......... 91% 228M 0s 2024-09-12T00:25:33.688 INFO:teuthology.orchestra.run.smithi067.stderr: 85050K .......... .......... .......... .......... .......... 91% 297M 0s 2024-09-12T00:25:33.688 INFO:teuthology.orchestra.run.smithi067.stderr: 85100K .......... .......... .......... .......... .......... 91% 309M 0s 2024-09-12T00:25:33.688 INFO:teuthology.orchestra.run.smithi067.stderr: 85150K .......... .......... .......... .......... .......... 91% 269M 0s 2024-09-12T00:25:33.688 INFO:teuthology.orchestra.run.smithi067.stderr: 85200K .......... .......... .......... .......... .......... 91% 376M 0s 2024-09-12T00:25:33.688 INFO:teuthology.orchestra.run.smithi067.stderr: 85250K .......... .......... .......... .......... .......... 91% 121M 0s 2024-09-12T00:25:33.688 INFO:teuthology.orchestra.run.smithi067.stderr: 85300K .......... .......... .......... .......... .......... 91% 301M 0s 2024-09-12T00:25:33.688 INFO:teuthology.orchestra.run.smithi067.stderr: 85350K .......... .......... .......... .......... .......... 91% 277M 0s 2024-09-12T00:25:33.688 INFO:teuthology.orchestra.run.smithi067.stderr: 85400K .......... .......... .......... .......... .......... 91% 334M 0s 2024-09-12T00:25:33.688 INFO:teuthology.orchestra.run.smithi067.stderr: 85450K .......... .......... .......... .......... .......... 92% 331M 0s 2024-09-12T00:25:33.688 INFO:teuthology.orchestra.run.smithi067.stderr: 85500K .......... .......... .......... .......... .......... 92% 211M 0s 2024-09-12T00:25:33.688 INFO:teuthology.orchestra.run.smithi067.stderr: 85550K .......... .......... .......... .......... .......... 92% 280M 0s 2024-09-12T00:25:33.688 INFO:teuthology.orchestra.run.smithi067.stderr: 85600K .......... .......... .......... .......... .......... 92% 364M 0s 2024-09-12T00:25:33.689 INFO:teuthology.orchestra.run.smithi067.stderr: 85650K .......... .......... .......... .......... .......... 92% 374M 0s 2024-09-12T00:25:33.689 INFO:teuthology.orchestra.run.smithi067.stderr: 85700K .......... .......... .......... .......... .......... 92% 197M 0s 2024-09-12T00:25:33.689 INFO:teuthology.orchestra.run.smithi067.stderr: 85750K .......... .......... .......... .......... .......... 92% 224M 0s 2024-09-12T00:25:33.689 INFO:teuthology.orchestra.run.smithi067.stderr: 85800K .......... .......... .......... .......... .......... 92% 123M 0s 2024-09-12T00:25:33.689 INFO:teuthology.orchestra.run.smithi067.stderr: 85850K .......... .......... .......... .......... .......... 92% 320M 0s 2024-09-12T00:25:33.689 INFO:teuthology.orchestra.run.smithi067.stderr: 85900K .......... .......... .......... .......... .......... 92% 352M 0s 2024-09-12T00:25:33.689 INFO:teuthology.orchestra.run.smithi067.stderr: 85950K .......... .......... .......... .......... .......... 92% 283M 0s 2024-09-12T00:25:33.689 INFO:teuthology.orchestra.run.smithi067.stderr: 86000K .......... .......... .......... .......... .......... 92% 177M 0s 2024-09-12T00:25:33.689 INFO:teuthology.orchestra.run.smithi067.stderr: 86050K .......... .......... .......... .......... .......... 92% 275M 0s 2024-09-12T00:25:33.689 INFO:teuthology.orchestra.run.smithi067.stderr: 86100K .......... .......... .......... .......... .......... 92% 292M 0s 2024-09-12T00:25:33.689 INFO:teuthology.orchestra.run.smithi067.stderr: 86150K .......... .......... .......... .......... .......... 92% 301M 0s 2024-09-12T00:25:33.689 INFO:teuthology.orchestra.run.smithi067.stderr: 86200K .......... .......... .......... .......... .......... 92% 214M 0s 2024-09-12T00:25:33.689 INFO:teuthology.orchestra.run.smithi067.stderr: 86250K .......... .......... .......... .......... .......... 92% 276M 0s 2024-09-12T00:25:33.689 INFO:teuthology.orchestra.run.smithi067.stderr: 86300K .......... .......... .......... .......... .......... 92% 318M 0s 2024-09-12T00:25:33.690 INFO:teuthology.orchestra.run.smithi067.stderr: 86350K .......... .......... .......... .......... .......... 93% 273M 0s 2024-09-12T00:25:33.690 INFO:teuthology.orchestra.run.smithi067.stderr: 86400K .......... .......... .......... .......... .......... 93% 338M 0s 2024-09-12T00:25:33.690 INFO:teuthology.orchestra.run.smithi067.stderr: 86450K .......... .......... .......... .......... .......... 93% 356M 0s 2024-09-12T00:25:33.690 INFO:teuthology.orchestra.run.smithi067.stderr: 86500K .......... .......... .......... .......... .......... 93% 304M 0s 2024-09-12T00:25:33.690 INFO:teuthology.orchestra.run.smithi067.stderr: 86550K .......... .......... .......... .......... .......... 93% 299M 0s 2024-09-12T00:25:33.690 INFO:teuthology.orchestra.run.smithi067.stderr: 86600K .......... .......... .......... .......... .......... 93% 331M 0s 2024-09-12T00:25:33.690 INFO:teuthology.orchestra.run.smithi067.stderr: 86650K .......... .......... .......... .......... .......... 93% 387M 0s 2024-09-12T00:25:33.690 INFO:teuthology.orchestra.run.smithi067.stderr: 86700K .......... .......... .......... .......... .......... 93% 334M 0s 2024-09-12T00:25:33.690 INFO:teuthology.orchestra.run.smithi067.stderr: 86750K .......... .......... .......... .......... .......... 93% 172M 0s 2024-09-12T00:25:33.690 INFO:teuthology.orchestra.run.smithi067.stderr: 86800K .......... .......... .......... .......... .......... 93% 347M 0s 2024-09-12T00:25:33.690 INFO:teuthology.orchestra.run.smithi067.stderr: 86850K .......... .......... .......... .......... .......... 93% 76.4M 0s 2024-09-12T00:25:33.690 INFO:teuthology.orchestra.run.smithi067.stderr: 86900K .......... .......... .......... .......... .......... 93% 391M 0s 2024-09-12T00:25:33.690 INFO:teuthology.orchestra.run.smithi067.stderr: 86950K .......... .......... .......... .......... .......... 93% 319M 0s 2024-09-12T00:25:33.690 INFO:teuthology.orchestra.run.smithi067.stderr: 87000K .......... .......... .......... .......... .......... 93% 336M 0s 2024-09-12T00:25:33.690 INFO:teuthology.orchestra.run.smithi067.stderr: 87050K .......... .......... .......... .......... .......... 93% 330M 0s 2024-09-12T00:25:33.691 INFO:teuthology.orchestra.run.smithi067.stderr: 87100K .......... .......... .......... .......... .......... 93% 345M 0s 2024-09-12T00:25:33.691 INFO:teuthology.orchestra.run.smithi067.stderr: 87150K .......... .......... .......... .......... .......... 93% 318M 0s 2024-09-12T00:25:33.691 INFO:teuthology.orchestra.run.smithi067.stderr: 87200K .......... .......... .......... .......... .......... 93% 99.8M 0s 2024-09-12T00:25:33.691 INFO:teuthology.orchestra.run.smithi067.stderr: 87250K .......... .......... .......... .......... .......... 93% 296M 0s 2024-09-12T00:25:33.691 INFO:teuthology.orchestra.run.smithi067.stderr: 87300K .......... .......... .......... .......... .......... 94% 367M 0s 2024-09-12T00:25:33.691 INFO:teuthology.orchestra.run.smithi067.stderr: 87350K .......... .......... .......... .......... .......... 94% 101M 0s 2024-09-12T00:25:33.691 INFO:teuthology.orchestra.run.smithi067.stderr: 87400K .......... .......... .......... .......... .......... 94% 301M 0s 2024-09-12T00:25:33.691 INFO:teuthology.orchestra.run.smithi067.stderr: 87450K .......... .......... .......... .......... .......... 94% 350M 0s 2024-09-12T00:25:33.691 INFO:teuthology.orchestra.run.smithi067.stderr: 87500K .......... .......... .......... .......... .......... 94% 102M 0s 2024-09-12T00:25:33.691 INFO:teuthology.orchestra.run.smithi067.stderr: 87550K .......... .......... .......... .......... .......... 94% 264M 0s 2024-09-12T00:25:33.691 INFO:teuthology.orchestra.run.smithi067.stderr: 87600K .......... .......... .......... .......... .......... 94% 383M 0s 2024-09-12T00:25:33.691 INFO:teuthology.orchestra.run.smithi067.stderr: 87650K .......... .......... .......... .......... .......... 94% 133M 0s 2024-09-12T00:25:33.691 INFO:teuthology.orchestra.run.smithi067.stderr: 87700K .......... .......... .......... .......... .......... 94% 330M 0s 2024-09-12T00:25:33.691 INFO:teuthology.orchestra.run.smithi067.stderr: 87750K .......... .......... .......... .......... .......... 94% 122M 0s 2024-09-12T00:25:33.692 INFO:teuthology.orchestra.run.smithi067.stderr: 87800K .......... .......... .......... .......... .......... 94% 204M 0s 2024-09-12T00:25:33.692 INFO:teuthology.orchestra.run.smithi067.stderr: 87850K .......... .......... .......... .......... .......... 94% 287M 0s 2024-09-12T00:25:33.692 INFO:teuthology.orchestra.run.smithi067.stderr: 87900K .......... .......... .......... .......... .......... 94% 307M 0s 2024-09-12T00:25:33.692 INFO:teuthology.orchestra.run.smithi067.stderr: 87950K .......... .......... .......... .......... .......... 94% 273M 0s 2024-09-12T00:25:33.692 INFO:teuthology.orchestra.run.smithi067.stderr: 88000K .......... .......... .......... .......... .......... 94% 347M 0s 2024-09-12T00:25:33.692 INFO:teuthology.orchestra.run.smithi067.stderr: 88050K .......... .......... .......... .......... .......... 94% 208M 0s 2024-09-12T00:25:33.692 INFO:teuthology.orchestra.run.smithi067.stderr: 88100K .......... .......... .......... .......... .......... 94% 321M 0s 2024-09-12T00:25:33.692 INFO:teuthology.orchestra.run.smithi067.stderr: 88150K .......... .......... .......... .......... .......... 94% 321M 0s 2024-09-12T00:25:33.692 INFO:teuthology.orchestra.run.smithi067.stderr: 88200K .......... .......... .......... .......... .......... 94% 353M 0s 2024-09-12T00:25:33.692 INFO:teuthology.orchestra.run.smithi067.stderr: 88250K .......... .......... .......... .......... .......... 95% 111M 0s 2024-09-12T00:25:33.692 INFO:teuthology.orchestra.run.smithi067.stderr: 88300K .......... .......... .......... .......... .......... 95% 317M 0s 2024-09-12T00:25:33.692 INFO:teuthology.orchestra.run.smithi067.stderr: 88350K .......... .......... .......... .......... .......... 95% 281M 0s 2024-09-12T00:25:33.692 INFO:teuthology.orchestra.run.smithi067.stderr: 88400K .......... .......... .......... .......... .......... 95% 330M 0s 2024-09-12T00:25:33.692 INFO:teuthology.orchestra.run.smithi067.stderr: 88450K .......... .......... .......... .......... .......... 95% 343M 0s 2024-09-12T00:25:33.693 INFO:teuthology.orchestra.run.smithi067.stderr: 88500K .......... .......... .......... .......... .......... 95% 333M 0s 2024-09-12T00:25:33.693 INFO:teuthology.orchestra.run.smithi067.stderr: 88550K .......... .......... .......... .......... .......... 95% 299M 0s 2024-09-12T00:25:33.693 INFO:teuthology.orchestra.run.smithi067.stderr: 88600K .......... .......... .......... .......... .......... 95% 359M 0s 2024-09-12T00:25:33.693 INFO:teuthology.orchestra.run.smithi067.stderr: 88650K .......... .......... .......... .......... .......... 95% 334M 0s 2024-09-12T00:25:33.693 INFO:teuthology.orchestra.run.smithi067.stderr: 88700K .......... .......... .......... .......... .......... 95% 356M 0s 2024-09-12T00:25:33.693 INFO:teuthology.orchestra.run.smithi067.stderr: 88750K .......... .......... .......... .......... .......... 95% 136M 0s 2024-09-12T00:25:33.693 INFO:teuthology.orchestra.run.smithi067.stderr: 88800K .......... .......... .......... .......... .......... 95% 337M 0s 2024-09-12T00:25:33.693 INFO:teuthology.orchestra.run.smithi067.stderr: 88850K .......... .......... .......... .......... .......... 95% 361M 0s 2024-09-12T00:25:33.693 INFO:teuthology.orchestra.run.smithi067.stderr: 88900K .......... .......... .......... .......... .......... 95% 253M 0s 2024-09-12T00:25:33.693 INFO:teuthology.orchestra.run.smithi067.stderr: 88950K .......... .......... .......... .......... .......... 95% 229M 0s 2024-09-12T00:25:33.693 INFO:teuthology.orchestra.run.smithi067.stderr: 89000K .......... .......... .......... .......... .......... 95% 84.2M 0s 2024-09-12T00:25:33.693 INFO:teuthology.orchestra.run.smithi067.stderr: 89050K .......... .......... .......... .......... .......... 95% 356M 0s 2024-09-12T00:25:33.693 INFO:teuthology.orchestra.run.smithi067.stderr: 89100K .......... .......... .......... .......... .......... 95% 370M 0s 2024-09-12T00:25:33.693 INFO:teuthology.orchestra.run.smithi067.stderr: 89150K .......... .......... .......... .......... .......... 96% 258M 0s 2024-09-12T00:25:33.694 INFO:teuthology.orchestra.run.smithi067.stderr: 89200K .......... .......... .......... .......... .......... 96% 356M 0s 2024-09-12T00:25:33.694 INFO:teuthology.orchestra.run.smithi067.stderr: 89250K .......... .......... .......... .......... .......... 96% 165M 0s 2024-09-12T00:25:33.694 INFO:teuthology.orchestra.run.smithi067.stderr: 89300K .......... .......... .......... .......... .......... 96% 98.9M 0s 2024-09-12T00:25:33.694 INFO:teuthology.orchestra.run.smithi067.stderr: 89350K .......... .......... .......... .......... .......... 96% 301M 0s 2024-09-12T00:25:33.694 INFO:teuthology.orchestra.run.smithi067.stderr: 89400K .......... .......... .......... .......... .......... 96% 316M 0s 2024-09-12T00:25:33.694 INFO:teuthology.orchestra.run.smithi067.stderr: 89450K .......... .......... .......... .......... .......... 96% 302M 0s 2024-09-12T00:25:33.694 INFO:teuthology.orchestra.run.smithi067.stderr: 89500K .......... .......... .......... .......... .......... 96% 335M 0s 2024-09-12T00:25:33.694 INFO:teuthology.orchestra.run.smithi067.stderr: 89550K .......... .......... .......... .......... .......... 96% 263M 0s 2024-09-12T00:25:33.694 INFO:teuthology.orchestra.run.smithi067.stderr: 89600K .......... .......... .......... .......... .......... 96% 326M 0s 2024-09-12T00:25:33.694 INFO:teuthology.orchestra.run.smithi067.stderr: 89650K .......... .......... .......... .......... .......... 96% 371M 0s 2024-09-12T00:25:33.694 INFO:teuthology.orchestra.run.smithi067.stderr: 89700K .......... .......... .......... .......... .......... 96% 384M 0s 2024-09-12T00:25:33.694 INFO:teuthology.orchestra.run.smithi067.stderr: 89750K .......... .......... .......... .......... .......... 96% 343M 0s 2024-09-12T00:25:33.694 INFO:teuthology.orchestra.run.smithi067.stderr: 89800K .......... .......... .......... .......... .......... 96% 340M 0s 2024-09-12T00:25:33.694 INFO:teuthology.orchestra.run.smithi067.stderr: 89850K .......... .......... .......... .......... .......... 96% 358M 0s 2024-09-12T00:25:33.694 INFO:teuthology.orchestra.run.smithi067.stderr: 89900K .......... .......... .......... .......... .......... 96% 316M 0s 2024-09-12T00:25:33.695 INFO:teuthology.orchestra.run.smithi067.stderr: 89950K .......... .......... .......... .......... .......... 96% 283M 0s 2024-09-12T00:25:33.695 INFO:teuthology.orchestra.run.smithi067.stderr: 90000K .......... .......... .......... .......... .......... 96% 348M 0s 2024-09-12T00:25:33.695 INFO:teuthology.orchestra.run.smithi067.stderr: 90050K .......... .......... .......... .......... .......... 96% 341M 0s 2024-09-12T00:25:33.695 INFO:teuthology.orchestra.run.smithi067.stderr: 90100K .......... .......... .......... .......... .......... 97% 304M 0s 2024-09-12T00:25:33.695 INFO:teuthology.orchestra.run.smithi067.stderr: 90150K .......... .......... .......... .......... .......... 97% 331M 0s 2024-09-12T00:25:33.695 INFO:teuthology.orchestra.run.smithi067.stderr: 90200K .......... .......... .......... .......... .......... 97% 118M 0s 2024-09-12T00:25:33.695 INFO:teuthology.orchestra.run.smithi067.stderr: 90250K .......... .......... .......... .......... .......... 97% 212M 0s 2024-09-12T00:25:33.695 INFO:teuthology.orchestra.run.smithi067.stderr: 90300K .......... .......... .......... .......... .......... 97% 358M 0s 2024-09-12T00:25:33.695 INFO:teuthology.orchestra.run.smithi067.stderr: 90350K .......... .......... .......... .......... .......... 97% 134M 0s 2024-09-12T00:25:33.695 INFO:teuthology.orchestra.run.smithi067.stderr: 90400K .......... .......... .......... .......... .......... 97% 318M 0s 2024-09-12T00:25:33.695 INFO:teuthology.orchestra.run.smithi067.stderr: 90450K .......... .......... .......... .......... .......... 97% 81.7M 0s 2024-09-12T00:25:33.695 INFO:teuthology.orchestra.run.smithi067.stderr: 90500K .......... .......... .......... .......... .......... 97% 278M 0s 2024-09-12T00:25:33.695 INFO:teuthology.orchestra.run.smithi067.stderr: 90550K .......... .......... .......... .......... .......... 97% 311M 0s 2024-09-12T00:25:33.695 INFO:teuthology.orchestra.run.smithi067.stderr: 90600K .......... .......... .......... .......... .......... 97% 385M 0s 2024-09-12T00:25:33.696 INFO:teuthology.orchestra.run.smithi067.stderr: 90650K .......... .......... .......... .......... .......... 97% 91.1M 0s 2024-09-12T00:25:33.696 INFO:teuthology.orchestra.run.smithi067.stderr: 90700K .......... .......... .......... .......... .......... 97% 293M 0s 2024-09-12T00:25:33.696 INFO:teuthology.orchestra.run.smithi067.stderr: 90750K .......... .......... .......... .......... .......... 97% 303M 0s 2024-09-12T00:25:33.696 INFO:teuthology.orchestra.run.smithi067.stderr: 90800K .......... .......... .......... .......... .......... 97% 319M 0s 2024-09-12T00:25:33.696 INFO:teuthology.orchestra.run.smithi067.stderr: 90850K .......... .......... .......... .......... .......... 97% 277M 0s 2024-09-12T00:25:33.696 INFO:teuthology.orchestra.run.smithi067.stderr: 90900K .......... .......... .......... .......... .......... 97% 329M 0s 2024-09-12T00:25:33.696 INFO:teuthology.orchestra.run.smithi067.stderr: 90950K .......... .......... .......... .......... .......... 97% 181M 0s 2024-09-12T00:25:33.696 INFO:teuthology.orchestra.run.smithi067.stderr: 91000K .......... .......... .......... .......... .......... 98% 330M 0s 2024-09-12T00:25:33.696 INFO:teuthology.orchestra.run.smithi067.stderr: 91050K .......... .......... .......... .......... .......... 98% 211M 0s 2024-09-12T00:25:33.696 INFO:teuthology.orchestra.run.smithi067.stderr: 91100K .......... .......... .......... .......... .......... 98% 315M 0s 2024-09-12T00:25:33.696 INFO:teuthology.orchestra.run.smithi067.stderr: 91150K .......... .......... .......... .......... .......... 98% 201M 0s 2024-09-12T00:25:33.696 INFO:teuthology.orchestra.run.smithi067.stderr: 91200K .......... .......... .......... .......... .......... 98% 200M 0s 2024-09-12T00:25:33.696 INFO:teuthology.orchestra.run.smithi067.stderr: 91250K .......... .......... .......... .......... .......... 98% 260M 0s 2024-09-12T00:25:33.696 INFO:teuthology.orchestra.run.smithi067.stderr: 91300K .......... .......... .......... .......... .......... 98% 353M 0s 2024-09-12T00:25:33.697 INFO:teuthology.orchestra.run.smithi067.stderr: 91350K .......... .......... .......... .......... .......... 98% 113M 0s 2024-09-12T00:25:33.697 INFO:teuthology.orchestra.run.smithi067.stderr: 91400K .......... .......... .......... .......... .......... 98% 301M 0s 2024-09-12T00:25:33.697 INFO:teuthology.orchestra.run.smithi067.stderr: 91450K .......... .......... .......... .......... .......... 98% 311M 0s 2024-09-12T00:25:33.697 INFO:teuthology.orchestra.run.smithi067.stderr: 91500K .......... .......... .......... .......... .......... 98% 335M 0s 2024-09-12T00:25:33.697 INFO:teuthology.orchestra.run.smithi067.stderr: 91550K .......... .......... .......... .......... .......... 98% 298M 0s 2024-09-12T00:25:33.697 INFO:teuthology.orchestra.run.smithi067.stderr: 91600K .......... .......... .......... .......... .......... 98% 332M 0s 2024-09-12T00:25:33.697 INFO:teuthology.orchestra.run.smithi067.stderr: 91650K .......... .......... .......... .......... .......... 98% 355M 0s 2024-09-12T00:25:33.697 INFO:teuthology.orchestra.run.smithi067.stderr: 91700K .......... .......... .......... .......... .......... 98% 367M 0s 2024-09-12T00:25:33.697 INFO:teuthology.orchestra.run.smithi067.stderr: 91750K .......... .......... .......... .......... .......... 98% 328M 0s 2024-09-12T00:25:33.697 INFO:teuthology.orchestra.run.smithi067.stderr: 91800K .......... .......... .......... .......... .......... 98% 336M 0s 2024-09-12T00:25:33.697 INFO:teuthology.orchestra.run.smithi067.stderr: 91850K .......... .......... .......... .......... .......... 98% 176M 0s 2024-09-12T00:25:33.697 INFO:teuthology.orchestra.run.smithi067.stderr: 91900K .......... .......... .......... .......... .......... 98% 250M 0s 2024-09-12T00:25:33.697 INFO:teuthology.orchestra.run.smithi067.stderr: 91950K .......... .......... .......... .......... .......... 99% 270M 0s 2024-09-12T00:25:33.697 INFO:teuthology.orchestra.run.smithi067.stderr: 92000K .......... .......... .......... .......... .......... 99% 349M 0s 2024-09-12T00:25:33.698 INFO:teuthology.orchestra.run.smithi067.stderr: 92050K .......... .......... .......... .......... .......... 99% 289M 0s 2024-09-12T00:25:33.698 INFO:teuthology.orchestra.run.smithi067.stderr: 92100K .......... .......... .......... .......... .......... 99% 130M 0s 2024-09-12T00:25:33.698 INFO:teuthology.orchestra.run.smithi067.stderr: 92150K .......... .......... .......... .......... .......... 99% 305M 0s 2024-09-12T00:25:33.698 INFO:teuthology.orchestra.run.smithi067.stderr: 92200K .......... .......... .......... .......... .......... 99% 302M 0s 2024-09-12T00:25:33.698 INFO:teuthology.orchestra.run.smithi067.stderr: 92250K .......... .......... .......... .......... .......... 99% 192M 0s 2024-09-12T00:25:33.698 INFO:teuthology.orchestra.run.smithi067.stderr: 92300K .......... .......... .......... .......... .......... 99% 229M 0s 2024-09-12T00:25:33.698 INFO:teuthology.orchestra.run.smithi067.stderr: 92350K .......... .......... .......... .......... .......... 99% 146M 0s 2024-09-12T00:25:33.698 INFO:teuthology.orchestra.run.smithi067.stderr: 92400K .......... .......... .......... .......... .......... 99% 337M 0s 2024-09-12T00:25:33.698 INFO:teuthology.orchestra.run.smithi067.stderr: 92450K .......... .......... .......... .......... .......... 99% 114M 0s 2024-09-12T00:25:33.698 INFO:teuthology.orchestra.run.smithi067.stderr: 92500K .......... .......... .......... .......... .......... 99% 336M 0s 2024-09-12T00:25:33.698 INFO:teuthology.orchestra.run.smithi067.stderr: 92550K .......... .......... .......... .......... .......... 99% 306M 0s 2024-09-12T00:25:33.698 INFO:teuthology.orchestra.run.smithi067.stderr: 92600K .......... .......... .......... .......... .......... 99% 260M 0s 2024-09-12T00:25:33.698 INFO:teuthology.orchestra.run.smithi067.stderr: 92650K .......... .......... .......... .......... .......... 99% 207M 0s 2024-09-12T00:25:33.698 INFO:teuthology.orchestra.run.smithi067.stderr: 92700K .......... .......... .......... .......... .......... 99% 328M 0s 2024-09-12T00:25:33.698 INFO:teuthology.orchestra.run.smithi067.stderr: 92750K .......... .......... .......... .......... .......... 99% 164M 0s 2024-09-12T00:25:33.699 INFO:teuthology.orchestra.run.smithi067.stderr: 92800K .......... .......... .......... .......... .......... 99% 338M 0s 2024-09-12T00:25:33.699 INFO:teuthology.orchestra.run.smithi067.stderr: 92850K .......... .......... .......... .......... .......... 99% 358M 0s 2024-09-12T00:25:33.699 INFO:teuthology.orchestra.run.smithi067.stderr: 92900K 100% 134G=0.5s 2024-09-12T00:25:33.699 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T00:25:33.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12 00:25:32 (188 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-12T00:25:33.699 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T00:25:33.737 INFO:teuthology.orchestra.run.smithi067.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T00:25:33.737 INFO:teuthology.orchestra.run.smithi067.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T00:25:33.737 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T00:25:33.737 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T00:25:33.737 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T00:25:33.737 INFO:teuthology.orchestra.run.smithi067.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T00:25:33.737 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T00:25:33.737 INFO:teuthology.orchestra.run.smithi067.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T00:25:33.737 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T00:25:33.737 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T00:25:33.737 INFO:teuthology.orchestra.run.smithi067.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T00:25:33.737 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T00:25:33.738 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T00:25:33.738 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T00:25:33.738 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T00:25:33.738 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T00:25:33.738 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T00:25:33.738 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T00:25:33.738 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T00:25:33.738 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T00:25:33.738 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T00:25:33.738 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T00:25:33.738 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T00:25:33.738 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T00:25:33.738 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T00:25:33.738 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T00:25:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T00:25:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T00:25:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T00:25:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T00:25:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T00:25:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T00:25:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T00:25:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T00:25:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T00:25:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T00:25:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T00:25:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T00:25:33.739 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T00:25:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T00:25:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T00:25:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T00:25:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T00:25:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T00:25:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T00:25:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T00:25:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T00:25:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T00:25:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T00:25:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:25:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T00:25:33.740 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T00:25:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T00:25:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T00:25:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T00:25:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T00:25:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T00:25:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T00:25:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T00:25:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T00:25:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T00:25:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T00:25:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T00:25:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T00:25:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T00:25:33.741 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T00:25:33.742 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T00:25:33.742 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T00:25:33.742 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T00:25:33.742 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T00:25:33.742 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T00:25:33.742 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T00:25:33.742 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T00:25:33.742 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T00:25:33.742 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T00:25:33.742 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T00:25:33.742 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T00:25:33.742 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T00:25:33.742 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T00:25:33.743 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T00:25:33.743 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T00:25:33.743 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T00:25:33.743 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T00:25:33.743 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T00:25:33.743 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T00:25:33.743 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T00:25:33.743 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T00:25:33.743 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T00:25:33.743 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T00:25:33.743 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T00:25:33.743 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T00:25:33.743 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T00:25:33.743 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T00:25:33.744 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T00:25:33.744 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T00:25:33.744 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T00:25:33.744 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T00:25:33.744 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T00:25:33.744 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T00:25:33.744 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T00:25:33.744 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T00:25:33.744 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T00:25:33.744 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T00:25:33.744 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T00:25:33.744 INFO:teuthology.orchestra.run.smithi067.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T00:25:33.744 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T00:25:33.744 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T00:25:33.745 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T00:25:33.745 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T00:25:33.745 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T00:25:33.745 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T00:25:33.748 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T00:25:33.748 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T00:25:33.748 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T00:25:33.749 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T00:25:33.749 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T00:25:33.749 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T00:25:33.749 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T00:25:33.749 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T00:25:33.749 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T00:25:33.749 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T00:25:33.749 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T00:25:33.749 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T00:25:33.749 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T00:25:33.749 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T00:25:33.749 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T00:25:33.749 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T00:25:33.749 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T00:25:33.750 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T00:25:33.750 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T00:25:33.750 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T00:25:33.750 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T00:25:33.750 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T00:25:33.750 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T00:25:33.750 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T00:25:33.750 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T00:25:33.750 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T00:25:33.750 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T00:25:33.750 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T00:25:33.750 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T00:25:33.750 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T00:25:33.751 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T00:25:33.751 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T00:25:33.751 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T00:25:33.751 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T00:25:33.751 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T00:25:33.751 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T00:25:33.751 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T00:25:33.751 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T00:25:33.751 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T00:25:33.751 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T00:25:33.751 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T00:25:33.751 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T00:25:33.751 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T00:25:33.751 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T00:25:33.752 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T00:25:33.752 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T00:25:33.752 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T00:25:33.752 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T00:25:33.752 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T00:25:33.752 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T00:25:33.752 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T00:25:33.752 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T00:25:33.752 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T00:25:33.752 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T00:25:33.752 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T00:25:33.752 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T00:25:33.752 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T00:25:33.753 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T00:25:33.753 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T00:25:33.753 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T00:25:33.753 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T00:25:33.753 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T00:25:33.753 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T00:25:33.753 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T00:25:33.753 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T00:25:33.753 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T00:25:33.753 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T00:25:33.753 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T00:25:33.753 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T00:25:33.753 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T00:25:33.753 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T00:25:33.754 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T00:25:33.754 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T00:25:33.754 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T00:25:33.754 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T00:25:33.754 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T00:25:33.754 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T00:25:33.754 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T00:25:33.754 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T00:25:33.754 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T00:25:33.754 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T00:25:33.754 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T00:25:33.754 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T00:25:33.754 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T00:25:33.754 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T00:25:33.755 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T00:25:33.755 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T00:25:33.755 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T00:25:33.755 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T00:25:33.755 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T00:25:33.755 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T00:25:33.755 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T00:25:33.755 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T00:25:33.755 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T00:25:33.755 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T00:25:33.755 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T00:25:33.755 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T00:25:33.755 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T00:25:33.755 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T00:25:33.756 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T00:25:33.756 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T00:25:33.756 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T00:25:33.756 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T00:25:33.756 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T00:25:33.756 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T00:25:33.756 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T00:25:33.756 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T00:25:33.756 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T00:25:33.756 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T00:25:33.756 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T00:25:33.756 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T00:25:33.756 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T00:25:33.757 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T00:25:33.757 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T00:25:33.757 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T00:25:33.757 INFO:teuthology.orchestra.run.smithi067.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T00:25:33.757 INFO:teuthology.orchestra.run.smithi067.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-12T00:25:33.757 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:25:33.757 INFO:teuthology.orchestra.run.smithi067.stdout:Welcome to Gradle 6.0.1! 2024-09-12T00:25:33.757 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:25:33.757 INFO:teuthology.orchestra.run.smithi067.stdout:Here are the highlights of this release: 2024-09-12T00:25:33.757 INFO:teuthology.orchestra.run.smithi067.stdout: - Substantial improvements in dependency management, including 2024-09-12T00:25:33.757 INFO:teuthology.orchestra.run.smithi067.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T00:25:33.757 INFO:teuthology.orchestra.run.smithi067.stdout: - Advanced control of transitive versions 2024-09-12T00:25:33.757 INFO:teuthology.orchestra.run.smithi067.stdout: - Support for optional features and dependencies 2024-09-12T00:25:33.757 INFO:teuthology.orchestra.run.smithi067.stdout: - Rules to tweak published metadata 2024-09-12T00:25:33.758 INFO:teuthology.orchestra.run.smithi067.stdout: - Support for Java 13 2024-09-12T00:25:33.758 INFO:teuthology.orchestra.run.smithi067.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T00:25:33.758 INFO:teuthology.orchestra.run.smithi067.stdout: - New Zinc compiler for Scala 2024-09-12T00:25:33.758 INFO:teuthology.orchestra.run.smithi067.stdout: - VS2019 support 2024-09-12T00:25:33.758 INFO:teuthology.orchestra.run.smithi067.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T00:25:33.758 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:25:33.758 INFO:teuthology.orchestra.run.smithi067.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T00:25:33.758 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:25:33.758 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:25:33.758 INFO:teuthology.orchestra.run.smithi067.stdout:------------------------------------------------------------ 2024-09-12T00:25:33.758 INFO:teuthology.orchestra.run.smithi067.stdout:Gradle 6.0.1 2024-09-12T00:25:33.758 INFO:teuthology.orchestra.run.smithi067.stdout:------------------------------------------------------------ 2024-09-12T00:25:33.758 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:25:33.758 INFO:teuthology.orchestra.run.smithi067.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T00:25:33.759 INFO:teuthology.orchestra.run.smithi067.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T00:25:33.759 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:25:33.759 INFO:teuthology.orchestra.run.smithi067.stdout:Kotlin: 1.3.50 2024-09-12T00:25:33.759 INFO:teuthology.orchestra.run.smithi067.stdout:Groovy: 2.5.8 2024-09-12T00:25:33.759 INFO:teuthology.orchestra.run.smithi067.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T00:25:33.759 INFO:teuthology.orchestra.run.smithi067.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-12T00:25:33.759 INFO:teuthology.orchestra.run.smithi067.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-12T00:25:33.759 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:25:33.759 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T00:25:33.760 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:25:33.760 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T00:25:33.760 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:25:33.760 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T00:25:33.760 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T00:25:34.128 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T00:25:34.128 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T00:25:34.129 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'RCXWVEBUZPCUMMSAUFDI', 'access_secret': 'MFi+RPXQNsQZ24eoP4760fvPXTe7ZP8T20L21FfBqCR62o++P3905A==', 'region': 'mexico', 'endpoint': 'smithi067.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi067.front.sepia.ceph.com'} 2024-09-12T00:25:34.129 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T00:25:34.129 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'RCXWVEBUZPCUMMSAUFDI', '--secret', 'MFi+RPXQNsQZ24eoP4760fvPXTe7ZP8T20L21FfBqCR62o++P3905A==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T00:25:34.129 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key RCXWVEBUZPCUMMSAUFDI --secret MFi+RPXQNsQZ24eoP4760fvPXTe7ZP8T20L21FfBqCR62o++P3905A== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T00:25:34.197 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:34.197 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:34.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:34.235+0000 7ff449f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:34.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:34.237+0000 7ff449f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:34.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:34.237+0000 7ff449f2c800 20 realm 2024-09-12T00:25:34.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:34.237+0000 7ff449f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:34.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:34.237+0000 7ff449f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:34.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:34.237+0000 7ff449f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:34.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:34.237+0000 7ff449f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:34.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:34.237+0000 7ff449f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:34.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:34.237+0000 7ff449f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:34.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:34.238+0000 7ff449f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:34.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:34.238+0000 7ff449f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:34.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:34.239+0000 7ff449f2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:34.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:34.239+0000 7ff449f2c800 20 searching for the correct realm 2024-09-12T00:25:34.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:34.242+0000 7ff445344640 0 -- 172.21.15.67:0/3579639701 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7ff4300adc00 msgr2=0x7ff4300e26b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:34.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:34.650+0000 7ff445b45640 0 -- 172.21.15.67:0/3579639701 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7ff440018070 msgr2=0x7ff440018450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:35.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.059+0000 7ff449f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:35.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.059+0000 7ff449f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:35.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.059+0000 7ff449f2c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:35.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.059+0000 7ff449f2c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:35.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.059+0000 7ff449f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:35.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.059+0000 7ff449f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:35.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.059+0000 7ff449f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.059+0000 7ff449f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:35.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.059+0000 7ff449f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.059+0000 7ff449f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:35.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.059+0000 7ff449f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.060+0000 7ff449f2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:35.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.060+0000 7ff449f2c800 20 zone default found 2024-09-12T00:25:35.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.060+0000 7ff449f2c800 4 Realm: () 2024-09-12T00:25:35.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.060+0000 7ff449f2c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:35.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.060+0000 7ff449f2c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:35.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.060+0000 7ff449f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:35.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.060+0000 7ff449f2c800 20 zonegroup default 2024-09-12T00:25:35.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.060+0000 7ff449f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.060+0000 7ff449f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:35.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.060+0000 7ff449f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.061+0000 7ff449f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:35.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.061+0000 7ff449f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.061+0000 7ff449f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:35.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.061+0000 7ff449f2c800 20 started sync module instance, tier type = 2024-09-12T00:25:35.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.061+0000 7ff449f2c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:35.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.074+0000 7ff449f2c800 20 add_watcher() i=0 2024-09-12T00:25:35.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.074+0000 7ff449f2c800 20 add_watcher() i=1 2024-09-12T00:25:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.074+0000 7ff449f2c800 20 add_watcher() i=2 2024-09-12T00:25:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.074+0000 7ff449f2c800 20 add_watcher() i=3 2024-09-12T00:25:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.074+0000 7ff449f2c800 20 add_watcher() i=4 2024-09-12T00:25:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.074+0000 7ff449f2c800 20 add_watcher() i=5 2024-09-12T00:25:35.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.074+0000 7ff449f2c800 20 add_watcher() i=6 2024-09-12T00:25:35.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.076+0000 7ff449f2c800 20 add_watcher() i=7 2024-09-12T00:25:35.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.076+0000 7ff449f2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:35.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.078+0000 7ff2f7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:35.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.078+0000 7ff449f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:35.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.078+0000 7ff449f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:35.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.078+0000 7ff449f2c800 5 note: GC not initialized 2024-09-12T00:25:35.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.078+0000 7ff2f6ffd640 20 reqs_thread_entry: start 2024-09-12T00:25:35.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.078+0000 7ff449f2c800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:35.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.078+0000 7ff449f2c800 20 Filter name: none 2024-09-12T00:25:35.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.079+0000 7ff2f4ff9640 20 reqs_thread_entry: start 2024-09-12T00:25:35.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.079+0000 7ff449f2c800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T00:25:35.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.079+0000 7ff449f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.079+0000 7ff449f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:35.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.079+0000 7ff449f2c800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T00:25:35.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.079+0000 7ff449f2c800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:25:35.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.079+0000 7ff449f2c800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T00:25:35.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.079+0000 7ff449f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.079+0000 7ff449f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:35.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.079+0000 7ff449f2c800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T00:25:35.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.079+0000 7ff449f2c800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:25:35.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.079+0000 7ff449f2c800 10 cache get: name=default.rgw.meta+users.keys+RCXWVEBUZPCUMMSAUFDI : miss 2024-09-12T00:25:35.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.079+0000 7ff449f2c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.080+0000 7ff449f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:35.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.080+0000 7ff449f2c800 10 cache put: name=default.rgw.meta+users.keys+RCXWVEBUZPCUMMSAUFDI info.flags=0x0 2024-09-12T00:25:35.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.080+0000 7ff449f2c800 10 adding default.rgw.meta+users.keys+RCXWVEBUZPCUMMSAUFDI to cache LRU end 2024-09-12T00:25:35.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.080+0000 7ff449f2c800 10 cache get: name=default.rgw.meta+users.keys+RCXWVEBUZPCUMMSAUFDI : hit (negative entry) 2024-09-12T00:25:35.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.080+0000 7ff449f2c800 10 cache get: name=default.rgw.meta+users.keys+RCXWVEBUZPCUMMSAUFDI : hit (negative entry) 2024-09-12T00:25:35.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.081+0000 7ff449f2c800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:25:35.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.081+0000 7ff449f2c800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:25:35.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.081+0000 7ff449f2c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T00:25:35.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.082+0000 7ff3297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562490 cookie 94358242393104 notifier 8790 bl.length()=670 2024-09-12T00:25:35.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.082+0000 7ff3297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:25:35.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.082+0000 7ff3297fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:25:35.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.084+0000 7ff449f2c800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:25:35.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.084+0000 7ff449f2c800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:25:35.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.084+0000 7ff449f2c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T00:25:35.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.084+0000 7ff328ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562397 cookie 94358242388128 notifier 8790 bl.length()=200 2024-09-12T00:25:35.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.084+0000 7ff328ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:25:35.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.084+0000 7ff328ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:25:35.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.086+0000 7ff449f2c800 10 cache put: name=default.rgw.meta+users.keys+RCXWVEBUZPCUMMSAUFDI info.flags=0x7 2024-09-12T00:25:35.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.086+0000 7ff449f2c800 10 moving default.rgw.meta+users.keys+RCXWVEBUZPCUMMSAUFDI to cache LRU end 2024-09-12T00:25:35.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.086+0000 7ff449f2c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:RCXWVEBUZPCUMMSAUFDI, ofs0, ns] 2024-09-12T00:25:35.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.086+0000 7ff328ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562491 cookie 94358242397040 notifier 8790 bl.length()=189 2024-09-12T00:25:35.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.086+0000 7ff328ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RCXWVEBUZPCUMMSAUFDI info.flags=0x7 2024-09-12T00:25:35.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.086+0000 7ff328ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RCXWVEBUZPCUMMSAUFDI to cache LRU end 2024-09-12T00:25:35.085 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:25:35.085 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "tester.client.0", 2024-09-12T00:25:35.085 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T00:25:35.085 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T00:25:35.086 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T00:25:35.086 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:25:35.086 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T00:25:35.086 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T00:25:35.086 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T00:25:35.086 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "tester.client.0", 2024-09-12T00:25:35.086 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "RCXWVEBUZPCUMMSAUFDI", 2024-09-12T00:25:35.086 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "MFi+RPXQNsQZ24eoP4760fvPXTe7ZP8T20L21FfBqCR62o++P3905A==", 2024-09-12T00:25:35.086 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T00:25:35.086 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:25:35.080790Z" 2024-09-12T00:25:35.086 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T00:25:35.086 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T00:25:35.086 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T00:25:35.086 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T00:25:35.087 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T00:25:35.087 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T00:25:35.087 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T00:25:35.087 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T00:25:35.087 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T00:25:35.087 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:25:35.087 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:25:35.087 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:25:35.087 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:25:35.087 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:25:35.087 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:25:35.087 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T00:25:35.087 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:25:35.088 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:25:35.088 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:25:35.088 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:25:35.088 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:25:35.088 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:25:35.088 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T00:25:35.088 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "rgw", 2024-09-12T00:25:35.088 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T00:25:35.088 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "", 2024-09-12T00:25:35.088 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T00:25:35.088 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:25:35.080776Z", 2024-09-12T00:25:35.088 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T00:25:35.088 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T00:25:35.088 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:25:35.089 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:25:35.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.088+0000 7ff2f7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:35.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.092+0000 7ff449f2c800 20 remove_watcher() i=0 2024-09-12T00:25:35.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.092+0000 7ff449f2c800 2 removed watcher, disabling cache 2024-09-12T00:25:35.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.093+0000 7ff449f2c800 20 remove_watcher() i=1 2024-09-12T00:25:35.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.095+0000 7ff449f2c800 20 remove_watcher() i=2 2024-09-12T00:25:35.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.096+0000 7ff449f2c800 20 remove_watcher() i=3 2024-09-12T00:25:35.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.097+0000 7ff449f2c800 20 remove_watcher() i=4 2024-09-12T00:25:35.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.099+0000 7ff449f2c800 20 remove_watcher() i=5 2024-09-12T00:25:35.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.100+0000 7ff449f2c800 20 remove_watcher() i=6 2024-09-12T00:25:35.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.101+0000 7ff449f2c800 20 remove_watcher() i=7 2024-09-12T00:25:35.113 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:25:35.113 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T00:25:35.149 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T00:25:35.150 DEBUG:teuthology.orchestra.run.smithi067:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T00:25:35.220 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T00:25:35.315 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:35.315 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:35.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.356+0000 7fe1b312c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.358+0000 7fe1b312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:35.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.358+0000 7fe1b312c800 20 realm 2024-09-12T00:25:35.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.358+0000 7fe1b312c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.358+0000 7fe1b312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:35.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.358+0000 7fe1b312c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:35.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.358+0000 7fe1b312c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.358+0000 7fe1b312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:35.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.358+0000 7fe1b312c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.359+0000 7fe1b312c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:35.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.359+0000 7fe1b312c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.360+0000 7fe1b312c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:35.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.360+0000 7fe1b312c800 20 searching for the correct realm 2024-09-12T00:25:35.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.363+0000 7fe1af650640 0 -- 172.21.15.67:0/1370418429 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7fe198080b00 msgr2=0x7fe1980799a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:35.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.367+0000 7fe1a664e640 0 -- 172.21.15.67:0/1370418429 >> [v2:172.21.15.170:6808/2113328631,v1:172.21.15.170:6809/2113328631] conn(0x562be9773b90 msgr2=0x562be9775fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:35.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.568+0000 7fe1b312c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:35.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.568+0000 7fe1b312c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:35.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.568+0000 7fe1b312c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:35.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.568+0000 7fe1b312c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:35.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.568+0000 7fe1b312c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:35.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.568+0000 7fe1b312c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:35.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.568+0000 7fe1b312c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.568+0000 7fe1b312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:35.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.568+0000 7fe1b312c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.568+0000 7fe1b312c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:35.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.568+0000 7fe1b312c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.569+0000 7fe1b312c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:35.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.569+0000 7fe1b312c800 20 zone default found 2024-09-12T00:25:35.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.569+0000 7fe1b312c800 4 Realm: () 2024-09-12T00:25:35.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.569+0000 7fe1b312c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:35.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.569+0000 7fe1b312c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:35.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.569+0000 7fe1b312c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:35.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.569+0000 7fe1b312c800 20 zonegroup default 2024-09-12T00:25:35.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.569+0000 7fe1b312c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.569+0000 7fe1b312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:35.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.569+0000 7fe1b312c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.569+0000 7fe1b312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:35.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.569+0000 7fe1b312c800 20 rados->read ofs=0 len=0 2024-09-12T00:25:35.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.570+0000 7fe1b312c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:35.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.570+0000 7fe1b312c800 20 started sync module instance, tier type = 2024-09-12T00:25:35.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.570+0000 7fe1b312c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:35.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.580+0000 7fe1b312c800 20 add_watcher() i=0 2024-09-12T00:25:35.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.580+0000 7fe1b312c800 20 add_watcher() i=1 2024-09-12T00:25:35.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.580+0000 7fe1b312c800 20 add_watcher() i=2 2024-09-12T00:25:35.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.580+0000 7fe1b312c800 20 add_watcher() i=3 2024-09-12T00:25:35.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.580+0000 7fe1b312c800 20 add_watcher() i=4 2024-09-12T00:25:35.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.580+0000 7fe1b312c800 20 add_watcher() i=5 2024-09-12T00:25:35.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.580+0000 7fe1b312c800 20 add_watcher() i=6 2024-09-12T00:25:35.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.581+0000 7fe1b312c800 20 add_watcher() i=7 2024-09-12T00:25:35.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.581+0000 7fe1b312c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:35.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.583+0000 7fe0657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:35.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.583+0000 7fe1b312c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:35.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.583+0000 7fe1b312c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:35.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.622+0000 7fdfdffff640 20 reqs_thread_entry: start 2024-09-12T00:25:35.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.622+0000 7fe1b312c800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:35.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.622+0000 7fe1b312c800 20 Filter name: none 2024-09-12T00:25:35.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.622+0000 7fdfddffb640 20 reqs_thread_entry: start 2024-09-12T00:25:35.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.622+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:25:35.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.624+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.624+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:25:35.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18208721276073510748', time=2024-09-12T02:17:10.346372+0000, chain.objs.size()=1 2024-09-12T00:25:35.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.NRejX9C6Y1Px1M_tNd3G5CCotk180yM_0 2024-09-12T00:25:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='_z9-ejIDhAGHnMJnpjsVn2ZM5MueHa6H', time=2024-09-12T02:17:10.536330+0000, chain.objs.size()=1 2024-09-12T00:25:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.jpCGXokVTBD3Ybr3yIvmXEUHDOkwsq__0 2024-09-12T00:25:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11090378268796007152', time=2024-09-12T02:18:15.920773+0000, chain.objs.size()=1 2024-09-12T00:25:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.3AdWLI-iskhoeeSkXh-bPEbkbU_jVgl_0 2024-09-12T00:25:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10907857979003469658', time=2024-09-12T02:18:16.773640+0000, chain.objs.size()=1 2024-09-12T00:25:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.Rfb3dPRqElX69XqC5rozSq1-CSFxBvZ_0 2024-09-12T00:25:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11635167159621222345', time=2024-09-12T02:18:48.676401+0000, chain.objs.size()=1 2024-09-12T00:25:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.Czs0oVFMrK6q1CnRF8rV5Adp7sOabMt_0 2024-09-12T00:25:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.874952020778521822', time=2024-09-12T02:19:24.642908+0000, chain.objs.size()=1 2024-09-12T00:25:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.VCFp26opVm3NL7sfhK4v-YrJ8KKD6NU_0 2024-09-12T00:25:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13747462881904406477', time=2024-09-12T02:19:27.712868+0000, chain.objs.size()=1 2024-09-12T00:25:35.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.nQs6mSrirD24GCv1u-jHmVvrPcmMb5k_0 2024-09-12T00:25:35.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15542643777182571307', time=2024-09-12T02:20:00.077519+0000, chain.objs.size()=1 2024-09-12T00:25:35.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.BlkesomhCLX4w-ZIOEBlfrgXfJcsiNf_0 2024-09-12T00:25:35.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10827885523841439701', time=2024-09-12T02:20:35.852244+0000, chain.objs.size()=1 2024-09-12T00:25:35.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.t0q2tg3N12nBFT7aF34uhNnLk-2f8OG_0 2024-09-12T00:25:35.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14971023837453372721', time=2024-09-12T02:20:38.920741+0000, chain.objs.size()=1 2024-09-12T00:25:35.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.U8nDHyiztiMgMLHpcH0JVRfHn_0Yd3W_0 2024-09-12T00:25:35.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11882766769888264260', time=2024-09-12T02:25:13.863347+0000, chain.objs.size()=1 2024-09-12T00:25:35.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18__shadow:.7C6ZuapYCKjjcT0FzmqLLntlMF5dWp_.ZG_C6UqAYDAc5CyjKA6obToRyb9oPC8_0 2024-09-12T00:25:35.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4592322264541615261', time=2024-09-12T02:25:13.864164+0000, chain.objs.size()=1 2024-09-12T00:25:35.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.625+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18__shadow:e8AKztV0iCh.ak9i-J7cTi-tHEsw7NH_.XGBxA7BTMrx-cZLKCb8Xq5d0oK2Gu11_0 2024-09-12T00:25:35.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.632+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.635+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:25:35.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.636+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.636+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T00:25:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12192607557588473183', time=2024-09-12T02:17:10.333302+0000, chain.objs.size()=1 2024-09-12T00:25:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.PgZ7kWN0VBZ5Zt2bjoGAa9BAspxEShR_0 2024-09-12T00:25:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1147801548380917796', time=2024-09-12T02:17:10.583683+0000, chain.objs.size()=2 2024-09-12T00:25:35.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13__shadow_.7FaSbOiVWn2m1qorwASfsVW12WswszV_0 2024-09-12T00:25:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13__shadow_.7FaSbOiVWn2m1qorwASfsVW12WswszV_1 2024-09-12T00:25:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4848140764920394780', time=2024-09-12T02:17:10.636592+0000, chain.objs.size()=1 2024-09-12T00:25:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7__shadow_.LVb8nPMyWpl2ozyJ7rG3MT8ETimEXRi_0 2024-09-12T00:25:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13992608502601179044', time=2024-09-12T02:18:15.914636+0000, chain.objs.size()=1 2024-09-12T00:25:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.ptwOS_VH2byMYm8tct7a-aFTg-oZWFP_0 2024-09-12T00:25:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6725520414047812331', time=2024-09-12T02:18:15.923006+0000, chain.objs.size()=1 2024-09-12T00:25:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.PUFFindzUXwKNlXqrz1sOLtPGY9bUdV_0 2024-09-12T00:25:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1225620545923539877', time=2024-09-12T02:18:16.777314+0000, chain.objs.size()=1 2024-09-12T00:25:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.RD8jJGDNY0QBu5EfiaWNJ--YUOMpK1N_0 2024-09-12T00:25:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6806023943924402347', time=2024-09-12T02:18:17.789454+0000, chain.objs.size()=1 2024-09-12T00:25:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.cBQ-EQ1ew_5zVQ9rKGP3Vaq0Z1tSjV7_0 2024-09-12T00:25:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7586643292123334215', time=2024-09-12T02:18:48.676501+0000, chain.objs.size()=1 2024-09-12T00:25:35.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.DPl7_t2qC0JOVxvaYi1QsV9KN8AoSgf_0 2024-09-12T00:25:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.309672187439627087', time=2024-09-12T02:18:48.679992+0000, chain.objs.size()=1 2024-09-12T00:25:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.R0CDSIPnOZoHOQBcLDj2Leum9sZUwue_0 2024-09-12T00:25:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11620598795722238517', time=2024-09-12T02:18:48.684045+0000, chain.objs.size()=1 2024-09-12T00:25:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.637+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.FAngDoLm7HzyPEGS5TE7w2zp20TiioI_0 2024-09-12T00:25:35.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.639+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8999249064751527278', time=2024-09-12T02:18:48.687009+0000, chain.objs.size()=1 2024-09-12T00:25:35.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.639+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.-WVv5bzhAl8n3RG8wYlyijAmaIlc2TW_0 2024-09-12T00:25:35.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.640+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12747007408449140487', time=2024-09-12T02:19:26.415249+0000, chain.objs.size()=1 2024-09-12T00:25:35.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.640+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.e1EorgJqBK2-uFSpCVP2kdyw09dr0B7_0 2024-09-12T00:25:35.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.641+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.371914801550580346', time=2024-09-12T02:19:27.718161+0000, chain.objs.size()=1 2024-09-12T00:25:35.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.641+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.UY4C0hgfH7Dpqg4QxMgTgecfOIcKIib_0 2024-09-12T00:25:35.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.641+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9097779888114439475', time=2024-09-12T02:20:00.078258+0000, chain.objs.size()=1 2024-09-12T00:25:35.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.641+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.V7wLhe8mMpk_9mwY7_ky74B5UNkbwTX_0 2024-09-12T00:25:35.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.641+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8124454161548665101', time=2024-09-12T02:20:35.844840+0000, chain.objs.size()=1 2024-09-12T00:25:35.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.641+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.DDRrAe5avrrDte72VeNZt2rk_ndNgy9_0 2024-09-12T00:25:35.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.641+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5975703833088404973', time=2024-09-12T02:20:35.847044+0000, chain.objs.size()=1 2024-09-12T00:25:35.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.641+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.e5b67ff-ONjBex2cFdVfbRzJ2PCuCmN_0 2024-09-12T00:25:35.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.641+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9814609311618439854', time=2024-09-12T02:20:38.920594+0000, chain.objs.size()=1 2024-09-12T00:25:35.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.641+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.bI675AvCC9Kvm8sIB9leDiRj2C8oZKU_0 2024-09-12T00:25:35.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.641+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16667073758154477290', time=2024-09-12T02:21:45.706443+0000, chain.objs.size()=1 2024-09-12T00:25:35.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.641+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.Q-sPYbGuYe1NA8uRpDtLzBdLV7Gmcz__0 2024-09-12T00:25:35.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.641+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13066155523243218692', time=2024-09-12T02:21:45.707963+0000, chain.objs.size()=1 2024-09-12T00:25:35.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.641+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.VtPBrf_4Cjb9beZ2y6N0qLCr79M4Z78_0 2024-09-12T00:25:35.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.642+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14869449224258209766', time=2024-09-12T02:21:45.709480+0000, chain.objs.size()=1 2024-09-12T00:25:35.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.642+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.Yhw0kv61m5IabfAAqT5k3WkgxcpUU0n_0 2024-09-12T00:25:35.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.643+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8454171783942944650', time=2024-09-12T02:22:18.708702+0000, chain.objs.size()=1 2024-09-12T00:25:35.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.643+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.qqMFMua52Jxb8m6GxNSYFwbFmlNsIXc_0 2024-09-12T00:25:35.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.643+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11584257214641521170', time=2024-09-12T02:22:20.801703+0000, chain.objs.size()=1 2024-09-12T00:25:35.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.643+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.LHr1hbDBFxV70DxX0EHCOSaXCUkXe67_0 2024-09-12T00:25:35.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.646+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5084129046397403331', time=2024-09-12T02:22:53.353567+0000, chain.objs.size()=1 2024-09-12T00:25:35.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.646+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.hO6Me5COao8lkixeQAgTboopNpiLlZB_0 2024-09-12T00:25:35.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.650+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.652+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:25:35.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.654+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.654+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:25:35.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3569600327410535288', time=2024-09-12T02:17:10.654843+0000, chain.objs.size()=1 2024-09-12T00:25:35.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8__shadow_.FjCU9X0ssr_QGxC_cFjceHcEUQ5DZdz_0 2024-09-12T00:25:35.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8698014958499874598', time=2024-09-12T02:18:50.649784+0000, chain.objs.size()=1 2024-09-12T00:25:35.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.Ggf6WK_vsjPquFufxmtcGROQWMGlgjJ_0 2024-09-12T00:25:35.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6115375735687257144', time=2024-09-12T02:18:51.910198+0000, chain.objs.size()=1 2024-09-12T00:25:35.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.v1Xv8BGT7haHx_pvJ-kEwH21W28wDxo_0 2024-09-12T00:25:35.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17506505657578096484', time=2024-09-12T02:19:26.415615+0000, chain.objs.size()=1 2024-09-12T00:25:35.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.qe6UNBOejz0achW4rQjeDUz6yJDMNvf_0 2024-09-12T00:25:35.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6399872330782208502', time=2024-09-12T02:20:00.070290+0000, chain.objs.size()=1 2024-09-12T00:25:35.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.1tqZ9irW12AuXCUN2GB8BNppZL0uxDM_0 2024-09-12T00:25:35.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5705243696095185267', time=2024-09-12T02:20:37.644228+0000, chain.objs.size()=1 2024-09-12T00:25:35.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.mt1fRb9OnpunfiG4O47P7XqsoxqxuIZ_0 2024-09-12T00:25:35.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15732671872441780914', time=2024-09-12T02:20:38.919369+0000, chain.objs.size()=1 2024-09-12T00:25:35.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.9j-_agOgYxnaxeh0t-00yBB0itqCuMS_0 2024-09-12T00:25:35.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2394837836413250747', time=2024-09-12T02:20:38.929226+0000, chain.objs.size()=1 2024-09-12T00:25:35.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.3aqUGwvlQfl_F_f3IoXJrMRsvYK3WjR_0 2024-09-12T00:25:35.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8133340280051166610', time=2024-09-12T02:21:12.540990+0000, chain.objs.size()=1 2024-09-12T00:25:35.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.Zd_JOyChgXd2zpbaaVsU1UPlPPyR3At_0 2024-09-12T00:25:35.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17651910149426550653', time=2024-09-12T02:21:44.714401+0000, chain.objs.size()=1 2024-09-12T00:25:35.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.hbw_QT53GqnsTaZOE2Bs4_SC9pglBZC_0 2024-09-12T00:25:35.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6404146004861478655', time=2024-09-12T02:22:17.649816+0000, chain.objs.size()=1 2024-09-12T00:25:35.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.YvvlA5Y_-hpU9oKWMAOA3nLkfJRLRn0_0 2024-09-12T00:25:35.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5174304426537289820', time=2024-09-12T02:22:17.652817+0000, chain.objs.size()=1 2024-09-12T00:25:35.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.655+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.Pu8Aqi3WhZOEKFD2o1tuB6siccI5aZg_0 2024-09-12T00:25:35.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.658+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13335855524533542741', time=2024-09-12T02:22:17.653704+0000, chain.objs.size()=1 2024-09-12T00:25:35.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.658+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.N9EpMvfPLq6HilODGlw62v7D1t76xsE_0 2024-09-12T00:25:35.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.659+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5145629379124227175', time=2024-09-12T02:22:20.786940+0000, chain.objs.size()=1 2024-09-12T00:25:35.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.659+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.kuKhcoj8Hmsua5MCMZNBP_y6-v0WU-S_0 2024-09-12T00:25:35.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.660+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17130321416819156107', time=2024-09-12T02:25:01.489941+0000, chain.objs.size()=1 2024-09-12T00:25:35.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.660+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17__shadow_.mDH0nwWeLK-5HU1UIyypnj0uGk9bsTE_0 2024-09-12T00:25:35.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.663+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.665+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:25:35.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.667+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:25:35.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14022861258467132135', time=2024-09-12T02:17:10.476755+0000, chain.objs.size()=1 2024-09-12T00:25:35.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.YnmTbQdqQ-SwYpJdhF1b44o8oB7_tuo_0 2024-09-12T00:25:35.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10039511231528686768', time=2024-09-12T02:18:15.912941+0000, chain.objs.size()=1 2024-09-12T00:25:35.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.GfOtAbf-uy-Cc-ZOLVygV4q-VKJJcH7_0 2024-09-12T00:25:35.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12972188514155796472', time=2024-09-12T02:18:16.768897+0000, chain.objs.size()=1 2024-09-12T00:25:35.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.qraMZ0zpakfF5WXG7jQ110WqJkxaitB_0 2024-09-12T00:25:35.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17922934200711257694', time=2024-09-12T02:18:16.773892+0000, chain.objs.size()=1 2024-09-12T00:25:35.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.1NIw676reEQT-4gpMxmVRrIcdb5FI6h_0 2024-09-12T00:25:35.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2608412533253411191', time=2024-09-12T02:19:24.650623+0000, chain.objs.size()=1 2024-09-12T00:25:35.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.MzP34J2f2j-i9bHv2kwckre9-zCQHOK_0 2024-09-12T00:25:35.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17497464433707859791', time=2024-09-12T02:20:35.849750+0000, chain.objs.size()=1 2024-09-12T00:25:35.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.BDLfjXW_0jRpw5Ae_ccUfF2jytoABwP_0 2024-09-12T00:25:35.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17664007768956697214', time=2024-09-12T02:20:38.929727+0000, chain.objs.size()=1 2024-09-12T00:25:35.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.j7ARviZnZfo74mFsx9TWTQwlfSTjNUg_0 2024-09-12T00:25:35.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1153993470797429676', time=2024-09-12T02:21:12.534682+0000, chain.objs.size()=1 2024-09-12T00:25:35.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.6AZxJUsvpBhZnM6pgTEFnEV3nHdiBQC_0 2024-09-12T00:25:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9375745103248772791', time=2024-09-12T02:21:12.542327+0000, chain.objs.size()=1 2024-09-12T00:25:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.668+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.QMDGZXKLmqnys5U-kfZ4r052tVuwow1_0 2024-09-12T00:25:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.669+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16309417614430033665', time=2024-09-12T02:22:19.455071+0000, chain.objs.size()=1 2024-09-12T00:25:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.669+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.aV3fObmdzScPrK9S6iS5RHiTPm5P8FN_0 2024-09-12T00:25:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.669+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12512873351878385180', time=2024-09-12T02:22:19.457849+0000, chain.objs.size()=1 2024-09-12T00:25:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.669+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.uYXFvGL6vj4JUA_irwnNXjE7D9865du_0 2024-09-12T00:25:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.669+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14739477924806236091', time=2024-09-12T02:22:53.359666+0000, chain.objs.size()=1 2024-09-12T00:25:35.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.669+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.bNTXxdovG5F0XraQODF0vdY9_LtSQ1q_0 2024-09-12T00:25:35.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.673+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4874647921363521742', time=2024-09-12T02:25:01.489921+0000, chain.objs.size()=1 2024-09-12T00:25:35.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.673+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17__shadow_.rylwo75jeKVgw7-r9pLAGgdJw5UhR9F_0 2024-09-12T00:25:35.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.675+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.677+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:25:35.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.679+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.679+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.679+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:25:35.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.679+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6106510527396649690', time=2024-09-12T02:17:10.318634+0000, chain.objs.size()=1 2024-09-12T00:25:35.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.679+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.8p4GulM72kNpOMtC-ofLrJdbPFMWxH__0 2024-09-12T00:25:35.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16138576808649423202', time=2024-09-12T02:17:10.495300+0000, chain.objs.size()=3 2024-09-12T00:25:35.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-FROZEN.2~sIcHF2inUJKAFYg19ZFLRgtZXnaKUP8.1 2024-09-12T00:25:35.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-FROZEN.2~sIcHF2inUJKAFYg19ZFLRgtZXnaKUP8.2 2024-09-12T00:25:35.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-FROZEN.2~sIcHF2inUJKAFYg19ZFLRgtZXnaKUP8.3 2024-09-12T00:25:35.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1429232844279081148', time=2024-09-12T02:18:16.771273+0000, chain.objs.size()=1 2024-09-12T00:25:35.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_._eMUbBAK8wGBOV75tRFHqV9AalrFWAD_0 2024-09-12T00:25:35.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5008363510263062022', time=2024-09-12T02:18:16.780788+0000, chain.objs.size()=1 2024-09-12T00:25:35.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.aR5HgR2nK1gV0m_YV5Hb7hUYX7SIwys_0 2024-09-12T00:25:35.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4410403869733576860', time=2024-09-12T02:18:48.676924+0000, chain.objs.size()=1 2024-09-12T00:25:35.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.bI4cufz3y42lYkUKZ__LQDvgAGP2k3v_0 2024-09-12T00:25:35.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11197768330398250657', time=2024-09-12T02:20:00.074773+0000, chain.objs.size()=1 2024-09-12T00:25:35.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.MztQc4-aE4spZll7raCOv7BKxM2QXra_0 2024-09-12T00:25:35.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7424565647559271487', time=2024-09-12T02:20:02.676663+0000, chain.objs.size()=1 2024-09-12T00:25:35.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.NOh0j84-8kU4cyqSSgiXs-oizKs-23Q_0 2024-09-12T00:25:35.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3008533834125666865', time=2024-09-12T02:20:02.682219+0000, chain.objs.size()=1 2024-09-12T00:25:35.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.K744ITs7PdHBI_POZHSiamVB7g8leco_0 2024-09-12T00:25:35.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6794793779284789665', time=2024-09-12T02:20:37.642958+0000, chain.objs.size()=1 2024-09-12T00:25:35.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.nXq0W6370c41SVzu08klh05WCwWEqNE_0 2024-09-12T00:25:35.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5454917793200383185', time=2024-09-12T02:21:10.944426+0000, chain.objs.size()=1 2024-09-12T00:25:35.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.680+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.qGeQEGyPI3733LxbGCige50yWSw06pX_0 2024-09-12T00:25:35.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.683+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8002491279983980987', time=2024-09-12T02:21:10.957053+0000, chain.objs.size()=1 2024-09-12T00:25:35.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.683+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.ieLKbdkLtm09F_VzPC82pdJsV8gZ_5m_0 2024-09-12T00:25:35.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.683+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.690450917370528093', time=2024-09-12T02:21:44.718407+0000, chain.objs.size()=1 2024-09-12T00:25:35.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.684+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.Al2IsAqylrPMiWEeJyvO3vCMig_QwL6_0 2024-09-12T00:25:35.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.684+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2153692461448070562', time=2024-09-12T02:21:44.719530+0000, chain.objs.size()=1 2024-09-12T00:25:35.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.684+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.XNH7-Sbb-1aalj6bee796HLbMlu3kdU_0 2024-09-12T00:25:35.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.684+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4463857374379991979', time=2024-09-12T02:21:44.721894+0000, chain.objs.size()=1 2024-09-12T00:25:35.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.684+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.vzvE8sku3KOhI53fbPt9Z9NF_Zc8J2g_0 2024-09-12T00:25:35.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.684+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17435843961215676509', time=2024-09-12T02:22:17.657030+0000, chain.objs.size()=1 2024-09-12T00:25:35.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.684+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.CmCv5cERc8Bl_5PZ-2v3nU74q4S2T-Q_0 2024-09-12T00:25:35.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.684+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17907033128096064378', time=2024-09-12T02:22:17.668166+0000, chain.objs.size()=1 2024-09-12T00:25:35.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.684+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.Te2igUQrBKngQ1ER64kac6P4BlAAcqC_0 2024-09-12T00:25:35.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.684+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9232714546448734649', time=2024-09-12T02:22:19.461038+0000, chain.objs.size()=1 2024-09-12T00:25:35.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.684+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.qi1YuycP3dIn49d2js3loKyn9Ky2lF3_0 2024-09-12T00:25:35.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.688+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.691+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:25:35.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.692+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.693+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.693+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:25:35.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.693+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='_JG4PYlQpMlCfJSdGbPqqSS6d1cMV8hW', time=2024-09-12T02:17:10.514241+0000, chain.objs.size()=2 2024-09-12T00:25:35.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.693+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.msQiyBSHO7j6OlmKyK6BlT3zla80yI4_0 2024-09-12T00:25:35.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.693+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.msQiyBSHO7j6OlmKyK6BlT3zla80yI4_1 2024-09-12T00:25:35.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17746145654053126910', time=2024-09-12T02:17:10.579697+0000, chain.objs.size()=2 2024-09-12T00:25:35.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13__shadow_.ImYpZcXiAIgikSQkxL7hR0QCHhsDxiZ_0 2024-09-12T00:25:35.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13__shadow_.ImYpZcXiAIgikSQkxL7hR0QCHhsDxiZ_1 2024-09-12T00:25:35.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17232408011302351498', time=2024-09-12T02:17:10.663053+0000, chain.objs.size()=1 2024-09-12T00:25:35.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8__shadow_.nuVi78fL_oxC2W_yYdva6LPubXwfmO7_0 2024-09-12T00:25:35.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.933330042466531416', time=2024-09-12T02:18:16.770786+0000, chain.objs.size()=1 2024-09-12T00:25:35.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.vqqxVXfJ0KcvUsy8WwnthCBxqf-qFIY_0 2024-09-12T00:25:35.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14941737985076448292', time=2024-09-12T02:18:48.676622+0000, chain.objs.size()=1 2024-09-12T00:25:35.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.fb9USeaV0tj42RuyZfolNhPYhwLMBZE_0 2024-09-12T00:25:35.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4493120759607177122', time=2024-09-12T02:18:48.682991+0000, chain.objs.size()=1 2024-09-12T00:25:35.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.UHDxX2jya5wrT1_3HVIZk4yeVmCos0-_0 2024-09-12T00:25:35.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6897126228209863114', time=2024-09-12T02:18:48.686030+0000, chain.objs.size()=1 2024-09-12T00:25:35.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.8ypceDEA0phUY6VzvoaZTmiYHTPKT61_0 2024-09-12T00:25:35.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14448597663421792230', time=2024-09-12T02:18:50.650837+0000, chain.objs.size()=1 2024-09-12T00:25:35.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.F5YcGD9S57PZOLpAp9PI9SBCuzNOLx8_0 2024-09-12T00:25:35.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17246309307873088589', time=2024-09-12T02:18:50.652724+0000, chain.objs.size()=1 2024-09-12T00:25:35.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.7yNZnNcXMlyBm5M-2nv5zSiyU7CWe99_0 2024-09-12T00:25:35.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4014969503632782559', time=2024-09-12T02:18:51.913622+0000, chain.objs.size()=1 2024-09-12T00:25:35.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.694+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.GaroYn0FOSaPRCFqPqWtvNybMzW1iFj_0 2024-09-12T00:25:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.698+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2850556371374260520', time=2024-09-12T02:19:26.426872+0000, chain.objs.size()=1 2024-09-12T00:25:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.698+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.RKGR_7ajvqu2_vqvMKLrXrV4bo88Pjq_0 2024-09-12T00:25:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.698+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18296853631657301239', time=2024-09-12T02:21:44.725659+0000, chain.objs.size()=1 2024-09-12T00:25:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.698+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.D73WShsqzwbf8dRcb73LK5wUwPxxbI2_0 2024-09-12T00:25:35.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.699+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13857596298025542847', time=2024-09-12T02:21:45.701919+0000, chain.objs.size()=1 2024-09-12T00:25:35.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.699+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.mWTnSK9GEkPYAr-LkxkDsxU2_9RzNm1_0 2024-09-12T00:25:35.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.699+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7001068297444558589', time=2024-09-12T02:21:45.702757+0000, chain.objs.size()=1 2024-09-12T00:25:35.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.699+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.joo0UQriYPh7ndV0Vd0rzpx4c6ghLLh_0 2024-09-12T00:25:35.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.699+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12481600866159760080', time=2024-09-12T02:22:17.648469+0000, chain.objs.size()=1 2024-09-12T00:25:35.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.699+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.D51WJjPrt484tA7tNjnBt7cv8on2vHE_0 2024-09-12T00:25:35.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.699+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2674980988524622073', time=2024-09-12T02:22:20.788042+0000, chain.objs.size()=1 2024-09-12T00:25:35.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.699+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.leR1EaaF1XUcv0Lp6SVpqQImt-7YRYD_0 2024-09-12T00:25:35.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.699+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5570362336574649907', time=2024-09-12T02:25:01.489918+0000, chain.objs.size()=1 2024-09-12T00:25:35.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.699+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17__shadow_.vnu81CnQt6b-kY_yW72SaGO05gjLtH2_0 2024-09-12T00:25:35.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.703+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.706+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:25:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.707+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.707+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T00:25:35.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17282556510603897492', time=2024-09-12T02:18:50.651792+0000, chain.objs.size()=1 2024-09-12T00:25:35.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.mYx8cfomJoz5WnTSH5kQdxO4JVlbx3g_0 2024-09-12T00:25:35.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8601680993740508601', time=2024-09-12T02:18:51.917773+0000, chain.objs.size()=1 2024-09-12T00:25:35.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.DmLs9-fw1uAd143vI-kiG6vhvbS279b_0 2024-09-12T00:25:35.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2405157478040744635', time=2024-09-12T02:19:26.425930+0000, chain.objs.size()=1 2024-09-12T00:25:35.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.KNLlnEabOrTVec6SlXY630UUD6B855y_0 2024-09-12T00:25:35.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3079072298322075082', time=2024-09-12T02:20:35.841823+0000, chain.objs.size()=1 2024-09-12T00:25:35.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.UuMKc3Q8WWI7U6MJxWpZtjbAfYeoDRc_0 2024-09-12T00:25:35.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.924535409630828160', time=2024-09-12T02:21:10.951805+0000, chain.objs.size()=1 2024-09-12T00:25:35.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.3L4O0BzImlXI79lriJ1bWjykuTRjsA9_0 2024-09-12T00:25:35.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5939947905446243874', time=2024-09-12T02:21:12.542379+0000, chain.objs.size()=1 2024-09-12T00:25:35.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.3TCJwnFLnge63lKdi7aBLARBUMrXtS-_0 2024-09-12T00:25:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8325973679910114817', time=2024-09-12T02:21:12.549316+0000, chain.objs.size()=1 2024-09-12T00:25:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.yyRS4sUdKBYYRR98-A8Sz0_EovirHD3_0 2024-09-12T00:25:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9744503117788249619', time=2024-09-12T02:22:19.451562+0000, chain.objs.size()=1 2024-09-12T00:25:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.v5h69UgY76E_fonQESfwe9N2OF9dgaP_0 2024-09-12T00:25:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17021098504382668067', time=2024-09-12T02:22:20.781049+0000, chain.objs.size()=1 2024-09-12T00:25:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.MO3S_-A44GrlE3Bzzy7J05ZpeJICK55_0 2024-09-12T00:25:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17633059813506546280', time=2024-09-12T02:22:20.784029+0000, chain.objs.size()=1 2024-09-12T00:25:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.zbt2VYM3070he4MLIANJTdmzeVUjXXS_0 2024-09-12T00:25:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15125270636647603552', time=2024-09-12T02:22:53.362276+0000, chain.objs.size()=1 2024-09-12T00:25:35.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.708+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.d4-g6dB8L12tIJnR3KxW6bHiz3-ih7T_0 2024-09-12T00:25:35.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.713+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.716+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:25:35.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.717+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.718+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.718+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:25:35.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.718+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16692790965145902790', time=2024-09-12T02:17:10.314136+0000, chain.objs.size()=1 2024-09-12T00:25:35.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.718+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.HR8p7NAcmJA867Xv1coTlfVQLKnS_Fq_0 2024-09-12T00:25:35.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15825072168278632048', time=2024-09-12T02:18:15.920714+0000, chain.objs.size()=1 2024-09-12T00:25:35.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.J0YlxV5UT5hGDvCNgLp0oe_GvpFLiLq_0 2024-09-12T00:25:35.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.520567106511839344', time=2024-09-12T02:18:48.688483+0000, chain.objs.size()=1 2024-09-12T00:25:35.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.Cnzm06A9m8mD9TJdOR_-pDm4LcqDugW_0 2024-09-12T00:25:35.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8584329241619220695', time=2024-09-12T02:19:26.431209+0000, chain.objs.size()=1 2024-09-12T00:25:35.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.QBUi9DMjeUua2HH-_5XUGM0kUJwqNY6_0 2024-09-12T00:25:35.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18256679075802809746', time=2024-09-12T02:19:26.436205+0000, chain.objs.size()=1 2024-09-12T00:25:35.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.DKjh1JC7NDbIzvC1Vx51hc9dt8E3aGS_0 2024-09-12T00:25:35.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13202966740488461503', time=2024-09-12T02:19:27.715312+0000, chain.objs.size()=1 2024-09-12T00:25:35.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.eDGxtitW0deGkpa8P2h0rt8nF6ZwLy-_0 2024-09-12T00:25:35.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4548094466939369059', time=2024-09-12T02:20:38.916011+0000, chain.objs.size()=1 2024-09-12T00:25:35.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.8_0B7rJbDD5pa6VeF7JhM6ItY6n-jZg_0 2024-09-12T00:25:35.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15583508769465255889', time=2024-09-12T02:21:44.723812+0000, chain.objs.size()=1 2024-09-12T00:25:35.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.CD4LLciHq_Tq1kbzJIjn9Xoil-Eg_rz_0 2024-09-12T00:25:35.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.299527436101541872', time=2024-09-12T02:22:19.453293+0000, chain.objs.size()=1 2024-09-12T00:25:35.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.L-7kiKQ2b5yyBFlfNcydn1a6XyuQ_le_0 2024-09-12T00:25:35.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1881437091386058328', time=2024-09-12T02:22:20.791047+0000, chain.objs.size()=1 2024-09-12T00:25:35.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.719+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.yRwYXqihs_an18fed_sfFWz8WHLlnm5_0 2024-09-12T00:25:35.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.724+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.726+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:25:35.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.727+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:25:35.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6663266903519560550', time=2024-09-12T02:17:10.364403+0000, chain.objs.size()=4 2024-09-12T00:25:35.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11__multipart_foo.2~2mt8P5vX3fUl7B1PcG4_ifgGBqG_Ymh.1 2024-09-12T00:25:35.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11__multipart_foo.2~2mt8P5vX3fUl7B1PcG4_ifgGBqG_Ymh.2 2024-09-12T00:25:35.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11__multipart_foo.2~2mt8P5vX3fUl7B1PcG4_ifgGBqG_Ymh.3 2024-09-12T00:25:35.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11__multipart_foo.2~2mt8P5vX3fUl7B1PcG4_ifgGBqG_Ymh.4 2024-09-12T00:25:35.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.844547769493095040', time=2024-09-12T02:17:10.414830+0000, chain.objs.size()=4 2024-09-12T00:25:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9__multipart_foo.2~IXQ-idoVse8yJQiwkcC3efu7s6NvGI8.1 2024-09-12T00:25:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9__multipart_foo.2~IXQ-idoVse8yJQiwkcC3efu7s6NvGI8.2 2024-09-12T00:25:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9__multipart_foo.2~IXQ-idoVse8yJQiwkcC3efu7s6NvGI8.3 2024-09-12T00:25:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9__multipart_foo.2~IXQ-idoVse8yJQiwkcC3efu7s6NvGI8.4 2024-09-12T00:25:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='_o8GG0lsR-dSXtuSl_rzM4SLm8KKl7Cy', time=2024-09-12T02:17:10.438581+0000, chain.objs.size()=1 2024-09-12T00:25:35.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.BTVooYDstqajOrnoqtpzSdlR93K-lgn_0 2024-09-12T00:25:35.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='_zEn5BymptQLPOe0Ccc4Iv568f5sRoby', time=2024-09-12T02:17:10.523824+0000, chain.objs.size()=2 2024-09-12T00:25:35.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.ieCU9R1Z5kVTdoivphmB_C-3f9IS6_m_0 2024-09-12T00:25:35.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.ieCU9R1Z5kVTdoivphmB_C-3f9IS6_m_1 2024-09-12T00:25:35.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15185877933458480575', time=2024-09-12T02:18:15.915413+0000, chain.objs.size()=1 2024-09-12T00:25:35.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.728+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.LEhTLfhX4dES7-lLlTyH-k0hIwkIg_I_0 2024-09-12T00:25:35.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.732+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13472577141617368227', time=2024-09-12T02:18:16.776293+0000, chain.objs.size()=1 2024-09-12T00:25:35.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.732+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.RzOitv2qNHJ9HpquD9YfzOWRqchLFm__0 2024-09-12T00:25:35.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.732+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1145226751172614514', time=2024-09-12T02:18:48.686271+0000, chain.objs.size()=1 2024-09-12T00:25:35.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.732+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.XJMOA72XtWgB7AxIX9HsPNKccjwJ1z8_0 2024-09-12T00:25:35.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.733+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16611219979366590099', time=2024-09-12T02:19:24.642821+0000, chain.objs.size()=1 2024-09-12T00:25:35.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.733+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.JWZ9oMBfJpg3XU_kcOxXnSVltziJsVQ_0 2024-09-12T00:25:35.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.733+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2880471220191417708', time=2024-09-12T02:19:25.688562+0000, chain.objs.size()=1 2024-09-12T00:25:35.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.733+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.lEZzHJVETXdVEG-_NjdSAk0EzVZOoYf_0 2024-09-12T00:25:35.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.733+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16995976681154351358', time=2024-09-12T02:19:27.705539+0000, chain.objs.size()=1 2024-09-12T00:25:35.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.733+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.uYARvg97r3t56-px3kay_NXiqjZjMaE_0 2024-09-12T00:25:35.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.733+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14369057609623507888', time=2024-09-12T02:19:27.711140+0000, chain.objs.size()=1 2024-09-12T00:25:35.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.733+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.b7yfg-TdJpg1856CpnqLeSxqVosQKds_0 2024-09-12T00:25:35.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.733+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5505124725989255309', time=2024-09-12T02:20:00.069800+0000, chain.objs.size()=1 2024-09-12T00:25:35.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.733+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.4M2MXlU8T3GX_OLIa0heN7oW90btlZZ_0 2024-09-12T00:25:35.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.733+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15582525302305233238', time=2024-09-12T02:20:00.072099+0000, chain.objs.size()=1 2024-09-12T00:25:35.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.733+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.H-K-EjWq5jLC1OIVum6c8NDOwNAFRbi_0 2024-09-12T00:25:35.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.733+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10996366598141647085', time=2024-09-12T02:20:02.662506+0000, chain.objs.size()=1 2024-09-12T00:25:35.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.733+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.8MmHusRxhUuLjhuzzjhpiUO4ItH-4vY_0 2024-09-12T00:25:35.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.736+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13632728942135070161', time=2024-09-12T02:20:02.675505+0000, chain.objs.size()=1 2024-09-12T00:25:35.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.736+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.O3qGI2iR_RGNO2mMvtFNp835So9DN7K_0 2024-09-12T00:25:35.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.736+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15872099791071649590', time=2024-09-12T02:20:35.855056+0000, chain.objs.size()=1 2024-09-12T00:25:35.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.736+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.PfU3qezc09KfxA9ZEJ3t9x3fxLWqznk_0 2024-09-12T00:25:35.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.736+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13787055344876092796', time=2024-09-12T02:20:38.919149+0000, chain.objs.size()=1 2024-09-12T00:25:35.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.736+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.NDRLjmszZPvB9tegHls9i-illT0e1Zd_0 2024-09-12T00:25:35.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.738+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10989553395254030075', time=2024-09-12T02:21:09.992304+0000, chain.objs.size()=1 2024-09-12T00:25:35.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.738+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.fgwOesBEBtLJCFwF9he1wvDkJjlPqUP_0 2024-09-12T00:25:35.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.738+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1723139406252086535', time=2024-09-12T02:21:10.949548+0000, chain.objs.size()=1 2024-09-12T00:25:35.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.738+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.A14vraXhg7Fjhi2DRba-xhOp6BzdkiC_0 2024-09-12T00:25:35.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.738+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9516694354149639757', time=2024-09-12T02:21:12.542759+0000, chain.objs.size()=1 2024-09-12T00:25:35.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.738+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.YXBuwR6aCi-ftknJXEbM32lzX5uLO-o_0 2024-09-12T00:25:35.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.743+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.746+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:25:35.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.748+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:25:35.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2314637739760701431', time=2024-09-12T02:17:10.337819+0000, chain.objs.size()=1 2024-09-12T00:25:35.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.76Aw6-Kth9DBBYzPPzR_-ZpxCccziXe_0 2024-09-12T00:25:35.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='_Y5XhdlY9773n4sKwCkBpRp1aCL31goU', time=2024-09-12T02:17:10.468033+0000, chain.objs.size()=1 2024-09-12T00:25:35.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.hkMfXNNdU55kcekFvQaFDDr-13AcOW1_0 2024-09-12T00:25:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15899411167106971393', time=2024-09-12T02:17:10.559616+0000, chain.objs.size()=3 2024-09-12T00:25:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-LUKEWARM.2~A6cO4zFzU40OlRaW9KRQobnvNRlB8Sd.1 2024-09-12T00:25:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-LUKEWARM.2~A6cO4zFzU40OlRaW9KRQobnvNRlB8Sd.2 2024-09-12T00:25:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-LUKEWARM.2~A6cO4zFzU40OlRaW9KRQobnvNRlB8Sd.3 2024-09-12T00:25:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5233554490176800901', time=2024-09-12T02:18:16.771559+0000, chain.objs.size()=1 2024-09-12T00:25:35.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.CjJjdHUF_Q_A8A7qGOBZgbfuQ82aeNm_0 2024-09-12T00:25:35.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17764656749326554067', time=2024-09-12T02:18:51.906184+0000, chain.objs.size()=1 2024-09-12T00:25:35.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.BJMkX_vTcNU6P9fDtxPmwzPN4ZyEvW8_0 2024-09-12T00:25:35.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8120693933352736330', time=2024-09-12T02:19:26.416893+0000, chain.objs.size()=1 2024-09-12T00:25:35.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.749+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.dGNyIn1YssJoSfX1ScANZHjjhqD6Zs4_0 2024-09-12T00:25:35.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.750+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2807507124168188395', time=2024-09-12T02:19:26.431340+0000, chain.objs.size()=1 2024-09-12T00:25:35.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.750+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.Pg69yp5GnMX-2Gn9z_inhGRcyf95TGs_0 2024-09-12T00:25:35.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.750+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17572681347901439578', time=2024-09-12T02:19:26.434354+0000, chain.objs.size()=1 2024-09-12T00:25:35.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.750+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.lSqKcnWTHn38yBqXj-LJTRH0bKamODb_0 2024-09-12T00:25:35.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.750+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.389798246866558775', time=2024-09-12T02:19:27.707965+0000, chain.objs.size()=1 2024-09-12T00:25:35.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.750+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.xAEYIy1bB6XKRsNO4XN-EEUmAPwhiOU_0 2024-09-12T00:25:35.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.750+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2410177664080019807', time=2024-09-12T02:20:02.672714+0000, chain.objs.size()=1 2024-09-12T00:25:35.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.750+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.V7G31q9ryoVVXvdYXyH_vDKEYvg2kHy_0 2024-09-12T00:25:35.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.752+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10823716572621776899', time=2024-09-12T02:20:02.678842+0000, chain.objs.size()=1 2024-09-12T00:25:35.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.752+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.6juSz517YDIJw3VwP1bh3jev4tYICig_0 2024-09-12T00:25:35.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.752+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8939504206270109120', time=2024-09-12T02:20:37.103538+0000, chain.objs.size()=1 2024-09-12T00:25:35.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.752+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.CllOKso1nWdDj3MWkc28eGqQEHLqJna_0 2024-09-12T00:25:35.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.752+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8382172471825796888', time=2024-09-12T02:20:37.636769+0000, chain.objs.size()=1 2024-09-12T00:25:35.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.752+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.gqSZoEX-fsRsqdXVNBaohdkVMOfuFLl_0 2024-09-12T00:25:35.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.754+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9323783589574666623', time=2024-09-12T02:20:37.640762+0000, chain.objs.size()=1 2024-09-12T00:25:35.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.754+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.Z0lf04huExr8jQgqmFdydEX2feo9ajp_0 2024-09-12T00:25:35.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.754+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7334901819207326834', time=2024-09-12T02:20:37.643713+0000, chain.objs.size()=1 2024-09-12T00:25:35.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.754+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.QE4hZPcxhxegq-pG-V9dJtaW7rNFZGU_0 2024-09-12T00:25:35.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.754+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9149587544118573652', time=2024-09-12T02:20:38.919377+0000, chain.objs.size()=1 2024-09-12T00:25:35.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.754+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.NAJNKtMHzZ39wq080vS7QskhjrVHI3D_0 2024-09-12T00:25:35.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.754+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15206345244877175305', time=2024-09-12T02:20:38.930344+0000, chain.objs.size()=1 2024-09-12T00:25:35.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.754+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.zbvmVO9Yc16fQExJKk-iTiQjCNJp7Zm_0 2024-09-12T00:25:35.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.754+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15949967977112164442', time=2024-09-12T02:21:10.945450+0000, chain.objs.size()=1 2024-09-12T00:25:35.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.754+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.bnr5Tf-ZWQBzrMlPV6igWVNRIPiiM7y_0 2024-09-12T00:25:35.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.754+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11960567301074507800', time=2024-09-12T02:22:19.449997+0000, chain.objs.size()=1 2024-09-12T00:25:35.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.754+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.s86c-DuOgFitftm-45aSNh1HURwfAGd_0 2024-09-12T00:25:35.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.754+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1061968731987333247', time=2024-09-12T02:25:01.491526+0000, chain.objs.size()=1 2024-09-12T00:25:35.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.754+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17__shadow_.of7moZ0k-ZaeYtLgoFYEhrS5uSVYlWW_0 2024-09-12T00:25:35.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.761+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.763+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:25:35.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.765+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.765+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.765+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:25:35.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.765+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='_lN10VIgzPwWO6Y8CrzwsaGm2hH6IEHU', time=2024-09-12T02:17:10.442917+0000, chain.objs.size()=1 2024-09-12T00:25:35.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.765+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.B9vxmkI8x8VvnUe6TgVT6otznmLPbuZ_0 2024-09-12T00:25:35.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.765+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3792881447123768246', time=2024-09-12T02:17:10.527967+0000, chain.objs.size()=3 2024-09-12T00:25:35.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.765+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-STANDARD.2~aHqUWSYdKe1S-x9yY0MsASwii3H_QZY.1 2024-09-12T00:25:35.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.765+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-STANDARD.2~aHqUWSYdKe1S-x9yY0MsASwii3H_QZY.2 2024-09-12T00:25:35.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.765+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-STANDARD.2~aHqUWSYdKe1S-x9yY0MsASwii3H_QZY.3 2024-09-12T00:25:35.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.765+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6279667171895921171', time=2024-09-12T02:17:10.555209+0000, chain.objs.size()=3 2024-09-12T00:25:35.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.765+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-FROZEN.2~jseCU4do2NnD4CPj2P1ELkQbfZqn7WO.1 2024-09-12T00:25:35.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.765+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-FROZEN.2~jseCU4do2NnD4CPj2P1ELkQbfZqn7WO.2 2024-09-12T00:25:35.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.765+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-FROZEN.2~jseCU4do2NnD4CPj2P1ELkQbfZqn7WO.3 2024-09-12T00:25:35.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.766+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7133501233715965164', time=2024-09-12T02:18:16.774076+0000, chain.objs.size()=1 2024-09-12T00:25:35.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.766+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.p3wI8LuzP8wEvY2P-epvyv_YD7DJNXC_0 2024-09-12T00:25:35.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.766+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14188157207340258213', time=2024-09-12T02:18:51.908883+0000, chain.objs.size()=1 2024-09-12T00:25:35.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.766+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.503WI4F8xpcSyhsHKRzOUY7_oZmtZzU_0 2024-09-12T00:25:35.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.766+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3999859510054512177', time=2024-09-12T02:18:51.920382+0000, chain.objs.size()=1 2024-09-12T00:25:35.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.766+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.XnUQHdxrmNJrXo3lKkUjWYewrxXgde4_0 2024-09-12T00:25:35.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.766+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15347639276975805033', time=2024-09-12T02:19:24.654099+0000, chain.objs.size()=1 2024-09-12T00:25:35.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.766+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.QVKAvW80UmglA1p0cG8Hbn1yd5iaDKb_0 2024-09-12T00:25:35.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.766+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15463685116181961267', time=2024-09-12T02:19:26.419550+0000, chain.objs.size()=1 2024-09-12T00:25:35.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.766+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.JurAQ7ayZih6QKXUerHazJH0sTZwPUO_0 2024-09-12T00:25:35.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.769+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12535750070757961785', time=2024-09-12T02:20:02.667699+0000, chain.objs.size()=1 2024-09-12T00:25:35.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.769+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.vdmUuxy0IwuSI-t2yFaZkz2VEB9gYqs_0 2024-09-12T00:25:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.769+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13770971758344882657', time=2024-09-12T02:20:35.848331+0000, chain.objs.size()=1 2024-09-12T00:25:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.769+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.iX5bPYus8TYNUT9cK5SG6WxrfgmjNuI_0 2024-09-12T00:25:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.770+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11486779267800756231', time=2024-09-12T02:20:35.856984+0000, chain.objs.size()=1 2024-09-12T00:25:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.770+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.ysqctOvTLOxc_YIXKWWAQ-yZA5BjsVi_0 2024-09-12T00:25:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.770+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9982050808866788603', time=2024-09-12T02:20:38.919023+0000, chain.objs.size()=1 2024-09-12T00:25:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.770+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.RCJQiHxnKPz3cm5bboBOuxKKg-nz2_u_0 2024-09-12T00:25:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.770+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9960831008994328155', time=2024-09-12T02:21:10.956857+0000, chain.objs.size()=1 2024-09-12T00:25:35.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.770+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.ICfMFPbeB1xuRutcMQlZZVn6nEObn2k_0 2024-09-12T00:25:35.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.770+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1837075375655563046', time=2024-09-12T02:21:12.538658+0000, chain.objs.size()=1 2024-09-12T00:25:35.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.770+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.C048JO1dCxPEgWvZr0cWj8VLFPjyudN_0 2024-09-12T00:25:35.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.771+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7348529066802738430', time=2024-09-12T02:21:12.540974+0000, chain.objs.size()=1 2024-09-12T00:25:35.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.771+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.Pffuajlh1A7aFOTqDFtHDVNngGJXZSS_0 2024-09-12T00:25:35.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.771+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11822714385046975596', time=2024-09-12T02:22:17.669972+0000, chain.objs.size()=1 2024-09-12T00:25:35.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.771+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.byP9Tj69sK9qcseEmfIuwAc7lV6j9sW_0 2024-09-12T00:25:35.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.771+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9600302123848732028', time=2024-09-12T02:22:20.790923+0000, chain.objs.size()=1 2024-09-12T00:25:35.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.771+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.I5kGcck3fT57W2JRhsIFEWxrKmCS2GM_0 2024-09-12T00:25:35.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.771+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5196564089079169152', time=2024-09-12T02:22:20.797345+0000, chain.objs.size()=1 2024-09-12T00:25:35.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.771+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.HFpODP1Et-otZzM90edEo2pp31_FE8d_0 2024-09-12T00:25:35.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.771+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16324873306188743434', time=2024-09-12T02:22:53.361863+0000, chain.objs.size()=1 2024-09-12T00:25:35.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.771+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.Im2gsG64OQpsacyBYm2ASXwhPJ2YCBQ_0 2024-09-12T00:25:35.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.777+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.780+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:25:35.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.781+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.781+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T00:25:35.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12655704562653855885', time=2024-09-12T02:18:15.915481+0000, chain.objs.size()=1 2024-09-12T00:25:35.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.H0U65dhJsGCBYxAD2uAYfqDvC_4btQv_0 2024-09-12T00:25:35.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6094424826494017279', time=2024-09-12T02:18:51.907657+0000, chain.objs.size()=1 2024-09-12T00:25:35.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.yzVjmm9BgKfbqNnSLdaZK720QNwsTXS_0 2024-09-12T00:25:35.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11004319172427173640', time=2024-09-12T02:19:26.424543+0000, chain.objs.size()=1 2024-09-12T00:25:35.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.sCXSljVKESNsIxUHb8MxwgH44rHGXfx_0 2024-09-12T00:25:35.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2358666496283461328', time=2024-09-12T02:20:37.637746+0000, chain.objs.size()=1 2024-09-12T00:25:35.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.vv09zQfVcOyNDRwwj0U1H4spM4qjEPM_0 2024-09-12T00:25:35.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14615250336508693695', time=2024-09-12T02:20:38.917517+0000, chain.objs.size()=1 2024-09-12T00:25:35.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.aQlOeLe2_Y-6E_uZydluV5EZlZPmEwD_0 2024-09-12T00:25:35.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18387913277321267691', time=2024-09-12T02:21:45.703709+0000, chain.objs.size()=1 2024-09-12T00:25:35.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.eS0YmiGEi_K8SNiOQoWErQ-dmOEYWX4_0 2024-09-12T00:25:35.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11049377172229595530', time=2024-09-12T02:22:20.790804+0000, chain.objs.size()=1 2024-09-12T00:25:35.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.a6e4C4aTYPBBXyb_hQzhVIMs9jUyQWi_0 2024-09-12T00:25:35.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15761559984112304760', time=2024-09-12T02:25:01.490957+0000, chain.objs.size()=1 2024-09-12T00:25:35.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.782+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17__shadow_.4jzTwHr2gLHSglHF_M76z25KwqV7Lvn_0 2024-09-12T00:25:35.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.786+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.788+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:25:35.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.790+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.790+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:25:35.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6546225208223285114', time=2024-09-12T02:17:10.396928+0000, chain.objs.size()=4 2024-09-12T00:25:35.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10__multipart_foo.2~VUFoh8XPOKbac87fYhuX_DrYUTcxIQ3.1 2024-09-12T00:25:35.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10__multipart_foo.2~VUFoh8XPOKbac87fYhuX_DrYUTcxIQ3.2 2024-09-12T00:25:35.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10__multipart_foo.2~VUFoh8XPOKbac87fYhuX_DrYUTcxIQ3.3 2024-09-12T00:25:35.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10__multipart_foo.2~VUFoh8XPOKbac87fYhuX_DrYUTcxIQ3.4 2024-09-12T00:25:35.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='_ZHx7urWTDuxvId0XNCaspnAFeKU9Adf', time=2024-09-12T02:17:10.451175+0000, chain.objs.size()=1 2024-09-12T00:25:35.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.g_tZbNPUbvbzYJUQ-esO9R6eCtIfRGF_0 2024-09-12T00:25:35.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10955790951480014717', time=2024-09-12T02:17:10.628322+0000, chain.objs.size()=1 2024-09-12T00:25:35.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7__shadow_.8yd3yXm7EkhhgyJ6ZkSEZ_ak9aV3ItX_0 2024-09-12T00:25:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5838808566970432648', time=2024-09-12T02:17:10.650786+0000, chain.objs.size()=1 2024-09-12T00:25:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8__shadow_.dlrKm5dejuFzoflRA-ZY5rj6T17m403_0 2024-09-12T00:25:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14794365745005293940', time=2024-09-12T02:18:15.908322+0000, chain.objs.size()=1 2024-09-12T00:25:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.OY_CvdbpKaJrLxJs_NDBKX-xb0iw57b_0 2024-09-12T00:25:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13312697470209603612', time=2024-09-12T02:18:50.652055+0000, chain.objs.size()=1 2024-09-12T00:25:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.J74VMlPQK9upr12CcPBGtDmBJ_gW_hi_0 2024-09-12T00:25:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4553108206182284325', time=2024-09-12T02:18:50.655107+0000, chain.objs.size()=1 2024-09-12T00:25:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.eGKx_J5DeDjcX22EcnhVjyjV-36Ayn7_0 2024-09-12T00:25:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8075006118912409088', time=2024-09-12T02:18:51.912283+0000, chain.objs.size()=1 2024-09-12T00:25:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.x6sr3y0y-je9zhHOIuWwQI42EQvaXDf_0 2024-09-12T00:25:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8604491891443615609', time=2024-09-12T02:18:51.913022+0000, chain.objs.size()=1 2024-09-12T00:25:35.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.791+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.yKYKsq1q1M_AKabGV1egtSJTqY9gdP9_0 2024-09-12T00:25:35.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.795+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15090362471316822322', time=2024-09-12T02:19:26.434284+0000, chain.objs.size()=1 2024-09-12T00:25:35.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.795+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.O7jrcDzx0TiLO3C2cG8DoZ02-kt3645_0 2024-09-12T00:25:35.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.795+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17839136368632056305', time=2024-09-12T02:19:27.711100+0000, chain.objs.size()=1 2024-09-12T00:25:35.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.795+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.v3x0OiGe7j05a6gu0uVJy6IclxAlg64_0 2024-09-12T00:25:35.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.795+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11948701927275868636', time=2024-09-12T02:20:35.848393+0000, chain.objs.size()=1 2024-09-12T00:25:35.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.795+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.nILPg6_AeFxzmcCiW-ZIXaXyuxAzfYb_0 2024-09-12T00:25:35.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.795+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.628936346715700859', time=2024-09-12T02:20:38.922807+0000, chain.objs.size()=1 2024-09-12T00:25:35.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.795+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.wMsgbjDKsCIRDOaBic5UpcJdj6qhsE6_0 2024-09-12T00:25:35.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.795+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.198509180143772145', time=2024-09-12T02:21:10.946876+0000, chain.objs.size()=1 2024-09-12T00:25:35.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.795+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.n7MK0ujy9SScbAR6tP6mJh-MtStC8c3_0 2024-09-12T00:25:35.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.795+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9615690336848207631', time=2024-09-12T02:21:45.703898+0000, chain.objs.size()=1 2024-09-12T00:25:35.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.795+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.plrq9w0157fQbeIXqo2Chirl_z-OWG__0 2024-09-12T00:25:35.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.795+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9141200728061413261', time=2024-09-12T02:21:45.713034+0000, chain.objs.size()=1 2024-09-12T00:25:35.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.795+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.aH8JfDg9AMCkKSZDRmmiCRAXPmWRSUo_0 2024-09-12T00:25:35.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.799+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.802+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:25:35.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.803+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:25:35.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='_Go59nfED_3WDg1FT_pFVkEV9kBzFluy', time=2024-09-12T02:17:10.504017+0000, chain.objs.size()=2 2024-09-12T00:25:35.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.e3tQjNShJ7L5Re0U41OLyDJzXQI9aJC_0 2024-09-12T00:25:35.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.e3tQjNShJ7L5Re0U41OLyDJzXQI9aJC_1 2024-09-12T00:25:35.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2790660346040954786', time=2024-09-12T02:18:15.905071+0000, chain.objs.size()=1 2024-09-12T00:25:35.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.h0HKe7DbrQnEz7NBzP8OcyOCN_-4Yfv_0 2024-09-12T00:25:35.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18007931224960970590', time=2024-09-12T02:18:48.678652+0000, chain.objs.size()=1 2024-09-12T00:25:35.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.qCvCOBOj9SoXFM6_Si1mW9RfKPx1HV7_0 2024-09-12T00:25:35.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3549945713915823843', time=2024-09-12T02:18:50.654084+0000, chain.objs.size()=1 2024-09-12T00:25:35.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.PybWexUqdJhdGynGwgeXGYZtG1rApcI_0 2024-09-12T00:25:35.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11864673462238016859', time=2024-09-12T02:18:51.920606+0000, chain.objs.size()=1 2024-09-12T00:25:35.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.OrKNyx9SBfYCMv1Hv9xFoL_LyQ1B8Dh_0 2024-09-12T00:25:35.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8108443078927749148', time=2024-09-12T02:19:24.641435+0000, chain.objs.size()=1 2024-09-12T00:25:35.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.WP7CnumySOX0XHxFUtgdibkLcyFjVid_0 2024-09-12T00:25:35.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4114355998551243024', time=2024-09-12T02:19:24.653792+0000, chain.objs.size()=1 2024-09-12T00:25:35.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.zYWRT8W6ZqgLDNm5bhUQIKcNpvWpq17_0 2024-09-12T00:25:35.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11412800701153481112', time=2024-09-12T02:19:26.431112+0000, chain.objs.size()=1 2024-09-12T00:25:35.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.hBMMmnSU89GaSxxHzMBlUSTk9wBlHf8_0 2024-09-12T00:25:35.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9554570990029283676', time=2024-09-12T02:20:35.852150+0000, chain.objs.size()=1 2024-09-12T00:25:35.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.uqA8UzrGu-6jmak_rhgr7MD7El6XDWc_0 2024-09-12T00:25:35.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.759092797214247641', time=2024-09-12T02:20:38.925359+0000, chain.objs.size()=1 2024-09-12T00:25:35.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.z0tdvB3yNtl0Fa2kAmVf7w0naLvGgBm_0 2024-09-12T00:25:35.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2864356022453539409', time=2024-09-12T02:21:10.945390+0000, chain.objs.size()=1 2024-09-12T00:25:35.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.804+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.qZaissU7WOskc4JiPnze3u1ma1SR8qJ_0 2024-09-12T00:25:35.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.807+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.809671554674070350', time=2024-09-12T02:22:20.796910+0000, chain.objs.size()=1 2024-09-12T00:25:35.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.807+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.fxfRUb7hmG4XQiVjjs3ExtTt99u-55G_0 2024-09-12T00:25:35.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.808+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8364190039623921071', time=2024-09-12T02:22:53.359849+0000, chain.objs.size()=1 2024-09-12T00:25:35.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.808+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.6J8s2U9wMpWf6cApLoRSnn_R2JUwY6J_0 2024-09-12T00:25:35.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.812+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.814+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:25:35.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.815+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.816+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.816+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:25:35.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.816+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18435194141957721611', time=2024-09-12T02:17:10.341767+0000, chain.objs.size()=1 2024-09-12T00:25:35.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.816+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.SUhj6XMqlLy6CfkwJ2AKlnnDW1iyCuZ_0 2024-09-12T00:25:35.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.816+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9026642825346727520', time=2024-09-12T02:17:10.509939+0000, chain.objs.size()=3 2024-09-12T00:25:35.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.816+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-LUKEWARM.2~AhGggEpNPmAOYLbKRyTstpmdWYqNeRi.1 2024-09-12T00:25:35.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.816+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-LUKEWARM.2~AhGggEpNPmAOYLbKRyTstpmdWYqNeRi.2 2024-09-12T00:25:35.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.816+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-LUKEWARM.2~AhGggEpNPmAOYLbKRyTstpmdWYqNeRi.3 2024-09-12T00:25:35.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.816+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7416679306482716358', time=2024-09-12T02:18:15.910186+0000, chain.objs.size()=1 2024-09-12T00:25:35.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.816+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.tXOzR0ci_v6thOGDReoJyHzZDwvU0QM_0 2024-09-12T00:25:35.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.816+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12644182907040238442', time=2024-09-12T02:18:16.776916+0000, chain.objs.size()=1 2024-09-12T00:25:35.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.816+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.E1sdWpRfqCKHzzcT-yS69GP_vmYz0Qu_0 2024-09-12T00:25:35.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.816+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14002712659738201200', time=2024-09-12T02:18:51.926286+0000, chain.objs.size()=1 2024-09-12T00:25:35.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.816+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.pps7aCrahui5mdHR5o42lTgnMrc0VSd_0 2024-09-12T00:25:35.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.816+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.753520654166007438', time=2024-09-12T02:20:02.666679+0000, chain.objs.size()=1 2024-09-12T00:25:35.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.817+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.Ks3_hVuQCnQ1E5i7wq0Row5E13EBVn6_0 2024-09-12T00:25:35.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.817+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7830415704392820554', time=2024-09-12T02:20:35.849770+0000, chain.objs.size()=1 2024-09-12T00:25:35.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.817+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.uw3cYgtEj_RuIIkm98XCAhE7ORJYqGs_0 2024-09-12T00:25:35.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.817+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15748436196523128096', time=2024-09-12T02:20:35.855911+0000, chain.objs.size()=1 2024-09-12T00:25:35.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.817+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.vjrMfIGTRGP5kO6Pkgw1pPoPdkg6fDz_0 2024-09-12T00:25:35.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.817+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2810707005070882264', time=2024-09-12T02:20:37.640738+0000, chain.objs.size()=1 2024-09-12T00:25:35.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.817+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.8-61XynwOlqxUvLHYfR3aVxhMgln46g_0 2024-09-12T00:25:35.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.817+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2540767551037530550', time=2024-09-12T02:21:45.700639+0000, chain.objs.size()=1 2024-09-12T00:25:35.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.817+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.KoNHS_PzssxBhOKYdpDspd5bjVWyNuz_0 2024-09-12T00:25:35.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.822+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.824+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:25:35.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.825+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.825+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:25:35.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17599000181439824352', time=2024-09-12T02:17:10.430192+0000, chain.objs.size()=1 2024-09-12T00:25:35.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.vOAufwm3RgCNFJYw6v3V51rXscFwVZh_0 2024-09-12T00:25:35.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5375310947842992831', time=2024-09-12T02:17:10.491225+0000, chain.objs.size()=3 2024-09-12T00:25:35.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-FROZEN.2~sIcHF2inUJKAFYg19ZFLRgtZXnaKUP8.1 2024-09-12T00:25:35.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-FROZEN.2~sIcHF2inUJKAFYg19ZFLRgtZXnaKUP8.2 2024-09-12T00:25:35.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-FROZEN.2~sIcHF2inUJKAFYg19ZFLRgtZXnaKUP8.3 2024-09-12T00:25:35.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7137548434544945584', time=2024-09-12T02:17:10.624243+0000, chain.objs.size()=1 2024-09-12T00:25:35.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7__shadow_.nXfEB243TQMz983ib3m_SemU9VRJpZw_0 2024-09-12T00:25:35.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7355122415036461853', time=2024-09-12T02:17:10.632441+0000, chain.objs.size()=1 2024-09-12T00:25:35.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7__shadow_.f35QEf0RqH6EEV5x_lTBKyWjEj5aPGN_0 2024-09-12T00:25:35.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14056086792767856633', time=2024-09-12T02:18:16.765610+0000, chain.objs.size()=1 2024-09-12T00:25:35.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.t9JdBmQrsBpck0vXD3We7kaXHKIqsJC_0 2024-09-12T00:25:35.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5678672357306019494', time=2024-09-12T02:19:27.725426+0000, chain.objs.size()=1 2024-09-12T00:25:35.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.DxGLOOlbF-nPQ7GUyv_rv3Xq2TQPuUT_0 2024-09-12T00:25:35.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5052421221534429718', time=2024-09-12T02:19:27.726103+0000, chain.objs.size()=1 2024-09-12T00:25:35.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.1w3-YCV5cZd7Ea_V1hPu7SLquVHjqvZ_0 2024-09-12T00:25:35.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18357970145923144493', time=2024-09-12T02:20:00.073821+0000, chain.objs.size()=1 2024-09-12T00:25:35.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.SBiIIqVO7iefXJmENG9_T2_RmXd-7z__0 2024-09-12T00:25:35.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2833279485413765100', time=2024-09-12T02:20:38.911481+0000, chain.objs.size()=1 2024-09-12T00:25:35.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.DGo-W-icrgbTGWkrblpis097mwNF8tR_0 2024-09-12T00:25:35.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1352526402296212001', time=2024-09-12T02:21:10.952262+0000, chain.objs.size()=1 2024-09-12T00:25:35.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.826+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.29XZKkC8iSegVQ65SSCd6-0NHGyXnVj_0 2024-09-12T00:25:35.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.830+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17887020934300907097', time=2024-09-12T02:21:10.958764+0000, chain.objs.size()=1 2024-09-12T00:25:35.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.830+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.C2m8aIlUMHUTh3Ml5mFdF096wLC4nSa_0 2024-09-12T00:25:35.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.830+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9037952769628169152', time=2024-09-12T02:21:44.720479+0000, chain.objs.size()=1 2024-09-12T00:25:35.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.830+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.Xi9kWy642UXdwc-9WggnnF6T_kTn1MK_0 2024-09-12T00:25:35.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.830+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6931686788379785887', time=2024-09-12T02:21:44.724803+0000, chain.objs.size()=1 2024-09-12T00:25:35.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.830+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.sAfxuP-rhs9RqfPgBmow6V2jvEqt65J_0 2024-09-12T00:25:35.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.830+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11857659343503001269', time=2024-09-12T02:21:45.703884+0000, chain.objs.size()=1 2024-09-12T00:25:35.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.830+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.lZLd09OQHY9DjkkSa3Sc81-xWoLbMNR_0 2024-09-12T00:25:35.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.830+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7661647565117042042', time=2024-09-12T02:21:46.742615+0000, chain.objs.size()=1 2024-09-12T00:25:35.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.830+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.wzQ-Vv-yXorUXEchoAx1-bIKSjAivQy_0 2024-09-12T00:25:35.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.831+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13385353911022918433', time=2024-09-12T02:22:19.458133+0000, chain.objs.size()=1 2024-09-12T00:25:35.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.831+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.jPSuN_Xt99TW6C5wEVcrV89AVa-hghe_0 2024-09-12T00:25:35.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.831+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9726930121580275035', time=2024-09-12T02:22:53.369007+0000, chain.objs.size()=1 2024-09-12T00:25:35.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.831+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.JxfbDbXxLyNvQjsAooBNYDtjLAMSKeN_0 2024-09-12T00:25:35.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.834+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.837+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:25:35.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.838+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.838+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:25:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2284166190106078535', time=2024-09-12T02:17:10.587528+0000, chain.objs.size()=2 2024-09-12T00:25:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13__shadow_.Pu6ZmHf9T_KocCr9CFhijALCm1vdlYA_0 2024-09-12T00:25:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13__shadow_.Pu6ZmHf9T_KocCr9CFhijALCm1vdlYA_1 2024-09-12T00:25:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3210585262579352857', time=2024-09-12T02:18:15.911860+0000, chain.objs.size()=1 2024-09-12T00:25:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.zqbPNjKFtophfb3s1_UwBTMVhQf9EMD_0 2024-09-12T00:25:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14012498280280496707', time=2024-09-12T02:18:16.777441+0000, chain.objs.size()=1 2024-09-12T00:25:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.ShkiewQVro9GHFo-ct0EsD4r0FgKpy__0 2024-09-12T00:25:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8633383651717392296', time=2024-09-12T02:18:50.652616+0000, chain.objs.size()=1 2024-09-12T00:25:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.TMbKJp7sS_oRUeH60UnLcL7NYJBm9Xx_0 2024-09-12T00:25:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6933556838216860482', time=2024-09-12T02:18:51.923737+0000, chain.objs.size()=1 2024-09-12T00:25:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.T89xGhhzFWprfU1GFCzm2dLs1jXqsr8_0 2024-09-12T00:25:35.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14750798769799977151', time=2024-09-12T02:19:24.636903+0000, chain.objs.size()=1 2024-09-12T00:25:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_._xgydayR2gg84Ly0m_9P54kt7UQhw1T_0 2024-09-12T00:25:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6410446049630814985', time=2024-09-12T02:19:24.642537+0000, chain.objs.size()=1 2024-09-12T00:25:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.JPSdO3aNe1oRAyD6KumEcFPFlFI411u_0 2024-09-12T00:25:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11661779472719031358', time=2024-09-12T02:20:00.069290+0000, chain.objs.size()=1 2024-09-12T00:25:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.8BEJRgiQGztnWNVpaygKbU5gBI8Hhd5_0 2024-09-12T00:25:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8235444404580559840', time=2024-09-12T02:20:38.916848+0000, chain.objs.size()=1 2024-09-12T00:25:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.CkJ19ctmpxVZ1CTvLW7Z_G6RJDG8eBY_0 2024-09-12T00:25:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12044223960768913069', time=2024-09-12T02:20:38.924676+0000, chain.objs.size()=1 2024-09-12T00:25:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.o_pFwKkzrHsHfNpfQj-vmbkIk1AcXqv_0 2024-09-12T00:25:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16775389907852122933', time=2024-09-12T02:21:10.953801+0000, chain.objs.size()=1 2024-09-12T00:25:35.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.839+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.J_aaeAEh9jeZl5PwyJIBo0CmA45CI2k_0 2024-09-12T00:25:35.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.842+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2756261546342671044', time=2024-09-12T02:21:10.955829+0000, chain.objs.size()=1 2024-09-12T00:25:35.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.842+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.InuVSYeCQ5pceVdWGL1SF6fCb8QcJbM_0 2024-09-12T00:25:35.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.842+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9747596287245916659', time=2024-09-12T02:21:12.541892+0000, chain.objs.size()=1 2024-09-12T00:25:35.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.842+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.x0CQicmJiIPmm1HvFXSwIgQrs2cZ_DC_0 2024-09-12T00:25:35.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.843+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15351826430409307463', time=2024-09-12T02:21:13.808824+0000, chain.objs.size()=1 2024-09-12T00:25:35.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.843+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.iJRyOLMkd7rA-PIdsSxUrZTLUT2lZ0S_0 2024-09-12T00:25:35.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.846+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15095730148699431942', time=2024-09-12T02:21:44.723597+0000, chain.objs.size()=1 2024-09-12T00:25:35.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.846+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.E9Kkju7vjDh4IVTBDfQG7EV6h6viZgC_0 2024-09-12T00:25:35.844 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.846+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12671760989746836933', time=2024-09-12T02:22:19.444156+0000, chain.objs.size()=1 2024-09-12T00:25:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.846+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.v4cZBRsFjJiWe6QZ9ob6Rf--0hTb-bS_0 2024-09-12T00:25:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.846+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7988100784957534143', time=2024-09-12T02:22:19.445362+0000, chain.objs.size()=1 2024-09-12T00:25:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.846+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.dBWPoYHW6QuJymDICf8_vPXABrqJrBa_0 2024-09-12T00:25:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.846+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8199944514827441731', time=2024-09-12T02:22:20.790891+0000, chain.objs.size()=1 2024-09-12T00:25:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.846+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.sEW8LVq7fk9AGAfWaeLKxq5GtQBQyAT_0 2024-09-12T00:25:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.846+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2616146539237815506', time=2024-09-12T02:22:53.364619+0000, chain.objs.size()=1 2024-09-12T00:25:35.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.846+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.9z9MA09hZWPx3QcN0njyqdsDkV2tLhZ_0 2024-09-12T00:25:35.848 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.850+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.853+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:25:35.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.854+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.854+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T00:25:35.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13642781602211229377', time=2024-09-12T02:17:10.350649+0000, chain.objs.size()=1 2024-09-12T00:25:35.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.r8RlORvEtOF_RwhsHaRoeSAFNAdUo88_0 2024-09-12T00:25:35.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14191655741130967598', time=2024-09-12T02:18:50.645530+0000, chain.objs.size()=1 2024-09-12T00:25:35.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.EFeXuIXn-hiON6Elyr8lTXxk3aCJhdk_0 2024-09-12T00:25:35.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7510331908618799854', time=2024-09-12T02:18:51.920684+0000, chain.objs.size()=1 2024-09-12T00:25:35.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.ZCbdOXuOb60akFxT60k0Ja225qCO0fW_0 2024-09-12T00:25:35.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11628899518486221332', time=2024-09-12T02:18:53.340237+0000, chain.objs.size()=1 2024-09-12T00:25:35.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.N28MAGXKob2JnZ4n-M_h30S4bjgEwz3_0 2024-09-12T00:25:35.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2527084343875314680', time=2024-09-12T02:19:24.638734+0000, chain.objs.size()=1 2024-09-12T00:25:35.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.gIUGGtH7K-rTNpuXgAXk6dgGuO9shfT_0 2024-09-12T00:25:35.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12763334530121739444', time=2024-09-12T02:20:00.078684+0000, chain.objs.size()=1 2024-09-12T00:25:35.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.__X7zUl1bhI9kN_HkEQXYsJXA7x9jpr_0 2024-09-12T00:25:35.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15269570125695381182', time=2024-09-12T02:22:19.444586+0000, chain.objs.size()=1 2024-09-12T00:25:35.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.BogUItiGzfceERQ982abxm0zQX_OwGO_0 2024-09-12T00:25:35.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1885230758311540762', time=2024-09-12T02:22:53.364411+0000, chain.objs.size()=1 2024-09-12T00:25:35.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.855+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.A19T2_MdMGts0sfoY1_b6qoVjDdqgAa_0 2024-09-12T00:25:35.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.859+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.861+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:25:35.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.862+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:25:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13287149950113972360', time=2024-09-12T02:17:10.447125+0000, chain.objs.size()=1 2024-09-12T00:25:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.IJCw_FVUPsZv_rripl9Nn8Y2TRjwCmW_0 2024-09-12T00:25:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1194118301278931954', time=2024-09-12T02:17:10.540389+0000, chain.objs.size()=3 2024-09-12T00:25:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-STANDARD.2~aHqUWSYdKe1S-x9yY0MsASwii3H_QZY.1 2024-09-12T00:25:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-STANDARD.2~aHqUWSYdKe1S-x9yY0MsASwii3H_QZY.2 2024-09-12T00:25:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-STANDARD.2~aHqUWSYdKe1S-x9yY0MsASwii3H_QZY.3 2024-09-12T00:25:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9347209589677660627', time=2024-09-12T02:17:10.658995+0000, chain.objs.size()=1 2024-09-12T00:25:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8__shadow_.W27yP5R8zu6ROttOWO8OrxsvW2w8Hmn_0 2024-09-12T00:25:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9452521517238918843', time=2024-09-12T02:18:16.766351+0000, chain.objs.size()=1 2024-09-12T00:25:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.AWyDiUqVnyJw0UbdLaG4ziD5VAzh7U3_0 2024-09-12T00:25:35.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1934539909208481741', time=2024-09-12T02:19:24.637125+0000, chain.objs.size()=1 2024-09-12T00:25:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_._8hBEVtdlCiuwpN9iLF0KxozT9i1qUO_0 2024-09-12T00:25:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17172710391388397981', time=2024-09-12T02:19:28.954946+0000, chain.objs.size()=1 2024-09-12T00:25:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.QBi4zah8JervJJUYlhuC20nVj1Qsj3D_0 2024-09-12T00:25:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4032387226967986625', time=2024-09-12T02:20:00.079232+0000, chain.objs.size()=1 2024-09-12T00:25:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.FS_O5ftVzh9NG43zKkWRpqIuCXZVJjW_0 2024-09-12T00:25:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13855311510015931756', time=2024-09-12T02:20:02.675616+0000, chain.objs.size()=1 2024-09-12T00:25:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.cq6hpHBzAFc9d_SmJpqQwUW_tdf5XFN_0 2024-09-12T00:25:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15138561100336939358', time=2024-09-12T02:20:02.676508+0000, chain.objs.size()=1 2024-09-12T00:25:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.V3eKVhfq6PGpAizxB3rXpNohXIkxV3x_0 2024-09-12T00:25:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13643530027594138019', time=2024-09-12T02:21:12.542143+0000, chain.objs.size()=1 2024-09-12T00:25:35.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.863+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.8PgauIuN-7WZZAse1cAopcWzije1nAl_0 2024-09-12T00:25:35.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.865+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4445832864054240080', time=2024-09-12T02:21:12.542996+0000, chain.objs.size()=1 2024-09-12T00:25:35.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.865+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.sJA4e_W13tQDcwU8ZuD0r_WFyDWLqTf_0 2024-09-12T00:25:35.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.867+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13452736017708313732', time=2024-09-12T02:22:19.442166+0000, chain.objs.size()=1 2024-09-12T00:25:35.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.867+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.CgRwDQjCjXNAzEUW2ITFA07tMHEWf2c_0 2024-09-12T00:25:35.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.870+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.872+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:25:35.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.874+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.872 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.874+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:25:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17687791948512763441', time=2024-09-12T02:18:48.682968+0000, chain.objs.size()=1 2024-09-12T00:25:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.13V9PL_imrG6YaSgae01pHWW-jJ0EMo_0 2024-09-12T00:25:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7390139117187621350', time=2024-09-12T02:18:50.659689+0000, chain.objs.size()=1 2024-09-12T00:25:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.QaNRhGPxcm30RHrxhwsF800hr3T7l4I_0 2024-09-12T00:25:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10010459005726044209', time=2024-09-12T02:19:26.423298+0000, chain.objs.size()=1 2024-09-12T00:25:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.Zv2MVCAl-0TQFvOVf2uOfWUKhE-8gNj_0 2024-09-12T00:25:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8222603517963575937', time=2024-09-12T02:20:00.067058+0000, chain.objs.size()=1 2024-09-12T00:25:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.Ekdo05NG7mH82C7eBawL4NPz7BcGGya_0 2024-09-12T00:25:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9632176579714372076', time=2024-09-12T02:20:00.073592+0000, chain.objs.size()=1 2024-09-12T00:25:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.eCv-49y_Fjqivi1kUoE-n9pPnja--2v_0 2024-09-12T00:25:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.49453845182480019', time=2024-09-12T02:20:03.910638+0000, chain.objs.size()=1 2024-09-12T00:25:35.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.liGZAb2Ftg2ySmTTwWR7opFcTHTp8NB_0 2024-09-12T00:25:35.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14113391089999304439', time=2024-09-12T02:20:37.633138+0000, chain.objs.size()=1 2024-09-12T00:25:35.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.M7YIl0FTyPN4zuXnEn8iyudH1tiVWPO_0 2024-09-12T00:25:35.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9449367659418433217', time=2024-09-12T02:20:37.639864+0000, chain.objs.size()=1 2024-09-12T00:25:35.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.1xDwzTGfev5FNLR7ria26lX6gnwHyQA_0 2024-09-12T00:25:35.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7796612174640138400', time=2024-09-12T02:20:37.647426+0000, chain.objs.size()=1 2024-09-12T00:25:35.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.W0hDvzosre0KcOARN2oSsrnCyapyu38_0 2024-09-12T00:25:35.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.136810444145079731', time=2024-09-12T02:21:44.723090+0000, chain.objs.size()=1 2024-09-12T00:25:35.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.Q3pFn50_ZS5ylZM3K1XTMNxM928deh3_0 2024-09-12T00:25:35.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15508978752619105841', time=2024-09-12T02:21:45.700739+0000, chain.objs.size()=1 2024-09-12T00:25:35.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.6IQzjC0golgMl1pGxSo_6GiaQje2bew_0 2024-09-12T00:25:35.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9609809696769875360', time=2024-09-12T02:22:20.783144+0000, chain.objs.size()=1 2024-09-12T00:25:35.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.875+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.EbnZ9Clge7Abr17zUJ42MGZgteRdooH_0 2024-09-12T00:25:35.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.878+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4176964765784450495', time=2024-09-12T02:22:53.354344+0000, chain.objs.size()=1 2024-09-12T00:25:35.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.878+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.ziAQ0iw56CR-MmFJ2ViGUZY2LgZTrFU_0 2024-09-12T00:25:35.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.878+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14525973363183370174', time=2024-09-12T02:22:53.357471+0000, chain.objs.size()=1 2024-09-12T00:25:35.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.878+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.pJ4XWksUzWy4veHl7AaQDbhX3jryKyK_0 2024-09-12T00:25:35.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.882+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.885+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:25:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.886+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:25:35.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18061739891822321467', time=2024-09-12T02:17:10.434349+0000, chain.objs.size()=1 2024-09-12T00:25:35.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.vOAufwm3RgCNFJYw6v3V51rXscFwVZh_0 2024-09-12T00:25:35.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13834011262628984668', time=2024-09-12T02:18:15.913813+0000, chain.objs.size()=1 2024-09-12T00:25:35.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.E6buE1ulJ5AfoHA78dMTrgEz6XcDrCZ_0 2024-09-12T00:25:35.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4178203076823247462', time=2024-09-12T02:18:48.692932+0000, chain.objs.size()=1 2024-09-12T00:25:35.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.dYKgGpOZ2pDa0q1sj8lZvMlKgWsEhF8_0 2024-09-12T00:25:35.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15699775081805419368', time=2024-09-12T02:19:24.644049+0000, chain.objs.size()=1 2024-09-12T00:25:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.WF9b03B0rQtMrN4hI9750AwR3zN2atW_0 2024-09-12T00:25:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5547298130168007331', time=2024-09-12T02:19:27.718361+0000, chain.objs.size()=1 2024-09-12T00:25:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.izn2Bpyys4U7f6ZXX6AauBcukI6k-L6_0 2024-09-12T00:25:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2045005174279602488', time=2024-09-12T02:20:00.075414+0000, chain.objs.size()=1 2024-09-12T00:25:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.7uivmPycuBRA4wXTq_A7kmKvNCLIE_3_0 2024-09-12T00:25:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7508688785154593769', time=2024-09-12T02:20:00.077351+0000, chain.objs.size()=1 2024-09-12T00:25:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.5QFV0V8ybvzgDU5eIzWNI7CfGj6MqJP_0 2024-09-12T00:25:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1115286699290140918', time=2024-09-12T02:20:37.637065+0000, chain.objs.size()=1 2024-09-12T00:25:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.5tlfdpsLEm6flUu0Y9G2ytnQ0-EgfK9_0 2024-09-12T00:25:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3517197102958236556', time=2024-09-12T02:20:37.637988+0000, chain.objs.size()=1 2024-09-12T00:25:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.aAxCvjeDiaQ1U7yGqBv5BBzMi_bgNkm_0 2024-09-12T00:25:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1093776456423896773', time=2024-09-12T02:20:37.639481+0000, chain.objs.size()=1 2024-09-12T00:25:35.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.CBBqtLz0ogSNVnJOXhfDtbfyZlUiJw9_0 2024-09-12T00:25:35.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.142719195004358578', time=2024-09-12T02:22:17.656351+0000, chain.objs.size()=1 2024-09-12T00:25:35.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.vbDTqvo2HhKUEioM1UpBNY6Q3GyUx5m_0 2024-09-12T00:25:35.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12368193076640249790', time=2024-09-12T02:22:19.451863+0000, chain.objs.size()=1 2024-09-12T00:25:35.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.887+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.l7EnqmjFaYQVe_XvQN_NSpX-Hyidutq_0 2024-09-12T00:25:35.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.891+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14526574053420131940', time=2024-09-12T02:22:19.459178+0000, chain.objs.size()=1 2024-09-12T00:25:35.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.891+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.lNIaG4e7Kbum-SrqOQ3MrOELQ-BvkUF_0 2024-09-12T00:25:35.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.891+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13382259940547565618', time=2024-09-12T02:25:01.490242+0000, chain.objs.size()=1 2024-09-12T00:25:35.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.891+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17__shadow_.PULlJq7YK__FYjRlAEdhIMSXRtDTBGx_0 2024-09-12T00:25:35.892 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.894+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.897+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:25:35.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.898+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T00:25:35.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='_iufA0rYOorKmORSnaD8JpTS2e2oN93X', time=2024-09-12T02:17:10.472633+0000, chain.objs.size()=1 2024-09-12T00:25:35.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.pOLjBZ7giBOvNsfxS_CW9MRaqgcBPzf_0 2024-09-12T00:25:35.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='_YbHyWBFZqUuPb4sLazkOzQgLcK68-M8', time=2024-09-12T02:17:10.499823+0000, chain.objs.size()=2 2024-09-12T00:25:35.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.GSuJlOUWZr3hyscZAwirvpfS5A7kwyc_0 2024-09-12T00:25:35.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.GSuJlOUWZr3hyscZAwirvpfS5A7kwyc_1 2024-09-12T00:25:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9314605642940589232', time=2024-09-12T02:18:15.915223+0000, chain.objs.size()=1 2024-09-12T00:25:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.HLIBuiFdABz6wsxdmkHq5-l8gTb_5Xr_0 2024-09-12T00:25:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9922085638313897175', time=2024-09-12T02:18:15.925565+0000, chain.objs.size()=1 2024-09-12T00:25:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.8VOX5KkaVCzejjFAoRTql0TehRPfsNP_0 2024-09-12T00:25:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2939206835064875856', time=2024-09-12T02:18:50.647167+0000, chain.objs.size()=1 2024-09-12T00:25:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.YTGQYcpd_z-HJ1ymKpZH3eGOXaAsSSl_0 2024-09-12T00:25:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1465925152986315614', time=2024-09-12T02:18:50.659171+0000, chain.objs.size()=1 2024-09-12T00:25:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.xqwHVF3xOsVNbyy7_3FJ-SwKwFT_v95_0 2024-09-12T00:25:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15749436727721733479', time=2024-09-12T02:18:51.924857+0000, chain.objs.size()=1 2024-09-12T00:25:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.5u0Zx3_K2tTmANGAknyVNrd6AJCeThZ_0 2024-09-12T00:25:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7984015128837941852', time=2024-09-12T02:19:27.710841+0000, chain.objs.size()=1 2024-09-12T00:25:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.TXWdxXcgXZez4OcRUxOR5dq_55qv9eJ_0 2024-09-12T00:25:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1368058463466031356', time=2024-09-12T02:20:00.084939+0000, chain.objs.size()=1 2024-09-12T00:25:35.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.oJoBzhbQ372Ap05yq9R3bz_CFBsJ5Z9_0 2024-09-12T00:25:35.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17802148654057491259', time=2024-09-12T02:20:35.840926+0000, chain.objs.size()=1 2024-09-12T00:25:35.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.fGQDgRN9NzTFBynt4wffYHz6UmYBcVs_0 2024-09-12T00:25:35.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7275180699195916138', time=2024-09-12T02:20:35.852896+0000, chain.objs.size()=1 2024-09-12T00:25:35.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.899+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.t-ITstjqeSCidjlhz5AnhDNZTWEminU_0 2024-09-12T00:25:35.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.901+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18401024641620323750', time=2024-09-12T02:20:37.638488+0000, chain.objs.size()=1 2024-09-12T00:25:35.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.901+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.goljQamn92RD4f3IOMj9dWaRyASqcpz_0 2024-09-12T00:25:35.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17534707041553709572', time=2024-09-12T02:21:12.540309+0000, chain.objs.size()=1 2024-09-12T00:25:35.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.tW3cR0lXL0c_4gTYgsoiOf6chlOk4aR_0 2024-09-12T00:25:35.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10646659573374517944', time=2024-09-12T02:21:45.371393+0000, chain.objs.size()=1 2024-09-12T00:25:35.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.7B5d0WBzdmpwiMEBvs60XSaRSOdYRKN_0 2024-09-12T00:25:35.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18207152681612526028', time=2024-09-12T02:22:17.657051+0000, chain.objs.size()=1 2024-09-12T00:25:35.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.sG5KK0-SF4P8r8w2whdIbJR1fccGDWJ_0 2024-09-12T00:25:35.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17662384224254121130', time=2024-09-12T02:22:17.657906+0000, chain.objs.size()=1 2024-09-12T00:25:35.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.z0yIW5A4o66SVdin3_qV4SFgag1-gZu_0 2024-09-12T00:25:35.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5618870940105170675', time=2024-09-12T02:22:19.449880+0000, chain.objs.size()=1 2024-09-12T00:25:35.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.BBJYReO_siFOCqGerAhERb3iQgAaIlr_0 2024-09-12T00:25:35.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5759068812810006124', time=2024-09-12T02:22:20.789328+0000, chain.objs.size()=1 2024-09-12T00:25:35.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.Ei_84rOwC29YLpwvjWctvqCw_vM3eX6_0 2024-09-12T00:25:35.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12425142636861834726', time=2024-09-12T02:22:20.798336+0000, chain.objs.size()=1 2024-09-12T00:25:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.IY2PG-da59djXtA1OjERREzsB9mWAw3_0 2024-09-12T00:25:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14833770385439826814', time=2024-09-12T02:22:21.832246+0000, chain.objs.size()=1 2024-09-12T00:25:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.J--eZFTf_CCjVM50M36_lnwPfXNwK7Q_0 2024-09-12T00:25:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10869514117892751082', time=2024-09-12T02:22:53.352378+0000, chain.objs.size()=1 2024-09-12T00:25:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.H3eEQHH7-W1GNtn82Yl5YhvpZRJAvlL_0 2024-09-12T00:25:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18087836227133755011', time=2024-09-12T02:22:53.355874+0000, chain.objs.size()=1 2024-09-12T00:25:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.q22ceLVV615m8mkF4YLO2tLmc0kaweS_0 2024-09-12T00:25:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.648170370099158189', time=2024-09-12T02:25:01.489982+0000, chain.objs.size()=1 2024-09-12T00:25:35.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.905+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17__shadow_.0PAA236iskNr90iEkCMnyx6_rDmF2rs_0 2024-09-12T00:25:35.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.911+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.913+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:25:35.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.914+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:25:35.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13840641934420598038', time=2024-09-12T02:17:10.324209+0000, chain.objs.size()=1 2024-09-12T00:25:35.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.RNU8REt_6IgJ-SE18x8k7LSHOO1IG1C_0 2024-09-12T00:25:35.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13518644535352781837', time=2024-09-12T02:18:16.785192+0000, chain.objs.size()=1 2024-09-12T00:25:35.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.eAQ6M8MO10LGwP_jzabVrPFcUztuyUZ_0 2024-09-12T00:25:35.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10438315227705482323', time=2024-09-12T02:18:50.648053+0000, chain.objs.size()=1 2024-09-12T00:25:35.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.QWZc0WR5_CJzPnkwC0-tR8G_38qTg8p_0 2024-09-12T00:25:35.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14216929323921296911', time=2024-09-12T02:20:01.329984+0000, chain.objs.size()=1 2024-09-12T00:25:35.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.sLjRchViBFiqmtpwivN-AqW99qb7Jm3_0 2024-09-12T00:25:35.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7124719142282907428', time=2024-09-12T02:20:35.842772+0000, chain.objs.size()=1 2024-09-12T00:25:35.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.EDXVN1lIMXmt_CL8FIj0HKtzPKUyfy-_0 2024-09-12T00:25:35.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4462054844104643351', time=2024-09-12T02:20:37.650543+0000, chain.objs.size()=1 2024-09-12T00:25:35.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.AeGsjp38qZbj9vEpw9KcXZkoLgdM7ch_0 2024-09-12T00:25:35.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15267111278479070341', time=2024-09-12T02:21:11.804940+0000, chain.objs.size()=1 2024-09-12T00:25:35.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.tB1K9aDdD6mKgBlsky-5pmjg1-UPwED_0 2024-09-12T00:25:35.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5584938519522783108', time=2024-09-12T02:21:44.721724+0000, chain.objs.size()=1 2024-09-12T00:25:35.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.Z52bVcpBDLOfd4YLSK1fCve2c4qa1dY_0 2024-09-12T00:25:35.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4737690442157426007', time=2024-09-12T02:21:44.735148+0000, chain.objs.size()=1 2024-09-12T00:25:35.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.5knU8sBjc-gndWag4eODAw0puVLBWut_0 2024-09-12T00:25:35.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7122498384146819791', time=2024-09-12T02:22:19.449891+0000, chain.objs.size()=1 2024-09-12T00:25:35.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.gtpxSDH_NgrJpYPJ0RUdmaUnBEQpN71_0 2024-09-12T00:25:35.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16569871088659296962', time=2024-09-12T02:22:19.453837+0000, chain.objs.size()=1 2024-09-12T00:25:35.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.OspXFUWUthqSh3xoC4pL2lK0vfOn6s2_0 2024-09-12T00:25:35.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6161171835690426458', time=2024-09-12T02:22:53.361894+0000, chain.objs.size()=1 2024-09-12T00:25:35.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.915+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.CDxv93bwmRHPRNNmF457mjdvUy4__5R_0 2024-09-12T00:25:35.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.922+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.924+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:25:35.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.926+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.924 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.926+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.926+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:25:35.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.926+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7037082653143750061', time=2024-09-12T02:17:10.563786+0000, chain.objs.size()=3 2024-09-12T00:25:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.926+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-STANDARD.2~fofVkMmtQN04LDrtJ5q3TDVOcUx4U6c.1 2024-09-12T00:25:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.926+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-STANDARD.2~fofVkMmtQN04LDrtJ5q3TDVOcUx4U6c.2 2024-09-12T00:25:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.926+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14__multipart_foo-STANDARD.2~fofVkMmtQN04LDrtJ5q3TDVOcUx4U6c.3 2024-09-12T00:25:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.926+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9183430289377028039', time=2024-09-12T02:18:48.687022+0000, chain.objs.size()=1 2024-09-12T00:25:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.926+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.TW4fuzuXqmKRUHOmwFRvdd96YEbakVO_0 2024-09-12T00:25:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13460076056144596579', time=2024-09-12T02:18:50.648402+0000, chain.objs.size()=1 2024-09-12T00:25:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.Lp9q--qSjUvGzU3yEOVS_fBiJu7ARvh_0 2024-09-12T00:25:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2349925172999003344', time=2024-09-12T02:19:24.650563+0000, chain.objs.size()=1 2024-09-12T00:25:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.OECNrq1kWAhdG3wBzR7mYix5SIozRNh_0 2024-09-12T00:25:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7478700646441976597', time=2024-09-12T02:19:24.656317+0000, chain.objs.size()=1 2024-09-12T00:25:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.93oi4pnjBP-wJeBGXNXX-bRvp9_70ai_0 2024-09-12T00:25:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14348110546603579346', time=2024-09-12T02:19:26.437764+0000, chain.objs.size()=1 2024-09-12T00:25:35.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_._cOGe03xGgNymkuIvV8ExMia_sjgV1f_0 2024-09-12T00:25:35.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6409674555798023411', time=2024-09-12T02:19:27.716651+0000, chain.objs.size()=1 2024-09-12T00:25:35.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.fzPGoZEbWDAg1iKczw7XLLTa-weURxE_0 2024-09-12T00:25:35.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6416120022855552348', time=2024-09-12T02:20:02.668380+0000, chain.objs.size()=1 2024-09-12T00:25:35.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.rYtS6-iWuwVY4Nze9FePE_HWEAtv-fQ_0 2024-09-12T00:25:35.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16330360876374143591', time=2024-09-12T02:20:02.669162+0000, chain.objs.size()=1 2024-09-12T00:25:35.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.K2iuduKidZTlE6qC9HPJpkP6y4dKVFo_0 2024-09-12T00:25:35.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3957512010161502286', time=2024-09-12T02:20:02.669950+0000, chain.objs.size()=1 2024-09-12T00:25:35.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.927+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.Rnq7XlDb9Xb1S_M6vcbD-gbeJ3tLdC4_0 2024-09-12T00:25:35.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.930+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17420561619988550612', time=2024-09-12T02:20:02.670725+0000, chain.objs.size()=1 2024-09-12T00:25:35.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.930+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.1CridlVTt3WuoPWSs5sfSrBKZWoZN9s_0 2024-09-12T00:25:35.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.931+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5401114967540264468', time=2024-09-12T02:22:17.661576+0000, chain.objs.size()=1 2024-09-12T00:25:35.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.931+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.wVIbZQUVyKdX4GfH_0eH_e00724tWQB_0 2024-09-12T00:25:35.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.931+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15408070397144518842', time=2024-09-12T02:25:01.489975+0000, chain.objs.size()=1 2024-09-12T00:25:35.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.931+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17__shadow_.rl2zXOYTcRhjuOF8NzBUOa50xJ6IaO3_0 2024-09-12T00:25:35.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.934+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.937+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:25:35.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.938+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:25:35.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='_Hm1Yd-yS5lbUgZE9EDbNA7HA95WfOcP', time=2024-09-12T02:17:10.459711+0000, chain.objs.size()=1 2024-09-12T00:25:35.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.Q1Gy028-ru7pmDgNtJUO7DDsnf3Hul9_0 2024-09-12T00:25:35.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7730571411770257296', time=2024-09-12T02:18:50.645299+0000, chain.objs.size()=1 2024-09-12T00:25:35.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.xW6I1T3q_Fkaf1rhUFmNpv0tyyc5bK3_0 2024-09-12T00:25:35.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17525232125671955011', time=2024-09-12T02:18:51.909925+0000, chain.objs.size()=1 2024-09-12T00:25:35.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.CZ2fvOgadJIAe7e-5NCL4X9-Fw60UvZ_0 2024-09-12T00:25:35.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15287700675298518121', time=2024-09-12T02:20:00.085193+0000, chain.objs.size()=1 2024-09-12T00:25:35.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.OFq9hvxQiqpY8w6wFHePa44CTktJj0F_0 2024-09-12T00:25:35.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15143359391596907399', time=2024-09-12T02:20:02.671404+0000, chain.objs.size()=1 2024-09-12T00:25:35.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.0m8OSqOYIK5ZO9gnj8tLRFcKyxR-Tpu_0 2024-09-12T00:25:35.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2177134213466887321', time=2024-09-12T02:20:37.642640+0000, chain.objs.size()=1 2024-09-12T00:25:35.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.X6vVLDdkeyThaCDN2V6AVFe6_8ibhLR_0 2024-09-12T00:25:35.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1882403597587503185', time=2024-09-12T02:21:44.718602+0000, chain.objs.size()=1 2024-09-12T00:25:35.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.I0N36r4as5rX0KVBIMZwsHBp53PPyNJ_0 2024-09-12T00:25:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13867491125408391569', time=2024-09-12T02:21:45.701844+0000, chain.objs.size()=1 2024-09-12T00:25:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.c7hqtPULBD7JTePKyAyQMIFFHiTJ1l5_0 2024-09-12T00:25:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10562964026741909751', time=2024-09-12T02:21:45.702595+0000, chain.objs.size()=1 2024-09-12T00:25:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.jsgMQyEfThUjpRLFLsehFGbzt8vpEXd_0 2024-09-12T00:25:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16791695167970110350', time=2024-09-12T02:22:17.658292+0000, chain.objs.size()=1 2024-09-12T00:25:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.sGCZcR4fBuEumDGeqbfGwHL1MRdlGzU_0 2024-09-12T00:25:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2976261418508546416', time=2024-09-12T02:22:19.456855+0000, chain.objs.size()=1 2024-09-12T00:25:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.6-y_43Szc8IJmoUX7lmj_8SyZ4Eceka_0 2024-09-12T00:25:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1149858636917463685', time=2024-09-12T02:22:20.786462+0000, chain.objs.size()=1 2024-09-12T00:25:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.939+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.o_xckg1VaE-w3-TD4dGDUbR80DD1AyY_0 2024-09-12T00:25:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.942+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8990356271817601039', time=2024-09-12T02:22:53.351392+0000, chain.objs.size()=1 2024-09-12T00:25:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.942+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.cC1TpDssR_d6tiiHfwlMfRKFEnLoito_0 2024-09-12T00:25:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.943+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4727197761385913932', time=2024-09-12T02:22:53.364543+0000, chain.objs.size()=1 2024-09-12T00:25:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.943+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.KtrkzwNQKA8ztJOyPq4UWrfqShpG6LD_0 2024-09-12T00:25:35.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.946+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.949+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:25:35.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.950+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.950+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T00:25:35.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8194616003558093925', time=2024-09-12T02:17:10.328593+0000, chain.objs.size()=1 2024-09-12T00:25:35.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4__shadow_.tmCjtk36IWcX3-GyGZHKoSF22vwDViu_0 2024-09-12T00:25:35.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15381223345067176499', time=2024-09-12T02:17:10.518094+0000, chain.objs.size()=3 2024-09-12T00:25:35.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-LUKEWARM.2~AhGggEpNPmAOYLbKRyTstpmdWYqNeRi.1 2024-09-12T00:25:35.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-LUKEWARM.2~AhGggEpNPmAOYLbKRyTstpmdWYqNeRi.2 2024-09-12T00:25:35.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__multipart_foo-LUKEWARM.2~AhGggEpNPmAOYLbKRyTstpmdWYqNeRi.3 2024-09-12T00:25:35.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9509134759562043096', time=2024-09-12T02:18:48.688333+0000, chain.objs.size()=1 2024-09-12T00:25:35.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.TA-M6XR3Om9WBZVyUeWZhxU3Uk_Ky63_0 2024-09-12T00:25:35.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11213329625491753507', time=2024-09-12T02:18:51.906237+0000, chain.objs.size()=1 2024-09-12T00:25:35.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.y-ETuF7xV4mvV5-xa7VtUM-G0iJoX7e_0 2024-09-12T00:25:35.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1630993284273885187', time=2024-09-12T02:19:24.640754+0000, chain.objs.size()=1 2024-09-12T00:25:35.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.iauQ6gQn6b-TNHwAFtBaC2CCegQgsmW_0 2024-09-12T00:25:35.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4161807278086161565', time=2024-09-12T02:19:26.419658+0000, chain.objs.size()=1 2024-09-12T00:25:35.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.JJnK7Wz9WndGU3GNMyY4KFGTCkXfiHn_0 2024-09-12T00:25:35.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18412661764038298097', time=2024-09-12T02:19:27.718464+0000, chain.objs.size()=1 2024-09-12T00:25:35.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.Kwoyhrw6nGClywfDOUu8eGiH5IS5sur_0 2024-09-12T00:25:35.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1270412156884752123', time=2024-09-12T02:19:27.719368+0000, chain.objs.size()=1 2024-09-12T00:25:35.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.dfp0JMHJUkBHX_LiNU0AcmWgL9PFpSr_0 2024-09-12T00:25:35.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10905713190843407349', time=2024-09-12T02:20:38.916738+0000, chain.objs.size()=1 2024-09-12T00:25:35.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.7q8GbkddKfchROfF8UjKpmMdJHCE96Z_0 2024-09-12T00:25:35.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11004265706108395299', time=2024-09-12T02:21:10.954505+0000, chain.objs.size()=1 2024-09-12T00:25:35.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.951+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.r0trJmyW8V6AuomDKQpyqlIRZkZ4IGW_0 2024-09-12T00:25:35.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.954+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13936088053772628921', time=2024-09-12T02:21:10.955683+0000, chain.objs.size()=1 2024-09-12T00:25:35.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.954+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.y-UJKypLyEN4HJ2sz3M-5S40-9XvM9r_0 2024-09-12T00:25:35.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.954+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13264540736775824153', time=2024-09-12T02:21:10.957084+0000, chain.objs.size()=1 2024-09-12T00:25:35.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.954+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.s7mqX04LAvTKt1nsi42PG9fK0DdecAk_0 2024-09-12T00:25:35.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.955+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14104821751436142219', time=2024-09-12T02:21:10.959649+0000, chain.objs.size()=1 2024-09-12T00:25:35.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.955+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.0Tvwy4P2t9u4UVg0qLwxm0eaQ5ruGz7_0 2024-09-12T00:25:35.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.955+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12043183292786824310', time=2024-09-12T02:21:12.533061+0000, chain.objs.size()=1 2024-09-12T00:25:35.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.955+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.zGgSFYiv_YoIlSBpRUvWbyW-6_sYhMt_0 2024-09-12T00:25:35.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.955+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.993761998012921442', time=2024-09-12T02:21:44.722847+0000, chain.objs.size()=1 2024-09-12T00:25:35.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.955+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.e2qsxC-3rb-mtlCf52c7EqbFFkk8ZaO_0 2024-09-12T00:25:35.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.955+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4437062317583617672', time=2024-09-12T02:21:44.725148+0000, chain.objs.size()=1 2024-09-12T00:25:35.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.955+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.FY4gjGpqh-VX4sEtjUAY1D-AGw00wGG_0 2024-09-12T00:25:35.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.955+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17280351828656201013', time=2024-09-12T02:21:44.726176+0000, chain.objs.size()=1 2024-09-12T00:25:35.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.955+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.XvdtyP1-fxxlUS1yReHZMbSe4XH-W-4_0 2024-09-12T00:25:35.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.955+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6348478599047922328', time=2024-09-12T02:21:45.702398+0000, chain.objs.size()=1 2024-09-12T00:25:35.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.955+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.G_wTT0UmNOiO4AskyxyCd9ieA7OYqI8_0 2024-09-12T00:25:35.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.956+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5846373279051608808', time=2024-09-12T02:22:53.351435+0000, chain.objs.size()=1 2024-09-12T00:25:35.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.956+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_._sQg8JWaXVK-dY9h-UullLDivfQOKkb_0 2024-09-12T00:25:35.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.956+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2204925588065978225', time=2024-09-12T02:22:53.364349+0000, chain.objs.size()=1 2024-09-12T00:25:35.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.956+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.6Cp61m021bM3N02UM4q1fpO_A6N_L4E_0 2024-09-12T00:25:35.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.956+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6293753842853278481', time=2024-09-12T02:25:01.493497+0000, chain.objs.size()=1 2024-09-12T00:25:35.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.956+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17__shadow_.vHKVpzCiaGnLdl75Iw8zWIk_hZC02h-_0 2024-09-12T00:25:35.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.958+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5736672839824356264', time=2024-09-12T02:25:13.863109+0000, chain.objs.size()=1 2024-09-12T00:25:35.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.958+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18__shadow:i94DRn6RhnOd3QNMwhsRx1AiR7Pur25_.0gC9vXqqYVHWu-MIhY-oFDsh_Uxdi_a_0 2024-09-12T00:25:35.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.961+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.964+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:25:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.965+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:25:35.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15806122684410213118', time=2024-09-12T02:18:15.904291+0000, chain.objs.size()=1 2024-09-12T00:25:35.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.eD8PJrDBzAnbruQPTin7kBzrtby571w_0 2024-09-12T00:25:35.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5238890964377811625', time=2024-09-12T02:18:16.769282+0000, chain.objs.size()=1 2024-09-12T00:25:35.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_._l2MkuHiQUmfO3bYATaBjlyzF8CFviA_0 2024-09-12T00:25:35.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9187607424720917224', time=2024-09-12T02:18:50.124763+0000, chain.objs.size()=1 2024-09-12T00:25:35.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.HtG52OKrEgoIn6T9f75BucClybxUOTZ_0 2024-09-12T00:25:35.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6254241380715984577', time=2024-09-12T02:19:24.640767+0000, chain.objs.size()=1 2024-09-12T00:25:35.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.Rx1Z3U2lbVSg7Pgh7IePVQlAAeEar3J_0 2024-09-12T00:25:35.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.898084466159575732', time=2024-09-12T02:19:26.418247+0000, chain.objs.size()=1 2024-09-12T00:25:35.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.u5IWg9nYnscigFcCHl8gBVWY-hRoj6n_0 2024-09-12T00:25:35.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13605825312010793080', time=2024-09-12T02:19:27.705683+0000, chain.objs.size()=1 2024-09-12T00:25:35.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.cDaNq3tSx3MvAvx_CTH8y3Lp8ls-3ad_0 2024-09-12T00:25:35.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3755140496765279838', time=2024-09-12T02:19:27.721486+0000, chain.objs.size()=1 2024-09-12T00:25:35.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.m5YZYZuTcJvkPZekqcFJ8gZtqFyW0yQ_0 2024-09-12T00:25:35.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14113063493100183389', time=2024-09-12T02:20:02.671558+0000, chain.objs.size()=1 2024-09-12T00:25:35.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.iTpvJR7qC6JiZxW-rP-UaGFm164d_4E_0 2024-09-12T00:25:35.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1938577068325343933', time=2024-09-12T02:20:37.638141+0000, chain.objs.size()=1 2024-09-12T00:25:35.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.tA1nQ2p_Df19qXHE8Q34Z6Ym6XDt5Uk_0 2024-09-12T00:25:35.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2957403873429538128', time=2024-09-12T02:20:38.916856+0000, chain.objs.size()=1 2024-09-12T00:25:35.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.fELXueuP28RkmSbu6NXrQimGsTrzTPz_0 2024-09-12T00:25:35.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14161684395871892886', time=2024-09-12T02:21:12.542059+0000, chain.objs.size()=1 2024-09-12T00:25:35.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.x2UuW0Y4hP6ejSaBqglZ08i60fkPpDP_0 2024-09-12T00:25:35.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5020768205178000765', time=2024-09-12T02:21:12.549373+0000, chain.objs.size()=1 2024-09-12T00:25:35.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.966+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.RgEs_Ddxorg6gvTsEllDx3TkS6X3jLG_0 2024-09-12T00:25:35.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.970+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9347350669719920462', time=2024-09-12T02:21:45.702699+0000, chain.objs.size()=1 2024-09-12T00:25:35.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.970+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.C5YVwL1_FPO_psiShWu8ni7hej9Txo0_0 2024-09-12T00:25:35.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.970+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5827970168690977109', time=2024-09-12T02:22:17.657477+0000, chain.objs.size()=1 2024-09-12T00:25:35.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.970+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.jXR8rXsIxJ0XNbl8S_CCB4_rJdtzu2b_0 2024-09-12T00:25:35.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.970+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5565860323067213170', time=2024-09-12T02:22:17.661270+0000, chain.objs.size()=1 2024-09-12T00:25:35.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.970+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.OF4mVJVMUhVCwNJcR-esRRk61HMdBvX_0 2024-09-12T00:25:35.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.970+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5974920515118119181', time=2024-09-12T02:22:20.790893+0000, chain.objs.size()=1 2024-09-12T00:25:35.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.970+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.wyigttBq1aP3axbbcoycq36MLsKE7Ws_0 2024-09-12T00:25:35.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.974+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.977+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:25:35.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.978+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.978+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:25:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5081495957436820623', time=2024-09-12T02:17:10.379288+0000, chain.objs.size()=4 2024-09-12T00:25:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12__multipart_foo.2~JLYIf8thVUjjzH8CIRV7gHVokajsy6x.1 2024-09-12T00:25:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12__multipart_foo.2~JLYIf8thVUjjzH8CIRV7gHVokajsy6x.2 2024-09-12T00:25:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12__multipart_foo.2~JLYIf8thVUjjzH8CIRV7gHVokajsy6x.3 2024-09-12T00:25:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12__multipart_foo.2~JLYIf8thVUjjzH8CIRV7gHVokajsy6x.4 2024-09-12T00:25:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='_sLSNSI_CbG9EVO0Hc_-Gj8l5I5V-QRU', time=2024-09-12T02:17:10.532118+0000, chain.objs.size()=1 2024-09-12T00:25:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16__shadow_.zeMKtiELy-LgOw1zmw_BaELJ97jLsYK_0 2024-09-12T00:25:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8413050657133713499', time=2024-09-12T02:18:15.912288+0000, chain.objs.size()=1 2024-09-12T00:25:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.PzDCO0qHwTkta4GX0MWGO3J27aPKe4e_0 2024-09-12T00:25:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15503947390987473257', time=2024-09-12T02:18:15.917759+0000, chain.objs.size()=1 2024-09-12T00:25:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.Rqu5lBIcRVwd_N6_nNmUIZT3Ksiyy4b_0 2024-09-12T00:25:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13343850825488082184', time=2024-09-12T02:18:48.690516+0000, chain.objs.size()=1 2024-09-12T00:25:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.Ugp5oNHP7CHvKrphAvu9WUT1CY9gDJh_0 2024-09-12T00:25:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16506457889231349803', time=2024-09-12T02:18:51.929079+0000, chain.objs.size()=1 2024-09-12T00:25:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.TbSON4YILFnoRMFDP0YJoZI4bw78scx_0 2024-09-12T00:25:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13455744290030572323', time=2024-09-12T02:19:27.707697+0000, chain.objs.size()=1 2024-09-12T00:25:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.3Veen_CrDXzSPGal31sn6kU5bQ2dmey_0 2024-09-12T00:25:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12371890801835477190', time=2024-09-12T02:20:35.841486+0000, chain.objs.size()=1 2024-09-12T00:25:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.Iea62iP7dkSH99qGvUa4Gn6j3sVPC7J_0 2024-09-12T00:25:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5865797721300250454', time=2024-09-12T02:20:35.849339+0000, chain.objs.size()=1 2024-09-12T00:25:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.979+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.nA3XEKHjxPzXrfjrIqZo7LxoDGXXm-q_0 2024-09-12T00:25:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.982+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17484235066406411835', time=2024-09-12T02:20:37.644655+0000, chain.objs.size()=1 2024-09-12T00:25:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.982+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.-AwSL46-IrY3vC98SpMFg7_svQNmwXb_0 2024-09-12T00:25:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.982+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15777077171693986637', time=2024-09-12T02:20:38.913119+0000, chain.objs.size()=1 2024-09-12T00:25:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.982+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.1tRDujhUZy1Dd8T8Eqtr2cQB0QH-vE-_0 2024-09-12T00:25:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.982+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15628972885225861868', time=2024-09-12T02:21:10.945306+0000, chain.objs.size()=1 2024-09-12T00:25:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.982+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.9Kp71m1BNWVITR1q7wQIJGdSZ_QlZI4_0 2024-09-12T00:25:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.984+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11674484291559795922', time=2024-09-12T02:21:10.946424+0000, chain.objs.size()=1 2024-09-12T00:25:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.984+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.cWGO-aEXE2OMW4-dafL1VByp59h-1Kr_0 2024-09-12T00:25:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.984+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5828045621119393264', time=2024-09-12T02:21:12.540347+0000, chain.objs.size()=1 2024-09-12T00:25:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.984+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.Eo3tWS5AKvJSnxQ_Wxom09CfJHXMQKf_0 2024-09-12T00:25:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.984+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16651427248095498947', time=2024-09-12T02:21:12.552737+0000, chain.objs.size()=1 2024-09-12T00:25:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.984+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.BQNRSaXrbbTbhRENh-UK24Z9E1mVqBN_0 2024-09-12T00:25:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.984+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6543112449266469002', time=2024-09-12T02:21:44.730426+0000, chain.objs.size()=1 2024-09-12T00:25:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.984+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.dNvu-JAjzpHsnfNw4Nydo3BSDYLozZY_0 2024-09-12T00:25:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.984+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7254314216835502321', time=2024-09-12T02:22:20.798217+0000, chain.objs.size()=1 2024-09-12T00:25:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.984+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.A2oNzcsa4JkGPFPfXDkbcv28Il3VZsI_0 2024-09-12T00:25:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.984+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13281212628908666801', time=2024-09-12T02:25:01.490480+0000, chain.objs.size()=1 2024-09-12T00:25:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.984+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17__shadow_.5x0hW3r4xNHngl7TjuOUeiVgeSpQXBx_0 2024-09-12T00:25:35.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.989+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:35.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.991+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:25:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.993+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:35.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.993+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:35.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.993+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:25:35.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.993+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9445920949108672434', time=2024-09-12T02:17:10.463948+0000, chain.objs.size()=1 2024-09-12T00:25:35.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.993+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.YnmTbQdqQ-SwYpJdhF1b44o8oB7_tuo_0 2024-09-12T00:25:35.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.993+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6594151678068458489', time=2024-09-12T02:18:15.385389+0000, chain.objs.size()=1 2024-09-12T00:25:35.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.993+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.u6Xw1IXu-4xAuSMreQJworxCpQFqChO_0 2024-09-12T00:25:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.993+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6282335155591381482', time=2024-09-12T02:18:16.770982+0000, chain.objs.size()=1 2024-09-12T00:25:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.993+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.us4ZGXbapxrotZwgDnl1GSVhaCX3XNU_0 2024-09-12T00:25:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14085057482273299688', time=2024-09-12T02:19:24.650934+0000, chain.objs.size()=1 2024-09-12T00:25:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.JhdbNzevpUMv087xonls-xeM4CY6kUG_0 2024-09-12T00:25:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3925335272132081152', time=2024-09-12T02:19:27.717026+0000, chain.objs.size()=1 2024-09-12T00:25:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.D8LsUoDIKMZ_8iw9OLP3wI8JVzfvd5b_0 2024-09-12T00:25:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5625325153932044681', time=2024-09-12T02:20:02.670518+0000, chain.objs.size()=1 2024-09-12T00:25:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.E5cmFv9KYf1PJO0NMEZFZzBBJOLFRaM_0 2024-09-12T00:25:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9806839798861545637', time=2024-09-12T02:20:35.841743+0000, chain.objs.size()=1 2024-09-12T00:25:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.WLwhh2dn_RkoCkcfR0uPgslTomyYDBq_0 2024-09-12T00:25:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1138131358135454686', time=2024-09-12T02:20:35.850952+0000, chain.objs.size()=1 2024-09-12T00:25:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29__shadow_.7xD1f9qbcpkV29AdtBaLpJerW_5XBO__0 2024-09-12T00:25:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15008009108172422253', time=2024-09-12T02:21:10.960438+0000, chain.objs.size()=1 2024-09-12T00:25:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32__shadow_.jmnLG8ZU0NumGtBZhJGaAuUnnEMBhiM_0 2024-09-12T00:25:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2503710966123437794', time=2024-09-12T02:21:45.711702+0000, chain.objs.size()=1 2024-09-12T00:25:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.rHj4edmPRWA05eum9qmCwrzl0fW-WC7_0 2024-09-12T00:25:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12588658088814276762', time=2024-09-12T02:21:45.714843+0000, chain.objs.size()=1 2024-09-12T00:25:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.PBP1543tF-glmsjJ2aHVxfWTD37oX5O_0 2024-09-12T00:25:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6951740274313653452', time=2024-09-12T02:22:17.660957+0000, chain.objs.size()=1 2024-09-12T00:25:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.994+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.ixmeKaEyjCIvgWcJUbKEu_NNzukl2vc_0 2024-09-12T00:25:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.996+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15360402965246504492', time=2024-09-12T02:22:19.443394+0000, chain.objs.size()=1 2024-09-12T00:25:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.996+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.Vu2XlEUxOdboMc2POJbYzfEe1XN7mBC_0 2024-09-12T00:25:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.996+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9849541576199304650', time=2024-09-12T02:22:19.458264+0000, chain.objs.size()=1 2024-09-12T00:25:35.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.996+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37__shadow_.WFuyhWGb4FzbDwXwTSZeLHiRkazZrX0_0 2024-09-12T00:25:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.998+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1806353388793095390', time=2024-09-12T02:22:20.797411+0000, chain.objs.size()=1 2024-09-12T00:25:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.998+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.ZjNXP__6hdEn1erNHf0jFqb8WiMD5LN_0 2024-09-12T00:25:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.998+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10544750806961334124', time=2024-09-12T02:22:53.366517+0000, chain.objs.size()=1 2024-09-12T00:25:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.998+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.WCPUgid0_udN4qGWC50z5VOzmgRNK6W_0 2024-09-12T00:25:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.998+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6803764788480198264', time=2024-09-12T02:25:09.577448+0000, chain.objs.size()=1 2024-09-12T00:25:35.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:35.998+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18__shadow:mWsiAkBATwQXWk8MeL2PC1lRKfChjkN_.w3yXvIE8TCB6iRFCRjjbfGDk1fNXieu_0 2024-09-12T00:25:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.002+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:36.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.004+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:25:36.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.005+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:25:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2104234286904694101', time=2024-09-12T02:18:15.905519+0000, chain.objs.size()=1 2024-09-12T00:25:36.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.UQenD2CZtFXrQJX7ee_VZuaC7JdLap-_0 2024-09-12T00:25:36.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15966242676151188410', time=2024-09-12T02:18:16.784105+0000, chain.objs.size()=1 2024-09-12T00:25:36.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.AYdlxBAsFM5cgBiyCle3nDbO7LgoSN3_0 2024-09-12T00:25:36.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3831596226660263047', time=2024-09-12T02:18:48.678806+0000, chain.objs.size()=1 2024-09-12T00:25:36.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.WCl95XOfr6p_1lwHN2Yg1p4cxy7A_Oi_0 2024-09-12T00:25:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2947760432449717586', time=2024-09-12T02:18:50.653766+0000, chain.objs.size()=1 2024-09-12T00:25:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.3iA91kDKP-BlRWdyx-u7LCOo9ZFEt1-_0 2024-09-12T00:25:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4945933473050073188', time=2024-09-12T02:18:51.924146+0000, chain.objs.size()=1 2024-09-12T00:25:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.KGx5GLBYXLxVu2KskZ5QTZXd__aJurN_0 2024-09-12T00:25:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16043071970192489134', time=2024-09-12T02:19:26.424429+0000, chain.objs.size()=1 2024-09-12T00:25:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.ixWWWdnv7ae8-as6HTJSelol66pA0zF_0 2024-09-12T00:25:36.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10378939636221992033', time=2024-09-12T02:20:02.681061+0000, chain.objs.size()=1 2024-09-12T00:25:36.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.V8VPFi7-gBQy6wT0r9Q3c_Afbp5SxN1_0 2024-09-12T00:25:36.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3630098683670932074', time=2024-09-12T02:20:37.647998+0000, chain.objs.size()=1 2024-09-12T00:25:36.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30__shadow_.JcvJiatg5uajCOU6XoJ_AKWkhNw2lOP_0 2024-09-12T00:25:36.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15733393071813963228', time=2024-09-12T02:20:38.924847+0000, chain.objs.size()=1 2024-09-12T00:25:36.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31__shadow_.LZlgZB0F_LtejbS6icogfMIGtZU4D8O_0 2024-09-12T00:25:36.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11351820237483836767', time=2024-09-12T02:21:44.732605+0000, chain.objs.size()=1 2024-09-12T00:25:36.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.RP9vGFKAFW2X7MsS-QYVuFoy3UmT1s6_0 2024-09-12T00:25:36.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4378205774812150641', time=2024-09-12T02:22:20.783330+0000, chain.objs.size()=1 2024-09-12T00:25:36.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.GHoEyB0o-P-HazdTKcnqKTFky37TuMb_0 2024-09-12T00:25:36.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7852453581677899052', time=2024-09-12T02:25:01.493795+0000, chain.objs.size()=1 2024-09-12T00:25:36.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.006+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17__shadow_.FQ_VQoX0zgYjgOMQP_vPtbqI3HLp97i_0 2024-09-12T00:25:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.012+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.014+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:25:36.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.015+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T00:25:36.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16184568788611412005', time=2024-09-12T02:17:10.455500+0000, chain.objs.size()=1 2024-09-12T00:25:36.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15__shadow_.IJCw_FVUPsZv_rripl9Nn8Y2TRjwCmW_0 2024-09-12T00:25:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9952156434318967123', time=2024-09-12T02:18:16.778669+0000, chain.objs.size()=1 2024-09-12T00:25:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.-YtTsRam182yxaZS-dJJtww35mze_Tz_0 2024-09-12T00:25:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4319464537782506539', time=2024-09-12T02:18:16.781308+0000, chain.objs.size()=1 2024-09-12T00:25:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.20__shadow_.arwg9rMzK1I0xgwZ7Y858tpEbNUKS95_0 2024-09-12T00:25:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17078739647797687994', time=2024-09-12T02:18:50.657299+0000, chain.objs.size()=1 2024-09-12T00:25:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.o0DWUo_Yeyhivaf-Rumzb-dLv_hS3Tj_0 2024-09-12T00:25:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5381021357707916245', time=2024-09-12T02:18:51.906327+0000, chain.objs.size()=1 2024-09-12T00:25:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.IJMqehzFIteE4VwfmYkndW9w4fNrazt_0 2024-09-12T00:25:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.877260435588116819', time=2024-09-12T02:18:51.912326+0000, chain.objs.size()=1 2024-09-12T00:25:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23__shadow_.xyohdgH_e0augHnLbvZAt8vv52HLWRM_0 2024-09-12T00:25:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9400948924486886399', time=2024-09-12T02:19:24.640740+0000, chain.objs.size()=1 2024-09-12T00:25:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.2WWbfdW1QgAQJmBc2q3O8U3qcuh0i-0_0 2024-09-12T00:25:36.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10524549688961324621', time=2024-09-12T02:19:24.650716+0000, chain.objs.size()=1 2024-09-12T00:25:36.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.MkjDSL8sxVUs1aFVL4l6GUHkLj0mfln_0 2024-09-12T00:25:36.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8332414978669247675', time=2024-09-12T02:19:26.423264+0000, chain.objs.size()=1 2024-09-12T00:25:36.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.25__shadow_.LsdFN_NvrFW9Gp5aSaGh4a-NnAfVjga_0 2024-09-12T00:25:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7162267472588264001', time=2024-09-12T02:19:27.707852+0000, chain.objs.size()=1 2024-09-12T00:25:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.65v0cjX0Vg2wnwua06UQYYYsIsGPRFY_0 2024-09-12T00:25:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15446366731922712075', time=2024-09-12T02:20:00.068089+0000, chain.objs.size()=1 2024-09-12T00:25:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.osIj9PfUkf0QjYlRRDy0XqTb3Foh-9t_0 2024-09-12T00:25:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14948807174313063808', time=2024-09-12T02:20:00.073270+0000, chain.objs.size()=1 2024-09-12T00:25:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.016+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.SfjkIkteI3DPkM2RCIJsAtpIqWqyzsT_0 2024-09-12T00:25:36.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.019+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2053396652560246342', time=2024-09-12T02:20:00.084870+0000, chain.objs.size()=1 2024-09-12T00:25:36.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.019+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.27__shadow_.CTfp8NViDq0Z3PD_wAmxuVeyHEc4m1B_0 2024-09-12T00:25:36.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.020+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8398290418364255027', time=2024-09-12T02:21:12.544036+0000, chain.objs.size()=1 2024-09-12T00:25:36.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.020+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.I2ktac8_8ChXOEiNggvn9tfk-v-UROF_0 2024-09-12T00:25:36.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.020+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17894547229746479540', time=2024-09-12T02:21:12.545627+0000, chain.objs.size()=1 2024-09-12T00:25:36.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.020+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33__shadow_.i_IFFxZD2PFppCpCQ7tGRA63lqsVjAc_0 2024-09-12T00:25:36.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.020+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3411634108971500851', time=2024-09-12T02:21:44.721794+0000, chain.objs.size()=1 2024-09-12T00:25:36.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.020+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.34__shadow_.d0nxZmJfuWZcVneuHNwDSjWisDtNeia_0 2024-09-12T00:25:36.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.020+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17997046814336825879', time=2024-09-12T02:21:45.697685+0000, chain.objs.size()=1 2024-09-12T00:25:36.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.020+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.cxxQRIA_L4swbrwxqe-xeQDTJP8oxDp_0 2024-09-12T00:25:36.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.020+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6273211029613657177', time=2024-09-12T02:21:45.705008+0000, chain.objs.size()=1 2024-09-12T00:25:36.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.020+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.35__shadow_.AjJGRXWNWVm-XWyki3XrQSQmTa5BLej_0 2024-09-12T00:25:36.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.020+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11710069194413363748', time=2024-09-12T02:22:17.658496+0000, chain.objs.size()=1 2024-09-12T00:25:36.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.020+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.6VA1KuZiHMhDb9a9_yqBOhpZqN7Jl3s_0 2024-09-12T00:25:36.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.020+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6623801091534623971', time=2024-09-12T02:22:17.664403+0000, chain.objs.size()=1 2024-09-12T00:25:36.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.020+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.wpKghHUaHubbE0nm9W5HLsppT427gr9_0 2024-09-12T00:25:36.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.021+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9916544339814663411', time=2024-09-12T02:22:17.668877+0000, chain.objs.size()=1 2024-09-12T00:25:36.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.021+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.qRR5K5pmAxzM703gfB2mbxPCS8R9lwb_0 2024-09-12T00:25:36.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.025+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2393717103171772789', time=2024-09-12T02:22:20.781437+0000, chain.objs.size()=1 2024-09-12T00:25:36.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.025+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38__shadow_.6lX2E4gp5q3ZvA2OQI0ydyzCMpjbfZt_0 2024-09-12T00:25:36.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.025+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10535554956615980072', time=2024-09-12T02:25:01.490121+0000, chain.objs.size()=1 2024-09-12T00:25:36.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.025+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17__shadow_.TbmyC6WhCSFzHmZ51xDQozlcixPcn1R_0 2024-09-12T00:25:36.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.028+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:36.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.030+0000 7fe1b312c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:25:36.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:25:36.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9229578972447105865', time=2024-09-12T02:18:15.927402+0000, chain.objs.size()=1 2024-09-12T00:25:36.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.19__shadow_.yRdle53HUazMWNxjyAYpqmd3RX1gV7w_0 2024-09-12T00:25:36.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4922293186761860226', time=2024-09-12T02:18:48.685356+0000, chain.objs.size()=1 2024-09-12T00:25:36.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.21__shadow_.MOb8cwohQ9OCdXyZyQjr_J9gUYFtB75_0 2024-09-12T00:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13073447674566900092', time=2024-09-12T02:18:50.644986+0000, chain.objs.size()=1 2024-09-12T00:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.WZgHZ1U4u5ghLlqp8HwW3giG11E3ok-_0 2024-09-12T00:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7954699475597214336', time=2024-09-12T02:18:50.657129+0000, chain.objs.size()=1 2024-09-12T00:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.22__shadow_.ZiJ14FHDLCKlw705uoWa4G7ooeO-Qgs_0 2024-09-12T00:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2008353382463431579', time=2024-09-12T02:19:24.644948+0000, chain.objs.size()=1 2024-09-12T00:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.24__shadow_.svJW0YmmJMc6kqXcZskvVeeyt-HZcO2_0 2024-09-12T00:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16355358750171314046', time=2024-09-12T02:19:27.720519+0000, chain.objs.size()=1 2024-09-12T00:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.26__shadow_.EICHrNminyRHDCFO9Bz_w3_tPbpeNVf_0 2024-09-12T00:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13567098362589247934', time=2024-09-12T02:20:02.666696+0000, chain.objs.size()=1 2024-09-12T00:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.032+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.28__shadow_.2r3OGKYKyj3rRtaTt0mRYbznjNqsz8E_0 2024-09-12T00:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.033+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6435459421938737935', time=2024-09-12T02:22:17.647483+0000, chain.objs.size()=1 2024-09-12T00:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.033+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36__shadow_.ioHJirTwmFj9Zizuwi71xVmZZbZ3bZP_0 2024-09-12T00:25:36.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.033+0000 7fe1b312c800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16658803705991947415', time=2024-09-12T02:22:53.369390+0000, chain.objs.size()=1 2024-09-12T00:25:36.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.033+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39__shadow_.5JsAMvE5w66A8VTR_cTZf37ZV1-PfcL_0 2024-09-12T00:25:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.036+0000 7fe1b312c800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:25:36.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.040+0000 7fe0657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.042+0000 7fe1b312c800 20 remove_watcher() i=0 2024-09-12T00:25:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.042+0000 7fe1b312c800 2 removed watcher, disabling cache 2024-09-12T00:25:36.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.043+0000 7fe1b312c800 20 remove_watcher() i=1 2024-09-12T00:25:36.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.043+0000 7fe1b312c800 20 remove_watcher() i=2 2024-09-12T00:25:36.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.045+0000 7fe1b312c800 20 remove_watcher() i=3 2024-09-12T00:25:36.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.045+0000 7fe1b312c800 20 remove_watcher() i=4 2024-09-12T00:25:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.046+0000 7fe1b312c800 20 remove_watcher() i=5 2024-09-12T00:25:36.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.047+0000 7fe1b312c800 20 remove_watcher() i=6 2024-09-12T00:25:36.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.048+0000 7fe1b312c800 20 remove_watcher() i=7 2024-09-12T00:25:36.058 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T00:25:36.151 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:36.152 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:36.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.193+0000 7ff741896800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.194+0000 7ff741896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.194+0000 7ff741896800 20 realm 2024-09-12T00:25:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.194+0000 7ff741896800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.194+0000 7ff741896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.194+0000 7ff741896800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:36.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.195+0000 7ff741896800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.195+0000 7ff741896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.195+0000 7ff741896800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.195+0000 7ff741896800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:36.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.195+0000 7ff741896800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.196+0000 7ff741896800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:25:36.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.196+0000 7ff741896800 20 searching for the correct realm 2024-09-12T00:25:36.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.199+0000 7ff73eb7f640 0 -- 172.21.15.67:0/535791093 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7ff7340ae1e0 msgr2=0x7ff7340baae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:25:36.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.404+0000 7ff73fb81640 0 -- 172.21.15.67:0/535791093 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55af1d7e5e60 msgr2=0x55af1d7e82a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:36.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.409+0000 7ff741896800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:36.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.409+0000 7ff741896800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:36.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.409+0000 7ff741896800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:25:36.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.409+0000 7ff741896800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:25:36.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.409+0000 7ff741896800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:36.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.409+0000 7ff741896800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:36.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.409+0000 7ff741896800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.409+0000 7ff741896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.409+0000 7ff741896800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.409+0000 7ff741896800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:36.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.409+0000 7ff741896800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.410+0000 7ff741896800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:25:36.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.410+0000 7ff741896800 20 zone default found 2024-09-12T00:25:36.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.410+0000 7ff741896800 4 Realm: () 2024-09-12T00:25:36.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.410+0000 7ff741896800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:25:36.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.410+0000 7ff741896800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:25:36.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.410+0000 7ff741896800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:36.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.410+0000 7ff741896800 20 zonegroup default 2024-09-12T00:25:36.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.410+0000 7ff741896800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.410+0000 7ff741896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.410+0000 7ff741896800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.410+0000 7ff741896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.410+0000 7ff741896800 20 rados->read ofs=0 len=0 2024-09-12T00:25:36.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.411+0000 7ff741896800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:36.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.411+0000 7ff741896800 20 started sync module instance, tier type = 2024-09-12T00:25:36.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.411+0000 7ff741896800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:25:36.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.419+0000 7ff741896800 20 add_watcher() i=0 2024-09-12T00:25:36.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.419+0000 7ff741896800 20 add_watcher() i=1 2024-09-12T00:25:36.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.419+0000 7ff741896800 20 add_watcher() i=2 2024-09-12T00:25:36.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.419+0000 7ff741896800 20 add_watcher() i=3 2024-09-12T00:25:36.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.419+0000 7ff741896800 20 add_watcher() i=4 2024-09-12T00:25:36.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.419+0000 7ff741896800 20 add_watcher() i=5 2024-09-12T00:25:36.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.419+0000 7ff741896800 20 add_watcher() i=6 2024-09-12T00:25:36.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.420+0000 7ff741896800 20 add_watcher() i=7 2024-09-12T00:25:36.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.420+0000 7ff741896800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:36.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.422+0000 7ff5f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:36.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.422+0000 7ff741896800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:36.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.422+0000 7ff741896800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.458+0000 7ff5f4fe1640 20 reqs_thread_entry: start 2024-09-12T00:25:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.458+0000 7ff741896800 20 init_complete bucket index max shards: 1 2024-09-12T00:25:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.458+0000 7ff741896800 20 Filter name: none 2024-09-12T00:25:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.458+0000 7ff56e7fc640 20 reqs_thread_entry: start 2024-09-12T00:25:36.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.459+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:25:36.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.460+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.460+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.461+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.461+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:25:36.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.463+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.463+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.463+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.464+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:25:36.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.466+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.466+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.466+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.467+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:25:36.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.469+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.469+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.469+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.470+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:25:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.472+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.472+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.473+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.474+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:25:36.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.475+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.476+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.476+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.477+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:25:36.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.478+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.478+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.478+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.479+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:25:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.481+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.481+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.482+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.483+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:25:36.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.484+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.484+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.485+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.486+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:25:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.487+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.488+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.488+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.489+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:25:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.490+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.491+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.491+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.492+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:25:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.493+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.494+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.494+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.495+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:25:36.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.497+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.497+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.497+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.498+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:25:36.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.500+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.500+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.500+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.501+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:25:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.502+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.503+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.503+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.504+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:25:36.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.505+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.506+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.506+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.507+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:25:36.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.508+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.509+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.509+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.510+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:25:36.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.512+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.512+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.512+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.513+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:25:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.515+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.515+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.515+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.516+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:25:36.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.518+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.518+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.518+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.520+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:25:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.521+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.521+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.522+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.522+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:25:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.524+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.524+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.524+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.525+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:25:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.527+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.527+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.527+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.528+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:25:36.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.530+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.530+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.530+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.532+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:25:36.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.533+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.533+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.534+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.534+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:25:36.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.536+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.536+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.536+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.537+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:25:36.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.538+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.539+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.539+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.540+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:25:36.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.541+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.542+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.542+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.543+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:25:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.544+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.545+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.545+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.546+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:25:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.547+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.548+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.548+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.549+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:25:36.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.550+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.551+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.551+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.552+0000 7ff741896800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:25:36.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.553+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.554+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:25:36.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.554+0000 7ff741896800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:25:36.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.556+0000 7ff5f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.559+0000 7ff741896800 20 remove_watcher() i=0 2024-09-12T00:25:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.559+0000 7ff741896800 2 removed watcher, disabling cache 2024-09-12T00:25:36.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.560+0000 7ff741896800 20 remove_watcher() i=1 2024-09-12T00:25:36.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.560+0000 7ff741896800 20 remove_watcher() i=2 2024-09-12T00:25:36.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.561+0000 7ff741896800 20 remove_watcher() i=3 2024-09-12T00:25:36.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.562+0000 7ff741896800 20 remove_watcher() i=4 2024-09-12T00:25:36.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.563+0000 7ff741896800 20 remove_watcher() i=5 2024-09-12T00:25:36.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.564+0000 7ff741896800 20 remove_watcher() i=6 2024-09-12T00:25:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:25:36.565+0000 7ff741896800 20 remove_watcher() i=7 2024-09-12T00:25:36.575 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T00:25:37.069 INFO:teuthology.orchestra.run.smithi067.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T00:25:40.870 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :clean UP-TO-DATE 2024-09-12T00:25:59.368 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :compileJava 2024-09-12T00:25:59.369 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :processResources 2024-09-12T00:25:59.468 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :classes 2024-09-12T00:26:00.268 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:00.269 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :compileTestJava 2024-09-12T00:26:00.269 INFO:teuthology.orchestra.run.smithi067.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:26:00.270 INFO:teuthology.orchestra.run.smithi067.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:26:00.270 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:00.271 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:26:00.271 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :testClasses 2024-09-12T00:26:06.269 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:06.269 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :test 2024-09-12T00:26:06.269 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:06.269 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T00:26:06.768 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:06.768 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T00:26:06.968 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:06.969 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T00:26:06.969 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:06.969 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T00:26:07.168 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:07.168 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T00:26:07.568 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:07.568 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T00:26:07.768 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:07.769 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:26:07.769 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:07.769 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:26:07.868 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:07.869 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T00:26:07.869 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:07.869 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T00:26:08.068 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:08.068 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T00:26:08.468 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:08.468 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T00:26:08.768 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:08.768 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:26:08.968 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:08.968 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T00:26:08.968 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12 00:26:08,920 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:26:12.968 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:12.968 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:26:13.268 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:13.268 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T00:26:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:13.368 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T00:26:13.468 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:13.468 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T00:26:13.568 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:13.568 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T00:26:13.868 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:13.868 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T00:26:14.168 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:14.168 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T00:26:14.368 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:14.368 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:26:14.468 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:14.468 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:26:14.568 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:14.568 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T00:26:17.068 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:17.068 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T00:26:17.168 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:17.168 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:26:17.568 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:17.568 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:26:17.868 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:17.868 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T00:26:18.068 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:18.068 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T00:26:18.268 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:18.268 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:26:24.168 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:24.169 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:26:24.368 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:24.368 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T00:26:25.868 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:25.868 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T00:26:25.968 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:25.968 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T00:26:26.468 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:26.468 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T00:26:26.668 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:26.668 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T00:26:27.068 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:27.068 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T00:26:27.268 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:27.268 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T00:26:27.268 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:27.269 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T00:26:27.468 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:27.468 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T00:26:27.468 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:27.469 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T00:26:27.668 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:27.668 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T00:26:27.768 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:27.768 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T00:26:27.868 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:27.868 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T00:26:27.968 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:27.968 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T00:26:28.068 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:28.068 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T00:26:28.168 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:28.168 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T00:26:28.368 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:28.368 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T00:26:28.368 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:28.368 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T00:26:28.568 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:28.568 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T00:26:28.569 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:28.569 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T00:26:28.768 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:28.768 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T00:26:29.368 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:29.368 INFO:teuthology.orchestra.run.smithi067.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T00:26:29.569 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:29.569 INFO:teuthology.orchestra.run.smithi067.stdout:---------------------------------------------------------------------- 2024-09-12T00:26:29.569 INFO:teuthology.orchestra.run.smithi067.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T00:26:29.570 INFO:teuthology.orchestra.run.smithi067.stdout:---------------------------------------------------------------------- 2024-09-12T00:26:29.570 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:29.570 INFO:teuthology.orchestra.run.smithi067.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:26:29.570 INFO:teuthology.orchestra.run.smithi067.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:26:29.570 INFO:teuthology.orchestra.run.smithi067.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:26:29.570 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:29.570 INFO:teuthology.orchestra.run.smithi067.stdout:BUILD SUCCESSFUL in 52s 2024-09-12T00:26:29.570 INFO:teuthology.orchestra.run.smithi067.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T00:26:29.896 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T00:26:29.950 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:29.950 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:29.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:29.993+0000 7f89d0f35800 20 rados->read ofs=0 len=0 2024-09-12T00:26:29.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:29.995+0000 7f89d0f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:29.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:29.995+0000 7f89d0f35800 20 realm 2024-09-12T00:26:29.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:29.995+0000 7f89d0f35800 20 rados->read ofs=0 len=0 2024-09-12T00:26:29.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:29.995+0000 7f89d0f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:29.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:29.995+0000 7f89d0f35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:29.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:29.995+0000 7f89d0f35800 20 rados->read ofs=0 len=0 2024-09-12T00:26:29.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:29.995+0000 7f89d0f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:29.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:29.995+0000 7f89d0f35800 20 rados->read ofs=0 len=0 2024-09-12T00:26:29.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:29.996+0000 7f89d0f35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:29.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:29.996+0000 7f89d0f35800 20 rados->read ofs=0 len=0 2024-09-12T00:26:29.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:29.997+0000 7f89d0f35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:29.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:29.997+0000 7f89d0f35800 20 searching for the correct realm 2024-09-12T00:26:29.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:29.999+0000 7f89ccc21640 0 -- 172.21.15.67:0/829922791 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f89c0077c00 msgr2=0x7f89c0055f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:30.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.205+0000 7f89ccc21640 0 -- 172.21.15.67:0/829922791 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f89c807d060 msgr2=0x7f89c80a9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:30.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.412+0000 7f89d0f35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.412+0000 7f89d0f35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.412+0000 7f89d0f35800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:26:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.412+0000 7f89d0f35800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:26:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.412+0000 7f89d0f35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.412+0000 7f89d0f35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.412+0000 7f89d0f35800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.412+0000 7f89d0f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.412+0000 7f89d0f35800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.412+0000 7f89d0f35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:30.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.412+0000 7f89d0f35800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.413+0000 7f89d0f35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:30.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.413+0000 7f89d0f35800 20 zone default found 2024-09-12T00:26:30.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.413+0000 7f89d0f35800 4 Realm: () 2024-09-12T00:26:30.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.413+0000 7f89d0f35800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:26:30.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.413+0000 7f89d0f35800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:26:30.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.413+0000 7f89d0f35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:30.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.413+0000 7f89d0f35800 20 zonegroup default 2024-09-12T00:26:30.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.413+0000 7f89d0f35800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.413+0000 7f89d0f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:30.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.413+0000 7f89d0f35800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.413+0000 7f89d0f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:30.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.413+0000 7f89d0f35800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.414+0000 7f89d0f35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:30.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.414+0000 7f89d0f35800 20 started sync module instance, tier type = 2024-09-12T00:26:30.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.414+0000 7f89d0f35800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:26:30.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.424+0000 7f89d0f35800 20 add_watcher() i=0 2024-09-12T00:26:30.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.424+0000 7f89d0f35800 20 add_watcher() i=1 2024-09-12T00:26:30.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.424+0000 7f89d0f35800 20 add_watcher() i=2 2024-09-12T00:26:30.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.424+0000 7f89d0f35800 20 add_watcher() i=3 2024-09-12T00:26:30.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.424+0000 7f89d0f35800 20 add_watcher() i=4 2024-09-12T00:26:30.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.424+0000 7f89d0f35800 20 add_watcher() i=5 2024-09-12T00:26:30.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.424+0000 7f89d0f35800 20 add_watcher() i=6 2024-09-12T00:26:30.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.425+0000 7f89d0f35800 20 add_watcher() i=7 2024-09-12T00:26:30.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.425+0000 7f89d0f35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:30.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.427+0000 7f8882fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:30.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.428+0000 7f89d0f35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:30.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.428+0000 7f89d0f35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:30.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.469+0000 7f8881fe3640 20 reqs_thread_entry: start 2024-09-12T00:26:30.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.469+0000 7f89d0f35800 20 init_complete bucket index max shards: 1 2024-09-12T00:26:30.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.469+0000 7f89d0f35800 20 Filter name: none 2024-09-12T00:26:30.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.469+0000 7f87f37fe640 20 reqs_thread_entry: start 2024-09-12T00:26:30.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.470+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:26:30.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.471+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.471+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.472+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.472+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='2~F1zz-p3VQ8Phx22JWsQbV99euFEjrws', time=2024-09-12T02:26:06.673344+0000, chain.objs.size()=5 2024-09-12T00:26:30.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.472+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.40__multipart_key1.2~F1zz-p3VQ8Phx22JWsQbV99euFEjrws.1 2024-09-12T00:26:30.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.472+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.40__multipart_key1.2~F1zz-p3VQ8Phx22JWsQbV99euFEjrws.2 2024-09-12T00:26:30.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.472+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.40__multipart_key1.2~F1zz-p3VQ8Phx22JWsQbV99euFEjrws.3 2024-09-12T00:26:30.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.472+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.40__multipart_key1.2~F1zz-p3VQ8Phx22JWsQbV99euFEjrws.4 2024-09-12T00:26:30.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.472+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.40__multipart_key1.2~F1zz-p3VQ8Phx22JWsQbV99euFEjrws.5 2024-09-12T00:26:30.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.476+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.479+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:26:30.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.480+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.481+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.481+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.482+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:26:30.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.484+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.484+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.484+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:30.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.484+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.379759902028436063', time=2024-09-12T02:26:13.161432+0000, chain.objs.size()=5 2024-09-12T00:26:30.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.484+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~zffnJvEWvUdSNhePHPkYlriv5GQQWK2.1 2024-09-12T00:26:30.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.485+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__shadow_key1.2~zffnJvEWvUdSNhePHPkYlriv5GQQWK2.1_1 2024-09-12T00:26:30.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.485+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~zffnJvEWvUdSNhePHPkYlriv5GQQWK2.2 2024-09-12T00:26:30.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.485+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__shadow_key1.2~zffnJvEWvUdSNhePHPkYlriv5GQQWK2.2_1 2024-09-12T00:26:30.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.485+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~zffnJvEWvUdSNhePHPkYlriv5GQQWK2.3 2024-09-12T00:26:30.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.489+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.489 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.491+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:26:30.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.493+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.493+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.494+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:26:30.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.494+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9122952596365990019', time=2024-09-12T02:26:19.948856+0000, chain.objs.size()=11 2024-09-12T00:26:30.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.494+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~ZALe0VylxQCErRbZXtRqXDCqfIMGPgT.1 2024-09-12T00:26:30.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.494+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~ZALe0VylxQCErRbZXtRqXDCqfIMGPgT.2 2024-09-12T00:26:30.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.494+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~ZALe0VylxQCErRbZXtRqXDCqfIMGPgT.3 2024-09-12T00:26:30.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.494+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~ZALe0VylxQCErRbZXtRqXDCqfIMGPgT.4 2024-09-12T00:26:30.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.494+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~ZALe0VylxQCErRbZXtRqXDCqfIMGPgT.5 2024-09-12T00:26:30.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.494+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~ZALe0VylxQCErRbZXtRqXDCqfIMGPgT.6 2024-09-12T00:26:30.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.494+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~ZALe0VylxQCErRbZXtRqXDCqfIMGPgT.7 2024-09-12T00:26:30.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.494+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~ZALe0VylxQCErRbZXtRqXDCqfIMGPgT.8 2024-09-12T00:26:30.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.494+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~ZALe0VylxQCErRbZXtRqXDCqfIMGPgT.9 2024-09-12T00:26:30.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.494+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~ZALe0VylxQCErRbZXtRqXDCqfIMGPgT.10 2024-09-12T00:26:30.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.494+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~ZALe0VylxQCErRbZXtRqXDCqfIMGPgT.11 2024-09-12T00:26:30.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.494+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10901769538191269683', time=2024-09-12T02:26:24.042476+0000, chain.objs.size()=11 2024-09-12T00:26:30.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.494+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~iWWyAYGZ0IKQCD2hDjbwjA7W-7q8_WJ.1 2024-09-12T00:26:30.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.498+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__shadow_key1.2~iWWyAYGZ0IKQCD2hDjbwjA7W-7q8_WJ.1_1 2024-09-12T00:26:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.499+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~iWWyAYGZ0IKQCD2hDjbwjA7W-7q8_WJ.2 2024-09-12T00:26:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.500+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__shadow_key1.2~iWWyAYGZ0IKQCD2hDjbwjA7W-7q8_WJ.2_1 2024-09-12T00:26:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.500+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~iWWyAYGZ0IKQCD2hDjbwjA7W-7q8_WJ.3 2024-09-12T00:26:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.500+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__shadow_key1.2~iWWyAYGZ0IKQCD2hDjbwjA7W-7q8_WJ.3_1 2024-09-12T00:26:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.500+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~iWWyAYGZ0IKQCD2hDjbwjA7W-7q8_WJ.4 2024-09-12T00:26:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.500+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__shadow_key1.2~iWWyAYGZ0IKQCD2hDjbwjA7W-7q8_WJ.4_1 2024-09-12T00:26:30.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.500+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~iWWyAYGZ0IKQCD2hDjbwjA7W-7q8_WJ.5 2024-09-12T00:26:30.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.501+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__shadow_key1.2~iWWyAYGZ0IKQCD2hDjbwjA7W-7q8_WJ.5_1 2024-09-12T00:26:30.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.501+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~iWWyAYGZ0IKQCD2hDjbwjA7W-7q8_WJ.6 2024-09-12T00:26:30.505 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.507+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.509+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:26:30.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.511+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.511+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.512+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.513+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:26:30.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.514+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.515+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.515+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:26:30.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.515+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14365924666309934029', time=2024-09-12T02:26:11.700517+0000, chain.objs.size()=5 2024-09-12T00:26:30.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.515+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~CH-87eiN3zKoJYO-VftW3qURIA2Hgvo.1 2024-09-12T00:26:30.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.515+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~CH-87eiN3zKoJYO-VftW3qURIA2Hgvo.2 2024-09-12T00:26:30.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.515+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~CH-87eiN3zKoJYO-VftW3qURIA2Hgvo.3 2024-09-12T00:26:30.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.515+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~CH-87eiN3zKoJYO-VftW3qURIA2Hgvo.4 2024-09-12T00:26:30.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.515+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~CH-87eiN3zKoJYO-VftW3qURIA2Hgvo.5 2024-09-12T00:26:30.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.515+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16620215229547128968', time=2024-09-12T02:26:17.028280+0000, chain.objs.size()=5 2024-09-12T00:26:30.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.515+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.52__multipart_key1.2~klplmy-2MR4D7mhy7gGs5d4UHEjpGAN.1 2024-09-12T00:26:30.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.515+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.52__multipart_key1.2~klplmy-2MR4D7mhy7gGs5d4UHEjpGAN.2 2024-09-12T00:26:30.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.515+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.52__multipart_key1.2~klplmy-2MR4D7mhy7gGs5d4UHEjpGAN.3 2024-09-12T00:26:30.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.516+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.52__multipart_key1.2~klplmy-2MR4D7mhy7gGs5d4UHEjpGAN.4 2024-09-12T00:26:30.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.516+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.52__multipart_key1.2~klplmy-2MR4D7mhy7gGs5d4UHEjpGAN.5 2024-09-12T00:26:30.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.523+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.525+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:26:30.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.526+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.527+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.527+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:30.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.527+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7916961830241906289', time=2024-09-12T02:26:13.053095+0000, chain.objs.size()=4 2024-09-12T00:26:30.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.527+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.46__shadow_.OGLiFn4_6MwQTyBgUFsw68hq-ZMQw7R_0 2024-09-12T00:26:30.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.527+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.46__shadow_.OGLiFn4_6MwQTyBgUFsw68hq-ZMQw7R_1 2024-09-12T00:26:30.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.527+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.46__shadow_.OGLiFn4_6MwQTyBgUFsw68hq-ZMQw7R_2 2024-09-12T00:26:30.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.527+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.46__shadow_.OGLiFn4_6MwQTyBgUFsw68hq-ZMQw7R_3 2024-09-12T00:26:30.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.530+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.533+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:26:30.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.534+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.535+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.535+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:26:30.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.535+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14879772237461414864', time=2024-09-12T02:26:17.673249+0000, chain.objs.size()=1 2024-09-12T00:26:30.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.535+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.53__shadow_.DJaG184E8mIiFfrlBKZ6WYJA9PihSV9_0 2024-09-12T00:26:30.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.535+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.745891886441302388', time=2024-09-12T02:26:25.859018+0000, chain.objs.size()=5 2024-09-12T00:26:30.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.535+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.56__multipart_key1.2~Kjb2jCSGfsuEhDwYRXOvgFv_jdkv2x2.1 2024-09-12T00:26:30.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.535+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.56__multipart_key1.2~Kjb2jCSGfsuEhDwYRXOvgFv_jdkv2x2.2 2024-09-12T00:26:30.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.535+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.56__multipart_key1.2~Kjb2jCSGfsuEhDwYRXOvgFv_jdkv2x2.3 2024-09-12T00:26:30.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.535+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.56__multipart_key1.2~Kjb2jCSGfsuEhDwYRXOvgFv_jdkv2x2.4 2024-09-12T00:26:30.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.535+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.56__multipart_key1.2~Kjb2jCSGfsuEhDwYRXOvgFv_jdkv2x2.5 2024-09-12T00:26:30.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.540+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.542+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:26:30.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.543+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.544+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.544+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:26:30.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.544+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12806072252322063965', time=2024-09-12T02:26:12.914319+0000, chain.objs.size()=5 2024-09-12T00:26:30.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.544+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~6WHaTABpKj29zVMIML7X5uXgGlTJnu2.1 2024-09-12T00:26:30.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.544+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__shadow_key1.2~6WHaTABpKj29zVMIML7X5uXgGlTJnu2.1_1 2024-09-12T00:26:30.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.544+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~6WHaTABpKj29zVMIML7X5uXgGlTJnu2.2 2024-09-12T00:26:30.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.544+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__shadow_key1.2~6WHaTABpKj29zVMIML7X5uXgGlTJnu2.2_1 2024-09-12T00:26:30.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.544+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~6WHaTABpKj29zVMIML7X5uXgGlTJnu2.3 2024-09-12T00:26:30.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.544+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6907789630972387783', time=2024-09-12T02:26:14.239061+0000, chain.objs.size()=5 2024-09-12T00:26:30.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.544+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.51__multipart_key1.2~YMhLgTQPwAbWN0K6FN-2k1Y1Uz3JthB.1 2024-09-12T00:26:30.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.544+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.51__multipart_key1.2~YMhLgTQPwAbWN0K6FN-2k1Y1Uz3JthB.2 2024-09-12T00:26:30.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.544+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.51__multipart_key1.2~YMhLgTQPwAbWN0K6FN-2k1Y1Uz3JthB.3 2024-09-12T00:26:30.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.544+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.51__multipart_key1.2~YMhLgTQPwAbWN0K6FN-2k1Y1Uz3JthB.4 2024-09-12T00:26:30.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.544+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.51__multipart_key1.2~YMhLgTQPwAbWN0K6FN-2k1Y1Uz3JthB.5 2024-09-12T00:26:30.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.550+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.553+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:26:30.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.554+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:26:30.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11733639311124258129', time=2024-09-12T02:26:08.633881+0000, chain.objs.size()=5 2024-09-12T00:26:30.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.44__multipart_key1.2~JNZli0jOZaoREq3x7PFXC_DnLxqiead.1 2024-09-12T00:26:30.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.44__multipart_key1.2~JNZli0jOZaoREq3x7PFXC_DnLxqiead.2 2024-09-12T00:26:30.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.44__multipart_key1.2~JNZli0jOZaoREq3x7PFXC_DnLxqiead.3 2024-09-12T00:26:30.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.44__multipart_key1.2~JNZli0jOZaoREq3x7PFXC_DnLxqiead.4 2024-09-12T00:26:30.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.44__multipart_key1.2~JNZli0jOZaoREq3x7PFXC_DnLxqiead.5 2024-09-12T00:26:30.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth', time=2024-09-12T02:26:27.172297+0000, chain.objs.size()=91 2024-09-12T00:26:30.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.1 2024-09-12T00:26:30.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.2 2024-09-12T00:26:30.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.3 2024-09-12T00:26:30.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.4 2024-09-12T00:26:30.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.5 2024-09-12T00:26:30.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.6 2024-09-12T00:26:30.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.555+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.7 2024-09-12T00:26:30.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.560+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.8 2024-09-12T00:26:30.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.560+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.9 2024-09-12T00:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.560+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.10 2024-09-12T00:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.560+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.11 2024-09-12T00:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.560+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.12 2024-09-12T00:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.560+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.13 2024-09-12T00:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.560+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.14 2024-09-12T00:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.560+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.15 2024-09-12T00:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.560+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.16 2024-09-12T00:26:30.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.560+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.17 2024-09-12T00:26:30.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.562+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.18 2024-09-12T00:26:30.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.563+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.19 2024-09-12T00:26:30.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.564+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.20 2024-09-12T00:26:30.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.564+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.21 2024-09-12T00:26:30.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.566+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.22 2024-09-12T00:26:30.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.566+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.23 2024-09-12T00:26:30.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.566+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.24 2024-09-12T00:26:30.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.566+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.25 2024-09-12T00:26:30.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.566+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.26 2024-09-12T00:26:30.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.566+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.27 2024-09-12T00:26:30.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.566+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.28 2024-09-12T00:26:30.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.566+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.29 2024-09-12T00:26:30.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.567+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.30 2024-09-12T00:26:30.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.570+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.31 2024-09-12T00:26:30.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.570+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.32 2024-09-12T00:26:30.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.571+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.33 2024-09-12T00:26:30.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.572+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.34 2024-09-12T00:26:30.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.572+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.35 2024-09-12T00:26:30.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.572+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.36 2024-09-12T00:26:30.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.572+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.37 2024-09-12T00:26:30.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.572+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.38 2024-09-12T00:26:30.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.572+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.39 2024-09-12T00:26:30.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.572+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.40 2024-09-12T00:26:30.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.572+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.41 2024-09-12T00:26:30.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.575+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.42 2024-09-12T00:26:30.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.575+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.43 2024-09-12T00:26:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.580+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.44 2024-09-12T00:26:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.580+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.45 2024-09-12T00:26:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.580+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.46 2024-09-12T00:26:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.580+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.47 2024-09-12T00:26:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.580+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.48 2024-09-12T00:26:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.580+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.49 2024-09-12T00:26:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.580+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.50 2024-09-12T00:26:30.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.580+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.51 2024-09-12T00:26:30.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.580+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.52 2024-09-12T00:26:30.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.580+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.53 2024-09-12T00:26:30.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.580+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.54 2024-09-12T00:26:30.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.585+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.55 2024-09-12T00:26:30.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.585+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.56 2024-09-12T00:26:30.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.586+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.57 2024-09-12T00:26:30.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.586+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.58 2024-09-12T00:26:30.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.586+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.59 2024-09-12T00:26:30.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.586+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.60 2024-09-12T00:26:30.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.586+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.61 2024-09-12T00:26:30.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.586+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.62 2024-09-12T00:26:30.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.586+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.63 2024-09-12T00:26:30.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.586+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.64 2024-09-12T00:26:30.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.586+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.65 2024-09-12T00:26:30.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.588+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.66 2024-09-12T00:26:30.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.589+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.67 2024-09-12T00:26:30.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.589+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.68 2024-09-12T00:26:30.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.591+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.69 2024-09-12T00:26:30.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.591+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.70 2024-09-12T00:26:30.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.591+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.71 2024-09-12T00:26:30.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.591+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.72 2024-09-12T00:26:30.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.592+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.73 2024-09-12T00:26:30.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.592+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.74 2024-09-12T00:26:30.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.592+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.75 2024-09-12T00:26:30.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.592+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.76 2024-09-12T00:26:30.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.595+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.77 2024-09-12T00:26:30.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.595+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.78 2024-09-12T00:26:30.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.596+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.79 2024-09-12T00:26:30.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.596+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.80 2024-09-12T00:26:30.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.596+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.81 2024-09-12T00:26:30.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.596+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.82 2024-09-12T00:26:30.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.597+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.83 2024-09-12T00:26:30.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.597+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.84 2024-09-12T00:26:30.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.599+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.85 2024-09-12T00:26:30.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.600+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.86 2024-09-12T00:26:30.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.600+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.87 2024-09-12T00:26:30.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.600+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.88 2024-09-12T00:26:30.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.600+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.89 2024-09-12T00:26:30.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.600+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.90 2024-09-12T00:26:30.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.600+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58__multipart_key1.2~Pcm2qKQ2LjUxG8Ha0xzEZmeo_qCMZth.91 2024-09-12T00:26:30.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.603+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10163997314455773580', time=2024-09-12T02:26:27.755531+0000, chain.objs.size()=1 2024-09-12T00:26:30.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.603+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.61__shadow_.58BxaTd6pme5vLpAjE2oNC-vrrJgMgo_0 2024-09-12T00:26:30.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.606+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.608+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:26:30.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.610+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.610+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.611+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:30.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.611+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14782619198849220625', time=2024-09-12T02:26:08.525281+0000, chain.objs.size()=5 2024-09-12T00:26:30.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.611+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.44__multipart_key1.2~JNZli0jOZaoREq3x7PFXC_DnLxqiead.1 2024-09-12T00:26:30.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.611+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.44__multipart_key1.2~JNZli0jOZaoREq3x7PFXC_DnLxqiead.2 2024-09-12T00:26:30.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.611+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.44__multipart_key1.2~JNZli0jOZaoREq3x7PFXC_DnLxqiead.3 2024-09-12T00:26:30.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.611+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.44__multipart_key1.2~JNZli0jOZaoREq3x7PFXC_DnLxqiead.4 2024-09-12T00:26:30.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.611+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.44__multipart_key1.2~JNZli0jOZaoREq3x7PFXC_DnLxqiead.5 2024-09-12T00:26:30.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.615+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.617+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:26:30.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.618+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.616 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.618+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.619+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:30.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.619+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16782364100258716347', time=2024-09-12T02:26:17.660683+0000, chain.objs.size()=1 2024-09-12T00:26:30.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.619+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.53__shadow_.f-8u2tNAn7AMY2UkSZ6enoMqHlQ0PK-_0 2024-09-12T00:26:30.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.620+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.622+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:26:30.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.623+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.624+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.624+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:30.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.624+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14482093799959615158', time=2024-09-12T02:26:07.634506+0000, chain.objs.size()=5 2024-09-12T00:26:30.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.624+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.42__multipart_key1.2~BESxugPOCgxszElYnJZS_sonDdnQ95J.1 2024-09-12T00:26:30.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.624+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.42__multipart_key1.2~BESxugPOCgxszElYnJZS_sonDdnQ95J.2 2024-09-12T00:26:30.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.624+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.42__multipart_key1.2~BESxugPOCgxszElYnJZS_sonDdnQ95J.3 2024-09-12T00:26:30.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.624+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.42__multipart_key1.2~BESxugPOCgxszElYnJZS_sonDdnQ95J.4 2024-09-12T00:26:30.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.624+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.42__multipart_key1.2~BESxugPOCgxszElYnJZS_sonDdnQ95J.5 2024-09-12T00:26:30.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.628+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.631+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:26:30.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.632+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.632+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.633+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:26:30.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.633+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6218670548285384807', time=2024-09-12T02:26:23.357585+0000, chain.objs.size()=11 2024-09-12T00:26:30.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.633+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~EBXCJaIXoqdNjZxW_fHwxgkFdxgstbE.1 2024-09-12T00:26:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.633+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__shadow_key1.2~EBXCJaIXoqdNjZxW_fHwxgkFdxgstbE.1_1 2024-09-12T00:26:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.633+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~EBXCJaIXoqdNjZxW_fHwxgkFdxgstbE.2 2024-09-12T00:26:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.633+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__shadow_key1.2~EBXCJaIXoqdNjZxW_fHwxgkFdxgstbE.2_1 2024-09-12T00:26:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.633+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~EBXCJaIXoqdNjZxW_fHwxgkFdxgstbE.3 2024-09-12T00:26:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.633+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__shadow_key1.2~EBXCJaIXoqdNjZxW_fHwxgkFdxgstbE.3_1 2024-09-12T00:26:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.633+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~EBXCJaIXoqdNjZxW_fHwxgkFdxgstbE.4 2024-09-12T00:26:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.633+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__shadow_key1.2~EBXCJaIXoqdNjZxW_fHwxgkFdxgstbE.4_1 2024-09-12T00:26:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.633+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~EBXCJaIXoqdNjZxW_fHwxgkFdxgstbE.5 2024-09-12T00:26:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.633+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__shadow_key1.2~EBXCJaIXoqdNjZxW_fHwxgkFdxgstbE.5_1 2024-09-12T00:26:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.633+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~EBXCJaIXoqdNjZxW_fHwxgkFdxgstbE.6 2024-09-12T00:26:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.633+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4716309753698510446', time=2024-09-12T02:26:27.550077+0000, chain.objs.size()=1 2024-09-12T00:26:30.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.633+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.60__shadow_.2m9PfHFxkOhzmCD1-HNn4EZb5kbzpF2_0 2024-09-12T00:26:30.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.640+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.640 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.642+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:26:30.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.644+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.644+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.644+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:26:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.644+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2930900805827273678', time=2024-09-12T02:26:20.716364+0000, chain.objs.size()=11 2024-09-12T00:26:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.644+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~GOdona9b9dy66vDvhXrV-V-mzXaiO4j.1 2024-09-12T00:26:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.644+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~GOdona9b9dy66vDvhXrV-V-mzXaiO4j.2 2024-09-12T00:26:30.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.644+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~GOdona9b9dy66vDvhXrV-V-mzXaiO4j.3 2024-09-12T00:26:30.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.644+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~GOdona9b9dy66vDvhXrV-V-mzXaiO4j.4 2024-09-12T00:26:30.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.644+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~GOdona9b9dy66vDvhXrV-V-mzXaiO4j.5 2024-09-12T00:26:30.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.644+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~GOdona9b9dy66vDvhXrV-V-mzXaiO4j.6 2024-09-12T00:26:30.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.644+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~GOdona9b9dy66vDvhXrV-V-mzXaiO4j.7 2024-09-12T00:26:30.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.644+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~GOdona9b9dy66vDvhXrV-V-mzXaiO4j.8 2024-09-12T00:26:30.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.644+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~GOdona9b9dy66vDvhXrV-V-mzXaiO4j.9 2024-09-12T00:26:30.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.645+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~GOdona9b9dy66vDvhXrV-V-mzXaiO4j.10 2024-09-12T00:26:30.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.645+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~GOdona9b9dy66vDvhXrV-V-mzXaiO4j.11 2024-09-12T00:26:30.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.645+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12726626574726204420', time=2024-09-12T02:26:29.357211+0000, chain.objs.size()=11 2024-09-12T00:26:30.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.645+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.66__multipart_key1.2~a9zbQE3iXxfKbFy8WSI4n7AVCuAFIJz.1 2024-09-12T00:26:30.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.651+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.66__multipart_key1.2~a9zbQE3iXxfKbFy8WSI4n7AVCuAFIJz.2 2024-09-12T00:26:30.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.651+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.66__multipart_key1.2~a9zbQE3iXxfKbFy8WSI4n7AVCuAFIJz.3 2024-09-12T00:26:30.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.651+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.66__multipart_key1.2~a9zbQE3iXxfKbFy8WSI4n7AVCuAFIJz.4 2024-09-12T00:26:30.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.651+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.66__multipart_key1.2~a9zbQE3iXxfKbFy8WSI4n7AVCuAFIJz.5 2024-09-12T00:26:30.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.651+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.66__multipart_key1.2~a9zbQE3iXxfKbFy8WSI4n7AVCuAFIJz.6 2024-09-12T00:26:30.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.651+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.66__multipart_key1.2~a9zbQE3iXxfKbFy8WSI4n7AVCuAFIJz.7 2024-09-12T00:26:30.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.651+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.66__multipart_key1.2~a9zbQE3iXxfKbFy8WSI4n7AVCuAFIJz.8 2024-09-12T00:26:30.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.651+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.66__multipart_key1.2~a9zbQE3iXxfKbFy8WSI4n7AVCuAFIJz.9 2024-09-12T00:26:30.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.651+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.66__multipart_key1.2~a9zbQE3iXxfKbFy8WSI4n7AVCuAFIJz.10 2024-09-12T00:26:30.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.651+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.66__multipart_key1.2~a9zbQE3iXxfKbFy8WSI4n7AVCuAFIJz.11 2024-09-12T00:26:30.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.658+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.661+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:26:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.662+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.662+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.663+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:30.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.663+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6219363651909140522', time=2024-09-12T02:26:17.654139+0000, chain.objs.size()=5 2024-09-12T00:26:30.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.663+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.53__multipart_file.mpg.2~OzMbR_YQs2dal8AwqQkNxpd7mhB9hdO.1 2024-09-12T00:26:30.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.663+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.53__multipart_file.mpg.2~OzMbR_YQs2dal8AwqQkNxpd7mhB9hdO.2 2024-09-12T00:26:30.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.663+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.53__multipart_file.mpg.2~OzMbR_YQs2dal8AwqQkNxpd7mhB9hdO.3 2024-09-12T00:26:30.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.663+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.53__multipart_file.mpg.2~OzMbR_YQs2dal8AwqQkNxpd7mhB9hdO.4 2024-09-12T00:26:30.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.663+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.53__multipart_file.mpg.2~OzMbR_YQs2dal8AwqQkNxpd7mhB9hdO.5 2024-09-12T00:26:30.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.665+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.668+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:26:30.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.670+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.670+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.670+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:26:30.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.670+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='2~cx0HBlj6XuXRC3Tgjg3LRZWY-CT1WFU', time=2024-09-12T02:26:18.184041+0000, chain.objs.size()=3 2024-09-12T00:26:30.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.670+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.54__multipart_key1.2~cx0HBlj6XuXRC3Tgjg3LRZWY-CT1WFU.7 2024-09-12T00:26:30.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.670+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.54__multipart_key1.2~cx0HBlj6XuXRC3Tgjg3LRZWY-CT1WFU.10 2024-09-12T00:26:30.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.670+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.54__multipart_key1.2~cx0HBlj6XuXRC3Tgjg3LRZWY-CT1WFU.13 2024-09-12T00:26:30.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.670+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16680978490725922375', time=2024-09-12T02:26:21.398177+0000, chain.objs.size()=10 2024-09-12T00:26:30.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.670+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~7BkPLf8i7LDuLwV6Z7uA0ZM6ZTK8wG8.1 2024-09-12T00:26:30.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.671+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~7BkPLf8i7LDuLwV6Z7uA0ZM6ZTK8wG8.2 2024-09-12T00:26:30.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.671+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~7BkPLf8i7LDuLwV6Z7uA0ZM6ZTK8wG8.3 2024-09-12T00:26:30.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.671+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~7BkPLf8i7LDuLwV6Z7uA0ZM6ZTK8wG8.4 2024-09-12T00:26:30.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.671+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~7BkPLf8i7LDuLwV6Z7uA0ZM6ZTK8wG8.5 2024-09-12T00:26:30.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.671+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~7BkPLf8i7LDuLwV6Z7uA0ZM6ZTK8wG8.6 2024-09-12T00:26:30.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.671+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~7BkPLf8i7LDuLwV6Z7uA0ZM6ZTK8wG8.7 2024-09-12T00:26:30.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.671+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~7BkPLf8i7LDuLwV6Z7uA0ZM6ZTK8wG8.8 2024-09-12T00:26:30.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.671+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~7BkPLf8i7LDuLwV6Z7uA0ZM6ZTK8wG8.9 2024-09-12T00:26:30.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.675+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~7BkPLf8i7LDuLwV6Z7uA0ZM6ZTK8wG8.10 2024-09-12T00:26:30.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.675+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12408164498279374754', time=2024-09-12T02:26:25.321475+0000, chain.objs.size()=1 2024-09-12T00:26:30.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.675+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.56__shadow_.b1TxoI5QGFPFwjwSbecY49FvHklUkmR_0 2024-09-12T00:26:30.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.679+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.681+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:26:30.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.682+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.683+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.683+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:30.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.683+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9904389373432403132', time=2024-09-12T02:26:28.380218+0000, chain.objs.size()=1 2024-09-12T00:26:30.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.683+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.64__shadow_.BYMQQue3zM_oiOUoN2nvhjgodAO2v8T_0 2024-09-12T00:26:30.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.685+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.687+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:26:30.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.688+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.688+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.689+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:30.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.689+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15371220526329047766', time=2024-09-12T02:26:10.629756+0000, chain.objs.size()=5 2024-09-12T00:26:30.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.689+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~jAF5IPxmrD1fqFVwYy30ptzM-0iQpFY.1 2024-09-12T00:26:30.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.689+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~jAF5IPxmrD1fqFVwYy30ptzM-0iQpFY.2 2024-09-12T00:26:30.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.689+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~jAF5IPxmrD1fqFVwYy30ptzM-0iQpFY.3 2024-09-12T00:26:30.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.689+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~jAF5IPxmrD1fqFVwYy30ptzM-0iQpFY.4 2024-09-12T00:26:30.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.689+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~jAF5IPxmrD1fqFVwYy30ptzM-0iQpFY.5 2024-09-12T00:26:30.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.692+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.695+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:26:30.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.696+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.697+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.697+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.698+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:26:30.697 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.699+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.700+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.700+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:30.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.700+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8820359850330157876', time=2024-09-12T02:26:27.961186+0000, chain.objs.size()=1 2024-09-12T00:26:30.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.700+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.62__shadow_.yKfLoW7tQkZ-GVz0uBQlUUpO_jFR80S_0 2024-09-12T00:26:30.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.701+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.704+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:26:30.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.705+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.705+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.706+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:30.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.706+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1018755061409060371', time=2024-09-12T02:26:27.339436+0000, chain.objs.size()=1 2024-09-12T00:26:30.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.706+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.59__shadow_.eIQ-CfjsntLOfpMPCCJr567LO_SdHTm_0 2024-09-12T00:26:30.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.707+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.709+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:26:30.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.710+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.710+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.711+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.711+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:26:30.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.713+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.713+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.714+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:26:30.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.714+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16714410906630303887', time=2024-09-12T02:26:12.107176+0000, chain.objs.size()=5 2024-09-12T00:26:30.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.714+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~Bft4C0FSqX5rndOlEMyT-JOOSQIfYId.1 2024-09-12T00:26:30.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.714+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~Bft4C0FSqX5rndOlEMyT-JOOSQIfYId.2 2024-09-12T00:26:30.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.714+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~Bft4C0FSqX5rndOlEMyT-JOOSQIfYId.3 2024-09-12T00:26:30.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.714+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~Bft4C0FSqX5rndOlEMyT-JOOSQIfYId.4 2024-09-12T00:26:30.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.714+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~Bft4C0FSqX5rndOlEMyT-JOOSQIfYId.5 2024-09-12T00:26:30.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.714+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12640441003465691926', time=2024-09-12T02:26:28.170058+0000, chain.objs.size()=1 2024-09-12T00:26:30.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.714+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.63__shadow_.KmHRHBBaAZrpzMzTfuPmcn78xOPsC1h_0 2024-09-12T00:26:30.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.717+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.720+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:26:30.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.721+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.722+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.722+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.723+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:26:30.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.724+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.725+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.725+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.726+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:26:30.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.727+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.728+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.728+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:30.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.728+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13587589766815524871', time=2024-09-12T02:26:24.179404+0000, chain.objs.size()=11 2024-09-12T00:26:30.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.728+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~DY7g-fW11vG2fzk1walkY0HS5j2Q0tX.1 2024-09-12T00:26:30.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.728+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__shadow_key1.2~DY7g-fW11vG2fzk1walkY0HS5j2Q0tX.1_1 2024-09-12T00:26:30.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.728+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~DY7g-fW11vG2fzk1walkY0HS5j2Q0tX.2 2024-09-12T00:26:30.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.728+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__shadow_key1.2~DY7g-fW11vG2fzk1walkY0HS5j2Q0tX.2_1 2024-09-12T00:26:30.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.728+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~DY7g-fW11vG2fzk1walkY0HS5j2Q0tX.3 2024-09-12T00:26:30.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.728+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__shadow_key1.2~DY7g-fW11vG2fzk1walkY0HS5j2Q0tX.3_1 2024-09-12T00:26:30.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.728+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~DY7g-fW11vG2fzk1walkY0HS5j2Q0tX.4 2024-09-12T00:26:30.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.728+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__shadow_key1.2~DY7g-fW11vG2fzk1walkY0HS5j2Q0tX.4_1 2024-09-12T00:26:30.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.728+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~DY7g-fW11vG2fzk1walkY0HS5j2Q0tX.5 2024-09-12T00:26:30.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.728+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__shadow_key1.2~DY7g-fW11vG2fzk1walkY0HS5j2Q0tX.5_1 2024-09-12T00:26:30.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.728+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.55__multipart_key1.2~DY7g-fW11vG2fzk1walkY0HS5j2Q0tX.6 2024-09-12T00:26:30.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.736+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.738+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:26:30.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.739+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.740+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.740+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.741+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:26:30.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.742+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.743+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.743+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.745+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:26:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.746+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.746+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.747+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:30.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.747+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1460375975307919793', time=2024-09-12T02:26:17.678571+0000, chain.objs.size()=1 2024-09-12T00:26:30.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.747+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.53__shadow_.8X28x_KzaH_8LmazLcs6duVoTtGq4QA_0 2024-09-12T00:26:30.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.748+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.750+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:26:30.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.751+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.752+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.752+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:30.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.752+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7109718974025303919', time=2024-09-12T02:26:17.667087+0000, chain.objs.size()=5 2024-09-12T00:26:30.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.752+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.53__multipart_file2.mpg.2~gJzOxi4cgZlrUVjPUbCUFP8bE0giBXq.1 2024-09-12T00:26:30.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.752+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.53__multipart_file2.mpg.2~gJzOxi4cgZlrUVjPUbCUFP8bE0giBXq.2 2024-09-12T00:26:30.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.752+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.53__multipart_file2.mpg.2~gJzOxi4cgZlrUVjPUbCUFP8bE0giBXq.3 2024-09-12T00:26:30.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.752+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.53__multipart_file2.mpg.2~gJzOxi4cgZlrUVjPUbCUFP8bE0giBXq.4 2024-09-12T00:26:30.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.752+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.53__multipart_file2.mpg.2~gJzOxi4cgZlrUVjPUbCUFP8bE0giBXq.5 2024-09-12T00:26:30.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.756+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.758+0000 7f89d0f35800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:26:30.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.759+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.760+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.760+0000 7f89d0f35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:26:30.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.760+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10149979893945524161', time=2024-09-12T02:26:12.511414+0000, chain.objs.size()=5 2024-09-12T00:26:30.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.760+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~7R5No1epN_1kLpq3pzUS-Cm8D4KftvZ.1 2024-09-12T00:26:30.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.760+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__shadow_key1.2~7R5No1epN_1kLpq3pzUS-Cm8D4KftvZ.1_1 2024-09-12T00:26:30.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.760+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~7R5No1epN_1kLpq3pzUS-Cm8D4KftvZ.2 2024-09-12T00:26:30.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.760+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__shadow_key1.2~7R5No1epN_1kLpq3pzUS-Cm8D4KftvZ.2_1 2024-09-12T00:26:30.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.760+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.47__multipart_key1.2~7R5No1epN_1kLpq3pzUS-Cm8D4KftvZ.3 2024-09-12T00:26:30.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.760+0000 7f89d0f35800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6692063643340793346', time=2024-09-12T02:26:26.540007+0000, chain.objs.size()=5 2024-09-12T00:26:30.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.760+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.57__multipart_key1.2~_xnCWZ5EqbtX7pdXSjo5kIBem3WpfC8.1 2024-09-12T00:26:30.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.760+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.57__multipart_key1.2~_xnCWZ5EqbtX7pdXSjo5kIBem3WpfC8.2 2024-09-12T00:26:30.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.760+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.57__multipart_key1.2~_xnCWZ5EqbtX7pdXSjo5kIBem3WpfC8.3 2024-09-12T00:26:30.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.760+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.57__multipart_key1.2~_xnCWZ5EqbtX7pdXSjo5kIBem3WpfC8.4 2024-09-12T00:26:30.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.760+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.57__multipart_key1.2~_xnCWZ5EqbtX7pdXSjo5kIBem3WpfC8.5 2024-09-12T00:26:30.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.766+0000 7f89d0f35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:30.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.769+0000 7f8882fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:30.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.771+0000 7f89d0f35800 20 remove_watcher() i=0 2024-09-12T00:26:30.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.771+0000 7f89d0f35800 2 removed watcher, disabling cache 2024-09-12T00:26:30.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.772+0000 7f89d0f35800 20 remove_watcher() i=1 2024-09-12T00:26:30.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.773+0000 7f89d0f35800 20 remove_watcher() i=2 2024-09-12T00:26:30.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.774+0000 7f89d0f35800 20 remove_watcher() i=3 2024-09-12T00:26:30.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.775+0000 7f89d0f35800 20 remove_watcher() i=4 2024-09-12T00:26:30.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.776+0000 7f89d0f35800 20 remove_watcher() i=5 2024-09-12T00:26:30.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.777+0000 7f89d0f35800 20 remove_watcher() i=6 2024-09-12T00:26:30.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.778+0000 7f89d0f35800 20 remove_watcher() i=7 2024-09-12T00:26:30.788 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T00:26:30.841 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:30.841 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:30.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.882+0000 7f212dcbb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.884+0000 7f212dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:30.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.884+0000 7f212dcbb800 20 realm 2024-09-12T00:26:30.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.884+0000 7f212dcbb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.884+0000 7f212dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:30.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.884+0000 7f212dcbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:30.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.884+0000 7f212dcbb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.884+0000 7f212dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:30.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.884+0000 7f212dcbb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.885+0000 7f212dcbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:30.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.885+0000 7f212dcbb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.886+0000 7f212dcbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:30.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.886+0000 7f212dcbb800 20 searching for the correct realm 2024-09-12T00:26:30.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.889+0000 7f2122fa4640 0 -- 172.21.15.67:0/3446610873 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f2114087410 msgr2=0x7f2114087890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:30.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.893+0000 7f212b7a5640 0 -- 172.21.15.67:0/3446610873 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f2124038960 msgr2=0x7f212401e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.896+0000 7f212dcbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.896+0000 7f212dcbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.896+0000 7f212dcbb800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:26:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.896+0000 7f212dcbb800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:26:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.896+0000 7f212dcbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.896+0000 7f212dcbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.896+0000 7f212dcbb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.897+0000 7f212dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:30.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.897+0000 7f212dcbb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.897+0000 7f212dcbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.897+0000 7f212dcbb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.897+0000 7f212dcbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.897+0000 7f212dcbb800 20 zone default found 2024-09-12T00:26:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.897+0000 7f212dcbb800 4 Realm: () 2024-09-12T00:26:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.897+0000 7f212dcbb800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:26:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.897+0000 7f212dcbb800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:26:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.897+0000 7f212dcbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.897+0000 7f212dcbb800 20 zonegroup default 2024-09-12T00:26:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.897+0000 7f212dcbb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.898+0000 7f212dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:30.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.898+0000 7f212dcbb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.898+0000 7f212dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.898+0000 7f212dcbb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.898+0000 7f212dcbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.898+0000 7f212dcbb800 20 started sync module instance, tier type = 2024-09-12T00:26:30.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.898+0000 7f212dcbb800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:26:30.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.906+0000 7f212dcbb800 20 add_watcher() i=0 2024-09-12T00:26:30.904 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.906+0000 7f212dcbb800 20 add_watcher() i=1 2024-09-12T00:26:30.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.906+0000 7f212dcbb800 20 add_watcher() i=2 2024-09-12T00:26:30.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.906+0000 7f212dcbb800 20 add_watcher() i=3 2024-09-12T00:26:30.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.906+0000 7f212dcbb800 20 add_watcher() i=4 2024-09-12T00:26:30.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.906+0000 7f212dcbb800 20 add_watcher() i=5 2024-09-12T00:26:30.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.906+0000 7f212dcbb800 20 add_watcher() i=6 2024-09-12T00:26:30.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.907+0000 7f212dcbb800 20 add_watcher() i=7 2024-09-12T00:26:30.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.907+0000 7f212dcbb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:30.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.909+0000 7f1fe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:30.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.909+0000 7f212dcbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:30.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.909+0000 7f212dcbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:30.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.945+0000 7f1fe0fe1640 20 reqs_thread_entry: start 2024-09-12T00:26:30.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.945+0000 7f212dcbb800 20 init_complete bucket index max shards: 1 2024-09-12T00:26:30.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.945+0000 7f212dcbb800 20 Filter name: none 2024-09-12T00:26:30.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.945+0000 7f1f5a7fc640 20 reqs_thread_entry: start 2024-09-12T00:26:30.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.946+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:26:30.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.947+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.947+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.948+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.948+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:26:30.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.950+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.950+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.950+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.951+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:26:30.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.952+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.953+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.953+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.954+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:26:30.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.955+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.956+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.956+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.958+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:26:30.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.959+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.960+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.960+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.961+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:26:30.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.962+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.963+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.963+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.965+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:26:30.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.966+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.967+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.967+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.968+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:26:30.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.969+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.970+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.970+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.971+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:26:30.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.973+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.973+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.973+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.974+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:26:30.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.976+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.976+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.976+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.977+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:26:30.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.979+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.979+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.979+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.980+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:26:30.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.982+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.982+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.982+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.983+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:26:30.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.985+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.986+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.986+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.987+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:26:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.989+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.989+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.989+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.990+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:26:30.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.991+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.992+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.992+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.993+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:26:30.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.994+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.995+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.995+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.996+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:26:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.998+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.998+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:30.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:30.999+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:30.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.000+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:26:31.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.001+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.002+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.002+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.003+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:26:31.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.004+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.005+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.005+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.006+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:26:31.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.007+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.008+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.008+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.009+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:26:31.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.011+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.011+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.011+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.012 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.013+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:26:31.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.014+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.014+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.014+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.015+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:26:31.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.017+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.017+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.017+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.018+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:26:31.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.019+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.020+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.020+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.021+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:26:31.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.022+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.023+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.023+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.024+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:26:31.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.025+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.026+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.026+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.027+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:26:31.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.029+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.029+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.030+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.031+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:26:31.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.032+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.033+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.033+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.034+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:26:31.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.035+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.035+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.036+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.037+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:26:31.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.038+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.038+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.039+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.039+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:26:31.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.041+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.041+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.042+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.042+0000 7f212dcbb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:26:31.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.044+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.044+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.044+0000 7f212dcbb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.046+0000 7f1fe1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:31.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.048+0000 7f212dcbb800 20 remove_watcher() i=0 2024-09-12T00:26:31.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.048+0000 7f212dcbb800 2 removed watcher, disabling cache 2024-09-12T00:26:31.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.049+0000 7f212dcbb800 20 remove_watcher() i=1 2024-09-12T00:26:31.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.050+0000 7f212dcbb800 20 remove_watcher() i=2 2024-09-12T00:26:31.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.051+0000 7f212dcbb800 20 remove_watcher() i=3 2024-09-12T00:26:31.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.052+0000 7f212dcbb800 20 remove_watcher() i=4 2024-09-12T00:26:31.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.053+0000 7f212dcbb800 20 remove_watcher() i=5 2024-09-12T00:26:31.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.054+0000 7f212dcbb800 20 remove_watcher() i=6 2024-09-12T00:26:31.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.055+0000 7f212dcbb800 20 remove_watcher() i=7 2024-09-12T00:26:31.066 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T00:26:31.119 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:31.120 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:31.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.160+0000 7f8288640800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.161+0000 7f8288640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:31.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.161+0000 7f8288640800 20 realm 2024-09-12T00:26:31.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.161+0000 7f8288640800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.162+0000 7f8288640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:31.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.162+0000 7f8288640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:31.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.162+0000 7f8288640800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.162+0000 7f8288640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:31.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.162+0000 7f8288640800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.163+0000 7f8288640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:31.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.163+0000 7f8288640800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.163+0000 7f8288640800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:31.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.163+0000 7f8288640800 20 searching for the correct realm 2024-09-12T00:26:31.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.166+0000 7f8285929640 0 -- 172.21.15.67:0/4127263722 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f827c0890b0 msgr2=0x7f827c05fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:31.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.372+0000 7f8285929640 0 -- 172.21.15.67:0/4127263722 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x56051b79bf00 msgr2=0x56051b79e320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:31.376 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:26:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:26:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 20 zone default found 2024-09-12T00:26:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 4 Realm: () 2024-09-12T00:26:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:26:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:26:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 20 zonegroup default 2024-09-12T00:26:31.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.377+0000 7f8288640800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.378+0000 7f8288640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:31.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.378+0000 7f8288640800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.378+0000 7f8288640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:31.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.378+0000 7f8288640800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.378+0000 7f8288640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:31.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.378+0000 7f8288640800 20 started sync module instance, tier type = 2024-09-12T00:26:31.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.378+0000 7f8288640800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:26:31.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.386+0000 7f8288640800 20 add_watcher() i=0 2024-09-12T00:26:31.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.386+0000 7f8288640800 20 add_watcher() i=1 2024-09-12T00:26:31.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.386+0000 7f8288640800 20 add_watcher() i=2 2024-09-12T00:26:31.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.386+0000 7f8288640800 20 add_watcher() i=3 2024-09-12T00:26:31.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.386+0000 7f8288640800 20 add_watcher() i=4 2024-09-12T00:26:31.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.386+0000 7f8288640800 20 add_watcher() i=5 2024-09-12T00:26:31.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.386+0000 7f8288640800 20 add_watcher() i=6 2024-09-12T00:26:31.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.387+0000 7f8288640800 20 add_watcher() i=7 2024-09-12T00:26:31.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.387+0000 7f8288640800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:31.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.390+0000 7f813cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:31.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.390+0000 7f8288640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:31.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.390+0000 7f8288640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:31.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.429+0000 7f80b77fe640 20 reqs_thread_entry: start 2024-09-12T00:26:31.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.429+0000 7f8288640800 20 init_complete bucket index max shards: 1 2024-09-12T00:26:31.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.429+0000 7f8288640800 20 Filter name: none 2024-09-12T00:26:31.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.429+0000 7f80b57fa640 20 reqs_thread_entry: start 2024-09-12T00:26:31.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.429+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:26:31.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.430+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.431+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.431+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.432+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:26:31.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.433+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.434+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.434+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.435+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:26:31.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.436+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.437+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.437+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.437 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.438+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:26:31.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.439+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.440+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.440+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.440 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.441+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:26:31.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.442+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.443+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.443+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.444+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:26:31.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.446+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.446+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.447+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.448+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:26:31.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.449+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.450+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.450+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.451+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:26:31.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.452+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.453+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.453+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.454+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:26:31.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.455+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.456+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.456+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.457+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:26:31.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.458+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.459+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.459+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.460+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:26:31.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.461+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.462+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.462+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.463+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:26:31.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.464+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.464+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.465+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.466+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:26:31.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.467+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.468+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.468+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.469+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:26:31.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.470+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.471+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.471+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.472+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:26:31.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.473+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.473+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.474+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.475+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:26:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.476+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.476+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.476+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.477+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:26:31.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.479+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.480+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.480+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.481+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:26:31.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.482+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.482+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.483+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.483+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:26:31.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.485+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.485+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.486+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.487+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:26:31.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.488+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.489+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.489+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.490+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:26:31.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.491+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.492+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.492+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.493+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:26:31.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.494+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.495+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.495+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.496+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:26:31.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.497+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.498+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.498+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.499+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:26:31.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.500+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.501+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.501+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.502+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:26:31.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.503+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.504+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.504+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.505+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:26:31.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.507+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.508+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.508+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.509+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:26:31.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.510+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.511+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.511+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.512+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:26:31.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.514+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.515+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.515+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.516+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:26:31.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.518+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.519+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.519+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.520+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:26:31.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.521+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.522+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.522+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.523+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:26:31.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.524+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.525+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.525+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.526+0000 7f8288640800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:26:31.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.539+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.540+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:31.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.540+0000 7f8288640800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:31.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.542+0000 7f813cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:31.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.544+0000 7f8288640800 20 remove_watcher() i=0 2024-09-12T00:26:31.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.544+0000 7f8288640800 2 removed watcher, disabling cache 2024-09-12T00:26:31.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.545+0000 7f8288640800 20 remove_watcher() i=1 2024-09-12T00:26:31.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.546+0000 7f8288640800 20 remove_watcher() i=2 2024-09-12T00:26:31.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.547+0000 7f8288640800 20 remove_watcher() i=3 2024-09-12T00:26:31.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.548+0000 7f8288640800 20 remove_watcher() i=4 2024-09-12T00:26:31.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.549+0000 7f8288640800 20 remove_watcher() i=5 2024-09-12T00:26:31.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.550+0000 7f8288640800 20 remove_watcher() i=6 2024-09-12T00:26:31.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.551+0000 7f8288640800 20 remove_watcher() i=7 2024-09-12T00:26:31.563 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T00:26:31.617 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:31.617 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:31.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.658+0000 7ff88aebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.660+0000 7ff88aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:31.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.660+0000 7ff88aebb800 20 realm 2024-09-12T00:26:31.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.660+0000 7ff88aebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.660+0000 7ff88aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:31.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.660+0000 7ff88aebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:31.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.660+0000 7ff88aebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.661+0000 7ff88aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:31.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.661+0000 7ff88aebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.661+0000 7ff88aebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:31.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.661+0000 7ff88aebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:31.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.662+0000 7ff88aebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:31.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.662+0000 7ff88aebb800 20 searching for the correct realm 2024-09-12T00:26:31.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.664+0000 7ff8889a5640 0 -- 172.21.15.67:0/33323844 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7ff87807dba0 msgr2=0x7ff87807a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:31.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:31.870+0000 7ff8889a5640 0 -- 172.21.15.67:0/33323844 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7ff880015030 msgr2=0x7ff880044470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:32.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.078+0000 7ff88aebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:32.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.078+0000 7ff88aebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:32.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.078+0000 7ff88aebb800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:26:32.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.078+0000 7ff88aebb800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:26:32.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.078+0000 7ff88aebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:32.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.078+0000 7ff88aebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:32.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.078+0000 7ff88aebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:32.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.078+0000 7ff88aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:32.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.078+0000 7ff88aebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:32.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.079+0000 7ff88aebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:32.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.079+0000 7ff88aebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.079+0000 7ff88aebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.079+0000 7ff88aebb800 20 zone default found 2024-09-12T00:26:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.079+0000 7ff88aebb800 4 Realm: () 2024-09-12T00:26:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.079+0000 7ff88aebb800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:26:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.079+0000 7ff88aebb800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:26:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.079+0000 7ff88aebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.079+0000 7ff88aebb800 20 zonegroup default 2024-09-12T00:26:32.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.079+0000 7ff88aebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:32.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.079+0000 7ff88aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:32.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.079+0000 7ff88aebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:32.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.080+0000 7ff88aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:32.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.080+0000 7ff88aebb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:32.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.080+0000 7ff88aebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:32.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.080+0000 7ff88aebb800 20 started sync module instance, tier type = 2024-09-12T00:26:32.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.080+0000 7ff88aebb800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:26:32.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.089+0000 7ff88aebb800 20 add_watcher() i=0 2024-09-12T00:26:32.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.089+0000 7ff88aebb800 20 add_watcher() i=1 2024-09-12T00:26:32.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.089+0000 7ff88aebb800 20 add_watcher() i=2 2024-09-12T00:26:32.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.089+0000 7ff88aebb800 20 add_watcher() i=3 2024-09-12T00:26:32.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.089+0000 7ff88aebb800 20 add_watcher() i=4 2024-09-12T00:26:32.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.089+0000 7ff88aebb800 20 add_watcher() i=5 2024-09-12T00:26:32.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.089+0000 7ff88aebb800 20 add_watcher() i=6 2024-09-12T00:26:32.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.090+0000 7ff88aebb800 20 add_watcher() i=7 2024-09-12T00:26:32.089 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.090+0000 7ff88aebb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:32.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.092+0000 7ff73f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:32.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.092+0000 7ff88aebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:32.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.092+0000 7ff88aebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:32.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.129+0000 7ff73e7e4640 20 reqs_thread_entry: start 2024-09-12T00:26:32.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.129+0000 7ff88aebb800 20 init_complete bucket index max shards: 1 2024-09-12T00:26:32.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.129+0000 7ff88aebb800 20 Filter name: none 2024-09-12T00:26:32.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.129+0000 7ff7377fe640 20 reqs_thread_entry: start 2024-09-12T00:26:32.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.129+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:26:32.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.131+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.131+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.132+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.132+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:26:32.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.134+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.134+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.135+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.136+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:26:32.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.137+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.137+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.138+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.139+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:26:32.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.140+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.141+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.141+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.142+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:26:32.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.144+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.144+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.144+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.146+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:26:32.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.148+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.149+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.149+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.150+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:26:32.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.151+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.152+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.152+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.153+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:26:32.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.154+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.155+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.155+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.156+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:26:32.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.157+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.158+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.158+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.159+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:26:32.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.160+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.161+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.161+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.162+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:26:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.164+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.164+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.165+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.166+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:26:32.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.167+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.167+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.168+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.169+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:26:32.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.170+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.170+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.170+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.171+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:26:32.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.173+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.174+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.174+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.175+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:26:32.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.177+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.177+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.177+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.179+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:26:32.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.180+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.180+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.181+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.182+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:26:32.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.183+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.184+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.184+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.185+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:26:32.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.186+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.187+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.187+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.188+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:26:32.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.190+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.191+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.191+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.192+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:26:32.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.194+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.194+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.194+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.196+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:26:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.198+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.198+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.198+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.199+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:26:32.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.201+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.201+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.202+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.203+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:26:32.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.204+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.205+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.205+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.206+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:26:32.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.208+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.208+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.209+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.210+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:26:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.212+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.212+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.213+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.214+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:26:32.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.215+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.215+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.216+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.217+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:26:32.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.218+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.219+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.219+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.220+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:26:32.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.221+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.222+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.222+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.223+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:26:32.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.224+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.225+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.225+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.226+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:26:32.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.227+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.228+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.228+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.229+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:26:32.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.230+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.231+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.231+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.233+0000 7ff88aebb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:26:32.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.234+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.235+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:32.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.235+0000 7ff88aebb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:32.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.237+0000 7ff73f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:32.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.239+0000 7ff88aebb800 20 remove_watcher() i=0 2024-09-12T00:26:32.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.239+0000 7ff88aebb800 2 removed watcher, disabling cache 2024-09-12T00:26:32.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.240+0000 7ff88aebb800 20 remove_watcher() i=1 2024-09-12T00:26:32.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.241+0000 7ff88aebb800 20 remove_watcher() i=2 2024-09-12T00:26:32.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.242+0000 7ff88aebb800 20 remove_watcher() i=3 2024-09-12T00:26:32.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.243+0000 7ff88aebb800 20 remove_watcher() i=4 2024-09-12T00:26:32.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.244+0000 7ff88aebb800 20 remove_watcher() i=5 2024-09-12T00:26:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.245+0000 7ff88aebb800 20 remove_watcher() i=6 2024-09-12T00:26:32.245 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:32.246+0000 7ff88aebb800 20 remove_watcher() i=7 2024-09-12T00:26:32.257 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T00:26:32.760 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :clean 2024-09-12T00:26:33.657 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :compileJava 2024-09-12T00:26:33.657 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :processResources 2024-09-12T00:26:33.657 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :classes 2024-09-12T00:26:34.257 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:34.257 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :compileTestJava 2024-09-12T00:26:34.257 INFO:teuthology.orchestra.run.smithi067.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:26:34.257 INFO:teuthology.orchestra.run.smithi067.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:26:34.258 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:34.258 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:26:34.258 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :testClasses 2024-09-12T00:26:36.258 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.258 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :test 2024-09-12T00:26:36.258 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.258 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T00:26:36.258 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12 00:26:35,540 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:26:36.259 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.259 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T00:26:36.259 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.259 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T00:26:36.259 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.259 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T00:26:36.259 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.259 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T00:26:36.259 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.259 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T00:26:36.259 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.259 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T00:26:36.356 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.357 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T00:26:36.357 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.357 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T00:26:36.457 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.457 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T00:26:36.457 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.457 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T00:26:36.656 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.657 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T00:26:36.756 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.756 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T00:26:36.856 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.857 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T00:26:36.857 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:36.857 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T00:26:37.156 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:37.156 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T00:26:37.256 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:37.257 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T00:26:37.456 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:37.457 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T00:26:37.457 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:37.457 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T00:26:37.558 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:37.558 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------- 2024-09-12T00:26:37.558 INFO:teuthology.orchestra.run.smithi067.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T00:26:37.558 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------- 2024-09-12T00:26:37.558 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:37.558 INFO:teuthology.orchestra.run.smithi067.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:26:37.558 INFO:teuthology.orchestra.run.smithi067.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:26:37.558 INFO:teuthology.orchestra.run.smithi067.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:26:37.558 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:37.558 INFO:teuthology.orchestra.run.smithi067.stdout:BUILD SUCCESSFUL in 5s 2024-09-12T00:26:37.559 INFO:teuthology.orchestra.run.smithi067.stdout:5 actionable tasks: 5 executed 2024-09-12T00:26:37.564 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T00:26:37.617 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:37.617 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:37.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.658+0000 7f915811f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:37.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.659+0000 7f915811f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:37.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.659+0000 7f915811f800 20 realm 2024-09-12T00:26:37.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.659+0000 7f915811f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:37.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.660+0000 7f915811f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:37.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.660+0000 7f915811f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:37.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.660+0000 7f915811f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:37.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.660+0000 7f915811f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:37.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.660+0000 7f915811f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:37.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.661+0000 7f915811f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:37.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.661+0000 7f915811f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:37.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.662+0000 7f915811f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:37.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.662+0000 7f915811f800 20 searching for the correct realm 2024-09-12T00:26:37.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.665+0000 7f914b60b640 0 -- 172.21.15.67:0/3797271148 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f913c0abb00 msgr2=0x7f913c0d9720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:37.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.870+0000 7f915460d640 0 -- 172.21.15.67:0/3797271148 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55bdd6b2e400 msgr2=0x55bdd6b30870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.874+0000 7f915811f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.874+0000 7f915811f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.874+0000 7f915811f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:26:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.874+0000 7f915811f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:26:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.874+0000 7f915811f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.874+0000 7f915811f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.874+0000 7f915811f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.875+0000 7f915811f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.875+0000 7f915811f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:37.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.875+0000 7f915811f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:37.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.875+0000 7f915811f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:37.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.876+0000 7f915811f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:37.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.876+0000 7f915811f800 20 zone default found 2024-09-12T00:26:37.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.876+0000 7f915811f800 4 Realm: () 2024-09-12T00:26:37.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.876+0000 7f915811f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:26:37.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.876+0000 7f915811f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:26:37.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.876+0000 7f915811f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:37.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.876+0000 7f915811f800 20 zonegroup default 2024-09-12T00:26:37.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.876+0000 7f915811f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:37.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.876+0000 7f915811f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:37.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.876+0000 7f915811f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:37.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.876+0000 7f915811f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:37.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.876+0000 7f915811f800 20 rados->read ofs=0 len=0 2024-09-12T00:26:37.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.877+0000 7f915811f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:37.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.877+0000 7f915811f800 20 started sync module instance, tier type = 2024-09-12T00:26:37.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.877+0000 7f915811f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:26:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.886+0000 7f915811f800 20 add_watcher() i=0 2024-09-12T00:26:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.886+0000 7f915811f800 20 add_watcher() i=1 2024-09-12T00:26:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.886+0000 7f915811f800 20 add_watcher() i=2 2024-09-12T00:26:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.886+0000 7f915811f800 20 add_watcher() i=3 2024-09-12T00:26:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.886+0000 7f915811f800 20 add_watcher() i=4 2024-09-12T00:26:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.886+0000 7f915811f800 20 add_watcher() i=5 2024-09-12T00:26:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.886+0000 7f915811f800 20 add_watcher() i=6 2024-09-12T00:26:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.888+0000 7f915811f800 20 add_watcher() i=7 2024-09-12T00:26:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.888+0000 7f915811f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.890+0000 7f9009fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.890+0000 7f915811f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.890+0000 7f915811f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:37.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.929+0000 7f9008fe1640 20 reqs_thread_entry: start 2024-09-12T00:26:37.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.929+0000 7f915811f800 20 init_complete bucket index max shards: 1 2024-09-12T00:26:37.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.929+0000 7f915811f800 20 Filter name: none 2024-09-12T00:26:37.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.930+0000 7f8f827fc640 20 reqs_thread_entry: start 2024-09-12T00:26:37.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.930+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:26:37.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.931+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.932+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.932+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.933+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:26:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.934+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.935+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.935+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.936+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:26:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.937+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.938+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.938+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.939+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:26:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.940+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.941+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.941+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.942+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:26:37.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.944+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.945+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.945+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.946+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:26:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.948+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.948+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.948+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.949+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:26:37.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.951+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.951+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.951+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:37.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.951+0000 7f915811f800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4006008033634369380', time=2024-09-12T02:26:36.538456+0000, chain.objs.size()=1 2024-09-12T00:26:37.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.951+0000 7f915811f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.71__shadow_.uQduI5UBzzQJZKTKSRZ6Kahc9s3He5X_0 2024-09-12T00:26:37.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.953+0000 7f915811f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:37.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.955+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:26:37.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.956+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.957+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.957+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.958+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:26:37.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.960+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.960+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.960+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.962+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:26:37.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.963+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.964+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.964+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.965+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:26:37.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.966+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.967+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.967+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.968+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:26:37.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.970+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.970+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.970+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.972+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:26:37.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.973+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.974+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.974+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.975+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:26:37.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.976+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.977+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.977+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.978+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:26:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.979+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.980+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.980+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.981+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:26:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.983+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.983+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.983+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.984+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:26:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.986+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.986+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.986+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.987+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:26:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.989+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.989+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.990+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.991+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:26:37.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.992+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.992+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.993+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.994+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:26:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.995+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.995+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.996+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.996+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:26:37.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.998+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.998+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:37.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.998+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:37.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:37.999+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:26:38.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.001+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.001+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.002+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.003+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:26:38.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.004+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.004+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.005+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.006+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:26:38.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.007+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.008+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.008+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.009+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:26:38.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.010+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.011+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.011+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.012+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:26:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.014+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.014+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.014+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.015+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:26:38.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.016+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.017+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.017+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.018+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:26:38.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.019+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.020+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.020+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.021+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:26:38.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.023+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.023+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.023+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.023 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.024+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:26:38.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.025+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.026+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.026+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.027+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:26:38.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.028+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.029+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.029+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:26:38.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.029+0000 7f915811f800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13340105649122845296', time=2024-09-12T02:26:37.040785+0000, chain.objs.size()=1 2024-09-12T00:26:38.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.029+0000 7f915811f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.72__shadow_.f8p4fFxN0BA86rrKl8mV2j5m-jdWiUI_0 2024-09-12T00:26:38.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.030+0000 7f915811f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:26:38.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.033+0000 7f915811f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:26:38.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.034+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.034+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.034+0000 7f915811f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.036+0000 7f9009fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:38.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.038+0000 7f915811f800 20 remove_watcher() i=0 2024-09-12T00:26:38.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.038+0000 7f915811f800 2 removed watcher, disabling cache 2024-09-12T00:26:38.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.039+0000 7f915811f800 20 remove_watcher() i=1 2024-09-12T00:26:38.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.040+0000 7f915811f800 20 remove_watcher() i=2 2024-09-12T00:26:38.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.041+0000 7f915811f800 20 remove_watcher() i=3 2024-09-12T00:26:38.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.042+0000 7f915811f800 20 remove_watcher() i=4 2024-09-12T00:26:38.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.043+0000 7f915811f800 20 remove_watcher() i=5 2024-09-12T00:26:38.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.044+0000 7f915811f800 20 remove_watcher() i=6 2024-09-12T00:26:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.045+0000 7f915811f800 20 remove_watcher() i=7 2024-09-12T00:26:38.056 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T00:26:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:38.109 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:38.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.148+0000 7ff487325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.150+0000 7ff487325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.150+0000 7ff487325800 20 realm 2024-09-12T00:26:38.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.150+0000 7ff487325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.150+0000 7ff487325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.150+0000 7ff487325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:38.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.150+0000 7ff487325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.150+0000 7ff487325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.150+0000 7ff487325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.151+0000 7ff487325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:38.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.151+0000 7ff487325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.152+0000 7ff487325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:38.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.152+0000 7ff487325800 20 searching for the correct realm 2024-09-12T00:26:38.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.155+0000 7ff482732640 0 -- 172.21.15.67:0/1025961526 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7ff4780a4260 msgr2=0x7ff4780ab960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:38.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.158+0000 7ff482f33640 0 -- 172.21.15.67:0/1025961526 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7ff47c029040 msgr2=0x7ff47c004570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:38.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.162+0000 7ff487325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:38.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.162+0000 7ff487325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.162+0000 7ff487325800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:26:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.162+0000 7ff487325800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:26:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.162+0000 7ff487325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.162+0000 7ff487325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.162+0000 7ff487325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.162+0000 7ff487325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.162+0000 7ff487325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.162+0000 7ff487325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.163+0000 7ff487325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.163+0000 7ff487325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.163+0000 7ff487325800 20 zone default found 2024-09-12T00:26:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.163+0000 7ff487325800 4 Realm: () 2024-09-12T00:26:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.163+0000 7ff487325800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:26:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.163+0000 7ff487325800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:26:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.163+0000 7ff487325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.163+0000 7ff487325800 20 zonegroup default 2024-09-12T00:26:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.163+0000 7ff487325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.163+0000 7ff487325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.163+0000 7ff487325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.163+0000 7ff487325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.163+0000 7ff487325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.164+0000 7ff487325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.164+0000 7ff487325800 20 started sync module instance, tier type = 2024-09-12T00:26:38.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.164+0000 7ff487325800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:26:38.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.172+0000 7ff487325800 20 add_watcher() i=0 2024-09-12T00:26:38.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.172+0000 7ff487325800 20 add_watcher() i=1 2024-09-12T00:26:38.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.172+0000 7ff487325800 20 add_watcher() i=2 2024-09-12T00:26:38.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.172+0000 7ff487325800 20 add_watcher() i=3 2024-09-12T00:26:38.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.172+0000 7ff487325800 20 add_watcher() i=4 2024-09-12T00:26:38.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.172+0000 7ff487325800 20 add_watcher() i=5 2024-09-12T00:26:38.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.172+0000 7ff487325800 20 add_watcher() i=6 2024-09-12T00:26:38.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.173+0000 7ff487325800 20 add_watcher() i=7 2024-09-12T00:26:38.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.173+0000 7ff487325800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:38.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.175+0000 7ff3397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:38.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.175+0000 7ff487325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:38.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.175+0000 7ff487325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:38.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.210+0000 7ff2b3fff640 20 reqs_thread_entry: start 2024-09-12T00:26:38.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.210+0000 7ff487325800 20 init_complete bucket index max shards: 1 2024-09-12T00:26:38.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.210+0000 7ff487325800 20 Filter name: none 2024-09-12T00:26:38.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.210+0000 7ff2b1ffb640 20 reqs_thread_entry: start 2024-09-12T00:26:38.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.210+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:26:38.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.212+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.212+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.212+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.213+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:26:38.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.214+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.215+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.215+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.216+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:26:38.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.218+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.218+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.218+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.219+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:26:38.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.221+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.221+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.222+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.223+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:26:38.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.224+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.225+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.225+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.227+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:26:38.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.228+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.228+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.229+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.229+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:26:38.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.231+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.231+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.231+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.232+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:26:38.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.233+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.234+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.234+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.235+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:26:38.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.237+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.237+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.238+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.239+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:26:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.240+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.241+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.241+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.242+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:26:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.243+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.244+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.244+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.244 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.245+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:26:38.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.247+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.247+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.247+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.248+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:26:38.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.249+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.250+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.250+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.251+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:26:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.252+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.253+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.253+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.254+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:26:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.256+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.256+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.257+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.258+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:26:38.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.259+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.260+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.260+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.261+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:26:38.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.263+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.263+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.264+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.265+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:26:38.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.266+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.267+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.267+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.268+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:26:38.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.270+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.270+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.271+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.272+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:26:38.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.273+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.273+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.274+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.275+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:26:38.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.276+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.277+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.277+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.279+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:26:38.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.280+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.281+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.281+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.282+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:26:38.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.283+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.283+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.284+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.285+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:26:38.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.286+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.286+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.287+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.288+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:26:38.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.289+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.289+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.290+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.291+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:26:38.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.292+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.293+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.293+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.295+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:26:38.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.296+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.297+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.297+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.298+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:26:38.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.299+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.300+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.300+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.301+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:26:38.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.302+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.303+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.303+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.305+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:26:38.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.306+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.307+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.307+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.308+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:26:38.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.310+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.310+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.310+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.310 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.311+0000 7ff487325800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:26:38.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.313+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.313+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.313+0000 7ff487325800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.315+0000 7ff3397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:38.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.318+0000 7ff487325800 20 remove_watcher() i=0 2024-09-12T00:26:38.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.318+0000 7ff487325800 2 removed watcher, disabling cache 2024-09-12T00:26:38.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.319+0000 7ff487325800 20 remove_watcher() i=1 2024-09-12T00:26:38.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.319+0000 7ff487325800 20 remove_watcher() i=2 2024-09-12T00:26:38.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.320+0000 7ff487325800 20 remove_watcher() i=3 2024-09-12T00:26:38.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.321+0000 7ff487325800 20 remove_watcher() i=4 2024-09-12T00:26:38.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.323+0000 7ff487325800 20 remove_watcher() i=5 2024-09-12T00:26:38.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.324+0000 7ff487325800 20 remove_watcher() i=6 2024-09-12T00:26:38.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.325+0000 7ff487325800 20 remove_watcher() i=7 2024-09-12T00:26:38.336 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T00:26:38.388 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:38.388 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:38.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.429+0000 7f2a992bb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.431+0000 7f2a992bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.431+0000 7f2a992bb800 20 realm 2024-09-12T00:26:38.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.431+0000 7f2a992bb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.431+0000 7f2a992bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.431+0000 7f2a992bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:38.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.431+0000 7f2a992bb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.431+0000 7f2a992bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.431+0000 7f2a992bb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.432+0000 7f2a992bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:38.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.432+0000 7f2a992bb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.433+0000 7f2a992bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:38.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.433+0000 7f2a992bb800 20 searching for the correct realm 2024-09-12T00:26:38.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.436+0000 7f2a965a4640 0 -- 172.21.15.67:0/2644179756 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f2a8c066df0 msgr2=0x7f2a8c0880d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:38.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.440+0000 7f2a975a6640 0 -- 172.21.15.67:0/2644179756 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55ef684aa030 msgr2=0x55ef684ac460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.444+0000 7f2a992bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.444+0000 7f2a992bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.444+0000 7f2a992bb800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:26:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.444+0000 7f2a992bb800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:26:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.444+0000 7f2a992bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.444+0000 7f2a992bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.444+0000 7f2a992bb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.445+0000 7f2a992bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.445+0000 7f2a992bb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.445+0000 7f2a992bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:38.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.445+0000 7f2a992bb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.445+0000 7f2a992bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:38.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.445+0000 7f2a992bb800 20 zone default found 2024-09-12T00:26:38.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.445+0000 7f2a992bb800 4 Realm: () 2024-09-12T00:26:38.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.445+0000 7f2a992bb800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:26:38.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.445+0000 7f2a992bb800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:26:38.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.445+0000 7f2a992bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:38.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.445+0000 7f2a992bb800 20 zonegroup default 2024-09-12T00:26:38.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.445+0000 7f2a992bb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.445+0000 7f2a992bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.445+0000 7f2a992bb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.446+0000 7f2a992bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.446+0000 7f2a992bb800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.446+0000 7f2a992bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.446+0000 7f2a992bb800 20 started sync module instance, tier type = 2024-09-12T00:26:38.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.446+0000 7f2a992bb800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:26:38.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.454+0000 7f2a992bb800 20 add_watcher() i=0 2024-09-12T00:26:38.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.454+0000 7f2a992bb800 20 add_watcher() i=1 2024-09-12T00:26:38.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.454+0000 7f2a992bb800 20 add_watcher() i=2 2024-09-12T00:26:38.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.454+0000 7f2a992bb800 20 add_watcher() i=3 2024-09-12T00:26:38.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.454+0000 7f2a992bb800 20 add_watcher() i=4 2024-09-12T00:26:38.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.454+0000 7f2a992bb800 20 add_watcher() i=5 2024-09-12T00:26:38.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.454+0000 7f2a992bb800 20 add_watcher() i=6 2024-09-12T00:26:38.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.455+0000 7f2a992bb800 20 add_watcher() i=7 2024-09-12T00:26:38.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.455+0000 7f2a992bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:38.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.456+0000 7f294d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:38.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.457+0000 7f2a992bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:38.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.457+0000 7f2a992bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:38.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.493+0000 7f28c7fff640 20 reqs_thread_entry: start 2024-09-12T00:26:38.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.493+0000 7f2a992bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:26:38.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.493+0000 7f2a992bb800 20 Filter name: none 2024-09-12T00:26:38.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.493+0000 7f28c5ffb640 20 reqs_thread_entry: start 2024-09-12T00:26:38.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.493+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:26:38.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.494+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.495+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.495+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.496+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:26:38.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.497+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.498+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.498+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.499+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:26:38.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.500+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.501+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.501+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.502+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:26:38.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.503+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.504+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.504+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.504 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.505+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:26:38.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.507+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.507+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.507+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.508+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:26:38.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.510+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.510+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.510+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.511+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:26:38.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.512+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.513+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.513+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.514+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:26:38.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.515+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.516+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.516+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.517+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:26:38.517 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.518+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.519+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.518 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.519+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.520+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:26:38.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.521+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.522+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.522+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.523+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:26:38.523 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.524+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.525+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.525+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.526+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:26:38.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.527+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.528+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.528+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.529+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:26:38.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.530+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.531+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.531+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.532+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:26:38.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.533+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.534+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.534+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.535+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:26:38.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.537+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.537+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.537+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.538+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:26:38.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.540+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.540+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.541+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.542+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:26:38.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.543+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.544+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.544+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.545+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:26:38.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.546+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.547+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.546 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.547+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.548+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:26:38.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.550+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.550+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.551+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.550 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.552+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:26:38.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.553+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.554+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.554+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.555+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:26:38.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.556+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.557+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.557+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.558+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:26:38.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.559+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.559+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.560+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.562+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:26:38.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.563+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.564+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.564+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.565+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:26:38.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.566+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.567+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.567+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.568+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:26:38.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.569+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.570+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.570+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.571+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:26:38.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.573+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.573+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.574+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.574+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:26:38.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.576+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.575 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.576+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.577+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.578+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:26:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.579+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.579+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.580+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.579 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.581+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:26:38.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.582+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.582+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.583+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.584+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:26:38.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.585+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.586+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.586+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.587+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:26:38.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.588+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.589+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.589+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.590+0000 7f2a992bb800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:26:38.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.592+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.592+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.592+0000 7f2a992bb800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.593 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.594+0000 7f294d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:38.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.597+0000 7f2a992bb800 20 remove_watcher() i=0 2024-09-12T00:26:38.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.597+0000 7f2a992bb800 2 removed watcher, disabling cache 2024-09-12T00:26:38.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.598+0000 7f2a992bb800 20 remove_watcher() i=1 2024-09-12T00:26:38.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.599+0000 7f2a992bb800 20 remove_watcher() i=2 2024-09-12T00:26:38.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.600+0000 7f2a992bb800 20 remove_watcher() i=3 2024-09-12T00:26:38.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.601+0000 7f2a992bb800 20 remove_watcher() i=4 2024-09-12T00:26:38.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.602+0000 7f2a992bb800 20 remove_watcher() i=5 2024-09-12T00:26:38.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.602+0000 7f2a992bb800 20 remove_watcher() i=6 2024-09-12T00:26:38.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.603+0000 7f2a992bb800 20 remove_watcher() i=7 2024-09-12T00:26:38.614 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T00:26:38.667 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:38.667 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:38.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.707+0000 7f7080e98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.709+0000 7f7080e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.709+0000 7f7080e98800 20 realm 2024-09-12T00:26:38.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.709+0000 7f7080e98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.709+0000 7f7080e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.709+0000 7f7080e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:38.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.709+0000 7f7080e98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.710+0000 7f7080e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.710+0000 7f7080e98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.710+0000 7f7080e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.710+0000 7f7080e98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.711+0000 7f7080e98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:38.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.711+0000 7f7080e98800 20 searching for the correct realm 2024-09-12T00:26:38.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.714+0000 7f707e188640 0 -- 172.21.15.67:0/2295836255 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f70740b8460 msgr2=0x7f70740639d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:38.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.718+0000 7f707f18a640 0 -- 172.21.15.67:0/2295836255 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x56277c37d580 msgr2=0x56277c37fa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:38.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.722+0000 7f7080e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:38.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.722+0000 7f7080e98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:38.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.722+0000 7f7080e98800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:26:38.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.722+0000 7f7080e98800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:26:38.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.722+0000 7f7080e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:38.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.722+0000 7f7080e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:38.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.722+0000 7f7080e98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.723+0000 7f7080e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.723+0000 7f7080e98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.723+0000 7f7080e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:38.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.723+0000 7f7080e98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.723+0000 7f7080e98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:38.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.723+0000 7f7080e98800 20 zone default found 2024-09-12T00:26:38.723 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.723+0000 7f7080e98800 4 Realm: () 2024-09-12T00:26:38.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.723+0000 7f7080e98800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:26:38.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.723+0000 7f7080e98800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:26:38.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.723+0000 7f7080e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:38.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.723+0000 7f7080e98800 20 zonegroup default 2024-09-12T00:26:38.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.723+0000 7f7080e98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.724+0000 7f7080e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.724+0000 7f7080e98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.724+0000 7f7080e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.724+0000 7f7080e98800 20 rados->read ofs=0 len=0 2024-09-12T00:26:38.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.724+0000 7f7080e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:38.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.724+0000 7f7080e98800 20 started sync module instance, tier type = 2024-09-12T00:26:38.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.724+0000 7f7080e98800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:26:38.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.732+0000 7f7080e98800 20 add_watcher() i=0 2024-09-12T00:26:38.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.732+0000 7f7080e98800 20 add_watcher() i=1 2024-09-12T00:26:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.732+0000 7f7080e98800 20 add_watcher() i=2 2024-09-12T00:26:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.732+0000 7f7080e98800 20 add_watcher() i=3 2024-09-12T00:26:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.732+0000 7f7080e98800 20 add_watcher() i=4 2024-09-12T00:26:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.732+0000 7f7080e98800 20 add_watcher() i=5 2024-09-12T00:26:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.732+0000 7f7080e98800 20 add_watcher() i=6 2024-09-12T00:26:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.733+0000 7f7080e98800 20 add_watcher() i=7 2024-09-12T00:26:38.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.733+0000 7f7080e98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:38.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.735+0000 7f6f357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:38.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.735+0000 7f7080e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:38.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.735+0000 7f7080e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:38.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.769+0000 7f6eaffff640 20 reqs_thread_entry: start 2024-09-12T00:26:38.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.769+0000 7f7080e98800 20 init_complete bucket index max shards: 1 2024-09-12T00:26:38.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.769+0000 7f7080e98800 20 Filter name: none 2024-09-12T00:26:38.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.769+0000 7f6eadffb640 20 reqs_thread_entry: start 2024-09-12T00:26:38.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.769+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:26:38.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.770+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.771+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.771+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.772+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:26:38.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.773+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.774+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.774+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.775+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:26:38.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.777+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.777+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.777+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.778+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:26:38.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.780+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.781+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.781+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.782+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:26:38.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.784+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.784+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.784+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.785+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:26:38.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.787+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.788+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.788+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.789+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:26:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.791+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.791+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.792+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.792+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:26:38.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.794+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.794+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.794+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.796+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:26:38.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.797+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.798+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.798+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.799+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:26:38.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.800+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.801+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.801+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.802+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:26:38.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.803+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.804+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.804+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.806+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:26:38.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.807+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.808+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.808+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.809+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:26:38.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.810+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.811+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.811+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.812+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:26:38.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.813+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.814+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.814+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.815+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:26:38.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.816+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.817+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.817+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.818+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:26:38.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.820+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.820+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.820+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.821+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:26:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.823+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.823+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.823+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.824+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:26:38.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.825+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.826+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.826+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.827+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:26:38.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.828+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.829+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.829+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.830+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:26:38.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.831+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.832+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.831 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.832+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.833+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:26:38.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.834+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.835+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.835+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.836+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:26:38.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.837+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.838+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.837 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.838+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.839+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:26:38.839 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.840+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.841+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.841+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.842+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:26:38.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.844+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.844+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.844+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.845+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:26:38.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.847+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.848+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.848+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.849+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:26:38.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.851+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.851+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.852+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.853+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:26:38.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.854+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.854+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.855+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.854 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.856+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:26:38.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.857+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.857+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.857+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.858+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:26:38.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.860+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.860+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.860+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.862+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:26:38.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.863+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.863+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.863+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.864+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:26:38.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.866+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.866+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.867+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.868+0000 7f7080e98800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:26:38.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.869+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.869+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:26:38.869 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.870+0000 7f7080e98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:26:38.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.872+0000 7f6f357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:38.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.874+0000 7f7080e98800 20 remove_watcher() i=0 2024-09-12T00:26:38.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.874+0000 7f7080e98800 2 removed watcher, disabling cache 2024-09-12T00:26:38.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.875+0000 7f7080e98800 20 remove_watcher() i=1 2024-09-12T00:26:38.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.876+0000 7f7080e98800 20 remove_watcher() i=2 2024-09-12T00:26:38.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.877+0000 7f7080e98800 20 remove_watcher() i=3 2024-09-12T00:26:38.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.877+0000 7f7080e98800 20 remove_watcher() i=4 2024-09-12T00:26:38.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.878+0000 7f7080e98800 20 remove_watcher() i=5 2024-09-12T00:26:38.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.879+0000 7f7080e98800 20 remove_watcher() i=6 2024-09-12T00:26:38.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:26:38.880+0000 7f7080e98800 20 remove_watcher() i=7 2024-09-12T00:26:38.891 DEBUG:teuthology.orchestra.run.smithi067:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T00:26:39.387 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :clean 2024-09-12T00:26:40.183 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :compileJava 2024-09-12T00:26:40.183 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :processResources 2024-09-12T00:26:40.183 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :classes 2024-09-12T00:26:40.583 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:40.583 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :compileTestJava 2024-09-12T00:26:40.583 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:40.584 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:26:40.584 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :testClasses 2024-09-12T00:26:40.584 INFO:teuthology.orchestra.run.smithi067.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:26:40.584 INFO:teuthology.orchestra.run.smithi067.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:26:42.584 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:42.584 INFO:teuthology.orchestra.run.smithi067.stdout:> Task :test 2024-09-12T00:26:42.584 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:42.584 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests STANDARD_OUT 2024-09-12T00:26:42.584 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12 00:26:41,939 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:26:42.585 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:42.585 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T00:26:42.585 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:42.585 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T00:26:42.585 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:42.585 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T00:26:42.585 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:42.585 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T00:26:42.682 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:42.682 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T00:26:42.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:42.782 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T00:26:42.982 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:42.983 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T00:26:43.282 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:43.283 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T00:26:43.482 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:43.483 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T00:26:43.584 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:43.585 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T00:26:43.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:43.782 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T00:26:43.882 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:43.882 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T00:26:44.083 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:44.083 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T00:26:44.083 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:44.083 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T00:26:44.083 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:44.083 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T00:26:44.182 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:44.182 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T00:26:44.282 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:44.283 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T00:26:44.482 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:44.482 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T00:26:44.682 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:44.683 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T00:26:44.683 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:44.683 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T00:26:44.883 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:44.883 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T00:26:44.883 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:44.883 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T00:26:45.082 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:45.082 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T00:26:45.183 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:45.183 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T00:26:45.283 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:45.283 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T00:26:45.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:45.382 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T00:26:45.582 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:45.583 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T00:26:45.583 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:45.583 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T00:26:45.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:45.782 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T00:26:45.882 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:45.883 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T00:26:46.082 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:46.083 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T00:26:46.182 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:46.183 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T00:26:46.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:46.383 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T00:26:46.682 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:46.682 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T00:26:47.082 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:47.082 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T00:26:51.082 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:51.082 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T00:26:51.282 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:51.282 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T00:26:51.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:51.382 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T00:26:51.482 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:51.482 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T00:26:51.582 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:51.582 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T00:26:51.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:51.782 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T00:26:52.182 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:52.182 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T00:26:52.383 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:52.383 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T00:26:52.383 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:52.383 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T00:26:52.482 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:52.482 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T00:26:53.182 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:53.182 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T00:26:53.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:53.382 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:26:53.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:53.782 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:26:54.082 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:54.082 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T00:26:54.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:54.382 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T00:26:54.582 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:54.582 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T00:26:58.182 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:58.183 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T00:26:58.384 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:58.384 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T00:26:59.182 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:59.182 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T00:26:59.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:26:59.382 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T00:27:00.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:00.383 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T00:27:00.582 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:00.582 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T00:27:01.082 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:01.082 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T00:27:01.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:01.383 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T00:27:01.383 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:01.383 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T00:27:01.483 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:01.483 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T00:27:01.483 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:01.483 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T00:27:01.682 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:01.682 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T00:27:01.682 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:01.682 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T00:27:01.882 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:01.882 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T00:27:01.983 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:01.983 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T00:27:02.182 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:02.182 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T00:27:02.182 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:02.183 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T00:27:02.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:02.382 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T00:27:02.482 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:02.482 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T00:27:02.683 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:02.683 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T00:27:02.683 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:02.683 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T00:27:02.882 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:02.882 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T00:27:02.882 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:02.883 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T00:27:03.082 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:03.082 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T00:27:03.182 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:03.182 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T00:27:03.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:03.382 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T00:27:03.482 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:03.482 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T00:27:03.682 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:03.682 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T00:27:03.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:03.782 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T00:27:03.982 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:03.983 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T00:27:04.082 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:04.082 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T00:27:04.282 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:04.282 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T00:27:04.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:04.383 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T00:27:04.582 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:04.582 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T00:27:04.682 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:04.682 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T00:27:04.882 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:04.882 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T00:27:04.882 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:04.883 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T00:27:05.082 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:05.082 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T00:27:05.182 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:05.183 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T00:27:05.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:05.382 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T00:27:05.482 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:05.483 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T00:27:05.682 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:05.682 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T00:27:05.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:05.783 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T00:27:05.982 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:05.982 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T00:27:06.082 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:06.082 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T00:27:06.282 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:06.282 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T00:27:06.282 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:06.283 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T00:27:06.482 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:06.482 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T00:27:06.582 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:06.582 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T00:27:06.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:06.782 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T00:27:06.882 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:06.882 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T00:27:07.082 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:07.082 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T00:27:07.182 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:07.182 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T00:27:07.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:07.382 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T00:27:07.482 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:07.482 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T00:27:07.682 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:07.682 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T00:27:07.683 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:07.683 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T00:27:07.882 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:07.883 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T00:27:07.982 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:07.982 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T00:27:08.182 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:08.183 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T00:27:08.282 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:08.282 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T00:27:08.482 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:08.482 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T00:27:08.582 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:08.582 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T00:27:08.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:08.782 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T00:27:08.783 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:08.783 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T00:27:08.982 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:08.982 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T00:27:09.082 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:09.082 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T00:27:09.282 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:09.283 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T00:27:09.283 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:09.283 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T00:27:09.482 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:09.483 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T00:27:09.483 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:09.483 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T00:27:09.682 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:09.682 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T00:27:09.683 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:09.683 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T00:27:09.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:09.782 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T00:27:09.982 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:09.982 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T00:27:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:10.182 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T00:27:10.182 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:10.182 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T00:27:10.282 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:10.282 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T00:27:10.382 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:10.383 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T00:27:10.582 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:10.583 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T00:27:10.583 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:10.583 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T00:27:10.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:10.893 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T00:27:10.893 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:10.894 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T00:27:11.082 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:11.083 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T00:27:11.083 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:11.083 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T00:27:11.282 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:11.282 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T00:27:11.782 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:11.783 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T00:27:11.982 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:11.983 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T00:27:12.482 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:12.482 INFO:teuthology.orchestra.run.smithi067.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T00:27:12.649 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:12.650 INFO:teuthology.orchestra.run.smithi067.stdout:---------------------------------------------------------------------- 2024-09-12T00:27:12.650 INFO:teuthology.orchestra.run.smithi067.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T00:27:12.650 INFO:teuthology.orchestra.run.smithi067.stdout:---------------------------------------------------------------------- 2024-09-12T00:27:12.650 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:12.650 INFO:teuthology.orchestra.run.smithi067.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:27:12.650 INFO:teuthology.orchestra.run.smithi067.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:27:12.650 INFO:teuthology.orchestra.run.smithi067.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:27:12.650 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:12.651 INFO:teuthology.orchestra.run.smithi067.stdout:BUILD SUCCESSFUL in 33s 2024-09-12T00:27:12.651 INFO:teuthology.orchestra.run.smithi067.stdout:5 actionable tasks: 5 executed 2024-09-12T00:27:12.665 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T00:27:12.719 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:12.719 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:12.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.760+0000 7f6cd8937800 20 rados->read ofs=0 len=0 2024-09-12T00:27:12.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.761+0000 7f6cd8937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:12.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.761+0000 7f6cd8937800 20 realm 2024-09-12T00:27:12.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.761+0000 7f6cd8937800 20 rados->read ofs=0 len=0 2024-09-12T00:27:12.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.762+0000 7f6cd8937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:12.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.762+0000 7f6cd8937800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:12.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.762+0000 7f6cd8937800 20 rados->read ofs=0 len=0 2024-09-12T00:27:12.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.762+0000 7f6cd8937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:12.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.762+0000 7f6cd8937800 20 rados->read ofs=0 len=0 2024-09-12T00:27:12.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.763+0000 7f6cd8937800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:12.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.763+0000 7f6cd8937800 20 rados->read ofs=0 len=0 2024-09-12T00:27:12.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.764+0000 7f6cd8937800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:12.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.764+0000 7f6cd8937800 20 searching for the correct realm 2024-09-12T00:27:12.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.767+0000 7f6cd3e20640 0 -- 172.21.15.67:0/4133591294 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f6cc807e430 msgr2=0x7f6cc807e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:12.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.973+0000 7f6cd4e22640 0 -- 172.21.15.67:0/4133591294 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55b220999d00 msgr2=0x55b22099c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:12.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.977+0000 7f6cd8937800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:12.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.977+0000 7f6cd8937800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:12.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.977+0000 7f6cd8937800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:12.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.977+0000 7f6cd8937800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:12.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.977+0000 7f6cd8937800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:12.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.977+0000 7f6cd8937800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:12.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.977+0000 7f6cd8937800 20 rados->read ofs=0 len=0 2024-09-12T00:27:12.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.977+0000 7f6cd8937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:12.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.977+0000 7f6cd8937800 20 rados->read ofs=0 len=0 2024-09-12T00:27:12.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.977+0000 7f6cd8937800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:12.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.977+0000 7f6cd8937800 20 rados->read ofs=0 len=0 2024-09-12T00:27:12.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.978+0000 7f6cd8937800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:12.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.978+0000 7f6cd8937800 20 zone default found 2024-09-12T00:27:12.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.978+0000 7f6cd8937800 4 Realm: () 2024-09-12T00:27:12.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.978+0000 7f6cd8937800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:12.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.978+0000 7f6cd8937800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:12.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.978+0000 7f6cd8937800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:12.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.978+0000 7f6cd8937800 20 zonegroup default 2024-09-12T00:27:12.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.978+0000 7f6cd8937800 20 rados->read ofs=0 len=0 2024-09-12T00:27:12.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.978+0000 7f6cd8937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:12.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.978+0000 7f6cd8937800 20 rados->read ofs=0 len=0 2024-09-12T00:27:12.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.978+0000 7f6cd8937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:12.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.978+0000 7f6cd8937800 20 rados->read ofs=0 len=0 2024-09-12T00:27:12.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.978+0000 7f6cd8937800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:12.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.979+0000 7f6cd8937800 20 started sync module instance, tier type = 2024-09-12T00:27:12.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.979+0000 7f6cd8937800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:12.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.987+0000 7f6cd8937800 20 add_watcher() i=0 2024-09-12T00:27:12.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.987+0000 7f6cd8937800 20 add_watcher() i=1 2024-09-12T00:27:12.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.987+0000 7f6cd8937800 20 add_watcher() i=2 2024-09-12T00:27:12.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.987+0000 7f6cd8937800 20 add_watcher() i=3 2024-09-12T00:27:12.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.987+0000 7f6cd8937800 20 add_watcher() i=4 2024-09-12T00:27:12.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.987+0000 7f6cd8937800 20 add_watcher() i=5 2024-09-12T00:27:12.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.987+0000 7f6cd8937800 20 add_watcher() i=6 2024-09-12T00:27:12.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.988+0000 7f6cd8937800 20 add_watcher() i=7 2024-09-12T00:27:12.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.988+0000 7f6cd8937800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:12.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.990+0000 7f6b8afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:12.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.990+0000 7f6cd8937800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:12.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:12.990+0000 7f6cd8937800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:13.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.025+0000 7f6b89fdb640 20 reqs_thread_entry: start 2024-09-12T00:27:13.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.025+0000 7f6cd8937800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:13.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.025+0000 7f6cd8937800 20 Filter name: none 2024-09-12T00:27:13.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.025+0000 7f6afb7fe640 20 reqs_thread_entry: start 2024-09-12T00:27:13.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.025+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:27:13.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.027+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.028+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.028+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:27:13.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.028+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7937965576536291766', time=2024-09-12T02:27:04.110811+0000, chain.objs.size()=1 2024-09-12T00:27:13.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.028+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.116__shadow_.nWz1hr_mtXgzDKRn3ctG0bPA7wv0BDG_0 2024-09-12T00:27:13.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.028+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1009157591971454006', time=2024-09-12T02:27:07.769148+0000, chain.objs.size()=1 2024-09-12T00:27:13.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.028+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.129__shadow_.EdvhqSBtpHVcl84j0OycSlU21_r_12E_0 2024-09-12T00:27:13.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.028+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1505802962933193855', time=2024-09-12T02:27:09.888122+0000, chain.objs.size()=1 2024-09-12T00:27:13.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.028+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.138__shadow_.m9KyWWIUyFCtyw3Fibn1hyqBdZRNdBx_0 2024-09-12T00:27:13.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.030+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.032+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:27:13.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.033+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.034+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.034+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:27:13.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.034+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9639088359315299951', time=2024-09-12T02:27:05.807474+0000, chain.objs.size()=1 2024-09-12T00:27:13.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.034+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.122__shadow_.TPdxsRJNSzc1Ial1mTcbNCZohMMFdGd_0 2024-09-12T00:27:13.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.034+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16849029835152964482', time=2024-09-12T02:27:05.824260+0000, chain.objs.size()=1 2024-09-12T00:27:13.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.034+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.122__shadow_.WHm1r_4d90pNqq3tjQBUeWPUpSXY9P7_0 2024-09-12T00:27:13.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.036+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.038+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:27:13.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.039+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.040+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.040+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:27:13.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.040+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10115967023701183114', time=2024-09-12T02:26:50.932227+0000, chain.objs.size()=5 2024-09-12T00:27:13.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.040+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~La9hhGumQ8V-lhN91YhpLvDDn8KvIPx.1 2024-09-12T00:27:13.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.040+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__shadow_key1.2~La9hhGumQ8V-lhN91YhpLvDDn8KvIPx.1_1 2024-09-12T00:27:13.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.040+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~La9hhGumQ8V-lhN91YhpLvDDn8KvIPx.2 2024-09-12T00:27:13.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.040+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__shadow_key1.2~La9hhGumQ8V-lhN91YhpLvDDn8KvIPx.2_1 2024-09-12T00:27:13.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.040+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~La9hhGumQ8V-lhN91YhpLvDDn8KvIPx.3 2024-09-12T00:27:13.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.040+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14810224924181633326', time=2024-09-12T02:26:57.520156+0000, chain.objs.size()=5 2024-09-12T00:27:13.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.040+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~g3avZdV4F99AkbRaFrLIWVMbyB23-81.1 2024-09-12T00:27:13.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.040+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~g3avZdV4F99AkbRaFrLIWVMbyB23-81.2 2024-09-12T00:27:13.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.040+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~g3avZdV4F99AkbRaFrLIWVMbyB23-81.3 2024-09-12T00:27:13.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.040+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~g3avZdV4F99AkbRaFrLIWVMbyB23-81.4 2024-09-12T00:27:13.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.040+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~g3avZdV4F99AkbRaFrLIWVMbyB23-81.5 2024-09-12T00:27:13.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.041+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7591604157757596168', time=2024-09-12T02:27:02.966895+0000, chain.objs.size()=1 2024-09-12T00:27:13.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.041+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.112__shadow_.ep0c8XlktKNrbtPTbX_us9uTp-cYnEY_0 2024-09-12T00:27:13.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.041+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8556199837563791261', time=2024-09-12T02:27:05.529194+0000, chain.objs.size()=1 2024-09-12T00:27:13.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.041+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.121__shadow_.Cy5ULBCBfqhYr1YCfTidUQ8nrhWRHTV_0 2024-09-12T00:27:13.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.044+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2670091722702963593', time=2024-09-12T02:27:08.582814+0000, chain.objs.size()=1 2024-09-12T00:27:13.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.045+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.132__shadow_.odqAhqGWGJbAKo_RV-bvmyThXsS89tD_0 2024-09-12T00:27:13.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.048+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.051+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:27:13.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.052+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:27:13.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13922311662270739669', time=2024-09-12T02:26:49.858124+0000, chain.objs.size()=5 2024-09-12T00:27:13.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~X7XW9y3NPl7TKublTCloXTf-5Xfshck.1 2024-09-12T00:27:13.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~X7XW9y3NPl7TKublTCloXTf-5Xfshck.2 2024-09-12T00:27:13.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~X7XW9y3NPl7TKublTCloXTf-5Xfshck.3 2024-09-12T00:27:13.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~X7XW9y3NPl7TKublTCloXTf-5Xfshck.4 2024-09-12T00:27:13.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~X7XW9y3NPl7TKublTCloXTf-5Xfshck.5 2024-09-12T00:27:13.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7069953736052188744', time=2024-09-12T02:27:02.972942+0000, chain.objs.size()=1 2024-09-12T00:27:13.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.112__shadow_.gZO5rdazIuF5ds1mfc9O7rXN1Ke90QT_0 2024-09-12T00:27:13.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10777929481383007920', time=2024-09-12T02:27:05.256899+0000, chain.objs.size()=1 2024-09-12T00:27:13.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.120__shadow_.UE5GEP07-ff9ZnR341vJNuCUuevXUaN_0 2024-09-12T00:27:13.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13388123946087405757', time=2024-09-12T02:27:05.541186+0000, chain.objs.size()=1 2024-09-12T00:27:13.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.121__shadow_.t5E3Xm7csRrq_KchHP501WNZj0NZnxc_0 2024-09-12T00:27:13.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14257733065196061027', time=2024-09-12T02:27:12.496431+0000, chain.objs.size()=1 2024-09-12T00:27:13.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.053+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.144__shadow_.ndU6ShapNh7NWaBsYg9B8P01CqHMGI-_0 2024-09-12T00:27:13.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.058+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.061+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:27:13.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.062+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.062+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.063+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:27:13.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.063+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.83377641403031532', time=2024-09-12T02:26:53.866599+0000, chain.objs.size()=1 2024-09-12T00:27:13.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.063+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.100__shadow_.Hotk6piCNn3HWP1h314VUM7kNM5vLqs_0 2024-09-12T00:27:13.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.063+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7719028212432095357', time=2024-09-12T02:27:04.396877+0000, chain.objs.size()=1 2024-09-12T00:27:13.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.063+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.117__shadow_.6qWCoo1C-Vzv8f9PBrcZTnFh1SwJlQt_0 2024-09-12T00:27:13.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.063+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17095149622185264144', time=2024-09-12T02:27:08.848581+0000, chain.objs.size()=1 2024-09-12T00:27:13.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.063+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.133__shadow_.ICI3Yfrv3JabnIvbE92vRvc0_4sHWtp_0 2024-09-12T00:27:13.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.065+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.067+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:27:13.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.068+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T00:27:13.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3901294794839450734', time=2024-09-12T02:26:59.266803+0000, chain.objs.size()=5 2024-09-12T00:27:13.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.103__multipart_key1.2~rY8qIpWDiTRyI8FCe4AXDE5BbIeKd9L.1 2024-09-12T00:27:13.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.103__multipart_key1.2~rY8qIpWDiTRyI8FCe4AXDE5BbIeKd9L.2 2024-09-12T00:27:13.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.103__multipart_key1.2~rY8qIpWDiTRyI8FCe4AXDE5BbIeKd9L.3 2024-09-12T00:27:13.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.103__multipart_key1.2~rY8qIpWDiTRyI8FCe4AXDE5BbIeKd9L.4 2024-09-12T00:27:13.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.103__multipart_key1.2~rY8qIpWDiTRyI8FCe4AXDE5BbIeKd9L.5 2024-09-12T00:27:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16048503842806140283', time=2024-09-12T02:27:03.828443+0000, chain.objs.size()=1 2024-09-12T00:27:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.115__shadow_.bEciqobd4Exz5vimUiSVKiE4GBV4wDH_0 2024-09-12T00:27:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6311483673166836108', time=2024-09-12T02:27:04.402478+0000, chain.objs.size()=1 2024-09-12T00:27:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.117__shadow_.2agAg7Q2ByNBPI9VWo7sRW2aOLGi-Kt_0 2024-09-12T00:27:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1065558852377362176', time=2024-09-12T02:27:05.241345+0000, chain.objs.size()=1 2024-09-12T00:27:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.120__shadow_.-_nLc_TyfQlXaxjmsXsyMbEifhMHxxA_0 2024-09-12T00:27:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11902914101591944731', time=2024-09-12T02:27:05.251897+0000, chain.objs.size()=1 2024-09-12T00:27:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.120__shadow_.4CyhRqE-q4kXcfFFS3CsrIF0T-aies8_0 2024-09-12T00:27:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15897376217152578675', time=2024-09-12T02:27:06.366208+0000, chain.objs.size()=1 2024-09-12T00:27:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.124__shadow_.cxQDKaQ-v-Au5ZsabqEUUz1CkVHuorl_0 2024-09-12T00:27:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15529370781261903397', time=2024-09-12T02:27:06.927354+0000, chain.objs.size()=1 2024-09-12T00:27:13.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.069+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.126__shadow_.DDb8lcqAqF2Zm4tjYWaVDzjSge0HF1O_0 2024-09-12T00:27:13.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.076+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.078+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:27:13.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.079+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:27:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1203160832976944524', time=2024-09-12T02:26:53.859945+0000, chain.objs.size()=5 2024-09-12T00:27:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.100__multipart_file.mpg.2~fnK9VG-l4ezcl5IbkSojK7QXxkL3UsB.1 2024-09-12T00:27:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.100__multipart_file.mpg.2~fnK9VG-l4ezcl5IbkSojK7QXxkL3UsB.2 2024-09-12T00:27:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.100__multipart_file.mpg.2~fnK9VG-l4ezcl5IbkSojK7QXxkL3UsB.3 2024-09-12T00:27:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.100__multipart_file.mpg.2~fnK9VG-l4ezcl5IbkSojK7QXxkL3UsB.4 2024-09-12T00:27:13.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.100__multipart_file.mpg.2~fnK9VG-l4ezcl5IbkSojK7QXxkL3UsB.5 2024-09-12T00:27:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16389225345569799451', time=2024-09-12T02:27:04.407924+0000, chain.objs.size()=1 2024-09-12T00:27:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.117__shadow_.X3Jg2AqqNhQ9K2MNL8SOnhIAZYWvzeA_0 2024-09-12T00:27:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5470869095851172171', time=2024-09-12T02:27:07.489506+0000, chain.objs.size()=1 2024-09-12T00:27:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.128__shadow_.TtnTLJCd6-yiCso-17MM-J7yZHNWIxF_0 2024-09-12T00:27:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.103552220592459667', time=2024-09-12T02:27:09.507220+0000, chain.objs.size()=1 2024-09-12T00:27:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.136__shadow_.Oa5vxop7_rqGhjvaDpnPAq9fTGm9vY6_0 2024-09-12T00:27:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14045665217883860647', time=2024-09-12T02:27:11.778610+0000, chain.objs.size()=5 2024-09-12T00:27:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.143__multipart_key1.2~CP3gZFuUXQzSkeX-_oz2LvA7hbB_rF2.1 2024-09-12T00:27:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.143__multipart_key1.2~CP3gZFuUXQzSkeX-_oz2LvA7hbB_rF2.2 2024-09-12T00:27:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.143__multipart_key1.2~CP3gZFuUXQzSkeX-_oz2LvA7hbB_rF2.3 2024-09-12T00:27:13.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.080+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.143__multipart_key1.2~CP3gZFuUXQzSkeX-_oz2LvA7hbB_rF2.4 2024-09-12T00:27:13.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.085+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.143__multipart_key1.2~CP3gZFuUXQzSkeX-_oz2LvA7hbB_rF2.5 2024-09-12T00:27:13.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.088+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.090+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:27:13.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.092+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.092+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.092+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:27:13.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.092+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13583532174231852384', time=2024-09-12T02:27:03.539613+0000, chain.objs.size()=1 2024-09-12T00:27:13.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.092+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.114__shadow_.gHVafTlVv9Jlsk1oGJjdWJLkds-KqXL_0 2024-09-12T00:27:13.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.092+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16051239193590811204', time=2024-09-12T02:27:05.812942+0000, chain.objs.size()=1 2024-09-12T00:27:13.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.092+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.122__shadow_.wUzkH0x4kv6wzWYSo3kodzC7_N1Rq9t_0 2024-09-12T00:27:13.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.092+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16839007014595599701', time=2024-09-12T02:27:07.202313+0000, chain.objs.size()=1 2024-09-12T00:27:13.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.092+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.127__shadow_.sRKcMzwzztJvNHZm70bjIbXxntK23-b_0 2024-09-12T00:27:13.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.092+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9180851295952856401', time=2024-09-12T02:27:07.213316+0000, chain.objs.size()=1 2024-09-12T00:27:13.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.092+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.127__shadow_.mjm-wdpJWGkeWMKnnA23-75XOaiHt4O_0 2024-09-12T00:27:13.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.092+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11667725744706225021', time=2024-09-12T02:27:09.675079+0000, chain.objs.size()=1 2024-09-12T00:27:13.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.092+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.137__shadow_.e11iPopD20ILL8yp5YFt4eGT_eeMtGR_0 2024-09-12T00:27:13.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.096+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.098+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:27:13.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.100+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.100+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.100+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:27:13.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.100+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16798263040405959834', time=2024-09-12T02:26:53.883208+0000, chain.objs.size()=1 2024-09-12T00:27:13.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.100+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.100__shadow_.oMocnFeIzVW5vIoQdKTmRZwBeHuzFD6_0 2024-09-12T00:27:13.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.100+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2649600361426712522', time=2024-09-12T02:27:08.315451+0000, chain.objs.size()=1 2024-09-12T00:27:13.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.100+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.131__shadow_.a0FTRWimh-Cw7psZ8JuHHxCgzxQF16N_0 2024-09-12T00:27:13.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.102+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.104+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:27:13.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.105+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.106+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.106+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:27:13.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.106+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17579308334582258793', time=2024-09-12T02:26:43.877337+0000, chain.objs.size()=1 2024-09-12T00:27:13.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.106+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.81__shadow_.FMYKsyI19y71GoEFocNwEiMop5mHEln_0 2024-09-12T00:27:13.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.106+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1868158022334126140', time=2024-09-12T02:26:44.502410+0000, chain.objs.size()=2 2024-09-12T00:27:13.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.106+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.83__shadow_.1qeH8IATC4Fr2iqQPTGhWFAripUGheg_0 2024-09-12T00:27:13.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.106+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.83__shadow_.1qeH8IATC4Fr2iqQPTGhWFAripUGheg_1 2024-09-12T00:27:13.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.106+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17086096580620034592', time=2024-09-12T02:27:07.774425+0000, chain.objs.size()=1 2024-09-12T00:27:13.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.106+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.129__shadow_.80817BNaeNIbNsRGS5PGiqYPZzM4ymJ_0 2024-09-12T00:27:13.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.106+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9160243748459563059', time=2024-09-12T02:27:08.038651+0000, chain.objs.size()=1 2024-09-12T00:27:13.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.106+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.130__shadow_.yx8HC70J0pAz5m1mYSFX05YfchM9lyF_0 2024-09-12T00:27:13.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.106+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15098538203111939178', time=2024-09-12T02:27:08.588325+0000, chain.objs.size()=1 2024-09-12T00:27:13.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.106+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.132__shadow_.AzXecwr1D59lVMn52ClHx_nFBiTxmMJ_0 2024-09-12T00:27:13.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.110+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.112+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:27:13.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.113+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.114+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.114+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:27:13.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.114+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2185251312057135918', time=2024-09-12T02:27:03.545524+0000, chain.objs.size()=1 2024-09-12T00:27:13.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.114+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.114__shadow_.UoNyq_0Uc5TFMlX1onaNm2tWIRKg-p4_0 2024-09-12T00:27:13.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.114+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3035304351434347935', time=2024-09-12T02:27:04.696542+0000, chain.objs.size()=1 2024-09-12T00:27:13.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.114+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.118__shadow_.HIj3jyjGC1F6mTkMV3l8eFuTOv-TOXk_0 2024-09-12T00:27:13.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.114+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1318772990909101961', time=2024-09-12T02:27:06.096057+0000, chain.objs.size()=1 2024-09-12T00:27:13.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.114+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.123__shadow_.MFbWNkHtifuv4zbloOAFeyrGSfp6oyF_0 2024-09-12T00:27:13.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.114+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5274918945967377382', time=2024-09-12T02:27:08.045167+0000, chain.objs.size()=1 2024-09-12T00:27:13.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.114+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.130__shadow_.jFpIcwD2-y1saod-kP5nnQ7-CTC1rHi_0 2024-09-12T00:27:13.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.116+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.119+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:27:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.120+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.120+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.121+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:27:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.121+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9127055073856613853', time=2024-09-12T02:26:44.929546+0000, chain.objs.size()=1 2024-09-12T00:27:13.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.121+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.85__shadow_.4vpQWsdYlgJdlqUTkRrrfGMXS0FTpPo_0 2024-09-12T00:27:13.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.121+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9791675142806744593', time=2024-09-12T02:27:02.979319+0000, chain.objs.size()=1 2024-09-12T00:27:13.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.121+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.112__shadow_.Ffnh6eYowHlrV_FRoARX8zm4qIA1260_0 2024-09-12T00:27:13.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.121+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6333542804263914753', time=2024-09-12T02:27:04.691228+0000, chain.objs.size()=1 2024-09-12T00:27:13.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.121+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.118__shadow_.1xgzOfZcuRTdWlLI0vBpL0oZB_gJ6me_0 2024-09-12T00:27:13.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.121+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13876848637440363814', time=2024-09-12T02:27:04.960930+0000, chain.objs.size()=1 2024-09-12T00:27:13.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.121+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.119__shadow_.FcxdMpamenFTC0LlNK_SXzqYwAK1BAN_0 2024-09-12T00:27:13.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.124+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.126+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:27:13.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.127+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.126 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T00:27:13.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16789449238981213100', time=2024-09-12T02:26:51.070579+0000, chain.objs.size()=5 2024-09-12T00:27:13.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~mlJeR0PAYlMOYTDORhbGlLKE3LAiPHJ.1 2024-09-12T00:27:13.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__shadow_key1.2~mlJeR0PAYlMOYTDORhbGlLKE3LAiPHJ.1_1 2024-09-12T00:27:13.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~mlJeR0PAYlMOYTDORhbGlLKE3LAiPHJ.2 2024-09-12T00:27:13.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__shadow_key1.2~mlJeR0PAYlMOYTDORhbGlLKE3LAiPHJ.2_1 2024-09-12T00:27:13.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~mlJeR0PAYlMOYTDORhbGlLKE3LAiPHJ.3 2024-09-12T00:27:13.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='2~ME3Ifrjl-aFV89yxkNBtgJhB5_9PXz9', time=2024-09-12T02:26:54.490806+0000, chain.objs.size()=5 2024-09-12T00:27:13.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.101__multipart_key1.2~ME3Ifrjl-aFV89yxkNBtgJhB5_9PXz9.7 2024-09-12T00:27:13.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.101__multipart_key1.2~ME3Ifrjl-aFV89yxkNBtgJhB5_9PXz9.8 2024-09-12T00:27:13.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.101__multipart_key1.2~ME3Ifrjl-aFV89yxkNBtgJhB5_9PXz9.9 2024-09-12T00:27:13.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.101__multipart_key1.2~ME3Ifrjl-aFV89yxkNBtgJhB5_9PXz9.10 2024-09-12T00:27:13.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.101__multipart_key1.2~ME3Ifrjl-aFV89yxkNBtgJhB5_9PXz9.11 2024-09-12T00:27:13.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10407736015263148725', time=2024-09-12T02:27:03.246883+0000, chain.objs.size()=1 2024-09-12T00:27:13.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.113__shadow_.6NdVZaM2mubSPb3pKkCXoxDZYzHHDDY_0 2024-09-12T00:27:13.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17984170526174874271', time=2024-09-12T02:27:03.258243+0000, chain.objs.size()=1 2024-09-12T00:27:13.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.128+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.113__shadow_.iVl3P4mQV11MoZdoTBLRtfy2hQLHG6W_0 2024-09-12T00:27:13.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.134+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5951390730613232593', time=2024-09-12T02:27:04.121965+0000, chain.objs.size()=1 2024-09-12T00:27:13.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.134+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.116__shadow_.TnxhfdChteljHQn8q-C0LLFnDOeVTNd_0 2024-09-12T00:27:13.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.134+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5086522643959967026', time=2024-09-12T02:27:08.859547+0000, chain.objs.size()=1 2024-09-12T00:27:13.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.134+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.133__shadow_.GjKOkCgbzNL4ttKrgI-vNDr3hlkdoP8_0 2024-09-12T00:27:13.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.134+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8439440781244653320', time=2024-09-12T02:27:09.839547+0000, chain.objs.size()=1 2024-09-12T00:27:13.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.134+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.138__shadow_.z884tqLT6FUkdMmLKJ9Gs6JcYXEFGUz_0 2024-09-12T00:27:13.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.137+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.139+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:27:13.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.140+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.141+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.141+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:27:13.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.141+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17075857944857128317', time=2024-09-12T02:27:08.320363+0000, chain.objs.size()=1 2024-09-12T00:27:13.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.141+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.131__shadow_.ZxYpsyRF0u20Rga1IkRbh_8HK0yFTZB_0 2024-09-12T00:27:13.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.142+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.145+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:27:13.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.146+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.147+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.147+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:27:13.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.147+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.685193872768772480', time=2024-09-12T02:26:50.293225+0000, chain.objs.size()=5 2024-09-12T00:27:13.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.147+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~H8WI5zhdsfQ2o6EkmHStcbKISbhJI_s.1 2024-09-12T00:27:13.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.147+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__shadow_key1.2~H8WI5zhdsfQ2o6EkmHStcbKISbhJI_s.1_1 2024-09-12T00:27:13.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.147+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~H8WI5zhdsfQ2o6EkmHStcbKISbhJI_s.2 2024-09-12T00:27:13.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.147+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__shadow_key1.2~H8WI5zhdsfQ2o6EkmHStcbKISbhJI_s.2_1 2024-09-12T00:27:13.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.147+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~H8WI5zhdsfQ2o6EkmHStcbKISbhJI_s.3 2024-09-12T00:27:13.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.147+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10970980372510056563', time=2024-09-12T02:27:06.641413+0000, chain.objs.size()=1 2024-09-12T00:27:13.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.147+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.125__shadow_.eS8sJPreAjjAxNMBXIP96kvEw5jvqSA_0 2024-09-12T00:27:13.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.147+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12983761254510189879', time=2024-09-12T02:27:10.392688+0000, chain.objs.size()=1 2024-09-12T00:27:13.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.147+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.139__shadow_.-0Xz84PNkpKm_lA1ykoBw5g4DXCrHmP_0 2024-09-12T00:27:13.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.151+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.154+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:27:13.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.155+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.156+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.156+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:27:13.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.156+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12676116475003364574', time=2024-09-12T02:27:00.412774+0000, chain.objs.size()=5 2024-09-12T00:27:13.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.156+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.104__multipart_key1.2~NJpV8RTt8Bdj0t-C-dEa1AsvGquyskb.1 2024-09-12T00:27:13.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.156+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.104__multipart_key1.2~NJpV8RTt8Bdj0t-C-dEa1AsvGquyskb.2 2024-09-12T00:27:13.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.156+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.104__multipart_key1.2~NJpV8RTt8Bdj0t-C-dEa1AsvGquyskb.3 2024-09-12T00:27:13.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.156+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.104__multipart_key1.2~NJpV8RTt8Bdj0t-C-dEa1AsvGquyskb.4 2024-09-12T00:27:13.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.156+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.104__multipart_key1.2~NJpV8RTt8Bdj0t-C-dEa1AsvGquyskb.5 2024-09-12T00:27:13.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.159+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.162+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:27:13.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.163+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.164+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.164+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:27:13.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.164+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14878174413371764361', time=2024-09-12T02:26:52.205678+0000, chain.objs.size()=5 2024-09-12T00:27:13.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.164+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.98__multipart_key1.2~AyE73LnbbT24WluI92NNAmUbbi44ySZ.1 2024-09-12T00:27:13.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.164+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.98__multipart_key1.2~AyE73LnbbT24WluI92NNAmUbbi44ySZ.2 2024-09-12T00:27:13.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.164+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.98__multipart_key1.2~AyE73LnbbT24WluI92NNAmUbbi44ySZ.3 2024-09-12T00:27:13.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.164+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.98__multipart_key1.2~AyE73LnbbT24WluI92NNAmUbbi44ySZ.4 2024-09-12T00:27:13.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.164+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.98__multipart_key1.2~AyE73LnbbT24WluI92NNAmUbbi44ySZ.5 2024-09-12T00:27:13.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.167+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.170+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:27:13.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.171+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.171+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.172+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:27:13.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.172+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3855122759849446987', time=2024-09-12T02:26:53.175039+0000, chain.objs.size()=5 2024-09-12T00:27:13.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.172+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.99__multipart_key1.2~em0iknXokfDeCyrDvHWFmYBLXlN8PMP.1 2024-09-12T00:27:13.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.172+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.99__multipart_key1.2~em0iknXokfDeCyrDvHWFmYBLXlN8PMP.2 2024-09-12T00:27:13.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.172+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.99__multipart_key1.2~em0iknXokfDeCyrDvHWFmYBLXlN8PMP.3 2024-09-12T00:27:13.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.172+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.99__multipart_key1.2~em0iknXokfDeCyrDvHWFmYBLXlN8PMP.4 2024-09-12T00:27:13.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.172+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.99__multipart_key1.2~em0iknXokfDeCyrDvHWFmYBLXlN8PMP.5 2024-09-12T00:27:13.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.172+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13744091729250584046', time=2024-09-12T02:27:07.484308+0000, chain.objs.size()=1 2024-09-12T00:27:13.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.172+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.128__shadow_.jNchCYDXp5DsyxunULrXxVQQUQ0N-qG_0 2024-09-12T00:27:13.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.176+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.178+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:27:13.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:27:13.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10216720374740556220', time=2024-09-12T02:26:44.717020+0000, chain.objs.size()=1 2024-09-12T00:27:13.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.84__shadow_.KJMcD2sxbeEMFUJPAI0uARgkvAmJVW1_0 2024-09-12T00:27:13.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3062909724576703150', time=2024-09-12T02:26:49.422998+0000, chain.objs.size()=5 2024-09-12T00:27:13.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~39xo4XRX95qVLeCCL5MWCxlQIx28ttg.1 2024-09-12T00:27:13.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~39xo4XRX95qVLeCCL5MWCxlQIx28ttg.2 2024-09-12T00:27:13.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~39xo4XRX95qVLeCCL5MWCxlQIx28ttg.3 2024-09-12T00:27:13.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~39xo4XRX95qVLeCCL5MWCxlQIx28ttg.4 2024-09-12T00:27:13.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~39xo4XRX95qVLeCCL5MWCxlQIx28ttg.5 2024-09-12T00:27:13.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9093520144870607933', time=2024-09-12T02:26:53.877559+0000, chain.objs.size()=1 2024-09-12T00:27:13.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.100__shadow_.e0qAhA8bBd49dBgSM_nEeH5zUdVfBin_0 2024-09-12T00:27:13.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.725208287366966504', time=2024-09-12T02:27:03.822736+0000, chain.objs.size()=1 2024-09-12T00:27:13.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.115__shadow_.gbmDj5CIrnkWB9utpOu3g7zCehVKbDm_0 2024-09-12T00:27:13.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8087115014967434352', time=2024-09-12T02:27:05.535310+0000, chain.objs.size()=1 2024-09-12T00:27:13.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.180+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.121__shadow_.PNz4qNaoTPzRNTdP9Un-2HW5ktm7FDL_0 2024-09-12T00:27:13.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.185+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.188+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:27:13.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.189+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.190+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.190+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:27:13.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.190+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1663695081869097527', time=2024-09-12T02:26:46.031705+0000, chain.objs.size()=1 2024-09-12T00:27:13.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.190+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.90__shadow_.E9302CbgeB_8Wx8wFUZcHFd7PX3WD1B_0 2024-09-12T00:27:13.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.192+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.192 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.194+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:27:13.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.196+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.196+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.196+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:27:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.196+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5360918657506167279', time=2024-09-12T02:26:46.872306+0000, chain.objs.size()=5 2024-09-12T00:27:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.196+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.91__multipart_key1.2~NaQ1Ceavj-NIm_ycAdF8xTjJ_Uljun8.1 2024-09-12T00:27:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.196+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.91__multipart_key1.2~NaQ1Ceavj-NIm_ycAdF8xTjJ_Uljun8.2 2024-09-12T00:27:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.196+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.91__multipart_key1.2~NaQ1Ceavj-NIm_ycAdF8xTjJ_Uljun8.3 2024-09-12T00:27:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.196+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.91__multipart_key1.2~NaQ1Ceavj-NIm_ycAdF8xTjJ_Uljun8.4 2024-09-12T00:27:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.196+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.91__multipart_key1.2~NaQ1Ceavj-NIm_ycAdF8xTjJ_Uljun8.5 2024-09-12T00:27:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.196+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15781375432505943187', time=2024-09-12T02:26:56.655347+0000, chain.objs.size()=5 2024-09-12T00:27:13.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.196+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~CY52c4G-cbu3DwuEKcMOHqP6xrqJfrX.1 2024-09-12T00:27:13.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.196+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~CY52c4G-cbu3DwuEKcMOHqP6xrqJfrX.2 2024-09-12T00:27:13.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.196+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~CY52c4G-cbu3DwuEKcMOHqP6xrqJfrX.3 2024-09-12T00:27:13.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.197+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~CY52c4G-cbu3DwuEKcMOHqP6xrqJfrX.4 2024-09-12T00:27:13.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.197+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~CY52c4G-cbu3DwuEKcMOHqP6xrqJfrX.5 2024-09-12T00:27:13.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.197+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4714874688668209619', time=2024-09-12T02:27:01.520395+0000, chain.objs.size()=1 2024-09-12T00:27:13.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.197+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.106__shadow_.ha_um-AeRJ23C5Ax7QACl9hbsp7bYY8_0 2024-09-12T00:27:13.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.197+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3485159039770567897', time=2024-09-12T02:27:06.084623+0000, chain.objs.size()=1 2024-09-12T00:27:13.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.197+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.123__shadow_.3KzyunNSjrgfXgQpPgj3gt0xYXkBSP5_0 2024-09-12T00:27:13.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.200+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5382702637960171234', time=2024-09-12T02:27:06.652771+0000, chain.objs.size()=1 2024-09-12T00:27:13.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.200+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.125__shadow_.EJjvN9_fEEO3kwWIJg4s8cnJn0qc1nC_0 2024-09-12T00:27:13.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.205+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.208+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:27:13.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.209+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T00:27:13.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.739746811747155897', time=2024-09-12T02:26:58.092913+0000, chain.objs.size()=5 2024-09-12T00:27:13.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~k77hyv8poF_9JBkuycsHfDtamXokCvB.1 2024-09-12T00:27:13.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__shadow_key1.2~k77hyv8poF_9JBkuycsHfDtamXokCvB.1_1 2024-09-12T00:27:13.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~k77hyv8poF_9JBkuycsHfDtamXokCvB.2 2024-09-12T00:27:13.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__shadow_key1.2~k77hyv8poF_9JBkuycsHfDtamXokCvB.2_1 2024-09-12T00:27:13.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~k77hyv8poF_9JBkuycsHfDtamXokCvB.3 2024-09-12T00:27:13.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7619186000737471056', time=2024-09-12T02:27:03.833844+0000, chain.objs.size()=1 2024-09-12T00:27:13.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.115__shadow_.t_OTltY5RFU6W5-BKk7G38y0-ZTQ45R_0 2024-09-12T00:27:13.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4272892618880633309', time=2024-09-12T02:27:04.105077+0000, chain.objs.size()=1 2024-09-12T00:27:13.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.116__shadow_.2-EvbilUzh_JBByjS24wrBxiLyMWsAD_0 2024-09-12T00:27:13.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3531680099419195922', time=2024-09-12T02:27:04.116551+0000, chain.objs.size()=1 2024-09-12T00:27:13.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.116__shadow_.B2l0UQ8uq5-ZCbrQ5lEHqVzskRS7yGa_0 2024-09-12T00:27:13.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15130193214496288968', time=2024-09-12T02:27:04.679738+0000, chain.objs.size()=1 2024-09-12T00:27:13.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.118__shadow_.xm4oyCfxwhGud6SZLQRgxWzA7TGpadk_0 2024-09-12T00:27:13.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14183961244859897577', time=2024-09-12T02:27:07.495328+0000, chain.objs.size()=1 2024-09-12T00:27:13.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.128__shadow_.9QdqliryLxPlbIs1p3ayLsEUKbKROul_0 2024-09-12T00:27:13.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2826866823573172997', time=2024-09-12T02:27:07.780057+0000, chain.objs.size()=1 2024-09-12T00:27:13.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.210+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.129__shadow_.cc_x-iHwnUdTWZHcvLyx4vZS3rawIZ7_0 2024-09-12T00:27:13.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.217+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.220+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:27:13.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.221+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.221+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.222+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:27:13.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.222+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17562499150597955402', time=2024-09-12T02:27:03.253039+0000, chain.objs.size()=1 2024-09-12T00:27:13.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.222+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.113__shadow_.NBr9gZRcwggflYp9FbsaSkB9k-MD6gg_0 2024-09-12T00:27:13.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.222+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16017663683288744943', time=2024-09-12T02:27:03.533367+0000, chain.objs.size()=1 2024-09-12T00:27:13.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.222+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.114__shadow_.d3B8pK2z0MgdSUCug_lA9BL01_buJ7l_0 2024-09-12T00:27:13.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.222+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9772531033119753920', time=2024-09-12T02:27:04.685221+0000, chain.objs.size()=1 2024-09-12T00:27:13.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.222+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.118__shadow_.7TXPUveMbZPsUojdkLM1345zd38QLYR_0 2024-09-12T00:27:13.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.222+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16023498137074834543', time=2024-09-12T02:27:04.971437+0000, chain.objs.size()=1 2024-09-12T00:27:13.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.222+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.119__shadow_.lZMJ5oAvkHccw2ZNNXykDWsuVVJ8qLZ_0 2024-09-12T00:27:13.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.222+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13244255859815629485', time=2024-09-12T02:27:05.818581+0000, chain.objs.size()=1 2024-09-12T00:27:13.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.222+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.122__shadow_.oapllrZLjpokFHyqXDOj5dDTwTzYOo1_0 2024-09-12T00:27:13.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.222+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11288244931836694450', time=2024-09-12T02:27:06.090483+0000, chain.objs.size()=1 2024-09-12T00:27:13.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.222+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.123__shadow_.FTb-nepSjH7dGj4iVHx8KSczig0C0Qg_0 2024-09-12T00:27:13.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.224+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.227+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:27:13.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.228+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.228+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.229+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:27:13.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.229+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9716758689696561748', time=2024-09-12T02:26:55.764671+0000, chain.objs.size()=5 2024-09-12T00:27:13.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.229+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~0aG9diZ-mtis2ubEA3l-QSwx1o7hWa7.1 2024-09-12T00:27:13.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.229+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~0aG9diZ-mtis2ubEA3l-QSwx1o7hWa7.2 2024-09-12T00:27:13.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.229+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~0aG9diZ-mtis2ubEA3l-QSwx1o7hWa7.3 2024-09-12T00:27:13.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.229+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~0aG9diZ-mtis2ubEA3l-QSwx1o7hWa7.4 2024-09-12T00:27:13.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.229+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~0aG9diZ-mtis2ubEA3l-QSwx1o7hWa7.5 2024-09-12T00:27:13.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.229+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18052931918713804175', time=2024-09-12T02:27:02.960968+0000, chain.objs.size()=1 2024-09-12T00:27:13.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.229+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.112__shadow_.bt2EjXQA4rnZV--jWBilGzQe43dUd8J_0 2024-09-12T00:27:13.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.229+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17413303897392131708', time=2024-09-12T02:27:04.390968+0000, chain.objs.size()=1 2024-09-12T00:27:13.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.229+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.117__shadow_.aRKG1J2th58WHLvqSf8dRfwPL-KJflU_0 2024-09-12T00:27:13.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.229+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3763724483429031971', time=2024-09-12T02:27:04.976723+0000, chain.objs.size()=1 2024-09-12T00:27:13.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.229+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.119__shadow_.zCPlrwx3yMOPELvhHQRqE1eBYjBhnYs_0 2024-09-12T00:27:13.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.229+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6265167860874020364', time=2024-09-12T02:27:06.372416+0000, chain.objs.size()=1 2024-09-12T00:27:13.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.229+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.124__shadow_.mtvq_L3pWULPDW7dP_NNXwHrPpV8ZCy_0 2024-09-12T00:27:13.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.234+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.236+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:27:13.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.237+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:27:13.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT', time=2024-09-12T02:27:01.186946+0000, chain.objs.size()=1 2024-09-12T00:27:13.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.21 2024-09-12T00:27:13.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT', time=2024-09-12T02:27:01.189156+0000, chain.objs.size()=1 2024-09-12T00:27:13.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.22 2024-09-12T00:27:13.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT', time=2024-09-12T02:27:01.193279+0000, chain.objs.size()=40 2024-09-12T00:27:13.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.1 2024-09-12T00:27:13.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.2 2024-09-12T00:27:13.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.3 2024-09-12T00:27:13.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.4 2024-09-12T00:27:13.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.5 2024-09-12T00:27:13.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.6 2024-09-12T00:27:13.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.7 2024-09-12T00:27:13.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.8 2024-09-12T00:27:13.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.9 2024-09-12T00:27:13.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.238+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.10 2024-09-12T00:27:13.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.243+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.11 2024-09-12T00:27:13.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.243+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.12 2024-09-12T00:27:13.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.243+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.13 2024-09-12T00:27:13.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.243+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.14 2024-09-12T00:27:13.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.243+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.15 2024-09-12T00:27:13.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.243+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.16 2024-09-12T00:27:13.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.244+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.17 2024-09-12T00:27:13.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.244+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.18 2024-09-12T00:27:13.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.244+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.19 2024-09-12T00:27:13.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.244+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.20 2024-09-12T00:27:13.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.244+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.qAqoXEIMK5f-4Fwo7ElpAKuiAWkqvxg5.21 2024-09-12T00:27:13.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.248+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.k_6aE4YA_cFY075f1uwmlqIRKPnJiIop.22 2024-09-12T00:27:13.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.248+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.23 2024-09-12T00:27:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.250+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.24 2024-09-12T00:27:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.250+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.25 2024-09-12T00:27:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.250+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.26 2024-09-12T00:27:13.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.250+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.27 2024-09-12T00:27:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.250+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.28 2024-09-12T00:27:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.250+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.29 2024-09-12T00:27:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.250+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.30 2024-09-12T00:27:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.250+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.31 2024-09-12T00:27:13.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.250+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.32 2024-09-12T00:27:13.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.251+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.33 2024-09-12T00:27:13.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.251+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.34 2024-09-12T00:27:13.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.256+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.35 2024-09-12T00:27:13.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.256+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.36 2024-09-12T00:27:13.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.256+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.37 2024-09-12T00:27:13.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.256+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.38 2024-09-12T00:27:13.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.256+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.39 2024-09-12T00:27:13.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.256+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.105__multipart_key1.2~wGif_vBqRdrOAUhsyyUm8kP8r53KspT.40 2024-09-12T00:27:13.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.256+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17492345159850165940', time=2024-09-12T02:27:03.550479+0000, chain.objs.size()=1 2024-09-12T00:27:13.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.256+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.114__shadow_.BpjmPuN7Xz8RYd0kYpYwGgKFOYzaQ4R_0 2024-09-12T00:27:13.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.257+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12939968765987285848', time=2024-09-12T02:27:06.360015+0000, chain.objs.size()=1 2024-09-12T00:27:13.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.257+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.124__shadow_.DKfLHyNgz-NNra8TfkfIhNNoLntq3dz_0 2024-09-12T00:27:13.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.257+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6860791669455610271', time=2024-09-12T02:27:06.938233+0000, chain.objs.size()=1 2024-09-12T00:27:13.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.257+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.126__shadow_.9kEFqb_5jBGNKsFwzTpTwArDqUt2pd0_0 2024-09-12T00:27:13.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.261+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.264+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:27:13.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.265+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.266+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.266+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:27:13.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.266+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14517511741095446787', time=2024-09-12T02:27:05.246844+0000, chain.objs.size()=1 2024-09-12T00:27:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.266+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.120__shadow_.ziVyvG4-aXzJQ73pPsv8GpyPk9GX1lc_0 2024-09-12T00:27:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.266+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8499020911408806401', time=2024-09-12T02:27:06.647324+0000, chain.objs.size()=1 2024-09-12T00:27:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.266+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.125__shadow_.6x8KHNBidFbZaBZXe-UkAW1Qka7t_lY_0 2024-09-12T00:27:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.266+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.270671955700418167', time=2024-09-12T02:27:06.933109+0000, chain.objs.size()=1 2024-09-12T00:27:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.266+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.126__shadow_.YrhZJn4HC9K2YS0pS1_ooJ0e42ZyCm5_0 2024-09-12T00:27:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.266+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5311288603469017251', time=2024-09-12T02:27:07.207550+0000, chain.objs.size()=1 2024-09-12T00:27:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.266+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.127__shadow_.l_uXGv1OGkUMwCF-1_NPrYi0-q1MtVe_0 2024-09-12T00:27:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.266+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8488424439792900383', time=2024-09-12T02:27:07.219563+0000, chain.objs.size()=1 2024-09-12T00:27:13.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.266+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.127__shadow_.V6eKDCGw21P3z55_vaJNCTBGvqcwiTw_0 2024-09-12T00:27:13.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.269+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.271+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:27:13.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:27:13.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='2~KZDVFIlZaeo4p5lzGVEOUbx7dCOFJaP', time=2024-09-12T02:26:43.258603+0000, chain.objs.size()=5 2024-09-12T00:27:13.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.79__multipart_key1.2~KZDVFIlZaeo4p5lzGVEOUbx7dCOFJaP.1 2024-09-12T00:27:13.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.79__multipart_key1.2~KZDVFIlZaeo4p5lzGVEOUbx7dCOFJaP.2 2024-09-12T00:27:13.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.79__multipart_key1.2~KZDVFIlZaeo4p5lzGVEOUbx7dCOFJaP.3 2024-09-12T00:27:13.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.79__multipart_key1.2~KZDVFIlZaeo4p5lzGVEOUbx7dCOFJaP.4 2024-09-12T00:27:13.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.79__multipart_key1.2~KZDVFIlZaeo4p5lzGVEOUbx7dCOFJaP.5 2024-09-12T00:27:13.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15736682469125539949', time=2024-09-12T02:26:57.801861+0000, chain.objs.size()=5 2024-09-12T00:27:13.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~msjJNu_JM1ibhUL62BKLZrGxXrDay-O.1 2024-09-12T00:27:13.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__shadow_key1.2~msjJNu_JM1ibhUL62BKLZrGxXrDay-O.1_1 2024-09-12T00:27:13.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~msjJNu_JM1ibhUL62BKLZrGxXrDay-O.2 2024-09-12T00:27:13.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__shadow_key1.2~msjJNu_JM1ibhUL62BKLZrGxXrDay-O.2_1 2024-09-12T00:27:13.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~msjJNu_JM1ibhUL62BKLZrGxXrDay-O.3 2024-09-12T00:27:13.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17611510316479521748', time=2024-09-12T02:27:07.763952+0000, chain.objs.size()=1 2024-09-12T00:27:13.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.273+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.129__shadow_.ZdEjxgLFgVpVYADEmbf2JZB27mubrIW_0 2024-09-12T00:27:13.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.278+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.281+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:27:13.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.282+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.283+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.283+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:27:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.283+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12312833811371710333', time=2024-09-12T02:26:46.764982+0000, chain.objs.size()=5 2024-09-12T00:27:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.283+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.91__multipart_key1.2~NaQ1Ceavj-NIm_ycAdF8xTjJ_Uljun8.1 2024-09-12T00:27:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.283+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.91__multipart_key1.2~NaQ1Ceavj-NIm_ycAdF8xTjJ_Uljun8.2 2024-09-12T00:27:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.283+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.91__multipart_key1.2~NaQ1Ceavj-NIm_ycAdF8xTjJ_Uljun8.3 2024-09-12T00:27:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.283+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.91__multipart_key1.2~NaQ1Ceavj-NIm_ycAdF8xTjJ_Uljun8.4 2024-09-12T00:27:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.283+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.91__multipart_key1.2~NaQ1Ceavj-NIm_ycAdF8xTjJ_Uljun8.5 2024-09-12T00:27:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.283+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9684456458183151847', time=2024-09-12T02:27:06.658242+0000, chain.objs.size()=1 2024-09-12T00:27:13.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.283+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.125__shadow_.J5Jgm2q6f1gWmQJv74g3EeGiOOwoTZS_0 2024-09-12T00:27:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.283+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12181797703885038920', time=2024-09-12T02:27:08.310304+0000, chain.objs.size()=1 2024-09-12T00:27:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.283+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.131__shadow_.9veIhHKUrrlHQowNRCfPqEUNVszOd_3_0 2024-09-12T00:27:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.283+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8017060904465730726', time=2024-09-12T02:27:08.577635+0000, chain.objs.size()=1 2024-09-12T00:27:13.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.283+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.132__shadow_.a9KNfIyWGvneQXueoqt0jTxHtADt684_0 2024-09-12T00:27:13.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.289+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.291+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:27:13.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.292+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.293+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.293+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T00:27:13.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.293+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5798485127057018312', time=2024-09-12T02:26:51.175775+0000, chain.objs.size()=4 2024-09-12T00:27:13.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.293+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.93__shadow_.P-Wk2V-QioLjYOx7cwoEA4ipoSlfrDl_0 2024-09-12T00:27:13.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.293+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.93__shadow_.P-Wk2V-QioLjYOx7cwoEA4ipoSlfrDl_1 2024-09-12T00:27:13.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.293+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.93__shadow_.P-Wk2V-QioLjYOx7cwoEA4ipoSlfrDl_2 2024-09-12T00:27:13.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.293+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.93__shadow_.P-Wk2V-QioLjYOx7cwoEA4ipoSlfrDl_3 2024-09-12T00:27:13.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.293+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1015983211706690262', time=2024-09-12T02:26:53.872274+0000, chain.objs.size()=5 2024-09-12T00:27:13.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.293+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.100__multipart_file2.mpg.2~oWqWcOijrQNzQW2lB-ftvDN0n4QXR7d.1 2024-09-12T00:27:13.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.293+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.100__multipart_file2.mpg.2~oWqWcOijrQNzQW2lB-ftvDN0n4QXR7d.2 2024-09-12T00:27:13.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.293+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.100__multipart_file2.mpg.2~oWqWcOijrQNzQW2lB-ftvDN0n4QXR7d.3 2024-09-12T00:27:13.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.293+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.100__multipart_file2.mpg.2~oWqWcOijrQNzQW2lB-ftvDN0n4QXR7d.4 2024-09-12T00:27:13.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.294+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.100__multipart_file2.mpg.2~oWqWcOijrQNzQW2lB-ftvDN0n4QXR7d.5 2024-09-12T00:27:13.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.294+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2396201862128566334', time=2024-09-12T02:27:03.264077+0000, chain.objs.size()=1 2024-09-12T00:27:13.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.294+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.113__shadow_.u2UGEunp_A3qX2iWltQlJK0aaqbaKZh_0 2024-09-12T00:27:13.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.294+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3491723302258155888', time=2024-09-12T02:27:03.817202+0000, chain.objs.size()=1 2024-09-12T00:27:13.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.294+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.115__shadow_.w2K0f7Y4AnypIiFqFk2Xx7NFspS0jpq_0 2024-09-12T00:27:13.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.294+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9018030888964562786', time=2024-09-12T02:27:04.966392+0000, chain.objs.size()=1 2024-09-12T00:27:13.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.294+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.119__shadow_.nII7J2SpABP354nHzmY1dPmmHL-kEjG_0 2024-09-12T00:27:13.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.298+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13395389992395563683', time=2024-09-12T02:27:05.523748+0000, chain.objs.size()=1 2024-09-12T00:27:13.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.299+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.121__shadow_.w5ecIR8iHTYEhkzi_CmSx02SwK69BxF_0 2024-09-12T00:27:13.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.299+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4794054589460488625', time=2024-09-12T02:27:08.050774+0000, chain.objs.size()=1 2024-09-12T00:27:13.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.299+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.130__shadow_.h5YVR9sp1q2WoMWRQx1qH39MGOMslPy_0 2024-09-12T00:27:13.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.299+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15176654556452319969', time=2024-09-12T02:27:08.854142+0000, chain.objs.size()=1 2024-09-12T00:27:13.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.299+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.133__shadow_.LuN6PYTanGE-GmOYsBfWNt8VS2Jod2g_0 2024-09-12T00:27:13.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.302+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.304+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:27:13.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.305+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.306+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.306+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:27:13.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.306+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6775973102493541675', time=2024-09-12T02:27:07.500211+0000, chain.objs.size()=1 2024-09-12T00:27:13.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.306+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.128__shadow_.dkqFG6aKoUjq6g6bTfgGSG1gqo_mIT9_0 2024-09-12T00:27:13.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.308+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.310+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:27:13.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.311+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.311+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:27:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10505009893725833274', time=2024-09-12T02:26:42.532256+0000, chain.objs.size()=1 2024-09-12T00:27:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.77__shadow_.Y0DtGUIBA_NNgyocLI4iHo4eLOSVbAI_0 2024-09-12T00:27:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11789314776507014565', time=2024-09-12T02:26:48.869508+0000, chain.objs.size()=5 2024-09-12T00:27:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~nwEkJRl6oNFa61DrY0QNIPY3RwS-bDu.1 2024-09-12T00:27:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~nwEkJRl6oNFa61DrY0QNIPY3RwS-bDu.2 2024-09-12T00:27:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~nwEkJRl6oNFa61DrY0QNIPY3RwS-bDu.3 2024-09-12T00:27:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~nwEkJRl6oNFa61DrY0QNIPY3RwS-bDu.4 2024-09-12T00:27:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.94__multipart_key1.2~nwEkJRl6oNFa61DrY0QNIPY3RwS-bDu.5 2024-09-12T00:27:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13541227759640447838', time=2024-09-12T02:26:58.229679+0000, chain.objs.size()=5 2024-09-12T00:27:13.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~Hri_QeGXK5Xc9ZPuFUOcgGHJOivPOHD.1 2024-09-12T00:27:13.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__shadow_key1.2~Hri_QeGXK5Xc9ZPuFUOcgGHJOivPOHD.1_1 2024-09-12T00:27:13.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~Hri_QeGXK5Xc9ZPuFUOcgGHJOivPOHD.2 2024-09-12T00:27:13.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__shadow_key1.2~Hri_QeGXK5Xc9ZPuFUOcgGHJOivPOHD.2_1 2024-09-12T00:27:13.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102__multipart_key1.2~Hri_QeGXK5Xc9ZPuFUOcgGHJOivPOHD.3 2024-09-12T00:27:13.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5753226479844754467', time=2024-09-12T02:27:10.644335+0000, chain.objs.size()=1 2024-09-12T00:27:13.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.312+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.140__shadow_.BvU6O4HHoRpHPKnffpJxM2XRLrZBZRa_0 2024-09-12T00:27:13.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.315+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2385566129909395376', time=2024-09-12T02:27:12.490432+0000, chain.objs.size()=5 2024-09-12T00:27:13.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.315+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.144__multipart_key1/data/file.mpg.2~_X888W0HK1f7L4qD7PiIrOWLhQm3sj-.1 2024-09-12T00:27:13.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.315+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.144__multipart_key1/data/file.mpg.2~_X888W0HK1f7L4qD7PiIrOWLhQm3sj-.2 2024-09-12T00:27:13.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.317+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.144__multipart_key1/data/file.mpg.2~_X888W0HK1f7L4qD7PiIrOWLhQm3sj-.3 2024-09-12T00:27:13.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.317+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.144__multipart_key1/data/file.mpg.2~_X888W0HK1f7L4qD7PiIrOWLhQm3sj-.4 2024-09-12T00:27:13.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.317+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.144__multipart_key1/data/file.mpg.2~_X888W0HK1f7L4qD7PiIrOWLhQm3sj-.5 2024-09-12T00:27:13.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.322+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.324+0000 7f6cd8937800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:27:13.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.325+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.325+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.326+0000 7f6cd8937800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:27:13.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.326+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16475286387574043381', time=2024-09-12T02:26:58.718923+0000, chain.objs.size()=1 2024-09-12T00:27:13.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.326+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.103__shadow_.zz7sEzw0BSxueQtBT2itsF9uIuTD4hm_0 2024-09-12T00:27:13.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.326+0000 7f6cd8937800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3971063717280979154', time=2024-09-12T02:27:06.922089+0000, chain.objs.size()=1 2024-09-12T00:27:13.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.326+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.126__shadow_.4DNzsNCDVc3APAU7VqF6Iw46JwG1ALz_0 2024-09-12T00:27:13.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.328+0000 7f6cd8937800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:27:13.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.331+0000 7f6b8afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:13.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.333+0000 7f6cd8937800 20 remove_watcher() i=0 2024-09-12T00:27:13.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.333+0000 7f6cd8937800 2 removed watcher, disabling cache 2024-09-12T00:27:13.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.334+0000 7f6cd8937800 20 remove_watcher() i=1 2024-09-12T00:27:13.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.335+0000 7f6cd8937800 20 remove_watcher() i=2 2024-09-12T00:27:13.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.336+0000 7f6cd8937800 20 remove_watcher() i=3 2024-09-12T00:27:13.335 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.337+0000 7f6cd8937800 20 remove_watcher() i=4 2024-09-12T00:27:13.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.338+0000 7f6cd8937800 20 remove_watcher() i=5 2024-09-12T00:27:13.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.339+0000 7f6cd8937800 20 remove_watcher() i=6 2024-09-12T00:27:13.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.340+0000 7f6cd8937800 20 remove_watcher() i=7 2024-09-12T00:27:13.350 DEBUG:teuthology.orchestra.run.smithi067:> radosgw-admin gc process --include-all 2024-09-12T00:27:13.403 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:13.403 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:13.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.444+0000 7fde8a214800 20 rados->read ofs=0 len=0 2024-09-12T00:27:13.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.446+0000 7fde8a214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:13.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.446+0000 7fde8a214800 20 realm 2024-09-12T00:27:13.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.446+0000 7fde8a214800 20 rados->read ofs=0 len=0 2024-09-12T00:27:13.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.446+0000 7fde8a214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:13.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.446+0000 7fde8a214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:13.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.446+0000 7fde8a214800 20 rados->read ofs=0 len=0 2024-09-12T00:27:13.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.446+0000 7fde8a214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:13.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.446+0000 7fde8a214800 20 rados->read ofs=0 len=0 2024-09-12T00:27:13.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.447+0000 7fde8a214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:13.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.447+0000 7fde8a214800 20 rados->read ofs=0 len=0 2024-09-12T00:27:13.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.448+0000 7fde8a214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:13.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.448+0000 7fde8a214800 20 searching for the correct realm 2024-09-12T00:27:13.450 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.451+0000 7fde850ca640 0 -- 172.21.15.67:0/1993537061 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fde7c0ab1a0 msgr2=0x7fde7c0b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:13.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.657+0000 7fde860cc640 0 -- 172.21.15.67:0/1993537061 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x562b6583e720 msgr2=0x562b65840b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:13.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.661+0000 7fde8a214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:13.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.661+0000 7fde8a214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:13.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.661+0000 7fde8a214800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:13.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.661+0000 7fde8a214800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:13.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.661+0000 7fde8a214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:13.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.661+0000 7fde8a214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:13.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.661+0000 7fde8a214800 20 rados->read ofs=0 len=0 2024-09-12T00:27:13.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.661+0000 7fde8a214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:13.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.661+0000 7fde8a214800 20 rados->read ofs=0 len=0 2024-09-12T00:27:13.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.661+0000 7fde8a214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:13.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.661+0000 7fde8a214800 20 rados->read ofs=0 len=0 2024-09-12T00:27:13.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.662+0000 7fde8a214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:13.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.662+0000 7fde8a214800 20 zone default found 2024-09-12T00:27:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.662+0000 7fde8a214800 4 Realm: () 2024-09-12T00:27:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.662+0000 7fde8a214800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.662+0000 7fde8a214800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.662+0000 7fde8a214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.662+0000 7fde8a214800 20 zonegroup default 2024-09-12T00:27:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.662+0000 7fde8a214800 20 rados->read ofs=0 len=0 2024-09-12T00:27:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.662+0000 7fde8a214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.662+0000 7fde8a214800 20 rados->read ofs=0 len=0 2024-09-12T00:27:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.662+0000 7fde8a214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.662+0000 7fde8a214800 20 rados->read ofs=0 len=0 2024-09-12T00:27:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.663+0000 7fde8a214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.663+0000 7fde8a214800 20 started sync module instance, tier type = 2024-09-12T00:27:13.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.663+0000 7fde8a214800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:13.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.671+0000 7fde8a214800 20 add_watcher() i=0 2024-09-12T00:27:13.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.671+0000 7fde8a214800 20 add_watcher() i=1 2024-09-12T00:27:13.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.671+0000 7fde8a214800 20 add_watcher() i=2 2024-09-12T00:27:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.671+0000 7fde8a214800 20 add_watcher() i=3 2024-09-12T00:27:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.671+0000 7fde8a214800 20 add_watcher() i=4 2024-09-12T00:27:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.671+0000 7fde8a214800 20 add_watcher() i=5 2024-09-12T00:27:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.671+0000 7fde8a214800 20 add_watcher() i=6 2024-09-12T00:27:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.672+0000 7fde8a214800 20 add_watcher() i=7 2024-09-12T00:27:13.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.672+0000 7fde8a214800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:13.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.673+0000 7fdd377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:13.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.674+0000 7fde8a214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:13.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.674+0000 7fde8a214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:13.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.707+0000 7fdd367fc640 20 reqs_thread_entry: start 2024-09-12T00:27:13.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.707+0000 7fde8a214800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:13.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.707+0000 7fde8a214800 20 Filter name: none 2024-09-12T00:27:13.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.708+0000 7fdca7fff640 20 reqs_thread_entry: start 2024-09-12T00:27:13.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.708+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:27:13.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.709+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.710+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.710+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.711+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:27:13.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.713+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.713+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.714+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.715+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:27:13.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.716+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.716+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.716+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.718+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:27:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.719+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.719+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.720+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.721+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:27:13.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.722+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.722+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.723+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.724+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:27:13.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.725+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.725+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.726+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.726+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:27:13.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.728+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.728+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.729+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.730+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:27:13.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.731+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.732+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.732+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.734+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:27:13.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.735+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.735+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.735 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.736+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.737+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:27:13.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.738+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.739+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.739+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.740+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:27:13.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.741+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.740 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.742+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.742+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.743+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:27:13.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.744+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.744+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.745+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.746+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:27:13.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.747+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.747+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.748+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.749+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:27:13.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.750+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.750+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.751+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.752+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:27:13.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.753+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.754+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.754+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.755+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:27:13.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.756+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.756+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.757+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.757 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.758+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:27:13.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.760+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.760+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.760 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.761+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.762+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:27:13.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.764+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.764+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.765+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.767+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:27:13.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.769+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.769+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.769+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.770+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:27:13.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.771+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.772+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.772+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.773+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:27:13.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.774+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.775+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.775+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.776+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:27:13.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.777+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.778+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.778+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.779+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:27:13.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.781+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.781+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.781+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.783+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:27:13.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.784+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.784+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.784+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.785+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:27:13.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.787+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.787+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.787+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.788+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:27:13.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.790+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.790+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.790+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.791+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:27:13.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.792+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.793+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.793+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.794+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:27:13.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.795+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.796+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.796+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.796 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.797+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:27:13.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.798+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.799+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.799+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.800+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:27:13.800 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.801+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.802+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.802+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.803+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:27:13.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.804+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.804+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.805+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.806+0000 7fde8a214800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:27:13.806 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.807+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.807+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:27:13.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.808+0000 7fde8a214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:27:13.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.810+0000 7fdd377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:13.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.812+0000 7fde8a214800 20 remove_watcher() i=0 2024-09-12T00:27:13.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.812+0000 7fde8a214800 2 removed watcher, disabling cache 2024-09-12T00:27:13.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.813+0000 7fde8a214800 20 remove_watcher() i=1 2024-09-12T00:27:13.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.814+0000 7fde8a214800 20 remove_watcher() i=2 2024-09-12T00:27:13.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.815+0000 7fde8a214800 20 remove_watcher() i=3 2024-09-12T00:27:13.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.816+0000 7fde8a214800 20 remove_watcher() i=4 2024-09-12T00:27:13.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.817+0000 7fde8a214800 20 remove_watcher() i=5 2024-09-12T00:27:13.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.818+0000 7fde8a214800 20 remove_watcher() i=6 2024-09-12T00:27:13.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:13.818+0000 7fde8a214800 20 remove_watcher() i=7 2024-09-12T00:27:13.829 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T00:27:13.879 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T00:27:13.879 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T00:27:13.879 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T00:27:13.880 DEBUG:teuthology.orchestra.run.smithi067:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:27:13.909 INFO:teuthology.orchestra.run.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T00:27:14.692 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T00:27:14.692 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-12T00:27:14.795 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:14.795 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:14.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:14.833+0000 7f2cec330800 20 rados->read ofs=0 len=0 2024-09-12T00:27:14.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:14.835+0000 7f2cec330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:14.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:14.835+0000 7f2cec330800 20 realm 2024-09-12T00:27:14.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:14.835+0000 7f2cec330800 20 rados->read ofs=0 len=0 2024-09-12T00:27:14.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:14.835+0000 7f2cec330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:14.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:14.835+0000 7f2cec330800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:14.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:14.835+0000 7f2cec330800 20 rados->read ofs=0 len=0 2024-09-12T00:27:14.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:14.835+0000 7f2cec330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:14.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:14.835+0000 7f2cec330800 20 rados->read ofs=0 len=0 2024-09-12T00:27:14.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:14.836+0000 7f2cec330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:14.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:14.836+0000 7f2cec330800 20 rados->read ofs=0 len=0 2024-09-12T00:27:14.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:14.837+0000 7f2cec330800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:14.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:14.837+0000 7f2cec330800 20 searching for the correct realm 2024-09-12T00:27:14.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:14.839+0000 7f2ce80b0640 0 -- 172.21.15.67:0/2277293213 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f2cd8072b80 msgr2=0x7f2cd8086300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:15.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.045+0000 7f2ce80b0640 0 -- 172.21.15.67:0/2277293213 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x55e3a27cbaa0 msgr2=0x7f2ce006e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:15.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.253+0000 7f2cec330800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:15.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.253+0000 7f2cec330800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:15.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.253+0000 7f2cec330800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:15.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.253+0000 7f2cec330800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:15.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.253+0000 7f2cec330800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:15.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.253+0000 7f2cec330800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:15.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.253+0000 7f2cec330800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.254+0000 7f2cec330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.254+0000 7f2cec330800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.254+0000 7f2cec330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:15.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.254+0000 7f2cec330800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.254+0000 7f2cec330800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:15.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.254+0000 7f2cec330800 20 zone default found 2024-09-12T00:27:15.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.254+0000 7f2cec330800 4 Realm: () 2024-09-12T00:27:15.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.254+0000 7f2cec330800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:15.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.254+0000 7f2cec330800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:15.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.254+0000 7f2cec330800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:15.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.254+0000 7f2cec330800 20 zonegroup default 2024-09-12T00:27:15.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.254+0000 7f2cec330800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.255+0000 7f2cec330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.255+0000 7f2cec330800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.255+0000 7f2cec330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.255+0000 7f2cec330800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.255+0000 7f2cec330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.255+0000 7f2cec330800 20 started sync module instance, tier type = 2024-09-12T00:27:15.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.255+0000 7f2cec330800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.266+0000 7f2cec330800 20 add_watcher() i=0 2024-09-12T00:27:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.266+0000 7f2cec330800 20 add_watcher() i=1 2024-09-12T00:27:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.266+0000 7f2cec330800 20 add_watcher() i=2 2024-09-12T00:27:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.266+0000 7f2cec330800 20 add_watcher() i=3 2024-09-12T00:27:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.266+0000 7f2cec330800 20 add_watcher() i=4 2024-09-12T00:27:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.266+0000 7f2cec330800 20 add_watcher() i=5 2024-09-12T00:27:15.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.266+0000 7f2cec330800 20 add_watcher() i=6 2024-09-12T00:27:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.267+0000 7f2cec330800 20 add_watcher() i=7 2024-09-12T00:27:15.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.267+0000 7f2cec330800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:15.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.268+0000 7f2b9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:15.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.268+0000 7f2cec330800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:15.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.268+0000 7f2cec330800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:15.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.268+0000 7f2cec330800 5 note: GC not initialized 2024-09-12T00:27:15.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.269+0000 7f2b9dfdb640 20 reqs_thread_entry: start 2024-09-12T00:27:15.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.269+0000 7f2cec330800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:15.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.269+0000 7f2cec330800 20 Filter name: none 2024-09-12T00:27:15.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.269+0000 7f2b0f7fe640 20 reqs_thread_entry: start 2024-09-12T00:27:15.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.269+0000 7f2cec330800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-12T00:27:15.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.269+0000 7f2cec330800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.269+0000 7f2cec330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.269+0000 7f2cec330800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-12T00:27:15.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.269+0000 7f2cec330800 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T00:27:15.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.269+0000 7f2cec330800 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-12T00:27:15.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.269+0000 7f2cec330800 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-12T00:27:15.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.269+0000 7f2cec330800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.270+0000 7f2cec330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.270+0000 7f2cec330800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-12T00:27:15.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.270+0000 7f2cec330800 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:27:15.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.270+0000 7f2cec330800 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-12T00:27:15.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.272+0000 7f2cec330800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T00:27:15.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.272+0000 7f2cec330800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T00:27:15.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.272+0000 7f2cec330800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-12T00:27:15.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.272+0000 7f2bbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562606 cookie 94436173992576 notifier 9018 bl.length()=384 2024-09-12T00:27:15.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.272+0000 7f2bbf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T00:27:15.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.272+0000 7f2bbf7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T00:27:15.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.274+0000 7f2cec330800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T00:27:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.274+0000 7f2cec330800 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T00:27:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.274+0000 7f2cec330800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-12T00:27:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.274+0000 7f2bbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562607 cookie 94436174006288 notifier 9018 bl.length()=225 2024-09-12T00:27:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.274+0000 7f2bbeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T00:27:15.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.274+0000 7f2bbeffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T00:27:15.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.276+0000 7f2cec330800 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T00:27:15.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.276+0000 7f2cec330800 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:27:15.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.276+0000 7f2cec330800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-12T00:27:15.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.276+0000 7f2bbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562450 cookie 94436173998704 notifier 9018 bl.length()=234 2024-09-12T00:27:15.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.276+0000 7f2bbeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T00:27:15.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.276+0000 7f2bbeffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:27:15.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.278+0000 7f2bbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562451 cookie 94436173998704 notifier 9018 bl.length()=234 2024-09-12T00:27:15.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.278+0000 7f2bbf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T00:27:15.278 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.278+0000 7f2bbf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:27:15.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.279+0000 7f2b9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:15.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.281+0000 7f2cec330800 20 remove_watcher() i=0 2024-09-12T00:27:15.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.281+0000 7f2cec330800 2 removed watcher, disabling cache 2024-09-12T00:27:15.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.283+0000 7f2cec330800 20 remove_watcher() i=1 2024-09-12T00:27:15.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.284+0000 7f2cec330800 20 remove_watcher() i=2 2024-09-12T00:27:15.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.285+0000 7f2cec330800 20 remove_watcher() i=3 2024-09-12T00:27:15.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.286+0000 7f2cec330800 20 remove_watcher() i=4 2024-09-12T00:27:15.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.287+0000 7f2cec330800 20 remove_watcher() i=5 2024-09-12T00:27:15.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.288+0000 7f2cec330800 20 remove_watcher() i=6 2024-09-12T00:27:15.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.289+0000 7f2cec330800 20 remove_watcher() i=7 2024-09-12T00:27:15.298 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:27:15.298 INFO:teuthology.orchestra.run.smithi067.stdout: "id": "RGW11111111111111111", 2024-09-12T00:27:15.298 INFO:teuthology.orchestra.run.smithi067.stdout: "tenant": "", 2024-09-12T00:27:15.298 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "Mr.RGW11111111111111111", 2024-09-12T00:27:15.298 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-12T00:27:15.298 INFO:teuthology.orchestra.run.smithi067.stdout: "quota": { 2024-09-12T00:27:15.298 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:15.298 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:15.298 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:15.299 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:15.299 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:15.299 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:15.299 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T00:27:15.299 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:15.299 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:15.299 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:15.299 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:15.299 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:15.299 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:15.299 INFO:teuthology.orchestra.run.smithi067.stdout: "max_users": 1000, 2024-09-12T00:27:15.299 INFO:teuthology.orchestra.run.smithi067.stdout: "max_roles": 1000, 2024-09-12T00:27:15.300 INFO:teuthology.orchestra.run.smithi067.stdout: "max_groups": 1000, 2024-09-12T00:27:15.300 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:27:15.300 INFO:teuthology.orchestra.run.smithi067.stdout: "max_access_keys": 4 2024-09-12T00:27:15.300 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:27:15.301 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-12T00:27:15.301 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key EURVLLYDHHKOTLRVJZTF --secret U6Ja48yu0Bc+IPgp6lQzmA4PT+A1RZOMMQiUM+EkpL2iQfAhYBDo9Q== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-12T00:27:15.372 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:15.372 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:15.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.409+0000 7f5f97b26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.411+0000 7f5f97b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.411+0000 7f5f97b26800 20 realm 2024-09-12T00:27:15.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.411+0000 7f5f97b26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.411+0000 7f5f97b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.411+0000 7f5f97b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:15.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.411+0000 7f5f97b26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.411+0000 7f5f97b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.411+0000 7f5f97b26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.412+0000 7f5f97b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:15.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.412+0000 7f5f97b26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.413+0000 7f5f97b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:15.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.413+0000 7f5f97b26800 20 searching for the correct realm 2024-09-12T00:27:15.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.416+0000 7f5f92fd8640 0 -- 172.21.15.67:0/184256320 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f5f8808c420 msgr2=0x7f5f8808c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:15.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.622+0000 7f5f93fda640 0 -- 172.21.15.67:0/184256320 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x564117adb830 msgr2=0x564117addcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:15.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.627+0000 7f5f97b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:15.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.627+0000 7f5f97b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:15.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.627+0000 7f5f97b26800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:15.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.627+0000 7f5f97b26800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:15.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.627+0000 7f5f97b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:15.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.627+0000 7f5f97b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:15.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.627+0000 7f5f97b26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.627+0000 7f5f97b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.627+0000 7f5f97b26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.628+0000 7f5f97b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:15.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.628+0000 7f5f97b26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.628+0000 7f5f97b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:15.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.628+0000 7f5f97b26800 20 zone default found 2024-09-12T00:27:15.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.628+0000 7f5f97b26800 4 Realm: () 2024-09-12T00:27:15.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.628+0000 7f5f97b26800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:15.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.628+0000 7f5f97b26800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:15.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.628+0000 7f5f97b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:15.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.628+0000 7f5f97b26800 20 zonegroup default 2024-09-12T00:27:15.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.628+0000 7f5f97b26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.628+0000 7f5f97b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.628+0000 7f5f97b26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.629+0000 7f5f97b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.629+0000 7f5f97b26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.629+0000 7f5f97b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.629+0000 7f5f97b26800 20 started sync module instance, tier type = 2024-09-12T00:27:15.630 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.629+0000 7f5f97b26800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:15.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.639+0000 7f5f97b26800 20 add_watcher() i=0 2024-09-12T00:27:15.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.639+0000 7f5f97b26800 20 add_watcher() i=1 2024-09-12T00:27:15.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.639+0000 7f5f97b26800 20 add_watcher() i=2 2024-09-12T00:27:15.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.639+0000 7f5f97b26800 20 add_watcher() i=3 2024-09-12T00:27:15.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.639+0000 7f5f97b26800 20 add_watcher() i=4 2024-09-12T00:27:15.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.639+0000 7f5f97b26800 20 add_watcher() i=5 2024-09-12T00:27:15.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.639+0000 7f5f97b26800 20 add_watcher() i=6 2024-09-12T00:27:15.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.640+0000 7f5f97b26800 20 add_watcher() i=7 2024-09-12T00:27:15.639 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.640+0000 7f5f97b26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:15.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.641+0000 7f5e49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:15.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.642+0000 7f5f97b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:15.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.642+0000 7f5f97b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:15.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.642+0000 7f5f97b26800 5 note: GC not initialized 2024-09-12T00:27:15.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.642+0000 7f5e48fe1640 20 reqs_thread_entry: start 2024-09-12T00:27:15.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.642+0000 7f5f97b26800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:15.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.642+0000 7f5f97b26800 20 Filter name: none 2024-09-12T00:27:15.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.642+0000 7f5dc27fc640 20 reqs_thread_entry: start 2024-09-12T00:27:15.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.642+0000 7f5f97b26800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:27:15.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.642+0000 7f5f97b26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.643+0000 7f5f97b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.643+0000 7f5f97b26800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T00:27:15.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.643+0000 7f5f97b26800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:27:15.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.643+0000 7f5f97b26800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T00:27:15.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.643+0000 7f5f97b26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.643+0000 7f5f97b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.643+0000 7f5f97b26800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T00:27:15.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.643+0000 7f5f97b26800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:27:15.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.643+0000 7f5f97b26800 10 cache get: name=default.rgw.meta+users.keys+EURVLLYDHHKOTLRVJZTF : miss 2024-09-12T00:27:15.644 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.643+0000 7f5f97b26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.643+0000 7f5f97b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.643+0000 7f5f97b26800 10 cache put: name=default.rgw.meta+users.keys+EURVLLYDHHKOTLRVJZTF info.flags=0x0 2024-09-12T00:27:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.643+0000 7f5f97b26800 10 adding default.rgw.meta+users.keys+EURVLLYDHHKOTLRVJZTF to cache LRU end 2024-09-12T00:27:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.643+0000 7f5f97b26800 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-12T00:27:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.643+0000 7f5f97b26800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.644+0000 7f5f97b26800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:27:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.644+0000 7f5f97b26800 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T00:27:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.644+0000 7f5f97b26800 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T00:27:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.644+0000 7f5f97b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.644+0000 7f5f97b26800 10 cache get: name=default.rgw.meta+users.keys+EURVLLYDHHKOTLRVJZTF : hit (negative entry) 2024-09-12T00:27:15.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.644+0000 7f5f97b26800 10 cache get: name=default.rgw.meta+users.keys+EURVLLYDHHKOTLRVJZTF : hit (negative entry) 2024-09-12T00:27:15.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.646+0000 7f5f97b26800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:27:15.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.646+0000 7f5f97b26800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:27:15.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.646+0000 7f5f97b26800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:27:15.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.646+0000 7f5e76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562511 cookie 94837570132000 notifier 8435 bl.length()=673 2024-09-12T00:27:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.646+0000 7f5e76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:27:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.646+0000 7f5e76ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:27:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.648+0000 7f5f97b26800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:27:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.648+0000 7f5f97b26800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:27:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.648+0000 7f5f97b26800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T00:27:15.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.648+0000 7f5e767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562608 cookie 94837570186864 notifier 8435 bl.length()=185 2024-09-12T00:27:15.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.648+0000 7f5e767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:27:15.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.648+0000 7f5e767fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:27:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.649+0000 7f5f97b26800 10 cache put: name=default.rgw.meta+users.keys+EURVLLYDHHKOTLRVJZTF info.flags=0x7 2024-09-12T00:27:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.649+0000 7f5f97b26800 10 moving default.rgw.meta+users.keys+EURVLLYDHHKOTLRVJZTF to cache LRU end 2024-09-12T00:27:15.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.649+0000 7f5f97b26800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:EURVLLYDHHKOTLRVJZTF, ofs0, ns] 2024-09-12T00:27:15.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.650+0000 7f5e76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562671 cookie 94837570190896 notifier 8435 bl.length()=186 2024-09-12T00:27:15.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.650+0000 7f5e76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EURVLLYDHHKOTLRVJZTF info.flags=0x7 2024-09-12T00:27:15.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.650+0000 7f5e76ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EURVLLYDHHKOTLRVJZTF to cache LRU end 2024-09-12T00:27:15.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.652+0000 7f5f97b26800 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-12T00:27:15.651 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:27:15.651 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "foo.client.0", 2024-09-12T00:27:15.651 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-12T00:27:15.651 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "foo+test@test.test", 2024-09-12T00:27:15.651 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T00:27:15.651 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:27:15.651 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T00:27:15.652 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T00:27:15.652 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T00:27:15.652 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "foo.client.0", 2024-09-12T00:27:15.652 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "EURVLLYDHHKOTLRVJZTF", 2024-09-12T00:27:15.653 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "U6Ja48yu0Bc+IPgp6lQzmA4PT+A1RZOMMQiUM+EkpL2iQfAhYBDo9Q==", 2024-09-12T00:27:15.653 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T00:27:15.654 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:27:15.645974Z" 2024-09-12T00:27:15.654 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T00:27:15.654 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T00:27:15.655 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T00:27:15.655 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T00:27:15.655 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T00:27:15.655 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T00:27:15.656 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T00:27:15.656 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T00:27:15.656 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T00:27:15.657 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:15.657 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:15.657 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:15.658 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:15.658 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:15.658 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:15.658 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T00:27:15.658 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:15.659 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:15.659 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:15.659 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:15.659 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:15.659 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:15.659 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T00:27:15.660 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "root", 2024-09-12T00:27:15.660 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T00:27:15.660 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "RGW11111111111111111", 2024-09-12T00:27:15.660 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T00:27:15.661 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:27:15.645960Z", 2024-09-12T00:27:15.661 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T00:27:15.661 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T00:27:15.661 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:27:15.662 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:15.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.653+0000 7f5e49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:15.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.655+0000 7f5f97b26800 20 remove_watcher() i=0 2024-09-12T00:27:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.655+0000 7f5f97b26800 2 removed watcher, disabling cache 2024-09-12T00:27:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.656+0000 7f5f97b26800 20 remove_watcher() i=1 2024-09-12T00:27:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.657+0000 7f5f97b26800 20 remove_watcher() i=2 2024-09-12T00:27:15.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.658+0000 7f5f97b26800 20 remove_watcher() i=3 2024-09-12T00:27:15.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.659+0000 7f5f97b26800 20 remove_watcher() i=4 2024-09-12T00:27:15.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.660+0000 7f5f97b26800 20 remove_watcher() i=5 2024-09-12T00:27:15.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.661+0000 7f5f97b26800 20 remove_watcher() i=6 2024-09-12T00:27:15.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.663+0000 7f5f97b26800 20 remove_watcher() i=7 2024-09-12T00:27:15.675 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 0250205308 --totp-seed AGH5THDGHJCAU2LNWXWI7O2MTE3U5CTXLK2PCD6HRWQBUT2TIX3RSRXKSFKH3QJW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:27:15.743 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:15.743 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:15.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.780+0000 7f4057d35800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.782+0000 7f4057d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.782+0000 7f4057d35800 20 realm 2024-09-12T00:27:15.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.782+0000 7f4057d35800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.782+0000 7f4057d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.782+0000 7f4057d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:15.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.782+0000 7f4057d35800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.782+0000 7f4057d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.782+0000 7f4057d35800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.783+0000 7f4057d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:15.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.783+0000 7f4057d35800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.784+0000 7f4057d35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:15.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.784+0000 7f4057d35800 20 searching for the correct realm 2024-09-12T00:27:15.786 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.787+0000 7f405327c640 0 -- 172.21.15.67:0/2974753288 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f4048065920 msgr2=0x7f4048064460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:15.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.791+0000 7f4053a7d640 0 -- 172.21.15.67:0/2974753288 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f404c0693f0 msgr2=0x7f404c063d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:15.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.796+0000 7f4057d35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:15.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.796+0000 7f4057d35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:15.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.796+0000 7f4057d35800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:15.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.796+0000 7f4057d35800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:15.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.796+0000 7f4057d35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:15.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.796+0000 7f4057d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:15.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.796+0000 7f4057d35800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.796+0000 7f4057d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.796+0000 7f4057d35800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.796+0000 7f4057d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:15.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.796+0000 7f4057d35800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.797+0000 7f4057d35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:15.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.797+0000 7f4057d35800 20 zone default found 2024-09-12T00:27:15.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.797+0000 7f4057d35800 4 Realm: () 2024-09-12T00:27:15.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.797+0000 7f4057d35800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:15.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.797+0000 7f4057d35800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:15.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.797+0000 7f4057d35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:15.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.797+0000 7f4057d35800 20 zonegroup default 2024-09-12T00:27:15.798 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.797+0000 7f4057d35800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.797+0000 7f4057d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.797+0000 7f4057d35800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.797+0000 7f4057d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.797+0000 7f4057d35800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.798+0000 7f4057d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:15.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.798+0000 7f4057d35800 20 started sync module instance, tier type = 2024-09-12T00:27:15.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.798+0000 7f4057d35800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:15.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.807+0000 7f4057d35800 20 add_watcher() i=0 2024-09-12T00:27:15.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.807+0000 7f4057d35800 20 add_watcher() i=1 2024-09-12T00:27:15.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.807+0000 7f4057d35800 20 add_watcher() i=2 2024-09-12T00:27:15.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.807+0000 7f4057d35800 20 add_watcher() i=3 2024-09-12T00:27:15.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.807+0000 7f4057d35800 20 add_watcher() i=4 2024-09-12T00:27:15.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.807+0000 7f4057d35800 20 add_watcher() i=5 2024-09-12T00:27:15.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.807+0000 7f4057d35800 20 add_watcher() i=6 2024-09-12T00:27:15.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.808+0000 7f4057d35800 20 add_watcher() i=7 2024-09-12T00:27:15.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.808+0000 7f4057d35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:15.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.809+0000 7f3f09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:15.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.810+0000 7f4057d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:15.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.810+0000 7f4057d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:15.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.810+0000 7f4057d35800 5 note: GC not initialized 2024-09-12T00:27:15.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.810+0000 7f3f08fe1640 20 reqs_thread_entry: start 2024-09-12T00:27:15.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.810+0000 7f4057d35800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:15.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.810+0000 7f4057d35800 20 Filter name: none 2024-09-12T00:27:15.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.810+0000 7f3e827fc640 20 reqs_thread_entry: start 2024-09-12T00:27:15.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.810+0000 7f4057d35800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:27:15.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.810+0000 7f4057d35800 20 rados->read ofs=0 len=0 2024-09-12T00:27:15.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.811+0000 7f4057d35800 20 rados_obj.operate() r=0 bl.length=488 2024-09-12T00:27:15.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.811+0000 7f4057d35800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T00:27:15.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.811+0000 7f4057d35800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:27:15.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:15.811+0000 7f4057d35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:17.580 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.581+0000 7f4057d35800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:27:17.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.581+0000 7f4057d35800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:27:17.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.581+0000 7f4057d35800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:27:17.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.582+0000 7f3f32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497104 cookie 94302254424736 notifier 9060 bl.length()=687 2024-09-12T00:27:17.581 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.582+0000 7f3f32ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:27:17.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.582+0000 7f3f32ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:27:17.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.584+0000 7f3f09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:17.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.587+0000 7f4057d35800 20 remove_watcher() i=0 2024-09-12T00:27:17.586 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.587+0000 7f4057d35800 2 removed watcher, disabling cache 2024-09-12T00:27:17.587 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.588+0000 7f4057d35800 20 remove_watcher() i=1 2024-09-12T00:27:17.588 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.589+0000 7f4057d35800 20 remove_watcher() i=2 2024-09-12T00:27:17.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.591+0000 7f4057d35800 20 remove_watcher() i=3 2024-09-12T00:27:17.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.592+0000 7f4057d35800 20 remove_watcher() i=4 2024-09-12T00:27:17.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.593+0000 7f4057d35800 20 remove_watcher() i=5 2024-09-12T00:27:17.594 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.594+0000 7f4057d35800 20 remove_watcher() i=6 2024-09-12T00:27:17.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.596+0000 7f4057d35800 20 remove_watcher() i=7 2024-09-12T00:27:17.609 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T00:27:17.609 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key EUCFQEMOMMWTFFPXMKLP --secret JoM0HJb38S4IdEA9HwWFFRFThlKiry4X70sz+aKw+vDavFYZgqI2Xg== --cluster ceph 2024-09-12T00:27:17.679 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:17.679 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:17.718 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.719+0000 7fc831d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.720+0000 7fc831d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.720+0000 7fc831d1f800 20 realm 2024-09-12T00:27:17.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.720+0000 7fc831d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.720+0000 7fc831d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.720 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.720+0000 7fc831d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:17.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.720+0000 7fc831d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.721+0000 7fc831d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.721+0000 7fc831d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.721+0000 7fc831d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:17.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.721+0000 7fc831d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.722+0000 7fc831d1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:17.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.722+0000 7fc831d1f800 20 searching for the correct realm 2024-09-12T00:27:17.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.726+0000 7fc82da0c640 0 -- 172.21.15.67:0/1860932241 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7fc820094040 msgr2=0x7fc820094930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:17.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.730+0000 7fc82da0c640 0 -- 172.21.15.67:0/1860932241 >> [v2:172.21.15.67:6800/2522402523,v1:172.21.15.67:6801/2522402523] conn(0x561603acb090 msgr2=0x561603acd480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:17.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.734+0000 7fc831d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:17.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.734+0000 7fc831d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:17.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.734+0000 7fc831d1f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:17.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.734+0000 7fc831d1f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:17.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.734+0000 7fc831d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:17.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.734+0000 7fc831d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:17.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.734+0000 7fc831d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.734+0000 7fc831d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.734+0000 7fc831d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.734+0000 7fc831d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:17.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.734+0000 7fc831d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.735+0000 7fc831d1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:17.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.735+0000 7fc831d1f800 20 zone default found 2024-09-12T00:27:17.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.735+0000 7fc831d1f800 4 Realm: () 2024-09-12T00:27:17.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.735+0000 7fc831d1f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:17.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.735+0000 7fc831d1f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:17.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.735+0000 7fc831d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:17.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.735+0000 7fc831d1f800 20 zonegroup default 2024-09-12T00:27:17.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.735+0000 7fc831d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.735+0000 7fc831d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.735+0000 7fc831d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.735+0000 7fc831d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.735+0000 7fc831d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.736+0000 7fc831d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.736+0000 7fc831d1f800 20 started sync module instance, tier type = 2024-09-12T00:27:17.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.736+0000 7fc831d1f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:17.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.745+0000 7fc831d1f800 20 add_watcher() i=0 2024-09-12T00:27:17.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.745+0000 7fc831d1f800 20 add_watcher() i=1 2024-09-12T00:27:17.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.745+0000 7fc831d1f800 20 add_watcher() i=2 2024-09-12T00:27:17.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.745+0000 7fc831d1f800 20 add_watcher() i=3 2024-09-12T00:27:17.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.745+0000 7fc831d1f800 20 add_watcher() i=4 2024-09-12T00:27:17.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.745+0000 7fc831d1f800 20 add_watcher() i=5 2024-09-12T00:27:17.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.745+0000 7fc831d1f800 20 add_watcher() i=6 2024-09-12T00:27:17.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.746+0000 7fc831d1f800 20 add_watcher() i=7 2024-09-12T00:27:17.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.746+0000 7fc831d1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:17.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.748+0000 7fc6dffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:17.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.748+0000 7fc831d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:17.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.748+0000 7fc831d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:17.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.748+0000 7fc831d1f800 5 note: GC not initialized 2024-09-12T00:27:17.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.749+0000 7fc6deffd640 20 reqs_thread_entry: start 2024-09-12T00:27:17.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.749+0000 7fc831d1f800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:17.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.749+0000 7fc831d1f800 20 Filter name: none 2024-09-12T00:27:17.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.749+0000 7fc6dcff9640 20 reqs_thread_entry: start 2024-09-12T00:27:17.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.749+0000 7fc831d1f800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:27:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.749+0000 7fc831d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.749+0000 7fc831d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.749+0000 7fc831d1f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T00:27:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.749+0000 7fc831d1f800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:27:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.749+0000 7fc831d1f800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T00:27:17.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.749+0000 7fc831d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.750+0000 7fc831d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.750+0000 7fc831d1f800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T00:27:17.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.750+0000 7fc831d1f800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:27:17.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.750+0000 7fc831d1f800 10 cache get: name=default.rgw.meta+users.keys+EUCFQEMOMMWTFFPXMKLP : miss 2024-09-12T00:27:17.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.750+0000 7fc831d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.750+0000 7fc831d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.750+0000 7fc831d1f800 10 cache put: name=default.rgw.meta+users.keys+EUCFQEMOMMWTFFPXMKLP info.flags=0x0 2024-09-12T00:27:17.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.750+0000 7fc831d1f800 10 adding default.rgw.meta+users.keys+EUCFQEMOMMWTFFPXMKLP to cache LRU end 2024-09-12T00:27:17.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.750+0000 7fc831d1f800 10 cache get: name=default.rgw.meta+users.keys+EUCFQEMOMMWTFFPXMKLP : hit (negative entry) 2024-09-12T00:27:17.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.750+0000 7fc831d1f800 10 cache get: name=default.rgw.meta+users.keys+EUCFQEMOMMWTFFPXMKLP : hit (negative entry) 2024-09-12T00:27:17.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.751+0000 7fc831d1f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:27:17.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.751+0000 7fc831d1f800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:27:17.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.751+0000 7fc831d1f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:27:17.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.752+0000 7fc7117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497201 cookie 94652550924688 notifier 8471 bl.length()=645 2024-09-12T00:27:17.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.752+0000 7fc7117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:27:17.752 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.752+0000 7fc7117fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:27:17.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.754+0000 7fc831d1f800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:27:17.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.754+0000 7fc831d1f800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:27:17.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.754+0000 7fc831d1f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T00:27:17.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.754+0000 7fc7117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497264 cookie 94652550965872 notifier 8471 bl.length()=185 2024-09-12T00:27:17.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.754+0000 7fc7117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:27:17.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.754+0000 7fc7117fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:27:17.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.756+0000 7fc831d1f800 10 cache put: name=default.rgw.meta+users.keys+EUCFQEMOMMWTFFPXMKLP info.flags=0x7 2024-09-12T00:27:17.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.756+0000 7fc831d1f800 10 moving default.rgw.meta+users.keys+EUCFQEMOMMWTFFPXMKLP to cache LRU end 2024-09-12T00:27:17.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.756+0000 7fc831d1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:EUCFQEMOMMWTFFPXMKLP, ofs0, ns] 2024-09-12T00:27:17.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.756+0000 7fc710ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497202 cookie 94652550961936 notifier 8471 bl.length()=186 2024-09-12T00:27:17.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.756+0000 7fc710ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EUCFQEMOMMWTFFPXMKLP info.flags=0x7 2024-09-12T00:27:17.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.756+0000 7fc710ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EUCFQEMOMMWTFFPXMKLP to cache LRU end 2024-09-12T00:27:17.756 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:27:17.756 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "bar.client.0", 2024-09-12T00:27:17.756 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T00:27:17.756 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "bar+test@test.test", 2024-09-12T00:27:17.757 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T00:27:17.757 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:27:17.757 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T00:27:17.757 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T00:27:17.757 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T00:27:17.757 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "bar.client.0", 2024-09-12T00:27:17.757 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "EUCFQEMOMMWTFFPXMKLP", 2024-09-12T00:27:17.757 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "JoM0HJb38S4IdEA9HwWFFRFThlKiry4X70sz+aKw+vDavFYZgqI2Xg==", 2024-09-12T00:27:17.757 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T00:27:17.757 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:27:17.752282Z" 2024-09-12T00:27:17.757 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T00:27:17.757 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T00:27:17.758 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T00:27:17.758 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T00:27:17.758 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T00:27:17.758 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T00:27:17.758 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T00:27:17.758 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T00:27:17.758 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T00:27:17.758 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:17.758 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:17.758 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:17.758 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:17.759 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:17.759 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:17.759 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T00:27:17.759 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:17.759 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:17.759 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:17.759 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:17.759 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:17.759 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:17.759 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T00:27:17.759 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "rgw", 2024-09-12T00:27:17.759 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T00:27:17.760 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "", 2024-09-12T00:27:17.760 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T00:27:17.760 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:27:17.752271Z", 2024-09-12T00:27:17.760 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T00:27:17.760 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T00:27:17.760 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:27:17.760 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:17.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.757+0000 7fc6dffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:17.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.760+0000 7fc831d1f800 20 remove_watcher() i=0 2024-09-12T00:27:17.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.760+0000 7fc831d1f800 2 removed watcher, disabling cache 2024-09-12T00:27:17.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.761+0000 7fc831d1f800 20 remove_watcher() i=1 2024-09-12T00:27:17.761 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.762+0000 7fc831d1f800 20 remove_watcher() i=2 2024-09-12T00:27:17.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.763+0000 7fc831d1f800 20 remove_watcher() i=3 2024-09-12T00:27:17.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.764+0000 7fc831d1f800 20 remove_watcher() i=4 2024-09-12T00:27:17.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.765+0000 7fc831d1f800 20 remove_watcher() i=5 2024-09-12T00:27:17.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.766+0000 7fc831d1f800 20 remove_watcher() i=6 2024-09-12T00:27:17.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.767+0000 7fc831d1f800 20 remove_watcher() i=7 2024-09-12T00:27:17.778 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 2103225610 --totp-seed B2CZHXZGWHBSJQNXJHWCZ7XQ2XUIHMRYAPPMS56PKGS2IGE2CJ4GQJ7FJ2CUFOV5 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:27:17.846 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:17.846 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:17.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.883+0000 7f1b7691f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.885+0000 7f1b7691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.885+0000 7f1b7691f800 20 realm 2024-09-12T00:27:17.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.885+0000 7f1b7691f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.885+0000 7f1b7691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.885+0000 7f1b7691f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:17.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.885+0000 7f1b7691f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.885+0000 7f1b7691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.885+0000 7f1b7691f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.886+0000 7f1b7691f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:17.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.886+0000 7f1b7691f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.887+0000 7f1b7691f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:17.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.887+0000 7f1b7691f800 20 searching for the correct realm 2024-09-12T00:27:17.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.890+0000 7f1b71ea8640 0 -- 172.21.15.67:0/1135957280 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f1b680cac20 msgr2=0x7f1b680e0250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:17.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.893+0000 7f1b726a9640 0 -- 172.21.15.67:0/1135957280 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f1b6c01e920 msgr2=0x7f1b6c00d3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:17.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.897+0000 7f1b7691f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:17.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.897+0000 7f1b7691f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:17.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.897+0000 7f1b7691f800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:17.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.897+0000 7f1b7691f800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:17.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.897+0000 7f1b7691f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:17.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.897+0000 7f1b7691f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:17.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.898+0000 7f1b7691f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.898+0000 7f1b7691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.898+0000 7f1b7691f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.898+0000 7f1b7691f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.898+0000 7f1b7691f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.898+0000 7f1b7691f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.898+0000 7f1b7691f800 20 zone default found 2024-09-12T00:27:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.898+0000 7f1b7691f800 4 Realm: () 2024-09-12T00:27:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.898+0000 7f1b7691f800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.898+0000 7f1b7691f800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.898+0000 7f1b7691f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.898+0000 7f1b7691f800 20 zonegroup default 2024-09-12T00:27:17.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.898+0000 7f1b7691f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.899+0000 7f1b7691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.899+0000 7f1b7691f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.899+0000 7f1b7691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.899+0000 7f1b7691f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.899+0000 7f1b7691f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:17.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.899+0000 7f1b7691f800 20 started sync module instance, tier type = 2024-09-12T00:27:17.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.899+0000 7f1b7691f800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:17.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.908+0000 7f1b7691f800 20 add_watcher() i=0 2024-09-12T00:27:17.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.908+0000 7f1b7691f800 20 add_watcher() i=1 2024-09-12T00:27:17.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.908+0000 7f1b7691f800 20 add_watcher() i=2 2024-09-12T00:27:17.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.908+0000 7f1b7691f800 20 add_watcher() i=3 2024-09-12T00:27:17.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.908+0000 7f1b7691f800 20 add_watcher() i=4 2024-09-12T00:27:17.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.908+0000 7f1b7691f800 20 add_watcher() i=5 2024-09-12T00:27:17.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.908+0000 7f1b7691f800 20 add_watcher() i=6 2024-09-12T00:27:17.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.909+0000 7f1b7691f800 20 add_watcher() i=7 2024-09-12T00:27:17.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.909+0000 7f1b7691f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:17.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.911+0000 7f1a297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:17.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.911+0000 7f1b7691f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:17.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.911+0000 7f1b7691f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:17.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.911+0000 7f1b7691f800 5 note: GC not initialized 2024-09-12T00:27:17.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.911+0000 7f1a237fe640 20 reqs_thread_entry: start 2024-09-12T00:27:17.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.911+0000 7f1b7691f800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:17.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.911+0000 7f1b7691f800 20 Filter name: none 2024-09-12T00:27:17.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.911+0000 7f1a217fa640 20 reqs_thread_entry: start 2024-09-12T00:27:17.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.912+0000 7f1b7691f800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:27:17.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.912+0000 7f1b7691f800 20 rados->read ofs=0 len=0 2024-09-12T00:27:17.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.912+0000 7f1b7691f800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:27:17.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.912+0000 7f1b7691f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T00:27:17.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.912+0000 7f1b7691f800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:27:17.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.912+0000 7f1b7691f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:17.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.915+0000 7f1b7691f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:27:17.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.915+0000 7f1b7691f800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:27:17.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.915+0000 7f1b7691f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:27:17.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.915+0000 7f1a55ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497203 cookie 94712587853008 notifier 8489 bl.length()=659 2024-09-12T00:27:17.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.915+0000 7f1a55ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:27:17.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.915+0000 7f1a55ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:27:17.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.917+0000 7f1a297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:17.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.919+0000 7f1b7691f800 20 remove_watcher() i=0 2024-09-12T00:27:17.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.919+0000 7f1b7691f800 2 removed watcher, disabling cache 2024-09-12T00:27:17.919 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.920+0000 7f1b7691f800 20 remove_watcher() i=1 2024-09-12T00:27:17.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.921+0000 7f1b7691f800 20 remove_watcher() i=2 2024-09-12T00:27:17.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.922+0000 7f1b7691f800 20 remove_watcher() i=3 2024-09-12T00:27:17.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.923+0000 7f1b7691f800 20 remove_watcher() i=4 2024-09-12T00:27:17.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.924+0000 7f1b7691f800 20 remove_watcher() i=5 2024-09-12T00:27:17.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.926+0000 7f1b7691f800 20 remove_watcher() i=6 2024-09-12T00:27:17.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:17.927+0000 7f1b7691f800 20 remove_watcher() i=7 2024-09-12T00:27:17.937 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-12T00:27:17.938 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key GNXMEICWJOZUXNKFLBNV --secret mM8pt9wSNfyRPNOVIw7QG06M/KXG7wF/yxUA1t1ZlkWaVzuiH5Joew== --cluster ceph 2024-09-12T00:27:18.003 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:18.003 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:18.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.040+0000 7fbdd520e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.042+0000 7fbdd520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.042+0000 7fbdd520e800 20 realm 2024-09-12T00:27:18.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.042+0000 7fbdd520e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.042+0000 7fbdd520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.042+0000 7fbdd520e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:18.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.042+0000 7fbdd520e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.042+0000 7fbdd520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.042+0000 7fbdd520e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.043+0000 7fbdd520e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:18.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.043+0000 7fbdd520e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.044+0000 7fbdd520e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:18.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.044+0000 7fbdd520e800 20 searching for the correct realm 2024-09-12T00:27:18.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.047+0000 7fbdd11e1640 0 -- 172.21.15.67:0/2374263187 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7fbdb8094060 msgr2=0x7fbdb8060fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:18.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.051+0000 7fbdd09e0640 0 -- 172.21.15.67:0/2374263187 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fbdc8055410 msgr2=0x7fbdc8055850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:18.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.054+0000 7fbdd520e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:18.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.054+0000 7fbdd520e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:18.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.054+0000 7fbdd520e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:18.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.054+0000 7fbdd520e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:18.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.054+0000 7fbdd520e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:18.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.054+0000 7fbdd520e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:18.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.054+0000 7fbdd520e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.055+0000 7fbdd520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.055+0000 7fbdd520e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.055+0000 7fbdd520e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:18.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.055+0000 7fbdd520e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.055+0000 7fbdd520e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:18.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.055+0000 7fbdd520e800 20 zone default found 2024-09-12T00:27:18.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.055+0000 7fbdd520e800 4 Realm: () 2024-09-12T00:27:18.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.055+0000 7fbdd520e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:18.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.055+0000 7fbdd520e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:18.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.055+0000 7fbdd520e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:18.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.055+0000 7fbdd520e800 20 zonegroup default 2024-09-12T00:27:18.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.055+0000 7fbdd520e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.056+0000 7fbdd520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.056+0000 7fbdd520e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.056+0000 7fbdd520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.056+0000 7fbdd520e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.056+0000 7fbdd520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.056+0000 7fbdd520e800 20 started sync module instance, tier type = 2024-09-12T00:27:18.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.056+0000 7fbdd520e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:18.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.065+0000 7fbdd520e800 20 add_watcher() i=0 2024-09-12T00:27:18.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.065+0000 7fbdd520e800 20 add_watcher() i=1 2024-09-12T00:27:18.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.065+0000 7fbdd520e800 20 add_watcher() i=2 2024-09-12T00:27:18.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.065+0000 7fbdd520e800 20 add_watcher() i=3 2024-09-12T00:27:18.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.065+0000 7fbdd520e800 20 add_watcher() i=4 2024-09-12T00:27:18.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.065+0000 7fbdd520e800 20 add_watcher() i=5 2024-09-12T00:27:18.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.065+0000 7fbdd520e800 20 add_watcher() i=6 2024-09-12T00:27:18.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.066+0000 7fbdd520e800 20 add_watcher() i=7 2024-09-12T00:27:18.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.066+0000 7fbdd520e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:18.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.068+0000 7fbc86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:18.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.068+0000 7fbdd520e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:18.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.068+0000 7fbdd520e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:18.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.068+0000 7fbdd520e800 5 note: GC not initialized 2024-09-12T00:27:18.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.068+0000 7fbc85fe3640 20 reqs_thread_entry: start 2024-09-12T00:27:18.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.068+0000 7fbdd520e800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:18.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.068+0000 7fbdd520e800 20 Filter name: none 2024-09-12T00:27:18.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.068+0000 7fbbf77fe640 20 reqs_thread_entry: start 2024-09-12T00:27:18.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.068+0000 7fbdd520e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:27:18.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.068+0000 7fbdd520e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.069+0000 7fbdd520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.069+0000 7fbdd520e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T00:27:18.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.069+0000 7fbdd520e800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:27:18.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.069+0000 7fbdd520e800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T00:27:18.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.069+0000 7fbdd520e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.069+0000 7fbdd520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.069+0000 7fbdd520e800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T00:27:18.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.069+0000 7fbdd520e800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:27:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.069+0000 7fbdd520e800 10 cache get: name=default.rgw.meta+users.keys+GNXMEICWJOZUXNKFLBNV : miss 2024-09-12T00:27:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.069+0000 7fbdd520e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.069+0000 7fbdd520e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.069+0000 7fbdd520e800 10 cache put: name=default.rgw.meta+users.keys+GNXMEICWJOZUXNKFLBNV info.flags=0x0 2024-09-12T00:27:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.069+0000 7fbdd520e800 10 adding default.rgw.meta+users.keys+GNXMEICWJOZUXNKFLBNV to cache LRU end 2024-09-12T00:27:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.069+0000 7fbdd520e800 10 cache get: name=default.rgw.meta+users.keys+GNXMEICWJOZUXNKFLBNV : hit (negative entry) 2024-09-12T00:27:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.069+0000 7fbdd520e800 10 cache get: name=default.rgw.meta+users.keys+GNXMEICWJOZUXNKFLBNV : hit (negative entry) 2024-09-12T00:27:18.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.071+0000 7fbdd520e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:27:18.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.071+0000 7fbdd520e800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:27:18.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.071+0000 7fbdd520e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:27:18.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.071+0000 7fbca7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497265 cookie 94110404622000 notifier 9114 bl.length()=719 2024-09-12T00:27:18.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.071+0000 7fbca7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:27:18.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.071+0000 7fbca7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:27:18.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.072+0000 7fbdd520e800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:27:18.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.072+0000 7fbdd520e800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:27:18.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.072+0000 7fbdd520e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T00:27:18.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.073+0000 7fbca7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497266 cookie 94110404633776 notifier 9114 bl.length()=215 2024-09-12T00:27:18.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.073+0000 7fbca7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:27:18.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.073+0000 7fbca7fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:27:18.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.075+0000 7fbdd520e800 10 cache put: name=default.rgw.meta+users.keys+GNXMEICWJOZUXNKFLBNV info.flags=0x7 2024-09-12T00:27:18.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.075+0000 7fbdd520e800 10 moving default.rgw.meta+users.keys+GNXMEICWJOZUXNKFLBNV to cache LRU end 2024-09-12T00:27:18.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.075+0000 7fbdd520e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:GNXMEICWJOZUXNKFLBNV, ofs0, ns] 2024-09-12T00:27:18.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.075+0000 7fbca7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497204 cookie 94110404612368 notifier 9114 bl.length()=201 2024-09-12T00:27:18.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.075+0000 7fbca7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GNXMEICWJOZUXNKFLBNV info.flags=0x7 2024-09-12T00:27:18.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.075+0000 7fbca7fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GNXMEICWJOZUXNKFLBNV to cache LRU end 2024-09-12T00:27:18.075 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:27:18.075 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T00:27:18.075 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-12T00:27:18.075 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T00:27:18.075 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T00:27:18.075 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:27:18.075 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T00:27:18.075 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T00:27:18.075 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T00:27:18.075 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T00:27:18.075 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "GNXMEICWJOZUXNKFLBNV", 2024-09-12T00:27:18.075 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "mM8pt9wSNfyRPNOVIw7QG06M/KXG7wF/yxUA1t1ZlkWaVzuiH5Joew==", 2024-09-12T00:27:18.075 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T00:27:18.076 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:27:18.071111Z" 2024-09-12T00:27:18.076 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T00:27:18.076 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T00:27:18.076 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T00:27:18.076 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T00:27:18.076 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T00:27:18.076 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T00:27:18.076 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T00:27:18.076 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T00:27:18.076 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T00:27:18.076 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:18.076 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:18.076 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:18.076 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:18.077 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:18.077 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:18.077 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T00:27:18.077 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:18.077 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:18.077 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:18.077 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:18.077 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:18.077 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:18.077 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T00:27:18.077 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "rgw", 2024-09-12T00:27:18.077 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T00:27:18.077 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "", 2024-09-12T00:27:18.077 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T00:27:18.078 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:27:18.071100Z", 2024-09-12T00:27:18.078 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T00:27:18.078 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T00:27:18.078 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:27:18.078 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:18.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.076+0000 7fbc86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:18.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.078+0000 7fbdd520e800 20 remove_watcher() i=0 2024-09-12T00:27:18.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.078+0000 7fbdd520e800 2 removed watcher, disabling cache 2024-09-12T00:27:18.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.079+0000 7fbdd520e800 20 remove_watcher() i=1 2024-09-12T00:27:18.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.080+0000 7fbdd520e800 20 remove_watcher() i=2 2024-09-12T00:27:18.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.081+0000 7fbdd520e800 20 remove_watcher() i=3 2024-09-12T00:27:18.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.082+0000 7fbdd520e800 20 remove_watcher() i=4 2024-09-12T00:27:18.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.083+0000 7fbdd520e800 20 remove_watcher() i=5 2024-09-12T00:27:18.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.084+0000 7fbdd520e800 20 remove_watcher() i=6 2024-09-12T00:27:18.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.085+0000 7fbdd520e800 20 remove_watcher() i=7 2024-09-12T00:27:18.095 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 3753706806 --totp-seed NTKA4HL3SEVF64MKITNBQZC24RGHWJ3MOVYYAVKN6ZDU7FTV7MNAMCJ33KF6XNYW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:27:18.163 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:18.163 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:18.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.201+0000 7f5a51e40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.203+0000 7f5a51e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.203+0000 7f5a51e40800 20 realm 2024-09-12T00:27:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.203+0000 7f5a51e40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.203+0000 7f5a51e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.203+0000 7f5a51e40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.203+0000 7f5a51e40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.203+0000 7f5a51e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.203+0000 7f5a51e40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.204+0000 7f5a51e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:18.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.204+0000 7f5a51e40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.205+0000 7f5a51e40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:18.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.205+0000 7f5a51e40800 20 searching for the correct realm 2024-09-12T00:27:18.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.207+0000 7f5a4f92a640 0 -- 172.21.15.67:0/2342660282 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f5a40001000 msgr2=0x7f5a4008d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:18.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.412+0000 7f5a4f92a640 0 -- 172.21.15.67:0/2342660282 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f5a480d7040 msgr2=0x7f5a480a3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.634+0000 7f5a51e40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.634+0000 7f5a51e40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.634+0000 7f5a51e40800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:18.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.634+0000 7f5a51e40800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:18.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.634+0000 7f5a51e40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:18.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.634+0000 7f5a51e40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:18.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.634+0000 7f5a51e40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.634+0000 7f5a51e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.634+0000 7f5a51e40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.635+0000 7f5a51e40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:18.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.635+0000 7f5a51e40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.635+0000 7f5a51e40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.635+0000 7f5a51e40800 20 zone default found 2024-09-12T00:27:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.635+0000 7f5a51e40800 4 Realm: () 2024-09-12T00:27:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.635+0000 7f5a51e40800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.635+0000 7f5a51e40800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.635+0000 7f5a51e40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.635+0000 7f5a51e40800 20 zonegroup default 2024-09-12T00:27:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.635+0000 7f5a51e40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.635+0000 7f5a51e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.635+0000 7f5a51e40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.636+0000 7f5a51e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.636+0000 7f5a51e40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.636+0000 7f5a51e40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.636+0000 7f5a51e40800 20 started sync module instance, tier type = 2024-09-12T00:27:18.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.636+0000 7f5a51e40800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:18.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.649+0000 7f5a51e40800 20 add_watcher() i=0 2024-09-12T00:27:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.649+0000 7f5a51e40800 20 add_watcher() i=1 2024-09-12T00:27:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.649+0000 7f5a51e40800 20 add_watcher() i=2 2024-09-12T00:27:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.649+0000 7f5a51e40800 20 add_watcher() i=3 2024-09-12T00:27:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.649+0000 7f5a51e40800 20 add_watcher() i=4 2024-09-12T00:27:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.649+0000 7f5a51e40800 20 add_watcher() i=5 2024-09-12T00:27:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.649+0000 7f5a51e40800 20 add_watcher() i=6 2024-09-12T00:27:18.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.650+0000 7f5a51e40800 20 add_watcher() i=7 2024-09-12T00:27:18.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.650+0000 7f5a51e40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:18.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.652+0000 7f5905fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:18.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.652+0000 7f5a51e40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:18.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.652+0000 7f5a51e40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.652+0000 7f5a51e40800 5 note: GC not initialized 2024-09-12T00:27:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.653+0000 7f5904fe1640 20 reqs_thread_entry: start 2024-09-12T00:27:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.653+0000 7f5a51e40800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:18.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.653+0000 7f5a51e40800 20 Filter name: none 2024-09-12T00:27:18.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.653+0000 7f587e7fc640 20 reqs_thread_entry: start 2024-09-12T00:27:18.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.653+0000 7f5a51e40800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:27:18.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.653+0000 7f5a51e40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.653+0000 7f5a51e40800 20 rados_obj.operate() r=0 bl.length=519 2024-09-12T00:27:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.653+0000 7f5a51e40800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T00:27:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.653+0000 7f5a51e40800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:27:18.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.653+0000 7f5a51e40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:18.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.656+0000 7f5a51e40800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:27:18.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.656+0000 7f5a51e40800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:27:18.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.656+0000 7f5a51e40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:27:18.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.656+0000 7f592effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464563 cookie 93977733466320 notifier 8519 bl.length()=733 2024-09-12T00:27:18.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.656+0000 7f592effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:27:18.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.656+0000 7f592effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:27:18.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.658+0000 7f5905fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:18.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.660+0000 7f5a51e40800 20 remove_watcher() i=0 2024-09-12T00:27:18.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.660+0000 7f5a51e40800 2 removed watcher, disabling cache 2024-09-12T00:27:18.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.661+0000 7f5a51e40800 20 remove_watcher() i=1 2024-09-12T00:27:18.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.662+0000 7f5a51e40800 20 remove_watcher() i=2 2024-09-12T00:27:18.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.663+0000 7f5a51e40800 20 remove_watcher() i=3 2024-09-12T00:27:18.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.664+0000 7f5a51e40800 20 remove_watcher() i=4 2024-09-12T00:27:18.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.665+0000 7f5a51e40800 20 remove_watcher() i=5 2024-09-12T00:27:18.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.666+0000 7f5a51e40800 20 remove_watcher() i=6 2024-09-12T00:27:18.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.667+0000 7f5a51e40800 20 remove_watcher() i=7 2024-09-12T00:27:18.679 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T00:27:18.679 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key KWDFNSUHAHQTPKJZHAJH --secret 4HDZ5bBtst+hCMN7LLnDCUMzhkQOOqIz9xn3Qky0axzMZMUH/GI3PQ== --cluster ceph 2024-09-12T00:27:18.745 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:18.746 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:18.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.782+0000 7fca26c14800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.784+0000 7fca26c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.784+0000 7fca26c14800 20 realm 2024-09-12T00:27:18.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.784+0000 7fca26c14800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.784+0000 7fca26c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.784+0000 7fca26c14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:18.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.784+0000 7fca26c14800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.784+0000 7fca26c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:18.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.784+0000 7fca26c14800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.785+0000 7fca26c14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:18.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.785+0000 7fca26c14800 20 rados->read ofs=0 len=0 2024-09-12T00:27:18.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.786+0000 7fca26c14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:18.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.786+0000 7fca26c14800 20 searching for the correct realm 2024-09-12T00:27:18.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.789+0000 7fca21aca640 0 -- 172.21.15.67:0/3230131486 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fca18064440 msgr2=0x7fca180648a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:18.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:18.995+0000 7fca22acc640 0 -- 172.21.15.67:0/3230131486 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55e0f292cc10 msgr2=0x55e0f292f0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:19.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.000+0000 7fca26c14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:19.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.000+0000 7fca26c14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:19.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.000+0000 7fca26c14800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:19.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.000+0000 7fca26c14800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:19.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.000+0000 7fca26c14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:19.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.000+0000 7fca26c14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:19.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.000+0000 7fca26c14800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.000+0000 7fca26c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.000+0000 7fca26c14800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.000+0000 7fca26c14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:19.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.000+0000 7fca26c14800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.001+0000 7fca26c14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:19.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.001+0000 7fca26c14800 20 zone default found 2024-09-12T00:27:19.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.001+0000 7fca26c14800 4 Realm: () 2024-09-12T00:27:19.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.001+0000 7fca26c14800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:19.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.001+0000 7fca26c14800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:19.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.001+0000 7fca26c14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:19.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.001+0000 7fca26c14800 20 zonegroup default 2024-09-12T00:27:19.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.001+0000 7fca26c14800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.001+0000 7fca26c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.001+0000 7fca26c14800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.001+0000 7fca26c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.001+0000 7fca26c14800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.001+0000 7fca26c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.001+0000 7fca26c14800 20 started sync module instance, tier type = 2024-09-12T00:27:19.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.001+0000 7fca26c14800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:19.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.011+0000 7fca26c14800 20 add_watcher() i=0 2024-09-12T00:27:19.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.011+0000 7fca26c14800 20 add_watcher() i=1 2024-09-12T00:27:19.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.011+0000 7fca26c14800 20 add_watcher() i=2 2024-09-12T00:27:19.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.011+0000 7fca26c14800 20 add_watcher() i=3 2024-09-12T00:27:19.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.011+0000 7fca26c14800 20 add_watcher() i=4 2024-09-12T00:27:19.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.011+0000 7fca26c14800 20 add_watcher() i=5 2024-09-12T00:27:19.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.011+0000 7fca26c14800 20 add_watcher() i=6 2024-09-12T00:27:19.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.012+0000 7fca26c14800 20 add_watcher() i=7 2024-09-12T00:27:19.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.012+0000 7fca26c14800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:19.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.014+0000 7fc8d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:19.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.014+0000 7fca26c14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:19.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.014+0000 7fca26c14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.014+0000 7fca26c14800 5 note: GC not initialized 2024-09-12T00:27:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.014+0000 7fc8537fe640 20 reqs_thread_entry: start 2024-09-12T00:27:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.015+0000 7fca26c14800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.015+0000 7fca26c14800 20 Filter name: none 2024-09-12T00:27:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.015+0000 7fc8517fa640 20 reqs_thread_entry: start 2024-09-12T00:27:19.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.015+0000 7fca26c14800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:27:19.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.015+0000 7fca26c14800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.015+0000 7fca26c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.015+0000 7fca26c14800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T00:27:19.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.015+0000 7fca26c14800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:27:19.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.015+0000 7fca26c14800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T00:27:19.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.015+0000 7fca26c14800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.015+0000 7fca26c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.015+0000 7fca26c14800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T00:27:19.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.015+0000 7fca26c14800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:27:19.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.015+0000 7fca26c14800 10 cache get: name=default.rgw.meta+users.keys+KWDFNSUHAHQTPKJZHAJH : miss 2024-09-12T00:27:19.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.015+0000 7fca26c14800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.016+0000 7fca26c14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.016+0000 7fca26c14800 10 cache put: name=default.rgw.meta+users.keys+KWDFNSUHAHQTPKJZHAJH info.flags=0x0 2024-09-12T00:27:19.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.016+0000 7fca26c14800 10 adding default.rgw.meta+users.keys+KWDFNSUHAHQTPKJZHAJH to cache LRU end 2024-09-12T00:27:19.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.016+0000 7fca26c14800 10 cache get: name=default.rgw.meta+users.keys+KWDFNSUHAHQTPKJZHAJH : hit (negative entry) 2024-09-12T00:27:19.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.016+0000 7fca26c14800 10 cache get: name=default.rgw.meta+users.keys+KWDFNSUHAHQTPKJZHAJH : hit (negative entry) 2024-09-12T00:27:19.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.017+0000 7fca26c14800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:27:19.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.017+0000 7fca26c14800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:27:19.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.017+0000 7fca26c14800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:27:19.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.018+0000 7fc905ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464564 cookie 94424630800704 notifier 9150 bl.length()=660 2024-09-12T00:27:19.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.018+0000 7fc905ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:27:19.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.018+0000 7fc905ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:27:19.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.019+0000 7fca26c14800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:27:19.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.019+0000 7fca26c14800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:27:19.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.019+0000 7fca26c14800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T00:27:19.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.019+0000 7fc905ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464501 cookie 94424630748304 notifier 9150 bl.length()=191 2024-09-12T00:27:19.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.019+0000 7fc905ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:27:19.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.019+0000 7fc905ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:27:19.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.021+0000 7fca26c14800 10 cache put: name=default.rgw.meta+users.keys+KWDFNSUHAHQTPKJZHAJH info.flags=0x7 2024-09-12T00:27:19.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.021+0000 7fca26c14800 10 moving default.rgw.meta+users.keys+KWDFNSUHAHQTPKJZHAJH to cache LRU end 2024-09-12T00:27:19.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.021+0000 7fca26c14800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:KWDFNSUHAHQTPKJZHAJH, ofs0, ns] 2024-09-12T00:27:19.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.022+0000 7fc905ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464502 cookie 94424630802272 notifier 9150 bl.length()=189 2024-09-12T00:27:19.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.022+0000 7fc905ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KWDFNSUHAHQTPKJZHAJH info.flags=0x7 2024-09-12T00:27:19.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.022+0000 7fc905ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KWDFNSUHAHQTPKJZHAJH to cache LRU end 2024-09-12T00:27:19.023 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:27:19.023 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "foobar.client.0", 2024-09-12T00:27:19.023 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:27:19.023 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "foobar+test@test.test", 2024-09-12T00:27:19.023 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T00:27:19.023 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:27:19.023 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T00:27:19.023 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T00:27:19.023 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T00:27:19.024 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "foobar.client.0", 2024-09-12T00:27:19.024 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "KWDFNSUHAHQTPKJZHAJH", 2024-09-12T00:27:19.024 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "4HDZ5bBtst+hCMN7LLnDCUMzhkQOOqIz9xn3Qky0axzMZMUH/GI3PQ==", 2024-09-12T00:27:19.024 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T00:27:19.024 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:27:19.017843Z" 2024-09-12T00:27:19.024 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T00:27:19.024 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T00:27:19.024 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T00:27:19.024 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T00:27:19.025 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T00:27:19.025 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T00:27:19.025 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T00:27:19.025 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T00:27:19.025 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T00:27:19.025 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:19.025 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:19.025 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:19.025 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:19.025 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:19.025 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:19.025 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T00:27:19.025 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:19.026 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:19.026 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:19.026 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:19.026 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:19.026 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:19.026 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T00:27:19.026 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "rgw", 2024-09-12T00:27:19.026 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T00:27:19.026 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "", 2024-09-12T00:27:19.026 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T00:27:19.026 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:27:19.017831Z", 2024-09-12T00:27:19.026 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T00:27:19.026 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T00:27:19.026 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:27:19.027 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:19.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.023+0000 7fc8d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:19.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.025+0000 7fca26c14800 20 remove_watcher() i=0 2024-09-12T00:27:19.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.025+0000 7fca26c14800 2 removed watcher, disabling cache 2024-09-12T00:27:19.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.026+0000 7fca26c14800 20 remove_watcher() i=1 2024-09-12T00:27:19.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.027+0000 7fca26c14800 20 remove_watcher() i=2 2024-09-12T00:27:19.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.028+0000 7fca26c14800 20 remove_watcher() i=3 2024-09-12T00:27:19.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.029+0000 7fca26c14800 20 remove_watcher() i=4 2024-09-12T00:27:19.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.030+0000 7fca26c14800 20 remove_watcher() i=5 2024-09-12T00:27:19.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.031+0000 7fca26c14800 20 remove_watcher() i=6 2024-09-12T00:27:19.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.032+0000 7fca26c14800 20 remove_watcher() i=7 2024-09-12T00:27:19.042 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 4693831570 --totp-seed NRK3FRWNVQOCHKOKVWCJ4HA3VRPOQFTNXMWHQF2UVHDY55EVII7OWNL5TJFCQBLJ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:27:19.110 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:19.110 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:19.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.147+0000 7fe950721800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.149+0000 7fe950721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.149+0000 7fe950721800 20 realm 2024-09-12T00:27:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.149+0000 7fe950721800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.150+0000 7fe950721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.150+0000 7fe950721800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:19.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.150+0000 7fe950721800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.150+0000 7fe950721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.150 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.150+0000 7fe950721800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.150+0000 7fe950721800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:19.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.150+0000 7fe950721800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.151+0000 7fe950721800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:19.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.151+0000 7fe950721800 20 searching for the correct realm 2024-09-12T00:27:19.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.155+0000 7fe94bc0b640 0 -- 172.21.15.67:0/746150321 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fe94000b040 msgr2=0x7fe940092990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:19.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.158+0000 7fe94c40c640 0 -- 172.21.15.67:0/746150321 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fe9440a9250 msgr2=0x7fe9440a3b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:19.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.163+0000 7fe950721800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:19.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.163+0000 7fe950721800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:19.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.163+0000 7fe950721800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:19.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.163+0000 7fe950721800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:19.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.163+0000 7fe950721800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:19.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.163+0000 7fe950721800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:19.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.163+0000 7fe950721800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.163+0000 7fe950721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.163+0000 7fe950721800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.163+0000 7fe950721800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:19.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.163+0000 7fe950721800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.164+0000 7fe950721800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:19.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.164+0000 7fe950721800 20 zone default found 2024-09-12T00:27:19.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.164+0000 7fe950721800 4 Realm: () 2024-09-12T00:27:19.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.164+0000 7fe950721800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:19.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.164+0000 7fe950721800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:19.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.164+0000 7fe950721800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:19.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.164+0000 7fe950721800 20 zonegroup default 2024-09-12T00:27:19.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.164+0000 7fe950721800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.164+0000 7fe950721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.164+0000 7fe950721800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.164+0000 7fe950721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.164+0000 7fe950721800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.165+0000 7fe950721800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.165+0000 7fe950721800 20 started sync module instance, tier type = 2024-09-12T00:27:19.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.165+0000 7fe950721800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:19.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.173+0000 7fe950721800 20 add_watcher() i=0 2024-09-12T00:27:19.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.173+0000 7fe950721800 20 add_watcher() i=1 2024-09-12T00:27:19.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.173+0000 7fe950721800 20 add_watcher() i=2 2024-09-12T00:27:19.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.173+0000 7fe950721800 20 add_watcher() i=3 2024-09-12T00:27:19.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.173+0000 7fe950721800 20 add_watcher() i=4 2024-09-12T00:27:19.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.173+0000 7fe950721800 20 add_watcher() i=5 2024-09-12T00:27:19.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.173+0000 7fe950721800 20 add_watcher() i=6 2024-09-12T00:27:19.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.174+0000 7fe950721800 20 add_watcher() i=7 2024-09-12T00:27:19.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.174+0000 7fe950721800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:19.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.176+0000 7fe802fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:19.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.176+0000 7fe950721800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:19.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.176+0000 7fe950721800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:19.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.176+0000 7fe950721800 5 note: GC not initialized 2024-09-12T00:27:19.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.176+0000 7fe801fdb640 20 reqs_thread_entry: start 2024-09-12T00:27:19.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.177+0000 7fe950721800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:19.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.177+0000 7fe950721800 20 Filter name: none 2024-09-12T00:27:19.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.177+0000 7fe7737fe640 20 reqs_thread_entry: start 2024-09-12T00:27:19.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.177+0000 7fe950721800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:27:19.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.177+0000 7fe950721800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.178+0000 7fe950721800 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T00:27:19.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.178+0000 7fe950721800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:27:19.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.178+0000 7fe950721800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:27:19.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.178+0000 7fe950721800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:19.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.180+0000 7fe950721800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:27:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.180+0000 7fe950721800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:27:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.180+0000 7fe950721800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:27:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.180+0000 7fe8237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464565 cookie 94314540726480 notifier 9168 bl.length()=674 2024-09-12T00:27:19.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.180+0000 7fe8237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:27:19.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.180+0000 7fe8237fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:27:19.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.182+0000 7fe802fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:19.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.184+0000 7fe950721800 20 remove_watcher() i=0 2024-09-12T00:27:19.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.184+0000 7fe950721800 2 removed watcher, disabling cache 2024-09-12T00:27:19.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.185+0000 7fe950721800 20 remove_watcher() i=1 2024-09-12T00:27:19.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.186+0000 7fe950721800 20 remove_watcher() i=2 2024-09-12T00:27:19.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.188+0000 7fe950721800 20 remove_watcher() i=3 2024-09-12T00:27:19.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.189+0000 7fe950721800 20 remove_watcher() i=4 2024-09-12T00:27:19.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.190+0000 7fe950721800 20 remove_watcher() i=5 2024-09-12T00:27:19.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.191+0000 7fe950721800 20 remove_watcher() i=6 2024-09-12T00:27:19.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.192+0000 7fe950721800 20 remove_watcher() i=7 2024-09-12T00:27:19.203 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T00:27:19.263 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:19.264 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:19.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.300+0000 7f69ba040800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.302+0000 7f69ba040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.302+0000 7f69ba040800 20 realm 2024-09-12T00:27:19.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.302+0000 7f69ba040800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.302+0000 7f69ba040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.302+0000 7f69ba040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:19.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.302+0000 7f69ba040800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.302+0000 7f69ba040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.302+0000 7f69ba040800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.303+0000 7f69ba040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:19.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.303+0000 7f69ba040800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.304+0000 7f69ba040800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:19.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.304+0000 7f69ba040800 20 searching for the correct realm 2024-09-12T00:27:19.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.307+0000 7f69b7329640 0 -- 172.21.15.67:0/2583839438 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f69ac0be0f0 msgr2=0x7f69ac0c69e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:19.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.310+0000 7f69b7b2a640 0 -- 172.21.15.67:0/2583839438 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f69b0025040 msgr2=0x7f69b0025420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:19.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.314+0000 7f69ba040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:19.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.314+0000 7f69ba040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:19.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.314+0000 7f69ba040800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:19.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.314+0000 7f69ba040800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:19.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.314+0000 7f69ba040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:19.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.314+0000 7f69ba040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:19.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.314+0000 7f69ba040800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.314+0000 7f69ba040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.314+0000 7f69ba040800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.315+0000 7f69ba040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:19.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.315+0000 7f69ba040800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.315+0000 7f69ba040800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:19.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.315+0000 7f69ba040800 20 zone default found 2024-09-12T00:27:19.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.315+0000 7f69ba040800 4 Realm: () 2024-09-12T00:27:19.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.315+0000 7f69ba040800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:19.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.315+0000 7f69ba040800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:19.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.315+0000 7f69ba040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:19.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.315+0000 7f69ba040800 20 zonegroup default 2024-09-12T00:27:19.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.315+0000 7f69ba040800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.315+0000 7f69ba040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.315+0000 7f69ba040800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.316+0000 7f69ba040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.316+0000 7f69ba040800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.316+0000 7f69ba040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.316+0000 7f69ba040800 20 started sync module instance, tier type = 2024-09-12T00:27:19.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.316+0000 7f69ba040800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:19.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.325+0000 7f69ba040800 20 add_watcher() i=0 2024-09-12T00:27:19.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.325+0000 7f69ba040800 20 add_watcher() i=1 2024-09-12T00:27:19.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.325+0000 7f69ba040800 20 add_watcher() i=2 2024-09-12T00:27:19.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.325+0000 7f69ba040800 20 add_watcher() i=3 2024-09-12T00:27:19.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.325+0000 7f69ba040800 20 add_watcher() i=4 2024-09-12T00:27:19.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.325+0000 7f69ba040800 20 add_watcher() i=5 2024-09-12T00:27:19.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.325+0000 7f69ba040800 20 add_watcher() i=6 2024-09-12T00:27:19.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.326+0000 7f69ba040800 20 add_watcher() i=7 2024-09-12T00:27:19.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.326+0000 7f69ba040800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:19.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.328+0000 7f686dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:19.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.328+0000 7f69ba040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:19.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.328+0000 7f69ba040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:19.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.328+0000 7f69ba040800 5 note: GC not initialized 2024-09-12T00:27:19.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.328+0000 7f686cfe1640 20 reqs_thread_entry: start 2024-09-12T00:27:19.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.328+0000 7f69ba040800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:19.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.328+0000 7f69ba040800 20 Filter name: none 2024-09-12T00:27:19.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.328+0000 7f67e67fc640 20 reqs_thread_entry: start 2024-09-12T00:27:19.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.328+0000 7f69ba040800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:27:19.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.328+0000 7f69ba040800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.329+0000 7f69ba040800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:27:19.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.329+0000 7f69ba040800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:27:19.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.329+0000 7f69ba040800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:27:19.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.329+0000 7f69ba040800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:19.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.330+0000 7f69ba040800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:27:19.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.330+0000 7f69ba040800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:27:19.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.330+0000 7f69ba040800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:27:19.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.331+0000 7f6896ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464566 cookie 94347757174880 notifier 9183 bl.length()=727 2024-09-12T00:27:19.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.331+0000 7f6896ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:27:19.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.331+0000 7f6896ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:27:19.331 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:27:19.332 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "foobar.client.0", 2024-09-12T00:27:19.332 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:27:19.332 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "foobar+test@test.test", 2024-09-12T00:27:19.332 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T00:27:19.332 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:27:19.332 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T00:27:19.332 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T00:27:19.332 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T00:27:19.332 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "foobar.client.0", 2024-09-12T00:27:19.332 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "KWDFNSUHAHQTPKJZHAJH", 2024-09-12T00:27:19.332 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "4HDZ5bBtst+hCMN7LLnDCUMzhkQOOqIz9xn3Qky0axzMZMUH/GI3PQ==", 2024-09-12T00:27:19.332 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T00:27:19.333 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:27:19.017843Z" 2024-09-12T00:27:19.333 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T00:27:19.333 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T00:27:19.333 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T00:27:19.333 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [ 2024-09-12T00:27:19.333 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T00:27:19.333 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "oidc-provider", 2024-09-12T00:27:19.333 INFO:teuthology.orchestra.run.smithi067.stdout: "perm": "*" 2024-09-12T00:27:19.333 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:19.333 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T00:27:19.333 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "roles", 2024-09-12T00:27:19.333 INFO:teuthology.orchestra.run.smithi067.stdout: "perm": "*" 2024-09-12T00:27:19.333 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:19.333 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T00:27:19.334 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "user-policy", 2024-09-12T00:27:19.334 INFO:teuthology.orchestra.run.smithi067.stdout: "perm": "*" 2024-09-12T00:27:19.334 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T00:27:19.334 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T00:27:19.334 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T00:27:19.334 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T00:27:19.334 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T00:27:19.335 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T00:27:19.335 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T00:27:19.335 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:19.335 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:19.335 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:19.335 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:19.335 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:19.335 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:19.335 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T00:27:19.335 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:19.335 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:19.335 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:19.335 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:19.335 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:19.336 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:19.336 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T00:27:19.336 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "rgw", 2024-09-12T00:27:19.336 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [ 2024-09-12T00:27:19.336 INFO:teuthology.orchestra.run.smithi067.stdout: "4693831570" 2024-09-12T00:27:19.336 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T00:27:19.336 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "", 2024-09-12T00:27:19.336 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T00:27:19.336 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:27:19.017831Z", 2024-09-12T00:27:19.337 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T00:27:19.337 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T00:27:19.337 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:27:19.337 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.332+0000 7f686dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.334+0000 7f69ba040800 20 remove_watcher() i=0 2024-09-12T00:27:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.334+0000 7f69ba040800 2 removed watcher, disabling cache 2024-09-12T00:27:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.335+0000 7f69ba040800 20 remove_watcher() i=1 2024-09-12T00:27:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.336+0000 7f69ba040800 20 remove_watcher() i=2 2024-09-12T00:27:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.337+0000 7f69ba040800 20 remove_watcher() i=3 2024-09-12T00:27:19.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.338+0000 7f69ba040800 20 remove_watcher() i=4 2024-09-12T00:27:19.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.339+0000 7f69ba040800 20 remove_watcher() i=5 2024-09-12T00:27:19.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.340+0000 7f69ba040800 20 remove_watcher() i=6 2024-09-12T00:27:19.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.341+0000 7f69ba040800 20 remove_watcher() i=7 2024-09-12T00:27:19.351 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T00:27:19.413 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:19.413 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:19.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.450+0000 7f376cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.451+0000 7f376cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.451+0000 7f376cd2e800 20 realm 2024-09-12T00:27:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.451+0000 7f376cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.451+0000 7f376cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.451+0000 7f376cd2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.451+0000 7f376cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.452+0000 7f376cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.452+0000 7f376cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.452+0000 7f376cd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:19.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.452+0000 7f376cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.453+0000 7f376cd2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:19.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.453+0000 7f376cd2e800 20 searching for the correct realm 2024-09-12T00:27:19.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.456+0000 7f3768163640 0 -- 172.21.15.67:0/3850332331 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f375c037970 msgr2=0x7f375c066e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:19.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.661+0000 7f3769165640 0 -- 172.21.15.67:0/3850332331 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x558a036d4e10 msgr2=0x558a036d72d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:19.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.665+0000 7f376cd2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:19.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.665+0000 7f376cd2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:19.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.665+0000 7f376cd2e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:19.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.665+0000 7f376cd2e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:19.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.665+0000 7f376cd2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:19.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.665+0000 7f376cd2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:19.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.665+0000 7f376cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.666+0000 7f376cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.666+0000 7f376cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.666+0000 7f376cd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.666+0000 7f376cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.666+0000 7f376cd2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.666+0000 7f376cd2e800 20 zone default found 2024-09-12T00:27:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.666+0000 7f376cd2e800 4 Realm: () 2024-09-12T00:27:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.666+0000 7f376cd2e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.666+0000 7f376cd2e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.666+0000 7f376cd2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:19.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.666+0000 7f376cd2e800 20 zonegroup default 2024-09-12T00:27:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.666+0000 7f376cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.666+0000 7f376cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.666+0000 7f376cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.667+0000 7f376cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.667+0000 7f376cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.667+0000 7f376cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.667+0000 7f376cd2e800 20 started sync module instance, tier type = 2024-09-12T00:27:19.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.667+0000 7f376cd2e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:19.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.676+0000 7f376cd2e800 20 add_watcher() i=0 2024-09-12T00:27:19.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.676+0000 7f376cd2e800 20 add_watcher() i=1 2024-09-12T00:27:19.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.676+0000 7f376cd2e800 20 add_watcher() i=2 2024-09-12T00:27:19.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.676+0000 7f376cd2e800 20 add_watcher() i=3 2024-09-12T00:27:19.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.676+0000 7f376cd2e800 20 add_watcher() i=4 2024-09-12T00:27:19.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.676+0000 7f376cd2e800 20 add_watcher() i=5 2024-09-12T00:27:19.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.676+0000 7f376cd2e800 20 add_watcher() i=6 2024-09-12T00:27:19.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.677+0000 7f376cd2e800 20 add_watcher() i=7 2024-09-12T00:27:19.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.677+0000 7f376cd2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:19.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.678+0000 7f361f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:19.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.678+0000 7f376cd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:19.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.678+0000 7f376cd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:19.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.678+0000 7f376cd2e800 5 note: GC not initialized 2024-09-12T00:27:19.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.679+0000 7f361e7e4640 20 reqs_thread_entry: start 2024-09-12T00:27:19.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.679+0000 7f376cd2e800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:19.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.679+0000 7f376cd2e800 20 Filter name: none 2024-09-12T00:27:19.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.679+0000 7f36177fe640 20 reqs_thread_entry: start 2024-09-12T00:27:19.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.679+0000 7f376cd2e800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T00:27:19.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.679+0000 7f376cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.679+0000 7f376cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.679+0000 7f376cd2e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T00:27:19.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.679+0000 7f376cd2e800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:27:19.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.679+0000 7f376cd2e800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T00:27:19.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.679+0000 7f376cd2e800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T00:27:19.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.679+0000 7f376cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.680+0000 7f376cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.680+0000 7f376cd2e800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T00:27:19.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.680+0000 7f376cd2e800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:27:19.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.680+0000 7f376cd2e800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T00:27:19.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.681+0000 7f376cd2e800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:27:19.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.681+0000 7f376cd2e800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:27:19.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.681+0000 7f376cd2e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T00:27:19.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.681+0000 7f363ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464503 cookie 94051251349184 notifier 8588 bl.length()=384 2024-09-12T00:27:19.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.681+0000 7f363ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:27:19.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.681+0000 7f363ffff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:27:19.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.682+0000 7f376cd2e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:27:19.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.682+0000 7f376cd2e800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:27:19.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.682+0000 7f376cd2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T00:27:19.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.683+0000 7f363ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464504 cookie 94051251404144 notifier 8588 bl.length()=225 2024-09-12T00:27:19.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.683+0000 7f363ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:27:19.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.683+0000 7f363ffff640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:27:19.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.684+0000 7f376cd2e800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:27:19.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.684+0000 7f376cd2e800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:27:19.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.684+0000 7f376cd2e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T00:27:19.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.685+0000 7f363f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464340 cookie 94051251395072 notifier 8588 bl.length()=234 2024-09-12T00:27:19.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.685+0000 7f363f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:27:19.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.685+0000 7f363f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:27:19.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.686+0000 7f361f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:19.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.688+0000 7f376cd2e800 20 remove_watcher() i=0 2024-09-12T00:27:19.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.688+0000 7f376cd2e800 2 removed watcher, disabling cache 2024-09-12T00:27:19.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.689+0000 7f376cd2e800 20 remove_watcher() i=1 2024-09-12T00:27:19.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.690+0000 7f376cd2e800 20 remove_watcher() i=2 2024-09-12T00:27:19.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.691+0000 7f376cd2e800 20 remove_watcher() i=3 2024-09-12T00:27:19.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.692+0000 7f376cd2e800 20 remove_watcher() i=4 2024-09-12T00:27:19.692 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.693+0000 7f376cd2e800 20 remove_watcher() i=5 2024-09-12T00:27:19.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.694+0000 7f376cd2e800 20 remove_watcher() i=6 2024-09-12T00:27:19.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.695+0000 7f376cd2e800 20 remove_watcher() i=7 2024-09-12T00:27:19.704 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:27:19.704 INFO:teuthology.orchestra.run.smithi067.stdout: "id": "RGW88888888888888888", 2024-09-12T00:27:19.704 INFO:teuthology.orchestra.run.smithi067.stdout: "tenant": "", 2024-09-12T00:27:19.704 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T00:27:19.704 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T00:27:19.704 INFO:teuthology.orchestra.run.smithi067.stdout: "quota": { 2024-09-12T00:27:19.705 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:19.705 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:19.705 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:19.705 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:19.705 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:19.705 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:19.705 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T00:27:19.705 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:19.705 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:19.705 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:19.705 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:19.705 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:19.705 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:19.705 INFO:teuthology.orchestra.run.smithi067.stdout: "max_users": 1000, 2024-09-12T00:27:19.706 INFO:teuthology.orchestra.run.smithi067.stdout: "max_roles": 1000, 2024-09-12T00:27:19.706 INFO:teuthology.orchestra.run.smithi067.stdout: "max_groups": 1000, 2024-09-12T00:27:19.706 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:27:19.706 INFO:teuthology.orchestra.run.smithi067.stdout: "max_access_keys": 4 2024-09-12T00:27:19.706 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:27:19.707 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T00:27:19.707 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key BDHFMURSHWSZEOTWHSPF --secret O0DFpP8/YTdUPHfG2G7gUYlWxXWyVFp9qxNHWEIXj45EVt0WrmH5rg== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T00:27:19.776 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:19.776 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:19.812 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.813+0000 7fe85072c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.815+0000 7fe85072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.815+0000 7fe85072c800 20 realm 2024-09-12T00:27:19.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.815+0000 7fe85072c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.815+0000 7fe85072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.815+0000 7fe85072c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:19.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.815+0000 7fe85072c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.815+0000 7fe85072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:19.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.815+0000 7fe85072c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.816+0000 7fe85072c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:19.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.816+0000 7fe85072c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:19.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.817+0000 7fe85072c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:19.816 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.817+0000 7fe85072c800 20 searching for the correct realm 2024-09-12T00:27:19.819 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:19.820+0000 7fe84bb60640 0 -- 172.21.15.67:0/1564209037 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fe8340c2030 msgr2=0x7fe8340a9a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:20.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.024+0000 7fe84cb62640 0 -- 172.21.15.67:0/1564209037 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55899bd582f0 msgr2=0x55899bd5a760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:20.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.028+0000 7fe85072c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:20.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.028+0000 7fe85072c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:20.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.028+0000 7fe85072c800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:20.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.028+0000 7fe85072c800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:20.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.028+0000 7fe85072c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:20.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.028+0000 7fe85072c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:20.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.028+0000 7fe85072c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.029+0000 7fe85072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.029+0000 7fe85072c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.029+0000 7fe85072c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:20.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.029+0000 7fe85072c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.029+0000 7fe85072c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:20.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.029+0000 7fe85072c800 20 zone default found 2024-09-12T00:27:20.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.029+0000 7fe85072c800 4 Realm: () 2024-09-12T00:27:20.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.029+0000 7fe85072c800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:20.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.029+0000 7fe85072c800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:20.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.029+0000 7fe85072c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:20.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.029+0000 7fe85072c800 20 zonegroup default 2024-09-12T00:27:20.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.029+0000 7fe85072c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.030+0000 7fe85072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.030+0000 7fe85072c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.030+0000 7fe85072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.030+0000 7fe85072c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.030+0000 7fe85072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.030+0000 7fe85072c800 20 started sync module instance, tier type = 2024-09-12T00:27:20.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.030+0000 7fe85072c800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:20.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.039+0000 7fe85072c800 20 add_watcher() i=0 2024-09-12T00:27:20.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.039+0000 7fe85072c800 20 add_watcher() i=1 2024-09-12T00:27:20.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.039+0000 7fe85072c800 20 add_watcher() i=2 2024-09-12T00:27:20.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.039+0000 7fe85072c800 20 add_watcher() i=3 2024-09-12T00:27:20.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.039+0000 7fe85072c800 20 add_watcher() i=4 2024-09-12T00:27:20.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.039+0000 7fe85072c800 20 add_watcher() i=5 2024-09-12T00:27:20.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.039+0000 7fe85072c800 20 add_watcher() i=6 2024-09-12T00:27:20.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.040+0000 7fe85072c800 20 add_watcher() i=7 2024-09-12T00:27:20.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.040+0000 7fe85072c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:20.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.042+0000 7fe702fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:20.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.042+0000 7fe85072c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:20.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.042+0000 7fe85072c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:20.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.042+0000 7fe85072c800 5 note: GC not initialized 2024-09-12T00:27:20.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.042+0000 7fe701fe3640 20 reqs_thread_entry: start 2024-09-12T00:27:20.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.042+0000 7fe85072c800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:20.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.042+0000 7fe85072c800 20 Filter name: none 2024-09-12T00:27:20.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.043+0000 7fe6faffd640 20 reqs_thread_entry: start 2024-09-12T00:27:20.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.043+0000 7fe85072c800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:27:20.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.043+0000 7fe85072c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.043+0000 7fe85072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.043+0000 7fe85072c800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T00:27:20.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.043+0000 7fe85072c800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:27:20.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.043+0000 7fe85072c800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T00:27:20.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.043+0000 7fe85072c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.043+0000 7fe85072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.043+0000 7fe85072c800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T00:27:20.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.043+0000 7fe85072c800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:27:20.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.043+0000 7fe85072c800 10 cache get: name=default.rgw.meta+users.keys+BDHFMURSHWSZEOTWHSPF : miss 2024-09-12T00:27:20.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.043+0000 7fe85072c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.044+0000 7fe85072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.044+0000 7fe85072c800 10 cache put: name=default.rgw.meta+users.keys+BDHFMURSHWSZEOTWHSPF info.flags=0x0 2024-09-12T00:27:20.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.044+0000 7fe85072c800 10 adding default.rgw.meta+users.keys+BDHFMURSHWSZEOTWHSPF to cache LRU end 2024-09-12T00:27:20.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.044+0000 7fe85072c800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T00:27:20.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.044+0000 7fe85072c800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.044+0000 7fe85072c800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:27:20.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.044+0000 7fe85072c800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:27:20.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.044+0000 7fe85072c800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:27:20.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.044+0000 7fe85072c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:20.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.044+0000 7fe85072c800 10 cache get: name=default.rgw.meta+users.keys+BDHFMURSHWSZEOTWHSPF : hit (negative entry) 2024-09-12T00:27:20.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.044+0000 7fe85072c800 10 cache get: name=default.rgw.meta+users.keys+BDHFMURSHWSZEOTWHSPF : hit (negative entry) 2024-09-12T00:27:20.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.046+0000 7fe85072c800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:27:20.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.046+0000 7fe85072c800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:27:20.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.046+0000 7fe85072c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:27:20.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.046+0000 7fe72b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464505 cookie 94049513395792 notifier 8606 bl.length()=681 2024-09-12T00:27:20.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.046+0000 7fe72b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:27:20.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.046+0000 7fe72b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:27:20.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.047+0000 7fe85072c800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:27:20.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.047+0000 7fe85072c800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:27:20.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.047+0000 7fe85072c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T00:27:20.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.048+0000 7fe72b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464567 cookie 94049513406576 notifier 8606 bl.length()=189 2024-09-12T00:27:20.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.048+0000 7fe72b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:27:20.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.048+0000 7fe72b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:27:20.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.050+0000 7fe85072c800 10 cache put: name=default.rgw.meta+users.keys+BDHFMURSHWSZEOTWHSPF info.flags=0x7 2024-09-12T00:27:20.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.050+0000 7fe85072c800 10 moving default.rgw.meta+users.keys+BDHFMURSHWSZEOTWHSPF to cache LRU end 2024-09-12T00:27:20.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.050+0000 7fe85072c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:BDHFMURSHWSZEOTWHSPF, ofs0, ns] 2024-09-12T00:27:20.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.050+0000 7fe72affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464341 cookie 94049513398544 notifier 8606 bl.length()=188 2024-09-12T00:27:20.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.050+0000 7fe72affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BDHFMURSHWSZEOTWHSPF info.flags=0x7 2024-09-12T00:27:20.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.050+0000 7fe72affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BDHFMURSHWSZEOTWHSPF to cache LRU end 2024-09-12T00:27:20.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.052+0000 7fe85072c800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T00:27:20.051 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:27:20.052 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "root1.client.0", 2024-09-12T00:27:20.052 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T00:27:20.052 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "root1+test@test.test", 2024-09-12T00:27:20.052 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T00:27:20.052 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:27:20.052 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T00:27:20.052 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T00:27:20.052 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T00:27:20.053 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "root1.client.0", 2024-09-12T00:27:20.053 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "BDHFMURSHWSZEOTWHSPF", 2024-09-12T00:27:20.053 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "O0DFpP8/YTdUPHfG2G7gUYlWxXWyVFp9qxNHWEIXj45EVt0WrmH5rg==", 2024-09-12T00:27:20.053 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T00:27:20.053 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:27:20.046117Z" 2024-09-12T00:27:20.053 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T00:27:20.053 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T00:27:20.053 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T00:27:20.053 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T00:27:20.053 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T00:27:20.053 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T00:27:20.053 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T00:27:20.054 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T00:27:20.054 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T00:27:20.054 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:20.054 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:20.054 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:20.054 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:20.054 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:20.054 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:20.054 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T00:27:20.054 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:20.054 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:20.054 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:20.054 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:20.054 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:20.055 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:20.055 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T00:27:20.055 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "root", 2024-09-12T00:27:20.055 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T00:27:20.055 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "RGW88888888888888888", 2024-09-12T00:27:20.055 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T00:27:20.055 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:27:20.046105Z", 2024-09-12T00:27:20.055 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T00:27:20.055 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T00:27:20.055 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:27:20.055 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:20.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.053+0000 7fe702fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:20.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.055+0000 7fe85072c800 20 remove_watcher() i=0 2024-09-12T00:27:20.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.055+0000 7fe85072c800 2 removed watcher, disabling cache 2024-09-12T00:27:20.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.056+0000 7fe85072c800 20 remove_watcher() i=1 2024-09-12T00:27:20.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.057+0000 7fe85072c800 20 remove_watcher() i=2 2024-09-12T00:27:20.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.058+0000 7fe85072c800 20 remove_watcher() i=3 2024-09-12T00:27:20.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.059+0000 7fe85072c800 20 remove_watcher() i=4 2024-09-12T00:27:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.060+0000 7fe85072c800 20 remove_watcher() i=5 2024-09-12T00:27:20.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.061+0000 7fe85072c800 20 remove_watcher() i=6 2024-09-12T00:27:20.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.062+0000 7fe85072c800 20 remove_watcher() i=7 2024-09-12T00:27:20.073 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 2496346638 --totp-seed PBEQ34FTUUYY7OQIJZN3OTKMU22J2JQOET5OJNQFBDCJTEWRJK4Q7Y7QL7YGLANE --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:27:20.141 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:20.141 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:20.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.177+0000 7fbb55b40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.179+0000 7fbb55b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.179+0000 7fbb55b40800 20 realm 2024-09-12T00:27:20.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.179+0000 7fbb55b40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.180+0000 7fbb55b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.180+0000 7fbb55b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:20.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.180+0000 7fbb55b40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.180+0000 7fbb55b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.180+0000 7fbb55b40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.181+0000 7fbb55b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:20.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.181+0000 7fbb55b40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.181+0000 7fbb55b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:20.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.181+0000 7fbb55b40800 20 searching for the correct realm 2024-09-12T00:27:20.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.184+0000 7fbb510bf640 0 -- 172.21.15.67:0/3930573117 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fbb4803fbf0 msgr2=0x7fbb4801f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:20.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.390+0000 7fbb520c1640 0 -- 172.21.15.67:0/3930573117 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55e36db45940 msgr2=0x55e36db47db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:20.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.395+0000 7fbb55b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:20.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.395+0000 7fbb55b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:20.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.395+0000 7fbb55b40800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:20.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.395+0000 7fbb55b40800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:20.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.395+0000 7fbb55b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:20.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.395+0000 7fbb55b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:20.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.395+0000 7fbb55b40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.395+0000 7fbb55b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.395 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.395+0000 7fbb55b40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.396+0000 7fbb55b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:20.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.396+0000 7fbb55b40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.396+0000 7fbb55b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:20.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.396+0000 7fbb55b40800 20 zone default found 2024-09-12T00:27:20.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.396+0000 7fbb55b40800 4 Realm: () 2024-09-12T00:27:20.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.396+0000 7fbb55b40800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:20.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.396+0000 7fbb55b40800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:20.396 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.396+0000 7fbb55b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.396+0000 7fbb55b40800 20 zonegroup default 2024-09-12T00:27:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.396+0000 7fbb55b40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.396+0000 7fbb55b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.396+0000 7fbb55b40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.396+0000 7fbb55b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.396+0000 7fbb55b40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.397+0000 7fbb55b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.397+0000 7fbb55b40800 20 started sync module instance, tier type = 2024-09-12T00:27:20.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.397+0000 7fbb55b40800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.407+0000 7fbb55b40800 20 add_watcher() i=0 2024-09-12T00:27:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.407+0000 7fbb55b40800 20 add_watcher() i=1 2024-09-12T00:27:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.407+0000 7fbb55b40800 20 add_watcher() i=2 2024-09-12T00:27:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.407+0000 7fbb55b40800 20 add_watcher() i=3 2024-09-12T00:27:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.407+0000 7fbb55b40800 20 add_watcher() i=4 2024-09-12T00:27:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.407+0000 7fbb55b40800 20 add_watcher() i=5 2024-09-12T00:27:20.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.407+0000 7fbb55b40800 20 add_watcher() i=6 2024-09-12T00:27:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.408+0000 7fbb55b40800 20 add_watcher() i=7 2024-09-12T00:27:20.407 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.408+0000 7fbb55b40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.410+0000 7fba03fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.410+0000 7fbb55b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.410+0000 7fbb55b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:20.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.410+0000 7fbb55b40800 5 note: GC not initialized 2024-09-12T00:27:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.410+0000 7fba02ffd640 20 reqs_thread_entry: start 2024-09-12T00:27:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.410+0000 7fbb55b40800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.410+0000 7fbb55b40800 20 Filter name: none 2024-09-12T00:27:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.410+0000 7fba00ff9640 20 reqs_thread_entry: start 2024-09-12T00:27:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.410+0000 7fbb55b40800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:27:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.410+0000 7fbb55b40800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.411+0000 7fbb55b40800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:27:20.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.411+0000 7fbb55b40800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T00:27:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.411+0000 7fbb55b40800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:27:20.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.411+0000 7fbb55b40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.414+0000 7fbb55b40800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:27:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.414+0000 7fbb55b40800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:27:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.414+0000 7fbb55b40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:27:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.414+0000 7fba357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464506 cookie 94435286479200 notifier 8624 bl.length()=695 2024-09-12T00:27:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.414+0000 7fba357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:27:20.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.414+0000 7fba357fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:27:20.414 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.415+0000 7fba03fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:20.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.418+0000 7fbb55b40800 20 remove_watcher() i=0 2024-09-12T00:27:20.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.418+0000 7fbb55b40800 2 removed watcher, disabling cache 2024-09-12T00:27:20.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.419+0000 7fbb55b40800 20 remove_watcher() i=1 2024-09-12T00:27:20.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.420+0000 7fbb55b40800 20 remove_watcher() i=2 2024-09-12T00:27:20.420 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.421+0000 7fbb55b40800 20 remove_watcher() i=3 2024-09-12T00:27:20.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.422+0000 7fbb55b40800 20 remove_watcher() i=4 2024-09-12T00:27:20.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.423+0000 7fbb55b40800 20 remove_watcher() i=5 2024-09-12T00:27:20.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.424+0000 7fbb55b40800 20 remove_watcher() i=6 2024-09-12T00:27:20.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.425+0000 7fbb55b40800 20 remove_watcher() i=7 2024-09-12T00:27:20.436 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T00:27:20.500 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:20.500 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:20.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.537+0000 7f787bb2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.538+0000 7f787bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.538+0000 7f787bb2e800 20 realm 2024-09-12T00:27:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.538+0000 7f787bb2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.539+0000 7f787bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.539+0000 7f787bb2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.539+0000 7f787bb2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.539+0000 7f787bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.539+0000 7f787bb2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.540+0000 7f787bb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:20.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.540+0000 7f787bb2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.541+0000 7f787bb2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:20.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.541+0000 7f787bb2e800 20 searching for the correct realm 2024-09-12T00:27:20.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.543+0000 7f786ffff640 0 -- 172.21.15.67:0/701768226 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f7860027420 msgr2=0x7f7860027880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:20.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.750+0000 7f7877f65640 0 -- 172.21.15.67:0/701768226 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5615d1382610 msgr2=0x5615d1384ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.754+0000 7f787bb2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.754+0000 7f787bb2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.754+0000 7f787bb2e800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.754+0000 7f787bb2e800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.754+0000 7f787bb2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.754+0000 7f787bb2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:20.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.754+0000 7f787bb2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.754+0000 7f787bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.754+0000 7f787bb2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.754+0000 7f787bb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:20.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.754+0000 7f787bb2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.755+0000 7f787bb2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:20.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.755+0000 7f787bb2e800 20 zone default found 2024-09-12T00:27:20.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.755+0000 7f787bb2e800 4 Realm: () 2024-09-12T00:27:20.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.755+0000 7f787bb2e800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:20.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.755+0000 7f787bb2e800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:20.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.755+0000 7f787bb2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:20.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.755+0000 7f787bb2e800 20 zonegroup default 2024-09-12T00:27:20.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.755+0000 7f787bb2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.755+0000 7f787bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.755+0000 7f787bb2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.755+0000 7f787bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.755+0000 7f787bb2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.756+0000 7f787bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.756+0000 7f787bb2e800 20 started sync module instance, tier type = 2024-09-12T00:27:20.756 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.756+0000 7f787bb2e800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:20.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.764+0000 7f787bb2e800 20 add_watcher() i=0 2024-09-12T00:27:20.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.764+0000 7f787bb2e800 20 add_watcher() i=1 2024-09-12T00:27:20.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.764+0000 7f787bb2e800 20 add_watcher() i=2 2024-09-12T00:27:20.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.764+0000 7f787bb2e800 20 add_watcher() i=3 2024-09-12T00:27:20.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.764+0000 7f787bb2e800 20 add_watcher() i=4 2024-09-12T00:27:20.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.764+0000 7f787bb2e800 20 add_watcher() i=5 2024-09-12T00:27:20.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.764+0000 7f787bb2e800 20 add_watcher() i=6 2024-09-12T00:27:20.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.765+0000 7f787bb2e800 20 add_watcher() i=7 2024-09-12T00:27:20.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.765+0000 7f787bb2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:20.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.766+0000 7f772dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:20.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.767+0000 7f787bb2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:20.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.767+0000 7f787bb2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:20.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.767+0000 7f787bb2e800 5 note: GC not initialized 2024-09-12T00:27:20.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.767+0000 7f772cfe1640 20 reqs_thread_entry: start 2024-09-12T00:27:20.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.767+0000 7f787bb2e800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:20.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.767+0000 7f787bb2e800 20 Filter name: none 2024-09-12T00:27:20.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.767+0000 7f76a67fc640 20 reqs_thread_entry: start 2024-09-12T00:27:20.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.767+0000 7f787bb2e800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T00:27:20.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.767+0000 7f787bb2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.768+0000 7f787bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.768+0000 7f787bb2e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T00:27:20.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.768+0000 7f787bb2e800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:27:20.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.768+0000 7f787bb2e800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T00:27:20.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.768+0000 7f787bb2e800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T00:27:20.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.768+0000 7f787bb2e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.768+0000 7f787bb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.768+0000 7f787bb2e800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T00:27:20.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.768+0000 7f787bb2e800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:27:20.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.768+0000 7f787bb2e800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T00:27:20.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.769+0000 7f787bb2e800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:27:20.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.769+0000 7f787bb2e800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:27:20.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.769+0000 7f787bb2e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T00:27:20.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.769+0000 7f775affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464507 cookie 94651704426160 notifier 9258 bl.length()=384 2024-09-12T00:27:20.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.769+0000 7f775affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:27:20.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.769+0000 7f775affd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:27:20.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.771+0000 7f787bb2e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:27:20.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.771+0000 7f787bb2e800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:27:20.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.771+0000 7f787bb2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T00:27:20.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.771+0000 7f775affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464508 cookie 94651704481856 notifier 9258 bl.length()=225 2024-09-12T00:27:20.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.771+0000 7f775affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:27:20.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.771+0000 7f775affd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:27:20.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.773+0000 7f787bb2e800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:27:20.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.773+0000 7f787bb2e800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:27:20.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.773+0000 7f787bb2e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T00:27:20.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.773+0000 7f775affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464342 cookie 94651704479520 notifier 9258 bl.length()=234 2024-09-12T00:27:20.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.773+0000 7f775affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:27:20.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.773+0000 7f775affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:27:20.773 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.775+0000 7f772dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:20.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.777+0000 7f787bb2e800 20 remove_watcher() i=0 2024-09-12T00:27:20.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.777+0000 7f787bb2e800 2 removed watcher, disabling cache 2024-09-12T00:27:20.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.778+0000 7f787bb2e800 20 remove_watcher() i=1 2024-09-12T00:27:20.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.779+0000 7f787bb2e800 20 remove_watcher() i=2 2024-09-12T00:27:20.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.780+0000 7f787bb2e800 20 remove_watcher() i=3 2024-09-12T00:27:20.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.781+0000 7f787bb2e800 20 remove_watcher() i=4 2024-09-12T00:27:20.781 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.782+0000 7f787bb2e800 20 remove_watcher() i=5 2024-09-12T00:27:20.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.783+0000 7f787bb2e800 20 remove_watcher() i=6 2024-09-12T00:27:20.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.784+0000 7f787bb2e800 20 remove_watcher() i=7 2024-09-12T00:27:20.792 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:27:20.792 INFO:teuthology.orchestra.run.smithi067.stdout: "id": "RGW99999999999999999", 2024-09-12T00:27:20.792 INFO:teuthology.orchestra.run.smithi067.stdout: "tenant": "", 2024-09-12T00:27:20.792 INFO:teuthology.orchestra.run.smithi067.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T00:27:20.792 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T00:27:20.793 INFO:teuthology.orchestra.run.smithi067.stdout: "quota": { 2024-09-12T00:27:20.793 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:20.793 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:20.793 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:20.793 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:20.793 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:20.793 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:20.793 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T00:27:20.793 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:20.793 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:20.793 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:20.793 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:20.793 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:20.793 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:20.794 INFO:teuthology.orchestra.run.smithi067.stdout: "max_users": 1000, 2024-09-12T00:27:20.794 INFO:teuthology.orchestra.run.smithi067.stdout: "max_roles": 1000, 2024-09-12T00:27:20.794 INFO:teuthology.orchestra.run.smithi067.stdout: "max_groups": 1000, 2024-09-12T00:27:20.794 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:27:20.794 INFO:teuthology.orchestra.run.smithi067.stdout: "max_access_keys": 4 2024-09-12T00:27:20.794 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:27:20.795 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T00:27:20.795 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key PSRLBEAGOGOCUROGLIUT --secret E1gUaKzplUxq4DwYq8XsJ+M23RYKOvRh3MvkbcVSoWOxqLS9+E0Z4Q== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T00:27:20.864 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:20.864 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:20.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.900+0000 7f330c087800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.902+0000 7f330c087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.902+0000 7f330c087800 20 realm 2024-09-12T00:27:20.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.902+0000 7f330c087800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.902+0000 7f330c087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.902+0000 7f330c087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:20.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.902+0000 7f330c087800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.902+0000 7f330c087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.902+0000 7f330c087800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.903+0000 7f330c087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:20.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.903+0000 7f330c087800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.904+0000 7f330c087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:20.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.904+0000 7f330c087800 20 searching for the correct realm 2024-09-12T00:27:20.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.907+0000 7f330a372640 0 -- 172.21.15.67:0/2186683224 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7f33000612c0 msgr2=0x7f330009f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:20.909 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.910+0000 7f3309b71640 0 -- 172.21.15.67:0/2186683224 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f330401f040 msgr2=0x7f330403a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:20.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.914+0000 7f330c087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:20.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.914+0000 7f330c087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:20.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.914+0000 7f330c087800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:20.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.914+0000 7f330c087800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:20.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.914+0000 7f330c087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:20.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.914+0000 7f330c087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:20.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.914+0000 7f330c087800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.914+0000 7f330c087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.914+0000 7f330c087800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.914+0000 7f330c087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:20.914 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.914+0000 7f330c087800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.915+0000 7f330c087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:20.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.915+0000 7f330c087800 20 zone default found 2024-09-12T00:27:20.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.915+0000 7f330c087800 4 Realm: () 2024-09-12T00:27:20.915 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.915+0000 7f330c087800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:20.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.915+0000 7f330c087800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:20.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.915+0000 7f330c087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:20.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.915+0000 7f330c087800 20 zonegroup default 2024-09-12T00:27:20.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.915+0000 7f330c087800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.915+0000 7f330c087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.915+0000 7f330c087800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.915+0000 7f330c087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.915+0000 7f330c087800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.916+0000 7f330c087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.916+0000 7f330c087800 20 started sync module instance, tier type = 2024-09-12T00:27:20.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.916+0000 7f330c087800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:20.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.924+0000 7f330c087800 20 add_watcher() i=0 2024-09-12T00:27:20.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.924+0000 7f330c087800 20 add_watcher() i=1 2024-09-12T00:27:20.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.924+0000 7f330c087800 20 add_watcher() i=2 2024-09-12T00:27:20.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.924+0000 7f330c087800 20 add_watcher() i=3 2024-09-12T00:27:20.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.924+0000 7f330c087800 20 add_watcher() i=4 2024-09-12T00:27:20.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.924+0000 7f330c087800 20 add_watcher() i=5 2024-09-12T00:27:20.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.924+0000 7f330c087800 20 add_watcher() i=6 2024-09-12T00:27:20.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.925+0000 7f330c087800 20 add_watcher() i=7 2024-09-12T00:27:20.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.925+0000 7f330c087800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:20.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.926+0000 7f31bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:20.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.926+0000 7f330c087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:20.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.926+0000 7f330c087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:20.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.926+0000 7f330c087800 5 note: GC not initialized 2024-09-12T00:27:20.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.927+0000 7f31ba7fc640 20 reqs_thread_entry: start 2024-09-12T00:27:20.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.927+0000 7f330c087800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:20.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.927+0000 7f330c087800 20 Filter name: none 2024-09-12T00:27:20.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.927+0000 7f312bfff640 20 reqs_thread_entry: start 2024-09-12T00:27:20.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.927+0000 7f330c087800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:27:20.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.927+0000 7f330c087800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.928+0000 7f330c087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.928+0000 7f330c087800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T00:27:20.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.928+0000 7f330c087800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:27:20.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.928+0000 7f330c087800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T00:27:20.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.928+0000 7f330c087800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.928+0000 7f330c087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.928+0000 7f330c087800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T00:27:20.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.928+0000 7f330c087800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:27:20.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.928+0000 7f330c087800 10 cache get: name=default.rgw.meta+users.keys+PSRLBEAGOGOCUROGLIUT : miss 2024-09-12T00:27:20.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.928+0000 7f330c087800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.928+0000 7f330c087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:20.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.928+0000 7f330c087800 10 cache put: name=default.rgw.meta+users.keys+PSRLBEAGOGOCUROGLIUT info.flags=0x0 2024-09-12T00:27:20.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.928+0000 7f330c087800 10 adding default.rgw.meta+users.keys+PSRLBEAGOGOCUROGLIUT to cache LRU end 2024-09-12T00:27:20.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.928+0000 7f330c087800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T00:27:20.929 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.928+0000 7f330c087800 20 rados->read ofs=0 len=0 2024-09-12T00:27:20.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.929+0000 7f330c087800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:27:20.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.929+0000 7f330c087800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:27:20.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.929+0000 7f330c087800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:27:20.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.929+0000 7f330c087800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:20.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.929+0000 7f330c087800 10 cache get: name=default.rgw.meta+users.keys+PSRLBEAGOGOCUROGLIUT : hit (negative entry) 2024-09-12T00:27:20.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.929+0000 7f330c087800 10 cache get: name=default.rgw.meta+users.keys+PSRLBEAGOGOCUROGLIUT : hit (negative entry) 2024-09-12T00:27:20.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.930+0000 7f330c087800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:27:20.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.930+0000 7f330c087800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:27:20.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.930+0000 7f330c087800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:27:20.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.931+0000 7f31ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464509 cookie 94305775617920 notifier 9273 bl.length()=681 2024-09-12T00:27:20.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.931+0000 7f31ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:27:20.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.931+0000 7f31ed7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:27:20.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.932+0000 7f330c087800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:27:20.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.932+0000 7f330c087800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:27:20.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.932+0000 7f330c087800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T00:27:20.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.932+0000 7f31ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464568 cookie 94305775626976 notifier 9273 bl.length()=189 2024-09-12T00:27:20.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.932+0000 7f31ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:27:20.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.932+0000 7f31ed7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:27:20.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.934+0000 7f330c087800 10 cache put: name=default.rgw.meta+users.keys+PSRLBEAGOGOCUROGLIUT info.flags=0x7 2024-09-12T00:27:20.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.934+0000 7f330c087800 10 moving default.rgw.meta+users.keys+PSRLBEAGOGOCUROGLIUT to cache LRU end 2024-09-12T00:27:20.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.934+0000 7f330c087800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:PSRLBEAGOGOCUROGLIUT, ofs0, ns] 2024-09-12T00:27:20.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.934+0000 7f31ecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464344 cookie 94305775621616 notifier 9273 bl.length()=188 2024-09-12T00:27:20.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.934+0000 7f31ecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PSRLBEAGOGOCUROGLIUT info.flags=0x7 2024-09-12T00:27:20.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.934+0000 7f31ecff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PSRLBEAGOGOCUROGLIUT to cache LRU end 2024-09-12T00:27:20.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.936+0000 7f330c087800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T00:27:20.937 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:27:20.937 INFO:teuthology.orchestra.run.smithi067.stdout: "user_id": "root2.client.0", 2024-09-12T00:27:20.937 INFO:teuthology.orchestra.run.smithi067.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T00:27:20.937 INFO:teuthology.orchestra.run.smithi067.stdout: "email": "root2+test@test.test", 2024-09-12T00:27:20.937 INFO:teuthology.orchestra.run.smithi067.stdout: "suspended": 0, 2024-09-12T00:27:20.937 INFO:teuthology.orchestra.run.smithi067.stdout: "max_buckets": 1000, 2024-09-12T00:27:20.937 INFO:teuthology.orchestra.run.smithi067.stdout: "subusers": [], 2024-09-12T00:27:20.937 INFO:teuthology.orchestra.run.smithi067.stdout: "keys": [ 2024-09-12T00:27:20.938 INFO:teuthology.orchestra.run.smithi067.stdout: { 2024-09-12T00:27:20.938 INFO:teuthology.orchestra.run.smithi067.stdout: "user": "root2.client.0", 2024-09-12T00:27:20.938 INFO:teuthology.orchestra.run.smithi067.stdout: "access_key": "PSRLBEAGOGOCUROGLIUT", 2024-09-12T00:27:20.938 INFO:teuthology.orchestra.run.smithi067.stdout: "secret_key": "E1gUaKzplUxq4DwYq8XsJ+M23RYKOvRh3MvkbcVSoWOxqLS9+E0Z4Q==", 2024-09-12T00:27:20.938 INFO:teuthology.orchestra.run.smithi067.stdout: "active": true, 2024-09-12T00:27:20.938 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:27:20.930717Z" 2024-09-12T00:27:20.938 INFO:teuthology.orchestra.run.smithi067.stdout: } 2024-09-12T00:27:20.938 INFO:teuthology.orchestra.run.smithi067.stdout: ], 2024-09-12T00:27:20.938 INFO:teuthology.orchestra.run.smithi067.stdout: "swift_keys": [], 2024-09-12T00:27:20.938 INFO:teuthology.orchestra.run.smithi067.stdout: "caps": [], 2024-09-12T00:27:20.938 INFO:teuthology.orchestra.run.smithi067.stdout: "op_mask": "read, write, delete", 2024-09-12T00:27:20.938 INFO:teuthology.orchestra.run.smithi067.stdout: "default_placement": "", 2024-09-12T00:27:20.938 INFO:teuthology.orchestra.run.smithi067.stdout: "default_storage_class": "", 2024-09-12T00:27:20.939 INFO:teuthology.orchestra.run.smithi067.stdout: "placement_tags": [], 2024-09-12T00:27:20.939 INFO:teuthology.orchestra.run.smithi067.stdout: "bucket_quota": { 2024-09-12T00:27:20.939 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:20.939 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:20.939 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:20.939 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:20.939 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:20.939 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:20.939 INFO:teuthology.orchestra.run.smithi067.stdout: "user_quota": { 2024-09-12T00:27:20.939 INFO:teuthology.orchestra.run.smithi067.stdout: "enabled": false, 2024-09-12T00:27:20.939 INFO:teuthology.orchestra.run.smithi067.stdout: "check_on_raw": false, 2024-09-12T00:27:20.939 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size": -1, 2024-09-12T00:27:20.939 INFO:teuthology.orchestra.run.smithi067.stdout: "max_size_kb": 0, 2024-09-12T00:27:20.939 INFO:teuthology.orchestra.run.smithi067.stdout: "max_objects": -1 2024-09-12T00:27:20.939 INFO:teuthology.orchestra.run.smithi067.stdout: }, 2024-09-12T00:27:20.940 INFO:teuthology.orchestra.run.smithi067.stdout: "temp_url_keys": [], 2024-09-12T00:27:20.940 INFO:teuthology.orchestra.run.smithi067.stdout: "type": "root", 2024-09-12T00:27:20.940 INFO:teuthology.orchestra.run.smithi067.stdout: "mfa_ids": [], 2024-09-12T00:27:20.940 INFO:teuthology.orchestra.run.smithi067.stdout: "account_id": "RGW99999999999999999", 2024-09-12T00:27:20.940 INFO:teuthology.orchestra.run.smithi067.stdout: "path": "/", 2024-09-12T00:27:20.940 INFO:teuthology.orchestra.run.smithi067.stdout: "create_date": "2024-09-12T00:27:20.930701Z", 2024-09-12T00:27:20.940 INFO:teuthology.orchestra.run.smithi067.stdout: "tags": [], 2024-09-12T00:27:20.940 INFO:teuthology.orchestra.run.smithi067.stdout: "group_ids": [] 2024-09-12T00:27:20.940 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:27:20.940 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:27:20.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.937+0000 7f31bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:20.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.939+0000 7f330c087800 20 remove_watcher() i=0 2024-09-12T00:27:20.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.939+0000 7f330c087800 2 removed watcher, disabling cache 2024-09-12T00:27:20.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.940+0000 7f330c087800 20 remove_watcher() i=1 2024-09-12T00:27:20.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.941+0000 7f330c087800 20 remove_watcher() i=2 2024-09-12T00:27:20.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.942+0000 7f330c087800 20 remove_watcher() i=3 2024-09-12T00:27:20.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.943+0000 7f330c087800 20 remove_watcher() i=4 2024-09-12T00:27:20.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.944+0000 7f330c087800 20 remove_watcher() i=5 2024-09-12T00:27:20.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.945+0000 7f330c087800 20 remove_watcher() i=6 2024-09-12T00:27:20.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:20.946+0000 7f330c087800 20 remove_watcher() i=7 2024-09-12T00:27:20.956 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 9730309429 --totp-seed ZIW547SQWHOMATNKNB63LRDTCQUBLMFRTZJMQUI5XERPJ5M7YTUPUTFCN34VMIOE --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:27:21.025 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:21.025 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:21.263 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.264+0000 7f8521620800 20 rados->read ofs=0 len=0 2024-09-12T00:27:21.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.265+0000 7f8521620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:21.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.265+0000 7f8521620800 20 realm 2024-09-12T00:27:21.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.265+0000 7f8521620800 20 rados->read ofs=0 len=0 2024-09-12T00:27:21.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.265+0000 7f8521620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:21.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.265+0000 7f8521620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:21.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.265+0000 7f8521620800 20 rados->read ofs=0 len=0 2024-09-12T00:27:21.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.265+0000 7f8521620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:21.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.265+0000 7f8521620800 20 rados->read ofs=0 len=0 2024-09-12T00:27:21.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.266+0000 7f8521620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:21.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.266+0000 7f8521620800 20 rados->read ofs=0 len=0 2024-09-12T00:27:21.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.267+0000 7f8521620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:21.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.267+0000 7f8521620800 20 searching for the correct realm 2024-09-12T00:27:21.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.269+0000 7f851f111640 0 -- 172.21.15.67:0/114843288 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f85100a0c20 msgr2=0x7f8510073910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:21.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.475+0000 7f851f111640 0 -- 172.21.15.67:0/114843288 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f8518069040 msgr2=0x7f851805a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:21.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.682+0000 7f8521620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:21.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.682+0000 7f8521620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:21.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.682+0000 7f8521620800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:27:21.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.682+0000 7f8521620800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:27:21.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.682+0000 7f8521620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:21.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.682+0000 7f8521620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:21.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.682+0000 7f8521620800 20 rados->read ofs=0 len=0 2024-09-12T00:27:21.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.683+0000 7f8521620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:21.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.683+0000 7f8521620800 20 rados->read ofs=0 len=0 2024-09-12T00:27:21.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.683+0000 7f8521620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:21.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.683+0000 7f8521620800 20 rados->read ofs=0 len=0 2024-09-12T00:27:21.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.683+0000 7f8521620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:21.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.683+0000 7f8521620800 20 zone default found 2024-09-12T00:27:21.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.683+0000 7f8521620800 4 Realm: () 2024-09-12T00:27:21.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.683+0000 7f8521620800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:27:21.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.683+0000 7f8521620800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:27:21.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.683+0000 7f8521620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:21.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.683+0000 7f8521620800 20 zonegroup default 2024-09-12T00:27:21.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.683+0000 7f8521620800 20 rados->read ofs=0 len=0 2024-09-12T00:27:21.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.684+0000 7f8521620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:21.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.684+0000 7f8521620800 20 rados->read ofs=0 len=0 2024-09-12T00:27:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.684+0000 7f8521620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.684+0000 7f8521620800 20 rados->read ofs=0 len=0 2024-09-12T00:27:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.685+0000 7f8521620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.685+0000 7f8521620800 20 started sync module instance, tier type = 2024-09-12T00:27:21.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.685+0000 7f8521620800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:27:21.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.694+0000 7f8521620800 20 add_watcher() i=0 2024-09-12T00:27:21.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.694+0000 7f8521620800 20 add_watcher() i=1 2024-09-12T00:27:21.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.694+0000 7f8521620800 20 add_watcher() i=2 2024-09-12T00:27:21.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.694+0000 7f8521620800 20 add_watcher() i=3 2024-09-12T00:27:21.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.694+0000 7f8521620800 20 add_watcher() i=4 2024-09-12T00:27:21.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.694+0000 7f8521620800 20 add_watcher() i=5 2024-09-12T00:27:21.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.694+0000 7f8521620800 20 add_watcher() i=6 2024-09-12T00:27:21.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.695+0000 7f8521620800 20 add_watcher() i=7 2024-09-12T00:27:21.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.695+0000 7f8521620800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:21.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.697+0000 7f83d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:21.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.697+0000 7f8521620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:21.698 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.697+0000 7f8521620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:21.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.697+0000 7f8521620800 5 note: GC not initialized 2024-09-12T00:27:21.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.698+0000 7f83d4fe1640 20 reqs_thread_entry: start 2024-09-12T00:27:21.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.698+0000 7f8521620800 20 init_complete bucket index max shards: 1 2024-09-12T00:27:21.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.698+0000 7f8521620800 20 Filter name: none 2024-09-12T00:27:21.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.698+0000 7f834e7fc640 20 reqs_thread_entry: start 2024-09-12T00:27:21.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.698+0000 7f8521620800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:27:21.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.698+0000 7f8521620800 20 rados->read ofs=0 len=0 2024-09-12T00:27:21.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.698+0000 7f8521620800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:27:21.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.698+0000 7f8521620800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T00:27:21.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.698+0000 7f8521620800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:27:21.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.698+0000 7f8521620800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:21.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.701+0000 7f8521620800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:27:21.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.701+0000 7f8521620800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:27:21.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.701+0000 7f8521620800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:27:21.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.701+0000 7f8402ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464510 cookie 94205191207376 notifier 9294 bl.length()=695 2024-09-12T00:27:21.702 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.701+0000 7f8402ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:27:21.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.701+0000 7f8402ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:27:21.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.703+0000 7f83d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:21.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.705+0000 7f8521620800 20 remove_watcher() i=0 2024-09-12T00:27:21.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.705+0000 7f8521620800 2 removed watcher, disabling cache 2024-09-12T00:27:21.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.706+0000 7f8521620800 20 remove_watcher() i=1 2024-09-12T00:27:21.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.707+0000 7f8521620800 20 remove_watcher() i=2 2024-09-12T00:27:21.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.708+0000 7f8521620800 20 remove_watcher() i=3 2024-09-12T00:27:21.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.709+0000 7f8521620800 20 remove_watcher() i=4 2024-09-12T00:27:21.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.710+0000 7f8521620800 20 remove_watcher() i=5 2024-09-12T00:27:21.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.711+0000 7f8521620800 20 remove_watcher() i=6 2024-09-12T00:27:21.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:27:21.711+0000 7f8521620800 20 remove_watcher() i=7 2024-09-12T00:27:21.722 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T00:27:21.723 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:27:21.723 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T00:27:21.754 INFO:tasks.s3tests:Configuring boto... 2024-09-12T00:27:21.754 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:27:21.754 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T00:27:21.824 DEBUG:teuthology.orchestra.run.smithi067:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:27:22.008 INFO:teuthology.orchestra.run.smithi067.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T00:27:22.194 INFO:teuthology.orchestra.run.smithi067.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T00:27:22.478 INFO:teuthology.orchestra.run.smithi067.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:29:16.012 INFO:teuthology.orchestra.run.smithi067.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T00:29:17.477 INFO:teuthology.orchestra.run.smithi067.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=e90febb2b35045c937073675f358361e92b3a18f8724b545589c86c3f81858ce,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T00:29:17.478 INFO:teuthology.orchestra.run.smithi067.stdout:py run-test-pre: PYTHONHASHSEED='2734423644' 2024-09-12T00:29:17.478 INFO:teuthology.orchestra.run.smithi067.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:29:17.619 INFO:teuthology.orchestra.run.smithi067.stdout:============================= test session starts ============================== 2024-09-12T00:29:17.620 INFO:teuthology.orchestra.run.smithi067.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T00:29:17.620 INFO:teuthology.orchestra.run.smithi067.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:29:17.620 INFO:teuthology.orchestra.run.smithi067.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:29:17.620 INFO:teuthology.orchestra.run.smithi067.stdout:configfile: pytest.ini 2024-09-12T00:29:19.461 INFO:teuthology.orchestra.run.smithi067.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T00:29:19.461 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:29:19.579 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T00:29:19.688 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T00:29:19.849 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T00:29:20.002 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T00:29:20.110 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T00:29:20.219 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T00:29:20.380 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T00:29:20.488 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T00:29:20.575 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T00:29:20.661 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T00:29:20.773 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T00:29:20.884 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T00:29:20.996 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T00:29:21.105 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T00:29:21.191 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T00:29:21.278 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T00:29:21.322 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T00:29:21.367 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T00:29:21.413 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T00:29:21.457 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T00:29:21.502 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T00:29:21.548 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T00:29:21.593 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:29:21.639 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:29:21.683 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:29:21.728 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:29:21.774 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:29:21.819 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:29:21.863 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T00:29:21.909 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T00:29:21.954 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:29:21.999 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:29:22.043 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:29:22.088 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:29:22.134 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:29:22.179 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:29:22.225 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T00:29:22.269 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T00:29:22.315 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:29:22.360 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:29:22.405 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T00:29:22.450 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:29:22.495 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:29:22.540 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:29:22.587 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T00:29:22.633 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:29:22.678 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:29:22.724 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:29:22.770 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:29:22.816 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:29:22.862 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:29:22.908 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T00:29:22.955 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T00:29:23.227 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T00:29:23.748 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T00:29:24.732 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T00:29:25.691 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T00:29:27.255 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T00:29:27.751 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T00:29:28.371 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T00:29:28.588 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T00:29:28.657 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T00:29:28.798 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T00:29:28.943 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T00:29:29.110 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T00:29:29.238 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T00:29:29.310 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T00:29:29.310 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:29:29.311 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:29:29.311 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:29:29.313 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:29:29.314 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:29:29.315 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:29:29.316 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T00:29:29.316 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:29:29.317 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:29:29.318 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:29:29.318 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:29:29.319 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T00:29:29.320 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:29:29.321 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:29:29.322 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:29:29.322 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:29:29.323 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:29:29.324 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:29:29.325 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:29:29.326 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T00:29:29.327 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T00:29:29.327 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T00:29:29.328 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T00:29:29.329 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T00:29:29.330 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T00:29:29.331 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T00:29:29.331 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T00:29:29.420 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T00:29:29.431 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T00:29:29.690 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T00:29:36.512 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T00:29:36.683 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T00:29:36.906 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T00:29:37.127 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T00:29:37.351 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T00:29:37.575 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T00:29:37.735 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T00:29:37.988 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T00:29:38.200 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T00:29:38.410 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T00:29:38.572 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T00:29:38.726 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T00:29:38.883 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T00:29:38.976 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T00:29:39.137 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T00:29:39.353 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T00:29:39.604 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T00:29:39.766 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T00:29:39.929 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T00:29:40.096 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T00:29:40.257 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T00:29:40.417 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T00:29:40.572 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T00:29:40.728 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T00:29:40.817 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T00:29:40.944 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T00:29:41.032 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T00:29:41.121 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T00:29:41.210 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T00:29:41.371 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T00:29:41.462 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:29:41.557 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T00:29:41.748 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T00:29:41.935 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T00:29:42.026 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:29:42.245 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T00:29:42.433 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:29:42.715 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:29:42.859 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T00:29:43.047 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T00:29:43.236 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T00:29:43.616 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:29:43.814 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:29:44.029 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:29:44.263 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:29:44.619 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:29:44.869 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:29:45.222 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:29:45.467 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:29:45.787 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:29:46.005 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T00:29:46.361 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T00:29:46.554 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T00:29:47.324 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T00:29:47.822 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T00:29:48.459 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T00:29:49.930 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T00:29:51.970 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T00:29:53.017 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T00:29:54.181 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T00:29:54.882 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T00:29:55.261 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T00:29:56.090 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T00:29:56.643 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T00:29:57.426 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T00:29:57.937 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T00:29:58.992 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T00:29:59.645 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T00:30:00.850 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T00:30:01.990 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T00:30:02.712 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T00:30:03.361 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T00:30:03.882 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T00:30:05.352 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T00:30:06.340 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T00:30:07.547 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T00:30:08.716 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T00:30:09.714 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T00:30:10.716 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T00:30:11.479 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T00:30:12.022 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T00:30:12.645 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T00:30:13.945 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T00:30:15.729 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T00:30:16.422 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T00:30:17.506 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T00:30:18.595 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T00:30:19.502 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T00:30:20.386 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T00:30:21.345 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T00:30:22.281 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T00:30:23.149 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T00:30:23.769 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T00:30:24.283 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T00:30:24.801 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T00:30:25.318 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T00:30:26.134 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T00:30:26.937 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T00:30:27.737 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T00:30:28.529 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T00:30:29.318 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T00:30:30.107 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T00:30:30.943 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T00:30:31.730 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T00:30:32.515 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T00:30:33.301 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T00:30:34.095 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T00:30:34.885 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T00:30:35.334 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T00:30:35.746 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T00:30:36.118 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T00:30:36.488 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T00:30:36.721 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T00:30:37.091 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T00:30:37.368 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T00:30:37.645 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T00:30:37.923 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T00:30:38.164 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T00:30:38.404 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T00:30:38.644 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T00:30:38.929 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T00:30:39.219 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T00:30:39.512 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T00:30:39.733 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T00:30:39.951 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T00:30:40.228 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T00:30:40.467 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T00:30:40.760 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T00:30:41.050 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T00:30:41.291 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T00:30:41.534 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T00:30:41.807 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T00:30:42.047 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T00:30:42.287 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T00:30:42.527 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T00:30:42.768 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T00:30:43.010 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T00:30:43.285 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T00:30:43.526 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T00:30:43.767 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T00:30:44.008 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T00:30:44.242 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T00:30:44.474 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T00:30:44.707 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T00:30:44.984 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T00:30:45.223 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T00:30:55.333 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T00:30:55.606 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T00:30:55.841 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T00:30:56.074 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T00:30:56.308 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T00:30:56.542 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T00:30:56.777 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T00:30:57.030 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T00:30:57.303 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T00:30:57.535 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T00:30:57.768 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T00:30:57.996 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T00:30:58.229 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T00:30:58.467 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T00:30:58.705 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T00:30:58.983 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T00:30:59.225 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T00:30:59.466 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T00:30:59.706 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T00:30:59.946 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:31:00.186 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:31:00.426 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:31:00.705 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:31:00.987 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T00:31:01.272 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T00:31:01.513 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T00:31:01.755 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T00:31:01.996 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T00:31:02.275 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T00:31:02.365 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T00:31:02.577 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T00:31:03.174 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T00:31:03.769 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T00:31:04.011 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T00:31:04.287 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T00:31:04.531 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T00:31:04.771 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T00:31:05.056 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T00:31:05.339 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T00:31:05.577 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T00:31:05.819 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T00:31:06.098 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T00:31:06.338 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T00:31:06.579 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T00:31:06.816 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T00:31:07.226 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T00:31:07.725 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T00:31:07.931 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T00:31:08.100 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T00:31:08.262 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T00:31:08.424 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T00:31:08.516 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T00:31:08.607 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T00:31:08.699 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T00:31:08.916 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T00:31:09.141 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T00:31:09.275 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T00:31:09.488 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T00:31:09.650 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T00:31:09.817 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T00:31:09.978 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T00:31:10.461 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T00:31:10.824 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T00:31:11.184 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T00:31:21.742 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T00:31:31.917 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T00:31:32.128 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T00:31:32.339 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T00:31:32.555 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T00:31:32.769 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T00:31:33.041 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T00:31:33.258 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T00:31:33.473 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T00:31:33.708 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T00:31:33.972 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T00:31:34.225 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T00:31:34.482 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T00:31:34.698 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T00:31:34.952 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T00:31:35.109 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T00:31:35.315 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T00:31:35.522 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T00:31:35.956 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T00:31:36.209 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T00:31:36.419 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T00:31:36.633 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T00:31:36.849 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T00:31:37.104 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T00:31:37.266 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T00:31:37.426 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T00:31:37.586 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T00:31:37.748 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T00:31:37.949 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T00:31:38.112 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T00:31:38.326 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T00:31:38.487 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T00:31:38.647 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T00:31:38.807 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T00:31:38.969 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T00:31:39.207 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T00:31:39.370 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T00:31:39.533 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T00:31:39.733 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T00:31:39.894 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T00:31:40.054 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T00:31:40.214 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T00:31:40.380 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T00:31:40.620 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T00:31:40.781 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T00:31:41.037 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T00:31:41.298 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T00:31:41.552 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T00:31:41.810 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T00:31:42.067 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T00:31:43.302 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T00:31:43.571 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T00:31:43.833 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T00:31:44.143 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T00:31:44.493 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T00:31:44.809 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T00:31:45.105 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T00:31:45.419 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T00:31:45.769 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T00:31:46.032 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T00:31:46.381 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T00:31:46.597 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T00:31:46.737 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T00:31:46.875 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T00:31:47.093 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T00:31:47.256 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T00:31:47.349 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T00:31:47.598 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T00:31:47.815 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T00:31:48.027 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T00:31:50.503 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T00:31:50.726 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T00:31:50.983 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T00:31:51.196 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T00:31:51.412 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T00:31:51.589 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T00:31:51.812 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T00:31:52.022 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T00:31:52.236 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T00:31:52.450 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T00:31:52.661 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T00:31:52.873 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T00:31:53.128 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T00:31:53.351 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T00:31:53.563 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T00:31:53.775 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T00:31:53.987 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T00:31:54.199 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T00:31:54.291 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T00:31:54.382 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T00:31:54.475 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T00:31:54.677 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T00:31:54.834 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T00:31:54.993 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T00:31:55.148 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T00:31:55.350 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T00:31:55.442 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T00:31:55.535 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T00:31:55.691 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T00:31:55.785 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T00:31:55.878 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T00:31:56.008 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T00:31:56.100 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T00:31:56.270 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T00:31:56.467 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T00:31:56.632 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T00:31:56.831 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T00:31:57.032 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T00:31:57.195 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T00:31:57.399 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T00:31:57.650 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T00:31:57.852 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T00:31:58.050 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T00:31:58.305 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T00:31:58.603 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T00:31:58.907 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T00:31:59.164 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T00:31:59.422 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T00:31:59.729 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T00:32:00.036 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T00:32:00.303 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T00:32:00.536 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T00:32:00.705 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T00:32:01.054 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T00:32:01.366 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T00:32:01.679 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T00:32:01.994 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T00:32:02.303 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T00:32:02.599 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T00:32:02.841 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T00:32:03.089 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T00:32:03.420 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T00:32:03.666 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T00:32:03.840 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T00:32:04.099 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T00:32:04.361 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T00:32:04.578 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T00:32:04.784 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T00:32:05.088 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T00:32:05.468 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T00:32:05.850 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T00:32:06.229 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T00:32:06.617 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T00:32:07.039 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T00:32:07.422 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T00:32:07.809 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T00:32:08.196 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T00:32:08.584 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T00:32:08.932 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T00:32:09.326 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T00:32:09.679 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T00:32:10.151 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T00:32:10.613 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T00:32:10.703 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T00:32:10.795 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T00:32:10.886 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T00:32:11.056 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T00:32:11.276 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T00:32:11.444 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T00:32:11.600 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T00:32:11.848 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T00:32:12.709 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T00:32:12.969 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T00:32:13.251 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T00:32:13.706 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T00:32:14.018 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T00:32:14.328 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T00:32:14.591 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T00:32:14.860 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T00:32:15.288 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T00:32:15.575 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T00:32:15.907 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T00:32:16.230 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T00:32:16.731 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T00:32:17.185 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T00:32:17.350 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T00:32:17.514 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T00:32:18.470 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T00:32:18.843 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T00:32:20.148 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T00:32:20.327 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T00:32:20.573 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T00:32:21.156 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T00:32:21.430 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T00:32:21.934 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T00:32:23.175 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T00:32:24.152 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T00:32:26.100 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T00:32:31.359 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T00:32:32.369 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T00:32:34.158 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T00:32:34.445 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T00:32:35.042 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T00:32:35.546 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T00:32:35.893 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T00:32:36.149 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T00:32:36.609 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T00:32:36.928 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T00:32:37.158 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T00:32:37.389 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T00:32:51.192 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T00:32:52.998 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T00:32:53.304 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T00:32:53.470 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T00:32:53.734 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T00:32:57.021 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T00:33:00.217 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T00:33:03.410 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T00:33:03.640 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T00:33:03.864 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T00:33:04.086 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T00:33:04.304 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T00:33:04.524 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T00:33:04.744 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T00:33:05.042 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T00:33:05.378 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T00:33:05.756 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T00:33:06.175 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T00:33:06.693 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T00:33:07.127 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T00:33:07.594 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T00:33:07.945 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T00:33:08.424 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T00:33:09.025 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T00:33:09.483 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T00:33:09.841 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T00:33:10.325 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T00:33:10.582 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T00:33:14.965 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T00:33:15.225 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T00:33:15.484 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T00:33:15.746 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T00:33:16.005 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T00:33:16.419 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T00:33:22.717 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T00:33:23.092 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T00:33:23.421 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T00:33:23.868 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T00:33:24.344 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T00:33:26.911 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T00:33:27.315 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T00:33:30.642 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T00:33:43.337 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T00:33:45.050 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T00:33:45.975 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T00:33:47.047 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T00:33:47.500 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T00:33:47.920 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T00:33:48.225 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T00:33:48.669 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T00:33:49.022 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T00:33:49.443 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T00:33:49.617 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T00:33:49.833 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T00:33:50.089 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T00:33:50.254 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T00:33:50.416 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T00:33:50.666 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T00:33:50.836 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T00:33:51.001 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T00:33:51.238 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T00:33:51.408 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T00:33:51.584 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T00:33:51.793 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T00:33:51.965 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T00:33:52.128 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T00:33:52.385 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T00:33:52.645 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T00:33:52.918 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T00:33:53.174 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T00:33:53.398 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T00:33:53.656 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T00:33:53.913 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T00:33:54.159 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T00:33:54.362 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T00:33:54.570 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T00:33:54.779 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T00:33:56.190 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T00:33:57.634 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T00:33:58.457 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T00:33:58.676 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T00:34:59.199 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T00:36:00.527 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T00:36:00.759 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T00:36:01.021 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T00:36:01.231 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T00:36:01.399 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T00:36:02.661 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T00:36:03.329 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T00:36:04.035 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T00:36:04.254 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T00:36:04.509 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T00:36:04.766 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T00:36:05.001 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T00:36:05.259 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T00:36:05.514 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T00:36:05.738 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T00:36:05.999 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T00:36:06.236 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T00:36:06.471 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T00:36:06.694 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T00:36:06.910 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T00:36:07.307 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T00:36:07.702 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T00:36:08.082 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T00:36:08.376 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T00:36:08.716 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T00:36:09.050 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T00:36:09.422 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T00:36:09.766 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T00:36:10.108 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T00:36:10.537 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T00:36:10.924 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T00:36:11.221 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T00:36:11.438 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T00:36:11.946 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T00:36:12.463 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T00:36:12.816 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T00:36:13.174 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T00:36:13.815 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T00:36:15.737 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T00:36:16.046 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T00:36:16.435 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T00:36:16.784 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T00:36:17.372 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T00:36:17.817 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T00:36:18.082 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T00:36:18.517 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T00:36:18.683 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T00:36:18.847 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T00:36:19.010 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T00:36:19.172 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T00:36:19.473 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T00:36:19.682 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T00:36:20.073 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T00:36:20.284 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T00:36:20.486 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T00:36:20.689 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T00:36:20.891 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T00:36:21.093 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T00:36:21.341 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T00:36:21.586 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T00:36:21.791 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T00:36:21.993 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T00:36:22.194 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T00:36:22.433 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T00:36:22.687 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T00:36:22.993 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T00:36:23.233 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T00:36:23.431 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T00:36:23.683 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T00:36:24.017 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T00:36:24.256 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T00:36:24.500 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T00:36:24.740 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T00:36:24.985 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T00:36:25.222 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T00:36:25.555 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T00:36:25.853 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T00:36:26.131 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T00:36:26.358 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T00:36:26.651 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T00:36:26.911 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T00:36:27.223 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T00:36:27.475 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T00:36:27.749 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T00:36:28.117 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T00:36:28.308 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T00:36:28.515 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T00:36:28.714 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T00:36:38.881 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T00:36:39.153 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T00:36:49.154 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T00:36:49.467 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T00:36:49.780 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T00:36:49.944 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T00:36:50.153 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T00:36:50.362 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T00:36:50.570 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T00:36:50.822 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T00:36:51.033 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T00:36:51.197 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T00:36:51.407 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T00:36:51.665 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T00:36:51.876 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T00:36:52.211 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T00:36:52.506 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T00:36:52.718 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T00:36:52.926 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T00:36:53.292 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T00:36:54.232 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T00:36:54.399 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T00:36:54.611 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T00:36:54.832 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T00:36:55.094 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T00:36:55.383 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T00:36:55.688 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T00:36:56.178 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T00:36:56.705 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T00:36:56.948 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T00:36:57.870 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T00:36:58.725 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T00:36:58.865 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T00:36:59.082 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T00:36:59.808 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T00:37:00.565 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T00:37:01.044 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T00:37:01.347 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T00:37:01.680 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T00:37:02.007 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T00:37:02.140 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T00:37:02.491 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T00:37:02.873 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T00:37:05.783 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T00:37:06.262 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T00:37:06.571 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T00:37:06.837 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T00:37:07.094 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T00:37:07.385 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T00:37:07.685 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T00:37:07.854 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T00:37:08.130 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T00:37:08.444 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T00:37:08.802 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T00:37:09.177 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T00:37:09.454 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T00:37:09.542 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T00:37:09.965 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T00:37:10.352 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T00:37:10.657 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T00:37:10.942 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T00:37:11.189 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T00:37:21.827 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T00:37:21.914 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T00:37:22.441 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T00:37:22.921 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T00:37:23.259 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T00:37:23.697 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T00:37:23.714 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T00:37:23.714 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.714 INFO:teuthology.orchestra.run.smithi067.stdout:=============================== warnings summary =============================== 2024-09-12T00:37:23.715 INFO:teuthology.orchestra.run.smithi067.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T00:37:23.715 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T00:37:23.715 INFO:teuthology.orchestra.run.smithi067.stdout: import imp 2024-09-12T00:37:23.715 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.715 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py:120 2024-09-12T00:37:23.715 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T00:37:23.715 INFO:teuthology.orchestra.run.smithi067.stdout: if boto_type is 'S3Connection': 2024-09-12T00:37:23.715 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.715 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_headers.py:124 2024-09-12T00:37:23.715 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T00:37:23.715 INFO:teuthology.orchestra.run.smithi067.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T00:37:23.715 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.715 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3.py:359 2024-09-12T00:37:23.715 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-12T00:37:23.716 INFO:teuthology.orchestra.run.smithi067.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T00:37:23.716 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.716 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T00:37:23.716 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T00:37:23.716 INFO:teuthology.orchestra.run.smithi067.stdout: if k is 'BucketName': 2024-09-12T00:37:23.716 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.716 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T00:37:23.716 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T00:37:23.716 INFO:teuthology.orchestra.run.smithi067.stdout: @pytest.mark.timeout(10) 2024-09-12T00:37:23.716 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.716 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T00:37:23.716 INFO:teuthology.orchestra.run.smithi067.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T00:37:23.716 INFO:teuthology.orchestra.run.smithi067.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T00:37:23.717 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.717 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T00:37:23.717 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-12T00:37:23.717 INFO:teuthology.orchestra.run.smithi067.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T00:37:23.717 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.717 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T00:37:23.717 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-12T00:37:23.717 INFO:teuthology.orchestra.run.smithi067.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T00:37:23.717 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.717 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T00:37:23.717 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-12T00:37:23.717 INFO:teuthology.orchestra.run.smithi067.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T00:37:23.717 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.717 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T00:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-12T00:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T00:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T00:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-12T00:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T00:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T00:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-12T00:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T00:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T00:37:23.718 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-12T00:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T00:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T00:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-12T00:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T00:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T00:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-12T00:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T00:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T00:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-12T00:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T00:37:23.719 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.720 INFO:teuthology.orchestra.run.smithi067.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T00:37:23.720 INFO:teuthology.orchestra.run.smithi067.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-12T00:37:23.720 INFO:teuthology.orchestra.run.smithi067.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T00:37:23.720 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:37:23.720 INFO:teuthology.orchestra.run.smithi067.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T00:37:23.720 INFO:teuthology.orchestra.run.smithi067.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 486.09s (0:08:06) = 2024-09-12T00:37:23.838 INFO:teuthology.orchestra.run.smithi067.stdout:___________________________________ summary ____________________________________ 2024-09-12T00:37:23.838 INFO:teuthology.orchestra.run.smithi067.stdout: py: commands succeeded 2024-09-12T00:37:23.838 INFO:teuthology.orchestra.run.smithi067.stdout: congratulations :) 2024-09-12T00:37:23.856 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T00:37:23.857 DEBUG:teuthology.orchestra.run.smithi067:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T00:37:23.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:37:23.969 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T00:37:23.969 DEBUG:teuthology.orchestra.run.smithi067:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T00:37:23.999 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T00:37:24.000 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:37:24.205 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:37:24.219 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:37:24.219 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:37:24.219 DEBUG:teuthology.orchestra.run.smithi067:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:37:24.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:37:24.249 INFO:teuthology.orchestra.run.smithi067.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:37:24.249 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:37:24.318 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:37:24.319 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:37:24.388 INFO:tasks.workunit:timeout=3h 2024-09-12T00:37:24.389 INFO:tasks.workunit:cleanup=True 2024-09-12T00:37:24.389 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:37:24.460 INFO:tasks.workunit.client.0.smithi067.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:38:10.982 INFO:tasks.workunit.client.0.smithi067.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:38:10.982 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:38:10.982 INFO:tasks.workunit.client.0.smithi067.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:38:10.983 INFO:tasks.workunit.client.0.smithi067.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:38:10.983 INFO:tasks.workunit.client.0.smithi067.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:38:10.983 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:38:10.983 INFO:tasks.workunit.client.0.smithi067.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:38:10.983 INFO:tasks.workunit.client.0.smithi067.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:38:10.983 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:38:10.983 INFO:tasks.workunit.client.0.smithi067.stderr: git switch -c 2024-09-12T00:38:10.983 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:38:10.983 INFO:tasks.workunit.client.0.smithi067.stderr:Or undo this operation with: 2024-09-12T00:38:10.983 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:38:10.983 INFO:tasks.workunit.client.0.smithi067.stderr: git switch - 2024-09-12T00:38:10.983 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:38:10.983 INFO:tasks.workunit.client.0.smithi067.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:38:10.984 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:38:10.984 INFO:tasks.workunit.client.0.smithi067.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:38:10.986 DEBUG:teuthology.orchestra.run.smithi067:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:38:11.056 INFO:tasks.workunit.client.0.smithi067.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:38:11.058 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:38:11.058 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:38:11.108 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:38:11.160 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:38:11.201 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:38:11.202 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:38:11.202 INFO:tasks.workunit.client.0.smithi067.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:38:11.244 INFO:tasks.workunit.client.0.smithi067.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:38:11.248 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2024-09-12T00:38:11.248 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:38:11.322 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T00:38:11.323 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T00:38:11.323 DEBUG:teuthology.orchestra.run.smithi067:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T00:38:11.396 INFO:tasks.workunit.client.0.smithi067.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T00:38:11.397 INFO:tasks.workunit.client.0.smithi067.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:38:11.397 INFO:tasks.workunit.client.0.smithi067.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:38:13.808 INFO:tasks.workunit.client.0.smithi067.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:38:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:++ deactivate nondestructive 2024-09-12T00:38:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T00:38:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T00:38:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:38:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:++ hash -r 2024-09-12T00:38:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T00:38:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:38:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:38:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:38:13.809 INFO:tasks.workunit.client.0.smithi067.stderr:++ export VIRTUAL_ENV 2024-09-12T00:38:13.810 INFO:tasks.workunit.client.0.smithi067.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:38:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:38:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:++ export PATH 2024-09-12T00:38:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n '' ']' 2024-09-12T00:38:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -z '' ']' 2024-09-12T00:38:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:38:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:++ PS1='(rgw) ' 2024-09-12T00:38:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:++ export PS1 2024-09-12T00:38:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:38:13.811 INFO:tasks.workunit.client.0.smithi067.stderr:++ hash -r 2024-09-12T00:38:13.812 INFO:tasks.workunit.client.0.smithi067.stderr:+ pip install pip --upgrade 2024-09-12T00:38:14.049 INFO:tasks.workunit.client.0.smithi067.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:38:14.241 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting pip 2024-09-12T00:38:14.247 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:38:14.294 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: pip 2024-09-12T00:38:14.294 INFO:tasks.workunit.client.0.smithi067.stdout: Attempting uninstall: pip 2024-09-12T00:38:14.294 INFO:tasks.workunit.client.0.smithi067.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:38:14.460 INFO:tasks.workunit.client.0.smithi067.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:38:14.465 INFO:tasks.workunit.client.0.smithi067.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:38:15.238 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed pip-24.2 2024-09-12T00:38:15.288 INFO:tasks.workunit.client.0.smithi067.stderr:+ pip install boto3 2024-09-12T00:38:16.106 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting boto3 2024-09-12T00:38:16.107 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:38:16.721 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:38:16.722 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:38:16.772 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:38:16.773 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:38:16.828 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:38:16.829 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:38:16.878 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:38:16.879 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:38:16.957 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:38:16.958 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:38:17.218 INFO:tasks.workunit.client.0.smithi067.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:38:17.219 INFO:tasks.workunit.client.0.smithi067.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:38:17.224 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:38:17.225 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:38:17.235 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:38:17.236 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:38:17.237 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:38:17.239 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:38:17.240 INFO:tasks.workunit.client.0.smithi067.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:38:17.315 INFO:tasks.workunit.client.0.smithi067.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:38:18.428 INFO:tasks.workunit.client.0.smithi067.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:38:18.545 INFO:tasks.workunit.client.0.smithi067.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T00:38:18.673 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T00:38:18.709 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:18.709 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:18.748 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.750+0000 7f283bb35800 20 rados->read ofs=0 len=0 2024-09-12T00:38:18.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.752+0000 7f283bb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:18.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.752+0000 7f283bb35800 20 realm 2024-09-12T00:38:18.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.752+0000 7f283bb35800 20 rados->read ofs=0 len=0 2024-09-12T00:38:18.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.752+0000 7f283bb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:18.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.752+0000 7f283bb35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:18.750 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.752+0000 7f283bb35800 20 rados->read ofs=0 len=0 2024-09-12T00:38:18.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.752+0000 7f283bb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:18.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.752+0000 7f283bb35800 20 rados->read ofs=0 len=0 2024-09-12T00:38:18.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.753+0000 7f283bb35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:18.751 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.753+0000 7f283bb35800 20 rados->read ofs=0 len=0 2024-09-12T00:38:18.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.754+0000 7f283bb35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:18.752 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.754+0000 7f283bb35800 20 searching for the correct realm 2024-09-12T00:38:18.755 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.757+0000 7f28380e5640 0 -- 172.21.15.67:0/2803906153 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7f282c048b10 msgr2=0x7f282c02f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:18.759 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.761+0000 7f28378e4640 0 -- 172.21.15.67:0/2803906153 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f2830061040 msgr2=0x7f2830070920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:18.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.765+0000 7f283bb35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:18.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.765+0000 7f283bb35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:18.763 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.765+0000 7f283bb35800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:38:18.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.765+0000 7f283bb35800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:38:18.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.765+0000 7f283bb35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:18.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.765+0000 7f283bb35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:18.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.765+0000 7f283bb35800 20 rados->read ofs=0 len=0 2024-09-12T00:38:18.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.765+0000 7f283bb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:18.764 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.765+0000 7f283bb35800 20 rados->read ofs=0 len=0 2024-09-12T00:38:18.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.765+0000 7f283bb35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:18.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.765+0000 7f283bb35800 20 rados->read ofs=0 len=0 2024-09-12T00:38:18.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.766+0000 7f283bb35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:18.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.766+0000 7f283bb35800 20 zone default found 2024-09-12T00:38:18.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.766+0000 7f283bb35800 4 Realm: () 2024-09-12T00:38:18.765 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.766+0000 7f283bb35800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:38:18.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.766+0000 7f283bb35800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:38:18.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.766+0000 7f283bb35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:18.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.766+0000 7f283bb35800 20 zonegroup default 2024-09-12T00:38:18.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.766+0000 7f283bb35800 20 rados->read ofs=0 len=0 2024-09-12T00:38:18.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.766+0000 7f283bb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:18.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.766+0000 7f283bb35800 20 rados->read ofs=0 len=0 2024-09-12T00:38:18.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.766+0000 7f283bb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:18.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.766+0000 7f283bb35800 20 rados->read ofs=0 len=0 2024-09-12T00:38:18.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.767+0000 7f283bb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:18.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.767+0000 7f283bb35800 20 started sync module instance, tier type = 2024-09-12T00:38:18.766 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.767+0000 7f283bb35800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:38:18.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.776+0000 7f283bb35800 20 add_watcher() i=0 2024-09-12T00:38:18.774 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.776+0000 7f283bb35800 20 add_watcher() i=1 2024-09-12T00:38:18.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.776+0000 7f283bb35800 20 add_watcher() i=2 2024-09-12T00:38:18.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.776+0000 7f283bb35800 20 add_watcher() i=3 2024-09-12T00:38:18.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.776+0000 7f283bb35800 20 add_watcher() i=4 2024-09-12T00:38:18.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.776+0000 7f283bb35800 20 add_watcher() i=5 2024-09-12T00:38:18.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.776+0000 7f283bb35800 20 add_watcher() i=6 2024-09-12T00:38:18.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.777+0000 7f283bb35800 20 add_watcher() i=7 2024-09-12T00:38:18.775 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.777+0000 7f283bb35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:18.777 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.779+0000 7f26edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:18.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.779+0000 7f283bb35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:18.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.779+0000 7f283bb35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:18.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.779+0000 7f283bb35800 5 note: GC not initialized 2024-09-12T00:38:18.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.779+0000 7f26ecfe1640 20 reqs_thread_entry: start 2024-09-12T00:38:18.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.780+0000 7f283bb35800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:18.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.780+0000 7f283bb35800 20 Filter name: none 2024-09-12T00:38:18.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.780+0000 7f26667fc640 20 reqs_thread_entry: start 2024-09-12T00:38:18.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.780+0000 7f283bb35800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T00:38:18.778 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.780+0000 7f283bb35800 20 rados->read ofs=0 len=0 2024-09-12T00:38:18.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.780+0000 7f283bb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:18.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.780+0000 7f283bb35800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T00:38:18.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.780+0000 7f283bb35800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T00:38:18.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.780+0000 7f283bb35800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T00:38:18.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.780+0000 7f283bb35800 20 rados->read ofs=0 len=0 2024-09-12T00:38:18.779 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.780+0000 7f283bb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:18.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.780+0000 7f283bb35800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T00:38:18.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.780+0000 7f283bb35800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T00:38:18.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.780+0000 7f283bb35800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T00:38:18.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.780+0000 7f283bb35800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T00:38:18.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.782+0000 7f283bb35800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T00:38:18.780 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.782+0000 7f283bb35800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T00:38:18.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.782+0000 7f283bb35800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T00:38:18.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.782+0000 7f2716ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986466134 cookie 94383034874528 notifier 9312 bl.length()=613 2024-09-12T00:38:18.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.782+0000 7f2716ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T00:38:18.781 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.782+0000 7f2716ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T00:38:18.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.784+0000 7f283bb35800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T00:38:18.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.784+0000 7f283bb35800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T00:38:18.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.784+0000 7f283bb35800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T00:38:18.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.784+0000 7f2716ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986466135 cookie 94383034870832 notifier 9312 bl.length()=191 2024-09-12T00:38:18.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.784+0000 7f2716ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T00:38:18.782 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.784+0000 7f2716ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T00:38:18.783 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.785+0000 7f26edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:18.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.787+0000 7f283bb35800 20 remove_watcher() i=0 2024-09-12T00:38:18.786 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.787+0000 7f283bb35800 2 removed watcher, disabling cache 2024-09-12T00:38:18.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.788+0000 7f283bb35800 20 remove_watcher() i=1 2024-09-12T00:38:18.787 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.789+0000 7f283bb35800 20 remove_watcher() i=2 2024-09-12T00:38:18.789 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.790+0000 7f283bb35800 20 remove_watcher() i=3 2024-09-12T00:38:18.790 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.791+0000 7f283bb35800 20 remove_watcher() i=4 2024-09-12T00:38:18.791 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.793+0000 7f283bb35800 20 remove_watcher() i=5 2024-09-12T00:38:18.792 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.794+0000 7f283bb35800 20 remove_watcher() i=6 2024-09-12T00:38:18.793 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:18.795+0000 7f283bb35800 20 remove_watcher() i=7 2024-09-12T00:38:18.978 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T00:38:18.978 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:38:19.011 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T00:38:19.039 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:19.040 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:19.079 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.081+0000 7fe8c6f28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:19.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.083+0000 7fe8c6f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:19.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.083+0000 7fe8c6f28800 20 realm 2024-09-12T00:38:19.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.083+0000 7fe8c6f28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:19.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.083+0000 7fe8c6f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:19.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.083+0000 7fe8c6f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:19.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.083+0000 7fe8c6f28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:19.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.083+0000 7fe8c6f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:19.082 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.083+0000 7fe8c6f28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:19.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.084+0000 7fe8c6f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:19.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.084+0000 7fe8c6f28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:19.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.085+0000 7fe8c6f28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:19.083 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.085+0000 7fe8c6f28800 20 searching for the correct realm 2024-09-12T00:38:19.086 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.088+0000 7fe8c246e640 0 -- 172.21.15.67:0/1493002417 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fe8b801f840 msgr2=0x7fe8b8042430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:19.292 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.294+0000 7fe8c3470640 0 -- 172.21.15.67:0/1493002417 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x5650ccaa0570 msgr2=0x5650ccaa2a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:19.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.299+0000 7fe8c6f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:19.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.299+0000 7fe8c6f28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:19.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.299+0000 7fe8c6f28800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:38:19.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.299+0000 7fe8c6f28800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:38:19.302 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.299+0000 7fe8c6f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:19.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.299+0000 7fe8c6f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:19.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.299+0000 7fe8c6f28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:19.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.299+0000 7fe8c6f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:19.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.299+0000 7fe8c6f28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:19.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.299+0000 7fe8c6f28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:19.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.299+0000 7fe8c6f28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:19.303 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.300+0000 7fe8c6f28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:19.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.300+0000 7fe8c6f28800 20 zone default found 2024-09-12T00:38:19.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.300+0000 7fe8c6f28800 4 Realm: () 2024-09-12T00:38:19.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.300+0000 7fe8c6f28800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:38:19.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.300+0000 7fe8c6f28800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:38:19.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.300+0000 7fe8c6f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:19.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.300+0000 7fe8c6f28800 20 zonegroup default 2024-09-12T00:38:19.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.300+0000 7fe8c6f28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:19.304 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.300+0000 7fe8c6f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:19.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.300+0000 7fe8c6f28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:19.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.300+0000 7fe8c6f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:19.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.300+0000 7fe8c6f28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:19.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.301+0000 7fe8c6f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:19.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.301+0000 7fe8c6f28800 20 started sync module instance, tier type = 2024-09-12T00:38:19.305 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.301+0000 7fe8c6f28800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:38:19.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.310+0000 7fe8c6f28800 20 add_watcher() i=0 2024-09-12T00:38:19.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.310+0000 7fe8c6f28800 20 add_watcher() i=1 2024-09-12T00:38:19.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.310+0000 7fe8c6f28800 20 add_watcher() i=2 2024-09-12T00:38:19.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.310+0000 7fe8c6f28800 20 add_watcher() i=3 2024-09-12T00:38:19.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.310+0000 7fe8c6f28800 20 add_watcher() i=4 2024-09-12T00:38:19.308 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.310+0000 7fe8c6f28800 20 add_watcher() i=5 2024-09-12T00:38:19.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.310+0000 7fe8c6f28800 20 add_watcher() i=6 2024-09-12T00:38:19.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.311+0000 7fe8c6f28800 20 add_watcher() i=7 2024-09-12T00:38:19.309 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.311+0000 7fe8c6f28800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:19.311 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.313+0000 7fe7797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:19.312 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.313+0000 7fe8c6f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:19.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.313+0000 7fe8c6f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:19.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.313+0000 7fe8c6f28800 5 note: GC not initialized 2024-09-12T00:38:19.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.314+0000 7fe6f3fff640 20 reqs_thread_entry: start 2024-09-12T00:38:19.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.314+0000 7fe8c6f28800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:19.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.314+0000 7fe8c6f28800 20 Filter name: none 2024-09-12T00:38:19.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.314+0000 7fe6f1ffb640 20 reqs_thread_entry: start 2024-09-12T00:38:19.313 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.314+0000 7fe8c6f28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:19.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.315+0000 7fe8c6f28800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T00:38:19.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.315+0000 7fe8c6f28800 20 rados->read ofs=0 len=0 2024-09-12T00:38:19.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.315+0000 7fe8c6f28800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T00:38:19.314 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.315+0000 7fe8c6f28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:19.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.315+0000 7fe8c6f28800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:38:19.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.315+0000 7fe8c6f28800 20 INFO: main: starting shard=0 2024-09-12T00:38:19.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.315+0000 7fe8c6f28800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.782.0 2024-09-12T00:38:19.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.316+0000 7fe8c6f28800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:38:19.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.316+0000 7fe8c6f28800 20 INFO: main: done 2024-09-12T00:38:19.315 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.317+0000 7fe7797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:19.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.319+0000 7fe8c6f28800 20 remove_watcher() i=0 2024-09-12T00:38:19.317 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.319+0000 7fe8c6f28800 2 removed watcher, disabling cache 2024-09-12T00:38:19.318 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.320+0000 7fe8c6f28800 20 remove_watcher() i=1 2024-09-12T00:38:19.319 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.321+0000 7fe8c6f28800 20 remove_watcher() i=2 2024-09-12T00:38:19.320 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.322+0000 7fe8c6f28800 20 remove_watcher() i=3 2024-09-12T00:38:19.321 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.323+0000 7fe8c6f28800 20 remove_watcher() i=4 2024-09-12T00:38:19.322 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.324+0000 7fe8c6f28800 20 remove_watcher() i=5 2024-09-12T00:38:19.323 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.325+0000 7fe8c6f28800 20 remove_watcher() i=6 2024-09-12T00:38:19.324 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.326+0000 7fe8c6f28800 20 remove_watcher() i=7 2024-09-12T00:38:19.336 INFO:tasks.workunit.client.0.smithi067.stderr:rados -p default.rgw.buckets.data ls | grep 65621beb-4d22-494d-a86b-6bfd3a9fa8ca 2024-09-12T00:38:19.359 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:19.359 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:19.433 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:19.435+0000 7ff55653d640 0 -- 172.21.15.67:0/1808265685 >> [v2:172.21.15.170:6808/2113328631,v1:172.21.15.170:6809/2113328631] conn(0x7ff55000bbd0 msgr2=0x7ff550002550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:19.446 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T00:38:19.447 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:38:19.448 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:38:20.879 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:38:21.300 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T00:38:21.329 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:21.329 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:21.368 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.369+0000 7f2c1301b800 20 rados->read ofs=0 len=0 2024-09-12T00:38:21.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.372+0000 7f2c1301b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:21.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.372+0000 7f2c1301b800 20 realm 2024-09-12T00:38:21.370 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.372+0000 7f2c1301b800 20 rados->read ofs=0 len=0 2024-09-12T00:38:21.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.372+0000 7f2c1301b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:21.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.372+0000 7f2c1301b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:21.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.372+0000 7f2c1301b800 20 rados->read ofs=0 len=0 2024-09-12T00:38:21.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.372+0000 7f2c1301b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:21.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.372+0000 7f2c1301b800 20 rados->read ofs=0 len=0 2024-09-12T00:38:21.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.373+0000 7f2c1301b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:21.371 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.373+0000 7f2c1301b800 20 rados->read ofs=0 len=0 2024-09-12T00:38:21.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.374+0000 7f2c1301b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:21.372 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.374+0000 7f2c1301b800 20 searching for the correct realm 2024-09-12T00:38:21.376 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.378+0000 7f2c0efec640 0 -- 172.21.15.67:0/1313341433 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x55b6b867f0e0 msgr2=0x55b6b86814d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:21.380 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.382+0000 7f2c0e7eb640 0 -- 172.21.15.67:0/1313341433 >> [v2:172.21.15.67:6800/2522402523,v1:172.21.15.67:6801/2522402523] conn(0x55b6b8683190 msgr2=0x55b6b8685650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:21.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.386+0000 7f2c1301b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:21.385 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.386+0000 7f2c1301b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.386+0000 7f2c1301b800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:38:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.386+0000 7f2c1301b800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:38:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.386+0000 7f2c1301b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.386+0000 7f2c1301b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.386+0000 7f2c1301b800 20 rados->read ofs=0 len=0 2024-09-12T00:38:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.386+0000 7f2c1301b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.386+0000 7f2c1301b800 20 rados->read ofs=0 len=0 2024-09-12T00:38:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.387+0000 7f2c1301b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.387+0000 7f2c1301b800 20 rados->read ofs=0 len=0 2024-09-12T00:38:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.387+0000 7f2c1301b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.387+0000 7f2c1301b800 20 zone default found 2024-09-12T00:38:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.387+0000 7f2c1301b800 4 Realm: () 2024-09-12T00:38:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.387+0000 7f2c1301b800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:38:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.387+0000 7f2c1301b800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:38:21.386 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.387+0000 7f2c1301b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:21.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.387+0000 7f2c1301b800 20 zonegroup default 2024-09-12T00:38:21.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.387+0000 7f2c1301b800 20 rados->read ofs=0 len=0 2024-09-12T00:38:21.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.387+0000 7f2c1301b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:21.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.387+0000 7f2c1301b800 20 rados->read ofs=0 len=0 2024-09-12T00:38:21.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.387+0000 7f2c1301b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:21.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.387+0000 7f2c1301b800 20 rados->read ofs=0 len=0 2024-09-12T00:38:21.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.388+0000 7f2c1301b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:21.387 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.388+0000 7f2c1301b800 20 started sync module instance, tier type = 2024-09-12T00:38:21.388 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.388+0000 7f2c1301b800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:38:21.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.397+0000 7f2c1301b800 20 add_watcher() i=0 2024-09-12T00:38:21.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.397+0000 7f2c1301b800 20 add_watcher() i=1 2024-09-12T00:38:21.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.397+0000 7f2c1301b800 20 add_watcher() i=2 2024-09-12T00:38:21.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.397+0000 7f2c1301b800 20 add_watcher() i=3 2024-09-12T00:38:21.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.397+0000 7f2c1301b800 20 add_watcher() i=4 2024-09-12T00:38:21.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.397+0000 7f2c1301b800 20 add_watcher() i=5 2024-09-12T00:38:21.396 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.397+0000 7f2c1301b800 20 add_watcher() i=6 2024-09-12T00:38:21.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.398+0000 7f2c1301b800 20 add_watcher() i=7 2024-09-12T00:38:21.397 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.398+0000 7f2c1301b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:21.399 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.400+0000 7f2ac4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:21.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.401+0000 7f2c1301b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:21.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.401+0000 7f2c1301b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:21.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.401+0000 7f2c1301b800 5 note: GC not initialized 2024-09-12T00:38:21.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.401+0000 7f2a3f7fe640 20 reqs_thread_entry: start 2024-09-12T00:38:21.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.401+0000 7f2c1301b800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:21.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.401+0000 7f2c1301b800 20 Filter name: none 2024-09-12T00:38:21.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.401+0000 7f2a3d7fa640 20 reqs_thread_entry: start 2024-09-12T00:38:21.400 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.401+0000 7f2c1301b800 20 rados->read ofs=0 len=0 2024-09-12T00:38:21.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.402+0000 7f2c1301b800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T00:38:21.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.402+0000 7f2c1301b800 20 rados->read ofs=0 len=0 2024-09-12T00:38:21.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.402+0000 7f2c1301b800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T00:38:21.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.402+0000 7f2c1301b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:21.401 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.402+0000 7f2c1301b800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:38:21.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.402+0000 7f2c1301b800 20 INFO: main: starting shard=0 2024-09-12T00:38:21.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.402+0000 7f2c1301b800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.782.0 2024-09-12T00:38:21.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.402+0000 7f2c1301b800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:38:21.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.402+0000 7f2c1301b800 20 INFO: main: done 2024-09-12T00:38:21.402 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.403+0000 7f2ac4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:21.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.406+0000 7f2c1301b800 20 remove_watcher() i=0 2024-09-12T00:38:21.404 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.406+0000 7f2c1301b800 2 removed watcher, disabling cache 2024-09-12T00:38:21.405 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.407+0000 7f2c1301b800 20 remove_watcher() i=1 2024-09-12T00:38:21.406 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.408+0000 7f2c1301b800 20 remove_watcher() i=2 2024-09-12T00:38:21.407 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.409+0000 7f2c1301b800 20 remove_watcher() i=3 2024-09-12T00:38:21.408 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.410+0000 7f2c1301b800 20 remove_watcher() i=4 2024-09-12T00:38:21.409 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.411+0000 7f2c1301b800 20 remove_watcher() i=5 2024-09-12T00:38:21.410 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.412+0000 7f2c1301b800 20 remove_watcher() i=6 2024-09-12T00:38:21.412 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.413+0000 7f2c1301b800 20 remove_watcher() i=7 2024-09-12T00:38:21.424 INFO:tasks.workunit.client.0.smithi067.stderr:rados -p default.rgw.buckets.data ls | grep 69e20871-03b5-49f5-b023-28e1ee2e4db7 2024-09-12T00:38:21.447 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:21.447 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:21.528 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:21.529+0000 7fea89fa5640 0 -- 172.21.15.67:0/406888243 >> [v2:172.21.15.170:6808/2113328631,v1:172.21.15.170:6809/2113328631] conn(0x7fea7c00fc00 msgr2=0x7fea7c00e1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:21.542 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T00:38:21.542 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:38:21.581 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:38:23.055 INFO:tasks.workunit.client.0.smithi067.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:38:23.057 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:38:23.491 INFO:tasks.workunit.client.0.smithi067.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T00:38:23.491 INFO:tasks.workunit.client.0.smithi067.stderr: 2024-09-12T00:38:23.591 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T00:38:27.036 INFO:tasks.workunit.client.0.smithi067.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T00:38:27.452 INFO:tasks.workunit.client.0.smithi067.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T00:38:27.483 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:27.483 INFO:tasks.workunit.client.0.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:27.523 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.525+0000 7fe66bb75800 20 rados->read ofs=0 len=0 2024-09-12T00:38:27.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.527+0000 7fe66bb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:27.525 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.527+0000 7fe66bb75800 20 realm 2024-09-12T00:38:27.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.527+0000 7fe66bb75800 20 rados->read ofs=0 len=0 2024-09-12T00:38:27.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.527+0000 7fe66bb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:27.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.527+0000 7fe66bb75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:27.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.527+0000 7fe66bb75800 20 rados->read ofs=0 len=0 2024-09-12T00:38:27.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.527+0000 7fe66bb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:27.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.527+0000 7fe66bb75800 20 rados->read ofs=0 len=0 2024-09-12T00:38:27.526 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.528+0000 7fe66bb75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:27.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.528+0000 7fe66bb75800 20 rados->read ofs=0 len=0 2024-09-12T00:38:27.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.529+0000 7fe66bb75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:27.527 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.529+0000 7fe66bb75800 20 searching for the correct realm 2024-09-12T00:38:27.530 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.532+0000 7fe669e67640 0 -- 172.21.15.67:0/71799217 >> [v2:172.21.15.67:6824/2280959600,v1:172.21.15.67:6825/2280959600] conn(0x7fe66006d060 msgr2=0x7fe6600a3290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:27.534 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.536+0000 7fe669666640 0 -- 172.21.15.67:0/71799217 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fe664024020 msgr2=0x7fe664063bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:27.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.540+0000 7fe66bb75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:27.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.540+0000 7fe66bb75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:27.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.540+0000 7fe66bb75800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:38:27.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.540+0000 7fe66bb75800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:38:27.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.540+0000 7fe66bb75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:27.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.540+0000 7fe66bb75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:27.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.540+0000 7fe66bb75800 20 rados->read ofs=0 len=0 2024-09-12T00:38:27.539 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.540+0000 7fe66bb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:27.540 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.540+0000 7fe66bb75800 20 rados->read ofs=0 len=0 2024-09-12T00:38:27.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.541+0000 7fe66bb75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:27.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.541+0000 7fe66bb75800 20 rados->read ofs=0 len=0 2024-09-12T00:38:27.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.541+0000 7fe66bb75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:27.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.541+0000 7fe66bb75800 20 zone default found 2024-09-12T00:38:27.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.541+0000 7fe66bb75800 4 Realm: () 2024-09-12T00:38:27.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.541+0000 7fe66bb75800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:38:27.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.541+0000 7fe66bb75800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:38:27.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.541+0000 7fe66bb75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:27.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.541+0000 7fe66bb75800 20 zonegroup default 2024-09-12T00:38:27.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.541+0000 7fe66bb75800 20 rados->read ofs=0 len=0 2024-09-12T00:38:27.541 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.541+0000 7fe66bb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:27.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.541+0000 7fe66bb75800 20 rados->read ofs=0 len=0 2024-09-12T00:38:27.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.542+0000 7fe66bb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:27.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.542+0000 7fe66bb75800 20 rados->read ofs=0 len=0 2024-09-12T00:38:27.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.542+0000 7fe66bb75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:27.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.542+0000 7fe66bb75800 20 started sync module instance, tier type = 2024-09-12T00:38:27.542 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.542+0000 7fe66bb75800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:38:27.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.551+0000 7fe66bb75800 20 add_watcher() i=0 2024-09-12T00:38:27.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.551+0000 7fe66bb75800 20 add_watcher() i=1 2024-09-12T00:38:27.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.551+0000 7fe66bb75800 20 add_watcher() i=2 2024-09-12T00:38:27.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.551+0000 7fe66bb75800 20 add_watcher() i=3 2024-09-12T00:38:27.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.551+0000 7fe66bb75800 20 add_watcher() i=4 2024-09-12T00:38:27.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.551+0000 7fe66bb75800 20 add_watcher() i=5 2024-09-12T00:38:27.550 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.551+0000 7fe66bb75800 20 add_watcher() i=6 2024-09-12T00:38:27.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.552+0000 7fe66bb75800 20 add_watcher() i=7 2024-09-12T00:38:27.551 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.553+0000 7fe66bb75800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:27.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.554+0000 7fe51f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:27.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.554+0000 7fe66bb75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:27.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.554+0000 7fe66bb75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:27.553 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.554+0000 7fe66bb75800 5 note: GC not initialized 2024-09-12T00:38:27.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.555+0000 7fe51e7e4640 20 reqs_thread_entry: start 2024-09-12T00:38:27.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.555+0000 7fe66bb75800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:27.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.555+0000 7fe66bb75800 20 Filter name: none 2024-09-12T00:38:27.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.555+0000 7fe48ffff640 20 reqs_thread_entry: start 2024-09-12T00:38:27.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.555+0000 7fe66bb75800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T00:38:27.554 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.555+0000 7fe66bb75800 20 rados->read ofs=0 len=0 2024-09-12T00:38:27.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.556+0000 7fe66bb75800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T00:38:27.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.556+0000 7fe66bb75800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T00:38:27.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.556+0000 7fe66bb75800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T00:38:27.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.556+0000 7fe66bb75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.782 : miss 2024-09-12T00:38:27.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.556+0000 7fe66bb75800 20 rados->read ofs=0 len=0 2024-09-12T00:38:27.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.556+0000 7fe66bb75800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T00:38:27.555 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.556+0000 7fe66bb75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.782 info.flags=0x17 2024-09-12T00:38:27.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.556+0000 7fe66bb75800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.782 to cache LRU end 2024-09-12T00:38:27.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.556+0000 7fe66bb75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:27.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.556+0000 7fe66bb75800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:38:27.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.556+0000 7fe66bb75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.782 2024-09-12T00:38:27.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.556+0000 7fe66bb75800 20 bucket index object: :.dir.ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.782.0 2024-09-12T00:38:27.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.557+0000 7fe66bb75800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:38:27.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.557+0000 7fe66bb75800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:38:27.556 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.558+0000 7fe51f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:27.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.560+0000 7fe66bb75800 20 remove_watcher() i=0 2024-09-12T00:38:27.558 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.560+0000 7fe66bb75800 2 removed watcher, disabling cache 2024-09-12T00:38:27.559 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.561+0000 7fe66bb75800 20 remove_watcher() i=1 2024-09-12T00:38:27.560 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.562+0000 7fe66bb75800 20 remove_watcher() i=2 2024-09-12T00:38:27.562 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.564+0000 7fe66bb75800 20 remove_watcher() i=3 2024-09-12T00:38:27.563 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.565+0000 7fe66bb75800 20 remove_watcher() i=4 2024-09-12T00:38:27.564 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.566+0000 7fe66bb75800 20 remove_watcher() i=5 2024-09-12T00:38:27.565 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.567+0000 7fe66bb75800 20 remove_watcher() i=6 2024-09-12T00:38:27.566 INFO:tasks.workunit.client.0.smithi067.stderr:2024-09-12T00:38:27.568+0000 7fe66bb75800 20 remove_watcher() i=7 2024-09-12T00:38:27.577 INFO:tasks.workunit.client.0.smithi067.stderr:Deleting bucket versioning-bucket 2024-09-12T00:38:27.598 INFO:tasks.workunit.client.0.smithi067.stderr:Completed bucket versioning tests 2024-09-12T00:38:27.599 INFO:tasks.workunit.client.0.smithi067.stdout:connected to http://localhost:80 2024-09-12T00:38:27.659 INFO:tasks.workunit.client.0.smithi067.stderr:+ deactivate 2024-09-12T00:38:27.659 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:38:27.659 INFO:tasks.workunit.client.0.smithi067.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:38:27.659 INFO:tasks.workunit.client.0.smithi067.stderr:+ export PATH 2024-09-12T00:38:27.659 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:38:27.659 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n '' ']' 2024-09-12T00:38:27.659 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:38:27.659 INFO:tasks.workunit.client.0.smithi067.stderr:+ hash -r 2024-09-12T00:38:27.660 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' -n '' ']' 2024-09-12T00:38:27.660 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:38:27.660 INFO:tasks.workunit.client.0.smithi067.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:38:27.660 INFO:tasks.workunit.client.0.smithi067.stderr:+ unset -f deactivate 2024-09-12T00:38:27.660 INFO:tasks.workunit.client.0.smithi067.stderr:+ echo OK. 2024-09-12T00:38:27.661 INFO:tasks.workunit.client.0.smithi067.stdout:OK. 2024-09-12T00:38:27.661 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:38:27.661 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:38:27.743 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T00:38:27.744 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:38:28.146 DEBUG:teuthology.parallel:result is None 2024-09-12T00:38:28.147 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:38:28.188 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:38:28.188 DEBUG:teuthology.orchestra.run.smithi067:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:38:28.258 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:38:28.258 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T00:38:28.270 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T00:38:28.280 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T00:38:28.280 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T00:38:28.280 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T00:38:28.363 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T00:38:28.363 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T00:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:28.422 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:28.461 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.463+0000 7fa24a240800 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.465+0000 7fa24a240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:28.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.465+0000 7fa24a240800 20 realm 2024-09-12T00:38:28.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.465+0000 7fa24a240800 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.465+0000 7fa24a240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:28.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.465+0000 7fa24a240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:28.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.465+0000 7fa24a240800 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.465+0000 7fa24a240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:28.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.465+0000 7fa24a240800 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.466+0000 7fa24a240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:28.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.466+0000 7fa24a240800 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.467+0000 7fa24a240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:28.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.467+0000 7fa24a240800 20 searching for the correct realm 2024-09-12T00:38:28.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.470+0000 7fa247529640 0 -- 172.21.15.67:0/2109005463 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7fa23c06d5b0 msgr2=0x7fa23c074780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:28.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.878+0000 7fa247d2a640 0 -- 172.21.15.67:0/2109005463 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7fa240072930 msgr2=0x7fa240055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:28.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.883+0000 7fa24a240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:28.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.883+0000 7fa24a240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:28.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.883+0000 7fa24a240800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:38:28.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.883+0000 7fa24a240800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:38:28.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.883+0000 7fa24a240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:28.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.883+0000 7fa24a240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:28.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.883+0000 7fa24a240800 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.884+0000 7fa24a240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:28.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.884+0000 7fa24a240800 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.884+0000 7fa24a240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.884+0000 7fa24a240800 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.884+0000 7fa24a240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.884+0000 7fa24a240800 20 zone default found 2024-09-12T00:38:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.884+0000 7fa24a240800 4 Realm: () 2024-09-12T00:38:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.884+0000 7fa24a240800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:38:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.884+0000 7fa24a240800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:38:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.884+0000 7fa24a240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.884+0000 7fa24a240800 20 zonegroup default 2024-09-12T00:38:28.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.884+0000 7fa24a240800 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.885+0000 7fa24a240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:28.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.885+0000 7fa24a240800 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.885+0000 7fa24a240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:28.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.885+0000 7fa24a240800 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.885+0000 7fa24a240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:28.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.885+0000 7fa24a240800 20 started sync module instance, tier type = 2024-09-12T00:38:28.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.885+0000 7fa24a240800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:38:28.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.895+0000 7fa24a240800 20 add_watcher() i=0 2024-09-12T00:38:28.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.895+0000 7fa24a240800 20 add_watcher() i=1 2024-09-12T00:38:28.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.895+0000 7fa24a240800 20 add_watcher() i=2 2024-09-12T00:38:28.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.895+0000 7fa24a240800 20 add_watcher() i=3 2024-09-12T00:38:28.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.895+0000 7fa24a240800 20 add_watcher() i=4 2024-09-12T00:38:28.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.895+0000 7fa24a240800 20 add_watcher() i=5 2024-09-12T00:38:28.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.895+0000 7fa24a240800 20 add_watcher() i=6 2024-09-12T00:38:28.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.896+0000 7fa24a240800 20 add_watcher() i=7 2024-09-12T00:38:28.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.896+0000 7fa24a240800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:28.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.898+0000 7fa0fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:28.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.898+0000 7fa24a240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:28.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.898+0000 7fa24a240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:28.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.939+0000 7fa0fcfe1640 20 reqs_thread_entry: start 2024-09-12T00:38:28.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.939+0000 7fa24a240800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:28.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.939+0000 7fa24a240800 20 Filter name: none 2024-09-12T00:38:28.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.939+0000 7fa0767fc640 20 reqs_thread_entry: start 2024-09-12T00:38:28.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.939+0000 7fa24a240800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T00:38:28.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.939+0000 7fa24a240800 20 rados->read ofs=0 len=0 2024-09-12T00:38:28.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.939+0000 7fa24a240800 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T00:38:28.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.939+0000 7fa24a240800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T00:38:28.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.939+0000 7fa24a240800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:38:28.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.939+0000 7fa24a240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:28.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.940+0000 7fa24a240800 10 removing key index: RCXWVEBUZPCUMMSAUFDI 2024-09-12T00:38:28.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.941+0000 7fa24a240800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:RCXWVEBUZPCUMMSAUFDI, ofs0, ns] 2024-09-12T00:38:28.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.942+0000 7fa126ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986466138 cookie 94438517953408 notifier 8801 bl.length()=170 2024-09-12T00:38:28.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.942+0000 7fa24a240800 10 removing email index: tester.client.0_test@test.test 2024-09-12T00:38:28.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.943+0000 7fa24a240800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T00:38:28.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.944+0000 7fa126ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464470 cookie 94438517942736 notifier 8801 bl.length()=181 2024-09-12T00:38:28.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.944+0000 7fa24a240800 10 removing user buckets index 2024-09-12T00:38:28.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.945+0000 7fa24a240800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T00:38:28.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.946+0000 7fa126ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986466139 cookie 94438517953408 notifier 8801 bl.length()=172 2024-09-12T00:38:28.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.946+0000 7fa24a240800 10 removing user index: tester.client.0 2024-09-12T00:38:28.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.947+0000 7fa24a240800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T00:38:28.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.947+0000 7fa24a240800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T00:38:28.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.947+0000 7fa126ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986466140 cookie 94438517936656 notifier 8801 bl.length()=164 2024-09-12T00:38:28.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.949+0000 7fa0fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:28.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.951+0000 7fa24a240800 20 remove_watcher() i=0 2024-09-12T00:38:28.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.951+0000 7fa24a240800 2 removed watcher, disabling cache 2024-09-12T00:38:28.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.952+0000 7fa24a240800 20 remove_watcher() i=1 2024-09-12T00:38:28.951 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.953+0000 7fa24a240800 20 remove_watcher() i=2 2024-09-12T00:38:28.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.954+0000 7fa24a240800 20 remove_watcher() i=3 2024-09-12T00:38:28.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.955+0000 7fa24a240800 20 remove_watcher() i=4 2024-09-12T00:38:28.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.956+0000 7fa24a240800 20 remove_watcher() i=5 2024-09-12T00:38:28.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.957+0000 7fa24a240800 20 remove_watcher() i=6 2024-09-12T00:38:28.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:28.958+0000 7fa24a240800 20 remove_watcher() i=7 2024-09-12T00:38:28.968 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T00:38:28.978 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T00:38:28.987 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T00:38:29.047 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T00:38:29.057 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T00:38:29.057 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:38:29.057 INFO:tasks.rgw.client.0.smithi067.stdout:2024-09-12T00:38:29.059+0000 7fd785941640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 45875) UID: 0 2024-09-12T00:38:29.058 INFO:tasks.rgw.client.0.smithi067.stdout:2024-09-12T00:38:29.059+0000 7fd78b121880 -1 shutting down 2024-09-12T00:38:35.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-12T00:38:35.158 INFO:tasks.rgw.client.0:Stopped 2024-09-12T00:38:35.158 DEBUG:teuthology.orchestra.run.smithi067:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T00:38:35.194 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T00:38:35.280 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T00:38:35.323 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T00:38:35.323 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T00:38:35.323 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T00:38:35.424 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:35.424 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:35.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.462+0000 7f10d6613800 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.464+0000 7f10d6613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.464+0000 7f10d6613800 20 realm 2024-09-12T00:38:35.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.464+0000 7f10d6613800 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.464+0000 7f10d6613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.464+0000 7f10d6613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:35.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.464+0000 7f10d6613800 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.464+0000 7f10d6613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.464+0000 7f10d6613800 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.465+0000 7f10d6613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:35.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.465+0000 7f10d6613800 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.466+0000 7f10d6613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:35.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.466+0000 7f10d6613800 20 searching for the correct realm 2024-09-12T00:38:35.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.469+0000 7f10d1547640 0 -- 172.21.15.67:0/1227616915 >> [v2:172.21.15.170:6800/3337629604,v1:172.21.15.170:6801/3337629604] conn(0x7f10c8022940 msgr2=0x7f10c8008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:35.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.675+0000 7f10d1d48640 0 -- 172.21.15.67:0/1227616915 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f10cc0153f0 msgr2=0x7f10cc015870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:35.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.883+0000 7f10d6613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:35.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.883+0000 7f10d6613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:35.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.883+0000 7f10d6613800 20 RGWRados::pool_iterate: got zone_info.ac196c0a-dca9-437f-ae63-d6980c8d425b 2024-09-12T00:38:35.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.883+0000 7f10d6613800 20 RGWRados::pool_iterate: got zonegroup_info.66f645ad-7643-41c5-9d6c-543ffd8fb764 2024-09-12T00:38:35.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.883+0000 7f10d6613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:35.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.883+0000 7f10d6613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:35.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.883+0000 7f10d6613800 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.883+0000 7f10d6613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.883+0000 7f10d6613800 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.883+0000 7f10d6613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.884+0000 7f10d6613800 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.884+0000 7f10d6613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.884+0000 7f10d6613800 20 zone default found 2024-09-12T00:38:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.884+0000 7f10d6613800 4 Realm: () 2024-09-12T00:38:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.884+0000 7f10d6613800 4 ZoneGroup: default (66f645ad-7643-41c5-9d6c-543ffd8fb764) 2024-09-12T00:38:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.884+0000 7f10d6613800 4 Zone: default (ac196c0a-dca9-437f-ae63-d6980c8d425b) 2024-09-12T00:38:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.884+0000 7f10d6613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.884+0000 7f10d6613800 20 zonegroup default 2024-09-12T00:38:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.884+0000 7f10d6613800 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.884+0000 7f10d6613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.884+0000 7f10d6613800 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.884 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.884+0000 7f10d6613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.885+0000 7f10d6613800 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.885+0000 7f10d6613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.885+0000 7f10d6613800 20 started sync module instance, tier type = 2024-09-12T00:38:35.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.885+0000 7f10d6613800 20 started zone id=ac196c0a-dca9-437f-ae63-d6980c8d425b (name=default) with tier type = 2024-09-12T00:38:35.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.895+0000 7f10d6613800 20 add_watcher() i=0 2024-09-12T00:38:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.895+0000 7f10d6613800 20 add_watcher() i=1 2024-09-12T00:38:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.895+0000 7f10d6613800 20 add_watcher() i=2 2024-09-12T00:38:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.895+0000 7f10d6613800 20 add_watcher() i=3 2024-09-12T00:38:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.895+0000 7f10d6613800 20 add_watcher() i=4 2024-09-12T00:38:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.895+0000 7f10d6613800 20 add_watcher() i=5 2024-09-12T00:38:35.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.895+0000 7f10d6613800 20 add_watcher() i=6 2024-09-12T00:38:35.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.896+0000 7f10d6613800 20 add_watcher() i=7 2024-09-12T00:38:35.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.896+0000 7f10d6613800 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:35.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.898+0000 7f0f83fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:35.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.899+0000 7f10d6613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:35.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.899+0000 7f10d6613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:35.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.938+0000 7f0f82ffd640 20 reqs_thread_entry: start 2024-09-12T00:38:35.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.938+0000 7f10d6613800 20 init_complete bucket index max shards: 1 2024-09-12T00:38:35.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.938+0000 7f10d6613800 20 Filter name: none 2024-09-12T00:38:35.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.938+0000 7f0f80ff9640 20 reqs_thread_entry: start 2024-09-12T00:38:35.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.938+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:38:35.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.940+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.940+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50002' 2024-09-12T00:38:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4948598497489892459', time=2024-09-12T02:29:39.480844+0000, chain.objs.size()=1 2024-09-12T00:38:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.189__shadow_._tGouD2Xpw8mFUp7a5FtwgHurx9eFfB_0 2024-09-12T00:38:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6547487670052159713', time=2024-09-12T02:30:38.808018+0000, chain.objs.size()=1 2024-09-12T00:38:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.236__shadow_.BsXa83ctZ11Wxi9lAbdyeiw9YLI-CdU_0 2024-09-12T00:38:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13310196982959492295', time=2024-09-12T02:30:41.410724+0000, chain.objs.size()=1 2024-09-12T00:38:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.246__shadow_.T5ugrIUl8YXVHC-yPwVPXjmfAcLa30N_0 2024-09-12T00:38:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16177522118064529841', time=2024-09-12T02:30:43.646942+0000, chain.objs.size()=1 2024-09-12T00:38:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.255__shadow_.P_C972PDX4mAVMDlTnL-aBTGxZKQ3Dy_0 2024-09-12T00:38:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15891559615537754864', time=2024-09-12T02:30:44.588195+0000, chain.objs.size()=1 2024-09-12T00:38:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.259__shadow_.8S4XaxbMUFPABjv1TtTltM7TB27tcbH_0 2024-09-12T00:38:35.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16942676815132862024', time=2024-09-12T02:30:44.864264+0000, chain.objs.size()=1 2024-09-12T00:38:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.260__shadow_.o9c4hfGxEU3Y2nOKL63VtFaiKrVjMbW_0 2024-09-12T00:38:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10196463904916353836', time=2024-09-12T02:30:53.152520+0000, chain.objs.size()=1 2024-09-12T00:38:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pNqkzGfTbtLzDW_TKU0WzIlvHghpEzb_0 2024-09-12T00:38:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18246855985672593489', time=2024-09-12T02:30:53.176061+0000, chain.objs.size()=1 2024-09-12T00:38:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.yLtBmDP-WVncCOxWQX10dY_scrp2dWM_0 2024-09-12T00:38:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8983899476695199333', time=2024-09-12T02:30:53.222021+0000, chain.objs.size()=1 2024-09-12T00:38:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.jpNEnCpFwv3auDuWx09OOztzUdKf3hs_0 2024-09-12T00:38:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12296446248298861691', time=2024-09-12T02:30:53.305443+0000, chain.objs.size()=1 2024-09-12T00:38:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AS-vjoEunqaC2C4_WeG6RRB1nMSpYwF_0 2024-09-12T00:38:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8743584900935320770', time=2024-09-12T02:30:53.307856+0000, chain.objs.size()=1 2024-09-12T00:38:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.fZSrf5doEi474IbdMl0VJpw1vEllk_0_0 2024-09-12T00:38:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11507430849790838338', time=2024-09-12T02:30:53.445136+0000, chain.objs.size()=1 2024-09-12T00:38:35.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.tNb0zoHG0WXQ8gSs2fisULATFj7GBo9_0 2024-09-12T00:38:35.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.945+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5335660190971526633', time=2024-09-12T02:30:53.497374+0000, chain.objs.size()=1 2024-09-12T00:38:35.943 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.945+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YmaQ5WEyMElrwP_WIczl608jGuKBZwH_0 2024-09-12T00:38:35.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.946+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18206782265701872611', time=2024-09-12T02:30:53.528206+0000, chain.objs.size()=1 2024-09-12T00:38:35.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.946+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.DdKsk3ROjEVaCFyaddhfz1pbhSGh9j1_0 2024-09-12T00:38:35.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.946+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5589133936538045488', time=2024-09-12T02:30:53.578203+0000, chain.objs.size()=1 2024-09-12T00:38:35.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.946+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.IrBQM2hAEe4pC7P6KMcgi_aF6e09jLO_0 2024-09-12T00:38:35.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.946+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.552879787762436737', time=2024-09-12T02:30:53.740602+0000, chain.objs.size()=1 2024-09-12T00:38:35.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.946+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HHYOBHS-kJYwoyZaht3uchsgoeSOz54_0 2024-09-12T00:38:35.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.946+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.299617886673121779', time=2024-09-12T02:30:53.769411+0000, chain.objs.size()=1 2024-09-12T00:38:35.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.946+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.5jAtgnj6PeqeDBGqDukEesnWdhMLMKw_0 2024-09-12T00:38:35.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.946+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.444796676223965648', time=2024-09-12T02:30:53.771755+0000, chain.objs.size()=1 2024-09-12T00:38:35.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.946+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BB6zOpiqfX9VzE6G-qfG5IEPUuRPUct_0 2024-09-12T00:38:35.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.946+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4663832367465567812', time=2024-09-12T02:30:53.778723+0000, chain.objs.size()=1 2024-09-12T00:38:35.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.946+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ZOQEQCbL_xEO9cDqx3M6hXfjzvBm-XD_0 2024-09-12T00:38:35.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.947+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6452132074286740945', time=2024-09-12T02:30:53.792452+0000, chain.objs.size()=1 2024-09-12T00:38:35.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.947+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YCKRsE4Qig8XdZpON0BAxTeP92dHtIx_0 2024-09-12T00:38:35.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.947+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.91467249839981276', time=2024-09-12T02:30:53.801411+0000, chain.objs.size()=1 2024-09-12T00:38:35.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.947+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ekdRM6Gv8H84BZi_7yVbF3VdE6UKx_q_0 2024-09-12T00:38:35.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.947+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5266511080110776685', time=2024-09-12T02:30:53.851385+0000, chain.objs.size()=1 2024-09-12T00:38:35.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.947+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JrBnvczLkhdkLoJIQwX8odyUykwotgu_0 2024-09-12T00:38:35.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.947+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1620496140996431778', time=2024-09-12T02:30:53.953243+0000, chain.objs.size()=1 2024-09-12T00:38:35.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.947+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.WpkzfEiZf1qsVnrzd2x8hGJcJGyQEWL_0 2024-09-12T00:38:35.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.950+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12997129451273439732', time=2024-09-12T02:30:53.954386+0000, chain.objs.size()=1 2024-09-12T00:38:35.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.950+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.jPmXmk47KU-G6_6rq-2NgrKKE_wSzIf_0 2024-09-12T00:38:35.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.953+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15434917006836767867', time=2024-09-12T02:30:54.012958+0000, chain.objs.size()=1 2024-09-12T00:38:35.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.953+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.dWT-hAg9t3ILNsivQ3TVBOQ5tNYnmns_0 2024-09-12T00:38:35.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.954+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7294282007051378068', time=2024-09-12T02:30:54.022545+0000, chain.objs.size()=1 2024-09-12T00:38:35.952 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.954+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.4i2vJCjHCuCS9-bOfsXXaNkyWXyF4XR_0 2024-09-12T00:38:35.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.955+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15000913017197615200', time=2024-09-12T02:30:54.039807+0000, chain.objs.size()=1 2024-09-12T00:38:35.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.955+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.3sh4tQWQj0ts7cW5QBJy16bxD9OmEwz_0 2024-09-12T00:38:35.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.955+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13261963270224474598', time=2024-09-12T02:30:54.167678+0000, chain.objs.size()=1 2024-09-12T00:38:35.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.955+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.DW4fhMPQd9dpFxxqms8rKdJoxYduahk_0 2024-09-12T00:38:35.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.955+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13103100399478747294', time=2024-09-12T02:30:54.282295+0000, chain.objs.size()=1 2024-09-12T00:38:35.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.955+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_._CFsJZp7gCnh_7UxUH1Vlk8ly5rbS8A_0 2024-09-12T00:38:35.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.955+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11043351008930549361', time=2024-09-12T02:30:54.405602+0000, chain.objs.size()=1 2024-09-12T00:38:35.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.955+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.xoHnlKZ1dPPkKwr283DhcJlk_DIZdEp_0 2024-09-12T00:38:35.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4551241925208487939', time=2024-09-12T02:30:54.409039+0000, chain.objs.size()=1 2024-09-12T00:38:35.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ti0qiz0mR8OIq63dbrIhSXXX55SAO0-_0 2024-09-12T00:38:35.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11546511191886945970', time=2024-09-12T02:30:54.411858+0000, chain.objs.size()=1 2024-09-12T00:38:35.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.V1ZdxXfOFkpPCTM-pHFdjyurYFAKLYV_0 2024-09-12T00:38:35.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13019914465441171878', time=2024-09-12T02:30:54.421706+0000, chain.objs.size()=1 2024-09-12T00:38:35.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.1y8MuHgvnPJO1n_f7gjMqG_hDys3d-x_0 2024-09-12T00:38:35.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1748857744976267572', time=2024-09-12T02:30:54.445324+0000, chain.objs.size()=1 2024-09-12T00:38:35.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ooPfxhKjDlTIwrrUA1adNh_fXK6ux9H_0 2024-09-12T00:38:35.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16559984919998274736', time=2024-09-12T02:30:54.447213+0000, chain.objs.size()=1 2024-09-12T00:38:35.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.gKuDY6unhELhHXEe9r8k80InxiobySE_0 2024-09-12T00:38:35.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10620321783849634539', time=2024-09-12T02:30:54.476825+0000, chain.objs.size()=1 2024-09-12T00:38:35.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-Rd-9HBp2hPOV_Gbu9hRqJchKTtQaRI_0 2024-09-12T00:38:35.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.958+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14554252166697831171', time=2024-09-12T02:30:54.566467+0000, chain.objs.size()=1 2024-09-12T00:38:35.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.958+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.aD0Tm8j2kP93GH_KgGnprNk06MI2Syv_0 2024-09-12T00:38:35.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.959+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16706654180091106832', time=2024-09-12T02:30:54.569100+0000, chain.objs.size()=1 2024-09-12T00:38:35.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.959+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Ci3NElK7CF_MdEjTF0lI8LBhifn-iR-_0 2024-09-12T00:38:35.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.962+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14764067571652243546', time=2024-09-12T02:30:54.639848+0000, chain.objs.size()=1 2024-09-12T00:38:35.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.962+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HrX6tXKll4WkHyIloy07O-9lX1HA8f3_0 2024-09-12T00:38:35.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.962+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14361255759804775591', time=2024-09-12T02:30:54.658020+0000, chain.objs.size()=1 2024-09-12T00:38:35.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.962+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.DIuSICjzApgcfJl_LhQMb1VHv66f9ni_0 2024-09-12T00:38:35.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.962+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1189329220648423636', time=2024-09-12T02:30:54.680755+0000, chain.objs.size()=1 2024-09-12T00:38:35.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.962+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.8yAqeqK4klSAznPeyStn-mjlk1M4G_C_0 2024-09-12T00:38:35.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.962+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12240098589504277207', time=2024-09-12T02:30:54.734461+0000, chain.objs.size()=1 2024-09-12T00:38:35.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.962+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BlWkTDCGfnHuMMMAVnMfghINFLQnYTq_0 2024-09-12T00:38:35.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.962+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14140275480667023093', time=2024-09-12T02:30:54.887047+0000, chain.objs.size()=1 2024-09-12T00:38:35.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.962+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ER5fewVv945DT7BzCGPINB0l2_6yrdR_0 2024-09-12T00:38:35.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.963+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9506493948189814594', time=2024-09-12T02:30:54.976296+0000, chain.objs.size()=1 2024-09-12T00:38:35.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.963+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.UhrWisoUQPgJ1YxKtlRdkjT-YyLdFpB_0 2024-09-12T00:38:35.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.963+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7395214120323476606', time=2024-09-12T02:30:55.008580+0000, chain.objs.size()=1 2024-09-12T00:38:35.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.963+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.g7B02T7HbSEjS12Pqu_mmrkpVNQnimP_0 2024-09-12T00:38:35.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.963+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3790499604978701079', time=2024-09-12T02:30:55.094556+0000, chain.objs.size()=1 2024-09-12T00:38:35.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.963+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.wBwAaCXnK44ZINRMWXXEBF4UDm48TqL_0 2024-09-12T00:38:35.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.963+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16016809824223579007', time=2024-09-12T02:30:55.106209+0000, chain.objs.size()=1 2024-09-12T00:38:35.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.963+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.3rcTmugi0LmEuvh1qmvLf93v3EFRUVA_0 2024-09-12T00:38:35.962 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.963+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11581435242278561235', time=2024-09-12T02:30:55.137126+0000, chain.objs.size()=1 2024-09-12T00:38:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.963+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.xa7pnajHiOpKvhsZNeKfAqoZfC7HztA_0 2024-09-12T00:38:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.963+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2035974430211576435', time=2024-09-12T02:30:55.151024+0000, chain.objs.size()=1 2024-09-12T00:38:35.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.963+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.767UkyldkM9CRKqO_s6SknmfAENPySa_0 2024-09-12T00:38:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.966+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4305410268311984093', time=2024-09-12T02:30:55.188277+0000, chain.objs.size()=1 2024-09-12T00:38:35.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.966+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.oqG_T7LXzt3Md_UXaKmbXWVnH7Utbn8_0 2024-09-12T00:38:35.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.967+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17980980699869301348', time=2024-09-12T02:30:55.214609+0000, chain.objs.size()=1 2024-09-12T00:38:35.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.967+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.5u6kLUCLBCQLr-EOYbj04gPWblX6bR6_0 2024-09-12T00:38:35.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.967+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3269018870169087903', time=2024-09-12T02:30:56.185986+0000, chain.objs.size()=1 2024-09-12T00:38:35.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.967+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.266__shadow_.S-U2-lBut8LBfIxAJWBzLQbA1FtWcpV_0 2024-09-12T00:38:35.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.967+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10755395314595707057', time=2024-09-12T02:30:57.142202+0000, chain.objs.size()=1 2024-09-12T00:38:35.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.967+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.270__shadow_.VKkm5wznvyuDn-L_gG_kN4AA21zRoir_0 2024-09-12T00:38:35.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.968+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5603904264264648960', time=2024-09-12T02:30:57.414013+0000, chain.objs.size()=1 2024-09-12T00:38:35.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.968+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.271__shadow_.nhcW5SqJf5vAPmgUUYS3s8VnCGHSAp6_0 2024-09-12T00:38:35.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.968+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15932155970546255511', time=2024-09-12T02:31:02.115084+0000, chain.objs.size()=1 2024-09-12T00:38:35.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.968+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.290__shadow_.zTstpNNEXMW4KfHvw8TJ5Ib_PhrVRlK_0 2024-09-12T00:38:35.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.970+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8946670602114746487', time=2024-09-12T02:31:04.935185+0000, chain.objs.size()=1 2024-09-12T00:38:35.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.970+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.298__shadow_.2GOtGItXV8Gw7sjGm0EX-VLxJinY6bP_0 2024-09-12T00:38:35.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.970+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2090615204106021617', time=2024-09-12T02:31:05.459736+0000, chain.objs.size()=1 2024-09-12T00:38:35.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.970+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.300__shadow_.R8UnSABY_vq7syLTdi9xHwQARqIxcQU_0 2024-09-12T00:38:35.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.970+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7822997402450028575', time=2024-09-12T02:31:19.406018+0000, chain.objs.size()=1 2024-09-12T00:38:35.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.970+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.GAdyOXJqMMHnNQ_TEyH5obxFIog2jSU_0 2024-09-12T00:38:35.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.970+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15119025318779811474', time=2024-09-12T02:31:19.445047+0000, chain.objs.size()=1 2024-09-12T00:38:35.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.970+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.R0IXsYs96PDnzigafuNgd8YNR_oMz2n_0 2024-09-12T00:38:35.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.971+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7702093915071383380', time=2024-09-12T02:31:19.456396+0000, chain.objs.size()=1 2024-09-12T00:38:35.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.971+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.OaOyHne5lLwU2awwdfNgAwq98APOD6N_0 2024-09-12T00:38:35.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.971+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4044256120519885062', time=2024-09-12T02:31:19.463844+0000, chain.objs.size()=1 2024-09-12T00:38:35.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.971+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.l-dXpriCaui-9XvFZlGleJ8DBJkAsn5_0 2024-09-12T00:38:35.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.972+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9760545384263226779', time=2024-09-12T02:31:19.481001+0000, chain.objs.size()=1 2024-09-12T00:38:35.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.972+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.klqgNPvIDiJql4T1gM3w05lI8aULlvB_0 2024-09-12T00:38:35.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.972+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16250894715918963332', time=2024-09-12T02:31:19.648994+0000, chain.objs.size()=1 2024-09-12T00:38:35.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.972+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.YCcNMC5czjQF34IQDtYIiHkUy4FPLuq_0 2024-09-12T00:38:35.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.972+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10524299657631065478', time=2024-09-12T02:31:19.656723+0000, chain.objs.size()=1 2024-09-12T00:38:35.971 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.972+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.1EenUC7Lhmj5gH1qRTL-rtQW9bP8HTs_0 2024-09-12T00:38:35.972 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.974+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8337625957238785985', time=2024-09-12T02:31:19.672914+0000, chain.objs.size()=1 2024-09-12T00:38:35.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.974+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.0y951all4NRo3KL0JV-rQRUlQRwZrKD_0 2024-09-12T00:38:35.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.974+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9364333565015883829', time=2024-09-12T02:31:19.809982+0000, chain.objs.size()=1 2024-09-12T00:38:35.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.974+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IfbodDJO9QHa19PStsvt8GXHBzsau14_0 2024-09-12T00:38:35.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.977+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7029961283941110745', time=2024-09-12T02:31:19.814824+0000, chain.objs.size()=1 2024-09-12T00:38:35.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.977+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.MwPtd4e6PHA5T-1vXSBjBbI_aJh-J3x_0 2024-09-12T00:38:35.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.977+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1059707716807753672', time=2024-09-12T02:31:19.835249+0000, chain.objs.size()=1 2024-09-12T00:38:35.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.977+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.eYirkdI3UB-lZuOa_mt1tQc9EKmuTCb_0 2024-09-12T00:38:35.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.977+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1975468218394522575', time=2024-09-12T02:31:19.849683+0000, chain.objs.size()=1 2024-09-12T00:38:35.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.977+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.75cWHB_TzAwZmDW11U4u2cGDEUpO9J__0 2024-09-12T00:38:35.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.977+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6380510273421743312', time=2024-09-12T02:31:20.043528+0000, chain.objs.size()=1 2024-09-12T00:38:35.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.977+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.lHvjItoWm0W4on1-E-llPTxbKK0kjyI_0 2024-09-12T00:38:35.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.977+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14215847189852961175', time=2024-09-12T02:31:20.053991+0000, chain.objs.size()=1 2024-09-12T00:38:35.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.977+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.PNFwuboHGdkUlfwsMbBU0SRuB7580ZE_0 2024-09-12T00:38:35.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.977+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12188307920228726260', time=2024-09-12T02:31:20.333455+0000, chain.objs.size()=1 2024-09-12T00:38:35.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.977+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.nkGoWCBFYnk1icu53BA1ZrbhNxFFq39_0 2024-09-12T00:38:35.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.980+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16369175151754126335', time=2024-09-12T02:31:20.373582+0000, chain.objs.size()=1 2024-09-12T00:38:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.980+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.j4KiPg1AXlbVkjJmygvfGRfUrR2ibmD_0 2024-09-12T00:38:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.980+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11921364551452562362', time=2024-09-12T02:31:20.423783+0000, chain.objs.size()=1 2024-09-12T00:38:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.980+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.kr63Tfim6pnfGfzXv-kuJzuiSA825UK_0 2024-09-12T00:38:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.980+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17514111809975530991', time=2024-09-12T02:31:20.459087+0000, chain.objs.size()=1 2024-09-12T00:38:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.980+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.5Ye-QKGwTksIqnSDkW2tQ8aF6baZwyv_0 2024-09-12T00:38:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.980+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12998394462185352042', time=2024-09-12T02:31:20.628440+0000, chain.objs.size()=1 2024-09-12T00:38:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.980+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.OWnfi6YhNUwwPU-7KUeIMEtW_KfkhWV_0 2024-09-12T00:38:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.980+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12228286246081824425', time=2024-09-12T02:31:20.773147+0000, chain.objs.size()=1 2024-09-12T00:38:35.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.980+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.hueZglt2bD6pk7Cp1zFJXtxeB0BhpS7_0 2024-09-12T00:38:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.981+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8276700085178174159', time=2024-09-12T02:31:20.955291+0000, chain.objs.size()=1 2024-09-12T00:38:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.981+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.a0ReL42T0Xn3YRMPHy5LNmj8Kd4NFgK_0 2024-09-12T00:38:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.981+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12555788333061118033', time=2024-09-12T02:31:20.987156+0000, chain.objs.size()=1 2024-09-12T00:38:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.981+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.jdpTt5ysWRdnmsOZaFZjzNu5gpJpBTP_0 2024-09-12T00:38:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.981+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2214419316051701066', time=2024-09-12T02:31:21.208445+0000, chain.objs.size()=1 2024-09-12T00:38:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.981+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.k_3Fftut0nEdk94kUhzsNCfNNioS8a__0 2024-09-12T00:38:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.981+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12161739680282714166', time=2024-09-12T02:31:21.330111+0000, chain.objs.size()=1 2024-09-12T00:38:35.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.981+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.5jwMlkcIP0toa4upHkKCXqKDSw8N91V_0 2024-09-12T00:38:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.981+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15920319727591261292', time=2024-09-12T02:31:21.367690+0000, chain.objs.size()=1 2024-09-12T00:38:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.981+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.V300CR0kafBXphHwKjslVCcgqM30h20_0 2024-09-12T00:38:35.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.983+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14354970814111124304', time=2024-09-12T02:31:21.479021+0000, chain.objs.size()=1 2024-09-12T00:38:35.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.983+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Fs_ZboD_AOWJ1CzTdujYPkHgL8V9dU__0 2024-09-12T00:38:35.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.985+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9334704795471589842', time=2024-09-12T02:31:29.687985+0000, chain.objs.size()=1 2024-09-12T00:38:35.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.985+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.vIf-IQ5OaGwcoNdLebqbqAWOmwUKX4V_0 2024-09-12T00:38:35.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.985+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1696895786769584439', time=2024-09-12T02:31:29.714840+0000, chain.objs.size()=1 2024-09-12T00:38:35.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.985+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.hUaVntU_vK2zZK6NLo9yvOoOHPavkz__0 2024-09-12T00:38:35.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.986+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6005942121243806203', time=2024-09-12T02:31:29.764828+0000, chain.objs.size()=1 2024-09-12T00:38:35.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.986+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.wAi0sNXOXqYqC3jVjpekai3WE2Gwf3z_0 2024-09-12T00:38:35.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.986+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1554247092057614204', time=2024-09-12T02:31:29.788869+0000, chain.objs.size()=1 2024-09-12T00:38:35.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.986+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.CPhUVgJ1co8y76hIfPsNJGlnm5pYsne_0 2024-09-12T00:38:35.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.986+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12726282459253598894', time=2024-09-12T02:31:29.795473+0000, chain.objs.size()=1 2024-09-12T00:38:35.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.986+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.YrSmflq-pPLv3PUJuGE7jQuDKcEGIQQ_0 2024-09-12T00:38:35.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.987+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17238276631820648328', time=2024-09-12T02:31:29.837879+0000, chain.objs.size()=1 2024-09-12T00:38:35.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.987+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.FyFaVxP2LkwgeURa7k0KS6WNBro6U_w_0 2024-09-12T00:38:35.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.987+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7707497180831500116', time=2024-09-12T02:31:30.096739+0000, chain.objs.size()=1 2024-09-12T00:38:35.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.987+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.y8p-CFkKa3VWwOX4sz-7vWXbu1wIaeV_0 2024-09-12T00:38:35.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.987+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10782239723099991757', time=2024-09-12T02:31:30.183085+0000, chain.objs.size()=1 2024-09-12T00:38:35.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.987+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.2RJvIbmxaX876yZZy37jnIuVADWbA47_0 2024-09-12T00:38:35.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.987+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14708691600977680202', time=2024-09-12T02:31:30.350485+0000, chain.objs.size()=1 2024-09-12T00:38:35.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.987+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Ys9SHSCSs_qgI8lqiPOnFqqve52TWM7_0 2024-09-12T00:38:35.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.987+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2967434113600951218', time=2024-09-12T02:31:30.403709+0000, chain.objs.size()=1 2024-09-12T00:38:35.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.987+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.uIkieT65CrkBOr4_jcEtrbrPYdnCvQr_0 2024-09-12T00:38:35.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.987+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2685682073477595533', time=2024-09-12T02:31:30.410244+0000, chain.objs.size()=1 2024-09-12T00:38:35.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.987+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.k0aHDQoMRlA5hJWkHTrqaIIN8j1t7zZ_0 2024-09-12T00:38:35.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.989+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13016558637350582055', time=2024-09-12T02:31:30.582272+0000, chain.objs.size()=1 2024-09-12T00:38:35.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.989+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.i8dY6Qcek6n8ktfIBy8GCLCyOez20JH_0 2024-09-12T00:38:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.991+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10721690065201256448', time=2024-09-12T02:31:30.605021+0000, chain.objs.size()=1 2024-09-12T00:38:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.991+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.wkmoXW_vq3V3RePWq0Eds6zUNb09CjY_0 2024-09-12T00:38:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.992+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5619150649891690278', time=2024-09-12T02:31:30.660679+0000, chain.objs.size()=1 2024-09-12T00:38:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.992+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.HQKYxYyfaCvvqUjwXsvRComcLKwUXQ8_0 2024-09-12T00:38:35.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.992+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16396577702068680706', time=2024-09-12T02:31:30.674498+0000, chain.objs.size()=1 2024-09-12T00:38:35.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.992+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.K8auD2OMeGjfTw8Lqmv2xd0qoMHRt5a_0 2024-09-12T00:38:35.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.992+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10985576533654904023', time=2024-09-12T02:31:30.854495+0000, chain.objs.size()=1 2024-09-12T00:38:35.991 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.992+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.zh4e6YiI9_w5FtlHMuCRHnkdC2KVE0w_0 2024-09-12T00:38:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.994+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.440711849039548215', time=2024-09-12T02:31:30.918438+0000, chain.objs.size()=1 2024-09-12T00:38:35.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.994+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.t3Cym4mXhbWovl-7Ohb_cpGsDq4Akuj_0 2024-09-12T00:38:35.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:35.997+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/50002 2024-09-12T00:38:35.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:38:35.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5338429216710801047', time=2024-09-12T02:31:30.960306+0000, chain.objs.size()=1 2024-09-12T00:38:35.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.HnHCAYmhdtst_givfIOlZJsLoxEjTZ9_0 2024-09-12T00:38:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2975685572704542213', time=2024-09-12T02:31:31.019907+0000, chain.objs.size()=1 2024-09-12T00:38:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.RcipszoqN2gfVLkbvn-WYEduyzCQPeI_0 2024-09-12T00:38:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6409571076341195153', time=2024-09-12T02:31:31.026479+0000, chain.objs.size()=1 2024-09-12T00:38:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.EkBbmuUfWr5EO3SsNEmLCDd2opm_T4p_0 2024-09-12T00:38:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.821320406739535789', time=2024-09-12T02:31:31.128550+0000, chain.objs.size()=1 2024-09-12T00:38:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.SsJZ5YgEQRJudCJ55Kb4ILgO1nnKyhe_0 2024-09-12T00:38:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8261716066123994016', time=2024-09-12T02:31:31.541746+0000, chain.objs.size()=1 2024-09-12T00:38:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.bS2M87ydgmYndXB8X47qqDGr-xe5qYF_0 2024-09-12T00:38:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6425699683071901984', time=2024-09-12T02:31:31.683210+0000, chain.objs.size()=1 2024-09-12T00:38:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._NlxR_W9xoEBvLzp6VNiADstNFuiZ8M_0 2024-09-12T00:38:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9410784182354669354', time=2024-09-12T02:31:31.731845+0000, chain.objs.size()=1 2024-09-12T00:38:36.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.sjHf3az0x6wutXseWAff48a2ASbP4KO_0 2024-09-12T00:38:36.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3775380497408508165', time=2024-09-12T02:31:31.756197+0000, chain.objs.size()=1 2024-09-12T00:38:36.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Cj3YxZJqk_1jFawzvFz5il6BxPXNmc4_0 2024-09-12T00:38:36.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5815738923092643076', time=2024-09-12T02:31:31.773548+0000, chain.objs.size()=1 2024-09-12T00:38:36.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.5kPPsKAu0CTqr_1atVSbbQW_OjxUcS__0 2024-09-12T00:38:36.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14683031843918373358', time=2024-09-12T02:31:31.788893+0000, chain.objs.size()=1 2024-09-12T00:38:36.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.tCOPUxtJ0e7HJzHhAEXIYdfRAon02tp_0 2024-09-12T00:38:36.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15577618089822289037', time=2024-09-12T02:32:12.597815+0000, chain.objs.size()=1 2024-09-12T00:38:36.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.483__shadow_.hs1vUdRB2sKkgX0hAJ2u5LwcjzXNb7t_0 2024-09-12T00:38:36.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14762914978094044880', time=2024-09-12T02:32:13.894610+0000, chain.objs.size()=1 2024-09-12T00:38:36.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.487__shadow_.GiXqeboXu_yphvddYpb8QQJUThlJOUa_0 2024-09-12T00:38:36.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.004+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5126453213697991377', time=2024-09-12T02:33:10.458178+0000, chain.objs.size()=1 2024-09-12T00:38:36.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.004+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.562__shadow_.RfYnwAxuGilMwr490H6FPH1hNoIsx6U_0 2024-09-12T00:38:36.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9101744287768436768', time=2024-09-12T02:33:45.847348+0000, chain.objs.size()=1 2024-09-12T00:38:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.579__shadow:AjD9QVPRMy8tnmsu9jNbrFnYyDgsRak_.Om6NWz-R5ulPFREFLWeFGvCZ5v1t6QV_0 2024-09-12T00:38:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6374988903726713388', time=2024-09-12T02:33:45.858037+0000, chain.objs.size()=1 2024-09-12T00:38:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.579__shadow:G0JIqzlAl7GuI-sOnS1J2f.f6ZRezUg_.60zjz4vV7iAlGvEtZndnfaXBuyhea8A_0 2024-09-12T00:38:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3182480866166715414', time=2024-09-12T02:33:48.556941+0000, chain.objs.size()=1 2024-09-12T00:38:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.585__shadow:7V5CA-9OVF7gpX6fG.1Rr-bafShhucZ_.Yi8VNiWsEmyxk3VdEOvg2lODZemKBml_0 2024-09-12T00:38:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14763684021628819581', time=2024-09-12T02:36:07.960019+0000, chain.objs.size()=2 2024-09-12T00:38:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.642__shadow_.WSFaGOBpP9WzaGqluZ0DUE49ebNVP6K_0 2024-09-12T00:38:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.642__shadow_.WSFaGOBpP9WzaGqluZ0DUE49ebNVP6K_1 2024-09-12T00:38:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8960620870285813790', time=2024-09-12T02:36:26.239432+0000, chain.objs.size()=1 2024-09-12T00:38:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.705__shadow:fDkBBb007RzA.6Jy9gnTjf6CQ63urLs_.TrJfulbE_oychnTcW2FLpu6x3goQF9O_0 2024-09-12T00:38:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14544258981646717790', time=2024-09-12T02:36:38.754761+0000, chain.objs.size()=1 2024-09-12T00:38:36.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.715__shadow:kiAIPeuYBoxqvHp1jZiMo-xphVt8Z8._.dmJNR0otbzg40zAJmwwqcZGOaCNNez0_0 2024-09-12T00:38:36.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~wIB_K3GrsC8QyDnDxsLHpOxnqpQN8M5', time=2024-09-12T02:36:56.091746+0000, chain.objs.size()=1 2024-09-12T00:38:36.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.742__multipart_mymultipart2.2~wIB_K3GrsC8QyDnDxsLHpOxnqpQN8M5.1 2024-09-12T00:38:36.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.011+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:36.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.013+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:38:36.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.015+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:36.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.015+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:36.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53504' 2024-09-12T00:38:36.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14329642674071786526', time=2024-09-12T02:29:23.730187+0000, chain.objs.size()=2 2024-09-12T00:38:36.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.158__shadow_.UBBCSIeyWcsOe_u88zFl0Ui_ooea5s4_0 2024-09-12T00:38:36.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.158__shadow_.UBBCSIeyWcsOe_u88zFl0Ui_ooea5s4_1 2024-09-12T00:38:36.015 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_WEzhtqucKe5qJLYeuuaEJ8tiwZJwilH', time=2024-09-12T02:29:28.358446+0000, chain.objs.size()=1 2024-09-12T00:38:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.165__shadow_.BJfIzdMAqLS6_bQODfume8WbTdPyZJi_0 2024-09-12T00:38:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9564233202310547085', time=2024-09-12T02:30:53.124761+0000, chain.objs.size()=1 2024-09-12T00:38:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.O1HjEkeN5fnFdbTgAfDW57AnESEM40J_0 2024-09-12T00:38:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9168124909765025552', time=2024-09-12T02:30:53.186713+0000, chain.objs.size()=1 2024-09-12T00:38:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YJFzKfH0HDAud1u1SZp_2IRPxbhNc9i_0 2024-09-12T00:38:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17369845978702336424', time=2024-09-12T02:30:53.249993+0000, chain.objs.size()=1 2024-09-12T00:38:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AyPDIcRxeBoC7YwOWR-_by8lAZ4Ozhw_0 2024-09-12T00:38:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14308644107548493685', time=2024-09-12T02:30:53.398897+0000, chain.objs.size()=1 2024-09-12T00:38:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.vbLn8hpHip9DWP7-IkYoEv676i-P5X2_0 2024-09-12T00:38:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7975771686353541906', time=2024-09-12T02:30:53.453015+0000, chain.objs.size()=1 2024-09-12T00:38:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AElC6Jzm1J8fSJjIcy2oxfF7uOSr3Bz_0 2024-09-12T00:38:36.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7174643242819601287', time=2024-09-12T02:30:53.460081+0000, chain.objs.size()=1 2024-09-12T00:38:36.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Z3fTIdlRuK1mL3GQuYO8IOj5KLeotO__0 2024-09-12T00:38:36.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15734361998248401810', time=2024-09-12T02:30:53.485506+0000, chain.objs.size()=1 2024-09-12T00:38:36.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.1rGo8eki795WobLB1o62i4wN96kpsYX_0 2024-09-12T00:38:36.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5529461070861813702', time=2024-09-12T02:30:53.687967+0000, chain.objs.size()=1 2024-09-12T00:38:36.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Q5Q2YuFcuzEBteq9nvEozBnULh4KiHF_0 2024-09-12T00:38:36.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8353867683555871397', time=2024-09-12T02:30:53.699462+0000, chain.objs.size()=1 2024-09-12T00:38:36.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.016+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.TBSYWaVcr3K_eM5kcQYMJZ0avT9ocGE_0 2024-09-12T00:38:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.020+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13895094132005230772', time=2024-09-12T02:30:53.726726+0000, chain.objs.size()=1 2024-09-12T00:38:36.018 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.020+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.gICnDp_etIj7vqXzNzIhEoQI__KXvLD_0 2024-09-12T00:38:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.020+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6867869794441627526', time=2024-09-12T02:30:53.782034+0000, chain.objs.size()=1 2024-09-12T00:38:36.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.020+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.f1x80mOJXM82b8-P1dER5AAF9yVMQxu_0 2024-09-12T00:38:36.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.021+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7916450321403990319', time=2024-09-12T02:30:53.823190+0000, chain.objs.size()=1 2024-09-12T00:38:36.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.021+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.yl5txEEkkxqdy-xHRAgYibGVxdWRUfL_0 2024-09-12T00:38:36.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.021+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2630299950214234344', time=2024-09-12T02:30:53.940993+0000, chain.objs.size()=1 2024-09-12T00:38:36.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.021+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.faU6bIciqrLmDYv9jesh_9JhLghD6sM_0 2024-09-12T00:38:36.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.021+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13248426952093260734', time=2024-09-12T02:30:53.951732+0000, chain.objs.size()=1 2024-09-12T00:38:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.021+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.cr7c0zJotitPArbL6fjCTJe1aUODSHU_0 2024-09-12T00:38:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.021+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10327152295572143236', time=2024-09-12T02:30:53.952371+0000, chain.objs.size()=1 2024-09-12T00:38:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.021+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.1uefwTWuDkzaKcrG8tfRy8IHyYlBb8f_0 2024-09-12T00:38:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.021+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8198749402907757312', time=2024-09-12T02:30:54.020108+0000, chain.objs.size()=1 2024-09-12T00:38:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.021+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.0XLui34Pazv6XMIlakxeXF0T_cIWX5a_0 2024-09-12T00:38:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.021+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11478103670915179571', time=2024-09-12T02:30:54.032492+0000, chain.objs.size()=1 2024-09-12T00:38:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.021+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6xaGFYTGCTj37PNhutAOYYo9D09fLw-_0 2024-09-12T00:38:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.021+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12137178408360192200', time=2024-09-12T02:30:54.049862+0000, chain.objs.size()=1 2024-09-12T00:38:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.021+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.40cvjjkjIAshTJ3rVKVGSjFecU4IMdQ_0 2024-09-12T00:38:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.022+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8122181335116577220', time=2024-09-12T02:30:54.257223+0000, chain.objs.size()=1 2024-09-12T00:38:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.022+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.oZ8NsL13CAn5f_22_d6brhEX7mLiVxl_0 2024-09-12T00:38:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.022+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2891677085863404695', time=2024-09-12T02:30:54.360925+0000, chain.objs.size()=1 2024-09-12T00:38:36.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.022+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.EMYqNu_zEAVpdbloQoI9P27T7ZQ3ZM2_0 2024-09-12T00:38:36.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.024+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12941563847718857870', time=2024-09-12T02:30:54.424964+0000, chain.objs.size()=1 2024-09-12T00:38:36.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.024+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.83BNcrx4uHBTvyH9pCq1f-B6s3mlA3L_0 2024-09-12T00:38:36.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.026+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13333554950248118453', time=2024-09-12T02:30:54.610972+0000, chain.objs.size()=1 2024-09-12T00:38:36.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.026+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.4I-LGPMjFa4owgVPMjNbopHCiye6yP2_0 2024-09-12T00:38:36.024 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.026+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.623180605263715068', time=2024-09-12T02:30:54.612512+0000, chain.objs.size()=1 2024-09-12T00:38:36.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.026+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.5eknA-zolH21MEfgcS0zjN6ob2yS8JC_0 2024-09-12T00:38:36.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.026+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4197163998279079070', time=2024-09-12T02:30:54.674377+0000, chain.objs.size()=1 2024-09-12T00:38:36.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.026+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.8j7d8rpgUprkgUmpkB5oLmY4zeuteLh_0 2024-09-12T00:38:36.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.026+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2771993975747273464', time=2024-09-12T02:30:54.678933+0000, chain.objs.size()=1 2024-09-12T00:38:36.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.40TKCd1WW7ZJIICoL6bfxb6XmGou4ad_0 2024-09-12T00:38:36.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.027+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7395778182792495198', time=2024-09-12T02:30:54.737721+0000, chain.objs.size()=1 2024-09-12T00:38:36.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.VaAoTjf-E5rSbHk_gCUpRYPGbMufAKP_0 2024-09-12T00:38:36.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.027+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15145547338073556843', time=2024-09-12T02:30:54.819651+0000, chain.objs.size()=1 2024-09-12T00:38:36.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ZialmrJ0C6OECNT58rh4kGBhiA7p26B_0 2024-09-12T00:38:36.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.027+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9955470055435653684', time=2024-09-12T02:30:54.825779+0000, chain.objs.size()=1 2024-09-12T00:38:36.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.zZcT0KdOr4GEnjCDCu0GgXAkvmDZ1_h_0 2024-09-12T00:38:36.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.027+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3589125218992866009', time=2024-09-12T02:30:54.834227+0000, chain.objs.size()=1 2024-09-12T00:38:36.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HzjhngksLEEHPqrnzgxokeAkgGgBhgd_0 2024-09-12T00:38:36.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.028+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6989059930180755967', time=2024-09-12T02:30:54.994197+0000, chain.objs.size()=1 2024-09-12T00:38:36.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.028+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Xna-lhsTyrbZEKKuFl4UXpsW4Bm0poz_0 2024-09-12T00:38:36.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.028+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13265318383197413572', time=2024-09-12T02:30:55.080431+0000, chain.objs.size()=1 2024-09-12T00:38:36.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.028+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.iiwoCGbNKXIzmygE3xFGMEpobs2vzRx_0 2024-09-12T00:38:36.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.028+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8605780127572943920', time=2024-09-12T02:30:55.094631+0000, chain.objs.size()=1 2024-09-12T00:38:36.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.028+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ctncAB4euliVBQhnVibRfgQ7aL8cIQw_0 2024-09-12T00:38:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.030+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11088110398794964795', time=2024-09-12T02:30:55.170329+0000, chain.objs.size()=1 2024-09-12T00:38:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.030+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.b_2xdmdMp-QpQZPP1OFwKOgufb-_6f8_0 2024-09-12T00:38:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.030+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2175484600256312270', time=2024-09-12T02:30:55.189479+0000, chain.objs.size()=1 2024-09-12T00:38:36.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.030+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.fz10NVj2yJ8V1rQFiUp40edgPQAffkI_0 2024-09-12T00:38:36.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.032+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5660317619393091620', time=2024-09-12T02:30:55.195095+0000, chain.objs.size()=1 2024-09-12T00:38:36.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.032+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.KUy1wAHicfR0F5Vr4FegrLT-FUc4SdL_0 2024-09-12T00:38:36.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.032+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15845662662470811311', time=2024-09-12T02:30:55.238586+0000, chain.objs.size()=1 2024-09-12T00:38:36.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.032+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-JcHCRsqlOzQ4JPxgSZPXJWjbpka5gj_0 2024-09-12T00:38:36.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.034+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11617440372315806619', time=2024-09-12T02:30:58.586005+0000, chain.objs.size()=1 2024-09-12T00:38:36.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.034+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.276__shadow_.SkRxK0Ee3AB13XYLkGyVXKstMKDp1Gh_0 2024-09-12T00:38:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.034+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8940347997853151392', time=2024-09-12T02:30:58.862785+0000, chain.objs.size()=1 2024-09-12T00:38:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.034+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.277__shadow_._MuIsr_ysrgoROQ8gwjeLHhjTy7pmTr_0 2024-09-12T00:38:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.034+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1217206810948217937', time=2024-09-12T02:31:01.876480+0000, chain.objs.size()=1 2024-09-12T00:38:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.034+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.289__shadow_.2ovdTgO6J9qHFXX7iwNUArEpPKEvV_u_0 2024-09-12T00:38:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.034+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15129662021669203994', time=2024-09-12T02:31:03.081979+0000, chain.objs.size()=1 2024-09-12T00:38:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.034+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.bCcc-goSffcX6akdvlvK4-0mdrMbpee_0 2024-09-12T00:38:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.034+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17476300569779698634', time=2024-09-12T02:31:10.516860+0000, chain.objs.size()=1 2024-09-12T00:38:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.035+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.321__shadow_.6HC7flWStxn3myTr4TUx_0I9-eF3PXb_0 2024-09-12T00:38:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.035+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13419382973420691906', time=2024-09-12T02:31:19.493292+0000, chain.objs.size()=1 2024-09-12T00:38:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.035+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NqJYN2Ct45K5qzNxuuchG-eD8gRgm6P_0 2024-09-12T00:38:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.035+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7278164142117937143', time=2024-09-12T02:31:19.664694+0000, chain.objs.size()=1 2024-09-12T00:38:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.035+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.hp-eULhnMhKqdWDHnZQlbWWV5KDmjDA_0 2024-09-12T00:38:36.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.035+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8218791773379280149', time=2024-09-12T02:31:19.712755+0000, chain.objs.size()=1 2024-09-12T00:38:36.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.035+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.4333Jl2Jg9L-qELsZM-WhSsZpBZzOGK_0 2024-09-12T00:38:36.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.036+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15041765317752622552', time=2024-09-12T02:31:19.727975+0000, chain.objs.size()=1 2024-09-12T00:38:36.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.036+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.lVcqx5f--OOX5TVxSGB1RzZKvaPSfe__0 2024-09-12T00:38:36.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.038+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.562169159605035292', time=2024-09-12T02:31:19.749704+0000, chain.objs.size()=1 2024-09-12T00:38:36.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.038+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.O5urRO2I4lBMiwvB-IqlTXEzgy_MULw_0 2024-09-12T00:38:36.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.038+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17444091325035903633', time=2024-09-12T02:31:19.821678+0000, chain.objs.size()=1 2024-09-12T00:38:36.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.038+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.OcCE1TlIWcHES2RgEESfFJvf2Fh23c0_0 2024-09-12T00:38:36.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.038+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16938728478782253171', time=2024-09-12T02:31:19.855631+0000, chain.objs.size()=1 2024-09-12T00:38:36.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.038+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.S76j6fGLR7B60vLJRgjJ4iEPBN5FeKI_0 2024-09-12T00:38:36.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.038+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1813431105754009769', time=2024-09-12T02:31:19.859765+0000, chain.objs.size()=1 2024-09-12T00:38:36.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.038+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Y0TQ_eTFLbbxSJWbZuOAOp_AopLzxwY_0 2024-09-12T00:38:36.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.039+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12766936929919358627', time=2024-09-12T02:31:20.009580+0000, chain.objs.size()=1 2024-09-12T00:38:36.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.039+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.PCBdTCfz8QSYMN0nKU6tvGhd_K7Wa-Q_0 2024-09-12T00:38:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.040+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2370846294213442840', time=2024-09-12T02:31:20.052947+0000, chain.objs.size()=1 2024-09-12T00:38:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.040+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.QRjpl5B2rxFcvTspOk9kd0pw2sfkPds_0 2024-09-12T00:38:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.040+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4790221582474207684', time=2024-09-12T02:31:20.083997+0000, chain.objs.size()=1 2024-09-12T00:38:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.040+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.LJMeL1QFumT6F9XtWOwIavDeuYpop3t_0 2024-09-12T00:38:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.041+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13633827876099449716', time=2024-09-12T02:31:20.278929+0000, chain.objs.size()=1 2024-09-12T00:38:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.041+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.jDJXPU0-2YVBgQhaKgnccusWOGMOWcz_0 2024-09-12T00:38:36.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.041+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1888409924424864993', time=2024-09-12T02:31:20.306412+0000, chain.objs.size()=1 2024-09-12T00:38:36.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.041+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.quG6WbZuePC5uDRS5QSn2FMCX-r_x5d_0 2024-09-12T00:38:36.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.041+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8934491826394980603', time=2024-09-12T02:31:20.333637+0000, chain.objs.size()=1 2024-09-12T00:38:36.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.041+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.bC9C9amx5MjJnQuwwxpjHESt4eIzFYA_0 2024-09-12T00:38:36.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.041+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2895390101261874261', time=2024-09-12T02:31:20.342579+0000, chain.objs.size()=1 2024-09-12T00:38:36.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.041+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.eh055ZpqxOgoLMzM1VXd5PtBn2HQhE__0 2024-09-12T00:38:36.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15429800825379726336', time=2024-09-12T02:31:20.571238+0000, chain.objs.size()=1 2024-09-12T00:38:36.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.p-BBnFy81kBhjPEEYUmnq0Z_tD21dtl_0 2024-09-12T00:38:36.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17174345524003418453', time=2024-09-12T02:31:20.603178+0000, chain.objs.size()=1 2024-09-12T00:38:36.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.pyO_MDiCS-ZALq0WKxcOwveipaZlHK5_0 2024-09-12T00:38:36.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4998799621290039218', time=2024-09-12T02:31:20.631017+0000, chain.objs.size()=1 2024-09-12T00:38:36.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.mMlbHsaDRoCEJemqzT_ChitdYFnQYeC_0 2024-09-12T00:38:36.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16569846416026592445', time=2024-09-12T02:31:20.631771+0000, chain.objs.size()=1 2024-09-12T00:38:36.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.fcCgya3VZbvVK5Qe-wkyVTCfCizBaYz_0 2024-09-12T00:38:36.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.044+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4312717885933927999', time=2024-09-12T02:31:20.654254+0000, chain.objs.size()=1 2024-09-12T00:38:36.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.044+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.4eplX2WUJFhn94mNZbJEwmPcyj_irBJ_0 2024-09-12T00:38:36.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.045+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12266672801649049094', time=2024-09-12T02:31:20.661063+0000, chain.objs.size()=1 2024-09-12T00:38:36.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.045+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.mVmBLLGujX1bveNUiJBZauq_12GWmeN_0 2024-09-12T00:38:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.046+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3383367664322163675', time=2024-09-12T02:31:20.683246+0000, chain.objs.size()=1 2024-09-12T00:38:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.046+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.rTQVRmbGpwVNXzrHcB2ff_v9rQ8F5K2_0 2024-09-12T00:38:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.046+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15638787104031706782', time=2024-09-12T02:31:20.704740+0000, chain.objs.size()=1 2024-09-12T00:38:36.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.046+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_._j72IG893xYXJhwPWZQ90or6wDyuIjZ_0 2024-09-12T00:38:36.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.046+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7208440357988430330', time=2024-09-12T02:31:20.864686+0000, chain.objs.size()=1 2024-09-12T00:38:36.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.046+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.udt6kQN2SYwD1amYiic6fmvlnMDhCuA_0 2024-09-12T00:38:36.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.046+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4064471768507959563', time=2024-09-12T02:31:21.031692+0000, chain.objs.size()=1 2024-09-12T00:38:36.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.046+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.jhVAJz6Rgr5WRmU234YYg5M9Izlr9E1_0 2024-09-12T00:38:36.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.047+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15709360072117893350', time=2024-09-12T02:31:21.073247+0000, chain.objs.size()=1 2024-09-12T00:38:36.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.047+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.0t4mtTthidda41ljPEsXmcQKnyBNoTk_0 2024-09-12T00:38:36.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.049+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17769499352110852504', time=2024-09-12T02:31:21.178814+0000, chain.objs.size()=1 2024-09-12T00:38:36.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.049+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.SgJFtoDv_zkOoNpRI4hohaqr0Zv7s-S_0 2024-09-12T00:38:36.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.049+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15675047889702880910', time=2024-09-12T02:31:21.231040+0000, chain.objs.size()=1 2024-09-12T00:38:36.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.049+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.avVTL1o4HyacDCiFkuxBcycVkrG-wrX_0 2024-09-12T00:38:36.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.049+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.983595722277795808', time=2024-09-12T02:31:21.516388+0000, chain.objs.size()=1 2024-09-12T00:38:36.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.049+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.4xFiXAlj1Y1vNzhCQIQnvsFBuypmyDQ_0 2024-09-12T00:38:36.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.050+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12466364979662416673', time=2024-09-12T02:31:21.517858+0000, chain.objs.size()=1 2024-09-12T00:38:36.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.050+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NFHnCTQwmq0AYW-ABwOT3yW7svDSOhk_0 2024-09-12T00:38:36.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.050+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7322477463925740876', time=2024-09-12T02:31:21.530725+0000, chain.objs.size()=1 2024-09-12T00:38:36.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.050+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.X4qP2PPnnSX_pS_eCjLg42Mnewrbi81_0 2024-09-12T00:38:36.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.050+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8003987458582190094', time=2024-09-12T02:31:21.592981+0000, chain.objs.size()=1 2024-09-12T00:38:36.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.050+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IU4B7QYQBTM3FBpkmN3VxgvQazWS7cL_0 2024-09-12T00:38:36.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.050+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3402454747134624933', time=2024-09-12T02:31:21.625587+0000, chain.objs.size()=1 2024-09-12T00:38:36.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.050+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.zLOl8ONt3gtL7faFtGrP2JC6rIj6biz_0 2024-09-12T00:38:36.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.050+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9824849504319174554', time=2024-09-12T02:31:29.700504+0000, chain.objs.size()=1 2024-09-12T00:38:36.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.050+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.9GL9x7u76uz5oZJQP3HJRpf6XJSjlZB_0 2024-09-12T00:38:36.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.050+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15870892279484366355', time=2024-09-12T02:31:29.709858+0000, chain.objs.size()=1 2024-09-12T00:38:36.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.050+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ho_WKcwmiPhBW_v-s5mxVWYpt3xMmTZ_0 2024-09-12T00:38:36.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.051+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1351360601610210579', time=2024-09-12T02:31:29.748015+0000, chain.objs.size()=1 2024-09-12T00:38:36.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.051+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.TVjzEvwjciYMU34TKh6oyPMhTegBAIx_0 2024-09-12T00:38:36.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.052+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4638630777480424871', time=2024-09-12T02:31:29.813513+0000, chain.objs.size()=1 2024-09-12T00:38:36.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.052+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.FrexbHRF1zuF3der_6U1xZik-SAW22r_0 2024-09-12T00:38:36.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.053+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13179629150831633862', time=2024-09-12T02:31:30.042316+0000, chain.objs.size()=1 2024-09-12T00:38:36.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.053+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.CEB6E0dNzyCSoBzRGyWfj7v5tISYIRl_0 2024-09-12T00:38:36.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.054+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7068303014731363139', time=2024-09-12T02:31:30.143163+0000, chain.objs.size()=1 2024-09-12T00:38:36.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.054+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.icGkLbGs1hY2xx_kd_msGqgO1k7iOA7_0 2024-09-12T00:38:36.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.054+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10318090533007574051', time=2024-09-12T02:31:30.183423+0000, chain.objs.size()=1 2024-09-12T00:38:36.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.054+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.c_PYkJclHINR9Hs4J-f0fyghjqRT06v_0 2024-09-12T00:38:36.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.054+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15100346954696100147', time=2024-09-12T02:31:30.305378+0000, chain.objs.size()=1 2024-09-12T00:38:36.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.054+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.d7lGnIR-7W-Czdf7kgWipVsORGcLST1_0 2024-09-12T00:38:36.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.054+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16154432994210131106', time=2024-09-12T02:31:30.325323+0000, chain.objs.size()=1 2024-09-12T00:38:36.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.054+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.qlyrFc_vFZwMqc_WBtuIe3XikQRKUqa_0 2024-09-12T00:38:36.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.054+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16891383640107287575', time=2024-09-12T02:31:30.412146+0000, chain.objs.size()=1 2024-09-12T00:38:36.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.054+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NvGVfMXLiyZjDsXJMzJWciCVWe5uq2p_0 2024-09-12T00:38:36.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.054+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13916064832562645485', time=2024-09-12T02:31:30.458921+0000, chain.objs.size()=1 2024-09-12T00:38:36.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.054+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.MWHyntFUDAjuXVOLxSFN5PhL91-cfnG_0 2024-09-12T00:38:36.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.056+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.226864125434277904', time=2024-09-12T02:31:30.570244+0000, chain.objs.size()=1 2024-09-12T00:38:36.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.056+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.b1OdivZKJiXruDWLSDRql90y8E7IeJ__0 2024-09-12T00:38:36.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.057+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7210110947983430285', time=2024-09-12T02:31:30.576640+0000, chain.objs.size()=1 2024-09-12T00:38:36.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.057+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.xA2bx1Ut1GGZeEI9lNei9ElCFdV7D8M_0 2024-09-12T00:38:36.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.057+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3482935326673856932', time=2024-09-12T02:31:30.624961+0000, chain.objs.size()=1 2024-09-12T00:38:36.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.057+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.noDinoSMrv1I0Sd3o_oxZd7lKjPgzOD_0 2024-09-12T00:38:36.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.057+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9737758965630198371', time=2024-09-12T02:31:30.701835+0000, chain.objs.size()=1 2024-09-12T00:38:36.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.057+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.AHTkWj7abigbv0MvuUggGk9KNao3Rck_0 2024-09-12T00:38:36.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.057+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2329466621234656401', time=2024-09-12T02:31:30.734602+0000, chain.objs.size()=1 2024-09-12T00:38:36.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.057+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Cfc_0_2eX-rWmQ_ld2l6bgZdsbVQ0SV_0 2024-09-12T00:38:36.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1380699967550940121', time=2024-09-12T02:31:30.739119+0000, chain.objs.size()=1 2024-09-12T00:38:36.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.vb2ufH_8teUZaP13bGBMDFFGZJ4UpGV_0 2024-09-12T00:38:36.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.060+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2194720251445112974', time=2024-09-12T02:31:30.756220+0000, chain.objs.size()=1 2024-09-12T00:38:36.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.060+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lkhgTJ1kjfU2puzTYA_9nF49TE28lLj_0 2024-09-12T00:38:36.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.060+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12402987954879600299', time=2024-09-12T02:31:30.759679+0000, chain.objs.size()=1 2024-09-12T00:38:36.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.060+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.22Isv8b1bX88jKmpaGlxAAUbDUeUYT4_0 2024-09-12T00:38:36.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.060+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10640309805379676046', time=2024-09-12T02:31:30.909370+0000, chain.objs.size()=1 2024-09-12T00:38:36.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.060+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.9W3cBNbi16aFIT-W_MBQmXDYTXf4ckb_0 2024-09-12T00:38:36.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.060+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13546222225066797429', time=2024-09-12T02:31:30.968299+0000, chain.objs.size()=1 2024-09-12T00:38:36.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.060+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.6o2UOmHKb9gu7tm-Yb9BeKeNnhOHudR_0 2024-09-12T00:38:36.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.060+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3764431837865793794', time=2024-09-12T02:31:30.995779+0000, chain.objs.size()=1 2024-09-12T00:38:36.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.060+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ANsmSwLU6CwKWV31bVqBWrzwDNf1xAT_0 2024-09-12T00:38:36.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.060+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9021896686135260584', time=2024-09-12T02:31:31.231788+0000, chain.objs.size()=1 2024-09-12T00:38:36.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.060+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.E6k2r5Qxbc8EnDAqGjPA9Ii96S7Mtso_0 2024-09-12T00:38:36.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.062+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16056887721082680970', time=2024-09-12T02:31:31.256504+0000, chain.objs.size()=1 2024-09-12T00:38:36.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.062+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.qB9JpcNLAQ6frJhoQWDXXsRSOyjMnCz_0 2024-09-12T00:38:36.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.066+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/53504 2024-09-12T00:38:36.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T00:38:36.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18442655666642147927', time=2024-09-12T02:31:31.405827+0000, chain.objs.size()=1 2024-09-12T00:38:36.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.p-NQrhZ4KKJAXOvqO4AvO2o3MFUCSWI_0 2024-09-12T00:38:36.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7227779555206590141', time=2024-09-12T02:31:31.413620+0000, chain.objs.size()=1 2024-09-12T00:38:36.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._sxBvcSa886bdwrS_vlSqBY3VpZN5El_0 2024-09-12T00:38:36.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14958632426976236236', time=2024-09-12T02:31:31.435357+0000, chain.objs.size()=1 2024-09-12T00:38:36.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.MNLPz72i1B-K3t4hhXCf0vhNTaDeOa1_0 2024-09-12T00:38:36.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4874638788044095133', time=2024-09-12T02:31:31.469465+0000, chain.objs.size()=1 2024-09-12T00:38:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.C9rN07STrDJDtmzdhP768yH3I-7Zg4F_0 2024-09-12T00:38:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7128323369603412114', time=2024-09-12T02:31:31.510908+0000, chain.objs.size()=1 2024-09-12T00:38:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.RM6tLTUBg10Z0wqTZD6y5hQ9efrYhqT_0 2024-09-12T00:38:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2171749916578271934', time=2024-09-12T02:31:31.552240+0000, chain.objs.size()=1 2024-09-12T00:38:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.glWub3W6YPJgnvGplqm-glt14nIYRIP_0 2024-09-12T00:38:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11223600104391360060', time=2024-09-12T02:31:31.666826+0000, chain.objs.size()=1 2024-09-12T00:38:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.fWld184VIclnPh8hXxsYYBURA1207hh_0 2024-09-12T00:38:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13547293655992875413', time=2024-09-12T02:31:34.106232+0000, chain.objs.size()=1 2024-09-12T00:38:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.334__shadow_.bkRRq84VMOaFLgRLNTXgt2EiX6hohus_0 2024-09-12T00:38:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6430298538112266756', time=2024-09-12T02:31:38.204100+0000, chain.objs.size()=1 2024-09-12T00:38:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.353__shadow_.Rwh0UN1w2XnPZQQp-4FK5KmgB92rBPq_0 2024-09-12T00:38:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8590899484895553485', time=2024-09-12T02:31:44.019372+0000, chain.objs.size()=1 2024-09-12T00:38:36.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.377__shadow_.1i0-YpaD_M2kI3Wg2sfhmNpw1oENT2G_0 2024-09-12T00:38:36.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12421317433892199987', time=2024-09-12T02:31:47.478462+0000, chain.objs.size()=1 2024-09-12T00:38:36.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.390__shadow_.TA97cCL4CAIFEwfRKM1Sfg1W3PVBpl3_0 2024-09-12T00:38:36.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.069+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11678388941308706202', time=2024-09-12T02:31:53.441700+0000, chain.objs.size()=1 2024-09-12T00:38:36.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.069+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.408__shadow_.HWRWrRy2wr-degUOLvaQEohzxp_eYiT_0 2024-09-12T00:38:36.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.072+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15701176098216037880', time=2024-09-12T02:32:02.475277+0000, chain.objs.size()=1 2024-09-12T00:38:36.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.073+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.444__shadow_.XhOX24yMi2sMonMbPg_PrO7fY3HKtx4_0 2024-09-12T00:38:36.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.073+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10274051513580166073', time=2024-09-12T02:32:09.205434+0000, chain.objs.size()=1 2024-09-12T00:38:36.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.073+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.465__shadow_.HLBC5ztJFErRQsheTmh1Kjr2aa4_IVO_0 2024-09-12T00:38:36.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.073+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7122343160666559692', time=2024-09-12T02:32:12.596856+0000, chain.objs.size()=1 2024-09-12T00:38:36.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.073+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.483__shadow_.FUeYK6hL-DEKKeqIGu0jFaot4-ZOtda_0 2024-09-12T00:38:36.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.073+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12313832055482333271', time=2024-09-12T02:32:31.577540+0000, chain.objs.size()=1 2024-09-12T00:38:36.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.073+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.523__multipart_mymultipart.2~2hzeERKNR4ofZulOouhwIXjw_pVpAVn.1 2024-09-12T00:38:36.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.073+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2248084432957686011', time=2024-09-12T02:32:32.817471+0000, chain.objs.size()=1 2024-09-12T00:38:36.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.074+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.525__multipart_mymultipart.2~bLQClvMybHuDZXr7zG8Xz8f8OaDAtYn.1 2024-09-12T00:38:36.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.074+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12473025937652918701', time=2024-09-12T02:33:07.663457+0000, chain.objs.size()=1 2024-09-12T00:38:36.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.074+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.556__shadow_.xTUFathbSvp1xGbO1PXPCwFZOvlzBvS_0 2024-09-12T00:38:36.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.074+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17704316148449434661', time=2024-09-12T02:33:17.073506+0000, chain.objs.size()=1 2024-09-12T00:38:36.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.074+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:54UT3LroLvauYaqcq-8cM.qm5iX7WE7_.-1js4JVlYnRrvQj-lw4Ly_TaudYORqy_0 2024-09-12T00:38:36.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.074+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8565237694153317650', time=2024-09-12T02:33:18.863694+0000, chain.objs.size()=1 2024-09-12T00:38:36.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.074+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:PBpyIIo8G1RFiXF-yrdgdDcGEWvONSS_.LgON5YNcPJWJk3lugxI9xm1GnUpmO4c_0 2024-09-12T00:38:36.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.074+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14537418095330761157', time=2024-09-12T02:33:20.307135+0000, chain.objs.size()=1 2024-09-12T00:38:36.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.074+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:mAhLRBs1Io4XX94OcKroLCeeRi0xZt._.uYLEYw1LjD_sbW3ue1aS8wgBw1fVh9H_0 2024-09-12T00:38:36.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.074+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16758402897945291618', time=2024-09-12T02:33:25.859645+0000, chain.objs.size()=1 2024-09-12T00:38:36.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.074+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.574__shadow:eP6fUv9GbyhBCYDJkI-N4qRJ2ABCE7k_.IHdvc3cVg51-oWo3htX52_4KzPTdvYO_0 2024-09-12T00:38:36.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.074+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10637719372220591277', time=2024-09-12T02:33:27.202454+0000, chain.objs.size()=1 2024-09-12T00:38:36.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.074+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.575__shadow:9iKGIPQ7GGf1h7-uG7mLYQIjH3yE2sy_.S3ChqTqIpWZtrfPsMyZgmQYz4A8IA8B_0 2024-09-12T00:38:36.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.076+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1628772803165339181', time=2024-09-12T02:33:32.651922+0000, chain.objs.size()=1 2024-09-12T00:38:36.074 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.076+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:QYYGpsg4sVxipOS90b8ctp41IIWIe3H_.Hmv506u_mHdflqEGNdJr6n_6x9PLvJx_0 2024-09-12T00:38:36.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.078+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3314948261230390827', time=2024-09-12T02:33:37.653817+0000, chain.objs.size()=1 2024-09-12T00:38:36.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.078+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:xLJ3a0NHFMotPqMMxXZu54weXm-wac3_.zDxd1ginVT5Uc_vUr_pAiI6_Nb8hXb6_0 2024-09-12T00:38:36.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.078+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14274907880460025357', time=2024-09-12T02:33:46.927624+0000, chain.objs.size()=1 2024-09-12T00:38:36.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.078+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.580__shadow:DJxLvk8A0Zn.aFUc13TGW-E5szu48Ng_.THsIllK1Y10ISbWJNjN56vDHgAHL5BK_0 2024-09-12T00:38:36.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.078+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6675504516456754534', time=2024-09-12T02:36:17.957986+0000, chain.objs.size()=1 2024-09-12T00:38:36.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.078+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.670__shadow_.JLqguRTRlipuR3NYtJgeByenwVs8D0A_0 2024-09-12T00:38:36.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.078+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1862676306234960861', time=2024-09-12T02:36:23.785218+0000, chain.objs.size()=1 2024-09-12T00:38:36.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.078+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.696__shadow:U0FvLg072dwFONqErbaRgYAE3TUPU.h_.dSVuP1XE1zXPiA58QIZ8dPUjSkLKsxg_0 2024-09-12T00:38:36.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.078+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16892583278957910112', time=2024-09-12T02:36:26.793124+0000, chain.objs.size()=1 2024-09-12T00:38:36.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.078+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.707__shadow:weKurL2ivyejWRp-CAWbQnhmKkXH5kq_.M7w5utHhjksfTXAAcwCNepTf1DJpsGS_0 2024-09-12T00:38:36.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.078+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.106660175590745612', time=2024-09-12T02:36:54.107044+0000, chain.objs.size()=10 2024-09-12T00:38:36.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.078+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.735__multipart_foo.2~zsgDONCTQ45gHRhIPQ9PSJyPZ2Cnno3.1 2024-09-12T00:38:36.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.080+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.735__multipart_foo.2~zsgDONCTQ45gHRhIPQ9PSJyPZ2Cnno3.2 2024-09-12T00:38:36.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.080+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.735__multipart_foo.2~zsgDONCTQ45gHRhIPQ9PSJyPZ2Cnno3.3 2024-09-12T00:38:36.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.080+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.735__multipart_foo.2~zsgDONCTQ45gHRhIPQ9PSJyPZ2Cnno3.4 2024-09-12T00:38:36.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.080+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.735__multipart_foo.2~zsgDONCTQ45gHRhIPQ9PSJyPZ2Cnno3.5 2024-09-12T00:38:36.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.080+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.735__multipart_foo.2~zsgDONCTQ45gHRhIPQ9PSJyPZ2Cnno3.6 2024-09-12T00:38:36.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.082+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.735__multipart_foo.2~zsgDONCTQ45gHRhIPQ9PSJyPZ2Cnno3.7 2024-09-12T00:38:36.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.735__multipart_foo.2~zsgDONCTQ45gHRhIPQ9PSJyPZ2Cnno3.8 2024-09-12T00:38:36.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.735__multipart_foo.2~zsgDONCTQ45gHRhIPQ9PSJyPZ2Cnno3.9 2024-09-12T00:38:36.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.735__multipart_foo.2~zsgDONCTQ45gHRhIPQ9PSJyPZ2Cnno3.10 2024-09-12T00:38:36.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.084+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9282787720024374409', time=2024-09-12T02:38:23.549582+0000, chain.objs.size()=1 2024-09-12T00:38:36.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.084+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.782__shadow_.nNsgd4vWjxKGM3ePC8WW9kaPKKtDKOD_0 2024-09-12T00:38:36.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.088+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:36.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.090+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:38:36.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.092+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:36.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.092+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:36.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53226' 2024-09-12T00:38:36.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6561428980998837553', time=2024-09-12T02:30:37.245981+0000, chain.objs.size()=1 2024-09-12T00:38:36.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.230__shadow_.LsWxDQdU-yD-t0t9MXcoUiPTpop1kTm_0 2024-09-12T00:38:36.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2488882503412071159', time=2024-09-12T02:30:38.525877+0000, chain.objs.size()=1 2024-09-12T00:38:36.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.235__shadow_.SBpbW04uw51ZqSFPpqL9g3Y24TrNuLf_0 2024-09-12T00:38:36.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6964514100933974718', time=2024-09-12T02:30:38.527100+0000, chain.objs.size()=1 2024-09-12T00:38:36.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.235__shadow_.l1Tn2VnqGIWlm39IUrFfZNtgtomwknH_0 2024-09-12T00:38:36.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2328411610097042055', time=2024-09-12T02:30:39.099190+0000, chain.objs.size()=1 2024-09-12T00:38:36.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.237__shadow_.fk6vIg98BnZreVBXM5wlvYa0BuNjCg8_0 2024-09-12T00:38:36.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17126559285937825978', time=2024-09-12T02:30:40.071094+0000, chain.objs.size()=1 2024-09-12T00:38:36.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.241__shadow_.zt20WbYQUDCXitouT7aGeq7A8MFA49z_0 2024-09-12T00:38:36.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10438356539171696684', time=2024-09-12T02:30:40.349272+0000, chain.objs.size()=1 2024-09-12T00:38:36.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.242__shadow_.2p88GqA-5TFsVgWjTu4z3KNzLCx9U6M_0 2024-09-12T00:38:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9806784474954875451', time=2024-09-12T02:30:43.404614+0000, chain.objs.size()=1 2024-09-12T00:38:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.254__shadow_.0VWayarpbJLI6JDMMmRnO_affH319of_0 2024-09-12T00:38:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16100798264147987770', time=2024-09-12T02:30:53.125574+0000, chain.objs.size()=1 2024-09-12T00:38:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Xu48ovrgZf0yYqH6A0sJ3t69I5d5tip_0 2024-09-12T00:38:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11833299537187977045', time=2024-09-12T02:30:53.185006+0000, chain.objs.size()=1 2024-09-12T00:38:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Zsy1U5bOmFAw_yyKyLJVh1rVrmvhzeT_0 2024-09-12T00:38:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10738506093269503550', time=2024-09-12T02:30:53.213322+0000, chain.objs.size()=1 2024-09-12T00:38:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.izJi347U0YffYlUL8wFQyRHN_dwBovU_0 2024-09-12T00:38:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14385678563045588570', time=2024-09-12T02:30:53.279648+0000, chain.objs.size()=1 2024-09-12T00:38:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.rz3NPwlGGZRzlyWMxX-MLHb_fEkn9at_0 2024-09-12T00:38:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10567789206855032999', time=2024-09-12T02:30:53.511017+0000, chain.objs.size()=1 2024-09-12T00:38:36.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.094+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.aL4rLsEZmzulIvrr52VpWiSeqRD3Hxb_0 2024-09-12T00:38:36.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.099+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3365864522008924275', time=2024-09-12T02:30:53.673342+0000, chain.objs.size()=1 2024-09-12T00:38:36.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.099+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.H3nigt8-lttqGpANibFpsy2MK6Onw0S_0 2024-09-12T00:38:36.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.099+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7335888060937934761', time=2024-09-12T02:30:53.711233+0000, chain.objs.size()=1 2024-09-12T00:38:36.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.099+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.WDyRHTuMlT94bNQfbMCMwDs1ALsZecQ_0 2024-09-12T00:38:36.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.099+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3666026132174274283', time=2024-09-12T02:30:53.723604+0000, chain.objs.size()=1 2024-09-12T00:38:36.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.099+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.5ARycQg4uW6x2Bv2jnJ2XfXNQ84oFqR_0 2024-09-12T00:38:36.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.099+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7418988898122559599', time=2024-09-12T02:30:53.731676+0000, chain.objs.size()=1 2024-09-12T00:38:36.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.099+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pllF1ezCyCrwrOs2sSADX7_rjzOYT-5_0 2024-09-12T00:38:36.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.100+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17138624521161141299', time=2024-09-12T02:30:53.750060+0000, chain.objs.size()=1 2024-09-12T00:38:36.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.100+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.l1SMabFSFJa_bjjXItgW7JGBwfUO9qc_0 2024-09-12T00:38:36.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.100+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4942327682349238718', time=2024-09-12T02:30:53.790117+0000, chain.objs.size()=1 2024-09-12T00:38:36.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.100+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Y8a3TkR1sLujVnQRxKrwpjP3lPbSvt6_0 2024-09-12T00:38:36.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.100+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8816552525301794362', time=2024-09-12T02:30:53.796101+0000, chain.objs.size()=1 2024-09-12T00:38:36.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.100+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.y3iipprRS28VKRaMefuJg8LQ0YfE8C__0 2024-09-12T00:38:36.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.100+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6306798065550654689', time=2024-09-12T02:30:53.815068+0000, chain.objs.size()=1 2024-09-12T00:38:36.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.100+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.XF1bMPR7F1d4nQ2QLsjTBsqFB5Tu0aJ_0 2024-09-12T00:38:36.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.100+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13045759641984608454', time=2024-09-12T02:30:54.066063+0000, chain.objs.size()=1 2024-09-12T00:38:36.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.100+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.vPXFmfTxdaVl3_7EeBKcSVHiQDgOnj8_0 2024-09-12T00:38:36.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.100+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11035008725590299637', time=2024-09-12T02:30:54.071720+0000, chain.objs.size()=1 2024-09-12T00:38:36.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.100+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.yTS1K9cDvP18e55EcLcfbeqawwVGhiu_0 2024-09-12T00:38:36.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.101+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5663602957928812171', time=2024-09-12T02:30:54.150240+0000, chain.objs.size()=1 2024-09-12T00:38:36.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.101+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2Ho4Uoe9wi9XP3iC9cL4baW7GOOF6ra_0 2024-09-12T00:38:36.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.104+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1900222690904907016', time=2024-09-12T02:30:54.164691+0000, chain.objs.size()=1 2024-09-12T00:38:36.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.104+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.__SGMlXwqdq4M8V3wCgsNtgXZayQ5K1_0 2024-09-12T00:38:36.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.105+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17029224070567186037', time=2024-09-12T02:30:54.296454+0000, chain.objs.size()=1 2024-09-12T00:38:36.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.105+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.kxyl122jbVtwbRZJJlNQs38S-2HVsTF_0 2024-09-12T00:38:36.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.105+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9359343669470498222', time=2024-09-12T02:30:54.310202+0000, chain.objs.size()=1 2024-09-12T00:38:36.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.105+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.N02HtXkCZGmqGfeohyYi_wpcofQNc80_0 2024-09-12T00:38:36.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.106+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10779347995627317476', time=2024-09-12T02:30:54.430970+0000, chain.objs.size()=1 2024-09-12T00:38:36.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.106+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.0F3qofJgBy6zUc8pgc4PYjh9kSlRG-a_0 2024-09-12T00:38:36.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.106+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1239485549736621268', time=2024-09-12T02:30:54.453430+0000, chain.objs.size()=1 2024-09-12T00:38:36.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.106+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.4f9JWsi2IDnPDOe2UifOFXatOT56WOR_0 2024-09-12T00:38:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.107+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2421266523189825089', time=2024-09-12T02:30:54.552417+0000, chain.objs.size()=1 2024-09-12T00:38:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.107+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.u-PS0yWtsK7KeEAnHGytB1bShqXntpg_0 2024-09-12T00:38:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.107+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11864135573504519431', time=2024-09-12T02:30:54.594602+0000, chain.objs.size()=1 2024-09-12T00:38:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.107+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.28S2mxwm4sEeSljgKh7F8eBXdxOMDu5_0 2024-09-12T00:38:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.107+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16115707129276314725', time=2024-09-12T02:30:54.686900+0000, chain.objs.size()=1 2024-09-12T00:38:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.107+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-8IgGgkrpI1RTtKAXxy1UAba8dBcbH5_0 2024-09-12T00:38:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.107+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12507390856236555462', time=2024-09-12T02:30:54.692932+0000, chain.objs.size()=1 2024-09-12T00:38:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.107+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.7ojahsIO3xCTNfVbN2WfYx4CKKHQ4vz_0 2024-09-12T00:38:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.107+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1147454123610097391', time=2024-09-12T02:30:54.695427+0000, chain.objs.size()=1 2024-09-12T00:38:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.107+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.GV8isgVL_CHoOPPUn2wcuLwXFL12Vo2_0 2024-09-12T00:38:36.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.107+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.110129692355334061', time=2024-09-12T02:30:54.912232+0000, chain.objs.size()=1 2024-09-12T00:38:36.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.107+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6ULmwvBFG8D4jM9c7Ov6Uw0tdr12u4__0 2024-09-12T00:38:36.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.108+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16625751951722897389', time=2024-09-12T02:30:54.983178+0000, chain.objs.size()=1 2024-09-12T00:38:36.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.108+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.H_uGKoklHz_MZ7Oqtq4VBc-Udc-WKoz_0 2024-09-12T00:38:36.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.109+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18323851324448936979', time=2024-09-12T02:30:55.162364+0000, chain.objs.size()=1 2024-09-12T00:38:36.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.109+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.VaBIy_E-X4cm6QAQxHX7v0NzNYcxq8e_0 2024-09-12T00:38:36.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.109+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10392916005113565098', time=2024-09-12T02:30:55.201603+0000, chain.objs.size()=1 2024-09-12T00:38:36.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.109+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lOULJaGtSVHQ2IZQ4QK-pCRRDhpvzEA_0 2024-09-12T00:38:36.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.111+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1766804964613215548', time=2024-09-12T02:30:58.345156+0000, chain.objs.size()=1 2024-09-12T00:38:36.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.111+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.275__shadow_.JCVYh1BC7-XaUmwIaluhe5UjHoi1yeQ_0 2024-09-12T00:38:36.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.111+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8382978250503320607', time=2024-09-12T02:31:00.866908+0000, chain.objs.size()=1 2024-09-12T00:38:36.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.111+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.285__shadow_.yBtnjcew-FHn8mpokz31Jt2Ur9P5Pzq_0 2024-09-12T00:38:36.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.111+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4157153144236619314', time=2024-09-12T02:31:03.074260+0000, chain.objs.size()=1 2024-09-12T00:38:36.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.111+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.2TwKxe67BL2cYGFRJEStmq-jHGjxt_p_0 2024-09-12T00:38:36.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.112+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2558482872838044515', time=2024-09-12T02:31:03.667856+0000, chain.objs.size()=1 2024-09-12T00:38:36.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.112+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.T63YucO44TasEVtiezWPiHoNZOLfnlS_0 2024-09-12T00:38:36.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.112+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8894697197730648864', time=2024-09-12T02:31:03.672286+0000, chain.objs.size()=1 2024-09-12T00:38:36.110 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.112+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.QNENbuVBZudYyD_h1ZKnJI5_2OJXlth_0 2024-09-12T00:38:36.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.113+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11367868903510180673', time=2024-09-12T02:31:03.678830+0000, chain.objs.size()=1 2024-09-12T00:38:36.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.113+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.8mOde_YfsU2hj8blB1MAtvzEKAGTAW5_0 2024-09-12T00:38:36.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.113+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3292541610872488651', time=2024-09-12T02:31:05.976600+0000, chain.objs.size()=1 2024-09-12T00:38:36.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.113+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.302__shadow_.UbPBUV7lZZ-F35H6DitQWc6D5UQwn7y_0 2024-09-12T00:38:36.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.113+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5988872447602037559', time=2024-09-12T02:31:10.170756+0000, chain.objs.size()=1 2024-09-12T00:38:36.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.113+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.319__shadow:SEk6xfWsrIV.vMzdM3Ts2ideRaxiDRe_.nmhSNmlkXFghE6FLfoff955BRyFDSr2_0 2024-09-12T00:38:36.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.113+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10339828546214381541', time=2024-09-12T02:31:19.350642+0000, chain.objs.size()=1 2024-09-12T00:38:36.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.113+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.uoe9nvSpv4_PGCAdwQPr6UKkQCTYS5X_0 2024-09-12T00:38:36.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.115+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16258492576817148806', time=2024-09-12T02:31:19.351469+0000, chain.objs.size()=1 2024-09-12T00:38:36.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.115+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.c3yqYhk6bIqRomDCAVhr66jZtg5TTYB_0 2024-09-12T00:38:36.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.115+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16732035730614211173', time=2024-09-12T02:31:19.371414+0000, chain.objs.size()=1 2024-09-12T00:38:36.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.115+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.wBkn8SQhMarAsnhHqL_9f5rqXjULbhv_0 2024-09-12T00:38:36.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.117+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.468156009322879914', time=2024-09-12T02:31:19.386095+0000, chain.objs.size()=1 2024-09-12T00:38:36.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.117+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.5I2FaAtJWvfwYoFIw28JJCKmfD_ia8D_0 2024-09-12T00:38:36.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.117+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5236082690920258183', time=2024-09-12T02:31:19.431496+0000, chain.objs.size()=1 2024-09-12T00:38:36.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.117+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ta1hi7Dv3taw4i7035tlr32-213sKCe_0 2024-09-12T00:38:36.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.117+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2317925266599383589', time=2024-09-12T02:31:19.512489+0000, chain.objs.size()=1 2024-09-12T00:38:36.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.117+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.K9V90us85xFUbnuXEmANhkyahfzW8Z6_0 2024-09-12T00:38:36.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.117+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13629060270473471398', time=2024-09-12T02:31:19.680070+0000, chain.objs.size()=1 2024-09-12T00:38:36.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.117+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.XDtaSvHwJ-ZURGPXHIUAYfRmh35gbn3_0 2024-09-12T00:38:36.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.117+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2621204705970102436', time=2024-09-12T02:31:19.738253+0000, chain.objs.size()=1 2024-09-12T00:38:36.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.117+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.bIMoDHTgr1p-EzsGgrpXsMa5Zr7T9QC_0 2024-09-12T00:38:36.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.119+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2975388564801873695', time=2024-09-12T02:31:19.965852+0000, chain.objs.size()=1 2024-09-12T00:38:36.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.119+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.gTP2vVsjJj40zCq1bTGLa8ffbmRu3iW_0 2024-09-12T00:38:36.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.119+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17450706446776736829', time=2024-09-12T02:31:20.056673+0000, chain.objs.size()=1 2024-09-12T00:38:36.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.119+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7Dt7Fzb-f-8RcElqbYZQR9DHF-Zjxlt_0 2024-09-12T00:38:36.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.119+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16524980218079646603', time=2024-09-12T02:31:20.059238+0000, chain.objs.size()=1 2024-09-12T00:38:36.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.119+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NiwvIoZqps45R7nAcFv_fGnTGI-Vv_8_0 2024-09-12T00:38:36.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.119+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8799876744045631331', time=2024-09-12T02:31:20.086318+0000, chain.objs.size()=1 2024-09-12T00:38:36.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.119+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ehqnif5kpRaOp1y86-668PljRQX3aD5_0 2024-09-12T00:38:36.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.122+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.32106574894637524', time=2024-09-12T02:31:20.342316+0000, chain.objs.size()=1 2024-09-12T00:38:36.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.122+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.lrFmezLTksR9gBrvXeBLXETqCPS-1BE_0 2024-09-12T00:38:36.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.122+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.196591782216693000', time=2024-09-12T02:31:20.430110+0000, chain.objs.size()=1 2024-09-12T00:38:36.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.122+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.d9zJjRa_pgKH_o8ConQFmWM8YDEMOvw_0 2024-09-12T00:38:36.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.124+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12533530852379698949', time=2024-09-12T02:31:20.435981+0000, chain.objs.size()=1 2024-09-12T00:38:36.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.124+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.fCO6xCIf_WLrQ7qsmpEwliZOEfBh9OC_0 2024-09-12T00:38:36.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.124+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9414489301393956433', time=2024-09-12T02:31:20.652422+0000, chain.objs.size()=1 2024-09-12T00:38:36.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.124+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.AUzWYbsXOif3OIVBWjhb4XTaY0yF-qm_0 2024-09-12T00:38:36.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.124+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14538632867617092791', time=2024-09-12T02:31:20.672163+0000, chain.objs.size()=1 2024-09-12T00:38:36.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.124+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.giD1KTJO2UtgqE-_-63H3I8m1diIKWQ_0 2024-09-12T00:38:36.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.124+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9160570059005929568', time=2024-09-12T02:31:20.691290+0000, chain.objs.size()=1 2024-09-12T00:38:36.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.124+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NXxtXPklShLsB4pQRZfXWDXLxJWTYA9_0 2024-09-12T00:38:36.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.124+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11017115637997287238', time=2024-09-12T02:31:20.753046+0000, chain.objs.size()=1 2024-09-12T00:38:36.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.124+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.tpRhrVKsPSMEpAVbW6QuF0XVmrAXwtx_0 2024-09-12T00:38:36.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.124+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11577683520331943603', time=2024-09-12T02:31:20.862395+0000, chain.objs.size()=1 2024-09-12T00:38:36.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.124+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Z9sPI0wfbplmkhtFg-I66XrVqBgy2zK_0 2024-09-12T00:38:36.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.124+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2371418598789200046', time=2024-09-12T02:31:20.871364+0000, chain.objs.size()=1 2024-09-12T00:38:36.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.124+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ADoCFLTZsyR080ZLpusajyMg5p_dBiE_0 2024-09-12T00:38:36.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.125+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6011457400627551419', time=2024-09-12T02:31:20.900246+0000, chain.objs.size()=1 2024-09-12T00:38:36.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.125+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Dz5zsMooZq1wwGi6d1biOrYg9Ak-WRR_0 2024-09-12T00:38:36.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.125+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7144958389153476752', time=2024-09-12T02:31:20.928658+0000, chain.objs.size()=1 2024-09-12T00:38:36.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.125+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ICmsC_8oawmwwHsdO15HrnmT-iZCI_v_0 2024-09-12T00:38:36.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.125+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4058119810062672411', time=2024-09-12T02:31:20.984480+0000, chain.objs.size()=1 2024-09-12T00:38:36.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.125+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.KqS5p7zR2nHKX5u031zrD4U4fl3ieMC_0 2024-09-12T00:38:36.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.126+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7604382547816380059', time=2024-09-12T02:31:20.985216+0000, chain.objs.size()=1 2024-09-12T00:38:36.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.126+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.lZUFp71rqwW-sO2mfZ5jO-aR4bWe7kr_0 2024-09-12T00:38:36.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.130+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17809614866735406474', time=2024-09-12T02:31:21.043125+0000, chain.objs.size()=1 2024-09-12T00:38:36.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.GHRnrybJSJifFfui_PTE5CKB6pPcewx_0 2024-09-12T00:38:36.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.130+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5796686760785048051', time=2024-09-12T02:31:21.200387+0000, chain.objs.size()=1 2024-09-12T00:38:36.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Zu1B5IjX8kV5PlP4gPtiO_9kYrN9gtj_0 2024-09-12T00:38:36.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.130+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13969310265890152628', time=2024-09-12T02:31:21.225366+0000, chain.objs.size()=1 2024-09-12T00:38:36.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Rda6DkqOpJvUoSvNmZvUj6o0n86KG9V_0 2024-09-12T00:38:36.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.130+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5744678523943602768', time=2024-09-12T02:31:21.230978+0000, chain.objs.size()=1 2024-09-12T00:38:36.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.q55Jgo-CkkNdVi-nRqXk5-JklM7Xt9Q_0 2024-09-12T00:38:36.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.130+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2458039395376553850', time=2024-09-12T02:31:21.335185+0000, chain.objs.size()=1 2024-09-12T00:38:36.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.oT7PHPafiWlLChhmh_pAC_71M88f3rt_0 2024-09-12T00:38:36.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.130+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15739227227097489861', time=2024-09-12T02:31:21.540095+0000, chain.objs.size()=1 2024-09-12T00:38:36.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ojcB1zq-hcwEV6B4nl8OnsQiA5q1sPU_0 2024-09-12T00:38:36.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.131+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14438791435465132929', time=2024-09-12T02:31:21.638855+0000, chain.objs.size()=1 2024-09-12T00:38:36.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.131+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.mhnGFA3t9uRkh0qeowDAK9Tr_Dkxg29_0 2024-09-12T00:38:36.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.132+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13267272565659752154', time=2024-09-12T02:31:21.654032+0000, chain.objs.size()=1 2024-09-12T00:38:36.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.132+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IRzazibLsJmH_oQGpNgxX7e6lroYoNf_0 2024-09-12T00:38:36.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.132+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4376766498533444675', time=2024-09-12T02:31:29.690148+0000, chain.objs.size()=1 2024-09-12T00:38:36.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.132+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Gq0KyrwfQBSYN9mLHTsr8B_YNHgkKqK_0 2024-09-12T00:38:36.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.132+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2634516724121501809', time=2024-09-12T02:31:29.726676+0000, chain.objs.size()=1 2024-09-12T00:38:36.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.132+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.IiOJ9_r6lFhgDpWv52EyPcEEAV3UHUZ_0 2024-09-12T00:38:36.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.132+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5399082085628807989', time=2024-09-12T02:31:29.731414+0000, chain.objs.size()=1 2024-09-12T00:38:36.131 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.132+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ZnPzbdlmwJ4qoqV190TLykYSetAekTC_0 2024-09-12T00:38:36.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.135+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16075233544721228441', time=2024-09-12T02:31:29.752418+0000, chain.objs.size()=1 2024-09-12T00:38:36.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.135+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.2e5xf-RAiItU6l0viFHubZj1joYMbs5_0 2024-09-12T00:38:36.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.135+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11288674268717276828', time=2024-09-12T02:31:29.796875+0000, chain.objs.size()=1 2024-09-12T00:38:36.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.135+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.63ls5HJ67p1-C4WZGuqwDMuT2FauhKd_0 2024-09-12T00:38:36.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.135+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6469996194246142827', time=2024-09-12T02:31:29.852810+0000, chain.objs.size()=1 2024-09-12T00:38:36.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.135+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.iYaAq8juKjEmpfgXyrTTj_ZaMYdFK9u_0 2024-09-12T00:38:36.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16919879139302458990', time=2024-09-12T02:31:30.138570+0000, chain.objs.size()=1 2024-09-12T00:38:36.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.tYyFYfFfan3idfIy59Ppyt9wdBvy9KP_0 2024-09-12T00:38:36.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6726900996991620548', time=2024-09-12T02:31:30.144432+0000, chain.objs.size()=1 2024-09-12T00:38:36.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.bzZQw9NXNpsk81_XnJApgmVpGmObme0_0 2024-09-12T00:38:36.137 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10462127739235024979', time=2024-09-12T02:31:30.178862+0000, chain.objs.size()=1 2024-09-12T00:38:36.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-WHvALdoiMf5TWrCTOhZHnu6NQujckQ_0 2024-09-12T00:38:36.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7877384674653465760', time=2024-09-12T02:31:30.302829+0000, chain.objs.size()=1 2024-09-12T00:38:36.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.BCH_TcHVETcFJa-_nX2Jm6ZJD0KjwS6_0 2024-09-12T00:38:36.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5492133853645616174', time=2024-09-12T02:31:30.624909+0000, chain.objs.size()=1 2024-09-12T00:38:36.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.RpMeC9Fghgeu5yTD24yKOu2kz7L-Zdd_0 2024-09-12T00:38:36.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.30334315785674384', time=2024-09-12T02:31:30.684360+0000, chain.objs.size()=1 2024-09-12T00:38:36.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.rflM2mtlz3FMBm_Rej9HfPdVGySbK9m_0 2024-09-12T00:38:36.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3851034528876811549', time=2024-09-12T02:31:30.694703+0000, chain.objs.size()=1 2024-09-12T00:38:36.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Aca1cwRloashwEwYmnBnyz5lWAYIN7R_0 2024-09-12T00:38:36.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5026439285719627937', time=2024-09-12T02:31:30.734364+0000, chain.objs.size()=1 2024-09-12T00:38:36.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.139+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.vlYVTzo-mSDOBeIHyqoZ7kADbVgqQxS_0 2024-09-12T00:38:36.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.140+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6083161349827377661', time=2024-09-12T02:31:30.765617+0000, chain.objs.size()=1 2024-09-12T00:38:36.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.140+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.4f8MPOdiAH3tlkVVpROCBwaPSRzQDz-_0 2024-09-12T00:38:36.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.140+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4810457101283990600', time=2024-09-12T02:31:30.771766+0000, chain.objs.size()=1 2024-09-12T00:38:36.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.140+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.fosMZM7jmZuYxHmBMDdAQOJ4m3zpci1_0 2024-09-12T00:38:36.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.140+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14615497681315886135', time=2024-09-12T02:31:30.873415+0000, chain.objs.size()=1 2024-09-12T00:38:36.140 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.140+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.WRF5BcDh6dJRZL9cLCEPrk2gaepFiih_0 2024-09-12T00:38:36.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.144+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12982800482134971338', time=2024-09-12T02:31:30.883409+0000, chain.objs.size()=1 2024-09-12T00:38:36.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.144+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.WWfGavU91osg3nQcKc8eU6N_i6gXF3Q_0 2024-09-12T00:38:36.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.144+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1104961117676394032', time=2024-09-12T02:31:30.885461+0000, chain.objs.size()=1 2024-09-12T00:38:36.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.144+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.hAAWZiri9UzqXWAp8n7vn5LP4lgodwK_0 2024-09-12T00:38:36.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.144+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18187430782633621187', time=2024-09-12T02:31:30.914352+0000, chain.objs.size()=1 2024-09-12T00:38:36.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.144+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.nUmUO7My1Fjg1s4o-ieJhxN0mBroTWj_0 2024-09-12T00:38:36.142 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.144+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1254931579890792990', time=2024-09-12T02:31:31.033245+0000, chain.objs.size()=1 2024-09-12T00:38:36.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.144+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.bYhLI09qnYRrfE8yhkKIKh_WASFYtgk_0 2024-09-12T00:38:36.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.146+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12275887090433292604', time=2024-09-12T02:31:31.258626+0000, chain.objs.size()=1 2024-09-12T00:38:36.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.146+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lzA2hnoDgHp-MDi_Ip5lz867TEgFO_5_0 2024-09-12T00:38:36.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.149+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/53226 2024-09-12T00:38:36.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:38:36.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17813976388615690692', time=2024-09-12T02:31:31.397312+0000, chain.objs.size()=1 2024-09-12T00:38:36.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.p5qWw2Sfiy_vtIE52Bxz-ItVDyPQrXI_0 2024-09-12T00:38:36.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17094203712660664010', time=2024-09-12T02:31:31.481365+0000, chain.objs.size()=1 2024-09-12T00:38:36.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.raE7GhJ_T_lk_xqxsDqNROB9ZNHvDLT_0 2024-09-12T00:38:36.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16943049376396467988', time=2024-09-12T02:31:31.571689+0000, chain.objs.size()=1 2024-09-12T00:38:36.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.afT1FdLuimI2s_0EfJQftH1VGn_NffZ_0 2024-09-12T00:38:36.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12241449736659376153', time=2024-09-12T02:31:31.802374+0000, chain.objs.size()=1 2024-09-12T00:38:36.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.GNTVS9dwjUARjGe6avBxmKRwIAvI__k_0 2024-09-12T00:38:36.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7655563073558191940', time=2024-09-12T02:31:33.133210+0000, chain.objs.size()=1 2024-09-12T00:38:36.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.330__shadow_.odR7W7hHd_aYY5N2WBfrzZoR2amXFWp_0 2024-09-12T00:38:36.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3603492443704404145', time=2024-09-12T02:31:33.584918+0000, chain.objs.size()=1 2024-09-12T00:38:36.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.332__shadow_.tjb9Ov6iHUWlzoXXLg5UOCFUG7-htNy_0 2024-09-12T00:38:36.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3705820453746041243', time=2024-09-12T02:31:36.298759+0000, chain.objs.size()=1 2024-09-12T00:38:36.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.343__shadow_.XPKSo5hEt4LdPxHSb0ZJ6zrmiXhNe_B_0 2024-09-12T00:38:36.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14014568277442282385', time=2024-09-12T02:31:58.439369+0000, chain.objs.size()=1 2024-09-12T00:38:36.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.430__shadow_.Lsjvqa1UFVPp3N8WZ8dDdPOmrZSAudu_0 2024-09-12T00:38:36.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9993232356243645818', time=2024-09-12T02:32:00.412347+0000, chain.objs.size()=1 2024-09-12T00:38:36.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.437__shadow_.DP5VkdNycP4L2vIhz6RL497MCydzwYB_0 2024-09-12T00:38:36.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7388956334068054410', time=2024-09-12T02:32:05.726991+0000, chain.objs.size()=1 2024-09-12T00:38:36.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.456__shadow_.UwAJa-v6dRR6WjvjA6VeE7Nc9oNct4-_0 2024-09-12T00:38:36.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6491081470395226449', time=2024-09-12T02:32:08.811859+0000, chain.objs.size()=1 2024-09-12T00:38:36.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.464__shadow_.NUbIFPQCK5-wMql6iE6UMlgEG5560rt_0 2024-09-12T00:38:36.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~CLisQVm5seG_VmyHY4dhweQb1Dm1xkY', time=2024-09-12T02:32:27.664778+0000, chain.objs.size()=1 2024-09-12T00:38:36.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~CLisQVm5seG_VmyHY4dhweQb1Dm1xkY.2 2024-09-12T00:38:36.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~1OsOBXlOiB_NKedQPOxtwpXYXp0L90O', time=2024-09-12T02:32:36.456362+0000, chain.objs.size()=2 2024-09-12T00:38:36.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.531__multipart_mymultipart.2~1OsOBXlOiB_NKedQPOxtwpXYXp0L90O.1 2024-09-12T00:38:36.154 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.531__multipart_mymultipart.2~1OsOBXlOiB_NKedQPOxtwpXYXp0L90O.2 2024-09-12T00:38:36.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10795488907535619997', time=2024-09-12T02:33:22.978281+0000, chain.objs.size()=1 2024-09-12T00:38:36.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.570__shadow:4GbzHL9MMruXJet99mIRyQYfUw49NQ3_.o3VHrmrJoSXzHcrybZ-hlp2X6sJcoVV_0 2024-09-12T00:38:36.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.607535074464943293', time=2024-09-12T02:33:23.185169+0000, chain.objs.size()=1 2024-09-12T00:38:36.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.571__shadow_.MRRasNw1D2YVufo665aBuzHInp9m_jZ_0 2024-09-12T00:38:36.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9398263498792746822', time=2024-09-12T02:36:17.596369+0000, chain.objs.size()=1 2024-09-12T00:38:36.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.668__shadow_.ridsnQiMKUeXzro-FZqMW8e8N2jkyWf_0 2024-09-12T00:38:36.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11965190377772498765', time=2024-09-12T02:36:18.296144+0000, chain.objs.size()=1 2024-09-12T00:38:36.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.671__shadow_.Ad2Rxw8zlQLBsQl-gKq0XM53VrPkEyZ_0 2024-09-12T00:38:36.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11846947810960323964', time=2024-09-12T02:36:22.283194+0000, chain.objs.size()=1 2024-09-12T00:38:36.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.690__shadow:vX4aQM-UfsxRO6Bgq9-xfolo0mXbwzt_.nkglKcMWdHbrU1MbuVeW4nIHKwzepkN_0 2024-09-12T00:38:36.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16264485060866573770', time=2024-09-12T02:36:23.082985+0000, chain.objs.size()=1 2024-09-12T00:38:36.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.693__shadow:oh3ZEfoF33K8K.o1fiGGKHH8la8ECAG_.n56EFLVQL7fxVgSQmaMVUHkzQQgKJ9I_0 2024-09-12T00:38:36.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.162+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:36.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.164+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:38:36.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.166+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:36.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.166+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:36.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.167+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46154' 2024-09-12T00:38:36.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12127882104386131361', time=2024-09-12T02:29:44.499767+0000, chain.objs.size()=1 2024-09-12T00:38:36.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.200__shadow_.B1ITZrfWnEsMZc1ZpXXiYkLVq7qY3TS_0 2024-09-12T00:38:36.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8580632066184092457', time=2024-09-12T02:30:39.395407+0000, chain.objs.size()=1 2024-09-12T00:38:36.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.238__shadow_.Yx-2P3SKgyifpd-GyXU6JrSAM6i-mTF_0 2024-09-12T00:38:36.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13268042899842299108', time=2024-09-12T02:30:43.167471+0000, chain.objs.size()=1 2024-09-12T00:38:36.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.253__shadow_.i8Qo7qfbItAAEGF6B2gNInlYDb_13V__0 2024-09-12T00:38:36.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4363732349760693490', time=2024-09-12T02:30:45.101881+0000, chain.objs.size()=1 2024-09-12T00:38:36.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.261__shadow_.Lhp6kbrwUnmp7cHvonMM2TnDxlQv1Vs_0 2024-09-12T00:38:36.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10022433983652820393', time=2024-09-12T02:30:53.126154+0000, chain.objs.size()=1 2024-09-12T00:38:36.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HtrFJWgjRwVrdIXWzdbUjkNDojIi8o4_0 2024-09-12T00:38:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16389524878933000697', time=2024-09-12T02:30:53.130004+0000, chain.objs.size()=1 2024-09-12T00:38:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.meFp8rnFsLcgrMQY3_i5Xd9OQdOA-F7_0 2024-09-12T00:38:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4157541339303523118', time=2024-09-12T02:30:53.178659+0000, chain.objs.size()=1 2024-09-12T00:38:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_._sQbZsRdChOUSBcxMVoXVMp6PoZBoKR_0 2024-09-12T00:38:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5471673914595993399', time=2024-09-12T02:30:53.222789+0000, chain.objs.size()=1 2024-09-12T00:38:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.OZro8e1hjZSedsN8EF7oktr5Uj1OhX7_0 2024-09-12T00:38:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6969476182053493069', time=2024-09-12T02:30:53.258889+0000, chain.objs.size()=1 2024-09-12T00:38:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.frvTt4cqQ1KbR4CeW-Jns_MsQrALOFX_0 2024-09-12T00:38:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2594286545857760357', time=2024-09-12T02:30:53.417039+0000, chain.objs.size()=1 2024-09-12T00:38:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ISMTIh-rAtBaXaUzWshZlfFR6czPpQj_0 2024-09-12T00:38:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6720375039469612718', time=2024-09-12T02:30:53.427331+0000, chain.objs.size()=1 2024-09-12T00:38:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YNf_q-Wh583UJtAhW1v9VMxzhKldhXC_0 2024-09-12T00:38:36.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18119242716880664117', time=2024-09-12T02:30:53.521046+0000, chain.objs.size()=1 2024-09-12T00:38:36.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.168+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.x6ctMy7oG6CKUYpMciwFZdJ5RZ2JPkl_0 2024-09-12T00:38:36.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10918728514627187536', time=2024-09-12T02:30:53.554373+0000, chain.objs.size()=1 2024-09-12T00:38:36.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AplDYuCplufyl9Ol3qIg81U7ppZIkEt_0 2024-09-12T00:38:36.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11803297877812507785', time=2024-09-12T02:30:53.668414+0000, chain.objs.size()=1 2024-09-12T00:38:36.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.iAmEGW-QkQQkHDx9v84Wimir2ptaJdX_0 2024-09-12T00:38:36.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16977859748851603698', time=2024-09-12T02:30:53.677059+0000, chain.objs.size()=1 2024-09-12T00:38:36.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.hLBVwx77OZnr5HGM_dvzHSisAAENcNL_0 2024-09-12T00:38:36.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12165029550044390547', time=2024-09-12T02:30:53.697041+0000, chain.objs.size()=1 2024-09-12T00:38:36.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.bD6kmPesugSYfGXm_P73brnu6Xgh3zO_0 2024-09-12T00:38:36.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10894756357913968860', time=2024-09-12T02:30:54.021832+0000, chain.objs.size()=1 2024-09-12T00:38:36.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.smKmAuqdsR47AO8Kc631VWYUdNE8ZbX_0 2024-09-12T00:38:36.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5797669343174884066', time=2024-09-12T02:30:54.022594+0000, chain.objs.size()=1 2024-09-12T00:38:36.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.krtjr7uh1AmHPfyd6fbwLdeV6VB_WV7_0 2024-09-12T00:38:36.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3180109772261398706', time=2024-09-12T02:30:54.041669+0000, chain.objs.size()=1 2024-09-12T00:38:36.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Fe0PoOL6VRppbHXuGlWJ9XWccHXAm6h_0 2024-09-12T00:38:36.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7028371240245601461', time=2024-09-12T02:30:54.047641+0000, chain.objs.size()=1 2024-09-12T00:38:36.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.DT9wPmHJRzrjPN4rCs7j65t-R2DEqTW_0 2024-09-12T00:38:36.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3231140879216674947', time=2024-09-12T02:30:54.364776+0000, chain.objs.size()=1 2024-09-12T00:38:36.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.hniNK6cO57OFa1SifEjEi82bwQyFz0q_0 2024-09-12T00:38:36.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6683467426661961378', time=2024-09-12T02:30:54.381905+0000, chain.objs.size()=1 2024-09-12T00:38:36.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.jkoQWtJK3NoZW7Etvjp8XHoRgzkJhtt_0 2024-09-12T00:38:36.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9609991899298326498', time=2024-09-12T02:30:54.402994+0000, chain.objs.size()=1 2024-09-12T00:38:36.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.172+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6-ztymDkHXmBd7VyezsTz0UMKGJzXQ7_0 2024-09-12T00:38:36.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.176+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15063970592698029206', time=2024-09-12T02:30:54.408698+0000, chain.objs.size()=1 2024-09-12T00:38:36.174 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.176+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_._qiMiKGbwIdWfrnW9PechotiXk4gYGE_0 2024-09-12T00:38:36.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.176+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8832057800698463448', time=2024-09-12T02:30:54.415580+0000, chain.objs.size()=1 2024-09-12T00:38:36.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.176+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.adLHiFLZcs4BdoqxDF6HNQOcb8LF8qz_0 2024-09-12T00:38:36.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.176+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7545652263039046257', time=2024-09-12T02:30:54.437299+0000, chain.objs.size()=1 2024-09-12T00:38:36.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.176+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.wejWMS0HqcpKKOxw_B8Z59nS0F0Oe1N_0 2024-09-12T00:38:36.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.176+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.720053828861867507', time=2024-09-12T02:30:54.443757+0000, chain.objs.size()=1 2024-09-12T00:38:36.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.176+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lPlQNmGRs_1yilL5w-EvzvAcnPrmecl_0 2024-09-12T00:38:36.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.176+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15351973716727893274', time=2024-09-12T02:30:54.458361+0000, chain.objs.size()=1 2024-09-12T00:38:36.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.176+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.hbZnUYYGj-tZvrlvVXaCzholNfJO55f_0 2024-09-12T00:38:36.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.176+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1550078340555493531', time=2024-09-12T02:30:54.466478+0000, chain.objs.size()=1 2024-09-12T00:38:36.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.176+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.wrp7QpjIratMCwkrw9QGl_GUReRuNs4_0 2024-09-12T00:38:36.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.179+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2257395674944881112', time=2024-09-12T02:30:54.470960+0000, chain.objs.size()=1 2024-09-12T00:38:36.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.179+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Q0J-4YOrE2a5pLTtvnzVw7ObiTfuuiA_0 2024-09-12T00:38:36.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.179+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14240807787337251650', time=2024-09-12T02:30:54.583040+0000, chain.objs.size()=1 2024-09-12T00:38:36.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.179+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.1HDtXvoVXi8xEE_6RCTJrZAgJ76eVF-_0 2024-09-12T00:38:36.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.179+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1644687052843312105', time=2024-09-12T02:30:54.591933+0000, chain.objs.size()=1 2024-09-12T00:38:36.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.179+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-BMYl8aUqDkJ3TNZ6OWsKls5aDiDDYH_0 2024-09-12T00:38:36.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.179+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15286987080225439880', time=2024-09-12T02:30:54.595366+0000, chain.objs.size()=1 2024-09-12T00:38:36.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.179+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pcvYcdFcQgCkpS4nv_jyQind1Vsb3fo_0 2024-09-12T00:38:36.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.180+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.778816989723636286', time=2024-09-12T02:30:54.639237+0000, chain.objs.size()=1 2024-09-12T00:38:36.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.180+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.dvX508G4fBGXaHFuzESEdB9lziozdbL_0 2024-09-12T00:38:36.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.181+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5838228776208096284', time=2024-09-12T02:30:54.668816+0000, chain.objs.size()=1 2024-09-12T00:38:36.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.181+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.wi0GHFCZQmsi8Ed0zABqsw6ZDRFnJJc_0 2024-09-12T00:38:36.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.181+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18437949790916674288', time=2024-09-12T02:30:54.688439+0000, chain.objs.size()=1 2024-09-12T00:38:36.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.181+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.603fMRt_Bn7Lsuiu2BI5uq1kJdhd9D__0 2024-09-12T00:38:36.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.182+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5326420707711951721', time=2024-09-12T02:30:54.725593+0000, chain.objs.size()=1 2024-09-12T00:38:36.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.182+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.XiL23Cu6yFI54GlPerGNYi0uL-gpiLf_0 2024-09-12T00:38:36.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.182+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17458098450428964564', time=2024-09-12T02:30:54.909370+0000, chain.objs.size()=1 2024-09-12T00:38:36.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.182+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.i5luFgrQmKnnQ7va29RI7DWgzBWW6bZ_0 2024-09-12T00:38:36.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8263492579431337743', time=2024-09-12T02:30:54.967558+0000, chain.objs.size()=1 2024-09-12T00:38:36.184 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-6Mdq_d9oWDxqnsnlJJBIYB5WX1KN_9_0 2024-09-12T00:38:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3146551087625381700', time=2024-09-12T02:30:55.093688+0000, chain.objs.size()=1 2024-09-12T00:38:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.7KtkNvFEU6X_BjFb0EAQF_VX_bhq1tH_0 2024-09-12T00:38:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6647418715250539618', time=2024-09-12T02:30:55.129948+0000, chain.objs.size()=1 2024-09-12T00:38:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Mcx3xPfu8j8HTQ-H-w5lAqd5Uqroqgu_0 2024-09-12T00:38:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7246083390916263750', time=2024-09-12T02:30:55.722239+0000, chain.objs.size()=1 2024-09-12T00:38:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.264__shadow_.7pMNBttAD8on5sJNumMELKEIi9Kbwa1_0 2024-09-12T00:38:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2192026173471648260', time=2024-09-12T02:30:57.877545+0000, chain.objs.size()=1 2024-09-12T00:38:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.273__shadow_.O8VygBjE-HpqJc1fQGKZAcjCRpljtTd_0 2024-09-12T00:38:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9169750829603102654', time=2024-09-12T02:31:00.305204+0000, chain.objs.size()=1 2024-09-12T00:38:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.283__shadow_.eyMlBPp6OO9bR6zBG9XJDfC3bByGRcM_0 2024-09-12T00:38:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11568302222584937124', time=2024-09-12T02:31:06.458852+0000, chain.objs.size()=1 2024-09-12T00:38:36.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.304__shadow_.T0oscQV8n2FDIXwcfGdmZd_FSsUw1jo_0 2024-09-12T00:38:36.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12838000427911552614', time=2024-09-12T02:31:10.165868+0000, chain.objs.size()=1 2024-09-12T00:38:36.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.319__shadow:0aea4JXImgTq7DXCRq-gpneTLOHDsNy_.RS73qEjzb6Bw3GyBqdmoByFNPq14bQG_0 2024-09-12T00:38:36.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17580226348075974457', time=2024-09-12T02:31:10.880822+0000, chain.objs.size()=1 2024-09-12T00:38:36.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.322__shadow_.fA1hhgw0pxQORmaDST4JRGy_6VuTB5q_0 2024-09-12T00:38:36.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11830515588468054734', time=2024-09-12T02:31:19.397035+0000, chain.objs.size()=1 2024-09-12T00:38:36.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.wHyR-LtF-_7xF0z1RVDZPJuqTG8JBe7_0 2024-09-12T00:38:36.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14105252896512106023', time=2024-09-12T02:31:19.466051+0000, chain.objs.size()=1 2024-09-12T00:38:36.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.pr6JOw5pvTQhwS4UaZanEkCCGw9UlwX_0 2024-09-12T00:38:36.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.190+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13590360705977702908', time=2024-09-12T02:31:19.536059+0000, chain.objs.size()=1 2024-09-12T00:38:36.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.190+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.qm_weajhp-lOyBNRyTB1oVJBxwrcpVZ_0 2024-09-12T00:38:36.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.191+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.309935664270222463', time=2024-09-12T02:31:19.771185+0000, chain.objs.size()=1 2024-09-12T00:38:36.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.191+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.6tuOD3tDrpCpw4cVeVG-97OHyxaQs_h_0 2024-09-12T00:38:36.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.191+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17903791817614631233', time=2024-09-12T02:31:19.775191+0000, chain.objs.size()=1 2024-09-12T00:38:36.189 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.191+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.uKQecTD4XFI2YJ7m_fBXSUet9fdTsA1_0 2024-09-12T00:38:36.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.191+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16817339235391107576', time=2024-09-12T02:31:19.830878+0000, chain.objs.size()=1 2024-09-12T00:38:36.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.191+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Z3a2KZjXXtD-fpnziP9dhET-SNtKrG6_0 2024-09-12T00:38:36.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.191+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17903153851065006293', time=2024-09-12T02:31:19.966449+0000, chain.objs.size()=1 2024-09-12T00:38:36.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.191+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JZtlODUUgYNITXyDkr6l-pqGFhp_1Ks_0 2024-09-12T00:38:36.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.191+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11466778550248019782', time=2024-09-12T02:31:20.433539+0000, chain.objs.size()=1 2024-09-12T00:38:36.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.191+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.amc5yvvWjfJh9pPze_hy2wSuqBRie-u_0 2024-09-12T00:38:36.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.191+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6866194411225616475', time=2024-09-12T02:31:20.580674+0000, chain.objs.size()=1 2024-09-12T00:38:36.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.191+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.03QlxeMgqHFb_tWuFaAVnxE_CW6UYCO_0 2024-09-12T00:38:36.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.192+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15392977491227352981', time=2024-09-12T02:31:20.621836+0000, chain.objs.size()=1 2024-09-12T00:38:36.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.192+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.BU68g5QrWQ9uew0Ex3EnoF0pd9VW_wG_0 2024-09-12T00:38:36.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.192+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6158789439490225611', time=2024-09-12T02:31:20.624701+0000, chain.objs.size()=1 2024-09-12T00:38:36.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.192+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.N-Fc4p84zEOUhMWTRLWzYmLc4obuNSB_0 2024-09-12T00:38:36.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.192+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17551500565964709687', time=2024-09-12T02:31:20.646644+0000, chain.objs.size()=1 2024-09-12T00:38:36.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.192+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.QECVSvIP1CPO9hK_RekbOJO2JBAQTlH_0 2024-09-12T00:38:36.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.192+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15817560821583712938', time=2024-09-12T02:31:20.944920+0000, chain.objs.size()=1 2024-09-12T00:38:36.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.192+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_._UkbhD9zPzR3wgFwpNc_3LZ_K5OvZwc_0 2024-09-12T00:38:36.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.195+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12161581843294419572', time=2024-09-12T02:31:21.007074+0000, chain.objs.size()=1 2024-09-12T00:38:36.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.195+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.SbbJdQhGr_AhMhUY4z0mqlCFl6-PKOK_0 2024-09-12T00:38:36.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.195+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2320679300637995610', time=2024-09-12T02:31:21.226437+0000, chain.objs.size()=1 2024-09-12T00:38:36.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.195+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.FoaVemXKlMzfqcdKJhyK-9m8E3r0ljs_0 2024-09-12T00:38:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.195+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6698853906628571410', time=2024-09-12T02:31:21.328537+0000, chain.objs.size()=1 2024-09-12T00:38:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.195+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.E_8qXccZ58cpkNpAmRwQV9gQq9motLR_0 2024-09-12T00:38:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.195+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2928505619114374763', time=2024-09-12T02:31:21.368842+0000, chain.objs.size()=1 2024-09-12T00:38:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.195+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Qlx2YK7x6O8ZBbvUwCEbEuuTEDeUlSA_0 2024-09-12T00:38:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.195+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8601584910275223669', time=2024-09-12T02:31:21.533417+0000, chain.objs.size()=1 2024-09-12T00:38:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.195+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.R5qfCOD9imTsbZ-Edzn0BkDFHgNKHQt_0 2024-09-12T00:38:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.195+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14812985321264087586', time=2024-09-12T02:31:21.553371+0000, chain.objs.size()=1 2024-09-12T00:38:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.195+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.QohCb1CAvT8oneqrU7EJ_V4cBCjto2n_0 2024-09-12T00:38:36.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.195+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11639160451746331106', time=2024-09-12T02:31:21.558700+0000, chain.objs.size()=1 2024-09-12T00:38:36.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.195+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.mHpCfdiVeOaMbynaxzWcMBx5YGQrQIx_0 2024-09-12T00:38:36.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.197+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17709252073013435472', time=2024-09-12T02:31:21.571254+0000, chain.objs.size()=1 2024-09-12T00:38:36.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.197+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ZDv7QslKuqUrBdYOsF_eIk3ZBa31f7s_0 2024-09-12T00:38:36.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.197+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1052247476328598250', time=2024-09-12T02:31:29.679302+0000, chain.objs.size()=1 2024-09-12T00:38:36.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.197+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.VMl35Z_K8jQhoemlscnAc3ITVtZPiaH_0 2024-09-12T00:38:36.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.197+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18085814658254701742', time=2024-09-12T02:31:29.825588+0000, chain.objs.size()=1 2024-09-12T00:38:36.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.197+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.KNZIuAAWSI8ALhUBz7VSOR1q3GNNW6A_0 2024-09-12T00:38:36.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.198+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1190686595554836282', time=2024-09-12T02:31:29.829090+0000, chain.objs.size()=1 2024-09-12T00:38:36.196 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.198+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.rV6pJ-BnuYxxu0Fy5Cy5xVdtYPzQSIH_0 2024-09-12T00:38:36.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.200+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11939236219876056539', time=2024-09-12T02:31:29.870705+0000, chain.objs.size()=1 2024-09-12T00:38:36.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.200+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.LXVZhk0TrlrSxYO4COQjM6MNwMUPjLW_0 2024-09-12T00:38:36.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.200+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9005905592448577961', time=2024-09-12T02:31:29.874945+0000, chain.objs.size()=1 2024-09-12T00:38:36.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.200+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.aggeyh7jkt_TQD-YkllvLXEK8IrrTYb_0 2024-09-12T00:38:36.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.200+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13333560866611866468', time=2024-09-12T02:31:30.072749+0000, chain.objs.size()=1 2024-09-12T00:38:36.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.200+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.0s3M84B4RnkVw7_OwtOf7jjHiJfnB-6_0 2024-09-12T00:38:36.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.201+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14485890660218254397', time=2024-09-12T02:31:30.081361+0000, chain.objs.size()=1 2024-09-12T00:38:36.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.201+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lIKe6NnZlzvyceqteyteSPDdWJv6Bz2_0 2024-09-12T00:38:36.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.202+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6077448096671854475', time=2024-09-12T02:31:30.156934+0000, chain.objs.size()=1 2024-09-12T00:38:36.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.202+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.STShSTqWoQAf8Pdir5e2y9Wgwz2JqaT_0 2024-09-12T00:38:36.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.202+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13600489099804837622', time=2024-09-12T02:31:30.164275+0000, chain.objs.size()=1 2024-09-12T00:38:36.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.202+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.5YoAnnc_22VH9uhgbCiwYvL6IQ8MmvS_0 2024-09-12T00:38:36.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.204+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15892081395870354339', time=2024-09-12T02:31:30.168898+0000, chain.objs.size()=1 2024-09-12T00:38:36.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.204+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.7HnNPUU99iXJ8ndXJTs7OSGza1JIY-9_0 2024-09-12T00:38:36.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.204+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2138223167421491491', time=2024-09-12T02:31:30.193361+0000, chain.objs.size()=1 2024-09-12T00:38:36.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.204+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.fq94n4i0-dk5yEV0HMzTZKLbJ52VngA_0 2024-09-12T00:38:36.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.204+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12987346132851613035', time=2024-09-12T02:31:30.315728+0000, chain.objs.size()=1 2024-09-12T00:38:36.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.204+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.kLCW00zjWAs43r28mYDPyZ_c_2hOSRD_0 2024-09-12T00:38:36.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.204+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10153210993062303291', time=2024-09-12T02:31:30.360367+0000, chain.objs.size()=1 2024-09-12T00:38:36.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.204+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.dpQargEb5HEi3wMSeiCc6Sa90ZxklVE_0 2024-09-12T00:38:36.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.204+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3925724480819215578', time=2024-09-12T02:31:30.368889+0000, chain.objs.size()=1 2024-09-12T00:38:36.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.204+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._UauraeklQvY5ffh3G_ldktdwCUeHaL_0 2024-09-12T00:38:36.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.204+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8625522030518568456', time=2024-09-12T02:31:30.426454+0000, chain.objs.size()=1 2024-09-12T00:38:36.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.204+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.E5zl5iyeQREnjpTyAinHacOBGRKorpF_0 2024-09-12T00:38:36.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.204+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18194430594720618891', time=2024-09-12T02:31:30.460917+0000, chain.objs.size()=1 2024-09-12T00:38:36.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.204+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.sPqYT8iWhocBaoVzBN-lv0Qm1Xdvukc_0 2024-09-12T00:38:36.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.205+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7033510747852563478', time=2024-09-12T02:31:30.479637+0000, chain.objs.size()=1 2024-09-12T00:38:36.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.205+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.9vIbQrrg1GUP05KN3OMmH6NbVyFymWF_0 2024-09-12T00:38:36.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.205+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17167555140455631827', time=2024-09-12T02:31:30.656259+0000, chain.objs.size()=1 2024-09-12T00:38:36.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.205+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.1TcuUR0AuSKYLiWM8cjOcfD9lr9t_tL_0 2024-09-12T00:38:36.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.205+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10013136850743584696', time=2024-09-12T02:31:30.672702+0000, chain.objs.size()=1 2024-09-12T00:38:36.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.205+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.pKJEOFOvQS3WfIeiXdEjJi8rsr2BSzt_0 2024-09-12T00:38:36.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.206+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11260531584519062848', time=2024-09-12T02:31:30.713949+0000, chain.objs.size()=1 2024-09-12T00:38:36.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.206+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.uDTZdsag8uYOa8XWrA1KCguFS48HZMH_0 2024-09-12T00:38:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4336621228142630743', time=2024-09-12T02:31:30.867612+0000, chain.objs.size()=1 2024-09-12T00:38:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.YTK7VGQiVCpqx6C7RNtB3FO4qF5UmxY_0 2024-09-12T00:38:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13356515413055360246', time=2024-09-12T02:31:30.917552+0000, chain.objs.size()=1 2024-09-12T00:38:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.gpBRkZnRqdSuIRoyXjm_NxE16BajWZE_0 2024-09-12T00:38:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11282577016710735000', time=2024-09-12T02:31:30.919512+0000, chain.objs.size()=1 2024-09-12T00:38:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.xKedh4gca9xzu5ndz_IG59iNGyLzP9H_0 2024-09-12T00:38:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10635013981214740159', time=2024-09-12T02:31:30.947265+0000, chain.objs.size()=1 2024-09-12T00:38:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.eNa3PyIyuijD5E5jEIlAkeWmQIWyMe7_0 2024-09-12T00:38:36.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3138969302915587384', time=2024-09-12T02:31:30.950376+0000, chain.objs.size()=1 2024-09-12T00:38:36.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.KDQeOm5d5cF94Z1vAWCnQrdqMmYR-TH_0 2024-09-12T00:38:36.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8615489286361610362', time=2024-09-12T02:31:31.000076+0000, chain.objs.size()=1 2024-09-12T00:38:36.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.rV9RR9OXVKtJWM2WvRzwwgyZuW2koU8_0 2024-09-12T00:38:36.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6667657328608458501', time=2024-09-12T02:31:31.005706+0000, chain.objs.size()=1 2024-09-12T00:38:36.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.HPnnGm-poN_lscnX_xfaBfBTGaqCte0_0 2024-09-12T00:38:36.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17611678326177462203', time=2024-09-12T02:31:31.215090+0000, chain.objs.size()=1 2024-09-12T00:38:36.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Q5WrL-q3mEuDFntHHnYMS_W76dUEy35_0 2024-09-12T00:38:36.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2697126232242365565', time=2024-09-12T02:31:31.292837+0000, chain.objs.size()=1 2024-09-12T00:38:36.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.74sdCDBXJy2tjekzVnILUHgd1q_D-sR_0 2024-09-12T00:38:36.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17103745478084020008', time=2024-09-12T02:31:31.427984+0000, chain.objs.size()=1 2024-09-12T00:38:36.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.YH1rdSqtPVSwfKrmNLNAQ-d0Bg7JMoa_0 2024-09-12T00:38:36.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5790772091414537542', time=2024-09-12T02:31:31.522975+0000, chain.objs.size()=1 2024-09-12T00:38:36.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.em72X9HQDVyBgsod9ojXScbC7ntq3y3_0 2024-09-12T00:38:36.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.214+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14193214293879834090', time=2024-09-12T02:31:31.529480+0000, chain.objs.size()=1 2024-09-12T00:38:36.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.214+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.9dS8zq6eyV6uztXUUZ6f9mmnqvKGwag_0 2024-09-12T00:38:36.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.218+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/46154 2024-09-12T00:38:36.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T00:38:36.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7345830189165761261', time=2024-09-12T02:31:31.554046+0000, chain.objs.size()=1 2024-09-12T00:38:36.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.rIsyjo3StD-W1xoKDhPbqq2nT10Hlqi_0 2024-09-12T00:38:36.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3153469234565135914', time=2024-09-12T02:31:31.561741+0000, chain.objs.size()=1 2024-09-12T00:38:36.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.hkxlRTbW24kTC_47IoMIwxgDJy6OPYA_0 2024-09-12T00:38:36.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13548766134776068406', time=2024-09-12T02:31:31.580759+0000, chain.objs.size()=1 2024-09-12T00:38:36.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ePEPKwLvmyTN9gwoOpDy1-aL_qlLN4A_0 2024-09-12T00:38:36.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.763241102364555301', time=2024-09-12T02:31:31.791768+0000, chain.objs.size()=1 2024-09-12T00:38:36.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.iQNBa7-ksBFDOQQGQIFx3p5xSBRy6lB_0 2024-09-12T00:38:36.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1366640073776748074', time=2024-09-12T02:31:31.810376+0000, chain.objs.size()=1 2024-09-12T00:38:36.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.0vCzWp9sfsKyKdsbBIZ6ltd6k68Vj3__0 2024-09-12T00:38:36.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7862131412729973936', time=2024-09-12T02:31:31.811439+0000, chain.objs.size()=1 2024-09-12T00:38:36.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.9AlM2wQIKpUlC5t_O8U1XhvJ6XKixDg_0 2024-09-12T00:38:36.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12733438306576011125', time=2024-09-12T02:31:31.825491+0000, chain.objs.size()=1 2024-09-12T00:38:36.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ebcGzp7pxdcjH2_B8XSZDoHukPUmSj4_0 2024-09-12T00:38:36.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14549568831137112220', time=2024-09-12T02:31:33.352049+0000, chain.objs.size()=1 2024-09-12T00:38:36.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.331__shadow_.TTVCY0k1X8YbsY0HKidvak8LIAR4N-q_0 2024-09-12T00:38:36.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8281815319587515917', time=2024-09-12T02:31:36.088914+0000, chain.objs.size()=1 2024-09-12T00:38:36.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.342__shadow_.cl4BEb1Wr1wUGt7rFEn3Tzv6OlH941m_0 2024-09-12T00:38:36.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17319399616792941618', time=2024-09-12T02:32:25.881205+0000, chain.objs.size()=1 2024-09-12T00:38:36.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.520__shadow:S1l9t0VsJVXzGVbnllGukdu0r35qbzH_.JtsUEvY7YyV3RZB1WvecoyItHB6u4vV_0 2024-09-12T00:38:36.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14645069043878070526', time=2024-09-12T02:32:32.180389+0000, chain.objs.size()=3 2024-09-12T00:38:36.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.523__multipart_mymultipart.2~2dx4Ibdmv3mynQ8HpMg93hf3BsrtgpU.1 2024-09-12T00:38:36.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.220+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.523__multipart_mymultipart.2~2dx4Ibdmv3mynQ8HpMg93hf3BsrtgpU.2 2024-09-12T00:38:36.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.523__multipart_mymultipart.2~2dx4Ibdmv3mynQ8HpMg93hf3BsrtgpU.3 2024-09-12T00:38:36.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8852304690523144999', time=2024-09-12T02:33:05.630336+0000, chain.objs.size()=1 2024-09-12T00:38:36.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.551__shadow_.drIkrJh9kgsslwEDz7mLAtpvj1dWISz_0 2024-09-12T00:38:36.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7747598983665644875', time=2024-09-12T02:33:08.302300+0000, chain.objs.size()=1 2024-09-12T00:38:36.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.557__shadow_.E1hVd79ZcBZpcdoq7H1-eLlw2AUIWX9_0 2024-09-12T00:38:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15972073923719118487', time=2024-09-12T02:33:15.621530+0000, chain.objs.size()=1 2024-09-12T00:38:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.566__shadow_.4D0ldsMNK5qsCjPxqXYy9ZflQfU7iK8_0 2024-09-12T00:38:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1981938239972231114', time=2024-09-12T02:33:25.539091+0000, chain.objs.size()=1 2024-09-12T00:38:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.574__shadow:z8opOwNe5S1O6X7EqJUXVZkisftK.rt_.3OD2xUXaH3R8f_Yl5R9oOSQXzVoFujZ_0 2024-09-12T00:38:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5350672166186620736', time=2024-09-12T02:33:27.119670+0000, chain.objs.size()=1 2024-09-12T00:38:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.575__shadow_.PqVcicc0137BGzM0KOOwB129MQNg2-a_0 2024-09-12T00:38:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1249404119884478358', time=2024-09-12T02:33:34.049134+0000, chain.objs.size()=1 2024-09-12T00:38:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:MieultGLVtXfV2CB7VIypISiSCu-vLO_.-dzkXIEiVVfF_NP2BZGo9WGZicUd7m4_0 2024-09-12T00:38:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18287396991004418514', time=2024-09-12T02:33:46.833718+0000, chain.objs.size()=1 2024-09-12T00:38:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.580__shadow:DJxLvk8A0Zn.aFUc13TGW-E5szu48Ng_.THsIllK1Y10ISbWJNjN56vDHgAHL5BK_0 2024-09-12T00:38:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.976658449699007176', time=2024-09-12T02:33:47.159480+0000, chain.objs.size()=1 2024-09-12T00:38:36.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.582__shadow:HNSoTUFlrgGhz8N.sN18T2rQ9Rhnd8-_.NWue9eoqO835RbfZEoMWhqIBKpm7Rr__0 2024-09-12T00:38:36.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15092222307641759255', time=2024-09-12T02:33:49.230273+0000, chain.objs.size()=1 2024-09-12T00:38:36.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.587__shadow:eg3hCCCEMpioWc9.7VD-ymUcqTrxrsF_.BXh-j8lM1ZguBmWizOfTkLJWd4_rTeL_0 2024-09-12T00:38:36.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8104481402304326259', time=2024-09-12T02:33:49.240036+0000, chain.objs.size()=1 2024-09-12T00:38:36.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.226+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.587__shadow:flB9UuCMVJkf.MZgrqQpcB0vjeyx-49_.3blGzzUL06C2pKVOgcBfGnElaEjMGFS_0 2024-09-12T00:38:36.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.231+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9380745396991351824', time=2024-09-12T02:36:05.133781+0000, chain.objs.size()=1 2024-09-12T00:38:36.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.231+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.630__shadow_.btyIi2LnNnamMyc1_QHltfiA7YXSyuC_0 2024-09-12T00:38:36.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.231+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11385135273160957752', time=2024-09-12T02:36:15.411332+0000, chain.objs.size()=6 2024-09-12T00:38:36.229 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.231+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.660__multipart_bar.2~I3z9Mr38GM-p3vi1fWUFoJOI7QkCzW2.1 2024-09-12T00:38:36.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.231+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.660__multipart_bar.2~I3z9Mr38GM-p3vi1fWUFoJOI7QkCzW2.2 2024-09-12T00:38:36.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.232+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.660__multipart_bar.2~I3z9Mr38GM-p3vi1fWUFoJOI7QkCzW2.3 2024-09-12T00:38:36.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.232+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.660__multipart_bar.2~I3z9Mr38GM-p3vi1fWUFoJOI7QkCzW2.4 2024-09-12T00:38:36.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.232+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.660__multipart_bar.2~I3z9Mr38GM-p3vi1fWUFoJOI7QkCzW2.5 2024-09-12T00:38:36.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.232+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.660__multipart_bar.2~I3z9Mr38GM-p3vi1fWUFoJOI7QkCzW2.6 2024-09-12T00:38:36.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.232+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13087937656846849873', time=2024-09-12T02:36:18.395878+0000, chain.objs.size()=1 2024-09-12T00:38:36.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.232+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.672__shadow_.1--uGvp9hUxwl9KR4UoUM_Nkusna6RD_0 2024-09-12T00:38:36.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.237+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:36.237 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.239+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:38:36.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.241+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:36.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.241+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:36.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49575' 2024-09-12T00:38:36.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10436631260930160631', time=2024-09-12T02:30:40.933303+0000, chain.objs.size()=1 2024-09-12T00:38:36.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.244__shadow_.v-bsT76KX5lO7oBBpZZ6uwZzwDx15lr_0 2024-09-12T00:38:36.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8143332850917133627', time=2024-09-12T02:30:44.353913+0000, chain.objs.size()=1 2024-09-12T00:38:36.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.258__shadow_.folHJ4H2AVc10qca5rnJCg_l79XH8Pu_0 2024-09-12T00:38:36.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7078648452134298463', time=2024-09-12T02:30:53.219454+0000, chain.objs.size()=1 2024-09-12T00:38:36.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.A2OX7vbh2pSU0zp4ZHNfeavGDG57WRu_0 2024-09-12T00:38:36.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5126156551542878986', time=2024-09-12T02:30:53.242420+0000, chain.objs.size()=1 2024-09-12T00:38:36.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.3t_cQMuBORixBDAEfPHctsDBNrsdLR3_0 2024-09-12T00:38:36.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9054159813812921808', time=2024-09-12T02:30:53.397950+0000, chain.objs.size()=1 2024-09-12T00:38:36.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HriLSMBC9GEHgGecpH3lxvufjTOt-vb_0 2024-09-12T00:38:36.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14204112631044416506', time=2024-09-12T02:30:53.447768+0000, chain.objs.size()=1 2024-09-12T00:38:36.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.nd9SEgBMBOHgTR56n_iGQYNT4YNrj2v_0 2024-09-12T00:38:36.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16163423150519595459', time=2024-09-12T02:30:53.502489+0000, chain.objs.size()=1 2024-09-12T00:38:36.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.hLKXZLO0Gc2NCnzVs3DWmnfonDNKunm_0 2024-09-12T00:38:36.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7838782175030672417', time=2024-09-12T02:30:53.829126+0000, chain.objs.size()=1 2024-09-12T00:38:36.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_._ffuSJ2UxhxCiAF0mYhmHqJc-4uQET3_0 2024-09-12T00:38:36.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1233538311374223755', time=2024-09-12T02:30:53.845202+0000, chain.objs.size()=1 2024-09-12T00:38:36.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Fz573R4LbpIO0r6R6E54nmthCTIJw40_0 2024-09-12T00:38:36.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1244951775915019058', time=2024-09-12T02:30:53.954215+0000, chain.objs.size()=1 2024-09-12T00:38:36.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.zVYUbNqBxuNE2R8vW7kLjoHD08eOR3y_0 2024-09-12T00:38:36.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2481370533942020679', time=2024-09-12T02:30:53.961428+0000, chain.objs.size()=1 2024-09-12T00:38:36.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.RevggL0es0vN8UEvnfV0p5kt37cDahY_0 2024-09-12T00:38:36.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4124280628945378480', time=2024-09-12T02:30:54.037000+0000, chain.objs.size()=1 2024-09-12T00:38:36.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.242+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.3jbjiHPK9QE_X2tJzg6qyuOP0B8MlGr_0 2024-09-12T00:38:36.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.245+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4849889803106959631', time=2024-09-12T02:30:54.075244+0000, chain.objs.size()=1 2024-09-12T00:38:36.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.245+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AKFSRDq4XkRslkKPo7fXCeTJf5mg1FX_0 2024-09-12T00:38:36.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.247+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4460913576463833807', time=2024-09-12T02:30:54.386063+0000, chain.objs.size()=1 2024-09-12T00:38:36.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.247+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.clTDJZxrsu2VPQsWtx6M2zE3zydRzJ-_0 2024-09-12T00:38:36.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.247+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13181663954755978970', time=2024-09-12T02:30:54.406563+0000, chain.objs.size()=1 2024-09-12T00:38:36.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.247+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.E4i2OwlQuV_eLxyZad7GRWiWLbpKUgM_0 2024-09-12T00:38:36.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.247+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8255756093083910213', time=2024-09-12T02:30:54.650965+0000, chain.objs.size()=1 2024-09-12T00:38:36.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.247+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.UtNc66TMpbKn6ouVl3aYvijQnpbILiU_0 2024-09-12T00:38:36.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.247+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6050514876138835507', time=2024-09-12T02:30:54.716632+0000, chain.objs.size()=1 2024-09-12T00:38:36.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.247+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BFuM1ghk0JyQk5LHKXWAp6wv_dpoh09_0 2024-09-12T00:38:36.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.248+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3561450421455866210', time=2024-09-12T02:30:54.831136+0000, chain.objs.size()=1 2024-09-12T00:38:36.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.248+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.I2yDjQY99rBBx8m9B9zgP7JxoYdVR0N_0 2024-09-12T00:38:36.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.249+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1183208343989398355', time=2024-09-12T02:30:54.996609+0000, chain.objs.size()=1 2024-09-12T00:38:36.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.249+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ob9iEEDDPeOHota8prC409XSuoteHFD_0 2024-09-12T00:38:36.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.249+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12403458126481313278', time=2024-09-12T02:30:55.079338+0000, chain.objs.size()=1 2024-09-12T00:38:36.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.249+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.xHjm9MVKCDOpLjSkUqYcGOQB4-6642c_0 2024-09-12T00:38:36.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.249+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2636004282652875768', time=2024-09-12T02:30:55.183474+0000, chain.objs.size()=1 2024-09-12T00:38:36.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.249+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.wHHSljH48OVnhoMRXHRhzZgx3zh6-v9_0 2024-09-12T00:38:36.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.249+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6205766065589985762', time=2024-09-12T02:30:55.202876+0000, chain.objs.size()=1 2024-09-12T00:38:36.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.249+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6zyLZhNE8-XM8XQMCbDmgj8fkx3yka5_0 2024-09-12T00:38:36.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.249+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17303287842170785401', time=2024-09-12T02:30:55.212086+0000, chain.objs.size()=1 2024-09-12T00:38:36.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.249+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.0K1XQDasMrv9lebnaYAB9IB2gRVqC2v_0 2024-09-12T00:38:36.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.249+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12524973159711493348', time=2024-09-12T02:30:55.448019+0000, chain.objs.size()=1 2024-09-12T00:38:36.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.249+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.263__shadow_.gY3_zM2ccMKo65TtmOOZlckQ6pksheO_0 2024-09-12T00:38:36.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.251+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11495996827228206466', time=2024-09-12T02:30:58.586006+0000, chain.objs.size()=1 2024-09-12T00:38:36.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.251+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.276__shadow_.5aLE9FScrBmT088c8Alc0_sYt8Ci758_0 2024-09-12T00:38:36.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.252+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3626041778287404547', time=2024-09-12T02:30:58.862996+0000, chain.objs.size()=1 2024-09-12T00:38:36.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.252+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.277__shadow_.vd3tf1iQ7Xy0WJxjdG1QGE8oVdXngW2_0 2024-09-12T00:38:36.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.252+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1716484074712788173', time=2024-09-12T02:31:00.585259+0000, chain.objs.size()=1 2024-09-12T00:38:36.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.252+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.284__shadow_.7j1pI0DAPEgZObDI0-HmQS-e4IFfpvR_0 2024-09-12T00:38:36.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.253+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4738835399204013805', time=2024-09-12T02:31:01.147750+0000, chain.objs.size()=1 2024-09-12T00:38:36.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.253+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.286__shadow_.Vl8tTn-S_zhzXisYb-XUr31TdhB7GJu_0 2024-09-12T00:38:36.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.253+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5106945753376820851', time=2024-09-12T02:31:01.876307+0000, chain.objs.size()=1 2024-09-12T00:38:36.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.253+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.289__shadow_.XWAGTV1DdwteQNLpR67DpJCPRQlM65-_0 2024-09-12T00:38:36.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.253+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17149356968210730371', time=2024-09-12T02:31:03.061202+0000, chain.objs.size()=1 2024-09-12T00:38:36.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.253+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.-FBDuTh1whFvUB_DSxvr29SLNRZy_ZO_0 2024-09-12T00:38:36.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.254+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15171426361371649958', time=2024-09-12T02:31:04.410000+0000, chain.objs.size()=1 2024-09-12T00:38:36.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.254+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.296__shadow_.kQsN-Hld_wekQYxUra9eB8ROLMTJb0E_0 2024-09-12T00:38:36.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.254+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1893771539413678988', time=2024-09-12T02:31:05.218619+0000, chain.objs.size()=1 2024-09-12T00:38:36.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.254+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.299__shadow_.jWMoCq-a2BpAaWD8w-CxQJ_B_bQ6nt8_0 2024-09-12T00:38:36.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.254+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1976346674929877173', time=2024-09-12T02:31:07.612724+0000, chain.objs.size()=1 2024-09-12T00:38:36.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.254+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.307__shadow:8BAEtilX7bs1hIttPtTViDC-V8sMPKn_.9q1egtci32SoSVPafrMNsqofJYam7W2_0 2024-09-12T00:38:36.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.254+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7882533534624900592', time=2024-09-12T02:31:19.415471+0000, chain.objs.size()=1 2024-09-12T00:38:36.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.254+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.R8eY2eVDUErC5F1ixbEjjImnREulTL8_0 2024-09-12T00:38:36.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.254+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.126329967618658861', time=2024-09-12T02:31:19.515205+0000, chain.objs.size()=1 2024-09-12T00:38:36.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.254+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ek8lscyl1Y9kfTI0JFyIutYM9QXQefz_0 2024-09-12T00:38:36.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.256+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5709748982393312376', time=2024-09-12T02:31:19.721230+0000, chain.objs.size()=1 2024-09-12T00:38:36.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.256+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.AuJa6XDedtS63lPOw7O1psqTSgiR6FB_0 2024-09-12T00:38:36.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.256+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14427972729764831400', time=2024-09-12T02:31:19.769845+0000, chain.objs.size()=1 2024-09-12T00:38:36.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.256+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7lg3Cu_BTO5Dhly69BdLKODRQShTss4_0 2024-09-12T00:38:36.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.257+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2367338390878257016', time=2024-09-12T02:31:19.853306+0000, chain.objs.size()=1 2024-09-12T00:38:36.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.257+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ymzm5z8105TyNZbS1y7-6gTLkd2XZgF_0 2024-09-12T00:38:36.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.258+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3530902008465029538', time=2024-09-12T02:31:19.965668+0000, chain.objs.size()=1 2024-09-12T00:38:36.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.258+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.1ieuDO-F3hYc_-of4bForNYgL7E-8AY_0 2024-09-12T00:38:36.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.258+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11532215416662979597', time=2024-09-12T02:31:20.065048+0000, chain.objs.size()=1 2024-09-12T00:38:36.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.258+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.dH7V7NQHPWQCgznfFz4vKFBDp1n5Kwh_0 2024-09-12T00:38:36.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.259+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.340627785843890248', time=2024-09-12T02:31:20.071597+0000, chain.objs.size()=1 2024-09-12T00:38:36.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.259+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.U-DCRGZ1Xb7KTuBcmK8JEJzGNyd_Y9D_0 2024-09-12T00:38:36.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.259+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14682637013075052978', time=2024-09-12T02:31:20.083244+0000, chain.objs.size()=1 2024-09-12T00:38:36.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.259+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.vMbh00lhvrYI24iYY_axiyMNWg6pNBl_0 2024-09-12T00:38:36.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.259+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4347554971147198576', time=2024-09-12T02:31:20.300413+0000, chain.objs.size()=1 2024-09-12T00:38:36.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.259+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.xLcVtRZleyHiD3MfbfLDGlo3ZRIYWO8_0 2024-09-12T00:38:36.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.260+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8846833776351258310', time=2024-09-12T02:31:20.354563+0000, chain.objs.size()=1 2024-09-12T00:38:36.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.260+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ilZyBFmVSPVQPmpUft2MU9gnNTeNhDd_0 2024-09-12T00:38:36.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.260+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14036995988337110326', time=2024-09-12T02:31:20.377966+0000, chain.objs.size()=1 2024-09-12T00:38:36.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.260+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ytb8a_R8OaA5IDeyRUILbuJFrrgpSY0_0 2024-09-12T00:38:36.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.260+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8084775100621211557', time=2024-09-12T02:31:20.423763+0000, chain.objs.size()=1 2024-09-12T00:38:36.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.260+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.yB3xLvaLAQTVFQkz5wUa8upFcnNpkkk_0 2024-09-12T00:38:36.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.263+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15414056346350082133', time=2024-09-12T02:31:20.453558+0000, chain.objs.size()=1 2024-09-12T00:38:36.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.263+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.sZpk3e1n4zoEtXTZ3XJ_i9YcJF-VIyS_0 2024-09-12T00:38:36.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.263+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8467677775072761248', time=2024-09-12T02:31:20.562112+0000, chain.objs.size()=1 2024-09-12T00:38:36.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.263+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.9LxmzrZ7iw20lbqY7xsIxa86wF-AlX6_0 2024-09-12T00:38:36.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.263+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2257661320750934018', time=2024-09-12T02:31:20.569002+0000, chain.objs.size()=1 2024-09-12T00:38:36.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.263+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.vGLIoLh1iSec7gW0AaGViZcBuDDy_Y1_0 2024-09-12T00:38:36.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.263+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3065343592067761501', time=2024-09-12T02:31:20.615377+0000, chain.objs.size()=1 2024-09-12T00:38:36.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.263+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.19GrpllIPgHbvIJOt-Ldc3t4gxg6iQU_0 2024-09-12T00:38:36.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.266+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3784609698435897307', time=2024-09-12T02:31:20.752333+0000, chain.objs.size()=1 2024-09-12T00:38:36.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.266+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.5m3ug2lC2HP36pJmA316Vqreiu8zaPb_0 2024-09-12T00:38:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.269+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17046717892728459417', time=2024-09-12T02:31:20.755559+0000, chain.objs.size()=1 2024-09-12T00:38:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.269+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.4mj37Re3Ls3uJ9X_dpRhZcYM2mCr6hF_0 2024-09-12T00:38:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.269+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.173044313045575957', time=2024-09-12T02:31:21.067114+0000, chain.objs.size()=1 2024-09-12T00:38:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.269+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Nazz_7xSXBPIWCCme47xmlvToSv-Voz_0 2024-09-12T00:38:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.269+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15034461314373957851', time=2024-09-12T02:31:21.252821+0000, chain.objs.size()=1 2024-09-12T00:38:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.269+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.XyA1LTLEgGI0S9OceMTEAfidePxIajt_0 2024-09-12T00:38:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.269+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1992383622046249058', time=2024-09-12T02:31:21.282435+0000, chain.objs.size()=1 2024-09-12T00:38:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.269+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.uSZqURxEv0MJ0hoQtgGcCDKEYb-L9X2_0 2024-09-12T00:38:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.269+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.884535950225772022', time=2024-09-12T02:31:21.292865+0000, chain.objs.size()=1 2024-09-12T00:38:36.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.269+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.b4Z4QGkLwESr0KcBljrMlj5lDoKuqFg_0 2024-09-12T00:38:36.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.270+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2414421852978070270', time=2024-09-12T02:31:21.342255+0000, chain.objs.size()=1 2024-09-12T00:38:36.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.270+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.RUgoCf7JKPYiVjRW7mn2ROMK2Y1UdHo_0 2024-09-12T00:38:36.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.270+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14807710585553600159', time=2024-09-12T02:31:21.511937+0000, chain.objs.size()=1 2024-09-12T00:38:36.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.270+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.H7s-MgB3pKRYvKKey7BeQ4s02_RrjV7_0 2024-09-12T00:38:36.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.270+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18333310477677349714', time=2024-09-12T02:31:29.734292+0000, chain.objs.size()=1 2024-09-12T00:38:36.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.270+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.2N1tWDi5dLTotjYyb7r2h0HCFYiwmAF_0 2024-09-12T00:38:36.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.270+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7263964826171834977', time=2024-09-12T02:31:29.814812+0000, chain.objs.size()=1 2024-09-12T00:38:36.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.270+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.2c4L0HYQLSs8dSJY5XBfBfxWIwIwPoL_0 2024-09-12T00:38:36.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.270+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5780701645739626580', time=2024-09-12T02:31:29.872997+0000, chain.objs.size()=1 2024-09-12T00:38:36.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.270+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.sKvqhcRMXFqzsEM0TR67pcYoQFyHdb9_0 2024-09-12T00:38:36.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.273+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1117386450070702911', time=2024-09-12T02:31:30.031896+0000, chain.objs.size()=1 2024-09-12T00:38:36.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.273+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.eCSCHHWJiZfqXkKB985SbkVJrO1ZEOD_0 2024-09-12T00:38:36.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.275+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8417614550866720237', time=2024-09-12T02:31:30.032659+0000, chain.objs.size()=1 2024-09-12T00:38:36.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.275+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.s1hFplUj67QpsHtYtyxEHTeBRRZlyme_0 2024-09-12T00:38:36.274 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6044390127536493467', time=2024-09-12T02:31:30.096905+0000, chain.objs.size()=1 2024-09-12T00:38:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.3gcsFHABsRWCj39JvPSFTGrMSv0f76L_0 2024-09-12T00:38:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5658120075736900913', time=2024-09-12T02:31:30.187958+0000, chain.objs.size()=1 2024-09-12T00:38:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.SXSBtV8HznFGdNsSRSlaPFALMdCO2DJ_0 2024-09-12T00:38:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10378335409052000982', time=2024-09-12T02:31:30.192148+0000, chain.objs.size()=1 2024-09-12T00:38:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.MHRShYca24umrNDAN6yP432umX0XtS-_0 2024-09-12T00:38:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6302008718630090199', time=2024-09-12T02:31:30.318750+0000, chain.objs.size()=1 2024-09-12T00:38:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.6hCBiS6JE9xSm1mX1mMPGW1h2RS45Mj_0 2024-09-12T00:38:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14904007795842713061', time=2024-09-12T02:31:30.329410+0000, chain.objs.size()=1 2024-09-12T00:38:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.IA-2vWn5xMCrByWXTKJcBIecascVlXa_0 2024-09-12T00:38:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14080709034375756528', time=2024-09-12T02:31:30.381594+0000, chain.objs.size()=1 2024-09-12T00:38:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.oU8iKv80rUYuC24fBmu8cjZR6Ro659c_0 2024-09-12T00:38:36.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12059845841145195955', time=2024-09-12T02:31:30.418403+0000, chain.objs.size()=1 2024-09-12T00:38:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.UjD4vxP1XakYS79X1TXEXjOtx8QbFee_0 2024-09-12T00:38:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5617066756254490043', time=2024-09-12T02:31:30.424553+0000, chain.objs.size()=1 2024-09-12T00:38:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.J4wa2mT-5_AhatpyMFoWr-QAEzGyMox_0 2024-09-12T00:38:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9629729633945554955', time=2024-09-12T02:31:30.445461+0000, chain.objs.size()=1 2024-09-12T00:38:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.LxKVapWnyqA4R7Q1ig8GJEK_aw0HAuz_0 2024-09-12T00:38:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6360791005130893396', time=2024-09-12T02:31:30.586048+0000, chain.objs.size()=1 2024-09-12T00:38:36.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.276+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.SigpTpEN6h3nLnUqnALBS3ih6lHwrC7_0 2024-09-12T00:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14471715342589714506', time=2024-09-12T02:31:30.634701+0000, chain.objs.size()=1 2024-09-12T00:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.8jy23uaZu_Wzxe__Odg5q0BOQsE2fUW_0 2024-09-12T00:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14345813507103900696', time=2024-09-12T02:31:30.697252+0000, chain.objs.size()=1 2024-09-12T00:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.e3XwSdhBpEdlfclOF_8j7eIfITqYiZY_0 2024-09-12T00:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15764790692383984638', time=2024-09-12T02:31:30.705226+0000, chain.objs.size()=1 2024-09-12T00:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.FmVEFFJCEZjbRvyDpvOdyMe76Wd8eGQ_0 2024-09-12T00:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16730822395005699402', time=2024-09-12T02:31:30.753904+0000, chain.objs.size()=1 2024-09-12T00:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.x9Nl-K7TZKuLWtJ7Af-gjxqH1DzzgZD_0 2024-09-12T00:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17431639765218579071', time=2024-09-12T02:31:30.901720+0000, chain.objs.size()=1 2024-09-12T00:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.CPW25VAays54_EuJWRsFzL8WDvv9846_0 2024-09-12T00:38:36.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15565181871748200707', time=2024-09-12T02:31:30.963745+0000, chain.objs.size()=1 2024-09-12T00:38:36.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.u_WV9Un9NEjlmRc1k9AlQjfqB3yp-L-_0 2024-09-12T00:38:36.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11928069468777337300', time=2024-09-12T02:31:30.965200+0000, chain.objs.size()=1 2024-09-12T00:38:36.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.R8Orq1wQma-099NGOmoGEbW3KOPfeML_0 2024-09-12T00:38:36.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8981504077379755571', time=2024-09-12T02:31:31.034947+0000, chain.objs.size()=1 2024-09-12T00:38:36.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.281+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.brjsxWLNfsjZmUJCzuf0PIfDjw0uOqE_0 2024-09-12T00:38:36.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.282+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10582086732291868567', time=2024-09-12T02:31:31.150417+0000, chain.objs.size()=1 2024-09-12T00:38:36.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.282+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.N6S3EKbacmMJlqT8z_czm0Shb7og6_-_0 2024-09-12T00:38:36.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.283+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17797246928438204473', time=2024-09-12T02:31:31.177773+0000, chain.objs.size()=1 2024-09-12T00:38:36.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.283+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.UhEhZXD6KV0M3WcIlRlNL6ByoZevR3a_0 2024-09-12T00:38:36.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.283+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14239032603332688330', time=2024-09-12T02:31:31.215141+0000, chain.objs.size()=1 2024-09-12T00:38:36.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.283+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.qcBUvDqIXkGIZibEzqfSz2ASIGsMg_b_0 2024-09-12T00:38:36.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.287+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17470970293264978462', time=2024-09-12T02:31:31.242159+0000, chain.objs.size()=1 2024-09-12T00:38:36.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.287+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.QR1vhmJsjYH1wZ1ZxDne_4Pn6bX1AgG_0 2024-09-12T00:38:36.286 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.288+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9832697050800029432', time=2024-09-12T02:31:31.282162+0000, chain.objs.size()=1 2024-09-12T00:38:36.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.288+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.H2q7cdjzFUkKDYok7Qy657_E4sT-cnR_0 2024-09-12T00:38:36.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.288+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9983722655149570369', time=2024-09-12T02:31:31.288487+0000, chain.objs.size()=1 2024-09-12T00:38:36.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.288+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.tZon-PasXBTUhra00fxq1071GvD7RxL_0 2024-09-12T00:38:36.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.289+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1560524220849616571', time=2024-09-12T02:31:31.306634+0000, chain.objs.size()=1 2024-09-12T00:38:36.287 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.289+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.9pghgPFIbc6asxCO00kxgrO_YcYvj1g_0 2024-09-12T00:38:36.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.289+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4573011659144503498', time=2024-09-12T02:31:31.475881+0000, chain.objs.size()=1 2024-09-12T00:38:36.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.289+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.kDZeIZdyjmvmR61Zrfm1fLn27CQw7ce_0 2024-09-12T00:38:36.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.289+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13850284990997820687', time=2024-09-12T02:31:31.498833+0000, chain.objs.size()=1 2024-09-12T00:38:36.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.289+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ALjOq4UXPXpBc_kWRoRWzhYSYM3HsF4_0 2024-09-12T00:38:36.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.289+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7096053799424408696', time=2024-09-12T02:31:31.529906+0000, chain.objs.size()=1 2024-09-12T00:38:36.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.289+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._gJFnahLsjewL6kNK2PXg3bGl2wP6le_0 2024-09-12T00:38:36.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.289+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8931290779399540755', time=2024-09-12T02:31:31.541360+0000, chain.objs.size()=1 2024-09-12T00:38:36.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.289+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.rr0wNiQDC8WhWliDNF6nJk4cp-xnFl2_0 2024-09-12T00:38:36.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.289+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12430094120066617522', time=2024-09-12T02:31:31.735034+0000, chain.objs.size()=1 2024-09-12T00:38:36.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.289+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.aZCAl8tRbGKMICynayOqM3qTixwNfaP_0 2024-09-12T00:38:36.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.292+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3468570354690277187', time=2024-09-12T02:31:31.742188+0000, chain.objs.size()=1 2024-09-12T00:38:36.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.292+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.EcW0-46SQpBKFGSytyPZpeUpKyWSsUd_0 2024-09-12T00:38:36.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.292+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3847764637311849427', time=2024-09-12T02:31:31.753315+0000, chain.objs.size()=1 2024-09-12T00:38:36.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.292+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NmiAYvP44WeKnGIZ9wzMlH0biHoq4Tu_0 2024-09-12T00:38:36.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.292+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8496028210612332513', time=2024-09-12T02:31:31.779298+0000, chain.objs.size()=1 2024-09-12T00:38:36.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.292+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.QHlarbz2Ik7n2snQgfg7M6G8W1ijzUy_0 2024-09-12T00:38:36.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.292+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14486147473354944114', time=2024-09-12T02:31:31.811845+0000, chain.objs.size()=1 2024-09-12T00:38:36.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.292+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.jH9J-QOGo4GVvTP-lniLR304XeSyfSX_0 2024-09-12T00:38:36.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.294+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15626481344462637749', time=2024-09-12T02:31:31.818343+0000, chain.objs.size()=1 2024-09-12T00:38:36.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.294+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.fxk_752B-OzK9FDjDFEuh0-q0SF2zsV_0 2024-09-12T00:38:36.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.294+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11981501730349254537', time=2024-09-12T02:31:34.575136+0000, chain.objs.size()=1 2024-09-12T00:38:36.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.294+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.336__shadow_.U9YbnjdgxQXn2TLbQmfMuS0sHawvrQ__0 2024-09-12T00:38:36.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.294+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10770124025911031842', time=2024-09-12T02:31:36.509349+0000, chain.objs.size()=1 2024-09-12T00:38:36.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.294+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.344__shadow_.6V7-1Zbu3P6VRQowb2zmIJ00CAXisaZ_0 2024-09-12T00:38:36.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.298+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/49575 2024-09-12T00:38:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:38:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14573641054928956143', time=2024-09-12T02:32:52.872938+0000, chain.objs.size()=1 2024-09-12T00:38:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.536__multipart_mymultipart.2~8I3-GIAxvnxC28VRtPk7dQQAhyr7JwB.1 2024-09-12T00:38:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2980827481217010684', time=2024-09-12T02:33:05.113617+0000, chain.objs.size()=1 2024-09-12T00:38:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.550__shadow_.kkmRctFjQnXBjN8gFDINiinDkjofqO3_0 2024-09-12T00:38:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1429895659556447751', time=2024-09-12T02:33:16.842466+0000, chain.objs.size()=1 2024-09-12T00:38:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:whLKRw7H5Yyw7bjUdg03nOrdInIwNse_.SjbqM88YlzGrIRYrR_CKibcdBFF2FRl_0 2024-09-12T00:38:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2693327572378329906', time=2024-09-12T02:33:21.472641+0000, chain.objs.size()=1 2024-09-12T00:38:36.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:0iEAU-gx3SGWrG0rgyVDgl.FzoyKAPM_.sxouNkIzawWqGBx8qnLLJNY494GcDfr_0 2024-09-12T00:38:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15350026453512014258', time=2024-09-12T02:33:30.331804+0000, chain.objs.size()=1 2024-09-12T00:38:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.576__shadow:UJZvMlLLIgCgIIhPuH4NRZFXMZo3t-T_.k3KIYBpDeqYJhjXxj7K4U8Pd2l31DBd_0 2024-09-12T00:38:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10535696055985743984', time=2024-09-12T02:33:31.865424+0000, chain.objs.size()=1 2024-09-12T00:38:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:gPFEK9SMBo5HYzFAY96qsyIyrNubLzw_.7sPjVbdsJrN0yZSkLitTw1LPnfhFbH9_0 2024-09-12T00:38:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14771768937777262714', time=2024-09-12T02:33:34.993999+0000, chain.objs.size()=1 2024-09-12T00:38:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:1kyPUzDbvb0RUoGtu6W-U5wg.zePOMD_.f5nxCBVSGjtaodukKX4RjVxE8NFKByY_0 2024-09-12T00:38:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17073820722847273131', time=2024-09-12T02:33:40.766934+0000, chain.objs.size()=1 2024-09-12T00:38:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:1uEwdShcy5uh3iyjDYszJVh9-D-YUE3_.lyj294WvGlMdSeSYrjRJfgLuFFETP_h_0 2024-09-12T00:38:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17133493914943556967', time=2024-09-12T02:33:41.630474+0000, chain.objs.size()=1 2024-09-12T00:38:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:jhqCc9BouqJsKU81K6RzMX3h.n2nRW0_.cnwrwrSWbUWj3LRb4ftfOHJgDsRfb-E_0 2024-09-12T00:38:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8801980420457021408', time=2024-09-12T02:36:05.393236+0000, chain.objs.size()=1 2024-09-12T00:38:36.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.301+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.631__shadow_.mIbqpxn226doFxkMogP3WKqNUos5vZZ_0 2024-09-12T00:38:36.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:36.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.309+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:38:36.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.311+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:36.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.311+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:36.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46675' 2024-09-12T00:38:36.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_X8jf-hqgbDlfzwgdLKNq3BsTmetI3hj', time=2024-09-12T02:29:26.094233+0000, chain.objs.size()=1 2024-09-12T00:38:36.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__shadow_.94M4RSq3xHLVukNZG26eOqpmDr2JwaE_0 2024-09-12T00:38:36.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9239550834966204603', time=2024-09-12T02:30:39.393797+0000, chain.objs.size()=1 2024-09-12T00:38:36.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.238__shadow_.GMkl3BPi5XoacqAS4jHl40o0h_bLtRV_0 2024-09-12T00:38:36.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17826314588326602743', time=2024-09-12T02:30:41.171086+0000, chain.objs.size()=1 2024-09-12T00:38:36.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.245__shadow_.9Hh5x8HOWSnEOqLuqvbD2RBejEgT6vw_0 2024-09-12T00:38:36.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16459677136647924588', time=2024-09-12T02:30:41.928217+0000, chain.objs.size()=1 2024-09-12T00:38:36.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.248__shadow_.IDaYUVJ-9Ari1tkGhpnl6_Q8aFzZMW5_0 2024-09-12T00:38:36.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3825634894252392495', time=2024-09-12T02:30:42.406005+0000, chain.objs.size()=1 2024-09-12T00:38:36.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.250__shadow_.PrN2w9ymkCFv788yUSiiMIjUIZEg8po_0 2024-09-12T00:38:36.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16876538502054903395', time=2024-09-12T02:30:42.888166+0000, chain.objs.size()=1 2024-09-12T00:38:36.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.252__shadow_.TpPUm2LsNdSlKcV39bBvgfP3QOMlID9_0 2024-09-12T00:38:36.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14511290597640254130', time=2024-09-12T02:30:43.885892+0000, chain.objs.size()=1 2024-09-12T00:38:36.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.256__shadow_.6FaOcB7TBl86p13YsSKuU4t5xdu50OL_0 2024-09-12T00:38:36.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1360694175454633233', time=2024-09-12T02:30:53.138104+0000, chain.objs.size()=1 2024-09-12T00:38:36.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Kl0pfuuYovU67w6gIXFlIxkJll0_56H_0 2024-09-12T00:38:36.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17827891074851752238', time=2024-09-12T02:30:53.138880+0000, chain.objs.size()=1 2024-09-12T00:38:36.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.5MRW8x0aICwo2FN60ewydvnRj3qPDXs_0 2024-09-12T00:38:36.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9063447334510129877', time=2024-09-12T02:30:53.229960+0000, chain.objs.size()=1 2024-09-12T00:38:36.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.C9R-7T8yE2y5b7g_Mgc2zbjSWJIYELG_0 2024-09-12T00:38:36.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17539960040264611733', time=2024-09-12T02:30:53.302671+0000, chain.objs.size()=1 2024-09-12T00:38:36.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.7YulFuBXOX3DX1VbRAKBRMCSG0eu4wM_0 2024-09-12T00:38:36.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10577747211553708528', time=2024-09-12T02:30:53.393280+0000, chain.objs.size()=1 2024-09-12T00:38:36.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.L_wrZ96bzQvywQTmN1ceoKmpDWhDZkO_0 2024-09-12T00:38:36.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.315+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4553077237078251612', time=2024-09-12T02:30:53.400470+0000, chain.objs.size()=1 2024-09-12T00:38:36.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.315+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.xM6IPz3CsWgsLFn1UzL8r7dPsI2Twyr_0 2024-09-12T00:38:36.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.317+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2477160885441256268', time=2024-09-12T02:30:53.405670+0000, chain.objs.size()=1 2024-09-12T00:38:36.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.317+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ZAUg9IkJuPR7UM5ymU5mXX1IWRQo4rZ_0 2024-09-12T00:38:36.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.317+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9933675734766951728', time=2024-09-12T02:30:53.433925+0000, chain.objs.size()=1 2024-09-12T00:38:36.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.317+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-1LEghk0U3scQgt-PY1arHnmrYt5gOy_0 2024-09-12T00:38:36.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.317+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17910984481684809696', time=2024-09-12T02:30:53.520791+0000, chain.objs.size()=1 2024-09-12T00:38:36.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.318+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lnV44bngtTK_uf25r38VT1E3c3VdPDt_0 2024-09-12T00:38:36.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.318+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17770043112110588434', time=2024-09-12T02:30:53.671786+0000, chain.objs.size()=1 2024-09-12T00:38:36.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.318+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.nTAcX-N0e-9mSLeJjc38a1Kwe9tuLLn_0 2024-09-12T00:38:36.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.318+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10570827967241222831', time=2024-09-12T02:30:53.777750+0000, chain.objs.size()=1 2024-09-12T00:38:36.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.318+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.WXjkJBhiZMRolbMjQBDAtGacVBCr7b8_0 2024-09-12T00:38:36.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.318+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14123784038702261935', time=2024-09-12T02:30:53.941381+0000, chain.objs.size()=1 2024-09-12T00:38:36.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.318+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Ixi-jwLIcX4K9CqV_qwuyohM0x_lASF_0 2024-09-12T00:38:36.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.318+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9428504555076231969', time=2024-09-12T02:30:53.985910+0000, chain.objs.size()=1 2024-09-12T00:38:36.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.318+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.8vjUWKJ1QavcA7lT61wQZTUQQbMVA8K_0 2024-09-12T00:38:36.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.318+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16496493731943876429', time=2024-09-12T02:30:54.005966+0000, chain.objs.size()=1 2024-09-12T00:38:36.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.318+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.By2333lDRWChVmvaHS4D3JXZEFkw0Ze_0 2024-09-12T00:38:36.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.318+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2146533085782414052', time=2024-09-12T02:30:54.130716+0000, chain.objs.size()=1 2024-09-12T00:38:36.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.318+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YnNg9l8PdRc9HDSZHeOSj53biWMRrDv_0 2024-09-12T00:38:36.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.319+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6293444978600608950', time=2024-09-12T02:30:54.151135+0000, chain.objs.size()=1 2024-09-12T00:38:36.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.319+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.b6id0gvokvaTICsqr4CrZmOye51AS1Z_0 2024-09-12T00:38:36.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.319+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17240456241700556032', time=2024-09-12T02:30:54.310391+0000, chain.objs.size()=1 2024-09-12T00:38:36.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.319+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.hU-mStY9zREqGnEk5X2ws_jIgGLiIo4_0 2024-09-12T00:38:36.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.321+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16592220177415056926', time=2024-09-12T02:30:54.578596+0000, chain.objs.size()=1 2024-09-12T00:38:36.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.321+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.rffDmHe4gzadrdHhcgTIYotQHwat4Vb_0 2024-09-12T00:38:36.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.321+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1196269540530355075', time=2024-09-12T02:30:54.629344+0000, chain.objs.size()=1 2024-09-12T00:38:36.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.321+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.qv0vxKAnKH15LyOCaFaAZGwqdydM_4u_0 2024-09-12T00:38:36.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.321+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7779872558933009944', time=2024-09-12T02:30:54.674006+0000, chain.objs.size()=1 2024-09-12T00:38:36.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.321+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Acufce3In6fda-HmIStn_QZjJkOinuf_0 2024-09-12T00:38:36.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9414438439993227581', time=2024-09-12T02:30:54.849761+0000, chain.objs.size()=1 2024-09-12T00:38:36.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.8tN4mNErxsgi5k1WFFLWgldCfVBSNVH_0 2024-09-12T00:38:36.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2131469319298911754', time=2024-09-12T02:30:54.851269+0000, chain.objs.size()=1 2024-09-12T00:38:36.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BZmwAkbipZLQvPrVuWAVdPT3NZ6kYkB_0 2024-09-12T00:38:36.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13204131259116675678', time=2024-09-12T02:30:54.910274+0000, chain.objs.size()=1 2024-09-12T00:38:36.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.d-aAAqapCvR2Z620k3PWEL4du0314BJ_0 2024-09-12T00:38:36.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15010983675475071009', time=2024-09-12T02:30:54.939324+0000, chain.objs.size()=1 2024-09-12T00:38:36.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.8zSwltVeAshan_PSp37pAYUJmlRwPGn_0 2024-09-12T00:38:36.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1835169198418350826', time=2024-09-12T02:30:54.966328+0000, chain.objs.size()=1 2024-09-12T00:38:36.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.fmzTcHC6Vp5-oYKzjnYC6xfgGexTBMB_0 2024-09-12T00:38:36.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11424727152012504049', time=2024-09-12T02:30:54.989205+0000, chain.objs.size()=1 2024-09-12T00:38:36.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HgppoR6Tf3_JJgHjlWod-RcApaebUel_0 2024-09-12T00:38:36.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1404633696891069621', time=2024-09-12T02:30:54.990028+0000, chain.objs.size()=1 2024-09-12T00:38:36.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.DwMv6RseSBeEuP3D3I-b7mIwMBQpQWe_0 2024-09-12T00:38:36.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.33774907866661376', time=2024-09-12T02:30:55.147952+0000, chain.objs.size()=1 2024-09-12T00:38:36.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.B8HWY92gaUFsQ2-TOTomNrzEPJP3lEq_0 2024-09-12T00:38:36.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2416268475732703088', time=2024-09-12T02:30:55.151245+0000, chain.objs.size()=1 2024-09-12T00:38:36.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.324+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Jc1wVwY7utgwKJnsf6hUDy2Lg8NtPAw_0 2024-09-12T00:38:36.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.327+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8794415242368230141', time=2024-09-12T02:30:55.161430+0000, chain.objs.size()=1 2024-09-12T00:38:36.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.327+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Bfrral4WWBLt-Jtnk0fNkiFzOM9-2kl_0 2024-09-12T00:38:36.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.327+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2380436120696936978', time=2024-09-12T02:30:55.162178+0000, chain.objs.size()=1 2024-09-12T00:38:36.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.327+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.rpge9XKX9krK36ER7VrTZTWQm0EKnWV_0 2024-09-12T00:38:36.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.328+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.804945866109434139', time=2024-09-12T02:30:55.237255+0000, chain.objs.size()=1 2024-09-12T00:38:36.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.328+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6GSQrVIxyihadYK5LtrkNSGz-5Eu867_0 2024-09-12T00:38:36.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.328+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.506894477936854952', time=2024-09-12T02:30:59.343518+0000, chain.objs.size()=1 2024-09-12T00:38:36.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.328+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.279__shadow_.vcajpm9wefDHZ-MhzWqf8aVch2TLtzH_0 2024-09-12T00:38:36.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.329+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7293640677516060536', time=2024-09-12T02:31:00.305549+0000, chain.objs.size()=1 2024-09-12T00:38:36.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.329+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.283__shadow_.r5NHb4RbbgbulGVDqqFr71B3zAS_aDB_0 2024-09-12T00:38:36.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.329+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13382654116403247833', time=2024-09-12T02:31:01.634417+0000, chain.objs.size()=1 2024-09-12T00:38:36.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.329+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.288__shadow_.parEUEj9jghrj2xnGg-aa7xG5RYY8tp_0 2024-09-12T00:38:36.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.329+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16172162989881240420', time=2024-09-12T02:31:02.117376+0000, chain.objs.size()=1 2024-09-12T00:38:36.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.329+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.290__shadow_.JsP-rREn-tI2GCcZ-xpb_riGTYMRVRs_0 2024-09-12T00:38:36.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.330+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8618032504575735473', time=2024-09-12T02:31:03.067727+0000, chain.objs.size()=1 2024-09-12T00:38:36.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.330+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.LyvBmTy0zdo-Sj-lPm26gE14mcXVwn8_0 2024-09-12T00:38:36.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.330+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.634581380224316788', time=2024-09-12T02:31:03.071386+0000, chain.objs.size()=1 2024-09-12T00:38:36.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.330+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.FTIXs0rItWf_uGy3OeBIl4UqWRvHd9P_0 2024-09-12T00:38:36.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.330+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18356834663648555331', time=2024-09-12T02:31:03.662542+0000, chain.objs.size()=1 2024-09-12T00:38:36.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.330+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.jyDFZF3MGncU7-l3ownyjBcJKyzxAMw_0 2024-09-12T00:38:36.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.330+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9973411554131378062', time=2024-09-12T02:31:03.889284+0000, chain.objs.size()=1 2024-09-12T00:38:36.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.330+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.294__shadow_.QmqDOFIQ4Pt5-VGLJ4qrX4vzNS9smVO_0 2024-09-12T00:38:36.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.330+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9482987831287437325', time=2024-09-12T02:31:04.408160+0000, chain.objs.size()=1 2024-09-12T00:38:36.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.330+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.296__shadow_.XFwOKacMucXl57l5NYFeJZGK1sn0kP__0 2024-09-12T00:38:36.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.332+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1492219200074471862', time=2024-09-12T02:31:05.218701+0000, chain.objs.size()=1 2024-09-12T00:38:36.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.332+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.299__shadow_.1dFrQvf03QI3fJ456IzwTI-GupGwCvK_0 2024-09-12T00:38:36.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.334+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1375784551616265460', time=2024-09-12T02:31:05.457721+0000, chain.objs.size()=1 2024-09-12T00:38:36.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.334+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.300__shadow_.iTesY7Rhk7qD_eO6hPUpXHr8hm-u1wz_0 2024-09-12T00:38:36.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12776714939720048702', time=2024-09-12T02:31:19.365030+0000, chain.objs.size()=1 2024-09-12T00:38:36.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.CCzlXQXGPscpJAiv3p500RzlnlH6VrV_0 2024-09-12T00:38:36.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10012797590769503403', time=2024-09-12T02:31:19.444675+0000, chain.objs.size()=1 2024-09-12T00:38:36.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.a5cuD0ZEV75dyCrJelm57xwtvnvjDPl_0 2024-09-12T00:38:36.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.920755220418188754', time=2024-09-12T02:31:19.774991+0000, chain.objs.size()=1 2024-09-12T00:38:36.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.2DpvrIxsLkeDAi1xMl6AUn40XEUvOUp_0 2024-09-12T00:38:36.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11797517064292733219', time=2024-09-12T02:31:20.031157+0000, chain.objs.size()=1 2024-09-12T00:38:36.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.fklB-S6ErRTTf7m4hLaA6-JlQGPdBTA_0 2024-09-12T00:38:36.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3517017462397825847', time=2024-09-12T02:31:20.034942+0000, chain.objs.size()=1 2024-09-12T00:38:36.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.1WdOxVb2wkf7E3fxPqZWmjz-wFbaEP2_0 2024-09-12T00:38:36.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13836567505433374031', time=2024-09-12T02:31:20.077202+0000, chain.objs.size()=1 2024-09-12T00:38:36.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.rRd0FW2LgF1-jsD734JFJmE4qPN7u9R_0 2024-09-12T00:38:36.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15583955853289581859', time=2024-09-12T02:31:20.088249+0000, chain.objs.size()=1 2024-09-12T00:38:36.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.pB9wRTdtKEe2naI7jNnGqvfNGJMllq7_0 2024-09-12T00:38:36.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12468305323631836123', time=2024-09-12T02:31:20.121118+0000, chain.objs.size()=1 2024-09-12T00:38:36.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.G5AKV5EHJN9aagFP7qIuWWH0BbEseNi_0 2024-09-12T00:38:36.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17835338232758131178', time=2024-09-12T02:31:20.166540+0000, chain.objs.size()=1 2024-09-12T00:38:36.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.iYaAm6SCh9mRQObaa9vGtJ18pcZ5m4Y_0 2024-09-12T00:38:36.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11317475260589406564', time=2024-09-12T02:31:20.284601+0000, chain.objs.size()=1 2024-09-12T00:38:36.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IFpgtsjjaqNtteFqJrfI18_XCRDOk3a_0 2024-09-12T00:38:36.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.339+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13706887933180421334', time=2024-09-12T02:31:20.317497+0000, chain.objs.size()=1 2024-09-12T00:38:36.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.339+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.j8K4nvw869-GHQUgZfcBXsimvQEVKeN_0 2024-09-12T00:38:36.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.341+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.437466879217343158', time=2024-09-12T02:31:20.325986+0000, chain.objs.size()=1 2024-09-12T00:38:36.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.341+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.INFHMKp67T456QKNU6vV0FcbpmOOJS5_0 2024-09-12T00:38:36.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.341+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5913365732517292716', time=2024-09-12T02:31:20.369316+0000, chain.objs.size()=1 2024-09-12T00:38:36.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.341+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.J4dF1ed_0XbsjMXSdQKh8fdyLiMz8yx_0 2024-09-12T00:38:36.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.343+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5221484249129929637', time=2024-09-12T02:31:20.400371+0000, chain.objs.size()=1 2024-09-12T00:38:36.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.343+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Qzi5dzN1q0dgVljd-Htq5dga1gUe19j_0 2024-09-12T00:38:36.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.343+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16138503445738931010', time=2024-09-12T02:31:20.580731+0000, chain.objs.size()=1 2024-09-12T00:38:36.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.343+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.9uGfRAWFGo-RM4KXrjXJr_WFQfgnDbW_0 2024-09-12T00:38:36.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.344+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7545919068495343783', time=2024-09-12T02:31:20.596453+0000, chain.objs.size()=1 2024-09-12T00:38:36.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.344+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.5JtpC5u1nsUvW11XUUFC32Y2hEkMYX1_0 2024-09-12T00:38:36.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.344+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4740429327727842566', time=2024-09-12T02:31:20.719605+0000, chain.objs.size()=1 2024-09-12T00:38:36.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.344+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NFCGT6QDF7rm-UmKxLjTkuGC6RSy5HI_0 2024-09-12T00:38:36.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.344+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12307002967533882226', time=2024-09-12T02:31:20.748303+0000, chain.objs.size()=1 2024-09-12T00:38:36.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.344+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.mh4NlEUmZOsP5FAh-WCsld2GHq7LsUO_0 2024-09-12T00:38:36.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.344+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17718342940651644166', time=2024-09-12T02:31:20.775921+0000, chain.objs.size()=1 2024-09-12T00:38:36.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.344+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.jKTnxw_04wENMwhrNeiwgy82GXMnQyW_0 2024-09-12T00:38:36.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.344+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6363162970921394022', time=2024-09-12T02:31:20.951191+0000, chain.objs.size()=1 2024-09-12T00:38:36.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.344+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.WvdVjeJEs7c2WL4G79o6ecffc5bgoF2_0 2024-09-12T00:38:36.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.344+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18114933304098855138', time=2024-09-12T02:31:21.058881+0000, chain.objs.size()=1 2024-09-12T00:38:36.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.344+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.zvxmJs82yAsNV1X9RCM_qNgGY6wT-Lv_0 2024-09-12T00:38:36.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.344+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14305433907906139957', time=2024-09-12T02:31:21.192488+0000, chain.objs.size()=1 2024-09-12T00:38:36.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.344+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.2M3RIEC53-ct7XXTRkcT8wL3TWiXAhZ_0 2024-09-12T00:38:36.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.347+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15369032195449800429', time=2024-09-12T02:31:21.361444+0000, chain.objs.size()=1 2024-09-12T00:38:36.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.347+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.QDq_rsNT0PMdXFuRvvncYPKvBqc8dXY_0 2024-09-12T00:38:36.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.347+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14643568952534036053', time=2024-09-12T02:31:21.528171+0000, chain.objs.size()=1 2024-09-12T00:38:36.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.347+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7WfH3xvnhzF0S12wS5se5i8nn8-uyu8_0 2024-09-12T00:38:36.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.347+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17937013187911977364', time=2024-09-12T02:31:21.545470+0000, chain.objs.size()=1 2024-09-12T00:38:36.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.347+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ebG4ESBwrUgZxh1lv7-NHVKZKpSlG4Q_0 2024-09-12T00:38:36.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.347+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10305535571043420733', time=2024-09-12T02:31:21.550869+0000, chain.objs.size()=1 2024-09-12T00:38:36.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.347+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.yOnT-gtwKPXXQBnZcz9w9t0T5frU0e3_0 2024-09-12T00:38:36.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.347+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1074298846359039753', time=2024-09-12T02:31:29.686394+0000, chain.objs.size()=1 2024-09-12T00:38:36.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.347+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.SEw-FmrGVG8ZbYjSWaZrUlo8lYN8m6u_0 2024-09-12T00:38:36.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13545907139505315557', time=2024-09-12T02:31:29.694463+0000, chain.objs.size()=1 2024-09-12T00:38:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.qhnNXuq4jDn1OriZiTxK2wIYGRLdPqP_0 2024-09-12T00:38:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13950031546579767009', time=2024-09-12T02:31:29.845666+0000, chain.objs.size()=1 2024-09-12T00:38:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-vAIPBlvlmlDqdhxQOuPr0_tu4RFWU3_0 2024-09-12T00:38:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10139611564187776663', time=2024-09-12T02:31:30.007788+0000, chain.objs.size()=1 2024-09-12T00:38:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.9P-mb_sF7_ZH2jrE3hMeNlk3btwQrC7_0 2024-09-12T00:38:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6648578676882792527', time=2024-09-12T02:31:30.099125+0000, chain.objs.size()=1 2024-09-12T00:38:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.h6GC13QsJlWgk0sA8swhWcAhm94Gd8L_0 2024-09-12T00:38:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8729771703423184357', time=2024-09-12T02:31:30.116934+0000, chain.objs.size()=1 2024-09-12T00:38:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.QGyjaeUVzP2tA6q-Etuq0eT2_l4bkW7_0 2024-09-12T00:38:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2665808614654220217', time=2024-09-12T02:31:30.134283+0000, chain.objs.size()=1 2024-09-12T00:38:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.cZIwKWSVWhQ517F7Fu4SLzShBN7H5e1_0 2024-09-12T00:38:36.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18180677763446216308', time=2024-09-12T02:31:30.157227+0000, chain.objs.size()=1 2024-09-12T00:38:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Ul1eyeEN4LZhEElJSbdyf1kv5HCSF3y_0 2024-09-12T00:38:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1856067665650511625', time=2024-09-12T02:31:30.158877+0000, chain.objs.size()=1 2024-09-12T00:38:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.350+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NF68InXwW9djPOJsMX5XugkRJBMgCWb_0 2024-09-12T00:38:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.351+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13391230485882893175', time=2024-09-12T02:31:30.323761+0000, chain.objs.size()=1 2024-09-12T00:38:36.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.351+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.P5dLiJHYv83I0KAXbQRfvWh23Wsw2Cj_0 2024-09-12T00:38:36.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.354+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4842533931149836815', time=2024-09-12T02:31:30.441350+0000, chain.objs.size()=1 2024-09-12T00:38:36.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.354+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ZheEkx0B68u7_E6nzNwV4NT9LtTL5lR_0 2024-09-12T00:38:36.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.354+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15790547213666220015', time=2024-09-12T02:31:30.448139+0000, chain.objs.size()=1 2024-09-12T00:38:36.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.354+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.5GWtWn3ZUyulTPiCm19m8nrqQyDsmu0_0 2024-09-12T00:38:36.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.354+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11967711858987038610', time=2024-09-12T02:31:30.467668+0000, chain.objs.size()=1 2024-09-12T00:38:36.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.354+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.TLMcgbFiZ91hmUNRCoeit60v1W9uKx1_0 2024-09-12T00:38:36.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.354+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15908727550210267782', time=2024-09-12T02:31:30.567750+0000, chain.objs.size()=1 2024-09-12T00:38:36.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.354+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.PHxlxz3wuHIc0uS24QifXnh4cLzl3cy_0 2024-09-12T00:38:36.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.354+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3191186719186191197', time=2024-09-12T02:31:30.631095+0000, chain.objs.size()=1 2024-09-12T00:38:36.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.354+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.9K0rQQitS3Hmo5f7odr8bVcEcShBvk3_0 2024-09-12T00:38:36.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.355+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16156672016837571508', time=2024-09-12T02:31:30.849709+0000, chain.objs.size()=1 2024-09-12T00:38:36.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.355+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Prrkg3USmNRHj4sJWG9RLWAAkpZeM65_0 2024-09-12T00:38:36.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.355+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13579209902217330841', time=2024-09-12T02:31:30.877353+0000, chain.objs.size()=1 2024-09-12T00:38:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.355+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.nhBXmK-OSFMFQD7QW7ypkfTNceG73pT_0 2024-09-12T00:38:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.355+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17814333966768652881', time=2024-09-12T02:31:30.912787+0000, chain.objs.size()=1 2024-09-12T00:38:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.355+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.X16TXXDpauOShq9r8f-9IvQ5ZHoars8_0 2024-09-12T00:38:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.356+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2418957760485156706', time=2024-09-12T02:31:30.956868+0000, chain.objs.size()=1 2024-09-12T00:38:36.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.356+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.zeyJg36SkcvEKRQWccwptVAB7OcgBbw_0 2024-09-12T00:38:36.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.357+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13849361956648062715', time=2024-09-12T02:31:31.016778+0000, chain.objs.size()=1 2024-09-12T00:38:36.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.357+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.pfVeEQAGxU7xgGN_Mvh-k-xzah_ec98_0 2024-09-12T00:38:36.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.357+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11075293441775545477', time=2024-09-12T02:31:31.039150+0000, chain.objs.size()=1 2024-09-12T00:38:36.356 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.357+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ww-454jqBJ13f-GZATDG8uJgg6rqgz7_0 2024-09-12T00:38:36.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.358+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17323412869934761014', time=2024-09-12T02:31:31.117514+0000, chain.objs.size()=1 2024-09-12T00:38:36.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.358+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.HkOvWzkQppw_E2RlSWtqCmAVcKxycN8_0 2024-09-12T00:38:36.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.359+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9289937814193073053', time=2024-09-12T02:31:31.171280+0000, chain.objs.size()=1 2024-09-12T00:38:36.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.359+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.MQw2c3lCK1kzxzBcu7UB2gMxo6CtGiM_0 2024-09-12T00:38:36.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.359+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1424946102659571296', time=2024-09-12T02:31:31.316994+0000, chain.objs.size()=1 2024-09-12T00:38:36.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.359+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.C2EPbFv5eulffDLF33_1YN0eP7dxmHK_0 2024-09-12T00:38:36.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.364+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/46675 2024-09-12T00:38:36.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T00:38:36.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10125609906330869070', time=2024-09-12T02:31:31.325356+0000, chain.objs.size()=1 2024-09-12T00:38:36.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NWBZaae4zUzJKf44VuWLhVEemcQ6v3E_0 2024-09-12T00:38:36.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13199139967695995621', time=2024-09-12T02:31:31.407498+0000, chain.objs.size()=1 2024-09-12T00:38:36.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NB55rDZBL8S2m6m4BXxO_gpS0Dn1JOs_0 2024-09-12T00:38:36.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7892099491640859635', time=2024-09-12T02:31:31.412580+0000, chain.objs.size()=1 2024-09-12T00:38:36.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.jeCi2SokhFrurg7Q8A9Z_NUblyjPUvo_0 2024-09-12T00:38:36.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15972477084716679248', time=2024-09-12T02:31:31.465590+0000, chain.objs.size()=1 2024-09-12T00:38:36.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.PnBKjc9lsuinNgb8yU0E8O_4_axCikf_0 2024-09-12T00:38:36.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8428386033032043490', time=2024-09-12T02:31:31.678788+0000, chain.objs.size()=1 2024-09-12T00:38:36.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Wh75IV311aCTb6usDkMv2YHaJaOc2vd_0 2024-09-12T00:38:36.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.38545386848245808', time=2024-09-12T02:31:31.751454+0000, chain.objs.size()=1 2024-09-12T00:38:36.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.TS76DDC-zs6-poHDzZ6CCw7htOmPVN2_0 2024-09-12T00:38:36.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12485336572048016044', time=2024-09-12T02:31:31.762826+0000, chain.objs.size()=1 2024-09-12T00:38:36.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ya0Pm90j3Mm8yrmdVPm-FOZ84ebYDYb_0 2024-09-12T00:38:36.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6408699352219760710', time=2024-09-12T02:31:59.299154+0000, chain.objs.size()=1 2024-09-12T00:38:36.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.433__shadow_.gZxqowwlgXlUIvlZgd1O1sOZ44iC3Ng_0 2024-09-12T00:38:36.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1638477383483056633', time=2024-09-12T02:31:59.499113+0000, chain.objs.size()=1 2024-09-12T00:38:36.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.434__shadow_.HweteKEzAOMsmM5ZCM96pm79x83y8ZF_0 2024-09-12T00:38:36.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18230260946138479158', time=2024-09-12T02:32:09.560464+0000, chain.objs.size()=1 2024-09-12T00:38:36.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.466__shadow_.Pe-F-1cnGSeVIPwpnWEfQHa-5GvH--R_0 2024-09-12T00:38:36.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4532941965737131995', time=2024-09-12T02:32:12.589368+0000, chain.objs.size()=1 2024-09-12T00:38:36.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.483__shadow_.lDlnESPBlYillbDg2dpNyKGib8foUhM_0 2024-09-12T00:38:36.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5366405510426416134', time=2024-09-12T02:32:12.596762+0000, chain.objs.size()=1 2024-09-12T00:38:36.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.366+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.483__shadow_.MY1AtD4f6yhFwwkUzvqNYTiKa9r3IUs_0 2024-09-12T00:38:36.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.370+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8579734434617193022', time=2024-09-12T02:32:12.600613+0000, chain.objs.size()=1 2024-09-12T00:38:36.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.370+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.483__shadow_.dr-e91OdCcxUZT7pxb1VoXjEmWVbiQ4_0 2024-09-12T00:38:36.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.370+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6408765061438621604', time=2024-09-12T02:32:33.787815+0000, chain.objs.size()=3 2024-09-12T00:38:36.368 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.370+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.525__multipart_mymultipart.2~yzgzPV0_T8uaLCBM5iZTS9rFi14sL5y.1 2024-09-12T00:38:36.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.370+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.525__multipart_mymultipart.2~yzgzPV0_T8uaLCBM5iZTS9rFi14sL5y.2 2024-09-12T00:38:36.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.370+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.525__multipart_mymultipart.2~yzgzPV0_T8uaLCBM5iZTS9rFi14sL5y.3 2024-09-12T00:38:36.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.370+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4207676017292153604', time=2024-09-12T02:32:35.296378+0000, chain.objs.size()=1 2024-09-12T00:38:36.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.370+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.528__shadow_.YUVLZL_tqU2sPbt7UZ-0eXfeUKRv2zb_0 2024-09-12T00:38:36.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.370+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~zEfbHgPRbE0RayCocveLws--SuL7ZNg', time=2024-09-12T02:32:37.699687+0000, chain.objs.size()=1 2024-09-12T00:38:36.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.370+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.535__multipart_mymultipart.2~zEfbHgPRbE0RayCocveLws--SuL7ZNg.3 2024-09-12T00:38:36.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.372+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3761798420337624971', time=2024-09-12T02:33:06.999998+0000, chain.objs.size()=1 2024-09-12T00:38:36.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.372+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.554__shadow_.h14Imxr8DF7r5IJSPh2lRxahIHXga9-_0 2024-09-12T00:38:36.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.372+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7554746446417954383', time=2024-09-12T02:33:24.616596+0000, chain.objs.size()=1 2024-09-12T00:38:36.370 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.372+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.574__shadow_.8xdJblsbd0RtKp1Erh7VBKxU8dEY6EN_0 2024-09-12T00:38:36.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.372+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4147294281043856983', time=2024-09-12T02:33:28.926798+0000, chain.objs.size()=1 2024-09-12T00:38:36.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.372+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.576__shadow:pedGZoNU2omParaJtfKkLD.qEUr1lxL_.1Fddnjuo9CQX-rX2Fjw1QP8ryrOkCx8_0 2024-09-12T00:38:36.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.372+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8064732137439563692', time=2024-09-12T02:33:31.407891+0000, chain.objs.size()=1 2024-09-12T00:38:36.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.372+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:LGkKG.ttLAWsqWxuXpmAALSa2W4yej8_.MiyK1kD0Xw5dEWQlSqb8mSSLCoKygox_0 2024-09-12T00:38:36.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.372+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1838240667383940301', time=2024-09-12T02:33:38.104058+0000, chain.objs.size()=1 2024-09-12T00:38:36.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.372+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:Jzi.KZSp5-13tWLMqnOmrvYiCrEx9SH_.cIOffven-hu86Ayw3KT4_UazzUZ0bqL_0 2024-09-12T00:38:36.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.374+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10199508424898758614', time=2024-09-12T02:33:41.997820+0000, chain.objs.size()=1 2024-09-12T00:38:36.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.374+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:PXm608jC-JRKvS3nmxeis69OELWPsGm_.2fgODLYEFwgKKcqoNSEWX4IS4FwHc9L_0 2024-09-12T00:38:36.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.375+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15643548400301354186', time=2024-09-12T02:33:42.841987+0000, chain.objs.size()=1 2024-09-12T00:38:36.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.375+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:yaY2cozDr9.keTy0NCFkZYPF.kzemTv_.p2W87RGaNJGhTC2vsl-AKy-gi16N1ms_0 2024-09-12T00:38:36.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.375+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17452312974685706535', time=2024-09-12T02:33:46.839932+0000, chain.objs.size()=1 2024-09-12T00:38:36.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.375+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.580__shadow:HooGfH8hx1SEa6IzJ2l8zy9gAlHTY11_.Rc7A8GkqIgP-0yDu_GRWjWs8GRPsKQJ_0 2024-09-12T00:38:36.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.375+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9489562927914810701', time=2024-09-12T02:33:48.562646+0000, chain.objs.size()=1 2024-09-12T00:38:36.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.375+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.585__shadow:E0NkYE-vJGW.SOyrWkX4zKK-fyW62OY_.mbtA4nUvhiONHsTkP1p5p1WW33wQw-F_0 2024-09-12T00:38:36.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.375+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12315434747955510725', time=2024-09-12T02:33:49.163093+0000, chain.objs.size()=1 2024-09-12T00:38:36.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.375+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.587__shadow:0068P3FKWSDeOs6GXJp5nxekcKlqsgC_.aQH6YLCOVlz5716HHXU5cu08-fpyq6x_0 2024-09-12T00:38:36.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.375+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9660161401154286026', time=2024-09-12T02:36:05.877541+0000, chain.objs.size()=1 2024-09-12T00:38:36.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.375+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.633__shadow_.wz9sU_LiOZhPRS3JSFD4XzJ6yaUg3co_0 2024-09-12T00:38:36.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.375+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6786161645660864466', time=2024-09-12T02:36:15.925568+0000, chain.objs.size()=1 2024-09-12T00:38:36.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.375+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.663__shadow_.R208K_xmUce_bNLmGGPz7VDXPU4cXMf_0 2024-09-12T00:38:36.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.379+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1268741111619656132', time=2024-09-12T02:36:24.111180+0000, chain.objs.size()=1 2024-09-12T00:38:36.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.379+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.697__shadow:rscJV0U0u7HDwtVp7efY6MASbfdrtea_.PLp8xbcPUHmIvF8pcbe6MlSTEU4pvsM_0 2024-09-12T00:38:36.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.379+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12685385718324217160', time=2024-09-12T02:36:27.631997+0000, chain.objs.size()=1 2024-09-12T00:38:36.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.379+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.710__shadow:Zo1V96-n4jnQxvduEojttazuHv8c6Z1_.1CWZbu4Jjgh6HcGoD9gB7JQucuWjTlN_0 2024-09-12T00:38:36.381 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.383+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:36.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.385+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:38:36.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.386+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:36.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.387+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:36.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49051' 2024-09-12T00:38:36.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14227324643464754519', time=2024-09-12T02:30:38.809603+0000, chain.objs.size()=1 2024-09-12T00:38:36.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.236__shadow_.tnYscsvBgYMKOmzgob1eJ9LVpOHKltj_0 2024-09-12T00:38:36.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1768374576989398184', time=2024-09-12T02:30:41.688651+0000, chain.objs.size()=1 2024-09-12T00:38:36.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.247__shadow_.Az5DyAa5m7czGl7tyKMQXy2o3hSi7we_0 2024-09-12T00:38:36.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4772093249091555047', time=2024-09-12T02:30:44.353656+0000, chain.objs.size()=1 2024-09-12T00:38:36.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.258__shadow_.dam2PjtTtMjUa66nj8oJIpk1AIwnHya_0 2024-09-12T00:38:36.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16335741982077085820', time=2024-09-12T02:30:53.172001+0000, chain.objs.size()=1 2024-09-12T00:38:36.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6FvsmMJVpkgY17ee-z74Gi-pB4dirS7_0 2024-09-12T00:38:36.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3048961208766005495', time=2024-09-12T02:30:53.250910+0000, chain.objs.size()=1 2024-09-12T00:38:36.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pAmgNzT858lHtFSR2FvEVmp3QsQt-Gh_0 2024-09-12T00:38:36.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12864702723425842780', time=2024-09-12T02:30:53.271381+0000, chain.objs.size()=1 2024-09-12T00:38:36.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.45qDCBad1I1bLzev0yBobbmjVBklfm__0 2024-09-12T00:38:36.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15930080404915812010', time=2024-09-12T02:30:53.462490+0000, chain.objs.size()=1 2024-09-12T00:38:36.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2phL-MKm-nZZ_crtBRapS3tfncIINTX_0 2024-09-12T00:38:36.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16652347694707211054', time=2024-09-12T02:30:53.518986+0000, chain.objs.size()=1 2024-09-12T00:38:36.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.MhJzYQOIC94e8U-DMXh4fnfvlM6wXMN_0 2024-09-12T00:38:36.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5613743406960734586', time=2024-09-12T02:30:53.530098+0000, chain.objs.size()=1 2024-09-12T00:38:36.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.y43g5_f-c6A0pwVDsA71-fSlR9Kfp4S_0 2024-09-12T00:38:36.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5149015121896144094', time=2024-09-12T02:30:53.718594+0000, chain.objs.size()=1 2024-09-12T00:38:36.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.thtIuauHAg-VqudFLVLdSe75igWaCiL_0 2024-09-12T00:38:36.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18056269432920530814', time=2024-09-12T02:30:53.720105+0000, chain.objs.size()=1 2024-09-12T00:38:36.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.SyN_ESyPNLcAi0OgH0vl79qF3BlaBwo_0 2024-09-12T00:38:36.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17758297641852258878', time=2024-09-12T02:30:53.735994+0000, chain.objs.size()=1 2024-09-12T00:38:36.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.FUJyDqAW5H8KvR-UFCXW7P6m3YJNiJD_0 2024-09-12T00:38:36.389 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.391+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.903670559370758623', time=2024-09-12T02:30:53.742697+0000, chain.objs.size()=1 2024-09-12T00:38:36.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.391+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.V8Xq_FZPH4gIaC3IsrOCA3rABMKg5Tq_0 2024-09-12T00:38:36.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8045650975285851355', time=2024-09-12T02:30:53.769600+0000, chain.objs.size()=1 2024-09-12T00:38:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.rDnIUug82P-ajsE30xnXKI2VQpqcnQk_0 2024-09-12T00:38:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17766415116255069944', time=2024-09-12T02:30:53.783289+0000, chain.objs.size()=1 2024-09-12T00:38:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.LOKQp1qXf1lNGXe17U_7NveGURxiWYz_0 2024-09-12T00:38:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8589068090066632890', time=2024-09-12T02:30:53.799782+0000, chain.objs.size()=1 2024-09-12T00:38:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JoqeUEVWj9KtpzUoflWWBjoaZE7dyeZ_0 2024-09-12T00:38:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17408278711971801952', time=2024-09-12T02:30:53.825162+0000, chain.objs.size()=1 2024-09-12T00:38:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Gea2Zscsib-Lnr3C6tsi_xnmngwkW0L_0 2024-09-12T00:38:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12388031526911240300', time=2024-09-12T02:30:53.829216+0000, chain.objs.size()=1 2024-09-12T00:38:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.tBqiy4LWYCvX2fPZZs6hVipuATVfnRC_0 2024-09-12T00:38:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15960131461096701176', time=2024-09-12T02:30:54.002734+0000, chain.objs.size()=1 2024-09-12T00:38:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.NDnDL38ybC8Wya356oVnURc4RKjBQ8h_0 2024-09-12T00:38:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14921173729044803783', time=2024-09-12T02:30:54.298722+0000, chain.objs.size()=1 2024-09-12T00:38:36.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Ums5dXB2A76JILpTqQpbV5dryQRfIum_0 2024-09-12T00:38:36.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8482980697944245503', time=2024-09-12T02:30:54.412310+0000, chain.objs.size()=1 2024-09-12T00:38:36.392 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.392+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.E8tdQkIXFdtm9y8IFi-BRU22yWL5LMH_0 2024-09-12T00:38:36.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.395+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12825193147529157708', time=2024-09-12T02:30:54.420283+0000, chain.objs.size()=1 2024-09-12T00:38:36.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.395+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.x8fuvqQOBMbCNtGJtpshjqMSJytj_qO_0 2024-09-12T00:38:36.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.395+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12183860612147829245', time=2024-09-12T02:30:54.470642+0000, chain.objs.size()=1 2024-09-12T00:38:36.393 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.395+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.4FaI89Ad0-kH7Y_ki2zjOJrS8BKpxnD_0 2024-09-12T00:38:36.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11880047312754462798', time=2024-09-12T02:30:54.702805+0000, chain.objs.size()=1 2024-09-12T00:38:36.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lgwQoLIbv_IPu-_IM1FehnxNlTlyibx_0 2024-09-12T00:38:36.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3558726845416179088', time=2024-09-12T02:30:54.710405+0000, chain.objs.size()=1 2024-09-12T00:38:36.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.tPE2l4jnqjKlEVpM5wUsaRI-w-75rm__0 2024-09-12T00:38:36.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13052220452932857270', time=2024-09-12T02:30:54.720715+0000, chain.objs.size()=1 2024-09-12T00:38:36.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.7dOLIaV_hIYCLFDjVWwOKruCUq0Sffc_0 2024-09-12T00:38:36.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4151836693329832362', time=2024-09-12T02:30:54.842812+0000, chain.objs.size()=1 2024-09-12T00:38:36.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.m4L47NfkWJCxnuWsVj9Qg8WNN5H2_sV_0 2024-09-12T00:38:36.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8585725252206283264', time=2024-09-12T02:30:54.865574+0000, chain.objs.size()=1 2024-09-12T00:38:36.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.3Xpp1bFMNLCFrcIneFGI-ga6e1bRopJ_0 2024-09-12T00:38:36.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17302862869011123519', time=2024-09-12T02:30:54.880805+0000, chain.objs.size()=1 2024-09-12T00:38:36.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.q0bvvzkyL2iDMLAVfGZXpmN0l7DCn4D_0 2024-09-12T00:38:36.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9406834164511188996', time=2024-09-12T02:30:54.885385+0000, chain.objs.size()=1 2024-09-12T00:38:36.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.sb-hkIRZJW0IIaH0YivgKWThgFbsa9Q_0 2024-09-12T00:38:36.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2036394408285201445', time=2024-09-12T02:30:54.946360+0000, chain.objs.size()=1 2024-09-12T00:38:36.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.0Zf4FhN7N0GxIQSXwoyqCC8HXzDc8Eh_0 2024-09-12T00:38:36.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12979802988117486354', time=2024-09-12T02:30:55.077575+0000, chain.objs.size()=1 2024-09-12T00:38:36.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.5ume9F1nAhpguJJLGKQRh7k9ZdUDmbK_0 2024-09-12T00:38:36.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11303171874623834759', time=2024-09-12T02:30:55.087827+0000, chain.objs.size()=1 2024-09-12T00:38:36.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.tizX6DL6YlVPCIbZ9VhJzrYHrG8U-xg_0 2024-09-12T00:38:36.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8140234851730947790', time=2024-09-12T02:30:55.089743+0000, chain.objs.size()=1 2024-09-12T00:38:36.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.399+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.uowRStGhYUW2QU3N6DU8R-yRDEaLBwY_0 2024-09-12T00:38:36.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.402+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7901396313162529647', time=2024-09-12T02:30:55.139226+0000, chain.objs.size()=1 2024-09-12T00:38:36.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.402+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lSURJPugADv08WkRknfZ7bu-Hh4YeHT_0 2024-09-12T00:38:36.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2871502592574011486', time=2024-09-12T02:30:55.150550+0000, chain.objs.size()=1 2024-09-12T00:38:36.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.rsqvuIzl6spdeIWnrvhKgnqFYvN_rpn_0 2024-09-12T00:38:36.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4714971311156091448', time=2024-09-12T02:30:55.164507+0000, chain.objs.size()=1 2024-09-12T00:38:36.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.P-esm8TLi35DLjHo398tsT08fNGHKwM_0 2024-09-12T00:38:36.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13486612740718952291', time=2024-09-12T02:30:56.421569+0000, chain.objs.size()=1 2024-09-12T00:38:36.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.267__shadow_.HtJz-wzyP5mgP12YBbtz08a0epwRFHw_0 2024-09-12T00:38:36.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.362644037799407036', time=2024-09-12T02:30:56.654736+0000, chain.objs.size()=1 2024-09-12T00:38:36.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.268__shadow_.i6P4WVeddWvJ3cmrF5qZ6Y7XHHapdPK_0 2024-09-12T00:38:36.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1233185530737290374', time=2024-09-12T02:30:57.877294+0000, chain.objs.size()=1 2024-09-12T00:38:36.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.273__shadow_.myh20KL3HY-BNQYhIv3ePwrMhgwAvsW_0 2024-09-12T00:38:36.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.360017786480266680', time=2024-09-12T02:31:01.877121+0000, chain.objs.size()=1 2024-09-12T00:38:36.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.289__shadow_.Hi2rnIkRF1BsL2o-dldXhHFnkOz8-2h_0 2024-09-12T00:38:36.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8455359944403662708', time=2024-09-12T02:31:03.065415+0000, chain.objs.size()=1 2024-09-12T00:38:36.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.G_ASc3wBJd1RbE9uYPBhXswewHYO-da_0 2024-09-12T00:38:36.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8122443920734484601', time=2024-09-12T02:31:05.218684+0000, chain.objs.size()=1 2024-09-12T00:38:36.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.404+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.299__shadow_.jg-bEgZ7kP3PBDhONFxvLIX25e5-NVK_0 2024-09-12T00:38:36.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.407+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6568598729091682053', time=2024-09-12T02:31:05.976490+0000, chain.objs.size()=1 2024-09-12T00:38:36.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.407+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.302__shadow_.BhYcq3bnUjYKUX-DgaA6SnSm6puteW8_0 2024-09-12T00:38:36.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.407+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5123817509081840109', time=2024-09-12T02:31:19.344891+0000, chain.objs.size()=1 2024-09-12T00:38:36.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.407+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.WGeOZlm_DNvyYqskxRvAb19MfZbXlv0_0 2024-09-12T00:38:36.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.407+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12808597934047506684', time=2024-09-12T02:31:19.439909+0000, chain.objs.size()=1 2024-09-12T00:38:36.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.407+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.tdzw7W2D4V2XYEMGWv9VvV22kRNhkuG_0 2024-09-12T00:38:36.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.411+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.427224691488687621', time=2024-09-12T02:31:19.446593+0000, chain.objs.size()=1 2024-09-12T00:38:36.409 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.411+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_._YWzkOXtD8FYQIWRRp-gkPMVmN44Ef7_0 2024-09-12T00:38:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9259804762149870635', time=2024-09-12T02:31:19.496176+0000, chain.objs.size()=1 2024-09-12T00:38:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.yo--6nhtbUwiHqVhjv3JahCfaB0gyAR_0 2024-09-12T00:38:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8919098682734464912', time=2024-09-12T02:31:19.721047+0000, chain.objs.size()=1 2024-09-12T00:38:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.x99vuukmvDlOeuNakw5n9jDJabTB_Iw_0 2024-09-12T00:38:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9714603136116728550', time=2024-09-12T02:31:19.723961+0000, chain.objs.size()=1 2024-09-12T00:38:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.YyBuesOB2WHVOVmAJB1w07d0-U8rrUa_0 2024-09-12T00:38:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12355942883645402132', time=2024-09-12T02:31:19.798736+0000, chain.objs.size()=1 2024-09-12T00:38:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.eYjjXFQCwxnC1cpF0n8t2MwNjOE2AcL_0 2024-09-12T00:38:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2097226449608520342', time=2024-09-12T02:31:19.958300+0000, chain.objs.size()=1 2024-09-12T00:38:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.55IABpM5BMSKtIn3WEOGjJTu8OC9oNO_0 2024-09-12T00:38:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6944468058236677251', time=2024-09-12T02:31:19.994040+0000, chain.objs.size()=1 2024-09-12T00:38:36.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.6Lu8jwxz8zWub40bakPxdJchfpIHn_6_0 2024-09-12T00:38:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17848574648156082686', time=2024-09-12T02:31:20.000912+0000, chain.objs.size()=1 2024-09-12T00:38:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.u6g-nJAepuVqy2LxipbD0b33XFO52Cq_0 2024-09-12T00:38:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2112239124908745317', time=2024-09-12T02:31:20.060373+0000, chain.objs.size()=1 2024-09-12T00:38:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ti-ahITN_L0NMmethNZ3ZYgBHROp5JA_0 2024-09-12T00:38:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.677040887298453800', time=2024-09-12T02:31:20.061201+0000, chain.objs.size()=1 2024-09-12T00:38:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.KbJskpBwIugk_jAicnp4qtX_wUoHl6S_0 2024-09-12T00:38:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17829938798138839400', time=2024-09-12T02:31:20.142830+0000, chain.objs.size()=1 2024-09-12T00:38:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ffGQTf_M1Lg_PTeVwwCbVzUGSO5VuU9_0 2024-09-12T00:38:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9300055773315506640', time=2024-09-12T02:31:20.353056+0000, chain.objs.size()=1 2024-09-12T00:38:36.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.413+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.B7SDc1wbIswS0pvQ1CIQ__wU0au6bH-_0 2024-09-12T00:38:36.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.418+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11883421673773962011', time=2024-09-12T02:31:20.439903+0000, chain.objs.size()=1 2024-09-12T00:38:36.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.418+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.OjBGKTGLggqpdWy-vQpB4ZijUfgw6cY_0 2024-09-12T00:38:36.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.418+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4537598139712087790', time=2024-09-12T02:31:20.560536+0000, chain.objs.size()=1 2024-09-12T00:38:36.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.418+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.bqFCwk2qqDI0BgFNtjCGNR6Pq4hyLLm_0 2024-09-12T00:38:36.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.418+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15669468322745574686', time=2024-09-12T02:31:20.675908+0000, chain.objs.size()=1 2024-09-12T00:38:36.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.418+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.dw_5V9Guh8gl9ekZLsrMpDmLvevkR5v_0 2024-09-12T00:38:36.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10849118651101711467', time=2024-09-12T02:31:20.733470+0000, chain.objs.size()=1 2024-09-12T00:38:36.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.oLSATaf3DSDzq-D0I8XgyjB4MlMSow1_0 2024-09-12T00:38:36.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2627486716030634472', time=2024-09-12T02:31:20.889562+0000, chain.objs.size()=1 2024-09-12T00:38:36.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_._SSbhRMk558u9_tGLvGuWe0_woNhgJq_0 2024-09-12T00:38:36.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13906116835216064130', time=2024-09-12T02:31:20.910908+0000, chain.objs.size()=1 2024-09-12T00:38:36.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IYZ6nljNfp1THkK9lX_EpaA9s97nrFs_0 2024-09-12T00:38:36.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11080302705627516691', time=2024-09-12T02:31:20.996831+0000, chain.objs.size()=1 2024-09-12T00:38:36.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.KDdCHMDbQO5NiXx_uyOzaj9baImJUvO_0 2024-09-12T00:38:36.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14010344315850998729', time=2024-09-12T02:31:21.075884+0000, chain.objs.size()=1 2024-09-12T00:38:36.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.rZXryD3vr1iJArF06VEn1eWGKI4yhFB_0 2024-09-12T00:38:36.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11195646894158114270', time=2024-09-12T02:31:21.164216+0000, chain.objs.size()=1 2024-09-12T00:38:36.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.c0jkHo9muWDv2J8ooDwoSBpcZLx2TAT_0 2024-09-12T00:38:36.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15733044723617964839', time=2024-09-12T02:31:21.194955+0000, chain.objs.size()=1 2024-09-12T00:38:36.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.84Ast-OH-o0MOtfiKSmDs-uIY4oJmFK_0 2024-09-12T00:38:36.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.667317063229177015', time=2024-09-12T02:31:21.254116+0000, chain.objs.size()=1 2024-09-12T00:38:36.419 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.419+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.PqLK9grsMJHYatD-TdBK-ZqDis4xxzn_0 2024-09-12T00:38:36.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.423+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15505810253140531661', time=2024-09-12T02:31:21.298641+0000, chain.objs.size()=1 2024-09-12T00:38:36.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.423+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Hdun_N1-yhvvlOJCZoHdaJDnZj7ubZ8_0 2024-09-12T00:38:36.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.423+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.275579142413356932', time=2024-09-12T02:31:21.315690+0000, chain.objs.size()=1 2024-09-12T00:38:36.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.423+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.of10C-_vqJ_Rt_k_1OZx09ll9ibC8Xl_0 2024-09-12T00:38:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11861738673086259022', time=2024-09-12T02:31:21.359440+0000, chain.objs.size()=1 2024-09-12T00:38:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.uYfTlZ8E0CqQeCPPS93MLD7FK_Gpcn2_0 2024-09-12T00:38:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8707821852181674329', time=2024-09-12T02:31:21.501928+0000, chain.objs.size()=1 2024-09-12T00:38:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JshSkb894u9_WVJ-un6n-DZP5cU-bjr_0 2024-09-12T00:38:36.424 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16424712038932633875', time=2024-09-12T02:31:21.533655+0000, chain.objs.size()=1 2024-09-12T00:38:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.SsqhMgc8rGkpmiUivyrCpHifBNKjE72_0 2024-09-12T00:38:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6735479189699167293', time=2024-09-12T02:31:29.676008+0000, chain.objs.size()=1 2024-09-12T00:38:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.x_HlViEvARXffUbWnmw8ZURbpJ_-nWr_0 2024-09-12T00:38:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9599090914265668727', time=2024-09-12T02:31:29.763747+0000, chain.objs.size()=1 2024-09-12T00:38:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.xUk6Cso28e-QKPeyoOL1_-J2A0eehkc_0 2024-09-12T00:38:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18066106666488730529', time=2024-09-12T02:31:29.832329+0000, chain.objs.size()=1 2024-09-12T00:38:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.2jjUp6GiPL5UvypMkIwlpLEeCZkEaYM_0 2024-09-12T00:38:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10906676269634112412', time=2024-09-12T02:31:29.838629+0000, chain.objs.size()=1 2024-09-12T00:38:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.PMlUc6_oXKMY7YHpPuusSBaHk8CnSW2_0 2024-09-12T00:38:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12762186469936980255', time=2024-09-12T02:31:29.862172+0000, chain.objs.size()=1 2024-09-12T00:38:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.OHqngDAKOKNv4kUPs8GId0L8MhchSiZ_0 2024-09-12T00:38:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16139384185067267147', time=2024-09-12T02:31:30.003151+0000, chain.objs.size()=1 2024-09-12T00:38:36.425 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.426+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.gBGtvU08DoJViKiLkzUNYBUxYqaj4uX_0 2024-09-12T00:38:36.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.428+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11560624227707347955', time=2024-09-12T02:31:30.063965+0000, chain.objs.size()=1 2024-09-12T00:38:36.426 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.428+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mQUVD5P5PheRhKA1SnSHEd-NRQ0zIqY_0 2024-09-12T00:38:36.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.428+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13380490309979173756', time=2024-09-12T02:31:30.296514+0000, chain.objs.size()=1 2024-09-12T00:38:36.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.428+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.FFN_F-W5eWu8nywsZPPgdCDpHz1FD9M_0 2024-09-12T00:38:36.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.429+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.954223759427690179', time=2024-09-12T02:31:30.414109+0000, chain.objs.size()=1 2024-09-12T00:38:36.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.429+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lma9SMCzFh8Axt4ZH6MV5riwrPV1utp_0 2024-09-12T00:38:36.428 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.430+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13596919464421629860', time=2024-09-12T02:31:30.574796+0000, chain.objs.size()=1 2024-09-12T00:38:36.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.430+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.1u0lKtpZlHeH0azTWAdXSLGsAx46WaF_0 2024-09-12T00:38:36.429 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.431+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1950857328474017238', time=2024-09-12T02:31:30.577487+0000, chain.objs.size()=1 2024-09-12T00:38:36.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.k0W0tN-lSx7krpIlnAaenhYNoTiUyU__0 2024-09-12T00:38:36.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.431+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14567058570900024447', time=2024-09-12T02:31:30.595866+0000, chain.objs.size()=1 2024-09-12T00:38:36.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.VxiXNxEyeE8bARtxeKXx-9f5DoCuRqv_0 2024-09-12T00:38:36.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.431+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7645602964309055665', time=2024-09-12T02:31:30.678400+0000, chain.objs.size()=1 2024-09-12T00:38:36.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.s2ICdK2ePrOkNs7dYXuHgHBPjBtyj_n_0 2024-09-12T00:38:36.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.431+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17933105750707495896', time=2024-09-12T02:31:30.721112+0000, chain.objs.size()=1 2024-09-12T00:38:36.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.9gVbKvf0F9pglHucf4QIFguOhJjuhWs_0 2024-09-12T00:38:36.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.431+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7980295131915499583', time=2024-09-12T02:31:30.887927+0000, chain.objs.size()=1 2024-09-12T00:38:36.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.tPXn7X-9OpSbY5Lr1ljWjx8JjlSaQ21_0 2024-09-12T00:38:36.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.431+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2939723616016420747', time=2024-09-12T02:31:30.932501+0000, chain.objs.size()=1 2024-09-12T00:38:36.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.HiwGP3_1_orxRBJMUu-LiF__GhVKLMP_0 2024-09-12T00:38:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.431+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.963384221113079244', time=2024-09-12T02:31:30.955785+0000, chain.objs.size()=1 2024-09-12T00:38:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.0zD0CsJLkdB0_Xt4yYcFGiHXqIF5E8K_0 2024-09-12T00:38:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.432+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4239711799834341177', time=2024-09-12T02:31:30.985126+0000, chain.objs.size()=1 2024-09-12T00:38:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.432+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.10LVu3yVvEx4ekU34hh8V8dneLMWT4w_0 2024-09-12T00:38:36.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.433+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17018239934316988106', time=2024-09-12T02:31:31.032593+0000, chain.objs.size()=1 2024-09-12T00:38:36.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.433+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.LRVHxcPV8wkMvmHN7fflAVbQMTAGxNI_0 2024-09-12T00:38:36.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.433+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.811581361187048140', time=2024-09-12T02:31:31.125267+0000, chain.objs.size()=1 2024-09-12T00:38:36.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.433+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.XVJ0SD3LGXDetjo5aNsSwgXoElw-5Xl_0 2024-09-12T00:38:36.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.435+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4566662041474693310', time=2024-09-12T02:31:31.130438+0000, chain.objs.size()=1 2024-09-12T00:38:36.433 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.435+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.QAMfLaJPjq9FdMSxzkRj1DAtHt2_C63_0 2024-09-12T00:38:36.434 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.436+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4301091260498167916', time=2024-09-12T02:31:31.156742+0000, chain.objs.size()=1 2024-09-12T00:38:36.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.436+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.M86P3BdgwymFi1H_mkNMICPnELfBc78_0 2024-09-12T00:38:36.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.437+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10895381660653405653', time=2024-09-12T02:31:31.165220+0000, chain.objs.size()=1 2024-09-12T00:38:36.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.437+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.XUxtGAFuWQV0yQ5BMCB-4STnvtz9Y_u_0 2024-09-12T00:38:36.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.437+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7769443448469924381', time=2024-09-12T02:31:31.257093+0000, chain.objs.size()=1 2024-09-12T00:38:36.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.437+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.0SbE2IUNp7VWR13teNvQR7JgQI09GXJ_0 2024-09-12T00:38:36.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.437+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13651737357710920317', time=2024-09-12T02:31:31.270422+0000, chain.objs.size()=1 2024-09-12T00:38:36.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.437+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.8xeIwvtfZCYP69xV_mGtGLBUYsLVIij_0 2024-09-12T00:38:36.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.437+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8765974291832082185', time=2024-09-12T02:31:31.301480+0000, chain.objs.size()=1 2024-09-12T00:38:36.436 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.437+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.kyXRaqG6VoK0j8vYeWJQ7SvHI6U5WkB_0 2024-09-12T00:38:36.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.441+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/49051 2024-09-12T00:38:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T00:38:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5914159861004858910', time=2024-09-12T02:31:31.401926+0000, chain.objs.size()=1 2024-09-12T00:38:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.9JawirP1D7-UakTBxV3cmuMK1U9hKl4_0 2024-09-12T00:38:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4583102660693733770', time=2024-09-12T02:31:31.406619+0000, chain.objs.size()=1 2024-09-12T00:38:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.GRnpsarLDGbII3lKpheBBFvw07FCRaZ_0 2024-09-12T00:38:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6200248224238200117', time=2024-09-12T02:31:31.434661+0000, chain.objs.size()=1 2024-09-12T00:38:36.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.tZ5Fis5-Hh-0q-QVVVmCpj-CSZAXvbF_0 2024-09-12T00:38:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14880008672966306064', time=2024-09-12T02:31:31.496385+0000, chain.objs.size()=1 2024-09-12T00:38:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.dbliLlLIpHtoetjz3EHVJY8hQYZlVbn_0 2024-09-12T00:38:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11899522528356314723', time=2024-09-12T02:31:31.509851+0000, chain.objs.size()=1 2024-09-12T00:38:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.b1F2NlARR4SQiOQOaazjpvCxxgA1QAU_0 2024-09-12T00:38:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1033133173947912023', time=2024-09-12T02:31:31.547153+0000, chain.objs.size()=1 2024-09-12T00:38:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.vSclSAt5F_hqJRwq_w0f04WdDvJqRjR_0 2024-09-12T00:38:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13817960090469612111', time=2024-09-12T02:31:31.706510+0000, chain.objs.size()=1 2024-09-12T00:38:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.YRBFNO2FtiTWpu8U9c0BmQbwH44aJUe_0 2024-09-12T00:38:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15831440507857374684', time=2024-09-12T02:31:31.722847+0000, chain.objs.size()=1 2024-09-12T00:38:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.oNIWigby_hI3BuRMq9eS5FGQ4Bj5Yq__0 2024-09-12T00:38:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8002000301250378891', time=2024-09-12T02:31:31.746297+0000, chain.objs.size()=1 2024-09-12T00:38:36.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.zsJsjucaidqvRoZZNLs1eyM9Okg963S_0 2024-09-12T00:38:36.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13106136542061884919', time=2024-09-12T02:31:31.770176+0000, chain.objs.size()=1 2024-09-12T00:38:36.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.CTgSx1bv_ASifruuKa29qMAQrfEPeob_0 2024-09-12T00:38:36.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13940339969377292472', time=2024-09-12T02:31:31.820939+0000, chain.objs.size()=1 2024-09-12T00:38:36.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.tIQzWhHl5VZmX4GyFZ221Dvdg9RtwFR_0 2024-09-12T00:38:36.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17494301799053022754', time=2024-09-12T02:31:33.517461+0000, chain.objs.size()=1 2024-09-12T00:38:36.444 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.444+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.332__shadow_.yaIbkR_ybID9r82b8WbX2OwIPINSuFB_0 2024-09-12T00:38:36.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.447+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8050062521041704561', time=2024-09-12T02:31:45.295267+0000, chain.objs.size()=1 2024-09-12T00:38:36.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.447+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.381__shadow_.C8G8vZC3G-V3umV9XoZ5ELgMWns1X0p_0 2024-09-12T00:38:36.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.447+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10066733561457708120', time=2024-09-12T02:32:12.594171+0000, chain.objs.size()=1 2024-09-12T00:38:36.445 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.447+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.483__shadow_.sDfgyaNc8RPybcL-xqh8rGDkuxRdCQ4_0 2024-09-12T00:38:36.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.449+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2815933404841173567', time=2024-09-12T02:32:12.847729+0000, chain.objs.size()=1 2024-09-12T00:38:36.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.449+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.484__shadow_.SfH6SlE6JFsSyFdTJnuAGZ6wd59VQOC_0 2024-09-12T00:38:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.449+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12584067265425589404', time=2024-09-12T02:32:16.106116+0000, chain.objs.size()=1 2024-09-12T00:38:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.449+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.496__shadow_.Bx8qCB5vrP4GbQ7gkpYnuifvwxjV5ZI_0 2024-09-12T00:38:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.449+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1634164717238061359', time=2024-09-12T02:32:18.156920+0000, chain.objs.size()=1 2024-09-12T00:38:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.449+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.503__shadow:ig1.iJ1ZviXIpIr.ZLyPeoYT.9MVwfX_.vO-G3V9zJdbWBBC0Ip0K0Zy9ROlszk8_0 2024-09-12T00:38:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.449+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13374845452565578167', time=2024-09-12T02:32:21.849501+0000, chain.objs.size()=1 2024-09-12T00:38:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.449+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.516__multipart_mymultipartcopy.2~FSGAewa66Jw1luwxLs5U8bLeKCk9Pjf.1 2024-09-12T00:38:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.449+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15451119719513106822', time=2024-09-12T02:32:24.028905+0000, chain.objs.size()=6 2024-09-12T00:38:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.449+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.519__multipart_mymultipart.2~1a4aT9Lv6B7KbRfjAThBLD2Ap6l5J_4.1 2024-09-12T00:38:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.449+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.519__multipart_mymultipart.2~1a4aT9Lv6B7KbRfjAThBLD2Ap6l5J_4.2 2024-09-12T00:38:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.449+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.519__multipart_mymultipart.2~1a4aT9Lv6B7KbRfjAThBLD2Ap6l5J_4.3 2024-09-12T00:38:36.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.449+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.519__multipart_mymultipart.2~1a4aT9Lv6B7KbRfjAThBLD2Ap6l5J_4.4 2024-09-12T00:38:36.449 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.449+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.519__multipart_mymultipart.2~1a4aT9Lv6B7KbRfjAThBLD2Ap6l5J_4.5 2024-09-12T00:38:36.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.453+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.519__multipart_mymultipart.2~1a4aT9Lv6B7KbRfjAThBLD2Ap6l5J_4.6 2024-09-12T00:38:36.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.453+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18424258614380294141', time=2024-09-12T02:32:25.886560+0000, chain.objs.size()=1 2024-09-12T00:38:36.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.453+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.520__shadow:pGbbBhyEIKtt6c2WBoate72tglf60EU_.-t2Y_3AyO6K74pWhvYizHANvQlZPFF7_0 2024-09-12T00:38:36.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.453+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8837903374241915488', time=2024-09-12T02:32:25.975726+0000, chain.objs.size()=3 2024-09-12T00:38:36.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.453+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.521__multipart_mymultipart.2~ZWLK8_LJ6-Z3kizSdJYzz4KIOYC8PrR.1 2024-09-12T00:38:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.455+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.521__multipart_mymultipart.2~ZWLK8_LJ6-Z3kizSdJYzz4KIOYC8PrR.2 2024-09-12T00:38:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.455+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.521__multipart_mymultipart.2~ZWLK8_LJ6-Z3kizSdJYzz4KIOYC8PrR.3 2024-09-12T00:38:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.455+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~1q0YdrNubf5jv45B7y-3ScDj3i0glzg', time=2024-09-12T02:32:28.681571+0000, chain.objs.size()=1 2024-09-12T00:38:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.455+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~1q0YdrNubf5jv45B7y-3ScDj3i0glzg.3 2024-09-12T00:38:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.455+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9036555032450742371', time=2024-09-12T02:33:15.100205+0000, chain.objs.size()=1 2024-09-12T00:38:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.455+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.564__shadow_.-iu4GReYTHUJEGVvDkaplzQfK4p08-e_0 2024-09-12T00:38:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.455+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3050826113192011508', time=2024-09-12T02:33:21.133661+0000, chain.objs.size()=1 2024-09-12T00:38:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.455+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:mxnKj3ZS2D59bN4drkqWy9iPfFSGmPx_.0ATPHMYlGFuEl5nUotoDdh-Pq6k_Ahm_0 2024-09-12T00:38:36.454 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.456+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3411727583223718582', time=2024-09-12T02:33:21.325787+0000, chain.objs.size()=1 2024-09-12T00:38:36.455 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.456+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:KBCG-u-wmTiwxvN90DrPnUi-aV1j4wX_.c3JaHGvEvDDkMDnFvpW_vonXNmQ3Kj8_0 2024-09-12T00:38:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.458+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2720603765913730210', time=2024-09-12T02:33:26.562857+0000, chain.objs.size()=1 2024-09-12T00:38:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.458+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.574__shadow:rzTJaB2wDYajwxG7fk45UUK-2fp0vSY_.JqWrh_eUWdxXkh0opxFVLYyDa95aZGW_0 2024-09-12T00:38:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.458+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5346655472749075634', time=2024-09-12T02:33:27.562720+0000, chain.objs.size()=1 2024-09-12T00:38:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.458+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.576__shadow:PRM5JULtXpmF4byr8IXzOgwMlbSybYT_.puryJBXlA825GnFuqs8EhjJXaxg4UR__0 2024-09-12T00:38:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.458+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12196748668612263293', time=2024-09-12T02:33:37.163200+0000, chain.objs.size()=1 2024-09-12T00:38:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.458+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:F4Sjv4b-RUMfti6HXNJ5udlvCpeUUMf_.H43iVEnAUGlUSrVvrNzA8yrb1VPs_kB_0 2024-09-12T00:38:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.458+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10960810007934051611', time=2024-09-12T02:33:49.152353+0000, chain.objs.size()=1 2024-09-12T00:38:36.456 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.458+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.587__shadow:iwN9sSMojDn7c9pFcI1jBLn5dZlmg8A_.AW7qeSp7OGN2Yt5FJcjLagtCbdqMa9n_0 2024-09-12T00:38:36.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.458+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17510888882097975526', time=2024-09-12T02:33:49.158151+0000, chain.objs.size()=1 2024-09-12T00:38:36.457 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.458+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.587__shadow:eLRQZZ0nZObHs3h0DsF6jK-zjgntvI9_.ARmHbDEts_wU3r8oV0aOvq4VcXhHk2I_0 2024-09-12T00:38:36.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.462+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1384518667889203176', time=2024-09-12T02:36:27.106851+0000, chain.objs.size()=1 2024-09-12T00:38:36.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.462+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.708__shadow:DjMpnRcb.4.ylXntlDcrN9VKaPxq8UK_.1IoeyPj75X15ZOPBdyxI8BWfR_-QHgP_0 2024-09-12T00:38:36.462 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.464+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:36.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.466+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:38:36.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.468+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:36.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.468+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/68885' 2024-09-12T00:38:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_-Z_FNakcDcJ4NIv7XxAB_Rcm4d2flHG', time=2024-09-12T02:29:24.961296+0000, chain.objs.size()=2 2024-09-12T00:38:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.EeMbjvn59xROoI5w9rD4eUW-09bSI8D_0 2024-09-12T00:38:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.EeMbjvn59xROoI5w9rD4eUW-09bSI8D_1 2024-09-12T00:38:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7369230956138415709', time=2024-09-12T02:30:37.523272+0000, chain.objs.size()=1 2024-09-12T00:38:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.231__shadow_.1zpdEcZBgWWYFuWOiHNTOI8d706EUMk_0 2024-09-12T00:38:36.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.132479880631309155', time=2024-09-12T02:30:40.639168+0000, chain.objs.size()=1 2024-09-12T00:38:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.243__shadow_.LtwEDofPTbzl77abCvjloGi8z2oVCKB_0 2024-09-12T00:38:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14301241950514107360', time=2024-09-12T02:30:41.169875+0000, chain.objs.size()=1 2024-09-12T00:38:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.245__shadow_.VpC6ACF-C_uEzgoPBzUWFzk3ECtADYT_0 2024-09-12T00:38:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16168572246716080121', time=2024-09-12T02:30:53.448652+0000, chain.objs.size()=1 2024-09-12T00:38:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lZuMf4abegGA6Fmuv0ZZWU2R0T843lm_0 2024-09-12T00:38:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4299154447019476392', time=2024-09-12T02:30:53.468340+0000, chain.objs.size()=1 2024-09-12T00:38:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.GDV88PFpymqlJAEItWnA531jUH-zf57_0 2024-09-12T00:38:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9308136424528050115', time=2024-09-12T02:30:53.525424+0000, chain.objs.size()=1 2024-09-12T00:38:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.nPrUbkSha-VLIG8QvYPNzgi-VNvHMMq_0 2024-09-12T00:38:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5412622692318426494', time=2024-09-12T02:30:53.705117+0000, chain.objs.size()=1 2024-09-12T00:38:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.X2BcGW1DwTfThucrGNrbFpFZH__d9hj_0 2024-09-12T00:38:36.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2221325750523984618', time=2024-09-12T02:30:53.809582+0000, chain.objs.size()=1 2024-09-12T00:38:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.kYFl3aSRLg4h04ZUpOd2dcUkOorHrip_0 2024-09-12T00:38:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14608376200443223263', time=2024-09-12T02:30:53.932494+0000, chain.objs.size()=1 2024-09-12T00:38:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JWH5-E8jraI-8rawlzOFUFY0by01n6K_0 2024-09-12T00:38:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7409254957178648731', time=2024-09-12T02:30:53.941210+0000, chain.objs.size()=1 2024-09-12T00:38:36.470 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.469+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.dK7A96-g8-MCIatU4KJBBrsG2MNczdX_0 2024-09-12T00:38:36.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.473+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1870409687296733353', time=2024-09-12T02:30:53.960730+0000, chain.objs.size()=1 2024-09-12T00:38:36.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.473+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2fvnVhsIDAMFp_epuzMwYxLG4MP_kDz_0 2024-09-12T00:38:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.473+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1786623591307524415', time=2024-09-12T02:30:54.009791+0000, chain.objs.size()=1 2024-09-12T00:38:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.473+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.U75pkg0InvJ4N9W__InFDd0b3hy8ifB_0 2024-09-12T00:38:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.474+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4648550818666092266', time=2024-09-12T02:30:54.134707+0000, chain.objs.size()=1 2024-09-12T00:38:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.474+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2U1bFuXMVeDokdph25Sek6oQDRGhPq2_0 2024-09-12T00:38:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.474+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8767623711767616466', time=2024-09-12T02:30:54.258460+0000, chain.objs.size()=1 2024-09-12T00:38:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.474+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.PVCRFaKlVRYB_-86RUW9MpfHvRCOkQS_0 2024-09-12T00:38:36.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.474+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14343269378349583513', time=2024-09-12T02:30:54.261243+0000, chain.objs.size()=1 2024-09-12T00:38:36.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.474+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.gdTMe_Pn41b6tZGzAv1x4XEncyxOrYs_0 2024-09-12T00:38:36.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.476+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1323854939061405413', time=2024-09-12T02:30:54.370393+0000, chain.objs.size()=1 2024-09-12T00:38:36.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.476+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-0BTTWrR6KEbvZfZ77a06taQ1EK1TTI_0 2024-09-12T00:38:36.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.476+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8639451841600303675', time=2024-09-12T02:30:54.388685+0000, chain.objs.size()=1 2024-09-12T00:38:36.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.476+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.PuMYGPQqhfIDsxtdiEHQiXieAgFhTlU_0 2024-09-12T00:38:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.476+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16399764680788636145', time=2024-09-12T02:30:54.552518+0000, chain.objs.size()=1 2024-09-12T00:38:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.476+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.tANtvYVovyce8yz44UY1l2Zx19-Agcy_0 2024-09-12T00:38:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.476+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10754995196606271391', time=2024-09-12T02:30:54.558846+0000, chain.objs.size()=1 2024-09-12T00:38:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.476+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.uQwrIppwDqQXDTXfChIlyCQlmf7w9d8_0 2024-09-12T00:38:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.476+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15374235387182696161', time=2024-09-12T02:30:54.585025+0000, chain.objs.size()=1 2024-09-12T00:38:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.476+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.uW-AEBVYmdkGrOARjMI97wb7wRw9xqx_0 2024-09-12T00:38:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.476+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18331058200677113396', time=2024-09-12T02:30:54.622690+0000, chain.objs.size()=1 2024-09-12T00:38:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.476+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.O0p6pAxqad6Gg62Ej-pb1DaF0jFe8U2_0 2024-09-12T00:38:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.476+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2320427854104937940', time=2024-09-12T02:30:54.647072+0000, chain.objs.size()=1 2024-09-12T00:38:36.475 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.476+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.a-J9ZUDWYm5tbu53kB70OJWSLunvOBC_0 2024-09-12T00:38:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.479+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4733649226412208098', time=2024-09-12T02:30:54.660486+0000, chain.objs.size()=1 2024-09-12T00:38:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.479+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6gyj6KEagUKkjfaVHn2WSRU_yn0R4n9_0 2024-09-12T00:38:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.479+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3480292975543803629', time=2024-09-12T02:30:54.673244+0000, chain.objs.size()=1 2024-09-12T00:38:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.479+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.M1Y2c3658vS9mUmRGvf5tjyMcKDex6u_0 2024-09-12T00:38:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.479+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5492033808042012263', time=2024-09-12T02:30:54.691590+0000, chain.objs.size()=1 2024-09-12T00:38:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.479+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.e3kHlT4M6ljRp2tiEWN3ubQKD6Hd-my_0 2024-09-12T00:38:36.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.479+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15589546127684163547', time=2024-09-12T02:30:54.843775+0000, chain.objs.size()=1 2024-09-12T00:38:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.479+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.rEFWoqo3AUFEXhU_WWb9-bWb_eNHGF3_0 2024-09-12T00:38:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.479+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12766304959190998463', time=2024-09-12T02:30:54.853738+0000, chain.objs.size()=1 2024-09-12T00:38:36.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.479+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ZCQUEz-Pzx6addtEF2Ts2FAnK_xhHr__0 2024-09-12T00:38:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.481+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15331253496328332381', time=2024-09-12T02:30:54.966469+0000, chain.objs.size()=1 2024-09-12T00:38:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.481+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.5fZOivGxDfYFUxBH4bvVxVDA0nXf_7U_0 2024-09-12T00:38:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.481+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.853363681910803879', time=2024-09-12T02:30:54.993597+0000, chain.objs.size()=1 2024-09-12T00:38:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.481+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.9Ltaxzy9dSA88MfM1c2YzSl3isOEOMX_0 2024-09-12T00:38:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.481+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14070830452833834751', time=2024-09-12T02:30:55.148939+0000, chain.objs.size()=1 2024-09-12T00:38:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.481+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.oqBSW4uQ1FOuBjEu06sm-bzlzcJQLbl_0 2024-09-12T00:38:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.481+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16026653148103063430', time=2024-09-12T02:30:55.156397+0000, chain.objs.size()=1 2024-09-12T00:38:36.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.481+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.hwnCWqc6btyKTLXWkJN1d9rxDPYTGuj_0 2024-09-12T00:38:36.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.482+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13065144531569906746', time=2024-09-12T02:30:55.165777+0000, chain.objs.size()=1 2024-09-12T00:38:36.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.482+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.nK1_Sy4FiO1WVleCLGJ4XxxkVFIyLzn_0 2024-09-12T00:38:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.482+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1177373119250629322', time=2024-09-12T02:31:00.868517+0000, chain.objs.size()=1 2024-09-12T00:38:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.482+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.285__shadow_.rIHVBKmTDw7yhZ2Qul3EYROOqMfsytm_0 2024-09-12T00:38:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.483+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17361377881900530436', time=2024-09-12T02:31:03.649375+0000, chain.objs.size()=1 2024-09-12T00:38:36.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.483+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.ltPMCu5MrFt1Fo9gsA65fLAy_sVUp8L_0 2024-09-12T00:38:36.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7471882605235838978', time=2024-09-12T02:31:04.935225+0000, chain.objs.size()=1 2024-09-12T00:38:36.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.298__shadow_.0WUq4YZLMiBdlzMruchjD_HrzfyQ4lQ_0 2024-09-12T00:38:36.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2133279917733445497', time=2024-09-12T02:31:05.458637+0000, chain.objs.size()=1 2024-09-12T00:38:36.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.300__shadow_.GmOHhT_uB12qiX-X6GxWda8nLOBdCHz_0 2024-09-12T00:38:36.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15294229046611018317', time=2024-09-12T02:31:06.218373+0000, chain.objs.size()=1 2024-09-12T00:38:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.303__shadow_.zpnJrLMFKrA1EVqO8cxz5IaFY7NvSyi_0 2024-09-12T00:38:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17536633078875111136', time=2024-09-12T02:31:07.104199+0000, chain.objs.size()=1 2024-09-12T00:38:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.306__shadow_.hi4deZ--TVB7YHeQVOEGP-9JRV7GsgV_0 2024-09-12T00:38:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9404193116913910664', time=2024-09-12T02:31:07.105027+0000, chain.objs.size()=1 2024-09-12T00:38:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.306__shadow_.1qOGHzXYOMxV8yJD1F-ZjX4cAxgfb2p_0 2024-09-12T00:38:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8513780731415676538', time=2024-09-12T02:31:19.355625+0000, chain.objs.size()=1 2024-09-12T00:38:36.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.MZVSCnYIaj4JETGxX4EQ-6bvcyiQv9v_0 2024-09-12T00:38:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6219758779107506610', time=2024-09-12T02:31:19.356598+0000, chain.objs.size()=1 2024-09-12T00:38:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.j2z98BpABG8HBdxqMYi3vQ0IN5OvHZj_0 2024-09-12T00:38:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7959240582202897485', time=2024-09-12T02:31:19.412518+0000, chain.objs.size()=1 2024-09-12T00:38:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.485+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_._1rh1BnwDhvVnno7o285BNn6GdFMRgY_0 2024-09-12T00:38:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.486+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14915065636455975211', time=2024-09-12T02:31:19.427625+0000, chain.objs.size()=1 2024-09-12T00:38:36.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.486+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.8axDmdTBzVEhC5-ltLUAOn_9r0ywiF1_0 2024-09-12T00:38:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.488+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7463696232575977507', time=2024-09-12T02:31:19.486730+0000, chain.objs.size()=1 2024-09-12T00:38:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.488+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ep-4cxig_3Mo9qHvv2Slo4mYBLFY3aT_0 2024-09-12T00:38:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.489+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10554414677112947249', time=2024-09-12T02:31:19.536608+0000, chain.objs.size()=1 2024-09-12T00:38:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.489+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.iQA7mNlupTZP8xJ4L80d71aOKG6w7B9_0 2024-09-12T00:38:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.489+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16650307526326717546', time=2024-09-12T02:31:19.558699+0000, chain.objs.size()=1 2024-09-12T00:38:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.489+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.i6dgiH24TfdAOg3U6XejKKT6f1ARmmi_0 2024-09-12T00:38:36.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.489+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6318577857161240897', time=2024-09-12T02:31:19.676239+0000, chain.objs.size()=1 2024-09-12T00:38:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.489+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Fklt_t0QuI1Jcc2ZJcG1EHXHNowJV1Q_0 2024-09-12T00:38:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.490+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15410095593151854034', time=2024-09-12T02:31:19.746020+0000, chain.objs.size()=1 2024-09-12T00:38:36.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.490+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.fNKsEraH0bDP0niZh3RHfstpTq0EHy7_0 2024-09-12T00:38:36.490 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15076054914905370791', time=2024-09-12T02:31:19.984969+0000, chain.objs.size()=1 2024-09-12T00:38:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.G5BqftRp72BHaBR2N4Ady0b1bbNh2rt_0 2024-09-12T00:38:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15446151653309825960', time=2024-09-12T02:31:20.007622+0000, chain.objs.size()=1 2024-09-12T00:38:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.DG-NypGBnImbbSpvGSvIZ53cr1fPC7i_0 2024-09-12T00:38:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17014705391238699623', time=2024-09-12T02:31:20.025774+0000, chain.objs.size()=1 2024-09-12T00:38:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.XZlpvVI2AcjN12LuOHiqVV81hhBjuWG_0 2024-09-12T00:38:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17619787034483440929', time=2024-09-12T02:31:20.041048+0000, chain.objs.size()=1 2024-09-12T00:38:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.DQ0QGEsIOp9BnNRu8CPNVXNtAeXiKiA_0 2024-09-12T00:38:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13219444301010294469', time=2024-09-12T02:31:20.045802+0000, chain.objs.size()=1 2024-09-12T00:38:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.2MXKlGYu95FdM-CoGSqhQAya8Mccaw5_0 2024-09-12T00:38:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17789032264607391986', time=2024-09-12T02:31:20.269412+0000, chain.objs.size()=1 2024-09-12T00:38:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.1JxWNaebbB0BqV7D9nBbxh2coVnW66k_0 2024-09-12T00:38:36.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17161011094537308378', time=2024-09-12T02:31:20.337171+0000, chain.objs.size()=1 2024-09-12T00:38:36.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.LGDvhXoG3uzczmwMufyCt1e1EtYwakh_0 2024-09-12T00:38:36.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13668151315711836782', time=2024-09-12T02:31:20.405103+0000, chain.objs.size()=1 2024-09-12T00:38:36.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.-dW0-fZFYvmbihC5tO-hbzqwFWmR_Z6_0 2024-09-12T00:38:36.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13770153350217194845', time=2024-09-12T02:31:20.569555+0000, chain.objs.size()=1 2024-09-12T00:38:36.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ske9aG5dT1-R6VNTAdUBAXeruTakT4e_0 2024-09-12T00:38:36.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14811011832772676534', time=2024-09-12T02:31:20.597116+0000, chain.objs.size()=1 2024-09-12T00:38:36.492 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.492+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.wLL8AUZIXZsdg4W3bQyT50sbgDT86HD_0 2024-09-12T00:38:36.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.495+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10918897986772953290', time=2024-09-12T02:31:20.758207+0000, chain.objs.size()=1 2024-09-12T00:38:36.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.495+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.dRn6DCUDZxa2IxSc5QhmSIsMg1SMx2u_0 2024-09-12T00:38:36.493 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.495+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10175871795803833917', time=2024-09-12T02:31:20.778818+0000, chain.objs.size()=1 2024-09-12T00:38:36.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.495+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.g7qJSTDFHAHuwZFe0vLEwr-DU0CI8U8_0 2024-09-12T00:38:36.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.496+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8452821023337927244', time=2024-09-12T02:31:20.933515+0000, chain.objs.size()=1 2024-09-12T00:38:36.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.496+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.EvoSy7_5L6w8L04NnNZCu4LJNW_ttaq_0 2024-09-12T00:38:36.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.499+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3995489207044858836', time=2024-09-12T02:31:21.026478+0000, chain.objs.size()=1 2024-09-12T00:38:36.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.499+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.bpU1Cu2Hnm-nTDc-3oYP6IOjELZBrCu_0 2024-09-12T00:38:36.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.499+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14202209367965335813', time=2024-09-12T02:31:21.039598+0000, chain.objs.size()=1 2024-09-12T00:38:36.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.499+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.3qGJ7-d9X4jg60nh6MbWLEi5ueHFGtK_0 2024-09-12T00:38:36.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.499+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12334630472815889253', time=2024-09-12T02:31:21.189466+0000, chain.objs.size()=1 2024-09-12T00:38:36.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.499+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.054zRHfI5sKlNyUlWOTylZCyY31Mh_j_0 2024-09-12T00:38:36.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.499+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10558006966478433708', time=2024-09-12T02:31:21.190400+0000, chain.objs.size()=1 2024-09-12T00:38:36.498 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.499+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.g4T4nPDKYW3TsY4tqRUUDmQVQlyON9W_0 2024-09-12T00:38:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13592109971799298971', time=2024-09-12T02:31:21.207356+0000, chain.objs.size()=1 2024-09-12T00:38:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Tz962E3-enxkCwxjrB1GO7buUkGdPeJ_0 2024-09-12T00:38:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17574170134803072653', time=2024-09-12T02:31:21.484381+0000, chain.objs.size()=1 2024-09-12T00:38:36.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.RmgFYJ2jasjHpn_je8dSOaMjL94n5MM_0 2024-09-12T00:38:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15523006088138929955', time=2024-09-12T02:31:21.500897+0000, chain.objs.size()=1 2024-09-12T00:38:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.El_sbAEyCx4EXDs2Hp13zIMKUTJCNZr_0 2024-09-12T00:38:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9779794536787375494', time=2024-09-12T02:31:21.514368+0000, chain.objs.size()=1 2024-09-12T00:38:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.tpQGoArjArKO4Zf-cDi-_m-AD4G6JRS_0 2024-09-12T00:38:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4714597540849730445', time=2024-09-12T02:31:21.538201+0000, chain.objs.size()=1 2024-09-12T00:38:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.owucaUtT5C9olNuBC8ODwtPu9t-_c3T_0 2024-09-12T00:38:36.501 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11604266273086017071', time=2024-09-12T02:31:21.588926+0000, chain.objs.size()=1 2024-09-12T00:38:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.jotPqvLwkD9av8IdqXrFmHngRulHm5m_0 2024-09-12T00:38:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3821222476611355371', time=2024-09-12T02:31:29.756735+0000, chain.objs.size()=1 2024-09-12T00:38:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.b2grrCO8bGTr3JdLygPVaoISCytfDBK_0 2024-09-12T00:38:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10308264782124296527', time=2024-09-12T02:31:29.819197+0000, chain.objs.size()=1 2024-09-12T00:38:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.502+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.kAjfKp_6pgdn2TAVh5DjUacORYhOCz3_0 2024-09-12T00:38:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.503+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4272579341514532863', time=2024-09-12T02:31:29.842592+0000, chain.objs.size()=1 2024-09-12T00:38:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.503+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.A9692B5n_1q-R_AO5nHvi6m_4rzly2r_0 2024-09-12T00:38:36.502 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.503+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13450511194353868566', time=2024-09-12T02:31:30.009172+0000, chain.objs.size()=1 2024-09-12T00:38:36.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.503+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Wmri6lTUYOrBuUtF-b4kul8xTY6LBK1_0 2024-09-12T00:38:36.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.503+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5469429576904915016', time=2024-09-12T02:31:30.130788+0000, chain.objs.size()=1 2024-09-12T00:38:36.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.503+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ZrhNF2DNlt7DnhIcsE2F-4CM6DzxREy_0 2024-09-12T00:38:36.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17782256350917640868', time=2024-09-12T02:31:30.292685+0000, chain.objs.size()=1 2024-09-12T00:38:36.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-3Gr1hnHiO5fwdQL56N8zQTimBeMR5O_0 2024-09-12T00:38:36.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7536613981244430174', time=2024-09-12T02:31:30.319939+0000, chain.objs.size()=1 2024-09-12T00:38:36.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.dV5MSMgqddTbuCJIghTr0VMXHJEKB7T_0 2024-09-12T00:38:36.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8644079786681821591', time=2024-09-12T02:31:30.348084+0000, chain.objs.size()=1 2024-09-12T00:38:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.cOpvBN3I3SHWqR617dRTGpbThKOLB6I_0 2024-09-12T00:38:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7614553629657519507', time=2024-09-12T02:31:30.389272+0000, chain.objs.size()=1 2024-09-12T00:38:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.d-UOdRxIpRiG3oxVePl843YlVwFjdgR_0 2024-09-12T00:38:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1164593133599008852', time=2024-09-12T02:31:30.392236+0000, chain.objs.size()=1 2024-09-12T00:38:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.XqyJrxiiX-SSbvlfFNiBptf9IF43M2j_0 2024-09-12T00:38:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2346314434457108356', time=2024-09-12T02:31:30.570248+0000, chain.objs.size()=1 2024-09-12T00:38:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.aSEgJJJSdz7K5_y83SI5d3VfowAxpT3_0 2024-09-12T00:38:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1391651962161858001', time=2024-09-12T02:31:30.574656+0000, chain.objs.size()=1 2024-09-12T00:38:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.T7mAibyi1mqwLv12mqPl_VvbndOyEvI_0 2024-09-12T00:38:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10504688200305457521', time=2024-09-12T02:31:30.577557+0000, chain.objs.size()=1 2024-09-12T00:38:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.z4eQl-YgIg-fPdJRVEKN7hnQkT_pKY8_0 2024-09-12T00:38:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3074049176649680659', time=2024-09-12T02:31:30.578473+0000, chain.objs.size()=1 2024-09-12T00:38:36.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.XP7sEDi8--7DK4wluzM7TnD2d3rg-Me_0 2024-09-12T00:38:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16213473496165419829', time=2024-09-12T02:31:30.599445+0000, chain.objs.size()=1 2024-09-12T00:38:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.1uE_XZYU0xC-WNxk6TEDopuMO-w55fu_0 2024-09-12T00:38:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1581269865507023725', time=2024-09-12T02:31:30.683406+0000, chain.objs.size()=1 2024-09-12T00:38:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.508+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.50clEXKQ5advJZYixezZhwNZshTcx6s_0 2024-09-12T00:38:36.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.512+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6502105414861321641', time=2024-09-12T02:31:30.739503+0000, chain.objs.size()=1 2024-09-12T00:38:36.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.512+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.DOy_kvdvRq-FZiBPQRWnVxbTLGw9kji_0 2024-09-12T00:38:36.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.512+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14448237765968340801', time=2024-09-12T02:31:30.743542+0000, chain.objs.size()=1 2024-09-12T00:38:36.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.512+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._OCMWRbGoB2sOprTqBYA9uGpyGqI0Ok_0 2024-09-12T00:38:36.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.513+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6172133038783269996', time=2024-09-12T02:31:31.008566+0000, chain.objs.size()=1 2024-09-12T00:38:36.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.513+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.RNKv8ph-AbIu_vljzjUDkUc2asEwmpc_0 2024-09-12T00:38:36.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.514+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9116294350668560130', time=2024-09-12T02:31:31.019188+0000, chain.objs.size()=1 2024-09-12T00:38:36.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.514+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.anIYkLaY0QsVnnGY5garlSO4P-htUTr_0 2024-09-12T00:38:36.512 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.514+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17083306335428784085', time=2024-09-12T02:31:31.216796+0000, chain.objs.size()=1 2024-09-12T00:38:36.513 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.514+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.4w1STHyo3n6PAieRBymv4KhfLpVMXaO_0 2024-09-12T00:38:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18426136425284005878', time=2024-09-12T02:31:31.281398+0000, chain.objs.size()=1 2024-09-12T00:38:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.zY5xnHtG5ufFT_jbVHaLQeKAiTJ2SZp_0 2024-09-12T00:38:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10680954137695813972', time=2024-09-12T02:31:31.304279+0000, chain.objs.size()=1 2024-09-12T00:38:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.FqrDyBCaUHxc725FHHSFKlCMKwSIRvJ_0 2024-09-12T00:38:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8813500050977711672', time=2024-09-12T02:31:31.433130+0000, chain.objs.size()=1 2024-09-12T00:38:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.rLwYMOX0iyzKIEHtazVFge5i0wXEI_L_0 2024-09-12T00:38:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13628814173364042151', time=2024-09-12T02:31:31.438116+0000, chain.objs.size()=1 2024-09-12T00:38:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Ma42QPryqMeYfKu-3wifqdP8JwKEDFO_0 2024-09-12T00:38:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14976781331265728160', time=2024-09-12T02:31:31.440419+0000, chain.objs.size()=1 2024-09-12T00:38:36.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mW5tKMMWRtYxkt1r-X1etclKBKZ0kp3_0 2024-09-12T00:38:36.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10183129009442628654', time=2024-09-12T02:31:31.449706+0000, chain.objs.size()=1 2024-09-12T00:38:36.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.YcMK9N4ShlTJILN2T4oD_giPKM76AFk_0 2024-09-12T00:38:36.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.517+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7144868855564590276', time=2024-09-12T02:31:31.483798+0000, chain.objs.size()=1 2024-09-12T00:38:36.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.517+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.7AKW-ozg3RNI99AzVpVRHVIynRuUjEY_0 2024-09-12T00:38:36.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.521+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/68885 2024-09-12T00:38:36.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T00:38:36.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18042569331372267999', time=2024-09-12T02:31:31.498799+0000, chain.objs.size()=1 2024-09-12T00:38:36.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.8oOz6PoQNCCqPErU48nUmdevZpB5iaC_0 2024-09-12T00:38:36.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16260374912504315014', time=2024-09-12T02:31:31.516984+0000, chain.objs.size()=1 2024-09-12T00:38:36.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.hoPjEsUj5vc0s_GU8_6MVHuymX78YZc_0 2024-09-12T00:38:36.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3942155064768622363', time=2024-09-12T02:31:31.783113+0000, chain.objs.size()=1 2024-09-12T00:38:36.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.HDKUgZY-LyYlICBtFrYuduhlxkCe8vQ_0 2024-09-12T00:38:36.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17064620493748478606', time=2024-09-12T02:31:31.797697+0000, chain.objs.size()=1 2024-09-12T00:38:36.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.D-VUyxyW8WyVqms4YZKXQoGYeGGrmeD_0 2024-09-12T00:38:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15723747161208638542', time=2024-09-12T02:31:45.185723+0000, chain.objs.size()=1 2024-09-12T00:38:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.381__shadow_.jkYhtucpZ_8HnmyKfYONYocPgSqBFu5_0 2024-09-12T00:38:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15781068874668760178', time=2024-09-12T02:31:53.229939+0000, chain.objs.size()=1 2024-09-12T00:38:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.407__shadow_.GILI9IDN_xt8mdPLZbe42N5F9iJiRF1_0 2024-09-12T00:38:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17362147548210436507', time=2024-09-12T02:32:08.695683+0000, chain.objs.size()=1 2024-09-12T00:38:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.464__shadow_.l9OEVxJn3YQWL9ozqBJ7IBpXI7ykUIy_0 2024-09-12T00:38:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5879394753564288340', time=2024-09-12T02:32:15.742571+0000, chain.objs.size()=1 2024-09-12T00:38:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.495__shadow_.YZePzcPIaSams2b8pGiZLyp9Xs27Hce_0 2024-09-12T00:38:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.436605845353163749', time=2024-09-12T02:32:21.304189+0000, chain.objs.size()=1 2024-09-12T00:38:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.514__shadow_.8unsLU6n185_oi4as7TL0tV7XGlNFHv_0 2024-09-12T00:38:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4205610544913839203', time=2024-09-12T02:32:22.380642+0000, chain.objs.size()=1 2024-09-12T00:38:36.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.518__multipart_mymultipart.2~croYv198mHl3FY0iQyUf-iS33U1tvSJ.1 2024-09-12T00:38:36.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8900013687292443970', time=2024-09-12T02:32:22.953213+0000, chain.objs.size()=1 2024-09-12T00:38:36.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.517__shadow_.CYxSqXxsLm4qOC_9wzwH81rZyebgm5c_0 2024-09-12T00:38:36.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7020951628327533152', time=2024-09-12T02:32:31.713902+0000, chain.objs.size()=2 2024-09-12T00:38:36.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.523__multipart_mymultipart.2~eFRcnUGVkbWjLjqCv62w66G4emW6YHW.1 2024-09-12T00:38:36.526 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.528+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.523__multipart_mymultipart.2~eFRcnUGVkbWjLjqCv62w66G4emW6YHW.2 2024-09-12T00:38:36.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.530+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18067414395479670721', time=2024-09-12T02:32:34.921307+0000, chain.objs.size()=4 2024-09-12T00:38:36.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.530+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.527__multipart_mymultipart.2~1EUAyZOgnkf-lQZYJUdz7-aEfH5l0GF.1 2024-09-12T00:38:36.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.530+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.527__multipart_mymultipart.2~1EUAyZOgnkf-lQZYJUdz7-aEfH5l0GF.2 2024-09-12T00:38:36.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.530+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.527__multipart_mymultipart.2~1EUAyZOgnkf-lQZYJUdz7-aEfH5l0GF.3 2024-09-12T00:38:36.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.530+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.527__multipart_mymultipart.2~1EUAyZOgnkf-lQZYJUdz7-aEfH5l0GF.4 2024-09-12T00:38:36.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.530+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12122695892939317500', time=2024-09-12T02:33:07.820810+0000, chain.objs.size()=1 2024-09-12T00:38:36.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.530+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.556__shadow_.FsrpU2qOhM1QRD2CWjGm8j9cNRt5knt_0 2024-09-12T00:38:36.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.530+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1896711583499045316', time=2024-09-12T02:33:10.203247+0000, chain.objs.size()=1 2024-09-12T00:38:36.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.530+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.561__multipart_mymultipart.uKqmIFhWk7WC23WoO5FS7TAVhlUhQCGV.1 2024-09-12T00:38:36.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.530+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14463067719045021818', time=2024-09-12T02:33:17.260454+0000, chain.objs.size()=1 2024-09-12T00:38:36.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.530+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:Gq2gPLTSgpAFJm-L912ktVrYLVp4FLK_.LpDpNuxrs1i16Ij9N7ZdZcdp6kckXsV_0 2024-09-12T00:38:36.529 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.530+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12634062957184901730', time=2024-09-12T02:33:22.355150+0000, chain.objs.size()=1 2024-09-12T00:38:36.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.530+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:RH1uQYjqNsBDenBXhYB0cqjUKwl3Rbb_.Wt1_kPN3qXXVYtjg1dPYMiY_oRHTd9G_0 2024-09-12T00:38:36.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.530+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8294544830388489075', time=2024-09-12T02:33:26.371247+0000, chain.objs.size()=1 2024-09-12T00:38:36.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.530+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.574__shadow:Vxrba-tsXA0tICj1Oelh4Fb3c1BvpZN_.7Fe_mVfcr_hbMC6H65TZLioDZ4F6iCI_0 2024-09-12T00:38:36.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.534+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10172042160393264186', time=2024-09-12T02:33:49.251065+0000, chain.objs.size()=1 2024-09-12T00:38:36.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.534+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.587__shadow:k6ZkuVCW4Ko1kFZecsQKEZDC9ifC4Yg_.kX9zMFAlbEMkuQcUX7ojBkRHE7-3WGa_0 2024-09-12T00:38:36.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.534+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18326100378050993344', time=2024-09-12T02:36:08.255423+0000, chain.objs.size()=1 2024-09-12T00:38:36.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.534+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.643__shadow_.UnE34VKZgQRin-jtFMA_T2pdn-oS5Yx_0 2024-09-12T00:38:36.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.534+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14043790065585692918', time=2024-09-12T02:36:11.821446+0000, chain.objs.size()=1 2024-09-12T00:38:36.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.534+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.653__shadow_.zFi-d4Uiob34Jur8_PdioKgMB-lTfO1_0 2024-09-12T00:38:36.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.534+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14230273726379527524', time=2024-09-12T02:36:24.838574+0000, chain.objs.size()=1 2024-09-12T00:38:36.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.534+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.700__shadow:j4TMtq1XiZehiHdoOwjp0xiBBvL4Npv_.BHktYH7d_15_aECQyrzrBWLo_MPJf1-_0 2024-09-12T00:38:36.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.534+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10816649062730498823', time=2024-09-12T02:36:55.562596+0000, chain.objs.size()=1 2024-09-12T00:38:36.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.534+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.741__shadow_.2i-UbUMIZEtoDQIsOrZHmkjpnDnNhwY_0 2024-09-12T00:38:36.536 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.538+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:36.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.541+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:38:36.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.542+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:36.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.543+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.543+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52913' 2024-09-12T00:38:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.543+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4282376775456820323', time=2024-09-12T02:29:38.079051+0000, chain.objs.size()=1 2024-09-12T00:38:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.543+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.182__shadow_.gOqGEsy6i9CgVUAYba4FWjxoh03L2aY_0 2024-09-12T00:38:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6549795623149157315', time=2024-09-12T02:30:36.908468+0000, chain.objs.size()=1 2024-09-12T00:38:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.228__shadow_.I5_jTKN2a_t7RGLmllIb_HX3NV_kSrv_0 2024-09-12T00:38:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7880627200620155303', time=2024-09-12T02:30:37.523080+0000, chain.objs.size()=1 2024-09-12T00:38:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.231__shadow_.UJO6AdgmG-0pV_fGWyibnP6pU1bf_EG_0 2024-09-12T00:38:36.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13936865631474203844', time=2024-09-12T02:30:40.638463+0000, chain.objs.size()=1 2024-09-12T00:38:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.243__shadow_.hZbMc196Wj27GjmtROj2gxVOf3LYKlr_0 2024-09-12T00:38:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11932750087749966400', time=2024-09-12T02:30:41.170948+0000, chain.objs.size()=1 2024-09-12T00:38:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.245__shadow_.xZU5dz02TeclxEVR3njUQsPML3Qv5_r_0 2024-09-12T00:38:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11287378436878863062', time=2024-09-12T02:30:45.102405+0000, chain.objs.size()=1 2024-09-12T00:38:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.261__shadow_.HhXrHmGxkk-MqN5Duwa3B3gPbI_t6CY_0 2024-09-12T00:38:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3430402399636681553', time=2024-09-12T02:30:53.153660+0000, chain.objs.size()=1 2024-09-12T00:38:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BmF8Dllw3k5RgQilzo7oqFHCs9wvdYO_0 2024-09-12T00:38:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6463489811190764092', time=2024-09-12T02:30:53.308591+0000, chain.objs.size()=1 2024-09-12T00:38:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ZeXk9lSI_uNxOg-T_1nYeVQxNnzs2A__0 2024-09-12T00:38:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.917247546865551401', time=2024-09-12T02:30:53.406125+0000, chain.objs.size()=1 2024-09-12T00:38:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.oaDpzhgulyYf3-R9TcLHDB_stuDcKT__0 2024-09-12T00:38:36.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1227512242565197518', time=2024-09-12T02:30:53.424802+0000, chain.objs.size()=1 2024-09-12T00:38:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.EQC3skOUyllEufnCEkW7IywUOEYIS9t_0 2024-09-12T00:38:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7693169626895830249', time=2024-09-12T02:30:53.521036+0000, chain.objs.size()=1 2024-09-12T00:38:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Un_czWMFl4B7OVd93Z1u4D70ifr50XG_0 2024-09-12T00:38:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15817800525584276798', time=2024-09-12T02:30:53.536224+0000, chain.objs.size()=1 2024-09-12T00:38:36.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.3Yhw1CTp41-Y1koIX6qQH7K8s_M_y7G_0 2024-09-12T00:38:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.547+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1736717624264655688', time=2024-09-12T02:30:53.564359+0000, chain.objs.size()=1 2024-09-12T00:38:36.545 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.547+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.MZGBg3vwOgdBs_jvpsI40v0-lz9LQRm_0 2024-09-12T00:38:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.548+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16794021351198436663', time=2024-09-12T02:30:53.668651+0000, chain.objs.size()=1 2024-09-12T00:38:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.548+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.wta1L0807kfaEbflkljCkDJnVM2XOQa_0 2024-09-12T00:38:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.548+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14017322871978512639', time=2024-09-12T02:30:53.680723+0000, chain.objs.size()=1 2024-09-12T00:38:36.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.549+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ydCE1MNwAEWa1dExArRzUihooI_VoEh_0 2024-09-12T00:38:36.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10792944143121168726', time=2024-09-12T02:30:53.728050+0000, chain.objs.size()=1 2024-09-12T00:38:36.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.MboMZtK7WGQvzkT9SXi9A6ze4FGrW0I_0 2024-09-12T00:38:36.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12603068068112350481', time=2024-09-12T02:30:53.745215+0000, chain.objs.size()=1 2024-09-12T00:38:36.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.kZ7a1cYlCtqY3vlj6fBUOK54XMMJ_9o_0 2024-09-12T00:38:36.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.439797731111654293', time=2024-09-12T02:30:53.748576+0000, chain.objs.size()=1 2024-09-12T00:38:36.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JpX0oUH2cUv50KNu2Zn_xOdLVPHxAE5_0 2024-09-12T00:38:36.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.336976775226016957', time=2024-09-12T02:30:53.835362+0000, chain.objs.size()=1 2024-09-12T00:38:36.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.l90jyBPeQiYVjkk5uHiBcVZoiVU1jt1_0 2024-09-12T00:38:36.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4930328399012335480', time=2024-09-12T02:30:53.930099+0000, chain.objs.size()=1 2024-09-12T00:38:36.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.RPEUiIjLHrlBdftEBJR5EXPKIubQLqH_0 2024-09-12T00:38:36.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15751357198721960867', time=2024-09-12T02:30:53.940495+0000, chain.objs.size()=1 2024-09-12T00:38:36.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.affOmgMMg-UBARGYz09cDEGb7pCdspa_0 2024-09-12T00:38:36.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16692367201028995947', time=2024-09-12T02:30:53.946262+0000, chain.objs.size()=1 2024-09-12T00:38:36.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AkhI7cGca89PsQeqZdatdqMEPk_gxaN_0 2024-09-12T00:38:36.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2110712256381579193', time=2024-09-12T02:30:53.960715+0000, chain.objs.size()=1 2024-09-12T00:38:36.549 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.550+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HJ_31n07eQmqaQ-g5nRnmtWKmWvcTjQ_0 2024-09-12T00:38:36.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.553+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15213870941170121361', time=2024-09-12T02:30:54.004532+0000, chain.objs.size()=1 2024-09-12T00:38:36.551 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.553+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.q0RvSwo2rm5nP3tMa3wAfhxFQVwwYSz_0 2024-09-12T00:38:36.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.554+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10688238274547787970', time=2024-09-12T02:30:54.014771+0000, chain.objs.size()=1 2024-09-12T00:38:36.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.554+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.h9FCpv6h5ahNDh3SKkKk08QK_7MghWo_0 2024-09-12T00:38:36.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.554+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16744362123367632630', time=2024-09-12T02:30:54.144460+0000, chain.objs.size()=1 2024-09-12T00:38:36.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.554+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Bdfqx46V6Kgzf4a_VvSpnQtE8e_ITus_0 2024-09-12T00:38:36.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.554+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12533372255176243993', time=2024-09-12T02:30:54.158071+0000, chain.objs.size()=1 2024-09-12T00:38:36.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.554+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.7cv_t8sq0fUHTqH3iNklSEzVNM3pv8p_0 2024-09-12T00:38:36.555 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.557+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12341324923223456269', time=2024-09-12T02:30:54.317564+0000, chain.objs.size()=1 2024-09-12T00:38:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.557+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.9O8Xi5U3NYodKxM6P8F4dJaqJ31wMNg_0 2024-09-12T00:38:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.557+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4108512748603297936', time=2024-09-12T02:30:54.444509+0000, chain.objs.size()=1 2024-09-12T00:38:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.557+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Gr7D6brFFTd-NQoSjdGcVIUUbizabPK_0 2024-09-12T00:38:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.557+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3752855631445669245', time=2024-09-12T02:30:54.447930+0000, chain.objs.size()=1 2024-09-12T00:38:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.557+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.zzafHlCsl7YbdOLAXEfDyZfspn7Q74__0 2024-09-12T00:38:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.557+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6837317842370044310', time=2024-09-12T02:30:54.596200+0000, chain.objs.size()=1 2024-09-12T00:38:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.557+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.i0IVTYMf-v51EmFbgp-lKc-ztrfp64q_0 2024-09-12T00:38:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.557+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11585263151098766754', time=2024-09-12T02:30:54.623147+0000, chain.objs.size()=1 2024-09-12T00:38:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.557+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.rO2szzbI_vjGKreHQQJlpCQmS9bkisi_0 2024-09-12T00:38:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.557+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16781715522909353134', time=2024-09-12T02:30:54.706582+0000, chain.objs.size()=1 2024-09-12T00:38:36.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.557+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.SPRDsYUtnsDwpnu2NdXa9Fle0dk9_Dy_0 2024-09-12T00:38:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.559+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4200106161947392509', time=2024-09-12T02:30:54.893497+0000, chain.objs.size()=1 2024-09-12T00:38:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.559+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.DwyYxRqoJSlbLu4dD_9U0LMJeM_8c-i_0 2024-09-12T00:38:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.559+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4821350400412527084', time=2024-09-12T02:30:54.950992+0000, chain.objs.size()=1 2024-09-12T00:38:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.559+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.9VtsQ4Ml5f5q2VYfkEBkGuX1LI9lu_s_0 2024-09-12T00:38:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.559+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11150728140432582159', time=2024-09-12T02:30:54.988637+0000, chain.objs.size()=1 2024-09-12T00:38:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.559+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.s_MnN2zrxX_G0mF-0x0CamtwkaOTg3L_0 2024-09-12T00:38:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.559+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15641143530508929500', time=2024-09-12T02:30:55.219104+0000, chain.objs.size()=1 2024-09-12T00:38:36.557 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.559+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Z4OIsFV__UBQNZaONvcs9l0yJxcUFE2_0 2024-09-12T00:38:36.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.561+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1715686898922079172', time=2024-09-12T02:30:58.348436+0000, chain.objs.size()=1 2024-09-12T00:38:36.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.561+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.275__shadow_.MsG0IjRV-D4CgmT0Ilumbi9chlopTOx_0 2024-09-12T00:38:36.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.562+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14364732700478430061', time=2024-09-12T02:30:58.864713+0000, chain.objs.size()=1 2024-09-12T00:38:36.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.562+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.277__shadow_.MpYL4QZZbnF2obfinu4MmvHDKuD8uzv_0 2024-09-12T00:38:36.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.562+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17244876888563329052', time=2024-09-12T02:31:03.055337+0000, chain.objs.size()=1 2024-09-12T00:38:36.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.562+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.i0RaP6VfYTQ22KIdpa0OaQfRNOv53f0_0 2024-09-12T00:38:36.560 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.562+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7804790045345706444', time=2024-09-12T02:31:04.129729+0000, chain.objs.size()=1 2024-09-12T00:38:36.561 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.562+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.295__shadow_.PryvQ2Qp2G_kAxZrH1julRpXVF1HBBD_0 2024-09-12T00:38:36.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.564+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13183938170620859942', time=2024-09-12T02:31:04.653696+0000, chain.objs.size()=1 2024-09-12T00:38:36.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.564+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.297__shadow_.tGffUfrjs_cu1ALUc7xo52sr2XO-ZGo_0 2024-09-12T00:38:36.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.564+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10839552541613237067', time=2024-09-12T02:31:05.699892+0000, chain.objs.size()=1 2024-09-12T00:38:36.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.564+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.301__shadow_.naIpAuO7sNcocT9edN3EO6RSYDfxN0b_0 2024-09-12T00:38:36.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.564+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4058541203339095948', time=2024-09-12T02:31:06.458326+0000, chain.objs.size()=1 2024-09-12T00:38:36.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.564+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.304__shadow_.4Vm-zu4ADHjJJHj7LHV_3E19mQkTP6G_0 2024-09-12T00:38:36.562 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.564+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13374390745114644047', time=2024-09-12T02:31:06.698517+0000, chain.objs.size()=1 2024-09-12T00:38:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.564+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.305__shadow_.HbJL7S6TuCuqRrWVvThjl9DpvvZljLf_0 2024-09-12T00:38:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.564+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5815371788562665037', time=2024-09-12T02:31:10.162608+0000, chain.objs.size()=1 2024-09-12T00:38:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.564+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.319__shadow:ZwmShF1dGHedlp892u7kYsgzmAcbI-7_.y5NTeewqPcBflsGoWb00DUna8fwWU0z_0 2024-09-12T00:38:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.564+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8154119646908204029', time=2024-09-12T02:31:19.341732+0000, chain.objs.size()=1 2024-09-12T00:38:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.564+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.BJtIOHYc1pgKsHYh7h0ABTEaa0jCcgc_0 2024-09-12T00:38:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.564+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5246073528753359629', time=2024-09-12T02:31:19.393508+0000, chain.objs.size()=1 2024-09-12T00:38:36.563 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.564+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.dmB8_ziVM5zTXuSCnh_xrEGBzLjTHnz_0 2024-09-12T00:38:36.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.565+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9475817159769398035', time=2024-09-12T02:31:19.510616+0000, chain.objs.size()=1 2024-09-12T00:38:36.564 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.565+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.vAKV8AjP7ZN4ztlkon1Y7_OK4QUX0t7_0 2024-09-12T00:38:36.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.567+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13716193761318991228', time=2024-09-12T02:31:19.544413+0000, chain.objs.size()=1 2024-09-12T00:38:36.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.567+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.yFjqvbLbEPVRk6GYD13yDohY3p-SbP7_0 2024-09-12T00:38:36.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.567+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2320296323997192596', time=2024-09-12T02:31:19.718498+0000, chain.objs.size()=1 2024-09-12T00:38:36.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.567+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.AG1MM2CDA9btBjCffdqoI8vkSgSMfYk_0 2024-09-12T00:38:36.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.568+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.738849042740227470', time=2024-09-12T02:31:19.820604+0000, chain.objs.size()=1 2024-09-12T00:38:36.566 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.568+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IcGxGA3sjhlYGDIMJnOfyyNT1Dhgm0n_0 2024-09-12T00:38:36.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.569+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16130164104474301896', time=2024-09-12T02:31:20.103600+0000, chain.objs.size()=1 2024-09-12T00:38:36.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.569+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.KKTNaGx8fnD-scnG_14ThNWjb6-4BMs_0 2024-09-12T00:38:36.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.569+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9097791619909414214', time=2024-09-12T02:31:20.161460+0000, chain.objs.size()=1 2024-09-12T00:38:36.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.569+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.rinurLAFO0k4T7VF8ab05gwPNsdnjOd_0 2024-09-12T00:38:36.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.570+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2481724723339251228', time=2024-09-12T02:31:20.165516+0000, chain.objs.size()=1 2024-09-12T00:38:36.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.570+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.g5TSPgZFRj4kU9xO1LJCCYaG9CHkgnL_0 2024-09-12T00:38:36.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.570+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9112502592870980413', time=2024-09-12T02:31:20.171018+0000, chain.objs.size()=1 2024-09-12T00:38:36.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.570+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NRmkTDxKcYBNOge9ltg-w6ENVPeJf49_0 2024-09-12T00:38:36.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.570+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10309620198510296037', time=2024-09-12T02:31:20.263295+0000, chain.objs.size()=1 2024-09-12T00:38:36.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.570+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.b35J9VOsl7XoiGpHlHXSAqp3NVEh8uD_0 2024-09-12T00:38:36.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.570+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12270153740968530244', time=2024-09-12T02:31:20.324572+0000, chain.objs.size()=1 2024-09-12T00:38:36.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.570+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.5wCmvsEO0citpqG0h6kx1WeWlPDG1gb_0 2024-09-12T00:38:36.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.570+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6409095394253319776', time=2024-09-12T02:31:20.352361+0000, chain.objs.size()=1 2024-09-12T00:38:36.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.570+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.OQjYblf3FX4zZmZFMxgJ3PWmsQS-tSd_0 2024-09-12T00:38:36.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.570+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12604264142112221038', time=2024-09-12T02:31:20.403921+0000, chain.objs.size()=1 2024-09-12T00:38:36.569 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.570+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.4DTxKzHBubuacgCImoujqAxJjpxlw0a_0 2024-09-12T00:38:36.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.572+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.956843413625455725', time=2024-09-12T02:31:20.586888+0000, chain.objs.size()=1 2024-09-12T00:38:36.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.572+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.c7ye1vTmEm1abn6jULhzJI_nRUOX5rl_0 2024-09-12T00:38:36.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.572+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6955824714947989345', time=2024-09-12T02:31:20.606886+0000, chain.objs.size()=1 2024-09-12T00:38:36.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.572+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.4Sh6KKK3zh1qvis99U6ytJfSg0v-hse_0 2024-09-12T00:38:36.571 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.573+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5459524396422382381', time=2024-09-12T02:31:20.763840+0000, chain.objs.size()=1 2024-09-12T00:38:36.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.573+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.1GswizYsMnkMCL8gJWmTttW9MPbqFtE_0 2024-09-12T00:38:36.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.574+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12580323203613087623', time=2024-09-12T02:31:20.940562+0000, chain.objs.size()=1 2024-09-12T00:38:36.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.574+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.iHVdaUish_y4olrQZfz6Rwxt53W3rf4_0 2024-09-12T00:38:36.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.574+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1261724392261608765', time=2024-09-12T02:31:20.991472+0000, chain.objs.size()=1 2024-09-12T00:38:36.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.574+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.2Mhsu2st7Y2VUD8XF1dn8KcbDQVXh9k_0 2024-09-12T00:38:36.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.574+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14111257614871628534', time=2024-09-12T02:31:21.033833+0000, chain.objs.size()=1 2024-09-12T00:38:36.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.574+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.VfReWiAsy1cYMHYmPUJA12jzTt1i8Cw_0 2024-09-12T00:38:36.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.574+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13906667029127157248', time=2024-09-12T02:31:21.222453+0000, chain.objs.size()=1 2024-09-12T00:38:36.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.574+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.UgQE_xUpmvkzdn5mG-PUIWPSskQyzb0_0 2024-09-12T00:38:36.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.574+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1144499547389182418', time=2024-09-12T02:31:21.229875+0000, chain.objs.size()=1 2024-09-12T00:38:36.573 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.574+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.m63abxTxf3jDXilg5Y5ddEV3DyaAcP6_0 2024-09-12T00:38:36.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.577+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14265760731129927633', time=2024-09-12T02:31:21.290369+0000, chain.objs.size()=1 2024-09-12T00:38:36.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.577+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.DXbEk0eanobMqPfvu4F1FDtXJ16HQuz_0 2024-09-12T00:38:36.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.577+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18302429880726424384', time=2024-09-12T02:31:21.334296+0000, chain.objs.size()=1 2024-09-12T00:38:36.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.577+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.iYqg3KS_h-9XdczOYBktiTsZYtmecB7_0 2024-09-12T00:38:36.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.577+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3625529414744308283', time=2024-09-12T02:31:21.369819+0000, chain.objs.size()=1 2024-09-12T00:38:36.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.577+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.E8ifsgqF4haDTcDlTEJmKFd7khN9gdp_0 2024-09-12T00:38:36.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.577+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18024350369175481050', time=2024-09-12T02:31:21.490677+0000, chain.objs.size()=1 2024-09-12T00:38:36.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.577+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.C2EVSDvw9HSMW5pmQzuhAziMUW5-A1B_0 2024-09-12T00:38:36.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.577+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4349098225102837896', time=2024-09-12T02:31:21.538782+0000, chain.objs.size()=1 2024-09-12T00:38:36.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.577+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.jI-bYoPg6hGq3_1S9JMT_QTqc7E454S_0 2024-09-12T00:38:36.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.577+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10636473830547769059', time=2024-09-12T02:31:21.611103+0000, chain.objs.size()=1 2024-09-12T00:38:36.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.577+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.QAHuKhNXbasHLLYRN7JcuZzUKY1fixU_0 2024-09-12T00:38:36.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.579+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13974862392086670418', time=2024-09-12T02:31:21.614855+0000, chain.objs.size()=1 2024-09-12T00:38:36.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.579+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Swhr2Ldt3bu6SfrdCiicg96LZzr9s9g_0 2024-09-12T00:38:36.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.579+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4866406061586955657', time=2024-09-12T02:31:29.680820+0000, chain.objs.size()=1 2024-09-12T00:38:36.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.579+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lcEcE6b0TxzCmsgMXcm-KqSh4RYeFig_0 2024-09-12T00:38:36.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.579+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11949268996245521428', time=2024-09-12T02:31:29.687274+0000, chain.objs.size()=1 2024-09-12T00:38:36.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.579+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.hFCpmbMox_HQwZHOZHfpkyWrbD-G4SC_0 2024-09-12T00:38:36.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.579+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18177372115998711736', time=2024-09-12T02:31:29.737100+0000, chain.objs.size()=1 2024-09-12T00:38:36.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.579+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.bEoo9t2E02wt4wBAQSQ4FPfJcn7HzId_0 2024-09-12T00:38:36.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.580+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.674707943738684637', time=2024-09-12T02:31:29.742816+0000, chain.objs.size()=1 2024-09-12T00:38:36.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.580+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.plbghlex-Wm8zu24abB67FBfUO0jUjo_0 2024-09-12T00:38:36.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9095263137843397589', time=2024-09-12T02:31:29.770673+0000, chain.objs.size()=1 2024-09-12T00:38:36.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.xSSpUxGhZ7HDaskEW23YfneHBgfPIph_0 2024-09-12T00:38:36.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10575399834643411558', time=2024-09-12T02:31:29.789690+0000, chain.objs.size()=1 2024-09-12T00:38:36.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.csk8DRgGZssVC44vPk4KUzJ5hwFwlQu_0 2024-09-12T00:38:36.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3304213411127778042', time=2024-09-12T02:31:29.804225+0000, chain.objs.size()=1 2024-09-12T00:38:36.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.YeuVwA5_Io3L1hy3aS9CZJRmET5XqhT_0 2024-09-12T00:38:36.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9354300150838801205', time=2024-09-12T02:31:29.825197+0000, chain.objs.size()=1 2024-09-12T00:38:36.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.XX2S_JQScQSkn-KWRa3lymxsIWiFvTH_0 2024-09-12T00:38:36.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7002155014278861027', time=2024-09-12T02:31:29.858423+0000, chain.objs.size()=1 2024-09-12T00:38:36.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.3l-NlmsbIQM-PWnwS7p1eifQ83gC1cC_0 2024-09-12T00:38:36.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4609720681847746857', time=2024-09-12T02:31:30.043965+0000, chain.objs.size()=1 2024-09-12T00:38:36.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.e32NYFz40NHI0EyhgpZMHZCafFWEiz6_0 2024-09-12T00:38:36.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15876253168618044042', time=2024-09-12T02:31:30.069202+0000, chain.objs.size()=1 2024-09-12T00:38:36.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ZM2BPeY_iit2s5HHrVWhg1M6_-ZlY26_0 2024-09-12T00:38:36.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2512261578482649854', time=2024-09-12T02:31:30.175247+0000, chain.objs.size()=1 2024-09-12T00:38:36.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-JZd9BNETgbQRV1KsysBF0sVqz7z0Kz_0 2024-09-12T00:38:36.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8825932379928479619', time=2024-09-12T02:31:30.299351+0000, chain.objs.size()=1 2024-09-12T00:38:36.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.4rraYglffqW4b0gUoRFZAo5io5OpFWz_0 2024-09-12T00:38:36.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.64889646791994102', time=2024-09-12T02:31:30.322825+0000, chain.objs.size()=1 2024-09-12T00:38:36.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.584+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.iWg4hsbVJu0aNzC9FC7uY_htkm-nBEv_0 2024-09-12T00:38:36.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.585+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12383210407721456869', time=2024-09-12T02:31:30.471304+0000, chain.objs.size()=1 2024-09-12T00:38:36.584 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.585+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.eA5cN20_AfP7RVmaIMLuHK5m8cCT-Cc_0 2024-09-12T00:38:36.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.590+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17163547524502501556', time=2024-09-12T02:31:30.640171+0000, chain.objs.size()=1 2024-09-12T00:38:36.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.590+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.xVUkgFhVzo9RVYMpo25umH_jOvaFywW_0 2024-09-12T00:38:36.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.590+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1289005119170448546', time=2024-09-12T02:31:30.660889+0000, chain.objs.size()=1 2024-09-12T00:38:36.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.590+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Dl3Y6pg7NRlrDYYLeRaG-eLwCbPF6Y9_0 2024-09-12T00:38:36.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.590+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3077892257560586623', time=2024-09-12T02:31:30.709025+0000, chain.objs.size()=1 2024-09-12T00:38:36.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.590+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.I65UpfKlp9RqA2Y4IKI0nG65IfpyfqH_0 2024-09-12T00:38:36.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.590+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11877811814175248963', time=2024-09-12T02:31:30.746899+0000, chain.objs.size()=1 2024-09-12T00:38:36.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.590+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.GJE2cYAOYdIjpcsofNiwbPFzj8TdLRH_0 2024-09-12T00:38:36.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.590+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8599687681672415906', time=2024-09-12T02:31:30.946373+0000, chain.objs.size()=1 2024-09-12T00:38:36.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.590+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.QJYLZ0uiFLPZynHSJxp6pTgOr8TvfCU_0 2024-09-12T00:38:36.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.593+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6498821124305822154', time=2024-09-12T02:31:30.971103+0000, chain.objs.size()=1 2024-09-12T00:38:36.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.593+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.dOoENVOvywrFT-3cEFHook4GZvfqwbG_0 2024-09-12T00:38:36.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.593+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7651794815858069402', time=2024-09-12T02:31:30.974951+0000, chain.objs.size()=1 2024-09-12T00:38:36.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.593+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mAeD6kqC5g1UFtvCUHje7zWswGcqsGb_0 2024-09-12T00:38:36.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.593+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1603432931331026664', time=2024-09-12T02:31:31.043873+0000, chain.objs.size()=1 2024-09-12T00:38:36.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.593+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.d1Tbd67M3v1OtkJ56g8thSk8wOIn9t9_0 2024-09-12T00:38:36.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.593+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16476235359434272687', time=2024-09-12T02:31:31.119404+0000, chain.objs.size()=1 2024-09-12T00:38:36.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.593+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.cX6wGBYMBaN0yobcpgTQl3BGhl_pGSu_0 2024-09-12T00:38:36.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.593+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10701695251127265296', time=2024-09-12T02:31:31.315446+0000, chain.objs.size()=1 2024-09-12T00:38:36.592 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.593+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.q6WDBulbpJUT0uIopE2jFcjKsYQURtj_0 2024-09-12T00:38:36.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.597+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/52913 2024-09-12T00:38:36.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T00:38:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2582039567671107646', time=2024-09-12T02:31:31.478523+0000, chain.objs.size()=1 2024-09-12T00:38:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mb70uQVKTsswSun2449RPAbvEqn7DtZ_0 2024-09-12T00:38:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15483947882477491847', time=2024-09-12T02:31:31.555180+0000, chain.objs.size()=1 2024-09-12T00:38:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.zmZzs7wsTWF2JLZ6QfRR5mnTjtfz4iN_0 2024-09-12T00:38:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17702158118801579154', time=2024-09-12T02:31:31.571625+0000, chain.objs.size()=1 2024-09-12T00:38:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.tudm4g1JCji-nl42pkV_hWwGxreLHhs_0 2024-09-12T00:38:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5484446643843583182', time=2024-09-12T02:31:31.595683+0000, chain.objs.size()=1 2024-09-12T00:38:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.xrESWLzj2JAOBZhnbIMmgp9O9DT-tiO_0 2024-09-12T00:38:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569453425307053276', time=2024-09-12T02:31:31.676160+0000, chain.objs.size()=1 2024-09-12T00:38:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.QQI22zC2PCA6yXV8dcmzVIkLeBeBHeV_0 2024-09-12T00:38:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6530956220153959165', time=2024-09-12T02:31:31.706904+0000, chain.objs.size()=1 2024-09-12T00:38:36.599 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.XD5GNoVB8ja0Fjb__P0FP_-CA4A8eJv_0 2024-09-12T00:38:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4370456250989456142', time=2024-09-12T02:31:31.720070+0000, chain.objs.size()=1 2024-09-12T00:38:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.YcJZQ-B51XK7iAm5YWkYFYVwSPVajAe_0 2024-09-12T00:38:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6048983676103255682', time=2024-09-12T02:31:31.725836+0000, chain.objs.size()=1 2024-09-12T00:38:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.PixW9QGmc62X_S9n73yByB0evrWyV2t_0 2024-09-12T00:38:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17711156186502712359', time=2024-09-12T02:31:31.745767+0000, chain.objs.size()=1 2024-09-12T00:38:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.SrkXEUMKoNb22gwHh6LWQJw7Tg3V60L_0 2024-09-12T00:38:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11271024647545638751', time=2024-09-12T02:31:31.823106+0000, chain.objs.size()=1 2024-09-12T00:38:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NcRBOM0Wguvms4gnIA9RxougcyRkgCs_0 2024-09-12T00:38:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13506757692992114032', time=2024-09-12T02:31:33.782793+0000, chain.objs.size()=1 2024-09-12T00:38:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.333__shadow_.Nu4QyAVQSJDGZMwxE5yXK-i0ZuGZG1D_0 2024-09-12T00:38:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5511650784443767624', time=2024-09-12T02:31:41.945897+0000, chain.objs.size()=1 2024-09-12T00:38:36.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.600+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.373__shadow_.c8HkOPgffX_FHkz422Y_hSDqzBECGUe_0 2024-09-12T00:38:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.603+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11575779524955191631', time=2024-09-12T02:31:58.182614+0000, chain.objs.size()=1 2024-09-12T00:38:36.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.603+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.429__shadow_.Vr0WR-Y5Ci2UNtb_cIJfuUpijx9mRpE_0 2024-09-12T00:38:36.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.604+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13322213622395039873', time=2024-09-12T02:32:01.865612+0000, chain.objs.size()=1 2024-09-12T00:38:36.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.604+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.442__shadow_.cmKvLt4GEiizMSDcskNLYhhK8hiWQBJ_0 2024-09-12T00:38:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10893539135329620353', time=2024-09-12T02:32:07.300100+0000, chain.objs.size()=1 2024-09-12T00:38:36.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.460__shadow_.t2T_Nnx8pdKpz73ht3YdeGBTgJQwtgh_0 2024-09-12T00:38:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7602119344333838877', time=2024-09-12T02:32:07.686591+0000, chain.objs.size()=1 2024-09-12T00:38:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.461__shadow_.hrUPcwu2i9s2L0wl7vVV2HCHe7K6IGw_0 2024-09-12T00:38:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10493904314177517740', time=2024-09-12T02:32:09.087569+0000, chain.objs.size()=1 2024-09-12T00:38:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.465__shadow_.e3t8cTqxl10Fhb4z70ZFMSrG0kWuGYm_0 2024-09-12T00:38:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4759095835461552880', time=2024-09-12T02:32:12.847127+0000, chain.objs.size()=1 2024-09-12T00:38:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.484__shadow_.xewkyOjcOsDhF_iISLDIp1HK1gfcw4x_0 2024-09-12T00:38:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1707971271246551631', time=2024-09-12T02:32:18.156758+0000, chain.objs.size()=1 2024-09-12T00:38:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.503__shadow:ig1.iJ1ZviXIpIr.ZLyPeoYT.9MVwfX_.vO-G3V9zJdbWBBC0Ip0K0Zy9ROlszk8_0 2024-09-12T00:38:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4590926689897144651', time=2024-09-12T02:32:22.951583+0000, chain.objs.size()=1 2024-09-12T00:38:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.517__shadow_.NMP5jl0dfuxI0cfGNXr8Ww1LwKxNLU1_0 2024-09-12T00:38:36.605 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~wWRK7eNxRfhZnO8PZk3wvuiX012pWpR', time=2024-09-12T02:32:26.639460+0000, chain.objs.size()=1 2024-09-12T00:38:36.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~wWRK7eNxRfhZnO8PZk3wvuiX012pWpR.1 2024-09-12T00:38:36.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2752470653987773886', time=2024-09-12T02:33:20.451639+0000, chain.objs.size()=1 2024-09-12T00:38:36.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:CV8V.1bBqnsHjoiG.k1VLVbFTPdur7q_.y-32Pv0vQdXWSGIG7WRwetcg2Gu-9rt_0 2024-09-12T00:38:36.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10147511578399699237', time=2024-09-12T02:33:22.825902+0000, chain.objs.size()=1 2024-09-12T00:38:36.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.606+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.570__shadow:jrOf-laxEyJsqyJ8TBxzJy-.T84vSq-_.kaYWOF-hRKLjFp35jA5SeRTlpE0__at_0 2024-09-12T00:38:36.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.608+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5766735606325232445', time=2024-09-12T02:33:29.295371+0000, chain.objs.size()=1 2024-09-12T00:38:36.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.608+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.576__shadow:KzxcBpiytXiF1TnCLplWUQ12QOPwIB7_.onYiMaz7hJtnyjmMlBJ8yLZP2zEav8-_0 2024-09-12T00:38:36.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.608+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7405767182365208876', time=2024-09-12T02:33:32.979919+0000, chain.objs.size()=1 2024-09-12T00:38:36.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.608+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:OccN88MInjvFF0Xq0m3bronY0ARAF9h_.vheLAje5AuYL4TRq8-RIcL1gVrsOt6w_0 2024-09-12T00:38:36.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.609+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.439971337195792072', time=2024-09-12T02:33:39.728613+0000, chain.objs.size()=1 2024-09-12T00:38:36.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.609+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:B9u7ib9FTTiAltVcL4xaTwqJu75qQRC_.imNrEWeF1Kk_Kogn1J0JXg0o3XEQ5CR_0 2024-09-12T00:38:36.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.610+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12824854398660184229', time=2024-09-12T02:33:48.906243+0000, chain.objs.size()=1 2024-09-12T00:38:36.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.610+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.586__shadow:5UdP2CZfikcPR8UmmPEcSZmTNGKAJJO_.GY7WZP_P0nof_rwemg1D0KVjhEuf_0d_0 2024-09-12T00:38:36.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.612+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8620791145002819179', time=2024-09-12T02:33:56.066602+0000, chain.objs.size()=6 2024-09-12T00:38:36.610 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.612+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.613__multipart_multipart_enc.2~VsqeMPk0R8ForVPef1dKoSLx1xDNyxl.1 2024-09-12T00:38:36.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.612+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.613__multipart_multipart_enc.2~VsqeMPk0R8ForVPef1dKoSLx1xDNyxl.2 2024-09-12T00:38:36.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.612+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.613__multipart_multipart_enc.2~VsqeMPk0R8ForVPef1dKoSLx1xDNyxl.3 2024-09-12T00:38:36.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.612+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.613__multipart_multipart_enc.2~VsqeMPk0R8ForVPef1dKoSLx1xDNyxl.4 2024-09-12T00:38:36.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.612+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.613__multipart_multipart_enc.2~VsqeMPk0R8ForVPef1dKoSLx1xDNyxl.5 2024-09-12T00:38:36.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.612+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.613__multipart_multipart_enc.2~VsqeMPk0R8ForVPef1dKoSLx1xDNyxl.6 2024-09-12T00:38:36.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.612+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13750101672478708706', time=2024-09-12T02:36:17.149908+0000, chain.objs.size()=1 2024-09-12T00:38:36.611 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.612+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.666__shadow_.-m-PMItxi4iObFUgRNPkU9Z6LVWbuKG_0 2024-09-12T00:38:36.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.614+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9347086170679109458', time=2024-09-12T02:36:27.997317+0000, chain.objs.size()=1 2024-09-12T00:38:36.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.614+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.711__multipart_file1.2~g6esj-Ich0sqIe4rMn7xsF3_1696K-h.1 2024-09-12T00:38:36.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.615+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15175823332041928653', time=2024-09-12T02:36:49.654835+0000, chain.objs.size()=1 2024-09-12T00:38:36.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.615+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.719__shadow_.MslIf4YJAsJ6Rcnme2AjP_h_dmoSVSl_0 2024-09-12T00:38:36.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.615+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18304112825291530448', time=2024-09-12T02:36:54.971369+0000, chain.objs.size()=1 2024-09-12T00:38:36.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.615+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.739__shadow_.-7bcoNkveDMNOi79xOD4VC5PfdJ4PqF_0 2024-09-12T00:38:36.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.622+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:36.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.624+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:38:36.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.626+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:36.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.626+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:36.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44084' 2024-09-12T00:38:36.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14507995352684943890', time=2024-09-12T02:29:25.443077+0000, chain.objs.size()=2 2024-09-12T00:38:36.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.ZfmX3Gn8Lj6cPISOrROiUod-eYEB4PQ_0 2024-09-12T00:38:36.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.ZfmX3Gn8Lj6cPISOrROiUod-eYEB4PQ_1 2024-09-12T00:38:36.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16349717758258533857', time=2024-09-12T02:29:27.671613+0000, chain.objs.size()=2 2024-09-12T00:38:36.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.162__shadow_.H3KlojI6CjwTb5fSRmE42NOJFh3_GWn_0 2024-09-12T00:38:36.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.162__shadow_.H3KlojI6CjwTb5fSRmE42NOJFh3_GWn_1 2024-09-12T00:38:36.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4779394632519683894', time=2024-09-12T02:29:28.294672+0000, chain.objs.size()=2 2024-09-12T00:38:36.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.164__multipart_foo.2~Ez7WK0A0MaGBSXKvc3jUhctFL-TcSxb.1 2024-09-12T00:38:36.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.164__multipart_foo.2~Ez7WK0A0MaGBSXKvc3jUhctFL-TcSxb.2 2024-09-12T00:38:36.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9942598442382188257', time=2024-09-12T02:29:28.419446+0000, chain.objs.size()=1 2024-09-12T00:38:36.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.166__shadow_.Da6Jg1V1iQFxNvrbHhFhsaNXyROaO6m_0 2024-09-12T00:38:36.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10052250491981716546', time=2024-09-12T02:30:39.099236+0000, chain.objs.size()=1 2024-09-12T00:38:36.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.237__shadow_.aqWVic4DN4Sp_Y-0TM-sZXp1U0IzcWS_0 2024-09-12T00:38:36.627 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16748957621864806169', time=2024-09-12T02:30:43.403611+0000, chain.objs.size()=1 2024-09-12T00:38:36.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.254__shadow_.Lczh4zDvXvoqDMxuKwepMNZUfI-FeAS_0 2024-09-12T00:38:36.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12387907970472660139', time=2024-09-12T02:30:43.886884+0000, chain.objs.size()=1 2024-09-12T00:38:36.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.256__shadow_.p8GFiH0g0dt_jfy43K5wZQQvfoAtASy_0 2024-09-12T00:38:36.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17979455454852460886', time=2024-09-12T02:30:45.103009+0000, chain.objs.size()=1 2024-09-12T00:38:36.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.261__shadow_.zUn46U1H0sSNVE46JBO9NfkseAR93ay_0 2024-09-12T00:38:36.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13578409011250838150', time=2024-09-12T02:30:53.119569+0000, chain.objs.size()=1 2024-09-12T00:38:36.628 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.628+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.iYB7oD4eXkbmt8TsJNA3oZIJkqWM_PO_0 2024-09-12T00:38:36.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.632+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.336060494765166864', time=2024-09-12T02:30:53.412648+0000, chain.objs.size()=1 2024-09-12T00:38:36.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.632+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.QV9cXSrK53PWhbLVkRLNATBdaH2INkx_0 2024-09-12T00:38:36.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.632+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2660735252208711053', time=2024-09-12T02:30:53.423857+0000, chain.objs.size()=1 2024-09-12T00:38:36.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.632+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.qvpjTgnQUCzysFQGgFW2KDz7ScfmQEV_0 2024-09-12T00:38:36.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.632+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2098074860465037017', time=2024-09-12T02:30:53.469444+0000, chain.objs.size()=1 2024-09-12T00:38:36.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.632+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2uEqc9yqaW1mxV10_VQ2fW-APWjJ0v1_0 2024-09-12T00:38:36.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.632+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3815908819602640966', time=2024-09-12T02:30:53.470547+0000, chain.objs.size()=1 2024-09-12T00:38:36.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.632+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.M74TQdjGtDNh70oKDmtUK30ISeGtDox_0 2024-09-12T00:38:36.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.632+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3536994834473137733', time=2024-09-12T02:30:53.543814+0000, chain.objs.size()=1 2024-09-12T00:38:36.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.632+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.iKJapMvUIX5Kq9G-EiypUlaqP8JpSK6_0 2024-09-12T00:38:36.631 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.632+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12799362208913724522', time=2024-09-12T02:30:53.556161+0000, chain.objs.size()=1 2024-09-12T00:38:36.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.632+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.WGQhmdCmbTPB2MIKs2PZVwJyegVryHd_0 2024-09-12T00:38:36.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.632+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14724058469970153438', time=2024-09-12T02:30:53.670439+0000, chain.objs.size()=1 2024-09-12T00:38:36.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.632+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.E5z4xyayZWx1UmxywjT2w4uOs3IORVZ_0 2024-09-12T00:38:36.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.633+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7001792608544897300', time=2024-09-12T02:30:53.710741+0000, chain.objs.size()=1 2024-09-12T00:38:36.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.633+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.SLKVvTnLIxlIrg-qsrnzFjtCuXdHILh_0 2024-09-12T00:38:36.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.633+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7230264818825990141', time=2024-09-12T02:30:53.767639+0000, chain.objs.size()=1 2024-09-12T00:38:36.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.633+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.O1ZnQuOABYsETJrNbgv4Vior6hSGAmd_0 2024-09-12T00:38:36.632 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.633+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10244266006567792622', time=2024-09-12T02:30:53.829104+0000, chain.objs.size()=1 2024-09-12T00:38:36.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.633+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.T7tDBfEk0nLr87PfvTcLH_gKz0YMY7p_0 2024-09-12T00:38:36.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.633+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11899258652090635089', time=2024-09-12T02:30:53.846676+0000, chain.objs.size()=1 2024-09-12T00:38:36.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.633+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Jl68FaKQGytKGNrEXxxxb3QvaeQxE16_0 2024-09-12T00:38:36.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.636+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15545863408646914611', time=2024-09-12T02:30:53.948852+0000, chain.objs.size()=1 2024-09-12T00:38:36.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.636+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.S31Zd6VG1-ddFf7wHJvwdFVlV5VMwjr_0 2024-09-12T00:38:36.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.636+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10312001409290246828', time=2024-09-12T02:30:53.968546+0000, chain.objs.size()=1 2024-09-12T00:38:36.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.636+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-y-TcXH9gbj43URqalzDjEOX51NusAJ_0 2024-09-12T00:38:36.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.636+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4133277947168853588', time=2024-09-12T02:30:54.000319+0000, chain.objs.size()=1 2024-09-12T00:38:36.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.637+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.yrXLYyh96nWA2UKSkrSatHWris9TWoa_0 2024-09-12T00:38:36.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.637+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18115589281734779389', time=2024-09-12T02:30:54.051817+0000, chain.objs.size()=1 2024-09-12T00:38:36.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.637+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.EO0fkcPb3Jdre1MTpq5M0ZyxkE8MXex_0 2024-09-12T00:38:36.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.638+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.821502312912907607', time=2024-09-12T02:30:54.134289+0000, chain.objs.size()=1 2024-09-12T00:38:36.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.638+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.1LP2WwnWh6YCXDSKtHF1e5PiLfPoxID_0 2024-09-12T00:38:36.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.638+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.713929013686994618', time=2024-09-12T02:30:54.258114+0000, chain.objs.size()=1 2024-09-12T00:38:36.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.638+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.10DlgtkPIMYGlgqJXgHixa32sS5w7yN_0 2024-09-12T00:38:36.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.638+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3976543925834826427', time=2024-09-12T02:30:54.281730+0000, chain.objs.size()=1 2024-09-12T00:38:36.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.638+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.O61Jjx5KJpPZkeWY4tpxuyhwyPEz8Sk_0 2024-09-12T00:38:36.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.638+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13984312991820778854', time=2024-09-12T02:30:54.379321+0000, chain.objs.size()=1 2024-09-12T00:38:36.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.638+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.X8abP5435a42LxndZ5htdkRhR3y6xs6_0 2024-09-12T00:38:36.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.639+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7480619508964364688', time=2024-09-12T02:30:54.380117+0000, chain.objs.size()=1 2024-09-12T00:38:36.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.639+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.MQjguzma6GYjF6QkbIM5SBziB_MW8cE_0 2024-09-12T00:38:36.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.639+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9604804491693760316', time=2024-09-12T02:30:54.411970+0000, chain.objs.size()=1 2024-09-12T00:38:36.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.639+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.dvUC63oOTo7m44dHkEhC5PflyCita4G_0 2024-09-12T00:38:36.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.639+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16021357326085611190', time=2024-09-12T02:30:54.443871+0000, chain.objs.size()=1 2024-09-12T00:38:36.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.639+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.m8SbJy8bJ8ZY0kn9pKOwHrVAxIilOmx_0 2024-09-12T00:38:36.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.639+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2710078533330351561', time=2024-09-12T02:30:54.560240+0000, chain.objs.size()=1 2024-09-12T00:38:36.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.639+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.l18RTqIotGtOijfmhSGJX_j9GyiYKwN_0 2024-09-12T00:38:36.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.642+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9049267930188211121', time=2024-09-12T02:30:54.656225+0000, chain.objs.size()=1 2024-09-12T00:38:36.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.642+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.PgRz3DzuHfFv5SOHRzbwf-WaiaIJa1Q_0 2024-09-12T00:38:36.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.642+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16112047197941559672', time=2024-09-12T02:30:54.728939+0000, chain.objs.size()=1 2024-09-12T00:38:36.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.642+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ucOZEjZB9P4eBHvUV_TP2chnP5UbgAE_0 2024-09-12T00:38:36.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.642+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15464594685703878929', time=2024-09-12T02:30:54.731573+0000, chain.objs.size()=1 2024-09-12T00:38:36.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.642+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ayqMo4CZ_aG5x41h2Qcpc2HkjKGh1Bn_0 2024-09-12T00:38:36.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.642+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10166119482993547634', time=2024-09-12T02:30:54.840348+0000, chain.objs.size()=1 2024-09-12T00:38:36.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.642+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.yeRN7H9pU-NCDlpRpjiWIzdgp5jMLso_0 2024-09-12T00:38:36.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.642+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14539345685294990240', time=2024-09-12T02:30:54.845932+0000, chain.objs.size()=1 2024-09-12T00:38:36.641 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.642+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pYwQ_XXrC6R2KEsnImLXMcu_ft9qzco_0 2024-09-12T00:38:36.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.643+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13417458954749716162', time=2024-09-12T02:30:54.921575+0000, chain.objs.size()=1 2024-09-12T00:38:36.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.643+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ngwJGuNaZ6Ye8EG0xMgbXsvP72djmt-_0 2024-09-12T00:38:36.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.643+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13139194317922205157', time=2024-09-12T02:30:54.980630+0000, chain.objs.size()=1 2024-09-12T00:38:36.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.643+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.WNInhBWQ4p3qeTmxszK4-LN8dozA8P9_0 2024-09-12T00:38:36.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.643+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12982924195341067762', time=2024-09-12T02:30:55.088160+0000, chain.objs.size()=1 2024-09-12T00:38:36.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.643+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Y8Oyh5QVgPgTsT-DNq7NbHpoyKcJ9ME_0 2024-09-12T00:38:36.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.643+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.732866834480453305', time=2024-09-12T02:30:55.228204+0000, chain.objs.size()=1 2024-09-12T00:38:36.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.643+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.FWVErDYTpvaQ1xO2_FWL_zopRsSdMLE_0 2024-09-12T00:38:36.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.643+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7524918923559234793', time=2024-09-12T02:30:56.421418+0000, chain.objs.size()=1 2024-09-12T00:38:36.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.643+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.267__shadow_.NVe-qSLd9n15GKCp_a6arxaCQA0gJ9A_0 2024-09-12T00:38:36.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.644+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.100467273914027164', time=2024-09-12T02:30:56.654863+0000, chain.objs.size()=1 2024-09-12T00:38:36.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.644+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.268__shadow_.7b0NFc-u4zuWe5yCCu-2vO8wVDNDFz3_0 2024-09-12T00:38:36.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.648+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18237484435430159983', time=2024-09-12T02:30:57.647441+0000, chain.objs.size()=1 2024-09-12T00:38:36.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.648+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.272__shadow_.bQR-UES4ZABZ5aOrCjk-S63-GhwdPqr_0 2024-09-12T00:38:36.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.648+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1898852407373271387', time=2024-09-12T02:30:59.103271+0000, chain.objs.size()=1 2024-09-12T00:38:36.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.648+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.278__shadow_.qfFDycaBs2cflb3olYtTNvySIG-sUcC_0 2024-09-12T00:38:36.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.649+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2074842938567999241', time=2024-09-12T02:30:59.344589+0000, chain.objs.size()=1 2024-09-12T00:38:36.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.649+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.279__shadow_.EMADZuwltwtAg6WRUS3FNB5OnXprB6b_0 2024-09-12T00:38:36.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.649+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10174615649773774785', time=2024-09-12T02:31:03.055200+0000, chain.objs.size()=1 2024-09-12T00:38:36.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.649+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.8q243lG079SJuXGqPTDnt8d3Ij25LjM_0 2024-09-12T00:38:36.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.650+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9713335975556845981', time=2024-09-12T02:31:03.653664+0000, chain.objs.size()=1 2024-09-12T00:38:36.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.650+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.LhYc63iz_yH7wJYAIoy4gs6liKaXgbO_0 2024-09-12T00:38:36.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.650+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14290276370815340608', time=2024-09-12T02:31:03.676906+0000, chain.objs.size()=1 2024-09-12T00:38:36.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.650+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.XBLAXSZ4sgJTHYbk_o2vJT2EBlz0Z5E_0 2024-09-12T00:38:36.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.650+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2191165601320066246', time=2024-09-12T02:31:04.651974+0000, chain.objs.size()=1 2024-09-12T00:38:36.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.650+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.297__shadow_.h2aBvUpDOWpdzTxV15g9TJnoE8J2WX7_0 2024-09-12T00:38:36.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.650+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7003017310873323606', time=2024-09-12T02:31:04.935532+0000, chain.objs.size()=1 2024-09-12T00:38:36.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.650+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.298__shadow_.hplg3qyTWW7cgw2jVaGCmnabbLoFauX_0 2024-09-12T00:38:36.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.650+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14571059044266648040', time=2024-09-12T02:31:05.701161+0000, chain.objs.size()=1 2024-09-12T00:38:36.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.650+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.301__shadow_.hqmMY7jnRD9_Vg5VqHU7g72IfqFxrbW_0 2024-09-12T00:38:36.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.650+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13110985170732471280', time=2024-09-12T02:31:06.697486+0000, chain.objs.size()=1 2024-09-12T00:38:36.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.650+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.305__shadow_.hS-gM62tlQc0t6mVA5AaHKA5kwKfoFm_0 2024-09-12T00:38:36.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.650+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2525967276417109993', time=2024-09-12T02:31:19.459163+0000, chain.objs.size()=1 2024-09-12T00:38:36.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.650+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.9C_4BUcrWrcW-kT9CYpehwaut63PRgm_0 2024-09-12T00:38:36.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.654+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11906654849811264339', time=2024-09-12T02:31:19.470420+0000, chain.objs.size()=1 2024-09-12T00:38:36.652 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.654+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.c20-jWlidpDPp4nSSlAHIS11z_2oiFo_0 2024-09-12T00:38:36.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.654+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8245818472459534560', time=2024-09-12T02:31:19.494171+0000, chain.objs.size()=1 2024-09-12T00:38:36.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.654+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.KFjCPx_tGLa3ohCjXORE2ltkOhiaxwA_0 2024-09-12T00:38:36.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.654+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5278734592559996271', time=2024-09-12T02:31:19.661868+0000, chain.objs.size()=1 2024-09-12T00:38:36.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.654+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.UeCBRqMxk8UAEvaYR4bsxWDhCde7-yl_0 2024-09-12T00:38:36.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.654+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15070700949313170382', time=2024-09-12T02:31:19.725600+0000, chain.objs.size()=1 2024-09-12T00:38:36.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.654+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.I4pKbItXK7Hno_IRvkPThcdKqGNp7gi_0 2024-09-12T00:38:36.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.655+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9544271919308629075', time=2024-09-12T02:31:19.850627+0000, chain.objs.size()=1 2024-09-12T00:38:36.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.655+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.2k9UqGBJA6lRDLM7XNh5Ubuza5Hc1xI_0 2024-09-12T00:38:36.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.655+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7843975099563902356', time=2024-09-12T02:31:19.982198+0000, chain.objs.size()=1 2024-09-12T00:38:36.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.655+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.TmDBwkoI8-2-W1CdpC8jEexcW5z-TPi_0 2024-09-12T00:38:36.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.655+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8163436702179142207', time=2024-09-12T02:31:20.075339+0000, chain.objs.size()=1 2024-09-12T00:38:36.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.655+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.TdUZpRtBXoeK7cbmHSYGvpVsVNfPRjp_0 2024-09-12T00:38:36.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.655+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2117661877087972575', time=2024-09-12T02:31:20.294147+0000, chain.objs.size()=1 2024-09-12T00:38:36.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.655+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.eApJ8GfEkaZ9om4aBos_J99eeiCjuhN_0 2024-09-12T00:38:36.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.655+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.36495728663267299', time=2024-09-12T02:31:20.294865+0000, chain.objs.size()=1 2024-09-12T00:38:36.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.655+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.DCgYIx57-M_KBLxxN4NMml0zIV4Wevq_0 2024-09-12T00:38:36.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.655+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3627967055393645749', time=2024-09-12T02:31:20.316158+0000, chain.objs.size()=1 2024-09-12T00:38:36.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.655+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.T-0GyZ1B2DvTbIF5Ys7FRsjb43sKBHJ_0 2024-09-12T00:38:36.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.655+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14462022743177024341', time=2024-09-12T02:31:20.330690+0000, chain.objs.size()=1 2024-09-12T00:38:36.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.655+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ccJiSnIH0HxAfiBPBeNgpv--QXa0nyV_0 2024-09-12T00:38:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.658+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5354125819365346068', time=2024-09-12T02:31:20.380754+0000, chain.objs.size()=1 2024-09-12T00:38:36.656 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.658+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.u10_-HqqvC9-bzgyZqr6sUDED3WIqNT_0 2024-09-12T00:38:36.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.658+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323841655276949812', time=2024-09-12T02:31:20.391218+0000, chain.objs.size()=1 2024-09-12T00:38:36.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.658+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_._2FXoKY9pj6ah_mA5_OFQlKeMHBIKlM_0 2024-09-12T00:38:36.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.660+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14480261378625461223', time=2024-09-12T02:31:20.427384+0000, chain.objs.size()=1 2024-09-12T00:38:36.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.660+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.YexMkUdOSzZrXQ2ch1wxPCgcMs0QpIQ_0 2024-09-12T00:38:36.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.660+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7674613137757827578', time=2024-09-12T02:31:20.446881+0000, chain.objs.size()=1 2024-09-12T00:38:36.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.660+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.v6iV-9Yi74PCdmTZ3hquGaIJnj4nYd7_0 2024-09-12T00:38:36.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.660+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10059397238197208963', time=2024-09-12T02:31:20.455423+0000, chain.objs.size()=1 2024-09-12T00:38:36.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.660+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.pBrTA5Lc24pFw3dDdGhAmw-mshtsnHm_0 2024-09-12T00:38:36.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.660+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10397288882976261586', time=2024-09-12T02:31:20.619049+0000, chain.objs.size()=1 2024-09-12T00:38:36.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.660+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.HCq9vUixowLTXNjLD12LH4ZgEuLVfy2_0 2024-09-12T00:38:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.661+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10201133771354214765', time=2024-09-12T02:31:20.637027+0000, chain.objs.size()=1 2024-09-12T00:38:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.661+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IU-hur3YdQs040kTeMvNVtaDpepcD2x_0 2024-09-12T00:38:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.661+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7640743505793701631', time=2024-09-12T02:31:20.696272+0000, chain.objs.size()=1 2024-09-12T00:38:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.661+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.QGl7QCvB8TX-aCEBfnVnNll2_RmBti2_0 2024-09-12T00:38:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.661+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11319794758648839494', time=2024-09-12T02:31:20.730917+0000, chain.objs.size()=1 2024-09-12T00:38:36.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.661+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ll2-Vs7dKlqBWhuJQvRDC03KV6IonKU_0 2024-09-12T00:38:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.661+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7170998129237971934', time=2024-09-12T02:31:20.870090+0000, chain.objs.size()=1 2024-09-12T00:38:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.661+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.T0ByRb4q9wafMVAhPi_Xo7CWUE00a9p_0 2024-09-12T00:38:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.661+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18341129707217248140', time=2024-09-12T02:31:20.979430+0000, chain.objs.size()=1 2024-09-12T00:38:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.661+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.2mg20uoLBwfJoflp4PV8w_8ezoJOfDH_0 2024-09-12T00:38:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.661+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12743025908249035955', time=2024-09-12T02:31:21.018220+0000, chain.objs.size()=1 2024-09-12T00:38:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.661+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.XdJqGFICiZ1Ko4jI9zm8_7FIvm0Pltb_0 2024-09-12T00:38:36.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.663+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7384551602331138573', time=2024-09-12T02:31:21.048353+0000, chain.objs.size()=1 2024-09-12T00:38:36.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.663+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.nHk9FrlMmIH6e_WdXDBZ8Bg-pG-wry__0 2024-09-12T00:38:36.663 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.665+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.249182519966063139', time=2024-09-12T02:31:21.213901+0000, chain.objs.size()=1 2024-09-12T00:38:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.665+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.SE4MNIu2SN_0b5uxmZhohj6KQIJvFU2_0 2024-09-12T00:38:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.665+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3049118693564242603', time=2024-09-12T02:31:21.261028+0000, chain.objs.size()=1 2024-09-12T00:38:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.665+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.8Dh2Hc0Vl6xa8fN9YnR8d1-BBaH-9Uq_0 2024-09-12T00:38:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.666+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6606944497182802893', time=2024-09-12T02:31:21.322886+0000, chain.objs.size()=1 2024-09-12T00:38:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.666+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Z8yXERxKGulAcz-s6xPL6Grgmiawh_t_0 2024-09-12T00:38:36.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.666+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13648002553772871419', time=2024-09-12T02:31:21.349822+0000, chain.objs.size()=1 2024-09-12T00:38:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.666+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.XJQIn5K0leLUg4w4I0ZGRIrEeZxP4yz_0 2024-09-12T00:38:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.666+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8492492660356314767', time=2024-09-12T02:31:21.569512+0000, chain.objs.size()=1 2024-09-12T00:38:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.666+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ag4vp1eFD2OTGBKECb9O-nwewMgF20B_0 2024-09-12T00:38:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.666+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4427710502870347236', time=2024-09-12T02:31:29.735502+0000, chain.objs.size()=1 2024-09-12T00:38:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.666+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.OHVyXWbHFsp4_HxVyCEypFJrLtd30lM_0 2024-09-12T00:38:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.666+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10674213133773426822', time=2024-09-12T02:31:29.868943+0000, chain.objs.size()=1 2024-09-12T00:38:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.666+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.7iRoyXeQkTr6A79vqGaSx1wiyRERGlT_0 2024-09-12T00:38:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.666+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.102681312521197364', time=2024-09-12T02:31:29.996230+0000, chain.objs.size()=1 2024-09-12T00:38:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.666+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.m7p6Tegjkerx_4YypG9vN2N4nUTmC-M_0 2024-09-12T00:38:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.666+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15771794101534241117', time=2024-09-12T02:31:29.998727+0000, chain.objs.size()=1 2024-09-12T00:38:36.665 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.666+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.sQayqd9eAz_ixKx5LVHKiz6f-mNYWRE_0 2024-09-12T00:38:36.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.668+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15842948636365638680', time=2024-09-12T02:31:30.102766+0000, chain.objs.size()=1 2024-09-12T00:38:36.666 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.668+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.LVMpWSmWRwVuRXdo0-guDF1uPzOO98B_0 2024-09-12T00:38:36.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.669+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17007036048640435591', time=2024-09-12T02:31:30.115552+0000, chain.objs.size()=1 2024-09-12T00:38:36.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.669+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lFhoE5_4TrgqImUcm3y9ktWFIcWloKD_0 2024-09-12T00:38:36.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.672+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5378876812215405125', time=2024-09-12T02:31:30.280411+0000, chain.objs.size()=1 2024-09-12T00:38:36.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.672+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.E3Dwkyowt6avcgh7pNxbOq2Ysus2msD_0 2024-09-12T00:38:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3707598367223697132', time=2024-09-12T02:31:30.338755+0000, chain.objs.size()=1 2024-09-12T00:38:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ArP5d_2SPNJIUeiW92RgJmD_Fa__dhi_0 2024-09-12T00:38:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6542234858173796963', time=2024-09-12T02:31:30.340852+0000, chain.objs.size()=1 2024-09-12T00:38:36.671 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.I-6FU7dZdMKjnQE99D6gtNCvhJtBRtN_0 2024-09-12T00:38:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6314270495242364533', time=2024-09-12T02:31:30.351554+0000, chain.objs.size()=1 2024-09-12T00:38:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.YUNjBBKeXJTz5-aUB4QyO1_QrBA0CBi_0 2024-09-12T00:38:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14162051944869441548', time=2024-09-12T02:31:30.374762+0000, chain.objs.size()=1 2024-09-12T00:38:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.pymgy1_XosbZ529qini5TyFQPgZXBa4_0 2024-09-12T00:38:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13440280424885138436', time=2024-09-12T02:31:30.409496+0000, chain.objs.size()=1 2024-09-12T00:38:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NAqtJRE0h8_mggaxZ00dstf-Ic_5XVW_0 2024-09-12T00:38:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9294376588107169846', time=2024-09-12T02:31:30.632407+0000, chain.objs.size()=1 2024-09-12T00:38:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.hNEi5n1alN1MBVNpEq6KfygglfpRfoD_0 2024-09-12T00:38:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3847843298105959170', time=2024-09-12T02:31:30.643580+0000, chain.objs.size()=1 2024-09-12T00:38:36.672 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.VtW4FRTCJ50OF-v7IUzK_hSnGnB0dt4_0 2024-09-12T00:38:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18106372132479915677', time=2024-09-12T02:31:30.645216+0000, chain.objs.size()=1 2024-09-12T00:38:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mgxHtyvmIu6IZOcGp3kzH-TvIV9keuV_0 2024-09-12T00:38:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11788545552582201812', time=2024-09-12T02:31:30.648896+0000, chain.objs.size()=1 2024-09-12T00:38:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.673+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.9tvNSTEb8cGVuxnBLXDAYYudak9Vspi_0 2024-09-12T00:38:36.673 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.675+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15414284522568231095', time=2024-09-12T02:31:30.652298+0000, chain.objs.size()=1 2024-09-12T00:38:36.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.675+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.r-rarvUnpU4N2IMtwZdZaC9wOJMNEOm_0 2024-09-12T00:38:36.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.679+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/44084 2024-09-12T00:38:36.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T00:38:36.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4978152699375956927', time=2024-09-12T02:31:30.657166+0000, chain.objs.size()=1 2024-09-12T00:38:36.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.DCUfsWAbKvM5wOU2kl0swnkWEPQL-G8_0 2024-09-12T00:38:36.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12724085289262487009', time=2024-09-12T02:31:30.752321+0000, chain.objs.size()=1 2024-09-12T00:38:36.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.z28-Uo4av19vJN8OMLC264BHPwJ5oEn_0 2024-09-12T00:38:36.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10912000161629985815', time=2024-09-12T02:31:31.036932+0000, chain.objs.size()=1 2024-09-12T00:38:36.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.uTpwSaQ2z1FsXchy3RcUikVkY1Gnupt_0 2024-09-12T00:38:36.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1136838513470171043', time=2024-09-12T02:31:31.174265+0000, chain.objs.size()=1 2024-09-12T00:38:36.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.CSKS0dUfeWmhNvcJeL-FqJHI1bjOHyr_0 2024-09-12T00:38:36.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1223946545697820558', time=2024-09-12T02:31:31.209999+0000, chain.objs.size()=1 2024-09-12T00:38:36.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.KSagsUYxbGMyHSfG1AUi5sZ1ZQPF2ev_0 2024-09-12T00:38:36.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4091943861329683433', time=2024-09-12T02:31:31.527961+0000, chain.objs.size()=1 2024-09-12T00:38:36.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.5AUpZ_HrVCWKsPugHGfJZuUF2SZcsXO_0 2024-09-12T00:38:36.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17963664841070584884', time=2024-09-12T02:31:31.540962+0000, chain.objs.size()=1 2024-09-12T00:38:36.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.CriLIrNzrr2oN1SgPYBlUqEpWV1qKYI_0 2024-09-12T00:38:36.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12209447055689171122', time=2024-09-12T02:31:31.578541+0000, chain.objs.size()=1 2024-09-12T00:38:36.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.h5h9oUOelWMP1tZ8R9eHYOFzKAQ5222_0 2024-09-12T00:38:36.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8616881906045457644', time=2024-09-12T02:31:31.682362+0000, chain.objs.size()=1 2024-09-12T00:38:36.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.UnMils_SquC2WownDHy04Yt4cyTDCiX_0 2024-09-12T00:38:36.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14269060026271092231', time=2024-09-12T02:31:34.828288+0000, chain.objs.size()=1 2024-09-12T00:38:36.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.337__shadow_.haS-luv598RaecED7CsLDP8PP6-8lht_0 2024-09-12T00:38:36.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16398126468657966071', time=2024-09-12T02:31:45.645415+0000, chain.objs.size()=1 2024-09-12T00:38:36.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.382__shadow_.GTkDJuVBmyZOoMOxooHMAB7sC1Q8LbP_0 2024-09-12T00:38:36.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7871192453734390913', time=2024-09-12T02:31:46.257842+0000, chain.objs.size()=1 2024-09-12T00:38:36.683 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.682+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.384__shadow_.oA_vzwVcJP2jTEN-AOgquDuHUbRcmQ-_0 2024-09-12T00:38:36.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.686+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13372615101544966979', time=2024-09-12T02:32:09.559964+0000, chain.objs.size()=1 2024-09-12T00:38:36.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.686+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.466__shadow_.d2Sly25ZMLMfpFLhD0QiIr9Pyd1YXp4_0 2024-09-12T00:38:36.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.686+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16316929624702609558', time=2024-09-12T02:32:11.726556+0000, chain.objs.size()=1 2024-09-12T00:38:36.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.686+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.481__shadow_.BXJK4OR9vJZMXKbivVaxcIH3aONO9Y9_0 2024-09-12T00:38:36.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.686+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17954003326726968700', time=2024-09-12T02:32:22.824107+0000, chain.objs.size()=1 2024-09-12T00:38:36.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.686+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.518__multipart_mymultipart.2~nrbJAHdhA25FccJ13DLyumHR0d7yWOD.1 2024-09-12T00:38:36.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.686+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1716702651603912225', time=2024-09-12T02:33:44.645987+0000, chain.objs.size()=4 2024-09-12T00:38:36.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.686+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.578__multipart_testobj.2~vZgM-CFVqzy-laYaBn2ke7dqDiMYM6x.1 2024-09-12T00:38:36.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.686+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.578__multipart_testobj.2~vZgM-CFVqzy-laYaBn2ke7dqDiMYM6x.2 2024-09-12T00:38:36.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.686+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.578__multipart_testobj.2~vZgM-CFVqzy-laYaBn2ke7dqDiMYM6x.3 2024-09-12T00:38:36.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.686+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.578__multipart_testobj.2~vZgM-CFVqzy-laYaBn2ke7dqDiMYM6x.4 2024-09-12T00:38:36.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.689+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3369093763537811560', time=2024-09-12T02:33:46.852542+0000, chain.objs.size()=1 2024-09-12T00:38:36.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.689+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.580__shadow:u8UCosg4Upi8Y.B4l2tqS5UHM7iPnOY_.QUGzWCuQxcWU7Gm4Xdjog3TGqxcTtn__0 2024-09-12T00:38:36.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.689+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13406953962358107038', time=2024-09-12T02:36:06.795616+0000, chain.objs.size()=1 2024-09-12T00:38:36.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.689+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.637__shadow_.01O-Kk1PMz9rbspJBaBDek8lqD6PJZ__0 2024-09-12T00:38:36.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.689+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7338320824613760270', time=2024-09-12T02:36:23.284106+0000, chain.objs.size()=1 2024-09-12T00:38:36.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.689+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.694__shadow:DjAxyWgpicajFd-Amj55qgQG75M1bVp_.ovjiS_bcEB3-GopGbn_pIOsUQCLx-Mp_0 2024-09-12T00:38:36.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.689+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9629113239037997206', time=2024-09-12T02:36:23.562873+0000, chain.objs.size()=1 2024-09-12T00:38:36.688 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.689+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.695__shadow_.wSHo8D9va0UlMo91Bdu3yG9IxAiwNLr_0 2024-09-12T00:38:36.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.691+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.143158786199604031', time=2024-09-12T02:36:25.407943+0000, chain.objs.size()=1 2024-09-12T00:38:36.690 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.691+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.702__multipart_file1.2~SqvqGh2a8P63KQGRablUweNtCWrg7WJ.1 2024-09-12T00:38:36.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.697+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:36.699 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.701+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:38:36.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.702+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:36.701 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.702+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:36.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45563' 2024-09-12T00:38:36.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~Vwes5lMsSt1_BjVNLtima8H1dZ2mhg9', time=2024-09-12T02:29:44.763934+0000, chain.objs.size()=1 2024-09-12T00:38:36.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.201__multipart_mymultipart.2~Vwes5lMsSt1_BjVNLtima8H1dZ2mhg9.1 2024-09-12T00:38:36.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10515507455765875018', time=2024-09-12T02:30:37.246526+0000, chain.objs.size()=1 2024-09-12T00:38:36.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.230__shadow_.sk9XD2W1NsSW6KkGoIN4PfHJn9LFdJS_0 2024-09-12T00:38:36.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7453687130251523296', time=2024-09-12T02:30:38.045962+0000, chain.objs.size()=1 2024-09-12T00:38:36.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.233__shadow_.BWjXSuEqkMn8YBBYY1VkSDjrM-ZiMEE_0 2024-09-12T00:38:36.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8695668973169854366', time=2024-09-12T02:30:40.929335+0000, chain.objs.size()=1 2024-09-12T00:38:36.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.244__shadow_.BrlzvyYrUumc1tw345V-BFkoXMKc0KF_0 2024-09-12T00:38:36.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16375055385954872989', time=2024-09-12T02:30:41.928105+0000, chain.objs.size()=1 2024-09-12T00:38:36.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.248__shadow_.rnCK5Nxjw6HdYfePiXXs8g-GpJrbYd-_0 2024-09-12T00:38:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16578810628383084105', time=2024-09-12T02:30:42.164760+0000, chain.objs.size()=1 2024-09-12T00:38:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.249__shadow_.4IleOLkpSSpKSEYI7ejfolz8R3-JZwJ_0 2024-09-12T00:38:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1059442599286812204', time=2024-09-12T02:30:53.118653+0000, chain.objs.size()=1 2024-09-12T00:38:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.WobEIaQ-6C2tYm9zgZ8MVHKFM5Z5UJY_0 2024-09-12T00:38:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.130744734625191567', time=2024-09-12T02:30:53.197291+0000, chain.objs.size()=1 2024-09-12T00:38:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.R-YH7BO_OntdAgmgedVBZaE00AbJGDU_0 2024-09-12T00:38:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10117645587365365058', time=2024-09-12T02:30:53.256651+0000, chain.objs.size()=1 2024-09-12T00:38:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.1wokK7EnooFjTufobivPtC-Kxluhkt-_0 2024-09-12T00:38:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15442886531343369951', time=2024-09-12T02:30:53.285321+0000, chain.objs.size()=1 2024-09-12T00:38:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HvfL-IqyQvFXLVej7ShdwQyCPQvydGt_0 2024-09-12T00:38:36.704 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17506785472592138284', time=2024-09-12T02:30:53.392806+0000, chain.objs.size()=1 2024-09-12T00:38:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.OhBhyORGMPwNrTHrQ4nge3exg6sxu4e_0 2024-09-12T00:38:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17521111424492470213', time=2024-09-12T02:30:53.413101+0000, chain.objs.size()=1 2024-09-12T00:38:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.704+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.8Kopuv_0Vb_wZ0GZo8N7-joEfM35QbA_0 2024-09-12T00:38:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.707+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15894866940183113229', time=2024-09-12T02:30:53.508270+0000, chain.objs.size()=1 2024-09-12T00:38:36.705 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.707+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pcNXk1HT3SaSqHGcyRPFc3KGsG8db99_0 2024-09-12T00:38:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2044029191158675348', time=2024-09-12T02:30:53.530451+0000, chain.objs.size()=1 2024-09-12T00:38:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.iSwJVV3YLmyXZqM30-KZr9vhW7n_QPy_0 2024-09-12T00:38:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17140220680937940727', time=2024-09-12T02:30:53.684987+0000, chain.objs.size()=1 2024-09-12T00:38:36.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.bmaAz_F17DU-wz5wc4rtbVlwwa71CgL_0 2024-09-12T00:38:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4763888904000402419', time=2024-09-12T02:30:53.702193+0000, chain.objs.size()=1 2024-09-12T00:38:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Eym_iwp5pnrAXJ5Xa84fib3rqx-4smC_0 2024-09-12T00:38:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1416657242688074047', time=2024-09-12T02:30:53.805193+0000, chain.objs.size()=1 2024-09-12T00:38:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.orKK4NnnOSF8yZKaZmN1darQ7bpPU1X_0 2024-09-12T00:38:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18108514135331890445', time=2024-09-12T02:30:53.816447+0000, chain.objs.size()=1 2024-09-12T00:38:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.EQqzC95WLkB8Qp8PLGaM5DYfX71TP8g_0 2024-09-12T00:38:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16315399075359650186', time=2024-09-12T02:30:53.969319+0000, chain.objs.size()=1 2024-09-12T00:38:36.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.tUKoBM14lLpWqNcc3dlCh9FfR9i5BEp_0 2024-09-12T00:38:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15726189006663879788', time=2024-09-12T02:30:53.981406+0000, chain.objs.size()=1 2024-09-12T00:38:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.3AvGe-UOP9uEP1G07CMP1TCkZRp6eNY_0 2024-09-12T00:38:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7371448392091302555', time=2024-09-12T02:30:54.129151+0000, chain.objs.size()=1 2024-09-12T00:38:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.709+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.mSOS1OoDu956UwZyNfdZEFdfHYh0pGz_0 2024-09-12T00:38:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.710+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10895988443348935774', time=2024-09-12T02:30:54.277732+0000, chain.objs.size()=1 2024-09-12T00:38:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.710+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.xwbFIAWWvB5on_djgi4918ch7Bu1vvh_0 2024-09-12T00:38:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.710+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.996549369848565835', time=2024-09-12T02:30:54.366187+0000, chain.objs.size()=1 2024-09-12T00:38:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.710+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.cRlDrJRD_ngFbYdjrd3xlziFaAlY2l5_0 2024-09-12T00:38:36.709 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.711+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6279603425492474319', time=2024-09-12T02:30:54.386250+0000, chain.objs.size()=1 2024-09-12T00:38:36.710 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.711+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.FX9P0oAaBZ4Lq_U48_t2O4k0_trq9iK_0 2024-09-12T00:38:36.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.713+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7212134840457990506', time=2024-09-12T02:30:54.389248+0000, chain.objs.size()=1 2024-09-12T00:38:36.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.713+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.4QRdergexHWUfH0X5aSTcXcKPXsIB3h_0 2024-09-12T00:38:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.715+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11840195380188026401', time=2024-09-12T02:30:54.562883+0000, chain.objs.size()=1 2024-09-12T00:38:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.715+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2DW0oBBiwcrlt9lWmdpCUEIJ4JgJemf_0 2024-09-12T00:38:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.715+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13252083885517383399', time=2024-09-12T02:30:54.563621+0000, chain.objs.size()=1 2024-09-12T00:38:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.715+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.rfI4-Ei6ZWgIm4THpgJtj6fimzq-8q8_0 2024-09-12T00:38:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.715+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6464944641815251137', time=2024-09-12T02:30:54.616376+0000, chain.objs.size()=1 2024-09-12T00:38:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.715+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.OZIV3tyXQ2izWYpUKVTjGf6b9qaGIAL_0 2024-09-12T00:38:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.715+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2848827040799369656', time=2024-09-12T02:30:54.617127+0000, chain.objs.size()=1 2024-09-12T00:38:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.715+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.J4UomyICD3PgVp4vxVQQQupKYyakEkY_0 2024-09-12T00:38:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.715+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3690090375854434858', time=2024-09-12T02:30:54.724286+0000, chain.objs.size()=1 2024-09-12T00:38:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.715+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.NUuL2lUAkgJCDnxPdaWtPLRL6cyXtJ__0 2024-09-12T00:38:36.714 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.715+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3850457998020162839', time=2024-09-12T02:30:54.881178+0000, chain.objs.size()=1 2024-09-12T00:38:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.715+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.kY3RjEjuql4XVagfvYYQGvRlFgG__RB_0 2024-09-12T00:38:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.717+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11342437659826577106', time=2024-09-12T02:30:54.905279+0000, chain.objs.size()=1 2024-09-12T00:38:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.717+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.hbt0bjAh3q7vBOSZ8zp1RMAxiV6Gv8w_0 2024-09-12T00:38:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.717+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6579868633227177500', time=2024-09-12T02:30:55.126182+0000, chain.objs.size()=1 2024-09-12T00:38:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.717+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.WQV9n5qLj4JgIRLLK7Zz3CeS5wbHS5-_0 2024-09-12T00:38:36.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.717+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15814083468589971492', time=2024-09-12T02:30:55.141379+0000, chain.objs.size()=1 2024-09-12T00:38:36.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.717+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.brUJVqV63Hd8ZyQSyzvGqsLVLGO60Zl_0 2024-09-12T00:38:36.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.717+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11907034048998770526', time=2024-09-12T02:30:55.174216+0000, chain.objs.size()=1 2024-09-12T00:38:36.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.717+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.A2e6DW41T6y4otHmIIguEfO_E-Kz7Jv_0 2024-09-12T00:38:36.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.717+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8649266053963647230', time=2024-09-12T02:30:55.186513+0000, chain.objs.size()=1 2024-09-12T00:38:36.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.717+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.L_lp-pmqUhRq8DX1B5lQwXOs9QPgSzD_0 2024-09-12T00:38:36.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.721+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11634937027030160700', time=2024-09-12T02:30:56.187154+0000, chain.objs.size()=1 2024-09-12T00:38:36.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.721+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.266__shadow_.k1XWLhb4cwyJztXHGN-CjsH_HnnWeJk_0 2024-09-12T00:38:36.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.721+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13218250271430855168', time=2024-09-12T02:31:03.071520+0000, chain.objs.size()=1 2024-09-12T00:38:36.719 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.721+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.VriMb5FyVWXiaf30C6-l1VZ8t0Y-RLI_0 2024-09-12T00:38:36.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1102778718193414687', time=2024-09-12T02:31:03.649415+0000, chain.objs.size()=1 2024-09-12T00:38:36.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.WTGz0kG2wPSYS7HzT-x2ORAWVF8n4QV_0 2024-09-12T00:38:36.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16550670121750312661', time=2024-09-12T02:31:19.402622+0000, chain.objs.size()=1 2024-09-12T00:38:36.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.AKpIStgo4HpKCm58ERzDAiTFmRAKXb5_0 2024-09-12T00:38:36.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13082554762276030295', time=2024-09-12T02:31:19.449238+0000, chain.objs.size()=1 2024-09-12T00:38:36.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.bJ9ygyE-XJ9iF91xAeANRls0Mmunpwq_0 2024-09-12T00:38:36.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16930152448607662597', time=2024-09-12T02:31:19.502070+0000, chain.objs.size()=1 2024-09-12T00:38:36.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.g4XOL7LTbywgNZI971HIKYBKR084FgQ_0 2024-09-12T00:38:36.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2091046123694437856', time=2024-09-12T02:31:19.712982+0000, chain.objs.size()=1 2024-09-12T00:38:36.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.3khhoUWqTdb7B8NduCwhUbvROzlRIS7_0 2024-09-12T00:38:36.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15550640274294863071', time=2024-09-12T02:31:19.742562+0000, chain.objs.size()=1 2024-09-12T00:38:36.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.i3_HMK-egvjDjNnXwuj_9q_T1u0FUzh_0 2024-09-12T00:38:36.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4100269319003900708', time=2024-09-12T02:31:19.809789+0000, chain.objs.size()=1 2024-09-12T00:38:36.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ngYnXGVlV-Z0olAmXMUZdJzAsNrX5wH_0 2024-09-12T00:38:36.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4869075391765199999', time=2024-09-12T02:31:19.869813+0000, chain.objs.size()=1 2024-09-12T00:38:36.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.D9PRwvfnvS8t3JyCFnGd0O2iQRLMvc__0 2024-09-12T00:38:36.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8622512817591111451', time=2024-09-12T02:31:19.989553+0000, chain.objs.size()=1 2024-09-12T00:38:36.722 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.722+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.0hnb8IVso-g8hX0UQLpIy7OoUMz_ssG_0 2024-09-12T00:38:36.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.727+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17778230307263123404', time=2024-09-12T02:31:19.999284+0000, chain.objs.size()=1 2024-09-12T00:38:36.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.-wRH1ext4tYoJvU5ZWV-fNgmqdQcV3D_0 2024-09-12T00:38:36.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.727+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12620497804565088629', time=2024-09-12T02:31:20.070404+0000, chain.objs.size()=1 2024-09-12T00:38:36.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.0ZAS6S5eFcYqhMLXdD_evB5mxR-Fq36_0 2024-09-12T00:38:36.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.727+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9538487259615543186', time=2024-09-12T02:31:20.387674+0000, chain.objs.size()=1 2024-09-12T00:38:36.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.vNwl4sjp0AoNGac9z_GGPySp9Y39Mlk_0 2024-09-12T00:38:36.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.727+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17805132371859570248', time=2024-09-12T02:31:20.567685+0000, chain.objs.size()=1 2024-09-12T00:38:36.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.tG1ZLTckZyv6t09Uj36LKUa8zFsszWN_0 2024-09-12T00:38:36.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.727+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16322570307375307709', time=2024-09-12T02:31:20.603868+0000, chain.objs.size()=1 2024-09-12T00:38:36.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.RczvOm-EkLqvfcUWroGI408aUeBFaLq_0 2024-09-12T00:38:36.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.727+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12752009671449634921', time=2024-09-12T02:31:20.627276+0000, chain.objs.size()=1 2024-09-12T00:38:36.726 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.KeA-vAJYNU_L9K1F2CtrsQaiQfWQOgD_0 2024-09-12T00:38:36.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.728+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1500156359601746783', time=2024-09-12T02:31:20.904803+0000, chain.objs.size()=1 2024-09-12T00:38:36.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.728+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NnYpFCUsrzuR2H2ayIYEXFisp3Dz3x3_0 2024-09-12T00:38:36.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.728+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14798991460981324836', time=2024-09-12T02:31:20.951624+0000, chain.objs.size()=1 2024-09-12T00:38:36.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.728+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.2WlqDhFWip4S-hrxVx2I3W_P7Pm3por_0 2024-09-12T00:38:36.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.728+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16338265645152085913', time=2024-09-12T02:31:20.963521+0000, chain.objs.size()=1 2024-09-12T00:38:36.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.728+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.tGt_vGPTWAlMDa2A9EKhwiKBey09XAr_0 2024-09-12T00:38:36.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.728+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16926090908918174302', time=2024-09-12T02:31:20.968196+0000, chain.objs.size()=1 2024-09-12T00:38:36.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.728+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ja2KAq8TCP2Es9gwZyfzB1O4uKbvmig_0 2024-09-12T00:38:36.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.728+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14790218238725154796', time=2024-09-12T02:31:20.968865+0000, chain.objs.size()=1 2024-09-12T00:38:36.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.728+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.3E9QlYJ97Hvp69Vl4aHvs8IoXva-6ft_0 2024-09-12T00:38:36.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.732+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.480598130875713541', time=2024-09-12T02:31:21.166763+0000, chain.objs.size()=1 2024-09-12T00:38:36.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.732+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.i4Wpw5Y-lZnDXkSv2OhYsw0TDlzKB6c_0 2024-09-12T00:38:36.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.732+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12300010517078437406', time=2024-09-12T02:31:21.198188+0000, chain.objs.size()=1 2024-09-12T00:38:36.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.732+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.J-PiOaqDhgzk2FMLZvoaqPirKL1xYtJ_0 2024-09-12T00:38:36.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.732+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7725349749385965311', time=2024-09-12T02:31:21.219873+0000, chain.objs.size()=1 2024-09-12T00:38:36.730 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.732+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.LE_XVb_pH7jpa6q8S5v3nCuVBkU-4d2_0 2024-09-12T00:38:36.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.733+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15455143138922070720', time=2024-09-12T02:31:21.222048+0000, chain.objs.size()=1 2024-09-12T00:38:36.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.733+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.qoPYj0W5H8qSXXDVEfH010ljbDF_0Cc_0 2024-09-12T00:38:36.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.733+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5600290177769547745', time=2024-09-12T02:31:21.236188+0000, chain.objs.size()=1 2024-09-12T00:38:36.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.733+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.qah16sEpHwHbfuiS75bGcuhkn8VXl9N_0 2024-09-12T00:38:36.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.733+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16088644148175923685', time=2024-09-12T02:31:21.238201+0000, chain.objs.size()=1 2024-09-12T00:38:36.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.733+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.LN6OBgYnpjDsF6plhM_zLP0beiWT-nT_0 2024-09-12T00:38:36.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.733+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10126673694302834827', time=2024-09-12T02:31:21.335153+0000, chain.objs.size()=1 2024-09-12T00:38:36.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.733+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.m_xNEEzcUf8VErPfNSjYgdQunlZGYPQ_0 2024-09-12T00:38:36.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.733+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1708127254941972092', time=2024-09-12T02:31:21.361556+0000, chain.objs.size()=1 2024-09-12T00:38:36.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.733+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.8_WIFiphuoz33yume8e_PBkt92Qjyzv_0 2024-09-12T00:38:36.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.733+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4784803355078434897', time=2024-09-12T02:31:21.490680+0000, chain.objs.size()=1 2024-09-12T00:38:36.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.733+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.0iVewdcjLkle_WSwozJvrF_Rl-QNoqD_0 2024-09-12T00:38:36.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.734+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6264681232976336046', time=2024-09-12T02:31:21.497998+0000, chain.objs.size()=1 2024-09-12T00:38:36.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.734+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.gpK5-vH11tp6rTTOw03nWs80whgPqvk_0 2024-09-12T00:38:36.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.735+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17586832158254826639', time=2024-09-12T02:31:21.551629+0000, chain.objs.size()=1 2024-09-12T00:38:36.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.735+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.MppqSkUNcQe7AL4rKtyMQM0NpoLccG__0 2024-09-12T00:38:36.736 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15136658457885472776', time=2024-09-12T02:31:21.607460+0000, chain.objs.size()=1 2024-09-12T00:38:36.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.gxE0fP-YOWcphibzu4yK1S-9iEsAha1_0 2024-09-12T00:38:36.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9922568439365774247', time=2024-09-12T02:31:29.681024+0000, chain.objs.size()=1 2024-09-12T00:38:36.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.hh7cGx6eJqhbac6AXPgIgjYaoT4cKf5_0 2024-09-12T00:38:36.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16486774980270686436', time=2024-09-12T02:31:29.723790+0000, chain.objs.size()=1 2024-09-12T00:38:36.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.XJWM8qSM0nW_clnszJJvOrFTpQLIy_Y_0 2024-09-12T00:38:36.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17590444071479452612', time=2024-09-12T02:31:29.755532+0000, chain.objs.size()=1 2024-09-12T00:38:36.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.AH2uljx8JY5QXq25PQYbzjz3kGXbeha_0 2024-09-12T00:38:36.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5235664450174516456', time=2024-09-12T02:31:29.997166+0000, chain.objs.size()=1 2024-09-12T00:38:36.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.QUw5hhX1mBOR-Zrj03G1gWSzDTNlmqg_0 2024-09-12T00:38:36.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7467647403627201126', time=2024-09-12T02:31:30.075504+0000, chain.objs.size()=1 2024-09-12T00:38:36.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.dTeojSqAzysRKQ_j1lJB_cBjsLwFh8j_0 2024-09-12T00:38:36.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10602460994669435', time=2024-09-12T02:31:30.202354+0000, chain.objs.size()=1 2024-09-12T00:38:36.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Ohn4OO2K7S4dBOjT1wZFQYFtH1_DucU_0 2024-09-12T00:38:36.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1950013156783394785', time=2024-09-12T02:31:30.351349+0000, chain.objs.size()=1 2024-09-12T00:38:36.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.GaPDxoiSdBZQ_NZEM17XFDOijEOu5KU_0 2024-09-12T00:38:36.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10603352284661496986', time=2024-09-12T02:31:30.422402+0000, chain.objs.size()=1 2024-09-12T00:38:36.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.738+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.DEUhKDZO9UkJRyHDrjVLo_97REgPZoR_0 2024-09-12T00:38:36.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.739+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14016069867741616246', time=2024-09-12T02:31:30.426708+0000, chain.objs.size()=1 2024-09-12T00:38:36.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.739+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.UlsuOJotIrhnCk_AOkmSlUp5KVOw3pj_0 2024-09-12T00:38:36.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.739+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3989276597756466401', time=2024-09-12T02:31:30.441759+0000, chain.objs.size()=1 2024-09-12T00:38:36.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.739+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.nfZAzF2aF0RCISrP4_Wv1psv7uyFPz8_0 2024-09-12T00:38:36.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17334148800230084852', time=2024-09-12T02:31:30.646618+0000, chain.objs.size()=1 2024-09-12T00:38:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.bAvSC8GKxY1mLD_KeISsmeeYH4PcKet_0 2024-09-12T00:38:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4610433716423206865', time=2024-09-12T02:31:30.648103+0000, chain.objs.size()=1 2024-09-12T00:38:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NgVR-DPeJTVAOq5DjE0bzYT8Ht5_WVe_0 2024-09-12T00:38:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12797155282828054658', time=2024-09-12T02:31:30.687232+0000, chain.objs.size()=1 2024-09-12T00:38:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.s0zrgMlz70EkDkdxOdFZGEXkA34Eewh_0 2024-09-12T00:38:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2682744346545234798', time=2024-09-12T02:31:30.761663+0000, chain.objs.size()=1 2024-09-12T00:38:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.6QugZbOAQcq_pL6e9XEpJIok1KWG4UK_0 2024-09-12T00:38:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16889931158848312918', time=2024-09-12T02:31:30.938120+0000, chain.objs.size()=1 2024-09-12T00:38:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.eyZabHlS5JfAfhOyC9o-fQxWTJ0glYe_0 2024-09-12T00:38:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1492976904806854723', time=2024-09-12T02:31:31.130291+0000, chain.objs.size()=1 2024-09-12T00:38:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.X84Txo40OUF1K9X8nJKiRR25-dedwSL_0 2024-09-12T00:38:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11413083765335708301', time=2024-09-12T02:31:31.142081+0000, chain.objs.size()=1 2024-09-12T00:38:36.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.JpwEXaRJmiXPwJ7xTWz51kijTFY6lpy_0 2024-09-12T00:38:36.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15367944157902719396', time=2024-09-12T02:31:31.157369+0000, chain.objs.size()=1 2024-09-12T00:38:36.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.IeDCuoV-b_FjARWJ7ScWrwxNz1cghzV_0 2024-09-12T00:38:36.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13701920603569795851', time=2024-09-12T02:31:31.165798+0000, chain.objs.size()=1 2024-09-12T00:38:36.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.dDrq4ufHtJKAwv3UHMZ-PWVFyApYaKZ_0 2024-09-12T00:38:36.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17628127348565775252', time=2024-09-12T02:31:31.195445+0000, chain.objs.size()=1 2024-09-12T00:38:36.745 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.5PDmYvupTdjBku44d_O0OKk7SxeqOB__0 2024-09-12T00:38:36.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.748+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.81287801337076940', time=2024-09-12T02:31:31.221455+0000, chain.objs.size()=1 2024-09-12T00:38:36.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.748+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.P9TRk5R8LM8o9IPiyYlaJ8kldMmNEhz_0 2024-09-12T00:38:36.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6934418748261241521', time=2024-09-12T02:31:31.251301+0000, chain.objs.size()=1 2024-09-12T00:38:36.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.zNjjinDtMTUPlaTWuhJzst0VQY5-P6e_0 2024-09-12T00:38:36.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3931729836986355824', time=2024-09-12T02:31:31.292474+0000, chain.objs.size()=1 2024-09-12T00:38:36.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mlSZf0UIyKfYVWfgfGsFBfLRfHV4X1m_0 2024-09-12T00:38:36.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16517498047325865145', time=2024-09-12T02:31:31.431136+0000, chain.objs.size()=1 2024-09-12T00:38:36.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.rvsyzZBHaF-7LdhDsmzzW_yNRATtLj6_0 2024-09-12T00:38:36.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3351141224542258309', time=2024-09-12T02:31:31.465206+0000, chain.objs.size()=1 2024-09-12T00:38:36.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._ZxiPpaEj7Qp6p-s3c3PzyqcDide4pa_0 2024-09-12T00:38:36.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13771369458248791439', time=2024-09-12T02:31:31.771607+0000, chain.objs.size()=1 2024-09-12T00:38:36.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.tftHf4k7N35q74FeRjicePfbI41GUn-_0 2024-09-12T00:38:36.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2807620020414519864', time=2024-09-12T02:31:53.654152+0000, chain.objs.size()=1 2024-09-12T00:38:36.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.409__shadow_.njKD9zFxe6_rk7Z9he23Q4U87rXnaj9_0 2024-09-12T00:38:36.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16074842061831114288', time=2024-09-12T02:32:11.726747+0000, chain.objs.size()=1 2024-09-12T00:38:36.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.481__shadow_.jHiIPAieCEJzG6-LGINbitU-o3BW0v3_0 2024-09-12T00:38:36.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.289091554569528000', time=2024-09-12T02:32:19.835090+0000, chain.objs.size()=6 2024-09-12T00:38:36.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.1 2024-09-12T00:38:36.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.2 2024-09-12T00:38:36.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.3 2024-09-12T00:38:36.751 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.751+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.4 2024-09-12T00:38:36.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.756+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.5 2024-09-12T00:38:36.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.756+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.6 2024-09-12T00:38:36.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.756+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2357636744046175168', time=2024-09-12T02:32:25.749422+0000, chain.objs.size()=3 2024-09-12T00:38:36.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.756+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.521__multipart_mymultipart.2~ZnxiO4OdbgQaD9TTF_zVtQk2azE-ubb.1 2024-09-12T00:38:36.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.756+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.521__multipart_mymultipart.2~ZnxiO4OdbgQaD9TTF_zVtQk2azE-ubb.2 2024-09-12T00:38:36.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.757+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.521__multipart_mymultipart.2~ZnxiO4OdbgQaD9TTF_zVtQk2azE-ubb.3 2024-09-12T00:38:36.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.760+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/45563 2024-09-12T00:38:36.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:38:36.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~sv_irUegLtQEwzx4IvabXsBqEXuvI-I', time=2024-09-12T02:32:37.303713+0000, chain.objs.size()=1 2024-09-12T00:38:36.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.534__multipart_mymultipart.2~sv_irUegLtQEwzx4IvabXsBqEXuvI-I.1 2024-09-12T00:38:36.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7703294954092318079', time=2024-09-12T02:33:07.467906+0000, chain.objs.size()=1 2024-09-12T00:38:36.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.555__shadow_.mbTMRRrpUYM8-XiT3LsQL0UpXozdOcD_0 2024-09-12T00:38:36.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10632495223030774718', time=2024-09-12T02:33:19.285322+0000, chain.objs.size()=1 2024-09-12T00:38:36.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:jDw6CcLE8taphyQXpnhxlvDwHPFwrrP_.2zIDyByHEegf2YsThEqnfvMGN2m0W7k_0 2024-09-12T00:38:36.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.844455111291049449', time=2024-09-12T02:33:20.898232+0000, chain.objs.size()=1 2024-09-12T00:38:36.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:-hJQn9eqbprN3yWnz8uBOzbpNlmOxSj_.ehSY4dFWUrOpaXng0ZWVmju8R4UItRi_0 2024-09-12T00:38:36.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9666188262390979420', time=2024-09-12T02:33:43.181139+0000, chain.objs.size()=1 2024-09-12T00:38:36.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:heYW3xVchckG-GyGGhs8HZHn-s1yJZC_.zXll8K959g09Nv31sZtZ_sU7dANPUK__0 2024-09-12T00:38:36.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2432428893387620208', time=2024-09-12T02:34:59.069591+0000, chain.objs.size()=1 2024-09-12T00:38:36.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.617__shadow_.Qvr_ZXxKB6kKhZie17RBk0IhKUzy0_H_0 2024-09-12T00:38:36.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17433673740207749321', time=2024-09-12T02:36:08.590272+0000, chain.objs.size()=1 2024-09-12T00:38:36.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.644__shadow_.HA2SKtPA8KThCGhD4B9h0BRbZlZ25qU_0 2024-09-12T00:38:36.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1052177285276291945', time=2024-09-12T02:36:15.507418+0000, chain.objs.size()=6 2024-09-12T00:38:36.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.661__multipart_baz.2~pNCg2ZR4zcrwwlBlYsrEn-YFgmOYKLF.1 2024-09-12T00:38:36.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.661__multipart_baz.2~pNCg2ZR4zcrwwlBlYsrEn-YFgmOYKLF.2 2024-09-12T00:38:36.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.661__multipart_baz.2~pNCg2ZR4zcrwwlBlYsrEn-YFgmOYKLF.3 2024-09-12T00:38:36.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.661__multipart_baz.2~pNCg2ZR4zcrwwlBlYsrEn-YFgmOYKLF.4 2024-09-12T00:38:36.764 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.763+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.661__multipart_baz.2~pNCg2ZR4zcrwwlBlYsrEn-YFgmOYKLF.5 2024-09-12T00:38:36.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.768+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.661__multipart_baz.2~pNCg2ZR4zcrwwlBlYsrEn-YFgmOYKLF.6 2024-09-12T00:38:36.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.768+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1167523842499889183', time=2024-09-12T02:36:17.249417+0000, chain.objs.size()=1 2024-09-12T00:38:36.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.768+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.666__shadow_.zecT4ml_5xRoTxamdRADZoB2kZ0DeZF_0 2024-09-12T00:38:36.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.768+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14819215735478735844', time=2024-09-12T02:36:19.950858+0000, chain.objs.size()=1 2024-09-12T00:38:36.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.768+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.679__shadow_.SflmyBtm2r8pwwlK0sWtuOv77zxHiYZ_0 2024-09-12T00:38:36.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.768+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.31630811201744933', time=2024-09-12T02:36:25.074771+0000, chain.objs.size()=1 2024-09-12T00:38:36.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.768+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.701__shadow:xWG3IOuaKn8eFvtQBm4dKomgM3uM6J2_.0_aIYLBkiMWwaunDu7_Ncy5DEmi9Zz4_0 2024-09-12T00:38:36.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.768+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17422500997582766212', time=2024-09-12T02:36:28.565339+0000, chain.objs.size()=1 2024-09-12T00:38:36.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.768+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.714__shadow:HPvneOyJMVJfc9I8akh0NkbcL-quQ4B_.Ptxbd1GMxmD8-oxQM2_tqtVksAtVAeM_0 2024-09-12T00:38:36.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.768+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2648821505962368064', time=2024-09-12T02:36:49.340870+0000, chain.objs.size()=1 2024-09-12T00:38:36.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.768+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.718__shadow_.GQTx2JbajFZ8pUYYADZMSVzjAtgecih_0 2024-09-12T00:38:36.772 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.774+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:36.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.777+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:38:36.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.779+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:36.777 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.779+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:36.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49507' 2024-09-12T00:38:36.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4946821947675041031', time=2024-09-12T02:29:19.829642+0000, chain.objs.size()=1 2024-09-12T00:38:36.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.147__shadow_.feHDtSyLwWwoB_ZVImRwnyUw5kcmizG_0 2024-09-12T00:38:36.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1668737041415465666', time=2024-09-12T02:29:19.989101+0000, chain.objs.size()=1 2024-09-12T00:38:36.778 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.148__shadow_.hADNm87VYoxxjHqqHD1sPD2potGVsFu_0 2024-09-12T00:38:36.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16094853993631216303', time=2024-09-12T02:29:23.203092+0000, chain.objs.size()=1 2024-09-12T00:38:36.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.157__shadow:KltbdaAUUIpHqkdfiLFNfrmDng0LWZR_.sEKlbga2yZJCjNSFr-bB1xokdcqhz6b_0 2024-09-12T00:38:36.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10976775984455452752', time=2024-09-12T02:30:39.099840+0000, chain.objs.size()=1 2024-09-12T00:38:36.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.237__shadow_.kShVwSUFzt5Zsn9IbQFHHUUQPbDxEEd_0 2024-09-12T00:38:36.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1164914902181900460', time=2024-09-12T02:30:40.928580+0000, chain.objs.size()=1 2024-09-12T00:38:36.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.244__shadow_.uDMGE2cmdM9EKD2m2jQNxV93oXi_FRQ_0 2024-09-12T00:38:36.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1734681813162581317', time=2024-09-12T02:30:45.102095+0000, chain.objs.size()=1 2024-09-12T00:38:36.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.261__shadow_.Vvwj2ztkzuuPV48SSSdddT3qq7zFnL0_0 2024-09-12T00:38:36.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2629026074420452050', time=2024-09-12T02:30:53.120788+0000, chain.objs.size()=1 2024-09-12T00:38:36.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.yViVXWVaXsi5uOLXRwQyiMEKvPWGoER_0 2024-09-12T00:38:36.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12555957575424335316', time=2024-09-12T02:30:53.130205+0000, chain.objs.size()=1 2024-09-12T00:38:36.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.KraJYX5dhEfvlVR-Oq_8hi3PlKIrINg_0 2024-09-12T00:38:36.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5961089982982309346', time=2024-09-12T02:30:53.146162+0000, chain.objs.size()=1 2024-09-12T00:38:36.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6r7I2gqce4WhBKMN-Yh62ysszxdxB8O_0 2024-09-12T00:38:36.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14502974619033053203', time=2024-09-12T02:30:53.147780+0000, chain.objs.size()=1 2024-09-12T00:38:36.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.tNRkNevouV91WJkB2G4mer8n39EaaN__0 2024-09-12T00:38:36.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3553729313359182613', time=2024-09-12T02:30:53.210160+0000, chain.objs.size()=1 2024-09-12T00:38:36.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.jgsDfvhXM7V8YPliLYi0QppuboL0tIw_0 2024-09-12T00:38:36.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8356854274713556500', time=2024-09-12T02:30:53.258635+0000, chain.objs.size()=1 2024-09-12T00:38:36.780 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.780+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Vf2EKDClLMV3e8hSwO6r0Nr6mbBnzWZ_0 2024-09-12T00:38:36.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.784+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9806893658172906877', time=2024-09-12T02:30:53.262127+0000, chain.objs.size()=1 2024-09-12T00:38:36.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.784+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Rgc0ogDs7C_70Y1KuyrQe5rtyu2S3Zd_0 2024-09-12T00:38:36.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.784+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8482644530370816530', time=2024-09-12T02:30:53.674553+0000, chain.objs.size()=1 2024-09-12T00:38:36.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.784+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.FQ6nPw2W_IHBPvi6v54I9FwEiajTxX0_0 2024-09-12T00:38:36.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.784+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10801530361037891526', time=2024-09-12T02:30:53.770775+0000, chain.objs.size()=1 2024-09-12T00:38:36.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.784+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.SBw6dYv1erPEOI_bYkjqpkEidO-XBG__0 2024-09-12T00:38:36.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.784+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15818241647947362046', time=2024-09-12T02:30:53.776855+0000, chain.objs.size()=1 2024-09-12T00:38:36.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.784+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.EIbFMtMhOlep8eDXR5wiKl38hc1shzS_0 2024-09-12T00:38:36.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.784+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17935527439723468478', time=2024-09-12T02:30:53.834270+0000, chain.objs.size()=1 2024-09-12T00:38:36.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.784+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6iiExCtFVSWKNF6Her590Flc0BuNlIP_0 2024-09-12T00:38:36.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.785+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8626543033838992288', time=2024-09-12T02:30:53.851124+0000, chain.objs.size()=1 2024-09-12T00:38:36.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.785+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.roWXP1Q1a8JJdyX7qy8lKrTO5mgt4Eo_0 2024-09-12T00:38:36.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.785+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.215524197751511486', time=2024-09-12T02:30:53.933946+0000, chain.objs.size()=1 2024-09-12T00:38:36.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.785+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.I54d7xP8_Izch5ePDzxN0Qhgb3T9ARw_0 2024-09-12T00:38:36.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.785+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14405198455246864707', time=2024-09-12T02:30:53.964282+0000, chain.objs.size()=1 2024-09-12T00:38:36.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.785+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.oW0SuQSPtHp87wHie1IcKw-bQPLEDb1_0 2024-09-12T00:38:36.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.785+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14666199975886784928', time=2024-09-12T02:30:53.978435+0000, chain.objs.size()=1 2024-09-12T00:38:36.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.785+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.vc3Lh65dmd7iFhG_rxq3nssCuobY3lh_0 2024-09-12T00:38:36.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.785+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.488854134090263084', time=2024-09-12T02:30:54.037177+0000, chain.objs.size()=1 2024-09-12T00:38:36.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.785+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.uJm1ByDNmxCHOOnx6kdUlRhY2i_iuLm_0 2024-09-12T00:38:36.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.785+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2090605984886576888', time=2024-09-12T02:30:54.130763+0000, chain.objs.size()=1 2024-09-12T00:38:36.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.785+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.QcQhYojK15muhIMNry0OjwZykbf0Khs_0 2024-09-12T00:38:36.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.789+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4412525387578730461', time=2024-09-12T02:30:54.273429+0000, chain.objs.size()=1 2024-09-12T00:38:36.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.789+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pNNjwWs93xRNPwNv_1O_PD7h3OeuUMO_0 2024-09-12T00:38:36.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.789+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.23769074037879825', time=2024-09-12T02:30:54.312057+0000, chain.objs.size()=1 2024-09-12T00:38:36.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.789+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.rD9QQZt4rpHO9WBCxD_KlYfashKuFpw_0 2024-09-12T00:38:36.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7847718703958824454', time=2024-09-12T02:30:54.381288+0000, chain.objs.size()=1 2024-09-12T00:38:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.9oAGgJnJAnSATJuDTZA7cMn4htAFsNT_0 2024-09-12T00:38:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3679550250355414654', time=2024-09-12T02:30:54.628922+0000, chain.objs.size()=1 2024-09-12T00:38:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.MfIdFqEULOMPigb1QCRE5TQq1YfNFII_0 2024-09-12T00:38:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5441389405788325444', time=2024-09-12T02:30:54.668742+0000, chain.objs.size()=1 2024-09-12T00:38:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HEOGQpNxWgX58xX3FGHzLW7PpgjrMR8_0 2024-09-12T00:38:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1209183379885227841', time=2024-09-12T02:30:54.745079+0000, chain.objs.size()=1 2024-09-12T00:38:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.L8ayxX_GyJUIBd6a8yXnz5Tj79Vcifw_0 2024-09-12T00:38:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6622551677918484994', time=2024-09-12T02:30:54.841618+0000, chain.objs.size()=1 2024-09-12T00:38:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.l8AwtUSidJFy51semtpfgiAGNipFCNr_0 2024-09-12T00:38:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11713124593633063424', time=2024-09-12T02:30:54.898979+0000, chain.objs.size()=1 2024-09-12T00:38:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ePBpsDt7gGkJPgVVer4fJJLE_AZR2XN_0 2024-09-12T00:38:36.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6059966397150655086', time=2024-09-12T02:30:54.928094+0000, chain.objs.size()=1 2024-09-12T00:38:36.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.bVi8wi_SgxcXHT5-wnI7w-FljpvkVX0_0 2024-09-12T00:38:36.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18201394446912514304', time=2024-09-12T02:30:54.971587+0000, chain.objs.size()=1 2024-09-12T00:38:36.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.1Q3Qhl2OUDC0mIce2gKDz6BuxKN44RS_0 2024-09-12T00:38:36.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17854349227482042193', time=2024-09-12T02:30:55.109253+0000, chain.objs.size()=1 2024-09-12T00:38:36.791 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.791+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.EN0MuNx6QuQu3w2L2LGFDApjYkGEbIf_0 2024-09-12T00:38:36.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.795+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14526394868129817267', time=2024-09-12T02:30:55.119660+0000, chain.objs.size()=1 2024-09-12T00:38:36.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.795+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lgEUYbQfT0MqravE5xeCYNaUX706b2l_0 2024-09-12T00:38:36.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.795+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17741019570471513402', time=2024-09-12T02:30:55.721432+0000, chain.objs.size()=1 2024-09-12T00:38:36.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.795+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.264__shadow_.zL4gpA2Lna2svIXi-mOKQbc_zbusHlB_0 2024-09-12T00:38:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.796+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16145266274708421999', time=2024-09-12T02:30:57.414314+0000, chain.objs.size()=1 2024-09-12T00:38:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.796+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.271__shadow_.8zyoYKGiZ14VQTyXxvrzfbB9aU37duO_0 2024-09-12T00:38:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.796+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7575727944607646780', time=2024-09-12T02:30:57.877957+0000, chain.objs.size()=1 2024-09-12T00:38:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.796+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.273__shadow_.cENlW0UJTY2qO-YP6cei_E_XzA-_qXS_0 2024-09-12T00:38:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.796+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13588865893189781909', time=2024-09-12T02:30:58.346473+0000, chain.objs.size()=1 2024-09-12T00:38:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.796+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.275__shadow_.g1H9QXxktsfg2QdojN-YzIyAYiEKrD2_0 2024-09-12T00:38:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.796+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7210410101239051350', time=2024-09-12T02:30:58.586583+0000, chain.objs.size()=1 2024-09-12T00:38:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.796+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.276__shadow_.fFmDJScwaXYpJ6wnjVbuUweHwOflXdp_0 2024-09-12T00:38:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.796+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5955455135068341996', time=2024-09-12T02:30:59.105826+0000, chain.objs.size()=1 2024-09-12T00:38:36.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.796+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.278__shadow_.sNbnkr9S_jGtc2ZpKw1INYK0BFykV23_0 2024-09-12T00:38:36.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.798+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15035362923111696242', time=2024-09-12T02:31:01.391712+0000, chain.objs.size()=1 2024-09-12T00:38:36.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.798+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.287__shadow_.BbUM61qN586px4cf0oYvuFwt6xz5aYA_0 2024-09-12T00:38:36.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.798+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14415547326503024378', time=2024-09-12T02:31:01.392531+0000, chain.objs.size()=1 2024-09-12T00:38:36.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.798+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.287__shadow_.kx6eDrQZTcRDNjEhAWTylFvMull2Fhe_0 2024-09-12T00:38:36.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.798+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13004757327785456787', time=2024-09-12T02:31:03.053440+0000, chain.objs.size()=1 2024-09-12T00:38:36.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.798+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.lx9cCSnrDNbhhsjCgflb7aVRkZXI8M1_0 2024-09-12T00:38:36.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.798+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4526113472646289625', time=2024-09-12T02:31:03.651271+0000, chain.objs.size()=1 2024-09-12T00:38:36.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.798+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.cRImwBUO9qexCpnSocFU87let8fE96__0 2024-09-12T00:38:36.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.801+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18014218820670180879', time=2024-09-12T02:31:03.659651+0000, chain.objs.size()=1 2024-09-12T00:38:36.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.801+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.JiccLOMUmCqa_5_uTpwCI_N8XFWT0F3_0 2024-09-12T00:38:36.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.801+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2009961860302829415', time=2024-09-12T02:31:03.660713+0000, chain.objs.size()=1 2024-09-12T00:38:36.799 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.801+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.ObuIZV43ih1-mP5mpmghFjy6yHXMec5_0 2024-09-12T00:38:36.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.803+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7408967417605477490', time=2024-09-12T02:31:04.407908+0000, chain.objs.size()=1 2024-09-12T00:38:36.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.803+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.296__shadow_.4Rh6fP8WYhXgkOBkuNbO66qJnFtPY9b_0 2024-09-12T00:38:36.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.803+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2586617826034627695', time=2024-09-12T02:31:19.481777+0000, chain.objs.size()=1 2024-09-12T00:38:36.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.803+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JtjCvZtJaLop6-kMLNsnqLalFEZR4Ef_0 2024-09-12T00:38:36.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.803+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.388125019741002536', time=2024-09-12T02:31:19.653994+0000, chain.objs.size()=1 2024-09-12T00:38:36.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.803+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.DOxlE_Dgjjwl9NRgZ_d8T9sM2axHfFO_0 2024-09-12T00:38:36.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.803+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15125918000659194014', time=2024-09-12T02:31:19.833839+0000, chain.objs.size()=1 2024-09-12T00:38:36.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.803+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JxIim8MH694KpmVAh4ZoU3xJ8Euxtxh_0 2024-09-12T00:38:36.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.803+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10513156621379831912', time=2024-09-12T02:31:19.843618+0000, chain.objs.size()=1 2024-09-12T00:38:36.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.803+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.86ScPEnQq_p8n55GUIc8JHGm-i4BQEH_0 2024-09-12T00:38:36.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.803+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2550454822501580016', time=2024-09-12T02:31:20.033933+0000, chain.objs.size()=1 2024-09-12T00:38:36.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.803+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.TjlbGYwx1_t7Q-6xYxR3QOeyDvquWNu_0 2024-09-12T00:38:36.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.803+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17113006580230655271', time=2024-09-12T02:31:20.147627+0000, chain.objs.size()=1 2024-09-12T00:38:36.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.803+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.arJF3sF0-MCAlttV-1_XsVJ4ClXq1We_0 2024-09-12T00:38:36.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.804+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2562425262759899011', time=2024-09-12T02:31:20.150662+0000, chain.objs.size()=1 2024-09-12T00:38:36.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.804+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IznBOmeB8TGtWgzV5_FEd4nDwE0z4OE_0 2024-09-12T00:38:36.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.804+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2726509222507297349', time=2024-09-12T02:31:20.174016+0000, chain.objs.size()=1 2024-09-12T00:38:36.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.804+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.TkKjQd2DX5LTcMUQhQ0dFr41hoLxfDt_0 2024-09-12T00:38:36.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.806+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10988892628692112440', time=2024-09-12T02:31:20.268502+0000, chain.objs.size()=1 2024-09-12T00:38:36.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.806+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.75oSG4PFr6z1SrAhOAbL5qqeuZAVXUN_0 2024-09-12T00:38:36.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.806+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11404290839762865180', time=2024-09-12T02:31:20.269609+0000, chain.objs.size()=1 2024-09-12T00:38:36.804 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.806+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.FPXTgm0aCcT8bf1nGBSF08BnO36kO3U_0 2024-09-12T00:38:36.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.807+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6238625846203540306', time=2024-09-12T02:31:20.321880+0000, chain.objs.size()=1 2024-09-12T00:38:36.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.807+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NetTK61ZADC3WI3Y3Tq-Weax8ytGQPl_0 2024-09-12T00:38:36.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.807+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6409380427693462366', time=2024-09-12T02:31:20.365957+0000, chain.objs.size()=1 2024-09-12T00:38:36.805 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.807+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Qno3_yKlCXRZj6WhaAd8BHm7A3PxRNp_0 2024-09-12T00:38:36.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.808+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16504020145501973787', time=2024-09-12T02:31:20.469963+0000, chain.objs.size()=1 2024-09-12T00:38:36.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.808+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.RtWROPC0QY2TakKcYy6hapMK1OqO7JQ_0 2024-09-12T00:38:36.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.808+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16718773324018293812', time=2024-09-12T02:31:20.472794+0000, chain.objs.size()=1 2024-09-12T00:38:36.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.808+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.CgNMJ2vGmZT5ujY5VIcIcWS1Hs-luIC_0 2024-09-12T00:38:36.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.808+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10339280547048751389', time=2024-09-12T02:31:20.728836+0000, chain.objs.size()=1 2024-09-12T00:38:36.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.808+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.gJ_06bnCihcnp40s4krGCcWyhykEXRO_0 2024-09-12T00:38:36.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.809+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7313078129322446456', time=2024-09-12T02:31:20.763339+0000, chain.objs.size()=1 2024-09-12T00:38:36.807 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.809+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.X4Ctx_Eq4fwr95jDzKnmbhKivvvaBVT_0 2024-09-12T00:38:36.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.809+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15347779482985397303', time=2024-09-12T02:31:20.886047+0000, chain.objs.size()=1 2024-09-12T00:38:36.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.809+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.RkfvpxBV0qwnDzoeh-2hADJOlcJbcsn_0 2024-09-12T00:38:36.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.809+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13609721180630334237', time=2024-09-12T02:31:20.893702+0000, chain.objs.size()=1 2024-09-12T00:38:36.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.809+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.1g2xGBQF7OutJH1oBzWYaU_DFBsvVq9_0 2024-09-12T00:38:36.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.809+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12911162948681638221', time=2024-09-12T02:31:20.922117+0000, chain.objs.size()=1 2024-09-12T00:38:36.808 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.809+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.vu51-ENBYoTpC3qyajF6PdZs4A7TUzN_0 2024-09-12T00:38:36.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.811+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12305825952600515238', time=2024-09-12T02:31:20.956659+0000, chain.objs.size()=1 2024-09-12T00:38:36.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.811+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.uVK0xDM_z6HccTkiYAtORmY0dYhI1QZ_0 2024-09-12T00:38:36.809 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.811+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1196388602250487107', time=2024-09-12T02:31:21.011559+0000, chain.objs.size()=1 2024-09-12T00:38:36.810 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.811+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.q3F67zo5nQdFvLd_LbX5FGqHCJwttUX_0 2024-09-12T00:38:36.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.813+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12939793886435396246', time=2024-09-12T02:31:21.015438+0000, chain.objs.size()=1 2024-09-12T00:38:36.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.813+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.SYqyeI-95KhIwmj9VDuda9GNLPyDJmk_0 2024-09-12T00:38:36.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.813+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13798381103350870320', time=2024-09-12T02:31:21.173196+0000, chain.objs.size()=1 2024-09-12T00:38:36.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.813+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.XzcQX2m6FwV9kw5-7meD0RnGZCkNzji_0 2024-09-12T00:38:36.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.813+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4196477588414235356', time=2024-09-12T02:31:21.240645+0000, chain.objs.size()=1 2024-09-12T00:38:36.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.813+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.-BYP71NqoJpX2VBL3DeG0RUtZDid2Kp_0 2024-09-12T00:38:36.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15270670101197480442', time=2024-09-12T02:31:21.263423+0000, chain.objs.size()=1 2024-09-12T00:38:36.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.2CGltQ8D-jtYmZIeEQwJqrmgC_FTR4b_0 2024-09-12T00:38:36.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3815268443557524566', time=2024-09-12T02:31:21.266976+0000, chain.objs.size()=1 2024-09-12T00:38:36.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JGQTGjI25kpOHNwRYrAhNp7Rr5Xaqfe_0 2024-09-12T00:38:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9885855117366607176', time=2024-09-12T02:31:21.269582+0000, chain.objs.size()=1 2024-09-12T00:38:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.XjUCTQeCFq1es4XK0Z4c82PXyBonODW_0 2024-09-12T00:38:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16097488564367128387', time=2024-09-12T02:31:21.324368+0000, chain.objs.size()=1 2024-09-12T00:38:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.83N6qHsxRn_ZZudEBtnSKrRSI057PTz_0 2024-09-12T00:38:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10045371517597725505', time=2024-09-12T02:31:21.337844+0000, chain.objs.size()=1 2024-09-12T00:38:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.kI_j6nrKNqCzqWeEOW_kTr8VYCR-TvT_0 2024-09-12T00:38:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8857225505273958502', time=2024-09-12T02:31:21.350568+0000, chain.objs.size()=1 2024-09-12T00:38:36.814 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ym0p92V292LEydrhXbdfG_PoqzPOEm5_0 2024-09-12T00:38:36.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15045984735232947660', time=2024-09-12T02:31:21.355635+0000, chain.objs.size()=1 2024-09-12T00:38:36.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.MTwfSm3lO0mBVDgAAkDj3l9KuHoxWtf_0 2024-09-12T00:38:36.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14754502437128958002', time=2024-09-12T02:31:21.525917+0000, chain.objs.size()=1 2024-09-12T00:38:36.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.815+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.6RTL9g9BzjluRWjMSgiWypIuC0W5yA__0 2024-09-12T00:38:36.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.819+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10694562611842248636', time=2024-09-12T02:31:21.542678+0000, chain.objs.size()=1 2024-09-12T00:38:36.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.819+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.mzsr9cdj6cJf3o8nk7a7QELxHVyJrZG_0 2024-09-12T00:38:36.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.819+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16607971818358711884', time=2024-09-12T02:31:21.543514+0000, chain.objs.size()=1 2024-09-12T00:38:36.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.819+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NXk_qV16_-SXVGQ3QVDXW1-v9QnBEnX_0 2024-09-12T00:38:36.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.819+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9495906781693388231', time=2024-09-12T02:31:21.554851+0000, chain.objs.size()=1 2024-09-12T00:38:36.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.819+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.jwxB83qesQQNBBL6Rjyg-GtVA1A22UB_0 2024-09-12T00:38:36.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.819+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10241664833758942400', time=2024-09-12T02:31:21.611305+0000, chain.objs.size()=1 2024-09-12T00:38:36.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.819+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.kjGRJI9n7eOBk50ZHd4SYwn1WWoyr0X_0 2024-09-12T00:38:36.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.819+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15077134512775671534', time=2024-09-12T02:31:21.633678+0000, chain.objs.size()=1 2024-09-12T00:38:36.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.819+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Mlp3kc2MPkVJRQ1RVDyKMgFGyzGxvZ2_0 2024-09-12T00:38:36.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.820+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12802682699884360230', time=2024-09-12T02:31:29.689612+0000, chain.objs.size()=1 2024-09-12T00:38:36.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.820+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Xj4D1NcsKskVz7DLTt9OWM4CZnVB6tT_0 2024-09-12T00:38:36.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.822+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5950990043536193688', time=2024-09-12T02:31:29.756602+0000, chain.objs.size()=1 2024-09-12T00:38:36.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.822+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.2UIoek5KB27KQmozRlOE8gn1ov3Kqpv_0 2024-09-12T00:38:36.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.822+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14536862783926088540', time=2024-09-12T02:31:29.788321+0000, chain.objs.size()=1 2024-09-12T00:38:36.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.822+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.WY3VpPEmbqnxqNKrntLgRK0DZ_nAnye_0 2024-09-12T00:38:36.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.822+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6775750904916653865', time=2024-09-12T02:31:29.801417+0000, chain.objs.size()=1 2024-09-12T00:38:36.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.822+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.nwyKSuPRmb9sgYyXjCRNESGajbi_A_d_0 2024-09-12T00:38:36.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.822+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9237715239626397940', time=2024-09-12T02:31:29.832787+0000, chain.objs.size()=1 2024-09-12T00:38:36.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.822+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.MjRLykIaeHXdk8J3OoMHATOLDL-FhHy_0 2024-09-12T00:38:36.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.822+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3045672279609527528', time=2024-09-12T02:31:30.011120+0000, chain.objs.size()=1 2024-09-12T00:38:36.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.822+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.jdXElULFaEwPXG5vrXNcZeS_AxQ56ve_0 2024-09-12T00:38:36.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.823+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8690774209747036206', time=2024-09-12T02:31:30.030580+0000, chain.objs.size()=1 2024-09-12T00:38:36.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.823+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.gimCogH_sZmVQrxxJCgMN30helrqeuu_0 2024-09-12T00:38:36.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.823+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9045657301168856042', time=2024-09-12T02:31:30.036549+0000, chain.objs.size()=1 2024-09-12T00:38:36.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.823+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NR3hKxhRPu-47GoU9kxsRky-VoL13YS_0 2024-09-12T00:38:36.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.825+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15585879285692933934', time=2024-09-12T02:31:30.084607+0000, chain.objs.size()=1 2024-09-12T00:38:36.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.825+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.r9EqmHwpDv474tdfxRESvWBHOtwmspf_0 2024-09-12T00:38:36.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.825+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6447516945487926533', time=2024-09-12T02:31:30.283378+0000, chain.objs.size()=1 2024-09-12T00:38:36.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.825+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.5QEtupGOPXNbXlUQ4eRAqVC_STqjFZo_0 2024-09-12T00:38:36.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.825+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17148604791144530338', time=2024-09-12T02:31:30.326720+0000, chain.objs.size()=1 2024-09-12T00:38:36.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.825+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.eU6R5OqMBQpeAwnsYGTPbiT9gkyddIN_0 2024-09-12T00:38:36.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.825+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3948984481284659523', time=2024-09-12T02:31:30.435647+0000, chain.objs.size()=1 2024-09-12T00:38:36.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.825+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lXwb1pjKC01gLrPa-N97Ssoz3RxfB4c_0 2024-09-12T00:38:36.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.825+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2367794167784433536', time=2024-09-12T02:31:30.451970+0000, chain.objs.size()=1 2024-09-12T00:38:36.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.825+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.YPSe23-WbS0AWwpqWqItck7TkGAWijr_0 2024-09-12T00:38:36.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.825+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5825017344830414978', time=2024-09-12T02:31:30.464491+0000, chain.objs.size()=1 2024-09-12T00:38:36.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.825+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ZyZZoTfsJxOhplz_sk1SCHQ7HhQKhov_0 2024-09-12T00:38:36.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.826+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17256014863155994897', time=2024-09-12T02:31:30.486670+0000, chain.objs.size()=1 2024-09-12T00:38:36.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.826+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.5YPZB6RRZYcrDMx2NL0OV7L-VZZnlRB_0 2024-09-12T00:38:36.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.830+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/49507 2024-09-12T00:38:36.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-12T00:38:36.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7225435040914380214', time=2024-09-12T02:31:30.605323+0000, chain.objs.size()=1 2024-09-12T00:38:36.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.xk7fiJH1rJN1a5YeizrsBNQwHXvFbtK_0 2024-09-12T00:38:36.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2680920957597986181', time=2024-09-12T02:31:30.676081+0000, chain.objs.size()=1 2024-09-12T00:38:36.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.p2YgC79z6oKcSuCFG6IIhtZAnXi9Xmm_0 2024-09-12T00:38:36.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12028901725425854985', time=2024-09-12T02:31:30.712498+0000, chain.objs.size()=1 2024-09-12T00:38:36.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.eAFkoGCukpaHdIfenKLuCEKVCT1vgyb_0 2024-09-12T00:38:36.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3144172114540902935', time=2024-09-12T02:31:30.723681+0000, chain.objs.size()=1 2024-09-12T00:38:36.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.TrV3FOdCJpGH6eWWoFNGOFy8Xs2lIc9_0 2024-09-12T00:38:36.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2014656955576012188', time=2024-09-12T02:31:30.874221+0000, chain.objs.size()=1 2024-09-12T00:38:36.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-OPzsAMiMp_8ilvLwRQ-oYlLo3hqMAg_0 2024-09-12T00:38:36.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11724774579578768047', time=2024-09-12T02:31:30.931442+0000, chain.objs.size()=1 2024-09-12T00:38:36.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mc4yv1IAmeeB4OAJBlIK4oHtP8QLjpx_0 2024-09-12T00:38:36.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5148735044887047028', time=2024-09-12T02:31:31.037690+0000, chain.objs.size()=1 2024-09-12T00:38:36.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.VXRd2qntXxv5GkE9oTtab4G6ZO5btCO_0 2024-09-12T00:38:36.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6704434358356064270', time=2024-09-12T02:31:31.133773+0000, chain.objs.size()=1 2024-09-12T00:38:36.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.G6seFsoIKeNmpHz5Ff4jdxYRWsj7j5K_0 2024-09-12T00:38:36.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11430067240456793978', time=2024-09-12T02:31:31.158061+0000, chain.objs.size()=1 2024-09-12T00:38:36.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.gDnQFZL_49wH0A5_eqPD6zVT_NKkHqe_0 2024-09-12T00:38:36.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13349509439789579691', time=2024-09-12T02:31:31.220980+0000, chain.objs.size()=1 2024-09-12T00:38:36.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Ha5ZI7iEdhxP1bHPQdWR3YWHdaTEciz_0 2024-09-12T00:38:36.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12824988922383561055', time=2024-09-12T02:31:31.231936+0000, chain.objs.size()=1 2024-09-12T00:38:36.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.E2W_Nr17u8aApwHYztEoQFIEjMf20np_0 2024-09-12T00:38:36.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9337013515226249165', time=2024-09-12T02:31:31.290841+0000, chain.objs.size()=1 2024-09-12T00:38:36.834 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ublCMJEKpSK9-tbGvI_3Di_lRw3B_kl_0 2024-09-12T00:38:36.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.837+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14098075361582618945', time=2024-09-12T02:31:31.295621+0000, chain.objs.size()=1 2024-09-12T00:38:36.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.837+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.BR-ZFGehLy0XbYbDlPRMUIS1ntcI1db_0 2024-09-12T00:38:36.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.837+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3630792218942278842', time=2024-09-12T02:31:31.297756+0000, chain.objs.size()=1 2024-09-12T00:38:36.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.837+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.rSz_wEwhbvqzVi0eGoklwmcNpg9zfCd_0 2024-09-12T00:38:36.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.837+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8950411917274185687', time=2024-09-12T02:31:31.667830+0000, chain.objs.size()=1 2024-09-12T00:38:36.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.837+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.th4dPbdIlSKJnPADPGKeK_fveARAvH4_0 2024-09-12T00:38:36.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.837+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10946796543119653424', time=2024-09-12T02:31:31.797015+0000, chain.objs.size()=1 2024-09-12T00:38:36.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.837+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.6NFtaUnDfy4127BrcorNZsiTacVuQJ5_0 2024-09-12T00:38:36.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.839+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4768872410731940351', time=2024-09-12T02:32:15.062558+0000, chain.objs.size()=1 2024-09-12T00:38:36.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.839+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.491__shadow_.3H-rR6-EFJe4-pCTrFFbTIvnuSs4Mha_0 2024-09-12T00:38:36.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.839+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14407189452309485874', time=2024-09-12T02:32:16.105557+0000, chain.objs.size()=1 2024-09-12T00:38:36.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.839+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.496__shadow_.Bx8qCB5vrP4GbQ7gkpYnuifvwxjV5ZI_0 2024-09-12T00:38:36.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.839+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4724674248635945549', time=2024-09-12T02:32:19.833135+0000, chain.objs.size()=6 2024-09-12T00:38:36.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.839+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.1 2024-09-12T00:38:36.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.839+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.2 2024-09-12T00:38:36.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.839+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.3 2024-09-12T00:38:36.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.839+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.4 2024-09-12T00:38:36.838 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.839+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.5 2024-09-12T00:38:36.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.843+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.6 2024-09-12T00:38:36.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.843+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.39862977161266176', time=2024-09-12T02:32:29.506332+0000, chain.objs.size()=6 2024-09-12T00:38:36.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.843+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~1q0YdrNubf5jv45B7y-3ScDj3i0glzg.1 2024-09-12T00:38:36.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.843+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~1q0YdrNubf5jv45B7y-3ScDj3i0glzg.2 2024-09-12T00:38:36.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.843+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.8EyGBQEr2tC_L8JCsb-L--w62ZEKf87j.3 2024-09-12T00:38:36.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.845+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~1q0YdrNubf5jv45B7y-3ScDj3i0glzg.4 2024-09-12T00:38:36.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.845+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~1q0YdrNubf5jv45B7y-3ScDj3i0glzg.5 2024-09-12T00:38:36.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.845+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~1q0YdrNubf5jv45B7y-3ScDj3i0glzg.6 2024-09-12T00:38:36.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.845+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8580995824843341574', time=2024-09-12T02:33:07.702445+0000, chain.objs.size()=1 2024-09-12T00:38:36.843 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.845+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.556__shadow_.cNN2fRgamfR106hdF3o5rpghqbFpc0V_0 2024-09-12T00:38:36.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.847+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14554102567521257479', time=2024-09-12T02:33:15.360887+0000, chain.objs.size()=1 2024-09-12T00:38:36.845 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.847+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.565__shadow_.8g3Ky2y4nbvR0Mv2ry8-51YdrjEpBPQ_0 2024-09-12T00:38:36.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.848+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14139350859314413548', time=2024-09-12T02:33:21.928347+0000, chain.objs.size()=1 2024-09-12T00:38:36.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.848+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:OM.KuNNz.C0O8ovViW8ednDFfzcCQUu_.WbRGCYUAdkFyooXrIkgybwg3taX-ZLw_0 2024-09-12T00:38:36.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.849+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13404198895371777124', time=2024-09-12T02:33:22.163615+0000, chain.objs.size()=1 2024-09-12T00:38:36.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.849+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:ivACVQD.IIQVruMH8sYh6CZphyMAFSV_.pX8YHXfSY7AkBovSwEFE3YeaOWJAXwm_0 2024-09-12T00:38:36.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.850+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6219265985736021729', time=2024-09-12T02:33:22.965883+0000, chain.objs.size()=1 2024-09-12T00:38:36.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.850+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.570__shadow:-Wii3lptWteVwbzXTBIctZl4vJI3xhG_.3jgCIS7oGIpAFbjGvFwk4E-Z77CSMIu_0 2024-09-12T00:38:36.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.850+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16622076929902459105', time=2024-09-12T02:33:23.574368+0000, chain.objs.size()=1 2024-09-12T00:38:36.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.850+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.572__shadow:6K5KyCglAzard-rQrwfBYaHCMPSA7f0_.9tcY9eSISn4D3uunfyx0kgWQBLw1Igk_0 2024-09-12T00:38:36.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.850+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6987723270063712959', time=2024-09-12T02:33:24.110514+0000, chain.objs.size()=1 2024-09-12T00:38:36.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.850+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.573__shadow_.8ISlDefw5f7qu8InISFj0xMtc1amRP6_0 2024-09-12T00:38:36.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.850+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9575248344172285430', time=2024-09-12T02:33:24.765020+0000, chain.objs.size()=1 2024-09-12T00:38:36.849 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.850+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.574__shadow:K2tL0e5CrYPhfnefqwabzpZ0df6ZhSz_.UzwZVPDDdjxRJsstLgEGGaaUJr-YCRr_0 2024-09-12T00:38:36.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.851+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7953874298548098668', time=2024-09-12T02:33:36.099123+0000, chain.objs.size()=1 2024-09-12T00:38:36.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.851+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:ysYdTjF9FgORRIQawdDFJiwnqegVgom_.Fu-S_X4j4oIun_3RU3n1oYw3p63mEEy_0 2024-09-12T00:38:36.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.851+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16487065691702026758', time=2024-09-12T02:33:36.809474+0000, chain.objs.size()=1 2024-09-12T00:38:36.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.851+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:DXkamY3WcHlv0msmce5FwEe7ij.S5wB_.oFH8avUzXRKrrtd8Mj__6nHlYitnXR6_0 2024-09-12T00:38:36.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.851+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11244264210604084063', time=2024-09-12T02:33:45.820428+0000, chain.objs.size()=1 2024-09-12T00:38:36.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.851+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.579__shadow:rsqypgwZ1OgaDC51XAiP5oMA-exJFpi_.LCz00PaAjFe5Qw4RtDtVOwQf89Wre8f_0 2024-09-12T00:38:36.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.851+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5408780446785196747', time=2024-09-12T02:33:46.845893+0000, chain.objs.size()=1 2024-09-12T00:38:36.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.851+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.580__shadow:DJxLvk8A0Zn.aFUc13TGW-E5szu48Ng_.THsIllK1Y10ISbWJNjN56vDHgAHL5BK_0 2024-09-12T00:38:36.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.851+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12460452498594867771', time=2024-09-12T02:36:24.592923+0000, chain.objs.size()=1 2024-09-12T00:38:36.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.851+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.699__shadow:kVhH5vWz1G.-Mv-h-maIXl2qaY2wPpI_.WIIwVRbVTO16CFOq5QKm_lPE46RoL8z_0 2024-09-12T00:38:36.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.853+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~AjdC7DTM54reIy3urhxIZPhtfjt4poD', time=2024-09-12T02:36:56.086665+0000, chain.objs.size()=1 2024-09-12T00:38:36.852 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.853+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.742__multipart_mymultipart.2~AjdC7DTM54reIy3urhxIZPhtfjt4poD.1 2024-09-12T00:38:36.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.857+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:36.858 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.860+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:38:36.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.861+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:36.860 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.861+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:36.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.862+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54416' 2024-09-12T00:38:36.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.862+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13242338678786096093', time=2024-09-12T02:29:23.735958+0000, chain.objs.size()=2 2024-09-12T00:38:36.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.862+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.158__shadow_.Lsx3Ufc6X-ZHG75ap3cK0KylTYNpjdw_0 2024-09-12T00:38:36.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.862+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.158__shadow_.Lsx3Ufc6X-ZHG75ap3cK0KylTYNpjdw_1 2024-09-12T00:38:36.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.862+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1820716393666243381', time=2024-09-12T02:30:37.523352+0000, chain.objs.size()=1 2024-09-12T00:38:36.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.862+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.231__shadow_.7rfh89JXR8NM56TysCTnbHUp49N-bPT_0 2024-09-12T00:38:36.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.862+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7248650132850367829', time=2024-09-12T02:30:38.283637+0000, chain.objs.size()=1 2024-09-12T00:38:36.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.234__shadow_.W9eZX0Iez5IgqTpjBSzeS10wo6kF_El_0 2024-09-12T00:38:36.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13153437442877565329', time=2024-09-12T02:30:41.172304+0000, chain.objs.size()=1 2024-09-12T00:38:36.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.245__shadow_.1cTqJ7qLTMbQic9FXWpGZNNqo9yZsTw_0 2024-09-12T00:38:36.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18299939924818517773', time=2024-09-12T02:30:44.587551+0000, chain.objs.size()=1 2024-09-12T00:38:36.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.259__shadow_.8iu2j52y8CcARTCPJHItqRjUbiYw9GW_0 2024-09-12T00:38:36.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15603390687292915572', time=2024-09-12T02:30:53.145036+0000, chain.objs.size()=1 2024-09-12T00:38:36.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.yJGYi1ja1TChjvvYHebSCk3zdAyF1hB_0 2024-09-12T00:38:36.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.680450400752868170', time=2024-09-12T02:30:53.227108+0000, chain.objs.size()=1 2024-09-12T00:38:36.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.N5hkndBK7zCaQ8Jqw5lkuruh6zhW3KZ_0 2024-09-12T00:38:36.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16722062901719908585', time=2024-09-12T02:30:53.234289+0000, chain.objs.size()=1 2024-09-12T00:38:36.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AJeMgyRx1sV3e-jwjbl1qQKvHch3kQf_0 2024-09-12T00:38:36.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12814433229653773860', time=2024-09-12T02:30:53.282821+0000, chain.objs.size()=1 2024-09-12T00:38:36.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.9LC7RRPZRukcz55-6sdW5L0jW-fSWN8_0 2024-09-12T00:38:36.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10951319481871520999', time=2024-09-12T02:30:53.295528+0000, chain.objs.size()=1 2024-09-12T00:38:36.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ILK5tmvEN3lFEfF3idnTUfG4M7zt4At_0 2024-09-12T00:38:36.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5600889115645939863', time=2024-09-12T02:30:53.448763+0000, chain.objs.size()=1 2024-09-12T00:38:36.863 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.863+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.OoZWkVMYDgkyyUt6ENyBEW0qqGwuTPF_0 2024-09-12T00:38:36.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.866+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16205582501455399855', time=2024-09-12T02:30:53.459544+0000, chain.objs.size()=1 2024-09-12T00:38:36.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.866+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.16PtAnHkciv_er0lYdC6j6OlrQ3e17t_0 2024-09-12T00:38:36.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.867+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2558094493086084947', time=2024-09-12T02:30:53.574030+0000, chain.objs.size()=1 2024-09-12T00:38:36.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.867+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.RaLe9Dy4kcNDmbhPUKnv2N-ACC8yo0j_0 2024-09-12T00:38:36.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.867+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16249508448541456024', time=2024-09-12T02:30:53.577178+0000, chain.objs.size()=1 2024-09-12T00:38:36.865 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.867+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.crfggT7osCjOYwVoqv5F-u2ro1zNWdx_0 2024-09-12T00:38:36.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7968512499161814056', time=2024-09-12T02:30:53.701596+0000, chain.objs.size()=1 2024-09-12T00:38:36.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.iueVuDyTM2XNSRIr5I90ZcWUTs4yQO1_0 2024-09-12T00:38:36.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3801672895216299703', time=2024-09-12T02:30:53.752900+0000, chain.objs.size()=1 2024-09-12T00:38:36.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ISBGykJ7gsv9oi7NfBPA-EZS2Wg-sMV_0 2024-09-12T00:38:36.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7279775175482874049', time=2024-09-12T02:30:53.755345+0000, chain.objs.size()=1 2024-09-12T00:38:36.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.m8Og1uW9JZGAw6nPh_2OYkgYKPePFnn_0 2024-09-12T00:38:36.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7350008776219956674', time=2024-09-12T02:30:53.802792+0000, chain.objs.size()=1 2024-09-12T00:38:36.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.w-REmcR9BREW5NmB1Vwwlp17ay5DHuW_0 2024-09-12T00:38:36.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9328298299104798302', time=2024-09-12T02:30:54.003692+0000, chain.objs.size()=1 2024-09-12T00:38:36.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.m6F7NFVkwTMNlsRwh2GgAhDvmDUntyo_0 2024-09-12T00:38:36.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14559761673600358723', time=2024-09-12T02:30:54.065563+0000, chain.objs.size()=1 2024-09-12T00:38:36.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.clno999Eza2XXx6oq73YavpIoO-uXA5_0 2024-09-12T00:38:36.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16153220831136866673', time=2024-09-12T02:30:54.152414+0000, chain.objs.size()=1 2024-09-12T00:38:36.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.8a6B6v-8dSx6Plf2wpVsyO3JK-cy2dk_0 2024-09-12T00:38:36.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16651979162154454918', time=2024-09-12T02:30:54.265080+0000, chain.objs.size()=1 2024-09-12T00:38:36.868 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.868+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.zvMFAqMLqTC-ux7JmLzzElFvDaPh1QA_0 2024-09-12T00:38:36.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.872+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1833859835179565901', time=2024-09-12T02:30:54.598318+0000, chain.objs.size()=1 2024-09-12T00:38:36.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.872+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.PpNnsIAXXBDsW5J86yMmCLjZPice4jn_0 2024-09-12T00:38:36.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.872+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8382490089290312847', time=2024-09-12T02:30:54.604802+0000, chain.objs.size()=1 2024-09-12T00:38:36.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.872+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.3MWuDJYhbLCUyDSs11IW7viACJAsY28_0 2024-09-12T00:38:36.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.873+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9455441989005139723', time=2024-09-12T02:30:54.643991+0000, chain.objs.size()=1 2024-09-12T00:38:36.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.873+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.TJw1mEfJOMcqoh7U7QS48MxLZLi6pcq_0 2024-09-12T00:38:36.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.873+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8221492920924236139', time=2024-09-12T02:30:54.648594+0000, chain.objs.size()=1 2024-09-12T00:38:36.871 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.873+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.OHecka6Ejjc8gmB7a51g0cChgHkm09x_0 2024-09-12T00:38:36.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.875+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5540311836596378068', time=2024-09-12T02:30:54.717499+0000, chain.objs.size()=1 2024-09-12T00:38:36.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.875+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_._BX8VBVACbFZt49dA4roUXv2bvfmakM_0 2024-09-12T00:38:36.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.875+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13706226711348407663', time=2024-09-12T02:30:54.742043+0000, chain.objs.size()=1 2024-09-12T00:38:36.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.875+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Z8tHMzkNBlW_wPRHS0Lwedv5Z9l8HRA_0 2024-09-12T00:38:36.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.875+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12400062090739741936', time=2024-09-12T02:30:54.839322+0000, chain.objs.size()=1 2024-09-12T00:38:36.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.875+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.jqIy9tpNkBVEWlk5wfELXhIUTLywhC-_0 2024-09-12T00:38:36.873 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.875+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2966074644881596897', time=2024-09-12T02:30:54.858767+0000, chain.objs.size()=1 2024-09-12T00:38:36.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.875+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YeWdXNy_8LaJmN2iqBr7bTcAtesV0y9_0 2024-09-12T00:38:36.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.875+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8874328117277675260', time=2024-09-12T02:30:54.932751+0000, chain.objs.size()=1 2024-09-12T00:38:36.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.875+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.qkZVu6ayPFT2yyek--BeCsZAuliJ-42_0 2024-09-12T00:38:36.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.875+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5536180793054711622', time=2024-09-12T02:30:54.964800+0000, chain.objs.size()=1 2024-09-12T00:38:36.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.875+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.72o-8-EkLZDv1HBFMXU68tlXSjBydXR_0 2024-09-12T00:38:36.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.875+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7297339257416468230', time=2024-09-12T02:30:55.000505+0000, chain.objs.size()=1 2024-09-12T00:38:36.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.875+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.b58k0IYr6HSYeMif9fdf3boxd37mrge_0 2024-09-12T00:38:36.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.876+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17125114958738071362', time=2024-09-12T02:30:55.007043+0000, chain.objs.size()=1 2024-09-12T00:38:36.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.876+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Y5-IX0WB9WKUi0xZ5mqx0nKEK9-nKlu_0 2024-09-12T00:38:36.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.876+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1684816749560857687', time=2024-09-12T02:30:55.138319+0000, chain.objs.size()=1 2024-09-12T00:38:36.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.876+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.S2u36_LVIbW7OoJ867w3Q7bQNzL4EoD_0 2024-09-12T00:38:36.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.877+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5752198005370237842', time=2024-09-12T02:30:55.186671+0000, chain.objs.size()=1 2024-09-12T00:38:36.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.877+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.mejqNDj6uHn4L1q6sklEQlt2xIltfs6_0 2024-09-12T00:38:36.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.877+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4960445765712229186', time=2024-09-12T02:30:55.217225+0000, chain.objs.size()=1 2024-09-12T00:38:36.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.877+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Z6d4kWkt2o2WLYIZqU4HmJ5grsIgUzn_0 2024-09-12T00:38:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7121301998759383549', time=2024-09-12T02:30:55.230716+0000, chain.objs.size()=1 2024-09-12T00:38:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.X-TOL5O37V1-KzHGo323hD7UbE8RdPP_0 2024-09-12T00:38:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15826738175507665301', time=2024-09-12T02:31:03.680250+0000, chain.objs.size()=1 2024-09-12T00:38:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.pbtF0BDINjaDysuo5LC-DPIleXrnEkz_0 2024-09-12T00:38:36.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15991319449115002085', time=2024-09-12T02:31:19.346050+0000, chain.objs.size()=1 2024-09-12T00:38:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.egRDkxAOJPJUI0y77kCrr63KBl-eLmL_0 2024-09-12T00:38:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15976363439909213615', time=2024-09-12T02:31:19.346763+0000, chain.objs.size()=1 2024-09-12T00:38:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.z-3uWA2G_tNCMzKaEuGL7MxAsBlSaAd_0 2024-09-12T00:38:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9345687696909027298', time=2024-09-12T02:31:19.355229+0000, chain.objs.size()=1 2024-09-12T00:38:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.8Ft8x6cWPs_3py3i3i9uVpfHS7pDpRG_0 2024-09-12T00:38:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1102593406084307605', time=2024-09-12T02:31:19.357901+0000, chain.objs.size()=1 2024-09-12T00:38:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.VdzirCVCm5GpCbbAM0ouQCp3JvEkFKl_0 2024-09-12T00:38:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7867903144470332765', time=2024-09-12T02:31:19.658051+0000, chain.objs.size()=1 2024-09-12T00:38:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.B_P9epQ4wnFb53MpEthkBQmwSAZj7bW_0 2024-09-12T00:38:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16252406940640540449', time=2024-09-12T02:31:19.688274+0000, chain.objs.size()=1 2024-09-12T00:38:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.6wmJfzsMCPcgM1j1vmr3GJ0T0pDwjcz_0 2024-09-12T00:38:36.880 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18061769190171001746', time=2024-09-12T02:31:19.793950+0000, chain.objs.size()=1 2024-09-12T00:38:36.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.WLD-oeUmnAz3-GxsHmO9Asr304dBE6A_0 2024-09-12T00:38:36.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5988330096362598797', time=2024-09-12T02:31:19.798879+0000, chain.objs.size()=1 2024-09-12T00:38:36.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.-wxPFdaYgbbVMNCpg-iA7-C9Xqr-pRi_0 2024-09-12T00:38:36.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13339172755598490795', time=2024-09-12T02:31:19.825078+0000, chain.objs.size()=1 2024-09-12T00:38:36.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.881+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.LRTKHONzf1CpQQApdFe3V9rBFePhf0A_0 2024-09-12T00:38:36.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.885+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6942125680707434865', time=2024-09-12T02:31:19.839886+0000, chain.objs.size()=1 2024-09-12T00:38:36.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.885+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.3g4wDVmJosX6o8RfmT1qYG2ToQcZrGK_0 2024-09-12T00:38:36.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.886+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9450974827282554723', time=2024-09-12T02:31:19.858469+0000, chain.objs.size()=1 2024-09-12T00:38:36.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.886+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.p2nV3wPQeBaAp3Jt9m3xBi4V7vuOSgV_0 2024-09-12T00:38:36.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.886+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3323788618645739359', time=2024-09-12T02:31:19.959828+0000, chain.objs.size()=1 2024-09-12T00:38:36.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.886+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IN3utxfYh9YyXglf2dVKZYqCJJuKDOd_0 2024-09-12T00:38:36.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.886+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13539208155724292258', time=2024-09-12T02:31:19.981607+0000, chain.objs.size()=1 2024-09-12T00:38:36.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.886+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.vtD7VwmH3E3J6vQVzBhJe9MmfTd7Kk6_0 2024-09-12T00:38:36.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.886+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13834907154720517173', time=2024-09-12T02:31:20.115840+0000, chain.objs.size()=1 2024-09-12T00:38:36.885 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.886+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.6oHMehtPS64LuuLB4GBRwHb2xW3flvg_0 2024-09-12T00:38:36.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.889+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7287801400443936692', time=2024-09-12T02:31:20.126375+0000, chain.objs.size()=1 2024-09-12T00:38:36.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.889+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.HA3zJfk9hEy_-1KJqIzagONJqftz0rc_0 2024-09-12T00:38:36.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.889+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15917562266141926283', time=2024-09-12T02:31:20.174085+0000, chain.objs.size()=1 2024-09-12T00:38:36.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.889+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.2OzVQGDeh_PX45fmo4XGWOWjEl05Q1f_0 2024-09-12T00:38:36.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.889+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11183224944077035672', time=2024-09-12T02:31:20.273801+0000, chain.objs.size()=1 2024-09-12T00:38:36.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.889+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.TORXXajk9rdcES_vYUTnLUIWc2HPG81_0 2024-09-12T00:38:36.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.889+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14599573843048390566', time=2024-09-12T02:31:20.286216+0000, chain.objs.size()=1 2024-09-12T00:38:36.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.889+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.WJGTcwuKvCOioQJULW0HYcB0Hfp-KtB_0 2024-09-12T00:38:36.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.890+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.261128830909275420', time=2024-09-12T02:31:20.312829+0000, chain.objs.size()=1 2024-09-12T00:38:36.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.890+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.9tgxUYwuH86NUyqwHM1ivhGUKAxMOWG_0 2024-09-12T00:38:36.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.890+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7925887220085208615', time=2024-09-12T02:31:20.339481+0000, chain.objs.size()=1 2024-09-12T00:38:36.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.890+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.UWSt6NIrMZ6f6E7Nb4XVSA7vB2Xc_1c_0 2024-09-12T00:38:36.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.890+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16691963786626364926', time=2024-09-12T02:31:20.347876+0000, chain.objs.size()=1 2024-09-12T00:38:36.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.890+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.d40m4HrNLNoK57EjlXJQT5D5OKbzh24_0 2024-09-12T00:38:36.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.890+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5219894553329493739', time=2024-09-12T02:31:20.426950+0000, chain.objs.size()=1 2024-09-12T00:38:36.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.890+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Q-YjdcIipFN33kmNXY4BPX_4YGqFBzX_0 2024-09-12T00:38:36.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.891+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17071682679986133695', time=2024-09-12T02:31:20.596852+0000, chain.objs.size()=1 2024-09-12T00:38:36.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.891+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.xFEzPAicvmZfUrz3wf69tT--HoJP1LM_0 2024-09-12T00:38:36.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.891+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6108203663998905692', time=2024-09-12T02:31:20.610452+0000, chain.objs.size()=1 2024-09-12T00:38:36.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.891+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.4A8zHq-EIJnrSBUQlFzQbLT904U0cw7_0 2024-09-12T00:38:36.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.891+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10835543422409789696', time=2024-09-12T02:31:20.611098+0000, chain.objs.size()=1 2024-09-12T00:38:36.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.891+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.3ejmMP34-Lg9xNUmuY372-Z3YsRYWON_0 2024-09-12T00:38:36.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.893+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13949914162057488770', time=2024-09-12T02:31:20.661442+0000, chain.objs.size()=1 2024-09-12T00:38:36.891 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.893+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ywi2sA6NxWGI75Y7jCCJAoipUltBJ98_0 2024-09-12T00:38:36.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.894+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16168405523370894207', time=2024-09-12T02:31:20.665276+0000, chain.objs.size()=1 2024-09-12T00:38:36.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.894+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.iaMa7fsMoBlZmpbju0FEyre2HAJRYcF_0 2024-09-12T00:38:36.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.895+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6052920149661362163', time=2024-09-12T02:31:20.669821+0000, chain.objs.size()=1 2024-09-12T00:38:36.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.895+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.uWf34REd6Wiw3vl99Sb-Ldb_IkmzCyV_0 2024-09-12T00:38:36.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.895+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4281195718927617595', time=2024-09-12T02:31:20.743564+0000, chain.objs.size()=1 2024-09-12T00:38:36.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.895+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.UAQsPKreWbqEiRCGxTmskKxZN03D0qR_0 2024-09-12T00:38:36.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.895+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9129891601977644222', time=2024-09-12T02:31:20.858196+0000, chain.objs.size()=1 2024-09-12T00:38:36.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.895+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.cjQrkOF3MZ-5sJlESZToQuq9lBlqjL3_0 2024-09-12T00:38:36.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.895+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12444009149902751548', time=2024-09-12T02:31:21.052454+0000, chain.objs.size()=1 2024-09-12T00:38:36.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.895+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.RhtJ1c_oN08345JuS9_4zjx0T67vtSC_0 2024-09-12T00:38:36.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.895+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14106240216287941356', time=2024-09-12T02:31:21.162333+0000, chain.objs.size()=1 2024-09-12T00:38:36.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.895+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.GEy76HJ3O7AvdCfoOuKX3ylHuhrfdtF_0 2024-09-12T00:38:36.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.895+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2196767092109497147', time=2024-09-12T02:31:21.243921+0000, chain.objs.size()=1 2024-09-12T00:38:36.894 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.895+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.myn6AYy6Gx1D2E_uUTJNUCQu0DXA6L4_0 2024-09-12T00:38:36.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.895+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1682305204830913873', time=2024-09-12T02:31:21.296618+0000, chain.objs.size()=1 2024-09-12T00:38:36.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.895+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.EcaNzzZJbU0hXJyIELZWMIseDsyfj3l_0 2024-09-12T00:38:36.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.897+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4333213329608557029', time=2024-09-12T02:31:21.306740+0000, chain.objs.size()=1 2024-09-12T00:38:36.895 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.897+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.rxJZdxRT8NYAUzDmi73L1btAAuXz3cQ_0 2024-09-12T00:38:36.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.897+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3397414728928649500', time=2024-09-12T02:31:21.484341+0000, chain.objs.size()=1 2024-09-12T00:38:36.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.897+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.o8EU8dTTmVJNzw7MWrbhNm_Ij3Om4Wo_0 2024-09-12T00:38:36.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.899+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12170976932289318411', time=2024-09-12T02:31:21.522327+0000, chain.objs.size()=1 2024-09-12T00:38:36.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.899+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.htmY1Z4d60W7dUtupF61Sw1Q1cAJWFs_0 2024-09-12T00:38:36.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.899+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4440641204398776958', time=2024-09-12T02:31:21.624235+0000, chain.objs.size()=1 2024-09-12T00:38:36.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.899+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.q8kFyzfAaahtBDkeVgZsNJyJ2tW9kHF_0 2024-09-12T00:38:36.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.900+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1140217113655564478', time=2024-09-12T02:31:21.629200+0000, chain.objs.size()=1 2024-09-12T00:38:36.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.900+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.cfssYs3HNUvjHuYpSrFunq1mbxbkmNK_0 2024-09-12T00:38:36.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.900+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2175083298994127001', time=2024-09-12T02:31:29.693570+0000, chain.objs.size()=1 2024-09-12T00:38:36.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.900+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.uJEnOhZ_PAHYoihJNpkI5vwkR5x202G_0 2024-09-12T00:38:36.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.902+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3001888235058421499', time=2024-09-12T02:31:29.769700+0000, chain.objs.size()=1 2024-09-12T00:38:36.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.902+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.sDgU5MbCudMFfF8qSTDBRM20-ofcUiF_0 2024-09-12T00:38:36.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1379235204736874757', time=2024-09-12T02:31:30.020910+0000, chain.objs.size()=1 2024-09-12T00:38:36.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.wJPHmYw4GhcT6IDR7z8qt8Mp5_lSjZg_0 2024-09-12T00:38:36.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14514757938986883690', time=2024-09-12T02:31:30.038662+0000, chain.objs.size()=1 2024-09-12T00:38:36.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.kvkqppteHNXV8h-PmRGmEnTUsRX_1uy_0 2024-09-12T00:38:36.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2680914038351526615', time=2024-09-12T02:31:30.109783+0000, chain.objs.size()=1 2024-09-12T00:38:36.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.32osvR3IAXzWR_poVhnoZReWUmYWsjV_0 2024-09-12T00:38:36.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9807078553666926077', time=2024-09-12T02:31:30.114464+0000, chain.objs.size()=1 2024-09-12T00:38:36.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.g_UDCeQNl_KtNl3Y2p-4HjH8XhEdwIZ_0 2024-09-12T00:38:36.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6776209351165893464', time=2024-09-12T02:31:30.334505+0000, chain.objs.size()=1 2024-09-12T00:38:36.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.tCRNGvY4cl2RbZlZlsd2BnMqBSrU7k7_0 2024-09-12T00:38:36.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12417533005513666359', time=2024-09-12T02:31:30.345578+0000, chain.objs.size()=1 2024-09-12T00:38:36.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.jzkaxD6zQTy5SSM60pD68X9oJGDKFIQ_0 2024-09-12T00:38:36.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6750846245524179940', time=2024-09-12T02:31:30.385009+0000, chain.objs.size()=1 2024-09-12T00:38:36.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.H2foioEgqf8cKzYj8VM7jj8Jw8WXGLX_0 2024-09-12T00:38:36.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2291549788441550034', time=2024-09-12T02:31:30.402913+0000, chain.objs.size()=1 2024-09-12T00:38:36.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.903+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.luIXMkgCjhqFM0RKgbwltwSheDG7vVz_0 2024-09-12T00:38:36.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.904+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2608473623198797682', time=2024-09-12T02:31:30.608831+0000, chain.objs.size()=1 2024-09-12T00:38:36.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.904+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.hWzRBahC76VIzw17hI88bSe1xPOKEc3_0 2024-09-12T00:38:36.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.904+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6792098298993529142', time=2024-09-12T02:31:30.653735+0000, chain.objs.size()=1 2024-09-12T00:38:36.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.904+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.PSp_PI3cRKl8QkRwBhJYLTZECpL_6xc_0 2024-09-12T00:38:36.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.907+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12634617433211898130', time=2024-09-12T02:31:30.658163+0000, chain.objs.size()=1 2024-09-12T00:38:36.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.907+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.bpKyvtp79CWtZpysRuOLtSIC6rEu6Jz_0 2024-09-12T00:38:36.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.908+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12512680521370192145', time=2024-09-12T02:31:30.694820+0000, chain.objs.size()=1 2024-09-12T00:38:36.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.908+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.aytrde6jUMdsQ_XhGDF5glg29OWmipL_0 2024-09-12T00:38:36.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.908+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8111324620805774850', time=2024-09-12T02:31:30.708389+0000, chain.objs.size()=1 2024-09-12T00:38:36.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.908+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.rVT7EIws6F-EIv3ONXviPLEDy7N4ufN_0 2024-09-12T00:38:36.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.908+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.204841439567403928', time=2024-09-12T02:31:30.743531+0000, chain.objs.size()=1 2024-09-12T00:38:36.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.908+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.hWboGW1UTWR_D-I9i-JnWE3qnbZig7D_0 2024-09-12T00:38:36.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.908+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8548484701665867457', time=2024-09-12T02:31:30.855306+0000, chain.objs.size()=1 2024-09-12T00:38:36.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.908+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.gEpW-I6H0rdz9T7UZVPWjlWlflNsRj4_0 2024-09-12T00:38:36.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.908+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12021770151301063013', time=2024-09-12T02:31:30.872613+0000, chain.objs.size()=1 2024-09-12T00:38:36.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.908+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.jdEckoHmhJ-hUNdWzTLi_sDfxyMaolp_0 2024-09-12T00:38:36.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.908+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15975010641326266312', time=2024-09-12T02:31:30.940820+0000, chain.objs.size()=1 2024-09-12T00:38:36.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.908+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.XSCUbOmQMobPG4l_mmQtdvQ7n1PpCvp_0 2024-09-12T00:38:36.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.908+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11443987059218921388', time=2024-09-12T02:31:30.956079+0000, chain.objs.size()=1 2024-09-12T00:38:36.907 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.908+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.30qnfVWWtQKZkqoqxzCPT4SFSQla7Fy_0 2024-09-12T00:38:36.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.909+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12592925728417273985', time=2024-09-12T02:31:31.016244+0000, chain.objs.size()=1 2024-09-12T00:38:36.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.909+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.KuRzJjKu-rC_OiFJYvPTOIys1hVkas-_0 2024-09-12T00:38:36.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.909+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13301508428056165427', time=2024-09-12T02:31:31.132394+0000, chain.objs.size()=1 2024-09-12T00:38:36.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.909+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.N4dJfIfJRPYh5_s5DPQKg4HFAee5eLZ_0 2024-09-12T00:38:36.913 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.915+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/54416 2024-09-12T00:38:36.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T00:38:36.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10396845235152643610', time=2024-09-12T02:31:31.203056+0000, chain.objs.size()=1 2024-09-12T00:38:36.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-h-s94N-Wf_nPgtgvRaHh4UVZnj8a3l_0 2024-09-12T00:38:36.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16169539010617562532', time=2024-09-12T02:31:31.406031+0000, chain.objs.size()=1 2024-09-12T00:38:36.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.krtyCg-Bh1f_3iQwMmlD_lgVPR9HwdC_0 2024-09-12T00:38:36.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11867084379391717193', time=2024-09-12T02:31:31.448485+0000, chain.objs.size()=1 2024-09-12T00:38:36.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.J4uafOSq9rRGyJHVleGaRbPar2Oc4JW_0 2024-09-12T00:38:36.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17348116267732280232', time=2024-09-12T02:31:31.504143+0000, chain.objs.size()=1 2024-09-12T00:38:36.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.D6d_kL1TVAc9ZNhjMu3XOUAD8j5Bqxc_0 2024-09-12T00:38:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9438915826253054461', time=2024-09-12T02:31:31.564510+0000, chain.objs.size()=1 2024-09-12T00:38:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.vKCetYly9lCwC9at52bByyFyNOWYQQx_0 2024-09-12T00:38:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3462221531595651415', time=2024-09-12T02:31:31.681896+0000, chain.objs.size()=1 2024-09-12T00:38:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.YmvRjYCyU9ea4AKMOhKdeKeqpNk1ulQ_0 2024-09-12T00:38:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13496644153425612719', time=2024-09-12T02:31:31.721711+0000, chain.objs.size()=1 2024-09-12T00:38:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.oYLMLTOcIKtm1RdaOrRlC3KF_oGhJGN_0 2024-09-12T00:38:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3630035991690207645', time=2024-09-12T02:31:31.776877+0000, chain.objs.size()=1 2024-09-12T00:38:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.uvGiXDvWvg_EVQqbru-YFXvH5eDxF5g_0 2024-09-12T00:38:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.721440233679403807', time=2024-09-12T02:31:31.787989+0000, chain.objs.size()=1 2024-09-12T00:38:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.5X7_txnZ96NXrVKXtYnNP3m73AlLUDF_0 2024-09-12T00:38:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8861789330286950744', time=2024-09-12T02:31:31.827084+0000, chain.objs.size()=1 2024-09-12T00:38:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.007dHyPSnY9-jROqEZp24Xy5sqCHKsj_0 2024-09-12T00:38:36.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.649011625484165468', time=2024-09-12T02:31:34.357635+0000, chain.objs.size()=1 2024-09-12T00:38:36.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.335__shadow_.3Av8yKY9UqHTALSjDk5f_ZNlb3ISauf_0 2024-09-12T00:38:36.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14994716462622626199', time=2024-09-12T02:32:12.591192+0000, chain.objs.size()=1 2024-09-12T00:38:36.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.918+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.483__shadow_.VSENothKCBttRKSl7LW_sLpYiVujA9M_0 2024-09-12T00:38:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.921+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11638503975890301759', time=2024-09-12T02:32:15.392126+0000, chain.objs.size()=1 2024-09-12T00:38:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.493__shadow_.9BgJxh-ZNX-yK_KoZ7DdMZIQPzsIbI1_0 2024-09-12T00:38:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10034334396068850705', time=2024-09-12T02:32:16.508865+0000, chain.objs.size()=1 2024-09-12T00:38:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.497__shadow_.eW15pVP7R8-F-4l-6wBr402ehtG3nZa_0 2024-09-12T00:38:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8463928159824088009', time=2024-09-12T02:33:06.050467+0000, chain.objs.size()=1 2024-09-12T00:38:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.552__shadow_.cIC-RBq3mUJGCW__v5RCHNd7iXrMKNv_0 2024-09-12T00:38:36.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3074245799643656886', time=2024-09-12T02:33:06.878675+0000, chain.objs.size()=1 2024-09-12T00:38:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.554__shadow_.u-Phh8N5SQTFs2A5Zw-c079FVMnmwHu_0 2024-09-12T00:38:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7306355707721479115', time=2024-09-12T02:33:16.566268+0000, chain.objs.size()=1 2024-09-12T00:38:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:qjOuaosQ18HkTCA6WczCbXOa3XLVXzl_.g7twMylikwOKt1owUPyI86fATWA9Qnz_0 2024-09-12T00:38:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4842302707628545046', time=2024-09-12T02:33:27.177745+0000, chain.objs.size()=1 2024-09-12T00:38:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.575__shadow_.PqVcicc0137BGzM0KOOwB129MQNg2-a_0 2024-09-12T00:38:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4421421144063265034', time=2024-09-12T02:33:30.909815+0000, chain.objs.size()=1 2024-09-12T00:38:36.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:crd0p57IBLTVJM9vlOqijevqtyUh.jx_.a7KGKePPGJS7NjMe9_pN0F14uD-okL7_0 2024-09-12T00:38:36.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14831660403967123535', time=2024-09-12T02:33:33.265334+0000, chain.objs.size()=1 2024-09-12T00:38:36.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:nNz9tBpj5sT0hStr50AEuodWjCJQA0t_.vv6sc6wfWc9ru8boHECR7qAEqttYQBh_0 2024-09-12T00:38:36.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.726983832151622734', time=2024-09-12T02:33:46.927282+0000, chain.objs.size()=1 2024-09-12T00:38:36.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.580__shadow:HooGfH8hx1SEa6IzJ2l8zy9gAlHTY11_.Rc7A8GkqIgP-0yDu_GRWjWs8GRPsKQJ_0 2024-09-12T00:38:36.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10983396474947401642', time=2024-09-12T02:33:47.618767+0000, chain.objs.size()=1 2024-09-12T00:38:36.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.922+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.583__shadow:3GwRKzBnEr.-qJjlu9FI2wfL4-oa9ih_.K9dAaznHChJ1fdXSOV8xl1t6zh4A19s_0 2024-09-12T00:38:36.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.924+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3234910957997181629', time=2024-09-12T02:36:07.185031+0000, chain.objs.size()=1 2024-09-12T00:38:36.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.924+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.639__shadow_.ZCdfM5rwYXLHHm2dUqHF7IA4M3zuitd_0 2024-09-12T00:38:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.928+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17451596448274526755', time=2024-09-12T02:36:12.691134+0000, chain.objs.size()=2 2024-09-12T00:38:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.928+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.655__shadow_.VTPnC7Dk44J3479fU1NqgxQFfAPXpEg_0 2024-09-12T00:38:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.928+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.655__shadow_.VTPnC7Dk44J3479fU1NqgxQFfAPXpEg_1 2024-09-12T00:38:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.928+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9372480797332488922', time=2024-09-12T02:36:15.924406+0000, chain.objs.size()=1 2024-09-12T00:38:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.928+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.663__shadow_.CdUpVtd2rEQfczBKKf_wMixyCuB-URG_0 2024-09-12T00:38:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.928+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9666442245122072083', time=2024-09-12T02:36:15.925409+0000, chain.objs.size()=1 2024-09-12T00:38:36.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.928+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.663__shadow_.6b9bTE_r0RaRgi4GqymlB7wAq7M-Gep_0 2024-09-12T00:38:36.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.928+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1419037974575423819', time=2024-09-12T02:36:16.313483+0000, chain.objs.size()=1 2024-09-12T00:38:36.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.928+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.664__shadow_.WuGR5Igr6f4eWHG4BI9e6hz2Qz4OmEp_0 2024-09-12T00:38:36.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.928+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17059228352040725216', time=2024-09-12T02:36:17.149673+0000, chain.objs.size()=1 2024-09-12T00:38:36.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.928+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.666__shadow_.zecT4ml_5xRoTxamdRADZoB2kZ0DeZF_0 2024-09-12T00:38:36.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.932+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:36.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.935+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:38:36.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.936+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:36.935 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.937+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:36.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49756' 2024-09-12T00:38:36.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16323863618048206459', time=2024-09-12T02:29:26.497741+0000, chain.objs.size()=3 2024-09-12T00:38:36.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__multipart_foo-LUKEWARM.2~0wh3_SFJPAvrrWvMzjCXUbAxfuVU8hN.1 2024-09-12T00:38:36.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__multipart_foo-LUKEWARM.2~0wh3_SFJPAvrrWvMzjCXUbAxfuVU8hN.2 2024-09-12T00:38:36.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__multipart_foo-LUKEWARM.2~0wh3_SFJPAvrrWvMzjCXUbAxfuVU8hN.3 2024-09-12T00:38:36.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_qXdbGu7CBc1djEpwm64isvkThwhRUwz', time=2024-09-12T02:29:28.352954+0000, chain.objs.size()=1 2024-09-12T00:38:36.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.165__shadow_.O3zkYDthKmI3ZtolYuyOCuixUKxxhOv_0 2024-09-12T00:38:36.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8928025232227995052', time=2024-09-12T02:30:41.410123+0000, chain.objs.size()=1 2024-09-12T00:38:36.937 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.246__shadow_.kqQ7ijRSAyVbXwykFZpB6HaeZixAaWl_0 2024-09-12T00:38:36.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2240539714105710475', time=2024-09-12T02:30:53.132070+0000, chain.objs.size()=1 2024-09-12T00:38:36.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.rz96AiwUqoI8osNR0W-IouK1UHc5cGL_0 2024-09-12T00:38:36.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7983605424406483994', time=2024-09-12T02:30:53.169154+0000, chain.objs.size()=1 2024-09-12T00:38:36.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HJkUBgEcKLPUPFKNkN5tYMj8AjhTiyB_0 2024-09-12T00:38:36.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14897439225469216352', time=2024-09-12T02:30:53.252377+0000, chain.objs.size()=1 2024-09-12T00:38:36.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YSBBrf0Txy3NYb1TxIbWjKj8VpGD_eM_0 2024-09-12T00:38:36.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6162110409353462338', time=2024-09-12T02:30:53.403415+0000, chain.objs.size()=1 2024-09-12T00:38:36.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.hivcIqYB_1AuzSMW00CnOHEqjGzREc0_0 2024-09-12T00:38:36.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8555076087084176838', time=2024-09-12T02:30:53.416501+0000, chain.objs.size()=1 2024-09-12T00:38:36.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.W8RQ5JYgWV6pF4qd0DLhIq-a6enPggq_0 2024-09-12T00:38:36.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11236432456841543741', time=2024-09-12T02:30:53.478150+0000, chain.objs.size()=1 2024-09-12T00:38:36.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.WG-8OGZ3Whll323qeBKAUB2gYuI0X9I_0 2024-09-12T00:38:36.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3260491815889845253', time=2024-09-12T02:30:53.500073+0000, chain.objs.size()=1 2024-09-12T00:38:36.938 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.938+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pvhKjWAm_SYEPPui3QztNbdN7LmJ6N9_0 2024-09-12T00:38:36.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4962119048672797203', time=2024-09-12T02:30:53.570985+0000, chain.objs.size()=1 2024-09-12T00:38:36.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.60Of0O8l-eWQrG-VKybVutIwcvo8WHT_0 2024-09-12T00:38:36.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7961555634936392705', time=2024-09-12T02:30:53.689950+0000, chain.objs.size()=1 2024-09-12T00:38:36.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ZlJNhfYNu1aCcooF5Fqzeu45kCi_nfK_0 2024-09-12T00:38:36.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16275064608031409695', time=2024-09-12T02:30:53.786638+0000, chain.objs.size()=1 2024-09-12T00:38:36.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.x-_r-5O3-i1sycbInhIENo-Ap1QYfhO_0 2024-09-12T00:38:36.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12098885576155237810', time=2024-09-12T02:30:53.822616+0000, chain.objs.size()=1 2024-09-12T00:38:36.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.KpwQwmWZDgSly37B4FKJtbdlHGCJubY_0 2024-09-12T00:38:36.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15054047502061718551', time=2024-09-12T02:30:53.830248+0000, chain.objs.size()=1 2024-09-12T00:38:36.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HGpR8xFD8XaXUxOiI_uW44OMjL3ovtc_0 2024-09-12T00:38:36.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.941+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6279859484856505033', time=2024-09-12T02:30:54.148047+0000, chain.objs.size()=1 2024-09-12T00:38:36.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.941+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.wrdvvJAw1PqNLY0yVVS55qVvvNJWX8D_0 2024-09-12T00:38:36.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.942+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3170159453466844464', time=2024-09-12T02:30:54.151593+0000, chain.objs.size()=1 2024-09-12T00:38:36.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.942+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.fa0_Mp25DFrQ6HKSsA9XCUMwhubZr8V_0 2024-09-12T00:38:36.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.942+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18222063595456301951', time=2024-09-12T02:30:54.411572+0000, chain.objs.size()=1 2024-09-12T00:38:36.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.942+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.K_jRJfKf6VnrA8i0la3dJUYzD9nnNID_0 2024-09-12T00:38:36.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.942+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13983486186966319812', time=2024-09-12T02:30:54.573417+0000, chain.objs.size()=1 2024-09-12T00:38:36.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.942+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.hTVEOhjnknmI4CvT4B2FuIV3P4LPsyC_0 2024-09-12T00:38:36.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.942+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13360670697582156962', time=2024-09-12T02:30:54.586959+0000, chain.objs.size()=1 2024-09-12T00:38:36.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.942+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.tfvvTgsn7JAIF5mBmIvLJWWEGkumTf2_0 2024-09-12T00:38:36.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.942+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15556656675056849902', time=2024-09-12T02:30:54.607110+0000, chain.objs.size()=1 2024-09-12T00:38:36.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.942+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.QDNMN6kitfi926A1AhZwPmG3LXqOHPB_0 2024-09-12T00:38:36.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.946+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12829531983214673240', time=2024-09-12T02:30:54.689708+0000, chain.objs.size()=1 2024-09-12T00:38:36.944 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.946+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ET9GlM9BKgTS70_7w4kknEnASqsUYBJ_0 2024-09-12T00:38:36.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.947+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17811207880424025451', time=2024-09-12T02:30:54.704244+0000, chain.objs.size()=1 2024-09-12T00:38:36.947 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.947+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.EWOWBdpPB1Jv0INjCh89ZqTSv7fxgCp_0 2024-09-12T00:38:36.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13026731664827131921', time=2024-09-12T02:30:54.859002+0000, chain.objs.size()=1 2024-09-12T00:38:36.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JTWcpGeSKtbxJO51_rsX2wA9p21bZkL_0 2024-09-12T00:38:36.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7545007684335543336', time=2024-09-12T02:30:54.904968+0000, chain.objs.size()=1 2024-09-12T00:38:36.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.F4vSLfpWnPDW0fFxGsL8c6lm4NG90Xs_0 2024-09-12T00:38:36.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2751977499836212901', time=2024-09-12T02:30:54.926117+0000, chain.objs.size()=1 2024-09-12T00:38:36.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ILZ1gfbFC7kI1t9Vkzhmjdze9HWuFkQ_0 2024-09-12T00:38:36.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8128933329946282824', time=2024-09-12T02:30:54.943083+0000, chain.objs.size()=1 2024-09-12T00:38:36.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.t79bvWVYBg_R3lXK1FXvMcbA-wUfOua_0 2024-09-12T00:38:36.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1708180963928301622', time=2024-09-12T02:30:54.950961+0000, chain.objs.size()=1 2024-09-12T00:38:36.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.IQFXcVu3sXYlC1a2DKx1Hv3SBGq1ySf_0 2024-09-12T00:38:36.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18235162207897651290', time=2024-09-12T02:30:55.087120+0000, chain.objs.size()=1 2024-09-12T00:38:36.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.qHlZZN0V2RRzzLdevO9BkwIUHi9woiD_0 2024-09-12T00:38:36.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3881836827961237305', time=2024-09-12T02:30:55.099409+0000, chain.objs.size()=1 2024-09-12T00:38:36.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.A4wuT27NzsoOKQqSIBhh6cLLdl-MgZm_0 2024-09-12T00:38:36.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.901382558700486650', time=2024-09-12T02:30:56.185933+0000, chain.objs.size()=1 2024-09-12T00:38:36.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.266__shadow_.FfIZkR3ADjTC09NMAOfljrJ9vRebhfm_0 2024-09-12T00:38:36.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1275626900022584542', time=2024-09-12T02:30:57.646843+0000, chain.objs.size()=1 2024-09-12T00:38:36.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.272__shadow_.ViqXotsYUlrdFxkqJ6PbKrlg4RBqk74_0 2024-09-12T00:38:36.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7855364333857086460', time=2024-09-12T02:31:02.116041+0000, chain.objs.size()=1 2024-09-12T00:38:36.949 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.949+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.290__shadow_.x3mUbi1I2JReUOZ3HyqnAce-guaZ0y4_0 2024-09-12T00:38:36.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.951+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13631990992259354447', time=2024-09-12T02:31:03.058579+0000, chain.objs.size()=1 2024-09-12T00:38:36.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.951+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.KX3h8XB1tXyuKs6d4XQ_9onbaq-gEHs_0 2024-09-12T00:38:36.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.955+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4003672506631572064', time=2024-09-12T02:31:03.067738+0000, chain.objs.size()=1 2024-09-12T00:38:36.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.955+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_._JTfD9O6R0g32QqENAxKnovhnV7CL7p_0 2024-09-12T00:38:36.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2865470096296129420', time=2024-09-12T02:31:04.653400+0000, chain.objs.size()=1 2024-09-12T00:38:36.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.297__shadow_.N-B9B6O5mrBSGRv0FD-CxnT0dUXs0eI_0 2024-09-12T00:38:36.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8768587376825945198', time=2024-09-12T02:31:19.410846+0000, chain.objs.size()=1 2024-09-12T00:38:36.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.I3odqkRoKz7e-qz051OYOPfYOabNiTb_0 2024-09-12T00:38:36.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12273410423258205963', time=2024-09-12T02:31:19.475982+0000, chain.objs.size()=1 2024-09-12T00:38:36.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.zadFvz63S6dvKpKgqpmYRPKmyeu91EM_0 2024-09-12T00:38:36.954 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1513465461447514176', time=2024-09-12T02:31:19.682316+0000, chain.objs.size()=1 2024-09-12T00:38:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.YUKYGF2sDVkj1o_IQPvW__V0TFpL210_0 2024-09-12T00:38:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5251914358468310992', time=2024-09-12T02:31:19.793056+0000, chain.objs.size()=1 2024-09-12T00:38:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.k9DpHJDC5Uurf7KqaBa7A413PrObTN4_0 2024-09-12T00:38:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10335352712884967327', time=2024-09-12T02:31:19.802161+0000, chain.objs.size()=1 2024-09-12T00:38:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.yNIUlC3-Oh-UquokIrwn7Mis_fj4JXz_0 2024-09-12T00:38:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7909069757486658909', time=2024-09-12T02:31:19.805270+0000, chain.objs.size()=1 2024-09-12T00:38:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Tq4Gs3XvRx5YjdrfBZPmc0xgL1fRPUn_0 2024-09-12T00:38:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4344154436392161393', time=2024-09-12T02:31:19.825400+0000, chain.objs.size()=1 2024-09-12T00:38:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.j1yfLMJ2rfGEZV-oLPWBqUt8K8QwQZJ_0 2024-09-12T00:38:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6558983050997734701', time=2024-09-12T02:31:19.871960+0000, chain.objs.size()=1 2024-09-12T00:38:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7PbUS2WF3HZFi8cpNbr2qUJ3sWCP3Mg_0 2024-09-12T00:38:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7601037951153159426', time=2024-09-12T02:31:20.041884+0000, chain.objs.size()=1 2024-09-12T00:38:36.955 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.83RBCjip0wz-sVsb01KE9XMLtnbQ1lk_0 2024-09-12T00:38:36.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.960+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.219924110497410791', time=2024-09-12T02:31:20.072187+0000, chain.objs.size()=1 2024-09-12T00:38:36.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.960+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.HY2ZLo7yY7LPm3sGypFP2UJZMgVpms6_0 2024-09-12T00:38:36.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.960+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4900322820448522689', time=2024-09-12T02:31:20.092580+0000, chain.objs.size()=1 2024-09-12T00:38:36.958 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.960+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Z9bGG5z96bgVPMoAWv9x7IdkJMFGfN8_0 2024-09-12T00:38:36.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.961+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15694817488961847787', time=2024-09-12T02:31:20.146265+0000, chain.objs.size()=1 2024-09-12T00:38:36.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.961+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.0luE9n16WBzx-w775sFa9h6aePZHnfi_0 2024-09-12T00:38:36.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.961+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16613372099093198950', time=2024-09-12T02:31:20.310640+0000, chain.objs.size()=1 2024-09-12T00:38:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.961+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.QgUrXPOmNuleQdm8BlnTXA6nP3_708A_0 2024-09-12T00:38:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.961+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8695404880006628979', time=2024-09-12T02:31:20.384964+0000, chain.objs.size()=1 2024-09-12T00:38:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.961+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.S2tbTmsP5zbKJHyCP8lSg4bexQx3pw-_0 2024-09-12T00:38:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.961+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17254801914097564666', time=2024-09-12T02:31:20.414710+0000, chain.objs.size()=1 2024-09-12T00:38:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.961+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.BdtpSTxK-OcgR_snvfwOrIvaLIIZY4N_0 2024-09-12T00:38:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.961+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10379864914709723390', time=2024-09-12T02:31:20.557468+0000, chain.objs.size()=1 2024-09-12T00:38:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.961+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.H-pSdwyErqeDzr3CzFgs3ooGts-axbF_0 2024-09-12T00:38:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.961+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16495239930984311973', time=2024-09-12T02:31:20.681314+0000, chain.objs.size()=1 2024-09-12T00:38:36.960 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.961+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.lxjLDKlnNApoGmFHSp7lWBhuYH0SMhZ_0 2024-09-12T00:38:36.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.962+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15758099456784612569', time=2024-09-12T02:31:20.869323+0000, chain.objs.size()=1 2024-09-12T00:38:36.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.962+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.W8yPlqwTfhxxs8PL5zfSaHyA-m241r3_0 2024-09-12T00:38:36.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.962+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17729207261409051062', time=2024-09-12T02:31:20.871430+0000, chain.objs.size()=1 2024-09-12T00:38:36.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.962+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.TYorPnxm_jEe42dn4C4nlZX0nNgEJ4p_0 2024-09-12T00:38:36.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.962+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8962689284739748801', time=2024-09-12T02:31:20.972106+0000, chain.objs.size()=1 2024-09-12T00:38:36.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.962+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.uqVD0BRgMRfu4vaysbNH5LTX8od9OtV_0 2024-09-12T00:38:36.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.965+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3105236455992815272', time=2024-09-12T02:31:20.996867+0000, chain.objs.size()=1 2024-09-12T00:38:36.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.965+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Y2PCuDeUgdEbEHWulWgFdazDAOPuskH_0 2024-09-12T00:38:36.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.965+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12753560037926774577', time=2024-09-12T02:31:21.006828+0000, chain.objs.size()=1 2024-09-12T00:38:36.963 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.965+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Xf3MVniw_4y7EPapJWuzkHw634l4p-r_0 2024-09-12T00:38:36.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.965+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15911782219279813438', time=2024-09-12T02:31:21.020432+0000, chain.objs.size()=1 2024-09-12T00:38:36.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.965+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.OOLCG4kK31VNdIpp8IvK-UDQ8ilGluz_0 2024-09-12T00:38:36.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.968+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6248745538358839464', time=2024-09-12T02:31:21.048680+0000, chain.objs.size()=1 2024-09-12T00:38:36.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.968+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Qy1ILihduhAEDPfum6MQVpHuaKhNvdp_0 2024-09-12T00:38:36.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.968+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7541829864705003136', time=2024-09-12T02:31:21.056788+0000, chain.objs.size()=1 2024-09-12T00:38:36.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.968+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.fA2pF6864dje6tK87UVv81jOwqVxFA8_0 2024-09-12T00:38:36.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.148945758750677801', time=2024-09-12T02:31:21.169284+0000, chain.objs.size()=1 2024-09-12T00:38:36.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.iQlK0P8BGZkpfg0OO8NlFgNCNyO1It7_0 2024-09-12T00:38:36.967 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18307585105889185102', time=2024-09-12T02:31:21.208293+0000, chain.objs.size()=1 2024-09-12T00:38:36.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.N_24W4P_OkB_oDS6UlxyO4zZq9WcH5v_0 2024-09-12T00:38:36.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6365432464432762041', time=2024-09-12T02:31:21.632301+0000, chain.objs.size()=1 2024-09-12T00:38:36.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.uO0c63WvAO_3vyWAk4sl3uPR2uWjqoq_0 2024-09-12T00:38:36.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16305622719134292115', time=2024-09-12T02:31:21.636123+0000, chain.objs.size()=1 2024-09-12T00:38:36.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.0RPLCECyzyDBOOaL6R82S0QTbwji-Vx_0 2024-09-12T00:38:36.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2403081055557603581', time=2024-09-12T02:31:29.680280+0000, chain.objs.size()=1 2024-09-12T00:38:36.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.TuE-5hGXp6MBO5sIU4F9SE5Xc2c5poZ_0 2024-09-12T00:38:36.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16932417838245681739', time=2024-09-12T02:31:29.688804+0000, chain.objs.size()=1 2024-09-12T00:38:36.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.KiEIS5QJMyGjQLaBZZjSipl7TVbgFxa_0 2024-09-12T00:38:36.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6737250690740453718', time=2024-09-12T02:31:29.726125+0000, chain.objs.size()=1 2024-09-12T00:38:36.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.7WPzEpA_4nnMTRezAswHtllG4nKz4oK_0 2024-09-12T00:38:36.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2196111331371135455', time=2024-09-12T02:31:29.727051+0000, chain.objs.size()=1 2024-09-12T00:38:36.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.X0tA5nyNE6p0AT-6z5lsclMdXU03X9N_0 2024-09-12T00:38:36.968 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13212210518748942415', time=2024-09-12T02:31:30.055935+0000, chain.objs.size()=1 2024-09-12T00:38:36.969 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.969+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.yE2fP1f2uYoHF2gR_RqVhd4Vnmrajvv_0 2024-09-12T00:38:36.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6760681174824376780', time=2024-09-12T02:31:30.167864+0000, chain.objs.size()=1 2024-09-12T00:38:36.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.cFa3Usgo2JNNFA_STxTfpbLtrvQwW0V_0 2024-09-12T00:38:36.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11574608263175538230', time=2024-09-12T02:31:30.182775+0000, chain.objs.size()=1 2024-09-12T00:38:36.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.wHMnQrxGc8S_ml88iojRf5ajKgiG6we_0 2024-09-12T00:38:36.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17356338795709768411', time=2024-09-12T02:31:30.329609+0000, chain.objs.size()=1 2024-09-12T00:38:36.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.GUlIdl9f0iARJAc5jGpDn2iuJ7vl3sA_0 2024-09-12T00:38:36.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7077447385195874681', time=2024-09-12T02:31:30.381685+0000, chain.objs.size()=1 2024-09-12T00:38:36.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.n8ouDeaHVqddUYiKmf8RU5Vtd8F9j7z_0 2024-09-12T00:38:36.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.206418997695279470', time=2024-09-12T02:31:30.390389+0000, chain.objs.size()=1 2024-09-12T00:38:36.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.rHwI6YGofiQnLKbD8hLZGSMOsdKPgiJ_0 2024-09-12T00:38:36.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9804191582907755191', time=2024-09-12T02:31:30.429198+0000, chain.objs.size()=1 2024-09-12T00:38:36.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-gBJ7K-rPZzSch8wDl26k19-MmoDZ2n_0 2024-09-12T00:38:36.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8778472703666789848', time=2024-09-12T02:31:30.473259+0000, chain.objs.size()=1 2024-09-12T00:38:36.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.uPv9HRbud8F3wdCXFoHozDSLNRLVx-T_0 2024-09-12T00:38:36.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8062655689186417202', time=2024-09-12T02:31:30.851790+0000, chain.objs.size()=1 2024-09-12T00:38:36.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.bcKc6KMOltcKvkt2eYowcY_WzQlZHRc_0 2024-09-12T00:38:36.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17842272329183766629', time=2024-09-12T02:31:30.867740+0000, chain.objs.size()=1 2024-09-12T00:38:36.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.cQa9dJuCkQrAacywzG6LgWyeDa_5bme_0 2024-09-12T00:38:36.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3426758396312786401', time=2024-09-12T02:31:30.872730+0000, chain.objs.size()=1 2024-09-12T00:38:36.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.QW8oN9dShc7FkqSY7ci_bo9KQ6TN9nH_0 2024-09-12T00:38:36.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10262803408721769029', time=2024-09-12T02:31:30.900502+0000, chain.objs.size()=1 2024-09-12T00:38:36.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.975+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.5hVpsLFrAufb_xIbHH6Ub0hHUHUjIat_0 2024-09-12T00:38:36.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.979+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4527028683651897318', time=2024-09-12T02:31:30.942930+0000, chain.objs.size()=1 2024-09-12T00:38:36.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.979+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.v12hv1CEjrPi5W25sViVQm4L6pttMSi_0 2024-09-12T00:38:36.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10249325985790478690', time=2024-09-12T02:31:31.130494+0000, chain.objs.size()=1 2024-09-12T00:38:36.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NXvODG3RdttUmDPWWaefoNyCHodU0Ac_0 2024-09-12T00:38:36.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.818714636132198888', time=2024-09-12T02:31:31.160094+0000, chain.objs.size()=1 2024-09-12T00:38:36.979 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.avNRiaLd60YsyoqUYAMVyLs6LIV91I__0 2024-09-12T00:38:36.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522968847396104009', time=2024-09-12T02:31:31.182468+0000, chain.objs.size()=1 2024-09-12T00:38:36.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.bxiLdZ2ST1-tlEKpKbe4gCVBFl7aoda_0 2024-09-12T00:38:36.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1113743320779475324', time=2024-09-12T02:31:31.535305+0000, chain.objs.size()=1 2024-09-12T00:38:36.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.8UH3zYTjwVCISHEa2MrBeVTBLVxWr-k_0 2024-09-12T00:38:36.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8721221423926525706', time=2024-09-12T02:31:31.536036+0000, chain.objs.size()=1 2024-09-12T00:38:36.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.XFG9gJXlktnmyWYjGLMxjlXN1E7LKpU_0 2024-09-12T00:38:36.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14952570383239621343', time=2024-09-12T02:31:31.573599+0000, chain.objs.size()=1 2024-09-12T00:38:36.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.MKUZajZA6qYmyH3Apo4V4CRyn5yEb-t_0 2024-09-12T00:38:36.980 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14551633586250292125', time=2024-09-12T02:31:31.712795+0000, chain.objs.size()=1 2024-09-12T00:38:36.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.UElRchxzaaEJXSPw7mZx6HlSaugoDbJ_0 2024-09-12T00:38:36.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.969191867651030851', time=2024-09-12T02:31:31.718430+0000, chain.objs.size()=1 2024-09-12T00:38:36.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.5WniDOxFVuCVj_XLaOnDD6lAXIoVSfP_0 2024-09-12T00:38:36.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2646104039561469727', time=2024-09-12T02:31:31.780228+0000, chain.objs.size()=1 2024-09-12T00:38:36.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lMJgvp7rPDCw9ghZwtvK8WZytcnciP-_0 2024-09-12T00:38:36.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14495427387605547657', time=2024-09-12T02:31:47.478752+0000, chain.objs.size()=1 2024-09-12T00:38:36.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.981+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.390__shadow_.VduFlLD86m-plM00zAvoIAbR_c_VUxW_0 2024-09-12T00:38:36.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.983+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9892210597712637248', time=2024-09-12T02:32:04.238477+0000, chain.objs.size()=1 2024-09-12T00:38:36.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.983+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.451__shadow_.CF_MsPK2KWn3p2kDkCRA-_KQOvzlaDv_0 2024-09-12T00:38:36.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.988+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2164099811289065876', time=2024-09-12T02:32:06.491740+0000, chain.objs.size()=1 2024-09-12T00:38:36.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.988+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.458__shadow_.jU7KK-pgNFHdK0xSgywaF6EtSaAsqrR_0 2024-09-12T00:38:36.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.988+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9985448388661202458', time=2024-09-12T02:32:09.205415+0000, chain.objs.size()=1 2024-09-12T00:38:36.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.988+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.465__shadow_.e0pntmjp_0R8IwgAjugZQiOg79ftz8A_0 2024-09-12T00:38:36.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.988+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9387042441702555313', time=2024-09-12T02:32:13.581444+0000, chain.objs.size()=1 2024-09-12T00:38:36.986 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.988+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.486__shadow_.7kwM6sXChBJYw_nj_-G2r_4Szg7Z5BX_0 2024-09-12T00:38:36.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.988+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6618462057513056465', time=2024-09-12T02:32:22.952547+0000, chain.objs.size()=1 2024-09-12T00:38:36.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.988+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.517__shadow_.m7O3kzaY97JcASoS6gZ_9m34bFSmhM2_0 2024-09-12T00:38:36.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.988+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17054007213646543763', time=2024-09-12T02:32:31.870268+0000, chain.objs.size()=2 2024-09-12T00:38:36.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.988+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.523__multipart_mymultipart.2~4Mw7it-ALXw5EuB1a6OpqVb2Bm5a3xn.1 2024-09-12T00:38:36.987 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.989+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.523__multipart_mymultipart.2~4Mw7it-ALXw5EuB1a6OpqVb2Bm5a3xn.2 2024-09-12T00:38:36.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.989+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5394193556399804888', time=2024-09-12T02:33:18.081643+0000, chain.objs.size()=1 2024-09-12T00:38:36.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.989+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:ILBK5d7UKWrPDa.5sy3eoh02T6dv3NR_.g05SSyjtuij2jwqq60-9h0B7e7dvclY_0 2024-09-12T00:38:36.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.989+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.336398775479041589', time=2024-09-12T02:33:20.622824+0000, chain.objs.size()=1 2024-09-12T00:38:36.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.989+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:6AvNVyOfpfmlHk1n3bwbvR8hogzMNyj_.p_QCYxOsQC95daF9AUgNTgrTKOw5_5B_0 2024-09-12T00:38:36.992 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.994+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/49756 2024-09-12T00:38:36.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.997+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T00:38:36.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.997+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3615852436249913240', time=2024-09-12T02:33:22.937913+0000, chain.objs.size()=1 2024-09-12T00:38:36.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.997+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.570__shadow:gNr3rlgE.jHXduJ0aUWCZvzKwe2iD9E_.HX-Kvm27f8uJoIweQLbz00mCKcaCDVJ_0 2024-09-12T00:38:36.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.997+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8587585801501353787', time=2024-09-12T02:33:45.840454+0000, chain.objs.size()=1 2024-09-12T00:38:36.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.997+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.579__shadow:f7sAnYp2khWasNJa78X5h2P68lzM88b_.kAmFZxASZsGMjo2DHZ8vQiZO1mPvjXT_0 2024-09-12T00:38:36.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.997+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15146361257925297885', time=2024-09-12T02:33:46.927507+0000, chain.objs.size()=1 2024-09-12T00:38:36.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.997+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.580__shadow:DJxLvk8A0Zn.aFUc13TGW-E5szu48Ng_.THsIllK1Y10ISbWJNjN56vDHgAHL5BK_0 2024-09-12T00:38:36.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.997+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3554945421390779207', time=2024-09-12T02:33:53.052452+0000, chain.objs.size()=1 2024-09-12T00:38:36.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.997+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.605__shadow_.TUW7J0LHRJXVVuN2o6Byj3HTUMG9a5G_0 2024-09-12T00:38:36.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.997+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17020294894680601878', time=2024-09-12T02:36:10.802780+0000, chain.objs.size()=1 2024-09-12T00:38:36.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.997+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.650__shadow_.xNDMC7iL-IlOC5bH25ulLiOCDvWPbtp_0 2024-09-12T00:38:36.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.997+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13015607185127312728', time=2024-09-12T02:36:28.161737+0000, chain.objs.size()=1 2024-09-12T00:38:36.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.997+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.712__shadow:kcSPPSq7s-96WYr5IFDDohGU-HZVMs8_.BlqngtC86ylkP5ZOiFjZJW_y0EtMRpr_0 2024-09-12T00:38:36.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.997+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9551580372308249198', time=2024-09-12T02:36:28.367967+0000, chain.objs.size()=1 2024-09-12T00:38:36.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:36.997+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.713__shadow:unoU7A71s-El2FLGXDurFd9Bx9Tq1tk_.XeVNsIU4kZ4IVPSw1iKwjyOvtY63fMD_0 2024-09-12T00:38:36.998 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:37.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.003+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:38:37.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.004+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:37.002 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.004+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:37.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45891' 2024-09-12T00:38:37.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14943583405230827430', time=2024-09-12T02:29:25.169233+0000, chain.objs.size()=2 2024-09-12T00:38:37.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_._R817xDt4oPruzKwLTxd9e_Fzf2Flzh_0 2024-09-12T00:38:37.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_._R817xDt4oPruzKwLTxd9e_Fzf2Flzh_1 2024-09-12T00:38:37.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_Bze6wirLrDikml9BGlf4yf6s5OdxuOX', time=2024-09-12T02:29:27.242733+0000, chain.objs.size()=1 2024-09-12T00:38:37.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__shadow_.5oTRIzhw5wqkREUmSc8t_U02o7ywyYP_0 2024-09-12T00:38:37.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17971639246845716637', time=2024-09-12T02:29:37.451273+0000, chain.objs.size()=1 2024-09-12T00:38:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.179__shadow_.hHPvcKfxFv15wrkj7WG5qWfqJhcENFn_0 2024-09-12T00:38:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1845855203623143320', time=2024-09-12T02:29:37.867392+0000, chain.objs.size()=1 2024-09-12T00:38:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.181__shadow_.co-IVX-kg9C29J1e5BWuVLdWX61HA6O_0 2024-09-12T00:38:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5250756421928985262', time=2024-09-12T02:29:39.231670+0000, chain.objs.size()=1 2024-09-12T00:38:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.188__shadow_.bLTWQdX0BtI0mQAZUYda8VcJmfkiMGk_0 2024-09-12T00:38:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8895946289221703085', time=2024-09-12T02:30:38.284480+0000, chain.objs.size()=1 2024-09-12T00:38:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.234__shadow_.LL96vfBPouhk9Rr0ILZdDYEdA9ghr85_0 2024-09-12T00:38:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5569159936038444812', time=2024-09-12T02:30:40.930761+0000, chain.objs.size()=1 2024-09-12T00:38:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.244__shadow_.HcIMMgIAnmkK9N6MrVixxTQpzpppwSh_0 2024-09-12T00:38:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4273505118222369316', time=2024-09-12T02:30:41.688756+0000, chain.objs.size()=1 2024-09-12T00:38:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.247__shadow_.xFjmjHCfrtDTyJxnNc2hNVJWmbatXax_0 2024-09-12T00:38:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8535629078900775068', time=2024-09-12T02:30:43.888077+0000, chain.objs.size()=1 2024-09-12T00:38:37.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.256__shadow_.RTUOQUje17yBelWXbvnll5GTIrbM96E_0 2024-09-12T00:38:37.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6330811836527668405', time=2024-09-12T02:30:53.193196+0000, chain.objs.size()=1 2024-09-12T00:38:37.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.l06rlf2fWVrkKmzSCI1pbqVyFTZEzqc_0 2024-09-12T00:38:37.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18402472011828220267', time=2024-09-12T02:30:53.236687+0000, chain.objs.size()=1 2024-09-12T00:38:37.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.005+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.F7X6MBzgwF9BEVH8JnnQ27XmX0fw_xR_0 2024-09-12T00:38:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9836825257493597465', time=2024-09-12T02:30:53.246920+0000, chain.objs.size()=1 2024-09-12T00:38:37.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Jko35W8gQR6HfiNiLHz4luNxoMj8QnI_0 2024-09-12T00:38:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15276048288447307044', time=2024-09-12T02:30:53.276449+0000, chain.objs.size()=1 2024-09-12T00:38:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.nq_2rwqxLFP4Y6qVKJlWu6u2bg66xiI_0 2024-09-12T00:38:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15029043623853298314', time=2024-09-12T02:30:53.281213+0000, chain.objs.size()=1 2024-09-12T00:38:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ZxoxTzlvlnO7s9VJRSUqXynHvIKcGWr_0 2024-09-12T00:38:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13831610782327469108', time=2024-09-12T02:30:53.308192+0000, chain.objs.size()=1 2024-09-12T00:38:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.NRTP6g5S93WcPedJriINO51qXKfu3WI_0 2024-09-12T00:38:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10928757419053335666', time=2024-09-12T02:30:53.434027+0000, chain.objs.size()=1 2024-09-12T00:38:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lKEy5ZUWS1m9SadZyb_vg7ihizn7Wt6_0 2024-09-12T00:38:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5365019442766450955', time=2024-09-12T02:30:53.553654+0000, chain.objs.size()=1 2024-09-12T00:38:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.32nbbXDOSBWcXdKKgS1U3D0ktu-KK1U_0 2024-09-12T00:38:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11570802769965077931', time=2024-09-12T02:30:53.567870+0000, chain.objs.size()=1 2024-09-12T00:38:37.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.wZgsaj5GKFT1dxqa-UXnRzHQ6reTDsz_0 2024-09-12T00:38:37.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12347462625548530805', time=2024-09-12T02:30:53.696275+0000, chain.objs.size()=1 2024-09-12T00:38:37.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.sW3Ba1kxWQZrczga1G-kZPEz1Xis1bJ_0 2024-09-12T00:38:37.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16366004693755139019', time=2024-09-12T02:30:53.958759+0000, chain.objs.size()=1 2024-09-12T00:38:37.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.009+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JqbXkkIEP-cj5A7mPSOF7J381aN8S-g_0 2024-09-12T00:38:37.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.010+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7747163812026331696', time=2024-09-12T02:30:53.975294+0000, chain.objs.size()=1 2024-09-12T00:38:37.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.010+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.nVJx2f1_24K4FAXHbklAs9ypMNuoDNz_0 2024-09-12T00:38:37.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.010+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9403580561737162879', time=2024-09-12T02:30:53.980691+0000, chain.objs.size()=1 2024-09-12T00:38:37.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.010+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Xo00j-MIpWTmAxl0ch6GsJ_fNs6Vwfa_0 2024-09-12T00:38:37.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.014+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11156285184405137319', time=2024-09-12T02:30:54.061366+0000, chain.objs.size()=1 2024-09-12T00:38:37.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.014+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.dSHyvnewXZn-U1qxPkVteXrrED4AKn5_0 2024-09-12T00:38:37.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.014+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10587526146927110652', time=2024-09-12T02:30:54.133355+0000, chain.objs.size()=1 2024-09-12T00:38:37.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.014+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.zl0IEpoqzRar3HHv500afqZJvEiIyA6_0 2024-09-12T00:38:37.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17086094186157029497', time=2024-09-12T02:30:54.274501+0000, chain.objs.size()=1 2024-09-12T00:38:37.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pU2gZear9xAj1_wVXabkn7yNrCZllPw_0 2024-09-12T00:38:37.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17540916324363883504', time=2024-09-12T02:30:54.281009+0000, chain.objs.size()=1 2024-09-12T00:38:37.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.hua2v7Wca9ALPmoIIv_eRtBs2RCbNqn_0 2024-09-12T00:38:37.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8801192208333203229', time=2024-09-12T02:30:54.287681+0000, chain.objs.size()=1 2024-09-12T00:38:37.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pPoqKhIidyn2XV11GNvx91h4rd7zaVe_0 2024-09-12T00:38:37.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7644423840530260637', time=2024-09-12T02:30:54.375745+0000, chain.objs.size()=1 2024-09-12T00:38:37.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-7nfB2oozSxPp6VbHkQjrIk3KKjDOwZ_0 2024-09-12T00:38:37.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12943457837890999315', time=2024-09-12T02:30:54.418626+0000, chain.objs.size()=1 2024-09-12T00:38:37.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.3Gyy7h6tTtL9OOa4juUk3LQC3WP4iz0_0 2024-09-12T00:38:37.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2732365456242981275', time=2024-09-12T02:30:54.649830+0000, chain.objs.size()=1 2024-09-12T00:38:37.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.FmpNJewUxx-glcK5bBUfDy4kxIKl_oY_0 2024-09-12T00:38:37.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10579213142608037130', time=2024-09-12T02:30:54.655520+0000, chain.objs.size()=1 2024-09-12T00:38:37.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.u9LOF2frF0aZnETI5CcJ8bCfivQl6Ft_0 2024-09-12T00:38:37.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.714086773365289710', time=2024-09-12T02:30:54.697735+0000, chain.objs.size()=1 2024-09-12T00:38:37.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.mdpgqvpQN9uJB-uChVnev8Wdq4dA3BG_0 2024-09-12T00:38:37.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16869211964953968559', time=2024-09-12T02:30:54.823422+0000, chain.objs.size()=1 2024-09-12T00:38:37.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.015+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.S8k3fMMEBOFFWzRlO5WNWgR0g335E58_0 2024-09-12T00:38:37.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.019+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11884373800312356774', time=2024-09-12T02:30:54.862463+0000, chain.objs.size()=1 2024-09-12T00:38:37.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.019+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.vmBGAbjO7Qkdx-7BADbNk4MiE5VDK0M_0 2024-09-12T00:38:37.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.020+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10428597841842580438', time=2024-09-12T02:30:54.873410+0000, chain.objs.size()=1 2024-09-12T00:38:37.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.020+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.9fMWzTqqBeai81h3zmgMylaZeN4pEuX_0 2024-09-12T00:38:37.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.020+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1573619466010255606', time=2024-09-12T02:30:54.950113+0000, chain.objs.size()=1 2024-09-12T00:38:37.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.020+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.nY_u5Bk6nZaOdJSAJEfx5iRqcplmEI7_0 2024-09-12T00:38:37.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.020+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1644980120082666174', time=2024-09-12T02:30:54.956701+0000, chain.objs.size()=1 2024-09-12T00:38:37.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.020+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.KEVHvpf5D3x1b52id7TCkQQxKhJyQjQ_0 2024-09-12T00:38:37.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.020+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4844274158142026201', time=2024-09-12T02:30:54.969036+0000, chain.objs.size()=1 2024-09-12T00:38:37.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.020+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.RFCK4zU_tgPH64KBW9DHln3r9Bv3zu0_0 2024-09-12T00:38:37.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.021+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10711514125714092314', time=2024-09-12T02:30:55.077452+0000, chain.objs.size()=1 2024-09-12T00:38:37.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.021+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.nx3wdAW37uq2S0es8Lqlpv8rSCJ9Ojg_0 2024-09-12T00:38:37.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.021+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1134661265840761639', time=2024-09-12T02:30:55.132289+0000, chain.objs.size()=1 2024-09-12T00:38:37.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.021+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.iFQidfWL2Z6LWNAJTloFL2Gf7iMp7_t_0 2024-09-12T00:38:37.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.021+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9136441577144718404', time=2024-09-12T02:30:55.139319+0000, chain.objs.size()=1 2024-09-12T00:38:37.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.021+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.9OaYTn9W8geqC7Kwc1XUQ4IB3Ynatxy_0 2024-09-12T00:38:37.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.021+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6058615804050673014', time=2024-09-12T02:30:55.188600+0000, chain.objs.size()=1 2024-09-12T00:38:37.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.021+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.V178NK3M6D76sBrT1r8NTdKraKV0pxG_0 2024-09-12T00:38:37.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.021+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6997541390877880974', time=2024-09-12T02:30:55.195075+0000, chain.objs.size()=1 2024-09-12T00:38:37.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.021+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.kvcSbNFr-q4_i4ykBs7avV9RxGuIWsI_0 2024-09-12T00:38:37.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.021+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14479164439689002505', time=2024-09-12T02:30:58.106452+0000, chain.objs.size()=1 2024-09-12T00:38:37.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.021+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.274__shadow_.p_6PSp6LwOXIq9_1BiURLWB_S_zklCD_0 2024-09-12T00:38:37.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.024+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9989934270145236259', time=2024-09-12T02:30:58.346466+0000, chain.objs.size()=1 2024-09-12T00:38:37.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.024+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.275__shadow_.5USo45-X_RVD7yDPYbQpL5ErOYObCFG_0 2024-09-12T00:38:37.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.024+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1150867942802936832', time=2024-09-12T02:31:00.066352+0000, chain.objs.size()=1 2024-09-12T00:38:37.022 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.024+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.282__shadow_.43tYzzdJ4Zk6T3g9VPyazlzA6iuiSxM_0 2024-09-12T00:38:37.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12431893564383815189', time=2024-09-12T02:31:03.667620+0000, chain.objs.size()=1 2024-09-12T00:38:37.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.opx39uQOJyMWWgZHPNHU8PDcs71d9NX_0 2024-09-12T00:38:37.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7957790948529523506', time=2024-09-12T02:31:05.460438+0000, chain.objs.size()=1 2024-09-12T00:38:37.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.300__shadow_.qgNgrpgb6Sb9EFBcwZ3SsxKPcIWrCtS_0 2024-09-12T00:38:37.025 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18070611458861770254', time=2024-09-12T02:31:10.881657+0000, chain.objs.size()=1 2024-09-12T00:38:37.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.322__shadow_.-UldDIJOwPGpIRFrZQ61MvWQ0y0Il5H_0 2024-09-12T00:38:37.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16906419514854923115', time=2024-09-12T02:31:19.381327+0000, chain.objs.size()=1 2024-09-12T00:38:37.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.EGBGiNP6Wn62EscMxnDrljl8Sc50lql_0 2024-09-12T00:38:37.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16053411746784230350', time=2024-09-12T02:31:19.481919+0000, chain.objs.size()=1 2024-09-12T00:38:37.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.E8_kKil7RScXqD-mZGUZseCNTHZI_97_0 2024-09-12T00:38:37.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14289964603142041815', time=2024-09-12T02:31:19.501632+0000, chain.objs.size()=1 2024-09-12T00:38:37.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.qwmxbkqpcPHXjmsWZBY8seMxoILoXpf_0 2024-09-12T00:38:37.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13190632468555877989', time=2024-09-12T02:31:19.537357+0000, chain.objs.size()=1 2024-09-12T00:38:37.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Htn4LlJWCXtly3ZNixnYLHk0aStQoBm_0 2024-09-12T00:38:37.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6513918338108896733', time=2024-09-12T02:31:19.538300+0000, chain.objs.size()=1 2024-09-12T00:38:37.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.qs4vDdbN_8htdYvw40Ndq_LmEoWb1q9_0 2024-09-12T00:38:37.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13711254009909183171', time=2024-09-12T02:31:19.560252+0000, chain.objs.size()=1 2024-09-12T00:38:37.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.T7vmXj6MGdT4K-5rxF2pWTHvz55yLM3_0 2024-09-12T00:38:37.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.849315858306692089', time=2024-09-12T02:31:19.656421+0000, chain.objs.size()=1 2024-09-12T00:38:37.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.2IsvQTWGjc0R8b6L6uH5uvQ469eKTbJ_0 2024-09-12T00:38:37.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4053186391631700251', time=2024-09-12T02:31:19.667928+0000, chain.objs.size()=1 2024-09-12T00:38:37.027 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Vbhv3k14L-Evx2nxaOPKLwGvOhCpQwY_0 2024-09-12T00:38:37.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.030+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1461841298619603390', time=2024-09-12T02:31:19.683625+0000, chain.objs.size()=1 2024-09-12T00:38:37.028 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.030+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.FApkMDR_OcEZCaSEZZFg2cLbP7urXib_0 2024-09-12T00:38:37.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.032+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12343319693444356551', time=2024-09-12T02:31:19.693591+0000, chain.objs.size()=1 2024-09-12T00:38:37.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.032+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.32ZdNP-Ee6QPZsq3cCcyS2rJgIrUZzJ_0 2024-09-12T00:38:37.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.032+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8229827565605391348', time=2024-09-12T02:31:19.733283+0000, chain.objs.size()=1 2024-09-12T00:38:37.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.032+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JDMAnTTfYQRqWar-azu-UJJhi0pQVCx_0 2024-09-12T00:38:37.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.032+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7521795255300117441', time=2024-09-12T02:31:19.866300+0000, chain.objs.size()=1 2024-09-12T00:38:37.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.032+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.pfiP3DYG02qlcMaDVQnWw-EkVFa5bNW_0 2024-09-12T00:38:37.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.033+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11372986444335008953', time=2024-09-12T02:31:20.030104+0000, chain.objs.size()=1 2024-09-12T00:38:37.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.033+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.l2IcKhEnusGyBC31pZzjALAaISQThiP_0 2024-09-12T00:38:37.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.033+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.306503398048508558', time=2024-09-12T02:31:20.078280+0000, chain.objs.size()=1 2024-09-12T00:38:37.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.033+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.LwiUyhG-KML85HygPJQwhAMai8dd2Al_0 2024-09-12T00:38:37.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.033+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13879114458725957203', time=2024-09-12T02:31:20.137108+0000, chain.objs.size()=1 2024-09-12T00:38:37.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.033+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.N1VF6eAf5uHVpK5pH-vonudwu4WRU8Z_0 2024-09-12T00:38:37.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.033+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17008286329846740774', time=2024-09-12T02:31:20.275041+0000, chain.objs.size()=1 2024-09-12T00:38:37.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.033+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.6ewg5dsPJBPPVitUoLZjjsty0F0veFQ_0 2024-09-12T00:38:37.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.033+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12282681131174367495', time=2024-09-12T02:31:20.362835+0000, chain.objs.size()=1 2024-09-12T00:38:37.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.033+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.hg1cFr_j4l1UiAekNf939opP0xqtX7Y_0 2024-09-12T00:38:37.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.033+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3609244955315708624', time=2024-09-12T02:31:20.419031+0000, chain.objs.size()=1 2024-09-12T00:38:37.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.033+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.b6crVfjkkNJ49IgSMNjgZoRudmpljdO_0 2024-09-12T00:38:37.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.033+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13873842946413649729', time=2024-09-12T02:31:20.443812+0000, chain.objs.size()=1 2024-09-12T00:38:37.032 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.033+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JV5JY93QcLdX_pa2Ri-70JAvuqioxcc_0 2024-09-12T00:38:37.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.035+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8100157571204475838', time=2024-09-12T02:31:20.560306+0000, chain.objs.size()=1 2024-09-12T00:38:37.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.035+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.p7NDzZoKPigklL-rpw6MCWZIfCEO-o6_0 2024-09-12T00:38:37.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.035+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8495635611021982800', time=2024-09-12T02:31:20.594182+0000, chain.objs.size()=1 2024-09-12T00:38:37.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.035+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.E7NJW57a9FNid5UqLBmEcmsvOCVwVwl_0 2024-09-12T00:38:37.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.037+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3162416198197989078', time=2024-09-12T02:31:20.696942+0000, chain.objs.size()=1 2024-09-12T00:38:37.035 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.037+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.gKeDIoJ-8AcAGLYUXPDpVwvgrKOfbWm_0 2024-09-12T00:38:37.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.037+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18118093046070581984', time=2024-09-12T02:31:20.709706+0000, chain.objs.size()=1 2024-09-12T00:38:37.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.037+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.svbhq9w90UNfpYxE96FpfC2tTtl2cAw_0 2024-09-12T00:38:37.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.037+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13964254643945885697', time=2024-09-12T02:31:20.756421+0000, chain.objs.size()=1 2024-09-12T00:38:37.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.037+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.QaW3Cs9mGdkF7f-HlBYOWqvpfR6wC50_0 2024-09-12T00:38:37.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.038+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18191814406588584487', time=2024-09-12T02:31:20.910063+0000, chain.objs.size()=1 2024-09-12T00:38:37.036 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.038+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.yEToJbEWmGMbd9Czz1otV53f4KKRLLV_0 2024-09-12T00:38:37.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.039+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.631868208824324451', time=2024-09-12T02:31:20.992138+0000, chain.objs.size()=1 2024-09-12T00:38:37.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.039+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.W02v_pMm_UpsmbXGqj3ZAPLJLbf2tQt_0 2024-09-12T00:38:37.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.039+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12687258304359326748', time=2024-09-12T02:31:21.156160+0000, chain.objs.size()=1 2024-09-12T00:38:37.038 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.039+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.QX60V2kw6Q-bIZlrdFBzmCV4_nazuLC_0 2024-09-12T00:38:37.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.041+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.50966924609237430', time=2024-09-12T02:31:21.169590+0000, chain.objs.size()=1 2024-09-12T00:38:37.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.041+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ht0tCUKrI_ikHSthsdc81_pZGZBddku_0 2024-09-12T00:38:37.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.041+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7862351954583995677', time=2024-09-12T02:31:21.258196+0000, chain.objs.size()=1 2024-09-12T00:38:37.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.041+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.LW9DputRvZg5lmJZyW0bL8RPMxUTX3D_0 2024-09-12T00:38:37.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.041+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1516614526046988706', time=2024-09-12T02:31:21.313311+0000, chain.objs.size()=1 2024-09-12T00:38:37.039 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.041+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.fxe_lVhzC5BKzKcl7ag6K8ONR1UPmOv_0 2024-09-12T00:38:37.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.041+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1028281740641734044', time=2024-09-12T02:31:21.576303+0000, chain.objs.size()=1 2024-09-12T00:38:37.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.041+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.vQmHulU7ryXMGhqcuDqL0SIidvZaKQ2_0 2024-09-12T00:38:37.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17863010032384498589', time=2024-09-12T02:31:21.615995+0000, chain.objs.size()=1 2024-09-12T00:38:37.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NXZZAFb81pxFrhRjXkaH4bUCFlHIjwe_0 2024-09-12T00:38:37.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5372287097552448178', time=2024-09-12T02:31:21.631329+0000, chain.objs.size()=1 2024-09-12T00:38:37.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.uTqrKH_GAH6z0y_AYykJcxB5eQ6Xc0m_0 2024-09-12T00:38:37.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14628119436986629112', time=2024-09-12T02:31:29.674445+0000, chain.objs.size()=1 2024-09-12T00:38:37.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.JpVMW7Dkx7NqhgC0GC7-ceOi26GpSjm_0 2024-09-12T00:38:37.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11945457887321359728', time=2024-09-12T02:31:29.706255+0000, chain.objs.size()=1 2024-09-12T00:38:37.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.7ZPhB7jr85g2p_Th67d4b1k6aPpQ3xu_0 2024-09-12T00:38:37.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17229213080388201794', time=2024-09-12T02:31:29.737863+0000, chain.objs.size()=1 2024-09-12T00:38:37.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.30krtCmg-4h50AWg0y7TbZUNLZx_z4O_0 2024-09-12T00:38:37.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.045+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8629267999311472501', time=2024-09-12T02:31:29.799348+0000, chain.objs.size()=1 2024-09-12T00:38:37.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.045+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._5cRUyTfEGv2tGc8FGT1-gH_wJLJgk4_0 2024-09-12T00:38:37.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.045+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5960528643543865158', time=2024-09-12T02:31:29.817207+0000, chain.objs.size()=1 2024-09-12T00:38:37.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.045+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.74KvXD4Ffb08jpX4EjknaPk0LQ8bMty_0 2024-09-12T00:38:37.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.047+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.481424274300033059', time=2024-09-12T02:31:29.999504+0000, chain.objs.size()=1 2024-09-12T00:38:37.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.047+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Lt25p3FZ4RSS9_p5ftdwO8aPpF8eflz_0 2024-09-12T00:38:37.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.047+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17506875467893622155', time=2024-09-12T02:31:30.012311+0000, chain.objs.size()=1 2024-09-12T00:38:37.045 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.047+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.oswDLK2Iq0znTPpkt7ADZFwcr7QdaxO_0 2024-09-12T00:38:37.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.047+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8083527370645427732', time=2024-09-12T02:31:30.051383+0000, chain.objs.size()=1 2024-09-12T00:38:37.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.047+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.2Jcp7Ks1-lGM5dwmvW9gFUNXJwM51VJ_0 2024-09-12T00:38:37.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.047+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2004605534607614353', time=2024-09-12T02:31:30.287137+0000, chain.objs.size()=1 2024-09-12T00:38:37.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.047+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.KYVXevrDCEi_MwKHQLnQUD09gzonHiZ_0 2024-09-12T00:38:37.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.047+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11204043588717358461', time=2024-09-12T02:31:30.296152+0000, chain.objs.size()=1 2024-09-12T00:38:37.046 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.047+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.WeiPTXLAdniHd3mwBuZ1VXFcnAbdfGy_0 2024-09-12T00:38:37.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.049+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18315842842136600216', time=2024-09-12T02:31:30.376778+0000, chain.objs.size()=1 2024-09-12T00:38:37.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.049+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.y87ORSs7UKUWwUHTAlojsSuDAKJJi8u_0 2024-09-12T00:38:37.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.049+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13993479827287529229', time=2024-09-12T02:31:30.450086+0000, chain.objs.size()=1 2024-09-12T00:38:37.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.049+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.M5zJwkCYj0-4vPvpswfQmcZDDWkv1xg_0 2024-09-12T00:38:37.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.051+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3162073218753106383', time=2024-09-12T02:31:30.622564+0000, chain.objs.size()=1 2024-09-12T00:38:37.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.051+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.TUBzNV2tbcqtGE-WIbN6PCyqiX--DO8_0 2024-09-12T00:38:37.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.051+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13845122842293582691', time=2024-09-12T02:31:30.640618+0000, chain.objs.size()=1 2024-09-12T00:38:37.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.051+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.S0J4mQNpqWGKyKz5CVQ7G3AtkiZiq0r_0 2024-09-12T00:38:37.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.051+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5648949553011889543', time=2024-09-12T02:31:30.699889+0000, chain.objs.size()=1 2024-09-12T00:38:37.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.051+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.yfHpfR9trzWfeFtfzv6JSnuP3YSrhA9_0 2024-09-12T00:38:37.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.051+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3130057332802632661', time=2024-09-12T02:31:30.728145+0000, chain.objs.size()=1 2024-09-12T00:38:37.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.051+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lKCERy-3YLTwEJvvmbXnrkLloTgOJUD_0 2024-09-12T00:38:37.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.051+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2789337013311723096', time=2024-09-12T02:31:30.982263+0000, chain.objs.size()=1 2024-09-12T00:38:37.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.051+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.RhD32c71PvSz1I4SdoJ-nz5x7xZVbKU_0 2024-09-12T00:38:37.050 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.052+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7903774521736830338', time=2024-09-12T02:31:30.987013+0000, chain.objs.size()=1 2024-09-12T00:38:37.051 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.052+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.5qjbOQ03c3YDFshQu-n3ptcqNIjI5eT_0 2024-09-12T00:38:37.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.055+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/45891 2024-09-12T00:38:37.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-12T00:38:37.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9041414671356134457', time=2024-09-12T02:31:31.010142+0000, chain.objs.size()=1 2024-09-12T00:38:37.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.BzUgjv34EnqH2pfUV2BGWUaRBrQIboD_0 2024-09-12T00:38:37.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18316619889405563248', time=2024-09-12T02:31:31.028135+0000, chain.objs.size()=1 2024-09-12T00:38:37.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.9MZlEWNoNuistpnGjrebtKQ_UetYjIN_0 2024-09-12T00:38:37.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9316226917735186495', time=2024-09-12T02:31:31.137996+0000, chain.objs.size()=1 2024-09-12T00:38:37.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.QBcWwgqhMSpxmDTGqVTq5OQr9YaQnma_0 2024-09-12T00:38:37.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17270472068136530539', time=2024-09-12T02:31:31.190707+0000, chain.objs.size()=1 2024-09-12T00:38:37.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.l-giVN6Utu6N-LfM9f8lXbW6d7--i0U_0 2024-09-12T00:38:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2828629610057621148', time=2024-09-12T02:31:31.240244+0000, chain.objs.size()=1 2024-09-12T00:38:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.f7g5AKHR9q743tuEMjvrwy4WU2x_GfK_0 2024-09-12T00:38:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7741209972247541661', time=2024-09-12T02:31:31.253351+0000, chain.objs.size()=1 2024-09-12T00:38:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Aihbs-6_nUOpFWCL3awsuUXkFdvVRAZ_0 2024-09-12T00:38:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17907909179430911616', time=2024-09-12T02:31:31.278352+0000, chain.objs.size()=1 2024-09-12T00:38:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lfPOoTLvMo0YSO7MVX6zFPY73rfqvoP_0 2024-09-12T00:38:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7721364422340053533', time=2024-09-12T02:31:31.309542+0000, chain.objs.size()=1 2024-09-12T00:38:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.dGwMTXVwsjqNFBwPOpdewImj2UiCXn0_0 2024-09-12T00:38:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6465751865760579725', time=2024-09-12T02:31:31.461582+0000, chain.objs.size()=1 2024-09-12T00:38:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.W0BbrFcf_pWojn_0toxQjLvjKdvbxAm_0 2024-09-12T00:38:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13471740645108507', time=2024-09-12T02:31:31.473019+0000, chain.objs.size()=1 2024-09-12T00:38:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.diEgka7ZcjF4vSOV0ZsfHOf41KqEV0s_0 2024-09-12T00:38:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11579021028711665546', time=2024-09-12T02:31:31.479979+0000, chain.objs.size()=1 2024-09-12T00:38:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.hiXe57Xcp3OOG4eVLFvwCkQKoRDgsIT_0 2024-09-12T00:38:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12087630152615296942', time=2024-09-12T02:31:31.517365+0000, chain.objs.size()=1 2024-09-12T00:38:37.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.FG2-6WfN63thusuT9CmKPCp83sjPG4A_0 2024-09-12T00:38:37.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.062+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12563034454860089831', time=2024-09-12T02:31:31.521421+0000, chain.objs.size()=1 2024-09-12T00:38:37.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.062+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.jw-mpKWfSGlBTFLabf1SRooPQptyYtZ_0 2024-09-12T00:38:37.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.062+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15033171139051720481', time=2024-09-12T02:31:31.533310+0000, chain.objs.size()=1 2024-09-12T00:38:37.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.062+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.nqHJYEnnAl0v0XzRuHE77kqdZpIX3hW_0 2024-09-12T00:38:37.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.062+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18122748831347972592', time=2024-09-12T02:31:31.560995+0000, chain.objs.size()=1 2024-09-12T00:38:37.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.062+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-qjWNJbjgA0IakCZZjcobqf_NCi2wLM_0 2024-09-12T00:38:37.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.062+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10493404588674570575', time=2024-09-12T02:31:31.577942+0000, chain.objs.size()=1 2024-09-12T00:38:37.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.062+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Z4iMhdjM7tWjzBS6xKfpHY823P4okMh_0 2024-09-12T00:38:37.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.063+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5778324717075579071', time=2024-09-12T02:31:31.586788+0000, chain.objs.size()=1 2024-09-12T00:38:37.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.063+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.df-Gwb_GKv-_GQ5Ss8nIwqmFQySugY__0 2024-09-12T00:38:37.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.063+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3223264786012281534', time=2024-09-12T02:31:31.729655+0000, chain.objs.size()=1 2024-09-12T00:38:37.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.063+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.cPuu47RYLrgDG21y5BDvAwZbr5LTCkd_0 2024-09-12T00:38:37.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.063+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2742961977251397712', time=2024-09-12T02:31:31.730661+0000, chain.objs.size()=1 2024-09-12T00:38:37.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.063+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.BjHbbwqkKz-7foYv5-JaxBdvfRLv4I0_0 2024-09-12T00:38:37.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.063+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2997762938227967281', time=2024-09-12T02:31:31.759358+0000, chain.objs.size()=1 2024-09-12T00:38:37.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.063+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.6kaF_HGPOw-ENXeH_VNkk_BVOwtGOZa_0 2024-09-12T00:38:37.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.063+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13441356711309740653', time=2024-09-12T02:31:31.780518+0000, chain.objs.size()=1 2024-09-12T00:38:37.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.063+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.bheb6gCqEWtSAaERsha9DcdIbqG66f-_0 2024-09-12T00:38:37.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.063+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6307156878516377353', time=2024-09-12T02:31:31.806271+0000, chain.objs.size()=1 2024-09-12T00:38:37.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.063+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.n2HyIsvUkkZb1V4ocwnTRPEMMhZCoNS_0 2024-09-12T00:38:37.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.063+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16872271846007113646', time=2024-09-12T02:31:31.815638+0000, chain.objs.size()=1 2024-09-12T00:38:37.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.063+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.dUb3xYcOm9cuvzc-4Tte8istiennDfR_0 2024-09-12T00:38:37.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.066+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6079191338754696679', time=2024-09-12T02:31:35.194552+0000, chain.objs.size()=1 2024-09-12T00:38:37.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.066+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.339__shadow_.SbiGnn5lH1xQGRx7E1nhiTM6HqMwC5p_0 2024-09-12T00:38:37.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.067+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18188122129602006348', time=2024-09-12T02:31:43.173731+0000, chain.objs.size()=1 2024-09-12T00:38:37.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.067+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.374__shadow_.7v5fsF-sq1jN5Q09I6Qm5vCrrdaP2Se_0 2024-09-12T00:38:37.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.067+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6129127675748971732', time=2024-09-12T02:32:02.179768+0000, chain.objs.size()=1 2024-09-12T00:38:37.065 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.067+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.443__shadow_.wqTWXcT_qnu6FSzEuA7MsUGPChF3vcJ_0 2024-09-12T00:38:37.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.067+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8050394004916662347', time=2024-09-12T02:32:08.070926+0000, chain.objs.size()=1 2024-09-12T00:38:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.067+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.462__shadow_.QUCd0Ls0UCIkhTkvValHIDBx9s8rTVv_0 2024-09-12T00:38:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.067+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5771638317647227158', time=2024-09-12T02:32:08.811611+0000, chain.objs.size()=1 2024-09-12T00:38:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.067+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.464__shadow_.J2Yn8tXG0sdFF8Dc1To0_2bsB63xQxF_0 2024-09-12T00:38:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6065171813694020126', time=2024-09-12T02:32:09.387835+0000, chain.objs.size()=1 2024-09-12T00:38:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.466__shadow_.lGmaaXY5TtJiz9oNI9kAIwjPHGUbCdG_0 2024-09-12T00:38:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18236234523593915910', time=2024-09-12T02:32:14.629594+0000, chain.objs.size()=1 2024-09-12T00:38:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.490__shadow_.A3XjglGeyckQpBiHfuQ7aAZNs1ldEc1_0 2024-09-12T00:38:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18236234523593915910', time=2024-09-12T02:32:14.737078+0000, chain.objs.size()=1 2024-09-12T00:38:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.490__shadow_.A3XjglGeyckQpBiHfuQ7aAZNs1ldEc1_0 2024-09-12T00:38:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4664676912821269087', time=2024-09-12T02:32:35.423244+0000, chain.objs.size()=2 2024-09-12T00:38:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.528__multipart_mymultipart.2~EZBKFF-gvKN-Yuq7bGfQchMCZdSvEAy.1 2024-09-12T00:38:37.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.528__multipart_mymultipart.2~EZBKFF-gvKN-Yuq7bGfQchMCZdSvEAy.2 2024-09-12T00:38:37.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2716374051168732967', time=2024-09-12T02:33:18.587528+0000, chain.objs.size()=1 2024-09-12T00:38:37.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:LGrAneyB6Y18CmTOQVVm2g3VzMASofM_.YL1EnmKDeYaWb76j1UlYmzY0KDXBrzp_0 2024-09-12T00:38:37.069 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.071+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5799408328911811618', time=2024-09-12T02:33:39.920982+0000, chain.objs.size()=1 2024-09-12T00:38:37.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.071+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:XF1hlPCkE5K0QP1trah3iIMXl1FH946_.ESvYKRefQqDYHm1uazuWIgbEbjhXKjE_0 2024-09-12T00:38:37.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.071+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6989619729861375354', time=2024-09-12T02:33:45.831593+0000, chain.objs.size()=1 2024-09-12T00:38:37.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.071+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.579__shadow:ZWjvKPnDC2HyWsyZGgKYQuX0uZ-flV-_.lrm6TyesZotLkUDnA8kfw49bsR8Pofu_0 2024-09-12T00:38:37.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.072+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11664759387297808084', time=2024-09-12T02:33:47.154604+0000, chain.objs.size()=1 2024-09-12T00:38:37.070 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.072+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.582__shadow:kPRsPVkp33eXSNTThxdONa3RTvNekzr_.v16Gg55jGSgVQsbUqnH3boyczF-aj9K_0 2024-09-12T00:38:37.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.073+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11969011865566349814', time=2024-09-12T02:34:58.949862+0000, chain.objs.size()=1 2024-09-12T00:38:37.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.073+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.617__shadow_.PTNmbHkyen729a6FwMwpzgh8_qftoR3_0 2024-09-12T00:38:37.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.077+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:37.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.080+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:38:37.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.081+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:37.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.082+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:37.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50982' 2024-09-12T00:38:37.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16010677909412208500', time=2024-09-12T02:29:24.705433+0000, chain.objs.size()=3 2024-09-12T00:38:37.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.159__multipart_mymultipart-FROZEN.2~-Djd7qCLUa28qHFs2zBV_WaKeefP8dd.1 2024-09-12T00:38:37.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.159__multipart_mymultipart-FROZEN.2~-Djd7qCLUa28qHFs2zBV_WaKeefP8dd.2 2024-09-12T00:38:37.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.159__multipart_mymultipart-FROZEN.2~-Djd7qCLUa28qHFs2zBV_WaKeefP8dd.3 2024-09-12T00:38:37.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~uzL-FnFibVeqNtCRifI8wxpcDqSm4xT', time=2024-09-12T02:29:45.119345+0000, chain.objs.size()=1 2024-09-12T00:38:37.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.202__multipart_mymultipart.2~uzL-FnFibVeqNtCRifI8wxpcDqSm4xT.1 2024-09-12T00:38:37.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11195815176588629062', time=2024-09-12T02:30:40.638838+0000, chain.objs.size()=1 2024-09-12T00:38:37.082 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.243__shadow_.ShFEXl_eTkKy6sLVAd4_es5q5YQN68W_0 2024-09-12T00:38:37.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12164887684016964914', time=2024-09-12T02:30:42.164946+0000, chain.objs.size()=1 2024-09-12T00:38:37.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.249__shadow_.Vun2SWPZyZbjGuenwpIGpAkBkUIJYrs_0 2024-09-12T00:38:37.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16322169115635662349', time=2024-09-12T02:30:53.122207+0000, chain.objs.size()=1 2024-09-12T00:38:37.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ZzjhvIDB7YrxssiUgih4rmUgv5DGTqW_0 2024-09-12T00:38:37.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6567208533935846208', time=2024-09-12T02:30:53.265908+0000, chain.objs.size()=1 2024-09-12T00:38:37.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.EZHEM5-KsWCMWl_WqTQzJdI0Ow_xTkw_0 2024-09-12T00:38:37.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4290807020415641733', time=2024-09-12T02:30:53.291101+0000, chain.objs.size()=1 2024-09-12T00:38:37.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.0P94JMH-b4_zTNhfdztz2M5Rg-bLPno_0 2024-09-12T00:38:37.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.842893504796538791', time=2024-09-12T02:30:53.303773+0000, chain.objs.size()=1 2024-09-12T00:38:37.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.IlFjStpUgSl0OTdwrWMLZXqkxjGf8PG_0 2024-09-12T00:38:37.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10877341123531773015', time=2024-09-12T02:30:53.395452+0000, chain.objs.size()=1 2024-09-12T00:38:37.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6Vtd73w6lo67nV1li84gqvWNI4VKdUl_0 2024-09-12T00:38:37.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6513479303116251801', time=2024-09-12T02:30:53.479480+0000, chain.objs.size()=1 2024-09-12T00:38:37.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.EfmHhN_se4ZtF3Vnoy2QcRugCuHIZlR_0 2024-09-12T00:38:37.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.086+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2488604346268379075', time=2024-09-12T02:30:53.487593+0000, chain.objs.size()=1 2024-09-12T00:38:37.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.086+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.QmAXYB4elG-1hGuzU6RYCNyrfGdyolN_0 2024-09-12T00:38:37.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.087+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6148905783404733395', time=2024-09-12T02:30:53.565511+0000, chain.objs.size()=1 2024-09-12T00:38:37.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.087+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.UIIk9VLOKxGRJgarzgkZ37zOYedp0Hm_0 2024-09-12T00:38:37.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.087+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13675942524665824464', time=2024-09-12T02:30:53.778545+0000, chain.objs.size()=1 2024-09-12T00:38:37.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.087+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Jb603Y8zPzUCn60G1lD4tKR2TNEZx5A_0 2024-09-12T00:38:37.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.087+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6144946254281746700', time=2024-09-12T02:30:53.791518+0000, chain.objs.size()=1 2024-09-12T00:38:37.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.087+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.KhiAZz6fnxBrJk7e967MNs0m2W09z3w_0 2024-09-12T00:38:37.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.087+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12737820216825612931', time=2024-09-12T02:30:53.938434+0000, chain.objs.size()=1 2024-09-12T00:38:37.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.088+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6fFCQ3V2CaJhl81l9XYGdFAAFFT_F8w_0 2024-09-12T00:38:37.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.088+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15685950551933392474', time=2024-09-12T02:30:53.946299+0000, chain.objs.size()=1 2024-09-12T00:38:37.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.088+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.g_SU4-neV6j1ISEZAWxnwT_CBNEB3nh_0 2024-09-12T00:38:37.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.088+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3569896375380501315', time=2024-09-12T02:30:53.947118+0000, chain.objs.size()=1 2024-09-12T00:38:37.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.088+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.0DlkgNiya4wfSkEjItqYoLAZo3LbA8g_0 2024-09-12T00:38:37.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.088+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8835577094376051984', time=2024-09-12T02:30:53.950695+0000, chain.objs.size()=1 2024-09-12T00:38:37.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.088+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YofDK2ui4WyHUoz9rn8mTCcYzF1U4sx_0 2024-09-12T00:38:37.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.089+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13268372216889283011', time=2024-09-12T02:30:53.972809+0000, chain.objs.size()=1 2024-09-12T00:38:37.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.089+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.j-QzzGAFW2HztFEAxD3aYmW26SCdeWx_0 2024-09-12T00:38:37.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.089+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.767525473143581847', time=2024-09-12T02:30:54.153835+0000, chain.objs.size()=1 2024-09-12T00:38:37.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.089+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.cSMDbqJ2PdQpPolBQUeNM3BOUbv3sEa_0 2024-09-12T00:38:37.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.090+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4241730881907869872', time=2024-09-12T02:30:54.319495+0000, chain.objs.size()=1 2024-09-12T00:38:37.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.090+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.X2nH5dqG9p47FK2h2-BdZ__h0tB8iQg_0 2024-09-12T00:38:37.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.090+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11006925424074612013', time=2024-09-12T02:30:54.421887+0000, chain.objs.size()=1 2024-09-12T00:38:37.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.090+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.igzfRPHJ5PBc3qCDpPDmH3C_XpVmufj_0 2024-09-12T00:38:37.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.092+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2536218329027635514', time=2024-09-12T02:30:54.434517+0000, chain.objs.size()=1 2024-09-12T00:38:37.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.092+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.9f8Kc4_wmiOhnoOzLapJHgPlQTR5qPS_0 2024-09-12T00:38:37.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.092+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8194257611502476855', time=2024-09-12T02:30:54.462925+0000, chain.objs.size()=1 2024-09-12T00:38:37.090 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.092+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_._wKUVVM3ctqeytpFf4LcoO2qDw9p8qx_0 2024-09-12T00:38:37.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.092+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13505729169125086988', time=2024-09-12T02:30:54.827741+0000, chain.objs.size()=1 2024-09-12T00:38:37.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.092+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Te3dJRrlG9Vjh8gum6NitSvoOva3xs6_0 2024-09-12T00:38:37.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.092+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6607858050318060870', time=2024-09-12T02:30:54.851245+0000, chain.objs.size()=1 2024-09-12T00:38:37.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.092+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pcFDQybsqwQ5JlRHTn9du3_2cfEdi8t_0 2024-09-12T00:38:37.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.092+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8866617993645808758', time=2024-09-12T02:30:55.099807+0000, chain.objs.size()=1 2024-09-12T00:38:37.091 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.092+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.QFR1bWeR2dE-98VpZytLCcSo7yMH6JA_0 2024-09-12T00:38:37.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.093+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13770601597986783147', time=2024-09-12T02:30:55.102199+0000, chain.objs.size()=1 2024-09-12T00:38:37.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.093+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-Iep-L4AxNV1BmI-AS-Q1moAWPsJY8K_0 2024-09-12T00:38:37.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.093+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10637282806853467295', time=2024-09-12T02:30:55.106381+0000, chain.objs.size()=1 2024-09-12T00:38:37.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.093+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.9Qno4L4fgn-9P6n_mWMeEF7cuHfcT0C_0 2024-09-12T00:38:37.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.093+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3674163090848712224', time=2024-09-12T02:30:55.111633+0000, chain.objs.size()=1 2024-09-12T00:38:37.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.093+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.28akekYbHWT1_adcWgUdl4eQhkMgmXO_0 2024-09-12T00:38:37.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.093+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6192989423596553807', time=2024-09-12T02:30:55.170175+0000, chain.objs.size()=1 2024-09-12T00:38:37.092 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.093+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AlrJcme3TWZj400Z5c6z4_Az6oetbi7_0 2024-09-12T00:38:37.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.095+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6949916095086238131', time=2024-09-12T02:31:01.634747+0000, chain.objs.size()=1 2024-09-12T00:38:37.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.095+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.288__shadow_.qFy7C09u6IcTkC4znum3TybH_fyd67m_0 2024-09-12T00:38:37.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.095+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12192829181782740042', time=2024-09-12T02:31:03.051147+0000, chain.objs.size()=1 2024-09-12T00:38:37.094 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.095+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.SXrTr1nmqaIjbo0zBiw9XWLuuLgbYX__0 2024-09-12T00:38:37.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17302214615934328709', time=2024-09-12T02:31:03.664290+0000, chain.objs.size()=1 2024-09-12T00:38:37.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.9m0n1F2APX05jVSNT2gxJ9OMijNkSmK_0 2024-09-12T00:38:37.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16641905742191416551', time=2024-09-12T02:31:19.398787+0000, chain.objs.size()=1 2024-09-12T00:38:37.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.pzr99BGYL65hx7VcB7ICPEHJX3yhk_l_0 2024-09-12T00:38:37.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7992196315284209328', time=2024-09-12T02:31:19.436821+0000, chain.objs.size()=1 2024-09-12T00:38:37.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.cjj8y6FU6evjduXETbyxtNp90uLdskO_0 2024-09-12T00:38:37.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14728091576753660819', time=2024-09-12T02:31:19.480231+0000, chain.objs.size()=1 2024-09-12T00:38:37.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.DP9d_iCZa5BfjZ1y0dzIHI8eOgH8EF__0 2024-09-12T00:38:37.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15290550850784910499', time=2024-09-12T02:31:19.528695+0000, chain.objs.size()=1 2024-09-12T00:38:37.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.RNx1NSkgVaac8ILnvlTJbSu8mHLv3Dt_0 2024-09-12T00:38:37.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16711879787433730978', time=2024-09-12T02:31:19.562931+0000, chain.objs.size()=1 2024-09-12T00:38:37.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.GVTKCAbT2TYuDqP_H7pdpAziceGaOsG_0 2024-09-12T00:38:37.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3855705816959972364', time=2024-09-12T02:31:19.693897+0000, chain.objs.size()=1 2024-09-12T00:38:37.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.zcY_maTjbj-QwQmsphRsCDe8taabGYX_0 2024-09-12T00:38:37.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8261374119626846020', time=2024-09-12T02:31:19.711184+0000, chain.objs.size()=1 2024-09-12T00:38:37.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.097+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Sr8S7RW492-xpcSsJ7ecuNktdph_PRI_0 2024-09-12T00:38:37.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.101+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11902595998792326394', time=2024-09-12T02:31:19.733537+0000, chain.objs.size()=1 2024-09-12T00:38:37.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.101+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.qzyB_N9M93d2SifTObOhndnjgpbieUP_0 2024-09-12T00:38:37.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.101+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3446002631060897746', time=2024-09-12T02:31:19.741315+0000, chain.objs.size()=1 2024-09-12T00:38:37.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.101+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JypBXokIIIAP1hHxzNYpmUMSyLsxqL2_0 2024-09-12T00:38:37.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.101+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.501939191508769893', time=2024-09-12T02:31:19.844704+0000, chain.objs.size()=1 2024-09-12T00:38:37.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.101+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.QlEkzkRhZyKWm5-X77amYrc1xzNu-je_0 2024-09-12T00:38:37.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17409115833418437206', time=2024-09-12T02:31:19.965779+0000, chain.objs.size()=1 2024-09-12T00:38:37.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NRvvHmb9x2JPe9Sm8qYtIeaZVJE1UqU_0 2024-09-12T00:38:37.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4862382000075356312', time=2024-09-12T02:31:19.971880+0000, chain.objs.size()=1 2024-09-12T00:38:37.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.DIcJwKq015CDPAzHldtLE9vfWecCAUb_0 2024-09-12T00:38:37.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9531120117576043026', time=2024-09-12T02:31:20.016411+0000, chain.objs.size()=1 2024-09-12T00:38:37.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.1jzwEmlZhegiTY2vi7eusqG5tmJ3PuC_0 2024-09-12T00:38:37.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4494190526220404031', time=2024-09-12T02:31:20.020802+0000, chain.objs.size()=1 2024-09-12T00:38:37.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NrM-BM9vTo79ZBTvKMzDv7LJENAchFv_0 2024-09-12T00:38:37.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2262196410060364667', time=2024-09-12T02:31:20.027615+0000, chain.objs.size()=1 2024-09-12T00:38:37.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IYY-Ufu8hfnb26kfX5uMlaAU_McPhO5_0 2024-09-12T00:38:37.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3055229541396152374', time=2024-09-12T02:31:20.033918+0000, chain.objs.size()=1 2024-09-12T00:38:37.102 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.sonTBPvKpHSU5vowPeWeqipO1P6Po4L_0 2024-09-12T00:38:37.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5146651956562499862', time=2024-09-12T02:31:20.098229+0000, chain.objs.size()=1 2024-09-12T00:38:37.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.H9yDTsb0lt4OtEoJWAPrv6z7TDLbAzh_0 2024-09-12T00:38:37.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3153275742626803355', time=2024-09-12T02:31:20.156415+0000, chain.objs.size()=1 2024-09-12T00:38:37.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.103+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.AsbB_Y9x0j8bBB20_d2o5P-tsLzSD_K_0 2024-09-12T00:38:37.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.106+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2717164140207947068', time=2024-09-12T02:31:20.282692+0000, chain.objs.size()=1 2024-09-12T00:38:37.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.106+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.G78jeq60c2CH4pwOkxjmBrtbiJR-Zzp_0 2024-09-12T00:38:37.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.107+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14833345493885182146', time=2024-09-12T02:31:20.302086+0000, chain.objs.size()=1 2024-09-12T00:38:37.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.107+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.cIOi6o2XekCqhY1OCsSlHIHyKPG9cl7_0 2024-09-12T00:38:37.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.107+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6971807847850492697', time=2024-09-12T02:31:20.328692+0000, chain.objs.size()=1 2024-09-12T00:38:37.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.107+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.vrNftmeIoRqDlJyxw1AvnqUtWvTvPUw_0 2024-09-12T00:38:37.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.107+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4452466220221402893', time=2024-09-12T02:31:20.384426+0000, chain.objs.size()=1 2024-09-12T00:38:37.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.107+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.eVIxeikIryIwsljWmoVx7jg3UxjlX83_0 2024-09-12T00:38:37.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.107+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11004654193235360711', time=2024-09-12T02:31:20.747424+0000, chain.objs.size()=1 2024-09-12T00:38:37.105 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.107+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.W_HXU06uPqIkusiUyhVYcwZMG8uPGZh_0 2024-09-12T00:38:37.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.108+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11374108760284320772', time=2024-09-12T02:31:20.774763+0000, chain.objs.size()=1 2024-09-12T00:38:37.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.108+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.-UlYzexe95hqgaPx6Z6XQeU5tk1fwkY_0 2024-09-12T00:38:37.107 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.109+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6336071312099936814', time=2024-09-12T02:31:20.974754+0000, chain.objs.size()=1 2024-09-12T00:38:37.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.109+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.M7K-sQ38Jf_eyNacWXpq2S5RouTHXBA_0 2024-09-12T00:38:37.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.109+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1476247418859363068', time=2024-09-12T02:31:21.170938+0000, chain.objs.size()=1 2024-09-12T00:38:37.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.109+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.3--NPi8hFlv-9dT-bdnQSci88KEl0Gc_0 2024-09-12T00:38:37.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.109+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17854454059864155841', time=2024-09-12T02:31:21.479430+0000, chain.objs.size()=1 2024-09-12T00:38:37.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.109+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.opu9wvNzBNN4d4MAr5I7WhXD9O8pGwy_0 2024-09-12T00:38:37.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.109+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12939744322124941006', time=2024-09-12T02:31:21.484555+0000, chain.objs.size()=1 2024-09-12T00:38:37.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.109+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.FHXrD-EALOjRvkC2kn4C1-Bf9QlNi2a_0 2024-09-12T00:38:37.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.109+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6247450065152984543', time=2024-09-12T02:31:21.510813+0000, chain.objs.size()=1 2024-09-12T00:38:37.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.109+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.AcTBRs_fDkCV7sC5fAVW7k_tBB1MLqN_0 2024-09-12T00:38:37.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.111+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6165598553536980109', time=2024-09-12T02:31:21.563910+0000, chain.objs.size()=1 2024-09-12T00:38:37.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.111+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.LyAU9fVXMySxuBsZwtocGdGC7hhFckY_0 2024-09-12T00:38:37.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.114+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10203836701324546745', time=2024-09-12T02:31:21.592912+0000, chain.objs.size()=1 2024-09-12T00:38:37.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.114+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.qzgR0cI0LbNIgTqtqVEw40gtqGhV9r-_0 2024-09-12T00:38:37.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.114+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.968799074785640368', time=2024-09-12T02:31:21.636886+0000, chain.objs.size()=1 2024-09-12T00:38:37.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.114+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.A7BrIzC0ynmwDtS_s4RaGbLA7w0L0M8_0 2024-09-12T00:38:37.112 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.114+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14954655634097124680', time=2024-09-12T02:31:29.717794+0000, chain.objs.size()=1 2024-09-12T00:38:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.114+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.pptVtuUBEMAqYAGNB7ayeT5gTPOsa5N_0 2024-09-12T00:38:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.114+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3725319607535442759', time=2024-09-12T02:31:29.765007+0000, chain.objs.size()=1 2024-09-12T00:38:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.114+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mvtK4ai8i4jQ9XEEuApK4Y4DTXdxben_0 2024-09-12T00:38:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.114+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6548321194435536192', time=2024-09-12T02:31:29.796435+0000, chain.objs.size()=1 2024-09-12T00:38:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.114+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.LekFIh6p2eixUUwXffyNUJWHjFk0x-O_0 2024-09-12T00:38:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.115+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17164953396411644301', time=2024-09-12T02:31:29.859369+0000, chain.objs.size()=1 2024-09-12T00:38:37.113 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.115+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.TM-Q_zHWGB1DniDK0-2o-fvBOdiFYHC_0 2024-09-12T00:38:37.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.116+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2913984038512759540', time=2024-09-12T02:31:30.025315+0000, chain.objs.size()=1 2024-09-12T00:38:37.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.116+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.S7bMv9s8VIbdmq8yx2277eint-DtfGr_0 2024-09-12T00:38:37.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.116+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12232115855722388720', time=2024-09-12T02:31:30.049570+0000, chain.objs.size()=1 2024-09-12T00:38:37.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.116+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ubUyJLMvWmz4xXXdagzvhUFDOKuq2AB_0 2024-09-12T00:38:37.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.116+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5192068513778090509', time=2024-09-12T02:31:30.116674+0000, chain.objs.size()=1 2024-09-12T00:38:37.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.116+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.L2B6IswixXTHAnGC44Gen_sn2_4QS5G_0 2024-09-12T00:38:37.114 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.116+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8048936562931624454', time=2024-09-12T02:31:30.153809+0000, chain.objs.size()=1 2024-09-12T00:38:37.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.116+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.D1tmz0kZJcrx3ic1TNs1GRLk5H1Fcyl_0 2024-09-12T00:38:37.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.117+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8936251071651181757', time=2024-09-12T02:31:30.334386+0000, chain.objs.size()=1 2024-09-12T00:38:37.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.117+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.As_W7hPQ_oVO6A5_HsBoD49lCW3wM2P_0 2024-09-12T00:38:37.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.118+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18071118614716284799', time=2024-09-12T02:31:30.399060+0000, chain.objs.size()=1 2024-09-12T00:38:37.116 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.118+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lPul_awza2stBN11LaUAwlG8tQZm7Hp_0 2024-09-12T00:38:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.118+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2946606623406262522', time=2024-09-12T02:31:30.407367+0000, chain.objs.size()=1 2024-09-12T00:38:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.118+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.PF3UIzmZrKi-8UnNMwZkC_DlT-lHZw3_0 2024-09-12T00:38:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.118+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13376040832922819211', time=2024-09-12T02:31:30.680374+0000, chain.objs.size()=1 2024-09-12T00:38:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.118+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.qXnEMq2_LCOogQfMiRjVxSGWvD5Mvrv_0 2024-09-12T00:38:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.118+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6720327302682042981', time=2024-09-12T02:31:30.848453+0000, chain.objs.size()=1 2024-09-12T00:38:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.118+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.fkmgW7T11NlIZs6gfrIaeHf8qV83djM_0 2024-09-12T00:38:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.118+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9953382193217599499', time=2024-09-12T02:31:30.945276+0000, chain.objs.size()=1 2024-09-12T00:38:37.117 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.118+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.j7QhJGGRYWSiku0UyxSdkxYWVepPc0Z_0 2024-09-12T00:38:37.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.120+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2613842606261665920', time=2024-09-12T02:31:30.983660+0000, chain.objs.size()=1 2024-09-12T00:38:37.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.120+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.TdX9yoIHN6Hs9cwOuedQXUV4r0RTWGF_0 2024-09-12T00:38:37.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.120+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4779660048543188329', time=2024-09-12T02:31:30.994028+0000, chain.objs.size()=1 2024-09-12T00:38:37.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.120+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.pgWBd3zT1TKTnrsKZ9Vhl_Dl8qIq7s3_0 2024-09-12T00:38:37.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.120+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8497653331580241099', time=2024-09-12T02:31:31.129491+0000, chain.objs.size()=1 2024-09-12T00:38:37.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.120+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.JV2jWgXyAGSL54uyDoSBDVlxvh9KQZG_0 2024-09-12T00:38:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2531049402811967850', time=2024-09-12T02:31:31.201425+0000, chain.objs.size()=1 2024-09-12T00:38:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.qfYsbOJpi51z0QgzVT-j7rpjHKWIunF_0 2024-09-12T00:38:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3136513256039850449', time=2024-09-12T02:31:31.228255+0000, chain.objs.size()=1 2024-09-12T00:38:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.GGUrNUqh5fh5NBKTnkqlEFoy5OQTB-Y_0 2024-09-12T00:38:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17685553849310501023', time=2024-09-12T02:31:31.273296+0000, chain.objs.size()=1 2024-09-12T00:38:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-roqcGh--awD9uqKS6Os0eZGketNDUm_0 2024-09-12T00:38:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4197182387325458109', time=2024-09-12T02:31:31.281669+0000, chain.objs.size()=1 2024-09-12T00:38:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.o3NF5c0sjZbkJJwCu6iuSRvBklbLjQV_0 2024-09-12T00:38:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8912256361888205675', time=2024-09-12T02:31:31.497371+0000, chain.objs.size()=1 2024-09-12T00:38:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.3JQ4CYot5c2isHxubt_8NMyaTU5qLTc_0 2024-09-12T00:38:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4090116351329082315', time=2024-09-12T02:31:31.547134+0000, chain.objs.size()=1 2024-09-12T00:38:37.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.D_dJz5fb61HGQyaMl9gBw9knOB2pPWI_0 2024-09-12T00:38:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4503868657922542335', time=2024-09-12T02:31:31.568606+0000, chain.objs.size()=1 2024-09-12T00:38:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.8gXIvw2FMiA1ysQY9hewk6ObylKYezK_0 2024-09-12T00:38:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4941678200902184792', time=2024-09-12T02:31:32.648387+0000, chain.objs.size()=1 2024-09-12T00:38:37.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.123+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.328__shadow_.TCyatZ1lH4MNQo5RmbbLNqNz87Y-NFx_0 2024-09-12T00:38:37.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.126+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1084520927040937045', time=2024-09-12T02:31:41.172056+0000, chain.objs.size()=1 2024-09-12T00:38:37.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.126+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.370__shadow_.3Wc0kXUM18jnKQiUcZQsYGO9WlvwWqU_0 2024-09-12T00:38:37.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.126+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.713016396861934149', time=2024-09-12T02:31:47.478636+0000, chain.objs.size()=1 2024-09-12T00:38:37.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.126+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.390__shadow_.sshgc7N0gNsOx55Xl5f15b2QrTgDb0S_0 2024-09-12T00:38:37.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.126+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1099038798909269937', time=2024-09-12T02:32:04.966319+0000, chain.objs.size()=1 2024-09-12T00:38:37.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.126+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.454__shadow_.lZei00RqsK61RublB8Hy665EGZBm9zX_0 2024-09-12T00:38:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.130+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10780838955799425793', time=2024-09-12T02:32:05.346188+0000, chain.objs.size()=1 2024-09-12T00:38:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.455__shadow_.z4REtDP2SGwsDchqMHXfdboGsT9-Ylv_0 2024-09-12T00:38:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.130+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5490173293106932182', time=2024-09-12T02:32:12.588966+0000, chain.objs.size()=1 2024-09-12T00:38:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.483__shadow_.Iok3DigZuflIHRXVn6P8TKL6kD2rWyc_0 2024-09-12T00:38:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.130+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10452491863899317162', time=2024-09-12T02:32:20.025024+0000, chain.objs.size()=6 2024-09-12T00:38:37.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.1 2024-09-12T00:38:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.2 2024-09-12T00:38:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.3 2024-09-12T00:38:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.4 2024-09-12T00:38:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.5 2024-09-12T00:38:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.6 2024-09-12T00:38:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.130+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5716693739011196519', time=2024-09-12T02:32:32.036120+0000, chain.objs.size()=3 2024-09-12T00:38:37.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.523__multipart_mymultipart.2~uWqCba4BEDPT2cMp888wgz9zaxTNUYu.1 2024-09-12T00:38:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.134+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.523__multipart_mymultipart.2~uWqCba4BEDPT2cMp888wgz9zaxTNUYu.2 2024-09-12T00:38:37.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.134+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.523__multipart_mymultipart.2~uWqCba4BEDPT2cMp888wgz9zaxTNUYu.3 2024-09-12T00:38:37.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.136+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~DHVFbd-zZ_k8XMeDISs6HRza51hO6Mi', time=2024-09-12T02:32:35.702733+0000, chain.objs.size()=2 2024-09-12T00:38:37.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.136+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.529__multipart_mymultipart.2~DHVFbd-zZ_k8XMeDISs6HRza51hO6Mi.1 2024-09-12T00:38:37.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.136+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.529__multipart_mymultipart.2~DHVFbd-zZ_k8XMeDISs6HRza51hO6Mi.2 2024-09-12T00:38:37.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.136+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7302163207011848715', time=2024-09-12T02:32:51.065409+0000, chain.objs.size()=4 2024-09-12T00:38:37.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.136+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.535__multipart_mymultipart.2~zEfbHgPRbE0RayCocveLws--SuL7ZNg.1 2024-09-12T00:38:37.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.136+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.535__multipart_mymultipart.2~zEfbHgPRbE0RayCocveLws--SuL7ZNg.2 2024-09-12T00:38:37.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.136+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.535__multipart_mymultipart.HDFvW-hqAOiYElxuFpcYBsNP9ahCWMDr.3 2024-09-12T00:38:37.135 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.136+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.535__multipart_mymultipart.2~zEfbHgPRbE0RayCocveLws--SuL7ZNg.4 2024-09-12T00:38:37.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.141+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/50982 2024-09-12T00:38:37.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T00:38:37.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3371505707196745234', time=2024-09-12T02:33:07.688692+0000, chain.objs.size()=1 2024-09-12T00:38:37.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.556__shadow_.Xp8_VVV5kAmQaeF_O8oetTzbFpPmX8F_0 2024-09-12T00:38:37.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.621179602996483374', time=2024-09-12T02:33:24.573768+0000, chain.objs.size()=1 2024-09-12T00:38:37.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.574__shadow_.s7-dHXrvUQXjTQIB1sE78dtX5CPqTdg_0 2024-09-12T00:38:37.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8250856890777655702', time=2024-09-12T02:33:42.322750+0000, chain.objs.size()=1 2024-09-12T00:38:37.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:Go9vm9hIeQfbOmkSj0tVSDYKO9D5o5v_.8DdlOigRmXFdU3gpw_fKEYpoPzcKdwj_0 2024-09-12T00:38:37.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~Et7DHaFJ6CuiIKYWtJvUfaVlRJVwhNn', time=2024-09-12T02:36:03.951067+0000, chain.objs.size()=6 2024-09-12T00:38:37.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.625__multipart_multipart_enc.2~Et7DHaFJ6CuiIKYWtJvUfaVlRJVwhNn.1 2024-09-12T00:38:37.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.625__multipart_multipart_enc.2~Et7DHaFJ6CuiIKYWtJvUfaVlRJVwhNn.2 2024-09-12T00:38:37.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.625__multipart_multipart_enc.2~Et7DHaFJ6CuiIKYWtJvUfaVlRJVwhNn.3 2024-09-12T00:38:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.625__multipart_multipart_enc.2~Et7DHaFJ6CuiIKYWtJvUfaVlRJVwhNn.4 2024-09-12T00:38:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.625__multipart_multipart_enc.2~Et7DHaFJ6CuiIKYWtJvUfaVlRJVwhNn.5 2024-09-12T00:38:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.625__multipart_multipart_enc.2~Et7DHaFJ6CuiIKYWtJvUfaVlRJVwhNn.6 2024-09-12T00:38:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9663357959873779104', time=2024-09-12T02:36:16.313584+0000, chain.objs.size()=1 2024-09-12T00:38:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.664__shadow_.97qj77dxd9sZ0Ljx6junrU5jKfm7pGG_0 2024-09-12T00:38:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4518612320136004100', time=2024-09-12T02:36:22.564036+0000, chain.objs.size()=1 2024-09-12T00:38:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.691__shadow_.raZ6YKLzKHNFdZBV0eHqQz0ahwo1jbV_0 2024-09-12T00:38:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14530020420129820243', time=2024-09-12T02:36:23.897424+0000, chain.objs.size()=1 2024-09-12T00:38:37.146 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.143+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.696__shadow:n4EapFnd4Lbk439y593LMmyKXN5o9hb_.kwMRyVx0gQUXwPZ3-1ojfIrGeVp4zRi_0 2024-09-12T00:38:37.149 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.151+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:37.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.154+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:38:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.155+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:37.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.155+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49647' 2024-09-12T00:38:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1413097419234436042', time=2024-09-12T02:30:40.637629+0000, chain.objs.size()=1 2024-09-12T00:38:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.243__shadow_.6Myte-HVRaSVR_3tof-4pN5UnqS90lA_0 2024-09-12T00:38:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15311797610378057909', time=2024-09-12T02:30:42.405944+0000, chain.objs.size()=1 2024-09-12T00:38:37.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.250__shadow_.55PxVzUeCkH92Hg6g2t7xtRK7iUJDFk_0 2024-09-12T00:38:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12177378927495160463', time=2024-09-12T02:30:44.863139+0000, chain.objs.size()=1 2024-09-12T00:38:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.260__shadow_.m3BLLQ5ZP8Yeg88JvZTdHNs28GBcmMg_0 2024-09-12T00:38:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4122914015492017028', time=2024-09-12T02:30:53.235054+0000, chain.objs.size()=1 2024-09-12T00:38:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.fHid9v48lFIH_B1yZL9B9-LvYbW5aMg_0 2024-09-12T00:38:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.875552152665149002', time=2024-09-12T02:30:53.714043+0000, chain.objs.size()=1 2024-09-12T00:38:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.iDCSVhMa8ShhTseo7o_XkisKpuJniFt_0 2024-09-12T00:38:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7511491445045979875', time=2024-09-12T02:30:53.721056+0000, chain.objs.size()=1 2024-09-12T00:38:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JO2ytTnOwkOy2QWXS1fif5P7xNfadnd_0 2024-09-12T00:38:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4213388871012592532', time=2024-09-12T02:30:54.154582+0000, chain.objs.size()=1 2024-09-12T00:38:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AWc0IbZW5-2gcrwbdtjxH0CslJEl4AR_0 2024-09-12T00:38:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6019190283469218815', time=2024-09-12T02:30:54.157554+0000, chain.objs.size()=1 2024-09-12T00:38:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.biSXYaY5NuZy97W4VQdl_K29v_24Ltg_0 2024-09-12T00:38:37.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1883611446332357541', time=2024-09-12T02:30:54.247681+0000, chain.objs.size()=1 2024-09-12T00:38:37.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2QWlgPT0IY0-HNkEe67HM_Ba_iM8yZ4_0 2024-09-12T00:38:37.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17926558612388520127', time=2024-09-12T02:30:54.255606+0000, chain.objs.size()=1 2024-09-12T00:38:37.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.yvUX3WoCp4lh086oTWJhaL1Do6SvqeQ_0 2024-09-12T00:38:37.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7162481866148505609', time=2024-09-12T02:30:54.267509+0000, chain.objs.size()=1 2024-09-12T00:38:37.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.y9VFKECpiGB2k3boRYXepiyZOlnss4t_0 2024-09-12T00:38:37.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8130258556770914060', time=2024-09-12T02:30:54.363626+0000, chain.objs.size()=1 2024-09-12T00:38:37.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.FVhU9ZZ5hdZcx4ehZr2JOJsZmjFLrzb_0 2024-09-12T00:38:37.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.159+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12245499183773813605', time=2024-09-12T02:30:54.365688+0000, chain.objs.size()=1 2024-09-12T00:38:37.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.159+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_._ZbiQi9sowWOLeJ32snJYweNejONa5V_0 2024-09-12T00:38:37.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.160+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9224848638838989815', time=2024-09-12T02:30:54.456055+0000, chain.objs.size()=1 2024-09-12T00:38:37.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.160+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Qx2175ozkpIDQpsL2kiawZahE1658RG_0 2024-09-12T00:38:37.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.160+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15028929305961666959', time=2024-09-12T02:30:54.633924+0000, chain.objs.size()=1 2024-09-12T00:38:37.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.160+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.uDcrIZGhvq5rdgT_MVBOBGYcKEFJpBd_0 2024-09-12T00:38:37.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.160+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18337442841931794755', time=2024-09-12T02:30:54.696206+0000, chain.objs.size()=1 2024-09-12T00:38:37.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.160+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BmhZ56i2dTyOIRTHQZtw0ltwYAWk8-K_0 2024-09-12T00:38:37.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.160+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12481976592839033766', time=2024-09-12T02:30:54.820534+0000, chain.objs.size()=1 2024-09-12T00:38:37.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.160+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.NqvHli-F3p39DtBchz54GNjpD3z57-2_0 2024-09-12T00:38:37.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.160+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17464473271164091160', time=2024-09-12T02:30:54.837473+0000, chain.objs.size()=1 2024-09-12T00:38:37.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.160+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Ucqu8SZoZKQ1Wi-CjMHF1MxtWN8nwog_0 2024-09-12T00:38:37.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.161+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.171709641513952427', time=2024-09-12T02:30:55.122518+0000, chain.objs.size()=1 2024-09-12T00:38:37.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.161+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.IUbLIqynUDp_bA17e7BQW-G1ko0Vw0n_0 2024-09-12T00:38:37.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.161+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13931722687866517027', time=2024-09-12T02:30:55.166407+0000, chain.objs.size()=1 2024-09-12T00:38:37.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.161+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lN7Itdp14CpfzDpuwO-vXkzLk0Q_3ev_0 2024-09-12T00:38:37.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.161+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1459112205651252511', time=2024-09-12T02:30:56.909465+0000, chain.objs.size()=1 2024-09-12T00:38:37.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.161+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.269__shadow_.yOawEEnYHr5wBwihBObx8WVPCttv4SK_0 2024-09-12T00:38:37.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.161+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11426422453295216675', time=2024-09-12T02:30:57.647451+0000, chain.objs.size()=1 2024-09-12T00:38:37.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.161+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.272__shadow_.Wk4WlpKWLxVrUafzp6ozl-pRI-rOEBL_0 2024-09-12T00:38:37.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.161+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16810270952399666420', time=2024-09-12T02:31:01.389770+0000, chain.objs.size()=1 2024-09-12T00:38:37.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.161+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.287__shadow_.R6LjZrvvcyzVeODeoF68xxCAoYXB3xa_0 2024-09-12T00:38:37.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.164+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18078848319257281755', time=2024-09-12T02:31:01.390493+0000, chain.objs.size()=1 2024-09-12T00:38:37.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.164+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.287__shadow_.vGCeMf3mV8e9j2KrADkG4lZ4-JGEe2D_0 2024-09-12T00:38:37.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8787362717735113099', time=2024-09-12T02:31:06.459183+0000, chain.objs.size()=1 2024-09-12T00:38:37.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.304__shadow_.oUO-Vq5ITywCty_Ri9H3o2xIDNNbFWh_0 2024-09-12T00:38:37.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6819178357017539244', time=2024-09-12T02:31:07.104597+0000, chain.objs.size()=1 2024-09-12T00:38:37.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.306__shadow_.xFeW4ns2bV5iIlK6gx7nyprkrgG9dDU_0 2024-09-12T00:38:37.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.711262917644449300', time=2024-09-12T02:31:10.881198+0000, chain.objs.size()=1 2024-09-12T00:38:37.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.322__shadow_.9s_DQUyk8tUFVmWSWoE_kGWsgmcJhN5_0 2024-09-12T00:38:37.165 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11205036264359323576', time=2024-09-12T02:31:19.360467+0000, chain.objs.size()=1 2024-09-12T00:38:37.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.1J20i6y1J3sAgnJjvEjwpZgaHPA0x53_0 2024-09-12T00:38:37.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4421920738568684566', time=2024-09-12T02:31:19.392260+0000, chain.objs.size()=1 2024-09-12T00:38:37.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.CM56TorQpFlZrqkWzXTSItLwH3F_2x2_0 2024-09-12T00:38:37.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9324453966201128239', time=2024-09-12T02:31:19.461434+0000, chain.objs.size()=1 2024-09-12T00:38:37.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.CsZbt1kpJu6c6pzmMpzbPlU7ISoFvcY_0 2024-09-12T00:38:37.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10028678792562988304', time=2024-09-12T02:31:19.488390+0000, chain.objs.size()=1 2024-09-12T00:38:37.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.y42G7U0GIQ8rQqVIq97-ZbwG6zb2M5Q_0 2024-09-12T00:38:37.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18164711443324759493', time=2024-09-12T02:31:19.489448+0000, chain.objs.size()=1 2024-09-12T00:38:37.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.nVPeMR13aReX6kdgEoJkJl0JoXI3Gdf_0 2024-09-12T00:38:37.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18248122143349764507', time=2024-09-12T02:31:19.507038+0000, chain.objs.size()=1 2024-09-12T00:38:37.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ld9RMbH1Q4mG4YsG5vGnKhJOLMN6lV9_0 2024-09-12T00:38:37.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17547031160104151302', time=2024-09-12T02:31:19.521660+0000, chain.objs.size()=1 2024-09-12T00:38:37.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.167+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.RINoVB0O8XI0Q89JzHEk0PlzJuDagG__0 2024-09-12T00:38:37.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.169+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7837720111501587225', time=2024-09-12T02:31:19.547852+0000, chain.objs.size()=1 2024-09-12T00:38:37.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.169+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.W9V69KAf-NHFgbSOAVmmfrrAD1D-mQG_0 2024-09-12T00:38:37.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.170+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15976294251739618861', time=2024-09-12T02:31:19.682201+0000, chain.objs.size()=1 2024-09-12T00:38:37.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.170+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.mbb-3brdz-Ef6mDCoPBxn4spHbA6y7U_0 2024-09-12T00:38:37.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.170+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14340502278918215440', time=2024-09-12T02:31:19.782204+0000, chain.objs.size()=1 2024-09-12T00:38:37.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.170+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.G0N7FiTvq27e4CXxbJtb2YcTZDAwDp9_0 2024-09-12T00:38:37.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.170+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8752860827277583092', time=2024-09-12T02:31:19.826275+0000, chain.objs.size()=1 2024-09-12T00:38:37.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.170+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.eSfAN9KunAXTGSoBNa2Q6qT76tR8AUT_0 2024-09-12T00:38:37.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.171+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16986443821415390757', time=2024-09-12T02:31:19.876310+0000, chain.objs.size()=1 2024-09-12T00:38:37.170 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.171+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.mNZJzKPfDtzgV4NZP2QdR24CTxMVuCA_0 2024-09-12T00:38:37.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.173+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11685434080687748571', time=2024-09-12T02:31:19.996140+0000, chain.objs.size()=1 2024-09-12T00:38:37.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.173+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.HGCeuK1kzl40Jv0arVIAht_ReAKb1B5_0 2024-09-12T00:38:37.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.173+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2463942850499698793', time=2024-09-12T02:31:20.121502+0000, chain.objs.size()=1 2024-09-12T00:38:37.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.173+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.WGP_n0lXIEYWr4dAXUvlC5r0AR8jEAN_0 2024-09-12T00:38:37.171 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.173+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12326928264870692509', time=2024-09-12T02:31:20.302030+0000, chain.objs.size()=1 2024-09-12T00:38:37.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.173+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.69w25lNK-0OwmUt2sPQiQ6LzNbqwD9i_0 2024-09-12T00:38:37.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.173+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13064731485627744020', time=2024-09-12T02:31:20.336365+0000, chain.objs.size()=1 2024-09-12T00:38:37.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.173+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.sforNAaJM3i2M8NK8JOxtLsUhc4Wve8_0 2024-09-12T00:38:37.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.173+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11739751436718937435', time=2024-09-12T02:31:20.369870+0000, chain.objs.size()=1 2024-09-12T00:38:37.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.173+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.oc6kJPUV0Anm5xOx_ISC0zXBmdaCMU0_0 2024-09-12T00:38:37.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.173+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15840915735126694930', time=2024-09-12T02:31:20.388858+0000, chain.objs.size()=1 2024-09-12T00:38:37.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.173+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.KVBmpDRWRt-H3AK9GQy7kdYU9yIgnlx_0 2024-09-12T00:38:37.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.173+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12699222746648880514', time=2024-09-12T02:31:20.463430+0000, chain.objs.size()=1 2024-09-12T00:38:37.172 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.173+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.MGN4cmWV-E1f6zqYYZ135edGY6DANFf_0 2024-09-12T00:38:37.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.175+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10456516947621132135', time=2024-09-12T02:31:20.467477+0000, chain.objs.size()=1 2024-09-12T00:38:37.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.175+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.F3n8WVnIOevrdGub9CxWpDM0n1oVrQB_0 2024-09-12T00:38:37.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.177+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8942470606628535117', time=2024-09-12T02:31:20.566558+0000, chain.objs.size()=1 2024-09-12T00:38:37.175 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.177+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.fsMgwLmNq0tiG-DQ_kLNohr3RIs_FXn_0 2024-09-12T00:38:37.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.178+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2138414445286857007', time=2024-09-12T02:31:20.583044+0000, chain.objs.size()=1 2024-09-12T00:38:37.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.178+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.5SFzajA7_1GPxQu_Mka_39OZsT8FX1c_0 2024-09-12T00:38:37.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2283700287735266120', time=2024-09-12T02:31:20.764621+0000, chain.objs.size()=1 2024-09-12T00:38:37.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.S4RLha3oNqhA2Y9XSxtdk2YpCRcnt5d_0 2024-09-12T00:38:37.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16995042737502292146', time=2024-09-12T02:31:20.768910+0000, chain.objs.size()=1 2024-09-12T00:38:37.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.WI65LSPvrcEDrvIQjOkNQOAksU5d-Io_0 2024-09-12T00:38:37.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6370167810306935393', time=2024-09-12T02:31:20.862356+0000, chain.objs.size()=1 2024-09-12T00:38:37.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.kueLVitXfLekA18b7hxgH5sRh_D4-IC_0 2024-09-12T00:38:37.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.471096871605902029', time=2024-09-12T02:31:20.910980+0000, chain.objs.size()=1 2024-09-12T00:38:37.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Q5uCSq7pdjg_0TVsbR7eC12SoXyjrbt_0 2024-09-12T00:38:37.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16248465136986309622', time=2024-09-12T02:31:20.917567+0000, chain.objs.size()=1 2024-09-12T00:38:37.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.5oFfDqXmuqaBL-zM6XWi7RAMklOLb6k_0 2024-09-12T00:38:37.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18273908310875753549', time=2024-09-12T02:31:21.000917+0000, chain.objs.size()=1 2024-09-12T00:38:37.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Irlzwr9eRxlIZ4jCfqQiT24aemGQME7_0 2024-09-12T00:38:37.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2413781217085382251', time=2024-09-12T02:31:21.241502+0000, chain.objs.size()=1 2024-09-12T00:38:37.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_._J_SoglwYT3o9Q1hvjeisV1CBNSO4K6_0 2024-09-12T00:38:37.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16500497340661161402', time=2024-09-12T02:31:21.247305+0000, chain.objs.size()=1 2024-09-12T00:38:37.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.y-O4Lota_SgEB3eHkflL1ydJshp22Dx_0 2024-09-12T00:38:37.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4356841555534209137', time=2024-09-12T02:31:21.496123+0000, chain.objs.size()=1 2024-09-12T00:38:37.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.179+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.sGGDulE1_uEWLGXlrD5g2KApRd2gNFh_0 2024-09-12T00:38:37.179 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.181+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2345095171747346305', time=2024-09-12T02:31:21.501196+0000, chain.objs.size()=1 2024-09-12T00:38:37.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.181+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JZ2P-04OgSfDeOlg2ElKnhC0hb_JuJE_0 2024-09-12T00:38:37.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.181+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8199511651751098721', time=2024-09-12T02:31:21.586597+0000, chain.objs.size()=1 2024-09-12T00:38:37.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.181+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.EBGf4avJubpv3Qq-_OT_5GBHMJe4NzI_0 2024-09-12T00:38:37.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.183+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7152853234331825761', time=2024-09-12T02:31:21.605869+0000, chain.objs.size()=1 2024-09-12T00:38:37.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.183+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.dkP2W8Du0E1CrfIAJsNht8kgJXLMy04_0 2024-09-12T00:38:37.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.183+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16975096914356135283', time=2024-09-12T02:31:29.759735+0000, chain.objs.size()=1 2024-09-12T00:38:37.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.183+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.24h9ibRYJJFecCTs15X9O6vsPm20cG6_0 2024-09-12T00:38:37.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.183+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8785172104062901029', time=2024-09-12T02:31:29.775892+0000, chain.objs.size()=1 2024-09-12T00:38:37.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.183+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.nxygSNT3P-GJcyvSeJ-LwKOFLGAOt9E_0 2024-09-12T00:38:37.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.183+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18039288717337544048', time=2024-09-12T02:31:29.822024+0000, chain.objs.size()=1 2024-09-12T00:38:37.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.183+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.KPFU3f7a6KSmLITblBW6oDqh-q5XcQH_0 2024-09-12T00:38:37.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.183+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17339844027266788750', time=2024-09-12T02:31:30.366027+0000, chain.objs.size()=1 2024-09-12T00:38:37.182 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.183+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.wZ68lhvaV0-E6BctdUJ0vwV4iP1hnCz_0 2024-09-12T00:38:37.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.184+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15785968315347548166', time=2024-09-12T02:31:30.382282+0000, chain.objs.size()=1 2024-09-12T00:38:37.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.184+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ScRuuzxf7QYUvF9x0plkRV2ZKe7IvMh_0 2024-09-12T00:38:37.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.184+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9444477377829060468', time=2024-09-12T02:31:30.452449+0000, chain.objs.size()=1 2024-09-12T00:38:37.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.184+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ST9CLTBlHC3c4SJ960ZnHnZ9njBmEhS_0 2024-09-12T00:38:37.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.184+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6119835486385778841', time=2024-09-12T02:31:30.465422+0000, chain.objs.size()=1 2024-09-12T00:38:37.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.184+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.jRYBgPkgiqE4DxlXGWFuRsETRbIg2Vg_0 2024-09-12T00:38:37.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.184+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1978127300700605201', time=2024-09-12T02:31:30.663199+0000, chain.objs.size()=1 2024-09-12T00:38:37.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.184+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mRX0LCLrYqFsvirP4O0bf0OXXz9smiM_0 2024-09-12T00:38:37.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.187+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18181211468848831292', time=2024-09-12T02:31:30.734957+0000, chain.objs.size()=1 2024-09-12T00:38:37.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.187+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.PzPWfHTCW-na1M00BpV267RQ0ZQtfHH_0 2024-09-12T00:38:37.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10411513000405112255', time=2024-09-12T02:31:30.861883+0000, chain.objs.size()=1 2024-09-12T00:38:37.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.VgBzdo0cZr-wgiXnNqXsVro5d8ZdAD5_0 2024-09-12T00:38:37.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1895407681353912370', time=2024-09-12T02:31:30.890599+0000, chain.objs.size()=1 2024-09-12T00:38:37.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.kDY-QXZTPUfguV1M7BzugyCHzmfaFpP_0 2024-09-12T00:38:37.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9289909525169605684', time=2024-09-12T02:31:30.899489+0000, chain.objs.size()=1 2024-09-12T00:38:37.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.bo2IfjYg-TjnlM_Kdx1xexp8AZSqFy9_0 2024-09-12T00:38:37.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18280379769131248339', time=2024-09-12T02:31:30.935083+0000, chain.objs.size()=1 2024-09-12T00:38:37.187 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.wMLHawsbJIS8lL-WCWNkCrMvXg1etIl_0 2024-09-12T00:38:37.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3141150763940885574', time=2024-09-12T02:31:30.961209+0000, chain.objs.size()=1 2024-09-12T00:38:37.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.8GY-1NZzqW9tXut9woObqbqOJKgEijd_0 2024-09-12T00:38:37.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15568876268317725957', time=2024-09-12T02:31:31.002747+0000, chain.objs.size()=1 2024-09-12T00:38:37.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.boVoP-ZpZUYkk3alMWxER5zr_ZLs-K1_0 2024-09-12T00:38:37.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10206912465291042220', time=2024-09-12T02:31:31.122591+0000, chain.objs.size()=1 2024-09-12T00:38:37.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.cqET-3FZI6bPE29eoybMki6z_OFSsYD_0 2024-09-12T00:38:37.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11222378728541152257', time=2024-09-12T02:31:31.150027+0000, chain.objs.size()=1 2024-09-12T00:38:37.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mfoi3CFwuzSH2G90s5i3iRcHYX9n_t1_0 2024-09-12T00:38:37.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8744649562939970898', time=2024-09-12T02:31:31.156720+0000, chain.objs.size()=1 2024-09-12T00:38:37.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.tzCqh4fhev63vPbmTP6Pvzp9qCUiJvl_0 2024-09-12T00:38:37.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.188+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1979353401051809604', time=2024-09-12T02:31:31.171335+0000, chain.objs.size()=1 2024-09-12T00:38:37.188 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.189+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.AvYHxpOWRGFnzNe90s3peCMF4a1VcuH_0 2024-09-12T00:38:37.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.192+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15377342794568366591', time=2024-09-12T02:31:31.197727+0000, chain.objs.size()=1 2024-09-12T00:38:37.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.192+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.WxHYUM8ZhYcKfi09M7kfphxCedXrNmy_0 2024-09-12T00:38:37.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.192+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14133736247297214817', time=2024-09-12T02:31:31.244668+0000, chain.objs.size()=1 2024-09-12T00:38:37.190 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.192+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.cqPN0vmdNdhE2CIl3yodSGTKqga5Q24_0 2024-09-12T00:38:37.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.193+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10269858029315311393', time=2024-09-12T02:31:31.261561+0000, chain.objs.size()=1 2024-09-12T00:38:37.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.193+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.aU_6yO1Hhf2Ron0f1lLtpWmoSK3rdfX_0 2024-09-12T00:38:37.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.193+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15246599932563586846', time=2024-09-12T02:31:31.297730+0000, chain.objs.size()=1 2024-09-12T00:38:37.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.193+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.JXket1tUgwbpVjkZ8HoLuwapG54j88z_0 2024-09-12T00:38:37.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.194+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9270024203553727996', time=2024-09-12T02:31:31.399935+0000, chain.objs.size()=1 2024-09-12T00:38:37.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.194+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-Z4flVdsEqWsy8AsaibskSGQ-6sHrtb_0 2024-09-12T00:38:37.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.194+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1084645750504767670', time=2024-09-12T02:31:31.418170+0000, chain.objs.size()=1 2024-09-12T00:38:37.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.194+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.qD9SMCozBVNATtJ9Secsqh9ivwhYSai_0 2024-09-12T00:38:37.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.194+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16276237529828896459', time=2024-09-12T02:31:31.528753+0000, chain.objs.size()=1 2024-09-12T00:38:37.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.194+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.OB2kpWcunShVCz9qWpbIydYzFHjxvLB_0 2024-09-12T00:38:37.193 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.195+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11826113712906741387', time=2024-09-12T02:31:31.595314+0000, chain.objs.size()=1 2024-09-12T00:38:37.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.195+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.PtuDRW4O6ntldbBxn6nlwtu7_1qwdvT_0 2024-09-12T00:38:37.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.195+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1783764716296780128', time=2024-09-12T02:31:31.670970+0000, chain.objs.size()=1 2024-09-12T00:38:37.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.195+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.H2nncx7KCDXYz5ahQOVpBguccgpGbdg_0 2024-09-12T00:38:37.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.195+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17499650464614121965', time=2024-09-12T02:31:31.688165+0000, chain.objs.size()=1 2024-09-12T00:38:37.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.195+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.RuMvjgkAwP732ZmF4CgWDJYpOdW5W9V_0 2024-09-12T00:38:37.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.195+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3680415927115590255', time=2024-09-12T02:31:31.748756+0000, chain.objs.size()=1 2024-09-12T00:38:37.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.195+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.YkGBpqknOHAH-8tS6KoSIvT9-E79BxC_0 2024-09-12T00:38:37.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.195+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16656614945612609478', time=2024-09-12T02:31:31.775495+0000, chain.objs.size()=1 2024-09-12T00:38:37.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.195+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.pwja5Eo9H6qL7rEeKlTfEAeqeGHmTpI_0 2024-09-12T00:38:37.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.196+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10928037222563864903', time=2024-09-12T02:31:40.497167+0000, chain.objs.size()=1 2024-09-12T00:38:37.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.196+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.367__shadow_.KMC6OTIJtttz3YDXviT64xofWrOU6-e_0 2024-09-12T00:38:37.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.196+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1171119265068553375', time=2024-09-12T02:32:06.108939+0000, chain.objs.size()=1 2024-09-12T00:38:37.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.196+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.457__shadow_.i5ucjxfmZ9C7lHucUIvKr0SgogP33eA_0 2024-09-12T00:38:37.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.200+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17860611248608340899', time=2024-09-12T02:32:06.109728+0000, chain.objs.size()=1 2024-09-12T00:38:37.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.200+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.457__shadow_.KWR-gWO-Zs2nyS1I8fN6mXipFe1wJeG_0 2024-09-12T00:38:37.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.201+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16863779911950279358', time=2024-09-12T02:32:06.917301+0000, chain.objs.size()=1 2024-09-12T00:38:37.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.201+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.459__shadow_.Lj3Be7aFuJBmJvZn1rQ6ATVdqqR3JZn_0 2024-09-12T00:38:37.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.201+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12346027354358186490', time=2024-09-12T02:32:25.877610+0000, chain.objs.size()=1 2024-09-12T00:38:37.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.201+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.520__shadow:0XTBE9Bj2FlSoPYx1qP401uQ2F98v3R_._A7tJ3znJZr5jYdcLCnhU6no-0ER-VF_0 2024-09-12T00:38:37.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.201+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2305578850551738360', time=2024-09-12T02:32:30.684927+0000, chain.objs.size()=6 2024-09-12T00:38:37.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.201+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~tS7KFzOR_KJH5pvN19ar0OA-C4wZ577.1 2024-09-12T00:38:37.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.201+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart._-_PM73rJMcCehWoXuzRIFWrlA38bRUQ.2 2024-09-12T00:38:37.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.201+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.y2Qf9nWbQPtaYz8qfa8Ut11dYCHIxQ1b.3 2024-09-12T00:38:37.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.201+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~tS7KFzOR_KJH5pvN19ar0OA-C4wZ577.4 2024-09-12T00:38:37.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.201+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~tS7KFzOR_KJH5pvN19ar0OA-C4wZ577.5 2024-09-12T00:38:37.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.201+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~tS7KFzOR_KJH5pvN19ar0OA-C4wZ577.6 2024-09-12T00:38:37.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.202+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4521039629160678989', time=2024-09-12T02:32:33.016530+0000, chain.objs.size()=2 2024-09-12T00:38:37.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.202+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.525__multipart_mymultipart.2~A0D1eqfmCZupif6tSOo3Nxp3yYsKKCC.1 2024-09-12T00:38:37.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.202+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.525__multipart_mymultipart.2~A0D1eqfmCZupif6tSOo3Nxp3yYsKKCC.2 2024-09-12T00:38:37.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.202+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~l9dTkSJ44Cw-s_PIDDH7HZwLnl1B6Uh', time=2024-09-12T02:32:36.462719+0000, chain.objs.size()=1 2024-09-12T00:38:37.201 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.202+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.531__multipart_mymultipart2.2~l9dTkSJ44Cw-s_PIDDH7HZwLnl1B6Uh.1 2024-09-12T00:38:37.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.208+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/49647 2024-09-12T00:38:37.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T00:38:37.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7303933778185438991', time=2024-09-12T02:33:06.566189+0000, chain.objs.size()=1 2024-09-12T00:38:37.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.553__shadow_.1SuWV_LlNEWZh0LQ8R5s2A1rmyChbbJ_0 2024-09-12T00:38:37.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3047967452931329327', time=2024-09-12T02:33:07.383351+0000, chain.objs.size()=1 2024-09-12T00:38:37.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.555__shadow_.6WzUa_13utVnVgcn6P_4uR8imnLAaoL_0 2024-09-12T00:38:37.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.798211697681005694', time=2024-09-12T02:33:09.714337+0000, chain.objs.size()=1 2024-09-12T00:38:37.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.560__shadow_.-hpzGc5-sy7clDu4Z6NgQrRaaZqIZ6V_0 2024-09-12T00:38:37.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4717872970818344048', time=2024-09-12T02:33:17.851076+0000, chain.objs.size()=1 2024-09-12T00:38:37.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:zYKsx8OxXfmJUtgcm8.ZV08zG5W.1EM_.VfBhdonhf-jUPM7ZsEttXsz50p6uoGg_0 2024-09-12T00:38:37.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13355593351523307483', time=2024-09-12T02:33:19.882743+0000, chain.objs.size()=1 2024-09-12T00:38:37.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:5up-.nrRoXoSRV2xUaQBNbChRNAUXkP_.WJisA1O__6jeEGdzfmIClPSpE_hH1Kp_0 2024-09-12T00:38:37.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7533136078490589566', time=2024-09-12T02:33:22.951126+0000, chain.objs.size()=1 2024-09-12T00:38:37.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.570__shadow:RR22JSSVG6c6oFcwSEJ86ct5oKderZH_.zx5s_4ki3vqGm9-eF_xD5KbEqMwo_QD_0 2024-09-12T00:38:37.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3915366190626069049', time=2024-09-12T02:33:48.910527+0000, chain.objs.size()=1 2024-09-12T00:38:37.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.586__shadow:yyQKcz5kSGnuQtG5jtgiezD9eJss.MP_.KM3Rp33DHTxtVJvptzvVYP9ruVP9t-I_0 2024-09-12T00:38:37.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2132232019117331487', time=2024-09-12T02:33:51.110787+0000, chain.objs.size()=1 2024-09-12T00:38:37.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.596__shadow_.h8knUqzbWsAeHeenPJzySF37tFrhCuO_0 2024-09-12T00:38:37.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12940989374167643134', time=2024-09-12T02:36:07.580168+0000, chain.objs.size()=1 2024-09-12T00:38:37.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.641__shadow_.Z9ZYujH3zDu1RCb_zc3qmhlZ8xP6NVc_0 2024-09-12T00:38:37.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1508565013590996925', time=2024-09-12T02:36:09.298346+0000, chain.objs.size()=1 2024-09-12T00:38:37.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.646__shadow_.uX9_H7xiPZnTTDt-w6DtS_DN4Umb1wz_0 2024-09-12T00:38:37.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11858415252925005422', time=2024-09-12T02:36:56.579299+0000, chain.objs.size()=3 2024-09-12T00:38:37.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.211+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.743__multipart_mymultipart3.2~Vo632oimcRlRDI7ntslj8nzd1syhyU8.1 2024-09-12T00:38:37.211 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.211+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.743__multipart_mymultipart3.2~Vo632oimcRlRDI7ntslj8nzd1syhyU8.2 2024-09-12T00:38:37.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.215+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.743__multipart_mymultipart3.2~Vo632oimcRlRDI7ntslj8nzd1syhyU8.3 2024-09-12T00:38:37.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.218+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:37.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.223+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:38:37.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.225+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:37.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.226+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:37.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44634' 2024-09-12T00:38:37.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5618761956604681378', time=2024-09-12T02:29:44.117012+0000, chain.objs.size()=1 2024-09-12T00:38:37.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.199__shadow_.uTDvlv996xcgtiWl4o42Q3jATXxStEI_0 2024-09-12T00:38:37.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9922932316137548279', time=2024-09-12T02:30:38.526093+0000, chain.objs.size()=1 2024-09-12T00:38:37.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.235__shadow_.ULaskZ_2scAFdgZc_hHEBzk3fIbDZ0C_0 2024-09-12T00:38:37.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7605422410485798943', time=2024-09-12T02:30:42.650395+0000, chain.objs.size()=1 2024-09-12T00:38:37.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.251__shadow_.Wm07KVs2kf36DNhhKV9AazNX45HPRfc_0 2024-09-12T00:38:37.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.543640577235436162', time=2024-09-12T02:30:43.166978+0000, chain.objs.size()=1 2024-09-12T00:38:37.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.253__shadow_.fYQGVrFZ-p1wAzXoskiPeu-oxKzngIj_0 2024-09-12T00:38:37.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1612564580002837828', time=2024-09-12T02:30:43.404575+0000, chain.objs.size()=1 2024-09-12T00:38:37.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.254__shadow_.d7caAxXB72dX5dMRHvd_qxB3em3IzkW_0 2024-09-12T00:38:37.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15477672518930861846', time=2024-09-12T02:30:43.887797+0000, chain.objs.size()=1 2024-09-12T00:38:37.226 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.256__shadow_.emWRD868Oo6QtdGpWi5PXHa2ixvhLa5_0 2024-09-12T00:38:37.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6132373854613931828', time=2024-09-12T02:30:44.119278+0000, chain.objs.size()=1 2024-09-12T00:38:37.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.257__shadow_.W3bHgfLw3QLohwwDvBoLFhbQDxubfJF_0 2024-09-12T00:38:37.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6636757101355892298', time=2024-09-12T02:30:53.157257+0000, chain.objs.size()=1 2024-09-12T00:38:37.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.iEz8qkf066GzA2i6eXM39QMIxEPkC1p_0 2024-09-12T00:38:37.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11251810851468948228', time=2024-09-12T02:30:53.167597+0000, chain.objs.size()=1 2024-09-12T00:38:37.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Msm5JewQkE_ZyKJSZFhAcK9pc0vR-6d_0 2024-09-12T00:38:37.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1478527340632930855', time=2024-09-12T02:30:53.191400+0000, chain.objs.size()=1 2024-09-12T00:38:37.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_._dusp9NLMKfMY2EYYcCVI4t-nhUrHL-_0 2024-09-12T00:38:37.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10613267345793613874', time=2024-09-12T02:30:53.205588+0000, chain.objs.size()=1 2024-09-12T00:38:37.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ulZga77Km11U1645ExF5f9IlbKC5h4O_0 2024-09-12T00:38:37.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11401571273106523809', time=2024-09-12T02:30:53.245678+0000, chain.objs.size()=1 2024-09-12T00:38:37.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.227+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.7aiaT5r1jUnhJ1XkJBtGwh21j_BG8hh_0 2024-09-12T00:38:37.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.231+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10563592284441969872', time=2024-09-12T02:30:53.249268+0000, chain.objs.size()=1 2024-09-12T00:38:37.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.231+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lTG5xew8mmai8RJb0mVJPTr0NbjXYfp_0 2024-09-12T00:38:37.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.231+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8828516540238741175', time=2024-09-12T02:30:53.256501+0000, chain.objs.size()=1 2024-09-12T00:38:37.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.231+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.4r77Gsmro6Pn8cCLzHR4Li9U4AqPqt5_0 2024-09-12T00:38:37.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.231+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10908236591923352176', time=2024-09-12T02:30:53.278115+0000, chain.objs.size()=1 2024-09-12T00:38:37.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.231+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.z-eqaDlFghrVKAFniAm4s3SxI0e5UJw_0 2024-09-12T00:38:37.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4490955411277794597', time=2024-09-12T02:30:53.424929+0000, chain.objs.size()=1 2024-09-12T00:38:37.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Jf2B-00iuIrwcXM1Ocw750Xv9IPdCkC_0 2024-09-12T00:38:37.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10879610378670607557', time=2024-09-12T02:30:53.462018+0000, chain.objs.size()=1 2024-09-12T00:38:37.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.CMK_Rd7Zg5c52d0cRb-igBO4BD0qUFo_0 2024-09-12T00:38:37.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11541839180096132494', time=2024-09-12T02:30:53.462624+0000, chain.objs.size()=1 2024-09-12T00:38:37.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.sA6rS1Hkz83cnJfO5L5Zv5bA3IAFYwn_0 2024-09-12T00:38:37.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3323483177508791910', time=2024-09-12T02:30:53.490339+0000, chain.objs.size()=1 2024-09-12T00:38:37.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.UI1xcWU-BDin4UR-PsCiVpezlrIiLI5_0 2024-09-12T00:38:37.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15377762927262024217', time=2024-09-12T02:30:53.504035+0000, chain.objs.size()=1 2024-09-12T00:38:37.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.RuxY-52cg6tIaomgBBldIssmT_Ba8jG_0 2024-09-12T00:38:37.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1625963052227474075', time=2024-09-12T02:30:53.520275+0000, chain.objs.size()=1 2024-09-12T00:38:37.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.04HpvFwiSjaSYJD72SQ5AHoFlTnSwQh_0 2024-09-12T00:38:37.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6423667456148083670', time=2024-09-12T02:30:53.541411+0000, chain.objs.size()=1 2024-09-12T00:38:37.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.0WaZ23t8FNQnzZfE5o9QhQ6ZqDPeHM6_0 2024-09-12T00:38:37.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14965722745469825625', time=2024-09-12T02:30:53.736680+0000, chain.objs.size()=1 2024-09-12T00:38:37.232 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.233+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.0TeE9pqqG3vHvgoxkA2LOtiSiFVYhTr_0 2024-09-12T00:38:37.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.236+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10742841168681725879', time=2024-09-12T02:30:53.762893+0000, chain.objs.size()=1 2024-09-12T00:38:37.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.236+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.y7Dtq-emCaYJXEVAbU_W_61A1X6uXA0_0 2024-09-12T00:38:37.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.236+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.905582348026654532', time=2024-09-12T02:30:53.795171+0000, chain.objs.size()=1 2024-09-12T00:38:37.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.236+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.XFVri_sPa6PvtcC7iQ3U7ZY7hDAUqBU_0 2024-09-12T00:38:37.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.236+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2556248145211510113', time=2024-09-12T02:30:53.846571+0000, chain.objs.size()=1 2024-09-12T00:38:37.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.236+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.nV2-M2QRN0uIfaBfcC2FLLdokUR_mn5_0 2024-09-12T00:38:37.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.237+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5691017220710837204', time=2024-09-12T02:30:54.032211+0000, chain.objs.size()=1 2024-09-12T00:38:37.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.237+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.fpwypqB0l08A4NPIpiXBi8wYR6UXKXK_0 2024-09-12T00:38:37.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.237+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16731793060915504914', time=2024-09-12T02:30:54.060189+0000, chain.objs.size()=1 2024-09-12T00:38:37.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.237+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.wWPVqSFGWlzo0ujDzkYK7fp1ULbSb3c_0 2024-09-12T00:38:37.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.237+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17224038194858777055', time=2024-09-12T02:30:54.133156+0000, chain.objs.size()=1 2024-09-12T00:38:37.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.237+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.vM6TPt9JLp2486e_-FL7PNABWGMM7pg_0 2024-09-12T00:38:37.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.237+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3985683833793379829', time=2024-09-12T02:30:54.251736+0000, chain.objs.size()=1 2024-09-12T00:38:37.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.237+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Rkbmth45SUQ4GhjfUD8DPg6jHDr5ms3_0 2024-09-12T00:38:37.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.237+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5126280829541611355', time=2024-09-12T02:30:54.389164+0000, chain.objs.size()=1 2024-09-12T00:38:37.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.237+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.cU4bxB5yrAKc3pIqIosW7AZXjVDxWbj_0 2024-09-12T00:38:37.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.240+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1969683870089002371', time=2024-09-12T02:30:54.398583+0000, chain.objs.size()=1 2024-09-12T00:38:37.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.240+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.1iK83QJXMN-6SCZYQJnfKHKnZDjyaxi_0 2024-09-12T00:38:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.241+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12751972057979200626', time=2024-09-12T02:30:54.567106+0000, chain.objs.size()=1 2024-09-12T00:38:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.241+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.96YFtUUZIziHKpb-z8s-83DjVUhj8SK_0 2024-09-12T00:38:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.241+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17296682785764592222', time=2024-09-12T02:30:54.681186+0000, chain.objs.size()=1 2024-09-12T00:38:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.241+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.7icbSFzgTlGI_nRr2HeylNlZYMd55Y5_0 2024-09-12T00:38:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.241+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12525041630615936800', time=2024-09-12T02:30:54.714394+0000, chain.objs.size()=1 2024-09-12T00:38:37.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.241+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.dASlR02Bv8u-FWjGuEi65koJ-iw8VEY_0 2024-09-12T00:38:37.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10359630770300247200', time=2024-09-12T02:30:54.874893+0000, chain.objs.size()=1 2024-09-12T00:38:37.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2RdqFM4RchYnCD41sg3nI0VTgyf9Bwa_0 2024-09-12T00:38:37.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17750213805896526798', time=2024-09-12T02:30:54.884147+0000, chain.objs.size()=1 2024-09-12T00:38:37.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.mtZpoDFT6N_jpTo7OQnOeX2lYruS6wL_0 2024-09-12T00:38:37.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6955210068105783532', time=2024-09-12T02:30:54.955276+0000, chain.objs.size()=1 2024-09-12T00:38:37.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.P3-RRQaYPadWBFvB6z27tzNQ9_fm-hl_0 2024-09-12T00:38:37.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13195147946891155036', time=2024-09-12T02:30:54.983924+0000, chain.objs.size()=1 2024-09-12T00:38:37.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-SkoelNOch9Ff6w5Un5iUroVchVmO-I_0 2024-09-12T00:38:37.241 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16414019213266402653', time=2024-09-12T02:30:55.128110+0000, chain.objs.size()=1 2024-09-12T00:38:37.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JfC-oFGe_qq_QglSnJARvTSxBM4H6l3_0 2024-09-12T00:38:37.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293931717793328635', time=2024-09-12T02:30:55.205234+0000, chain.objs.size()=1 2024-09-12T00:38:37.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.W3ETlyJRVUnbZ8IVdZTIUN7CYU91qZV_0 2024-09-12T00:38:37.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16029656732431833122', time=2024-09-12T02:30:55.236351+0000, chain.objs.size()=1 2024-09-12T00:38:37.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.hI1YBLfdCTo-MOPnezLOSjuX8WfTgHF_0 2024-09-12T00:38:37.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14631951035212612885', time=2024-09-12T02:30:55.446788+0000, chain.objs.size()=1 2024-09-12T00:38:37.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.243+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.263__shadow_.AEaydzxjNiql59KQWVns2eay2OfGhgK_0 2024-09-12T00:38:37.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.244+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11753497522694417145', time=2024-09-12T02:31:06.458687+0000, chain.objs.size()=1 2024-09-12T00:38:37.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.244+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.304__shadow_.RTT8wCUUQIkqmEeIWyY50tPSj9LEaAB_0 2024-09-12T00:38:37.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.245+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10403199886563498824', time=2024-09-12T02:31:06.696438+0000, chain.objs.size()=1 2024-09-12T00:38:37.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.245+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.305__shadow_.qk2Ja3mPvm0rfOrTn5Zf142_e5Dfi96_0 2024-09-12T00:38:37.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.245+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6471765850584540125', time=2024-09-12T02:31:07.613739+0000, chain.objs.size()=1 2024-09-12T00:38:37.243 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.245+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.307__shadow:lRbXc6DN64SqIPAG7.6qeL1YTCeecqm_.REHuwP-kl0q0obxpb3akaSKJLDCHLx0_0 2024-09-12T00:38:37.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.248+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11900644745520605704', time=2024-09-12T02:31:19.378205+0000, chain.objs.size()=1 2024-09-12T00:38:37.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.248+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.9Z8QiiSvSdbkZr2ifA6RtZYAi7NTlzt_0 2024-09-12T00:38:37.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.248+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.750165375835516777', time=2024-09-12T02:31:19.507183+0000, chain.objs.size()=1 2024-09-12T00:38:37.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.248+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.D_BNi-8aS1Yhw0D9XVGoHJG1bylY8dK_0 2024-09-12T00:38:37.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.248+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11096676623482486971', time=2024-09-12T02:31:19.515913+0000, chain.objs.size()=1 2024-09-12T00:38:37.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.248+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Wk-Reb2nTDBbe2rFR64d3aWzMXS9zqU_0 2024-09-12T00:38:37.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.248+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14188580101719498397', time=2024-09-12T02:31:19.702131+0000, chain.objs.size()=1 2024-09-12T00:38:37.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.248+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.WPQ3YFGqKiAUNQLDcLBq48cPMEWnV8M_0 2024-09-12T00:38:37.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.249+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17163652593109665034', time=2024-09-12T02:31:19.747731+0000, chain.objs.size()=1 2024-09-12T00:38:37.247 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.249+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.VnHEMmRPbAZUz3lFI7Dv8YeLIvUcmKF_0 2024-09-12T00:38:37.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.249+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12877728748204397072', time=2024-09-12T02:31:19.756460+0000, chain.objs.size()=1 2024-09-12T00:38:37.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.249+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.eCrxL3sOCnU7XgeqhCf2e4QahUg9u9D_0 2024-09-12T00:38:37.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.249+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.881394346042888020', time=2024-09-12T02:31:19.977852+0000, chain.objs.size()=1 2024-09-12T00:38:37.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.249+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.v8sYYwp3qnvPgRyZnzsi7O6Fl__d-3y_0 2024-09-12T00:38:37.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.250+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2492314013713642414', time=2024-09-12T02:31:20.125899+0000, chain.objs.size()=1 2024-09-12T00:38:37.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.250+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.OzhiraZImTbgICwvvToGZKUKDh7FsrZ_0 2024-09-12T00:38:37.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.250+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12686119667406572129', time=2024-09-12T02:31:20.137604+0000, chain.objs.size()=1 2024-09-12T00:38:37.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.250+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.xPDRqaGtLuDPdE8ppxFbERD5Z8qlP-R_0 2024-09-12T00:38:37.248 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.250+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17167380918038864037', time=2024-09-12T02:31:20.145658+0000, chain.objs.size()=1 2024-09-12T00:38:37.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.250+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.kbfnufl6cB9p1077VCvNM_TijDx7Q5V_0 2024-09-12T00:38:37.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.252+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17638549795334955156', time=2024-09-12T02:31:20.157164+0000, chain.objs.size()=1 2024-09-12T00:38:37.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.252+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.5v-dDeopfN7via5gJXvkMKHQXrYF5h7_0 2024-09-12T00:38:37.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.253+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5076955507966259286', time=2024-09-12T02:31:20.257954+0000, chain.objs.size()=1 2024-09-12T00:38:37.252 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.253+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.5v_NjDyMg2YUakbapFjX5j6Q3HO8AbA_0 2024-09-12T00:38:37.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13600159748397829665', time=2024-09-12T02:31:20.263716+0000, chain.objs.size()=1 2024-09-12T00:38:37.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.__K6cC3MBgrwLLvYP0vEU3w3xMGbseS_0 2024-09-12T00:38:37.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12852371262571352243', time=2024-09-12T02:31:20.292995+0000, chain.objs.size()=1 2024-09-12T00:38:37.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.4FNvZCkGkR4WpqvbuubfflShkLakuaF_0 2024-09-12T00:38:37.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16111364535465006443', time=2024-09-12T02:31:20.294060+0000, chain.objs.size()=1 2024-09-12T00:38:37.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.EoZkEDiPz6U6rM3tPn49W5AvYt7dPb-_0 2024-09-12T00:38:37.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10487585201751659223', time=2024-09-12T02:31:20.379976+0000, chain.objs.size()=1 2024-09-12T00:38:37.253 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.n868QLFWtlwC0c2gCM2tdTbSYNycVNz_0 2024-09-12T00:38:37.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10785918548143732304', time=2024-09-12T02:31:20.394921+0000, chain.objs.size()=1 2024-09-12T00:38:37.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.FMoghiCfy6AGO8UV_0ILUSk_mH498UC_0 2024-09-12T00:38:37.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15689895877488366221', time=2024-09-12T02:31:20.409692+0000, chain.objs.size()=1 2024-09-12T00:38:37.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.OQ3y6ph2eOzCUeSLnQl66h0cCrOKUyV_0 2024-09-12T00:38:37.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16182308376879459723', time=2024-09-12T02:31:20.560644+0000, chain.objs.size()=1 2024-09-12T00:38:37.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Rb2DodPgSND_-jMB2ASI_RKMfMdIw7M_0 2024-09-12T00:38:37.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8445841573850241692', time=2024-09-12T02:31:20.711570+0000, chain.objs.size()=1 2024-09-12T00:38:37.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.esXKZOIPzZ0r2dfBFZ3Xq8Tjp0u2Rkx_0 2024-09-12T00:38:37.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10282767711109307151', time=2024-09-12T02:31:20.737517+0000, chain.objs.size()=1 2024-09-12T00:38:37.254 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.255+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.1TBbNIr_gkv1eeFfTSDSLzXB8WMab5V_0 2024-09-12T00:38:37.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.257+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1148178664492984573', time=2024-09-12T02:31:20.766559+0000, chain.objs.size()=1 2024-09-12T00:38:37.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.257+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.giCuUWw2q3nCMOq0uRptK3yeGklelb1_0 2024-09-12T00:38:37.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.258+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17108937685352098645', time=2024-09-12T02:31:20.862324+0000, chain.objs.size()=1 2024-09-12T00:38:37.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.258+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.2LArlvOsn6h9jbPKcnIfWpTeYq0cJfO_0 2024-09-12T00:38:37.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.259+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8287536046044615543', time=2024-09-12T02:31:20.896449+0000, chain.objs.size()=1 2024-09-12T00:38:37.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.259+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.bWHm5QPvgkJGYWyOtkZ8VETmxsTnxsH_0 2024-09-12T00:38:37.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.260+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7077769651998871385', time=2024-09-12T02:31:20.916435+0000, chain.objs.size()=1 2024-09-12T00:38:37.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.260+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NKM9a8ZsovU8pou-w2u2uZABaBuz4ey_0 2024-09-12T00:38:37.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.260+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7013757512547048461', time=2024-09-12T02:31:20.934360+0000, chain.objs.size()=1 2024-09-12T00:38:37.258 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.260+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.QvbI9T5ptjbcl_ihpp7yG5-v2kpMp0L_0 2024-09-12T00:38:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2632007865914624698', time=2024-09-12T02:31:20.968151+0000, chain.objs.size()=1 2024-09-12T00:38:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.bmxK9OoYxMwFjM63gW8T1LH2A0feGN6_0 2024-09-12T00:38:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6837628701650634678', time=2024-09-12T02:31:21.064948+0000, chain.objs.size()=1 2024-09-12T00:38:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.hC9CGdqTB4Xb5cpdva0yuv9G-3W1f6C_0 2024-09-12T00:38:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3396293783084626695', time=2024-09-12T02:31:21.155710+0000, chain.objs.size()=1 2024-09-12T00:38:37.260 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_._9d_aGZnozIOch_YEWVWjo6mQGxT55K_0 2024-09-12T00:38:37.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15973731166998803047', time=2024-09-12T02:31:21.162684+0000, chain.objs.size()=1 2024-09-12T00:38:37.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.CmRhPrYw-nIeq6o11ROOu3MJ8NFGxf1_0 2024-09-12T00:38:37.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5745330189398600589', time=2024-09-12T02:31:21.200736+0000, chain.objs.size()=1 2024-09-12T00:38:37.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.aeyrjHrXmXnwPuA2tiz7nL79k27LEW7_0 2024-09-12T00:38:37.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14050623914542665070', time=2024-09-12T02:31:21.254861+0000, chain.objs.size()=1 2024-09-12T00:38:37.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IUwndUxRZlrUUrvW8Dkl0mhbVETslM7_0 2024-09-12T00:38:37.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.509669525267399578', time=2024-09-12T02:31:21.271670+0000, chain.objs.size()=1 2024-09-12T00:38:37.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.iyaQ-FvTJyR9jxj2IAbel_qB9tP-AmW_0 2024-09-12T00:38:37.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4219073897422161486', time=2024-09-12T02:31:21.329786+0000, chain.objs.size()=1 2024-09-12T00:38:37.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.yLSnUgJXdrF36-MdBWnAjXDookDUWve_0 2024-09-12T00:38:37.264 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.266+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10526617661030166314', time=2024-09-12T02:31:21.341528+0000, chain.objs.size()=1 2024-09-12T00:38:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.266+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.lkOlrszMW82aHYaIvKCUl99HZYmjztB_0 2024-09-12T00:38:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.266+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11146420522961151888', time=2024-09-12T02:31:21.362905+0000, chain.objs.size()=1 2024-09-12T00:38:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.266+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Cp0wceVTnPP9Y6dxVV7rbBAOXAL3bIC_0 2024-09-12T00:38:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.266+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17503014977196543720', time=2024-09-12T02:31:21.480596+0000, chain.objs.size()=1 2024-09-12T00:38:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.266+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.33owWtqTdFYOTSYEerpSjy6JcMEqNEP_0 2024-09-12T00:38:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.266+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15383545529649676132', time=2024-09-12T02:31:21.526711+0000, chain.objs.size()=1 2024-09-12T00:38:37.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.266+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.sY8GgDWKenu0SRlz659xWAXCPbqs0eE_0 2024-09-12T00:38:37.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.267+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5824220016567190620', time=2024-09-12T02:31:21.583995+0000, chain.objs.size()=1 2024-09-12T00:38:37.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.268+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.vhK4NpYHeLfNyElECxjYS8R-SmMnhax_0 2024-09-12T00:38:37.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.268+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3268506197385909601', time=2024-09-12T02:31:21.619516+0000, chain.objs.size()=1 2024-09-12T00:38:37.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.268+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.173fvBPc38ERGveho-isfJi77sJZwca_0 2024-09-12T00:38:37.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.268+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15326409310836200083', time=2024-09-12T02:31:21.645947+0000, chain.objs.size()=1 2024-09-12T00:38:37.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.268+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NSWmhAaS5ehMk1ad0Hg3Fc4p8z1leaj_0 2024-09-12T00:38:37.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.268+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17353409405374149416', time=2024-09-12T02:31:29.699008+0000, chain.objs.size()=1 2024-09-12T00:38:37.266 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.268+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lBj2zsz36oeF8cju7Y82Ptwc9iMQ64O_0 2024-09-12T00:38:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.268+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16450286866644042281', time=2024-09-12T02:31:29.731235+0000, chain.objs.size()=1 2024-09-12T00:38:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.268+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.F7wHlWVpjS_LYHaoBsuWzf1wSV6KEoR_0 2024-09-12T00:38:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.268+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2878877491385131076', time=2024-09-12T02:31:29.784574+0000, chain.objs.size()=1 2024-09-12T00:38:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.268+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Vh3gT-MW16DqDh8FDoX2rG4MMQRdze0_0 2024-09-12T00:38:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.268+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.687594503395302944', time=2024-09-12T02:31:30.038409+0000, chain.objs.size()=1 2024-09-12T00:38:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.268+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.cegJ8AxtN1sHcLUcecP2X_Kts53wQpK_0 2024-09-12T00:38:37.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.269+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17138825007508449279', time=2024-09-12T02:31:30.054807+0000, chain.objs.size()=1 2024-09-12T00:38:37.268 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.269+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.TqrWF6H6DZ45Nz9i8kiTUwDuJErC0CX_0 2024-09-12T00:38:37.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.272+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6059571602814842407', time=2024-09-12T02:31:30.090507+0000, chain.objs.size()=1 2024-09-12T00:38:37.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.272+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.HD2yRFdOxIU06Tj5bDxAOpAoyz9G2H3_0 2024-09-12T00:38:37.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.272+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1139440178056625002', time=2024-09-12T02:31:30.189045+0000, chain.objs.size()=1 2024-09-12T00:38:37.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.272+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.guKEO8gM_16p8NhJIkg7FeP_xRp4M35_0 2024-09-12T00:38:37.270 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.272+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9626678686494294348', time=2024-09-12T02:31:30.191735+0000, chain.objs.size()=1 2024-09-12T00:38:37.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.272+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.xmQVezfLeDhQllCIW-34Ed43ENVxChf_0 2024-09-12T00:38:37.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.272+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13473443752540240883', time=2024-09-12T02:31:30.312132+0000, chain.objs.size()=1 2024-09-12T00:38:37.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.272+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.bVwo0t9VSzKWWBQ5W0LkjxRP2AwCZ56_0 2024-09-12T00:38:37.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.272+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4114893550127169331', time=2024-09-12T02:31:30.395707+0000, chain.objs.size()=1 2024-09-12T00:38:37.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.272+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.JmRlF8rKqgk_r9eCa0XnMFVOP4OBUBo_0 2024-09-12T00:38:37.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.272+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4433014992199610978', time=2024-09-12T02:31:30.462552+0000, chain.objs.size()=1 2024-09-12T00:38:37.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.272+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.OeS6u2G_ZAphXTaSFkBP-TBLqtll96v_0 2024-09-12T00:38:37.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.272+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17361932793870118795', time=2024-09-12T02:31:30.854442+0000, chain.objs.size()=1 2024-09-12T00:38:37.271 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.272+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.QQDL4_SgFRLvd3d8Rr2NWA2L8CPL_M__0 2024-09-12T00:38:37.272 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.274+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15598067123864628284', time=2024-09-12T02:31:30.856460+0000, chain.objs.size()=1 2024-09-12T00:38:37.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.274+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Xfho4n6l3O5yyg_g4NmzpsQEHXJWo3Y_0 2024-09-12T00:38:37.276 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.278+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/44634 2024-09-12T00:38:37.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T00:38:37.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4713851518519811904', time=2024-09-12T02:31:31.187766+0000, chain.objs.size()=1 2024-09-12T00:38:37.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.O5ZLnjoSZvuwmioCwGYuKYSBUxiLO1s_0 2024-09-12T00:38:37.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2309219888177507919', time=2024-09-12T02:31:31.286327+0000, chain.objs.size()=1 2024-09-12T00:38:37.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.4eyN6Aios9hHxDo9maI53DFbDPHySB0_0 2024-09-12T00:38:37.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.401489836338539367', time=2024-09-12T02:31:31.485843+0000, chain.objs.size()=1 2024-09-12T00:38:37.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.69xzxPqNgqF7nrrdP2vJe_o0R2WbUa__0 2024-09-12T00:38:37.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16569983585470544173', time=2024-09-12T02:31:31.504722+0000, chain.objs.size()=1 2024-09-12T00:38:37.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.zsBsoGOhj59Kco4UzCGof7kcjBvcXg1_0 2024-09-12T00:38:37.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2607846656146509814', time=2024-09-12T02:31:31.701625+0000, chain.objs.size()=1 2024-09-12T00:38:37.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.xPFV0cU0rYoNyURrap-MtwXNjv2WoPW_0 2024-09-12T00:38:37.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3525861341713917299', time=2024-09-12T02:31:31.737699+0000, chain.objs.size()=1 2024-09-12T00:38:37.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.b8lPaOypz1UqReOt86spmIwh7j5MYR3_0 2024-09-12T00:38:37.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4884876135306712802', time=2024-09-12T02:31:31.738491+0000, chain.objs.size()=1 2024-09-12T00:38:37.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.u8zpiNSHM3dyHu4vv9eY-GuXLkBSmNK_0 2024-09-12T00:38:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11594013425165112842', time=2024-09-12T02:31:31.755744+0000, chain.objs.size()=1 2024-09-12T00:38:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.EI0jf-YmJAmvUDiIaE3eZb8BuOacJIi_0 2024-09-12T00:38:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1047849526398112987', time=2024-09-12T02:31:32.849266+0000, chain.objs.size()=1 2024-09-12T00:38:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.329__shadow_.HkOTHOCeQRYVM138RtEr6llNgL4HkMa_0 2024-09-12T00:38:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14812518701628140675', time=2024-09-12T02:32:06.490216+0000, chain.objs.size()=1 2024-09-12T00:38:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.280+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.458__shadow_.I3Ejpz5C1VIETNvA73UjbJYUm01CGYV_0 2024-09-12T00:38:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.281+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1543575236733306527', time=2024-09-12T02:32:08.070696+0000, chain.objs.size()=1 2024-09-12T00:38:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.281+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.462__shadow_.gGKYih6DCzAupiKdHvrh4Dtb5e71vKM_0 2024-09-12T00:38:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.281+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2386074428234134111', time=2024-09-12T02:32:08.460477+0000, chain.objs.size()=1 2024-09-12T00:38:37.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.281+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.463__shadow_._cTnFTM9nKavCuGKUVkzPDyQXq3OOce_0 2024-09-12T00:38:37.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.284+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1251669878892558610', time=2024-09-12T02:32:12.850045+0000, chain.objs.size()=1 2024-09-12T00:38:37.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.284+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.484__shadow_.alLJIKy2MXcVYNOPJkqI1tR2uxmwo9O_0 2024-09-12T00:38:37.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.284+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17759184776436944049', time=2024-09-12T02:32:13.582153+0000, chain.objs.size()=1 2024-09-12T00:38:37.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.284+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.486__shadow_.7kwM6sXChBJYw_nj_-G2r_4Szg7Z5BX_0 2024-09-12T00:38:37.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.284+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14829819418401163036', time=2024-09-12T02:32:16.964564+0000, chain.objs.size()=1 2024-09-12T00:38:37.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.284+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.499__shadow_.eZMSxHa7UUiviwBdt5w9C84TnLLDIiY_0 2024-09-12T00:38:37.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.285+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1086957418777548962', time=2024-09-12T02:32:22.605668+0000, chain.objs.size()=1 2024-09-12T00:38:37.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.285+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.518__multipart_mymultipart.2~U9rTCdqoolLpgUmTrL9ykrRcMFuKEqB.1 2024-09-12T00:38:37.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.286+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4223612291734772496', time=2024-09-12T02:32:28.687501+0000, chain.objs.size()=6 2024-09-12T00:38:37.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.286+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~CLisQVm5seG_VmyHY4dhweQb1Dm1xkY.1 2024-09-12T00:38:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.286+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.3k15eC_hZtb9CCdQk8pyKrFqgxVunnj_.2 2024-09-12T00:38:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.286+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~CLisQVm5seG_VmyHY4dhweQb1Dm1xkY.3 2024-09-12T00:38:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.286+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~CLisQVm5seG_VmyHY4dhweQb1Dm1xkY.4 2024-09-12T00:38:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.286+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~CLisQVm5seG_VmyHY4dhweQb1Dm1xkY.5 2024-09-12T00:38:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.286+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~CLisQVm5seG_VmyHY4dhweQb1Dm1xkY.6 2024-09-12T00:38:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.286+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10081114588154657687', time=2024-09-12T02:33:14.838256+0000, chain.objs.size()=1 2024-09-12T00:38:37.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.286+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.563__shadow_.C2Z2nm-amHWLxxkOgXRQf7zIw5htO1t_0 2024-09-12T00:38:37.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.290+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6329681802461728504', time=2024-09-12T02:33:33.847423+0000, chain.objs.size()=1 2024-09-12T00:38:37.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.290+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:Ar9U7WYAKtqgWJleb.cvRqkacVjFjAT_.B2_rreRDb9XVwEWN69XqHoRX0hpJzDy_0 2024-09-12T00:38:37.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.292+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3817311788091171255', time=2024-09-12T02:33:40.070469+0000, chain.objs.size()=1 2024-09-12T00:38:37.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.292+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:UudZ.OzyZWkWZXgAMv0UAsqR2SoyQ5l_.qxzMcV2_o-IoMdwrZD2MCXKRPC6DUii_0 2024-09-12T00:38:37.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.292+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13507015609944036591', time=2024-09-12T02:33:44.900100+0000, chain.objs.size()=4 2024-09-12T00:38:37.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.292+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.578__multipart_testobj.2~G_HchRhjC2K5KKkndiVCqc4Ol7t0mNM.1 2024-09-12T00:38:37.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.292+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.578__multipart_testobj.2~G_HchRhjC2K5KKkndiVCqc4Ol7t0mNM.2 2024-09-12T00:38:37.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.293+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.578__multipart_testobj.2~G_HchRhjC2K5KKkndiVCqc4Ol7t0mNM.3 2024-09-12T00:38:37.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.293+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.578__multipart_testobj.2~G_HchRhjC2K5KKkndiVCqc4Ol7t0mNM.4 2024-09-12T00:38:37.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.293+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7705239419115106836', time=2024-09-12T02:33:45.877441+0000, chain.objs.size()=1 2024-09-12T00:38:37.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.293+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.579__shadow:TAcKJ--11uJV7aklYgMjIjAvTHH7TpA_.zLghpWY--ZeMbf2s-hYCYulNoZxv5TX_0 2024-09-12T00:38:37.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.293+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7567358553369162031', time=2024-09-12T02:33:53.533686+0000, chain.objs.size()=1 2024-09-12T00:38:37.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.293+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.607__shadow_.bM7bTLFkg6yG-4ET9aNqHrc5WtmMrvN_0 2024-09-12T00:38:37.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.293+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1644827127855376742', time=2024-09-12T02:36:09.643795+0000, chain.objs.size()=2 2024-09-12T00:38:37.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.293+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.647__shadow_.VF5pKESGMZ8XjblMxHJwVQFj-znR_xX_0 2024-09-12T00:38:37.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.293+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.647__shadow_.VF5pKESGMZ8XjblMxHJwVQFj-znR_xX_1 2024-09-12T00:38:37.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.293+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9855583061914082974', time=2024-09-12T02:36:09.985585+0000, chain.objs.size()=2 2024-09-12T00:38:37.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.293+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.648__shadow_.8J-l8HmUtu_ydJec3XmbgaX2vN-b5Rw_0 2024-09-12T00:38:37.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.294+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.648__shadow_.8J-l8HmUtu_ydJec3XmbgaX2vN-b5Rw_1 2024-09-12T00:38:37.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.296+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8093553562778503723', time=2024-09-12T02:36:25.707195+0000, chain.objs.size()=1 2024-09-12T00:38:37.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.296+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.703__shadow:uxxgyOoDeDnNZq3ea0BlpT044z3nhYX_.ZYn6h5_vpIka2M6oTztMdVlFyAYHGlO_0 2024-09-12T00:38:37.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.296+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13637128468330887926', time=2024-09-12T02:36:25.955900+0000, chain.objs.size()=1 2024-09-12T00:38:37.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.296+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.704__shadow:98EeKvOUxmLTvmnp6N39AhzjvAHUJ1k_.PbybkHjFsYDrvB3QCaBVFIVFDd6eUoU_0 2024-09-12T00:38:37.295 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.296+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4193410109504487555', time=2024-09-12T02:36:53.165079+0000, chain.objs.size()=1 2024-09-12T00:38:37.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.296+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.734__shadow_.8bFo9YclsbzGxPMdQSvWC5elIo79xwk_0 2024-09-12T00:38:37.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.296+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11535762718041476159', time=2024-09-12T02:36:55.260361+0000, chain.objs.size()=1 2024-09-12T00:38:37.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.296+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.740__shadow_.SpsAUio1L8FeZ0wROY_BJoJzXzToLpd_0 2024-09-12T00:38:37.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.303+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:37.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.305+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:38:37.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.306+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:37.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.306+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45068' 2024-09-12T00:38:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_ZWRZl7JlsPn1R7o8eI9XvOELVb-WuAC', time=2024-09-12T02:29:27.731541+0000, chain.objs.size()=2 2024-09-12T00:38:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.163__shadow_.zljMnpAy3dKDs055XkRxgs6NbLVIBp__0 2024-09-12T00:38:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.163__shadow_.zljMnpAy3dKDs055XkRxgs6NbLVIBp__1 2024-09-12T00:38:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12864679534715951286', time=2024-09-12T02:29:36.785550+0000, chain.objs.size()=1 2024-09-12T00:38:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.176__shadow_.AdrRBP5ow4jWIZNLibpHH2dS-LxiN4T_0 2024-09-12T00:38:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7627776539425105292', time=2024-09-12T02:30:39.099123+0000, chain.objs.size()=1 2024-09-12T00:38:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.237__shadow_.jIpjMZfBTwZ4knP2Y86t1GGn9DRlMIx_0 2024-09-12T00:38:37.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4937318850144841751', time=2024-09-12T02:30:39.392790+0000, chain.objs.size()=1 2024-09-12T00:38:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.238__shadow_.gk-uQ1y_mhwVoaJqVcxDffXwhEj9DtV_0 2024-09-12T00:38:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12353764158535681064', time=2024-09-12T02:30:40.638244+0000, chain.objs.size()=1 2024-09-12T00:38:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.243__shadow_.4L99ZUZaUR4VIIBeBbhkkt6m9z21Jci_0 2024-09-12T00:38:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14131855240912812210', time=2024-09-12T02:30:41.929455+0000, chain.objs.size()=1 2024-09-12T00:38:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.248__shadow_.TzO3f4zeqQEWciY2mIOaXBtJi9B4gQm_0 2024-09-12T00:38:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12724981531396593353', time=2024-09-12T02:30:42.165942+0000, chain.objs.size()=1 2024-09-12T00:38:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.249__shadow_.ILIpY8DXPX9wUgUjsJxb6gSr7vRDZDd_0 2024-09-12T00:38:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4473403739749318303', time=2024-09-12T02:30:42.889626+0000, chain.objs.size()=1 2024-09-12T00:38:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.252__shadow_.dPVu_5bRUHQaS3K79JOrHBsj3CKr5lR_0 2024-09-12T00:38:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13008107900942438119', time=2024-09-12T02:30:43.404335+0000, chain.objs.size()=1 2024-09-12T00:38:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.254__shadow_.KaVCAHbyRwdAVGV7GewIrdkcA6FgejE_0 2024-09-12T00:38:37.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.142791194252046309', time=2024-09-12T02:30:53.134022+0000, chain.objs.size()=1 2024-09-12T00:38:37.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lm3v1xfwGI1PP5bsQ8CbdRcAKJfb_6b_0 2024-09-12T00:38:37.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10368190601878903989', time=2024-09-12T02:30:53.151938+0000, chain.objs.size()=1 2024-09-12T00:38:37.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_._XohNkvA3X5YrLs-z0-5--zgdxDldsY_0 2024-09-12T00:38:37.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.311+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.636109049769168687', time=2024-09-12T02:30:53.402265+0000, chain.objs.size()=1 2024-09-12T00:38:37.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.311+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.7k-Soqthtuodks0T4nmvFn3xYFNuEOz_0 2024-09-12T00:38:37.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.311+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13153104079939727974', time=2024-09-12T02:30:53.407106+0000, chain.objs.size()=1 2024-09-12T00:38:37.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.311+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Dudoo1x_9X_0SWHuEoN5K7GGgDtQPBN_0 2024-09-12T00:38:37.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.300742706607978602', time=2024-09-12T02:30:53.436104+0000, chain.objs.size()=1 2024-09-12T00:38:37.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ooNJIW1VTS7U1vpyff-p5dGDdA1XGEA_0 2024-09-12T00:38:37.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1069420751834737779', time=2024-09-12T02:30:53.577703+0000, chain.objs.size()=1 2024-09-12T00:38:37.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.bBUtAjrxTcD-D-3EfxMj9V7sn7zdE6h_0 2024-09-12T00:38:37.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1145830860230080650', time=2024-09-12T02:30:53.763598+0000, chain.objs.size()=1 2024-09-12T00:38:37.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pt_SJIQv5LeKRN9RQWFt_V1VBkh3rU7_0 2024-09-12T00:38:37.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11773854072482247494', time=2024-09-12T02:30:53.819712+0000, chain.objs.size()=1 2024-09-12T00:38:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.A4IvL1Ki4jYMWxn4hcV9242G4ha3VNi_0 2024-09-12T00:38:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13899585478877934264', time=2024-09-12T02:30:53.964488+0000, chain.objs.size()=1 2024-09-12T00:38:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-cF3mlsGHWefpENmlYbcbx_rF_8lq_y_0 2024-09-12T00:38:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9151217471192496052', time=2024-09-12T02:30:54.037751+0000, chain.objs.size()=1 2024-09-12T00:38:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.SqVIp02uhmYnHX1S_aIKD68oDQGrxx1_0 2024-09-12T00:38:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8636608971910452403', time=2024-09-12T02:30:54.133654+0000, chain.objs.size()=1 2024-09-12T00:38:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.vnTlmZ-h_OlD5fu7okOHIFNQGGZqaWh_0 2024-09-12T00:38:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14898997827610593263', time=2024-09-12T02:30:54.250017+0000, chain.objs.size()=1 2024-09-12T00:38:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.uJWcCmrylZSv-a99w34vGjYfFbS4j_D_0 2024-09-12T00:38:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9330213547383923994', time=2024-09-12T02:30:54.270031+0000, chain.objs.size()=1 2024-09-12T00:38:37.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.q35Byh7PWFlIq2ZSiYjoQlRrbs9gSNT_0 2024-09-12T00:38:37.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.315+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6954198352724818925', time=2024-09-12T02:30:54.317412+0000, chain.objs.size()=1 2024-09-12T00:38:37.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.315+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.DCYcPm1NE2i9Qt1xQCrZJCjw6oQ8gOk_0 2024-09-12T00:38:37.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.315+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14485753787129381989', time=2024-09-12T02:30:54.325077+0000, chain.objs.size()=1 2024-09-12T00:38:37.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.315+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.A6biqmCugrQTPiEGfplRbn7GtWR4hE-_0 2024-09-12T00:38:37.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.316+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17465995035082680503', time=2024-09-12T02:30:54.366228+0000, chain.objs.size()=1 2024-09-12T00:38:37.315 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.316+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JoIoCkGcCYPx4_XE9ZejJHK2HvWNJeq_0 2024-09-12T00:38:37.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.317+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4725462641149801780', time=2024-09-12T02:30:54.451414+0000, chain.objs.size()=1 2024-09-12T00:38:37.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.317+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.WTYKHasC0zA5Us9tOZIqrJqOqcR298N_0 2024-09-12T00:38:37.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.317+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3365948764156694559', time=2024-09-12T02:30:54.590561+0000, chain.objs.size()=1 2024-09-12T00:38:37.316 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.317+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.vLgGuLfXcxMc5anWxVGY9mznkeTTAsm_0 2024-09-12T00:38:37.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.317+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14121501432553111092', time=2024-09-12T02:30:54.621268+0000, chain.objs.size()=1 2024-09-12T00:38:37.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.317+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.SMUv5M9vi541lA-QC0FWscvlT-dufqH_0 2024-09-12T00:38:37.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.317+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11087473046430486219', time=2024-09-12T02:30:54.675350+0000, chain.objs.size()=1 2024-09-12T00:38:37.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.317+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.UQCQX87mcLIXQgs9ccxnoP0jx4oMBfM_0 2024-09-12T00:38:37.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.317+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14396016836387012686', time=2024-09-12T02:30:54.710879+0000, chain.objs.size()=1 2024-09-12T00:38:37.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.317+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Evr6z49S7tAIGe1NwICiSndtnyEoAqV_0 2024-09-12T00:38:37.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.317+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2420715538998565267', time=2024-09-12T02:30:54.878461+0000, chain.objs.size()=1 2024-09-12T00:38:37.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.317+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.mbRAkFLqQoTq6jb3KPfIUuJxQbZCg5S_0 2024-09-12T00:38:37.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.319+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4854186719583615797', time=2024-09-12T02:30:54.935482+0000, chain.objs.size()=1 2024-09-12T00:38:37.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.319+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.fvt292zZwp9ilacIUtkcFMkIm2vaxR4_0 2024-09-12T00:38:37.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.319+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15161768474156298891', time=2024-09-12T02:30:55.190223+0000, chain.objs.size()=1 2024-09-12T00:38:37.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.319+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.wPx9EP2myu9iHZDbwHn_VrIWMSmpNyd_0 2024-09-12T00:38:37.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.320+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14644968154306771780', time=2024-09-12T02:30:55.211096+0000, chain.objs.size()=1 2024-09-12T00:38:37.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.320+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.4AfLpsw2ktv7_HJ7pUfRlkcnj2AKWPt_0 2024-09-12T00:38:37.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.320+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15124429924580210882', time=2024-09-12T02:31:00.064843+0000, chain.objs.size()=1 2024-09-12T00:38:37.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.320+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.282__shadow_.pOAi1SreiF6wUF464uw5OofWrPwkNVk_0 2024-09-12T00:38:37.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.320+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3555327723716456785', time=2024-09-12T02:31:01.148581+0000, chain.objs.size()=1 2024-09-12T00:38:37.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.320+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.286__shadow_.rHnAp8s8yESalRRCpPuXXkGy2ohLOOp_0 2024-09-12T00:38:37.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.320+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17918483909752214656', time=2024-09-12T02:31:03.670669+0000, chain.objs.size()=1 2024-09-12T00:38:37.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.320+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.lfakO0Y40q3yZyzh9djx7MxtmISGeL4_0 2024-09-12T00:38:37.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.322+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.710897677209870807', time=2024-09-12T02:31:03.672280+0000, chain.objs.size()=1 2024-09-12T00:38:37.322 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.322+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_._MXpAhWc_MQ7GVgKTTUu7WpxZScPfrY_0 2024-09-12T00:38:37.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.323+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5007023521520316864', time=2024-09-12T02:31:04.653619+0000, chain.objs.size()=1 2024-09-12T00:38:37.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.323+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.297__shadow_.uvsq51JNaB_swQjKQkCe6W-3n_nNm6A_0 2024-09-12T00:38:37.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.323+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15450158927810384204', time=2024-09-12T02:31:05.978775+0000, chain.objs.size()=1 2024-09-12T00:38:37.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.323+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.302__shadow_.rqqhyn3hJvgNluyIUehLCxA881Fm8ZX_0 2024-09-12T00:38:37.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.323+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2953062413498469030', time=2024-09-12T02:31:05.979553+0000, chain.objs.size()=1 2024-09-12T00:38:37.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.323+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.302__shadow_.Xp5vk5yOS-ukmwkW4SYThz5_DzoH2k3_0 2024-09-12T00:38:37.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.323+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3853339314410640976', time=2024-09-12T02:31:06.217201+0000, chain.objs.size()=1 2024-09-12T00:38:37.323 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.323+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.303__shadow_.480kNi6qIvlqLuYNJp555fi3zefY8as_0 2024-09-12T00:38:37.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.325+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15634994865194025593', time=2024-09-12T02:31:19.350131+0000, chain.objs.size()=1 2024-09-12T00:38:37.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.325+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.vIzSIcJWLFJC5odlgBZJXQhQYZCukQa_0 2024-09-12T00:38:37.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.326+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11731123190070848972', time=2024-09-12T02:31:19.357667+0000, chain.objs.size()=1 2024-09-12T00:38:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.326+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JbzAjdRopJUx1amhc1lmq-GmZUXD98g_0 2024-09-12T00:38:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.326+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18015095108230077947', time=2024-09-12T02:31:19.384649+0000, chain.objs.size()=1 2024-09-12T00:38:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.326+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.DAalEherpQiF9OaT85dgLNvUNEVGx8C_0 2024-09-12T00:38:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.326+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2819829621355788110', time=2024-09-12T02:31:19.433104+0000, chain.objs.size()=1 2024-09-12T00:38:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.326+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.hq2xmfnJWJJXZgMGm2YhYZ2YGR5bK8b_0 2024-09-12T00:38:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.326+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13976613607838677805', time=2024-09-12T02:31:19.445889+0000, chain.objs.size()=1 2024-09-12T00:38:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.326+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.xrIpMZYZeBukgKkjKZ5Q_fuRnKD9ohJ_0 2024-09-12T00:38:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.326+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3922689493591304861', time=2024-09-12T02:31:19.472334+0000, chain.objs.size()=1 2024-09-12T00:38:37.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.326+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.iVYFWVaixwG3T6DZYUoP2HHvSkhVCuX_0 2024-09-12T00:38:37.327 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.328+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7504286658335727421', time=2024-09-12T02:31:19.492532+0000, chain.objs.size()=1 2024-09-12T00:38:37.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.328+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.2sgjfZ2vI5GAOMfuj3aAWrHSnRsNYfj_0 2024-09-12T00:38:37.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.328+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8051459489413985974', time=2024-09-12T02:31:19.665288+0000, chain.objs.size()=1 2024-09-12T00:38:37.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.328+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JEWljM4ojMlQIuKaasfEjGJuD-neMEM_0 2024-09-12T00:38:37.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.328+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5441456708452539270', time=2024-09-12T02:31:19.689000+0000, chain.objs.size()=1 2024-09-12T00:38:37.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.328+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.A9qqFQsCvAn4zH8PbMqB_E_u8u0qd7-_0 2024-09-12T00:38:37.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.328+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11883340088084252088', time=2024-09-12T02:31:19.998327+0000, chain.objs.size()=1 2024-09-12T00:38:37.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.328+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.f54GpocUhkpCp1zSnzEzRUh2RTshDo0_0 2024-09-12T00:38:37.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.328+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13197856344397640354', time=2024-09-12T02:31:20.050593+0000, chain.objs.size()=1 2024-09-12T00:38:37.328 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.328+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.a-gNtaGvuujdg_Qa116kXl6PIA9ahwJ_0 2024-09-12T00:38:37.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.331+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14648307339268850853', time=2024-09-12T02:31:20.062534+0000, chain.objs.size()=1 2024-09-12T00:38:37.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.331+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.1l7R22x2SWgrKGtPmRDkTmTrgKHZk9J_0 2024-09-12T00:38:37.330 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.331+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15026962474721660207', time=2024-09-12T02:31:20.283802+0000, chain.objs.size()=1 2024-09-12T00:38:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.331+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.bvTtVoeS1Ck7qQmkVY4QIe1Pv4ZSHNW_0 2024-09-12T00:38:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.331+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16024538886661940516', time=2024-09-12T02:31:20.310083+0000, chain.objs.size()=1 2024-09-12T00:38:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.331+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.TpZF0brjga0pgUAGw2X4QgBDtAog-Ai_0 2024-09-12T00:38:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.331+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7676587019241821529', time=2024-09-12T02:31:20.358170+0000, chain.objs.size()=1 2024-09-12T00:38:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.331+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.N49NgZbKxvA71cdOTUDye0qqQUKxZJk_0 2024-09-12T00:38:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.331+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6825316508170208457', time=2024-09-12T02:31:20.390420+0000, chain.objs.size()=1 2024-09-12T00:38:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.331+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.cVPEdpS6ZU3WZXE0Y0P_jS55IB0wMrh_0 2024-09-12T00:38:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.331+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8910201562587125878', time=2024-09-12T02:31:20.409805+0000, chain.objs.size()=1 2024-09-12T00:38:37.331 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.331+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.wnKKAWojAsAK3Xy4N4qzTW1QK5uFjN0_0 2024-09-12T00:38:37.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9322981137375361407', time=2024-09-12T02:31:20.460057+0000, chain.objs.size()=1 2024-09-12T00:38:37.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.333+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.8n17VcT8q2_gahgt5PfDxajp3kdG2Ko_0 2024-09-12T00:38:37.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15284562801323904174', time=2024-09-12T02:31:20.467075+0000, chain.objs.size()=1 2024-09-12T00:38:37.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.333+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.9i6SQznFGPGa4_4M6NBaFiHjD5myDCI_0 2024-09-12T00:38:37.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5583639883048777724', time=2024-09-12T02:31:20.556590+0000, chain.objs.size()=1 2024-09-12T00:38:37.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.333+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.dX9Gcs3pXFvihjdueTmFX3S3Um-3FfB_0 2024-09-12T00:38:37.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17421903970981794070', time=2024-09-12T02:31:20.633451+0000, chain.objs.size()=1 2024-09-12T00:38:37.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.334+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.xbYbW-hG0PKds9PO73tm-DZ-oaLq0ZS_0 2024-09-12T00:38:37.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.335+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12446800735134284727', time=2024-09-12T02:31:20.648978+0000, chain.objs.size()=1 2024-09-12T00:38:37.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.335+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.RcrOD3ckkm1Bik_Xvrj7mEIjkt13esk_0 2024-09-12T00:38:37.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.335+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3802440162768199773', time=2024-09-12T02:31:20.716650+0000, chain.objs.size()=1 2024-09-12T00:38:37.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.335+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.QSAbrnmi6Y3rTCX7fyireB4rh9ljZ4S_0 2024-09-12T00:38:37.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.235967953237720453', time=2024-09-12T02:31:20.938197+0000, chain.objs.size()=1 2024-09-12T00:38:37.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.FBEFoAvbTigBvGSkvCezp_YJYW1bhRp_0 2024-09-12T00:38:37.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.977683870427879635', time=2024-09-12T02:31:20.947176+0000, chain.objs.size()=1 2024-09-12T00:38:37.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.bbINFjn2xoNXXoeF4ONb9jVRjrwpQZ3_0 2024-09-12T00:38:37.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2531365555681174863', time=2024-09-12T02:31:21.041894+0000, chain.objs.size()=1 2024-09-12T00:38:37.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.uLwlktuAcBmOZqx_dXyHAtm23KyIDkc_0 2024-09-12T00:38:37.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10870458558527024558', time=2024-09-12T02:31:21.048951+0000, chain.objs.size()=1 2024-09-12T00:38:37.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.toOXGMofZezkid7FqnI2ikcl8Jl8fRG_0 2024-09-12T00:38:37.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.338+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15434890545336186001', time=2024-09-12T02:31:21.069686+0000, chain.objs.size()=1 2024-09-12T00:38:37.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.338+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.0VAENFbY5hVZ8gezWPTr-YmuGACqIuq_0 2024-09-12T00:38:37.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.339+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5423341665950190250', time=2024-09-12T02:31:21.495387+0000, chain.objs.size()=1 2024-09-12T00:38:37.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.339+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.OZvLskbDHs54JjzYeI9p6k0M8fPDc2w_0 2024-09-12T00:38:37.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.339+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7750371256425604225', time=2024-09-12T02:31:21.523961+0000, chain.objs.size()=1 2024-09-12T00:38:37.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.339+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.0tNNOVal7RT65ynGLCvthBgmepu1ZRB_0 2024-09-12T00:38:37.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.339+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13126341566365235235', time=2024-09-12T02:31:21.627056+0000, chain.objs.size()=1 2024-09-12T00:38:37.338 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.339+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.BdyMuPvHFN2P7si7wqze6PxYh8vJw45_0 2024-09-12T00:38:37.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.339+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5068348830812720755', time=2024-09-12T02:31:29.717638+0000, chain.objs.size()=1 2024-09-12T00:38:37.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.339+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.2Ie-dw5goM1OzFZMCrFVV_ohGxC8vXN_0 2024-09-12T00:38:37.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.339+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10470156483214118991', time=2024-09-12T02:31:29.740176+0000, chain.objs.size()=1 2024-09-12T00:38:37.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.339+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.gn0OB53G1Q6TuG3IbtXBToHt9UB7Vm6_0 2024-09-12T00:38:37.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.339+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9818850509048359288', time=2024-09-12T02:31:29.744151+0000, chain.objs.size()=1 2024-09-12T00:38:37.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.339+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.F81Y3BftZXV8dRn5oS00yPlEUdKcBdr_0 2024-09-12T00:38:37.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.343+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14701053592558542699', time=2024-09-12T02:31:29.799707+0000, chain.objs.size()=1 2024-09-12T00:38:37.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.343+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.IpEf3eebdIRnHEXFzivDwkG_0XxIbIH_0 2024-09-12T00:38:37.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.343+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4157354191081545527', time=2024-09-12T02:31:29.841770+0000, chain.objs.size()=1 2024-09-12T00:38:37.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.343+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.fD9tk0JhTQ2gHjVcBzJbt5P0HNTYTe-_0 2024-09-12T00:38:37.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.343+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7893499928226355837', time=2024-09-12T02:31:30.066014+0000, chain.objs.size()=1 2024-09-12T00:38:37.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.343+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.yVks5o0gOVPOUf7KI2JqywCPnZccPRH_0 2024-09-12T00:38:37.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.343+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.875314293367474269', time=2024-09-12T02:31:30.093550+0000, chain.objs.size()=1 2024-09-12T00:38:37.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.343+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.U5QAdBHoAtibCRcgnYq_z4ScEorQNDf_0 2024-09-12T00:38:37.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.344+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18158622652469985679', time=2024-09-12T02:31:30.162666+0000, chain.objs.size()=1 2024-09-12T00:38:37.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.344+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mnLovFg3Lnb19jx9Oi5b4ciPZX4PIsO_0 2024-09-12T00:38:37.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.344+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9859878393535404826', time=2024-09-12T02:31:30.285010+0000, chain.objs.size()=1 2024-09-12T00:38:37.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.344+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lGuLXGRCU8-MQGOoAgVv9R3VhJeMNJi_0 2024-09-12T00:38:37.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.345+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12396538010283643663', time=2024-09-12T02:31:30.360503+0000, chain.objs.size()=1 2024-09-12T00:38:37.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.345+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.6jdGV9viuYgzVIQinFscbnn56Aoeh_f_0 2024-09-12T00:38:37.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.345+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12526039440931485038', time=2024-09-12T02:31:30.361193+0000, chain.objs.size()=1 2024-09-12T00:38:37.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.345+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.G5l6rBabUzV8_5h_6WIhNJznlK7GgrJ_0 2024-09-12T00:38:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.347+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12934004420636296543', time=2024-09-12T02:31:30.432208+0000, chain.objs.size()=1 2024-09-12T00:38:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.347+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ILgD9OgEtHv6ts4ZLET2P5s3ZlaFRUQ_0 2024-09-12T00:38:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.347+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9182698062590019570', time=2024-09-12T02:31:30.567126+0000, chain.objs.size()=1 2024-09-12T00:38:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.347+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.u_2BIgYGWJ6EeLRKY706BmlS3HRWk6W_0 2024-09-12T00:38:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.347+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6627424648506706110', time=2024-09-12T02:31:30.576407+0000, chain.objs.size()=1 2024-09-12T00:38:37.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.347+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.3BJUHdfaoJ2WpJhaAaIa4wyFSsEqovs_0 2024-09-12T00:38:37.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.348+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9701306266433524639', time=2024-09-12T02:31:30.890615+0000, chain.objs.size()=1 2024-09-12T00:38:37.347 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.348+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mqTXEEvzv7dnuIfbfd2yfwMZ4wG1At4_0 2024-09-12T00:38:37.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.349+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9671199718840929953', time=2024-09-12T02:31:30.988998+0000, chain.objs.size()=1 2024-09-12T00:38:37.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.349+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.sQlnUmyHs0klIruY9R_uMNev6ZyuJgH_0 2024-09-12T00:38:37.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.349+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2341433850979798161', time=2024-09-12T02:31:31.000846+0000, chain.objs.size()=1 2024-09-12T00:38:37.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.349+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.x-AmqcQyY84IfZEtCTnk75brCkr36pU_0 2024-09-12T00:38:37.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.350+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8619747500585119368', time=2024-09-12T02:31:31.024096+0000, chain.objs.size()=1 2024-09-12T00:38:37.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.350+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.CkpMk8-cp_yqikkDhBVBeNhqC_lHE5P_0 2024-09-12T00:38:37.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.350+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10674669005169623274', time=2024-09-12T02:31:31.125266+0000, chain.objs.size()=1 2024-09-12T00:38:37.349 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.350+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mpswDgHIk9ja6a1gqpoJ0PKwh_lQGJh_0 2024-09-12T00:38:37.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.350+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11146323339975651826', time=2024-09-12T02:31:31.126260+0000, chain.objs.size()=1 2024-09-12T00:38:37.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.350+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ZRyTohIldEvjnbY9qR5Yfk34kP5vJJi_0 2024-09-12T00:38:37.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.350+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10431235163526556009', time=2024-09-12T02:31:31.161012+0000, chain.objs.size()=1 2024-09-12T00:38:37.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.350+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Z1FcS7g8LPW3EBmc0I2thQT9mcI5RNT_0 2024-09-12T00:38:37.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.350+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12726089572910394081', time=2024-09-12T02:31:31.215482+0000, chain.objs.size()=1 2024-09-12T00:38:37.350 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.350+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.kYxSoATvXL5mqqm2X5n9gScRmacdABy_0 2024-09-12T00:38:37.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.352+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7441170842623028055', time=2024-09-12T02:31:31.247528+0000, chain.objs.size()=1 2024-09-12T00:38:37.351 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.352+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.aX-K6-GQmvHf6hSDdXNwOLcY4V1Ca2h_0 2024-09-12T00:38:37.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.353+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10054197076587452414', time=2024-09-12T02:31:31.276620+0000, chain.objs.size()=1 2024-09-12T00:38:37.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.353+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Ij7NF45RjRA1nWWhpjBkAZLtZ-mrmlp_0 2024-09-12T00:38:37.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.353+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17143138171973549649', time=2024-09-12T02:31:31.452638+0000, chain.objs.size()=1 2024-09-12T00:38:37.352 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.353+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.6kVICR3BfyQ6wp_Y45pBdrclsTvWxQd_0 2024-09-12T00:38:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.353+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15532173728918350205', time=2024-09-12T02:31:31.457160+0000, chain.objs.size()=1 2024-09-12T00:38:37.353 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.353+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.2NJa0vWiGc8t4LqQhqPCbMJ5rIGt--I_0 2024-09-12T00:38:37.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.356+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14663520715666445914', time=2024-09-12T02:31:31.534973+0000, chain.objs.size()=1 2024-09-12T00:38:37.355 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.356+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.XIEZwwPs52WmY7kDYk4B9USIb0VVO-Y_0 2024-09-12T00:38:37.358 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.359+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/45068 2024-09-12T00:38:37.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:38:37.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8027555363367601079', time=2024-09-12T02:31:31.668715+0000, chain.objs.size()=1 2024-09-12T00:38:37.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.2aWbLcpVw6cd-5eYIIMYeTEFlQSbAVC_0 2024-09-12T00:38:37.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5951353907422965002', time=2024-09-12T02:31:31.674995+0000, chain.objs.size()=1 2024-09-12T00:38:37.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Y-tGwQ2BuXO1AYA6XA7rpI6_Y2_8THk_0 2024-09-12T00:38:37.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14002486484990474434', time=2024-09-12T02:31:31.701632+0000, chain.objs.size()=1 2024-09-12T00:38:37.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lH3ITPp_8QJMXTjQX7h-JGEc86xrydQ_0 2024-09-12T00:38:37.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3122745613454823525', time=2024-09-12T02:31:31.739966+0000, chain.objs.size()=1 2024-09-12T00:38:37.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.x5HebFLL8oFXEdSSgsFqjmUT_ExJLLi_0 2024-09-12T00:38:37.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6766134840272624973', time=2024-09-12T02:31:31.762567+0000, chain.objs.size()=1 2024-09-12T00:38:37.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Kf3veO3LLMFN-Wx3dtrjgUN_lHGxO1p_0 2024-09-12T00:38:37.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2623215114289318270', time=2024-09-12T02:31:31.801318+0000, chain.objs.size()=1 2024-09-12T00:38:37.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.HY_Wfg08CR-_4j88rfMKfqxJ2LgCOCf_0 2024-09-12T00:38:37.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15997693099462364990', time=2024-09-12T02:32:03.973255+0000, chain.objs.size()=1 2024-09-12T00:38:37.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.450__shadow_.q-NpiO9oHn8u6AY9Xx_vAjAre35RFya_0 2024-09-12T00:38:37.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8150742713183145316', time=2024-09-12T02:32:17.063822+0000, chain.objs.size()=1 2024-09-12T00:38:37.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.500__shadow_.2cwjuvqwnTXntSA6CcHsH2tbFC5aQuh_0 2024-09-12T00:38:37.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13232556006761922555', time=2024-09-12T02:32:21.709175+0000, chain.objs.size()=1 2024-09-12T00:38:37.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.515__shadow_.nGChl_Vy4fOJrG1H6SRTxc6FguDFG_s_0 2024-09-12T00:38:37.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8072160781744537319', time=2024-09-12T02:33:06.447877+0000, chain.objs.size()=1 2024-09-12T00:38:37.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.553__shadow_.FWB8A3YN3Yek2bq-6gOXSrljHJAhzZW_0 2024-09-12T00:38:37.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1720328914426565144', time=2024-09-12T02:33:47.623185+0000, chain.objs.size()=1 2024-09-12T00:38:37.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.583__shadow:r1HdxoLq4MYRtGNrapie5D9mtbxzEzM_.gjlSfxHrGhsMZDbSWhLV2Zshi6ocl67_0 2024-09-12T00:38:37.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11471192705216940189', time=2024-09-12T02:36:16.313576+0000, chain.objs.size()=1 2024-09-12T00:38:37.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.361+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.664__shadow_.vvOi9fp1MU6JzVSrLyqwT2tyT4-UuvC_0 2024-09-12T00:38:37.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.365+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4427184895691940515', time=2024-09-12T02:36:56.821841+0000, chain.objs.size()=1 2024-09-12T00:38:37.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.365+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.744__shadow_.5ioyN0SBBT6_iyDBin_Yl9Bv2c9kcIl_0 2024-09-12T00:38:37.367 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.368+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:37.369 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.370+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:38:37.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.371+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:37.371 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.372+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:37.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47470' 2024-09-12T00:38:37.372 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13710749589970245748', time=2024-09-12T02:30:53.405332+0000, chain.objs.size()=1 2024-09-12T00:38:37.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.IVEcGvdArIE7FEHiJBb4UKutNboP0WO_0 2024-09-12T00:38:37.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7114585467752158787', time=2024-09-12T02:30:53.499378+0000, chain.objs.size()=1 2024-09-12T00:38:37.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pZKxW2DBP0p7bO0W7Yd4-oTOCdnMrBw_0 2024-09-12T00:38:37.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9693848317337369374', time=2024-09-12T02:30:53.507020+0000, chain.objs.size()=1 2024-09-12T00:38:37.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ouh9GRjPAjJF7a3QjWlK6zjpMp-TFTW_0 2024-09-12T00:38:37.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9574645875805165386', time=2024-09-12T02:30:53.525338+0000, chain.objs.size()=1 2024-09-12T00:38:37.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.aJOaBawu_mtlQ5J_swCykHPX5LW-ziQ_0 2024-09-12T00:38:37.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9759313459890793840', time=2024-09-12T02:30:53.821849+0000, chain.objs.size()=1 2024-09-12T00:38:37.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.S2jG0fqEJK-802jeL_KNDpQAqRS5EDe_0 2024-09-12T00:38:37.373 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2070970795533462828', time=2024-09-12T02:30:53.944000+0000, chain.objs.size()=1 2024-09-12T00:38:37.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ZtbJG168nN7oh3d9AboC9ilcd4746Ty_0 2024-09-12T00:38:37.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4324702295682693759', time=2024-09-12T02:30:53.983475+0000, chain.objs.size()=1 2024-09-12T00:38:37.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AQY9PlPdM_aAkledOtTf5kdRCZQ9wqQ_0 2024-09-12T00:38:37.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13348792217588236333', time=2024-09-12T02:30:53.990165+0000, chain.objs.size()=1 2024-09-12T00:38:37.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ZcbNXZ4FOCDAFKd63aPJT2hBuv0_MhR_0 2024-09-12T00:38:37.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2839338063084648851', time=2024-09-12T02:30:54.064971+0000, chain.objs.size()=1 2024-09-12T00:38:37.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.o2X0gQCkkH79OAm46Onj7bc2I0UOS2V_0 2024-09-12T00:38:37.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16799841049508913700', time=2024-09-12T02:30:54.075833+0000, chain.objs.size()=1 2024-09-12T00:38:37.374 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.uH9qLS5rv6RMoe3fY_FJC0fYgactnX5_0 2024-09-12T00:38:37.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6110163724170000941', time=2024-09-12T02:30:54.267049+0000, chain.objs.size()=1 2024-09-12T00:38:37.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.er5iukggxxAQtD6hvxNa9oU6HS_C0qr_0 2024-09-12T00:38:37.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.492879404644617468', time=2024-09-12T02:30:54.394122+0000, chain.objs.size()=1 2024-09-12T00:38:37.375 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.373+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.z_nA1leWg__NRFVutgYfBUA-4_AntDM_0 2024-09-12T00:38:37.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9891651253302113897', time=2024-09-12T02:30:54.572836+0000, chain.objs.size()=1 2024-09-12T00:38:37.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.fRgFNLOJnfF3GBqi7GqFe8yemazcqJQ_0 2024-09-12T00:38:37.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9047107177509781210', time=2024-09-12T02:30:54.617600+0000, chain.objs.size()=1 2024-09-12T00:38:37.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.q9YBapI0P_HojFoEJyPiBft_PVtHfRK_0 2024-09-12T00:38:37.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13273249095928328587', time=2024-09-12T02:30:54.822940+0000, chain.objs.size()=1 2024-09-12T00:38:37.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YHMQAUMUtN9wFogChWngx7M8STqdAb-_0 2024-09-12T00:38:37.377 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2135504865642916937', time=2024-09-12T02:30:54.868473+0000, chain.objs.size()=1 2024-09-12T00:38:37.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JoTKATmHwxMogjZSfctlgKuYKS1T2WN_0 2024-09-12T00:38:37.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13398638271515966813', time=2024-09-12T02:30:54.978006+0000, chain.objs.size()=1 2024-09-12T00:38:37.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.IUGXQeTgDcAj7CEnH2xoxqUzVxaUb3h_0 2024-09-12T00:38:37.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10512766519332525844', time=2024-09-12T02:30:54.998820+0000, chain.objs.size()=1 2024-09-12T00:38:37.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.5geNgISuhNEeLGvcES-qtDAn4Z0bwjT_0 2024-09-12T00:38:37.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4190351948599205321', time=2024-09-12T02:30:55.115701+0000, chain.objs.size()=1 2024-09-12T00:38:37.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.N8cjLBH9NEpekXuVJOZQyAJrwav1vJF_0 2024-09-12T00:38:37.378 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2858281355709261782', time=2024-09-12T02:30:55.177581+0000, chain.objs.size()=1 2024-09-12T00:38:37.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.FGInhX-0Gb2Ja0PhX_HpujkghhrCEj2_0 2024-09-12T00:38:37.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16132871846993149049', time=2024-09-12T02:30:57.142191+0000, chain.objs.size()=1 2024-09-12T00:38:37.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.270__shadow_.AeM-9jxm3fpj8PtC1hXxd2YqOXg1cM6_0 2024-09-12T00:38:37.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12688993815440538152', time=2024-09-12T02:30:59.344827+0000, chain.objs.size()=1 2024-09-12T00:38:37.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.279__shadow_.GikdFixBMR_GL7PLgmQtJUyUXVLGCTN_0 2024-09-12T00:38:37.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17196435568369518033', time=2024-09-12T02:30:59.587879+0000, chain.objs.size()=1 2024-09-12T00:38:37.379 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.378+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.280__shadow_._Ilz2PdfIxKQbjiNIu2inoKRW3QPuwB_0 2024-09-12T00:38:37.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.383+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10685760709717511975', time=2024-09-12T02:31:00.868288+0000, chain.objs.size()=1 2024-09-12T00:38:37.382 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.383+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.285__shadow_.uM0IJwgCgvbVRt14LcBTLfmzcHhcZel_0 2024-09-12T00:38:37.383 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.384+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16305128927175113395', time=2024-09-12T02:31:01.635430+0000, chain.objs.size()=1 2024-09-12T00:38:37.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.384+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.288__shadow_.pqtGLODA2Z8cxHevQSyamgMFSgOOfb5_0 2024-09-12T00:38:37.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.384+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14243195176476005722', time=2024-09-12T02:31:03.074467+0000, chain.objs.size()=1 2024-09-12T00:38:37.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.384+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.1ypS_xLH50KRpUyoRUke7kC0az5OSrL_0 2024-09-12T00:38:37.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.384+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16228303148592054232', time=2024-09-12T02:31:03.891076+0000, chain.objs.size()=1 2024-09-12T00:38:37.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.384+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.294__shadow_.FrBF6VCs0Fto4UtaNB82fq6ZHtlejPy_0 2024-09-12T00:38:37.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.384+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7620160884338183066', time=2024-09-12T02:31:05.701754+0000, chain.objs.size()=1 2024-09-12T00:38:37.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.384+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.301__shadow_.3Zi_s1Fh6lcdQ7yZuvZV_Gou8SaQjkt_0 2024-09-12T00:38:37.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.384+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3115053492319254522', time=2024-09-12T02:31:19.465101+0000, chain.objs.size()=1 2024-09-12T00:38:37.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.384+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.YLKPXMMcI6lG5_Hs6fXSHiDdWUEABGz_0 2024-09-12T00:38:37.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.384+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14341084071150974000', time=2024-09-12T02:31:19.506280+0000, chain.objs.size()=1 2024-09-12T00:38:37.384 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.384+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.oiyzQmM4MwAYF2ApZ06ktBje-ZuJ09u_0 2024-09-12T00:38:37.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.385+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16073522843712750546', time=2024-09-12T02:31:19.525067+0000, chain.objs.size()=1 2024-09-12T00:38:37.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.385+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.SPuhi8-2B8zrbM9dkoVquJwQS03zV4u_0 2024-09-12T00:38:37.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.385+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18351142649272512315', time=2024-09-12T02:31:19.556860+0000, chain.objs.size()=1 2024-09-12T00:38:37.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.385+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.DfqQX9UFUeYjONfV6iCh2LnHn_EFZSF_0 2024-09-12T00:38:37.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.386+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4631598181651511669', time=2024-09-12T02:31:19.565177+0000, chain.objs.size()=1 2024-09-12T00:38:37.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.386+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.HW_Aki8QzfQ59KNOxjECjq5NPDopq6w_0 2024-09-12T00:38:37.385 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.386+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13805613418869412975', time=2024-09-12T02:31:19.657813+0000, chain.objs.size()=1 2024-09-12T00:38:37.386 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.386+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Nl9g3tryLlVa5xePoy8TRbzMcGE_wpb_0 2024-09-12T00:38:37.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13915478466153922035', time=2024-09-12T02:31:19.698911+0000, chain.objs.size()=1 2024-09-12T00:38:37.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.XabpxMwp8SAkUAnZVyhbUkD3vXMhtvj_0 2024-09-12T00:38:37.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.446998665206094065', time=2024-09-12T02:31:19.728364+0000, chain.objs.size()=1 2024-09-12T00:38:37.387 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.P_08khlqAxdS6IfRVkPMHIKGwJ1KZvm_0 2024-09-12T00:38:37.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8101509491459737864', time=2024-09-12T02:31:19.797502+0000, chain.objs.size()=1 2024-09-12T00:38:37.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.uLbhpz1SXzF-zsIb44zs10p41dIu-A__0 2024-09-12T00:38:37.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4222611754093665754', time=2024-09-12T02:31:19.838484+0000, chain.objs.size()=1 2024-09-12T00:38:37.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ai2VAR4JHQblljtFuAO192372BPrnO8_0 2024-09-12T00:38:37.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16375098389651461120', time=2024-09-12T02:31:19.846258+0000, chain.objs.size()=1 2024-09-12T00:38:37.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.K5lgs0eBrgBzTfuZq-QAR4PqKzyu2y7_0 2024-09-12T00:38:37.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.388+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1076714043481159722', time=2024-09-12T02:31:20.046501+0000, chain.objs.size()=1 2024-09-12T00:38:37.388 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.388+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.XxMK0vxjvm6dqXlsJplo4GJY2G6qj4T_0 2024-09-12T00:38:37.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.391+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5521864197813853414', time=2024-09-12T02:31:20.153302+0000, chain.objs.size()=1 2024-09-12T00:38:37.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.391+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.a-qHRCSgC3f0ksX-SdG_7JmvCL-fu--_0 2024-09-12T00:38:37.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.391+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3498304826354385093', time=2024-09-12T02:31:20.555229+0000, chain.objs.size()=1 2024-09-12T00:38:37.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.391+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.DNZru6YRZQ2N5T_xgymYFg6zErQjEjI_0 2024-09-12T00:38:37.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.391+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10623985623635214052', time=2024-09-12T02:31:20.643994+0000, chain.objs.size()=1 2024-09-12T00:38:37.390 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.391+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.dNHcLD-3ZQYnGstzJOZ-6ISp0SN9ttQ_0 2024-09-12T00:38:37.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.391+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5328150409804437760', time=2024-09-12T02:31:20.663112+0000, chain.objs.size()=1 2024-09-12T00:38:37.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.391+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ywCSSakt2GujJZG3QVHeE4NlyOiRc8q_0 2024-09-12T00:38:37.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.391+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13944897186531390833', time=2024-09-12T02:31:20.687117+0000, chain.objs.size()=1 2024-09-12T00:38:37.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.391+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.RTDvPPUmb4lkhmReS0vKxf7ktO-Ia_g_0 2024-09-12T00:38:37.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.392+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9035492483586537995', time=2024-09-12T02:31:20.695779+0000, chain.objs.size()=1 2024-09-12T00:38:37.391 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.392+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.bR2OBCP1O2bwpVo59sKfDDUqlfzIhcH_0 2024-09-12T00:38:37.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.395+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17544774740575524341', time=2024-09-12T02:31:20.703770+0000, chain.objs.size()=1 2024-09-12T00:38:37.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.395+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.0yi1EIARqi6V8BxeLJBtQa4q_cLr_fS_0 2024-09-12T00:38:37.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.395+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17377179445787233091', time=2024-09-12T02:31:20.876531+0000, chain.objs.size()=1 2024-09-12T00:38:37.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.395+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.vxSGzQzcvCUIEwKXl3u5n2pqk7-9b3G_0 2024-09-12T00:38:37.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.395+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17858599135173782189', time=2024-09-12T02:31:20.883908+0000, chain.objs.size()=1 2024-09-12T00:38:37.394 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.395+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.m6tXxymnkVGsMzhPIgnkqHGAEmCKqkF_0 2024-09-12T00:38:37.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3980034769426396813', time=2024-09-12T02:31:20.889630+0000, chain.objs.size()=1 2024-09-12T00:38:37.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Yb2LHlvAC4j-EQwKMytMksBwrR3J6ds_0 2024-09-12T00:38:37.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2194079737959967582', time=2024-09-12T02:31:20.996605+0000, chain.objs.size()=1 2024-09-12T00:38:37.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.isnd50zehNb6vEBT2XY3JuLsLED9-ba_0 2024-09-12T00:38:37.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1582414234138504207', time=2024-09-12T02:31:21.053079+0000, chain.objs.size()=1 2024-09-12T00:38:37.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.-tMQ437hgDC_6TQShyn3zO2PI22xYxj_0 2024-09-12T00:38:37.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16431553947458806136', time=2024-09-12T02:31:21.061203+0000, chain.objs.size()=1 2024-09-12T00:38:37.397 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.q4zCQETsKCk7znFtwUcl6FbGN1Eagez_0 2024-09-12T00:38:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9093621135374427970', time=2024-09-12T02:31:21.179440+0000, chain.objs.size()=1 2024-09-12T00:38:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.1hh1k8MegoRf57g5HEH9_eV_hQTuz4G_0 2024-09-12T00:38:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4599196170824537222', time=2024-09-12T02:31:21.277705+0000, chain.objs.size()=1 2024-09-12T00:38:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.dr5Rq5a57RQUJznFzX2DW7OCUT5yehK_0 2024-09-12T00:38:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10896302188870134974', time=2024-09-12T02:31:21.285813+0000, chain.objs.size()=1 2024-09-12T00:38:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.t9UsuolVmG_IGn67B7ullineBBd0j3i_0 2024-09-12T00:38:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3825218588404542115', time=2024-09-12T02:31:21.332791+0000, chain.objs.size()=1 2024-09-12T00:38:37.398 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.397+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.e9HmB0rY9KOsG7jJeWnCvrZUTPhNzMb_0 2024-09-12T00:38:37.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.399+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15928195709125631149', time=2024-09-12T02:31:21.350993+0000, chain.objs.size()=1 2024-09-12T00:38:37.399 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.399+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7PaSWr9zxLxqfERLVMSFvLMNKmxi91m_0 2024-09-12T00:38:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.401+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5468514434619321819', time=2024-09-12T02:31:21.354592+0000, chain.objs.size()=1 2024-09-12T00:38:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.401+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JB9OGIlrqoyxuSOiJKll3HyqZTb1hBx_0 2024-09-12T00:38:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.401+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17441261995336408526', time=2024-09-12T02:31:21.510230+0000, chain.objs.size()=1 2024-09-12T00:38:37.400 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.401+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.u9KbgB2NWt39N10YaFE30MxsPLgvoPv_0 2024-09-12T00:38:37.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.401+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7043251255852842814', time=2024-09-12T02:31:21.597733+0000, chain.objs.size()=1 2024-09-12T00:38:37.401 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.401+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.CAuZsKXKBL2xCM_cUJky-babG7L96dd_0 2024-09-12T00:38:37.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11138041382070610519', time=2024-09-12T02:31:29.702214+0000, chain.objs.size()=1 2024-09-12T00:38:37.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.E03ipEwdbEFvJKSK4PgGT5DThLkR3Nq_0 2024-09-12T00:38:37.402 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17570678367786307477', time=2024-09-12T02:31:29.762228+0000, chain.objs.size()=1 2024-09-12T00:38:37.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.b8aiY0Bl3ZZQjvh-C9TMjWXE0OAJu79_0 2024-09-12T00:38:37.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6222218596994039013', time=2024-09-12T02:31:29.856909+0000, chain.objs.size()=1 2024-09-12T00:38:37.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.N5BR0sIcTiL_LhTXrJbRP10NbEd89ob_0 2024-09-12T00:38:37.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2662944596379890995', time=2024-09-12T02:31:30.002665+0000, chain.objs.size()=1 2024-09-12T00:38:37.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.UpaxWO8-xGLBJxnyl09DZft9EkyQH9Q_0 2024-09-12T00:38:37.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9517112972855478018', time=2024-09-12T02:31:30.007597+0000, chain.objs.size()=1 2024-09-12T00:38:37.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.G4YF67QjFE-QImkYd6YeT2BmI3kmMu1_0 2024-09-12T00:38:37.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1730431413693237584', time=2024-09-12T02:31:30.009621+0000, chain.objs.size()=1 2024-09-12T00:38:37.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.GawZMn117Ps9Su6uTvZyxSRBSeQnLCb_0 2024-09-12T00:38:37.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13821659578762728230', time=2024-09-12T02:31:30.063561+0000, chain.objs.size()=1 2024-09-12T00:38:37.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.tMrtH5M3t21Xb3k5by6aUMg2WDVCZoX_0 2024-09-12T00:38:37.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17443675646258202335', time=2024-09-12T02:31:30.151181+0000, chain.objs.size()=1 2024-09-12T00:38:37.403 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.403+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.yaH-KsLidAI_dGbzMcWNHcj7JJRfB-U_0 2024-09-12T00:38:37.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.406+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13298068085085230983', time=2024-09-12T02:31:30.314602+0000, chain.objs.size()=1 2024-09-12T00:38:37.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.406+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.bOsFXQOvGXPi0GfPW2JsqtUmLD6HkOv_0 2024-09-12T00:38:37.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.406+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3506591081407816047', time=2024-09-12T02:31:30.443107+0000, chain.objs.size()=1 2024-09-12T00:38:37.405 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.406+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.IevuSB9M8h7x445fVsc7J8E0C9dOjnk_0 2024-09-12T00:38:37.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.406+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16867309621005064944', time=2024-09-12T02:31:30.578423+0000, chain.objs.size()=1 2024-09-12T00:38:37.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.406+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.UkWz45sJ7t2RRytFeEVnC5u9sC3bfud_0 2024-09-12T00:38:37.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.407+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9880260161421037948', time=2024-09-12T02:31:30.614074+0000, chain.objs.size()=1 2024-09-12T00:38:37.406 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.407+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Sd-Pi-zn1xHAh4i_Nz4tGn-uKiavZ5s_0 2024-09-12T00:38:37.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.408+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3375842292301786022', time=2024-09-12T02:31:30.712319+0000, chain.objs.size()=1 2024-09-12T00:38:37.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.408+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.T-W_vySr0-2e6eMYRKpeCjaLzog5Svv_0 2024-09-12T00:38:37.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.408+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.90996560690659124', time=2024-09-12T02:31:30.904032+0000, chain.objs.size()=1 2024-09-12T00:38:37.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.408+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._sU4w2O0Ixmb5uMawwQZ3Xs9lGwFQRH_0 2024-09-12T00:38:37.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.409+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10943981457790663066', time=2024-09-12T02:31:30.927363+0000, chain.objs.size()=1 2024-09-12T00:38:37.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.409+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Wtn1jnFP5LUL0D4GkWNKqEhwuBo0D_M_0 2024-09-12T00:38:37.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.409+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.900557817593962941', time=2024-09-12T02:31:30.935990+0000, chain.objs.size()=1 2024-09-12T00:38:37.408 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.409+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.jDY8SlAo93WoPRHjUxeeoYWyMSKdOtw_0 2024-09-12T00:38:37.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.410+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13837455642900770753', time=2024-09-12T02:31:30.958587+0000, chain.objs.size()=1 2024-09-12T00:38:37.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.410+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.AImrGedZ2N-Bov9FY89yOA2-6dhB1c8_0 2024-09-12T00:38:37.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.410+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16400321426723611366', time=2024-09-12T02:31:30.980889+0000, chain.objs.size()=1 2024-09-12T00:38:37.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.410+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.gcgLL6InI7ZfwCLVrkCcilF0KQtHee5_0 2024-09-12T00:38:37.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.411+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1016553327979485861', time=2024-09-12T02:31:31.120572+0000, chain.objs.size()=1 2024-09-12T00:38:37.410 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.411+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.18qAtX3hTT8mhGxGEU9dfNShwgCYJSY_0 2024-09-12T00:38:37.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.412+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.434599495809804085', time=2024-09-12T02:31:31.144620+0000, chain.objs.size()=1 2024-09-12T00:38:37.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.412+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.VH-x7ePGL9r5vuu0OWPaOvg8wZTZDUL_0 2024-09-12T00:38:37.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.412+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18431710005010065944', time=2024-09-12T02:31:31.194734+0000, chain.objs.size()=1 2024-09-12T00:38:37.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.412+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ASaZtmMHkesPBNWhF3mDHh6pD5JbYk__0 2024-09-12T00:38:37.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.412+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8525537607048928783', time=2024-09-12T02:31:31.267924+0000, chain.objs.size()=1 2024-09-12T00:38:37.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.412+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.xiTLENpq6xKRJ38oIjkijRE8u_wXUYX_0 2024-09-12T00:38:37.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.412+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2814866393471027857', time=2024-09-12T02:31:31.277895+0000, chain.objs.size()=1 2024-09-12T00:38:37.411 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.412+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.22T8sxMTMMCREph84ER6kmGGRa53ZMf_0 2024-09-12T00:38:37.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.413+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5047091301504784744', time=2024-09-12T02:31:31.425535+0000, chain.objs.size()=1 2024-09-12T00:38:37.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.413+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.VYEYN7i5ZgbtHSxu1AVdSDpLcqbwxb8_0 2024-09-12T00:38:37.412 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.413+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2180695553055845144', time=2024-09-12T02:31:31.485732+0000, chain.objs.size()=1 2024-09-12T00:38:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.413+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._E_yRK95mJX0ThagEGfOaS48lIzm0tL_0 2024-09-12T00:38:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.413+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18134399929698895063', time=2024-09-12T02:31:31.584933+0000, chain.objs.size()=1 2024-09-12T00:38:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.413+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.bNkw5IAZ6k74t7r-t0K15hT2Xgi-rys_0 2024-09-12T00:38:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.413+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18171451633344458150', time=2024-09-12T02:31:31.673667+0000, chain.objs.size()=1 2024-09-12T00:38:37.413 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.413+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.WSbUPOj_T2uMoht33blQSgQHBHrL88-_0 2024-09-12T00:38:37.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.416+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.943960779599665502', time=2024-09-12T02:31:31.697093+0000, chain.objs.size()=1 2024-09-12T00:38:37.415 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.416+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.eViNqQFe58VcktzascUe6MF-_6hQyyy_0 2024-09-12T00:38:37.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.417+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17452701023722596341', time=2024-09-12T02:31:31.714135+0000, chain.objs.size()=1 2024-09-12T00:38:37.416 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.417+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.LwqxwDR47w6bxVpay_yRXL9KOEE5OCJ_0 2024-09-12T00:38:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.417+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10261656944129846419', time=2024-09-12T02:31:31.725883+0000, chain.objs.size()=1 2024-09-12T00:38:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.417+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.N7ni-eDeVvckyCpiEdJiKY_HrRrjnH7_0 2024-09-12T00:38:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.417+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7143469692446845897', time=2024-09-12T02:31:44.576619+0000, chain.objs.size()=1 2024-09-12T00:38:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.417+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.379__shadow_.iAP8SFh5ER5A0C-ttLpDEQrvbkHn81Y_0 2024-09-12T00:38:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.417+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15729488190135020830', time=2024-09-12T02:31:44.684577+0000, chain.objs.size()=1 2024-09-12T00:38:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.417+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.379__shadow_.f6_nAZhKoG6mtXoCJgJ9Xp6p1nyH8d8_0 2024-09-12T00:38:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.417+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13640476767284889531', time=2024-09-12T02:32:09.205374+0000, chain.objs.size()=1 2024-09-12T00:38:37.417 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.417+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.465__shadow_.1cw17y4EI90LTXAagNmNOf2UAKwJB-c_0 2024-09-12T00:38:37.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.417+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10193912919193090224', time=2024-09-12T02:32:31.234417+0000, chain.objs.size()=6 2024-09-12T00:38:37.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.417+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart._oH75729H1kjMregOcWPAa1XLKxRlUUK.1 2024-09-12T00:38:37.418 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.419+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.htKumW72ZvISNGR6Wgr-DSFYmLYHGkxr.2 2024-09-12T00:38:37.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.422+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.RLtNNTXj3R2HMYPUsXBxnvbiNDh-r5M2.3 2024-09-12T00:38:37.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.422+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.RY9VAEBPyGP-9I9iYS1xW-eMHGLOAv0K.4 2024-09-12T00:38:37.421 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.422+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.8R2102nT-Jpop2c3Nm_MTnrtMkwx_njG.5 2024-09-12T00:38:37.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.422+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.KTlsFpaTGuFnPpwmdDSEgeNYeHxuxTdH.6 2024-09-12T00:38:37.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.423+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~J2KoJiOAqswGoj9nLYxHdOI-t9caqhu', time=2024-09-12T02:32:37.072034+0000, chain.objs.size()=1 2024-09-12T00:38:37.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.423+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.533__multipart_mymultipart.2~J2KoJiOAqswGoj9nLYxHdOI-t9caqhu.1 2024-09-12T00:38:37.422 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.423+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13656614891737604058', time=2024-09-12T02:33:05.253370+0000, chain.objs.size()=1 2024-09-12T00:38:37.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.423+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.550__shadow_.9uGy5vMRNLWh1Hu2suaN-RHla58M07F_0 2024-09-12T00:38:37.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.423+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14569095105709751479', time=2024-09-12T02:33:08.102053+0000, chain.objs.size()=1 2024-09-12T00:38:37.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.423+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.557__shadow_.2UdisgyxrVKMIruTcWRWpWi9sd7wlWs_0 2024-09-12T00:38:37.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.423+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6030821590455966438', time=2024-09-12T02:33:09.360767+0000, chain.objs.size()=1 2024-09-12T00:38:37.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.423+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.559__shadow_.CSfr1fBqGdQDuW5MOS6sDRYWuJ0QmR7_0 2024-09-12T00:38:37.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.423+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9984727058291492511', time=2024-09-12T02:33:22.503230+0000, chain.objs.size()=1 2024-09-12T00:38:37.423 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.423+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:np.89DohvsF8-uesPMQMQmP64WNp4mV_.3s5NYj6clCeE85LMkETANpQSwPNr80I_0 2024-09-12T00:38:37.427 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.428+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/47470 2024-09-12T00:38:37.430 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.430+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:38:37.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.430+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14713778827686113934', time=2024-09-12T02:33:25.173016+0000, chain.objs.size()=1 2024-09-12T00:38:37.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.430+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.574__shadow:nqXKI79lwnBbRNEh3h0-rHFPjgi2rAk_.aiHxcnev8r8D2MvMTH1JeBu5u9CeEGr_0 2024-09-12T00:38:37.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.431+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18198065067437503629', time=2024-09-12T02:33:26.711638+0000, chain.objs.size()=1 2024-09-12T00:38:37.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.574__shadow:vW0kj79fpSl4YwqoxQI0loUD7jH9QGL_.FoQDqgy3ijuOgzrJ3MokF6g3HxJggS3_0 2024-09-12T00:38:37.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.431+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16477820753791301226', time=2024-09-12T02:33:40.274351+0000, chain.objs.size()=1 2024-09-12T00:38:37.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:hBj-KzBUIxKIg82ZRUgLoeN2a.ZaivP_.3tmrouEG_HgITGm3ZFhBxkH_UWUIkIP_0 2024-09-12T00:38:37.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.431+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16607948367653765124', time=2024-09-12T02:36:02.538590+0000, chain.objs.size()=6 2024-09-12T00:38:37.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.623__multipart_multipart_enc.2~JnIFmfYCt1XgBkPplQMID7B1Nmpn2cT.1 2024-09-12T00:38:37.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.623__multipart_multipart_enc.2~JnIFmfYCt1XgBkPplQMID7B1Nmpn2cT.2 2024-09-12T00:38:37.431 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.623__multipart_multipart_enc.2~JnIFmfYCt1XgBkPplQMID7B1Nmpn2cT.3 2024-09-12T00:38:37.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.623__multipart_multipart_enc.2~JnIFmfYCt1XgBkPplQMID7B1Nmpn2cT.4 2024-09-12T00:38:37.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.623__multipart_multipart_enc.2~JnIFmfYCt1XgBkPplQMID7B1Nmpn2cT.5 2024-09-12T00:38:37.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.623__multipart_multipart_enc.2~JnIFmfYCt1XgBkPplQMID7B1Nmpn2cT.6 2024-09-12T00:38:37.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.431+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14480922849567527442', time=2024-09-12T02:36:04.877916+0000, chain.objs.size()=1 2024-09-12T00:38:37.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.629__shadow_.2Dj5cJn2RgjfSZqk0jDoDI_WUKeCy_j_0 2024-09-12T00:38:37.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.431+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5762793691000978062', time=2024-09-12T02:36:17.696926+0000, chain.objs.size()=1 2024-09-12T00:38:37.432 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.431+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.668__shadow_.ridsnQiMKUeXzro-FZqMW8e8N2jkyWf_0 2024-09-12T00:38:37.435 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.436+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:37.438 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.439+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:38:37.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.440+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:37.439 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.440+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/41863' 2024-09-12T00:38:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_4hHbBpglcY4v2VVWrUNxfHt4G3r1uzh', time=2024-09-12T02:29:27.232050+0000, chain.objs.size()=2 2024-09-12T00:38:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__shadow_.KrnibhgIUFNq2UPGE3geb_XUA2ehpMj_0 2024-09-12T00:38:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__shadow_.KrnibhgIUFNq2UPGE3geb_XUA2ehpMj_1 2024-09-12T00:38:37.441 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14889236233303349114', time=2024-09-12T02:29:29.096385+0000, chain.objs.size()=1 2024-09-12T00:38:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.170__shadow_.ZWxMfZOuU2WkHzdrPNj-TmdC6kBXCMH_0 2024-09-12T00:38:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11612638483992579803', time=2024-09-12T02:30:44.863489+0000, chain.objs.size()=1 2024-09-12T00:38:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.260__shadow_.TBsU1k63LxYVIxXVMyhhRMskqeWJo3Q_0 2024-09-12T00:38:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15530816055509374592', time=2024-09-12T02:30:53.125623+0000, chain.objs.size()=1 2024-09-12T00:38:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.P6a7JrLM_YLmie9Koje2Av9gImyLgH4_0 2024-09-12T00:38:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6800247051740454959', time=2024-09-12T02:30:53.195880+0000, chain.objs.size()=1 2024-09-12T00:38:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.uuAtSVXatPph8kcW00XuCEsOHDAyk_a_0 2024-09-12T00:38:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14169253484558992260', time=2024-09-12T02:30:53.213033+0000, chain.objs.size()=1 2024-09-12T00:38:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.l6hsHFSpOhku36XmH8TwLo1osiu9iIx_0 2024-09-12T00:38:37.442 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17315262227387436557', time=2024-09-12T02:30:53.272269+0000, chain.objs.size()=1 2024-09-12T00:38:37.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Wfp1E-6hyknZYfwCJAqKHKV5mjm2vmR_0 2024-09-12T00:38:37.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3993072682767458913', time=2024-09-12T02:30:53.447705+0000, chain.objs.size()=1 2024-09-12T00:38:37.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.dyGMPbCuHez9WKU19ro33vZcUBEQlJP_0 2024-09-12T00:38:37.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6444325841419584075', time=2024-09-12T02:30:53.449316+0000, chain.objs.size()=1 2024-09-12T00:38:37.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.eFdLXASCiDYvoD8Lz8q1qswsNIKUR20_0 2024-09-12T00:38:37.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4493835570165511761', time=2024-09-12T02:30:53.457869+0000, chain.objs.size()=1 2024-09-12T00:38:37.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.PpsJA0L1aA6mmfT2XvGccLBU8g85ktA_0 2024-09-12T00:38:37.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6334788098974168070', time=2024-09-12T02:30:53.474748+0000, chain.objs.size()=1 2024-09-12T00:38:37.443 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.441+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.w_G4ZizcipiSgeXm9Vo0fEVTWKkNZWn_0 2024-09-12T00:38:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6319135275263857907', time=2024-09-12T02:30:53.485264+0000, chain.objs.size()=1 2024-09-12T00:38:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.c5azcHb-LuspJUF1jJF9pHVbsWtq8fB_0 2024-09-12T00:38:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6454365019487899357', time=2024-09-12T02:30:53.757525+0000, chain.objs.size()=1 2024-09-12T00:38:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6ehKWuCWfEhoqdcrMcLdW_VGPLuBnNZ_0 2024-09-12T00:38:37.446 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5256226902305763639', time=2024-09-12T02:30:53.845246+0000, chain.objs.size()=1 2024-09-12T00:38:37.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.uC_7mU-idRYbBmqd09P79zlm96XiyqF_0 2024-09-12T00:38:37.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10108128825289783339', time=2024-09-12T02:30:53.850339+0000, chain.objs.size()=1 2024-09-12T00:38:37.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AyptVp6T6eQ7mO22cMLVYssV-L3beY8_0 2024-09-12T00:38:37.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.948615280671785216', time=2024-09-12T02:30:54.000362+0000, chain.objs.size()=1 2024-09-12T00:38:37.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.36A4R2MfqP8LGjX0bkSgjIRLA1X6syV_0 2024-09-12T00:38:37.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9291685563879349298', time=2024-09-12T02:30:54.015025+0000, chain.objs.size()=1 2024-09-12T00:38:37.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.vY4mWvVimadzHm46UQTYacu7D1uRQXC_0 2024-09-12T00:38:37.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17783321468192387032', time=2024-09-12T02:30:54.129143+0000, chain.objs.size()=1 2024-09-12T00:38:37.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.r_4zCdgJYLhhDQHUpUl3OahwSi77m2h_0 2024-09-12T00:38:37.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1330289902694218727', time=2024-09-12T02:30:54.130029+0000, chain.objs.size()=1 2024-09-12T00:38:37.447 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.nGJteQjzmdqawtae2N6OheqJpcz-Rj3_0 2024-09-12T00:38:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7094604180783521082', time=2024-09-12T02:30:54.131481+0000, chain.objs.size()=1 2024-09-12T00:38:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.vdnVZCWM5zMy7rOD80DdYVbyx87qjDZ_0 2024-09-12T00:38:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.686740844047679137', time=2024-09-12T02:30:54.162880+0000, chain.objs.size()=1 2024-09-12T00:38:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.kmMCJcjMvWDb-z9KPxJkzydUgLDiG6w_0 2024-09-12T00:38:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6755344438628310790', time=2024-09-12T02:30:54.247659+0000, chain.objs.size()=1 2024-09-12T00:38:37.448 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.447+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.s2xUFdeqVyqa0Mhz9qqMkLOcKIQofH7_0 2024-09-12T00:38:37.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.452+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3689821169492630878', time=2024-09-12T02:30:54.256023+0000, chain.objs.size()=1 2024-09-12T00:38:37.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.452+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lQoR9ZAsJQn-0S3yNJ1xnVQjHymIxMA_0 2024-09-12T00:38:37.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.452+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1559825044094579772', time=2024-09-12T02:30:54.380011+0000, chain.objs.size()=1 2024-09-12T00:38:37.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.452+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.9CQ59itA-ThWhSfXDPsqXJux3pGPaEK_0 2024-09-12T00:38:37.451 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.452+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10541520281227175945', time=2024-09-12T02:30:54.403400+0000, chain.objs.size()=1 2024-09-12T00:38:37.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.452+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.mmraYlUgR5cA6XVXQC_Hw-htsSEM1tQ_0 2024-09-12T00:38:37.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.452+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15699512702347555475', time=2024-09-12T02:30:54.576526+0000, chain.objs.size()=1 2024-09-12T00:38:37.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.452+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Qai1EKpu1MN3eZes0VNiaQOLj3viaWU_0 2024-09-12T00:38:37.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.452+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11445422089889231773', time=2024-09-12T02:30:54.626027+0000, chain.objs.size()=1 2024-09-12T00:38:37.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.452+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6OPVz5zCdcXcoesTWtKVKPgw-tUcCRr_0 2024-09-12T00:38:37.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.452+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2366885579670206089', time=2024-09-12T02:30:54.656791+0000, chain.objs.size()=1 2024-09-12T00:38:37.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.452+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.yxOHX7HEMQQMV7eChYvNrD_5_d41od3_0 2024-09-12T00:38:37.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.452+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4642336345347306627', time=2024-09-12T02:30:54.711559+0000, chain.objs.size()=1 2024-09-12T00:38:37.452 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.452+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.QAR6g7sf_vv42KEXhgnwN6O57de57fd_0 2024-09-12T00:38:37.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.453+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8848526945166021107', time=2024-09-12T02:30:54.854412+0000, chain.objs.size()=1 2024-09-12T00:38:37.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.453+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.PdzHxj3S7KfBqVi7ErrhKm_NtOYY1SW_0 2024-09-12T00:38:37.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.453+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15182189938587805718', time=2024-09-12T02:30:54.860137+0000, chain.objs.size()=1 2024-09-12T00:38:37.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.453+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.bNQeDugzySUG_cGbAbSLTNrtT7ORGgw_0 2024-09-12T00:38:37.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.453+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13257873581099031573', time=2024-09-12T02:30:54.864725+0000, chain.objs.size()=1 2024-09-12T00:38:37.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.453+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.T98JVnqD4Hjb-rBlsxwN-IhbuMuOHOW_0 2024-09-12T00:38:37.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.453+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10197931197485952834', time=2024-09-12T02:30:54.865544+0000, chain.objs.size()=1 2024-09-12T00:38:37.453 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.453+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.CCAsFnNVg5ObN0vvIPoB8oDlZl8nd4S_0 2024-09-12T00:38:37.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15570265359658328960', time=2024-09-12T02:30:54.921976+0000, chain.objs.size()=1 2024-09-12T00:38:37.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.GqjaJ8pxD1VKnSmgAUzfmnSIZfm4iGD_0 2024-09-12T00:38:37.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9004909414233374003', time=2024-09-12T02:30:55.097075+0000, chain.objs.size()=1 2024-09-12T00:38:37.458 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.DfeXQrGGXCZQoPIZbdiz5BYrJVgx8yT_0 2024-09-12T00:38:37.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15915549847762303247', time=2024-09-12T02:30:55.182563+0000, chain.objs.size()=1 2024-09-12T00:38:37.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.8qdh9d_sPx0Lexh3s1fJJ4oAIrmwbtH_0 2024-09-12T00:38:37.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17275771770687284544', time=2024-09-12T02:30:55.215777+0000, chain.objs.size()=1 2024-09-12T00:38:37.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.aquULXolgdXnKt_JYa_VJPbqgDGILtj_0 2024-09-12T00:38:37.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6441856879476122798', time=2024-09-12T02:30:58.585727+0000, chain.objs.size()=1 2024-09-12T00:38:37.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.276__shadow_.E3jflvBgtWpRbXhlWWuA_ceB3oWIA_d_0 2024-09-12T00:38:37.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2572264983133623300', time=2024-09-12T02:31:00.306340+0000, chain.objs.size()=1 2024-09-12T00:38:37.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.283__shadow_.LfoQab1IvevotEQm5yuB0Snt4lP2zWg_0 2024-09-12T00:38:37.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5206799490706376403', time=2024-09-12T02:31:02.115975+0000, chain.objs.size()=1 2024-09-12T00:38:37.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.290__shadow_.XeyyaIz4h2amP3DmVGy6UIWQUJto_Wf_0 2024-09-12T00:38:37.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12924208777709370079', time=2024-09-12T02:31:03.057877+0000, chain.objs.size()=1 2024-09-12T00:38:37.459 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.XZblqUS-ZTglEkWcUE0YhEQf82aCu0f_0 2024-09-12T00:38:37.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17133785547652608432', time=2024-09-12T02:31:03.654975+0000, chain.objs.size()=1 2024-09-12T00:38:37.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.i899KcgUh-YB_U1OGgDj2ypEUnN1VQn_0 2024-09-12T00:38:37.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6059884706233406160', time=2024-09-12T02:31:03.661841+0000, chain.objs.size()=1 2024-09-12T00:38:37.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.IrgjmWSv1A3AO86JCr3DCdZLUjdVAMX_0 2024-09-12T00:38:37.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3966307877809966017', time=2024-09-12T02:31:19.401060+0000, chain.objs.size()=1 2024-09-12T00:38:37.460 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.459+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.jLK7d6arf6IJCl2PQmiYDXg5FwUD3L9_0 2024-09-12T00:38:37.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.463+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11627872787782089349', time=2024-09-12T02:31:19.427408+0000, chain.objs.size()=1 2024-09-12T00:38:37.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.463+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.nuP4iPOQUOww-9CNtHcngWoY2_U93Ty_0 2024-09-12T00:38:37.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4937065384961358261', time=2024-09-12T02:31:19.451369+0000, chain.objs.size()=1 2024-09-12T00:38:37.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.PPi_67yKJXrs2Fq9Lpc0cVttztuVPqc_0 2024-09-12T00:38:37.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12843882358637657138', time=2024-09-12T02:31:19.476245+0000, chain.objs.size()=1 2024-09-12T00:38:37.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.dgonIe4b4_UT550JH34FV4_qxA5-MXf_0 2024-09-12T00:38:37.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2297649559466123231', time=2024-09-12T02:31:19.539795+0000, chain.objs.size()=1 2024-09-12T00:38:37.463 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.bmM3oPQVIWVqpH-Q9AtX4ckk8n63IzO_0 2024-09-12T00:38:37.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7270621721091463123', time=2024-09-12T02:31:19.541678+0000, chain.objs.size()=1 2024-09-12T00:38:37.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.n3xM4CSqANu6NNqpZJPeTPyk3XiNqNl_0 2024-09-12T00:38:37.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2998471224679908900', time=2024-09-12T02:31:19.553234+0000, chain.objs.size()=1 2024-09-12T00:38:37.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IGvmpRxYZdW4RNtLFV9hWbSQyanJwwE_0 2024-09-12T00:38:37.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9082120437217731354', time=2024-09-12T02:31:19.555838+0000, chain.objs.size()=1 2024-09-12T00:38:37.464 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.hGyYewflvLopGxegtJjThX-WDtYwSrx_0 2024-09-12T00:38:37.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9384012775980783936', time=2024-09-12T02:31:19.658084+0000, chain.objs.size()=1 2024-09-12T00:38:37.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ZpHXu5dhjx2_NEMyUmoETtgvQl2GgeO_0 2024-09-12T00:38:37.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8567567373512381447', time=2024-09-12T02:31:19.692565+0000, chain.objs.size()=1 2024-09-12T00:38:37.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.B3cgIMkyge35CK_doOJL7kN3YKxqEuv_0 2024-09-12T00:38:37.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2318457887514269808', time=2024-09-12T02:31:19.774313+0000, chain.objs.size()=1 2024-09-12T00:38:37.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ZXsARu0Vlba689vt9g_T1fZ59F_6qo2_0 2024-09-12T00:38:37.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13650403394854463083', time=2024-09-12T02:31:20.003736+0000, chain.objs.size()=1 2024-09-12T00:38:37.465 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.464+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.MUfMIRcRzg5_YXg-lF3GaoAIELtdOC__0 2024-09-12T00:38:37.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.467+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14085821073304407416', time=2024-09-12T02:31:20.021019+0000, chain.objs.size()=1 2024-09-12T00:38:37.466 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.467+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.wPuBjEb85LBR14ES1ea_aFlDBkt93oL_0 2024-09-12T00:38:37.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.468+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13654625095127752924', time=2024-09-12T02:31:20.024930+0000, chain.objs.size()=1 2024-09-12T00:38:37.467 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.468+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JYSHfGjsOa_vZ3K2FmVTXxhhZ7k4Oiu_0 2024-09-12T00:38:37.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.468+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17861253198771306154', time=2024-09-12T02:31:20.112645+0000, chain.objs.size()=1 2024-09-12T00:38:37.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.468+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.hZOgupzh3uiCdpOa2ZCK5QDltrN9HoT_0 2024-09-12T00:38:37.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.468+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5468843171841183412', time=2024-09-12T02:31:20.129548+0000, chain.objs.size()=1 2024-09-12T00:38:37.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.468+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JwYhcLsnjXBFF5lgHsCvYi3-9k8DgaV_0 2024-09-12T00:38:37.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.468+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16764250122916592015', time=2024-09-12T02:31:20.263310+0000, chain.objs.size()=1 2024-09-12T00:38:37.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.468+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IHfYJqG7klOtaxwLwiOlz1ngneVtuX8_0 2024-09-12T00:38:37.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.468+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11241008730914662024', time=2024-09-12T02:31:20.288573+0000, chain.objs.size()=1 2024-09-12T00:38:37.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.468+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7jXzzkonsGxNHCk2-82m51p7zwlEARX_0 2024-09-12T00:38:37.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.468+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15926435037929112397', time=2024-09-12T02:31:20.372121+0000, chain.objs.size()=1 2024-09-12T00:38:37.468 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.468+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.n0xE5kBN2E7eI04v-ZGffGsu7GKHxVr_0 2024-09-12T00:38:37.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.469+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11841314629506691336', time=2024-09-12T02:31:20.449748+0000, chain.objs.size()=1 2024-09-12T00:38:37.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.469+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ugFV96dfE0uBzuXe1Ge2P3wCGjew4oF_0 2024-09-12T00:38:37.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.469+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16219568108893921726', time=2024-09-12T02:31:20.477449+0000, chain.objs.size()=1 2024-09-12T00:38:37.469 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.469+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.u3wp4SWzWBD5DQlWTWoP93-8W6lOXQZ_0 2024-09-12T00:38:37.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.471+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15325825667458051037', time=2024-09-12T02:31:20.576438+0000, chain.objs.size()=1 2024-09-12T00:38:37.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.471+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.J1tno7mcIZ3RgbHXq96al46u3f_LsHO_0 2024-09-12T00:38:37.471 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.472+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10116435415025003750', time=2024-09-12T02:31:20.601236+0000, chain.objs.size()=1 2024-09-12T00:38:37.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.472+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.VwbX6rSyU6kpl9mhlFTHHvpu_1FQK2w_0 2024-09-12T00:38:37.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.472+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13796174301820226730', time=2024-09-12T02:31:20.686614+0000, chain.objs.size()=1 2024-09-12T00:38:37.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.472+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.oRRcLpkKOK4rml45s9Wo0t6Xd5DCewM_0 2024-09-12T00:38:37.472 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.473+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4449164075347137164', time=2024-09-12T02:31:20.772422+0000, chain.objs.size()=1 2024-09-12T00:38:37.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.473+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.twEPZKGZhcQsoCgga507CB4cDdtUxp6_0 2024-09-12T00:38:37.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.473+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12543764851689110391', time=2024-09-12T02:31:20.882728+0000, chain.objs.size()=1 2024-09-12T00:38:37.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.473+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.-U0RroX0zlfMziL2VEpVqvzTm17AZzK_0 2024-09-12T00:38:37.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.473+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4455519218535596115', time=2024-09-12T02:31:20.986617+0000, chain.objs.size()=1 2024-09-12T00:38:37.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.473+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.CyyF9MzA3eajG3UPTy5q0kF0gPCMqS9_0 2024-09-12T00:38:37.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.473+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9392124482197395050', time=2024-09-12T02:31:21.037201+0000, chain.objs.size()=1 2024-09-12T00:38:37.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.473+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.FXAX_o1ZIpFG9rteeCrx5gx5r2XmjTe_0 2024-09-12T00:38:37.473 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.474+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5259893046359346027', time=2024-09-12T02:31:21.490366+0000, chain.objs.size()=1 2024-09-12T00:38:37.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.474+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.EchH9ePg52w_2bLfmtz7O1YxpDwlgDG_0 2024-09-12T00:38:37.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.474+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2255569872207140129', time=2024-09-12T02:31:29.708257+0000, chain.objs.size()=1 2024-09-12T00:38:37.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.474+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.vAIIsFHtuxebObp6RLUR8aeAJDzZQ3__0 2024-09-12T00:38:37.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.474+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12595520767964830439', time=2024-09-12T02:31:29.712168+0000, chain.objs.size()=1 2024-09-12T00:38:37.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.474+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.C5P06z67lWX9Ts1W0jQq-kYYW-Zs6_L_0 2024-09-12T00:38:37.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.474+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15262643451031328105', time=2024-09-12T02:31:29.783463+0000, chain.objs.size()=1 2024-09-12T00:38:37.474 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.474+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.a8_U61fP6IXhrvFHLyWbTv3ZUhHOiJR_0 2024-09-12T00:38:37.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.477+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18064165798529200547', time=2024-09-12T02:31:29.824186+0000, chain.objs.size()=1 2024-09-12T00:38:37.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.477+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.x_T-T9iMG_HLEVU1M3LKqEwAM0hjOt0_0 2024-09-12T00:38:37.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.477+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5485853875120512676', time=2024-09-12T02:31:29.848114+0000, chain.objs.size()=1 2024-09-12T00:38:37.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.477+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.GQ2Iw4axvZcdRbcYJiuNoq0vBwJiET2_0 2024-09-12T00:38:37.476 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.477+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11083958253913847171', time=2024-09-12T02:31:29.850900+0000, chain.objs.size()=1 2024-09-12T00:38:37.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.477+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.4ghV-eQDQMfMDjkTICI6-9wsPnmSKXO_0 2024-09-12T00:38:37.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.477+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12856683791376318525', time=2024-09-12T02:31:29.851686+0000, chain.objs.size()=1 2024-09-12T00:38:37.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.477+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.GOJfDvgxsFdXwpymmdLf3PZNhAb5hhE_0 2024-09-12T00:38:37.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.477+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5751919897619056177', time=2024-09-12T02:31:30.032311+0000, chain.objs.size()=1 2024-09-12T00:38:37.477 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.477+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.7b0j29LWlqK6yRdjNQPsfHWDHcxdHSn_0 2024-09-12T00:38:37.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.479+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11369431575164916019', time=2024-09-12T02:31:30.076160+0000, chain.objs.size()=1 2024-09-12T00:38:37.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.479+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.nS5fmZH2gH582Lxr2zrTzFp4N9gLuvy_0 2024-09-12T00:38:37.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.479+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17244227142973736213', time=2024-09-12T02:31:30.080430+0000, chain.objs.size()=1 2024-09-12T00:38:37.478 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.479+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Fb80NdE8uIVovBOcmmu7Lm1WdKypUhb_0 2024-09-12T00:38:37.479 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.480+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11855281510741263047', time=2024-09-12T02:31:30.121897+0000, chain.objs.size()=1 2024-09-12T00:38:37.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.480+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.VCnKtsNtJEwAu3KERqAfoCd36TBHYSD_0 2024-09-12T00:38:37.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.480+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15585578867559546052', time=2024-09-12T02:31:30.174732+0000, chain.objs.size()=1 2024-09-12T00:38:37.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.480+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.uXxRPWcwHnW3CW3DxGycAyf8iG7pe_c_0 2024-09-12T00:38:37.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.480+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18193078668022855506', time=2024-09-12T02:31:30.178553+0000, chain.objs.size()=1 2024-09-12T00:38:37.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.480+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.jvH4IIUtyZEd2MkolNTFDY2OhpoUcjc_0 2024-09-12T00:38:37.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.480+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9748245489517894889', time=2024-09-12T02:31:30.292776+0000, chain.objs.size()=1 2024-09-12T00:38:37.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.480+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.HGYNowU8p8DR0qWrNWfwIJHrfVhIEnf_0 2024-09-12T00:38:37.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.480+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18152578168844574967', time=2024-09-12T02:31:30.309900+0000, chain.objs.size()=1 2024-09-12T00:38:37.480 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.480+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.8dxDCCbJWq3XG79-fkMjquHyMnezvZu_0 2024-09-12T00:38:37.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.481+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2004046295424613199', time=2024-09-12T02:31:30.338267+0000, chain.objs.size()=1 2024-09-12T00:38:37.481 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.481+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.hm7vIOltDg3SVuXJDZKawMB2Hzhx6Z0_0 2024-09-12T00:38:37.482 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.483+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.429686248850586954', time=2024-09-12T02:31:30.394129+0000, chain.objs.size()=1 2024-09-12T00:38:37.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.483+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.qExZjqhbcOyRyWNXX6YQMz4MzNciUNv_0 2024-09-12T00:38:37.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.484+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16759663719083836931', time=2024-09-12T02:31:30.477112+0000, chain.objs.size()=1 2024-09-12T00:38:37.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.484+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-cTuI7m92vyXNUrHdt7yRAGZ-WpSusc_0 2024-09-12T00:38:37.483 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.484+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14846901504595550020', time=2024-09-12T02:31:30.619453+0000, chain.objs.size()=1 2024-09-12T00:38:37.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.484+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.uf98vjtfpSjLGafEhz0-5z-3N5Ogqpc_0 2024-09-12T00:38:37.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.484+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9881277821083273265', time=2024-09-12T02:31:30.717164+0000, chain.objs.size()=1 2024-09-12T00:38:37.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.484+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mIl4yZb-O9kNMI_44QzMfx09bIgqKZZ_0 2024-09-12T00:38:37.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.484+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17538711792741218735', time=2024-09-12T02:31:30.723299+0000, chain.objs.size()=1 2024-09-12T00:38:37.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.484+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.66Jcnm2yRnJTe5KSBCWaaXxedokMe-C_0 2024-09-12T00:38:37.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.484+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4896403264898984942', time=2024-09-12T02:31:30.727513+0000, chain.objs.size()=1 2024-09-12T00:38:37.484 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.484+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.V2kSlxtyu-4VfezNI2pwmFdA82wcRED_0 2024-09-12T00:38:37.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.486+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1963833831892125350', time=2024-09-12T02:31:30.731052+0000, chain.objs.size()=1 2024-09-12T00:38:37.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.486+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.H0jKoTfdOTI8SF_QlqlvZhsWmofRLY8_0 2024-09-12T00:38:37.485 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.486+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5566169492264947027', time=2024-09-12T02:31:30.739087+0000, chain.objs.size()=1 2024-09-12T00:38:37.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.486+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Ak2SEk4og8zg5YtB4zkxWRpTSx-P_tg_0 2024-09-12T00:38:37.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.486+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5701889923162528965', time=2024-09-12T02:31:30.934764+0000, chain.objs.size()=1 2024-09-12T00:38:37.486 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.486+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.WzfwrBw5aX635YAGktbJNlLiVmJJYXP_0 2024-09-12T00:38:37.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.488+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11385420349551109402', time=2024-09-12T02:31:31.022360+0000, chain.objs.size()=1 2024-09-12T00:38:37.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.488+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.1UGrBvioILp5YS_io2xAx3zkfaZKRZu_0 2024-09-12T00:38:37.487 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.488+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6900721403815958405', time=2024-09-12T02:31:31.304566+0000, chain.objs.size()=1 2024-09-12T00:38:37.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.488+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.UJJcDXKIR15Q7oknwBhaiRj0j8IyVm9_0 2024-09-12T00:38:37.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.488+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14558078280207657982', time=2024-09-12T02:31:31.404634+0000, chain.objs.size()=1 2024-09-12T00:38:37.488 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.488+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.g9MaKg1ey0kWSBIR82yZFHEXOtb9wVa_0 2024-09-12T00:38:37.491 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.492+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/41863 2024-09-12T00:38:37.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:38:37.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9783279637962751364', time=2024-09-12T02:31:31.549960+0000, chain.objs.size()=1 2024-09-12T00:38:37.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ph4J6avHa8RKVFr4qlpFz4RUaEYZhbZ_0 2024-09-12T00:38:37.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4806876363323440828', time=2024-09-12T02:31:31.582553+0000, chain.objs.size()=1 2024-09-12T00:38:37.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.n-V2gZ2GKU6cCnmuiiVua9IQa9RlQXo_0 2024-09-12T00:38:37.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17289030865837503379', time=2024-09-12T02:31:31.677185+0000, chain.objs.size()=1 2024-09-12T00:38:37.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.h7XS6e2Cvjf6F_rRJmbSBiAKkev31pD_0 2024-09-12T00:38:37.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17035137833692522186', time=2024-09-12T02:31:31.729972+0000, chain.objs.size()=1 2024-09-12T00:38:37.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.JCBxJAoU4NdujCc5cFLn9CR-tC_sCFk_0 2024-09-12T00:38:37.494 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8658869420437497533', time=2024-09-12T02:31:31.760561+0000, chain.objs.size()=1 2024-09-12T00:38:37.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.J3uBzbaXJATNd5a1Je4wD6zbGqYRq6P_0 2024-09-12T00:38:37.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12870291921922680709', time=2024-09-12T02:31:31.787147+0000, chain.objs.size()=1 2024-09-12T00:38:37.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.j7HSTF_5qlbj7cPmv1r4BuLQjQs3vaL_0 2024-09-12T00:38:37.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12755002627798662716', time=2024-09-12T02:31:31.795221+0000, chain.objs.size()=1 2024-09-12T00:38:37.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.tVHTqyp-5dsMZlaIrcCre-208MAopm-_0 2024-09-12T00:38:37.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11353258124329749642', time=2024-09-12T02:31:59.041963+0000, chain.objs.size()=1 2024-09-12T00:38:37.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.432__shadow_.1zI4P13jfOdZhKwKIHWK_wRRvwWRUyF_0 2024-09-12T00:38:37.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1633031423266433804', time=2024-09-12T02:32:12.850305+0000, chain.objs.size()=1 2024-09-12T00:38:37.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.484__shadow_.ysUXscl4Xc-jzCVvVb3zkiKfjRaeuI1_0 2024-09-12T00:38:37.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8981605574693665710', time=2024-09-12T02:32:32.247264+0000, chain.objs.size()=2 2024-09-12T00:38:37.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.523__multipart_mymultipart.2~feFQj6bu6CwMmynwzDSe2IusE0ST-7U.1 2024-09-12T00:38:37.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.523__multipart_mymultipart.2~feFQj6bu6CwMmynwzDSe2IusE0ST-7U.2 2024-09-12T00:38:37.495 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16961226123029349863', time=2024-09-12T02:33:18.270027+0000, chain.objs.size()=1 2024-09-12T00:38:37.496 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.494+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:x-4pqDpZJV7GDia8DjNbcJZx7wyPZyk_.Yop9Q5PEDAEDtiC_tZywA2DjjLO3vPa_0 2024-09-12T00:38:37.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.498+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8831094453470201760', time=2024-09-12T02:33:21.650782+0000, chain.objs.size()=1 2024-09-12T00:38:37.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.498+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:iDwl843rvA3HYHQhVnts0xmG26P5-5b_.Rc93FNMumuC_Hx9V5Vj0R9HzL9AEq-X_0 2024-09-12T00:38:37.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.498+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9807311454386071639', time=2024-09-12T02:33:23.632784+0000, chain.objs.size()=1 2024-09-12T00:38:37.497 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.498+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.572__shadow_.wrYN5r8SO0l3fMlHmyyDiYz5BYQnFQf_0 2024-09-12T00:38:37.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.500+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10886247269623516008', time=2024-09-12T02:33:24.589648+0000, chain.objs.size()=1 2024-09-12T00:38:37.499 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.500+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.574__shadow_.N7xSkEZjRBWUdtFI_mVyaa0kzCoqJfn_0 2024-09-12T00:38:37.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.500+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9480705841470916493', time=2024-09-12T02:33:32.279456+0000, chain.objs.size()=1 2024-09-12T00:38:37.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.500+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:HpGFwwvv7yJv8fYDij8G1uYNCSKQ50R_.j5P9kj953D8H5YzxjkmCrrzui8V6vM1_0 2024-09-12T00:38:37.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.500+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3413500858100395991', time=2024-09-12T02:33:36.616974+0000, chain.objs.size()=1 2024-09-12T00:38:37.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.500+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:PpUgKd6yQs2goZlaMvGMJyUUtEXWC6b_.xmEj_aYCHwFukMoY0cWcqZhwtJXoIvW_0 2024-09-12T00:38:37.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.500+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11960238351250101360', time=2024-09-12T02:33:45.873564+0000, chain.objs.size()=1 2024-09-12T00:38:37.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.500+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.579__shadow:RQUm-2S3xNRtIv6kQbW6I1dvccS.dvx_.smp09nlHeszhfbh_2f8BV2pQLn3hVqh_0 2024-09-12T00:38:37.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.500+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16160330874422116867', time=2024-09-12T02:36:00.324707+0000, chain.objs.size()=1 2024-09-12T00:38:37.500 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.500+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.618__shadow_.VbHP29C9dvrSVQ_irrfEtS2m92-tckh_0 2024-09-12T00:38:37.503 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.504+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:37.506 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.507+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:38:37.507 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.508+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:37.508 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.509+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:37.509 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47850' 2024-09-12T00:38:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_k__Xs7ZnO2WoiohzmoUHUI6pRtBuqIq', time=2024-09-12T02:29:25.244084+0000, chain.objs.size()=2 2024-09-12T00:38:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.Xa-W2kOw9n5Q7AzqIxC5Tlx9LU72_xM_0 2024-09-12T00:38:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.Xa-W2kOw9n5Q7AzqIxC5Tlx9LU72_xM_1 2024-09-12T00:38:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3966004442438441670', time=2024-09-12T02:29:26.042379+0000, chain.objs.size()=3 2024-09-12T00:38:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__multipart_foo-STANDARD.2~CBseX8KEb63Btzc_kvklmuYqFo6Aja3.1 2024-09-12T00:38:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__multipart_foo-STANDARD.2~CBseX8KEb63Btzc_kvklmuYqFo6Aja3.2 2024-09-12T00:38:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__multipart_foo-STANDARD.2~CBseX8KEb63Btzc_kvklmuYqFo6Aja3.3 2024-09-12T00:38:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5070836862560204672', time=2024-09-12T02:29:29.222881+0000, chain.objs.size()=1 2024-09-12T00:38:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.171__shadow_.bj26o9xI2mqYj4g7XkXzYrmxtFo9jg8_0 2024-09-12T00:38:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17288014121010477846', time=2024-09-12T02:30:41.689006+0000, chain.objs.size()=1 2024-09-12T00:38:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.247__shadow_.9OHWGmjtgXZjNvhQ808S9wAb9BAd_Ki_0 2024-09-12T00:38:37.510 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8158285699002255281', time=2024-09-12T02:30:41.927279+0000, chain.objs.size()=1 2024-09-12T00:38:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.248__shadow_.d-X7tsdpYsY4PSHkgd4KUPRJO1AYxiz_0 2024-09-12T00:38:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16763510390615500311', time=2024-09-12T02:30:53.156279+0000, chain.objs.size()=1 2024-09-12T00:38:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.xavAtBS45AWUGSKwkBjb4yqqPfOhSXs_0 2024-09-12T00:38:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1240608009568463438', time=2024-09-12T02:30:53.203676+0000, chain.objs.size()=1 2024-09-12T00:38:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.bCRoCGeJVoF4wzXqpibQ8f_8REiUTgz_0 2024-09-12T00:38:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7632494509873130227', time=2024-09-12T02:30:53.235981+0000, chain.objs.size()=1 2024-09-12T00:38:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.LXjggvVFDPUFISU17TV1YMBE0p4D3LT_0 2024-09-12T00:38:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2187359242666906582', time=2024-09-12T02:30:53.410038+0000, chain.objs.size()=1 2024-09-12T00:38:37.511 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.510+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.LDPmszjH_UcrQ37RYO0KJttpJBWF34i_0 2024-09-12T00:38:37.514 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9962734368710946039', time=2024-09-12T02:30:53.427723+0000, chain.objs.size()=1 2024-09-12T00:38:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.yS21SleADNe06Lm4Qs2r-6Iw7RSNBlU_0 2024-09-12T00:38:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10686838630389958925', time=2024-09-12T02:30:53.443619+0000, chain.objs.size()=1 2024-09-12T00:38:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.kc7NK5kp_tyM_dsQ8svddoo2jSEbiCN_0 2024-09-12T00:38:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5793050636640314956', time=2024-09-12T02:30:53.456142+0000, chain.objs.size()=1 2024-09-12T00:38:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.FQN4ym8geHp08BgP7RrybmWgp6uhIwR_0 2024-09-12T00:38:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.336993742627096110', time=2024-09-12T02:30:53.775752+0000, chain.objs.size()=1 2024-09-12T00:38:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.vsSa1l3yc-zDFmOJXlQMqJIOZYNkthR_0 2024-09-12T00:38:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12262580219840495878', time=2024-09-12T02:30:53.823928+0000, chain.objs.size()=1 2024-09-12T00:38:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.WDVXeBXCOfevKyQlUuwxfTSBefqgvmH_0 2024-09-12T00:38:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15542966791315725655', time=2024-09-12T02:30:53.977620+0000, chain.objs.size()=1 2024-09-12T00:38:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.hCIbFFseqelFVnIjBi0IPrCB5P_VeoJ_0 2024-09-12T00:38:37.515 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10363368610803936640', time=2024-09-12T02:30:54.014975+0000, chain.objs.size()=1 2024-09-12T00:38:37.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.OZsL9LvDDxJFEffC10ZMyhpk62PAIpY_0 2024-09-12T00:38:37.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10423593931709238553', time=2024-09-12T02:30:54.026047+0000, chain.objs.size()=1 2024-09-12T00:38:37.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.8CJOFwtEnQOXSKS4yKexsBnfZa6G8pC_0 2024-09-12T00:38:37.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10555668965555114536', time=2024-09-12T02:30:54.156431+0000, chain.objs.size()=1 2024-09-12T00:38:37.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Od78L_2U1f3SS6sdu586Ht3uvkK4GBg_0 2024-09-12T00:38:37.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8882058655048864786', time=2024-09-12T02:30:54.254963+0000, chain.objs.size()=1 2024-09-12T00:38:37.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.vDjpEbvjqmiMUObbCt8QvZZv35utJeA_0 2024-09-12T00:38:37.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5142479958039694253', time=2024-09-12T02:30:54.262442+0000, chain.objs.size()=1 2024-09-12T00:38:37.516 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.515+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Cd_87_ooivc8mTMaPZuhaBLLVBHr75c_0 2024-09-12T00:38:37.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.520+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7638625647289319942', time=2024-09-12T02:30:54.601218+0000, chain.objs.size()=1 2024-09-12T00:38:37.519 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.520+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.OSX9HtdOWbK8-t3iUS3m_eevFtcOpBt_0 2024-09-12T00:38:37.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.520+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11513047738158517249', time=2024-09-12T02:30:54.607411+0000, chain.objs.size()=1 2024-09-12T00:38:37.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.520+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.4NOmDeLOjJIn2EZ9GV4q2x0HbekV9Dt_0 2024-09-12T00:38:37.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.520+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7688624839474353852', time=2024-09-12T02:30:54.652098+0000, chain.objs.size()=1 2024-09-12T00:38:37.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.520+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.1kbqDnGBdWonpA7_6sHGg_RnLcs8VgS_0 2024-09-12T00:38:37.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.520+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12797087797626319133', time=2024-09-12T02:30:54.705520+0000, chain.objs.size()=1 2024-09-12T00:38:37.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.520+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.VPGXp204qgyqIs4_Lp09tPzAXrxJRDX_0 2024-09-12T00:38:37.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.520+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14313691388601001164', time=2024-09-12T02:30:54.735406+0000, chain.objs.size()=1 2024-09-12T00:38:37.520 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.520+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.spw6pZStwbWExLjUjny9D_cFaW_qC1q_0 2024-09-12T00:38:37.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.521+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6023714493541354566', time=2024-09-12T02:30:54.834608+0000, chain.objs.size()=1 2024-09-12T00:38:37.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.521+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.RmDzRXlS5suIopMR37qe5vnFhvkl9Wg_0 2024-09-12T00:38:37.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.521+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8213135151958219832', time=2024-09-12T02:30:54.914221+0000, chain.objs.size()=1 2024-09-12T00:38:37.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.521+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.R6HkGPw33xgepbD0NPhuvZLOrD8BlPc_0 2024-09-12T00:38:37.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.521+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1872575832348800747', time=2024-09-12T02:30:54.926288+0000, chain.objs.size()=1 2024-09-12T00:38:37.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.521+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BQDcchvDMH1LmFNFK_Rn4JuxNqrDF2R_0 2024-09-12T00:38:37.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.521+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13103445363214031755', time=2024-09-12T02:30:54.928213+0000, chain.objs.size()=1 2024-09-12T00:38:37.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.521+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AnhY4pbcdtDxXOmzkBUYGNAE19Umw-v_0 2024-09-12T00:38:37.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.521+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5496529346835583205', time=2024-09-12T02:30:54.973086+0000, chain.objs.size()=1 2024-09-12T00:38:37.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.521+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-YdsW-Br2IApp6ikL217H_ZyEF3n7TV_0 2024-09-12T00:38:37.521 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.521+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6549707350143019944', time=2024-09-12T02:30:55.126946+0000, chain.objs.size()=1 2024-09-12T00:38:37.522 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.521+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.F1kU6dOF1FTxKXNn6LdiYsqJZYLbckF_0 2024-09-12T00:38:37.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5898255814101538189', time=2024-09-12T02:30:57.413954+0000, chain.objs.size()=1 2024-09-12T00:38:37.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.271__shadow_.C9ZzbV_QNw5N02mp7CG5uZZRnRkBC3v_0 2024-09-12T00:38:37.524 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5635821588534331794', time=2024-09-12T02:30:59.345413+0000, chain.objs.size()=1 2024-09-12T00:38:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.279__shadow_.K87CX1Z4gfBeGhhtsCe3-tP8r8Lnx5u_0 2024-09-12T00:38:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11911615958113077481', time=2024-09-12T02:30:59.589205+0000, chain.objs.size()=1 2024-09-12T00:38:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.280__shadow_.TCalILQ4GaqaBBsWk9FKr5ffoUoWxrP_0 2024-09-12T00:38:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6214209382384064583', time=2024-09-12T02:31:00.585685+0000, chain.objs.size()=1 2024-09-12T00:38:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.284__shadow_.5xWr66qIogrT3mHRAZpfb2p8T29J_aY_0 2024-09-12T00:38:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6917016611484308523', time=2024-09-12T02:31:01.149100+0000, chain.objs.size()=1 2024-09-12T00:38:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.286__shadow_.GBj8T43inlj6IJ3maN8cCL-ovSlB7gl_0 2024-09-12T00:38:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.342374457484939087', time=2024-09-12T02:31:03.078681+0000, chain.objs.size()=1 2024-09-12T00:38:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.YbExiciib9hMXGo0ckUkql58Hzh6lBc_0 2024-09-12T00:38:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.525+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8143253739147945560', time=2024-09-12T02:31:06.696393+0000, chain.objs.size()=1 2024-09-12T00:38:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.525+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.305__shadow_.UBQcJC3IWu7y-YFftN40k8CBUzHIsfn_0 2024-09-12T00:38:37.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.528+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4559185398387094680', time=2024-09-12T02:31:19.392075+0000, chain.objs.size()=1 2024-09-12T00:38:37.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.528+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Wzfzfcd3WB-npR-8RxLnmjbkgb17aH-_0 2024-09-12T00:38:37.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.528+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10559494509977321302', time=2024-09-12T02:31:19.397498+0000, chain.objs.size()=1 2024-09-12T00:38:37.527 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.528+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.gR-7c6zxliYZC0bER-Ra8y4DRVCpguW_0 2024-09-12T00:38:37.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.528+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3002497012781872457', time=2024-09-12T02:31:19.408732+0000, chain.objs.size()=1 2024-09-12T00:38:37.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.528+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IozYZypuijjsWjgqQ5LtqYJPGhKNhDN_0 2024-09-12T00:38:37.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.528+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7427866078728175722', time=2024-09-12T02:31:19.440709+0000, chain.objs.size()=1 2024-09-12T00:38:37.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.528+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.u1U7ehFLJCVsMS1oCrP7gDw8whV5Ft7_0 2024-09-12T00:38:37.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.529+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.634998583727356522', time=2024-09-12T02:31:19.771151+0000, chain.objs.size()=1 2024-09-12T00:38:37.528 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.529+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.lb7eS6wbzHGPuf3k-w9zr35nyST_rXv_0 2024-09-12T00:38:37.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.530+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13430353674908055869', time=2024-09-12T02:31:20.050144+0000, chain.objs.size()=1 2024-09-12T00:38:37.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.530+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.0tmSebVFMg21s56rc1Wy5CDzw1Ph__S_0 2024-09-12T00:38:37.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.530+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17486360943677468220', time=2024-09-12T02:31:20.090381+0000, chain.objs.size()=1 2024-09-12T00:38:37.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.530+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.lG-3gbZhcysMlZpJiiwFPaZPvxN1cWg_0 2024-09-12T00:38:37.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.530+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17478327318429844539', time=2024-09-12T02:31:20.142390+0000, chain.objs.size()=1 2024-09-12T00:38:37.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.530+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.xmMP56IJuoxZkDs1jSS4HAwo4TVOcEp_0 2024-09-12T00:38:37.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.530+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16986166660711908865', time=2024-09-12T02:31:20.267265+0000, chain.objs.size()=1 2024-09-12T00:38:37.530 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.530+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.KM8DbZtlobi1u2uAk5n-uPmQsmCZvih_0 2024-09-12T00:38:37.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.530+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.508918198611362127', time=2024-09-12T02:31:20.305191+0000, chain.objs.size()=1 2024-09-12T00:38:37.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.530+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.lUOMTTNSGfzBWKP3sztlli7RKpFfkwO_0 2024-09-12T00:38:37.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.530+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13753902445483190117', time=2024-09-12T02:31:20.440331+0000, chain.objs.size()=1 2024-09-12T00:38:37.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.530+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.cIbrZa0Oeg23foYDqEco5wbiFaot3wv_0 2024-09-12T00:38:37.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.532+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3793763773454955956', time=2024-09-12T02:31:20.595457+0000, chain.objs.size()=1 2024-09-12T00:38:37.531 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.532+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.FcFf1JAi1NVaJcTB3Aqsh78gXMPXcyK_0 2024-09-12T00:38:37.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.533+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4571986320020648253', time=2024-09-12T02:31:20.628963+0000, chain.objs.size()=1 2024-09-12T00:38:37.532 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.533+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.auLNFagtd_y2W8wxr6iiXsfbcaWKgO__0 2024-09-12T00:38:37.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.534+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10850338890924196439', time=2024-09-12T02:31:20.650670+0000, chain.objs.size()=1 2024-09-12T00:38:37.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.534+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.j6DsFWMEc6p3UOGpcNdj8xIauHi2PcC_0 2024-09-12T00:38:37.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.534+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5289551094924816216', time=2024-09-12T02:31:20.724603+0000, chain.objs.size()=1 2024-09-12T00:38:37.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.534+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Wc5_gEK7SXPKVZJ98ImQbWQ0rewablC_0 2024-09-12T00:38:37.533 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.534+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15291550145023271760', time=2024-09-12T02:31:20.742450+0000, chain.objs.size()=1 2024-09-12T00:38:37.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.534+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.2UKbwkh_orNDOIykVHkTQy1ZvQrHaEv_0 2024-09-12T00:38:37.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.535+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3022792599326826236', time=2024-09-12T02:31:20.870873+0000, chain.objs.size()=1 2024-09-12T00:38:37.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.535+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.6hWvfkDsRsCmNMMSuWa51DasDqcRlCt_0 2024-09-12T00:38:37.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.535+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9524123065027144233', time=2024-09-12T02:31:21.157885+0000, chain.objs.size()=1 2024-09-12T00:38:37.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.535+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Vo1uSCmN1xSDdMxiimJBckisckFKCFj_0 2024-09-12T00:38:37.534 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.535+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12697290357021138976', time=2024-09-12T02:31:21.250856+0000, chain.objs.size()=1 2024-09-12T00:38:37.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.535+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.APZnEuv9HhkUiBH7kZa2yirwV_8-l8A_0 2024-09-12T00:38:37.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.535+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7022340146285515204', time=2024-09-12T02:31:21.257694+0000, chain.objs.size()=1 2024-09-12T00:38:37.535 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.535+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.c6SrZZOfDHME1vRvVYDnP2Lgo29M5O4_0 2024-09-12T00:38:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.537+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.656788398940091278', time=2024-09-12T02:31:21.280343+0000, chain.objs.size()=1 2024-09-12T00:38:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.537+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.jlhmVDPqprMEjO6pZi_CyB-F6jeiOj6_0 2024-09-12T00:38:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.537+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9380259909416408049', time=2024-09-12T02:31:21.287731+0000, chain.objs.size()=1 2024-09-12T00:38:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.537+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.KxERR642tbI8REQj06ihxztVHMjO-wr_0 2024-09-12T00:38:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.537+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12066683093890386112', time=2024-09-12T02:31:21.363816+0000, chain.objs.size()=1 2024-09-12T00:38:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.537+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.qsJe64n56yjwVWy2zJfH9jppU-ykP6m_0 2024-09-12T00:38:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.537+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6415569972826989581', time=2024-09-12T02:31:21.491613+0000, chain.objs.size()=1 2024-09-12T00:38:37.537 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.537+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.k-91SgGYXU28FtKr0OS_17FffCKT2oW_0 2024-09-12T00:38:37.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.539+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17744119515293109657', time=2024-09-12T02:31:21.505920+0000, chain.objs.size()=1 2024-09-12T00:38:37.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.539+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.QjTV_aPhStWOIDEP4IgSdu4iVhQ9RCf_0 2024-09-12T00:38:37.538 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.539+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10490877210423786792', time=2024-09-12T02:31:21.567091+0000, chain.objs.size()=1 2024-09-12T00:38:37.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.539+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JpOA-LPYdeda8RFYPn-1JRqf908Efd5_0 2024-09-12T00:38:37.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.539+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15014812112580387966', time=2024-09-12T02:31:21.591338+0000, chain.objs.size()=1 2024-09-12T00:38:37.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.539+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Bbxiz0QOu_AEkiORiiiLrPOSZ3e0d2O_0 2024-09-12T00:38:37.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.539+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2704180539300858597', time=2024-09-12T02:31:21.599763+0000, chain.objs.size()=1 2024-09-12T00:38:37.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.539+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.cfFdNFMLfwrCwwoVexNggQCxkp25cHu_0 2024-09-12T00:38:37.539 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.540+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3783001519099062438', time=2024-09-12T02:31:21.605555+0000, chain.objs.size()=1 2024-09-12T00:38:37.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.540+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.mxT7eY_-kcHyzpUNNKeIknUOTAtwFFm_0 2024-09-12T00:38:37.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.541+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1982958382144973293', time=2024-09-12T02:31:29.710458+0000, chain.objs.size()=1 2024-09-12T00:38:37.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.541+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lllm0P2XbCDaKrJu8cjLGsYPkz4y90k_0 2024-09-12T00:38:37.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.541+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.414391769950900701', time=2024-09-12T02:31:29.791623+0000, chain.objs.size()=1 2024-09-12T00:38:37.540 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.541+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.B-xWwF7o7vLsfRQDREMnwCy9-SScNos_0 2024-09-12T00:38:37.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.542+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14527154037457509074', time=2024-09-12T02:31:30.050349+0000, chain.objs.size()=1 2024-09-12T00:38:37.541 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.542+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.75vMLnuL0G54bk0tW_NlqfY8NtceFtl_0 2024-09-12T00:38:37.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.543+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11855131074039529491', time=2024-09-12T02:31:30.150504+0000, chain.objs.size()=1 2024-09-12T00:38:37.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.543+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.rxGYiWepz7SD1TC7MSZNKNIa6XN82Ti_0 2024-09-12T00:38:37.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.543+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18077839305431870216', time=2024-09-12T02:31:30.345493+0000, chain.objs.size()=1 2024-09-12T00:38:37.542 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.543+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.REjBsSdiXxQJhxCdaI0g30DNMU4CcWO_0 2024-09-12T00:38:37.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.543+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1338492826140071469', time=2024-09-12T02:31:30.366929+0000, chain.objs.size()=1 2024-09-12T00:38:37.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.543+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.02y1rviO4LQ6MWY2FrR6j7RxgMg6xEn_0 2024-09-12T00:38:37.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2566413192576376631', time=2024-09-12T02:31:30.372832+0000, chain.objs.size()=1 2024-09-12T00:38:37.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NfRcJphp5trsemS31-598r75rLckmC3_0 2024-09-12T00:38:37.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12853412310661021183', time=2024-09-12T02:31:30.613889+0000, chain.objs.size()=1 2024-09-12T00:38:37.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.vC2HJO0NRWrjAvNdV3ogHU_qmW5pz5T_0 2024-09-12T00:38:37.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3599309834381860263', time=2024-09-12T02:31:30.731034+0000, chain.objs.size()=1 2024-09-12T00:38:37.543 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.uN_3BXPzCuKwrk7iPrc5d3FG3uNWiQj_0 2024-09-12T00:38:37.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11983785390921127803', time=2024-09-12T02:31:30.749179+0000, chain.objs.size()=1 2024-09-12T00:38:37.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.3hk3tD9o0Wd-HKJS5_6KY2BHXjNjt53_0 2024-09-12T00:38:37.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.544+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15881156711022697260', time=2024-09-12T02:31:30.857295+0000, chain.objs.size()=1 2024-09-12T00:38:37.544 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.544+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.YeuYEy-B7WJevPPgMduCBAyrUz7pEW6_0 2024-09-12T00:38:37.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.548+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16770463939100222230', time=2024-09-12T02:31:30.864581+0000, chain.objs.size()=1 2024-09-12T00:38:37.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.548+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.b230arlE8uCTUWTruq66Nfx3qs-v6PT_0 2024-09-12T00:38:37.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.548+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5907953039230204116', time=2024-09-12T02:31:30.883709+0000, chain.objs.size()=1 2024-09-12T00:38:37.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.548+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ktD8T_cDEP_F1dBNuaEnIqpe471IVuN_0 2024-09-12T00:38:37.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.548+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13426466810757897335', time=2024-09-12T02:31:30.896244+0000, chain.objs.size()=1 2024-09-12T00:38:37.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.548+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.RbMNs05P-fSzKhit8A6vDhLw40VFHcu_0 2024-09-12T00:38:37.547 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.548+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.559757413516160100', time=2024-09-12T02:31:30.913462+0000, chain.objs.size()=1 2024-09-12T00:38:37.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.548+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.JhEqtPFP85yVsaT1dRUkKmIRpoo6qFN_0 2024-09-12T00:38:37.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.548+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17610280732882565773', time=2024-09-12T02:31:30.966108+0000, chain.objs.size()=1 2024-09-12T00:38:37.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.548+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.DFxa5cRh9siMT3PDHApcYq-ncq3BN9z_0 2024-09-12T00:38:37.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.548+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14997813059491016227', time=2024-09-12T02:31:31.009444+0000, chain.objs.size()=1 2024-09-12T00:38:37.548 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.548+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Ed2MH0XH2e_tgXK9xI0_IHX-UcuUa35_0 2024-09-12T00:38:37.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.551+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4008073785187759477', time=2024-09-12T02:31:31.206395+0000, chain.objs.size()=1 2024-09-12T00:38:37.552 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.551+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.VgMSnEKZQ4dK4S3ps96R6vfQglR8BwV_0 2024-09-12T00:38:37.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13128604851452793631', time=2024-09-12T02:31:31.210885+0000, chain.objs.size()=1 2024-09-12T00:38:37.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.AGs09XrJoQzXTCWP6vH1y2xFHtAQZKS_0 2024-09-12T00:38:37.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17572440325335580770', time=2024-09-12T02:31:31.244653+0000, chain.objs.size()=1 2024-09-12T00:38:37.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.DE1VDVpap5G518iaQOMJ_a6Axqj3r-V_0 2024-09-12T00:38:37.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9969319614425460293', time=2024-09-12T02:31:31.262128+0000, chain.objs.size()=1 2024-09-12T00:38:37.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.M1f_GecLEyfIbwlrnzJBdBhAA4RFTwY_0 2024-09-12T00:38:37.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15947110689104271728', time=2024-09-12T02:31:31.269489+0000, chain.objs.size()=1 2024-09-12T00:38:37.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.taramR0sk-fzbVyXJ1f-Igki5xB1Q1p_0 2024-09-12T00:38:37.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4102692700250247060', time=2024-09-12T02:31:31.310262+0000, chain.objs.size()=1 2024-09-12T00:38:37.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.dCRS0CGVILz9EbNUt2YhWuWWuSJlT6J_0 2024-09-12T00:38:37.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17632016894943982777', time=2024-09-12T02:31:31.473507+0000, chain.objs.size()=1 2024-09-12T00:38:37.553 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.6hRypSsoFhSblKZUc1IQP4AIH8SWbzW_0 2024-09-12T00:38:37.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12945150918658243539', time=2024-09-12T02:31:31.523266+0000, chain.objs.size()=1 2024-09-12T00:38:37.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.nuu2zKUpOKZMbJsWR5JhtwaHe5pQHlk_0 2024-09-12T00:38:37.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11675997106844014420', time=2024-09-12T02:31:31.770501+0000, chain.objs.size()=1 2024-09-12T00:38:37.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.8QZUp8VNKIMvvhMNk4RGLUSG3NXGkFE_0 2024-09-12T00:38:37.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14224341249935243933', time=2024-09-12T02:31:31.793547+0000, chain.objs.size()=1 2024-09-12T00:38:37.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.PEVhjrx5UwmEiaAGOSehSrhbMVo57l4_0 2024-09-12T00:38:37.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6506320120725636061', time=2024-09-12T02:31:40.915716+0000, chain.objs.size()=1 2024-09-12T00:38:37.554 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.552+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.369__shadow_.4sPAT0yYGAmCYl3sDKiOW8sdJutZtIa_0 2024-09-12T00:38:37.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.556+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16505556817368724662', time=2024-09-12T02:32:07.299891+0000, chain.objs.size()=1 2024-09-12T00:38:37.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.556+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.460__shadow_.k37rf6sjfc-sieYYSBVXO2_AjdXmZVP_0 2024-09-12T00:38:37.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.557+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7081499896793475370', time=2024-09-12T02:32:09.441988+0000, chain.objs.size()=1 2024-09-12T00:38:37.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.557+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.466__shadow_.dBYidOLrrYh7DdkdhtFw0N6xXzXMImS_0 2024-09-12T00:38:37.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.557+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7766201826600925551', time=2024-09-12T02:32:18.156393+0000, chain.objs.size()=1 2024-09-12T00:38:37.556 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.557+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.503__shadow:ig1.iJ1ZviXIpIr.ZLyPeoYT.9MVwfX_.vO-G3V9zJdbWBBC0Ip0K0Zy9ROlszk8_0 2024-09-12T00:38:37.558 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.559+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13926101276862867292', time=2024-09-12T02:32:20.025698+0000, chain.objs.size()=6 2024-09-12T00:38:37.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.559+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.1 2024-09-12T00:38:37.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.559+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.2 2024-09-12T00:38:37.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.559+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.3 2024-09-12T00:38:37.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.559+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.4 2024-09-12T00:38:37.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.559+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.5 2024-09-12T00:38:37.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.559+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.6 2024-09-12T00:38:37.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.559+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5747501376781731627', time=2024-09-12T02:33:08.789694+0000, chain.objs.size()=1 2024-09-12T00:38:37.559 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.559+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.558__shadow_.EsE0qjVriH3xscQGVbf6TY6MShWaz7e_0 2024-09-12T00:38:37.565 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.565+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/47850 2024-09-12T00:38:37.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.568+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:38:37.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.568+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12223344830359165293', time=2024-09-12T02:33:19.431770+0000, chain.objs.size()=1 2024-09-12T00:38:37.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.568+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:2M62SBeXHgSOVNfAY.dp79kukkZ4bGf_._0LktMxhTvdqdWRGNoPrk_Gy76KjOPm_0 2024-09-12T00:38:37.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.568+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5753749263060065493', time=2024-09-12T02:33:19.605219+0000, chain.objs.size()=1 2024-09-12T00:38:37.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.568+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:3DL7A7A4nXeGTYzfmqOXqHiUaGB76ik_.PH4c_X1_DnnRllzYJ69Jsgg4mH4IdYa_0 2024-09-12T00:38:37.567 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.568+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1035755336426189867', time=2024-09-12T02:33:38.878342+0000, chain.objs.size()=1 2024-09-12T00:38:37.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.568+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:xmkbd1M1WOvRj3BZBkeHX2hEBct0LJF_.X97dYzFnUh0fiKcl_vDjcS209tb_YS2_0 2024-09-12T00:38:37.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.568+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1630127845886259869', time=2024-09-12T02:36:04.388157+0000, chain.objs.size()=1 2024-09-12T00:38:37.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.568+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.627__shadow_.4RwQZuwIYSzDbUG6Vlog5aBgxUXzAR9_0 2024-09-12T00:38:37.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.568+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15264790932156958476', time=2024-09-12T02:36:17.150105+0000, chain.objs.size()=1 2024-09-12T00:38:37.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.568+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.666__shadow_.Ph3s5QmfY0bOLQyYYnfS6oxm9OSX2Xr_0 2024-09-12T00:38:37.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.568+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1814448484093685743', time=2024-09-12T02:36:19.951783+0000, chain.objs.size()=1 2024-09-12T00:38:37.568 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.568+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.679__shadow_.ibkrpjVMTC9x9R_BDRxj_fZLRmvCm-t_0 2024-09-12T00:38:37.570 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.570+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:37.572 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.573+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:38:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.574+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:37.574 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.575+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:37.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47479' 2024-09-12T00:38:37.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9547448542781416954', time=2024-09-12T02:29:20.364306+0000, chain.objs.size()=1 2024-09-12T00:38:37.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.151__shadow_.NabmNq7B3gkVMf7_Y3GthHNDOF73aO5_0 2024-09-12T00:38:37.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_WLJnrLDGV5YK2HhgMFBPEOvrlgJEwKV', time=2024-09-12T02:29:25.670637+0000, chain.objs.size()=2 2024-09-12T00:38:37.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.cfzZr7cGRBsNvBuRWXROHJGqvFmy4tR_0 2024-09-12T00:38:37.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.cfzZr7cGRBsNvBuRWXROHJGqvFmy4tR_1 2024-09-12T00:38:37.576 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_jYehdyirie77BSnYOCLWU1VMlsYaR59', time=2024-09-12T02:29:26.596558+0000, chain.objs.size()=2 2024-09-12T00:38:37.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__shadow_.9zOl3maO_VjnALIlhNk1LcVv217UGBi_0 2024-09-12T00:38:37.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__shadow_.9zOl3maO_VjnALIlhNk1LcVv217UGBi_1 2024-09-12T00:38:37.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3972004255906929529', time=2024-09-12T02:29:28.574145+0000, chain.objs.size()=1 2024-09-12T00:38:37.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.166__shadow_.b5uc8_MwYV4zZglvfxmg9WTg6SEmwbv_0 2024-09-12T00:38:37.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13255615750662623797', time=2024-09-12T02:29:37.227297+0000, chain.objs.size()=1 2024-09-12T00:38:37.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.178__shadow_.fJhnwnBplyUpkNupl0SHEIGCeYZLN89_0 2024-09-12T00:38:37.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12001169720624287719', time=2024-09-12T02:30:38.042795+0000, chain.objs.size()=1 2024-09-12T00:38:37.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.233__shadow_.vaxmJ8fopmtHLQErs4ZJWG5g8IqQWt9_0 2024-09-12T00:38:37.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12471636895704826117', time=2024-09-12T02:30:38.044174+0000, chain.objs.size()=1 2024-09-12T00:38:37.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.233__shadow_.eyjK4YW1zgVX-mxzKdxrax2uph7A3lB_0 2024-09-12T00:38:37.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18126188242303693628', time=2024-09-12T02:30:40.931055+0000, chain.objs.size()=1 2024-09-12T00:38:37.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.244__shadow_.ipewjs-DUjtlq_tHc55fSg4lUf9NO7D_0 2024-09-12T00:38:37.577 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5780303368158079135', time=2024-09-12T02:30:41.411287+0000, chain.objs.size()=1 2024-09-12T00:38:37.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.246__shadow_.b0A7IxuaH80IdJmu8XTNEEFhiMSyOaL_0 2024-09-12T00:38:37.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14600125819384859674', time=2024-09-12T02:30:42.405076+0000, chain.objs.size()=1 2024-09-12T00:38:37.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.576+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.250__shadow_.YsPfV4_5SfLlXgJMpp2cyhhULuB85rJ_0 2024-09-12T00:38:37.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.579+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11408652471165689307', time=2024-09-12T02:30:44.120129+0000, chain.objs.size()=1 2024-09-12T00:38:37.578 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.579+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.257__shadow_.tjCSAJFNhK0HVh_JQHA9Nln1_8QNrz3_0 2024-09-12T00:38:37.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8069042179439005400', time=2024-09-12T02:30:53.132003+0000, chain.objs.size()=1 2024-09-12T00:38:37.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.MSK4sHhq1x8fXzyLftiAVWAA8rrTwMa_0 2024-09-12T00:38:37.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8875500719097611333', time=2024-09-12T02:30:53.177418+0000, chain.objs.size()=1 2024-09-12T00:38:37.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.85L8V4uEBFk8Tq-eNqcHFtT6j61yoZk_0 2024-09-12T00:38:37.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3535652489922395634', time=2024-09-12T02:30:53.396781+0000, chain.objs.size()=1 2024-09-12T00:38:37.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.QVQPELg1Fm5mS3vJIVQWsQNKyx8e-8o_0 2024-09-12T00:38:37.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9209441048942909986', time=2024-09-12T02:30:53.411487+0000, chain.objs.size()=1 2024-09-12T00:38:37.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JY0oBZKffSxUZVfnwA1VPRv3T7q6qO6_0 2024-09-12T00:38:37.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8312095728816802289', time=2024-09-12T02:30:53.543335+0000, chain.objs.size()=1 2024-09-12T00:38:37.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.WF_XDEecAPJoCXGLzMStD_9yMAFc-iW_0 2024-09-12T00:38:37.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16166545654833450479', time=2024-09-12T02:30:53.700634+0000, chain.objs.size()=1 2024-09-12T00:38:37.582 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6hXXTEvN6lOP0vbqnPo7bKiqkMH_uSP_0 2024-09-12T00:38:37.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.259550755233790705', time=2024-09-12T02:30:53.843247+0000, chain.objs.size()=1 2024-09-12T00:38:37.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.0181vhC4y3bItQKYKzNZkmqsFPZDV3L_0 2024-09-12T00:38:37.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15357276872459375703', time=2024-09-12T02:30:53.974288+0000, chain.objs.size()=1 2024-09-12T00:38:37.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HD3o4hOfu-0HOxWyxKr-K06epaRkrvR_0 2024-09-12T00:38:37.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9869156357855597045', time=2024-09-12T02:30:54.009382+0000, chain.objs.size()=1 2024-09-12T00:38:37.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.G940DAGOcxgMsy2d7wW_eDT3OZarESl_0 2024-09-12T00:38:37.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.147895734109115321', time=2024-09-12T02:30:54.028362+0000, chain.objs.size()=1 2024-09-12T00:38:37.583 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.582+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.OXaGqL2W4Lgnpfp20HWtaBGofZVLcYQ_0 2024-09-12T00:38:37.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.586+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8714382786043560170', time=2024-09-12T02:30:54.151427+0000, chain.objs.size()=1 2024-09-12T00:38:37.585 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.586+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Lt2abMxf736iBziaqjOcjqGISrQRGId_0 2024-09-12T00:38:37.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.589+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2762308785211162955', time=2024-09-12T02:30:54.280994+0000, chain.objs.size()=1 2024-09-12T00:38:37.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.589+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.nEHq0leu2kitWbGUNKRb4LDHfzUKvgs_0 2024-09-12T00:38:37.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.589+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14911401886865397918', time=2024-09-12T02:30:54.438612+0000, chain.objs.size()=1 2024-09-12T00:38:37.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.589+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.opSmeYO5rWggFYVPlU7HLhTHgawB0oQ_0 2024-09-12T00:38:37.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.589+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.801979521586019920', time=2024-09-12T02:30:54.449263+0000, chain.objs.size()=1 2024-09-12T00:38:37.589 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.589+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.sgpVK6-YSqn40JTRdQQ5v2LQWUBiwgQ_0 2024-09-12T00:38:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.589+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13948220694740163006', time=2024-09-12T02:30:54.552054+0000, chain.objs.size()=1 2024-09-12T00:38:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.590+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.goVKHmuaw5-KOHPfecKjLWhwvBq3ay9_0 2024-09-12T00:38:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.590+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13664717490404793999', time=2024-09-12T02:30:54.567015+0000, chain.objs.size()=1 2024-09-12T00:38:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.590+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.vAoZtEkEnM4TrEYxoFc-epSiG22YmJb_0 2024-09-12T00:38:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.590+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8875288352777797357', time=2024-09-12T02:30:54.612304+0000, chain.objs.size()=1 2024-09-12T00:38:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.590+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.zbV9JkwC9NltprDL5vAPPJT5QvSgLa-_0 2024-09-12T00:38:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.590+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3850732364825555378', time=2024-09-12T02:30:54.700473+0000, chain.objs.size()=1 2024-09-12T00:38:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.590+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.sC6IaKhkXfVr2vJyKHqx3FMjUFYT5QQ_0 2024-09-12T00:38:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.590+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5763406937672871713', time=2024-09-12T02:30:54.729226+0000, chain.objs.size()=1 2024-09-12T00:38:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.590+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.7cEgJ652zpYlpbNK2eRY2UwA-bHq32M_0 2024-09-12T00:38:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.590+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16826684111530414369', time=2024-09-12T02:30:54.735551+0000, chain.objs.size()=1 2024-09-12T00:38:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.590+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.f8UmcpoMoGCxFs-4YPrUhLwHjo3hvUP_0 2024-09-12T00:38:37.590 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.590+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17112901294725929234', time=2024-09-12T02:30:54.830189+0000, chain.objs.size()=1 2024-09-12T00:38:37.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.590+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Et-n1rzD7aqoPKPaMICR0jZPCj20Oc9_0 2024-09-12T00:38:37.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.590+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5411333706711456892', time=2024-09-12T02:30:54.856456+0000, chain.objs.size()=1 2024-09-12T00:38:37.591 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.590+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.upbIUG0ZER4YRA3abaGqF8jRQsXN332_0 2024-09-12T00:38:37.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16338646781385017512', time=2024-09-12T02:30:54.889551+0000, chain.objs.size()=1 2024-09-12T00:38:37.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.cOtBobYnMGUVP3bFK2nXC-Dei-JQCVK_0 2024-09-12T00:38:37.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.971785921495879378', time=2024-09-12T02:30:54.901847+0000, chain.objs.size()=1 2024-09-12T00:38:37.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.jwpV3ovFvYn89Ozx-ql7Ds2ey-fcrME_0 2024-09-12T00:38:37.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18207543335567465323', time=2024-09-12T02:30:54.937028+0000, chain.objs.size()=1 2024-09-12T00:38:37.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.in5GXObl4kVjJxBgiDKAbApHgMmcTCh_0 2024-09-12T00:38:37.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13165793264977194698', time=2024-09-12T02:30:54.945770+0000, chain.objs.size()=1 2024-09-12T00:38:37.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.LQALUfQgZKpGUhHmrsu-GRyC3BP0FxX_0 2024-09-12T00:38:37.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14938412726654806924', time=2024-09-12T02:30:54.962170+0000, chain.objs.size()=1 2024-09-12T00:38:37.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.qW8P7RHZoYn76y7pJFUT14kDO7SMGpu_0 2024-09-12T00:38:37.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6638336358156609357', time=2024-09-12T02:30:55.100049+0000, chain.objs.size()=1 2024-09-12T00:38:37.595 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.5TFgvv5JSBx7aPTOx7Vyfl-RGbA3N72_0 2024-09-12T00:38:37.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1334411091356306356', time=2024-09-12T02:30:55.158684+0000, chain.objs.size()=1 2024-09-12T00:38:37.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.yfagzOmtJAsdafBIoVM4ieqB0AJ1gFj_0 2024-09-12T00:38:37.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5135213527328938434', time=2024-09-12T02:30:55.954094+0000, chain.objs.size()=1 2024-09-12T00:38:37.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.265__shadow_.JrcCvt34qF7_6aI1c-HE0Zyo3N3sw03_0 2024-09-12T00:38:37.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12046910002795682657', time=2024-09-12T02:30:59.825103+0000, chain.objs.size()=1 2024-09-12T00:38:37.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.281__shadow_.lgb4x2dxTDeTgHTNTGgApi6K9MyIBm5_0 2024-09-12T00:38:37.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10378701231459185432', time=2024-09-12T02:31:03.066624+0000, chain.objs.size()=1 2024-09-12T00:38:37.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.595+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.f2LRwIfaV2K3r2LaFoDX6HH-fXxfsr4_0 2024-09-12T00:38:37.596 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.597+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10178485991055431131', time=2024-09-12T02:31:05.702315+0000, chain.objs.size()=1 2024-09-12T00:38:37.597 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.597+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.301__shadow_.aIMINWvR5EWMbplqII7IjxoI-_8AWVh_0 2024-09-12T00:38:37.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.599+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6569774154874713821', time=2024-09-12T02:31:10.516819+0000, chain.objs.size()=1 2024-09-12T00:38:37.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.599+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.321__shadow_.vcjvNQyRaeB_hXljQ7pFx6qjX5Puuzu_0 2024-09-12T00:38:37.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.599+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9255667323351855155', time=2024-09-12T02:31:19.363832+0000, chain.objs.size()=1 2024-09-12T00:38:37.598 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.599+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.pWaIZ_EaaiRtZarIsSg7pIN1B-FrBwh_0 2024-09-12T00:38:37.600 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.601+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11554566902029228303', time=2024-09-12T02:31:19.374381+0000, chain.objs.size()=1 2024-09-12T00:38:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.601+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.OLnPUQ6H5cqRyT7EcsIC0Coo-ZRLtJN_0 2024-09-12T00:38:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.601+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15120696364044907465', time=2024-09-12T02:31:19.699066+0000, chain.objs.size()=1 2024-09-12T00:38:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.601+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.lcJlpzgH7sqkO4RxCOpRW2cGplGqB0W_0 2024-09-12T00:38:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.601+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13634412784355365579', time=2024-09-12T02:31:19.708590+0000, chain.objs.size()=1 2024-09-12T00:38:37.601 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.601+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Foh0IXhR1i5_-nWc_EXwlJ218HRMUBr_0 2024-09-12T00:38:37.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.603+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14000276810104224730', time=2024-09-12T02:31:19.718131+0000, chain.objs.size()=1 2024-09-12T00:38:37.602 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.603+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.XWZ4Qbku0Sh43SYZTA10SlcClrkyz1f_0 2024-09-12T00:38:37.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.604+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14439790813455995051', time=2024-09-12T02:31:19.754505+0000, chain.objs.size()=1 2024-09-12T00:38:37.603 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.604+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.mTFNyCz7bRhz8ravMmcHOgordCCHrMB_0 2024-09-12T00:38:37.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.604+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18435459240151159002', time=2024-09-12T02:31:19.803675+0000, chain.objs.size()=1 2024-09-12T00:38:37.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.604+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.B_mKqGIwBqEOt_KtKkCXkFbpmqz9vsA_0 2024-09-12T00:38:37.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.604+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6819240986720750536', time=2024-09-12T02:31:19.959082+0000, chain.objs.size()=1 2024-09-12T00:38:37.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.604+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.49mObpCpJrfsXbyeMgMa9VK0EtUIqJN_0 2024-09-12T00:38:37.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.604+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11506572281257162167', time=2024-09-12T02:31:19.960712+0000, chain.objs.size()=1 2024-09-12T00:38:37.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.604+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.XoLUPN9xKLQty_vnJra8N8idz2RhULR_0 2024-09-12T00:38:37.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.604+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11207763400954744966', time=2024-09-12T02:31:20.003866+0000, chain.objs.size()=1 2024-09-12T00:38:37.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.604+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.d9QF_10rYJULrbKuool74oEocITdwOo_0 2024-09-12T00:38:37.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.604+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7041270504514899716', time=2024-09-12T02:31:20.013360+0000, chain.objs.size()=1 2024-09-12T00:38:37.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.604+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.9UTUGUj-ci_kdtUyVM2_H3Sy4Oay2gC_0 2024-09-12T00:38:37.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.604+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8257156742271951262', time=2024-09-12T02:31:20.106771+0000, chain.objs.size()=1 2024-09-12T00:38:37.604 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.604+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.W3ODtOq0kpZgTACjbVjH5q9w1GP5poM_0 2024-09-12T00:38:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.607+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16207999083715312009', time=2024-09-12T02:31:20.313584+0000, chain.objs.size()=1 2024-09-12T00:38:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.607+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.bwO7JPHnUembhjPzuuqnX5mnsYiV2bh_0 2024-09-12T00:38:37.606 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.607+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16783125288236833974', time=2024-09-12T02:31:20.320349+0000, chain.objs.size()=1 2024-09-12T00:38:37.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.607+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.uLhSjdAaatT_4UXlZqHJjSPu3ZMHYsS_0 2024-09-12T00:38:37.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.607+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9807837841107142799', time=2024-09-12T02:31:20.566574+0000, chain.objs.size()=1 2024-09-12T00:38:37.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.607+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.9Vi_qU7k-2Rads9eU7dfQUM4M8NUYZR_0 2024-09-12T00:38:37.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.607+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10420432911974742172', time=2024-09-12T02:31:20.691696+0000, chain.objs.size()=1 2024-09-12T00:38:37.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.607+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.zTE9ZZIIxHIoOYPqFammkfxCv3fXotl_0 2024-09-12T00:38:37.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.607+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8770957212295996448', time=2024-09-12T02:31:20.869689+0000, chain.objs.size()=1 2024-09-12T00:38:37.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.607+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.AfCEvukAUDbu9FTwKAcYr_loEKkKt6I_0 2024-09-12T00:38:37.607 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.608+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9296015242622933238', time=2024-09-12T02:31:20.927164+0000, chain.objs.size()=1 2024-09-12T00:38:37.608 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.608+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.PGWkNDEkUt_O6bTOxdz15btlrn_CETq_0 2024-09-12T00:38:37.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.609+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.84597438840423186', time=2024-09-12T02:31:20.946219+0000, chain.objs.size()=1 2024-09-12T00:38:37.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.609+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ZNVorywKF8g13VVMou3J30hkkrQbAUV_0 2024-09-12T00:38:37.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.610+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13973007099872692033', time=2024-09-12T02:31:20.975700+0000, chain.objs.size()=1 2024-09-12T00:38:37.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.610+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.p_U6-ivEgZ5RaILkSNWlAbL03c5ZK72_0 2024-09-12T00:38:37.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.610+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1979990523633739709', time=2024-09-12T02:31:20.976862+0000, chain.objs.size()=1 2024-09-12T00:38:37.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.610+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.4uUT31uW84ckY4CC9e7B1nuF-rB_v5__0 2024-09-12T00:38:37.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.610+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10384569720979954629', time=2024-09-12T02:31:21.014175+0000, chain.objs.size()=1 2024-09-12T00:38:37.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.610+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.eO4sMrGDEJxx2lztSC58GcJzhal9KhT_0 2024-09-12T00:38:37.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.610+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5691266105275854445', time=2024-09-12T02:31:21.071143+0000, chain.objs.size()=1 2024-09-12T00:38:37.609 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.610+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.fuLIVcOpwcjAbIp7CodQi0m6gJtOCsi_0 2024-09-12T00:38:37.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.612+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1990375232377459044', time=2024-09-12T02:31:21.177785+0000, chain.objs.size()=1 2024-09-12T00:38:37.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.612+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IWo2ubgRBi2RacXsPyDqfPsATXgVcYD_0 2024-09-12T00:38:37.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.613+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1873276460814143774', time=2024-09-12T02:31:21.213776+0000, chain.objs.size()=1 2024-09-12T00:38:37.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.613+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.s66U-KLIkxrCUa-wBUAsJVijemwuwmg_0 2024-09-12T00:38:37.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.613+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8220364551171147313', time=2024-09-12T02:31:21.262635+0000, chain.objs.size()=1 2024-09-12T00:38:37.612 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.613+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Df4uR0ujEjTNl5IV1p5mxvNB-X1MEio_0 2024-09-12T00:38:37.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.613+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.37750485260516534', time=2024-09-12T02:31:21.308300+0000, chain.objs.size()=1 2024-09-12T00:38:37.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.613+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.P2J4yMbVJkqiHrfysge7meZviR4Kvc__0 2024-09-12T00:38:37.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.613+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16300573067241301330', time=2024-09-12T02:31:21.483639+0000, chain.objs.size()=1 2024-09-12T00:38:37.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.613+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.tAjoeu2OVF7uUX6yCeEyL6WEbHtX4ps_0 2024-09-12T00:38:37.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.613+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1685502001922940428', time=2024-09-12T02:31:21.610490+0000, chain.objs.size()=1 2024-09-12T00:38:37.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.613+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.VRdI9vay53NofH3kWp4QbnMgcRpFPEo_0 2024-09-12T00:38:37.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.613+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14360339245266392927', time=2024-09-12T02:31:29.674716+0000, chain.objs.size()=1 2024-09-12T00:38:37.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.613+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.jH8GfnxlgMpCzFpUmx2cJuoF5SGjOlg_0 2024-09-12T00:38:37.613 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.614+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10435202430093674863', time=2024-09-12T02:31:29.732113+0000, chain.objs.size()=1 2024-09-12T00:38:37.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.614+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.jGv7j4DCarWGSJigT2VTs-K0k6PAaUn_0 2024-09-12T00:38:37.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.614+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3119506834876424467', time=2024-09-12T02:31:29.803282+0000, chain.objs.size()=1 2024-09-12T00:38:37.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.614+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.HfZzj1ZqsYfY02n-aKxYobTtwuo8E-Z_0 2024-09-12T00:38:37.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.615+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.545139399406686106', time=2024-09-12T02:31:30.012766+0000, chain.objs.size()=1 2024-09-12T00:38:37.614 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.615+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.8HF4a6XWTjJoqIrCdvNlJC4f1swmXwI_0 2024-09-12T00:38:37.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.616+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.291826898911697562', time=2024-09-12T02:31:30.065610+0000, chain.objs.size()=1 2024-09-12T00:38:37.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.616+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.KGWxaHzlJKlieIUwzDowr8Q84bTFfeS_0 2024-09-12T00:38:37.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.616+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7732669584137986334', time=2024-09-12T02:31:30.068483+0000, chain.objs.size()=1 2024-09-12T00:38:37.615 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.616+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Kst0HSN29uI6dX4NlmVkCkkUIztV08r_0 2024-09-12T00:38:37.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.618+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8264009603050433823', time=2024-09-12T02:31:30.119688+0000, chain.objs.size()=1 2024-09-12T00:38:37.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.618+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.1t68tK5DM2PkvPRW5hNmUrJkH1ruWfn_0 2024-09-12T00:38:37.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.618+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9453000779210032565', time=2024-09-12T02:31:30.314528+0000, chain.objs.size()=1 2024-09-12T00:38:37.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.618+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.oSm4dw2DQZxWNq_XZTGbfzmWsQ5P0pi_0 2024-09-12T00:38:37.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.618+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8408590064615014226', time=2024-09-12T02:31:30.378346+0000, chain.objs.size()=1 2024-09-12T00:38:37.617 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.618+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lfbS-jQjGQ1zf0JEEb5q3NPLKgfvGoP_0 2024-09-12T00:38:37.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.619+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.652991884429008166', time=2024-09-12T02:31:30.399664+0000, chain.objs.size()=1 2024-09-12T00:38:37.618 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.619+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Us8FpNLTYExZvYj7syxisopngyhJm_c_0 2024-09-12T00:38:37.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.620+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3868963694477451154', time=2024-09-12T02:31:30.569906+0000, chain.objs.size()=1 2024-09-12T00:38:37.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.620+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.jwq1IomhbZP1YaEob7hrrrHLj09cFOa_0 2024-09-12T00:38:37.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.620+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3885138586285421494', time=2024-09-12T02:31:30.603548+0000, chain.objs.size()=1 2024-09-12T00:38:37.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.620+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.wEpTmlaKNzL7KY0XcmsP4m4Uq_1Zk1G_0 2024-09-12T00:38:37.619 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.620+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6804024176469931128', time=2024-09-12T02:31:30.613049+0000, chain.objs.size()=1 2024-09-12T00:38:37.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.620+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mUyhlzFvsZR8Ue1dxHJxzpLYwPHBAZu_0 2024-09-12T00:38:37.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.620+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.661108465471647590', time=2024-09-12T02:31:30.688883+0000, chain.objs.size()=1 2024-09-12T00:38:37.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.620+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.3lHb3ymEGclm7mSsEHufkASJpgZ9IRD_0 2024-09-12T00:38:37.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.620+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15923601973726329523', time=2024-09-12T02:31:30.894762+0000, chain.objs.size()=1 2024-09-12T00:38:37.620 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.620+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.uftHesLrUhWXcIurIznPCwEyzuL2ps0_0 2024-09-12T00:38:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.621+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14623735862424176231', time=2024-09-12T02:31:30.974948+0000, chain.objs.size()=1 2024-09-12T00:38:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.621+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._fHgoYb20l0tF-q1tpW-JEoBQaG7yPa_0 2024-09-12T00:38:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.621+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17503225318423430517', time=2024-09-12T02:31:31.174437+0000, chain.objs.size()=1 2024-09-12T00:38:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.621+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.rw3La7DjjePGi1YlA20Y7CVegcGUuC0_0 2024-09-12T00:38:37.621 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.622+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2342875229661430808', time=2024-09-12T02:31:31.227949+0000, chain.objs.size()=1 2024-09-12T00:38:37.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.622+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mYofxLZvNH33Beqe5WJv48CPLcCZzK__0 2024-09-12T00:38:37.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.623+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11530674619447858509', time=2024-09-12T02:31:31.301713+0000, chain.objs.size()=1 2024-09-12T00:38:37.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.623+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.iAisaip4vL0t29r7JSrkYcfdsXfD00t_0 2024-09-12T00:38:37.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.623+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16317293589521902163', time=2024-09-12T02:31:31.314564+0000, chain.objs.size()=1 2024-09-12T00:38:37.622 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.623+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.YvZvPDe6KnyDiRgPALIycjicEZt36s3_0 2024-09-12T00:38:37.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.624+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12019995927229202184', time=2024-09-12T02:31:31.429370+0000, chain.objs.size()=1 2024-09-12T00:38:37.623 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.624+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.rFo-QfhTTNpHY_kdGfAhGyrfa6OsWM5_0 2024-09-12T00:38:37.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.625+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1434324041715852477', time=2024-09-12T02:31:31.460959+0000, chain.objs.size()=1 2024-09-12T00:38:37.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.625+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.sHApSrH0yTZN6WebqBRbYdgMv50GEaC_0 2024-09-12T00:38:37.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.625+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1351500837684809191', time=2024-09-12T02:31:31.471257+0000, chain.objs.size()=1 2024-09-12T00:38:37.624 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.625+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lxfgHXhDklRTvfixW-AULzZcucvIwmb_0 2024-09-12T00:38:37.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.626+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18415887021953845067', time=2024-09-12T02:31:31.490669+0000, chain.objs.size()=1 2024-09-12T00:38:37.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.626+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.JoSXk9IC0TH0QL5katwSs5ewiMst6-v_0 2024-09-12T00:38:37.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.626+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16108298770260620136', time=2024-09-12T02:31:31.560482+0000, chain.objs.size()=1 2024-09-12T00:38:37.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.626+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.yvdLefx6b9ZEV-M-Mynk_8H7wuO8The_0 2024-09-12T00:38:37.625 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.626+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3507329804383694841', time=2024-09-12T02:31:31.688411+0000, chain.objs.size()=1 2024-09-12T00:38:37.626 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.626+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ts2LkBpRr78b2rMQswZWmPeThmAV8uH_0 2024-09-12T00:38:37.629 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.630+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/47479 2024-09-12T00:38:37.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:38:37.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11121998368265475715', time=2024-09-12T02:31:31.710079+0000, chain.objs.size()=1 2024-09-12T00:38:37.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.O1m7klZuhEX6XeLV5SvlcruvwYpWrDy_0 2024-09-12T00:38:37.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.756448221273725030', time=2024-09-12T02:31:31.791979+0000, chain.objs.size()=1 2024-09-12T00:38:37.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.yRe9yfLntpOA3D5ZPPBD40JY_JUIFJx_0 2024-09-12T00:38:37.633 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5309064372824697113', time=2024-09-12T02:31:31.805532+0000, chain.objs.size()=1 2024-09-12T00:38:37.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.3tf_afkz0hznf5c0ZQBJnTjonuFyIcu_0 2024-09-12T00:38:37.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13278245094670001620', time=2024-09-12T02:31:35.401378+0000, chain.objs.size()=1 2024-09-12T00:38:37.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.340__shadow_.XIyGqzYoMFIs4fMtZAn-Nr_V6J9HMAp_0 2024-09-12T00:38:37.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14860397372408231176', time=2024-09-12T02:31:43.709076+0000, chain.objs.size()=1 2024-09-12T00:38:37.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.376__shadow_.8jEQ9iWOha5y5u33TGtygcvc2iATcmc_0 2024-09-12T00:38:37.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7896447123488230655', time=2024-09-12T02:31:43.911926+0000, chain.objs.size()=1 2024-09-12T00:38:37.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.377__shadow_.wE9R4hdaaEU0CsBRyE5jcqRE4A_jCRU_0 2024-09-12T00:38:37.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8468974594761400200', time=2024-09-12T02:31:44.370156+0000, chain.objs.size()=1 2024-09-12T00:38:37.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.378__shadow_.AOG84WUcqc-iA9_Ry97D3KQqmulhq8J_0 2024-09-12T00:38:37.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12064373326155505725', time=2024-09-12T02:31:50.377334+0000, chain.objs.size()=1 2024-09-12T00:38:37.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.633+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.394__shadow:VVPav-Y7wR.pAFq85RTM7ieE-Y9v8ZE_.7pKjkM54BQl6VVL2DxknQ-Vv3-VX-7t_0 2024-09-12T00:38:37.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.634+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16089145559466709649', time=2024-09-12T02:31:53.871540+0000, chain.objs.size()=1 2024-09-12T00:38:37.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.634+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.410__shadow_.0nzan8QTznUU5zI-bNHgxF1H6zsvFno_0 2024-09-12T00:38:37.634 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.634+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13540488089616869271', time=2024-09-12T02:32:01.552906+0000, chain.objs.size()=1 2024-09-12T00:38:37.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.634+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.441__shadow_.kGSkgIAD2hA1ZwZDfKzjm9MbBZhIYm1_0 2024-09-12T00:38:37.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.634+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2865924361361970222', time=2024-09-12T02:32:12.849419+0000, chain.objs.size()=1 2024-09-12T00:38:37.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.634+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.484__shadow_.nS-9DPTmOQ11TZ9XLDzMqpB-FDq34NN_0 2024-09-12T00:38:37.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.634+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17106917033455738807', time=2024-09-12T02:32:20.930757+0000, chain.objs.size()=1 2024-09-12T00:38:37.635 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.634+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.512__shadow_.r7Qu8cjdNexbklAg-Ipc6j6-9NreMSz_0 2024-09-12T00:38:37.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.637+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1269312761207775173', time=2024-09-12T02:33:08.168634+0000, chain.objs.size()=1 2024-09-12T00:38:37.636 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.637+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.557__shadow_._LYknIfvNOxtKs_of9chU2ux0mek3VB_0 2024-09-12T00:38:37.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.638+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9875559089654094476', time=2024-09-12T02:33:45.827432+0000, chain.objs.size()=1 2024-09-12T00:38:37.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.638+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.579__shadow:nL72MgP2Xbs7UkBH8pc78wqn1IFKBBG_.pY-rTXiEWKIlpKlShbqs4miulPPYp33_0 2024-09-12T00:38:37.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.638+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8592513247733566154', time=2024-09-12T02:33:49.165996+0000, chain.objs.size()=1 2024-09-12T00:38:37.637 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.638+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.587__shadow:y8ylw2D9r6ISs0SJrNylhvUG9lvyPp4_.rZpTM8TncIJQRCcu6BDYGuHuuixpA_J_0 2024-09-12T00:38:37.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.638+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3448093317242047626', time=2024-09-12T02:33:49.245639+0000, chain.objs.size()=1 2024-09-12T00:38:37.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.638+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.587__shadow:GeBkF.VnMXEETzidZ5Y0IlFEAFx-TRN_.dBagaN76ELgTiILAprjiCF6-V2qnKcx_0 2024-09-12T00:38:37.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.638+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15254446244231681249', time=2024-09-12T02:33:52.263202+0000, chain.objs.size()=1 2024-09-12T00:38:37.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.638+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.602__shadow_.vr8Guj6E0JJBzZcnn-sARphtGpRmqrA_0 2024-09-12T00:38:37.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.638+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7320397854551927570', time=2024-09-12T02:36:19.950890+0000, chain.objs.size()=1 2024-09-12T00:38:37.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.638+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.679__shadow_.W7DsB2Mlx1gdJ1-q_X0vVG3iB4tkcuJ_0 2024-09-12T00:38:37.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.638+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4647717867665336738', time=2024-09-12T02:36:25.913317+0000, chain.objs.size()=1 2024-09-12T00:38:37.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.638+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.704__shadow:t1SdotFfvW67DNmXgBzn2ndzfvLLfil_.kzRuiwxSUjeRX-w9evWoXjeY0tAkgjr_0 2024-09-12T00:38:37.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.638+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3982783720331453389', time=2024-09-12T02:36:56.044028+0000, chain.objs.size()=1 2024-09-12T00:38:37.638 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.638+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.742__multipart_mymultipart3.2~wcFKYxuGkILtv2V0-HT4dqxmHIYsBbd.1 2024-09-12T00:38:37.642 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.643+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:37.643 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.644+0000 7f10d1d48640 0 -- 172.21.15.67:0/1227616915 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f0f9c08cbe0 msgr2=0x7f0f9c08efd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:37.645 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.646+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:38:37.646 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.647+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:37.647 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:37.648 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42507' 2024-09-12T00:38:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_5XQMBMBhGj6BjUnxArsrohVV9hbDk3p', time=2024-09-12T02:29:27.099172+0000, chain.objs.size()=2 2024-09-12T00:38:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__shadow_.ki5e3BAunEmDZFlzFHsUEQ7h2w-M_iu_0 2024-09-12T00:38:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__shadow_.ki5e3BAunEmDZFlzFHsUEQ7h2w-M_iu_1 2024-09-12T00:38:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6173395275124613836', time=2024-09-12T02:30:38.525330+0000, chain.objs.size()=1 2024-09-12T00:38:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.235__shadow_.VaoujETC7RBtB-A1f8Elzc1wCFl_T0X_0 2024-09-12T00:38:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13006958537224920765', time=2024-09-12T02:30:39.393857+0000, chain.objs.size()=1 2024-09-12T00:38:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.238__shadow_.uCoRL3Di_hEFfTZrE4kxZbDq8eODDES_0 2024-09-12T00:38:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9775124008919375041', time=2024-09-12T02:30:41.690279+0000, chain.objs.size()=1 2024-09-12T00:38:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.247__shadow_.9NA7SuLxoIgLfe1DSf6knOZZpo8d9AT_0 2024-09-12T00:38:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12873040924367731351', time=2024-09-12T02:30:42.404663+0000, chain.objs.size()=1 2024-09-12T00:38:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.250__shadow_.h5sStuBLQKhQpK79sxoy6tMVbCgmimA_0 2024-09-12T00:38:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7594740058179277002', time=2024-09-12T02:30:53.135890+0000, chain.objs.size()=1 2024-09-12T00:38:37.649 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.9kGETGzNHnc1P_lAO9YsDoArnmGSn2H_0 2024-09-12T00:38:37.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11216507354927257875', time=2024-09-12T02:30:53.175109+0000, chain.objs.size()=1 2024-09-12T00:38:37.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.648+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pduibnHik05RZTk0XcJeKRzfaEEp_8R_0 2024-09-12T00:38:37.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.649+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7069915420349089512', time=2024-09-12T02:30:53.211132+0000, chain.objs.size()=1 2024-09-12T00:38:37.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.649+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ofh8YLpNXSJevyqYZYfffkrSOyQSxUg_0 2024-09-12T00:38:37.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.649+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7351811581375363286', time=2024-09-12T02:30:53.229110+0000, chain.objs.size()=1 2024-09-12T00:38:37.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.649+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.9fG9Bthj9CCuSWYalv5pgfscInWgz_o_0 2024-09-12T00:38:37.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.649+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13756213716468370798', time=2024-09-12T02:30:53.244746+0000, chain.objs.size()=1 2024-09-12T00:38:37.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.649+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ySSgEmeo60ouRJBriwlHD3d16lNX2Cq_0 2024-09-12T00:38:37.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.649+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14768739714440584655', time=2024-09-12T02:30:53.250871+0000, chain.objs.size()=1 2024-09-12T00:38:37.650 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.649+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.J9NhcvWB3hhXKN8NaWDiQMabZUFEHLl_0 2024-09-12T00:38:37.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.652+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3286646810176152492', time=2024-09-12T02:30:53.287266+0000, chain.objs.size()=1 2024-09-12T00:38:37.651 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.652+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.OO2ftFABnvTbDrPNzivOCrJOYUh5Z3c_0 2024-09-12T00:38:37.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.654+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11105363952163038370', time=2024-09-12T02:30:53.467929+0000, chain.objs.size()=1 2024-09-12T00:38:37.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.654+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.FsReKMlzOc7ibWR-0k_inLQIQVU9Mmn_0 2024-09-12T00:38:37.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.654+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10282120845317821785', time=2024-09-12T02:30:53.495804+0000, chain.objs.size()=1 2024-09-12T00:38:37.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.654+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.wNZUnyRMMVWtTyxrXdowg1YCJ8bQyEG_0 2024-09-12T00:38:37.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.654+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4576211941629765272', time=2024-09-12T02:30:53.500452+0000, chain.objs.size()=1 2024-09-12T00:38:37.653 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.654+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Qxxvesxi6IYflJ3EBqfagwnV80ly7iC_0 2024-09-12T00:38:37.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.655+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16841060186091336124', time=2024-09-12T02:30:53.507454+0000, chain.objs.size()=1 2024-09-12T00:38:37.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.655+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.zkqV10D625a-c3PkPOJ83Vm9Wb_0Y3a_0 2024-09-12T00:38:37.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.655+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.337045065740422357', time=2024-09-12T02:30:53.542355+0000, chain.objs.size()=1 2024-09-12T00:38:37.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.655+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.LhUtdjyVKqzaMK1AntqwYPz7Rl-Jxe6_0 2024-09-12T00:38:37.654 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.655+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3437278350340034770', time=2024-09-12T02:30:53.678975+0000, chain.objs.size()=1 2024-09-12T00:38:37.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.655+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.WftXnk5uZ_UY74TucH6g0PEB20XGqEQ_0 2024-09-12T00:38:37.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.655+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13614114373847316105', time=2024-09-12T02:30:53.695411+0000, chain.objs.size()=1 2024-09-12T00:38:37.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.655+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.iCKAQKCmPCzbd-U5phrhg0k9tRECXJG_0 2024-09-12T00:38:37.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.655+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5537570818558011680', time=2024-09-12T02:30:53.731073+0000, chain.objs.size()=1 2024-09-12T00:38:37.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.655+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.7x4xLKWe08vzzSEf9QYyloO70lndyBi_0 2024-09-12T00:38:37.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.655+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18258188270401247680', time=2024-09-12T02:30:53.762096+0000, chain.objs.size()=1 2024-09-12T00:38:37.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.655+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.oLF6Q4SHKFBqff_yEwf7ekSn7qatgPI_0 2024-09-12T00:38:37.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.655+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13331237354874086881', time=2024-09-12T02:30:53.800614+0000, chain.objs.size()=1 2024-09-12T00:38:37.655 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.655+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.SF03-X3cP0D0C0KMIiZjbSGuax4R8uh_0 2024-09-12T00:38:37.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.658+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4744758553348814117', time=2024-09-12T02:30:53.803548+0000, chain.objs.size()=1 2024-09-12T00:38:37.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.658+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Xub8gBrOAqMr9buK3nd12RgHjUq8qro_0 2024-09-12T00:38:37.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.658+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9510423083738889980', time=2024-09-12T02:30:54.316611+0000, chain.objs.size()=1 2024-09-12T00:38:37.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.658+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.O_INQuNQUV2gaPk83a-WrzIeNe4yNJQ_0 2024-09-12T00:38:37.657 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.658+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3487555130581157525', time=2024-09-12T02:30:54.464226+0000, chain.objs.size()=1 2024-09-12T00:38:37.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.658+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.UmMnIhbbFGSOX-vcM4AV3t6YmZvYTBU_0 2024-09-12T00:38:37.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.658+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3250541683927830422', time=2024-09-12T02:30:54.565797+0000, chain.objs.size()=1 2024-09-12T00:38:37.658 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.658+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.q8-m6kxwPMHfcP8IinsQEq5c0Z4lj-i_0 2024-09-12T00:38:37.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.660+0000 7f10d2549640 0 -- 172.21.15.67:0/1227616915 >> [v2:172.21.15.170:6813/3583292503,v1:172.21.15.170:6815/3583292503] conn(0x7f10c8022940 msgr2=0x7f0f9c08c6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:37.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.660+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17026272840151976838', time=2024-09-12T02:30:54.632547+0000, chain.objs.size()=1 2024-09-12T00:38:37.659 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.660+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.zjXeaRjBQmynMAr_T2M1yuK3rLo33GZ_0 2024-09-12T00:38:37.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.660+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13230507847532243434', time=2024-09-12T02:30:54.639260+0000, chain.objs.size()=1 2024-09-12T00:38:37.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.660+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.KLVzvMqvXABUZW6emv9YJ-fNq5idlR-_0 2024-09-12T00:38:37.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.660+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.837150274682192178', time=2024-09-12T02:30:54.646691+0000, chain.objs.size()=1 2024-09-12T00:38:37.660 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.660+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pATCjxiKHKJVmZO82vc8iNRHKPLiwnC_0 2024-09-12T00:38:37.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.661+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10157119272086962335', time=2024-09-12T02:30:54.699568+0000, chain.objs.size()=1 2024-09-12T00:38:37.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.661+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.VQPcRr-4PM3pi7LtfYqyVmrqth2LMDj_0 2024-09-12T00:38:37.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.661+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4672503413797684565', time=2024-09-12T02:30:54.722541+0000, chain.objs.size()=1 2024-09-12T00:38:37.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.661+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6d4gE6vuAPi_pLAXCVA9DlAgdOvEQ7H_0 2024-09-12T00:38:37.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.661+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15536290135096929003', time=2024-09-12T02:30:54.850810+0000, chain.objs.size()=1 2024-09-12T00:38:37.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.661+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ApA5duSLQ0j6fZkRkbcL0-TvNsay5Vm_0 2024-09-12T00:38:37.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.661+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4880954522451741081', time=2024-09-12T02:30:54.897991+0000, chain.objs.size()=1 2024-09-12T00:38:37.661 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.661+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.0XeF3Pf5HyJ3MoTd61jcCH1lA76omqo_0 2024-09-12T00:38:37.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.662+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18096086213052052054', time=2024-09-12T02:30:54.931891+0000, chain.objs.size()=1 2024-09-12T00:38:37.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.662+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BAJpoFnjHQEUvgkSbdNGlFnKt8ICfgQ_0 2024-09-12T00:38:37.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.662+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11237932009162947705', time=2024-09-12T02:30:55.118020+0000, chain.objs.size()=1 2024-09-12T00:38:37.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.662+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.9Az7VNaCeeckqb1-7Mt2oqMwrl9aYvq_0 2024-09-12T00:38:37.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.662+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3111114476120611689', time=2024-09-12T02:30:55.162307+0000, chain.objs.size()=1 2024-09-12T00:38:37.662 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.662+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ZZkfTdKPG8-ENfUxi7bXzcQJl9MoX1o_0 2024-09-12T00:38:37.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.664+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6248472436431213742', time=2024-09-12T02:30:55.219562+0000, chain.objs.size()=1 2024-09-12T00:38:37.664 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.664+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.znE5_Y-CO3r7zL54c0uAiypLoMQxpXM_0 2024-09-12T00:38:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.665+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6773120483151633783', time=2024-09-12T02:30:55.228621+0000, chain.objs.size()=1 2024-09-12T00:38:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.665+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.cXEqCwXw6FL2pab7Hn1q1ZCr2phby3W_0 2024-09-12T00:38:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.665+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15050230652868845982', time=2024-09-12T02:30:55.232456+0000, chain.objs.size()=1 2024-09-12T00:38:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.665+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.nwyzS0gwo7VueSCVQEnB-WqrTFe2sV9_0 2024-09-12T00:38:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.665+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9119551196168270277', time=2024-09-12T02:30:57.143125+0000, chain.objs.size()=1 2024-09-12T00:38:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.665+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.270__shadow_.Tm7wtfiGJm7zYw-NRVv7AMU-R7E67K7_0 2024-09-12T00:38:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.665+0000 7f10d1d48640 0 -- 172.21.15.67:0/1227616915 >> [v2:172.21.15.67:6808/758855525,v1:172.21.15.67:6809/758855525] conn(0x7f10c405c5e0 msgr2=0x7f10c40a38d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.666+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12727988762181132239', time=2024-09-12T02:31:00.064604+0000, chain.objs.size()=1 2024-09-12T00:38:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.666+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.282__shadow_.ml-zntyJib0XxmJyqixOxd9T-PZFOOE_0 2024-09-12T00:38:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.667+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17008588811728063989', time=2024-09-12T02:31:00.304993+0000, chain.objs.size()=1 2024-09-12T00:38:37.667 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.667+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.283__shadow_.bIo1GEPfQ-9ipXpt8AtLsyjkQ_gxgwQ_0 2024-09-12T00:38:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.668+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15511752928064466549', time=2024-09-12T02:31:01.148806+0000, chain.objs.size()=1 2024-09-12T00:38:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.668+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.286__shadow_.vMh_CImTCp8JrICjOY72zS2C_a9u17y_0 2024-09-12T00:38:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.669+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2122277461156883023', time=2024-09-12T02:31:03.084490+0000, chain.objs.size()=1 2024-09-12T00:38:37.668 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.669+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.u0IIBD1EpHMe0P1LntaA9peRo8XHTAU_0 2024-09-12T00:38:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.669+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18311852328877094443', time=2024-09-12T02:31:03.662085+0000, chain.objs.size()=1 2024-09-12T00:38:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.670+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.BHFmjIjrMJNzdGtMzxt3VJNPzEgLlVy_0 2024-09-12T00:38:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.670+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10847257652979046267', time=2024-09-12T02:31:19.365058+0000, chain.objs.size()=1 2024-09-12T00:38:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.670+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_._eVna32k4igW4NL5BDYNkeBX6EvYmLC_0 2024-09-12T00:38:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.670+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6826173365146006781', time=2024-09-12T02:31:19.419886+0000, chain.objs.size()=1 2024-09-12T00:38:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.670+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.5NFN4QCg-hWmoiivbvsxgIol4pIfNqO_0 2024-09-12T00:38:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.670+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12665720670124804588', time=2024-09-12T02:31:19.450984+0000, chain.objs.size()=1 2024-09-12T00:38:37.669 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.670+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.SHnYBXPswKuIg5-9GoSaDMBIEmlA7ZR_0 2024-09-12T00:38:37.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.670+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14476676420826521306', time=2024-09-12T02:31:19.520322+0000, chain.objs.size()=1 2024-09-12T00:38:37.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.670+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.dJGRgb3prVThD29_mBMCb_lhPd_LFR4_0 2024-09-12T00:38:37.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.670+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5215806921509484688', time=2024-09-12T02:31:19.522945+0000, chain.objs.size()=1 2024-09-12T00:38:37.670 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.670+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.8t0BYb00d3Eff6KMB5HOv81V3xNQ9S5_0 2024-09-12T00:38:37.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.674+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6821687827262045460', time=2024-09-12T02:31:19.651378+0000, chain.objs.size()=1 2024-09-12T00:38:37.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.674+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.YffYWcrqg31nsh6-j_ZKM-I6n7O79l2_0 2024-09-12T00:38:37.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.674+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.433487251637616836', time=2024-09-12T02:31:19.652897+0000, chain.objs.size()=1 2024-09-12T00:38:37.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.674+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.iOF7wOuuSVide6atni-U_GI3ksfAK8x_0 2024-09-12T00:38:37.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.674+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8939581591448932975', time=2024-09-12T02:31:19.753830+0000, chain.objs.size()=1 2024-09-12T00:38:37.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.674+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.WFvoSRdGk70Op0GSJeM2cIxW3gIcZhZ_0 2024-09-12T00:38:37.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13671708154139845117', time=2024-09-12T02:31:19.767155+0000, chain.objs.size()=1 2024-09-12T00:38:37.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ieef1FUnQ3XaOujILK2DQpXNABb1qXH_0 2024-09-12T00:38:37.674 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2410956195271795862', time=2024-09-12T02:31:19.780857+0000, chain.objs.size()=1 2024-09-12T00:38:37.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.an-Dps7pM757cD43xEg3BRHWyhcZ6_t_0 2024-09-12T00:38:37.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7682455525942611156', time=2024-09-12T02:31:19.861110+0000, chain.objs.size()=1 2024-09-12T00:38:37.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ryK5OboYtn5ePoYE32PuXf7ch3mjXzt_0 2024-09-12T00:38:37.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14086339600173820596', time=2024-09-12T02:31:19.870083+0000, chain.objs.size()=1 2024-09-12T00:38:37.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.X77a6DSMzrFR5NsWrtlfZLzZMkQknes_0 2024-09-12T00:38:37.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4907659897481680849', time=2024-09-12T02:31:19.996047+0000, chain.objs.size()=1 2024-09-12T00:38:37.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.6WsnbIHPKFIuKc8wOs4PD_-dTnXVAi0_0 2024-09-12T00:38:37.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12146866452924404746', time=2024-09-12T02:31:20.038177+0000, chain.objs.size()=1 2024-09-12T00:38:37.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.FSqW9broaJ6LGQiJYwIOrBoxCVf7Eo3_0 2024-09-12T00:38:37.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10097018147575375577', time=2024-09-12T02:31:20.099067+0000, chain.objs.size()=1 2024-09-12T00:38:37.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.rfVD37riW_4u3Smz_NwjsYFOG7UTy1e_0 2024-09-12T00:38:37.675 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2193321678890009976', time=2024-09-12T02:31:20.131881+0000, chain.objs.size()=1 2024-09-12T00:38:37.676 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.675+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7ZTMeYTEEzdoEpR0zXYkWw1ztXalF--_0 2024-09-12T00:38:37.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.678+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8000814032737576732', time=2024-09-12T02:31:20.132702+0000, chain.objs.size()=1 2024-09-12T00:38:37.677 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.678+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.1bYfYtwrxrwqtcFxaTH_4A8R8aLnWJB_0 2024-09-12T00:38:37.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17676042926288667817', time=2024-09-12T02:31:20.320284+0000, chain.objs.size()=1 2024-09-12T00:38:37.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.TuWrZTlWFlcRFr7uu6yNeYy3ciPlJXx_0 2024-09-12T00:38:37.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9240758389503513704', time=2024-09-12T02:31:20.396655+0000, chain.objs.size()=1 2024-09-12T00:38:37.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.DilZtiYMDJEoWSoDexNx_FBpuIHuW7X_0 2024-09-12T00:38:37.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4752747143364454741', time=2024-09-12T02:31:20.405883+0000, chain.objs.size()=1 2024-09-12T00:38:37.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JHhf1va9YniFtUKLAPC_x2N3re1uYOW_0 2024-09-12T00:38:37.679 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14506419808912493262', time=2024-09-12T02:31:20.433553+0000, chain.objs.size()=1 2024-09-12T00:38:37.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_._sN_O0FUn4arSnmWR4Y9jYWblPfSI18_0 2024-09-12T00:38:37.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15931563245388690728', time=2024-09-12T02:31:20.593897+0000, chain.objs.size()=1 2024-09-12T00:38:37.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7og4lTM51IZGuLm-d-8QICY5igtsVHD_0 2024-09-12T00:38:37.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.466885943194884436', time=2024-09-12T02:31:20.657927+0000, chain.objs.size()=1 2024-09-12T00:38:37.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IkCi5cLduPOKNBO6zc84gpLcCJeU7cu_0 2024-09-12T00:38:37.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12462188411258647080', time=2024-09-12T02:31:20.717654+0000, chain.objs.size()=1 2024-09-12T00:38:37.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.s8Mei7u0mexju1t9fLNKBlM7DaMZDxA_0 2024-09-12T00:38:37.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11267260111463801262', time=2024-09-12T02:31:20.738277+0000, chain.objs.size()=1 2024-09-12T00:38:37.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.dPaDsjsEvhnAv2Wqu1qaZylCR-fPGzc_0 2024-09-12T00:38:37.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1289443692450496083', time=2024-09-12T02:31:20.748541+0000, chain.objs.size()=1 2024-09-12T00:38:37.680 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.680+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.LB5EQutQvXjgRlcBuKBKXC_weUtCIJp_0 2024-09-12T00:38:37.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.682+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4186053408612189881', time=2024-09-12T02:31:20.881118+0000, chain.objs.size()=1 2024-09-12T00:38:37.681 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.682+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.rc7oS_Id3Pbwwmbe9_PPoXVn-LpHS3t_0 2024-09-12T00:38:37.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.683+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12290746554461198747', time=2024-09-12T02:31:20.897678+0000, chain.objs.size()=1 2024-09-12T00:38:37.682 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.683+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.qOQLBSlxm6f0hMAthHGu4kPshGqtDjK_0 2024-09-12T00:38:37.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.685+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13869370746655001991', time=2024-09-12T02:31:20.899338+0000, chain.objs.size()=1 2024-09-12T00:38:37.684 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.685+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.9boD2QWRK1w9G2v_gTi9EhV-C9zt8HE_0 2024-09-12T00:38:37.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.685+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17900494523943888831', time=2024-09-12T02:31:20.903913+0000, chain.objs.size()=1 2024-09-12T00:38:37.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.685+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.VFCPh6VCJbtVqzv7ERdy4vw1RBkxgmD_0 2024-09-12T00:38:37.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.685+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11252536302892027482', time=2024-09-12T02:31:20.958442+0000, chain.objs.size()=1 2024-09-12T00:38:37.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.685+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.G71ZEX4qsCP7zLybhoq6kAwKYOowsbb_0 2024-09-12T00:38:37.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.685+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2700462075693739770', time=2024-09-12T02:31:21.002573+0000, chain.objs.size()=1 2024-09-12T00:38:37.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.685+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.0W3XcZMqRux9uuA1yVqL8uTl_Wz5A--_0 2024-09-12T00:38:37.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.685+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9855629078553789858', time=2024-09-12T02:31:21.029279+0000, chain.objs.size()=1 2024-09-12T00:38:37.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.685+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.rHMuJu2yDvZoNaWLMFLW4vq2NoXyof6_0 2024-09-12T00:38:37.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.685+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11860849032368545200', time=2024-09-12T02:31:21.163452+0000, chain.objs.size()=1 2024-09-12T00:38:37.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.685+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.k_DwsYsvGgoM5pJMHEI62a-8x-Srfem_0 2024-09-12T00:38:37.685 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.685+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6470861654108755869', time=2024-09-12T02:31:21.186639+0000, chain.objs.size()=1 2024-09-12T00:38:37.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.685+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.CW8KqWvrst59kxGUroDMspxSzgPbgKw_0 2024-09-12T00:38:37.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.686+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6175209960252526444', time=2024-09-12T02:31:21.346241+0000, chain.objs.size()=1 2024-09-12T00:38:37.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.686+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Yq-arXsfMUOTkfjecvGFNPiLjOr3Tki_0 2024-09-12T00:38:37.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.686+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5582119094095377237', time=2024-09-12T02:31:21.502884+0000, chain.objs.size()=1 2024-09-12T00:38:37.686 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.686+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.9S6dFHN0z9n14y3vLFBVNJBHuoEJRkd_0 2024-09-12T00:38:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.687+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11399834389772522938', time=2024-09-12T02:31:21.519550+0000, chain.objs.size()=1 2024-09-12T00:38:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.688+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Htc0oTNiTB7upm0Tyq8AEH3lPbXzQJZ_0 2024-09-12T00:38:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.688+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5389219419212743395', time=2024-09-12T02:31:21.581224+0000, chain.objs.size()=1 2024-09-12T00:38:37.687 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.688+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.XhzIxt4_bQ5JRP6LMec4BMwO4A-jITy_0 2024-09-12T00:38:37.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.689+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1276863576813536776', time=2024-09-12T02:31:21.582167+0000, chain.objs.size()=1 2024-09-12T00:38:37.689 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.689+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.PwMRfkBv3tvsqwjdatIlOC2y2UPJYyJ_0 2024-09-12T00:38:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.691+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16080507926094141123', time=2024-09-12T02:31:29.684501+0000, chain.objs.size()=1 2024-09-12T00:38:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.691+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.j739AYBKYfSTPuIDq6IJml0w7Fppki2_0 2024-09-12T00:38:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.691+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11604902714910303575', time=2024-09-12T02:31:29.728047+0000, chain.objs.size()=1 2024-09-12T00:38:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.691+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Nf2aN5e44imbAmIEcSl0KL-rcYClDzn_0 2024-09-12T00:38:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.691+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13175851336754495474', time=2024-09-12T02:31:30.018637+0000, chain.objs.size()=1 2024-09-12T00:38:37.691 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.691+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.VvY2WYpNCY3UqXvEDV69PRsm2ZHSGO3_0 2024-09-12T00:38:37.693 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2760201747961563933', time=2024-09-12T02:31:30.028170+0000, chain.objs.size()=1 2024-09-12T00:38:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._dEBJUDJE_MvA0flgJHdQrbyqnc5med_0 2024-09-12T00:38:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18362567272225661406', time=2024-09-12T02:31:30.058785+0000, chain.objs.size()=1 2024-09-12T00:38:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Jor0cjrxDGDAcEA1HxC3axX5b3DLc30_0 2024-09-12T00:38:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8703612416283454765', time=2024-09-12T02:31:30.089485+0000, chain.objs.size()=1 2024-09-12T00:38:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Ir9EyL9F_G_9xg0RrXB1JviyvsRO3IP_0 2024-09-12T00:38:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1910790010202146753', time=2024-09-12T02:31:30.121180+0000, chain.objs.size()=1 2024-09-12T00:38:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._bq0trAl38YFumwVLeczZ8_zkY8xpUY_0 2024-09-12T00:38:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2137789279987449206', time=2024-09-12T02:31:30.169059+0000, chain.objs.size()=1 2024-09-12T00:38:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.BYC9RFsSkpNAEIU2o-set2oTbLs7jtw_0 2024-09-12T00:38:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5671561523740602596', time=2024-09-12T02:31:30.304533+0000, chain.objs.size()=1 2024-09-12T00:38:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.UOyHJbw0XNhaSZdobuhZXwGxt4tytsq_0 2024-09-12T00:38:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13538344317224521231', time=2024-09-12T02:31:30.341045+0000, chain.objs.size()=1 2024-09-12T00:38:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.tL039BOragtEkjlYt1KDAx8jvH_HKqS_0 2024-09-12T00:38:37.694 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1375195790744536915', time=2024-09-12T02:31:30.386214+0000, chain.objs.size()=1 2024-09-12T00:38:37.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.694+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.QAd_Tk3d5LDr--KZpLm3OFLYzkEG-WT_0 2024-09-12T00:38:37.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.695+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14314002902869229697', time=2024-09-12T02:31:30.467504+0000, chain.objs.size()=1 2024-09-12T00:38:37.695 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.695+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.AqxeUkUzxVClSP8xeoPv7X3f2hrb8p4_0 2024-09-12T00:38:37.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.696+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17523097168768966536', time=2024-09-12T02:31:30.604454+0000, chain.objs.size()=1 2024-09-12T00:38:37.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.696+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lJGzKRkVxvqG1AoCBMahchilDCHPERu_0 2024-09-12T00:38:37.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.696+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8784511389040977460', time=2024-09-12T02:31:30.627030+0000, chain.objs.size()=1 2024-09-12T00:38:37.696 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.696+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.4eumYJoJ1UQIFh-BSLLPhrl-Fi9qSHW_0 2024-09-12T00:38:37.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.701+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4005852902496645566', time=2024-09-12T02:31:30.630033+0000, chain.objs.size()=1 2024-09-12T00:38:37.700 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.701+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.vR5xJN9Ls3mzyRkkizlbWGRxDOCSxSj_0 2024-09-12T00:38:37.703 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.704+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/42507 2024-09-12T00:38:37.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T00:38:37.706 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16148003738633538672', time=2024-09-12T02:31:30.698941+0000, chain.objs.size()=1 2024-09-12T00:38:37.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.mOl_DJGJfs728eCDtwu2mxj53acUXbZ_0 2024-09-12T00:38:37.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16216051016404297515', time=2024-09-12T02:31:30.861515+0000, chain.objs.size()=1 2024-09-12T00:38:37.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.vCKv2B3n1dZOyX6C4Bo9RvGd0D-XEVM_0 2024-09-12T00:38:37.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17144099949378980194', time=2024-09-12T02:31:30.882465+0000, chain.objs.size()=1 2024-09-12T00:38:37.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.b5y_VpyDyaTuZZJxi-dyohgf2qgYh1o_0 2024-09-12T00:38:37.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6485599305468466493', time=2024-09-12T02:31:31.178915+0000, chain.objs.size()=1 2024-09-12T00:38:37.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.AMSe0OSZh6ctcKeEcwue26nyKziM_L2_0 2024-09-12T00:38:37.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6321199998164531017', time=2024-09-12T02:31:31.185518+0000, chain.objs.size()=1 2024-09-12T00:38:37.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.3YD5qXPO0vcD6Ly6Nzs0M7Wr6TswSGm_0 2024-09-12T00:38:37.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15976386791829139537', time=2024-09-12T02:31:31.237475+0000, chain.objs.size()=1 2024-09-12T00:38:37.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.p9KcyGi-2-aeQR6R0Yd6lf4iqy32UR7_0 2024-09-12T00:38:37.707 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3809122039560614474', time=2024-09-12T02:31:31.272863+0000, chain.objs.size()=1 2024-09-12T00:38:37.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.V94jMbeN7UEqLG1HtpMT-wZ-iXVdDm2_0 2024-09-12T00:38:37.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4732067229400896205', time=2024-09-12T02:31:31.284665+0000, chain.objs.size()=1 2024-09-12T00:38:37.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Q6I3ZxnzmNzO1wU0_OniRoV_cD6xoLq_0 2024-09-12T00:38:37.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18325169964889662058', time=2024-09-12T02:31:31.402507+0000, chain.objs.size()=1 2024-09-12T00:38:37.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.BQ44X6tLmn9DqjABlRxqQLM360KcVxp_0 2024-09-12T00:38:37.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7226612188992758482', time=2024-09-12T02:31:31.421159+0000, chain.objs.size()=1 2024-09-12T00:38:37.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.DTfCbI6A3ne-M4k3Ai3I2Cl_6RrHPyV_0 2024-09-12T00:38:37.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12940011003026212258', time=2024-09-12T02:31:31.440866+0000, chain.objs.size()=1 2024-09-12T00:38:37.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ajPlCv4bKSXMVQNPxHeaf3UqR9Z6iwE_0 2024-09-12T00:38:37.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9092898183641876008', time=2024-09-12T02:31:31.442813+0000, chain.objs.size()=1 2024-09-12T00:38:37.708 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.707+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Sh1bZQDzBpBCECOi9cPGUQrpwpOn55O_0 2024-09-12T00:38:37.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.711+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8866007308941955536', time=2024-09-12T02:31:31.487663+0000, chain.objs.size()=1 2024-09-12T00:38:37.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.711+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.CceGvJTQa79C2gX6JO8t8D7ld8cdSq6_0 2024-09-12T00:38:37.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.711+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16732520114373922106', time=2024-09-12T02:31:31.547516+0000, chain.objs.size()=1 2024-09-12T00:38:37.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.711+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-IbSbRdsNzbNfW8604hYz57fUmPNU6f_0 2024-09-12T00:38:37.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.711+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6224720205239386796', time=2024-09-12T02:31:31.552494+0000, chain.objs.size()=1 2024-09-12T00:38:37.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.711+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.o5293fN3pjpoqXu1EtEI_k1XcvqFZct_0 2024-09-12T00:38:37.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10288775253431925357', time=2024-09-12T02:31:31.566683+0000, chain.objs.size()=1 2024-09-12T00:38:37.711 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.w5wnOCsqc0aa1IiCZwQ4btJuY1RpRhx_0 2024-09-12T00:38:37.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16218981972267746747', time=2024-09-12T02:31:31.570756+0000, chain.objs.size()=1 2024-09-12T00:38:37.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.WWyM6V5vwwCGzcuNSVzWDYoY6fvY-bN_0 2024-09-12T00:38:37.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1821311189014244856', time=2024-09-12T02:31:31.587483+0000, chain.objs.size()=1 2024-09-12T00:38:37.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.DJPhkq_9r2E9ymYFB_lr1tzEVRJ3LZC_0 2024-09-12T00:38:37.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1685681081985732904', time=2024-09-12T02:31:31.674985+0000, chain.objs.size()=1 2024-09-12T00:38:37.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.QGUa98KIhyqQQeakGxB-Lar_75gNnbj_0 2024-09-12T00:38:37.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7111671820742377541', time=2024-09-12T02:31:31.697643+0000, chain.objs.size()=1 2024-09-12T00:38:37.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.sv1K7vsUzWKaaPcE7IX6FSZXAKHPO1F_0 2024-09-12T00:38:37.712 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9100093160570042352', time=2024-09-12T02:31:31.807712+0000, chain.objs.size()=1 2024-09-12T00:38:37.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NuU7NhIWxhAWg9uemE0ggttUuH0-Smf_0 2024-09-12T00:38:37.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.747312307666014208', time=2024-09-12T02:32:12.594947+0000, chain.objs.size()=1 2024-09-12T00:38:37.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.483__shadow_.-boxwvh0ZK9Mqd15wKArevAT70ygx2H_0 2024-09-12T00:38:37.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10743005493268905792', time=2024-09-12T02:32:13.007674+0000, chain.objs.size()=1 2024-09-12T00:38:37.713 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.712+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.485__shadow_.tXzHXRuPAUJaODj2zDYRe51fcu03f9D_0 2024-09-12T00:38:37.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.715+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10153009233247243488', time=2024-09-12T02:32:16.509427+0000, chain.objs.size()=1 2024-09-12T00:38:37.715 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.715+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.497__shadow_.eW15pVP7R8-F-4l-6wBr402ehtG3nZa_0 2024-09-12T00:38:37.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.717+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15757694745291707936', time=2024-09-12T02:33:18.417385+0000, chain.objs.size()=1 2024-09-12T00:38:37.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.717+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:c9QGO0DH6y5h1ylbFNkOLy.QjxV-.R2_.8cnL7k9RJW_E2KV-Byn35u8HXVVN9m__0 2024-09-12T00:38:37.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.717+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14791249427640227207', time=2024-09-12T02:33:42.605285+0000, chain.objs.size()=1 2024-09-12T00:38:37.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.717+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:MCMAn-EC3Saxv6BbDViBFbtRxxlmKXO_.amK53DEHkoJeHIlmFgvYGqT_L2rjeCT_0 2024-09-12T00:38:37.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.717+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12787392223925501563', time=2024-09-12T02:36:00.632135+0000, chain.objs.size()=1 2024-09-12T00:38:37.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.717+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.619__shadow_.nOlAowppA-u_WcJr3sFVqZmS9ZZ80e7_0 2024-09-12T00:38:37.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.717+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5491796356769406794', time=2024-09-12T02:36:04.130589+0000, chain.objs.size()=1 2024-09-12T00:38:37.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.717+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.626__shadow_.plZAF-9up-mW0KFoThHIgQIPhLcOIPy_0 2024-09-12T00:38:37.716 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.717+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8743941141195483934', time=2024-09-12T02:36:08.929104+0000, chain.objs.size()=1 2024-09-12T00:38:37.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.717+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.645__shadow_.BZB1_t1WOyGBV_equZUSjZnlZEFK1hc_0 2024-09-12T00:38:37.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.717+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10406025443104714816', time=2024-09-12T02:36:11.315270+0000, chain.objs.size()=1 2024-09-12T00:38:37.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.717+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.652__shadow_.Mlca1Zga8_JTNuOOAXbNQ5A6-uCDE4o_0 2024-09-12T00:38:37.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.717+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4026882015066365073', time=2024-09-12T02:36:17.595494+0000, chain.objs.size()=1 2024-09-12T00:38:37.717 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.717+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.668__shadow_.dtysOUC2WWX101Y42XFrCMk-1Ri7DbI_0 2024-09-12T00:38:37.721 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.722+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:37.724 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.725+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:38:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.726+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:37.725 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.726+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51076' 2024-09-12T00:38:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3500116627389172516', time=2024-09-12T02:29:24.711725+0000, chain.objs.size()=3 2024-09-12T00:38:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.159__multipart_mymultipart-LUKEWARM.2~uCqXjZ7X6m54SNnNKqrSuZ3iLnWnF8x.1 2024-09-12T00:38:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.159__multipart_mymultipart-LUKEWARM.2~uCqXjZ7X6m54SNnNKqrSuZ3iLnWnF8x.2 2024-09-12T00:38:37.727 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.159__multipart_mymultipart-LUKEWARM.2~uCqXjZ7X6m54SNnNKqrSuZ3iLnWnF8x.3 2024-09-12T00:38:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_z8HG2vMzB8GtttkaRsGtzVfXOwrN1Pr', time=2024-09-12T02:29:25.528588+0000, chain.objs.size()=2 2024-09-12T00:38:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.QWFIRv7R6CpkHLR8Lw6k0Taoos5UoS9_0 2024-09-12T00:38:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.QWFIRv7R6CpkHLR8Lw6k0Taoos5UoS9_1 2024-09-12T00:38:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_dYDYxSKZtmgdoBJCjux4lbP1jS7P4Ew', time=2024-09-12T02:29:27.237502+0000, chain.objs.size()=2 2024-09-12T00:38:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__shadow_.Q-YkFWWU8YU6UjbJ-5DG993IOP2B2_Z_0 2024-09-12T00:38:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__shadow_.Q-YkFWWU8YU6UjbJ-5DG993IOP2B2_Z_1 2024-09-12T00:38:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11288369542697980228', time=2024-09-12T02:29:43.665350+0000, chain.objs.size()=1 2024-09-12T00:38:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.197__shadow_.Q1UcMIruCzJsOo8lEICl4QJ_mF6UCaR_0 2024-09-12T00:38:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16496933071881585687', time=2024-09-12T02:30:38.284990+0000, chain.objs.size()=1 2024-09-12T00:38:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.234__shadow_.iWNxCtgDu24sV2cfs34l3cAc0xl3ZNY_0 2024-09-12T00:38:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12547160243180562639', time=2024-09-12T02:30:39.829325+0000, chain.objs.size()=1 2024-09-12T00:38:37.728 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.240__shadow_.qI3zGzu3CKomTIBH1SymImyZqFUAr7K_0 2024-09-12T00:38:37.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18081720268250767100', time=2024-09-12T02:30:40.071210+0000, chain.objs.size()=1 2024-09-12T00:38:37.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.241__shadow_.sv1wHRGUsZz_WR-ujokwsVmeHXSl-0e_0 2024-09-12T00:38:37.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5582362137459162318', time=2024-09-12T02:30:42.649182+0000, chain.objs.size()=1 2024-09-12T00:38:37.729 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.727+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.251__shadow_.9zfD23VLhLkm2WFuFp-6xPi3RzaOmm9_0 2024-09-12T00:38:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.731+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7594750643209009839', time=2024-09-12T02:30:42.650739+0000, chain.objs.size()=1 2024-09-12T00:38:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.731+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.251__shadow_.8Oj5BJ8SyyahgyEwOC-95MDv_4BP8l__0 2024-09-12T00:38:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.731+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14315985997130167018', time=2024-09-12T02:30:44.352881+0000, chain.objs.size()=1 2024-09-12T00:38:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.731+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.258__shadow_.flNEhJX0k-Ax-kxKUtKy5GvI1dcHEgX_0 2024-09-12T00:38:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.731+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9893168294867223899', time=2024-09-12T02:30:53.171683+0000, chain.objs.size()=1 2024-09-12T00:38:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.731+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.GAYJnJPacySjVqMF5bXn9gbMhEOIf6s_0 2024-09-12T00:38:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.731+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15135686052500300334', time=2024-09-12T02:30:53.189371+0000, chain.objs.size()=1 2024-09-12T00:38:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.731+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-a-CfUrhGbKcmmz41qcKD3qE5rhAyl7_0 2024-09-12T00:38:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.731+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15585088923921162302', time=2024-09-12T02:30:53.256628+0000, chain.objs.size()=1 2024-09-12T00:38:37.731 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.731+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.F6IeuQoP5w_TTUZD1Zeo2Zu2VX5uAun_0 2024-09-12T00:38:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.731+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5565860172742181460', time=2024-09-12T02:30:53.420211+0000, chain.objs.size()=1 2024-09-12T00:38:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.731+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.a0X-6Z578k4senOnlav9wboYkEM8V4h_0 2024-09-12T00:38:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.732+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2244146284349209384', time=2024-09-12T02:30:53.486374+0000, chain.objs.size()=1 2024-09-12T00:38:37.732 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.732+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Aurxu5ex6D8-SnvAc12y2a_KbWJJdsb_0 2024-09-12T00:38:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.733+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.427799542999998891', time=2024-09-12T02:30:53.525802+0000, chain.objs.size()=1 2024-09-12T00:38:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.733+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.x-WzvMHqZ12YakF2io4-utp_rMfRayp_0 2024-09-12T00:38:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.734+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12195464740368843700', time=2024-09-12T02:30:53.539202+0000, chain.objs.size()=1 2024-09-12T00:38:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.734+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.w-Ly_RGJIF3d1_3WRDyq9mc2aTnzqea_0 2024-09-12T00:38:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.734+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12611526142529525512', time=2024-09-12T02:30:53.560914+0000, chain.objs.size()=1 2024-09-12T00:38:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.734+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.H8PfIS1xF21DuEa2-UdG7GjFcOI6iJE_0 2024-09-12T00:38:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.734+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8812332061988748643', time=2024-09-12T02:30:53.568360+0000, chain.objs.size()=1 2024-09-12T00:38:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.734+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2pqSpUA2o8fMRn7JdHbfUQQU0uuf5Vw_0 2024-09-12T00:38:37.733 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.734+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17454940377065106505', time=2024-09-12T02:30:53.670801+0000, chain.objs.size()=1 2024-09-12T00:38:37.734 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.734+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.5M3n8OxzDUspgWiH2z9GPOucgAJMmaV_0 2024-09-12T00:38:37.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.737+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3830003333231652632', time=2024-09-12T02:30:53.678672+0000, chain.objs.size()=1 2024-09-12T00:38:37.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.737+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ZHcNwkS_EJZ5_x5RyzXanhF7icGDdwc_0 2024-09-12T00:38:37.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.737+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8004545804405002800', time=2024-09-12T02:30:53.740109+0000, chain.objs.size()=1 2024-09-12T00:38:37.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.737+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.53Kp37Dh2Fj0iedSpcRKFfbBCjZptRu_0 2024-09-12T00:38:37.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.737+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1619096196188539313', time=2024-09-12T02:30:53.782567+0000, chain.objs.size()=1 2024-09-12T00:38:37.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.737+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_._CXETZZuirWXa8n39CtJvO7xZv5UKLv_0 2024-09-12T00:38:37.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.737+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3566150932725191449', time=2024-09-12T02:30:53.837018+0000, chain.objs.size()=1 2024-09-12T00:38:37.737 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.737+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.NqUzWlljenW0Yi0UacfIqxD5nWlvn95_0 2024-09-12T00:38:37.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.737+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12325990906692913027', time=2024-09-12T02:30:53.932338+0000, chain.objs.size()=1 2024-09-12T00:38:37.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.737+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BHGipZcQGWpXzO85O-N3vVnHk1b_rVO_0 2024-09-12T00:38:37.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.737+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13672682782188003220', time=2024-09-12T02:30:53.976830+0000, chain.objs.size()=1 2024-09-12T00:38:37.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.737+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HacOX9hpEbWoZkT0Gad5Xw9sJNhjzk0_0 2024-09-12T00:38:37.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.738+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7120793620977111247', time=2024-09-12T02:30:54.017652+0000, chain.objs.size()=1 2024-09-12T00:38:37.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.738+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lTjlAQYh-OW64SUR-AKVT7zdpEnqEqe_0 2024-09-12T00:38:37.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.738+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14184086796326398575', time=2024-09-12T02:30:54.052097+0000, chain.objs.size()=1 2024-09-12T00:38:37.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.738+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.xK6w8TF1iReDsgIVWPyq4TZ0DW_BBOK_0 2024-09-12T00:38:37.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.739+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15198659257002900070', time=2024-09-12T02:30:54.144904+0000, chain.objs.size()=1 2024-09-12T00:38:37.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.739+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HN7KMVhOIq12l0SiyGHrjNCxYKE0R9T_0 2024-09-12T00:38:37.738 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.739+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6525949904820109920', time=2024-09-12T02:30:54.157064+0000, chain.objs.size()=1 2024-09-12T00:38:37.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.739+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-QIdNE0EB7qgJCpZPbE7ZITk_NQTSOf_0 2024-09-12T00:38:37.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.739+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5024133132228026755', time=2024-09-12T02:30:54.303612+0000, chain.objs.size()=1 2024-09-12T00:38:37.739 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.739+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.mP_eYedcnEHQKPvSBO-KBNCQC0Km_bD_0 2024-09-12T00:38:37.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.742+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15937719489232693272', time=2024-09-12T02:30:54.310396+0000, chain.objs.size()=1 2024-09-12T00:38:37.741 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.742+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Wz9Nmpk25H03ga_Nzv9MnderTD7Gr_y_0 2024-09-12T00:38:37.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.743+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3451670071589257083', time=2024-09-12T02:30:54.365216+0000, chain.objs.size()=1 2024-09-12T00:38:37.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.743+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HSjuIvqPLKQRY_O8nxd1s19A8fBcMuV_0 2024-09-12T00:38:37.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.743+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3479296028523454303', time=2024-09-12T02:30:54.382689+0000, chain.objs.size()=1 2024-09-12T00:38:37.742 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.743+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.IyBivQlVW3mcrYDMZb5xIZBp2bE_uGF_0 2024-09-12T00:38:37.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.743+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18214588120608932947', time=2024-09-12T02:30:54.591375+0000, chain.objs.size()=1 2024-09-12T00:38:37.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.743+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BfCV3KjuIpNPlYpSAS-bMFQJKax38r5_0 2024-09-12T00:38:37.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.743+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7055659079675941578', time=2024-09-12T02:30:54.673429+0000, chain.objs.size()=1 2024-09-12T00:38:37.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.743+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.sjEcVFpghSLpMOPPJQ33HrnjB8DzDWg_0 2024-09-12T00:38:37.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9383464658702628869', time=2024-09-12T02:30:54.732886+0000, chain.objs.size()=1 2024-09-12T00:38:37.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.4IsjG56dbk9UOXLEYzIrG9pJjeDvrnR_0 2024-09-12T00:38:37.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6716454231927310872', time=2024-09-12T02:30:54.887383+0000, chain.objs.size()=1 2024-09-12T00:38:37.743 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.qfbD9yDmUtzIKio72fbnWZkvIWDgD40_0 2024-09-12T00:38:37.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10983955750637910497', time=2024-09-12T02:30:54.915430+0000, chain.objs.size()=1 2024-09-12T00:38:37.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.KgWEJGxXCiz_uBs2lgZ8W9eygNXf9D7_0 2024-09-12T00:38:37.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2521684168368366617', time=2024-09-12T02:30:55.080589+0000, chain.objs.size()=1 2024-09-12T00:38:37.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.SwG0TwvrN7JgjWerq3_oJ4KflGTsMMY_0 2024-09-12T00:38:37.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9203008217778046501', time=2024-09-12T02:30:55.111248+0000, chain.objs.size()=1 2024-09-12T00:38:37.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.FSFLHildAOe9t5v2Ts9Zfbui6vYLXCr_0 2024-09-12T00:38:37.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.744+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6947774285509304133', time=2024-09-12T02:30:55.233253+0000, chain.objs.size()=1 2024-09-12T00:38:37.744 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.744+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.PohcMxsjfZQxNcgBSaeCG5YmdFKEhOr_0 2024-09-12T00:38:37.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.746+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12055980537899602347', time=2024-09-12T02:31:00.582923+0000, chain.objs.size()=1 2024-09-12T00:38:37.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.746+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.284__shadow_.eF0WAKxu9fE8hpJ3fDaxV_FH-a0IKkP_0 2024-09-12T00:38:37.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.747+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8361433106459697500', time=2024-09-12T02:31:06.218476+0000, chain.objs.size()=1 2024-09-12T00:38:37.746 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.747+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.303__shadow_.Tr8FBwN-GeSdwU9I3xZzGLgmxuMASar_0 2024-09-12T00:38:37.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.748+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4484358616305827303', time=2024-09-12T02:31:07.612683+0000, chain.objs.size()=1 2024-09-12T00:38:37.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.748+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.307__shadow:e1M7CrwXN7nTDIE6BTC955Zjmtnsnkm_.etLfUK7ki8Xguu9ur1VorrZ8HtEWc7P_0 2024-09-12T00:38:37.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.748+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18314518622489698243', time=2024-09-12T02:31:10.517251+0000, chain.objs.size()=1 2024-09-12T00:38:37.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.748+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.321__shadow_.Xd0hlrYk6S-1CuECakrGe9tCi-Kzs8Y_0 2024-09-12T00:38:37.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.748+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18349691514496321689', time=2024-09-12T02:31:19.355730+0000, chain.objs.size()=1 2024-09-12T00:38:37.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.748+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.gzYE2F2rZlQvunE5d-m_rMLqcqk6pkm_0 2024-09-12T00:38:37.747 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.748+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3854080172001953246', time=2024-09-12T02:31:19.497116+0000, chain.objs.size()=1 2024-09-12T00:38:37.748 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.748+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.SK_MTT0zSgA6rmtbhwJEvxaygCEWYRf_0 2024-09-12T00:38:37.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.749+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15240656055039398278', time=2024-09-12T02:31:19.649846+0000, chain.objs.size()=1 2024-09-12T00:38:37.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.749+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Av2Pfygxb90dfw6wnYUUZThfbf05nWm_0 2024-09-12T00:38:37.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.749+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9345537185044777887', time=2024-09-12T02:31:19.683153+0000, chain.objs.size()=1 2024-09-12T00:38:37.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.749+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.avXUxDoCAHPcJ5cdUWwl2_9hv3HFEnI_0 2024-09-12T00:38:37.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.749+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2025510154428572997', time=2024-09-12T02:31:19.704112+0000, chain.objs.size()=1 2024-09-12T00:38:37.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.749+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.60EzyfXTtmogL3jWkZJGXeMBWumimcO_0 2024-09-12T00:38:37.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.749+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6350200804216310138', time=2024-09-12T02:31:19.759222+0000, chain.objs.size()=1 2024-09-12T00:38:37.749 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.749+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.PAlmD2vj-TpGdEgd0SLzMyAeaamqwbS_0 2024-09-12T00:38:37.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.749+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3422030431397670010', time=2024-09-12T02:31:19.777479+0000, chain.objs.size()=1 2024-09-12T00:38:37.750 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.749+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ykidxxcxIy9MPWuL1y0ty33MfjYIOjl_0 2024-09-12T00:38:37.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.754+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11377083432814491725', time=2024-09-12T02:31:19.830170+0000, chain.objs.size()=1 2024-09-12T00:38:37.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.754+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.tJZi7sKWswaGro9uKDhoxhxVAvoYl6g_0 2024-09-12T00:38:37.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.754+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7397710205197659273', time=2024-09-12T02:31:19.861675+0000, chain.objs.size()=1 2024-09-12T00:38:37.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.754+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.kg8oog4nLWvU5hFVDSNF7mQKlH3u10p_0 2024-09-12T00:38:37.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.754+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3168040933532323251', time=2024-09-12T02:31:19.971417+0000, chain.objs.size()=1 2024-09-12T00:38:37.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.754+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.mKDRDjlh7a49u8nMQGR-Vb6F46xYpxi_0 2024-09-12T00:38:37.753 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.754+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14192948117641169293', time=2024-09-12T02:31:19.973419+0000, chain.objs.size()=1 2024-09-12T00:38:37.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.754+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.I6DGCUmoVE6l727WE1M2g4War-rEBJj_0 2024-09-12T00:38:37.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.754+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6606851458873177121', time=2024-09-12T02:31:19.976136+0000, chain.objs.size()=1 2024-09-12T00:38:37.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.754+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.5q4YPuzQX2fWlUcrNaA0f6Men8u2EAP_0 2024-09-12T00:38:37.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.754+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.359897086217289009', time=2024-09-12T02:31:19.981586+0000, chain.objs.size()=1 2024-09-12T00:38:37.754 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.754+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7uMiW9kDnlKYO0uIHwaFLaCczouIaUC_0 2024-09-12T00:38:37.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.755+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.435837656523569342', time=2024-09-12T02:31:20.008337+0000, chain.objs.size()=1 2024-09-12T00:38:37.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.755+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.SYNRepEo_TAedRmpPVMTBIsrQ6ihOsB_0 2024-09-12T00:38:37.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.755+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8396770889993620451', time=2024-09-12T02:31:20.091982+0000, chain.objs.size()=1 2024-09-12T00:38:37.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.755+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.fDyz7f4NhASF4XthTNIa3bKGK1PDveC_0 2024-09-12T00:38:37.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.755+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1852612842084022602', time=2024-09-12T02:31:20.119021+0000, chain.objs.size()=1 2024-09-12T00:38:37.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.755+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.OTMcL2P_W49waTc8r6ZPXNRToJXHmah_0 2024-09-12T00:38:37.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.756+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4261488936204401421', time=2024-09-12T02:31:20.258860+0000, chain.objs.size()=1 2024-09-12T00:38:37.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.756+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.zlznd8JvnZiaMug1ks7xKcJsYgQKVv2_0 2024-09-12T00:38:37.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.756+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6240441469789134069', time=2024-09-12T02:31:20.566874+0000, chain.objs.size()=1 2024-09-12T00:38:37.755 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.756+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.pwE-O45MJNGUr5djLqjQmghIE2BG-6j_0 2024-09-12T00:38:37.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.759+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10901407686512422830', time=2024-09-12T02:31:20.723731+0000, chain.objs.size()=1 2024-09-12T00:38:37.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.759+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.CVg5kqRtnPZOADSHsAvKW2HI8EGzQg-_0 2024-09-12T00:38:37.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.759+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10331306291598651346', time=2024-09-12T02:31:20.733473+0000, chain.objs.size()=1 2024-09-12T00:38:37.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.759+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.78gRjM5j11W5Mf4_klL-lETkht5SXsq_0 2024-09-12T00:38:37.758 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.759+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6273483433603635674', time=2024-09-12T02:31:20.876062+0000, chain.objs.size()=1 2024-09-12T00:38:37.759 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.759+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NBm0mo3ByLobiETFxD9DgNj58_UoemL_0 2024-09-12T00:38:37.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4511831044137638647', time=2024-09-12T02:31:20.955056+0000, chain.objs.size()=1 2024-09-12T00:38:37.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JggxDKKVqdbETF19Pu72yx88KWhsK7A_0 2024-09-12T00:38:37.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16481987765818054969', time=2024-09-12T02:31:21.020062+0000, chain.objs.size()=1 2024-09-12T00:38:37.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.F3HsAyac9eldL36G6Rnk_-4I2kJruDf_0 2024-09-12T00:38:37.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7587275700941769985', time=2024-09-12T02:31:21.030769+0000, chain.objs.size()=1 2024-09-12T00:38:37.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.YjbB640mhDoJdfJh0ZYlb561ICB4oYX_0 2024-09-12T00:38:37.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12193135048124777185', time=2024-09-12T02:31:21.037129+0000, chain.objs.size()=1 2024-09-12T00:38:37.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.QQWsWVisTMEUd5-04pU2-iPso3FQ_bq_0 2024-09-12T00:38:37.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4448675920576630763', time=2024-09-12T02:31:21.077702+0000, chain.objs.size()=1 2024-09-12T00:38:37.762 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.iDCX1iD2_rUnTyt8o0-Vkqxh4IitqJr_0 2024-09-12T00:38:37.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17250786275082741987', time=2024-09-12T02:31:21.163745+0000, chain.objs.size()=1 2024-09-12T00:38:37.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IDaW90NzUTbXNhnprLZbpR6qx_NtBY4_0 2024-09-12T00:38:37.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3247958977475358741', time=2024-09-12T02:31:21.220338+0000, chain.objs.size()=1 2024-09-12T00:38:37.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.RvTVe-UP5iOS3CxG71EpPlj_28Ox2uJ_0 2024-09-12T00:38:37.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11983793768320394956', time=2024-09-12T02:31:21.232719+0000, chain.objs.size()=1 2024-09-12T00:38:37.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.IwLw9JnNx9Wj1N5BmwMyCYE2awu0gno_0 2024-09-12T00:38:37.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10915709644390193390', time=2024-09-12T02:31:21.303521+0000, chain.objs.size()=1 2024-09-12T00:38:37.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7iwyBBLbA0orPuJiCBhqBGtFV25x_eu_0 2024-09-12T00:38:37.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12898077053737971548', time=2024-09-12T02:31:21.311185+0000, chain.objs.size()=1 2024-09-12T00:38:37.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.6M8k5v_tEXBANKRz2pcKLtJC02cbDo__0 2024-09-12T00:38:37.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10883835194967054701', time=2024-09-12T02:31:21.346330+0000, chain.objs.size()=1 2024-09-12T00:38:37.763 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.762+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Zr3EHSolt8OI-Lr1eQqSYmZMg2epzVk_0 2024-09-12T00:38:37.765 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.766+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15658941853201951915', time=2024-09-12T02:31:21.552845+0000, chain.objs.size()=1 2024-09-12T00:38:37.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.766+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.e_acx4sRVTzAJa2xpuapvke3DoZF6F3_0 2024-09-12T00:38:37.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12968427156374629423', time=2024-09-12T02:31:21.562496+0000, chain.objs.size()=1 2024-09-12T00:38:37.766 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.WLOBNtwq-uOX08Gy8_NjNqoW2zTxN7h_0 2024-09-12T00:38:37.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12998104379971644449', time=2024-09-12T02:31:21.571672+0000, chain.objs.size()=1 2024-09-12T00:38:37.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Mr5urM_7g5Sq9KM60ytmB2RxwUo2tyw_0 2024-09-12T00:38:37.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17672246867047680741', time=2024-09-12T02:31:21.579915+0000, chain.objs.size()=1 2024-09-12T00:38:37.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.pSxTLoQGqYIvcM8-seeCTMAL7rnz8I-_0 2024-09-12T00:38:37.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.278206035835132735', time=2024-09-12T02:31:21.601587+0000, chain.objs.size()=1 2024-09-12T00:38:37.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.r5JXzHdff8udhSaNUVWyD_SdK5YxyGu_0 2024-09-12T00:38:37.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4937440398670498357', time=2024-09-12T02:31:29.701222+0000, chain.objs.size()=1 2024-09-12T00:38:37.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.SJ3D4XqYEo5HglYn5iiMDGVLdHhJoMh_0 2024-09-12T00:38:37.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9697816013404578828', time=2024-09-12T02:31:29.743284+0000, chain.objs.size()=1 2024-09-12T00:38:37.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ebGs1VpiQEs8fmdS0ZSQURAZg7On-Vh_0 2024-09-12T00:38:37.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14241421433444229559', time=2024-09-12T02:31:29.780330+0000, chain.objs.size()=1 2024-09-12T00:38:37.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.v4GsgKBcbunDnIb_P-xURPecbKyxMnK_0 2024-09-12T00:38:37.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16283302907252224706', time=2024-09-12T02:31:29.790133+0000, chain.objs.size()=1 2024-09-12T00:38:37.767 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.767+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Vzq3tAHC5juAZKCn7K3xos3qFetRxI8_0 2024-09-12T00:38:37.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.769+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1311721943756296583', time=2024-09-12T02:31:29.809434+0000, chain.objs.size()=1 2024-09-12T00:38:37.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.769+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.HsEhaf8sgefVr6cYFXJajRnXD6mbHzs_0 2024-09-12T00:38:37.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.769+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1754114265587912653', time=2024-09-12T02:31:29.999576+0000, chain.objs.size()=1 2024-09-12T00:38:37.768 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.769+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.v4Z_KJ5NZy138cC_q1pMBVBm1yRAimC_0 2024-09-12T00:38:37.769 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.770+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5095658875397744892', time=2024-09-12T02:31:30.001124+0000, chain.objs.size()=1 2024-09-12T00:38:37.770 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.770+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.VK2otY6fGIBA815TzWc7JjBfUtjzVuM_0 2024-09-12T00:38:37.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.772+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3899166351305336208', time=2024-09-12T02:31:30.072639+0000, chain.objs.size()=1 2024-09-12T00:38:37.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.772+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.pJXQADonvVVCjCyqvSuPplanqJegAgW_0 2024-09-12T00:38:37.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.772+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11871140032782480621', time=2024-09-12T02:31:30.083074+0000, chain.objs.size()=1 2024-09-12T00:38:37.771 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.772+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Msr6lZK_3CfLV7ayCku1AsjLiOUnLOI_0 2024-09-12T00:38:37.774 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2473100292799467746', time=2024-09-12T02:31:30.293595+0000, chain.objs.size()=1 2024-09-12T00:38:37.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Orf6t0boFSdfVqYO-OudIXL_xvZSN-G_0 2024-09-12T00:38:37.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.759676447034898046', time=2024-09-12T02:31:30.455051+0000, chain.objs.size()=1 2024-09-12T00:38:37.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.21x9ljGj1pNls4ldBjM55pS__hdZoZS_0 2024-09-12T00:38:37.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8169478686114025627', time=2024-09-12T02:31:30.458490+0000, chain.objs.size()=1 2024-09-12T00:38:37.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.u7Rr45T9rFAKfhog4NZSZ-9wv71dmpy_0 2024-09-12T00:38:37.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9672611038958721959', time=2024-09-12T02:31:30.599118+0000, chain.objs.size()=1 2024-09-12T00:38:37.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.9dN3BqHiidlsTbZ8Y1s7Y5sp-c7ApIS_0 2024-09-12T00:38:37.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9072563287101130064', time=2024-09-12T02:31:30.630180+0000, chain.objs.size()=1 2024-09-12T00:38:37.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.h8JFVc4ipukGuZwOQxQ5OkEf3rS83iW_0 2024-09-12T00:38:37.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14839416812676253546', time=2024-09-12T02:31:30.716627+0000, chain.objs.size()=1 2024-09-12T00:38:37.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.vKtVz1sCpg_hFuMS42N36RgB7nRQdR2_0 2024-09-12T00:38:37.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11180346692169720772', time=2024-09-12T02:31:30.991638+0000, chain.objs.size()=1 2024-09-12T00:38:37.775 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.RBHnPfEWMwv9GuhW7qhdF-yO_EQsZpm_0 2024-09-12T00:38:37.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9158403982673876670', time=2024-09-12T02:31:31.000309+0000, chain.objs.size()=1 2024-09-12T00:38:37.776 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.775+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.hbiOe6khgKrVp-sMKTBNGiU6uTiyuwy_0 2024-09-12T00:38:37.779 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.780+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/51076 2024-09-12T00:38:37.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.782+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-09-12T00:38:37.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.782+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11929951935462031141', time=2024-09-12T02:31:31.013599+0000, chain.objs.size()=1 2024-09-12T00:38:37.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.782+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.amZkUEyeBpxgLoImDTLrPjwOaP6moit_0 2024-09-12T00:38:37.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.782+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18416713764530790972', time=2024-09-12T02:31:31.180414+0000, chain.objs.size()=1 2024-09-12T00:38:37.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.782+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.uHOjxIdORAJu7o3ud9E099_vZOKotDI_0 2024-09-12T00:38:37.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.782+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4565228267092164736', time=2024-09-12T02:31:31.428624+0000, chain.objs.size()=1 2024-09-12T00:38:37.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.782+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.fQxt2nx5nAvbe5SWOh3f9kE2QL6UOuV_0 2024-09-12T00:38:37.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11331059139413169825', time=2024-09-12T02:31:31.437597+0000, chain.objs.size()=1 2024-09-12T00:38:37.782 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.OcccU-RZkhFy65BZO6z1Gv7K0Ie6Ygr_0 2024-09-12T00:38:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8324041395509895476', time=2024-09-12T02:31:31.444152+0000, chain.objs.size()=1 2024-09-12T00:38:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.RIGzyCHer53Q54Wjkb9YiqYm0sKJFJJ_0 2024-09-12T00:38:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1085882839615806880', time=2024-09-12T02:31:31.515715+0000, chain.objs.size()=1 2024-09-12T00:38:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.JE1Cy3nWpMiJQqLdVRxlyjoDSn3VZ44_0 2024-09-12T00:38:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7121779285030080511', time=2024-09-12T02:31:31.576341+0000, chain.objs.size()=1 2024-09-12T00:38:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.amKxKGUGVNqLe5tk9YZX5E-r_upuise_0 2024-09-12T00:38:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11089172043561478458', time=2024-09-12T02:31:31.713347+0000, chain.objs.size()=1 2024-09-12T00:38:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.E3TmPttI9l16UXI5x8k7rKmxY-N5oXi_0 2024-09-12T00:38:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8406462200906022010', time=2024-09-12T02:31:31.716938+0000, chain.objs.size()=1 2024-09-12T00:38:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.5BLXyr1pVC0XNo-LZ0oCyDcEWSV9rmy_0 2024-09-12T00:38:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5991691647541895865', time=2024-09-12T02:31:31.752906+0000, chain.objs.size()=1 2024-09-12T00:38:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.IhIZ0Q-5x84vvnF3DtQLKulovbHdvZ2_0 2024-09-12T00:38:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11392237903274644190', time=2024-09-12T02:31:31.764432+0000, chain.objs.size()=1 2024-09-12T00:38:37.783 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.OOhUlCCwV_7ErlCxQta9tuUASx0X6eP_0 2024-09-12T00:38:37.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1074988406607031212', time=2024-09-12T02:31:31.805010+0000, chain.objs.size()=1 2024-09-12T00:38:37.784 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.783+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.O45Nq_RSOoaupZPSmm-6jF8tDammPlL_0 2024-09-12T00:38:37.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.786+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3854525602250947212', time=2024-09-12T02:31:58.785838+0000, chain.objs.size()=1 2024-09-12T00:38:37.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.786+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.431__shadow_.5L1k_fRaSSa5iTsTBwGfUoAOkwyhrZp_0 2024-09-12T00:38:37.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.786+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14961495947030460362', time=2024-09-12T02:32:06.918201+0000, chain.objs.size()=1 2024-09-12T00:38:37.785 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.786+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.459__shadow_.XGqxxjBRUu8gwyzO3Y1gjezCvQX5Mz__0 2024-09-12T00:38:37.787 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15034297788656946454', time=2024-09-12T02:32:08.460699+0000, chain.objs.size()=1 2024-09-12T00:38:37.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.463__shadow_.yykHA2ZOMGKQ1lxs-Hq17Il5RDqUK6R_0 2024-09-12T00:38:37.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3680499370393192023', time=2024-09-12T02:32:08.811853+0000, chain.objs.size()=1 2024-09-12T00:38:37.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.464__shadow_.L_bQ7c6_Fg1NO4SlfXHvO7_wBvjNN5R_0 2024-09-12T00:38:37.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16845227417163136073', time=2024-09-12T02:32:09.033111+0000, chain.objs.size()=1 2024-09-12T00:38:37.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.465__shadow_.Q8DqJ6ZUYd1FaTcKqLcQVGh2ff9pbWG_0 2024-09-12T00:38:37.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3515249116034704879', time=2024-09-12T02:32:12.595221+0000, chain.objs.size()=1 2024-09-12T00:38:37.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.483__shadow_.cP9FKY3JAm9cuIormYS9saVwMs-_o4d_0 2024-09-12T00:38:37.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12800144274891246215', time=2024-09-12T02:32:14.204727+0000, chain.objs.size()=1 2024-09-12T00:38:37.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.488__shadow_._TISH4lPLRnXG_gGMBCOstZFnU21iRz_0 2024-09-12T00:38:37.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14275224518664334748', time=2024-09-12T02:32:16.608497+0000, chain.objs.size()=1 2024-09-12T00:38:37.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.498__shadow_._A3xJino1fme0_y4gZPpPfrVcXijYa-_0 2024-09-12T00:38:37.788 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9638772309526097876', time=2024-09-12T02:32:20.451407+0000, chain.objs.size()=1 2024-09-12T00:38:37.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.511__multipart_mymultipart.2~UlD-E7G32nTuG1LO4F_vpFsee-Ihxm7.1 2024-09-12T00:38:37.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~dr5v0lM46zosv_JRx9GptmktCDpxmvF', time=2024-09-12T02:32:30.672281+0000, chain.objs.size()=1 2024-09-12T00:38:37.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.788+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~dr5v0lM46zosv_JRx9GptmktCDpxmvF.1 2024-09-12T00:38:37.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.789+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~dr5v0lM46zosv_JRx9GptmktCDpxmvF', time=2024-09-12T02:32:30.673648+0000, chain.objs.size()=1 2024-09-12T00:38:37.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.789+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~dr5v0lM46zosv_JRx9GptmktCDpxmvF.2 2024-09-12T00:38:37.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.790+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~dr5v0lM46zosv_JRx9GptmktCDpxmvF', time=2024-09-12T02:32:30.674788+0000, chain.objs.size()=1 2024-09-12T00:38:37.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.790+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~dr5v0lM46zosv_JRx9GptmktCDpxmvF.3 2024-09-12T00:38:37.789 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.790+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~dr5v0lM46zosv_JRx9GptmktCDpxmvF', time=2024-09-12T02:32:30.676038+0000, chain.objs.size()=1 2024-09-12T00:38:37.790 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.790+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~dr5v0lM46zosv_JRx9GptmktCDpxmvF.4 2024-09-12T00:38:37.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.792+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~dr5v0lM46zosv_JRx9GptmktCDpxmvF', time=2024-09-12T02:32:30.677253+0000, chain.objs.size()=1 2024-09-12T00:38:37.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.792+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~dr5v0lM46zosv_JRx9GptmktCDpxmvF.5 2024-09-12T00:38:37.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.793+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~dr5v0lM46zosv_JRx9GptmktCDpxmvF', time=2024-09-12T02:32:30.678870+0000, chain.objs.size()=1 2024-09-12T00:38:37.792 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.793+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~dr5v0lM46zosv_JRx9GptmktCDpxmvF.6 2024-09-12T00:38:37.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.794+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.280459375848110094', time=2024-09-12T02:32:33.259135+0000, chain.objs.size()=2 2024-09-12T00:38:37.793 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.794+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.525__multipart_mymultipart.2~fkiLqXMSkTBDgt7G3tb9ucqldCYvivw.1 2024-09-12T00:38:37.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.794+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.525__multipart_mymultipart.2~fkiLqXMSkTBDgt7G3tb9ucqldCYvivw.2 2024-09-12T00:38:37.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.794+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15690819519580769198', time=2024-09-12T02:32:33.505982+0000, chain.objs.size()=3 2024-09-12T00:38:37.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.794+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.525__multipart_mymultipart.2~KT9AGXKSa7yQj8-WLrM0BEw2pkh2Q2I.1 2024-09-12T00:38:37.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.794+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.525__multipart_mymultipart.2~KT9AGXKSa7yQj8-WLrM0BEw2pkh2Q2I.2 2024-09-12T00:38:37.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.794+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.525__multipart_mymultipart.2~KT9AGXKSa7yQj8-WLrM0BEw2pkh2Q2I.3 2024-09-12T00:38:37.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.794+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4687965002592638272', time=2024-09-12T02:33:33.698047+0000, chain.objs.size()=1 2024-09-12T00:38:37.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.794+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:Dho1WKyzX.dEWCtPauFKjIYh04aNqV7_.V1VtvBiXLqqj0j8A_oHU315XhWZQKzQ_0 2024-09-12T00:38:37.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.794+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.610941396733684505', time=2024-09-12T02:33:46.833710+0000, chain.objs.size()=1 2024-09-12T00:38:37.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.794+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.580__shadow:HooGfH8hx1SEa6IzJ2l8zy9gAlHTY11_.Rc7A8GkqIgP-0yDu_GRWjWs8GRPsKQJ_0 2024-09-12T00:38:37.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.794+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15762255310399012524', time=2024-09-12T02:33:51.111389+0000, chain.objs.size()=1 2024-09-12T00:38:37.794 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.794+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.596__shadow_.6QnW6aGiZKhw2EIfwlGENG2XmVzhFM-_0 2024-09-12T00:38:37.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.795+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2951824495452254962', time=2024-09-12T02:33:57.510487+0000, chain.objs.size()=6 2024-09-12T00:38:37.795 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.795+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.614__multipart_multipart_enc.2~ajzyQz1QEp2vzGAWL7-37_bIiz6tzoY.1 2024-09-12T00:38:37.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.798+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.614__multipart_multipart_enc.2~ajzyQz1QEp2vzGAWL7-37_bIiz6tzoY.2 2024-09-12T00:38:37.797 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.798+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.614__multipart_multipart_enc.2~ajzyQz1QEp2vzGAWL7-37_bIiz6tzoY.3 2024-09-12T00:38:37.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.801+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.614__multipart_multipart_enc.2~ajzyQz1QEp2vzGAWL7-37_bIiz6tzoY.4 2024-09-12T00:38:37.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.801+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.614__multipart_multipart_enc.2~ajzyQz1QEp2vzGAWL7-37_bIiz6tzoY.5 2024-09-12T00:38:37.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.801+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.614__multipart_multipart_enc.2~ajzyQz1QEp2vzGAWL7-37_bIiz6tzoY.6 2024-09-12T00:38:37.801 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.801+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12640860852689272950', time=2024-09-12T02:33:58.550576+0000, chain.objs.size()=1 2024-09-12T00:38:37.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.801+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.616__shadow_.qw68xrI8FEkaSVdaz1PtA1LaUlSvNvB_0 2024-09-12T00:38:37.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.801+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~tcvrQ4nYC1Hx5V5kBJ0482fX0gyR4nz', time=2024-09-12T02:36:03.245563+0000, chain.objs.size()=6 2024-09-12T00:38:37.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.801+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.624__multipart_multipart_enc.2~tcvrQ4nYC1Hx5V5kBJ0482fX0gyR4nz.1 2024-09-12T00:38:37.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.801+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.624__multipart_multipart_enc.2~tcvrQ4nYC1Hx5V5kBJ0482fX0gyR4nz.2 2024-09-12T00:38:37.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.802+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.624__multipart_multipart_enc.2~tcvrQ4nYC1Hx5V5kBJ0482fX0gyR4nz.3 2024-09-12T00:38:37.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.802+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.624__multipart_multipart_enc.2~tcvrQ4nYC1Hx5V5kBJ0482fX0gyR4nz.4 2024-09-12T00:38:37.802 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.802+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.624__multipart_multipart_enc.2~tcvrQ4nYC1Hx5V5kBJ0482fX0gyR4nz.5 2024-09-12T00:38:37.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.803+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.624__multipart_multipart_enc.2~tcvrQ4nYC1Hx5V5kBJ0482fX0gyR4nz.6 2024-09-12T00:38:37.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.803+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14251761609471055033', time=2024-09-12T02:36:22.874008+0000, chain.objs.size()=1 2024-09-12T00:38:37.803 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.803+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.692__shadow:Q7DW9dAAGw2tBZvvWzFFHpqnHE7sAm8_.JovyVu2uEdm2rEc-AQHTcqjUEvyrJWF_0 2024-09-12T00:38:37.811 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.812+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:37.813 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.814+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:38:37.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.816+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:37.815 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.816+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:37.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.817+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43947' 2024-09-12T00:38:37.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.817+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17679204697648305942', time=2024-09-12T02:29:26.989348+0000, chain.objs.size()=3 2024-09-12T00:38:37.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.817+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__multipart_foo-FROZEN.2~vqqiofIL0rNDSHVmob66UtZQurRTw3B.1 2024-09-12T00:38:37.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.817+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__multipart_foo-FROZEN.2~vqqiofIL0rNDSHVmob66UtZQurRTw3B.2 2024-09-12T00:38:37.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.817+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.161__multipart_foo-FROZEN.2~vqqiofIL0rNDSHVmob66UtZQurRTw3B.3 2024-09-12T00:38:37.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.817+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2441068382200596932', time=2024-09-12T02:29:38.290979+0000, chain.objs.size()=1 2024-09-12T00:38:37.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.817+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.183__shadow_.LF-LOXN1osLoSijFo7CTU-AetwGDhP5_0 2024-09-12T00:38:37.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16761667148026563709', time=2024-09-12T02:30:38.809472+0000, chain.objs.size()=1 2024-09-12T00:38:37.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.236__shadow_.WGpLdYBfuBjKO0td8ARtAeH2KepJiGg_0 2024-09-12T00:38:37.817 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4510998404524448804', time=2024-09-12T02:30:39.394539+0000, chain.objs.size()=1 2024-09-12T00:38:37.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.238__shadow_.4qFHJQ5bPgbT03om3sPNDktLNgnXdFV_0 2024-09-12T00:38:37.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5056334549332653765', time=2024-09-12T02:30:42.163658+0000, chain.objs.size()=1 2024-09-12T00:38:37.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.249__shadow_.cAMhJOWuYpoRJ3pFavNKPtB6t769SOF_0 2024-09-12T00:38:37.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.926133102722951030', time=2024-09-12T02:30:43.644245+0000, chain.objs.size()=1 2024-09-12T00:38:37.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.255__shadow_.jSBSor5RYEuInRkfmngy7YenHihHgwD_0 2024-09-12T00:38:37.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13152096425482103184', time=2024-09-12T02:30:44.587106+0000, chain.objs.size()=1 2024-09-12T00:38:37.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.259__shadow_.4hQtU2l07wUD6yKPkwlaexB2gZDBz9__0 2024-09-12T00:38:37.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13613368510432447892', time=2024-09-12T02:30:53.184983+0000, chain.objs.size()=1 2024-09-12T00:38:37.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JQo1A5QD9boSXI7bRQd71S9efocO2WW_0 2024-09-12T00:38:37.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9545684667514222326', time=2024-09-12T02:30:53.238158+0000, chain.objs.size()=1 2024-09-12T00:38:37.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.B5idsx0NperxGtRQrlCrOtJg96SH8MK_0 2024-09-12T00:38:37.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17499598705558203759', time=2024-09-12T02:30:53.254156+0000, chain.objs.size()=1 2024-09-12T00:38:37.818 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.818+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.bmwIN385l8LHeSLopcmNVKp7VCawrVD_0 2024-09-12T00:38:37.820 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.821+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4261214094801408769', time=2024-09-12T02:30:53.282131+0000, chain.objs.size()=1 2024-09-12T00:38:37.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.821+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.FnSgdVRDEF6M-5g_nYsFcOukbPPFPiz_0 2024-09-12T00:38:37.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.821+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11386466341186821148', time=2024-09-12T02:30:53.399247+0000, chain.objs.size()=1 2024-09-12T00:38:37.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.821+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.jAOlhtgtDaiFLwBQErjwkqEbzai7WXF_0 2024-09-12T00:38:37.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.821+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11539231130990831766', time=2024-09-12T02:30:53.417450+0000, chain.objs.size()=1 2024-09-12T00:38:37.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.821+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.wmcdRwMbmJgryyHsSe-lMIQ54jFvOTB_0 2024-09-12T00:38:37.821 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1930894179294222377', time=2024-09-12T02:30:53.429506+0000, chain.objs.size()=1 2024-09-12T00:38:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.zOBlwSyhuM_yQko4PPMphHF1Vazh2-H_0 2024-09-12T00:38:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17385650611367169610', time=2024-09-12T02:30:53.438697+0000, chain.objs.size()=1 2024-09-12T00:38:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.IVVFDqAzA-IRQZRgXxbKSHQ6W26Tztf_0 2024-09-12T00:38:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4368647434980298389', time=2024-09-12T02:30:53.534395+0000, chain.objs.size()=1 2024-09-12T00:38:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.G7KA3aY-lRTXLjWjGLDcsLXP-WsqCdL_0 2024-09-12T00:38:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12936565984946791633', time=2024-09-12T02:30:53.543220+0000, chain.objs.size()=1 2024-09-12T00:38:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.annIqHmOejKaeFIqj7Nhno3Mng9RnKN_0 2024-09-12T00:38:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13790164171759562659', time=2024-09-12T02:30:53.548732+0000, chain.objs.size()=1 2024-09-12T00:38:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.9KUUslcRA7QwQQ6xlcRtL1E6WfCDTcN_0 2024-09-12T00:38:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9317789222167344378', time=2024-09-12T02:30:53.583930+0000, chain.objs.size()=1 2024-09-12T00:38:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.0QNPW-8EbrxY641vEKqSkaC5IA_jEbw_0 2024-09-12T00:38:37.822 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1363656437579686299', time=2024-09-12T02:30:53.708688+0000, chain.objs.size()=1 2024-09-12T00:38:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2wGM-rNpvgYCcbQ9wXdoCJbxaIFIXyl_0 2024-09-12T00:38:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2752008325057715263', time=2024-09-12T02:30:53.726894+0000, chain.objs.size()=1 2024-09-12T00:38:37.823 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.822+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.O4MxVIh5F7yZjWNqYCEzZgA3COFxUIE_0 2024-09-12T00:38:37.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.825+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14119001744173168291', time=2024-09-12T02:30:53.728467+0000, chain.objs.size()=1 2024-09-12T00:38:37.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.825+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.19kIXebsrnB6Kfx8ECAM7xbWkLU2cRi_0 2024-09-12T00:38:37.824 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.825+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9539736537939136818', time=2024-09-12T02:30:53.749576+0000, chain.objs.size()=1 2024-09-12T00:38:37.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.825+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Ob2GG6oLpAxOUKJtqNujWz3z_n7uX6I_0 2024-09-12T00:38:37.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.825+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1241644687494710523', time=2024-09-12T02:30:53.801450+0000, chain.objs.size()=1 2024-09-12T00:38:37.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.825+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.1XWuJpRV-q5q6NSSJdbiXhdq6IstIGD_0 2024-09-12T00:38:37.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.826+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.421968164434541181', time=2024-09-12T02:30:53.805245+0000, chain.objs.size()=1 2024-09-12T00:38:37.825 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.826+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.vLDmcdSFH_0M90FrngxGQffgpbXGwzv_0 2024-09-12T00:38:37.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.827+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14436394977431965838', time=2024-09-12T02:30:53.830042+0000, chain.objs.size()=1 2024-09-12T00:38:37.826 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.827+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2x0WgxsyoQG8SqNITzObXjaw9UTd8LW_0 2024-09-12T00:38:37.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.828+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12856599100400953564', time=2024-09-12T02:30:54.167282+0000, chain.objs.size()=1 2024-09-12T00:38:37.827 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.828+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.p8pfbchCYKf9V0FZiV3e9StwupGKQCv_0 2024-09-12T00:38:37.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.828+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13408487649199228243', time=2024-09-12T02:30:54.249230+0000, chain.objs.size()=1 2024-09-12T00:38:37.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.828+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.fccZodNPd97CL4zkY30e49QfaGxCecT_0 2024-09-12T00:38:37.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.828+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11290042533598486637', time=2024-09-12T02:30:54.275883+0000, chain.objs.size()=1 2024-09-12T00:38:37.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.828+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YrhkaOzFCd0HY7TuhhBAAGWxTGyy45-_0 2024-09-12T00:38:37.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.828+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.499531811288298844', time=2024-09-12T02:30:54.285507+0000, chain.objs.size()=1 2024-09-12T00:38:37.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.828+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.12x4-n_K302J67jFY58dgEn3PFYgDYg_0 2024-09-12T00:38:37.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.828+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5116311741593097893', time=2024-09-12T02:30:54.363086+0000, chain.objs.size()=1 2024-09-12T00:38:37.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.828+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.RP4vM9trDeRw4GS0a7pCwUdbdz1t76Z_0 2024-09-12T00:38:37.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.828+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2730414353296292295', time=2024-09-12T02:30:54.385648+0000, chain.objs.size()=1 2024-09-12T00:38:37.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.828+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.scadDh2sKxHXrOVzQLntb9XZS_XhJM0_0 2024-09-12T00:38:37.828 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.828+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8127542842730385371', time=2024-09-12T02:30:54.572588+0000, chain.objs.size()=1 2024-09-12T00:38:37.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.829+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.J385-fi1S9xnss6jW-mVKB3sOeStmN3_0 2024-09-12T00:38:37.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.829+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3488486280335127384', time=2024-09-12T02:30:54.586134+0000, chain.objs.size()=1 2024-09-12T00:38:37.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.829+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.7D1ZlyaKngc7FPYqcM6YQM_IL7UscKr_0 2024-09-12T00:38:37.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.829+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17920867944495261142', time=2024-09-12T02:30:54.600409+0000, chain.objs.size()=1 2024-09-12T00:38:37.829 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.829+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.9Fbcy6PLZLmNylRCfL2oCmis5kiM8nu_0 2024-09-12T00:38:37.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.831+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8590282110727789168', time=2024-09-12T02:30:54.667750+0000, chain.objs.size()=1 2024-09-12T00:38:37.830 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.831+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.gvkcUQEQyG-k07y-QP4j0yOx6O0Zi4l_0 2024-09-12T00:38:37.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.832+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8629797141275624860', time=2024-09-12T02:30:54.819455+0000, chain.objs.size()=1 2024-09-12T00:38:37.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.832+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.cqDNXRwymoCNBaxmBlBWM3igd_5VMJs_0 2024-09-12T00:38:37.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5901928297576457833', time=2024-09-12T02:30:54.829815+0000, chain.objs.size()=1 2024-09-12T00:38:37.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.20Cbw7TjUX6e9ofE5B5TrpZ11LlhvKE_0 2024-09-12T00:38:37.832 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9456534933590755861', time=2024-09-12T02:30:54.889432+0000, chain.objs.size()=1 2024-09-12T00:38:37.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Ex8GEsXVUWMsx76xJJ5ww64FdDqfqsG_0 2024-09-12T00:38:37.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18286280752481388685', time=2024-09-12T02:30:55.088474+0000, chain.objs.size()=1 2024-09-12T00:38:37.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.GoQuMhxc2nuAChq4Z232bSVBJ6YxLsc_0 2024-09-12T00:38:37.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9895324050312082873', time=2024-09-12T02:30:55.115065+0000, chain.objs.size()=1 2024-09-12T00:38:37.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lsJeffhLqF9_0zY0lGg5b3WHcIWM3Uo_0 2024-09-12T00:38:37.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15203671226705442064', time=2024-09-12T02:30:55.134712+0000, chain.objs.size()=1 2024-09-12T00:38:37.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.bTqIfF5Jcbor0q-UWnf0CrAsUTxXol3_0 2024-09-12T00:38:37.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.833+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15288125380020623378', time=2024-09-12T02:30:55.176919+0000, chain.objs.size()=1 2024-09-12T00:38:37.833 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.833+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.8Mvy5f4nBVtW8Cmgk9zml3vNKsTyaFt_0 2024-09-12T00:38:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.836+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3957825616095188847', time=2024-09-12T02:30:55.223506+0000, chain.objs.size()=1 2024-09-12T00:38:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.836+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.gBKsheNKOxYkmdiJgPgn0ZPyIjj2XmU_0 2024-09-12T00:38:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.836+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18025901371312754794', time=2024-09-12T02:30:55.227765+0000, chain.objs.size()=1 2024-09-12T00:38:37.835 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.836+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.TXMFb0ewUd5cdMxGy3OTmX5a9ydsoBl_0 2024-09-12T00:38:37.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.836+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6923945062131236231', time=2024-09-12T02:30:59.587853+0000, chain.objs.size()=1 2024-09-12T00:38:37.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.836+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.280__shadow_._dkKijFAdOB7ZCas5wzBE5QnW_Il3fo_0 2024-09-12T00:38:37.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.836+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15205302339199614520', time=2024-09-12T02:31:03.082364+0000, chain.objs.size()=1 2024-09-12T00:38:37.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.836+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.X1-HsARN9JL9FadTDpBUsShy41gUC7K_0 2024-09-12T00:38:37.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.837+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11264718600512536286', time=2024-09-12T02:31:04.129339+0000, chain.objs.size()=1 2024-09-12T00:38:37.836 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.837+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.295__shadow_.jm_H8zh8yRntjnmddwW2FDUiPTXe5BS_0 2024-09-12T00:38:37.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.840+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16763104205937301726', time=2024-09-12T02:31:19.345160+0000, chain.objs.size()=1 2024-09-12T00:38:37.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.840+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.R1Q83m1_eJDzJFpFCjm87K7sG826Rla_0 2024-09-12T00:38:37.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.840+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.519372119147181199', time=2024-09-12T02:31:19.520589+0000, chain.objs.size()=1 2024-09-12T00:38:37.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.840+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.9MWPheumuruNKI9Q6Pi650FXF0N2Psd_0 2024-09-12T00:38:37.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.840+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11950822435795809327', time=2024-09-12T02:31:19.667704+0000, chain.objs.size()=1 2024-09-12T00:38:37.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.840+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.86MCXIjvZAR3fLKMM-OQP0eyWn7sKip_0 2024-09-12T00:38:37.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.840+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10644432452194571262', time=2024-09-12T02:31:19.763732+0000, chain.objs.size()=1 2024-09-12T00:38:37.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.840+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.5AiRHfIlWukfAnmpJ0Sysjf6XsWaFAZ_0 2024-09-12T00:38:37.840 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.840+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16487015388651398880', time=2024-09-12T02:31:19.987762+0000, chain.objs.size()=1 2024-09-12T00:38:37.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.840+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.2CqF1AG6f_hpekcpSRH8N4E9sjcEY4r_0 2024-09-12T00:38:37.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.840+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15549218680534903913', time=2024-09-12T02:31:19.990009+0000, chain.objs.size()=1 2024-09-12T00:38:37.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.840+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.wFyTMN0aFtSQlXTJEVsqQSkXt0_b_J-_0 2024-09-12T00:38:37.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.841+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4247293947471695244', time=2024-09-12T02:31:20.015714+0000, chain.objs.size()=1 2024-09-12T00:38:37.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.841+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.bGne-iKIen9pXbZsw_TVYHC-zwEO0w__0 2024-09-12T00:38:37.841 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.841+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15981571431305621802', time=2024-09-12T02:31:20.101848+0000, chain.objs.size()=1 2024-09-12T00:38:37.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.841+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.H9r1QNSeEdGaZ52Fth3EjGhA0nyaByf_0 2024-09-12T00:38:37.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.842+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4014929557976856306', time=2024-09-12T02:31:20.108671+0000, chain.objs.size()=1 2024-09-12T00:38:37.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.842+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.-_3nq2MQlmzkiODN3wAuLKMgaoSoI--_0 2024-09-12T00:38:37.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.842+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7513393451837312369', time=2024-09-12T02:31:20.164881+0000, chain.objs.size()=1 2024-09-12T00:38:37.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.842+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_._2SjBO98--XMw8KJ-uLou2man_Utz4M_0 2024-09-12T00:38:37.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.842+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6394807051528421236', time=2024-09-12T02:31:20.170281+0000, chain.objs.size()=1 2024-09-12T00:38:37.842 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.842+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.3CcsN05tIKByyIfjwjrS49tJNQx5ByM_0 2024-09-12T00:38:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.847+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3281924306354688080', time=2024-09-12T02:31:20.297499+0000, chain.objs.size()=1 2024-09-12T00:38:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.847+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.4l5dO7CeFvHhOTbShQb-Ddylqdf7UEa_0 2024-09-12T00:38:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.847+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.496224630525470830', time=2024-09-12T02:31:20.399498+0000, chain.objs.size()=1 2024-09-12T00:38:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.847+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.8iOdLyHyfW14dP31FRBj7lx4m30vPxY_0 2024-09-12T00:38:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.847+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5731367465724905886', time=2024-09-12T02:31:20.410666+0000, chain.objs.size()=1 2024-09-12T00:38:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.847+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ZsYS1yovQWiIEguESF_aH31AkqiKdSJ_0 2024-09-12T00:38:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.847+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12020312851051071824', time=2024-09-12T02:31:20.598791+0000, chain.objs.size()=1 2024-09-12T00:38:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.847+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.e7w61OO2VN278lCip_9ALGCfSNnlhig_0 2024-09-12T00:38:37.846 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.847+0000 7f10d1d48640 0 -- 172.21.15.67:0/1227616915 >> [v2:172.21.15.67:6816/1829992128,v1:172.21.15.67:6817/1829992128] conn(0x7f0f9c0903b0 msgr2=0x7f0f9c0927a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:37.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.847+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17572671810851927805', time=2024-09-12T02:31:20.668593+0000, chain.objs.size()=1 2024-09-12T00:38:37.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.847+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.pYZ3LKfZQc58h8pejJWZkafC69lhuiV_0 2024-09-12T00:38:37.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.847+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15471375422679647485', time=2024-09-12T02:31:20.728068+0000, chain.objs.size()=1 2024-09-12T00:38:37.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.847+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.SKT5eFULmxGCqg9TCFzkIn4l6ZRJ57c_0 2024-09-12T00:38:37.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.847+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10412594069313223303', time=2024-09-12T02:31:20.905638+0000, chain.objs.size()=1 2024-09-12T00:38:37.847 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.847+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.YqAiAVl2UeVQ5iPPmNyK2ftnpXfRkw7_0 2024-09-12T00:38:37.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.851+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12912243107049557197', time=2024-09-12T02:31:20.923785+0000, chain.objs.size()=1 2024-09-12T00:38:37.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.851+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.gxtOjXtEGZf0JgVaBc35xv6c6C9oAjg_0 2024-09-12T00:38:37.850 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.851+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6819385764758790437', time=2024-09-12T02:31:20.981563+0000, chain.objs.size()=1 2024-09-12T00:38:37.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.851+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.yeUX_0TAXKrzL-ExkDPGOt7HTSC4Iye_0 2024-09-12T00:38:37.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.851+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1435668407064520849', time=2024-09-12T02:31:21.001439+0000, chain.objs.size()=1 2024-09-12T00:38:37.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.851+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JU6LZ-X5XT4SDkTziN6igJ29R9kaBqU_0 2024-09-12T00:38:37.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.851+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.363900065716941253', time=2024-09-12T02:31:21.014639+0000, chain.objs.size()=1 2024-09-12T00:38:37.851 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.851+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.BpzwLvNrhsCRa9uGw9wz9p5Lu1w9mMt_0 2024-09-12T00:38:37.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.853+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18209211756587007748', time=2024-09-12T02:31:21.026030+0000, chain.objs.size()=1 2024-09-12T00:38:37.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.853+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ki0dMhTjW2h_cdDK7znxeaDgzx2Ftf-_0 2024-09-12T00:38:37.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.853+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12797709846902569631', time=2024-09-12T02:31:21.059870+0000, chain.objs.size()=1 2024-09-12T00:38:37.853 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.853+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.1CX7fA-L4kSYn7YVJitos4hqnqBMz3G_0 2024-09-12T00:38:37.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4371612413693424500', time=2024-09-12T02:31:21.167086+0000, chain.objs.size()=1 2024-09-12T00:38:37.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.GZQeZ1GcQ_XsdqfHQfKWdfoV0AMzHW9_0 2024-09-12T00:38:37.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16504311642918479907', time=2024-09-12T02:31:21.201053+0000, chain.objs.size()=1 2024-09-12T00:38:37.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.9wBTKQSTUYylio32aK9qj0r98xL7qH0_0 2024-09-12T00:38:37.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2671194382580645909', time=2024-09-12T02:31:21.281908+0000, chain.objs.size()=1 2024-09-12T00:38:37.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.8Er6pqO5kQ8jRsBYzAnOPr8009uyI44_0 2024-09-12T00:38:37.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3118441343936599481', time=2024-09-12T02:31:21.297062+0000, chain.objs.size()=1 2024-09-12T00:38:37.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.LrF7DJC7xLZNoTnYh515msVY9Qru0cK_0 2024-09-12T00:38:37.855 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1864667161562535324', time=2024-09-12T02:31:21.355629+0000, chain.objs.size()=1 2024-09-12T00:38:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.FNMoldOKfHDT1LrvPyn7NVKrbYtkufw_0 2024-09-12T00:38:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7155177770427304623', time=2024-09-12T02:31:21.514603+0000, chain.objs.size()=1 2024-09-12T00:38:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.EjJQk6dB7w43_jyuyGpY0t2T7wKfX7K_0 2024-09-12T00:38:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3192354723207640591', time=2024-09-12T02:31:21.620325+0000, chain.objs.size()=1 2024-09-12T00:38:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.FPlZTd3pd3d5KlQ54Kph1aMH6hNPUUH_0 2024-09-12T00:38:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14528935917368484848', time=2024-09-12T02:31:29.778716+0000, chain.objs.size()=1 2024-09-12T00:38:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Fjpt2ZoJ23I-0kjxGAZsLMWdclCQoN0_0 2024-09-12T00:38:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11912060112746785559', time=2024-09-12T02:31:29.782578+0000, chain.objs.size()=1 2024-09-12T00:38:37.856 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.855+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.aBwhUjZeyz5AWUfCGvqye8eqY-PQjmH_0 2024-09-12T00:38:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.856+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13301338955910399673', time=2024-09-12T02:31:29.820123+0000, chain.objs.size()=1 2024-09-12T00:38:37.857 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.856+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.wSS5NaQ1oRRMK4u1VgBCp5LY3fR3ypD_0 2024-09-12T00:38:37.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.860+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15900672194405560194', time=2024-09-12T02:31:30.005255+0000, chain.objs.size()=1 2024-09-12T00:38:37.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.860+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-YcanDsQqvxWr4Naw5GBaQ6u__AvZvI_0 2024-09-12T00:38:37.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.860+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2675750654834528144', time=2024-09-12T02:31:30.091226+0000, chain.objs.size()=1 2024-09-12T00:38:37.859 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.860+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.dOhMuSng_YAgsbjYTz534BC5RVhLFvl_0 2024-09-12T00:38:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2167382001589122329', time=2024-09-12T02:31:30.130244+0000, chain.objs.size()=1 2024-09-12T00:38:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-EgjhI6tOau5RGjMtONbOsAVlyWf7EJ_0 2024-09-12T00:38:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7912979153211553513', time=2024-09-12T02:31:30.139196+0000, chain.objs.size()=1 2024-09-12T00:38:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.QcNpezrlKZ71fy8eMom8ACfDib0HSft_0 2024-09-12T00:38:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5606776219700635664', time=2024-09-12T02:31:30.142106+0000, chain.objs.size()=1 2024-09-12T00:38:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.02X2MzVvfw4rvdbVz8slzmsRAh443XM_0 2024-09-12T00:38:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5968547408088354079', time=2024-09-12T02:31:30.433792+0000, chain.objs.size()=1 2024-09-12T00:38:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.1DTSCqaq_Nig37CG_VljxqvudXmUYz1_0 2024-09-12T00:38:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16427633038983982999', time=2024-09-12T02:31:30.456320+0000, chain.objs.size()=1 2024-09-12T00:38:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.dCu6DvKBmnHl89LmxY09-XYUty9Q_M8_0 2024-09-12T00:38:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12325693368357632618', time=2024-09-12T02:31:30.473342+0000, chain.objs.size()=1 2024-09-12T00:38:37.861 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.zfFZ2Yr4L84_ADF7tbnreerqhWvp1rC_0 2024-09-12T00:38:37.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12072924241312298464', time=2024-09-12T02:31:30.680588+0000, chain.objs.size()=1 2024-09-12T00:38:37.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.F6fYMoU6GZmWLFyimzVlRjtyYUJx5Mu_0 2024-09-12T00:38:37.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16446340652023864186', time=2024-09-12T02:31:30.691510+0000, chain.objs.size()=1 2024-09-12T00:38:37.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NKf4ictgAWdGIlG7TX-phwOP-3y9CEX_0 2024-09-12T00:38:37.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9355068193638348002', time=2024-09-12T02:31:30.693784+0000, chain.objs.size()=1 2024-09-12T00:38:37.862 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.861+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.B6RZk0ipd1p3_Hae6VBd6B-GfXNpc3c_0 2024-09-12T00:38:37.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.864+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2276551323151805754', time=2024-09-12T02:31:30.703276+0000, chain.objs.size()=1 2024-09-12T00:38:37.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.864+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.o9vtzAuKF4onxuaBE1KIEJDIR7a38JA_0 2024-09-12T00:38:37.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.864+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4786174549150262598', time=2024-09-12T02:31:30.851655+0000, chain.objs.size()=1 2024-09-12T00:38:37.864 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.864+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.WlKDhhV6csJPApWt1-VdCmS1_BfdcIb_0 2024-09-12T00:38:37.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.867+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16563786259942875739', time=2024-09-12T02:31:30.868469+0000, chain.objs.size()=1 2024-09-12T00:38:37.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.867+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NIHPk-QbctTbKaUYpWC7J36rnYc3kHl_0 2024-09-12T00:38:37.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.867+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3939229207071265359', time=2024-09-12T02:31:30.888547+0000, chain.objs.size()=1 2024-09-12T00:38:37.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.867+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.isVKvHuIT5Xe2MAHsWWQmBc4TSuIxDB_0 2024-09-12T00:38:37.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.867+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4134227842454277684', time=2024-09-12T02:31:30.922744+0000, chain.objs.size()=1 2024-09-12T00:38:37.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.867+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-RCm24jZf_KDejxwWET7x3JKBmrgkCi_0 2024-09-12T00:38:37.866 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.867+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4329905169585522447', time=2024-09-12T02:31:30.949278+0000, chain.objs.size()=1 2024-09-12T00:38:37.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.867+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.XMrErbZSE-qUCyBW8lvrQTDfnbUO_g4_0 2024-09-12T00:38:37.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.867+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15983670271545991723', time=2024-09-12T02:31:30.969124+0000, chain.objs.size()=1 2024-09-12T00:38:37.867 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.867+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.KNrLnQ-uW5GGQmTJE_ygfqTHQZXc34a_0 2024-09-12T00:38:37.870 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.871+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/43947 2024-09-12T00:38:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T00:38:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7468621385277706070', time=2024-09-12T02:31:30.979171+0000, chain.objs.size()=1 2024-09-12T00:38:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.08_IeflMquCbnawOsBbwWx7sOnTocnc_0 2024-09-12T00:38:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3691789117432873190', time=2024-09-12T02:31:30.991547+0000, chain.objs.size()=1 2024-09-12T00:38:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.uHH1I65-4iZh-LGN2_r63UR5QiY7T9L_0 2024-09-12T00:38:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14897308399741619592', time=2024-09-12T02:31:30.992311+0000, chain.objs.size()=1 2024-09-12T00:38:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ucxqZFvWiCShgHqpFg99BCDl9EtJ4pS_0 2024-09-12T00:38:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14559836552646153927', time=2024-09-12T02:31:31.200442+0000, chain.objs.size()=1 2024-09-12T00:38:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.yBstZqBcUXZpg69B3UlSFfN9pcyTaaD_0 2024-09-12T00:38:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.602634738278449598', time=2024-09-12T02:31:31.416324+0000, chain.objs.size()=1 2024-09-12T00:38:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.GCOPoIneoKm52Or52F7dmyi4GpSmNR3_0 2024-09-12T00:38:37.874 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11424252243024791752', time=2024-09-12T02:31:31.426430+0000, chain.objs.size()=1 2024-09-12T00:38:37.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.PEyN8gGFRgjTF-Kb9esPcAbCsK48ybQ_0 2024-09-12T00:38:37.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17658510966666849610', time=2024-09-12T02:31:31.479396+0000, chain.objs.size()=1 2024-09-12T00:38:37.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.p51EzAWF-yBBGmBReTV631QOHQo9gPj_0 2024-09-12T00:38:37.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16728277499593720498', time=2024-09-12T02:31:31.701156+0000, chain.objs.size()=1 2024-09-12T00:38:37.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.zP9ABX1hQkIvstu_6OHjsVLWFyPAls1_0 2024-09-12T00:38:37.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5165641323809331908', time=2024-09-12T02:31:35.629654+0000, chain.objs.size()=1 2024-09-12T00:38:37.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.341__shadow_.vXXrtGj_dA4cGkVLnUsM_L46JzdSuhf_0 2024-09-12T00:38:37.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16994372859095935626', time=2024-09-12T02:31:45.904612+0000, chain.objs.size()=1 2024-09-12T00:38:37.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.383__shadow_.xflFw5ErPClMlIP3RSHHTQCy4504Lgr_0 2024-09-12T00:38:37.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4224325382145244282', time=2024-09-12T02:32:23.051672+0000, chain.objs.size()=1 2024-09-12T00:38:37.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.518__multipart_mymultipart.2~hdso2UBFaWv758Hb41YZARuR7N6vyEB.1 2024-09-12T00:38:37.875 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~26-giFjXj_OynFlxSYZso03sXCS_4Nh', time=2024-09-12T02:32:34.359624+0000, chain.objs.size()=10 2024-09-12T00:38:37.876 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.874+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.526__multipart_mymultipart.2~26-giFjXj_OynFlxSYZso03sXCS_4Nh.1 2024-09-12T00:38:37.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.878+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.526__multipart_mymultipart.2~26-giFjXj_OynFlxSYZso03sXCS_4Nh.2 2024-09-12T00:38:37.877 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.878+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.526__multipart_mymultipart.2~26-giFjXj_OynFlxSYZso03sXCS_4Nh.3 2024-09-12T00:38:37.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.879+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.526__multipart_mymultipart.2~26-giFjXj_OynFlxSYZso03sXCS_4Nh.4 2024-09-12T00:38:37.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.879+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.526__multipart_mymultipart.2~26-giFjXj_OynFlxSYZso03sXCS_4Nh.5 2024-09-12T00:38:37.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.879+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.526__multipart_mymultipart.2~26-giFjXj_OynFlxSYZso03sXCS_4Nh.6 2024-09-12T00:38:37.878 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.879+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.526__multipart_mymultipart.2~26-giFjXj_OynFlxSYZso03sXCS_4Nh.7 2024-09-12T00:38:37.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.880+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.526__multipart_mymultipart.2~26-giFjXj_OynFlxSYZso03sXCS_4Nh.8 2024-09-12T00:38:37.879 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.880+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.526__multipart_mymultipart.2~26-giFjXj_OynFlxSYZso03sXCS_4Nh.9 2024-09-12T00:38:37.881 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.882+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.526__multipart_mymultipart.2~26-giFjXj_OynFlxSYZso03sXCS_4Nh.10 2024-09-12T00:38:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.882+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16583999638022988225', time=2024-09-12T02:33:05.962628+0000, chain.objs.size()=1 2024-09-12T00:38:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.882+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.552__shadow_.fDdl72OLUlEdbDjHCSBdQZ5TAZsejcW_0 2024-09-12T00:38:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.882+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1129931920082837163', time=2024-09-12T02:33:08.216694+0000, chain.objs.size()=1 2024-09-12T00:38:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.882+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.557__shadow_.C0KtF9UIF5pB5TdQi0dCxcaIX3NCUFp_0 2024-09-12T00:38:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.882+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7090169721197834366', time=2024-09-12T02:33:08.817372+0000, chain.objs.size()=1 2024-09-12T00:38:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.882+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.558__shadow_.oO9CsIWedw_zrPZEv1nKaibgF8SRm68_0 2024-09-12T00:38:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.882+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14297942193660345367', time=2024-09-12T02:33:09.242882+0000, chain.objs.size()=1 2024-09-12T00:38:37.882 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.882+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.559__shadow_.V9qGJfON28GtjocD2sRDLZUfM_LdnmM_0 2024-09-12T00:38:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.884+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17301506099699838619', time=2024-09-12T02:33:09.971845+0000, chain.objs.size()=1 2024-09-12T00:38:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.884+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.561__multipart_mymultipart.2~oocPcs4142Gu43zoDE8v3FwjBfZPOTG.1 2024-09-12T00:38:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.884+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.277816077670357018', time=2024-09-12T02:33:26.137878+0000, chain.objs.size()=1 2024-09-12T00:38:37.883 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.884+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.574__shadow:Mn9k0Pc1C.NJQ.xgUdj4q0-KRCjtPfF_.TK0sVUhFftzgpDPCiWTtmp1-V0c7Rdy_0 2024-09-12T00:38:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.887+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17448574698239425136', time=2024-09-12T02:33:29.621877+0000, chain.objs.size()=1 2024-09-12T00:38:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.887+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.576__shadow:x9NQqjicuzprTlr2BtIAJFcrwgFrehT_.0K8OplnHA8GGjRMYwkOab-WOz77SwZs_0 2024-09-12T00:38:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.887+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15482221085953118717', time=2024-09-12T02:33:33.502831+0000, chain.objs.size()=1 2024-09-12T00:38:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.887+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:PfbZfbcEkp5g56MoRLsAN-EBBAo9zam_.ID7dQ3lLj4UApJHh2QfqUC2VctVap0r_0 2024-09-12T00:38:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.887+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17267982840231294301', time=2024-09-12T02:33:34.540922+0000, chain.objs.size()=1 2024-09-12T00:38:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.887+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:uTYTvQYZOuTJM92xyMBYd-gtj075Awy_.qW-ue_tko5IcExFk7XJ-E3JOAlKJkqB_0 2024-09-12T00:38:37.886 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.887+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7883628865083520013', time=2024-09-12T02:33:38.509969+0000, chain.objs.size()=1 2024-09-12T00:38:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.887+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:kZKfNr5rURJ0hauwLolfE2E6pMLzV5T_.NL9ThsQITqRZscoLKkkHto2jTWbsx1c_0 2024-09-12T00:38:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.887+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10279666494967442720', time=2024-09-12T02:33:39.204072+0000, chain.objs.size()=1 2024-09-12T00:38:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.887+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:ehtGTaTTvHqZwEhxaoneORjCHaOR46p_.LYD718OoMXuzVp8OPHg-OX6gZ9ZAtu8_0 2024-09-12T00:38:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.887+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7319230469010608640', time=2024-09-12T02:33:44.788667+0000, chain.objs.size()=4 2024-09-12T00:38:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.887+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.578__multipart_testobj.2~dfx1Cli242R66JXIMuywqyRsKiyhpPd.1 2024-09-12T00:38:37.887 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.887+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.578__multipart_testobj.2~dfx1Cli242R66JXIMuywqyRsKiyhpPd.2 2024-09-12T00:38:37.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.889+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.578__multipart_testobj.2~dfx1Cli242R66JXIMuywqyRsKiyhpPd.3 2024-09-12T00:38:37.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.889+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.578__multipart_testobj.2~dfx1Cli242R66JXIMuywqyRsKiyhpPd.4 2024-09-12T00:38:37.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.889+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16596764176703850266', time=2024-09-12T02:33:52.519537+0000, chain.objs.size()=1 2024-09-12T00:38:37.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.889+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.603__shadow_.SmdZdwLgW--6_zYqQ39os6EL_0bXjX4_0 2024-09-12T00:38:37.888 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.889+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14094237286495268924', time=2024-09-12T02:36:00.897556+0000, chain.objs.size()=1 2024-09-12T00:38:37.889 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.889+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.620__shadow_.E2rPJXNr5dmSs9DLAR-NJq54iRY3g-j_0 2024-09-12T00:38:37.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.890+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10417347198638647948', time=2024-09-12T02:36:49.025464+0000, chain.objs.size()=1 2024-09-12T00:38:37.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.890+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.717__shadow:uwDIPfHl27Nz0yrdLK4Gh5YNjY8.N3A_.aGt-7k6-6CtcOhIOdob6-4lGyZrNjwj_0 2024-09-12T00:38:37.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.890+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7839217767580091190', time=2024-09-12T02:36:49.655203+0000, chain.objs.size()=1 2024-09-12T00:38:37.890 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.890+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.719__shadow_.MslIf4YJAsJ6Rcnme2AjP_h_dmoSVSl_0 2024-09-12T00:38:37.893 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.894+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:37.896 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.896+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:38:37.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.898+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:37.897 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.898+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:37.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43862' 2024-09-12T00:38:37.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12115961372320797957', time=2024-09-12T02:30:38.283571+0000, chain.objs.size()=1 2024-09-12T00:38:37.898 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.234__shadow_.-oznP4kZj2QW2_d77IDnp_doKUvvXOw_0 2024-09-12T00:38:37.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6079412638676395135', time=2024-09-12T02:30:40.347180+0000, chain.objs.size()=1 2024-09-12T00:38:37.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.242__shadow_.OoSfiWABjdj2yAwUvke_aeGgnIQE6j3_0 2024-09-12T00:38:37.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7782868414407649289', time=2024-09-12T02:30:53.129556+0000, chain.objs.size()=1 2024-09-12T00:38:37.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.C3wg2Q7eQcDsJ8n4o27xCuPUqF2Yjub_0 2024-09-12T00:38:37.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.876706090558648052', time=2024-09-12T02:30:53.161366+0000, chain.objs.size()=1 2024-09-12T00:38:37.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.XUx-VP1gwdDNKNYUrMFim0uCBYa20Hc_0 2024-09-12T00:38:37.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6948098422785195400', time=2024-09-12T02:30:53.191114+0000, chain.objs.size()=1 2024-09-12T00:38:37.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.b9P8krtjMostDqlyxvKryjF6CVE_JPd_0 2024-09-12T00:38:37.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17817934023643277841', time=2024-09-12T02:30:53.219354+0000, chain.objs.size()=1 2024-09-12T00:38:37.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.elfZmNw4ccbwN7VSgNblz0c831AgCBS_0 2024-09-12T00:38:37.899 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4822432023375755006', time=2024-09-12T02:30:53.419901+0000, chain.objs.size()=1 2024-09-12T00:38:37.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.738AzJiYyUcWLnPA8mp1N2FnepyO-_t_0 2024-09-12T00:38:37.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11483034870978183782', time=2024-09-12T02:30:53.455439+0000, chain.objs.size()=1 2024-09-12T00:38:37.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ebQuyFksgqzrfwGP4PTuUO0_KXNjJMi_0 2024-09-12T00:38:37.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11166621009596045015', time=2024-09-12T02:30:53.467924+0000, chain.objs.size()=1 2024-09-12T00:38:37.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.nksXaPEKewkWDgtO8qWEl7bioURUOlX_0 2024-09-12T00:38:37.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12164982124644386495', time=2024-09-12T02:30:53.481111+0000, chain.objs.size()=1 2024-09-12T00:38:37.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pnx7tBDbM4tp_HSWoXsuEveXkhgSYs4_0 2024-09-12T00:38:37.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9946295295692231739', time=2024-09-12T02:30:53.513057+0000, chain.objs.size()=1 2024-09-12T00:38:37.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.NnmgzJxsgFo_BmLSpy3hRS-bJ21Da9U_0 2024-09-12T00:38:37.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16259529014223328349', time=2024-09-12T02:30:53.515708+0000, chain.objs.size()=1 2024-09-12T00:38:37.900 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.899+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lm1PMCjvP_Wa532UD4FIb1MKg4GPwEu_0 2024-09-12T00:38:37.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.902+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9436791366332280250', time=2024-09-12T02:30:53.547489+0000, chain.objs.size()=1 2024-09-12T00:38:37.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.902+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ly8EGO9Y51gKh1xlIl16algOR5lmuTg_0 2024-09-12T00:38:37.901 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.902+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8344087949312300757', time=2024-09-12T02:30:53.552008+0000, chain.objs.size()=1 2024-09-12T00:38:37.902 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.902+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-lcZ5KdeL16UQfWAvWrCuN5qaujqCWC_0 2024-09-12T00:38:37.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.903+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14962797151915007534', time=2024-09-12T02:30:53.559173+0000, chain.objs.size()=1 2024-09-12T00:38:37.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.903+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.y0_4sXAugtbNjdzfwPbLXzoGK0_EZC2_0 2024-09-12T00:38:37.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.903+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8172475082758779128', time=2024-09-12T02:30:53.753736+0000, chain.objs.size()=1 2024-09-12T00:38:37.903 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.903+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YG5ATSA_jaLQkwGpQy1k9Mfj4M213Ca_0 2024-09-12T00:38:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17691213174434648473', time=2024-09-12T02:30:53.838091+0000, chain.objs.size()=1 2024-09-12T00:38:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.H57u6adOIPBANWx8ekd_T5BkTVvrKSn_0 2024-09-12T00:38:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4592752161919815872', time=2024-09-12T02:30:53.994429+0000, chain.objs.size()=1 2024-09-12T00:38:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.iioOgNQlL5uXrqEu0w_zkdI56EcEOra_0 2024-09-12T00:38:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16665638551389129759', time=2024-09-12T02:30:54.162455+0000, chain.objs.size()=1 2024-09-12T00:38:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2nxowuDMVIpQ3iiYLklq7bJ6jpmytfJ_0 2024-09-12T00:38:37.905 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.660830413555477703', time=2024-09-12T02:30:54.400886+0000, chain.objs.size()=1 2024-09-12T00:38:37.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.rxUMLICZBMOeBKm-STuwNJMahXKKef0_0 2024-09-12T00:38:37.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2392972637779699479', time=2024-09-12T02:30:54.434356+0000, chain.objs.size()=1 2024-09-12T00:38:37.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.N-AMHzItQNjRFsg10THlsVCDMX7pk1p_0 2024-09-12T00:38:37.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15507580317504031835', time=2024-09-12T02:30:54.458863+0000, chain.objs.size()=1 2024-09-12T00:38:37.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Vg0Umf1sh3395mvljIY6yBgukULeKnw_0 2024-09-12T00:38:37.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4824659314208220669', time=2024-09-12T02:30:54.572210+0000, chain.objs.size()=1 2024-09-12T00:38:37.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.84CXFApwUEtJ342fgzAc0lgf7AxTJps_0 2024-09-12T00:38:37.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3581899859228290621', time=2024-09-12T02:30:54.728942+0000, chain.objs.size()=1 2024-09-12T00:38:37.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.xtl-7d0gBq2H-6YxjC3nhATYxbGqqAI_0 2024-09-12T00:38:37.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6030340949789561890', time=2024-09-12T02:30:54.837140+0000, chain.objs.size()=1 2024-09-12T00:38:37.906 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.905+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AndmbQkEZsj7nYMSLp9EiA8dRYl2Sfw_0 2024-09-12T00:38:37.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.909+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8403641916478434939', time=2024-09-12T02:30:54.859117+0000, chain.objs.size()=1 2024-09-12T00:38:37.908 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.909+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.oagxL17zIiIfoMwRTqdxKJpdTHSnkFE_0 2024-09-12T00:38:37.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.788504929060326635', time=2024-09-12T02:30:54.871683+0000, chain.objs.size()=1 2024-09-12T00:38:37.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.usDa-AFtT8ah8T65GQqR2XsNXdQzFNz_0 2024-09-12T00:38:37.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11717875060057943155', time=2024-09-12T02:30:54.882674+0000, chain.objs.size()=1 2024-09-12T00:38:37.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.vqkuAUgZOAoPulWR07wQhw2-I-1smTG_0 2024-09-12T00:38:37.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11645826572327905340', time=2024-09-12T02:30:54.922947+0000, chain.objs.size()=1 2024-09-12T00:38:37.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BrK6WbxbEn53f2u1DWNSuGHJLmmuuAp_0 2024-09-12T00:38:37.910 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17052506447987367048', time=2024-09-12T02:30:54.979200+0000, chain.objs.size()=1 2024-09-12T00:38:37.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.8rcYZicCqWFRxJHlvSUJs2Cre1qBeKl_0 2024-09-12T00:38:37.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.688794414978499818', time=2024-09-12T02:30:54.993639+0000, chain.objs.size()=1 2024-09-12T00:38:37.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.e-oI-wj-_Z1SDDWx9WGb3xfGAcHP51e_0 2024-09-12T00:38:37.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7952381586015620703', time=2024-09-12T02:30:55.001281+0000, chain.objs.size()=1 2024-09-12T00:38:37.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.D9f46VwZQzeUfAPkVyK-q1B_JHQTZX-_0 2024-09-12T00:38:37.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1059359538264274264', time=2024-09-12T02:30:55.087175+0000, chain.objs.size()=1 2024-09-12T00:38:37.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BGnvghzkwABUpRYeOCK6jMwiF8lQb9C_0 2024-09-12T00:38:37.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15698312676946851398', time=2024-09-12T02:30:55.116080+0000, chain.objs.size()=1 2024-09-12T00:38:37.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.N0NXNt8KR0xb1AryEAjtf5VWhslrYuV_0 2024-09-12T00:38:37.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9683378412955678623', time=2024-09-12T02:30:55.210368+0000, chain.objs.size()=1 2024-09-12T00:38:37.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.uG9NTAhNuaII9KneWmFry4N4-kjXmlS_0 2024-09-12T00:38:37.911 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11362861428526086808', time=2024-09-12T02:30:55.244636+0000, chain.objs.size()=1 2024-09-12T00:38:37.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.911+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.7WYwqyKbYTIKpoFRm2ITPlSrBZaT-Yo_0 2024-09-12T00:38:37.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.913+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12002100896148263014', time=2024-09-12T02:30:55.953493+0000, chain.objs.size()=1 2024-09-12T00:38:37.912 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.913+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.265__shadow_.8xfEvxRv1exVD7KEmUMasu_g_nPuXk3_0 2024-09-12T00:38:37.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.916+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9603884850394701278', time=2024-09-12T02:30:56.910399+0000, chain.objs.size()=1 2024-09-12T00:38:37.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.916+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.269__shadow_.UguY-QLVC-BWua7Xdfm34hX45yAJnge_0 2024-09-12T00:38:37.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12578041095684041876', time=2024-09-12T02:30:58.865240+0000, chain.objs.size()=1 2024-09-12T00:38:37.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.277__shadow_.9P_NZFHsm1O4HlgsXEwfL8q256Iqu2Q_0 2024-09-12T00:38:37.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5939126286805378827', time=2024-09-12T02:30:59.105016+0000, chain.objs.size()=1 2024-09-12T00:38:37.916 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.278__shadow_.mfJ8hjJWtMoodqmPh_wbjBmIsIIHwdL_0 2024-09-12T00:38:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11868211887997124366', time=2024-09-12T02:30:59.824997+0000, chain.objs.size()=1 2024-09-12T00:38:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.281__shadow_.kO9LQNk13zJut1sk-s8zQpC5BNKs-F7_0 2024-09-12T00:38:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8718291245458257266', time=2024-09-12T02:31:03.056626+0000, chain.objs.size()=1 2024-09-12T00:38:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.jI2ioQXQj_Yu87KvYNADrSZYFliVr0x_0 2024-09-12T00:38:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13872014963962932145', time=2024-09-12T02:31:03.889463+0000, chain.objs.size()=1 2024-09-12T00:38:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.294__shadow_.7jyIknps2aeWWAJOouomcA7lzd_AlbH_0 2024-09-12T00:38:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16562627470845870168', time=2024-09-12T02:31:04.407029+0000, chain.objs.size()=1 2024-09-12T00:38:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.296__shadow_.W_80cnZTQeAaY7ac7TCzmlOod97R2qb_0 2024-09-12T00:38:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15035322492120667611', time=2024-09-12T02:31:06.218404+0000, chain.objs.size()=1 2024-09-12T00:38:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.303__shadow_.B8HVfCAQcqymr0PtK6Kc9wIiBDUYZst_0 2024-09-12T00:38:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15653307376805546128', time=2024-09-12T02:31:19.379286+0000, chain.objs.size()=1 2024-09-12T00:38:37.917 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.8t4UdEAkjyL35GDPCaQjKQ7-igXH2-I_0 2024-09-12T00:38:37.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12214817432479850163', time=2024-09-12T02:31:19.408095+0000, chain.objs.size()=1 2024-09-12T00:38:37.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.z1tvcopK4Rj9OcO0g_w1oWVC8cdjD30_0 2024-09-12T00:38:37.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14991515303957162795', time=2024-09-12T02:31:19.422712+0000, chain.objs.size()=1 2024-09-12T00:38:37.918 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.917+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ieHb89pID8gwtsTOL2bfQ6xid_cakFp_0 2024-09-12T00:38:37.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.920+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2759130136645447897', time=2024-09-12T02:31:19.728538+0000, chain.objs.size()=1 2024-09-12T00:38:37.920 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.920+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.WhL7rUCbLxTPHyPm4pNJzTfqoN1ZMVM_0 2024-09-12T00:38:37.921 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.922+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16029956521347588275', time=2024-09-12T02:31:19.782333+0000, chain.objs.size()=1 2024-09-12T00:38:37.922 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.922+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.4VbWH4ixe3vkOAEWSjLWyDT2rMbtkGU_0 2024-09-12T00:38:37.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.924+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13760099547670794633', time=2024-09-12T02:31:19.788541+0000, chain.objs.size()=1 2024-09-12T00:38:37.923 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.924+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Uw8twr9b6I3yqUYUHrKGbxBseXZqI8m_0 2024-09-12T00:38:37.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11530130984003148853', time=2024-09-12T02:31:19.839228+0000, chain.objs.size()=1 2024-09-12T00:38:37.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.1Dy-kJO9Yz6zpF6OPpSdzpwGx103hqz_0 2024-09-12T00:38:37.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7711118362668081237', time=2024-09-12T02:31:19.970720+0000, chain.objs.size()=1 2024-09-12T00:38:37.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.RAgraQtoeEbjCbUvUiA3jELsjhoQYiC_0 2024-09-12T00:38:37.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18445850737143810270', time=2024-09-12T02:31:20.016998+0000, chain.objs.size()=1 2024-09-12T00:38:37.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.z-LxeqceYwyamtIrTy69udyuY2ykrLs_0 2024-09-12T00:38:37.925 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3962085342158999959', time=2024-09-12T02:31:20.153442+0000, chain.objs.size()=1 2024-09-12T00:38:37.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JkdoBT-XQs2mpxvhVeIxJg9VNp8CYAH_0 2024-09-12T00:38:37.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.613994706435443412', time=2024-09-12T02:31:20.362929+0000, chain.objs.size()=1 2024-09-12T00:38:37.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.LeXrttP1ZeCj1G6SaqmNwWyDp6VdvxF_0 2024-09-12T00:38:37.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17321369042213495594', time=2024-09-12T02:31:20.368476+0000, chain.objs.size()=1 2024-09-12T00:38:37.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.45BvOwoaK5W7j46YmQ5ymIY26pbcBXq_0 2024-09-12T00:38:37.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5868947346397343217', time=2024-09-12T02:31:20.399550+0000, chain.objs.size()=1 2024-09-12T00:38:37.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.iOnG0uX1AV6sNjLgEyjyAynYOxOWqUX_0 2024-09-12T00:38:37.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11276215334383396664', time=2024-09-12T02:31:20.457101+0000, chain.objs.size()=1 2024-09-12T00:38:37.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.6z32eZCU83la4xLzxomjPViXOLrmD3J_0 2024-09-12T00:38:37.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9417585561104775340', time=2024-09-12T02:31:20.616221+0000, chain.objs.size()=1 2024-09-12T00:38:37.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.yjWnE_I1xo59HCNqFWFHEn7Ql5eeIbl_0 2024-09-12T00:38:37.926 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14710803775048362800', time=2024-09-12T02:31:20.624399+0000, chain.objs.size()=1 2024-09-12T00:38:37.927 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.926+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.awyGfsDB613WeFp5wCFIIsIiU3Amtnk_0 2024-09-12T00:38:37.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.929+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10145864664597193607', time=2024-09-12T02:31:20.639198+0000, chain.objs.size()=1 2024-09-12T00:38:37.928 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.929+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.vQJc30Wrwm6jndrDBd9Qu1__ysV4Z8J_0 2024-09-12T00:38:37.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.931+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3681360430027376868', time=2024-09-12T02:31:20.895949+0000, chain.objs.size()=1 2024-09-12T00:38:37.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.931+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.9WChFTG4EI-_ZNe5Li0EtKmTup8-Xky_0 2024-09-12T00:38:37.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.931+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13772247384351550952', time=2024-09-12T02:31:20.915929+0000, chain.objs.size()=1 2024-09-12T00:38:37.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.931+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.GHw5-B16l6l8UiflafPg6vmS8xDTrZV_0 2024-09-12T00:38:37.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.931+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7503771135819464794', time=2024-09-12T02:31:20.927618+0000, chain.objs.size()=1 2024-09-12T00:38:37.930 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.931+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.GWIhpqWZD9DD3GwPG8pf7_uaZRRrNo-_0 2024-09-12T00:38:37.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.931+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7753444963086665726', time=2024-09-12T02:31:21.077774+0000, chain.objs.size()=1 2024-09-12T00:38:37.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.931+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.EWhHPNe5nGvk8rw6hfTk4p_ZwpkewpC_0 2024-09-12T00:38:37.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.931+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4985179971551247142', time=2024-09-12T02:31:21.159276+0000, chain.objs.size()=1 2024-09-12T00:38:37.931 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.931+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.0V0GsWHApn-S-q2JEgGqtFo7wxhjq1u_0 2024-09-12T00:38:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.932+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.602206606145604547', time=2024-09-12T02:31:21.284798+0000, chain.objs.size()=1 2024-09-12T00:38:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.932+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.BtsZK2N8zlmp5U2DnvhbSMlEFMifUxP_0 2024-09-12T00:38:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.932+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3531033950892861858', time=2024-09-12T02:31:21.525288+0000, chain.objs.size()=1 2024-09-12T00:38:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.932+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.R7ZXZNEX366PrktT2y2PM6wjxamr-Xs_0 2024-09-12T00:38:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.932+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7508826334706125678', time=2024-09-12T02:31:21.573649+0000, chain.objs.size()=1 2024-09-12T00:38:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.932+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.DfDqQ7doCtPLbK0DFMyJB03hGY0ybeW_0 2024-09-12T00:38:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.932+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13295969212632371073', time=2024-09-12T02:31:29.778247+0000, chain.objs.size()=1 2024-09-12T00:38:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.932+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.A9gpilV0HQWn8V_sDRbxTMPHkodRQNm_0 2024-09-12T00:38:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.932+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.40928854651172702', time=2024-09-12T02:31:29.807261+0000, chain.objs.size()=1 2024-09-12T00:38:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.932+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.00X6QghVfzi2gZBxtbLTCqoPFPTtCmE_0 2024-09-12T00:38:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.932+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9161169785014971131', time=2024-09-12T02:31:29.837654+0000, chain.objs.size()=1 2024-09-12T00:38:37.932 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.932+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.f3Cb_6O5Cy6ZDcmG8o5aOwkMCWNK1Br_0 2024-09-12T00:38:37.933 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.934+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16006575253679030261', time=2024-09-12T02:31:29.866019+0000, chain.objs.size()=1 2024-09-12T00:38:37.934 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.934+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.C_Qy9cg6ajL28b4mWivphegysLwlr14_0 2024-09-12T00:38:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.937+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4148494375164575556', time=2024-09-12T02:31:30.025185+0000, chain.objs.size()=1 2024-09-12T00:38:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.937+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.TVGAh8RehZVnGFxM5r40UhZq093fXaM_0 2024-09-12T00:38:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.937+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4314620292160344751', time=2024-09-12T02:31:30.037319+0000, chain.objs.size()=1 2024-09-12T00:38:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.937+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.8tnynyanXXQkjmp0tuaNzctwmT5RJph_0 2024-09-12T00:38:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.937+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12187924675150366621', time=2024-09-12T02:31:30.085370+0000, chain.objs.size()=1 2024-09-12T00:38:37.936 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.937+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.4SPbrm-0VRTGCKO0khtFqC6dxPkZNfN_0 2024-09-12T00:38:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.939+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13062714847409730839', time=2024-09-12T02:31:30.109153+0000, chain.objs.size()=1 2024-09-12T00:38:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.939+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.fN23ytVjKY7PoyWgCmWIu7mDvoqsjIw_0 2024-09-12T00:38:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.939+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2275431904180605032', time=2024-09-12T02:31:30.148629+0000, chain.objs.size()=1 2024-09-12T00:38:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.939+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.pmD1QkAC4FJjqEfvY777axr8p2NeCGf_0 2024-09-12T00:38:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.939+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16260467798341425429', time=2024-09-12T02:31:30.153720+0000, chain.objs.size()=1 2024-09-12T00:38:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.939+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lXLdNYg3lWFOP30aLlut8ibqfwmRH83_0 2024-09-12T00:38:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.939+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17754153646735343583', time=2024-09-12T02:31:30.289530+0000, chain.objs.size()=1 2024-09-12T00:38:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.939+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.AsF3aQklTJCg7kCFPKhEWueePm8kOfK_0 2024-09-12T00:38:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.939+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15214310324057839679', time=2024-09-12T02:31:30.332385+0000, chain.objs.size()=1 2024-09-12T00:38:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.939+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.MvF7mJvXRb7ITPj7wODxmnZ3b5a6WSu_0 2024-09-12T00:38:37.939 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.939+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12702431829591015488', time=2024-09-12T02:31:30.452587+0000, chain.objs.size()=1 2024-09-12T00:38:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.939+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.pJslB8CGeRZyS_dwwXEUkblZ4NLxltR_0 2024-09-12T00:38:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.940+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14956496432830545768', time=2024-09-12T02:31:30.583971+0000, chain.objs.size()=1 2024-09-12T00:38:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.940+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.nKoNoSl7uUmsBIMWUWzSF-GcUzCPqsi_0 2024-09-12T00:38:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.940+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1148888102005185806', time=2024-09-12T02:31:30.590102+0000, chain.objs.size()=1 2024-09-12T00:38:37.940 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.940+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.5NqRfyoJB0jg6Q-3b6cTBxlIif5spku_0 2024-09-12T00:38:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.942+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9107547093840350507', time=2024-09-12T02:31:30.637825+0000, chain.objs.size()=1 2024-09-12T00:38:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.942+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._QC1dwS-sIlz8iceBopz402H2iHYHpZ_0 2024-09-12T00:38:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.942+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.594741426415424031', time=2024-09-12T02:31:30.644049+0000, chain.objs.size()=1 2024-09-12T00:38:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.942+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.p65r-eZ0k-H_VEj8_g_jWElkG9DR-wK_0 2024-09-12T00:38:37.941 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.942+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15919043777312024594', time=2024-09-12T02:31:30.863104+0000, chain.objs.size()=1 2024-09-12T00:38:37.942 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.942+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.hkjpwx9hYgKWeacNT1U25oRvYsl_2W7_0 2024-09-12T00:38:37.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.945+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7820332478942713789', time=2024-09-12T02:31:31.026651+0000, chain.objs.size()=1 2024-09-12T00:38:37.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.946+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-cw_lbNZOvMP6lHO-BNMUNPNMHAMiVN_0 2024-09-12T00:38:37.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.946+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17009041541331097702', time=2024-09-12T02:31:31.139166+0000, chain.objs.size()=1 2024-09-12T00:38:37.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.946+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.byj7xMRl0z4nnsTBpMJu9NSkAvJ1LvB_0 2024-09-12T00:38:37.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.946+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3556031994342551294', time=2024-09-12T02:31:31.219929+0000, chain.objs.size()=1 2024-09-12T00:38:37.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.946+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.yLdOzWmbAuGF6qP6PfPPPyC4JNGkLT6_0 2024-09-12T00:38:37.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.946+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11831753712674312290', time=2024-09-12T02:31:31.223465+0000, chain.objs.size()=1 2024-09-12T00:38:37.945 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.946+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Cjk3p-JPwwEDZRT6KMUxnd5nZvzupl7_0 2024-09-12T00:38:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.946+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6281697603509360777', time=2024-09-12T02:31:31.264883+0000, chain.objs.size()=1 2024-09-12T00:38:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.946+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.MNIBAGpLPMx2rqlgUZoeMCmYCkKnnlK_0 2024-09-12T00:38:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.946+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16493003189002352657', time=2024-09-12T02:31:31.276145+0000, chain.objs.size()=1 2024-09-12T00:38:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.946+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-CMUMmPv0i8Ewu-ljEVJrUVOBjJZvVp_0 2024-09-12T00:38:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.946+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15579505560183055174', time=2024-09-12T02:31:31.412184+0000, chain.objs.size()=1 2024-09-12T00:38:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.946+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.4HF1W-PLmkbs4agKSDItdWNvA7BIU_2_0 2024-09-12T00:38:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.946+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3375689768229595344', time=2024-09-12T02:31:31.467328+0000, chain.objs.size()=1 2024-09-12T00:38:37.946 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.946+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.fRl0tt-5ideWGV1qv9Y34CIHJQHMQ-P_0 2024-09-12T00:38:37.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.949+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7662585679214980980', time=2024-09-12T02:31:31.510418+0000, chain.objs.size()=1 2024-09-12T00:38:37.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.949+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.brSTm6Mr5me4N4VMQ_82RjPtiLOLs1Z_0 2024-09-12T00:38:37.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.949+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8753699488482043147', time=2024-09-12T02:31:31.515288+0000, chain.objs.size()=1 2024-09-12T00:38:37.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.949+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.u81a2XHqVGdkq9iV8rMYXmpgvTDhwRF_0 2024-09-12T00:38:37.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.949+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9881658252936056280', time=2024-09-12T02:31:31.564995+0000, chain.objs.size()=1 2024-09-12T00:38:37.948 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.949+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.G41D8azU0A4zNfDpafOQvjWymAHR5mI_0 2024-09-12T00:38:37.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.951+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18255609227584565623', time=2024-09-12T02:31:31.713708+0000, chain.objs.size()=1 2024-09-12T00:38:37.950 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.951+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.EsOCOgXLNEzejiaMfX85LylYHYBtty0_0 2024-09-12T00:38:37.953 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.954+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/43862 2024-09-12T00:38:37.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:38:37.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7454962238710582418', time=2024-09-12T02:31:31.735631+0000, chain.objs.size()=1 2024-09-12T00:38:37.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Q9ygTN0Z0SDezJAB94qPbCxwjTrbaKD_0 2024-09-12T00:38:37.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3708392532218771027', time=2024-09-12T02:31:43.444428+0000, chain.objs.size()=1 2024-09-12T00:38:37.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.375__shadow_.K_zsLDU6_g2D3me23tAImF7Tds8cgwg_0 2024-09-12T00:38:37.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16254317674873713935', time=2024-09-12T02:31:59.806971+0000, chain.objs.size()=1 2024-09-12T00:38:37.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.435__shadow_.eqz-O5psrZownNsc9hvEsIvGrseoDfi_0 2024-09-12T00:38:37.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4994381001667693830', time=2024-09-12T02:32:08.643603+0000, chain.objs.size()=1 2024-09-12T00:38:37.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.464__shadow_.y31NqnBzDxiLBxSWGGpDIcWZ5yCGEEy_0 2024-09-12T00:38:37.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14208564579873809260', time=2024-09-12T02:32:09.559964+0000, chain.objs.size()=1 2024-09-12T00:38:37.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.466__shadow_.bjwaw83anybzzv-Xdhc88q9iMVL1VXM_0 2024-09-12T00:38:37.956 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9948493127113483148', time=2024-09-12T02:32:16.607946+0000, chain.objs.size()=1 2024-09-12T00:38:37.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.498__shadow_._A3xJino1fme0_y4gZPpPfrVcXijYa-_0 2024-09-12T00:38:37.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8202779030740530833', time=2024-09-12T02:32:18.251115+0000, chain.objs.size()=1 2024-09-12T00:38:37.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.503__shadow:ig1.iJ1ZviXIpIr.ZLyPeoYT.9MVwfX_.vO-G3V9zJdbWBBC0Ip0K0Zy9ROlszk8_0 2024-09-12T00:38:37.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14013699357956439560', time=2024-09-12T02:32:19.834344+0000, chain.objs.size()=6 2024-09-12T00:38:37.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.1 2024-09-12T00:38:37.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.2 2024-09-12T00:38:37.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.3 2024-09-12T00:38:37.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.4 2024-09-12T00:38:37.957 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.956+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.5 2024-09-12T00:38:37.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.960+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.6 2024-09-12T00:38:37.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.960+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5201009153022092782', time=2024-09-12T02:32:34.033759+0000, chain.objs.size()=2 2024-09-12T00:38:37.959 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.960+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.525__multipart_mymultipart.2~nf_orFup4l1qLDk-lWCxxLt6lYTs244.1 2024-09-12T00:38:37.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.961+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.525__multipart_mymultipart.2~nf_orFup4l1qLDk-lWCxxLt6lYTs244.2 2024-09-12T00:38:37.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.961+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6398183663128395193', time=2024-09-12T02:32:53.179636+0000, chain.objs.size()=1 2024-09-12T00:38:37.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.961+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.537__shadow_.um0WWoffqj2gfv9_MoTRDWk0bwgVr4k_0 2024-09-12T00:38:37.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.961+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2195286590264611746', time=2024-09-12T02:33:17.405685+0000, chain.objs.size()=1 2024-09-12T00:38:37.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.961+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:5IQUwQYNY.8z3aLxqV.K19QrCE1A1N2_.sx-9P6wXE1D6Zp9C6vLOVnu7uBJNHuT_0 2024-09-12T00:38:37.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.961+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12925334978487001375', time=2024-09-12T02:33:24.011837+0000, chain.objs.size()=1 2024-09-12T00:38:37.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.961+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.573__shadow_.kOTCBuvS--mKXIiA4YFFgVwfW01wPoD_0 2024-09-12T00:38:37.961 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.962+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17781016120013438919', time=2024-09-12T02:33:39.489523+0000, chain.objs.size()=1 2024-09-12T00:38:37.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.962+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:eCpmfJKvBpb3mWe5pJwznlG4Fb4VKP0_.8-z9FDW_vLStAv3_57bv_XtTo4l61Ag_0 2024-09-12T00:38:37.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.962+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11531669487687786137', time=2024-09-12T02:33:46.926701+0000, chain.objs.size()=1 2024-09-12T00:38:37.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.962+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.580__shadow:u8UCosg4Upi8Y.B4l2tqS5UHM7iPnOY_.QUGzWCuQxcWU7Gm4Xdjog3TGqxcTtn__0 2024-09-12T00:38:37.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.962+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14272257613643302296', time=2024-09-12T02:33:48.916678+0000, chain.objs.size()=1 2024-09-12T00:38:37.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.962+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.586__shadow:QRoWZdGw-Vde304fGhmpVxsvjauG5CL_._M84jVMuz-7Sp9BN0tCalmIRgg2HO31_0 2024-09-12T00:38:37.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.962+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14053086494114780031', time=2024-09-12T02:36:00.391691+0000, chain.objs.size()=1 2024-09-12T00:38:37.964 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.962+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.618__shadow_.k1nm1RBodpM2CQsy-fnJhHZSu677f8J_0 2024-09-12T00:38:37.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.962+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9990803501018644769', time=2024-09-12T02:36:04.644051+0000, chain.objs.size()=1 2024-09-12T00:38:37.965 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.962+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.628__shadow_.q5HIh87wV55hVaXRaPRpd3ltvJEZinX_0 2024-09-12T00:38:37.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.966+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10644261749531062745', time=2024-09-12T02:36:05.614766+0000, chain.objs.size()=1 2024-09-12T00:38:37.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.966+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.632__shadow_.DmsHVLrg_dGeY1N4JC1XKMozxSL91Bg_0 2024-09-12T00:38:37.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.966+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4765317865834415820', time=2024-09-12T02:36:06.113291+0000, chain.objs.size()=1 2024-09-12T00:38:37.966 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.966+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.634__shadow_._ByR1uNfwc9rOLlqOj4bUTnZqY2CbQN_0 2024-09-12T00:38:37.970 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.970+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:37.973 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.973+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:38:37.974 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.975+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:37.975 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:37.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44331' 2024-09-12T00:38:37.976 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12064691770407712895', time=2024-09-12T02:30:41.410560+0000, chain.objs.size()=1 2024-09-12T00:38:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.246__shadow_.89LhYNjXXjyH7lSHQanfGatM_tmpPEH_0 2024-09-12T00:38:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6434542458572760594', time=2024-09-12T02:30:53.181724+0000, chain.objs.size()=1 2024-09-12T00:38:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.bUEPfzb1I_YAHz1aqw3_sX28NTQ-bOq_0 2024-09-12T00:38:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6868094966306642741', time=2024-09-12T02:30:53.452990+0000, chain.objs.size()=1 2024-09-12T00:38:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.4HPn31JuQJ6Iwk9E30hS8gLCmchBNbb_0 2024-09-12T00:38:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11902853048154065941', time=2024-09-12T02:30:53.519263+0000, chain.objs.size()=1 2024-09-12T00:38:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6tUlVESiJ7eXUufbuHN22uclvZwtYOJ_0 2024-09-12T00:38:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1206834482544610147', time=2024-09-12T02:30:53.572683+0000, chain.objs.size()=1 2024-09-12T00:38:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.qPO-BwckUTIqRypog8NQhzRFCJVhugQ_0 2024-09-12T00:38:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17984083094988914476', time=2024-09-12T02:30:53.674146+0000, chain.objs.size()=1 2024-09-12T00:38:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ZQSSw_IyyT3DDnp6fOg00mCAgdurOtr_0 2024-09-12T00:38:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17729854941103224921', time=2024-09-12T02:30:53.687187+0000, chain.objs.size()=1 2024-09-12T00:38:37.977 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.cfj0lD5d3GgIQ1qA3fCOp55mnmqeCC7_0 2024-09-12T00:38:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2923085121810639961', time=2024-09-12T02:30:53.934517+0000, chain.objs.size()=1 2024-09-12T00:38:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.fBaDJ98rZq7Y-e4MclDhJdkox3RBH9k_0 2024-09-12T00:38:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8121489618778130949', time=2024-09-12T02:30:53.936350+0000, chain.objs.size()=1 2024-09-12T00:38:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.gX3YY0y_U1cA-eGSG_444FmRa36AIRQ_0 2024-09-12T00:38:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3716865250441535065', time=2024-09-12T02:30:53.999407+0000, chain.objs.size()=1 2024-09-12T00:38:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.h_DKRYQ8DxEi45IbrmlvgK_1lzaDUY2_0 2024-09-12T00:38:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17935671809736439115', time=2024-09-12T02:30:54.067660+0000, chain.objs.size()=1 2024-09-12T00:38:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.V9esQyVuWEEOwrHcfBit_F4tAAb04Q7_0 2024-09-12T00:38:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5198496055649321449', time=2024-09-12T02:30:54.292226+0000, chain.objs.size()=1 2024-09-12T00:38:37.978 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.976+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.VJyyLRnNMPTLfKEE3YA4xHO3ip8L8xP_0 2024-09-12T00:38:37.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.982+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11098303745920817753', time=2024-09-12T02:30:54.363499+0000, chain.objs.size()=1 2024-09-12T00:38:37.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.982+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.hCa_48iYr3C7hZ95RmJeRY1Jxczhjwu_0 2024-09-12T00:38:37.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.982+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16052675716773919618', time=2024-09-12T02:30:54.427316+0000, chain.objs.size()=1 2024-09-12T00:38:37.981 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.982+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lXSDjqY5Nv_hK6OU6Rt7-Zx3oh3gDIn_0 2024-09-12T00:38:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.982+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10245321865968085903', time=2024-09-12T02:30:54.465847+0000, chain.objs.size()=1 2024-09-12T00:38:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.982+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.4qGfgPNC-7pmyZZix1ekYr8IdmvZFLr_0 2024-09-12T00:38:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3761455163865200645', time=2024-09-12T02:30:54.660748+0000, chain.objs.size()=1 2024-09-12T00:38:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.MqMTiTWDyou47eKKPTCiLuvv2I-KJ9k_0 2024-09-12T00:38:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7824075110519930678', time=2024-09-12T02:30:54.667656+0000, chain.objs.size()=1 2024-09-12T00:38:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2fuDVMbCaUyZKuSLfmhML4d7DLhhiw9_0 2024-09-12T00:38:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10985594791703755429', time=2024-09-12T02:30:54.683158+0000, chain.objs.size()=1 2024-09-12T00:38:37.982 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.P8ozGHGVDbcyMIhex_nBErHAmsQG6Lt_0 2024-09-12T00:38:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.744782092567132012', time=2024-09-12T02:30:54.897131+0000, chain.objs.size()=1 2024-09-12T00:38:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Qemy8rXInJbduCcNsC3fGWv98oA6sG8_0 2024-09-12T00:38:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2295187104449034544', time=2024-09-12T02:30:54.931450+0000, chain.objs.size()=1 2024-09-12T00:38:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.7jNnyZR7EA_Tk48t46IT6uO_99-8F20_0 2024-09-12T00:38:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18401187664822212339', time=2024-09-12T02:30:54.955144+0000, chain.objs.size()=1 2024-09-12T00:38:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.VvZUdwUtuOEzWFZgvJN0MSgLsgi4zI0_0 2024-09-12T00:38:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.899799670476486762', time=2024-09-12T02:30:54.972094+0000, chain.objs.size()=1 2024-09-12T00:38:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.b0egXlfNQqQGCfP3RvatKYUVWh1m2Q1_0 2024-09-12T00:38:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7357710964837649341', time=2024-09-12T02:30:55.093328+0000, chain.objs.size()=1 2024-09-12T00:38:37.983 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.983+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.hqSZPLTKKQlP79Ms4GwB-f3irNwcjta_0 2024-09-12T00:38:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.985+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5511168941177109396', time=2024-09-12T02:30:55.107877+0000, chain.objs.size()=1 2024-09-12T00:38:37.984 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.985+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.hu6y9zta9jCVeh5lvovI7GHdl5ugnOd_0 2024-09-12T00:38:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.985+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7762810259807796902', time=2024-09-12T02:30:55.177367+0000, chain.objs.size()=1 2024-09-12T00:38:37.985 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.985+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.28GWEYjnyyrke9hmUXmUzOtnaTOUN3o_0 2024-09-12T00:38:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14665777405780113147', time=2024-09-12T02:30:55.446406+0000, chain.objs.size()=1 2024-09-12T00:38:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.263__shadow_.pGeMXiZlqyeto_CvKG4WHWu-1oTZQCg_0 2024-09-12T00:38:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14761101046738791275', time=2024-09-12T02:30:59.106239+0000, chain.objs.size()=1 2024-09-12T00:38:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.278__shadow_.6hHpLeqQWON7tbvFFmk9rt1dVYs51K8_0 2024-09-12T00:38:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11970362170901271184', time=2024-09-12T02:31:00.869011+0000, chain.objs.size()=1 2024-09-12T00:38:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.285__shadow_.6Bv-UjtjPGD6ce6rDBH_DrMELJR9wYu_0 2024-09-12T00:38:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.713100033414576687', time=2024-09-12T02:31:02.456987+0000, chain.objs.size()=1 2024-09-12T00:38:37.988 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.291__shadow_.GvQUWIWzrdZaFWzSrbroqS3-wMSudJv_0 2024-09-12T00:38:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9189488830540404089', time=2024-09-12T02:31:03.051828+0000, chain.objs.size()=1 2024-09-12T00:38:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.XXJg1288o6primq_Wl3KHRKL_PStxGA_0 2024-09-12T00:38:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2542532379794926310', time=2024-09-12T02:31:03.078705+0000, chain.objs.size()=1 2024-09-12T00:38:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.MsGT1z-fEFmR2tGJ36G2QKlm_1H_Sjj_0 2024-09-12T00:38:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2932916054612493768', time=2024-09-12T02:31:03.084529+0000, chain.objs.size()=1 2024-09-12T00:38:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.M68IRpN5YBJBWZBePYM07vW-5LYFJcc_0 2024-09-12T00:38:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6121428747036966719', time=2024-09-12T02:31:03.672764+0000, chain.objs.size()=1 2024-09-12T00:38:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.sSLGZoW9PdmO1DWLG8I7FsawLziiJpx_0 2024-09-12T00:38:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.370752945822927891', time=2024-09-12T02:31:03.888397+0000, chain.objs.size()=1 2024-09-12T00:38:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.294__shadow_.7Wd1TxtWYRBXd3mMukiVj4LEYnpLgHU_0 2024-09-12T00:38:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4025306688191460198', time=2024-09-12T02:31:04.129209+0000, chain.objs.size()=1 2024-09-12T00:38:37.989 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.988+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.295__shadow_.jMS4jV356xZdVgiNIl1xS52l79DU0SO_0 2024-09-12T00:38:37.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.990+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6972127889843020093', time=2024-09-12T02:31:04.936570+0000, chain.objs.size()=1 2024-09-12T00:38:37.990 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.990+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.298__shadow_.6XOqpQKO5iAhB6-qlpBUV9q9CRylxBH_0 2024-09-12T00:38:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.993+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8053004029722379835', time=2024-09-12T02:31:09.364308+0000, chain.objs.size()=1 2024-09-12T00:38:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.993+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.315__shadow_._Bg6td2DrYpGjMrEnS1h87hOLML0u6P_0 2024-09-12T00:38:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.993+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11018198008290672804', time=2024-09-12T02:31:10.175766+0000, chain.objs.size()=1 2024-09-12T00:38:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.993+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.319__shadow:fwVQfv1ypR0WUiU-Lp1uQ3dr2lu9Eev_.yku4kbqduWSutcKh4dY9MSRVjSKY0vz_0 2024-09-12T00:38:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15148473468503488184', time=2024-09-12T02:31:19.387599+0000, chain.objs.size()=1 2024-09-12T00:38:37.993 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.sQ-0ZknpkiT2WINiWP1G7soHvd6hsTj_0 2024-09-12T00:38:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11470159405308905673', time=2024-09-12T02:31:19.470866+0000, chain.objs.size()=1 2024-09-12T00:38:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.O3k-DCpVn398etWWx5BRd3jYmBIYTdq_0 2024-09-12T00:38:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16370270452147739414', time=2024-09-12T02:31:19.741186+0000, chain.objs.size()=1 2024-09-12T00:38:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.HXLaf_plMjQuNFOFE5mq4Zf0ieLrW3v_0 2024-09-12T00:38:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13189818804256690854', time=2024-09-12T02:31:19.792439+0000, chain.objs.size()=1 2024-09-12T00:38:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.xdFYeV2p39OG8EkRJqm1H0thSavoh6E_0 2024-09-12T00:38:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17138298695949893974', time=2024-09-12T02:31:19.814888+0000, chain.objs.size()=1 2024-09-12T00:38:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.tyAp0RlMWlM_T-6MzEZPvqGo6D1etG5_0 2024-09-12T00:38:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11911036298348268750', time=2024-09-12T02:31:19.854994+0000, chain.objs.size()=1 2024-09-12T00:38:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.BHuRl8PIhISsLPGvMOsBer50RvdPDXc_0 2024-09-12T00:38:37.994 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3437368169546498301', time=2024-09-12T02:31:19.973296+0000, chain.objs.size()=1 2024-09-12T00:38:37.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.PMe3nwpMvxZ8UTSpcExyveJJbOYT7wc_0 2024-09-12T00:38:37.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14993765727664508174', time=2024-09-12T02:31:20.024963+0000, chain.objs.size()=1 2024-09-12T00:38:37.995 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.994+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.i2UU77sNyW6l83HEEANol-uRBWz36zd_0 2024-09-12T00:38:37.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.997+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5930622322451006833', time=2024-09-12T02:31:20.055946+0000, chain.objs.size()=1 2024-09-12T00:38:37.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.997+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.f-sJM2yw7VaNs3BrnYiqrwvg2wjX2LV_0 2024-09-12T00:38:37.996 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.997+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9456362216571822430', time=2024-09-12T02:31:20.129742+0000, chain.objs.size()=1 2024-09-12T00:38:37.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.997+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.-yVOoe-bVLcOHoBpyoy1hWPUnsPZzir_0 2024-09-12T00:38:37.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.997+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13703901870307864475', time=2024-09-12T02:31:20.136243+0000, chain.objs.size()=1 2024-09-12T00:38:37.997 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:37.997+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.cKMz6w8gq2uIS0khZ0l20iYSGUQRSKQ_0 2024-09-12T00:38:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11470221536792011869', time=2024-09-12T02:31:20.150776+0000, chain.objs.size()=1 2024-09-12T00:38:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.MJCdyc6jkudbYFxtrjhQJ9a5ASDxYs__0 2024-09-12T00:38:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15601940175291856316', time=2024-09-12T02:31:20.273970+0000, chain.objs.size()=1 2024-09-12T00:38:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.mm9YUdApZIrNldz0OhRps7EsspsiUBO_0 2024-09-12T00:38:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15651445146017604100', time=2024-09-12T02:31:20.372554+0000, chain.objs.size()=1 2024-09-12T00:38:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.nIVINJLiro2NXfNpouzfiGFfJWBnZcq_0 2024-09-12T00:38:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2450318375327388826', time=2024-09-12T02:31:20.413250+0000, chain.objs.size()=1 2024-09-12T00:38:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ykf-fLJSXRymhqavo4BJyDHVbxsTZft_0 2024-09-12T00:38:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.000+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5620374267732387819', time=2024-09-12T02:31:20.451510+0000, chain.objs.size()=1 2024-09-12T00:38:37.999 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.000+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.L0XoDD5iCvJt5TTGxIeB_iLtL9eEXw5_0 2024-09-12T00:38:38.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.001+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5070404772584024742', time=2024-09-12T02:31:20.468582+0000, chain.objs.size()=1 2024-09-12T00:38:38.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.001+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.EQ-Jf2ZefGN6rB-9v4pq9VM42DRfgYu_0 2024-09-12T00:38:38.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.001+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15632594084242463419', time=2024-09-12T02:31:20.578784+0000, chain.objs.size()=1 2024-09-12T00:38:38.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.001+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.8huq0O5_5uVuYktYC4m1Yz2b6HLqRS4_0 2024-09-12T00:38:38.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.001+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5129001119905605387', time=2024-09-12T02:31:20.607633+0000, chain.objs.size()=1 2024-09-12T00:38:38.000 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.001+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ws4IvWsn7PZX604wkSWGTmSnbh0Q9vj_0 2024-09-12T00:38:38.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.001+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8472676969295125151', time=2024-09-12T02:31:20.699367+0000, chain.objs.size()=1 2024-09-12T00:38:38.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.001+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.d462raSjWMZE905E2HBhAThtSl1oXp5_0 2024-09-12T00:38:38.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.001+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2795929115995183779', time=2024-09-12T02:31:20.700622+0000, chain.objs.size()=1 2024-09-12T00:38:38.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.001+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.SS4qwAI00-1g3ZSHPC9p_YlLSw1wvDA_0 2024-09-12T00:38:38.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.001+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15807379453215403620', time=2024-09-12T02:31:20.919023+0000, chain.objs.size()=1 2024-09-12T00:38:38.001 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.001+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7i3qjUhuU0r1r0cpo9MUT4jEoMkvuA4_0 2024-09-12T00:38:38.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.004+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6986239428855606337', time=2024-09-12T02:31:21.237054+0000, chain.objs.size()=1 2024-09-12T00:38:38.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.004+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Duxnwr16Rf5t9W1sLa9ScAIoEhlVDu6_0 2024-09-12T00:38:38.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.004+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9155424497595190544', time=2024-09-12T02:31:21.249551+0000, chain.objs.size()=1 2024-09-12T00:38:38.003 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.004+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.KczeGyCwUzVZ9uCurI-4YH8nKkIS4dR_0 2024-09-12T00:38:38.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.004+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10214190105954145893', time=2024-09-12T02:31:21.274742+0000, chain.objs.size()=1 2024-09-12T00:38:38.004 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.004+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.hsiA3PELmvV0e-JDAU9yVneWxG9cSLX_0 2024-09-12T00:38:38.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.006+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13589890347543450518', time=2024-09-12T02:31:21.324686+0000, chain.objs.size()=1 2024-09-12T00:38:38.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.006+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.W5deky_67NIgOvxlCDvJHRyNmkStmlk_0 2024-09-12T00:38:38.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.006+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5855125685585904725', time=2024-09-12T02:31:21.340905+0000, chain.objs.size()=1 2024-09-12T00:38:38.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.006+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Kn1HO0D2y2yWAuEQv8BOrBmBtNF3qkv_0 2024-09-12T00:38:38.005 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.006+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15715932138622127543', time=2024-09-12T02:31:21.507473+0000, chain.objs.size()=1 2024-09-12T00:38:38.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.006+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7-i1UZqeehWf-l3VFthQCZuGdY6s-85_0 2024-09-12T00:38:38.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.006+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14464865922106957651', time=2024-09-12T02:31:21.536536+0000, chain.objs.size()=1 2024-09-12T00:38:38.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.006+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.RLeipSl4HRc0LXSgMy0tvlkohInOaMF_0 2024-09-12T00:38:38.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.006+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13486168463677701586', time=2024-09-12T02:31:21.577997+0000, chain.objs.size()=1 2024-09-12T00:38:38.006 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.006+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.EQm8HxKPEbY6wTGxoUIRHojlnisgiz6_0 2024-09-12T00:38:38.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.008+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8008239702754422954', time=2024-09-12T02:31:21.597793+0000, chain.objs.size()=1 2024-09-12T00:38:38.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.008+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.psGFvstdk2FShQihmngjQnq6hXV3nk__0 2024-09-12T00:38:38.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.008+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9064207508868016882', time=2024-09-12T02:31:21.618357+0000, chain.objs.size()=1 2024-09-12T00:38:38.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.008+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.d7Ms658ax8A7lo5-_Z9VUVmLvxH1w8o_0 2024-09-12T00:38:38.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.008+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4075370172245072828', time=2024-09-12T02:31:21.641402+0000, chain.objs.size()=1 2024-09-12T00:38:38.007 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.008+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Qf5SUgXNi7_sSS5gwUl5aBtS7iOPCgd_0 2024-09-12T00:38:38.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.008+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4689978958582602462', time=2024-09-12T02:31:21.642594+0000, chain.objs.size()=1 2024-09-12T00:38:38.008 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.008+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.DvjaQNU7nkd9EAPCl3SDgOsmwlNcN2M_0 2024-09-12T00:38:38.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.010+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.982397603857493995', time=2024-09-12T02:31:21.646034+0000, chain.objs.size()=1 2024-09-12T00:38:38.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.010+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.cuyobLQHbkz9nTxO3wJL3f1Tg4S_p0G_0 2024-09-12T00:38:38.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.010+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11515843107285848614', time=2024-09-12T02:31:29.695843+0000, chain.objs.size()=1 2024-09-12T00:38:38.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.010+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.azINdKMqUC1M7GmAwoPlerJ1E_3GVd1_0 2024-09-12T00:38:38.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.010+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17510788516516787312', time=2024-09-12T02:31:29.812972+0000, chain.objs.size()=1 2024-09-12T00:38:38.009 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.010+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.uAqmDVtdr9tKflwnGeFZarWFpqV2dk4_0 2024-09-12T00:38:38.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.011+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10778695396009622600', time=2024-09-12T02:31:30.059569+0000, chain.objs.size()=1 2024-09-12T00:38:38.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.011+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.aUVN3wpW41zlZm0X6tXfEZZJJlkNN9I_0 2024-09-12T00:38:38.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.011+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4807114001428585708', time=2024-09-12T02:31:30.077655+0000, chain.objs.size()=1 2024-09-12T00:38:38.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.011+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.zAWcbfP_hGVnUOl8YG06pMX1w2I-TfS_0 2024-09-12T00:38:38.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.011+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18442063199184620698', time=2024-09-12T02:31:30.101026+0000, chain.objs.size()=1 2024-09-12T00:38:38.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.011+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.yvsPHZybiA7VZCQ1cqcMYU9bZWqNXEX_0 2024-09-12T00:38:38.010 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.011+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13409845614668265464', time=2024-09-12T02:31:30.138472+0000, chain.objs.size()=1 2024-09-12T00:38:38.011 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.011+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ZfPLuf8h0xC_6KGLoGhCe1z8lFh8OiA_0 2024-09-12T00:38:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.013+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1785575623971395909', time=2024-09-12T02:31:30.171102+0000, chain.objs.size()=1 2024-09-12T00:38:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.013+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.L2X1mCUCHNbw0jAzE0vRJVKDMY3RRxQ_0 2024-09-12T00:38:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.013+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13569335235568734883', time=2024-09-12T02:31:30.300876+0000, chain.objs.size()=1 2024-09-12T00:38:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.013+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.pLM6bY1zA_X_jgSK92KXr0Np-6Hl5f6_0 2024-09-12T00:38:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.013+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11261218763189051930', time=2024-09-12T02:31:30.308584+0000, chain.objs.size()=1 2024-09-12T00:38:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.013+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.o8ewK-aFjf_f0hRtL90iGpkq9gK-Gbx_0 2024-09-12T00:38:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.013+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9962564533637603728', time=2024-09-12T02:31:30.309435+0000, chain.objs.size()=1 2024-09-12T00:38:38.013 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.013+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.hFuTW9Z2bEWlpBcLh1RBwNXE-8-thBY_0 2024-09-12T00:38:38.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.014+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1269523115319664688', time=2024-09-12T02:31:30.356276+0000, chain.objs.size()=1 2024-09-12T00:38:38.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.014+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.aig05ejeKHK61BRtYI560RgyuuJ-zde_0 2024-09-12T00:38:38.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.014+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10744382790537020919', time=2024-09-12T02:31:30.419307+0000, chain.objs.size()=1 2024-09-12T00:38:38.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.014+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.sDdAqRcbTjW_zaZG5VvqGOpWSS96NSo_0 2024-09-12T00:38:38.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.014+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16900976539663929956', time=2024-09-12T02:31:30.430729+0000, chain.objs.size()=1 2024-09-12T00:38:38.014 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.014+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.op3rwWg05d0yK4QD3VIiT7I0LgkB83c_0 2024-09-12T00:38:38.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.016+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2333571458828294888', time=2024-09-12T02:31:30.457576+0000, chain.objs.size()=1 2024-09-12T00:38:38.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.016+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.dbFfVcb4ftkXV9ODPpVgNTxbWinuId0_0 2024-09-12T00:38:38.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.016+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.697144976932995857', time=2024-09-12T02:31:30.601214+0000, chain.objs.size()=1 2024-09-12T00:38:38.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.016+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.FnKRqF5ZRygZ0imv32UuzjrAgrRkrXu_0 2024-09-12T00:38:38.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.017+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7343173806267748056', time=2024-09-12T02:31:30.616641+0000, chain.objs.size()=1 2024-09-12T00:38:38.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.017+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.l8O_q_LIBaocLl00VXiiuEs__7BlHwl_0 2024-09-12T00:38:38.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.017+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14441694497445181338', time=2024-09-12T02:31:30.669383+0000, chain.objs.size()=1 2024-09-12T00:38:38.016 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.017+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.vu97AxLFmyarp6nFPemofNavEwkz-Ef_0 2024-09-12T00:38:38.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.017+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6821493961658634079', time=2024-09-12T02:31:30.755861+0000, chain.objs.size()=1 2024-09-12T00:38:38.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.017+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.kCSpPs9XKGZNFn6buKJV6KTl4qqKByd_0 2024-09-12T00:38:38.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.017+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.185627475985678071', time=2024-09-12T02:31:30.905362+0000, chain.objs.size()=1 2024-09-12T00:38:38.017 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.017+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.I6GjoJ4b-0g5bEBhLic7txutNgHJlHZ_0 2024-09-12T00:38:38.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.020+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16679381371016420456', time=2024-09-12T02:31:30.946591+0000, chain.objs.size()=1 2024-09-12T00:38:38.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.020+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.tWZtHovp5XY3Mo7AZjQW1Zn7DlJcXbf_0 2024-09-12T00:38:38.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.020+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11648958665231283005', time=2024-09-12T02:31:30.952535+0000, chain.objs.size()=1 2024-09-12T00:38:38.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.020+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.GCP1u2hlWcomWeXS4plj69AlURj3Hg6_0 2024-09-12T00:38:38.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.020+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2736776420026228524', time=2024-09-12T02:31:31.005771+0000, chain.objs.size()=1 2024-09-12T00:38:38.019 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.020+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.f1CZU7w7PnbyugNWICAydOU524wvVp0_0 2024-09-12T00:38:38.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.020+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12118085720571548612', time=2024-09-12T02:31:31.141766+0000, chain.objs.size()=1 2024-09-12T00:38:38.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.020+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.N5-do5Xzjx7j5J8a0ATp__proKbr8u6_0 2024-09-12T00:38:38.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.020+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7169272741473895972', time=2024-09-12T02:31:31.163010+0000, chain.objs.size()=1 2024-09-12T00:38:38.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.020+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.U95wbQpKLdersB-uXf3F5uIIfnk61QF_0 2024-09-12T00:38:38.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.021+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9530516564721194217', time=2024-09-12T02:31:31.236830+0000, chain.objs.size()=1 2024-09-12T00:38:38.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.021+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.e-sXARZk_ujzhgtiXtdedWZr7EG_rCK_0 2024-09-12T00:38:38.020 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.021+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13906477830042247042', time=2024-09-12T02:31:31.241098+0000, chain.objs.size()=1 2024-09-12T00:38:38.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.021+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NPumrW34v-d6LbxMCNXa5N0Tn9edQFK_0 2024-09-12T00:38:38.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.022+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10585235210623719428', time=2024-09-12T02:31:31.269327+0000, chain.objs.size()=1 2024-09-12T00:38:38.021 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.022+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-XOIRdFxU5iMdogspLWkvB0x721jv1P_0 2024-09-12T00:38:38.026 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.027+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/44331 2024-09-12T00:38:38.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:38:38.029 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7706193802676477702', time=2024-09-12T02:31:31.453021+0000, chain.objs.size()=1 2024-09-12T00:38:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.H6VNr3qfy3n_eiIew1BjY50WdiJXBkj_0 2024-09-12T00:38:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8594876531179735301', time=2024-09-12T02:31:31.457064+0000, chain.objs.size()=1 2024-09-12T00:38:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.g__A-rtj7PzJQtVek_13hyHrJ14yCA0_0 2024-09-12T00:38:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2016460340556524304', time=2024-09-12T02:31:31.676264+0000, chain.objs.size()=1 2024-09-12T00:38:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.GAy_X4wAgV_lVUxxqI6zbxAaokAaklM_0 2024-09-12T00:38:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13783813791727108462', time=2024-09-12T02:31:31.693274+0000, chain.objs.size()=1 2024-09-12T00:38:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.2qiulmauKT84GomZ0DgfgFztf72AFaZ_0 2024-09-12T00:38:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6901699044807235261', time=2024-09-12T02:31:31.695049+0000, chain.objs.size()=1 2024-09-12T00:38:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._bf3gzV5k-IVY2zedApkePh4Cdw8-RB_0 2024-09-12T00:38:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1251049326424123853', time=2024-09-12T02:31:31.820544+0000, chain.objs.size()=1 2024-09-12T00:38:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.cNJ3O0qiDA_vqsu3VX4wrasX8n-CIvU_0 2024-09-12T00:38:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6035847252621413566', time=2024-09-12T02:32:05.726371+0000, chain.objs.size()=1 2024-09-12T00:38:38.030 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.456__shadow_.STeRG2oR4lPx3sI72Xd3t51od2ZqwMX_0 2024-09-12T00:38:38.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18444796417501341790', time=2024-09-12T02:32:13.894257+0000, chain.objs.size()=1 2024-09-12T00:38:38.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.487__shadow_.GiXqeboXu_yphvddYpb8QQJUThlJOUa_0 2024-09-12T00:38:38.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16460661273828071769', time=2024-09-12T02:32:14.205359+0000, chain.objs.size()=1 2024-09-12T00:38:38.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.488__shadow_._TISH4lPLRnXG_gGMBCOstZFnU21iRz_0 2024-09-12T00:38:38.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17148203333114812000', time=2024-09-12T02:32:18.346141+0000, chain.objs.size()=1 2024-09-12T00:38:38.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.503__shadow:ig1.iJ1ZviXIpIr.ZLyPeoYT.9MVwfX_.vO-G3V9zJdbWBBC0Ip0K0Zy9ROlszk8_0 2024-09-12T00:38:38.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1834903726559834613', time=2024-09-12T02:33:08.689997+0000, chain.objs.size()=1 2024-09-12T00:38:38.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.558__shadow_.SshElamaSVKQ7Om7LKodJLhavf7aj7e_0 2024-09-12T00:38:38.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5777176886673385159', time=2024-09-12T02:33:28.056707+0000, chain.objs.size()=1 2024-09-12T00:38:38.031 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.030+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.576__shadow:SrpbwaRl0Hr0MnpRt10SYnW7TyPV13K_.xRo3Q3gCeRC5YKw9zvsLH-1cXH3t5bp_0 2024-09-12T00:38:38.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.033+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16549717552826824580', time=2024-09-12T02:33:29.901652+0000, chain.objs.size()=1 2024-09-12T00:38:38.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.033+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.576__shadow:NA.wa9MejEiumAxmLwcbBaMmHIdMmM3_.WIQ9Z5XgN6yt50xCnOf4ufoTzwKhn86_0 2024-09-12T00:38:38.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.034+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10141048611360995609', time=2024-09-12T02:33:30.479863+0000, chain.objs.size()=1 2024-09-12T00:38:38.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.034+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.576__shadow:GFFrZ6kpZhUCxDHbyikuyTUVcuCNRn1_.30dZ4HKM6fVV23dAmLFdjmbJxlik2tb_0 2024-09-12T00:38:38.033 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.034+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7986784665682324080', time=2024-09-12T02:33:36.957484+0000, chain.objs.size()=1 2024-09-12T00:38:38.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.034+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:.KxWwbNsq7nUpDIfVXF4kObqrkrVx7Z_.O2PqbIGgoP52OJUZeIcUA3lZIMUDa2z_0 2024-09-12T00:38:38.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.034+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8399750237632277585', time=2024-09-12T02:33:41.219781+0000, chain.objs.size()=1 2024-09-12T00:38:38.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.034+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:-wWpbfiw0xUsA6mfRNEKSqTf1jVCZjq_.xjx1gJ_r-kTrxGi_Bmjo1w9OlHcypq9_0 2024-09-12T00:38:38.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.034+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14223583994030455749', time=2024-09-12T02:36:16.665875+0000, chain.objs.size()=1 2024-09-12T00:38:38.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.034+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.665__shadow_.h1y4zlVB46x_5zm9PxM9xlscHrbLgI3_0 2024-09-12T00:38:38.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.034+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10633646564596209285', time=2024-09-12T02:36:49.340952+0000, chain.objs.size()=1 2024-09-12T00:38:38.034 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.034+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.718__shadow_.GQTx2JbajFZ8pUYYADZMSVzjAtgecih_0 2024-09-12T00:38:38.037 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.038+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:38.040 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.041+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:38:38.041 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.042+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:38.042 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.042+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:38.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50160' 2024-09-12T00:38:38.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15160955713954802469', time=2024-09-12T02:29:24.890621+0000, chain.objs.size()=2 2024-09-12T00:38:38.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.uYh3Va1nh4GxFEy174X2anNRu3RdtcD_0 2024-09-12T00:38:38.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.uYh3Va1nh4GxFEy174X2anNRu3RdtcD_1 2024-09-12T00:38:38.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_sYEPGKF6raj_KmQiS4mZCYNAB4aDKle', time=2024-09-12T02:29:27.736607+0000, chain.objs.size()=2 2024-09-12T00:38:38.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.163__shadow_.GZNN5jeXuCSMoK5eENZfFg1TJaYnoa7_0 2024-09-12T00:38:38.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.163__shadow_.GZNN5jeXuCSMoK5eENZfFg1TJaYnoa7_1 2024-09-12T00:38:38.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6366365677934667233', time=2024-09-12T02:30:39.100326+0000, chain.objs.size()=1 2024-09-12T00:38:38.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.237__shadow_.FzAlaVThtjIMXgBfSsxcl48PzZy1t5o_0 2024-09-12T00:38:38.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15983042076123444739', time=2024-09-12T02:30:39.608574+0000, chain.objs.size()=1 2024-09-12T00:38:38.043 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.239__shadow_.Uzz8sQ3bGGCLJZTeLyzZg-M8p8mmW1t_0 2024-09-12T00:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13435797792569273218', time=2024-09-12T02:30:40.071822+0000, chain.objs.size()=1 2024-09-12T00:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.241__shadow_.hya7GrH6bqo_ZczmXQbVde2WswdXSIM_0 2024-09-12T00:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11494545424014459215', time=2024-09-12T02:30:53.153762+0000, chain.objs.size()=1 2024-09-12T00:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.LRF5UFvMRxPMfNpA5PsQ29XRA50SJkU_0 2024-09-12T00:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11508640843888645241', time=2024-09-12T02:30:53.158901+0000, chain.objs.size()=1 2024-09-12T00:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.5nDg6CXXl36hp1_Y5wat-4bOby9SHJc_0 2024-09-12T00:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.819995834902542718', time=2024-09-12T02:30:53.162989+0000, chain.objs.size()=1 2024-09-12T00:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.8B6CgoKiGV7vJXFZDRcp-iXgnugZcUE_0 2024-09-12T00:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17989330645491167376', time=2024-09-12T02:30:53.169415+0000, chain.objs.size()=1 2024-09-12T00:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.GoXE-RyHGxkRON1MX47Cnbkc3V7jT59_0 2024-09-12T00:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17357589987456265666', time=2024-09-12T02:30:53.177392+0000, chain.objs.size()=1 2024-09-12T00:38:38.044 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.043+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BAwqYHNZuBGsqR4wZs83V9HYO2pHRgS_0 2024-09-12T00:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.047+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1830321742283011803', time=2024-09-12T02:30:53.179775+0000, chain.objs.size()=1 2024-09-12T00:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.047+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YeWMVzq8fLXcum75lHKDiIMIFuwkMFN_0 2024-09-12T00:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.047+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13168376501862278270', time=2024-09-12T02:30:53.196119+0000, chain.objs.size()=1 2024-09-12T00:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.047+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.gyKvT9FRPmMnwEIvv21986DC4YNxQN1_0 2024-09-12T00:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.047+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12547913446751996012', time=2024-09-12T02:30:53.220732+0000, chain.objs.size()=1 2024-09-12T00:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.047+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BcDkDSMM_eVQGqgPUe7XIvj9I-3MpVI_0 2024-09-12T00:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.048+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.384992192392469945', time=2024-09-12T02:30:53.224846+0000, chain.objs.size()=1 2024-09-12T00:38:38.047 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.048+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.nM2oecCSdd7ANVzYnp943XInd4BrLi8_0 2024-09-12T00:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.049+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13083387526444246412', time=2024-09-12T02:30:53.274874+0000, chain.objs.size()=1 2024-09-12T00:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.049+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.F6hdqmVw4tOSFguG6puQAbnkAW84E5s_0 2024-09-12T00:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.049+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15432957238725751032', time=2024-09-12T02:30:53.283847+0000, chain.objs.size()=1 2024-09-12T00:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.049+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.P8RllOtkTWVFXSVUFsfTTlEbwvYkB3g_0 2024-09-12T00:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.049+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8286361073384196164', time=2024-09-12T02:30:53.441070+0000, chain.objs.size()=1 2024-09-12T00:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.049+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.I7xdZZ2fYZOs-yreuMOBMUV9NMoIOpr_0 2024-09-12T00:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.049+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7477692966214346371', time=2024-09-12T02:30:53.547985+0000, chain.objs.size()=1 2024-09-12T00:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.049+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.0lMhHsF0MoCsDAEXq8YATZN82gwR4lJ_0 2024-09-12T00:38:38.048 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.049+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10397410027771816222', time=2024-09-12T02:30:53.665078+0000, chain.objs.size()=1 2024-09-12T00:38:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.049+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YtWXoBjv7FXrNVYn8T9-JNrDchOzuxr_0 2024-09-12T00:38:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.049+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7110269741319017988', time=2024-09-12T02:30:53.700138+0000, chain.objs.size()=1 2024-09-12T00:38:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.049+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AKRFQE9aQl4Um2wWu9LSwMatQ19TpJb_0 2024-09-12T00:38:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.049+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1857704855570966071', time=2024-09-12T02:30:53.786162+0000, chain.objs.size()=1 2024-09-12T00:38:38.049 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.049+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ltBhPpTKHAb9_vi3UgGGDQbegzzhj6h_0 2024-09-12T00:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.053+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17431217830772041378', time=2024-09-12T02:30:53.794423+0000, chain.objs.size()=1 2024-09-12T00:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.053+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HXX1Fxde_NU-QLDfJpH2EDA5dBxga9A_0 2024-09-12T00:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.053+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5335117852617090589', time=2024-09-12T02:30:53.798110+0000, chain.objs.size()=1 2024-09-12T00:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.053+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.G-ECUJ1p_83b2YoA9TGtgwfonVcGFu-_0 2024-09-12T00:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.053+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.535005475765884917', time=2024-09-12T02:30:53.809340+0000, chain.objs.size()=1 2024-09-12T00:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.053+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.iXT9DBm-6AeoHgnTTpTGWuxtYS7Ives_0 2024-09-12T00:38:38.052 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.053+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3960303573918047741', time=2024-09-12T02:30:53.812619+0000, chain.objs.size()=1 2024-09-12T00:38:38.053 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.053+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Ywd3dyizODOjBxsNgDCBUfDB00s4pnL_0 2024-09-12T00:38:38.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.055+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3153359995512092710', time=2024-09-12T02:30:53.819066+0000, chain.objs.size()=1 2024-09-12T00:38:38.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.055+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BJDnZyqjI4YzDMszf-If1R-Xph6TGXK_0 2024-09-12T00:38:38.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.055+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15689919341078315699', time=2024-09-12T02:30:53.833475+0000, chain.objs.size()=1 2024-09-12T00:38:38.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.055+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Y1Z_7F32ma4GKQhjDSRriaZ9NnBiqkP_0 2024-09-12T00:38:38.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.055+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7531282469916966333', time=2024-09-12T02:30:53.970347+0000, chain.objs.size()=1 2024-09-12T00:38:38.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.055+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.wPIJjL1ylrY1B_vA8KWx1EjjQOpCp9w_0 2024-09-12T00:38:38.054 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.055+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7449128996114731504', time=2024-09-12T02:30:53.991651+0000, chain.objs.size()=1 2024-09-12T00:38:38.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.055+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.qkTU7i0VI_gxU9DAOjMN1CEnr4IAJI__0 2024-09-12T00:38:38.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.055+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.688704153386942969', time=2024-09-12T02:30:54.131641+0000, chain.objs.size()=1 2024-09-12T00:38:38.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.055+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ODwFGzdeAnFMTcoTGn1JOrZ0_nq-reQ_0 2024-09-12T00:38:38.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.055+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14094736625448134549', time=2024-09-12T02:30:54.146182+0000, chain.objs.size()=1 2024-09-12T00:38:38.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.055+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BlTHLCF9p9dihpKtdYZUep7EyQunpK0_0 2024-09-12T00:38:38.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.055+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16464865248632639354', time=2024-09-12T02:30:54.299538+0000, chain.objs.size()=1 2024-09-12T00:38:38.055 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.055+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.P62N2k-7okSuGgNDzelyUo2PYFk6VTx_0 2024-09-12T00:38:38.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.057+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18305658344860130877', time=2024-09-12T02:30:54.468514+0000, chain.objs.size()=1 2024-09-12T00:38:38.056 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.057+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.w1VxHkpuDPgOWNK--_YNTirhdmRH70W_0 2024-09-12T00:38:38.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8075615362643475153', time=2024-09-12T02:30:54.566095+0000, chain.objs.size()=1 2024-09-12T00:38:38.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JaVIBD61RybAu4-bOdIkIvOLSYqJ6Kf_0 2024-09-12T00:38:38.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7789148914775362866', time=2024-09-12T02:30:54.576493+0000, chain.objs.size()=1 2024-09-12T00:38:38.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.aIwWH387oyHEyWApnR-RZx1tSGDj86d_0 2024-09-12T00:38:38.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.058+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17483755170922647672', time=2024-09-12T02:30:54.624458+0000, chain.objs.size()=1 2024-09-12T00:38:38.057 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.058+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ul_lz-_2fKJOpWsqE-yf_gEXgl-lWQf_0 2024-09-12T00:38:38.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.060+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10193014192400942953', time=2024-09-12T02:30:54.634801+0000, chain.objs.size()=1 2024-09-12T00:38:38.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.060+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Z0kAeUZr-SPMOQ05g7M7JalIKnNjSz-_0 2024-09-12T00:38:38.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.060+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16540385654032755266', time=2024-09-12T02:30:54.644422+0000, chain.objs.size()=1 2024-09-12T00:38:38.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.060+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.A0HJau3nBQEBMfmC7FwUa4Mfc97Xpc6_0 2024-09-12T00:38:38.059 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.060+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16724846444562245279', time=2024-09-12T02:30:54.705311+0000, chain.objs.size()=1 2024-09-12T00:38:38.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.060+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.VkGr7TOsA3spjjvt-8jAm2LNcglxUU-_0 2024-09-12T00:38:38.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.061+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17764448321522570893', time=2024-09-12T02:30:54.963126+0000, chain.objs.size()=1 2024-09-12T00:38:38.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.061+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.KKl1-JjQoD-fP7qFZS-EmeUaa23xzNo_0 2024-09-12T00:38:38.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.061+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16761771355486062340', time=2024-09-12T02:30:54.971380+0000, chain.objs.size()=1 2024-09-12T00:38:38.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.061+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.zgT5zQxm4VzwL9LOJkPEVp_NxF68Tii_0 2024-09-12T00:38:38.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.061+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5168185948636270540', time=2024-09-12T02:30:55.153583+0000, chain.objs.size()=1 2024-09-12T00:38:38.060 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.061+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BUw3NBQKSZxdHsYrkIHJYaZ7QG1UfIT_0 2024-09-12T00:38:38.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.062+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11381858013521941387', time=2024-09-12T02:30:55.154594+0000, chain.objs.size()=1 2024-09-12T00:38:38.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.062+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.MDx_AX286MYrpnS646eUmQRbv80xc8V_0 2024-09-12T00:38:38.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.062+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3439180887563979155', time=2024-09-12T02:30:55.206444+0000, chain.objs.size()=1 2024-09-12T00:38:38.061 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.062+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.eyshQd5mKtANSKj5IDhlm2aGku7pLUV_0 2024-09-12T00:38:38.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.062+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8734128593144991454', time=2024-09-12T02:30:58.106421+0000, chain.objs.size()=1 2024-09-12T00:38:38.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.062+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.274__shadow_.tB-WcXkdASTSH9bX2KCXP1qZ4DMaISz_0 2024-09-12T00:38:38.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.062+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4315977067914131010', time=2024-09-12T02:30:59.587805+0000, chain.objs.size()=1 2024-09-12T00:38:38.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.062+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.280__shadow_.tSVlujwdTF-irUOvoCg3oIXVFzeYQ3O_0 2024-09-12T00:38:38.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.062+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12037639127374485791', time=2024-09-12T02:31:01.634017+0000, chain.objs.size()=1 2024-09-12T00:38:38.062 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.062+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.288__shadow_._-Sj2vQSkuz1IdzglKmm8uRjRx0RN1v_0 2024-09-12T00:38:38.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.064+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6066085727609354207', time=2024-09-12T02:31:03.051047+0000, chain.objs.size()=1 2024-09-12T00:38:38.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.064+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.xE4wgQjPKhS-ELTcCBtbTxyTN4qDhy9_0 2024-09-12T00:38:38.063 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.064+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8536182575667564900', time=2024-09-12T02:31:03.658883+0000, chain.objs.size()=1 2024-09-12T00:38:38.064 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.064+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.VSA6MYzTzskq_jfwUEFDG9yGPgDwL0r_0 2024-09-12T00:38:38.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.067+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15101510313674069702', time=2024-09-12T02:31:10.168492+0000, chain.objs.size()=1 2024-09-12T00:38:38.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.067+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.319__shadow:29O2DDYQGxbuSxQNmz7g0NNVZkkZFmL_.d4qlSucwyh0-jrQwyV5S9DsXWOPn2i3_0 2024-09-12T00:38:38.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.067+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16076295694150348559', time=2024-09-12T02:31:19.411095+0000, chain.objs.size()=1 2024-09-12T00:38:38.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.067+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Gl4WZi5QPsCe7uFRCHf7jyvuAn6L4HQ_0 2024-09-12T00:38:38.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.067+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10841084888414058794', time=2024-09-12T02:31:19.473538+0000, chain.objs.size()=1 2024-09-12T00:38:38.066 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.067+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.FnIr6zNLBuTvm6zjsegcpAUV7Ll9uA1_0 2024-09-12T00:38:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.067+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14304118909626166360', time=2024-09-12T02:31:19.484282+0000, chain.objs.size()=1 2024-09-12T00:38:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.067+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.mOiy-gZU-VWGbM4NFNWyfq6bTCY8Dpk_0 2024-09-12T00:38:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.067+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16563930256290767554', time=2024-09-12T02:31:19.507336+0000, chain.objs.size()=1 2024-09-12T00:38:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.067+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.auPm2PbKBzMTUWh2c3WcfUxmgLA8yh2_0 2024-09-12T00:38:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.067+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1230661736664762648', time=2024-09-12T02:31:19.530014+0000, chain.objs.size()=1 2024-09-12T00:38:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.067+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.KDdtVP2aHDmMlglHN0OnzjlnxRZLErl_0 2024-09-12T00:38:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12129637647351551543', time=2024-09-12T02:31:19.552137+0000, chain.objs.size()=1 2024-09-12T00:38:38.067 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.EPtUxfnp6192JYVYVGGWmzdG8vXNsuz_0 2024-09-12T00:38:38.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5827711858746471651', time=2024-09-12T02:31:19.670896+0000, chain.objs.size()=1 2024-09-12T00:38:38.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.5LS4Mb0ffdbcTCiAH5smOATMpZR39dD_0 2024-09-12T00:38:38.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.068+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13105621949413301635', time=2024-09-12T02:31:19.698322+0000, chain.objs.size()=1 2024-09-12T00:38:38.068 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.068+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.K87OfL4I86IBLuvPghTeCaOJaazCKoo_0 2024-09-12T00:38:38.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.071+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10962447672452106170', time=2024-09-12T02:31:19.805953+0000, chain.objs.size()=1 2024-09-12T00:38:38.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.071+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.PQr-CR-8gjrl2oWN99jykloQoUB-agM_0 2024-09-12T00:38:38.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.071+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7742732352498761015', time=2024-09-12T02:31:19.821274+0000, chain.objs.size()=1 2024-09-12T00:38:38.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.071+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.U9yPBP6gvKSbXEI9Q5bIjFBqDQRV5S4_0 2024-09-12T00:38:38.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.072+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10783416546905801622', time=2024-09-12T02:31:19.972912+0000, chain.objs.size()=1 2024-09-12T00:38:38.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.072+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.fO2Vkkhh7HyabLhX1RTOeO4S1K2Tsob_0 2024-09-12T00:38:38.071 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.072+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.184962227590315025', time=2024-09-12T02:31:20.079818+0000, chain.objs.size()=1 2024-09-12T00:38:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.072+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.XZNUFsSxMPj4B0tb5imdXGKcCbLSo6h_0 2024-09-12T00:38:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.072+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16860070622465112553', time=2024-09-12T02:31:20.278721+0000, chain.objs.size()=1 2024-09-12T00:38:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.072+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7YizBS2ElB14MkB4AXGH_1_4cQ9HSI0_0 2024-09-12T00:38:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.072+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5371935525958269836', time=2024-09-12T02:31:20.289242+0000, chain.objs.size()=1 2024-09-12T00:38:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.072+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.OHQRAj_rRzj_iOIrmzCT7P-DZWltXuR_0 2024-09-12T00:38:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.072+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6314550329583910410', time=2024-09-12T02:31:20.345804+0000, chain.objs.size()=1 2024-09-12T00:38:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.072+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Qjo-RBVZ6xJMBr-XJNnLOg0_SjfUkk-_0 2024-09-12T00:38:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.072+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10015335603442530442', time=2024-09-12T02:31:20.357783+0000, chain.objs.size()=1 2024-09-12T00:38:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.072+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.LY-gbLutheyxyN8G9ETolQJWzyOTjaa_0 2024-09-12T00:38:38.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.073+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3400300913702654588', time=2024-09-12T02:31:20.422492+0000, chain.objs.size()=1 2024-09-12T00:38:38.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.074+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.SCEzHIxec6pXC90QixTLka04os2aMgE_0 2024-09-12T00:38:38.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.074+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9098959136448260777', time=2024-09-12T02:31:20.449666+0000, chain.objs.size()=1 2024-09-12T00:38:38.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.074+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.MrfCSsZIIa438wuBs9hZHvbRtolCBtp_0 2024-09-12T00:38:38.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.074+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9166900716394223413', time=2024-09-12T02:31:20.563269+0000, chain.objs.size()=1 2024-09-12T00:38:38.073 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.074+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.uRtgPB0UuzxLKztrL8wwE16Hc9uIrmc_0 2024-09-12T00:38:38.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.076+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14094788489731574952', time=2024-09-12T02:31:20.639601+0000, chain.objs.size()=1 2024-09-12T00:38:38.075 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.076+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.9_FFYtMs6Nm0oT8Tlu2fOnQLcV90Qbs_0 2024-09-12T00:38:38.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.077+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15362768855758206775', time=2024-09-12T02:31:20.642173+0000, chain.objs.size()=1 2024-09-12T00:38:38.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.077+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.23jGOgIBBSczCNvwHTX04XvK3BxmhxH_0 2024-09-12T00:38:38.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.077+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4189806393289090683', time=2024-09-12T02:31:20.706298+0000, chain.objs.size()=1 2024-09-12T00:38:38.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.077+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.evt_xiHBSBvHntTxw6szOGgjpy33XCs_0 2024-09-12T00:38:38.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.077+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6890320324676285851', time=2024-09-12T02:31:20.876777+0000, chain.objs.size()=1 2024-09-12T00:38:38.076 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.077+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NrbcNWUAvV8dthfvAmiorXiZiWc2S6d_0 2024-09-12T00:38:38.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.078+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3606562710069739940', time=2024-09-12T02:31:20.887936+0000, chain.objs.size()=1 2024-09-12T00:38:38.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.078+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.loCWpSl3zkrc8OFvZMVQI8zm-XGssYf_0 2024-09-12T00:38:38.077 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.078+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10753272424497763989', time=2024-09-12T02:31:20.942886+0000, chain.objs.size()=1 2024-09-12T00:38:38.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.078+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.pKe-RKUQEtUGNLE1PniVZPKPSI8zAzs_0 2024-09-12T00:38:38.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.078+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14749726073996132350', time=2024-09-12T02:31:21.008275+0000, chain.objs.size()=1 2024-09-12T00:38:38.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.078+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.VhxYLc8ZksTNqao_c8esFqOTkTJ3O2G_0 2024-09-12T00:38:38.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.078+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9844553402949265543', time=2024-09-12T02:31:21.024808+0000, chain.objs.size()=1 2024-09-12T00:38:38.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.078+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Hu2zBZR7MdIY-_hBGRAL6hDZZ-xX3Fa_0 2024-09-12T00:38:38.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.078+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6344511106993272715', time=2024-09-12T02:31:21.173882+0000, chain.objs.size()=1 2024-09-12T00:38:38.078 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.078+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.aZG8dWI8Glz8NAtHXGri9XIf_FPJ4xM_0 2024-09-12T00:38:38.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.078+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2416575424414985349', time=2024-09-12T02:31:21.301816+0000, chain.objs.size()=1 2024-09-12T00:38:38.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.078+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.rWz3RbXoH1znaCDc9Y9Zf5xlepkeoAn_0 2024-09-12T00:38:38.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.079+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16538913286919585829', time=2024-09-12T02:31:29.750042+0000, chain.objs.size()=1 2024-09-12T00:38:38.079 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.079+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.0AKGEApJkxvTKOXcMfeS1dM1TbLH8eu_0 2024-09-12T00:38:38.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.081+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16203121985631220227', time=2024-09-12T02:31:29.866306+0000, chain.objs.size()=1 2024-09-12T00:38:38.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.081+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.KrleK-srkV5QyvDPZcce4BqKk3rb1aY_0 2024-09-12T00:38:38.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.081+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7496130990637359750', time=2024-09-12T02:31:30.126686+0000, chain.objs.size()=1 2024-09-12T00:38:38.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.081+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.6EWKzZH5sxEg17FihpoBy0Th_SaiTe5_0 2024-09-12T00:38:38.080 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.081+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15304335349100993020', time=2024-09-12T02:31:30.150352+0000, chain.objs.size()=1 2024-09-12T00:38:38.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.081+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.9ztdut1v4swQhWR9FIJ5Kp7T3wA6qiP_0 2024-09-12T00:38:38.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.081+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17807603665988523483', time=2024-09-12T02:31:30.283271+0000, chain.objs.size()=1 2024-09-12T00:38:38.081 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.081+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.zn9L93Ipo0nrogL3aek9BA1jnRQRNVm_0 2024-09-12T00:38:38.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.083+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1560935379138864304', time=2024-09-12T02:31:30.320100+0000, chain.objs.size()=1 2024-09-12T00:38:38.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.e6CBjHO6DVmZhTDdwAlhFkjPEfS9DAB_0 2024-09-12T00:38:38.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.083+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17914489268996838217', time=2024-09-12T02:31:30.415593+0000, chain.objs.size()=1 2024-09-12T00:38:38.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.xVA5xHcU5bEZxcJDd_nToH5gonQfQdd_0 2024-09-12T00:38:38.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.083+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1471299139725256148', time=2024-09-12T02:31:30.421394+0000, chain.objs.size()=1 2024-09-12T00:38:38.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-z8nvlq3FSpD-350nx-DbOcPd5Yo__v_0 2024-09-12T00:38:38.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.083+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10731427983316006272', time=2024-09-12T02:31:30.609088+0000, chain.objs.size()=1 2024-09-12T00:38:38.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.HXzdQVIVufG4EWtZTyAwTKmSCRHXqMg_0 2024-09-12T00:38:38.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.083+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14481085316566815510', time=2024-09-12T02:31:30.609903+0000, chain.objs.size()=1 2024-09-12T00:38:38.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.083+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.1PIdfYAG2XSk3l56UzLWl6heH4ukjH2_0 2024-09-12T00:38:38.083 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.084+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7954632675448123318', time=2024-09-12T02:31:30.718685+0000, chain.objs.size()=1 2024-09-12T00:38:38.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.084+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ErdN98MxAhIMnEPwcSeV-pVqukfPJqc_0 2024-09-12T00:38:38.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.084+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1753863748922551132', time=2024-09-12T02:31:30.877414+0000, chain.objs.size()=1 2024-09-12T00:38:38.084 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.084+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.PNz6MpnJNmjtyHSh80aZQvGUKbxSiHF_0 2024-09-12T00:38:38.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.086+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5062580895853162830', time=2024-09-12T02:31:30.908641+0000, chain.objs.size()=1 2024-09-12T00:38:38.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.086+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.MkXLtBaAwlfZTlYWX6HJkgn8LVkVihk_0 2024-09-12T00:38:38.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.086+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6287894980577023277', time=2024-09-12T02:31:30.972850+0000, chain.objs.size()=1 2024-09-12T00:38:38.085 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.086+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.an3F4iwHfn98i87xwTA8pz9i0wqhBtv_0 2024-09-12T00:38:38.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.087+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17261370031348448986', time=2024-09-12T02:31:31.012143+0000, chain.objs.size()=1 2024-09-12T00:38:38.086 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.087+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.0xC43C2808sK4Dx4rYSvQdnHBwdphkx_0 2024-09-12T00:38:38.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.087+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2505184761324408476', time=2024-09-12T02:31:31.030771+0000, chain.objs.size()=1 2024-09-12T00:38:38.087 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.087+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.oTGJ0qoGFYK0GoLxKaBkGLIJ3bGnLAr_0 2024-09-12T00:38:38.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.088+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11683856887634966845', time=2024-09-12T02:31:31.117765+0000, chain.objs.size()=1 2024-09-12T00:38:38.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.088+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.B-LqlziZUcNBWoZGsif7aJVSsI_-3y0_0 2024-09-12T00:38:38.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.088+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.211187930476537742', time=2024-09-12T02:31:31.121264+0000, chain.objs.size()=1 2024-09-12T00:38:38.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.088+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-KUM4N2ZOQmckjjKtJCj2zLEKxTgi6U_0 2024-09-12T00:38:38.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.088+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13110542184338992828', time=2024-09-12T02:31:31.137633+0000, chain.objs.size()=1 2024-09-12T00:38:38.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.088+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ZQZsGdI_Zog_OD8eG-xQJJ2_7WdbXKp_0 2024-09-12T00:38:38.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.088+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4853366453868036140', time=2024-09-12T02:31:31.165649+0000, chain.objs.size()=1 2024-09-12T00:38:38.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.088+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.SMkJC2d393Nk_aMz6CeYeR6Dg71AMOi_0 2024-09-12T00:38:38.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.088+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3451297561865661991', time=2024-09-12T02:31:31.190030+0000, chain.objs.size()=1 2024-09-12T00:38:38.088 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.088+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-z8untN2znU_kB-yTyAxog1cjmDfGJq_0 2024-09-12T00:38:38.093 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.093+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/50160 2024-09-12T00:38:38.095 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T00:38:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7542472302350571222', time=2024-09-12T02:31:31.203940+0000, chain.objs.size()=1 2024-09-12T00:38:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.j4p4n7ovnl663B-MkYorWeGyxYbqgmt_0 2024-09-12T00:38:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7243225785078303992', time=2024-09-12T02:31:31.207508+0000, chain.objs.size()=1 2024-09-12T00:38:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.4mtD32_Vw-L57ywtUw_4EdlKg4jM4k8_0 2024-09-12T00:38:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2676660093358918173', time=2024-09-12T02:31:31.250509+0000, chain.objs.size()=1 2024-09-12T00:38:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.KR0fBRuPYNMrdBnZAH3DZe602kHC7sR_0 2024-09-12T00:38:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11293514867883669422', time=2024-09-12T02:31:31.398962+0000, chain.objs.size()=1 2024-09-12T00:38:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.EPWe4pVt-0DrzQm6GSgPmwWLrssRdQV_0 2024-09-12T00:38:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10433265794857537744', time=2024-09-12T02:31:31.407785+0000, chain.objs.size()=1 2024-09-12T00:38:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.eE57jos2BOOblrzQnnH8MWB1sep5AkA_0 2024-09-12T00:38:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10304288337140258357', time=2024-09-12T02:31:31.521604+0000, chain.objs.size()=1 2024-09-12T00:38:38.096 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.vq1LdJGh9AXcHzlWTzLsAmNPTVBQQXK_0 2024-09-12T00:38:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5958446377712008297', time=2024-09-12T02:31:31.545909+0000, chain.objs.size()=1 2024-09-12T00:38:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.n2LHB3zLOuhj84gF3quxRqw15MO7Fn8_0 2024-09-12T00:38:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17621993574019029253', time=2024-09-12T02:31:31.556985+0000, chain.objs.size()=1 2024-09-12T00:38:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.HH7kw9A7wkztI7uPZRQXI0H3mg-JTWa_0 2024-09-12T00:38:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1136798900676798199', time=2024-09-12T02:31:31.673538+0000, chain.objs.size()=1 2024-09-12T00:38:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.eLkfJ-oGu8ibhuf-zjajb5CQ9XbCnh3_0 2024-09-12T00:38:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7479058046352384381', time=2024-09-12T02:31:31.687846+0000, chain.objs.size()=1 2024-09-12T00:38:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.nvBkryd9Tz93N0GsjHXkSdRJGnfBmAv_0 2024-09-12T00:38:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14784353122927580456', time=2024-09-12T02:31:31.698933+0000, chain.objs.size()=1 2024-09-12T00:38:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.jtbwBM3B8ES9W-lEUUoxsyHXh1XaDT0_0 2024-09-12T00:38:38.097 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3287168957731329430', time=2024-09-12T02:31:31.706800+0000, chain.objs.size()=1 2024-09-12T00:38:38.098 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.096+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.4tInaj7QXdFK_QflZUBxzNzFiH7BHRm_0 2024-09-12T00:38:38.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.099+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8963010490677538529', time=2024-09-12T02:31:31.801600+0000, chain.objs.size()=1 2024-09-12T00:38:38.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.099+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.2raMoUrW5nw912oSw_7Attw5x9fa6ee_0 2024-09-12T00:38:38.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.099+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10297452624152893001', time=2024-09-12T02:31:32.899595+0000, chain.objs.size()=1 2024-09-12T00:38:38.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.099+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.329__shadow_.kr9MZncRu-bwNyksjWVm93XGzE-Tra__0 2024-09-12T00:38:38.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.100+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7643509265184787032', time=2024-09-12T02:31:36.727200+0000, chain.objs.size()=1 2024-09-12T00:38:38.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.100+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.345__shadow_.9Y8ZaHSUUVsJOkF1Kf3Z71ZsprhD24o_0 2024-09-12T00:38:38.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.100+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14664147446493683952', time=2024-09-12T02:31:41.431022+0000, chain.objs.size()=1 2024-09-12T00:38:38.099 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.100+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.371__shadow_.Xsu8rI-76ILGzUDs1JAd1_6zRHgbiSf_0 2024-09-12T00:38:38.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.100+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10111015903423960069', time=2024-09-12T02:32:12.590635+0000, chain.objs.size()=1 2024-09-12T00:38:38.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.100+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.483__shadow_.531m5pXTbkyRKBLyDtAoSU_6IftKVx6_0 2024-09-12T00:38:38.100 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.101+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14396974636621604275', time=2024-09-12T02:32:15.165386+0000, chain.objs.size()=1 2024-09-12T00:38:38.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.101+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.491__shadow_.3H-rR6-EFJe4-pCTrFFbTIvnuSs4Mha_0 2024-09-12T00:38:38.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.101+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6746252748497428597', time=2024-09-12T02:32:15.997630+0000, chain.objs.size()=1 2024-09-12T00:38:38.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.101+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.496__shadow_.Bx8qCB5vrP4GbQ7gkpYnuifvwxjV5ZI_0 2024-09-12T00:38:38.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.101+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7568116736994145911', time=2024-09-12T02:32:27.670663+0000, chain.objs.size()=6 2024-09-12T00:38:38.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.101+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.SDh2IAEMAVLAxldUeF5xZ7cVvbvhBmMd.1 2024-09-12T00:38:38.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.101+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~wWRK7eNxRfhZnO8PZk3wvuiX012pWpR.2 2024-09-12T00:38:38.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.101+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~wWRK7eNxRfhZnO8PZk3wvuiX012pWpR.3 2024-09-12T00:38:38.101 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.101+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~wWRK7eNxRfhZnO8PZk3wvuiX012pWpR.4 2024-09-12T00:38:38.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.104+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~wWRK7eNxRfhZnO8PZk3wvuiX012pWpR.5 2024-09-12T00:38:38.103 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.104+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~wWRK7eNxRfhZnO8PZk3wvuiX012pWpR.6 2024-09-12T00:38:38.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.105+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~tS7KFzOR_KJH5pvN19ar0OA-C4wZ577', time=2024-09-12T02:32:29.499030+0000, chain.objs.size()=1 2024-09-12T00:38:38.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.105+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~tS7KFzOR_KJH5pvN19ar0OA-C4wZ577.2 2024-09-12T00:38:38.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.105+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~tS7KFzOR_KJH5pvN19ar0OA-C4wZ577', time=2024-09-12T02:32:29.500415+0000, chain.objs.size()=1 2024-09-12T00:38:38.104 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.105+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.522__multipart_mymultipart.2~tS7KFzOR_KJH5pvN19ar0OA-C4wZ577.3 2024-09-12T00:38:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.106+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~v5VdHJeBPow9sfjmvc9JfCfTCqjVtjZ', time=2024-09-12T02:32:36.449840+0000, chain.objs.size()=1 2024-09-12T00:38:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.106+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.531__multipart_mymultipart.2~v5VdHJeBPow9sfjmvc9JfCfTCqjVtjZ.1 2024-09-12T00:38:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.106+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='2~225fhpKw_HE8n1_6WBJzUzWpMqwBiAX', time=2024-09-12T02:33:10.040617+0000, chain.objs.size()=1 2024-09-12T00:38:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.106+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.561__multipart_mymultipart.2~225fhpKw_HE8n1_6WBJzUzWpMqwBiAX.1 2024-09-12T00:38:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.106+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17015025420346224301', time=2024-09-12T02:33:35.772678+0000, chain.objs.size()=1 2024-09-12T00:38:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.106+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:jEK8XLwpL9q8bafS.ehMVJwr9taTVkl_.8XIU_yUDJFYBcu-0ngKIrFSyjTA0kzz_0 2024-09-12T00:38:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.107+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8558408408634808123', time=2024-09-12T02:33:36.379695+0000, chain.objs.size()=1 2024-09-12T00:38:38.106 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.107+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:uK3Zb.5AGSa4orYU-GxkHbJRQOlQPb1_.4gFFTRCVnuDb8ru6cU0QdW-SIGiltMg_0 2024-09-12T00:38:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.108+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2851170771253897432', time=2024-09-12T02:33:45.862197+0000, chain.objs.size()=1 2024-09-12T00:38:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.109+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.579__shadow:fWQKjhAyEq1G9EzoFYAnEUnAfyAoA93_.Pn2EKkJxUhkKJGI6laKPgjAs1Omm6o7_0 2024-09-12T00:38:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.109+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3602896089271073792', time=2024-09-12T02:33:49.234540+0000, chain.objs.size()=1 2024-09-12T00:38:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.109+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.587__shadow:ppFX2RlMQhdClf10CNcVkvZMbk0ifmv_.Ly0KXaHKwm3q0U0gl8N1RL4ZR-36aqq_0 2024-09-12T00:38:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.109+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13025982176431482238', time=2024-09-12T02:33:53.273712+0000, chain.objs.size()=1 2024-09-12T00:38:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.109+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.606__shadow_.zz4HB7aWMPtzAt86f07MlyG3vwlQLiU_0 2024-09-12T00:38:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.109+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14755400977088565862', time=2024-09-12T02:36:07.479238+0000, chain.objs.size()=1 2024-09-12T00:38:38.108 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.109+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.640__shadow_.gq4TFE_6oQTUBKelmnU--c0M4rgkj_1_0 2024-09-12T00:38:38.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.110+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14038152881191232704', time=2024-09-12T02:36:11.097528+0000, chain.objs.size()=1 2024-09-12T00:38:38.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.110+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.651__shadow_.51c6TWdBkQFi19LPTZezeKiRyxfX2F3_0 2024-09-12T00:38:38.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.110+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12227541121407095238', time=2024-09-12T02:36:16.664388+0000, chain.objs.size()=1 2024-09-12T00:38:38.109 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.110+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.665__shadow_.7MgQka_DT_r9BAVbarZFVKF5-h0ZHj1_0 2024-09-12T00:38:38.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.112+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13517989678712110858', time=2024-09-12T02:36:17.249383+0000, chain.objs.size()=1 2024-09-12T00:38:38.111 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.112+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.666__shadow_.Ph3s5QmfY0bOLQyYYnfS6oxm9OSX2Xr_0 2024-09-12T00:38:38.115 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.116+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:38.118 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.119+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:38:38.119 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.120+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:38.120 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:38.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46247' 2024-09-12T00:38:38.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10011836820541768509', time=2024-09-12T02:29:24.717144+0000, chain.objs.size()=3 2024-09-12T00:38:38.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.159__multipart_mymultipart-STANDARD.2~oMec7w5nsxgl-P6JFqlsAXYSAiFNaF_.1 2024-09-12T00:38:38.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.159__multipart_mymultipart-STANDARD.2~oMec7w5nsxgl-P6JFqlsAXYSAiFNaF_.2 2024-09-12T00:38:38.121 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.159__multipart_mymultipart-STANDARD.2~oMec7w5nsxgl-P6JFqlsAXYSAiFNaF_.3 2024-09-12T00:38:38.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14652583725641193145', time=2024-09-12T02:30:37.246876+0000, chain.objs.size()=1 2024-09-12T00:38:38.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.230__shadow_.bvN7pCvAK9__zsN1IA5hyu5ipeF0xP4_0 2024-09-12T00:38:38.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11181249909385298460', time=2024-09-12T02:30:38.808173+0000, chain.objs.size()=1 2024-09-12T00:38:38.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.236__shadow_.5l_tFcD9nv65yMLaBXpvw1NfeYzgEn2_0 2024-09-12T00:38:38.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13247913257099866804', time=2024-09-12T02:30:42.889263+0000, chain.objs.size()=1 2024-09-12T00:38:38.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.252__shadow_.UeaoSGWcVzDAI_EU_fxNvn7sde7CDbd_0 2024-09-12T00:38:38.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7427262081340733142', time=2024-09-12T02:30:53.141003+0000, chain.objs.size()=1 2024-09-12T00:38:38.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.8Bynu2110zooERrWamsbIl9zteR5gL5_0 2024-09-12T00:38:38.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18325182731779855143', time=2024-09-12T02:30:53.145337+0000, chain.objs.size()=1 2024-09-12T00:38:38.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ZfQ_qCMrj1zOq-ebx2ANx6OBDiu-24H_0 2024-09-12T00:38:38.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14654406204048249690', time=2024-09-12T02:30:53.164580+0000, chain.objs.size()=1 2024-09-12T00:38:38.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.rxu2yDHcM45L93b2NZePzxjkackYW8Y_0 2024-09-12T00:38:38.122 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3664631324187465394', time=2024-09-12T02:30:53.174296+0000, chain.objs.size()=1 2024-09-12T00:38:38.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.E6qNdQMR5LcpopZpuVJCImQd11qYxrE_0 2024-09-12T00:38:38.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11230542099323661645', time=2024-09-12T02:30:53.233630+0000, chain.objs.size()=1 2024-09-12T00:38:38.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.n_iV1a0mfqVdcZ53DPkhPQh3SUkJp4I_0 2024-09-12T00:38:38.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16852222094576533848', time=2024-09-12T02:30:53.243838+0000, chain.objs.size()=1 2024-09-12T00:38:38.123 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.121+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.bDGQTsGW0iKeAzPq8DSfzwJwF3t5TPk_0 2024-09-12T00:38:38.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.125+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2182751868492227953', time=2024-09-12T02:30:53.267905+0000, chain.objs.size()=1 2024-09-12T00:38:38.124 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.125+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.mWg4SdXukLi3tzJ-J3OEd7CnVoi_hmy_0 2024-09-12T00:38:38.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.126+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4378306761020952966', time=2024-09-12T02:30:53.288682+0000, chain.objs.size()=1 2024-09-12T00:38:38.125 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.126+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2eczx_nRdM926BAZ7Xg_uZ6yyN8X6Db_0 2024-09-12T00:38:38.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18172535320055621405', time=2024-09-12T02:30:53.297108+0000, chain.objs.size()=1 2024-09-12T00:38:38.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.cRdAMLiUgRqD15DnobrJmnGNMuhm3ip_0 2024-09-12T00:38:38.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9453572179688099058', time=2024-09-12T02:30:53.297823+0000, chain.objs.size()=1 2024-09-12T00:38:38.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.uxKUkDmaxq4W6BzAw1WD0yKmXkULka__0 2024-09-12T00:38:38.127 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14983464099270830856', time=2024-09-12T02:30:53.299313+0000, chain.objs.size()=1 2024-09-12T00:38:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.EuqOuBkumHo-nnG0cz97DjRUV278DT9_0 2024-09-12T00:38:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9475631068117626514', time=2024-09-12T02:30:53.306661+0000, chain.objs.size()=1 2024-09-12T00:38:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.PxXEAFT-aWlI7GtzL0tLVqcv3UPyDW2_0 2024-09-12T00:38:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13460114242997651825', time=2024-09-12T02:30:53.489643+0000, chain.objs.size()=1 2024-09-12T00:38:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.uT-14NwSTPHQGjHIixaJvG_4vN8cL03_0 2024-09-12T00:38:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2879235724525731430', time=2024-09-12T02:30:53.495308+0000, chain.objs.size()=1 2024-09-12T00:38:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.z5Sa4kiWuF7klVZXVBSf-HgUDs27wce_0 2024-09-12T00:38:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18027881562153079659', time=2024-09-12T02:30:53.664827+0000, chain.objs.size()=1 2024-09-12T00:38:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.UrrI5heohzfU_RU1jbzo0eh2y5nzbYG_0 2024-09-12T00:38:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5189859225441922345', time=2024-09-12T02:30:53.692240+0000, chain.objs.size()=1 2024-09-12T00:38:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.E5DOG6yPyXO_2pnceLnLpKaKbaupCmK_0 2024-09-12T00:38:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8817830850716532078', time=2024-09-12T02:30:53.714004+0000, chain.objs.size()=1 2024-09-12T00:38:38.128 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ePIPid1XXPA2HhKrR2Bri6wy_xFwhNd_0 2024-09-12T00:38:38.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11242523562701789083', time=2024-09-12T02:30:54.042109+0000, chain.objs.size()=1 2024-09-12T00:38:38.129 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.128+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2MR5zoD-cVBjrfZlU3HzuZWaJmdPDGC_0 2024-09-12T00:38:38.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.130+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7010452238764622711', time=2024-09-12T02:30:54.067963+0000, chain.objs.size()=1 2024-09-12T00:38:38.130 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.130+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YvaXyi9IiYhBlV_9qq4-OMQ8xoYY2Sq_0 2024-09-12T00:38:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.133+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16791085892026554296', time=2024-09-12T02:30:54.132177+0000, chain.objs.size()=1 2024-09-12T00:38:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.133+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.5Vn8k4_fHeK4hkN-cJTVp7TThxVEcKf_0 2024-09-12T00:38:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.133+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13007893028489595492', time=2024-09-12T02:30:54.160857+0000, chain.objs.size()=1 2024-09-12T00:38:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.133+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.HCBsmHSfQeinU4V-Zq0799TN8he6mYg_0 2024-09-12T00:38:38.132 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.133+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13846594558714131675', time=2024-09-12T02:30:54.264246+0000, chain.objs.size()=1 2024-09-12T00:38:38.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.133+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.lrMvLCotSLCZAvTTu1Mo8LZ02rDTlVT_0 2024-09-12T00:38:38.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.133+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15502553536490865500', time=2024-09-12T02:30:54.272982+0000, chain.objs.size()=1 2024-09-12T00:38:38.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.133+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.95ZAVWBvSflfD6kNTCuT1k49JUzO4mL_0 2024-09-12T00:38:38.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.133+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11484789378848385618', time=2024-09-12T02:30:54.360997+0000, chain.objs.size()=1 2024-09-12T00:38:38.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.133+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.fY0m5eU-n0ejb6GvqUT75yeHI2YYmTm_0 2024-09-12T00:38:38.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.133+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14417361401740808334', time=2024-09-12T02:30:54.415653+0000, chain.objs.size()=1 2024-09-12T00:38:38.133 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.133+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JWtJVPyZEUa3RbslfIo99mcMyY9lIIZ_0 2024-09-12T00:38:38.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.133+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3065081055842364539', time=2024-09-12T02:30:54.438363+0000, chain.objs.size()=1 2024-09-12T00:38:38.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.133+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YDNE3t0yTEI-9ySpzDuUZBfO3pbOQUQ_0 2024-09-12T00:38:38.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.134+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8432085894990238431', time=2024-09-12T02:30:54.449226+0000, chain.objs.size()=1 2024-09-12T00:38:38.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.134+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_._GR4cDqjixhGvxKKRCI26l3UpHe6TBM_0 2024-09-12T00:38:38.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.134+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11454209554368422915', time=2024-09-12T02:30:54.473387+0000, chain.objs.size()=1 2024-09-12T00:38:38.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.134+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.cEqd0K3D7rfKKug13B1NyM7AUSeVerf_0 2024-09-12T00:38:38.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.134+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5352429085699831291', time=2024-09-12T02:30:54.565614+0000, chain.objs.size()=1 2024-09-12T00:38:38.134 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.134+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.84cST_mKoWNx1xHQMQkpietXPE76f-F_0 2024-09-12T00:38:38.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.137+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7320437551097801275', time=2024-09-12T02:30:54.679228+0000, chain.objs.size()=1 2024-09-12T00:38:38.136 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.137+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.4Wc_ee5ZpHhqJJ7nGBd76Gm6sn3CTF4_0 2024-09-12T00:38:38.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.139+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11944069749470957857', time=2024-09-12T02:30:54.876952+0000, chain.objs.size()=1 2024-09-12T00:38:38.138 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.139+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2GGQ7y8ANnQzB7znCzv2cw2mxkv3MFH_0 2024-09-12T00:38:38.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.139+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7207696206131406352', time=2024-09-12T02:30:54.894147+0000, chain.objs.size()=1 2024-09-12T00:38:38.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.139+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.rVtsrZQMT_Cc3tUKmdpb6Kq6wIs-FEN_0 2024-09-12T00:38:38.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.139+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10394229631140749228', time=2024-09-12T02:30:54.901842+0000, chain.objs.size()=1 2024-09-12T00:38:38.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.139+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Iw-C6ATsgx3QLDc-T-lxFsa0HPe-JWb_0 2024-09-12T00:38:38.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.139+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11702229896481748843', time=2024-09-12T02:30:54.908177+0000, chain.objs.size()=1 2024-09-12T00:38:38.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.139+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.MhjCqabGkJCR5I2KzhrQw9lO5D0CirD_0 2024-09-12T00:38:38.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.139+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13448662454163772284', time=2024-09-12T02:30:54.920496+0000, chain.objs.size()=1 2024-09-12T00:38:38.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.139+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.XUoKn69RyeORH6r58ivBpBXN1lSML9t_0 2024-09-12T00:38:38.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.139+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14017587164859280155', time=2024-09-12T02:30:55.141361+0000, chain.objs.size()=1 2024-09-12T00:38:38.139 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.139+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.mFiVT_6gxiX77Vn0PawFcMrT7lqO8PQ_0 2024-09-12T00:38:38.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.141+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7888606717446365196', time=2024-09-12T02:30:55.183542+0000, chain.objs.size()=1 2024-09-12T00:38:38.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.141+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.FKq20FoobrNKOjuzwk3rSEVsn8KJBou_0 2024-09-12T00:38:38.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.141+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7578487918632511799', time=2024-09-12T02:30:55.220850+0000, chain.objs.size()=1 2024-09-12T00:38:38.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.141+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.owUaNO1ucoiIUs9sJpor9xfVvvV6H9B_0 2024-09-12T00:38:38.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.141+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2173995740339646987', time=2024-09-12T02:30:55.722205+0000, chain.objs.size()=1 2024-09-12T00:38:38.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.141+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.264__shadow_.JW5hZHEndKQsnxeMmEVBjsULMY7NJsv_0 2024-09-12T00:38:38.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.141+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9537912032291669447', time=2024-09-12T02:30:56.654610+0000, chain.objs.size()=1 2024-09-12T00:38:38.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.141+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.268__shadow_.R1kxxCjA-_B7MPDfFAoU3OqxjdDanzk_0 2024-09-12T00:38:38.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.141+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8919188416040893517', time=2024-09-12T02:30:58.107047+0000, chain.objs.size()=1 2024-09-12T00:38:38.141 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.141+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.274__shadow_._vYUJrfrMlTprZl2Ad90fNYZhs2Emsu_0 2024-09-12T00:38:38.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.144+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8034378683129852172', time=2024-09-12T02:30:59.825238+0000, chain.objs.size()=1 2024-09-12T00:38:38.143 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.144+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.281__shadow_.ce3ms_MvC2ZHLfyxV8CLAEjs8fs0ibd_0 2024-09-12T00:38:38.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.144+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18028813422729699461', time=2024-09-12T02:30:59.826014+0000, chain.objs.size()=1 2024-09-12T00:38:38.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.144+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.281__shadow_.ONeiqLtexFhDky96XM95K7N_XoplEgk_0 2024-09-12T00:38:38.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.144+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.704961470557317161', time=2024-09-12T02:31:00.065447+0000, chain.objs.size()=1 2024-09-12T00:38:38.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.144+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.282__shadow_.VxqMtQcXudLJW3kQZwF3LouZz9Whd6j_0 2024-09-12T00:38:38.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.144+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11114925603440589148', time=2024-09-12T02:31:19.380042+0000, chain.objs.size()=1 2024-09-12T00:38:38.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.144+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.x50jgsGPBppvJruIHgVYkjlMo3mtEH5_0 2024-09-12T00:38:38.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.144+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17024455530778510664', time=2024-09-12T02:31:19.422864+0000, chain.objs.size()=1 2024-09-12T00:38:38.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.144+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.8zB3zChmvKn_YyRc93AbsvXdJQVacY0_0 2024-09-12T00:38:38.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.144+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6673886445732833147', time=2024-09-12T02:31:19.429311+0000, chain.objs.size()=1 2024-09-12T00:38:38.144 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.144+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.964N3R5DIPpjVjceJyY_-I4mggSjyIt_0 2024-09-12T00:38:38.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.146+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8824265249556709447', time=2024-09-12T02:31:19.455014+0000, chain.objs.size()=1 2024-09-12T00:38:38.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.146+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.BI27fU9jt2yOuiz552T0fUhwSJ8zMHN_0 2024-09-12T00:38:38.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.146+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2075851396190793453', time=2024-09-12T02:31:19.501015+0000, chain.objs.size()=1 2024-09-12T00:38:38.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.146+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.BU5T3_yqQBRxXOqKzoftXGAwOgIIetM_0 2024-09-12T00:38:38.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.146+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5314268911040376876', time=2024-09-12T02:31:19.816250+0000, chain.objs.size()=1 2024-09-12T00:38:38.145 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.146+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.W37h7ODwoHHaRQQ1MCLfpvE-DkTM0qX_0 2024-09-12T00:38:38.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.148+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16508895098233113022', time=2024-09-12T02:31:19.850039+0000, chain.objs.size()=1 2024-09-12T00:38:38.147 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.148+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.qVYnKwY7jhFG6wAHy1l4ABACgT7hur5_0 2024-09-12T00:38:38.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.148+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16042869001334674292', time=2024-09-12T02:31:19.865559+0000, chain.objs.size()=1 2024-09-12T00:38:38.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.148+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.lvGFYksLFkix_yBFxOMUMachHizWmkZ_0 2024-09-12T00:38:38.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.148+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.811799231550523155', time=2024-09-12T02:31:20.067265+0000, chain.objs.size()=1 2024-09-12T00:38:38.148 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.148+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.G8UrB-pJxd42vL8ypNGimaP-Yfw9IIy_0 2024-09-12T00:38:38.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.151+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7130603040119443706', time=2024-09-12T02:31:20.109742+0000, chain.objs.size()=1 2024-09-12T00:38:38.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.151+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.LtsN3zFsmVYo4ERG1sPakz1uFJ-vO3Z_0 2024-09-12T00:38:38.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14586809974387653055', time=2024-09-12T02:31:20.116006+0000, chain.objs.size()=1 2024-09-12T00:38:38.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.NvHz14nzs5GvavSIbwZL0schX126bQr_0 2024-09-12T00:38:38.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3271551565630993314', time=2024-09-12T02:31:20.261651+0000, chain.objs.size()=1 2024-09-12T00:38:38.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Et_ODWHK226Cm6ZalW4kSZ7Zi0kCimp_0 2024-09-12T00:38:38.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10044870028996906427', time=2024-09-12T02:31:20.349202+0000, chain.objs.size()=1 2024-09-12T00:38:38.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.8iAKzqKw0vFoPLEXfpdoKvgwrxn7J9g_0 2024-09-12T00:38:38.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11957458910133629896', time=2024-09-12T02:31:20.395696+0000, chain.objs.size()=1 2024-09-12T00:38:38.151 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.CsWCDc8nPzZYyiVXy_az2RHu77T0h4e_0 2024-09-12T00:38:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15530418381375454440', time=2024-09-12T02:31:20.439346+0000, chain.objs.size()=1 2024-09-12T00:38:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7RAOwjH_gIGVpFMTsTLLvxqFmx6woQc_0 2024-09-12T00:38:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13114154402508683127', time=2024-09-12T02:31:20.574430+0000, chain.objs.size()=1 2024-09-12T00:38:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.kYBKo7FGD2tRv0UrJNklAoVWAQTpiEG_0 2024-09-12T00:38:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4300602699850075898', time=2024-09-12T02:31:20.635547+0000, chain.objs.size()=1 2024-09-12T00:38:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.QKpugULFbMsEYb0bYklLkYD3y4Kf3Ks_0 2024-09-12T00:38:38.152 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14328414471317638636', time=2024-09-12T02:31:20.673569+0000, chain.objs.size()=1 2024-09-12T00:38:38.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.152+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.-cC2S66dXuOH03zzBsSyG-hN06LcnwT_0 2024-09-12T00:38:38.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.153+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6264562489086271058', time=2024-09-12T02:31:20.961638+0000, chain.objs.size()=1 2024-09-12T00:38:38.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.153+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JRsNh3lFRQYPS1OygTS82LpQNfAh-s2_0 2024-09-12T00:38:38.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.153+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2513898519293051752', time=2024-09-12T02:31:20.990399+0000, chain.objs.size()=1 2024-09-12T00:38:38.153 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.153+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.bZmlfXazgSoWjUgfrHT2Ltu5ooqa1pW_0 2024-09-12T00:38:38.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.155+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13784890028759200260', time=2024-09-12T02:31:21.062039+0000, chain.objs.size()=1 2024-09-12T00:38:38.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.155+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ZBKcWbN_F1PLfSX1UGLkXJMX2lfnh-K_0 2024-09-12T00:38:38.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.155+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11615039642904238511', time=2024-09-12T02:31:21.072609+0000, chain.objs.size()=1 2024-09-12T00:38:38.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.155+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Zwh1ilSJfM2jXFQFmtBi2Am7RWi4T6P_0 2024-09-12T00:38:38.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.155+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12666383979327258575', time=2024-09-12T02:31:21.171115+0000, chain.objs.size()=1 2024-09-12T00:38:38.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.155+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.yyCLCMqapIBhaFRWkBjjyyeVTpzf0Fz_0 2024-09-12T00:38:38.155 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17081130820832240252', time=2024-09-12T02:31:21.183933+0000, chain.objs.size()=1 2024-09-12T00:38:38.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.hvw_feGStNDpIUDc4x1eQsPlJF37QnD_0 2024-09-12T00:38:38.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9986323404900831350', time=2024-09-12T02:31:21.195643+0000, chain.objs.size()=1 2024-09-12T00:38:38.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.758Zb3Xuduf5BWf8dTlGEyW7zR2ojvl_0 2024-09-12T00:38:38.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5828226913107652330', time=2024-09-12T02:31:21.215473+0000, chain.objs.size()=1 2024-09-12T00:38:38.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.PFFisVkZwy2zi4yNyjSGP26vAT2v_2S_0 2024-09-12T00:38:38.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.156+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.488410456201638766', time=2024-09-12T02:31:21.246862+0000, chain.objs.size()=1 2024-09-12T00:38:38.156 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.156+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.sIK496VmFaij58kIXpHmSlKj3p_2hR7_0 2024-09-12T00:38:38.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.158+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3920386076015280801', time=2024-09-12T02:31:21.268108+0000, chain.objs.size()=1 2024-09-12T00:38:38.157 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.158+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.D0kJaUCkBRUNxQONSYxcnhEkyeUg4_B_0 2024-09-12T00:38:38.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.158+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3273697981596398997', time=2024-09-12T02:31:21.318606+0000, chain.objs.size()=1 2024-09-12T00:38:38.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.158+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.e5AMWYmv9kqLd8sgCd1shTLrgy8hAPU_0 2024-09-12T00:38:38.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.158+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.501725004108571773', time=2024-09-12T02:31:21.494535+0000, chain.objs.size()=1 2024-09-12T00:38:38.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.158+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.rF7TUAwO1X02uDIpOrskaPlKHkp54bJ_0 2024-09-12T00:38:38.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.158+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11788788733386015885', time=2024-09-12T02:31:21.568141+0000, chain.objs.size()=1 2024-09-12T00:38:38.158 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.158+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.EzBfnRrCzNKgyhSqbDX66Eq-3tEhUP8_0 2024-09-12T00:38:38.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.160+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17884381321233931369', time=2024-09-12T02:31:21.604502+0000, chain.objs.size()=1 2024-09-12T00:38:38.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.160+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.kdlkKUTd9hgpuLXJEefVUi6hyryirUN_0 2024-09-12T00:38:38.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.160+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5492848844593988865', time=2024-09-12T02:31:29.769161+0000, chain.objs.size()=1 2024-09-12T00:38:38.159 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.160+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.q3Oj5lAyHRdlR5f0oFZV_E0IgzyvCln_0 2024-09-12T00:38:38.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.161+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7176451352301126809', time=2024-09-12T02:31:29.807230+0000, chain.objs.size()=1 2024-09-12T00:38:38.160 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.161+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.XNBeSBOuV2sTs1Es2DKGQXHkxrX1a1Z_0 2024-09-12T00:38:38.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.162+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11438361001024308167', time=2024-09-12T02:31:29.833439+0000, chain.objs.size()=1 2024-09-12T00:38:38.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.162+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-6_PMXbmwHUxwmIXoUgI3J9PcKWfjtK_0 2024-09-12T00:38:38.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.162+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12738153511043435790', time=2024-09-12T02:31:29.846234+0000, chain.objs.size()=1 2024-09-12T00:38:38.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.162+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Fg56GTfdzU2gsWHjDcuYOBe_NhApt7J_0 2024-09-12T00:38:38.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.162+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17360888541709773979', time=2024-09-12T02:31:30.023851+0000, chain.objs.size()=1 2024-09-12T00:38:38.161 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.162+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.wzD0d7P4Z8Aru59ewg_D_G6MGQbq3ae_0 2024-09-12T00:38:38.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.163+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15037476911820261625', time=2024-09-12T02:31:30.059322+0000, chain.objs.size()=1 2024-09-12T00:38:38.162 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.163+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.wWoHFUsZrSb0NGbMs_ZEFbRyHXkI6cz_0 2024-09-12T00:38:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.164+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11604164889589614135', time=2024-09-12T02:31:30.089167+0000, chain.objs.size()=1 2024-09-12T00:38:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.164+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.LyBU40QxFiiT2xK7LC4b34a-bUzmvTR_0 2024-09-12T00:38:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.164+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1561948370135114799', time=2024-09-12T02:31:30.163618+0000, chain.objs.size()=1 2024-09-12T00:38:38.163 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.164+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.A8VOcA4iwUB2QHoPMSKzoKWpMRWumR__0 2024-09-12T00:38:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.165+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8425730732474275403', time=2024-09-12T02:31:30.187937+0000, chain.objs.size()=1 2024-09-12T00:38:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.165+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.l3PkrZcQnX3bhWm2FGWFOKIaKbVhIQ3_0 2024-09-12T00:38:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.165+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16214008105665725526', time=2024-09-12T02:31:30.286366+0000, chain.objs.size()=1 2024-09-12T00:38:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.165+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.CC0T-Ssps7WOdxLBBg4UKRnCNq__KJf_0 2024-09-12T00:38:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.165+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13434584027460670847', time=2024-09-12T02:31:30.292671+0000, chain.objs.size()=1 2024-09-12T00:38:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.165+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lYW8GnlJrnXXjNvOgeamhNAnuQC8zO__0 2024-09-12T00:38:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.165+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6583602668360081030', time=2024-09-12T02:31:30.298235+0000, chain.objs.size()=1 2024-09-12T00:38:38.164 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.165+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.va5CtAaXdYSCjsFiQrLjH7dkgeEA5JM_0 2024-09-12T00:38:38.166 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9054422586263368600', time=2024-09-12T02:31:30.356798+0000, chain.objs.size()=1 2024-09-12T00:38:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.167+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ni39zXICdNKb21f7mbOwXC0SltrMd2y_0 2024-09-12T00:38:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11689774872746176786', time=2024-09-12T02:31:30.378607+0000, chain.objs.size()=1 2024-09-12T00:38:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.167+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.oGHCUNFc1go6MRL1gQEKD-6rkZx1n6z_0 2024-09-12T00:38:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2780223766571293689', time=2024-09-12T02:31:30.475544+0000, chain.objs.size()=1 2024-09-12T00:38:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.167+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.9XRLhPB0dS5XZ81VkfBuwfABbOmRH1r_0 2024-09-12T00:38:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11823660303161560736', time=2024-09-12T02:31:30.566122+0000, chain.objs.size()=1 2024-09-12T00:38:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.167+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._rbn3OUUt3vyzrnJvRMoJizB7cv8ONa_0 2024-09-12T00:38:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.167+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5080946811505948569', time=2024-09-12T02:31:30.655138+0000, chain.objs.size()=1 2024-09-12T00:38:38.167 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.167+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._IERc1sqkwHTbL22lHLyCySM1i1zQoT_0 2024-09-12T00:38:38.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.168+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7285324471273794785', time=2024-09-12T02:31:30.747614+0000, chain.objs.size()=1 2024-09-12T00:38:38.168 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.168+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.QyhN_dcSoH4pweQEfSLcDhBqszuSz_U_0 2024-09-12T00:38:38.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.170+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1851165353763601170', time=2024-09-12T02:31:30.850694+0000, chain.objs.size()=1 2024-09-12T00:38:38.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.170+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.P720-_t7abQyPGOxog0jT9cu9OGhRzR_0 2024-09-12T00:38:38.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.170+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3911862281641725805', time=2024-09-12T02:31:30.895287+0000, chain.objs.size()=1 2024-09-12T00:38:38.169 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.170+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.h-JOZgDObdrzFTBzH82SIaASkgGik9R_0 2024-09-12T00:38:38.173 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.174+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/46247 2024-09-12T00:38:38.176 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T00:38:38.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6808174251160612060', time=2024-09-12T02:31:30.927055+0000, chain.objs.size()=1 2024-09-12T00:38:38.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.7wjz1gWezB6NC0xMf1Neaevov7WVjxz_0 2024-09-12T00:38:38.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17058007807273175918', time=2024-09-12T02:31:31.168921+0000, chain.objs.size()=1 2024-09-12T00:38:38.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.56ho78FTxUbwLBUzUXzbrpRg6FWFB9G_0 2024-09-12T00:38:38.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9048108423826054248', time=2024-09-12T02:31:31.184239+0000, chain.objs.size()=1 2024-09-12T00:38:38.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.itMYd6lWDcv9QVrYC6Cry-X0zcmJklY_0 2024-09-12T00:38:38.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3636647318797723584', time=2024-09-12T02:31:31.411041+0000, chain.objs.size()=1 2024-09-12T00:38:38.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.KQ48b5QGpRSrxDYJZDMvSUP_bQDR3JY_0 2024-09-12T00:38:38.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10952565861069503081', time=2024-09-12T02:31:31.416277+0000, chain.objs.size()=1 2024-09-12T00:38:38.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.EFgp53owqg3z_xsrDJj4ik5t20Bs7uD_0 2024-09-12T00:38:38.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3249410758649202526', time=2024-09-12T02:31:31.493846+0000, chain.objs.size()=1 2024-09-12T00:38:38.177 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.yemGHDbIYiZKaH7P0GWkkZM0nxFpEc3_0 2024-09-12T00:38:38.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1702686474496441899', time=2024-09-12T02:31:31.504354+0000, chain.objs.size()=1 2024-09-12T00:38:38.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.VSrbCGdPiMLCFTnee4_lm4-8aRBBLU8_0 2024-09-12T00:38:38.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9457034377771143683', time=2024-09-12T02:31:31.766338+0000, chain.objs.size()=1 2024-09-12T00:38:38.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.btNxOvkNYhxKFjkewsmccQfi31arpHS_0 2024-09-12T00:38:38.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.627349026050765979', time=2024-09-12T02:31:32.216938+0000, chain.objs.size()=1 2024-09-12T00:38:38.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.326__shadow_.S6iSGI8Bcr_qn-yhPJRbZrkecGhwCx8_0 2024-09-12T00:38:38.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10252710833054689902', time=2024-09-12T02:31:32.433251+0000, chain.objs.size()=1 2024-09-12T00:38:38.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.327__shadow_.pExLOFL7zhMkcypbdjdbZQH43VkJmQ5_0 2024-09-12T00:38:38.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5837142065816295205', time=2024-09-12T02:32:00.888833+0000, chain.objs.size()=1 2024-09-12T00:38:38.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.439__shadow_.7MRTkUMv7np2PdTtaRLElLOMrvpT-x-_0 2024-09-12T00:38:38.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2475235228227434885', time=2024-09-12T02:32:01.238890+0000, chain.objs.size()=1 2024-09-12T00:38:38.178 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.177+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.440__shadow_.BkPVK_7j3MvtKPbW4M8l3T5-4dop6oS_0 2024-09-12T00:38:38.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.181+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5441483562945704035', time=2024-09-12T02:32:07.686284+0000, chain.objs.size()=1 2024-09-12T00:38:38.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.181+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.461__shadow_.usk9fT2WG5ty644agotwmAkebfvVlC8_0 2024-09-12T00:38:38.180 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.181+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18242075340423864555', time=2024-09-12T02:32:16.965458+0000, chain.objs.size()=1 2024-09-12T00:38:38.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.181+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.499__shadow_.eZMSxHa7UUiviwBdt5w9C84TnLLDIiY_0 2024-09-12T00:38:38.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.181+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12747786251028482227', time=2024-09-12T02:32:17.062927+0000, chain.objs.size()=1 2024-09-12T00:38:38.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.181+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.500__shadow_.2cwjuvqwnTXntSA6CcHsH2tbFC5aQuh_0 2024-09-12T00:38:38.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.181+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8243152677067035856', time=2024-09-12T02:32:18.157780+0000, chain.objs.size()=1 2024-09-12T00:38:38.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.181+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.503__shadow:ig1.iJ1ZviXIpIr.ZLyPeoYT.9MVwfX_.vO-G3V9zJdbWBBC0Ip0K0Zy9ROlszk8_0 2024-09-12T00:38:38.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.181+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2418175694507635013', time=2024-09-12T02:32:22.953458+0000, chain.objs.size()=1 2024-09-12T00:38:38.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.181+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.517__shadow_.M2yAAur_B_y8Js3BIv1b0Vk9nsB5OLO_0 2024-09-12T00:38:38.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.181+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.556542684795334189', time=2024-09-12T02:32:25.435347+0000, chain.objs.size()=3 2024-09-12T00:38:38.181 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.181+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.521__multipart_mymultipart.2~ONFNrP_ZYcXBTLJnhaodW6zInadRqFc.1 2024-09-12T00:38:38.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.183+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.521__multipart_mymultipart.2~ONFNrP_ZYcXBTLJnhaodW6zInadRqFc.2 2024-09-12T00:38:38.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.184+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.521__multipart_mymultipart.2~ONFNrP_ZYcXBTLJnhaodW6zInadRqFc.3 2024-09-12T00:38:38.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.184+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5724493814994537832', time=2024-09-12T02:33:28.511359+0000, chain.objs.size()=1 2024-09-12T00:38:38.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.184+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.576__shadow:NbZ9CQHmd7wbSXdsuD-KRU9BUWFFKI-_.2ROUARDLHo0Nw8PO-iaQplOqBB4H52w_0 2024-09-12T00:38:38.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.184+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7742264298332511500', time=2024-09-12T02:33:46.838564+0000, chain.objs.size()=1 2024-09-12T00:38:38.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.184+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.580__shadow:u8UCosg4Upi8Y.B4l2tqS5UHM7iPnOY_.QUGzWCuQxcWU7Gm4Xdjog3TGqxcTtn__0 2024-09-12T00:38:38.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.184+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16569645167316640456', time=2024-09-12T02:33:48.568831+0000, chain.objs.size()=1 2024-09-12T00:38:38.183 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.184+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.585__shadow:4zt34DhDK0gVpgSdeRdnxtPFgGNM8.7_.UJe4KVOm57eEC30amutNJifxJyAOT47_0 2024-09-12T00:38:38.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.531379157108220220', time=2024-09-12T02:33:52.796932+0000, chain.objs.size()=1 2024-09-12T00:38:38.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.604__shadow_.iWUWoFVrvt2dsYdAqJz4KHkBA0RkVkN_0 2024-09-12T00:38:38.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10937577654389439588', time=2024-09-12T02:36:07.084550+0000, chain.objs.size()=1 2024-09-12T00:38:38.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.638__shadow_.E7XhXWDtxM1TQXqx2Wec9mKic8YukRl_0 2024-09-12T00:38:38.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11139080310577332348', time=2024-09-12T02:36:12.134138+0000, chain.objs.size()=2 2024-09-12T00:38:38.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.654__shadow_.--A4Ha0ZZXWe1LXbBttfACQgpQFw-RC_0 2024-09-12T00:38:38.185 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.654__shadow_.--A4Ha0ZZXWe1LXbBttfACQgpQFw-RC_1 2024-09-12T00:38:38.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.29751713945245043', time=2024-09-12T02:36:24.350508+0000, chain.objs.size()=1 2024-09-12T00:38:38.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.698__shadow:29HLiPw.BGFBSNDAa41YaXUyu1IoMMA_.azM6oJQMG_z0cqxQX1GaquNbblZRkxI_0 2024-09-12T00:38:38.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.186+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17991533916531083040', time=2024-09-12T02:36:26.528302+0000, chain.objs.size()=1 2024-09-12T00:38:38.186 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.186+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.706__shadow_.CsJbRtlS9NLqDvt-5IEHHVQk8pOoIXS_0 2024-09-12T00:38:38.191 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.192+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:38.194 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.194+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:38:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.196+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:38.195 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.196+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50481' 2024-09-12T00:38:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7179246023490810949', time=2024-09-12T02:29:23.724301+0000, chain.objs.size()=2 2024-09-12T00:38:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.158__shadow_.fiBrYS5ScA6H_5Jelp5Iw0Q3LW4BBA1_0 2024-09-12T00:38:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.158__shadow_.fiBrYS5ScA6H_5Jelp5Iw0Q3LW4BBA1_1 2024-09-12T00:38:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_dU2GRILNF4eBPj0aS152tsXcnKLp_cs', time=2024-09-12T02:29:25.663936+0000, chain.objs.size()=2 2024-09-12T00:38:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.RlJC5Jxgu8TywovZcu8GC-h39aEjatS_0 2024-09-12T00:38:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.RlJC5Jxgu8TywovZcu8GC-h39aEjatS_1 2024-09-12T00:38:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='_GrwhL7NWpYLBzWtTqGDPN54xELaUM-j', time=2024-09-12T02:29:25.677133+0000, chain.objs.size()=2 2024-09-12T00:38:38.197 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.R4Whz1IVnbVuiyfuR5T4addkW41CI5p_0 2024-09-12T00:38:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.160__shadow_.R4Whz1IVnbVuiyfuR5T4addkW41CI5p_1 2024-09-12T00:38:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1919407313187943534', time=2024-09-12T02:29:45.681779+0000, chain.objs.size()=1 2024-09-12T00:38:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.204__shadow_.TMhRkx8rDrZlwB0UfJWwZ_WHgbJ6R20_0 2024-09-12T00:38:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7825659413946729093', time=2024-09-12T02:30:40.070812+0000, chain.objs.size()=1 2024-09-12T00:38:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.241__shadow_.yTW03KJGTDYLLZlJd8pgDpxzWqBtt73_0 2024-09-12T00:38:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.409141215095514054', time=2024-09-12T02:30:40.347904+0000, chain.objs.size()=1 2024-09-12T00:38:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.242__shadow_.7PdG7s00PR0-lTStmw0KrsA5GnW451x_0 2024-09-12T00:38:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14855832510152536941', time=2024-09-12T02:30:42.649891+0000, chain.objs.size()=1 2024-09-12T00:38:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.251__shadow_.EklyXYXw38zeOi0sy2Vd3HXgkgq0Yv2_0 2024-09-12T00:38:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13173598711859185770', time=2024-09-12T02:30:43.165301+0000, chain.objs.size()=1 2024-09-12T00:38:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.253__shadow_.mkSkWMWUGIPlAqc1tMxzhqjMD8-IPEU_0 2024-09-12T00:38:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13350568945645642166', time=2024-09-12T02:30:43.645226+0000, chain.objs.size()=1 2024-09-12T00:38:38.198 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.197+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.255__shadow_.HEFGsBYqIGxdFZewbe16xrd2ge4V6IT_0 2024-09-12T00:38:38.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.200+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.754083327202232939', time=2024-09-12T02:30:44.119203+0000, chain.objs.size()=1 2024-09-12T00:38:38.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.200+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.257__shadow_.JP5jNcNyli9RL0XhodHU25sUZADsYO0_0 2024-09-12T00:38:38.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.200+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8212260685478706908', time=2024-09-12T02:30:44.864474+0000, chain.objs.size()=1 2024-09-12T00:38:38.199 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.200+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.260__shadow_.-1D335lOrsMB7nuGNHcsOpHmPLaQEXK_0 2024-09-12T00:38:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.201+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5838507438014394823', time=2024-09-12T02:30:53.200433+0000, chain.objs.size()=1 2024-09-12T00:38:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.201+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.wkL4t8H2Xyna6Zn09pcbOKfswtaqF9e_0 2024-09-12T00:38:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.201+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6282783908023576239', time=2024-09-12T02:30:53.224385+0000, chain.objs.size()=1 2024-09-12T00:38:38.200 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.201+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.bTda89jZo9cPp3cY0_dtKcLfKCx_kBR_0 2024-09-12T00:38:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13432906032884108948', time=2024-09-12T02:30:53.265811+0000, chain.objs.size()=1 2024-09-12T00:38:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BXE1ArNcgEjUxAeKR_EMNQlM4Tmaau1_0 2024-09-12T00:38:38.202 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4589649393135123922', time=2024-09-12T02:30:53.272361+0000, chain.objs.size()=1 2024-09-12T00:38:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2XiDK1ytY59oPeIoC5bUuRmVMYYzHlK_0 2024-09-12T00:38:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9731137639760573264', time=2024-09-12T02:30:53.393278+0000, chain.objs.size()=1 2024-09-12T00:38:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.VQhBPiR0oZfx8zYzNOU9KczZdFqUO5i_0 2024-09-12T00:38:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5492597735218502316', time=2024-09-12T02:30:53.442484+0000, chain.objs.size()=1 2024-09-12T00:38:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Qfw62wUVnzOQmYZsADVOQMDdYiXwaOF_0 2024-09-12T00:38:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17152886703035521393', time=2024-09-12T02:30:53.473241+0000, chain.objs.size()=1 2024-09-12T00:38:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.N3mdeJqukNOXiYOduRN0AQo-FZxmNjI_0 2024-09-12T00:38:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10352435771897059520', time=2024-09-12T02:30:53.494183+0000, chain.objs.size()=1 2024-09-12T00:38:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.jMhV48dHm6UNlWeqj9YAyUxtOpzihvo_0 2024-09-12T00:38:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2877651322313912177', time=2024-09-12T02:30:53.531072+0000, chain.objs.size()=1 2024-09-12T00:38:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.RagRLki5wBTlcJzx5GElu80M0ij5_E-_0 2024-09-12T00:38:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14863367350502411871', time=2024-09-12T02:30:53.669321+0000, chain.objs.size()=1 2024-09-12T00:38:38.203 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.SxrD0EZAgS2GiHrG0xwFF7kvz3g-gc__0 2024-09-12T00:38:38.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8449926270037131492', time=2024-09-12T02:30:53.704742+0000, chain.objs.size()=1 2024-09-12T00:38:38.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.203+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AnWaxNqfgR_M4cYtmIIa0HIuKUlkmBa_0 2024-09-12T00:38:38.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.205+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10488955236173242304', time=2024-09-12T02:30:53.733536+0000, chain.objs.size()=1 2024-09-12T00:38:38.204 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.205+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.Gop_TfaUllzZ9QbpvEXo9rkPPwFmxOI_0 2024-09-12T00:38:38.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.205+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10951783713486980980', time=2024-09-12T02:30:53.755231+0000, chain.objs.size()=1 2024-09-12T00:38:38.205 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.205+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.b8YNxkrBfPThEkZVWH4Hv6noZ_Frqat_0 2024-09-12T00:38:38.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.207+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16058015586173163341', time=2024-09-12T02:30:53.772594+0000, chain.objs.size()=1 2024-09-12T00:38:38.206 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.207+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.C1f49CKIbnJEz7rv0TIMw6Asf4lytt-_0 2024-09-12T00:38:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.208+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14171365334357106455', time=2024-09-12T02:30:53.990848+0000, chain.objs.size()=1 2024-09-12T00:38:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.208+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.oyylj6yyDAQaklv6EoSgpjyK_AuCDIe_0 2024-09-12T00:38:38.207 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.208+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8393651789467983436', time=2024-09-12T02:30:54.029154+0000, chain.objs.size()=1 2024-09-12T00:38:38.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.208+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.vRcMIUxmkfS-hM41Hu-q4y0PbHs5Bbw_0 2024-09-12T00:38:38.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.208+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11254786546209334809', time=2024-09-12T02:30:54.078317+0000, chain.objs.size()=1 2024-09-12T00:38:38.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.208+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.X6uQNZYlvbOAOzMHnsnj4RcAR4Xepax_0 2024-09-12T00:38:38.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.208+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4302201988535035347', time=2024-09-12T02:30:54.284605+0000, chain.objs.size()=1 2024-09-12T00:38:38.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.208+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.5y78tFL-vo3lDKdh3ZgEQ0yFNrkeCLV_0 2024-09-12T00:38:38.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.208+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17866343307425331006', time=2024-09-12T02:30:54.285355+0000, chain.objs.size()=1 2024-09-12T00:38:38.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.208+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.sXRVaBhCo911ill7rOl1ja55LS492to_0 2024-09-12T00:38:38.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.208+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14329202823028969454', time=2024-09-12T02:30:54.322358+0000, chain.objs.size()=1 2024-09-12T00:38:38.208 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.208+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.xd2eBrP--loALF1-H87EyW5lfeLVHxw_0 2024-09-12T00:38:38.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.209+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1190607745780703481', time=2024-09-12T02:30:54.364620+0000, chain.objs.size()=1 2024-09-12T00:38:38.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.209+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.F2o15jPohH3ZNmVCZs7dAC2OCSB7odM_0 2024-09-12T00:38:38.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.209+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16595837525963329442', time=2024-09-12T02:30:54.423757+0000, chain.objs.size()=1 2024-09-12T00:38:38.209 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.209+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.70m8kdHEPuKV6HE1CTnRwaqIZ6XcWfZ_0 2024-09-12T00:38:38.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.210+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2376099499084388489', time=2024-09-12T02:30:54.461370+0000, chain.objs.size()=1 2024-09-12T00:38:38.210 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.210+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.pNw1uM_F-8WrdT0n1ewpsFYioP4phgK_0 2024-09-12T00:38:38.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.212+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6347373980649843682', time=2024-09-12T02:30:54.554706+0000, chain.objs.size()=1 2024-09-12T00:38:38.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.212+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.kRx34pA6WVtb7FElrttv6Jv5--wr4Ux_0 2024-09-12T00:38:38.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.212+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17208219579818494386', time=2024-09-12T02:30:54.557221+0000, chain.objs.size()=1 2024-09-12T00:38:38.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.212+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.V4O7y1BWOqR729P_E3pH4Gb3uufJOG7_0 2024-09-12T00:38:38.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.212+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15902550795589438635', time=2024-09-12T02:30:54.606937+0000, chain.objs.size()=1 2024-09-12T00:38:38.212 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.212+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.VRIrnHP64uUGrqVxhOHuCzbtc1vg-lC_0 2024-09-12T00:38:38.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.213+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4306127915718417145', time=2024-09-12T02:30:54.661860+0000, chain.objs.size()=1 2024-09-12T00:38:38.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.213+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.bwdXKYsm5casrbga2iBHnYbQoeQ1n8B_0 2024-09-12T00:38:38.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.213+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3448960759247578787', time=2024-09-12T02:30:54.683884+0000, chain.objs.size()=1 2024-09-12T00:38:38.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.213+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.7zZZD5-ZlzSK9Zh2I8V8d1mBgeNz_zP_0 2024-09-12T00:38:38.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.214+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15986690823275840568', time=2024-09-12T02:30:54.819530+0000, chain.objs.size()=1 2024-09-12T00:38:38.213 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.214+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.8JhzFcTrmQYNYXczmKFfh4x84ggaBIY_0 2024-09-12T00:38:38.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.214+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17680428571041557390', time=2024-09-12T02:30:54.939344+0000, chain.objs.size()=1 2024-09-12T00:38:38.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.214+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.e3WxU1lkUO9LJNbkhhiq9HZ8dsBkDox_0 2024-09-12T00:38:38.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.214+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12341832970290658809', time=2024-09-12T02:30:54.943826+0000, chain.objs.size()=1 2024-09-12T00:38:38.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.214+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.iSGYgJbPiox2MD4xmUc2YGwqMUA8_f9_0 2024-09-12T00:38:38.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.214+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17102687804045843942', time=2024-09-12T02:30:54.958825+0000, chain.objs.size()=1 2024-09-12T00:38:38.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.214+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.2SuKwIUW55Z73U1h89l0fdEVvl7J9Jl_0 2024-09-12T00:38:38.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.214+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1088301814191223676', time=2024-09-12T02:30:55.001866+0000, chain.objs.size()=1 2024-09-12T00:38:38.214 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.214+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.NsWbJd7hVAbzRlyQ6MDkx3ZvNn7G4M2_0 2024-09-12T00:38:38.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.216+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16574496602770302082', time=2024-09-12T02:30:55.130248+0000, chain.objs.size()=1 2024-09-12T00:38:38.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.216+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.f6Yr2m2ODiZzcUDunpLg8afxdyRaznE_0 2024-09-12T00:38:38.215 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.216+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9370318816283799895', time=2024-09-12T02:30:55.188813+0000, chain.objs.size()=1 2024-09-12T00:38:38.216 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.216+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BCw9RCysIAHJ3lwFm9VGcT-Fbg5q7oo_0 2024-09-12T00:38:38.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.218+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14902473041693883521', time=2024-09-12T02:30:55.206132+0000, chain.objs.size()=1 2024-09-12T00:38:38.217 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.218+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.yD6VeeD6g_u5_Z-nMg5D8jrLI6Dyng9_0 2024-09-12T00:38:38.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.218+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1075003610910238452', time=2024-09-12T02:30:55.224442+0000, chain.objs.size()=1 2024-09-12T00:38:38.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.218+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.IR1jorhgxKcnYWKlC8LQS4qkAXeumT5_0 2024-09-12T00:38:38.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.218+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13261172322185079297', time=2024-09-12T02:30:56.421260+0000, chain.objs.size()=1 2024-09-12T00:38:38.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.218+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.267__shadow_.co14FCNsOcVMRx1F2Hg5ZcuylADKUWD_0 2024-09-12T00:38:38.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.218+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4303758273523406665', time=2024-09-12T02:30:56.910723+0000, chain.objs.size()=1 2024-09-12T00:38:38.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.218+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.269__shadow_.cd-OBuIM4fQ1SBpsw_D7Nas_gLBrW9U_0 2024-09-12T00:38:38.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.218+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1489474692347869349', time=2024-09-12T02:31:00.584493+0000, chain.objs.size()=1 2024-09-12T00:38:38.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.218+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.284__shadow_.4EAP68uGXvK_z3O7sAK2qi3odO5JWCd_0 2024-09-12T00:38:38.218 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.218+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.414743914927699994', time=2024-09-12T02:31:01.875373+0000, chain.objs.size()=1 2024-09-12T00:38:38.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.218+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.289__shadow_.Xuvqr_27i1f7d38JEhduosttDZISA5-_0 2024-09-12T00:38:38.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.219+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17845368440717054279', time=2024-09-12T02:31:03.060139+0000, chain.objs.size()=1 2024-09-12T00:38:38.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.219+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.25LdyT0OEnydNDL_1ZmbrYsZjFhWK6N_0 2024-09-12T00:38:38.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.220+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16457921303769926445', time=2024-09-12T02:31:03.065830+0000, chain.objs.size()=1 2024-09-12T00:38:38.219 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.220+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.292__shadow_.3WiQASGpvBBggycaWdpCNu8MpRRFUbb_0 2024-09-12T00:38:38.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.221+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.822925893110802596', time=2024-09-12T02:31:03.650457+0000, chain.objs.size()=1 2024-09-12T00:38:38.220 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.221+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.08EmkuwtaJwOg5mujTsDAaLPzsyBJ7U_0 2024-09-12T00:38:38.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.221+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14256052139281380783', time=2024-09-12T02:31:03.658244+0000, chain.objs.size()=1 2024-09-12T00:38:38.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.221+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.qa3cSHVBqYjbUleZFfSxqwq1a0Nota2_0 2024-09-12T00:38:38.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.221+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12554390458443662260', time=2024-09-12T02:31:03.662957+0000, chain.objs.size()=1 2024-09-12T00:38:38.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.221+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.HbuEAMiugei_hWppLroPvCTAKox34Zn_0 2024-09-12T00:38:38.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.221+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2634933231834377965', time=2024-09-12T02:31:03.665598+0000, chain.objs.size()=1 2024-09-12T00:38:38.221 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.221+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.oQoLTLGI-iIkjR8M63MF5L5f02aPbY3_0 2024-09-12T00:38:38.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.222+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2454747262149400007', time=2024-09-12T02:31:05.218349+0000, chain.objs.size()=1 2024-09-12T00:38:38.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.222+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.299__shadow_.cvN1rBrJg33LTXr0ScMDKGdNvZRX_AP_0 2024-09-12T00:38:38.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.222+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12635637843822196934', time=2024-09-12T02:31:08.795240+0000, chain.objs.size()=1 2024-09-12T00:38:38.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.222+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.313__shadow_.ze4eML5N-s760MnBvzA_RZoLp-gUtVa_0 2024-09-12T00:38:38.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.222+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8279046742675836180', time=2024-09-12T02:31:19.374259+0000, chain.objs.size()=1 2024-09-12T00:38:38.222 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.222+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.17IXh1AphOu2car_Oyb8EtSgEY0jDbF_0 2024-09-12T00:38:38.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.224+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7563134389912852599', time=2024-09-12T02:31:19.417007+0000, chain.objs.size()=1 2024-09-12T00:38:38.223 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.224+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.D2gKOEiV6F-N1vtC8HLb-tHE0_eaFGo_0 2024-09-12T00:38:38.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.225+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1635388715186339081', time=2024-09-12T02:31:19.532205+0000, chain.objs.size()=1 2024-09-12T00:38:38.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.225+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.kXwdlc5ieKJaAj9jOvhtcBOFG-ygRSI_0 2024-09-12T00:38:38.224 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.225+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7569618874906112093', time=2024-09-12T02:31:19.544380+0000, chain.objs.size()=1 2024-09-12T00:38:38.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.225+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.i1hkhqfsOH9YcYwimNZLB2ADPniqZut_0 2024-09-12T00:38:38.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.225+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10501383787670713424', time=2024-09-12T02:31:19.550994+0000, chain.objs.size()=1 2024-09-12T00:38:38.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.225+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.JX3CHoa0jXIvXGs3CBj0u6q2dCxWy0i_0 2024-09-12T00:38:38.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.225+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4556747628887713228', time=2024-09-12T02:31:19.669249+0000, chain.objs.size()=1 2024-09-12T00:38:38.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.225+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.CDnwAA59aME45RVyhLaUTlVJJKBrHPq_0 2024-09-12T00:38:38.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.226+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10579439903623387565', time=2024-09-12T02:31:19.712836+0000, chain.objs.size()=1 2024-09-12T00:38:38.225 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.226+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.YiYUcLno-E7lIUc5QQY6U03x7Ji-Z4S_0 2024-09-12T00:38:38.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.228+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10687453174152126188', time=2024-09-12T02:31:19.733422+0000, chain.objs.size()=1 2024-09-12T00:38:38.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.228+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.hKaAFML5QMf8S6MF3nQyw1FIc8W42lu_0 2024-09-12T00:38:38.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.228+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9647738143245431551', time=2024-09-12T02:31:20.094049+0000, chain.objs.size()=1 2024-09-12T00:38:38.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.228+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.kYTtPmMKG6sRym8sEAhvzfKy3tRim8M_0 2024-09-12T00:38:38.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.228+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1766245416190132356', time=2024-09-12T02:31:20.160063+0000, chain.objs.size()=1 2024-09-12T00:38:38.227 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.228+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.xxBUfBd-vuCGtXR4piJANopygPburhJ_0 2024-09-12T00:38:38.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.228+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2112760780686318518', time=2024-09-12T02:31:20.263902+0000, chain.objs.size()=1 2024-09-12T00:38:38.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.228+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.hzQTvSHs-_YTYsxyAZguEBh5OhNGSnv_0 2024-09-12T00:38:38.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.228+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10471192662920260980', time=2024-09-12T02:31:20.417681+0000, chain.objs.size()=1 2024-09-12T00:38:38.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.228+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.WC_kwJy5A44Cgmo5ADYeRxWPn8F0V9L_0 2024-09-12T00:38:38.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.228+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15864046000794772239', time=2024-09-12T02:31:20.573247+0000, chain.objs.size()=1 2024-09-12T00:38:38.228 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.228+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.8TsFJeeZDstH0fHRRoIyLiY4Tlw3hj0_0 2024-09-12T00:38:38.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.231+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2265892022115146315', time=2024-09-12T02:31:20.586739+0000, chain.objs.size()=1 2024-09-12T00:38:38.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.231+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.YuuThEyfVAylrddguI-x4rg4LWhU8mn_0 2024-09-12T00:38:38.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.231+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3757841861207781581', time=2024-09-12T02:31:20.666325+0000, chain.objs.size()=1 2024-09-12T00:38:38.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.231+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.V7OXNlF9HfZ-4uztz7VP4pl53MFjRmX_0 2024-09-12T00:38:38.230 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.231+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6498358264943151640', time=2024-09-12T02:31:20.711379+0000, chain.objs.size()=1 2024-09-12T00:38:38.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.231+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.DcmVN7FAoCXcDQar4JpZIOj6_oFRZX6_0 2024-09-12T00:38:38.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.231+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.325160647907765989', time=2024-09-12T02:31:20.748545+0000, chain.objs.size()=1 2024-09-12T00:38:38.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.231+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Fm1ckR-SyZQg-dgZHpUwezASRhJ_ZHq_0 2024-09-12T00:38:38.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.231+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2575601799402702714', time=2024-09-12T02:31:20.759789+0000, chain.objs.size()=1 2024-09-12T00:38:38.231 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.231+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.eQ-asjdOtiMMRSDNF475ldLxh-yxboV_0 2024-09-12T00:38:38.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.233+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5872421022870292321', time=2024-09-12T02:31:20.865902+0000, chain.objs.size()=1 2024-09-12T00:38:38.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.233+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.y3QmSQok3WW05okTWAfGwwdehRNuQ8J_0 2024-09-12T00:38:38.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.233+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7231559864679238109', time=2024-09-12T02:31:20.928378+0000, chain.objs.size()=1 2024-09-12T00:38:38.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.233+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ptxNesiAnN6BQ6Jmtgc7DbUYeLI1_EN_0 2024-09-12T00:38:38.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.233+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16990909013880060356', time=2024-09-12T02:31:20.938890+0000, chain.objs.size()=1 2024-09-12T00:38:38.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.233+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ozpnf7whlAX_WdsxmBBtJK7I8McFQXy_0 2024-09-12T00:38:38.233 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.233+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4668482251411696770', time=2024-09-12T02:31:21.183664+0000, chain.objs.size()=1 2024-09-12T00:38:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.233+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.9YwemXR1AxOQcUpvEJMSrEBa3ARR9yO_0 2024-09-12T00:38:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.234+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5564327503816274977', time=2024-09-12T02:31:21.190210+0000, chain.objs.size()=1 2024-09-12T00:38:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.234+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.wViqWb9GH4xZPEOE-R1xrYWILrL0atD_0 2024-09-12T00:38:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.234+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11332585041565132099', time=2024-09-12T02:31:21.274267+0000, chain.objs.size()=1 2024-09-12T00:38:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.234+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.2fTwYBva3ojTnOxyh1xt6wnzJ6WjCwG_0 2024-09-12T00:38:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.235+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13960562927456925791', time=2024-09-12T02:31:21.292594+0000, chain.objs.size()=1 2024-09-12T00:38:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.235+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.or6IW9D0bqkdNhIJqMi8bW0y5X0P9tl_0 2024-09-12T00:38:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.235+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2405828724404872910', time=2024-09-12T02:31:21.300795+0000, chain.objs.size()=1 2024-09-12T00:38:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.235+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.OTAmglJ9QzK3Prx-SsD6cax2dZYsdDA_0 2024-09-12T00:38:38.234 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.235+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3717232247531484112', time=2024-09-12T02:31:21.309295+0000, chain.objs.size()=1 2024-09-12T00:38:38.235 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.235+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.bv1yct-lAp27ovGlM1B-xhwvE1c6ms5_0 2024-09-12T00:38:38.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.236+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8880922464099109328', time=2024-09-12T02:31:21.314631+0000, chain.objs.size()=1 2024-09-12T00:38:38.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.236+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.jUB-u22cShKYGm12Gq6hDI9EO_jqsYi_0 2024-09-12T00:38:38.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.236+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12419458301947411638', time=2024-09-12T02:31:21.489206+0000, chain.objs.size()=1 2024-09-12T00:38:38.236 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.236+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.iYauSLGo3LqkjpBgQoq1thIDSy9l_0-_0 2024-09-12T00:38:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11754600496107148793', time=2024-09-12T02:31:21.558246+0000, chain.objs.size()=1 2024-09-12T00:38:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ww03fc7zBDb2lBZnP3ulBzRRWAZb2vZ_0 2024-09-12T00:38:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8461608743369672293', time=2024-09-12T02:31:29.699436+0000, chain.objs.size()=1 2024-09-12T00:38:38.238 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_._j8meucQzr_Yjcp74F4R8lr9P3YD-b1_0 2024-09-12T00:38:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17061252384102798076', time=2024-09-12T02:31:29.713646+0000, chain.objs.size()=1 2024-09-12T00:38:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.sDwiKzQ8q-0Djn_cU5qyog8WRGb2U4o_0 2024-09-12T00:38:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5357947998654342983', time=2024-09-12T02:31:29.773881+0000, chain.objs.size()=1 2024-09-12T00:38:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.BWD5V3rahX8ge-97RrnVbyxUjWkh8xH_0 2024-09-12T00:38:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8922146033122466744', time=2024-09-12T02:31:29.828698+0000, chain.objs.size()=1 2024-09-12T00:38:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.qVuiPRf6pOgq7VIs2-ze4j0GOxdQo64_0 2024-09-12T00:38:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3405546501389493446', time=2024-09-12T02:31:29.855142+0000, chain.objs.size()=1 2024-09-12T00:38:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.HpCAnvTmjiWHuLibtG4M6oYM4U0OXeF_0 2024-09-12T00:38:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12785143576201030815', time=2024-09-12T02:31:29.861694+0000, chain.objs.size()=1 2024-09-12T00:38:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.nap31-VRxgfEIQLMIFHt4pkjFTZJgZr_0 2024-09-12T00:38:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2793621747018326199', time=2024-09-12T02:31:29.867339+0000, chain.objs.size()=1 2024-09-12T00:38:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.239+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.zy5FYd6R0ZMucEfhkk7KG0vdXDMHgTE_0 2024-09-12T00:38:38.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.240+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14515550439669106510', time=2024-09-12T02:31:30.019157+0000, chain.objs.size()=1 2024-09-12T00:38:38.240 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.240+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Coabl7-v0ghVahJKbIR3pEOkvKS6-ZO_0 2024-09-12T00:38:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.242+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5479701518252346868', time=2024-09-12T02:31:30.042331+0000, chain.objs.size()=1 2024-09-12T00:38:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.242+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.iAOBRuT3xhKr4Qx_bC2NZc1E4scBk2A_0 2024-09-12T00:38:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.242+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.763800421005073216', time=2024-09-12T02:31:30.046079+0000, chain.objs.size()=1 2024-09-12T00:38:38.242 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.242+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.p_4lhhpdL0Tm9rMCnUbWV8m9ovgBxxd_0 2024-09-12T00:38:38.246 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.247+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/50481 2024-09-12T00:38:38.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=39, truncated=0, next_marker='' 2024-09-12T00:38:38.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.403732400194226766', time=2024-09-12T02:31:30.095254+0000, chain.objs.size()=1 2024-09-12T00:38:38.249 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.kmdDumRdPyhBHWBcAisuTqNuRIqDptI_0 2024-09-12T00:38:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11778590041131552216', time=2024-09-12T02:31:30.105373+0000, chain.objs.size()=1 2024-09-12T00:38:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-X2bHv2MbSLfNA4A4HFS7h05qx83SMD_0 2024-09-12T00:38:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17028459699993413870', time=2024-09-12T02:31:30.123455+0000, chain.objs.size()=1 2024-09-12T00:38:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.o7fj5vEdAtdRF4EMVAopgkBOS0UzfIY_0 2024-09-12T00:38:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11566966752183161884', time=2024-09-12T02:31:30.145047+0000, chain.objs.size()=1 2024-09-12T00:38:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.hQmWeda-H69Wx_Kkx43jy6bgjUsQBNN_0 2024-09-12T00:38:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6269332890757855988', time=2024-09-12T02:31:30.174065+0000, chain.objs.size()=1 2024-09-12T00:38:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.M-iTIH6HmeF678BqZvz_u536JFqbOQs_0 2024-09-12T00:38:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11335153205144536064', time=2024-09-12T02:31:30.180272+0000, chain.objs.size()=1 2024-09-12T00:38:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ABydU-aKqdklKQNPD3r77Hli6gJ4iG1_0 2024-09-12T00:38:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3034079709235951119', time=2024-09-12T02:31:30.288047+0000, chain.objs.size()=1 2024-09-12T00:38:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Q88nZmmrjtvw2s86HcBt2aLaY7E7xeM_0 2024-09-12T00:38:38.250 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8021755220196249060', time=2024-09-12T02:31:30.422769+0000, chain.objs.size()=1 2024-09-12T00:38:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.WHSIwRKqbSUGeZ-rxQuakcMdc8wjqd0_0 2024-09-12T00:38:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12796414423089225129', time=2024-09-12T02:31:30.438933+0000, chain.objs.size()=1 2024-09-12T00:38:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.BhoUbYrOSTAphG_IfEpCMC1wipRNkO2_0 2024-09-12T00:38:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5395222859809496371', time=2024-09-12T02:31:30.563793+0000, chain.objs.size()=1 2024-09-12T00:38:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.BeEOyz4Kv5fP1A49IbywpJKgIBm5nii_0 2024-09-12T00:38:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15499083334673632544', time=2024-09-12T02:31:30.576967+0000, chain.objs.size()=1 2024-09-12T00:38:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.jmyalx1Rv1btKfQck8gVwsFAUas_pV1_0 2024-09-12T00:38:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2376446507240104206', time=2024-09-12T02:31:30.587893+0000, chain.objs.size()=1 2024-09-12T00:38:38.251 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.250+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.T5JZIZdkt6EWd8QOfECmXiUY47dDbOi_0 2024-09-12T00:38:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.255+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2714181519778599562', time=2024-09-12T02:31:30.638215+0000, chain.objs.size()=1 2024-09-12T00:38:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.255+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NkZxLsNBgkcILz0labcl8ovI7OEJxMD_0 2024-09-12T00:38:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.255+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2817643465894499662', time=2024-09-12T02:31:30.705228+0000, chain.objs.size()=1 2024-09-12T00:38:38.255 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.255+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.DtLIY3PO89iGJr6DNfQa6iaPrgJC4I7_0 2024-09-12T00:38:38.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12584728321900085000', time=2024-09-12T02:31:30.861590+0000, chain.objs.size()=1 2024-09-12T00:38:38.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.oYz32nP_jKDhxG0KMjJ1jSR37gtoTD8_0 2024-09-12T00:38:38.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3195566329462807840', time=2024-09-12T02:31:30.907049+0000, chain.objs.size()=1 2024-09-12T00:38:38.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.twg2mWJ1B3a17mw1pgSMdnECBA_aCml_0 2024-09-12T00:38:38.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2550465192781284359', time=2024-09-12T02:31:30.922646+0000, chain.objs.size()=1 2024-09-12T00:38:38.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.J5lRnBcFr3OoJpOw_9DZfWG0IvllpOp_0 2024-09-12T00:38:38.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8437712432077452671', time=2024-09-12T02:31:30.924490+0000, chain.objs.size()=1 2024-09-12T00:38:38.256 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.5a44qnUKOAEKElDNa7s_TXlpKyKo3aB_0 2024-09-12T00:38:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16727315507438227847', time=2024-09-12T02:31:30.978346+0000, chain.objs.size()=1 2024-09-12T00:38:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.xsSHf8fuPgDWlNo8eHMwgAwdOHATlew_0 2024-09-12T00:38:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6466837523877142028', time=2024-09-12T02:31:31.195268+0000, chain.objs.size()=1 2024-09-12T00:38:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.92C6-ZzZ3jzOdpJT3pVoG2N3jDfIx02_0 2024-09-12T00:38:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14296716198536663161', time=2024-09-12T02:31:31.413791+0000, chain.objs.size()=1 2024-09-12T00:38:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.DFPVPR7Bib6CyOzWnQ79zgCteV3FkmW_0 2024-09-12T00:38:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17243837764634082806', time=2024-09-12T02:31:31.420852+0000, chain.objs.size()=1 2024-09-12T00:38:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.QNSJEB9XaC0uko1M3MQwdg6hYh0RYLo_0 2024-09-12T00:38:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8054788600451440024', time=2024-09-12T02:31:31.448511+0000, chain.objs.size()=1 2024-09-12T00:38:38.257 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.257+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Tklx9DsG1V0lj35Dt6kvo2tlAOMfH1Y_0 2024-09-12T00:38:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.260+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2910598991531006199', time=2024-09-12T02:31:31.491575+0000, chain.objs.size()=1 2024-09-12T00:38:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.260+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.v4NvgRDEDKGRoJOwriOk67kYiQWOPyA_0 2024-09-12T00:38:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.260+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14142724339858743837', time=2024-09-12T02:31:31.502912+0000, chain.objs.size()=1 2024-09-12T00:38:38.259 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.260+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.KAKQDFacFPWFHn9uvaqrAITGm0uYAah_0 2024-09-12T00:38:38.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3332622655967254712', time=2024-09-12T02:31:31.690828+0000, chain.objs.size()=1 2024-09-12T00:38:38.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Org-BzpcnH0qk78CyoR5EIZycuTaHjp_0 2024-09-12T00:38:38.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5319203426844080519', time=2024-09-12T02:31:36.982269+0000, chain.objs.size()=1 2024-09-12T00:38:38.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.346__shadow_.Ojqw-jKQ0ighrg6XQNPnpQlexmcouXi_0 2024-09-12T00:38:38.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2926580896063250435', time=2024-09-12T02:32:03.296147+0000, chain.objs.size()=1 2024-09-12T00:38:38.261 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.447__shadow_.yJmHY8uoQO5A5ldUD9X_ozOcM4M5Gy8_0 2024-09-12T00:38:38.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17158789943408637842', time=2024-09-12T02:32:33.932806+0000, chain.objs.size()=1 2024-09-12T00:38:38.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.524__shadow_.SUDoylMz8djpr1yjwThzlltFMcE3RlG_0 2024-09-12T00:38:38.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.810167260056169499', time=2024-09-12T02:33:05.525644+0000, chain.objs.size()=1 2024-09-12T00:38:38.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.551__shadow_.z27DMMPS--Pf53s3yHUQ6-Dzgm0ZniV_0 2024-09-12T00:38:38.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12156621888200349691', time=2024-09-12T02:33:08.901109+0000, chain.objs.size()=1 2024-09-12T00:38:38.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.558__shadow_.1-K49ocYwfeHW34dQ0TI79Us-rtW7rY_0 2024-09-12T00:38:38.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5916261823710887493', time=2024-09-12T02:33:17.574998+0000, chain.objs.size()=1 2024-09-12T00:38:38.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:CvYapt9c00G2WFzvyr-k81LERd0wbQE_._dp2pIomsViOhWruuU5AnJDdZZzzBwt_0 2024-09-12T00:38:38.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17489382530502535411', time=2024-09-12T02:33:30.138243+0000, chain.objs.size()=1 2024-09-12T00:38:38.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.576__shadow:Iq2PUMlSj3uyM0suB4MtddOcUr7L3Z8_.NXyWp_3B50l6cY5zxJeIPmlJgsRrMm__0 2024-09-12T00:38:38.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14036333338417295410', time=2024-09-12T02:33:43.033210+0000, chain.objs.size()=1 2024-09-12T00:38:38.262 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.262+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:BZBnqvhUNsyPuSLYPLgu1RfRtULd5zi_.QHT3uoWMOmrWKDjZc0a3kJuJ2nD0bOJ_0 2024-09-12T00:38:38.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.266+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14997595792575168505', time=2024-09-12T02:36:06.349290+0000, chain.objs.size()=1 2024-09-12T00:38:38.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.266+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.635__shadow_.ydKrkpNlhAGlK3zv-fdy5xO0jaMvHaq_0 2024-09-12T00:38:38.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.266+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13212166548677150434', time=2024-09-12T02:36:13.051539+0000, chain.objs.size()=2 2024-09-12T00:38:38.265 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.266+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.656__shadow_.1e4ZfK11K3_A6jRxn6eq0EuXg4uRnjC_0 2024-09-12T00:38:38.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.267+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.656__shadow_.1e4ZfK11K3_A6jRxn6eq0EuXg4uRnjC_1 2024-09-12T00:38:38.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.268+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3619068979608621936', time=2024-09-12T02:36:15.612258+0000, chain.objs.size()=6 2024-09-12T00:38:38.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.268+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.662__multipart_foo.2~rw0g9_luJ8Zwj0eGHOhxaoRXDgjUMBu.1 2024-09-12T00:38:38.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.268+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.662__multipart_foo.2~rw0g9_luJ8Zwj0eGHOhxaoRXDgjUMBu.2 2024-09-12T00:38:38.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.268+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.662__multipart_foo.2~rw0g9_luJ8Zwj0eGHOhxaoRXDgjUMBu.3 2024-09-12T00:38:38.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.268+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.662__multipart_foo.2~rw0g9_luJ8Zwj0eGHOhxaoRXDgjUMBu.4 2024-09-12T00:38:38.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.268+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.662__multipart_foo.2~rw0g9_luJ8Zwj0eGHOhxaoRXDgjUMBu.5 2024-09-12T00:38:38.267 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.268+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.662__multipart_foo.2~rw0g9_luJ8Zwj0eGHOhxaoRXDgjUMBu.6 2024-09-12T00:38:38.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.269+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7427230757899125684', time=2024-09-12T02:36:16.664409+0000, chain.objs.size()=1 2024-09-12T00:38:38.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.269+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.665__shadow_.iCHBzOniWUSInbiDNv5oVTCorPhkCpL_0 2024-09-12T00:38:38.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.269+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5056960625172253638', time=2024-09-12T02:36:39.029594+0000, chain.objs.size()=1 2024-09-12T00:38:38.269 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.269+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.716__shadow:ktLNhmxkdR6JWDGRhi9-PJW.TtCxa.R_.-FPLoFiKIvzK3pDahY8palCIjuLnMud_0 2024-09-12T00:38:38.273 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.274+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:38.275 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.276+0000 7f10d6613800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:38:38.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.278+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:38.277 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.278+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:38.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47465' 2024-09-12T00:38:38.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9556089822609754674', time=2024-09-12T02:29:37.007196+0000, chain.objs.size()=1 2024-09-12T00:38:38.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.177__shadow_.XwqXXWdAx2abPeIpCdPrySPb7DPMuwj_0 2024-09-12T00:38:38.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18423460049156792049', time=2024-09-12T02:29:45.363493+0000, chain.objs.size()=1 2024-09-12T00:38:38.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.203__shadow_.efwNtQwMqaBqnOm8nY3o4IuD1S8Z3DX_0 2024-09-12T00:38:38.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8200680078830137356', time=2024-09-12T02:30:38.045108+0000, chain.objs.size()=1 2024-09-12T00:38:38.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.233__shadow_.Z7bqkpCAR6Qb-Qdwzwadl6oZWZT7t1T_0 2024-09-12T00:38:38.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1425274833438931530', time=2024-09-12T02:30:40.348592+0000, chain.objs.size()=1 2024-09-12T00:38:38.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.242__shadow_.yWWC06DIlKAiPMGmXT3Fa9gy6vxnrdO_0 2024-09-12T00:38:38.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.767482591854536343', time=2024-09-12T02:30:42.889335+0000, chain.objs.size()=1 2024-09-12T00:38:38.279 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.252__shadow_.fxPCCJH0kFhQii-zfCfNqUT_zZNhTS9_0 2024-09-12T00:38:38.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12920683438818006348', time=2024-09-12T02:30:43.167204+0000, chain.objs.size()=1 2024-09-12T00:38:38.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.253__shadow_.xYTEQmLbVBy6hf_oDOR-2nvuat_6_tP_0 2024-09-12T00:38:38.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7452856112001175468', time=2024-09-12T02:30:43.646227+0000, chain.objs.size()=1 2024-09-12T00:38:38.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.255__shadow_.9zkO2V29gWAbz7DwU4Z6VCR4KSongh9_0 2024-09-12T00:38:38.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16247745009216853355', time=2024-09-12T02:30:53.120024+0000, chain.objs.size()=1 2024-09-12T00:38:38.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.M0Rh86-l--0ZYD0IVphShF1V7Bu53DK_0 2024-09-12T00:38:38.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16293872762747499436', time=2024-09-12T02:30:53.144180+0000, chain.objs.size()=1 2024-09-12T00:38:38.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.guoflSUWVvREjX30Tq-Kf0-LKlocJsv_0 2024-09-12T00:38:38.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5372840282931672325', time=2024-09-12T02:30:53.293709+0000, chain.objs.size()=1 2024-09-12T00:38:38.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.aSLOvLlNnmAgxJCXv_AeDdeKXQWZn6f_0 2024-09-12T00:38:38.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8293581951315326141', time=2024-09-12T02:30:53.301343+0000, chain.objs.size()=1 2024-09-12T00:38:38.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_._bRj4d8hlJDutqAXU28lB2fC6P9YRP8_0 2024-09-12T00:38:38.280 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1420849137802593507', time=2024-09-12T02:30:53.473728+0000, chain.objs.size()=1 2024-09-12T00:38:38.281 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.279+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ObiThYIc29iDIZmiz95rDd4kD20C7UB_0 2024-09-12T00:38:38.282 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.283+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4451352736941454263', time=2024-09-12T02:30:53.492504+0000, chain.objs.size()=1 2024-09-12T00:38:38.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.283+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JhRkMa6pk0sGbzimDH9FJ-meXEYLp56_0 2024-09-12T00:38:38.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.283+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17638290832550311986', time=2024-09-12T02:30:53.575237+0000, chain.objs.size()=1 2024-09-12T00:38:38.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.283+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BR51vm6qDFgrWUlMQu9uFXQH8VHn24u_0 2024-09-12T00:38:38.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.283+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8908544083082391488', time=2024-09-12T02:30:53.677534+0000, chain.objs.size()=1 2024-09-12T00:38:38.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.283+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.YtpWuZ21V_TgqAEHySm3MV9GzhlodAA_0 2024-09-12T00:38:38.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.283+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6459112732817181536', time=2024-09-12T02:30:53.704779+0000, chain.objs.size()=1 2024-09-12T00:38:38.283 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.283+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.4BFdopllbw5FgfYYJx9_Od2iCKdKSv9_0 2024-09-12T00:38:38.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.285+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2529039636595387463', time=2024-09-12T02:30:53.716980+0000, chain.objs.size()=1 2024-09-12T00:38:38.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.285+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.xgD-Sl-QRqUdngcsGg3orhIZxI38pqP_0 2024-09-12T00:38:38.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.285+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2461420265469926106', time=2024-09-12T02:30:53.814309+0000, chain.objs.size()=1 2024-09-12T00:38:38.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.285+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.52jo5P9DXMfXtAYAaz7tRAmFleICfWg_0 2024-09-12T00:38:38.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.285+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16538281135801187613', time=2024-09-12T02:30:53.984444+0000, chain.objs.size()=1 2024-09-12T00:38:38.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.285+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.AgkEsZZV_6plZ0TzjEGDUxQeKKy2XJd_0 2024-09-12T00:38:38.284 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.285+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4153004690908780397', time=2024-09-12T02:30:54.010342+0000, chain.objs.size()=1 2024-09-12T00:38:38.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.285+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.eWWkBSIMyS8tbPnSiZ_PN8dFTuiMK2t_0 2024-09-12T00:38:38.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.285+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6345434976720706904', time=2024-09-12T02:30:54.032355+0000, chain.objs.size()=1 2024-09-12T00:38:38.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.285+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.gVS5l1zw9mXRJnC0dGVYRUZ_98Oen5Q_0 2024-09-12T00:38:38.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.285+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7941085862482178837', time=2024-09-12T02:30:54.035366+0000, chain.objs.size()=1 2024-09-12T00:38:38.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.285+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.GfhoETCoABQSQoN5hh-lHST5MNFI5Sj_0 2024-09-12T00:38:38.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.285+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10012728741904963417', time=2024-09-12T02:30:54.133310+0000, chain.objs.size()=1 2024-09-12T00:38:38.285 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.285+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.95gIGpir81DEsf_Co8UPqypTq5byxu1_0 2024-09-12T00:38:38.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.289+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.722223770694735805', time=2024-09-12T02:30:54.260664+0000, chain.objs.size()=1 2024-09-12T00:38:38.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.289+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-j7UjJ8Oz5zClPsBQKkG5-0qiMRH1i__0 2024-09-12T00:38:38.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.289+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13918020275607749978', time=2024-09-12T02:30:54.360807+0000, chain.objs.size()=1 2024-09-12T00:38:38.288 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.289+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.k95913NbvgJ4ctbEKXTZa9gybhQfxWg_0 2024-09-12T00:38:38.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.289+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1951563523260534441', time=2024-09-12T02:30:54.376101+0000, chain.objs.size()=1 2024-09-12T00:38:38.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.289+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.6uibXA8Vq4eGsqTZc8Ye83D9jx10FJg_0 2024-09-12T00:38:38.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.289+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15897347554464032484', time=2024-09-12T02:30:54.394627+0000, chain.objs.size()=1 2024-09-12T00:38:38.289 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.289+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.rpy3yOfXg-fb6ZpWit5F581ho5XEoIP_0 2024-09-12T00:38:38.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.291+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14345820220190316774', time=2024-09-12T02:30:54.399391+0000, chain.objs.size()=1 2024-09-12T00:38:38.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.291+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.-KAYZoU_J3s0EuTTc9YSg_7bDv5hhu6_0 2024-09-12T00:38:38.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.291+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12585940789918413759', time=2024-09-12T02:30:54.434254+0000, chain.objs.size()=1 2024-09-12T00:38:38.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.291+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.5kRKnuo_pTbKGHrHJoAY_f-8fZGuSmT_0 2024-09-12T00:38:38.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.291+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1078953615868716092', time=2024-09-12T02:30:54.598768+0000, chain.objs.size()=1 2024-09-12T00:38:38.290 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.291+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.UKLLywqYdxWw_ELX6x-KUQITOoln9w2_0 2024-09-12T00:38:38.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.291+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16932710950582528515', time=2024-09-12T02:30:54.603777+0000, chain.objs.size()=1 2024-09-12T00:38:38.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.291+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.ti6N3PZyt517V8T71JS0F9hIHpkqbRo_0 2024-09-12T00:38:38.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.291+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17389475863729314768', time=2024-09-12T02:30:54.639142+0000, chain.objs.size()=1 2024-09-12T00:38:38.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.291+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.rZNdZ1hmk8Nd7Wgyr9AyuzG8HBLRJJi_0 2024-09-12T00:38:38.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.291+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15778603638638584856', time=2024-09-12T02:30:54.827061+0000, chain.objs.size()=1 2024-09-12T00:38:38.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.291+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.BdNBkbX0HLFW2D1SquqTT1VChq7YlEG_0 2024-09-12T00:38:38.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.291+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6100833066631193461', time=2024-09-12T02:30:54.834047+0000, chain.objs.size()=1 2024-09-12T00:38:38.291 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.291+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.GEaS8RJKET0cZ0P7HX8uY-pyxzjKVKZ_0 2024-09-12T00:38:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.293+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.67703516635728062', time=2024-09-12T02:30:54.874212+0000, chain.objs.size()=1 2024-09-12T00:38:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.293+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.k86Pt02mp2vSgtAeZlvIAwAkOUydjoE_0 2024-09-12T00:38:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.293+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17379198740463306633', time=2024-09-12T02:30:54.918050+0000, chain.objs.size()=1 2024-09-12T00:38:38.292 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.293+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_._LWYBThwoKHczLtKDZKD4qboD47fGp6_0 2024-09-12T00:38:38.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.293+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13739190744518953545', time=2024-09-12T02:30:54.978003+0000, chain.objs.size()=1 2024-09-12T00:38:38.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.293+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.xRFyhB_VeuY5DC3NTtt9RAJ_DOXNEJt_0 2024-09-12T00:38:38.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.294+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15740824041861927454', time=2024-09-12T02:30:54.992680+0000, chain.objs.size()=1 2024-09-12T00:38:38.293 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.294+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.3cbXmofyf6l1MQnziQ_uIENilG0LkkA_0 2024-09-12T00:38:38.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7286619920857144723', time=2024-09-12T02:30:55.081773+0000, chain.objs.size()=1 2024-09-12T00:38:38.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.wRMtVUqig6EgFFxxDND705mrvs3gNz__0 2024-09-12T00:38:38.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9478277323403486565', time=2024-09-12T02:30:55.144677+0000, chain.objs.size()=1 2024-09-12T00:38:38.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.JXMVglR5VKFeJP8uyv5A-QMajBipmMJ_0 2024-09-12T00:38:38.296 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6348621510908085378', time=2024-09-12T02:30:55.213476+0000, chain.objs.size()=1 2024-09-12T00:38:38.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.262__shadow_.z2jntKlWgTRa011e3nfl7_P6V9H52qE_0 2024-09-12T00:38:38.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10435156449961475680', time=2024-09-12T02:30:55.955089+0000, chain.objs.size()=1 2024-09-12T00:38:38.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.265__shadow_.WxaRljkcgUeJcD71-zlevgpi7jyWMst_0 2024-09-12T00:38:38.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9857798539346556684', time=2024-09-12T02:31:03.652356+0000, chain.objs.size()=1 2024-09-12T00:38:38.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.293__shadow_.Zh4vOZ50-HUAw1ijjIc-Xnurtema9zn_0 2024-09-12T00:38:38.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10659662572653198364', time=2024-09-12T02:31:04.128919+0000, chain.objs.size()=1 2024-09-12T00:38:38.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.295__shadow_.uLrObc3UPlTKr9KAg9bVvV4oq0lY3JM_0 2024-09-12T00:38:38.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11455376405182129048', time=2024-09-12T02:31:19.341887+0000, chain.objs.size()=1 2024-09-12T00:38:38.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.aHDBII9NFTgpUinnVTO3u4PLsnPNI-5_0 2024-09-12T00:38:38.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4753750878633736000', time=2024-09-12T02:31:19.365626+0000, chain.objs.size()=1 2024-09-12T00:38:38.297 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.8M4Tm3kp4y7Bhd9lCiddd94u7XKbapD_0 2024-09-12T00:38:38.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14270821700350322534', time=2024-09-12T02:31:19.369405+0000, chain.objs.size()=1 2024-09-12T00:38:38.298 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.297+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7O_GeWpAfST42rgo4xCPik2gVc9YbCF_0 2024-09-12T00:38:38.299 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.300+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6770579249227910438', time=2024-09-12T02:31:19.696210+0000, chain.objs.size()=1 2024-09-12T00:38:38.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.300+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.PpgFmP_A5tstN_HSItNNxYGEOjbHzBZ_0 2024-09-12T00:38:38.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.300+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.984253213901539424', time=2024-09-12T02:31:19.750428+0000, chain.objs.size()=1 2024-09-12T00:38:38.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.300+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ams1jswKH3c0PnvP-IBj3QkNqL7Hztz_0 2024-09-12T00:38:38.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.300+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9399519178815190847', time=2024-09-12T02:31:19.788746+0000, chain.objs.size()=1 2024-09-12T00:38:38.300 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.300+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.vQ21qp_CTqQmXJGB__RPhvKd19hMIQx_0 2024-09-12T00:38:38.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12663848472787260187', time=2024-09-12T02:31:19.790019+0000, chain.objs.size()=1 2024-09-12T00:38:38.301 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.7ueJN9aMyJKcdsXUEGitgrk6nZRECcV_0 2024-09-12T00:38:38.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7216027416959337214', time=2024-09-12T02:31:19.809739+0000, chain.objs.size()=1 2024-09-12T00:38:38.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.UeCxzVfSBXPQrb4lXWGUrcM_b85OiS5_0 2024-09-12T00:38:38.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16891686115546109431', time=2024-09-12T02:31:19.872251+0000, chain.objs.size()=1 2024-09-12T00:38:38.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.rpTVT26gG0YaRIHdxfRwEcJspB8tPtT_0 2024-09-12T00:38:38.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5545101284449463849', time=2024-09-12T02:31:19.962723+0000, chain.objs.size()=1 2024-09-12T00:38:38.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.TJViPjo4mQPPlScwjuKwYhHLHcWOtYy_0 2024-09-12T00:38:38.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14766087381728442614', time=2024-09-12T02:31:20.088516+0000, chain.objs.size()=1 2024-09-12T00:38:38.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.vF1-7WGGdK5dfdFQBVA29m7uD6zZ9no_0 2024-09-12T00:38:38.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11721854208745051652', time=2024-09-12T02:31:20.098986+0000, chain.objs.size()=1 2024-09-12T00:38:38.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.qtnmrceRzUkPHFtzVDYdOrnkPT2v_dE_0 2024-09-12T00:38:38.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10063753247443847136', time=2024-09-12T02:31:20.106159+0000, chain.objs.size()=1 2024-09-12T00:38:38.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.sH8nKfjoH-yhIkY8hnXgHi58uQ9Q_PD_0 2024-09-12T00:38:38.302 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8555170527711598419', time=2024-09-12T02:31:20.270552+0000, chain.objs.size()=1 2024-09-12T00:38:38.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.302+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.FwSUxnLDDqAtTl1jt2RJZz6pZ1RjCUk_0 2024-09-12T00:38:38.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.304+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10274915826677537213', time=2024-09-12T02:31:20.363599+0000, chain.objs.size()=1 2024-09-12T00:38:38.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.304+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.A7ofPLLSmE3ui_qiqw5A5mFKAyQpvNo_0 2024-09-12T00:38:38.303 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.304+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13875295414787621668', time=2024-09-12T02:31:20.383109+0000, chain.objs.size()=1 2024-09-12T00:38:38.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.304+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.Ghq8V_whnziHj3PdKLgEKsx8yOcRSCg_0 2024-09-12T00:38:38.304 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.305+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15389268120137168962', time=2024-09-12T02:31:20.446251+0000, chain.objs.size()=1 2024-09-12T00:38:38.305 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.305+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.ZR3bzmwDZJi-jsPC24DPttw0Wzl9Nm4_0 2024-09-12T00:38:38.306 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13165673116621850254', time=2024-09-12T02:31:20.473728+0000, chain.objs.size()=1 2024-09-12T00:38:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.MAOzgSltdXU3chtTyQb93zz3GqGHFwl_0 2024-09-12T00:38:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3418831130320098451', time=2024-09-12T02:31:20.657567+0000, chain.objs.size()=1 2024-09-12T00:38:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.EFeZ146gvP58z5XZOwh33f3QxzTlwgU_0 2024-09-12T00:38:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12844509697207540181', time=2024-09-12T02:31:20.677261+0000, chain.objs.size()=1 2024-09-12T00:38:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.aceWB2mVdBeq3XRdSWzYeVA1E21YZ-L_0 2024-09-12T00:38:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3138929331489655695', time=2024-09-12T02:31:20.682317+0000, chain.objs.size()=1 2024-09-12T00:38:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.zwo3g0COOUw6g2QGx4DC_BbgPC5EBZo_0 2024-09-12T00:38:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18411606216025570501', time=2024-09-12T02:31:20.723854+0000, chain.objs.size()=1 2024-09-12T00:38:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.LjjetXpksBvzcC-v9zrEuZsHUXxG1ab_0 2024-09-12T00:38:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1588548421005337182', time=2024-09-12T02:31:20.738619+0000, chain.objs.size()=1 2024-09-12T00:38:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.1fnZeyAvvqzKOOTaf6Cdk3ppPN86FPg_0 2024-09-12T00:38:38.307 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4922348121970965225', time=2024-09-12T02:31:20.858629+0000, chain.objs.size()=1 2024-09-12T00:38:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.21ypLaR6oXZQNcYOZI97dbK7ZETtSZc_0 2024-09-12T00:38:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16382105254129929670', time=2024-09-12T02:31:20.934553+0000, chain.objs.size()=1 2024-09-12T00:38:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.307+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.35Ip_Qp7__ni5JCo1ncWUkgU7iu_ulC_0 2024-09-12T00:38:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.309+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.2096684615916690753', time=2024-09-12T02:31:20.961470+0000, chain.objs.size()=1 2024-09-12T00:38:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.309+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.nV1cf_t2To7zXiwZ0ciOrXiCYYvQ4pJ_0 2024-09-12T00:38:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.309+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1070014144864943445', time=2024-09-12T02:31:21.044308+0000, chain.objs.size()=1 2024-09-12T00:38:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.309+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.iIyDve6zFFhgTV3uCQ1FS2RTY-7-e8q_0 2024-09-12T00:38:38.308 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.309+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1083553473791792415', time=2024-09-12T02:31:21.318356+0000, chain.objs.size()=1 2024-09-12T00:38:38.309 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.309+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.uJ-IZjdSIBVudIEXbmZoutcF8j4VU3a_0 2024-09-12T00:38:38.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3749814534578969743', time=2024-09-12T02:31:21.489462+0000, chain.objs.size()=1 2024-09-12T00:38:38.311 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.02yoMeerU3h3xd30nLkcAq8OqnjBupx_0 2024-09-12T00:38:38.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13339176533051787622', time=2024-09-12T02:31:21.548162+0000, chain.objs.size()=1 2024-09-12T00:38:38.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.323__shadow_.jBjAfvJABZJod-AOvacIwXEpYdlN263_0 2024-09-12T00:38:38.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16102855103574481111', time=2024-09-12T02:31:29.675976+0000, chain.objs.size()=1 2024-09-12T00:38:38.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.dMxn-P_3o9jRESgzRJKzVl9XLROXA12_0 2024-09-12T00:38:38.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4908337311467126946', time=2024-09-12T02:31:29.719760+0000, chain.objs.size()=1 2024-09-12T00:38:38.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.dV-JezwjrAyIzCTaW8__Uelkt--eOsT_0 2024-09-12T00:38:38.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10868365619617916287', time=2024-09-12T02:31:29.751228+0000, chain.objs.size()=1 2024-09-12T00:38:38.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.ixa6TPz7z0SfuilHhiH6bg4-0bksnjd_0 2024-09-12T00:38:38.312 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.312+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9271378638532003679', time=2024-09-12T02:31:29.854055+0000, chain.objs.size()=1 2024-09-12T00:38:38.313 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.312+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-JpzAhKagTN8i89AKIOR4rxCsnJDGfl_0 2024-09-12T00:38:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.315+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1801319566125926862', time=2024-09-12T02:31:30.014762+0000, chain.objs.size()=1 2024-09-12T00:38:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.315+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Pa0O9ik1pVI9vDWPjcjtfXvNEaQUwpE_0 2024-09-12T00:38:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.315+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9870517952600399836', time=2024-09-12T02:31:30.106457+0000, chain.objs.size()=1 2024-09-12T00:38:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.315+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.k6Pyaph8Zca05IqzS48XaIBdXiaVqdW_0 2024-09-12T00:38:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.315+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7157758713781904391', time=2024-09-12T02:31:30.110898+0000, chain.objs.size()=1 2024-09-12T00:38:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.315+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.pc-SAzUF11Pdf750wJ9e4P3AfX-CvLK_0 2024-09-12T00:38:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.315+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4798687514595557048', time=2024-09-12T02:31:30.128762+0000, chain.objs.size()=1 2024-09-12T00:38:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.315+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.SR9eHv2wq8nHVHal4eIz81akqz3Pxso_0 2024-09-12T00:38:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.315+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9899279011701606037', time=2024-09-12T02:31:30.364521+0000, chain.objs.size()=1 2024-09-12T00:38:38.314 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.315+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.O-kpCSlknZXZddh2j4L6x_epTsR6qvZ_0 2024-09-12T00:38:38.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.317+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10498414438794165458', time=2024-09-12T02:31:30.372831+0000, chain.objs.size()=1 2024-09-12T00:38:38.317 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.317+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.eaEjK1c46q1EzdMNo8zIOwEG_uuBzml_0 2024-09-12T00:38:38.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.319+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.808349276367561083', time=2024-09-12T02:31:30.385026+0000, chain.objs.size()=1 2024-09-12T00:38:38.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.319+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.SJqoo-ppuRSEAnTyRyCF-oEahGOB0YH_0 2024-09-12T00:38:38.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.319+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15997544389350995646', time=2024-09-12T02:31:30.399881+0000, chain.objs.size()=1 2024-09-12T00:38:38.318 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.319+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.RjqYLbAC-hrVAUcg6aT_5l8EyxK6Dpq_0 2024-09-12T00:38:38.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.319+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13971856295182370716', time=2024-09-12T02:31:30.405880+0000, chain.objs.size()=1 2024-09-12T00:38:38.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.319+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.a4iIitIYg0U-YZQk0lCL4Y-BcZXQeQq_0 2024-09-12T00:38:38.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.319+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.6584636941085820755', time=2024-09-12T02:31:30.589485+0000, chain.objs.size()=1 2024-09-12T00:38:38.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.319+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.uG0GHkiS9srzh6Cf0kN2wgRH6Pr7jG5_0 2024-09-12T00:38:38.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.319+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8741621342486004390', time=2024-09-12T02:31:30.592281+0000, chain.objs.size()=1 2024-09-12T00:38:38.319 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.319+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.CqIMWvFXuwUuA5vWwxag_9BOoxsek95_0 2024-09-12T00:38:38.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.321+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15224884066528951145', time=2024-09-12T02:31:30.666041+0000, chain.objs.size()=1 2024-09-12T00:38:38.320 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.321+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Q3ApJtmyq6iJieJzKAS6q5_WCuJIsSp_0 2024-09-12T00:38:38.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.322+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9699755030218718324', time=2024-09-12T02:31:30.667755+0000, chain.objs.size()=1 2024-09-12T00:38:38.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.322+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.X2w150FRToQokFQgbL8HsVXU-vuxWb3_0 2024-09-12T00:38:38.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.322+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.16400206065146776659', time=2024-09-12T02:31:30.669510+0000, chain.objs.size()=1 2024-09-12T00:38:38.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.322+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.EVtoGtOnBco1c8dHTzXZo97ZXfgtJad_0 2024-09-12T00:38:38.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.322+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.13915515705959277508', time=2024-09-12T02:31:30.706077+0000, chain.objs.size()=1 2024-09-12T00:38:38.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.322+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.xNtd1BTgsBrvPuzGTlliG_4I0_X9He1_0 2024-09-12T00:38:38.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.322+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.5583980551783156185', time=2024-09-12T02:31:30.760945+0000, chain.objs.size()=1 2024-09-12T00:38:38.321 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.322+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.tJT45h61b0VWRy_C9uaJa_aYWOKEUYj_0 2024-09-12T00:38:38.324 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.325+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.9332871375549742068', time=2024-09-12T02:31:30.868332+0000, chain.objs.size()=1 2024-09-12T00:38:38.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.325+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.EvkAcNfMrggW6sBksQ8Mh5UXOy7yDNX_0 2024-09-12T00:38:38.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.325+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1340695220999785503', time=2024-09-12T02:31:30.877148+0000, chain.objs.size()=1 2024-09-12T00:38:38.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.325+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.VHyXBCBO-F5GBfCvU2DQKRYrxi93O1j_0 2024-09-12T00:38:38.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.326+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12526576618842332523', time=2024-09-12T02:31:30.942670+0000, chain.objs.size()=1 2024-09-12T00:38:38.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.326+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NF1oSNr4C_xwY3LN9QFeZ9W0vRBiztH_0 2024-09-12T00:38:38.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.326+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10188011261527807636', time=2024-09-12T02:31:31.146636+0000, chain.objs.size()=1 2024-09-12T00:38:38.325 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.326+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.6oi_kz8FycAk9zhkR_exrBQsOUWAbUw_0 2024-09-12T00:38:38.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.326+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1886831125041727617', time=2024-09-12T02:31:31.190125+0000, chain.objs.size()=1 2024-09-12T00:38:38.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.326+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.oJ-mtelfuPWx9vS-DNlFOapkYQ0yN5I_0 2024-09-12T00:38:38.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.326+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7895173548344494975', time=2024-09-12T02:31:31.226253+0000, chain.objs.size()=1 2024-09-12T00:38:38.326 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.326+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.INRq2VkGEtl4ko16ZNivDJLvVLaFZsJ_0 2024-09-12T00:38:38.329 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.330+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 0/47465 2024-09-12T00:38:38.332 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T00:38:38.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12703716457919565953', time=2024-09-12T02:31:31.234949+0000, chain.objs.size()=1 2024-09-12T00:38:38.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.5wbQJFeh471pYQdq8dZB_8o2JSQ_eQL_0 2024-09-12T00:38:38.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.208686528391233447', time=2024-09-12T02:31:31.248019+0000, chain.objs.size()=1 2024-09-12T00:38:38.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.TZFIAzwOvdz2wVI9H9PcisCKx3XYmu8_0 2024-09-12T00:38:38.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.3206116898256514177', time=2024-09-12T02:31:31.309637+0000, chain.objs.size()=1 2024-09-12T00:38:38.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.Hrwpwo8C5uY4evu44ZXHhOu6eMwroM0_0 2024-09-12T00:38:38.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1069959263343366577', time=2024-09-12T02:31:31.454717+0000, chain.objs.size()=1 2024-09-12T00:38:38.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.-6nnWIJDeFLejKnT2HgMCuEK34LMK6e_0 2024-09-12T00:38:38.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.14250864214129205428', time=2024-09-12T02:31:31.492548+0000, chain.objs.size()=1 2024-09-12T00:38:38.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.lwW_wZb2Svdk9aZaOnLtAG8TT2GJJDk_0 2024-09-12T00:38:38.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.10814492985160555093', time=2024-09-12T02:31:31.510102+0000, chain.objs.size()=1 2024-09-12T00:38:38.333 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.NWZazGBoYXhDQdVqnIEAu8HnQvmedXv_0 2024-09-12T00:38:38.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17422814362996385231', time=2024-09-12T02:31:31.681269+0000, chain.objs.size()=1 2024-09-12T00:38:38.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.MA6rc48oKTlXzZ_U4LcqJyB7rsxxqxx_0 2024-09-12T00:38:38.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17293336619278540446', time=2024-09-12T02:31:31.745571+0000, chain.objs.size()=1 2024-09-12T00:38:38.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.fDyndh2WDs--7uJyk09GOm6Kv0kcJxS_0 2024-09-12T00:38:38.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17281256815412151973', time=2024-09-12T02:31:31.817951+0000, chain.objs.size()=1 2024-09-12T00:38:38.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.324__shadow_.OSnJL9wumvd8SIxoDJ5mwX0JUILddj4_0 2024-09-12T00:38:38.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.18216813620426037614', time=2024-09-12T02:31:33.851004+0000, chain.objs.size()=1 2024-09-12T00:38:38.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.333__shadow_.WPhH8Wa92DcFwczYTFstWV2sj_8IK6o_0 2024-09-12T00:38:38.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15780078082384692344', time=2024-09-12T02:31:41.687601+0000, chain.objs.size()=1 2024-09-12T00:38:38.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.372__shadow_.M7-pGRKA7YxDkdOPSchrsqhS5rVyO-x_0 2024-09-12T00:38:38.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1304148998158366815', time=2024-09-12T02:32:00.179255+0000, chain.objs.size()=1 2024-09-12T00:38:38.334 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.333+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.436__shadow_.KoUvtnqr3IOk9rR_yROPauQPD17na2x_0 2024-09-12T00:38:38.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7803209437767187642', time=2024-09-12T02:32:05.346054+0000, chain.objs.size()=1 2024-09-12T00:38:38.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.455__shadow_.V-QvZvVDCyu4iuMQb2mNK880DLbdR0z_0 2024-09-12T00:38:38.336 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8334912976966350771', time=2024-09-12T02:32:12.599146+0000, chain.objs.size()=1 2024-09-12T00:38:38.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.483__shadow_.vKYjnnLo3MtnKRWQQwdLaNhpRqaL7rT_0 2024-09-12T00:38:38.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17310169011300239408', time=2024-09-12T02:32:14.468093+0000, chain.objs.size()=1 2024-09-12T00:38:38.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.489__shadow_.hKcbFMtxzMDp792RwOuhHN8LnKkDTR6_0 2024-09-12T00:38:38.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11317122673227513953', time=2024-09-12T02:32:15.742926+0000, chain.objs.size()=1 2024-09-12T00:38:38.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.495__shadow_.YZePzcPIaSams2b8pGiZLyp9Xs27Hce_0 2024-09-12T00:38:38.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.337+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.8255313381570489745', time=2024-09-12T02:32:19.929962+0000, chain.objs.size()=6 2024-09-12T00:38:38.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.1 2024-09-12T00:38:38.337 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.337+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.2 2024-09-12T00:38:38.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.339+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.3 2024-09-12T00:38:38.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.339+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.4 2024-09-12T00:38:38.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.339+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.5 2024-09-12T00:38:38.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.339+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.507__multipart_srcmultipart.2~Es4rVTk0nJIobzYzC8cRnBIjzdGGu4d.6 2024-09-12T00:38:38.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.339+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.4615611346458227345', time=2024-09-12T02:32:21.030791+0000, chain.objs.size()=1 2024-09-12T00:38:38.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.339+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.513__multipart_mymultipart.2~U-gTSUCXusvp2aOQnQJcP_w9GV0Ckj3.1 2024-09-12T00:38:38.339 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.340+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.1347104217057104335', time=2024-09-12T02:33:19.095197+0000, chain.objs.size()=1 2024-09-12T00:38:38.340 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.340+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:w1spiACkEu0VIVki3csgZ49K9xWwIDy_.GKFus0NfIEs6DmfeE7gvpMgW_Q4wnY3_0 2024-09-12T00:38:38.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.342+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15755245546794932424', time=2024-09-12T02:33:20.116235+0000, chain.objs.size()=1 2024-09-12T00:38:38.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.342+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.569__shadow:qfVGyZlTcgoXA0oplpz9uBJmadWB1aw_.Lq1McU6TuFJ2jXINU30ehTr3h6mBE2M_0 2024-09-12T00:38:38.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.342+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.58268245759853140', time=2024-09-12T02:33:35.403328+0000, chain.objs.size()=1 2024-09-12T00:38:38.341 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.342+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.577__shadow:Ik0XOrgvBjwXI6cXinQQXI1A.LuxlBM_.F_4-YcuW26JZs4awiXCVuaNk40xjVEh_0 2024-09-12T00:38:38.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.343+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17442065205603390457', time=2024-09-12T02:33:45.816937+0000, chain.objs.size()=1 2024-09-12T00:38:38.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.343+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.579__shadow:-5Gs3rptTDBxaDbZBmEGR-UXRbQCA4t_.UusgUUnsWeUioPePzLMa14c4gDva9-7_0 2024-09-12T00:38:38.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.343+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15004098847004845090', time=2024-09-12T02:33:53.791447+0000, chain.objs.size()=1 2024-09-12T00:38:38.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.343+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.608__shadow_.QiUN2juhvT83TCSaYYkWCINV9BnCWPr_0 2024-09-12T00:38:38.342 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.343+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.12247676137195660948', time=2024-09-12T02:33:58.335931+0000, chain.objs.size()=6 2024-09-12T00:38:38.343 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.343+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.615__multipart_multipart_enc.2~VwsaWvayHdU8ejyRZTtjuZJQyTG-MXH.1 2024-09-12T00:38:38.344 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.345+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.615__multipart_multipart_enc.2~VwsaWvayHdU8ejyRZTtjuZJQyTG-MXH.2 2024-09-12T00:38:38.345 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.346+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.615__multipart_multipart_enc.2~VwsaWvayHdU8ejyRZTtjuZJQyTG-MXH.3 2024-09-12T00:38:38.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.346+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.615__multipart_multipart_enc.2~VwsaWvayHdU8ejyRZTtjuZJQyTG-MXH.4 2024-09-12T00:38:38.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.346+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.615__multipart_multipart_enc.2~VwsaWvayHdU8ejyRZTtjuZJQyTG-MXH.5 2024-09-12T00:38:38.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.346+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.615__multipart_multipart_enc.2~VwsaWvayHdU8ejyRZTtjuZJQyTG-MXH.6 2024-09-12T00:38:38.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.346+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.15799789278221339433', time=2024-09-12T02:36:06.573041+0000, chain.objs.size()=1 2024-09-12T00:38:38.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.346+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.636__shadow_.ktdmbk-1yTStuXvX14SYrZyLRmjom38_0 2024-09-12T00:38:38.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.346+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.11109139534987206091', time=2024-09-12T02:36:10.375377+0000, chain.objs.size()=2 2024-09-12T00:38:38.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.346+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.649__shadow_.vBcX7ZhHtdEsm1b123883CKgV8Cd2wu_0 2024-09-12T00:38:38.346 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.346+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.649__shadow_.vBcX7ZhHtdEsm1b123883CKgV8Cd2wu_1 2024-09-12T00:38:38.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.349+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.17800386971388275950', time=2024-09-12T02:36:27.354223+0000, chain.objs.size()=1 2024-09-12T00:38:38.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.349+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.709__shadow_.a3ho6s35Xw1IQd5snpH6s4wWANddhvt_0 2024-09-12T00:38:38.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.349+0000 7f10d6613800 20 garbage collection: RGWGC::process iterating over entry tag='ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.7065807254129748875', time=2024-09-12T02:36:58.976291+0000, chain.objs.size()=1 2024-09-12T00:38:38.348 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.349+0000 7f10d6613800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:ac196c0a-dca9-437f-ae63-d6980c8d425b.4532.745__shadow_.uy4khQR2p9lQJgDgqQIcnl-FxYGQBv6_0 2024-09-12T00:38:38.354 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.355+0000 7f10d6613800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:38.357 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.358+0000 7f0f83fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.360+0000 7f10d6613800 20 remove_watcher() i=0 2024-09-12T00:38:38.359 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.360+0000 7f10d6613800 2 removed watcher, disabling cache 2024-09-12T00:38:38.360 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.361+0000 7f10d6613800 20 remove_watcher() i=1 2024-09-12T00:38:38.361 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.362+0000 7f10d6613800 20 remove_watcher() i=2 2024-09-12T00:38:38.362 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.363+0000 7f10d6613800 20 remove_watcher() i=3 2024-09-12T00:38:38.363 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.364+0000 7f10d6613800 20 remove_watcher() i=4 2024-09-12T00:38:38.364 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.365+0000 7f10d6613800 20 remove_watcher() i=5 2024-09-12T00:38:38.365 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.366+0000 7f10d6613800 20 remove_watcher() i=6 2024-09-12T00:38:38.366 INFO:teuthology.orchestra.run.smithi067.stderr:2024-09-12T00:38:38.367+0000 7f10d6613800 20 remove_watcher() i=7 2024-09-12T00:38:38.379 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T00:38:38.391 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T00:38:38.400 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:38:38.400 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:38:38.756 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:38:38.769 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T00:38:38.771 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":1364,"stamp":"2024-09-12T00:38:37.627546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661242444,"num_objects":4425,"num_object_clones":0,"num_object_copies":16924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4425,"num_whiteouts":0,"num_read":175391,"num_read_kb":2423358,"num_write":138652,"num_write_kb":2382567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13600,"ondisk_log_size":13600,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2604888,"kb_used_data":1079784,"kb_used_omap":12,"kb_used_meta":1524915,"kb_avail":752369832,"statfs":{"total":773094113280,"available":770426707968,"internally_reserved":0,"allocated":1105698816,"data_stored":1089753011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1561513520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-31998863,"num_objects":-369,"num_object_clones":0,"num_object_copies":-1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-369,"num_whiteouts":0,"num_read":530,"num_read_kb":617,"num_write":436,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005642"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.383088+0000","last_change":"2024-09-12T00:27:17.580532+0000","last_active":"2024-09-12T00:34:49.383088+0000","last_peered":"2024-09-12T00:34:49.383088+0000","last_clean":"2024-09-12T00:34:49.383088+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:34:49.383088+0000","last_undegraded":"2024-09-12T00:34:49.383088+0000","last_fullsized":"2024-09-12T00:34:49.383088+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:42.988688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'10","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.315467+0000","last_change":"2024-09-12T00:17:03.214457+0000","last_active":"2024-09-12T00:38:36.315467+0000","last_peered":"2024-09-12T00:38:36.315467+0000","last_clean":"2024-09-12T00:38:36.315467+0000","last_became_active":"2024-09-12T00:17:03.213906+0000","last_became_peered":"2024-09-12T00:17:03.213906+0000","last_unstale":"2024-09-12T00:38:36.315467+0000","last_undegraded":"2024-09-12T00:38:36.315467+0000","last_fullsized":"2024-09-12T00:38:36.315467+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:43.554284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":18831,"num_write":10,"num_write_kb":11989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.498249+0000","last_change":"2024-09-12T00:17:00.182788+0000","last_active":"2024-09-12T00:34:29.498249+0000","last_peered":"2024-09-12T00:34:29.498249+0000","last_clean":"2024-09-12T00:34:29.498249+0000","last_became_active":"2024-09-12T00:17:00.182510+0000","last_became_peered":"2024-09-12T00:17:00.182510+0000","last_unstale":"2024-09-12T00:34:29.498249+0000","last_undegraded":"2024-09-12T00:34:29.498249+0000","last_fullsized":"2024-09-12T00:34:29.498249+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:10.766253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'18","reported_seq":91,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:27.517806+0000","last_change":"2024-09-12T00:15:34.415639+0000","last_active":"2024-09-12T00:36:27.517806+0000","last_peered":"2024-09-12T00:36:27.517806+0000","last_clean":"2024-09-12T00:36:27.517806+0000","last_became_active":"2024-09-12T00:15:34.415364+0000","last_became_peered":"2024-09-12T00:15:34.415364+0000","last_unstale":"2024-09-12T00:36:27.517806+0000","last_undegraded":"2024-09-12T00:36:27.517806+0000","last_fullsized":"2024-09-12T00:36:27.517806+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:04.462246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.500985+0000","last_change":"2024-09-12T00:27:17.581875+0000","last_active":"2024-09-12T00:34:49.500985+0000","last_peered":"2024-09-12T00:34:49.500985+0000","last_clean":"2024-09-12T00:34:49.500985+0000","last_became_active":"2024-09-12T00:27:17.581520+0000","last_became_peered":"2024-09-12T00:27:17.581520+0000","last_unstale":"2024-09-12T00:34:49.500985+0000","last_undegraded":"2024-09-12T00:34:49.500985+0000","last_fullsized":"2024-09-12T00:34:49.500985+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:28.315835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'1","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615836+0000","last_change":"2024-09-12T00:17:03.206913+0000","last_active":"2024-09-12T00:34:34.615836+0000","last_peered":"2024-09-12T00:34:34.615836+0000","last_clean":"2024-09-12T00:34:34.615836+0000","last_became_active":"2024-09-12T00:17:03.206566+0000","last_became_peered":"2024-09-12T00:17:03.206566+0000","last_unstale":"2024-09-12T00:34:34.615836+0000","last_undegraded":"2024-09-12T00:34:34.615836+0000","last_fullsized":"2024-09-12T00:34:34.615836+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.057828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'2","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.498577+0000","last_change":"2024-09-12T00:17:00.176346+0000","last_active":"2024-09-12T00:34:29.498577+0000","last_peered":"2024-09-12T00:34:29.498577+0000","last_clean":"2024-09-12T00:34:29.498577+0000","last_became_active":"2024-09-12T00:17:00.175196+0000","last_became_peered":"2024-09-12T00:17:00.175196+0000","last_unstale":"2024-09-12T00:34:29.498577+0000","last_undegraded":"2024-09-12T00:34:29.498577+0000","last_fullsized":"2024-09-12T00:34:29.498577+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:52.503715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"258'75","reported_seq":276,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:42.511663+0000","last_change":"2024-09-12T00:15:34.417010+0000","last_active":"2024-09-12T00:35:42.511663+0000","last_peered":"2024-09-12T00:35:42.511663+0000","last_clean":"2024-09-12T00:35:42.511663+0000","last_became_active":"2024-09-12T00:15:34.416706+0000","last_became_peered":"2024-09-12T00:15:34.416706+0000","last_unstale":"2024-09-12T00:35:42.511663+0000","last_undegraded":"2024-09-12T00:35:42.511663+0000","last_fullsized":"2024-09-12T00:35:42.511663+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:28.483679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":462,"num_read_kb":331,"num_write":93,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:31.497481+0000","last_change":"2024-09-12T00:27:17.573237+0000","last_active":"2024-09-12T00:34:31.497481+0000","last_peered":"2024-09-12T00:34:31.497481+0000","last_clean":"2024-09-12T00:34:31.497481+0000","last_became_active":"2024-09-12T00:27:17.572934+0000","last_became_peered":"2024-09-12T00:27:17.572934+0000","last_unstale":"2024-09-12T00:34:31.497481+0000","last_undegraded":"2024-09-12T00:34:31.497481+0000","last_fullsized":"2024-09-12T00:34:31.497481+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:52.238701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'2","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510306+0000","last_change":"2024-09-12T00:17:03.212082+0000","last_active":"2024-09-12T00:35:49.510306+0000","last_peered":"2024-09-12T00:35:49.510306+0000","last_clean":"2024-09-12T00:35:49.510306+0000","last_became_active":"2024-09-12T00:17:03.211755+0000","last_became_peered":"2024-09-12T00:17:03.211755+0000","last_unstale":"2024-09-12T00:35:49.510306+0000","last_undegraded":"2024-09-12T00:35:49.510306+0000","last_fullsized":"2024-09-12T00:35:49.510306+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:11.463541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503282+0000","last_change":"2024-09-12T00:17:00.181734+0000","last_active":"2024-09-12T00:35:04.503282+0000","last_peered":"2024-09-12T00:35:04.503282+0000","last_clean":"2024-09-12T00:35:04.503282+0000","last_became_active":"2024-09-12T00:17:00.181461+0000","last_became_peered":"2024-09-12T00:17:00.181461+0000","last_unstale":"2024-09-12T00:35:04.503282+0000","last_undegraded":"2024-09-12T00:35:04.503282+0000","last_fullsized":"2024-09-12T00:35:04.503282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:40.876171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'16","reported_seq":82,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:34.507625+0000","last_change":"2024-09-12T00:15:34.428333+0000","last_active":"2024-09-12T00:35:34.507625+0000","last_peered":"2024-09-12T00:35:34.507625+0000","last_clean":"2024-09-12T00:35:34.507625+0000","last_became_active":"2024-09-12T00:15:34.428023+0000","last_became_peered":"2024-09-12T00:15:34.428023+0000","last_unstale":"2024-09-12T00:35:34.507625+0000","last_undegraded":"2024-09-12T00:35:34.507625+0000","last_fullsized":"2024-09-12T00:35:34.507625+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:33.470085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499223+0000","last_change":"2024-09-12T00:27:17.577865+0000","last_active":"2024-09-12T00:34:34.499223+0000","last_peered":"2024-09-12T00:34:34.499223+0000","last_clean":"2024-09-12T00:34:34.499223+0000","last_became_active":"2024-09-12T00:27:17.577034+0000","last_became_peered":"2024-09-12T00:27:17.577034+0000","last_unstale":"2024-09-12T00:34:34.499223+0000","last_undegraded":"2024-09-12T00:34:34.499223+0000","last_fullsized":"2024-09-12T00:34:34.499223+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:24.642513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"261'2","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503652+0000","last_change":"2024-09-12T00:17:03.210262+0000","last_active":"2024-09-12T00:35:04.503652+0000","last_peered":"2024-09-12T00:35:04.503652+0000","last_clean":"2024-09-12T00:35:04.503652+0000","last_became_active":"2024-09-12T00:17:03.209945+0000","last_became_peered":"2024-09-12T00:17:03.209945+0000","last_unstale":"2024-09-12T00:35:04.503652+0000","last_undegraded":"2024-09-12T00:35:04.503652+0000","last_fullsized":"2024-09-12T00:35:04.503652+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:00.406310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:46.508609+0000","last_change":"2024-09-12T00:17:00.177502+0000","last_active":"2024-09-12T00:35:46.508609+0000","last_peered":"2024-09-12T00:35:46.508609+0000","last_clean":"2024-09-12T00:35:46.508609+0000","last_became_active":"2024-09-12T00:17:00.176151+0000","last_became_peered":"2024-09-12T00:17:00.176151+0000","last_unstale":"2024-09-12T00:35:46.508609+0000","last_undegraded":"2024-09-12T00:35:46.508609+0000","last_fullsized":"2024-09-12T00:35:46.508609+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:32.829277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'69","reported_seq":229,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.090824+0000","last_change":"2024-09-12T00:15:34.422703+0000","last_active":"2024-09-12T00:36:56.090824+0000","last_peered":"2024-09-12T00:36:56.090824+0000","last_clean":"2024-09-12T00:36:56.090824+0000","last_became_active":"2024-09-12T00:15:34.422426+0000","last_became_peered":"2024-09-12T00:15:34.422426+0000","last_unstale":"2024-09-12T00:36:56.090824+0000","last_undegraded":"2024-09-12T00:36:56.090824+0000","last_fullsized":"2024-09-12T00:36:56.090824+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:50.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":354,"num_read_kb":254,"num_write":121,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:19.505464+0000","last_change":"2024-09-12T00:27:17.579859+0000","last_active":"2024-09-12T00:35:19.505464+0000","last_peered":"2024-09-12T00:35:19.505464+0000","last_clean":"2024-09-12T00:35:19.505464+0000","last_became_active":"2024-09-12T00:27:17.579540+0000","last_became_peered":"2024-09-12T00:27:17.579540+0000","last_unstale":"2024-09-12T00:35:19.505464+0000","last_undegraded":"2024-09-12T00:35:19.505464+0000","last_fullsized":"2024-09-12T00:35:19.505464+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:23.867988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:04.377127+0000","last_change":"2024-09-12T00:17:03.220542+0000","last_active":"2024-09-12T00:34:04.377127+0000","last_peered":"2024-09-12T00:34:04.377127+0000","last_clean":"2024-09-12T00:34:04.377127+0000","last_became_active":"2024-09-12T00:17:03.218684+0000","last_became_peered":"2024-09-12T00:17:03.218684+0000","last_unstale":"2024-09-12T00:34:04.377127+0000","last_undegraded":"2024-09-12T00:34:04.377127+0000","last_fullsized":"2024-09-12T00:34:04.377127+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:18.120265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'16","reported_seq":71,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:54.493830+0000","last_change":"2024-09-12T00:17:00.186275+0000","last_active":"2024-09-12T00:33:54.493830+0000","last_peered":"2024-09-12T00:33:54.493830+0000","last_clean":"2024-09-12T00:33:54.493830+0000","last_became_active":"2024-09-12T00:17:00.185974+0000","last_became_peered":"2024-09-12T00:17:00.185974+0000","last_unstale":"2024-09-12T00:33:54.493830+0000","last_undegraded":"2024-09-12T00:33:54.493830+0000","last_fullsized":"2024-09-12T00:33:54.493830+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:40.351049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":38916,"num_write":31,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'44","reported_seq":155,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:34.507543+0000","last_change":"2024-09-12T00:15:34.423404+0000","last_active":"2024-09-12T00:35:34.507543+0000","last_peered":"2024-09-12T00:35:34.507543+0000","last_clean":"2024-09-12T00:35:34.507543+0000","last_became_active":"2024-09-12T00:15:34.423149+0000","last_became_peered":"2024-09-12T00:15:34.423149+0000","last_unstale":"2024-09-12T00:35:34.507543+0000","last_undegraded":"2024-09-12T00:35:34.507543+0000","last_fullsized":"2024-09-12T00:35:34.507543+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:23.508263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":150,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:37.510807+0000","last_change":"2024-09-12T00:27:17.575993+0000","last_active":"2024-09-12T00:35:37.510807+0000","last_peered":"2024-09-12T00:35:37.510807+0000","last_clean":"2024-09-12T00:35:37.510807+0000","last_became_active":"2024-09-12T00:27:17.575513+0000","last_became_peered":"2024-09-12T00:27:17.575513+0000","last_unstale":"2024-09-12T00:35:37.510807+0000","last_undegraded":"2024-09-12T00:35:37.510807+0000","last_fullsized":"2024-09-12T00:35:37.510807+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:31.106786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.376944+0000","last_change":"2024-09-12T00:17:03.220037+0000","last_active":"2024-09-12T00:33:59.376944+0000","last_peered":"2024-09-12T00:33:59.376944+0000","last_clean":"2024-09-12T00:33:59.376944+0000","last_became_active":"2024-09-12T00:17:03.219058+0000","last_became_peered":"2024-09-12T00:17:03.219058+0000","last_unstale":"2024-09-12T00:33:59.376944+0000","last_undegraded":"2024-09-12T00:33:59.376944+0000","last_fullsized":"2024-09-12T00:33:59.376944+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:44.822354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.377013+0000","last_change":"2024-09-12T00:17:00.183145+0000","last_active":"2024-09-12T00:33:59.377013+0000","last_peered":"2024-09-12T00:33:59.377013+0000","last_clean":"2024-09-12T00:33:59.377013+0000","last_became_active":"2024-09-12T00:17:00.182830+0000","last_became_peered":"2024-09-12T00:17:00.182830+0000","last_unstale":"2024-09-12T00:33:59.377013+0000","last_undegraded":"2024-09-12T00:33:59.377013+0000","last_fullsized":"2024-09-12T00:33:59.377013+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:04.640403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'10","reported_seq":67,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:34.625266+0000","last_change":"2024-09-12T00:15:34.421131+0000","last_active":"2024-09-12T00:35:34.625266+0000","last_peered":"2024-09-12T00:35:34.625266+0000","last_clean":"2024-09-12T00:35:34.625266+0000","last_became_active":"2024-09-12T00:15:34.420841+0000","last_became_peered":"2024-09-12T00:15:34.420841+0000","last_unstale":"2024-09-12T00:35:34.625266+0000","last_undegraded":"2024-09-12T00:35:34.625266+0000","last_fullsized":"2024-09-12T00:35:34.625266+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:18.021901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.618279+0000","last_change":"2024-09-12T00:27:17.583663+0000","last_active":"2024-09-12T00:34:49.618279+0000","last_peered":"2024-09-12T00:34:49.618279+0000","last_clean":"2024-09-12T00:34:49.618279+0000","last_became_active":"2024-09-12T00:27:17.583300+0000","last_became_peered":"2024-09-12T00:27:17.583300+0000","last_unstale":"2024-09-12T00:34:49.618279+0000","last_undegraded":"2024-09-12T00:34:49.618279+0000","last_fullsized":"2024-09-12T00:34:49.618279+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:10.632365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615804+0000","last_change":"2024-09-12T00:17:03.212176+0000","last_active":"2024-09-12T00:34:34.615804+0000","last_peered":"2024-09-12T00:34:34.615804+0000","last_clean":"2024-09-12T00:34:34.615804+0000","last_became_active":"2024-09-12T00:17:03.211869+0000","last_became_peered":"2024-09-12T00:17:03.211869+0000","last_unstale":"2024-09-12T00:34:34.615804+0000","last_undegraded":"2024-09-12T00:34:34.615804+0000","last_fullsized":"2024-09-12T00:34:34.615804+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:39.796531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.380585+0000","last_change":"2024-09-12T00:17:00.181340+0000","last_active":"2024-09-12T00:34:29.380585+0000","last_peered":"2024-09-12T00:34:29.380585+0000","last_clean":"2024-09-12T00:34:29.380585+0000","last_became_active":"2024-09-12T00:17:00.180995+0000","last_became_peered":"2024-09-12T00:17:00.180995+0000","last_unstale":"2024-09-12T00:34:29.380585+0000","last_undegraded":"2024-09-12T00:34:29.380585+0000","last_fullsized":"2024-09-12T00:34:29.380585+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:35.862245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"261'23","reported_seq":101,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.468546+0000","last_change":"2024-09-12T00:15:34.417460+0000","last_active":"2024-09-12T00:36:56.468546+0000","last_peered":"2024-09-12T00:36:56.468546+0000","last_clean":"2024-09-12T00:36:56.468546+0000","last_became_active":"2024-09-12T00:15:34.417149+0000","last_became_peered":"2024-09-12T00:15:34.417149+0000","last_unstale":"2024-09-12T00:36:56.468546+0000","last_undegraded":"2024-09-12T00:36:56.468546+0000","last_fullsized":"2024-09-12T00:36:56.468546+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:57.189731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.383151+0000","last_change":"2024-09-12T00:27:17.579098+0000","last_active":"2024-09-12T00:34:49.383151+0000","last_peered":"2024-09-12T00:34:49.383151+0000","last_clean":"2024-09-12T00:34:49.383151+0000","last_became_active":"2024-09-12T00:27:17.578739+0000","last_became_peered":"2024-09-12T00:27:17.578739+0000","last_unstale":"2024-09-12T00:34:49.383151+0000","last_undegraded":"2024-09-12T00:34:49.383151+0000","last_fullsized":"2024-09-12T00:34:49.383151+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:48.348663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498899+0000","last_change":"2024-09-12T00:17:03.213329+0000","last_active":"2024-09-12T00:34:34.498899+0000","last_peered":"2024-09-12T00:34:34.498899+0000","last_clean":"2024-09-12T00:34:34.498899+0000","last_became_active":"2024-09-12T00:17:03.213071+0000","last_became_peered":"2024-09-12T00:17:03.213071+0000","last_unstale":"2024-09-12T00:34:34.498899+0000","last_undegraded":"2024-09-12T00:34:34.498899+0000","last_fullsized":"2024-09-12T00:34:34.498899+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:46.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.497692+0000","last_change":"2024-09-12T00:17:00.178668+0000","last_active":"2024-09-12T00:34:29.497692+0000","last_peered":"2024-09-12T00:34:29.497692+0000","last_clean":"2024-09-12T00:34:29.497692+0000","last_became_active":"2024-09-12T00:17:00.178279+0000","last_became_peered":"2024-09-12T00:17:00.178279+0000","last_unstale":"2024-09-12T00:34:29.497692+0000","last_undegraded":"2024-09-12T00:34:29.497692+0000","last_fullsized":"2024-09-12T00:34:29.497692+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:59.897917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'24","reported_seq":104,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:54.501600+0000","last_change":"2024-09-12T00:15:34.420370+0000","last_active":"2024-09-12T00:34:54.501600+0000","last_peered":"2024-09-12T00:34:54.501600+0000","last_clean":"2024-09-12T00:34:54.501600+0000","last_became_active":"2024-09-12T00:15:34.420120+0000","last_became_peered":"2024-09-12T00:15:34.420120+0000","last_unstale":"2024-09-12T00:34:54.501600+0000","last_undegraded":"2024-09-12T00:34:54.501600+0000","last_fullsized":"2024-09-12T00:34:54.501600+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:10.354241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.497122+0000","last_change":"2024-09-12T00:27:17.578396+0000","last_active":"2024-09-12T00:34:19.497122+0000","last_peered":"2024-09-12T00:34:19.497122+0000","last_clean":"2024-09-12T00:34:19.497122+0000","last_became_active":"2024-09-12T00:27:17.577671+0000","last_became_peered":"2024-09-12T00:27:17.577671+0000","last_unstale":"2024-09-12T00:34:19.497122+0000","last_undegraded":"2024-09-12T00:34:19.497122+0000","last_fullsized":"2024-09-12T00:34:19.497122+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:02.287213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.494167+0000","last_change":"2024-09-12T00:17:03.214034+0000","last_active":"2024-09-12T00:33:59.494167+0000","last_peered":"2024-09-12T00:33:59.494167+0000","last_clean":"2024-09-12T00:33:59.494167+0000","last_became_active":"2024-09-12T00:17:03.213775+0000","last_became_peered":"2024-09-12T00:17:03.213775+0000","last_unstale":"2024-09-12T00:33:59.494167+0000","last_undegraded":"2024-09-12T00:33:59.494167+0000","last_fullsized":"2024-09-12T00:33:59.494167+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:03.713762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'4","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391598+0000","last_change":"2024-09-12T00:17:00.183189+0000","last_active":"2024-09-12T00:35:44.391598+0000","last_peered":"2024-09-12T00:35:44.391598+0000","last_clean":"2024-09-12T00:35:44.391598+0000","last_became_active":"2024-09-12T00:17:00.182842+0000","last_became_peered":"2024-09-12T00:17:00.182842+0000","last_unstale":"2024-09-12T00:35:44.391598+0000","last_undegraded":"2024-09-12T00:35:44.391598+0000","last_fullsized":"2024-09-12T00:35:44.391598+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:45.925037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'14","reported_seq":77,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:57.505085+0000","last_change":"2024-09-12T00:15:34.421873+0000","last_active":"2024-09-12T00:34:57.505085+0000","last_peered":"2024-09-12T00:34:57.505085+0000","last_clean":"2024-09-12T00:34:57.505085+0000","last_became_active":"2024-09-12T00:15:34.421585+0000","last_became_peered":"2024-09-12T00:15:34.421585+0000","last_unstale":"2024-09-12T00:34:57.505085+0000","last_undegraded":"2024-09-12T00:34:57.505085+0000","last_fullsized":"2024-09-12T00:34:57.505085+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:19.525663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.496362+0000","last_change":"2024-09-12T00:27:17.573564+0000","last_active":"2024-09-12T00:34:19.496362+0000","last_peered":"2024-09-12T00:34:19.496362+0000","last_clean":"2024-09-12T00:34:19.496362+0000","last_became_active":"2024-09-12T00:27:17.572899+0000","last_became_peered":"2024-09-12T00:27:17.572899+0000","last_unstale":"2024-09-12T00:34:19.496362+0000","last_undegraded":"2024-09-12T00:34:19.496362+0000","last_fullsized":"2024-09-12T00:34:19.496362+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.537722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509411+0000","last_change":"2024-09-12T00:17:03.217326+0000","last_active":"2024-09-12T00:35:44.509411+0000","last_peered":"2024-09-12T00:35:44.509411+0000","last_clean":"2024-09-12T00:35:44.509411+0000","last_became_active":"2024-09-12T00:17:03.217052+0000","last_became_peered":"2024-09-12T00:17:03.217052+0000","last_unstale":"2024-09-12T00:35:44.509411+0000","last_undegraded":"2024-09-12T00:35:44.509411+0000","last_fullsized":"2024-09-12T00:35:44.509411+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:57.870587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:54.375795+0000","last_change":"2024-09-12T00:17:00.181429+0000","last_active":"2024-09-12T00:33:54.375795+0000","last_peered":"2024-09-12T00:33:54.375795+0000","last_clean":"2024-09-12T00:33:54.375795+0000","last_became_active":"2024-09-12T00:17:00.181082+0000","last_became_peered":"2024-09-12T00:17:00.181082+0000","last_unstale":"2024-09-12T00:33:54.375795+0000","last_undegraded":"2024-09-12T00:33:54.375795+0000","last_fullsized":"2024-09-12T00:33:54.375795+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:14.637476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'32","reported_seq":127,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:57.505046+0000","last_change":"2024-09-12T00:15:34.414194+0000","last_active":"2024-09-12T00:34:57.505046+0000","last_peered":"2024-09-12T00:34:57.505046+0000","last_clean":"2024-09-12T00:34:57.505046+0000","last_became_active":"2024-09-12T00:15:34.413875+0000","last_became_peered":"2024-09-12T00:15:34.413875+0000","last_unstale":"2024-09-12T00:34:57.505046+0000","last_undegraded":"2024-09-12T00:34:57.505046+0000","last_fullsized":"2024-09-12T00:34:57.505046+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:38.268487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":63,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.613353+0000","last_change":"2024-09-12T00:27:17.577218+0000","last_active":"2024-09-12T00:34:19.613353+0000","last_peered":"2024-09-12T00:34:19.613353+0000","last_clean":"2024-09-12T00:34:19.613353+0000","last_became_active":"2024-09-12T00:27:17.576878+0000","last_became_peered":"2024-09-12T00:27:17.576878+0000","last_unstale":"2024-09-12T00:34:19.613353+0000","last_undegraded":"2024-09-12T00:34:19.613353+0000","last_fullsized":"2024-09-12T00:34:19.613353+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:47.322848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.494224+0000","last_change":"2024-09-12T00:17:03.216054+0000","last_active":"2024-09-12T00:33:59.494224+0000","last_peered":"2024-09-12T00:33:59.494224+0000","last_clean":"2024-09-12T00:33:59.494224+0000","last_became_active":"2024-09-12T00:17:03.215625+0000","last_became_peered":"2024-09-12T00:17:03.215625+0000","last_unstale":"2024-09-12T00:33:59.494224+0000","last_undegraded":"2024-09-12T00:33:59.494224+0000","last_fullsized":"2024-09-12T00:33:59.494224+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:53.227970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:54.493546+0000","last_change":"2024-09-12T00:17:00.182907+0000","last_active":"2024-09-12T00:33:54.493546+0000","last_peered":"2024-09-12T00:33:54.493546+0000","last_clean":"2024-09-12T00:33:54.493546+0000","last_became_active":"2024-09-12T00:17:00.182392+0000","last_became_peered":"2024-09-12T00:17:00.182392+0000","last_unstale":"2024-09-12T00:33:54.493546+0000","last_undegraded":"2024-09-12T00:33:54.493546+0000","last_fullsized":"2024-09-12T00:33:54.493546+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:13.824576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:54.501773+0000","last_change":"2024-09-12T00:15:34.419666+0000","last_active":"2024-09-12T00:34:54.501773+0000","last_peered":"2024-09-12T00:34:54.501773+0000","last_clean":"2024-09-12T00:34:54.501773+0000","last_became_active":"2024-09-12T00:15:34.419377+0000","last_became_peered":"2024-09-12T00:15:34.419377+0000","last_unstale":"2024-09-12T00:34:54.501773+0000","last_undegraded":"2024-09-12T00:34:54.501773+0000","last_fullsized":"2024-09-12T00:34:54.501773+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:00.834278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.379164+0000","last_change":"2024-09-12T00:27:17.580695+0000","last_active":"2024-09-12T00:34:19.379164+0000","last_peered":"2024-09-12T00:34:19.379164+0000","last_clean":"2024-09-12T00:34:19.379164+0000","last_became_active":"2024-09-12T00:27:17.580400+0000","last_became_peered":"2024-09-12T00:27:17.580400+0000","last_unstale":"2024-09-12T00:34:19.379164+0000","last_undegraded":"2024-09-12T00:34:19.379164+0000","last_fullsized":"2024-09-12T00:34:19.379164+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:32.333059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"258'5","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.376572+0000","last_change":"2024-09-12T00:17:03.224050+0000","last_active":"2024-09-12T00:33:59.376572+0000","last_peered":"2024-09-12T00:33:59.376572+0000","last_clean":"2024-09-12T00:33:59.376572+0000","last_became_active":"2024-09-12T00:17:03.223700+0000","last_became_peered":"2024-09-12T00:17:03.223700+0000","last_unstale":"2024-09-12T00:33:59.376572+0000","last_undegraded":"2024-09-12T00:33:59.376572+0000","last_fullsized":"2024-09-12T00:33:59.376572+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:20.435420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:54.493928+0000","last_change":"2024-09-12T00:17:00.170090+0000","last_active":"2024-09-12T00:33:54.493928+0000","last_peered":"2024-09-12T00:33:54.493928+0000","last_clean":"2024-09-12T00:33:54.493928+0000","last_became_active":"2024-09-12T00:17:00.169797+0000","last_became_peered":"2024-09-12T00:17:00.169797+0000","last_unstale":"2024-09-12T00:33:54.493928+0000","last_undegraded":"2024-09-12T00:33:54.493928+0000","last_fullsized":"2024-09-12T00:33:54.493928+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:21.374423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'40","reported_seq":151,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:53.994944+0000","last_change":"2024-09-12T00:15:34.422467+0000","last_active":"2024-09-12T00:36:53.994944+0000","last_peered":"2024-09-12T00:36:53.994944+0000","last_clean":"2024-09-12T00:36:53.994944+0000","last_became_active":"2024-09-12T00:15:34.422176+0000","last_became_peered":"2024-09-12T00:15:34.422176+0000","last_unstale":"2024-09-12T00:36:53.994944+0000","last_undegraded":"2024-09-12T00:36:53.994944+0000","last_fullsized":"2024-09-12T00:36:53.994944+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.956475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":149,"num_write":70,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499308+0000","last_change":"2024-09-12T00:27:17.579910+0000","last_active":"2024-09-12T00:34:34.499308+0000","last_peered":"2024-09-12T00:34:34.499308+0000","last_clean":"2024-09-12T00:34:34.499308+0000","last_became_active":"2024-09-12T00:27:17.579646+0000","last_became_peered":"2024-09-12T00:27:17.579646+0000","last_unstale":"2024-09-12T00:34:34.499308+0000","last_undegraded":"2024-09-12T00:34:34.499308+0000","last_fullsized":"2024-09-12T00:34:34.499308+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:11.016979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"261'5","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509340+0000","last_change":"2024-09-12T00:17:03.212032+0000","last_active":"2024-09-12T00:35:44.509340+0000","last_peered":"2024-09-12T00:35:44.509340+0000","last_clean":"2024-09-12T00:35:44.509340+0000","last_became_active":"2024-09-12T00:17:03.211732+0000","last_became_peered":"2024-09-12T00:17:03.211732+0000","last_unstale":"2024-09-12T00:35:44.509340+0000","last_undegraded":"2024-09-12T00:35:44.509340+0000","last_fullsized":"2024-09-12T00:35:44.509340+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:51.849541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:41.507507+0000","last_change":"2024-09-12T00:17:00.175751+0000","last_active":"2024-09-12T00:35:41.507507+0000","last_peered":"2024-09-12T00:35:41.507507+0000","last_clean":"2024-09-12T00:35:41.507507+0000","last_became_active":"2024-09-12T00:17:00.175460+0000","last_became_peered":"2024-09-12T00:17:00.175460+0000","last_unstale":"2024-09-12T00:35:41.507507+0000","last_undegraded":"2024-09-12T00:35:41.507507+0000","last_fullsized":"2024-09-12T00:35:41.507507+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:16.723140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'37","reported_seq":132,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.379113+0000","last_change":"2024-09-12T00:15:34.424716+0000","last_active":"2024-09-12T00:34:14.379113+0000","last_peered":"2024-09-12T00:34:14.379113+0000","last_clean":"2024-09-12T00:34:14.379113+0000","last_became_active":"2024-09-12T00:15:34.423734+0000","last_became_peered":"2024-09-12T00:15:34.423734+0000","last_unstale":"2024-09-12T00:34:14.379113+0000","last_undegraded":"2024-09-12T00:34:14.379113+0000","last_fullsized":"2024-09-12T00:34:14.379113+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:11.973619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":116,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498603+0000","last_change":"2024-09-12T00:27:17.574614+0000","last_active":"2024-09-12T00:34:34.498603+0000","last_peered":"2024-09-12T00:34:34.498603+0000","last_clean":"2024-09-12T00:34:34.498603+0000","last_became_active":"2024-09-12T00:27:17.574346+0000","last_became_peered":"2024-09-12T00:27:17.574346+0000","last_unstale":"2024-09-12T00:34:34.498603+0000","last_undegraded":"2024-09-12T00:34:34.498603+0000","last_fullsized":"2024-09-12T00:34:34.498603+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:58.931421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'2","reported_seq":30,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509305+0000","last_change":"2024-09-12T00:17:03.210709+0000","last_active":"2024-09-12T00:35:44.509305+0000","last_peered":"2024-09-12T00:35:44.509305+0000","last_clean":"2024-09-12T00:35:44.509305+0000","last_became_active":"2024-09-12T00:17:03.210439+0000","last_became_peered":"2024-09-12T00:17:03.210439+0000","last_unstale":"2024-09-12T00:35:44.509305+0000","last_undegraded":"2024-09-12T00:35:44.509305+0000","last_fullsized":"2024-09-12T00:35:44.509305+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:13.002169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'1","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.508520+0000","last_change":"2024-09-12T00:17:00.179628+0000","last_active":"2024-09-12T00:35:39.508520+0000","last_peered":"2024-09-12T00:35:39.508520+0000","last_clean":"2024-09-12T00:35:39.508520+0000","last_became_active":"2024-09-12T00:17:00.179337+0000","last_became_peered":"2024-09-12T00:17:00.179337+0000","last_unstale":"2024-09-12T00:35:39.508520+0000","last_undegraded":"2024-09-12T00:35:39.508520+0000","last_fullsized":"2024-09-12T00:35:39.508520+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:55.994787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'135","reported_seq":450,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.496301+0000","last_change":"2024-09-12T00:15:34.421442+0000","last_active":"2024-09-12T00:34:14.496301+0000","last_peered":"2024-09-12T00:34:14.496301+0000","last_clean":"2024-09-12T00:34:14.496301+0000","last_became_active":"2024-09-12T00:15:34.421180+0000","last_became_peered":"2024-09-12T00:15:34.421180+0000","last_unstale":"2024-09-12T00:34:14.496301+0000","last_undegraded":"2024-09-12T00:34:14.496301+0000","last_fullsized":"2024-09-12T00:34:14.496301+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:29.396389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":617,"num_write":164,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:17.499229+0000","last_change":"2024-09-12T00:27:17.575634+0000","last_active":"2024-09-12T00:34:17.499229+0000","last_peered":"2024-09-12T00:34:17.499229+0000","last_clean":"2024-09-12T00:34:17.499229+0000","last_became_active":"2024-09-12T00:27:17.575257+0000","last_became_peered":"2024-09-12T00:27:17.575257+0000","last_unstale":"2024-09-12T00:34:17.499229+0000","last_undegraded":"2024-09-12T00:34:17.499229+0000","last_fullsized":"2024-09-12T00:34:17.499229+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:49.548072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'1","reported_seq":30,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509194+0000","last_change":"2024-09-12T00:17:03.222496+0000","last_active":"2024-09-12T00:35:44.509194+0000","last_peered":"2024-09-12T00:35:44.509194+0000","last_clean":"2024-09-12T00:35:44.509194+0000","last_became_active":"2024-09-12T00:17:03.222110+0000","last_became_peered":"2024-09-12T00:17:03.222110+0000","last_unstale":"2024-09-12T00:35:44.509194+0000","last_undegraded":"2024-09-12T00:35:44.509194+0000","last_fullsized":"2024-09-12T00:35:44.509194+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:07.242934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:41.507584+0000","last_change":"2024-09-12T00:17:00.174832+0000","last_active":"2024-09-12T00:35:41.507584+0000","last_peered":"2024-09-12T00:35:41.507584+0000","last_clean":"2024-09-12T00:35:41.507584+0000","last_became_active":"2024-09-12T00:17:00.174537+0000","last_became_peered":"2024-09-12T00:17:00.174537+0000","last_unstale":"2024-09-12T00:35:41.507584+0000","last_undegraded":"2024-09-12T00:35:41.507584+0000","last_fullsized":"2024-09-12T00:35:41.507584+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:23.549160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"258'31","reported_seq":128,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.612667+0000","last_change":"2024-09-12T00:15:34.428066+0000","last_active":"2024-09-12T00:34:14.612667+0000","last_peered":"2024-09-12T00:34:14.612667+0000","last_clean":"2024-09-12T00:34:14.612667+0000","last_became_active":"2024-09-12T00:15:34.427756+0000","last_became_peered":"2024-09-12T00:15:34.427756+0000","last_unstale":"2024-09-12T00:34:14.612667+0000","last_undegraded":"2024-09-12T00:34:14.612667+0000","last_fullsized":"2024-09-12T00:34:14.612667+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:05.925579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":137,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498569+0000","last_change":"2024-09-12T00:27:17.577377+0000","last_active":"2024-09-12T00:34:34.498569+0000","last_peered":"2024-09-12T00:34:34.498569+0000","last_clean":"2024-09-12T00:34:34.498569+0000","last_became_active":"2024-09-12T00:27:17.577076+0000","last_became_peered":"2024-09-12T00:27:17.577076+0000","last_unstale":"2024-09-12T00:34:34.498569+0000","last_undegraded":"2024-09-12T00:34:34.498569+0000","last_fullsized":"2024-09-12T00:34:34.498569+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.624069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391561+0000","last_change":"2024-09-12T00:17:03.217429+0000","last_active":"2024-09-12T00:35:44.391561+0000","last_peered":"2024-09-12T00:35:44.391561+0000","last_clean":"2024-09-12T00:35:44.391561+0000","last_became_active":"2024-09-12T00:17:03.217101+0000","last_became_peered":"2024-09-12T00:17:03.217101+0000","last_unstale":"2024-09-12T00:35:44.391561+0000","last_undegraded":"2024-09-12T00:35:44.391561+0000","last_fullsized":"2024-09-12T00:35:44.391561+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:37.636780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:41.507635+0000","last_change":"2024-09-12T00:17:00.180771+0000","last_active":"2024-09-12T00:35:41.507635+0000","last_peered":"2024-09-12T00:35:41.507635+0000","last_clean":"2024-09-12T00:35:41.507635+0000","last_became_active":"2024-09-12T00:17:00.180475+0000","last_became_peered":"2024-09-12T00:17:00.180475+0000","last_unstale":"2024-09-12T00:35:41.507635+0000","last_undegraded":"2024-09-12T00:35:41.507635+0000","last_fullsized":"2024-09-12T00:35:41.507635+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:32.615984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'61","reported_seq":207,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.496260+0000","last_change":"2024-09-12T00:15:34.419120+0000","last_active":"2024-09-12T00:34:14.496260+0000","last_peered":"2024-09-12T00:34:14.496260+0000","last_clean":"2024-09-12T00:34:14.496260+0000","last_became_active":"2024-09-12T00:15:34.418831+0000","last_became_peered":"2024-09-12T00:15:34.418831+0000","last_unstale":"2024-09-12T00:34:14.496260+0000","last_undegraded":"2024-09-12T00:34:14.496260+0000","last_fullsized":"2024-09-12T00:34:14.496260+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:01.991294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":218,"num_write":105,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.511752+0000","last_change":"2024-09-12T00:27:17.579649+0000","last_active":"2024-09-12T00:35:59.511752+0000","last_peered":"2024-09-12T00:35:59.511752+0000","last_clean":"2024-09-12T00:35:59.511752+0000","last_became_active":"2024-09-12T00:27:17.579263+0000","last_became_peered":"2024-09-12T00:27:17.579263+0000","last_unstale":"2024-09-12T00:35:59.511752+0000","last_undegraded":"2024-09-12T00:35:59.511752+0000","last_fullsized":"2024-09-12T00:35:59.511752+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:10.487761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"258'2","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503243+0000","last_change":"2024-09-12T00:17:03.211987+0000","last_active":"2024-09-12T00:35:04.503243+0000","last_peered":"2024-09-12T00:35:04.503243+0000","last_clean":"2024-09-12T00:35:04.503243+0000","last_became_active":"2024-09-12T00:17:03.211582+0000","last_became_peered":"2024-09-12T00:17:03.211582+0000","last_unstale":"2024-09-12T00:35:04.503243+0000","last_undegraded":"2024-09-12T00:35:04.503243+0000","last_fullsized":"2024-09-12T00:35:04.503243+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:27.493123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"261'1","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.619883+0000","last_change":"2024-09-12T00:17:00.182834+0000","last_active":"2024-09-12T00:34:59.619883+0000","last_peered":"2024-09-12T00:34:59.619883+0000","last_clean":"2024-09-12T00:34:59.619883+0000","last_became_active":"2024-09-12T00:17:00.182477+0000","last_became_peered":"2024-09-12T00:17:00.182477+0000","last_unstale":"2024-09-12T00:34:59.619883+0000","last_undegraded":"2024-09-12T00:34:59.619883+0000","last_fullsized":"2024-09-12T00:34:59.619883+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:39.317297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"258'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.510828+0000","last_change":"2024-09-12T00:15:34.419921+0000","last_active":"2024-09-12T00:35:54.510828+0000","last_peered":"2024-09-12T00:35:54.510828+0000","last_clean":"2024-09-12T00:35:54.510828+0000","last_became_active":"2024-09-12T00:15:34.419584+0000","last_became_peered":"2024-09-12T00:15:34.419584+0000","last_unstale":"2024-09-12T00:35:54.510828+0000","last_undegraded":"2024-09-12T00:35:54.510828+0000","last_fullsized":"2024-09-12T00:35:54.510828+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:04.179967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:16.512831+0000","last_change":"2024-09-12T00:27:17.580152+0000","last_active":"2024-09-12T00:36:16.512831+0000","last_peered":"2024-09-12T00:36:16.512831+0000","last_clean":"2024-09-12T00:36:16.512831+0000","last_became_active":"2024-09-12T00:27:17.579859+0000","last_became_peered":"2024-09-12T00:27:17.579859+0000","last_unstale":"2024-09-12T00:36:16.512831+0000","last_undegraded":"2024-09-12T00:36:16.512831+0000","last_fullsized":"2024-09-12T00:36:16.512831+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:44.205082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'2","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503201+0000","last_change":"2024-09-12T00:17:03.216727+0000","last_active":"2024-09-12T00:35:04.503201+0000","last_peered":"2024-09-12T00:35:04.503201+0000","last_clean":"2024-09-12T00:35:04.503201+0000","last_became_active":"2024-09-12T00:17:03.216437+0000","last_became_peered":"2024-09-12T00:17:03.216437+0000","last_unstale":"2024-09-12T00:35:04.503201+0000","last_undegraded":"2024-09-12T00:35:04.503201+0000","last_fullsized":"2024-09-12T00:35:04.503201+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:54.699248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.502357+0000","last_change":"2024-09-12T00:17:00.179209+0000","last_active":"2024-09-12T00:34:59.502357+0000","last_peered":"2024-09-12T00:34:59.502357+0000","last_clean":"2024-09-12T00:34:59.502357+0000","last_became_active":"2024-09-12T00:17:00.178905+0000","last_became_peered":"2024-09-12T00:17:00.178905+0000","last_unstale":"2024-09-12T00:34:59.502357+0000","last_undegraded":"2024-09-12T00:34:59.502357+0000","last_fullsized":"2024-09-12T00:34:59.502357+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:09.052476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'17","reported_seq":81,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.392457+0000","last_change":"2024-09-12T00:15:34.419487+0000","last_active":"2024-09-12T00:35:49.392457+0000","last_peered":"2024-09-12T00:35:49.392457+0000","last_clean":"2024-09-12T00:35:49.392457+0000","last_became_active":"2024-09-12T00:15:34.418859+0000","last_became_peered":"2024-09-12T00:15:34.418859+0000","last_unstale":"2024-09-12T00:35:49.392457+0000","last_undegraded":"2024-09-12T00:35:49.392457+0000","last_fullsized":"2024-09-12T00:35:49.392457+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:58.036831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.393701+0000","last_change":"2024-09-12T00:27:17.579640+0000","last_active":"2024-09-12T00:35:59.393701+0000","last_peered":"2024-09-12T00:35:59.393701+0000","last_clean":"2024-09-12T00:35:59.393701+0000","last_became_active":"2024-09-12T00:27:17.577728+0000","last_became_peered":"2024-09-12T00:27:17.577728+0000","last_unstale":"2024-09-12T00:35:59.393701+0000","last_undegraded":"2024-09-12T00:35:59.393701+0000","last_fullsized":"2024-09-12T00:35:59.393701+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:51.317752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"261'10","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.504036+0000","last_change":"2024-09-12T00:17:03.215255+0000","last_active":"2024-09-12T00:35:09.504036+0000","last_peered":"2024-09-12T00:35:09.504036+0000","last_clean":"2024-09-12T00:35:09.504036+0000","last_became_active":"2024-09-12T00:17:03.214958+0000","last_became_peered":"2024-09-12T00:17:03.214958+0000","last_unstale":"2024-09-12T00:35:09.504036+0000","last_undegraded":"2024-09-12T00:35:09.504036+0000","last_fullsized":"2024-09-12T00:35:09.504036+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:24.067787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":25,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"261'6","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.502530+0000","last_change":"2024-09-12T00:17:00.184968+0000","last_active":"2024-09-12T00:34:59.502530+0000","last_peered":"2024-09-12T00:34:59.502530+0000","last_clean":"2024-09-12T00:34:59.502530+0000","last_became_active":"2024-09-12T00:17:00.184703+0000","last_became_peered":"2024-09-12T00:17:00.184703+0000","last_unstale":"2024-09-12T00:34:59.502530+0000","last_undegraded":"2024-09-12T00:34:59.502530+0000","last_fullsized":"2024-09-12T00:34:59.502530+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:09.775190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":24576,"num_write":6,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'12","reported_seq":74,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:51.509350+0000","last_change":"2024-09-12T00:15:34.424421+0000","last_active":"2024-09-12T00:35:51.509350+0000","last_peered":"2024-09-12T00:35:51.509350+0000","last_clean":"2024-09-12T00:35:51.509350+0000","last_became_active":"2024-09-12T00:15:34.424129+0000","last_became_peered":"2024-09-12T00:15:34.424129+0000","last_unstale":"2024-09-12T00:35:51.509350+0000","last_undegraded":"2024-09-12T00:35:51.509350+0000","last_fullsized":"2024-09-12T00:35:51.509350+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:19.458965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:56.510098+0000","last_change":"2024-09-12T00:27:17.571287+0000","last_active":"2024-09-12T00:35:56.510098+0000","last_peered":"2024-09-12T00:35:56.510098+0000","last_clean":"2024-09-12T00:35:56.510098+0000","last_became_active":"2024-09-12T00:27:17.570973+0000","last_became_peered":"2024-09-12T00:27:17.570973+0000","last_unstale":"2024-09-12T00:35:56.510098+0000","last_undegraded":"2024-09-12T00:35:56.510098+0000","last_fullsized":"2024-09-12T00:35:56.510098+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:28.959152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"258'5","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503609+0000","last_change":"2024-09-12T00:17:03.221266+0000","last_active":"2024-09-12T00:35:04.503609+0000","last_peered":"2024-09-12T00:35:04.503609+0000","last_clean":"2024-09-12T00:35:04.503609+0000","last_became_active":"2024-09-12T00:17:03.220961+0000","last_became_peered":"2024-09-12T00:17:03.220961+0000","last_unstale":"2024-09-12T00:35:04.503609+0000","last_undegraded":"2024-09-12T00:35:04.503609+0000","last_fullsized":"2024-09-12T00:35:04.503609+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:28.129316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503320+0000","last_change":"2024-09-12T00:17:00.178846+0000","last_active":"2024-09-12T00:35:04.503320+0000","last_peered":"2024-09-12T00:35:04.503320+0000","last_clean":"2024-09-12T00:35:04.503320+0000","last_became_active":"2024-09-12T00:17:00.178572+0000","last_became_peered":"2024-09-12T00:17:00.178572+0000","last_unstale":"2024-09-12T00:35:04.503320+0000","last_undegraded":"2024-09-12T00:35:04.503320+0000","last_fullsized":"2024-09-12T00:35:04.503320+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:24.934660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'26","reported_seq":111,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510002+0000","last_change":"2024-09-12T00:15:34.421329+0000","last_active":"2024-09-12T00:35:49.510002+0000","last_peered":"2024-09-12T00:35:49.510002+0000","last_clean":"2024-09-12T00:35:49.510002+0000","last_became_active":"2024-09-12T00:15:34.421019+0000","last_became_peered":"2024-09-12T00:15:34.421019+0000","last_unstale":"2024-09-12T00:35:49.510002+0000","last_undegraded":"2024-09-12T00:35:49.510002+0000","last_fullsized":"2024-09-12T00:35:49.510002+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:35.834745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":93,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.514214+0000","last_change":"2024-09-12T00:27:17.581884+0000","last_active":"2024-09-12T00:36:19.514214+0000","last_peered":"2024-09-12T00:36:19.514214+0000","last_clean":"2024-09-12T00:36:19.514214+0000","last_became_active":"2024-09-12T00:27:17.579926+0000","last_became_peered":"2024-09-12T00:27:17.579926+0000","last_unstale":"2024-09-12T00:36:19.514214+0000","last_undegraded":"2024-09-12T00:36:19.514214+0000","last_fullsized":"2024-09-12T00:36:19.514214+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:28.218032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:24.380499+0000","last_change":"2024-09-12T00:17:03.219491+0000","last_active":"2024-09-12T00:34:24.380499+0000","last_peered":"2024-09-12T00:34:24.380499+0000","last_clean":"2024-09-12T00:34:24.380499+0000","last_became_active":"2024-09-12T00:17:03.219156+0000","last_became_peered":"2024-09-12T00:17:03.219156+0000","last_unstale":"2024-09-12T00:34:24.380499+0000","last_undegraded":"2024-09-12T00:34:24.380499+0000","last_fullsized":"2024-09-12T00:34:24.380499+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:35.748043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"261'1","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.496969+0000","last_change":"2024-09-12T00:17:00.182726+0000","last_active":"2024-09-12T00:34:19.496969+0000","last_peered":"2024-09-12T00:34:19.496969+0000","last_clean":"2024-09-12T00:34:19.496969+0000","last_became_active":"2024-09-12T00:17:00.182424+0000","last_became_peered":"2024-09-12T00:17:00.182424+0000","last_unstale":"2024-09-12T00:34:19.496969+0000","last_undegraded":"2024-09-12T00:34:19.496969+0000","last_fullsized":"2024-09-12T00:34:19.496969+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:44.087656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"258'17","reported_seq":89,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.509911+0000","last_change":"2024-09-12T00:15:34.423351+0000","last_active":"2024-09-12T00:35:49.509911+0000","last_peered":"2024-09-12T00:35:49.509911+0000","last_clean":"2024-09-12T00:35:49.509911+0000","last_became_active":"2024-09-12T00:15:34.423037+0000","last_became_peered":"2024-09-12T00:15:34.423037+0000","last_unstale":"2024-09-12T00:35:49.509911+0000","last_undegraded":"2024-09-12T00:35:49.509911+0000","last_fullsized":"2024-09-12T00:35:49.509911+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:11.688876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":64,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:04.611481+0000","last_change":"2024-09-12T00:27:17.583413+0000","last_active":"2024-09-12T00:34:04.611481+0000","last_peered":"2024-09-12T00:34:04.611481+0000","last_clean":"2024-09-12T00:34:04.611481+0000","last_became_active":"2024-09-12T00:27:17.583096+0000","last_became_peered":"2024-09-12T00:27:17.583096+0000","last_unstale":"2024-09-12T00:34:04.611481+0000","last_undegraded":"2024-09-12T00:34:04.611481+0000","last_fullsized":"2024-09-12T00:34:04.611481+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:05.013570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'3","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:24.614128+0000","last_change":"2024-09-12T00:17:03.214309+0000","last_active":"2024-09-12T00:34:24.614128+0000","last_peered":"2024-09-12T00:34:24.614128+0000","last_clean":"2024-09-12T00:34:24.614128+0000","last_became_active":"2024-09-12T00:17:03.214023+0000","last_became_peered":"2024-09-12T00:17:03.214023+0000","last_unstale":"2024-09-12T00:34:24.614128+0000","last_undegraded":"2024-09-12T00:34:24.614128+0000","last_fullsized":"2024-09-12T00:34:24.614128+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.420166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'2","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.497088+0000","last_change":"2024-09-12T00:17:00.178739+0000","last_active":"2024-09-12T00:34:19.497088+0000","last_peered":"2024-09-12T00:34:19.497088+0000","last_clean":"2024-09-12T00:34:19.497088+0000","last_became_active":"2024-09-12T00:17:00.178465+0000","last_became_peered":"2024-09-12T00:17:00.178465+0000","last_unstale":"2024-09-12T00:34:19.497088+0000","last_undegraded":"2024-09-12T00:34:19.497088+0000","last_fullsized":"2024-09-12T00:34:19.497088+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:08.316507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'34","reported_seq":137,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:27.839282+0000","last_change":"2024-09-12T00:15:34.425982+0000","last_active":"2024-09-12T00:36:27.839282+0000","last_peered":"2024-09-12T00:36:27.839282+0000","last_clean":"2024-09-12T00:36:27.839282+0000","last_became_active":"2024-09-12T00:15:34.425540+0000","last_became_peered":"2024-09-12T00:15:34.425540+0000","last_unstale":"2024-09-12T00:36:27.839282+0000","last_undegraded":"2024-09-12T00:36:27.839282+0000","last_fullsized":"2024-09-12T00:36:27.839282+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:11.621389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":136,"num_write":51,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.394938+0000","last_change":"2024-09-12T00:27:17.582031+0000","last_active":"2024-09-12T00:36:19.394938+0000","last_peered":"2024-09-12T00:36:19.394938+0000","last_clean":"2024-09-12T00:36:19.394938+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:36:19.394938+0000","last_undegraded":"2024-09-12T00:36:19.394938+0000","last_fullsized":"2024-09-12T00:36:19.394938+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:26.824932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503080+0000","last_change":"2024-09-12T00:17:03.212419+0000","last_active":"2024-09-12T00:35:04.503080+0000","last_peered":"2024-09-12T00:35:04.503080+0000","last_clean":"2024-09-12T00:35:04.503080+0000","last_became_active":"2024-09-12T00:17:03.212150+0000","last_became_peered":"2024-09-12T00:17:03.212150+0000","last_unstale":"2024-09-12T00:35:04.503080+0000","last_undegraded":"2024-09-12T00:35:04.503080+0000","last_fullsized":"2024-09-12T00:35:04.503080+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:25.410634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"261'7","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:24.497626+0000","last_change":"2024-09-12T00:17:00.181254+0000","last_active":"2024-09-12T00:34:24.497626+0000","last_peered":"2024-09-12T00:34:24.497626+0000","last_clean":"2024-09-12T00:34:24.497626+0000","last_became_active":"2024-09-12T00:17:00.180944+0000","last_became_peered":"2024-09-12T00:17:00.180944+0000","last_unstale":"2024-09-12T00:34:24.497626+0000","last_undegraded":"2024-09-12T00:34:24.497626+0000","last_fullsized":"2024-09-12T00:34:24.497626+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:53.637952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6171,"num_write":12,"num_write_kb":11291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'34","reported_seq":126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.095497+0000","last_change":"2024-09-12T00:15:34.419063+0000","last_active":"2024-09-12T00:36:56.095497+0000","last_peered":"2024-09-12T00:36:56.095497+0000","last_clean":"2024-09-12T00:36:56.095497+0000","last_became_active":"2024-09-12T00:15:34.418474+0000","last_became_peered":"2024-09-12T00:15:34.418474+0000","last_unstale":"2024-09-12T00:36:56.095497+0000","last_undegraded":"2024-09-12T00:36:56.095497+0000","last_fullsized":"2024-09-12T00:36:56.095497+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:27.863297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.513761+0000","last_change":"2024-09-12T00:27:17.581423+0000","last_active":"2024-09-12T00:36:19.513761+0000","last_peered":"2024-09-12T00:36:19.513761+0000","last_clean":"2024-09-12T00:36:19.513761+0000","last_became_active":"2024-09-12T00:27:17.581149+0000","last_became_peered":"2024-09-12T00:27:17.581149+0000","last_unstale":"2024-09-12T00:36:19.513761+0000","last_undegraded":"2024-09-12T00:36:19.513761+0000","last_fullsized":"2024-09-12T00:36:19.513761+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:04.939255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.380608+0000","last_change":"2024-09-12T00:17:03.221232+0000","last_active":"2024-09-12T00:34:29.380608+0000","last_peered":"2024-09-12T00:34:29.380608+0000","last_clean":"2024-09-12T00:34:29.380608+0000","last_became_active":"2024-09-12T00:17:03.220965+0000","last_became_peered":"2024-09-12T00:17:03.220965+0000","last_unstale":"2024-09-12T00:34:29.380608+0000","last_undegraded":"2024-09-12T00:34:29.380608+0000","last_fullsized":"2024-09-12T00:34:29.380608+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:54.919281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'11","reported_seq":66,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.385612+0000","last_change":"2024-09-12T00:17:00.185880+0000","last_active":"2024-09-12T00:34:59.385612+0000","last_peered":"2024-09-12T00:34:59.385612+0000","last_clean":"2024-09-12T00:34:59.385612+0000","last_became_active":"2024-09-12T00:17:00.185600+0000","last_became_peered":"2024-09-12T00:17:00.185600+0000","last_unstale":"2024-09-12T00:34:59.385612+0000","last_undegraded":"2024-09-12T00:34:59.385612+0000","last_fullsized":"2024-09-12T00:34:59.385612+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.338622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":41662,"num_write":16,"num_write_kb":10938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'54","reported_seq":186,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:25.312227+0000","last_change":"2024-09-12T00:15:34.417774+0000","last_active":"2024-09-12T00:36:25.312227+0000","last_peered":"2024-09-12T00:36:25.312227+0000","last_clean":"2024-09-12T00:36:25.312227+0000","last_became_active":"2024-09-12T00:15:34.417393+0000","last_became_peered":"2024-09-12T00:15:34.417393+0000","last_unstale":"2024-09-12T00:36:25.312227+0000","last_undegraded":"2024-09-12T00:36:25.312227+0000","last_fullsized":"2024-09-12T00:36:25.312227+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:49.338246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":189,"num_write":107,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390022+0000","last_change":"2024-09-12T00:27:17.580912+0000","last_active":"2024-09-12T00:35:39.390022+0000","last_peered":"2024-09-12T00:35:39.390022+0000","last_clean":"2024-09-12T00:35:39.390022+0000","last_became_active":"2024-09-12T00:27:17.578983+0000","last_became_peered":"2024-09-12T00:27:17.578983+0000","last_unstale":"2024-09-12T00:35:39.390022+0000","last_undegraded":"2024-09-12T00:35:39.390022+0000","last_fullsized":"2024-09-12T00:35:39.390022+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.598333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"258'10","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510247+0000","last_change":"2024-09-12T00:17:03.210161+0000","last_active":"2024-09-12T00:35:49.510247+0000","last_peered":"2024-09-12T00:35:49.510247+0000","last_clean":"2024-09-12T00:35:49.510247+0000","last_became_active":"2024-09-12T00:17:03.209874+0000","last_became_peered":"2024-09-12T00:17:03.209874+0000","last_unstale":"2024-09-12T00:35:49.510247+0000","last_undegraded":"2024-09-12T00:35:49.510247+0000","last_fullsized":"2024-09-12T00:35:49.510247+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:07.562732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":41988,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"258'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391613+0000","last_change":"2024-09-12T00:17:00.186026+0000","last_active":"2024-09-12T00:35:44.391613+0000","last_peered":"2024-09-12T00:35:44.391613+0000","last_clean":"2024-09-12T00:35:44.391613+0000","last_became_active":"2024-09-12T00:17:00.185688+0000","last_became_peered":"2024-09-12T00:17:00.185688+0000","last_unstale":"2024-09-12T00:35:44.391613+0000","last_undegraded":"2024-09-12T00:35:44.391613+0000","last_fullsized":"2024-09-12T00:35:44.391613+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:40.682390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:15.301825+0000","last_change":"2024-09-12T00:15:34.412266+0000","last_active":"2024-09-12T00:36:15.301825+0000","last_peered":"2024-09-12T00:36:15.301825+0000","last_clean":"2024-09-12T00:36:15.301825+0000","last_became_active":"2024-09-12T00:15:34.411977+0000","last_became_peered":"2024-09-12T00:15:34.411977+0000","last_unstale":"2024-09-12T00:36:15.301825+0000","last_undegraded":"2024-09-12T00:36:15.301825+0000","last_fullsized":"2024-09-12T00:36:15.301825+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:53.336733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":161,"num_write":73,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390048+0000","last_change":"2024-09-12T00:27:17.579176+0000","last_active":"2024-09-12T00:35:39.390048+0000","last_peered":"2024-09-12T00:35:39.390048+0000","last_clean":"2024-09-12T00:35:39.390048+0000","last_became_active":"2024-09-12T00:27:17.578763+0000","last_became_peered":"2024-09-12T00:27:17.578763+0000","last_unstale":"2024-09-12T00:35:39.390048+0000","last_undegraded":"2024-09-12T00:35:39.390048+0000","last_fullsized":"2024-09-12T00:35:39.390048+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:54.867145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510203+0000","last_change":"2024-09-12T00:17:03.216611+0000","last_active":"2024-09-12T00:35:49.510203+0000","last_peered":"2024-09-12T00:35:49.510203+0000","last_clean":"2024-09-12T00:35:49.510203+0000","last_became_active":"2024-09-12T00:17:03.216349+0000","last_became_peered":"2024-09-12T00:17:03.216349+0000","last_unstale":"2024-09-12T00:35:49.510203+0000","last_undegraded":"2024-09-12T00:35:49.510203+0000","last_fullsized":"2024-09-12T00:35:49.510203+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:48.582027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:47.512361+0000","last_change":"2024-09-12T00:17:00.183051+0000","last_active":"2024-09-12T00:35:47.512361+0000","last_peered":"2024-09-12T00:35:47.512361+0000","last_clean":"2024-09-12T00:35:47.512361+0000","last_became_active":"2024-09-12T00:17:00.182780+0000","last_became_peered":"2024-09-12T00:17:00.182780+0000","last_unstale":"2024-09-12T00:35:47.512361+0000","last_undegraded":"2024-09-12T00:35:47.512361+0000","last_fullsized":"2024-09-12T00:35:47.512361+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:39.837277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'38","reported_seq":141,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.386303+0000","last_change":"2024-09-12T00:15:34.410030+0000","last_active":"2024-09-12T00:35:04.386303+0000","last_peered":"2024-09-12T00:35:04.386303+0000","last_clean":"2024-09-12T00:35:04.386303+0000","last_became_active":"2024-09-12T00:15:34.409622+0000","last_became_peered":"2024-09-12T00:15:34.409622+0000","last_unstale":"2024-09-12T00:35:04.386303+0000","last_undegraded":"2024-09-12T00:35:04.386303+0000","last_fullsized":"2024-09-12T00:35:04.386303+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:55.447920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":134,"num_write":65,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:19.505635+0000","last_change":"2024-09-12T00:27:17.582282+0000","last_active":"2024-09-12T00:35:19.505635+0000","last_peered":"2024-09-12T00:35:19.505635+0000","last_clean":"2024-09-12T00:35:19.505635+0000","last_became_active":"2024-09-12T00:27:17.581993+0000","last_became_peered":"2024-09-12T00:27:17.581993+0000","last_unstale":"2024-09-12T00:35:19.505635+0000","last_undegraded":"2024-09-12T00:35:19.505635+0000","last_fullsized":"2024-09-12T00:35:19.505635+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:14.848118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:24.379865+0000","last_change":"2024-09-12T00:17:03.220273+0000","last_active":"2024-09-12T00:34:24.379865+0000","last_peered":"2024-09-12T00:34:24.379865+0000","last_clean":"2024-09-12T00:34:24.379865+0000","last_became_active":"2024-09-12T00:17:03.219888+0000","last_became_peered":"2024-09-12T00:17:03.219888+0000","last_unstale":"2024-09-12T00:34:24.379865+0000","last_undegraded":"2024-09-12T00:34:24.379865+0000","last_fullsized":"2024-09-12T00:34:24.379865+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:38.861820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"258'3","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.613476+0000","last_change":"2024-09-12T00:17:00.170322+0000","last_active":"2024-09-12T00:34:19.613476+0000","last_peered":"2024-09-12T00:34:19.613476+0000","last_clean":"2024-09-12T00:34:19.613476+0000","last_became_active":"2024-09-12T00:17:00.169299+0000","last_became_peered":"2024-09-12T00:17:00.169299+0000","last_unstale":"2024-09-12T00:34:19.613476+0000","last_undegraded":"2024-09-12T00:34:19.613476+0000","last_fullsized":"2024-09-12T00:34:19.613476+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:43.905465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'48","reported_seq":176,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.631907+0000","last_change":"2024-09-12T00:15:34.428023+0000","last_active":"2024-09-12T00:36:24.631907+0000","last_peered":"2024-09-12T00:36:24.631907+0000","last_clean":"2024-09-12T00:36:24.631907+0000","last_became_active":"2024-09-12T00:15:34.427735+0000","last_became_peered":"2024-09-12T00:15:34.427735+0000","last_unstale":"2024-09-12T00:36:24.631907+0000","last_undegraded":"2024-09-12T00:36:24.631907+0000","last_fullsized":"2024-09-12T00:36:24.631907+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:09.348935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":182,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390825+0000","last_change":"2024-09-12T00:27:17.573147+0000","last_active":"2024-09-12T00:35:39.390825+0000","last_peered":"2024-09-12T00:35:39.390825+0000","last_clean":"2024-09-12T00:35:39.390825+0000","last_became_active":"2024-09-12T00:27:17.572817+0000","last_became_peered":"2024-09-12T00:27:17.572817+0000","last_unstale":"2024-09-12T00:35:39.390825+0000","last_undegraded":"2024-09-12T00:35:39.390825+0000","last_fullsized":"2024-09-12T00:35:39.390825+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:43.980881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"261'5","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:24.380607+0000","last_change":"2024-09-12T00:17:03.220324+0000","last_active":"2024-09-12T00:34:24.380607+0000","last_peered":"2024-09-12T00:34:24.380607+0000","last_clean":"2024-09-12T00:34:24.380607+0000","last_became_active":"2024-09-12T00:17:03.219129+0000","last_became_peered":"2024-09-12T00:17:03.219129+0000","last_unstale":"2024-09-12T00:34:24.380607+0000","last_undegraded":"2024-09-12T00:34:24.380607+0000","last_fullsized":"2024-09-12T00:34:24.380607+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:56.169527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'5","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.379929+0000","last_change":"2024-09-12T00:17:00.182941+0000","last_active":"2024-09-12T00:34:19.379929+0000","last_peered":"2024-09-12T00:34:19.379929+0000","last_clean":"2024-09-12T00:34:19.379929+0000","last_became_active":"2024-09-12T00:17:00.182301+0000","last_became_peered":"2024-09-12T00:17:00.182301+0000","last_unstale":"2024-09-12T00:34:19.379929+0000","last_undegraded":"2024-09-12T00:34:19.379929+0000","last_fullsized":"2024-09-12T00:34:19.379929+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:08.258223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'23","reported_seq":102,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.514235+0000","last_change":"2024-09-12T00:15:34.428381+0000","last_active":"2024-09-12T00:36:24.514235+0000","last_peered":"2024-09-12T00:36:24.514235+0000","last_clean":"2024-09-12T00:36:24.514235+0000","last_became_active":"2024-09-12T00:15:34.428056+0000","last_became_peered":"2024-09-12T00:15:34.428056+0000","last_unstale":"2024-09-12T00:36:24.514235+0000","last_undegraded":"2024-09-12T00:36:24.514235+0000","last_fullsized":"2024-09-12T00:36:24.514235+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:43.858120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.511476+0000","last_change":"2024-09-12T00:27:17.575634+0000","last_active":"2024-09-12T00:35:59.511476+0000","last_peered":"2024-09-12T00:35:59.511476+0000","last_clean":"2024-09-12T00:35:59.511476+0000","last_became_active":"2024-09-12T00:27:17.575332+0000","last_became_peered":"2024-09-12T00:27:17.575332+0000","last_unstale":"2024-09-12T00:35:59.511476+0000","last_undegraded":"2024-09-12T00:35:59.511476+0000","last_fullsized":"2024-09-12T00:35:59.511476+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:10.996773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"258'6","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:47.512261+0000","last_change":"2024-09-12T00:17:03.206898+0000","last_active":"2024-09-12T00:35:47.512261+0000","last_peered":"2024-09-12T00:35:47.512261+0000","last_clean":"2024-09-12T00:35:47.512261+0000","last_became_active":"2024-09-12T00:17:03.206580+0000","last_became_peered":"2024-09-12T00:17:03.206580+0000","last_unstale":"2024-09-12T00:35:47.512261+0000","last_undegraded":"2024-09-12T00:35:47.512261+0000","last_fullsized":"2024-09-12T00:35:47.512261+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:19.086717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'1","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.619797+0000","last_change":"2024-09-12T00:17:00.169805+0000","last_active":"2024-09-12T00:34:59.619797+0000","last_peered":"2024-09-12T00:34:59.619797+0000","last_clean":"2024-09-12T00:34:59.619797+0000","last_became_active":"2024-09-12T00:17:00.169464+0000","last_became_peered":"2024-09-12T00:17:00.169464+0000","last_unstale":"2024-09-12T00:34:59.619797+0000","last_undegraded":"2024-09-12T00:34:59.619797+0000","last_fullsized":"2024-09-12T00:34:59.619797+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:30.563501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'22","reported_seq":97,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.631855+0000","last_change":"2024-09-12T00:15:34.428025+0000","last_active":"2024-09-12T00:36:24.631855+0000","last_peered":"2024-09-12T00:36:24.631855+0000","last_clean":"2024-09-12T00:36:24.631855+0000","last_became_active":"2024-09-12T00:15:34.427661+0000","last_became_peered":"2024-09-12T00:15:34.427661+0000","last_unstale":"2024-09-12T00:36:24.631855+0000","last_undegraded":"2024-09-12T00:36:24.631855+0000","last_fullsized":"2024-09-12T00:36:24.631855+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:18.676590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":70,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.514020+0000","last_change":"2024-09-12T00:27:17.576241+0000","last_active":"2024-09-12T00:35:57.514020+0000","last_peered":"2024-09-12T00:35:57.514020+0000","last_clean":"2024-09-12T00:35:57.514020+0000","last_became_active":"2024-09-12T00:27:17.575941+0000","last_became_peered":"2024-09-12T00:27:17.575941+0000","last_unstale":"2024-09-12T00:35:57.514020+0000","last_undegraded":"2024-09-12T00:35:57.514020+0000","last_fullsized":"2024-09-12T00:35:57.514020+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:41.216300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'1","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.386837+0000","last_change":"2024-09-12T00:17:03.218016+0000","last_active":"2024-09-12T00:35:09.386837+0000","last_peered":"2024-09-12T00:35:09.386837+0000","last_clean":"2024-09-12T00:35:09.386837+0000","last_became_active":"2024-09-12T00:17:03.217678+0000","last_became_peered":"2024-09-12T00:17:03.217678+0000","last_unstale":"2024-09-12T00:35:09.386837+0000","last_undegraded":"2024-09-12T00:35:09.386837+0000","last_fullsized":"2024-09-12T00:35:09.386837+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:41.125288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'4","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391501+0000","last_change":"2024-09-12T00:17:00.186355+0000","last_active":"2024-09-12T00:35:44.391501+0000","last_peered":"2024-09-12T00:35:44.391501+0000","last_clean":"2024-09-12T00:35:44.391501+0000","last_became_active":"2024-09-12T00:17:00.185637+0000","last_became_peered":"2024-09-12T00:17:00.185637+0000","last_unstale":"2024-09-12T00:35:44.391501+0000","last_undegraded":"2024-09-12T00:35:44.391501+0000","last_fullsized":"2024-09-12T00:35:44.391501+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:36.584176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396562+0000","last_change":"2024-09-12T00:15:34.408975+0000","last_active":"2024-09-12T00:36:24.396562+0000","last_peered":"2024-09-12T00:36:24.396562+0000","last_clean":"2024-09-12T00:36:24.396562+0000","last_became_active":"2024-09-12T00:15:34.408612+0000","last_became_peered":"2024-09-12T00:15:34.408612+0000","last_unstale":"2024-09-12T00:36:24.396562+0000","last_undegraded":"2024-09-12T00:36:24.396562+0000","last_fullsized":"2024-09-12T00:36:24.396562+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:00.278541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":97,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.508580+0000","last_change":"2024-09-12T00:27:17.579650+0000","last_active":"2024-09-12T00:35:39.508580+0000","last_peered":"2024-09-12T00:35:39.508580+0000","last_clean":"2024-09-12T00:35:39.508580+0000","last_became_active":"2024-09-12T00:27:17.579332+0000","last_became_peered":"2024-09-12T00:27:17.579332+0000","last_unstale":"2024-09-12T00:35:39.508580+0000","last_undegraded":"2024-09-12T00:35:39.508580+0000","last_fullsized":"2024-09-12T00:35:39.508580+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:02.812642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627538+0000","last_change":"2024-09-12T00:17:03.203730+0000","last_active":"2024-09-12T00:35:49.627538+0000","last_peered":"2024-09-12T00:35:49.627538+0000","last_clean":"2024-09-12T00:35:49.627538+0000","last_became_active":"2024-09-12T00:17:03.203401+0000","last_became_peered":"2024-09-12T00:17:03.203401+0000","last_unstale":"2024-09-12T00:35:49.627538+0000","last_undegraded":"2024-09-12T00:35:49.627538+0000","last_fullsized":"2024-09-12T00:35:49.627538+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:07.999569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509116+0000","last_change":"2024-09-12T00:17:00.181373+0000","last_active":"2024-09-12T00:35:44.509116+0000","last_peered":"2024-09-12T00:35:44.509116+0000","last_clean":"2024-09-12T00:35:44.509116+0000","last_became_active":"2024-09-12T00:17:00.181095+0000","last_became_peered":"2024-09-12T00:17:00.181095+0000","last_unstale":"2024-09-12T00:35:44.509116+0000","last_undegraded":"2024-09-12T00:35:44.509116+0000","last_fullsized":"2024-09-12T00:35:44.509116+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:49.208397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'19","reported_seq":93,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396515+0000","last_change":"2024-09-12T00:15:34.421629+0000","last_active":"2024-09-12T00:36:24.396515+0000","last_peered":"2024-09-12T00:36:24.396515+0000","last_clean":"2024-09-12T00:36:24.396515+0000","last_became_active":"2024-09-12T00:15:34.420583+0000","last_became_peered":"2024-09-12T00:15:34.420583+0000","last_unstale":"2024-09-12T00:36:24.396515+0000","last_undegraded":"2024-09-12T00:36:24.396515+0000","last_fullsized":"2024-09-12T00:36:24.396515+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:19.714778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391630+0000","last_change":"2024-09-12T00:27:17.580218+0000","last_active":"2024-09-12T00:35:44.391630+0000","last_peered":"2024-09-12T00:35:44.391630+0000","last_clean":"2024-09-12T00:35:44.391630+0000","last_became_active":"2024-09-12T00:27:17.579957+0000","last_became_peered":"2024-09-12T00:27:17.579957+0000","last_unstale":"2024-09-12T00:35:44.391630+0000","last_undegraded":"2024-09-12T00:35:44.391630+0000","last_fullsized":"2024-09-12T00:35:44.391630+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:50.892944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627493+0000","last_change":"2024-09-12T00:17:03.222544+0000","last_active":"2024-09-12T00:35:49.627493+0000","last_peered":"2024-09-12T00:35:49.627493+0000","last_clean":"2024-09-12T00:35:49.627493+0000","last_became_active":"2024-09-12T00:17:03.222212+0000","last_became_peered":"2024-09-12T00:17:03.222212+0000","last_unstale":"2024-09-12T00:35:49.627493+0000","last_undegraded":"2024-09-12T00:35:49.627493+0000","last_fullsized":"2024-09-12T00:35:49.627493+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:51.034286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"258'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:46.508514+0000","last_change":"2024-09-12T00:17:00.184916+0000","last_active":"2024-09-12T00:35:46.508514+0000","last_peered":"2024-09-12T00:35:46.508514+0000","last_clean":"2024-09-12T00:35:46.508514+0000","last_became_active":"2024-09-12T00:17:00.184654+0000","last_became_peered":"2024-09-12T00:17:00.184654+0000","last_unstale":"2024-09-12T00:35:46.508514+0000","last_undegraded":"2024-09-12T00:35:46.508514+0000","last_fullsized":"2024-09-12T00:35:46.508514+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:59.225633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'33","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:55.935669+0000","last_change":"2024-09-12T00:15:34.425813+0000","last_active":"2024-09-12T00:36:55.935669+0000","last_peered":"2024-09-12T00:36:55.935669+0000","last_clean":"2024-09-12T00:36:55.935669+0000","last_became_active":"2024-09-12T00:15:34.425489+0000","last_became_peered":"2024-09-12T00:15:34.425489+0000","last_unstale":"2024-09-12T00:36:55.935669+0000","last_undegraded":"2024-09-12T00:36:55.935669+0000","last_fullsized":"2024-09-12T00:36:55.935669+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:24.112153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":114,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'272","reported_seq":915,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.758515+0000","last_change":"2024-09-12T00:01:57.152485+0000","last_active":"2024-09-12T00:36:56.758515+0000","last_peered":"2024-09-12T00:36:56.758515+0000","last_clean":"2024-09-12T00:36:56.758515+0000","last_became_active":"2024-09-12T00:01:57.152039+0000","last_became_peered":"2024-09-12T00:01:57.152039+0000","last_unstale":"2024-09-12T00:36:56.758515+0000","last_undegraded":"2024-09-12T00:36:56.758515+0000","last_fullsized":"2024-09-12T00:36:56.758515+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:46.339403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6862783,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":435,"num_read_kb":62278,"num_write":1063,"num_write_kb":40244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'78","reported_seq":659,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.458046+0000","last_change":"2024-09-12T00:01:59.156460+0000","last_active":"2024-09-12T00:37:01.458046+0000","last_peered":"2024-09-12T00:37:01.458046+0000","last_clean":"2024-09-12T00:37:01.458046+0000","last_became_active":"2024-09-12T00:01:59.156166+0000","last_became_peered":"2024-09-12T00:01:59.156166+0000","last_unstale":"2024-09-12T00:37:01.458046+0000","last_undegraded":"2024-09-12T00:37:01.458046+0000","last_fullsized":"2024-09-12T00:37:01.458046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:59.037812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":327,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'244","reported_seq":878,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:11.314967+0000","last_change":"2024-09-12T00:01:57.147898+0000","last_active":"2024-09-12T00:36:11.314967+0000","last_peered":"2024-09-12T00:36:11.314967+0000","last_clean":"2024-09-12T00:36:11.314967+0000","last_became_active":"2024-09-12T00:01:57.147519+0000","last_became_peered":"2024-09-12T00:01:57.147519+0000","last_unstale":"2024-09-12T00:36:11.314967+0000","last_undegraded":"2024-09-12T00:36:11.314967+0000","last_fullsized":"2024-09-12T00:36:11.314967+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:29.218354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23215665,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":387,"num_read_kb":64017,"num_write":932,"num_write_kb":35322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'285","reported_seq":942,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.878962+0000","last_change":"2024-09-12T00:01:59.140999+0000","last_active":"2024-09-12T00:36:58.878962+0000","last_peered":"2024-09-12T00:36:58.878962+0000","last_clean":"2024-09-12T00:36:58.878962+0000","last_became_active":"2024-09-12T00:01:59.140661+0000","last_became_peered":"2024-09-12T00:01:59.140661+0000","last_unstale":"2024-09-12T00:36:58.878962+0000","last_undegraded":"2024-09-12T00:36:58.878962+0000","last_fullsized":"2024-09-12T00:36:58.878962+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:42.180513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1344,"num_read_kb":1119,"num_write":493,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'291","reported_seq":915,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.992097+0000","last_change":"2024-09-12T00:01:57.141302+0000","last_active":"2024-09-12T00:36:58.992097+0000","last_peered":"2024-09-12T00:36:58.992097+0000","last_clean":"2024-09-12T00:36:58.992097+0000","last_became_active":"2024-09-12T00:01:57.140885+0000","last_became_peered":"2024-09-12T00:01:57.140885+0000","last_unstale":"2024-09-12T00:36:58.992097+0000","last_undegraded":"2024-09-12T00:36:58.992097+0000","last_fullsized":"2024-09-12T00:36:58.992097+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:07.324855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1047047,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":433,"num_read_kb":8971,"num_write":1057,"num_write_kb":33019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'357","reported_seq":997,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.252007+0000","last_change":"2024-09-12T00:01:59.145361+0000","last_active":"2024-09-12T00:36:59.252007+0000","last_peered":"2024-09-12T00:36:59.252007+0000","last_clean":"2024-09-12T00:36:59.252007+0000","last_became_active":"2024-09-12T00:01:59.144660+0000","last_became_peered":"2024-09-12T00:01:59.144660+0000","last_unstale":"2024-09-12T00:36:59.252007+0000","last_undegraded":"2024-09-12T00:36:59.252007+0000","last_fullsized":"2024-09-12T00:36:59.252007+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:56.723947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1585,"num_read_kb":1295,"num_write":589,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'296","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.005357+0000","last_change":"2024-09-12T00:01:57.155155+0000","last_active":"2024-09-12T00:37:07.005357+0000","last_peered":"2024-09-12T00:37:07.005357+0000","last_clean":"2024-09-12T00:37:07.005357+0000","last_became_active":"2024-09-12T00:01:57.154749+0000","last_became_peered":"2024-09-12T00:01:57.154749+0000","last_unstale":"2024-09-12T00:37:07.005357+0000","last_undegraded":"2024-09-12T00:37:07.005357+0000","last_fullsized":"2024-09-12T00:37:07.005357+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:49.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12585342,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":467,"num_read_kb":65052,"num_write":1070,"num_write_kb":38777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'303","reported_seq":925,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.238836+0000","last_change":"2024-09-12T00:01:59.147206+0000","last_active":"2024-09-12T00:37:08.238836+0000","last_peered":"2024-09-12T00:37:08.238836+0000","last_clean":"2024-09-12T00:37:08.238836+0000","last_became_active":"2024-09-12T00:01:59.146925+0000","last_became_peered":"2024-09-12T00:01:59.146925+0000","last_unstale":"2024-09-12T00:37:08.238836+0000","last_undegraded":"2024-09-12T00:37:08.238836+0000","last_fullsized":"2024-09-12T00:37:08.238836+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:07.011599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1201,"num_read_kb":972,"num_write":449,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'304","reported_seq":1040,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.889819+0000","last_change":"2024-09-12T00:01:57.151401+0000","last_active":"2024-09-12T00:37:01.889819+0000","last_peered":"2024-09-12T00:37:01.889819+0000","last_clean":"2024-09-12T00:37:01.889819+0000","last_became_active":"2024-09-12T00:01:57.151028+0000","last_became_peered":"2024-09-12T00:01:57.151028+0000","last_unstale":"2024-09-12T00:37:01.889819+0000","last_undegraded":"2024-09-12T00:37:01.889819+0000","last_fullsized":"2024-09-12T00:37:01.889819+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:42.442785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7677799,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":772,"num_read_kb":49842,"num_write":1089,"num_write_kb":22305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'253","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.591163+0000","last_change":"2024-09-12T00:01:59.150011+0000","last_active":"2024-09-12T00:38:27.591163+0000","last_peered":"2024-09-12T00:38:27.591163+0000","last_clean":"2024-09-12T00:38:27.591163+0000","last_became_active":"2024-09-12T00:01:59.149728+0000","last_became_peered":"2024-09-12T00:01:59.149728+0000","last_unstale":"2024-09-12T00:38:27.591163+0000","last_undegraded":"2024-09-12T00:38:27.591163+0000","last_fullsized":"2024-09-12T00:38:27.591163+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:46.169594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1186,"num_read_kb":981,"num_write":436,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'289","reported_seq":1031,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:21.555440+0000","last_change":"2024-09-12T00:01:57.153165+0000","last_active":"2024-09-12T00:38:21.555440+0000","last_peered":"2024-09-12T00:38:21.555440+0000","last_clean":"2024-09-12T00:38:21.555440+0000","last_became_active":"2024-09-12T00:01:57.152791+0000","last_became_peered":"2024-09-12T00:01:57.152791+0000","last_unstale":"2024-09-12T00:38:21.555440+0000","last_undegraded":"2024-09-12T00:38:21.555440+0000","last_fullsized":"2024-09-12T00:38:21.555440+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:34.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1812510,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":753,"num_read_kb":39077,"num_write":1127,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'276","reported_seq":864,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:10.033280+0000","last_change":"2024-09-12T00:01:59.151834+0000","last_active":"2024-09-12T00:36:10.033280+0000","last_peered":"2024-09-12T00:36:10.033280+0000","last_clean":"2024-09-12T00:36:10.033280+0000","last_became_active":"2024-09-12T00:01:59.151168+0000","last_became_peered":"2024-09-12T00:01:59.151168+0000","last_unstale":"2024-09-12T00:36:10.033280+0000","last_undegraded":"2024-09-12T00:36:10.033280+0000","last_fullsized":"2024-09-12T00:36:10.033280+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:07.026026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1184,"num_read_kb":963,"num_write":440,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'280","reported_seq":942,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:49.549636+0000","last_change":"2024-09-12T00:01:57.146987+0000","last_active":"2024-09-12T00:36:49.549636+0000","last_peered":"2024-09-12T00:36:49.549636+0000","last_clean":"2024-09-12T00:36:49.549636+0000","last_became_active":"2024-09-12T00:01:57.146592+0000","last_became_peered":"2024-09-12T00:01:57.146592+0000","last_unstale":"2024-09-12T00:36:49.549636+0000","last_undegraded":"2024-09-12T00:36:49.549636+0000","last_fullsized":"2024-09-12T00:36:49.549636+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:36.580016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5307031,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":486,"num_read_kb":36664,"num_write":1054,"num_write_kb":21178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'169","reported_seq":757,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.751860+0000","last_change":"2024-09-12T00:01:59.153636+0000","last_active":"2024-09-12T00:36:58.751860+0000","last_peered":"2024-09-12T00:36:58.751860+0000","last_clean":"2024-09-12T00:36:58.751860+0000","last_became_active":"2024-09-12T00:01:59.153277+0000","last_became_peered":"2024-09-12T00:01:59.153277+0000","last_unstale":"2024-09-12T00:36:58.751860+0000","last_undegraded":"2024-09-12T00:36:58.751860+0000","last_fullsized":"2024-09-12T00:36:58.751860+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:06.223418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":798,"num_read_kb":679,"num_write":291,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'288","reported_seq":901,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.720538+0000","last_change":"2024-09-12T00:01:57.152039+0000","last_active":"2024-09-12T00:37:06.720538+0000","last_peered":"2024-09-12T00:37:06.720538+0000","last_clean":"2024-09-12T00:37:06.720538+0000","last_became_active":"2024-09-12T00:01:57.151506+0000","last_became_peered":"2024-09-12T00:01:57.151506+0000","last_unstale":"2024-09-12T00:37:06.720538+0000","last_undegraded":"2024-09-12T00:37:06.720538+0000","last_fullsized":"2024-09-12T00:37:06.720538+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:02.754894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550480,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":450,"num_read_kb":7555,"num_write":1082,"num_write_kb":27882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'125","reported_seq":711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.323304+0000","last_change":"2024-09-12T00:01:59.149439+0000","last_active":"2024-09-12T00:36:54.323304+0000","last_peered":"2024-09-12T00:36:54.323304+0000","last_clean":"2024-09-12T00:36:54.323304+0000","last_became_active":"2024-09-12T00:01:59.148098+0000","last_became_peered":"2024-09-12T00:01:59.148098+0000","last_unstale":"2024-09-12T00:36:54.323304+0000","last_undegraded":"2024-09-12T00:36:54.323304+0000","last_fullsized":"2024-09-12T00:36:54.323304+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:18.916236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":439,"num_write":182,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'114","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.963544+0000","last_change":"2024-09-12T00:01:59.148279+0000","last_active":"2024-09-12T00:36:58.963544+0000","last_peered":"2024-09-12T00:36:58.963544+0000","last_clean":"2024-09-12T00:36:58.963544+0000","last_became_active":"2024-09-12T00:01:59.148017+0000","last_became_peered":"2024-09-12T00:01:59.148017+0000","last_unstale":"2024-09-12T00:36:58.963544+0000","last_undegraded":"2024-09-12T00:36:58.963544+0000","last_fullsized":"2024-09-12T00:36:58.963544+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:15.214488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":485,"num_read_kb":395,"num_write":184,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'289","reported_seq":972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.507580+0000","last_change":"2024-09-12T00:01:57.151683+0000","last_active":"2024-09-12T00:38:36.507580+0000","last_peered":"2024-09-12T00:38:36.507580+0000","last_clean":"2024-09-12T00:38:36.507580+0000","last_became_active":"2024-09-12T00:01:57.151116+0000","last_became_peered":"2024-09-12T00:01:57.151116+0000","last_unstale":"2024-09-12T00:38:36.507580+0000","last_undegraded":"2024-09-12T00:38:36.507580+0000","last_fullsized":"2024-09-12T00:38:36.507580+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:35.763246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15090525,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":523,"num_read_kb":78307,"num_write":1124,"num_write_kb":30055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'230","reported_seq":811,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:39.381829+0000","last_change":"2024-09-12T00:01:59.152420+0000","last_active":"2024-09-12T00:34:39.381829+0000","last_peered":"2024-09-12T00:34:39.381829+0000","last_clean":"2024-09-12T00:34:39.381829+0000","last_became_active":"2024-09-12T00:01:59.152131+0000","last_became_peered":"2024-09-12T00:01:59.152131+0000","last_unstale":"2024-09-12T00:34:39.381829+0000","last_undegraded":"2024-09-12T00:34:39.381829+0000","last_fullsized":"2024-09-12T00:34:39.381829+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:35.864717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":807,"num_write":370,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'272","reported_seq":903,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.990923+0000","last_change":"2024-09-12T00:01:57.145166+0000","last_active":"2024-09-12T00:36:58.990923+0000","last_peered":"2024-09-12T00:36:58.990923+0000","last_clean":"2024-09-12T00:36:58.990923+0000","last_became_active":"2024-09-12T00:01:57.143834+0000","last_became_peered":"2024-09-12T00:01:57.143834+0000","last_unstale":"2024-09-12T00:36:58.990923+0000","last_undegraded":"2024-09-12T00:36:58.990923+0000","last_fullsized":"2024-09-12T00:36:58.990923+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:52.588497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2710,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":461,"num_read_kb":1593,"num_write":1123,"num_write_kb":15734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'430","reported_seq":1135,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.136558+0000","last_change":"2024-09-12T00:01:59.153835+0000","last_active":"2024-09-12T00:36:52.136558+0000","last_peered":"2024-09-12T00:36:52.136558+0000","last_clean":"2024-09-12T00:36:52.136558+0000","last_became_active":"2024-09-12T00:01:59.153559+0000","last_became_peered":"2024-09-12T00:01:59.153559+0000","last_unstale":"2024-09-12T00:36:52.136558+0000","last_undegraded":"2024-09-12T00:36:52.136558+0000","last_fullsized":"2024-09-12T00:36:52.136558+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:14.763454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2074,"num_read_kb":1775,"num_write":771,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'252","reported_seq":861,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:23.551844+0000","last_change":"2024-09-12T00:01:57.151910+0000","last_active":"2024-09-12T00:38:23.551844+0000","last_peered":"2024-09-12T00:38:23.551844+0000","last_clean":"2024-09-12T00:38:23.551844+0000","last_became_active":"2024-09-12T00:01:57.150789+0000","last_became_peered":"2024-09-12T00:01:57.150789+0000","last_unstale":"2024-09-12T00:38:23.551844+0000","last_undegraded":"2024-09-12T00:38:23.551844+0000","last_fullsized":"2024-09-12T00:38:23.551844+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:08.148314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2191305,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":374,"num_read_kb":13160,"num_write":898,"num_write_kb":19470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'149","reported_seq":772,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.747639+0000","last_change":"2024-09-12T00:01:59.149460+0000","last_active":"2024-09-12T00:36:50.747639+0000","last_peered":"2024-09-12T00:36:50.747639+0000","last_clean":"2024-09-12T00:36:50.747639+0000","last_became_active":"2024-09-12T00:01:59.149195+0000","last_became_peered":"2024-09-12T00:01:59.149195+0000","last_unstale":"2024-09-12T00:36:50.747639+0000","last_undegraded":"2024-09-12T00:36:50.747639+0000","last_fullsized":"2024-09-12T00:36:50.747639+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:43.524528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":604,"num_write":216,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'291","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.622977+0000","last_change":"2024-09-12T00:01:57.158820+0000","last_active":"2024-09-12T00:37:21.622977+0000","last_peered":"2024-09-12T00:37:21.622977+0000","last_clean":"2024-09-12T00:37:21.622977+0000","last_became_active":"2024-09-12T00:01:57.157877+0000","last_became_peered":"2024-09-12T00:01:57.157877+0000","last_unstale":"2024-09-12T00:37:21.622977+0000","last_undegraded":"2024-09-12T00:37:21.622977+0000","last_fullsized":"2024-09-12T00:37:21.622977+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:52.712462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14341133,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":451,"num_read_kb":26576,"num_write":1041,"num_write_kb":46689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'164","reported_seq":755,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.250417+0000","last_change":"2024-09-12T00:01:59.159547+0000","last_active":"2024-09-12T00:37:02.250417+0000","last_peered":"2024-09-12T00:37:02.250417+0000","last_clean":"2024-09-12T00:37:02.250417+0000","last_became_active":"2024-09-12T00:01:59.159215+0000","last_became_peered":"2024-09-12T00:01:59.159215+0000","last_unstale":"2024-09-12T00:37:02.250417+0000","last_undegraded":"2024-09-12T00:37:02.250417+0000","last_fullsized":"2024-09-12T00:37:02.250417+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:31.759927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":584,"num_write":229,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'230","reported_seq":867,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.421114+0000","last_change":"2024-09-12T00:02:32.844919+0000","last_active":"2024-09-12T00:37:21.421114+0000","last_peered":"2024-09-12T00:37:21.421114+0000","last_clean":"2024-09-12T00:37:21.421114+0000","last_became_active":"2024-09-12T00:02:32.844466+0000","last_became_peered":"2024-09-12T00:02:32.844466+0000","last_unstale":"2024-09-12T00:37:21.421114+0000","last_undegraded":"2024-09-12T00:37:21.421114+0000","last_fullsized":"2024-09-12T00:37:21.421114+0000","mapping_epoch":37,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:09.241156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12118951,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":429,"num_read_kb":38682,"num_write":973,"num_write_kb":28786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'136","reported_seq":724,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.061425+0000","last_change":"2024-09-12T00:01:59.156382+0000","last_active":"2024-09-12T00:37:23.061425+0000","last_peered":"2024-09-12T00:37:23.061425+0000","last_clean":"2024-09-12T00:37:23.061425+0000","last_became_active":"2024-09-12T00:01:59.156058+0000","last_became_peered":"2024-09-12T00:01:59.156058+0000","last_unstale":"2024-09-12T00:37:23.061425+0000","last_undegraded":"2024-09-12T00:37:23.061425+0000","last_fullsized":"2024-09-12T00:37:23.061425+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:10.726145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":582,"num_read_kb":485,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'328","reported_seq":943,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:23.252947+0000","last_change":"2024-09-12T00:01:57.137262+0000","last_active":"2024-09-12T00:36:23.252947+0000","last_peered":"2024-09-12T00:36:23.252947+0000","last_clean":"2024-09-12T00:36:23.252947+0000","last_became_active":"2024-09-12T00:01:57.136872+0000","last_became_peered":"2024-09-12T00:01:57.136872+0000","last_unstale":"2024-09-12T00:36:23.252947+0000","last_undegraded":"2024-09-12T00:36:23.252947+0000","last_fullsized":"2024-09-12T00:36:23.252947+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:32.662213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8171851,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":434,"num_read_kb":28039,"num_write":1218,"num_write_kb":53988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'147","reported_seq":642,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.514493+0000","last_change":"2024-09-12T00:02:07.159622+0000","last_active":"2024-09-12T00:37:23.514493+0000","last_peered":"2024-09-12T00:37:23.514493+0000","last_clean":"2024-09-12T00:37:23.514493+0000","last_became_active":"2024-09-12T00:02:07.159308+0000","last_became_peered":"2024-09-12T00:02:07.159308+0000","last_unstale":"2024-09-12T00:37:23.514493+0000","last_undegraded":"2024-09-12T00:37:23.514493+0000","last_fullsized":"2024-09-12T00:37:23.514493+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:23.798981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'123","reported_seq":707,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.287204+0000","last_change":"2024-09-12T00:01:59.152275+0000","last_active":"2024-09-12T00:36:50.287204+0000","last_peered":"2024-09-12T00:36:50.287204+0000","last_clean":"2024-09-12T00:36:50.287204+0000","last_became_active":"2024-09-12T00:01:59.151773+0000","last_became_peered":"2024-09-12T00:01:59.151773+0000","last_unstale":"2024-09-12T00:36:50.287204+0000","last_undegraded":"2024-09-12T00:36:50.287204+0000","last_fullsized":"2024-09-12T00:36:50.287204+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:11.927074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":478,"num_write":204,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'261","reported_seq":948,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.888399+0000","last_change":"2024-09-12T00:01:57.166828+0000","last_active":"2024-09-12T00:37:01.888399+0000","last_peered":"2024-09-12T00:37:01.888399+0000","last_clean":"2024-09-12T00:37:01.888399+0000","last_became_active":"2024-09-12T00:01:57.165987+0000","last_became_peered":"2024-09-12T00:01:57.165987+0000","last_unstale":"2024-09-12T00:37:01.888399+0000","last_undegraded":"2024-09-12T00:37:01.888399+0000","last_fullsized":"2024-09-12T00:37:01.888399+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:40.754997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5864980,"num_objects":86,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":524,"num_read_kb":32539,"num_write":898,"num_write_kb":21474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.393143+0000","last_change":"2024-09-12T00:02:01.154807+0000","last_active":"2024-09-12T00:35:54.393143+0000","last_peered":"2024-09-12T00:35:54.393143+0000","last_clean":"2024-09-12T00:35:54.393143+0000","last_became_active":"2024-09-12T00:02:01.154464+0000","last_became_peered":"2024-09-12T00:02:01.154464+0000","last_unstale":"2024-09-12T00:35:54.393143+0000","last_undegraded":"2024-09-12T00:35:54.393143+0000","last_fullsized":"2024-09-12T00:35:54.393143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.047642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'356","reported_seq":955,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.920759+0000","last_change":"2024-09-12T00:02:03.156471+0000","last_active":"2024-09-12T00:38:28.920759+0000","last_peered":"2024-09-12T00:38:28.920759+0000","last_clean":"2024-09-12T00:38:28.920759+0000","last_became_active":"2024-09-12T00:02:03.156175+0000","last_became_peered":"2024-09-12T00:02:03.156175+0000","last_unstale":"2024-09-12T00:38:28.920759+0000","last_undegraded":"2024-09-12T00:38:28.920759+0000","last_fullsized":"2024-09-12T00:38:28.920759+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:33.670259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66861,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":1114,"num_write":466,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:56.510205+0000","last_change":"2024-09-12T00:02:05.165724+0000","last_active":"2024-09-12T00:35:56.510205+0000","last_peered":"2024-09-12T00:35:56.510205+0000","last_clean":"2024-09-12T00:35:56.510205+0000","last_became_active":"2024-09-12T00:02:05.165424+0000","last_became_peered":"2024-09-12T00:02:05.165424+0000","last_unstale":"2024-09-12T00:35:56.510205+0000","last_undegraded":"2024-09-12T00:35:56.510205+0000","last_fullsized":"2024-09-12T00:35:56.510205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:38.859922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'129","reported_seq":679,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.108575+0000","last_change":"2024-09-12T00:02:07.175107+0000","last_active":"2024-09-12T00:37:21.108575+0000","last_peered":"2024-09-12T00:37:21.108575+0000","last_clean":"2024-09-12T00:37:21.108575+0000","last_became_active":"2024-09-12T00:02:07.174795+0000","last_became_peered":"2024-09-12T00:02:07.174795+0000","last_unstale":"2024-09-12T00:37:21.108575+0000","last_undegraded":"2024-09-12T00:37:21.108575+0000","last_fullsized":"2024-09-12T00:37:21.108575+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.332589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":239,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'75","reported_seq":622,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.555629+0000","last_change":"2024-09-12T00:01:59.146503+0000","last_active":"2024-09-12T00:37:08.555629+0000","last_peered":"2024-09-12T00:37:08.555629+0000","last_clean":"2024-09-12T00:37:08.555629+0000","last_became_active":"2024-09-12T00:01:59.145411+0000","last_became_peered":"2024-09-12T00:01:59.145411+0000","last_unstale":"2024-09-12T00:37:08.555629+0000","last_undegraded":"2024-09-12T00:37:08.555629+0000","last_fullsized":"2024-09-12T00:37:08.555629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:33.082390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":104,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'300","reported_seq":944,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:23.003179+0000","last_change":"2024-09-12T00:01:57.147335+0000","last_active":"2024-09-12T00:38:23.003179+0000","last_peered":"2024-09-12T00:38:23.003179+0000","last_clean":"2024-09-12T00:38:23.003179+0000","last_became_active":"2024-09-12T00:01:57.146952+0000","last_became_peered":"2024-09-12T00:01:57.146952+0000","last_unstale":"2024-09-12T00:38:23.003179+0000","last_undegraded":"2024-09-12T00:38:23.003179+0000","last_fullsized":"2024-09-12T00:38:23.003179+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:11.335615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17404174,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":487,"num_read_kb":41499,"num_write":1191,"num_write_kb":32474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:47.503501+0000","last_change":"2024-09-12T00:02:01.156228+0000","last_active":"2024-09-12T00:34:47.503501+0000","last_peered":"2024-09-12T00:34:47.503501+0000","last_clean":"2024-09-12T00:34:47.503501+0000","last_became_active":"2024-09-12T00:02:01.155948+0000","last_became_peered":"2024-09-12T00:02:01.155948+0000","last_unstale":"2024-09-12T00:34:47.503501+0000","last_undegraded":"2024-09-12T00:34:47.503501+0000","last_fullsized":"2024-09-12T00:34:47.503501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:34.073281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'81","reported_seq":596,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:51.124923+0000","last_change":"2024-09-12T00:02:03.152995+0000","last_active":"2024-09-12T00:36:51.124923+0000","last_peered":"2024-09-12T00:36:51.124923+0000","last_clean":"2024-09-12T00:36:51.124923+0000","last_became_active":"2024-09-12T00:02:03.152708+0000","last_became_peered":"2024-09-12T00:02:03.152708+0000","last_unstale":"2024-09-12T00:36:51.124923+0000","last_undegraded":"2024-09-12T00:36:51.124923+0000","last_fullsized":"2024-09-12T00:36:51.124923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:00.923044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":85,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:56.510160+0000","last_change":"2024-09-12T00:02:05.163074+0000","last_active":"2024-09-12T00:35:56.510160+0000","last_peered":"2024-09-12T00:35:56.510160+0000","last_clean":"2024-09-12T00:35:56.510160+0000","last_became_active":"2024-09-12T00:02:05.162755+0000","last_became_peered":"2024-09-12T00:02:05.162755+0000","last_unstale":"2024-09-12T00:35:56.510160+0000","last_undegraded":"2024-09-12T00:35:56.510160+0000","last_fullsized":"2024-09-12T00:35:56.510160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:20.807313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'133","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.520320+0000","last_change":"2024-09-12T00:02:07.168207+0000","last_active":"2024-09-12T00:37:09.520320+0000","last_peered":"2024-09-12T00:37:09.520320+0000","last_clean":"2024-09-12T00:37:09.520320+0000","last_became_active":"2024-09-12T00:02:07.167851+0000","last_became_peered":"2024-09-12T00:02:07.167851+0000","last_unstale":"2024-09-12T00:37:09.520320+0000","last_undegraded":"2024-09-12T00:37:09.520320+0000","last_fullsized":"2024-09-12T00:37:09.520320+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:11.325627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":137,"num_write":333,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'4128","reported_seq":4726,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510282+0000","last_change":"2024-09-12T00:01:59.151349+0000","last_active":"2024-09-12T00:35:49.510282+0000","last_peered":"2024-09-12T00:35:49.510282+0000","last_clean":"2024-09-12T00:35:49.510282+0000","last_became_active":"2024-09-12T00:01:59.151026+0000","last_became_peered":"2024-09-12T00:01:59.151026+0000","last_unstale":"2024-09-12T00:35:49.510282+0000","last_undegraded":"2024-09-12T00:35:49.510282+0000","last_fullsized":"2024-09-12T00:35:49.510282+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":3000,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:16.187111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16602,"num_read_kb":13937,"num_write":6188,"num_write_kb":3085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'240","reported_seq":939,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.804729+0000","last_change":"2024-09-12T00:01:57.144752+0000","last_active":"2024-09-12T00:37:10.804729+0000","last_peered":"2024-09-12T00:37:10.804729+0000","last_clean":"2024-09-12T00:37:10.804729+0000","last_became_active":"2024-09-12T00:01:57.144269+0000","last_became_peered":"2024-09-12T00:01:57.144269+0000","last_unstale":"2024-09-12T00:37:10.804729+0000","last_undegraded":"2024-09-12T00:37:10.804729+0000","last_fullsized":"2024-09-12T00:37:10.804729+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:54.481149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":728542,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":647,"num_read_kb":1796,"num_write":865,"num_write_kb":33986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:52.513137+0000","last_change":"2024-09-12T00:02:01.155683+0000","last_active":"2024-09-12T00:35:52.513137+0000","last_peered":"2024-09-12T00:35:52.513137+0000","last_clean":"2024-09-12T00:35:52.513137+0000","last_became_active":"2024-09-12T00:02:01.155425+0000","last_became_peered":"2024-09-12T00:02:01.155425+0000","last_unstale":"2024-09-12T00:35:52.513137+0000","last_undegraded":"2024-09-12T00:35:52.513137+0000","last_fullsized":"2024-09-12T00:35:52.513137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:38.140909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'103","reported_seq":636,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.325100+0000","last_change":"2024-09-12T00:02:03.152143+0000","last_active":"2024-09-12T00:36:54.325100+0000","last_peered":"2024-09-12T00:36:54.325100+0000","last_clean":"2024-09-12T00:36:54.325100+0000","last_became_active":"2024-09-12T00:02:03.151839+0000","last_became_peered":"2024-09-12T00:02:03.151839+0000","last_unstale":"2024-09-12T00:36:54.325100+0000","last_undegraded":"2024-09-12T00:36:54.325100+0000","last_fullsized":"2024-09-12T00:36:54.325100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:56.820811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'751","reported_seq":2039,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.954004+0000","last_change":"2024-09-12T00:02:05.167777+0000","last_active":"2024-09-12T00:38:28.954004+0000","last_peered":"2024-09-12T00:38:28.954004+0000","last_clean":"2024-09-12T00:38:28.954004+0000","last_became_active":"2024-09-12T00:02:05.166985+0000","last_became_peered":"2024-09-12T00:02:05.166985+0000","last_unstale":"2024-09-12T00:38:28.954004+0000","last_undegraded":"2024-09-12T00:38:28.954004+0000","last_fullsized":"2024-09-12T00:38:28.954004+0000","mapping_epoch":32,"log_start":"261'701","ondisk_log_start":"261'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":701,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:46.965686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'217","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.117831+0000","last_change":"2024-09-12T00:02:07.167855+0000","last_active":"2024-09-12T00:37:23.117831+0000","last_peered":"2024-09-12T00:37:23.117831+0000","last_clean":"2024-09-12T00:37:23.117831+0000","last_became_active":"2024-09-12T00:02:07.167576+0000","last_became_peered":"2024-09-12T00:02:07.167576+0000","last_unstale":"2024-09-12T00:37:23.117831+0000","last_undegraded":"2024-09-12T00:37:23.117831+0000","last_fullsized":"2024-09-12T00:37:23.117831+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:16.693441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":605,"num_read_kb":603,"num_write":488,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'58","reported_seq":609,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:22.120801+0000","last_change":"2024-09-12T00:01:59.149396+0000","last_active":"2024-09-12T00:36:22.120801+0000","last_peered":"2024-09-12T00:36:22.120801+0000","last_clean":"2024-09-12T00:36:22.120801+0000","last_became_active":"2024-09-12T00:01:59.149087+0000","last_became_peered":"2024-09-12T00:01:59.149087+0000","last_unstale":"2024-09-12T00:36:22.120801+0000","last_undegraded":"2024-09-12T00:36:22.120801+0000","last_fullsized":"2024-09-12T00:36:22.120801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:13.031884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":233,"num_write":78,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'305","reported_seq":1002,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.507120+0000","last_change":"2024-09-12T00:01:57.153276+0000","last_active":"2024-09-12T00:38:36.507120+0000","last_peered":"2024-09-12T00:38:36.507120+0000","last_clean":"2024-09-12T00:38:36.507120+0000","last_became_active":"2024-09-12T00:01:57.152332+0000","last_became_peered":"2024-09-12T00:01:57.152332+0000","last_unstale":"2024-09-12T00:38:36.507120+0000","last_undegraded":"2024-09-12T00:38:36.507120+0000","last_fullsized":"2024-09-12T00:38:36.507120+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:07.357627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8905738,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":607,"num_read_kb":43786,"num_write":1133,"num_write_kb":39072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.393180+0000","last_change":"2024-09-12T00:02:01.154452+0000","last_active":"2024-09-12T00:35:54.393180+0000","last_peered":"2024-09-12T00:35:54.393180+0000","last_clean":"2024-09-12T00:35:54.393180+0000","last_became_active":"2024-09-12T00:02:01.154110+0000","last_became_peered":"2024-09-12T00:02:01.154110+0000","last_unstale":"2024-09-12T00:35:54.393180+0000","last_undegraded":"2024-09-12T00:35:54.393180+0000","last_fullsized":"2024-09-12T00:35:54.393180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:04.241524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'252","reported_seq":799,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:19.529625+0000","last_change":"2024-09-12T00:02:03.146008+0000","last_active":"2024-09-12T00:38:19.529625+0000","last_peered":"2024-09-12T00:38:19.529625+0000","last_clean":"2024-09-12T00:38:19.529625+0000","last_became_active":"2024-09-12T00:02:03.145673+0000","last_became_peered":"2024-09-12T00:02:03.145673+0000","last_unstale":"2024-09-12T00:38:19.529625+0000","last_undegraded":"2024-09-12T00:38:19.529625+0000","last_fullsized":"2024-09-12T00:38:19.529625+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:24.216453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51035,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":413,"num_read_kb":852,"num_write":342,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'777","reported_seq":2149,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.958358+0000","last_change":"2024-09-12T00:02:05.165636+0000","last_active":"2024-09-12T00:38:28.958358+0000","last_peered":"2024-09-12T00:38:28.958358+0000","last_clean":"2024-09-12T00:38:28.958358+0000","last_became_active":"2024-09-12T00:02:05.165283+0000","last_became_peered":"2024-09-12T00:02:05.165283+0000","last_unstale":"2024-09-12T00:38:28.958358+0000","last_undegraded":"2024-09-12T00:38:28.958358+0000","last_fullsized":"2024-09-12T00:38:28.958358+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:20.861078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'107","reported_seq":676,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:17.644092+0000","last_change":"2024-09-12T00:01:59.154031+0000","last_active":"2024-09-12T00:36:17.644092+0000","last_peered":"2024-09-12T00:36:17.644092+0000","last_clean":"2024-09-12T00:36:17.644092+0000","last_became_active":"2024-09-12T00:01:59.153704+0000","last_became_peered":"2024-09-12T00:01:59.153704+0000","last_unstale":"2024-09-12T00:36:17.644092+0000","last_undegraded":"2024-09-12T00:36:17.644092+0000","last_fullsized":"2024-09-12T00:36:17.644092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:25.468551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":389,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'278","reported_seq":917,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.568253+0000","last_change":"2024-09-12T00:01:57.155999+0000","last_active":"2024-09-12T00:37:10.568253+0000","last_peered":"2024-09-12T00:37:10.568253+0000","last_clean":"2024-09-12T00:37:10.568253+0000","last_became_active":"2024-09-12T00:01:57.154222+0000","last_became_peered":"2024-09-12T00:01:57.154222+0000","last_unstale":"2024-09-12T00:37:10.568253+0000","last_undegraded":"2024-09-12T00:37:10.568253+0000","last_fullsized":"2024-09-12T00:37:10.568253+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:34.043715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11402269,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":450,"num_read_kb":40357,"num_write":1089,"num_write_kb":32511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:31.497551+0000","last_change":"2024-09-12T00:02:01.144820+0000","last_active":"2024-09-12T00:34:31.497551+0000","last_peered":"2024-09-12T00:34:31.497551+0000","last_clean":"2024-09-12T00:34:31.497551+0000","last_became_active":"2024-09-12T00:02:01.144531+0000","last_became_peered":"2024-09-12T00:02:01.144531+0000","last_unstale":"2024-09-12T00:34:31.497551+0000","last_undegraded":"2024-09-12T00:34:31.497551+0000","last_fullsized":"2024-09-12T00:34:31.497551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:47.902602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'366","reported_seq":963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.399693+0000","last_change":"2024-09-12T00:02:03.155592+0000","last_active":"2024-09-12T00:36:54.399693+0000","last_peered":"2024-09-12T00:36:54.399693+0000","last_clean":"2024-09-12T00:36:54.399693+0000","last_became_active":"2024-09-12T00:02:03.155293+0000","last_became_peered":"2024-09-12T00:02:03.155293+0000","last_unstale":"2024-09-12T00:36:54.399693+0000","last_undegraded":"2024-09-12T00:36:54.399693+0000","last_fullsized":"2024-09-12T00:36:54.399693+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:29.029401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62749,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":1121,"num_write":476,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.509941+0000","last_change":"2024-09-12T00:02:05.168024+0000","last_active":"2024-09-12T00:35:49.509941+0000","last_peered":"2024-09-12T00:35:49.509941+0000","last_clean":"2024-09-12T00:35:49.509941+0000","last_became_active":"2024-09-12T00:02:05.167762+0000","last_became_peered":"2024-09-12T00:02:05.167762+0000","last_unstale":"2024-09-12T00:35:49.509941+0000","last_undegraded":"2024-09-12T00:35:49.509941+0000","last_fullsized":"2024-09-12T00:35:49.509941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:56.207387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'546","reported_seq":1342,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.940888+0000","last_change":"2024-09-12T00:02:07.172418+0000","last_active":"2024-09-12T00:38:28.940888+0000","last_peered":"2024-09-12T00:38:28.940888+0000","last_clean":"2024-09-12T00:38:28.940888+0000","last_became_active":"2024-09-12T00:02:07.172005+0000","last_became_peered":"2024-09-12T00:02:07.172005+0000","last_unstale":"2024-09-12T00:38:28.940888+0000","last_undegraded":"2024-09-12T00:38:28.940888+0000","last_fullsized":"2024-09-12T00:38:28.940888+0000","mapping_epoch":34,"log_start":"261'500","ondisk_log_start":"261'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:59.842808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1294,"num_read_kb":1285,"num_write":1129,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'119","reported_seq":688,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:49.065624+0000","last_change":"2024-09-12T00:01:59.152065+0000","last_active":"2024-09-12T00:36:49.065624+0000","last_peered":"2024-09-12T00:36:49.065624+0000","last_clean":"2024-09-12T00:36:49.065624+0000","last_became_active":"2024-09-12T00:01:59.151782+0000","last_became_peered":"2024-09-12T00:01:59.151782+0000","last_unstale":"2024-09-12T00:36:49.065624+0000","last_undegraded":"2024-09-12T00:36:49.065624+0000","last_fullsized":"2024-09-12T00:36:49.065624+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:29.853489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":439,"num_write":192,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'246","reported_seq":855,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.553989+0000","last_change":"2024-09-12T00:01:57.157778+0000","last_active":"2024-09-12T00:37:07.553989+0000","last_peered":"2024-09-12T00:37:07.553989+0000","last_clean":"2024-09-12T00:37:07.553989+0000","last_became_active":"2024-09-12T00:01:57.157370+0000","last_became_peered":"2024-09-12T00:01:57.157370+0000","last_unstale":"2024-09-12T00:37:07.553989+0000","last_undegraded":"2024-09-12T00:37:07.553989+0000","last_fullsized":"2024-09-12T00:37:07.553989+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:25.879830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":654605,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":382,"num_read_kb":3842,"num_write":909,"num_write_kb":16793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498474+0000","last_change":"2024-09-12T00:02:01.152227+0000","last_active":"2024-09-12T00:34:34.498474+0000","last_peered":"2024-09-12T00:34:34.498474+0000","last_clean":"2024-09-12T00:34:34.498474+0000","last_became_active":"2024-09-12T00:02:01.151914+0000","last_became_peered":"2024-09-12T00:02:01.151914+0000","last_unstale":"2024-09-12T00:34:34.498474+0000","last_undegraded":"2024-09-12T00:34:34.498474+0000","last_fullsized":"2024-09-12T00:34:34.498474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:15.461722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'276","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.700469+0000","last_change":"2024-09-12T00:02:03.155128+0000","last_active":"2024-09-12T00:38:36.700469+0000","last_peered":"2024-09-12T00:38:36.700469+0000","last_clean":"2024-09-12T00:38:36.700469+0000","last_became_active":"2024-09-12T00:02:03.154819+0000","last_became_peered":"2024-09-12T00:02:03.154819+0000","last_unstale":"2024-09-12T00:38:36.700469+0000","last_undegraded":"2024-09-12T00:38:36.700469+0000","last_fullsized":"2024-09-12T00:38:36.700469+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:47.375234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":1012,"num_write":362,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:42.502604+0000","last_change":"2024-09-12T00:02:05.168924+0000","last_active":"2024-09-12T00:34:42.502604+0000","last_peered":"2024-09-12T00:34:42.502604+0000","last_clean":"2024-09-12T00:34:42.502604+0000","last_became_active":"2024-09-12T00:02:05.168649+0000","last_became_peered":"2024-09-12T00:02:05.168649+0000","last_unstale":"2024-09-12T00:34:42.502604+0000","last_undegraded":"2024-09-12T00:34:42.502604+0000","last_fullsized":"2024-09-12T00:34:42.502604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:59.645822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2367","reported_seq":4178,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:10.204589+0000","last_change":"2024-09-12T00:02:07.175086+0000","last_active":"2024-09-12T00:38:10.204589+0000","last_peered":"2024-09-12T00:38:10.204589+0000","last_clean":"2024-09-12T00:38:10.204589+0000","last_became_active":"2024-09-12T00:02:07.174769+0000","last_became_peered":"2024-09-12T00:02:07.174769+0000","last_unstale":"2024-09-12T00:38:10.204589+0000","last_undegraded":"2024-09-12T00:38:10.204589+0000","last_fullsized":"2024-09-12T00:38:10.204589+0000","mapping_epoch":34,"log_start":"261'2300","ondisk_log_start":"261'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":2300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:04.650587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5961,"num_read_kb":5964,"num_write":4767,"num_write_kb":1768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'190","reported_seq":812,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.531588+0000","last_change":"2024-09-12T00:01:59.156546+0000","last_active":"2024-09-12T00:36:54.531588+0000","last_peered":"2024-09-12T00:36:54.531588+0000","last_clean":"2024-09-12T00:36:54.531588+0000","last_became_active":"2024-09-12T00:01:59.156252+0000","last_became_peered":"2024-09-12T00:01:59.156252+0000","last_unstale":"2024-09-12T00:36:54.531588+0000","last_undegraded":"2024-09-12T00:36:54.531588+0000","last_fullsized":"2024-09-12T00:36:54.531588+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:11.696792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":702,"num_write":296,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'306","reported_seq":945,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.552837+0000","last_change":"2024-09-12T00:01:57.158137+0000","last_active":"2024-09-12T00:37:07.552837+0000","last_peered":"2024-09-12T00:37:07.552837+0000","last_clean":"2024-09-12T00:37:07.552837+0000","last_became_active":"2024-09-12T00:01:57.157699+0000","last_became_peered":"2024-09-12T00:01:57.157699+0000","last_unstale":"2024-09-12T00:37:07.552837+0000","last_undegraded":"2024-09-12T00:37:07.552837+0000","last_fullsized":"2024-09-12T00:37:07.552837+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:28.312365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5571188,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":499,"num_read_kb":32954,"num_write":1159,"num_write_kb":41911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510167+0000","last_change":"2024-09-12T00:02:01.153356+0000","last_active":"2024-09-12T00:35:49.510167+0000","last_peered":"2024-09-12T00:35:49.510167+0000","last_clean":"2024-09-12T00:35:49.510167+0000","last_became_active":"2024-09-12T00:02:01.153090+0000","last_became_peered":"2024-09-12T00:02:01.153090+0000","last_unstale":"2024-09-12T00:35:49.510167+0000","last_undegraded":"2024-09-12T00:35:49.510167+0000","last_fullsized":"2024-09-12T00:35:49.510167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:13.705146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'316","reported_seq":889,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.457091+0000","last_change":"2024-09-12T00:02:03.153714+0000","last_active":"2024-09-12T00:37:23.457091+0000","last_peered":"2024-09-12T00:37:23.457091+0000","last_clean":"2024-09-12T00:37:23.457091+0000","last_became_active":"2024-09-12T00:02:03.153386+0000","last_became_peered":"2024-09-12T00:02:03.153386+0000","last_unstale":"2024-09-12T00:37:23.457091+0000","last_undegraded":"2024-09-12T00:37:23.457091+0000","last_fullsized":"2024-09-12T00:37:23.457091+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:33.982115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65188,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":520,"num_read_kb":1069,"num_write":432,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'777","reported_seq":2231,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.959436+0000","last_change":"2024-09-12T00:02:05.166163+0000","last_active":"2024-09-12T00:38:28.959436+0000","last_peered":"2024-09-12T00:38:28.959436+0000","last_clean":"2024-09-12T00:38:28.959436+0000","last_became_active":"2024-09-12T00:02:05.165892+0000","last_became_peered":"2024-09-12T00:02:05.165892+0000","last_unstale":"2024-09-12T00:38:28.959436+0000","last_undegraded":"2024-09-12T00:38:28.959436+0000","last_fullsized":"2024-09-12T00:38:28.959436+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:29.616858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'87","reported_seq":561,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.556657+0000","last_change":"2024-09-12T00:02:07.169522+0000","last_active":"2024-09-12T00:38:27.556657+0000","last_peered":"2024-09-12T00:38:27.556657+0000","last_clean":"2024-09-12T00:38:27.556657+0000","last_became_active":"2024-09-12T00:02:07.169216+0000","last_became_peered":"2024-09-12T00:02:07.169216+0000","last_unstale":"2024-09-12T00:38:27.556657+0000","last_undegraded":"2024-09-12T00:38:27.556657+0000","last_fullsized":"2024-09-12T00:38:27.556657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:40.757968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":199,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'131","reported_seq":707,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.791148+0000","last_change":"2024-09-12T00:01:59.153212+0000","last_active":"2024-09-12T00:37:01.791148+0000","last_peered":"2024-09-12T00:37:01.791148+0000","last_clean":"2024-09-12T00:37:01.791148+0000","last_became_active":"2024-09-12T00:01:59.152836+0000","last_became_peered":"2024-09-12T00:01:59.152836+0000","last_unstale":"2024-09-12T00:37:01.791148+0000","last_undegraded":"2024-09-12T00:37:01.791148+0000","last_fullsized":"2024-09-12T00:37:01.791148+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:52.164308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":483,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'271","reported_seq":908,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.009854+0000","last_change":"2024-09-12T00:01:57.143503+0000","last_active":"2024-09-12T00:37:08.009854+0000","last_peered":"2024-09-12T00:37:08.009854+0000","last_clean":"2024-09-12T00:37:08.009854+0000","last_became_active":"2024-09-12T00:01:57.143137+0000","last_became_peered":"2024-09-12T00:01:57.143137+0000","last_unstale":"2024-09-12T00:37:08.009854+0000","last_undegraded":"2024-09-12T00:37:08.009854+0000","last_fullsized":"2024-09-12T00:37:08.009854+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:29.714719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":958448,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":471,"num_read_kb":8103,"num_write":1014,"num_write_kb":32276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:39.499399+0000","last_change":"2024-09-12T00:02:01.144552+0000","last_active":"2024-09-12T00:34:39.499399+0000","last_peered":"2024-09-12T00:34:39.499399+0000","last_clean":"2024-09-12T00:34:39.499399+0000","last_became_active":"2024-09-12T00:02:01.144199+0000","last_became_peered":"2024-09-12T00:02:01.144199+0000","last_unstale":"2024-09-12T00:34:39.499399+0000","last_undegraded":"2024-09-12T00:34:39.499399+0000","last_fullsized":"2024-09-12T00:34:39.499399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:06.942666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'487","reported_seq":1119,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.934906+0000","last_change":"2024-09-12T00:02:03.155884+0000","last_active":"2024-09-12T00:38:36.934906+0000","last_peered":"2024-09-12T00:38:36.934906+0000","last_clean":"2024-09-12T00:38:36.934906+0000","last_became_active":"2024-09-12T00:02:03.155625+0000","last_became_peered":"2024-09-12T00:02:03.155625+0000","last_unstale":"2024-09-12T00:38:36.934906+0000","last_undegraded":"2024-09-12T00:38:36.934906+0000","last_fullsized":"2024-09-12T00:38:36.934906+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:38.186042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104418,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":868,"num_read_kb":2109,"num_write":716,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499199+0000","last_change":"2024-09-12T00:02:05.169143+0000","last_active":"2024-09-12T00:34:34.499199+0000","last_peered":"2024-09-12T00:34:34.499199+0000","last_clean":"2024-09-12T00:34:34.499199+0000","last_became_active":"2024-09-12T00:02:05.168816+0000","last_became_peered":"2024-09-12T00:02:05.168816+0000","last_unstale":"2024-09-12T00:34:34.499199+0000","last_undegraded":"2024-09-12T00:34:34.499199+0000","last_fullsized":"2024-09-12T00:34:34.499199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:06.783756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'158","reported_seq":651,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.701085+0000","last_change":"2024-09-12T00:02:07.172017+0000","last_active":"2024-09-12T00:37:07.701085+0000","last_peered":"2024-09-12T00:37:07.701085+0000","last_clean":"2024-09-12T00:37:07.701085+0000","last_became_active":"2024-09-12T00:02:07.171762+0000","last_became_peered":"2024-09-12T00:02:07.171762+0000","last_unstale":"2024-09-12T00:37:07.701085+0000","last_undegraded":"2024-09-12T00:37:07.701085+0000","last_fullsized":"2024-09-12T00:37:07.701085+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:23.109250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":181,"num_read_kb":171,"num_write":367,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'250","reported_seq":889,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.771797+0000","last_change":"2024-09-12T00:01:59.148026+0000","last_active":"2024-09-12T00:37:10.771797+0000","last_peered":"2024-09-12T00:37:10.771797+0000","last_clean":"2024-09-12T00:37:10.771797+0000","last_became_active":"2024-09-12T00:01:59.147762+0000","last_became_peered":"2024-09-12T00:01:59.147762+0000","last_unstale":"2024-09-12T00:37:10.771797+0000","last_undegraded":"2024-09-12T00:37:10.771797+0000","last_fullsized":"2024-09-12T00:37:10.771797+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:56.095727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1058,"num_read_kb":865,"num_write":369,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'254","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:06.955645+0000","last_change":"2024-09-12T00:01:57.140135+0000","last_active":"2024-09-12T00:36:06.955645+0000","last_peered":"2024-09-12T00:36:06.955645+0000","last_clean":"2024-09-12T00:36:06.955645+0000","last_became_active":"2024-09-12T00:01:57.139677+0000","last_became_peered":"2024-09-12T00:01:57.139677+0000","last_unstale":"2024-09-12T00:36:06.955645+0000","last_undegraded":"2024-09-12T00:36:06.955645+0000","last_fullsized":"2024-09-12T00:36:06.955645+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:12.642146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11620117,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":384,"num_read_kb":3669,"num_write":999,"num_write_kb":17146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510008+0000","last_change":"2024-09-12T00:02:01.151052+0000","last_active":"2024-09-12T00:35:49.510008+0000","last_peered":"2024-09-12T00:35:49.510008+0000","last_clean":"2024-09-12T00:35:49.510008+0000","last_became_active":"2024-09-12T00:02:01.150796+0000","last_became_peered":"2024-09-12T00:02:01.150796+0000","last_unstale":"2024-09-12T00:35:49.510008+0000","last_undegraded":"2024-09-12T00:35:49.510008+0000","last_fullsized":"2024-09-12T00:35:49.510008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:30.994773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'271","reported_seq":831,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.908210+0000","last_change":"2024-09-12T00:02:03.153772+0000","last_active":"2024-09-12T00:38:28.908210+0000","last_peered":"2024-09-12T00:38:28.908210+0000","last_clean":"2024-09-12T00:38:28.908210+0000","last_became_active":"2024-09-12T00:02:03.153447+0000","last_became_peered":"2024-09-12T00:02:03.153447+0000","last_unstale":"2024-09-12T00:38:28.908210+0000","last_undegraded":"2024-09-12T00:38:28.908210+0000","last_fullsized":"2024-09-12T00:38:28.908210+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:52.487542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52403,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":456,"num_read_kb":904,"num_write":414,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":471,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.510853+0000","last_change":"2024-09-12T00:02:05.163959+0000","last_active":"2024-09-12T00:35:54.510853+0000","last_peered":"2024-09-12T00:35:54.510853+0000","last_clean":"2024-09-12T00:35:54.510853+0000","last_became_active":"2024-09-12T00:02:05.163689+0000","last_became_peered":"2024-09-12T00:02:05.163689+0000","last_unstale":"2024-09-12T00:35:54.510853+0000","last_undegraded":"2024-09-12T00:35:54.510853+0000","last_fullsized":"2024-09-12T00:35:54.510853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:14.624849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'128","reported_seq":610,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:14.529969+0000","last_change":"2024-09-12T00:02:07.172273+0000","last_active":"2024-09-12T00:38:14.529969+0000","last_peered":"2024-09-12T00:38:14.529969+0000","last_clean":"2024-09-12T00:38:14.529969+0000","last_became_active":"2024-09-12T00:02:07.171942+0000","last_became_peered":"2024-09-12T00:02:07.171942+0000","last_unstale":"2024-09-12T00:38:14.529969+0000","last_undegraded":"2024-09-12T00:38:14.529969+0000","last_fullsized":"2024-09-12T00:38:14.529969+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:54.534357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'138","reported_seq":727,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.949864+0000","last_change":"2024-09-12T00:01:59.150356+0000","last_active":"2024-09-12T00:36:59.949864+0000","last_peered":"2024-09-12T00:36:59.949864+0000","last_clean":"2024-09-12T00:36:59.949864+0000","last_became_active":"2024-09-12T00:01:59.148534+0000","last_became_peered":"2024-09-12T00:01:59.148534+0000","last_unstale":"2024-09-12T00:36:59.949864+0000","last_undegraded":"2024-09-12T00:36:59.949864+0000","last_fullsized":"2024-09-12T00:36:59.949864+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:28.691183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":510,"num_write":211,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'303","reported_seq":944,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.857744+0000","last_change":"2024-09-12T00:01:57.167545+0000","last_active":"2024-09-12T00:37:09.857744+0000","last_peered":"2024-09-12T00:37:09.857744+0000","last_clean":"2024-09-12T00:37:09.857744+0000","last_became_active":"2024-09-12T00:01:57.165226+0000","last_became_peered":"2024-09-12T00:01:57.165226+0000","last_unstale":"2024-09-12T00:37:09.857744+0000","last_undegraded":"2024-09-12T00:37:09.857744+0000","last_fullsized":"2024-09-12T00:37:09.857744+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:33.371625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6032007,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":517,"num_read_kb":11178,"num_write":1159,"num_write_kb":42398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510231+0000","last_change":"2024-09-12T00:02:01.154098+0000","last_active":"2024-09-12T00:35:49.510231+0000","last_peered":"2024-09-12T00:35:49.510231+0000","last_clean":"2024-09-12T00:35:49.510231+0000","last_became_active":"2024-09-12T00:02:01.153818+0000","last_became_peered":"2024-09-12T00:02:01.153818+0000","last_unstale":"2024-09-12T00:35:49.510231+0000","last_undegraded":"2024-09-12T00:35:49.510231+0000","last_fullsized":"2024-09-12T00:35:49.510231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:57.741932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'287","reported_seq":846,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:09.529359+0000","last_change":"2024-09-12T00:02:03.152712+0000","last_active":"2024-09-12T00:38:09.529359+0000","last_peered":"2024-09-12T00:38:09.529359+0000","last_clean":"2024-09-12T00:38:09.529359+0000","last_became_active":"2024-09-12T00:02:03.152421+0000","last_became_peered":"2024-09-12T00:02:03.152421+0000","last_unstale":"2024-09-12T00:38:09.529359+0000","last_undegraded":"2024-09-12T00:38:09.529359+0000","last_fullsized":"2024-09-12T00:38:09.529359+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:06.190143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61953,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":1004,"num_write":396,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'757","reported_seq":2114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.955130+0000","last_change":"2024-09-12T00:02:05.164910+0000","last_active":"2024-09-12T00:38:28.955130+0000","last_peered":"2024-09-12T00:38:28.955130+0000","last_clean":"2024-09-12T00:38:28.955130+0000","last_became_active":"2024-09-12T00:02:05.164655+0000","last_became_peered":"2024-09-12T00:02:05.164655+0000","last_unstale":"2024-09-12T00:38:28.955130+0000","last_undegraded":"2024-09-12T00:38:28.955130+0000","last_fullsized":"2024-09-12T00:38:28.955130+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:28.772936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'95","reported_seq":570,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:00.719827+0000","last_change":"2024-09-12T00:02:07.165060+0000","last_active":"2024-09-12T00:37:00.719827+0000","last_peered":"2024-09-12T00:37:00.719827+0000","last_clean":"2024-09-12T00:37:00.719827+0000","last_became_active":"2024-09-12T00:02:07.164754+0000","last_became_peered":"2024-09-12T00:02:07.164754+0000","last_unstale":"2024-09-12T00:37:00.719827+0000","last_undegraded":"2024-09-12T00:37:00.719827+0000","last_fullsized":"2024-09-12T00:37:00.719827+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:35.892955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":233,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'85","reported_seq":639,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:21.919959+0000","last_change":"2024-09-12T00:01:59.157814+0000","last_active":"2024-09-12T00:36:21.919959+0000","last_peered":"2024-09-12T00:36:21.919959+0000","last_clean":"2024-09-12T00:36:21.919959+0000","last_became_active":"2024-09-12T00:01:59.157172+0000","last_became_peered":"2024-09-12T00:01:59.157172+0000","last_unstale":"2024-09-12T00:36:21.919959+0000","last_undegraded":"2024-09-12T00:36:21.919959+0000","last_fullsized":"2024-09-12T00:36:21.919959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:05.814891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":384,"num_read_kb":356,"num_write":138,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'315","reported_seq":965,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:19.008345+0000","last_change":"2024-09-12T00:01:57.146086+0000","last_active":"2024-09-12T00:38:19.008345+0000","last_peered":"2024-09-12T00:38:19.008345+0000","last_clean":"2024-09-12T00:38:19.008345+0000","last_became_active":"2024-09-12T00:01:57.145710+0000","last_became_peered":"2024-09-12T00:01:57.145710+0000","last_unstale":"2024-09-12T00:38:19.008345+0000","last_undegraded":"2024-09-12T00:38:19.008345+0000","last_fullsized":"2024-09-12T00:38:19.008345+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:34.573066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7008783,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":520,"num_read_kb":20016,"num_write":1232,"num_write_kb":22247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":1920,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.884434+0000","last_change":"2024-09-12T00:02:01.144164+0000","last_active":"2024-09-12T00:38:35.884434+0000","last_peered":"2024-09-12T00:38:35.884434+0000","last_clean":"2024-09-12T00:38:35.884434+0000","last_became_active":"2024-09-12T00:02:01.143823+0000","last_became_peered":"2024-09-12T00:02:01.143823+0000","last_unstale":"2024-09-12T00:38:35.884434+0000","last_undegraded":"2024-09-12T00:38:35.884434+0000","last_fullsized":"2024-09-12T00:38:35.884434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:46.468299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1676,"num_read_kb":1674,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'65","reported_seq":563,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:26.578538+0000","last_change":"2024-09-12T00:02:03.157279+0000","last_active":"2024-09-12T00:36:26.578538+0000","last_peered":"2024-09-12T00:36:26.578538+0000","last_clean":"2024-09-12T00:36:26.578538+0000","last_became_active":"2024-09-12T00:02:03.156680+0000","last_became_peered":"2024-09-12T00:02:03.156680+0000","last_unstale":"2024-09-12T00:36:26.578538+0000","last_undegraded":"2024-09-12T00:36:26.578538+0000","last_fullsized":"2024-09-12T00:36:26.578538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:51.959162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'774","reported_seq":2288,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.892384+0000","last_change":"2024-09-12T00:02:05.164449+0000","last_active":"2024-09-12T00:38:35.892384+0000","last_peered":"2024-09-12T00:38:35.892384+0000","last_clean":"2024-09-12T00:38:35.892384+0000","last_became_active":"2024-09-12T00:02:05.163596+0000","last_became_peered":"2024-09-12T00:02:05.163596+0000","last_unstale":"2024-09-12T00:38:35.892384+0000","last_undegraded":"2024-09-12T00:38:35.892384+0000","last_fullsized":"2024-09-12T00:38:35.892384+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:09.031568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'118","reported_seq":600,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.085766+0000","last_change":"2024-09-12T00:02:07.169460+0000","last_active":"2024-09-12T00:37:22.085766+0000","last_peered":"2024-09-12T00:37:22.085766+0000","last_clean":"2024-09-12T00:37:22.085766+0000","last_became_active":"2024-09-12T00:02:07.169160+0000","last_became_peered":"2024-09-12T00:02:07.169160+0000","last_unstale":"2024-09-12T00:37:22.085766+0000","last_undegraded":"2024-09-12T00:37:22.085766+0000","last_fullsized":"2024-09-12T00:37:22.085766+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:26.962721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":119,"num_write":276,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'226","reported_seq":785,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.164666+0000","last_change":"2024-09-12T00:01:59.152409+0000","last_active":"2024-09-12T00:37:07.164666+0000","last_peered":"2024-09-12T00:37:07.164666+0000","last_clean":"2024-09-12T00:37:07.164666+0000","last_became_active":"2024-09-12T00:01:59.152145+0000","last_became_peered":"2024-09-12T00:01:59.152145+0000","last_unstale":"2024-09-12T00:37:07.164666+0000","last_undegraded":"2024-09-12T00:37:07.164666+0000","last_fullsized":"2024-09-12T00:37:07.164666+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:24.656234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":744,"num_write":332,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'381","reported_seq":1086,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.378930+0000","last_change":"2024-09-12T00:01:57.141659+0000","last_active":"2024-09-12T00:38:37.378930+0000","last_peered":"2024-09-12T00:38:37.378930+0000","last_clean":"2024-09-12T00:38:37.378930+0000","last_became_active":"2024-09-12T00:01:57.140715+0000","last_became_peered":"2024-09-12T00:01:57.140715+0000","last_unstale":"2024-09-12T00:38:37.378930+0000","last_undegraded":"2024-09-12T00:38:37.378930+0000","last_fullsized":"2024-09-12T00:38:37.378930+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:50.244966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":346,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":671,"num_read_kb":94303,"num_write":1256,"num_write_kb":32809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.392478+0000","last_change":"2024-09-12T00:02:01.153751+0000","last_active":"2024-09-12T00:35:49.392478+0000","last_peered":"2024-09-12T00:35:49.392478+0000","last_clean":"2024-09-12T00:35:49.392478+0000","last_became_active":"2024-09-12T00:02:01.153347+0000","last_became_peered":"2024-09-12T00:02:01.153347+0000","last_unstale":"2024-09-12T00:35:49.392478+0000","last_undegraded":"2024-09-12T00:35:49.392478+0000","last_fullsized":"2024-09-12T00:35:49.392478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:05.059094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'312","reported_seq":894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.923474+0000","last_change":"2024-09-12T00:02:03.155029+0000","last_active":"2024-09-12T00:38:28.923474+0000","last_peered":"2024-09-12T00:38:28.923474+0000","last_clean":"2024-09-12T00:38:28.923474+0000","last_became_active":"2024-09-12T00:02:03.154752+0000","last_became_peered":"2024-09-12T00:02:03.154752+0000","last_unstale":"2024-09-12T00:38:28.923474+0000","last_undegraded":"2024-09-12T00:38:28.923474+0000","last_fullsized":"2024-09-12T00:38:28.923474+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:16.822889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56942,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":509,"num_read_kb":981,"num_write":406,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627588+0000","last_change":"2024-09-12T00:02:05.164441+0000","last_active":"2024-09-12T00:35:49.627588+0000","last_peered":"2024-09-12T00:35:49.627588+0000","last_clean":"2024-09-12T00:35:49.627588+0000","last_became_active":"2024-09-12T00:02:05.164108+0000","last_became_peered":"2024-09-12T00:02:05.164108+0000","last_unstale":"2024-09-12T00:35:49.627588+0000","last_undegraded":"2024-09-12T00:35:49.627588+0000","last_fullsized":"2024-09-12T00:35:49.627588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:12.635310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'159","reported_seq":633,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.847980+0000","last_change":"2024-09-12T00:02:07.169610+0000","last_active":"2024-09-12T00:36:52.847980+0000","last_peered":"2024-09-12T00:36:52.847980+0000","last_clean":"2024-09-12T00:36:52.847980+0000","last_became_active":"2024-09-12T00:02:07.169351+0000","last_became_peered":"2024-09-12T00:02:07.169351+0000","last_unstale":"2024-09-12T00:36:52.847980+0000","last_undegraded":"2024-09-12T00:36:52.847980+0000","last_fullsized":"2024-09-12T00:36:52.847980+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:28.308716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":164,"num_write":397,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'164","reported_seq":768,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:26.283270+0000","last_change":"2024-09-12T00:01:59.151096+0000","last_active":"2024-09-12T00:36:26.283270+0000","last_peered":"2024-09-12T00:36:26.283270+0000","last_clean":"2024-09-12T00:36:26.283270+0000","last_became_active":"2024-09-12T00:01:59.150072+0000","last_became_peered":"2024-09-12T00:01:59.150072+0000","last_unstale":"2024-09-12T00:36:26.283270+0000","last_undegraded":"2024-09-12T00:36:26.283270+0000","last_fullsized":"2024-09-12T00:36:26.283270+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:28.419527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":763,"num_read_kb":636,"num_write":273,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":605,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:46.508442+0000","last_change":"2024-09-12T00:01:39.721517+0000","last_active":"2024-09-12T00:35:46.508442+0000","last_peered":"2024-09-12T00:35:46.508442+0000","last_clean":"2024-09-12T00:35:46.508442+0000","last_became_active":"2024-09-12T00:01:39.720425+0000","last_became_peered":"2024-09-12T00:01:39.720425+0000","last_unstale":"2024-09-12T00:35:46.508442+0000","last_undegraded":"2024-09-12T00:35:46.508442+0000","last_fullsized":"2024-09-12T00:35:46.508442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:37.438834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:37.438834+0000","last_clean_scrub_stamp":"2024-09-12T00:01:37.438834+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:26.565085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":512,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.386954+0000","last_change":"2024-09-12T00:01:48.515868+0000","last_active":"2024-09-12T00:35:09.386954+0000","last_peered":"2024-09-12T00:35:09.386954+0000","last_clean":"2024-09-12T00:35:09.386954+0000","last_became_active":"2024-09-12T00:01:46.613916+0000","last_became_peered":"2024-09-12T00:01:46.613916+0000","last_unstale":"2024-09-12T00:35:09.386954+0000","last_undegraded":"2024-09-12T00:35:09.386954+0000","last_fullsized":"2024-09-12T00:35:09.386954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:23.127685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014566500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'350","reported_seq":1043,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.483073+0000","last_change":"2024-09-12T00:01:57.141951+0000","last_active":"2024-09-12T00:38:37.483073+0000","last_peered":"2024-09-12T00:38:37.483073+0000","last_clean":"2024-09-12T00:38:37.483073+0000","last_became_active":"2024-09-12T00:01:57.141553+0000","last_became_peered":"2024-09-12T00:01:57.141553+0000","last_unstale":"2024-09-12T00:38:37.483073+0000","last_undegraded":"2024-09-12T00:38:37.483073+0000","last_fullsized":"2024-09-12T00:38:37.483073+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:47.205119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11861347,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":681,"num_read_kb":51086,"num_write":1018,"num_write_kb":49735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.387995+0000","last_change":"2024-09-12T00:02:01.148969+0000","last_active":"2024-09-12T00:35:24.387995+0000","last_peered":"2024-09-12T00:35:24.387995+0000","last_clean":"2024-09-12T00:35:24.387995+0000","last_became_active":"2024-09-12T00:02:01.148696+0000","last_became_peered":"2024-09-12T00:02:01.148696+0000","last_unstale":"2024-09-12T00:35:24.387995+0000","last_undegraded":"2024-09-12T00:35:24.387995+0000","last_fullsized":"2024-09-12T00:35:24.387995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:28.294552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'675","reported_seq":1354,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.925680+0000","last_change":"2024-09-12T00:02:03.150355+0000","last_active":"2024-09-12T00:38:28.925680+0000","last_peered":"2024-09-12T00:38:28.925680+0000","last_clean":"2024-09-12T00:38:28.925680+0000","last_became_active":"2024-09-12T00:02:03.150075+0000","last_became_peered":"2024-09-12T00:02:03.150075+0000","last_unstale":"2024-09-12T00:38:28.925680+0000","last_undegraded":"2024-09-12T00:38:28.925680+0000","last_fullsized":"2024-09-12T00:38:28.925680+0000","mapping_epoch":30,"log_start":"261'600","ondisk_log_start":"261'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":600,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:08.116055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158560,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1315,"num_read_kb":2733,"num_write":1224,"num_write_kb":1081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499342+0000","last_change":"2024-09-12T00:02:05.162858+0000","last_active":"2024-09-12T00:34:34.499342+0000","last_peered":"2024-09-12T00:34:34.499342+0000","last_clean":"2024-09-12T00:34:34.499342+0000","last_became_active":"2024-09-12T00:02:05.162455+0000","last_became_peered":"2024-09-12T00:02:05.162455+0000","last_unstale":"2024-09-12T00:34:34.499342+0000","last_undegraded":"2024-09-12T00:34:34.499342+0000","last_fullsized":"2024-09-12T00:34:34.499342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.590391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'258","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.461047+0000","last_change":"2024-09-12T00:02:07.168139+0000","last_active":"2024-09-12T00:37:23.461047+0000","last_peered":"2024-09-12T00:37:23.461047+0000","last_clean":"2024-09-12T00:37:23.461047+0000","last_became_active":"2024-09-12T00:02:07.167844+0000","last_became_peered":"2024-09-12T00:02:07.167844+0000","last_unstale":"2024-09-12T00:37:23.461047+0000","last_undegraded":"2024-09-12T00:37:23.461047+0000","last_fullsized":"2024-09-12T00:37:23.461047+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:00.761039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":469,"num_read_kb":454,"num_write":531,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'172","reported_seq":761,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:10.423640+0000","last_change":"2024-09-12T00:01:59.149437+0000","last_active":"2024-09-12T00:36:10.423640+0000","last_peered":"2024-09-12T00:36:10.423640+0000","last_clean":"2024-09-12T00:36:10.423640+0000","last_became_active":"2024-09-12T00:01:59.149145+0000","last_became_peered":"2024-09-12T00:01:59.149145+0000","last_unstale":"2024-09-12T00:36:10.423640+0000","last_undegraded":"2024-09-12T00:36:10.423640+0000","last_fullsized":"2024-09-12T00:36:10.423640+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:31.451704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":604,"num_write":249,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.393043+0000","last_change":"2024-09-12T00:01:48.515091+0000","last_active":"2024-09-12T00:35:54.393043+0000","last_peered":"2024-09-12T00:35:54.393043+0000","last_clean":"2024-09-12T00:35:54.393043+0000","last_became_active":"2024-09-12T00:01:46.505677+0000","last_became_peered":"2024-09-12T00:01:46.505677+0000","last_unstale":"2024-09-12T00:35:54.393043+0000","last_undegraded":"2024-09-12T00:35:54.393043+0000","last_fullsized":"2024-09-12T00:35:54.393043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:07.430053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075102999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'264","reported_seq":882,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:28.001470+0000","last_change":"2024-09-12T00:01:57.152548+0000","last_active":"2024-09-12T00:36:28.001470+0000","last_peered":"2024-09-12T00:36:28.001470+0000","last_clean":"2024-09-12T00:36:28.001470+0000","last_became_active":"2024-09-12T00:01:57.152153+0000","last_became_peered":"2024-09-12T00:01:57.152153+0000","last_unstale":"2024-09-12T00:36:28.001470+0000","last_undegraded":"2024-09-12T00:36:28.001470+0000","last_fullsized":"2024-09-12T00:36:28.001470+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:18.135861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506847,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":438,"num_read_kb":31134,"num_write":931,"num_write_kb":29868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.382185+0000","last_change":"2024-09-12T00:02:01.153210+0000","last_active":"2024-09-12T00:34:34.382185+0000","last_peered":"2024-09-12T00:34:34.382185+0000","last_clean":"2024-09-12T00:34:34.382185+0000","last_became_active":"2024-09-12T00:02:01.152904+0000","last_became_peered":"2024-09-12T00:02:01.152904+0000","last_unstale":"2024-09-12T00:34:34.382185+0000","last_undegraded":"2024-09-12T00:34:34.382185+0000","last_fullsized":"2024-09-12T00:34:34.382185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:50.681148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1195","reported_seq":2538,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.950946+0000","last_change":"2024-09-12T00:02:03.153993+0000","last_active":"2024-09-12T00:38:28.950946+0000","last_peered":"2024-09-12T00:38:28.950946+0000","last_clean":"2024-09-12T00:38:28.950946+0000","last_became_active":"2024-09-12T00:02:03.153702+0000","last_became_peered":"2024-09-12T00:02:03.153702+0000","last_unstale":"2024-09-12T00:38:28.950946+0000","last_undegraded":"2024-09-12T00:38:28.950946+0000","last_fullsized":"2024-09-12T00:38:28.950946+0000","mapping_epoch":30,"log_start":"261'1100","ondisk_log_start":"261'1100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":1100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.693992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153682,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1878,"num_read_kb":3200,"num_write":996,"num_write_kb":845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:29.389647+0000","last_change":"2024-09-12T00:02:05.172331+0000","last_active":"2024-09-12T00:35:29.389647+0000","last_peered":"2024-09-12T00:35:29.389647+0000","last_clean":"2024-09-12T00:35:29.389647+0000","last_became_active":"2024-09-12T00:02:05.171787+0000","last_became_peered":"2024-09-12T00:02:05.171787+0000","last_unstale":"2024-09-12T00:35:29.389647+0000","last_undegraded":"2024-09-12T00:35:29.389647+0000","last_fullsized":"2024-09-12T00:35:29.389647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:38.114555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'217","reported_seq":737,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.191898+0000","last_change":"2024-09-12T00:02:07.169700+0000","last_active":"2024-09-12T00:36:56.191898+0000","last_peered":"2024-09-12T00:36:56.191898+0000","last_clean":"2024-09-12T00:36:56.191898+0000","last_became_active":"2024-09-12T00:02:07.169173+0000","last_became_peered":"2024-09-12T00:02:07.169173+0000","last_unstale":"2024-09-12T00:36:56.191898+0000","last_undegraded":"2024-09-12T00:36:56.191898+0000","last_fullsized":"2024-09-12T00:36:56.191898+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:07.710548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":374,"num_read_kb":362,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'88","reported_seq":639,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:20.939776+0000","last_change":"2024-09-12T00:01:59.139141+0000","last_active":"2024-09-12T00:37:20.939776+0000","last_peered":"2024-09-12T00:37:20.939776+0000","last_clean":"2024-09-12T00:37:20.939776+0000","last_became_active":"2024-09-12T00:01:59.138731+0000","last_became_peered":"2024-09-12T00:01:59.138731+0000","last_unstale":"2024-09-12T00:37:20.939776+0000","last_undegraded":"2024-09-12T00:37:20.939776+0000","last_fullsized":"2024-09-12T00:37:20.939776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:31.598716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":368,"num_read_kb":306,"num_write":121,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":503,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.503944+0000","last_change":"2024-09-12T00:01:50.044924+0000","last_active":"2024-09-12T00:35:09.503944+0000","last_peered":"2024-09-12T00:35:09.503944+0000","last_clean":"2024-09-12T00:35:09.503944+0000","last_became_active":"2024-09-12T00:01:46.505857+0000","last_became_peered":"2024-09-12T00:01:46.505857+0000","last_unstale":"2024-09-12T00:35:09.503944+0000","last_undegraded":"2024-09-12T00:35:09.503944+0000","last_fullsized":"2024-09-12T00:35:09.503944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:18.728534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039331300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'267","reported_seq":872,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.360496+0000","last_change":"2024-09-12T00:01:57.154563+0000","last_active":"2024-09-12T00:37:08.360496+0000","last_peered":"2024-09-12T00:37:08.360496+0000","last_clean":"2024-09-12T00:37:08.360496+0000","last_became_active":"2024-09-12T00:01:57.151644+0000","last_became_peered":"2024-09-12T00:01:57.151644+0000","last_unstale":"2024-09-12T00:37:08.360496+0000","last_undegraded":"2024-09-12T00:37:08.360496+0000","last_fullsized":"2024-09-12T00:37:08.360496+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:39.639241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11935188,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":393,"num_read_kb":2373,"num_write":1049,"num_write_kb":41035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498978+0000","last_change":"2024-09-12T00:02:01.151980+0000","last_active":"2024-09-12T00:34:34.498978+0000","last_peered":"2024-09-12T00:34:34.498978+0000","last_clean":"2024-09-12T00:34:34.498978+0000","last_became_active":"2024-09-12T00:02:01.151474+0000","last_became_peered":"2024-09-12T00:02:01.151474+0000","last_unstale":"2024-09-12T00:34:34.498978+0000","last_undegraded":"2024-09-12T00:34:34.498978+0000","last_fullsized":"2024-09-12T00:34:34.498978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:15.387013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'208","reported_seq":1181,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:25.299127+0000","last_change":"2024-09-12T00:02:03.155847+0000","last_active":"2024-09-12T00:38:25.299127+0000","last_peered":"2024-09-12T00:38:25.299127+0000","last_clean":"2024-09-12T00:38:25.299127+0000","last_became_active":"2024-09-12T00:02:03.155311+0000","last_became_peered":"2024-09-12T00:02:03.155311+0000","last_unstale":"2024-09-12T00:38:25.299127+0000","last_undegraded":"2024-09-12T00:38:25.299127+0000","last_fullsized":"2024-09-12T00:38:25.299127+0000","mapping_epoch":30,"log_start":"258'100","ondisk_log_start":"258'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:37.168360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":119,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:27.509399+0000","last_change":"2024-09-12T00:02:05.168343+0000","last_active":"2024-09-12T00:35:27.509399+0000","last_peered":"2024-09-12T00:35:27.509399+0000","last_clean":"2024-09-12T00:35:27.509399+0000","last_became_active":"2024-09-12T00:02:05.167874+0000","last_became_peered":"2024-09-12T00:02:05.167874+0000","last_unstale":"2024-09-12T00:35:27.509399+0000","last_undegraded":"2024-09-12T00:35:27.509399+0000","last_fullsized":"2024-09-12T00:35:27.509399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:12.012160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'262","reported_seq":856,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.604136+0000","last_change":"2024-09-12T00:02:07.162130+0000","last_active":"2024-09-12T00:37:23.604136+0000","last_peered":"2024-09-12T00:37:23.604136+0000","last_clean":"2024-09-12T00:37:23.604136+0000","last_became_active":"2024-09-12T00:02:07.161814+0000","last_became_peered":"2024-09-12T00:02:07.161814+0000","last_unstale":"2024-09-12T00:37:23.604136+0000","last_undegraded":"2024-09-12T00:37:23.604136+0000","last_fullsized":"2024-09-12T00:37:23.604136+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:02.767585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":499,"num_read_kb":517,"num_write":567,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'135","reported_seq":711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.489664+0000","last_change":"2024-09-12T00:01:59.153823+0000","last_active":"2024-09-12T00:37:10.489664+0000","last_peered":"2024-09-12T00:37:10.489664+0000","last_clean":"2024-09-12T00:37:10.489664+0000","last_became_active":"2024-09-12T00:01:59.153542+0000","last_became_peered":"2024-09-12T00:01:59.153542+0000","last_unstale":"2024-09-12T00:37:10.489664+0000","last_undegraded":"2024-09-12T00:37:10.489664+0000","last_fullsized":"2024-09-12T00:37:10.489664+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:16.930267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":619,"num_read_kb":513,"num_write":207,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":513,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.386923+0000","last_change":"2024-09-12T00:01:48.515810+0000","last_active":"2024-09-12T00:35:09.386923+0000","last_peered":"2024-09-12T00:35:09.386923+0000","last_clean":"2024-09-12T00:35:09.386923+0000","last_became_active":"2024-09-12T00:01:46.502428+0000","last_became_peered":"2024-09-12T00:01:46.502428+0000","last_unstale":"2024-09-12T00:35:09.386923+0000","last_undegraded":"2024-09-12T00:35:09.386923+0000","last_fullsized":"2024-09-12T00:35:09.386923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:13.947790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001414925,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'274","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:24.402749+0000","last_change":"2024-09-12T00:01:57.156552+0000","last_active":"2024-09-12T00:37:24.402749+0000","last_peered":"2024-09-12T00:37:24.402749+0000","last_clean":"2024-09-12T00:37:24.402749+0000","last_became_active":"2024-09-12T00:01:57.156172+0000","last_became_peered":"2024-09-12T00:01:57.156172+0000","last_unstale":"2024-09-12T00:37:24.402749+0000","last_undegraded":"2024-09-12T00:37:24.402749+0000","last_fullsized":"2024-09-12T00:37:24.402749+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:22.222372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8151797,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":384,"num_read_kb":22094,"num_write":1036,"num_write_kb":41486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:29.506844+0000","last_change":"2024-09-12T00:02:01.153018+0000","last_active":"2024-09-12T00:35:29.506844+0000","last_peered":"2024-09-12T00:35:29.506844+0000","last_clean":"2024-09-12T00:35:29.506844+0000","last_became_active":"2024-09-12T00:02:01.152752+0000","last_became_peered":"2024-09-12T00:02:01.152752+0000","last_unstale":"2024-09-12T00:35:29.506844+0000","last_undegraded":"2024-09-12T00:35:29.506844+0000","last_fullsized":"2024-09-12T00:35:29.506844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:50.379948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'112","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.961118+0000","last_change":"2024-09-12T00:02:03.152362+0000","last_active":"2024-09-12T00:36:50.961118+0000","last_peered":"2024-09-12T00:36:50.961118+0000","last_clean":"2024-09-12T00:36:50.961118+0000","last_became_active":"2024-09-12T00:02:03.152008+0000","last_became_peered":"2024-09-12T00:02:03.152008+0000","last_unstale":"2024-09-12T00:36:50.961118+0000","last_undegraded":"2024-09-12T00:36:50.961118+0000","last_fullsized":"2024-09-12T00:36:50.961118+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:40.412153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":94,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.382152+0000","last_change":"2024-09-12T00:02:05.170927+0000","last_active":"2024-09-12T00:34:34.382152+0000","last_peered":"2024-09-12T00:34:34.382152+0000","last_clean":"2024-09-12T00:34:34.382152+0000","last_became_active":"2024-09-12T00:02:05.170487+0000","last_became_peered":"2024-09-12T00:02:05.170487+0000","last_unstale":"2024-09-12T00:34:34.382152+0000","last_undegraded":"2024-09-12T00:34:34.382152+0000","last_fullsized":"2024-09-12T00:34:34.382152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:15.416030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":662,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.519983+0000","last_change":"2024-09-12T00:02:07.169125+0000","last_active":"2024-09-12T00:36:52.519983+0000","last_peered":"2024-09-12T00:36:52.519983+0000","last_clean":"2024-09-12T00:36:52.519983+0000","last_became_active":"2024-09-12T00:02:07.168820+0000","last_became_peered":"2024-09-12T00:02:07.168820+0000","last_unstale":"2024-09-12T00:36:52.519983+0000","last_undegraded":"2024-09-12T00:36:52.519983+0000","last_fullsized":"2024-09-12T00:36:52.519983+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:54.542834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":226,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'300","reported_seq":884,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.965247+0000","last_change":"2024-09-12T00:01:59.145724+0000","last_active":"2024-09-12T00:37:07.965247+0000","last_peered":"2024-09-12T00:37:07.965247+0000","last_clean":"2024-09-12T00:37:07.965247+0000","last_became_active":"2024-09-12T00:01:59.145273+0000","last_became_peered":"2024-09-12T00:01:59.145273+0000","last_unstale":"2024-09-12T00:37:07.965247+0000","last_undegraded":"2024-09-12T00:37:07.965247+0000","last_fullsized":"2024-09-12T00:37:07.965247+0000","mapping_epoch":26,"log_start":"258'200","ondisk_log_start":"258'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:10.954485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1215,"num_write":550,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'308","reported_seq":1003,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.263089+0000","last_change":"2024-09-12T00:01:57.154791+0000","last_active":"2024-09-12T00:37:10.263089+0000","last_peered":"2024-09-12T00:37:10.263089+0000","last_clean":"2024-09-12T00:37:10.263089+0000","last_became_active":"2024-09-12T00:01:57.154387+0000","last_became_peered":"2024-09-12T00:01:57.154387+0000","last_unstale":"2024-09-12T00:37:10.263089+0000","last_undegraded":"2024-09-12T00:37:10.263089+0000","last_fullsized":"2024-09-12T00:37:10.263089+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:15.020141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11674169,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":571,"num_read_kb":122441,"num_write":1093,"num_write_kb":43815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":509,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.504322+0000","last_change":"2024-09-12T00:01:49.473468+0000","last_active":"2024-09-12T00:35:09.504322+0000","last_peered":"2024-09-12T00:35:09.504322+0000","last_clean":"2024-09-12T00:35:09.504322+0000","last_became_active":"2024-09-12T00:01:46.505954+0000","last_became_peered":"2024-09-12T00:01:46.505954+0000","last_unstale":"2024-09-12T00:35:09.504322+0000","last_undegraded":"2024-09-12T00:35:09.504322+0000","last_fullsized":"2024-09-12T00:35:09.504322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:03.543109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050498000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:22.508574+0000","last_change":"2024-09-12T00:02:01.149787+0000","last_active":"2024-09-12T00:35:22.508574+0000","last_peered":"2024-09-12T00:35:22.508574+0000","last_clean":"2024-09-12T00:35:22.508574+0000","last_became_active":"2024-09-12T00:02:01.149529+0000","last_became_peered":"2024-09-12T00:02:01.149529+0000","last_unstale":"2024-09-12T00:35:22.508574+0000","last_undegraded":"2024-09-12T00:35:22.508574+0000","last_fullsized":"2024-09-12T00:35:22.508574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:38.924972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'547","reported_seq":1188,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.916250+0000","last_change":"2024-09-12T00:02:03.152903+0000","last_active":"2024-09-12T00:38:28.916250+0000","last_peered":"2024-09-12T00:38:28.916250+0000","last_clean":"2024-09-12T00:38:28.916250+0000","last_became_active":"2024-09-12T00:02:03.152535+0000","last_became_peered":"2024-09-12T00:02:03.152535+0000","last_unstale":"2024-09-12T00:38:28.916250+0000","last_undegraded":"2024-09-12T00:38:28.916250+0000","last_fullsized":"2024-09-12T00:38:28.916250+0000","mapping_epoch":30,"log_start":"261'500","ondisk_log_start":"261'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:26.014665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106310,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1504,"num_read_kb":2448,"num_write":1940,"num_write_kb":1778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":471,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.623486+0000","last_change":"2024-09-12T00:02:05.168263+0000","last_active":"2024-09-12T00:35:24.623486+0000","last_peered":"2024-09-12T00:35:24.623486+0000","last_clean":"2024-09-12T00:35:24.623486+0000","last_became_active":"2024-09-12T00:02:05.167998+0000","last_became_peered":"2024-09-12T00:02:05.167998+0000","last_unstale":"2024-09-12T00:35:24.623486+0000","last_undegraded":"2024-09-12T00:35:24.623486+0000","last_fullsized":"2024-09-12T00:35:24.623486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:50.635765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'161","reported_seq":644,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.451268+0000","last_change":"2024-09-12T00:02:07.168288+0000","last_active":"2024-09-12T00:37:23.451268+0000","last_peered":"2024-09-12T00:37:23.451268+0000","last_clean":"2024-09-12T00:37:23.451268+0000","last_became_active":"2024-09-12T00:02:07.168005+0000","last_became_peered":"2024-09-12T00:02:07.168005+0000","last_unstale":"2024-09-12T00:37:23.451268+0000","last_undegraded":"2024-09-12T00:37:23.451268+0000","last_fullsized":"2024-09-12T00:37:23.451268+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:33.779846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":133,"num_write":373,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'348","reported_seq":992,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.432202+0000","last_change":"2024-09-12T00:01:59.137316+0000","last_active":"2024-09-12T00:36:52.432202+0000","last_peered":"2024-09-12T00:36:52.432202+0000","last_clean":"2024-09-12T00:36:52.432202+0000","last_became_active":"2024-09-12T00:01:59.137020+0000","last_became_peered":"2024-09-12T00:01:59.137020+0000","last_unstale":"2024-09-12T00:36:52.432202+0000","last_undegraded":"2024-09-12T00:36:52.432202+0000","last_fullsized":"2024-09-12T00:36:52.432202+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:36.922276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1524,"num_read_kb":1224,"num_write":576,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'242","reported_seq":847,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.768424+0000","last_change":"2024-09-12T00:01:57.152881+0000","last_active":"2024-09-12T00:37:07.768424+0000","last_peered":"2024-09-12T00:37:07.768424+0000","last_clean":"2024-09-12T00:37:07.768424+0000","last_became_active":"2024-09-12T00:01:57.152021+0000","last_became_peered":"2024-09-12T00:01:57.152021+0000","last_unstale":"2024-09-12T00:37:07.768424+0000","last_undegraded":"2024-09-12T00:37:07.768424+0000","last_fullsized":"2024-09-12T00:37:07.768424+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:43.435665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11102901,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":378,"num_read_kb":13162,"num_write":897,"num_write_kb":28256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:14.387659+0000","last_change":"2024-09-12T00:01:48.515165+0000","last_active":"2024-09-12T00:35:14.387659+0000","last_peered":"2024-09-12T00:35:14.387659+0000","last_clean":"2024-09-12T00:35:14.387659+0000","last_became_active":"2024-09-12T00:01:46.505315+0000","last_became_peered":"2024-09-12T00:01:46.505315+0000","last_unstale":"2024-09-12T00:35:14.387659+0000","last_undegraded":"2024-09-12T00:35:14.387659+0000","last_fullsized":"2024-09-12T00:35:14.387659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:31.136294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079890600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.387917+0000","last_change":"2024-09-12T00:02:01.148940+0000","last_active":"2024-09-12T00:35:24.387917+0000","last_peered":"2024-09-12T00:35:24.387917+0000","last_clean":"2024-09-12T00:35:24.387917+0000","last_became_active":"2024-09-12T00:02:01.148650+0000","last_became_peered":"2024-09-12T00:02:01.148650+0000","last_unstale":"2024-09-12T00:35:24.387917+0000","last_undegraded":"2024-09-12T00:35:24.387917+0000","last_fullsized":"2024-09-12T00:35:24.387917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:11.664931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'162","reported_seq":707,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:29.523102+0000","last_change":"2024-09-12T00:02:03.153955+0000","last_active":"2024-09-12T00:37:29.523102+0000","last_peered":"2024-09-12T00:37:29.523102+0000","last_clean":"2024-09-12T00:37:29.523102+0000","last_became_active":"2024-09-12T00:02:03.153640+0000","last_became_peered":"2024-09-12T00:02:03.153640+0000","last_unstale":"2024-09-12T00:37:29.523102+0000","last_undegraded":"2024-09-12T00:37:29.523102+0000","last_fullsized":"2024-09-12T00:37:29.523102+0000","mapping_epoch":30,"log_start":"258'100","ondisk_log_start":"258'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:03.938144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":206,"num_read_kb":198,"num_write":166,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'774","reported_seq":2507,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.888775+0000","last_change":"2024-09-12T00:02:05.165645+0000","last_active":"2024-09-12T00:38:35.888775+0000","last_peered":"2024-09-12T00:38:35.888775+0000","last_clean":"2024-09-12T00:38:35.888775+0000","last_became_active":"2024-09-12T00:02:05.163720+0000","last_became_peered":"2024-09-12T00:02:05.163720+0000","last_unstale":"2024-09-12T00:38:35.888775+0000","last_undegraded":"2024-09-12T00:38:35.888775+0000","last_fullsized":"2024-09-12T00:38:35.888775+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:23.515740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'122","reported_seq":618,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:19.409311+0000","last_change":"2024-09-12T00:02:07.168152+0000","last_active":"2024-09-12T00:38:19.409311+0000","last_peered":"2024-09-12T00:38:19.409311+0000","last_clean":"2024-09-12T00:38:19.409311+0000","last_became_active":"2024-09-12T00:02:07.167797+0000","last_became_peered":"2024-09-12T00:02:07.167797+0000","last_unstale":"2024-09-12T00:38:19.409311+0000","last_undegraded":"2024-09-12T00:38:19.409311+0000","last_fullsized":"2024-09-12T00:38:19.409311+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:43.278651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":159,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'140","reported_seq":725,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:11.053276+0000","last_change":"2024-09-12T00:01:59.155408+0000","last_active":"2024-09-12T00:37:11.053276+0000","last_peered":"2024-09-12T00:37:11.053276+0000","last_clean":"2024-09-12T00:37:11.053276+0000","last_became_active":"2024-09-12T00:01:59.155117+0000","last_became_peered":"2024-09-12T00:01:59.155117+0000","last_unstale":"2024-09-12T00:37:11.053276+0000","last_undegraded":"2024-09-12T00:37:11.053276+0000","last_fullsized":"2024-09-12T00:37:11.053276+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:27.119934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":474,"num_write":223,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'336","reported_seq":996,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.521536+0000","last_change":"2024-09-12T00:01:57.134608+0000","last_active":"2024-09-12T00:38:37.521536+0000","last_peered":"2024-09-12T00:38:37.521536+0000","last_clean":"2024-09-12T00:38:37.521536+0000","last_became_active":"2024-09-12T00:01:57.134235+0000","last_became_peered":"2024-09-12T00:01:57.134235+0000","last_unstale":"2024-09-12T00:38:37.521536+0000","last_undegraded":"2024-09-12T00:38:37.521536+0000","last_fullsized":"2024-09-12T00:38:37.521536+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:42.049998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9470447,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":498,"num_read_kb":31500,"num_write":1159,"num_write_kb":36639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":514,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:27.517783+0000","last_change":"2024-09-12T00:01:48.511519+0000","last_active":"2024-09-12T00:36:27.517783+0000","last_peered":"2024-09-12T00:36:27.517783+0000","last_clean":"2024-09-12T00:36:27.517783+0000","last_became_active":"2024-09-12T00:01:46.508144+0000","last_became_peered":"2024-09-12T00:01:46.508144+0000","last_unstale":"2024-09-12T00:36:27.517783+0000","last_undegraded":"2024-09-12T00:36:27.517783+0000","last_fullsized":"2024-09-12T00:36:27.517783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:13.771631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045024799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.388920+0000","last_change":"2024-09-12T00:02:01.153487+0000","last_active":"2024-09-12T00:35:24.388920+0000","last_peered":"2024-09-12T00:35:24.388920+0000","last_clean":"2024-09-12T00:35:24.388920+0000","last_became_active":"2024-09-12T00:02:01.153207+0000","last_became_peered":"2024-09-12T00:02:01.153207+0000","last_unstale":"2024-09-12T00:35:24.388920+0000","last_undegraded":"2024-09-12T00:35:24.388920+0000","last_fullsized":"2024-09-12T00:35:24.388920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:46.459368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'107","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.666790+0000","last_change":"2024-09-12T00:02:03.151323+0000","last_active":"2024-09-12T00:36:24.666790+0000","last_peered":"2024-09-12T00:36:24.666790+0000","last_clean":"2024-09-12T00:36:24.666790+0000","last_became_active":"2024-09-12T00:02:03.151029+0000","last_became_peered":"2024-09-12T00:02:03.151029+0000","last_unstale":"2024-09-12T00:36:24.666790+0000","last_undegraded":"2024-09-12T00:36:24.666790+0000","last_fullsized":"2024-09-12T00:36:24.666790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:22.745763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":125,"num_read_kb":114,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'777","reported_seq":4554,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.957333+0000","last_change":"2024-09-12T00:02:05.164285+0000","last_active":"2024-09-12T00:38:28.957333+0000","last_peered":"2024-09-12T00:38:28.957333+0000","last_clean":"2024-09-12T00:38:28.957333+0000","last_became_active":"2024-09-12T00:02:05.162687+0000","last_became_peered":"2024-09-12T00:02:05.162687+0000","last_unstale":"2024-09-12T00:38:28.957333+0000","last_undegraded":"2024-09-12T00:38:28.957333+0000","last_fullsized":"2024-09-12T00:38:28.957333+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:19.706882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'155","reported_seq":657,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.251347+0000","last_change":"2024-09-12T00:02:07.166773+0000","last_active":"2024-09-12T00:37:02.251347+0000","last_peered":"2024-09-12T00:37:02.251347+0000","last_clean":"2024-09-12T00:37:02.251347+0000","last_became_active":"2024-09-12T00:02:07.166471+0000","last_became_peered":"2024-09-12T00:02:07.166471+0000","last_unstale":"2024-09-12T00:37:02.251347+0000","last_undegraded":"2024-09-12T00:37:02.251347+0000","last_fullsized":"2024-09-12T00:37:02.251347+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:15.572916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":126,"num_write":337,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'81","reported_seq":638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:51.799754+0000","last_change":"2024-09-12T00:01:59.157320+0000","last_active":"2024-09-12T00:36:51.799754+0000","last_peered":"2024-09-12T00:36:51.799754+0000","last_clean":"2024-09-12T00:36:51.799754+0000","last_became_active":"2024-09-12T00:01:59.157044+0000","last_became_peered":"2024-09-12T00:01:59.157044+0000","last_unstale":"2024-09-12T00:36:51.799754+0000","last_undegraded":"2024-09-12T00:36:51.799754+0000","last_fullsized":"2024-09-12T00:36:51.799754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:09.577038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":122,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'412","reported_seq":1046,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.413500+0000","last_change":"2024-09-12T00:01:57.134999+0000","last_active":"2024-09-12T00:38:37.413500+0000","last_peered":"2024-09-12T00:38:37.413500+0000","last_clean":"2024-09-12T00:38:37.413500+0000","last_became_active":"2024-09-12T00:01:57.134646+0000","last_became_peered":"2024-09-12T00:01:57.134646+0000","last_unstale":"2024-09-12T00:38:37.413500+0000","last_undegraded":"2024-09-12T00:38:37.413500+0000","last_fullsized":"2024-09-12T00:38:37.413500+0000","mapping_epoch":24,"log_start":"261'400","ondisk_log_start":"261'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:37.804939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2183609,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":719,"num_read_kb":1717,"num_write":1227,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":510,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.379940+0000","last_change":"2024-09-12T00:01:48.515417+0000","last_active":"2024-09-12T00:34:19.379940+0000","last_peered":"2024-09-12T00:34:19.379940+0000","last_clean":"2024-09-12T00:34:19.379940+0000","last_became_active":"2024-09-12T00:01:46.502847+0000","last_became_peered":"2024-09-12T00:01:46.502847+0000","last_unstale":"2024-09-12T00:34:19.379940+0000","last_undegraded":"2024-09-12T00:34:19.379940+0000","last_fullsized":"2024-09-12T00:34:19.379940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:49.727360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:07.515474+0000","last_change":"2024-09-12T00:02:01.152727+0000","last_active":"2024-09-12T00:36:07.515474+0000","last_peered":"2024-09-12T00:36:07.515474+0000","last_clean":"2024-09-12T00:36:07.515474+0000","last_became_active":"2024-09-12T00:02:01.152467+0000","last_became_peered":"2024-09-12T00:02:01.152467+0000","last_unstale":"2024-09-12T00:36:07.515474+0000","last_undegraded":"2024-09-12T00:36:07.515474+0000","last_fullsized":"2024-09-12T00:36:07.515474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:32.840264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'734","reported_seq":1432,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.912719+0000","last_change":"2024-09-12T00:02:03.151458+0000","last_active":"2024-09-12T00:38:28.912719+0000","last_peered":"2024-09-12T00:38:28.912719+0000","last_clean":"2024-09-12T00:38:28.912719+0000","last_became_active":"2024-09-12T00:02:03.151140+0000","last_became_peered":"2024-09-12T00:02:03.151140+0000","last_unstale":"2024-09-12T00:38:28.912719+0000","last_undegraded":"2024-09-12T00:38:28.912719+0000","last_fullsized":"2024-09-12T00:38:28.912719+0000","mapping_epoch":30,"log_start":"261'700","ondisk_log_start":"261'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:44.111850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174334,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1303,"num_read_kb":2810,"num_write":1090,"num_write_kb":924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:27.509341+0000","last_change":"2024-09-12T00:02:05.169087+0000","last_active":"2024-09-12T00:35:27.509341+0000","last_peered":"2024-09-12T00:35:27.509341+0000","last_clean":"2024-09-12T00:35:27.509341+0000","last_became_active":"2024-09-12T00:02:05.168419+0000","last_became_peered":"2024-09-12T00:02:05.168419+0000","last_unstale":"2024-09-12T00:35:27.509341+0000","last_undegraded":"2024-09-12T00:35:27.509341+0000","last_fullsized":"2024-09-12T00:35:27.509341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:37.208808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'139","reported_seq":629,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.772962+0000","last_change":"2024-09-12T00:02:07.170358+0000","last_active":"2024-09-12T00:37:10.772962+0000","last_peered":"2024-09-12T00:37:10.772962+0000","last_clean":"2024-09-12T00:37:10.772962+0000","last_became_active":"2024-09-12T00:02:07.169937+0000","last_became_peered":"2024-09-12T00:02:07.169937+0000","last_unstale":"2024-09-12T00:37:10.772962+0000","last_undegraded":"2024-09-12T00:37:10.772962+0000","last_fullsized":"2024-09-12T00:37:10.772962+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:08.055256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":184,"num_read_kb":169,"num_write":343,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'133","reported_seq":678,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.561260+0000","last_change":"2024-09-12T00:02:07.173368+0000","last_active":"2024-09-12T00:37:23.561260+0000","last_peered":"2024-09-12T00:37:23.561260+0000","last_clean":"2024-09-12T00:37:23.561260+0000","last_became_active":"2024-09-12T00:02:07.173094+0000","last_became_peered":"2024-09-12T00:02:07.173094+0000","last_unstale":"2024-09-12T00:37:23.561260+0000","last_undegraded":"2024-09-12T00:37:23.561260+0000","last_fullsized":"2024-09-12T00:37:23.561260+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:56.973946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":191,"num_read_kb":191,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'183","reported_seq":771,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:23.610776+0000","last_change":"2024-09-12T00:01:59.154754+0000","last_active":"2024-09-12T00:36:23.610776+0000","last_peered":"2024-09-12T00:36:23.610776+0000","last_clean":"2024-09-12T00:36:23.610776+0000","last_became_active":"2024-09-12T00:01:59.154463+0000","last_became_peered":"2024-09-12T00:01:59.154463+0000","last_unstale":"2024-09-12T00:36:23.610776+0000","last_undegraded":"2024-09-12T00:36:23.610776+0000","last_fullsized":"2024-09-12T00:36:23.610776+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:22.287932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":794,"num_read_kb":651,"num_write":258,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'276","reported_seq":912,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.416968+0000","last_change":"2024-09-12T00:01:57.164242+0000","last_active":"2024-09-12T00:37:21.416968+0000","last_peered":"2024-09-12T00:37:21.416968+0000","last_clean":"2024-09-12T00:37:21.416968+0000","last_became_active":"2024-09-12T00:01:57.163847+0000","last_became_peered":"2024-09-12T00:01:57.163847+0000","last_unstale":"2024-09-12T00:37:21.416968+0000","last_undegraded":"2024-09-12T00:37:21.416968+0000","last_fullsized":"2024-09-12T00:37:21.416968+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:14.319412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12961627,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":447,"num_read_kb":27210,"num_write":1041,"num_write_kb":33935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.500143+0000","last_change":"2024-09-12T00:02:01.144933+0000","last_active":"2024-09-12T00:34:44.500143+0000","last_peered":"2024-09-12T00:34:44.500143+0000","last_clean":"2024-09-12T00:34:44.500143+0000","last_became_active":"2024-09-12T00:02:01.144579+0000","last_became_peered":"2024-09-12T00:02:01.144579+0000","last_unstale":"2024-09-12T00:34:44.500143+0000","last_undegraded":"2024-09-12T00:34:44.500143+0000","last_fullsized":"2024-09-12T00:34:44.500143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:13.618101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'291","reported_seq":846,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.519550+0000","last_change":"2024-09-12T00:02:03.155013+0000","last_active":"2024-09-12T00:37:04.519550+0000","last_peered":"2024-09-12T00:37:04.519550+0000","last_clean":"2024-09-12T00:37:04.519550+0000","last_became_active":"2024-09-12T00:02:03.154710+0000","last_became_peered":"2024-09-12T00:02:03.154710+0000","last_unstale":"2024-09-12T00:37:04.519550+0000","last_undegraded":"2024-09-12T00:37:04.519550+0000","last_fullsized":"2024-09-12T00:37:04.519550+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:23.714644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55995,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":934,"num_write":382,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.500232+0000","last_change":"2024-09-12T00:02:05.163654+0000","last_active":"2024-09-12T00:34:44.500232+0000","last_peered":"2024-09-12T00:34:44.500232+0000","last_clean":"2024-09-12T00:34:44.500232+0000","last_became_active":"2024-09-12T00:02:05.163389+0000","last_became_peered":"2024-09-12T00:02:05.163389+0000","last_unstale":"2024-09-12T00:34:44.500232+0000","last_undegraded":"2024-09-12T00:34:44.500232+0000","last_fullsized":"2024-09-12T00:34:44.500232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:54.688629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'116","reported_seq":591,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.374469+0000","last_change":"2024-09-12T00:02:07.172652+0000","last_active":"2024-09-12T00:37:06.374469+0000","last_peered":"2024-09-12T00:37:06.374469+0000","last_clean":"2024-09-12T00:37:06.374469+0000","last_became_active":"2024-09-12T00:02:07.172360+0000","last_became_peered":"2024-09-12T00:02:07.172360+0000","last_unstale":"2024-09-12T00:37:06.374469+0000","last_undegraded":"2024-09-12T00:37:06.374469+0000","last_fullsized":"2024-09-12T00:37:06.374469+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:50.938865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'116","reported_seq":715,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:38.799905+0000","last_change":"2024-09-12T00:01:59.155610+0000","last_active":"2024-09-12T00:36:38.799905+0000","last_peered":"2024-09-12T00:36:38.799905+0000","last_clean":"2024-09-12T00:36:38.799905+0000","last_became_active":"2024-09-12T00:01:59.155287+0000","last_became_peered":"2024-09-12T00:01:59.155287+0000","last_unstale":"2024-09-12T00:36:38.799905+0000","last_undegraded":"2024-09-12T00:36:38.799905+0000","last_fullsized":"2024-09-12T00:36:38.799905+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:33.145869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":525,"num_read_kb":443,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'272","reported_seq":906,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.033160+0000","last_change":"2024-09-12T00:01:57.150227+0000","last_active":"2024-09-12T00:38:27.033160+0000","last_peered":"2024-09-12T00:38:27.033160+0000","last_clean":"2024-09-12T00:38:27.033160+0000","last_became_active":"2024-09-12T00:01:57.144743+0000","last_became_peered":"2024-09-12T00:01:57.144743+0000","last_unstale":"2024-09-12T00:38:27.033160+0000","last_undegraded":"2024-09-12T00:38:27.033160+0000","last_fullsized":"2024-09-12T00:38:27.033160+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:04.356175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6732343,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":428,"num_read_kb":7937,"num_write":966,"num_write_kb":13946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:42.502624+0000","last_change":"2024-09-12T00:02:01.151142+0000","last_active":"2024-09-12T00:34:42.502624+0000","last_peered":"2024-09-12T00:34:42.502624+0000","last_clean":"2024-09-12T00:34:42.502624+0000","last_became_active":"2024-09-12T00:02:01.150857+0000","last_became_peered":"2024-09-12T00:02:01.150857+0000","last_unstale":"2024-09-12T00:34:42.502624+0000","last_undegraded":"2024-09-12T00:34:42.502624+0000","last_fullsized":"2024-09-12T00:34:42.502624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:45.672680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'41","reported_seq":534,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:38.801722+0000","last_change":"2024-09-12T00:02:03.150541+0000","last_active":"2024-09-12T00:36:38.801722+0000","last_peered":"2024-09-12T00:36:38.801722+0000","last_clean":"2024-09-12T00:36:38.801722+0000","last_became_active":"2024-09-12T00:02:03.149558+0000","last_became_peered":"2024-09-12T00:02:03.149558+0000","last_unstale":"2024-09-12T00:36:38.801722+0000","last_undegraded":"2024-09-12T00:36:38.801722+0000","last_fullsized":"2024-09-12T00:36:38.801722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:42.429865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":469,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.617409+0000","last_change":"2024-09-12T00:02:05.171121+0000","last_active":"2024-09-12T00:34:44.617409+0000","last_peered":"2024-09-12T00:34:44.617409+0000","last_clean":"2024-09-12T00:34:44.617409+0000","last_became_active":"2024-09-12T00:02:05.170836+0000","last_became_peered":"2024-09-12T00:02:05.170836+0000","last_unstale":"2024-09-12T00:34:44.617409+0000","last_undegraded":"2024-09-12T00:34:44.617409+0000","last_fullsized":"2024-09-12T00:34:44.617409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:00.009417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'258","reported_seq":776,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.055886+0000","last_change":"2024-09-12T00:02:07.168954+0000","last_active":"2024-09-12T00:37:23.055886+0000","last_peered":"2024-09-12T00:37:23.055886+0000","last_clean":"2024-09-12T00:37:23.055886+0000","last_became_active":"2024-09-12T00:02:07.168678+0000","last_became_peered":"2024-09-12T00:02:07.168678+0000","last_unstale":"2024-09-12T00:37:23.055886+0000","last_undegraded":"2024-09-12T00:37:23.055886+0000","last_fullsized":"2024-09-12T00:37:23.055886+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:23.449987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":392,"num_read_kb":368,"num_write":602,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'4088","reported_seq":4638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:42.502575+0000","last_change":"2024-09-12T00:01:59.154536+0000","last_active":"2024-09-12T00:34:42.502575+0000","last_peered":"2024-09-12T00:34:42.502575+0000","last_clean":"2024-09-12T00:34:42.502575+0000","last_became_active":"2024-09-12T00:01:59.154260+0000","last_became_peered":"2024-09-12T00:01:59.154260+0000","last_unstale":"2024-09-12T00:34:42.502575+0000","last_undegraded":"2024-09-12T00:34:42.502575+0000","last_fullsized":"2024-09-12T00:34:42.502575+0000","mapping_epoch":26,"log_start":"261'4000","ondisk_log_start":"261'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:35.639955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16394,"num_read_kb":13744,"num_write":6133,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'238","reported_seq":832,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.060926+0000","last_change":"2024-09-12T00:01:57.160338+0000","last_active":"2024-09-12T00:37:09.060926+0000","last_peered":"2024-09-12T00:37:09.060926+0000","last_clean":"2024-09-12T00:37:09.060926+0000","last_became_active":"2024-09-12T00:01:57.158677+0000","last_became_peered":"2024-09-12T00:01:57.158677+0000","last_unstale":"2024-09-12T00:37:09.060926+0000","last_undegraded":"2024-09-12T00:37:09.060926+0000","last_fullsized":"2024-09-12T00:37:09.060926+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:16.844146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9635143,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":338,"num_read_kb":56505,"num_write":875,"num_write_kb":31346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.617371+0000","last_change":"2024-09-12T00:02:01.155814+0000","last_active":"2024-09-12T00:34:44.617371+0000","last_peered":"2024-09-12T00:34:44.617371+0000","last_clean":"2024-09-12T00:34:44.617371+0000","last_became_active":"2024-09-12T00:02:01.155490+0000","last_became_peered":"2024-09-12T00:02:01.155490+0000","last_unstale":"2024-09-12T00:34:44.617371+0000","last_undegraded":"2024-09-12T00:34:44.617371+0000","last_fullsized":"2024-09-12T00:34:44.617371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:27.105020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'279","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.519632+0000","last_change":"2024-09-12T00:02:03.149010+0000","last_active":"2024-09-12T00:37:04.519632+0000","last_peered":"2024-09-12T00:37:04.519632+0000","last_clean":"2024-09-12T00:37:04.519632+0000","last_became_active":"2024-09-12T00:02:03.148690+0000","last_became_peered":"2024-09-12T00:02:03.148690+0000","last_unstale":"2024-09-12T00:37:04.519632+0000","last_undegraded":"2024-09-12T00:37:04.519632+0000","last_fullsized":"2024-09-12T00:37:04.519632+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:39.130947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49452,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":914,"num_write":368,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:46.499667+0000","last_change":"2024-09-12T00:02:05.168740+0000","last_active":"2024-09-12T00:34:46.499667+0000","last_peered":"2024-09-12T00:34:46.499667+0000","last_clean":"2024-09-12T00:34:46.499667+0000","last_became_active":"2024-09-12T00:02:05.168232+0000","last_became_peered":"2024-09-12T00:02:05.168232+0000","last_unstale":"2024-09-12T00:34:46.499667+0000","last_undegraded":"2024-09-12T00:34:46.499667+0000","last_fullsized":"2024-09-12T00:34:46.499667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:43.713032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'134","reported_seq":667,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.879910+0000","last_change":"2024-09-12T00:02:07.169044+0000","last_active":"2024-09-12T00:36:58.879910+0000","last_peered":"2024-09-12T00:36:58.879910+0000","last_clean":"2024-09-12T00:36:58.879910+0000","last_became_active":"2024-09-12T00:02:07.168747+0000","last_became_peered":"2024-09-12T00:02:07.168747+0000","last_unstale":"2024-09-12T00:36:58.879910+0000","last_undegraded":"2024-09-12T00:36:58.879910+0000","last_fullsized":"2024-09-12T00:36:58.879910+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:23.448210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":291,"num_read_kb":255,"num_write":337,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'104","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.673042+0000","last_change":"2024-09-12T00:01:59.155125+0000","last_active":"2024-09-12T00:37:09.673042+0000","last_peered":"2024-09-12T00:37:09.673042+0000","last_clean":"2024-09-12T00:37:09.673042+0000","last_became_active":"2024-09-12T00:01:59.154848+0000","last_became_peered":"2024-09-12T00:01:59.154848+0000","last_unstale":"2024-09-12T00:37:09.673042+0000","last_undegraded":"2024-09-12T00:37:09.673042+0000","last_fullsized":"2024-09-12T00:37:09.673042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:47.132457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":392,"num_write":152,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'253","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:22.215022+0000","last_change":"2024-09-12T00:01:57.142768+0000","last_active":"2024-09-12T00:36:22.215022+0000","last_peered":"2024-09-12T00:36:22.215022+0000","last_clean":"2024-09-12T00:36:22.215022+0000","last_became_active":"2024-09-12T00:01:57.142385+0000","last_became_peered":"2024-09-12T00:01:57.142385+0000","last_unstale":"2024-09-12T00:36:22.215022+0000","last_undegraded":"2024-09-12T00:36:22.215022+0000","last_fullsized":"2024-09-12T00:36:22.215022+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:28.588091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2776446,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":554,"num_read_kb":9162,"num_write":973,"num_write_kb":16984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.383518+0000","last_change":"2024-09-12T00:02:01.154218+0000","last_active":"2024-09-12T00:34:44.383518+0000","last_peered":"2024-09-12T00:34:44.383518+0000","last_clean":"2024-09-12T00:34:44.383518+0000","last_became_active":"2024-09-12T00:02:01.153906+0000","last_became_peered":"2024-09-12T00:02:01.153906+0000","last_unstale":"2024-09-12T00:34:44.383518+0000","last_undegraded":"2024-09-12T00:34:44.383518+0000","last_fullsized":"2024-09-12T00:34:44.383518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:16.965088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'244","reported_seq":798,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.400722+0000","last_change":"2024-09-12T00:02:03.155251+0000","last_active":"2024-09-12T00:37:04.400722+0000","last_peered":"2024-09-12T00:37:04.400722+0000","last_clean":"2024-09-12T00:37:04.400722+0000","last_became_active":"2024-09-12T00:02:03.154896+0000","last_became_peered":"2024-09-12T00:02:03.154896+0000","last_unstale":"2024-09-12T00:37:04.400722+0000","last_undegraded":"2024-09-12T00:37:04.400722+0000","last_fullsized":"2024-09-12T00:37:04.400722+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:31.639970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54781,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":400,"num_read_kb":853,"num_write":328,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.500273+0000","last_change":"2024-09-12T00:02:05.162572+0000","last_active":"2024-09-12T00:34:44.500273+0000","last_peered":"2024-09-12T00:34:44.500273+0000","last_clean":"2024-09-12T00:34:44.500273+0000","last_became_active":"2024-09-12T00:02:05.162204+0000","last_became_peered":"2024-09-12T00:02:05.162204+0000","last_unstale":"2024-09-12T00:34:44.500273+0000","last_undegraded":"2024-09-12T00:34:44.500273+0000","last_fullsized":"2024-09-12T00:34:44.500273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:56.188492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'125","reported_seq":678,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:22.357033+0000","last_change":"2024-09-12T00:01:59.145758+0000","last_active":"2024-09-12T00:36:22.357033+0000","last_peered":"2024-09-12T00:36:22.357033+0000","last_clean":"2024-09-12T00:36:22.357033+0000","last_became_active":"2024-09-12T00:01:59.145456+0000","last_became_peered":"2024-09-12T00:01:59.145456+0000","last_unstale":"2024-09-12T00:36:22.357033+0000","last_undegraded":"2024-09-12T00:36:22.357033+0000","last_fullsized":"2024-09-12T00:36:22.357033+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:45.253029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":512,"num_read_kb":415,"num_write":196,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'302","reported_seq":933,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:25.575893+0000","last_change":"2024-09-12T00:01:57.144156+0000","last_active":"2024-09-12T00:36:25.575893+0000","last_peered":"2024-09-12T00:36:25.575893+0000","last_clean":"2024-09-12T00:36:25.575893+0000","last_became_active":"2024-09-12T00:01:57.143684+0000","last_became_peered":"2024-09-12T00:01:57.143684+0000","last_unstale":"2024-09-12T00:36:25.575893+0000","last_undegraded":"2024-09-12T00:36:25.575893+0000","last_fullsized":"2024-09-12T00:36:25.575893+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:44.165024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6831063,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":432,"num_read_kb":22065,"num_write":1132,"num_write_kb":32922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:09.512535+0000","last_change":"2024-09-12T00:02:01.154936+0000","last_active":"2024-09-12T00:36:09.512535+0000","last_peered":"2024-09-12T00:36:09.512535+0000","last_clean":"2024-09-12T00:36:09.512535+0000","last_became_active":"2024-09-12T00:02:01.154541+0000","last_became_peered":"2024-09-12T00:02:01.154541+0000","last_unstale":"2024-09-12T00:36:09.512535+0000","last_undegraded":"2024-09-12T00:36:09.512535+0000","last_fullsized":"2024-09-12T00:36:09.512535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:34.459769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'480","reported_seq":1086,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.909459+0000","last_change":"2024-09-12T00:02:03.158651+0000","last_active":"2024-09-12T00:38:28.909459+0000","last_peered":"2024-09-12T00:38:28.909459+0000","last_clean":"2024-09-12T00:38:28.909459+0000","last_became_active":"2024-09-12T00:02:03.158360+0000","last_became_peered":"2024-09-12T00:02:03.158360+0000","last_unstale":"2024-09-12T00:38:28.909459+0000","last_undegraded":"2024-09-12T00:38:28.909459+0000","last_fullsized":"2024-09-12T00:38:28.909459+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:44.063536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115135,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":865,"num_read_kb":1864,"num_write":756,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":468,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615861+0000","last_change":"2024-09-12T00:02:05.167419+0000","last_active":"2024-09-12T00:34:34.615861+0000","last_peered":"2024-09-12T00:34:34.615861+0000","last_clean":"2024-09-12T00:34:34.615861+0000","last_became_active":"2024-09-12T00:02:05.167052+0000","last_became_peered":"2024-09-12T00:02:05.167052+0000","last_unstale":"2024-09-12T00:34:34.615861+0000","last_undegraded":"2024-09-12T00:34:34.615861+0000","last_fullsized":"2024-09-12T00:34:34.615861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:41.679779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'206","reported_seq":704,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.939992+0000","last_change":"2024-09-12T00:02:07.167621+0000","last_active":"2024-09-12T00:37:22.939992+0000","last_peered":"2024-09-12T00:37:22.939992+0000","last_clean":"2024-09-12T00:37:22.939992+0000","last_became_active":"2024-09-12T00:02:07.167331+0000","last_became_peered":"2024-09-12T00:02:07.167331+0000","last_unstale":"2024-09-12T00:37:22.939992+0000","last_undegraded":"2024-09-12T00:37:22.939992+0000","last_fullsized":"2024-09-12T00:37:22.939992+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:21.029667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":483,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'398","reported_seq":1157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:57.885047+0000","last_change":"2024-09-12T00:01:59.150197+0000","last_active":"2024-09-12T00:36:57.885047+0000","last_peered":"2024-09-12T00:36:57.885047+0000","last_clean":"2024-09-12T00:36:57.885047+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:36:57.885047+0000","last_undegraded":"2024-09-12T00:36:57.885047+0000","last_fullsized":"2024-09-12T00:36:57.885047+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:47.950131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1910,"num_read_kb":1650,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'335","reported_seq":1011,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.489466+0000","last_change":"2024-09-12T00:01:57.142382+0000","last_active":"2024-09-12T00:38:37.489466+0000","last_peered":"2024-09-12T00:38:37.489466+0000","last_clean":"2024-09-12T00:38:37.489466+0000","last_became_active":"2024-09-12T00:01:57.141998+0000","last_became_peered":"2024-09-12T00:01:57.141998+0000","last_unstale":"2024-09-12T00:38:37.489466+0000","last_undegraded":"2024-09-12T00:38:37.489466+0000","last_fullsized":"2024-09-12T00:38:37.489466+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:28.887996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":587,"num_read_kb":1840,"num_write":1187,"num_write_kb":17126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.623582+0000","last_change":"2024-09-12T00:02:01.153965+0000","last_active":"2024-09-12T00:35:24.623582+0000","last_peered":"2024-09-12T00:35:24.623582+0000","last_clean":"2024-09-12T00:35:24.623582+0000","last_became_active":"2024-09-12T00:02:01.153611+0000","last_became_peered":"2024-09-12T00:02:01.153611+0000","last_unstale":"2024-09-12T00:35:24.623582+0000","last_undegraded":"2024-09-12T00:35:24.623582+0000","last_fullsized":"2024-09-12T00:35:24.623582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:43.203100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'279","reported_seq":838,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.598694+0000","last_change":"2024-09-12T00:02:03.155107+0000","last_active":"2024-09-12T00:38:27.598694+0000","last_peered":"2024-09-12T00:38:27.598694+0000","last_clean":"2024-09-12T00:38:27.598694+0000","last_became_active":"2024-09-12T00:02:03.154821+0000","last_became_peered":"2024-09-12T00:02:03.154821+0000","last_unstale":"2024-09-12T00:38:27.598694+0000","last_undegraded":"2024-09-12T00:38:27.598694+0000","last_fullsized":"2024-09-12T00:38:27.598694+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:25.034969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54123,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":452,"num_read_kb":904,"num_write":380,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":473,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499293+0000","last_change":"2024-09-12T00:02:05.170002+0000","last_active":"2024-09-12T00:34:34.499293+0000","last_peered":"2024-09-12T00:34:34.499293+0000","last_clean":"2024-09-12T00:34:34.499293+0000","last_became_active":"2024-09-12T00:02:05.169726+0000","last_became_peered":"2024-09-12T00:02:05.169726+0000","last_unstale":"2024-09-12T00:34:34.499293+0000","last_undegraded":"2024-09-12T00:34:34.499293+0000","last_fullsized":"2024-09-12T00:34:34.499293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:22.827175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'193","reported_seq":1061,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.503992+0000","last_change":"2024-09-12T00:02:07.175207+0000","last_active":"2024-09-12T00:37:22.503992+0000","last_peered":"2024-09-12T00:37:22.503992+0000","last_clean":"2024-09-12T00:37:22.503992+0000","last_became_active":"2024-09-12T00:02:07.174910+0000","last_became_peered":"2024-09-12T00:02:07.174910+0000","last_unstale":"2024-09-12T00:37:22.503992+0000","last_undegraded":"2024-09-12T00:37:22.503992+0000","last_fullsized":"2024-09-12T00:37:22.503992+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:19.459374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":668,"num_read_kb":649,"num_write":556,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'98","reported_seq":665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.598641+0000","last_change":"2024-09-12T00:01:59.151423+0000","last_active":"2024-09-12T00:37:02.598641+0000","last_peered":"2024-09-12T00:37:02.598641+0000","last_clean":"2024-09-12T00:37:02.598641+0000","last_became_active":"2024-09-12T00:01:59.151143+0000","last_became_peered":"2024-09-12T00:01:59.151143+0000","last_unstale":"2024-09-12T00:37:02.598641+0000","last_undegraded":"2024-09-12T00:37:02.598641+0000","last_fullsized":"2024-09-12T00:37:02.598641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:08.277331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":451,"num_read_kb":380,"num_write":139,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'251","reported_seq":839,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.489562+0000","last_change":"2024-09-12T00:01:57.142179+0000","last_active":"2024-09-12T00:38:36.489562+0000","last_peered":"2024-09-12T00:38:36.489562+0000","last_clean":"2024-09-12T00:38:36.489562+0000","last_became_active":"2024-09-12T00:01:57.141789+0000","last_became_peered":"2024-09-12T00:01:57.141789+0000","last_unstale":"2024-09-12T00:38:36.489562+0000","last_undegraded":"2024-09-12T00:38:36.489562+0000","last_fullsized":"2024-09-12T00:38:36.489562+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:44.370591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10815112,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":334,"num_read_kb":31078,"num_write":835,"num_write_kb":48318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615850+0000","last_change":"2024-09-12T00:02:01.154963+0000","last_active":"2024-09-12T00:34:34.615850+0000","last_peered":"2024-09-12T00:34:34.615850+0000","last_clean":"2024-09-12T00:34:34.615850+0000","last_became_active":"2024-09-12T00:02:01.154530+0000","last_became_peered":"2024-09-12T00:02:01.154530+0000","last_unstale":"2024-09-12T00:34:34.615850+0000","last_undegraded":"2024-09-12T00:34:34.615850+0000","last_fullsized":"2024-09-12T00:34:34.615850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:06.651100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'283","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:23.550648+0000","last_change":"2024-09-12T00:02:03.156889+0000","last_active":"2024-09-12T00:38:23.550648+0000","last_peered":"2024-09-12T00:38:23.550648+0000","last_clean":"2024-09-12T00:38:23.550648+0000","last_became_active":"2024-09-12T00:02:03.156529+0000","last_became_peered":"2024-09-12T00:02:03.156529+0000","last_unstale":"2024-09-12T00:38:23.550648+0000","last_undegraded":"2024-09-12T00:38:23.550648+0000","last_fullsized":"2024-09-12T00:38:23.550648+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:52.310627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66765,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":1019,"num_write":396,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":473,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:09.512584+0000","last_change":"2024-09-12T00:02:05.164244+0000","last_active":"2024-09-12T00:36:09.512584+0000","last_peered":"2024-09-12T00:36:09.512584+0000","last_clean":"2024-09-12T00:36:09.512584+0000","last_became_active":"2024-09-12T00:02:05.163956+0000","last_became_peered":"2024-09-12T00:02:05.163956+0000","last_unstale":"2024-09-12T00:36:09.512584+0000","last_undegraded":"2024-09-12T00:36:09.512584+0000","last_fullsized":"2024-09-12T00:36:09.512584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:58.031555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'127","reported_seq":603,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.940297+0000","last_change":"2024-09-12T00:02:07.172798+0000","last_active":"2024-09-12T00:38:28.940297+0000","last_peered":"2024-09-12T00:38:28.940297+0000","last_clean":"2024-09-12T00:38:28.940297+0000","last_became_active":"2024-09-12T00:02:07.172496+0000","last_became_peered":"2024-09-12T00:02:07.172496+0000","last_unstale":"2024-09-12T00:38:28.940297+0000","last_undegraded":"2024-09-12T00:38:28.940297+0000","last_fullsized":"2024-09-12T00:38:28.940297+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:11.813869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":307,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'198","reported_seq":828,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:13.741103+0000","last_change":"2024-09-12T00:01:59.149165+0000","last_active":"2024-09-12T00:36:13.741103+0000","last_peered":"2024-09-12T00:36:13.741103+0000","last_clean":"2024-09-12T00:36:13.741103+0000","last_became_active":"2024-09-12T00:01:59.148559+0000","last_became_peered":"2024-09-12T00:01:59.148559+0000","last_unstale":"2024-09-12T00:36:13.741103+0000","last_undegraded":"2024-09-12T00:36:13.741103+0000","last_fullsized":"2024-09-12T00:36:13.741103+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:56.810526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":733,"num_write":278,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'356","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.522107+0000","last_change":"2024-09-12T00:01:57.145004+0000","last_active":"2024-09-12T00:38:37.522107+0000","last_peered":"2024-09-12T00:38:37.522107+0000","last_clean":"2024-09-12T00:38:37.522107+0000","last_became_active":"2024-09-12T00:01:57.144397+0000","last_became_peered":"2024-09-12T00:01:57.144397+0000","last_unstale":"2024-09-12T00:38:37.522107+0000","last_undegraded":"2024-09-12T00:38:37.522107+0000","last_fullsized":"2024-09-12T00:38:37.522107+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:00.869585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293811,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":551,"num_read_kb":18154,"num_write":1202,"num_write_kb":40983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'5","reported_seq":968,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.454747+0000","last_change":"2024-09-12T00:02:01.152013+0000","last_active":"2024-09-12T00:38:35.454747+0000","last_peered":"2024-09-12T00:38:35.454747+0000","last_clean":"2024-09-12T00:38:35.454747+0000","last_became_active":"2024-09-12T00:02:01.151739+0000","last_became_peered":"2024-09-12T00:02:01.151739+0000","last_unstale":"2024-09-12T00:38:35.454747+0000","last_undegraded":"2024-09-12T00:38:35.454747+0000","last_fullsized":"2024-09-12T00:38:35.454747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:45.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'84","reported_seq":593,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.062825+0000","last_change":"2024-09-12T00:02:03.154234+0000","last_active":"2024-09-12T00:37:23.062825+0000","last_peered":"2024-09-12T00:37:23.062825+0000","last_clean":"2024-09-12T00:37:23.062825+0000","last_became_active":"2024-09-12T00:02:03.153948+0000","last_became_peered":"2024-09-12T00:02:03.153948+0000","last_unstale":"2024-09-12T00:37:23.062825+0000","last_undegraded":"2024-09-12T00:37:23.062825+0000","last_fullsized":"2024-09-12T00:37:23.062825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:26.035209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":128,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'761","reported_seq":4276,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.951944+0000","last_change":"2024-09-12T00:02:05.170722+0000","last_active":"2024-09-12T00:38:28.951944+0000","last_peered":"2024-09-12T00:38:28.951944+0000","last_clean":"2024-09-12T00:38:28.951944+0000","last_became_active":"2024-09-12T00:02:05.170399+0000","last_became_peered":"2024-09-12T00:02:05.170399+0000","last_unstale":"2024-09-12T00:38:28.951944+0000","last_undegraded":"2024-09-12T00:38:28.951944+0000","last_fullsized":"2024-09-12T00:38:28.951944+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:06.211117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'118","reported_seq":604,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.949325+0000","last_change":"2024-09-12T00:02:07.173296+0000","last_active":"2024-09-12T00:37:06.949325+0000","last_peered":"2024-09-12T00:37:06.949325+0000","last_clean":"2024-09-12T00:37:06.949325+0000","last_became_active":"2024-09-12T00:02:07.173030+0000","last_became_peered":"2024-09-12T00:02:07.173030+0000","last_unstale":"2024-09-12T00:37:06.949325+0000","last_undegraded":"2024-09-12T00:37:06.949325+0000","last_fullsized":"2024-09-12T00:37:06.949325+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:13.276457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":288,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'244","reported_seq":873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.077246+0000","last_change":"2024-09-12T00:01:59.152008+0000","last_active":"2024-09-12T00:36:50.077246+0000","last_peered":"2024-09-12T00:36:50.077246+0000","last_clean":"2024-09-12T00:36:50.077246+0000","last_became_active":"2024-09-12T00:01:59.151743+0000","last_became_peered":"2024-09-12T00:01:59.151743+0000","last_unstale":"2024-09-12T00:36:50.077246+0000","last_undegraded":"2024-09-12T00:36:50.077246+0000","last_fullsized":"2024-09-12T00:36:50.077246+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:35.993592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1082,"num_read_kb":884,"num_write":389,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'263","reported_seq":860,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.448347+0000","last_change":"2024-09-12T00:01:57.145465+0000","last_active":"2024-09-12T00:38:36.448347+0000","last_peered":"2024-09-12T00:38:36.448347+0000","last_clean":"2024-09-12T00:38:36.448347+0000","last_became_active":"2024-09-12T00:01:57.144946+0000","last_became_peered":"2024-09-12T00:01:57.144946+0000","last_unstale":"2024-09-12T00:38:36.448347+0000","last_undegraded":"2024-09-12T00:38:36.448347+0000","last_fullsized":"2024-09-12T00:38:36.448347+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:23.104871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41902,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":369,"num_read_kb":501,"num_write":918,"num_write_kb":20369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:31.497576+0000","last_change":"2024-09-12T00:02:01.152803+0000","last_active":"2024-09-12T00:34:31.497576+0000","last_peered":"2024-09-12T00:34:31.497576+0000","last_clean":"2024-09-12T00:34:31.497576+0000","last_became_active":"2024-09-12T00:02:01.152493+0000","last_became_peered":"2024-09-12T00:02:01.152493+0000","last_unstale":"2024-09-12T00:34:31.497576+0000","last_undegraded":"2024-09-12T00:34:31.497576+0000","last_fullsized":"2024-09-12T00:34:31.497576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:39.421026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'308","reported_seq":898,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.900764+0000","last_change":"2024-09-12T00:02:03.150973+0000","last_active":"2024-09-12T00:38:28.900764+0000","last_peered":"2024-09-12T00:38:28.900764+0000","last_clean":"2024-09-12T00:38:28.900764+0000","last_became_active":"2024-09-12T00:02:03.150631+0000","last_became_peered":"2024-09-12T00:02:03.150631+0000","last_unstale":"2024-09-12T00:38:28.900764+0000","last_undegraded":"2024-09-12T00:38:28.900764+0000","last_fullsized":"2024-09-12T00:38:28.900764+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:17.364587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78037,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":500,"num_read_kb":1028,"num_write":406,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.513886+0000","last_change":"2024-09-12T00:02:05.167377+0000","last_active":"2024-09-12T00:35:57.513886+0000","last_peered":"2024-09-12T00:35:57.513886+0000","last_clean":"2024-09-12T00:35:57.513886+0000","last_became_active":"2024-09-12T00:02:05.167082+0000","last_became_peered":"2024-09-12T00:02:05.167082+0000","last_unstale":"2024-09-12T00:35:57.513886+0000","last_undegraded":"2024-09-12T00:35:57.513886+0000","last_fullsized":"2024-09-12T00:35:57.513886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:04.610051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'123","reported_seq":614,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.557143+0000","last_change":"2024-09-12T00:02:07.173111+0000","last_active":"2024-09-12T00:38:27.557143+0000","last_peered":"2024-09-12T00:38:27.557143+0000","last_clean":"2024-09-12T00:38:27.557143+0000","last_became_active":"2024-09-12T00:02:07.172810+0000","last_became_peered":"2024-09-12T00:02:07.172810+0000","last_unstale":"2024-09-12T00:38:27.557143+0000","last_undegraded":"2024-09-12T00:38:27.557143+0000","last_fullsized":"2024-09-12T00:38:27.557143+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:47.728676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":135,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'223","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:25.779475+0000","last_change":"2024-09-12T00:01:59.147668+0000","last_active":"2024-09-12T00:36:25.779475+0000","last_peered":"2024-09-12T00:36:25.779475+0000","last_clean":"2024-09-12T00:36:25.779475+0000","last_became_active":"2024-09-12T00:01:59.147373+0000","last_became_peered":"2024-09-12T00:01:59.147373+0000","last_unstale":"2024-09-12T00:36:25.779475+0000","last_undegraded":"2024-09-12T00:36:25.779475+0000","last_fullsized":"2024-09-12T00:36:25.779475+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:21.257179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1007,"num_read_kb":830,"num_write":359,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'231","reported_seq":826,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:11.086295+0000","last_change":"2024-09-12T00:01:57.161842+0000","last_active":"2024-09-12T00:37:11.086295+0000","last_peered":"2024-09-12T00:37:11.086295+0000","last_clean":"2024-09-12T00:37:11.086295+0000","last_became_active":"2024-09-12T00:01:57.161414+0000","last_became_peered":"2024-09-12T00:01:57.161414+0000","last_unstale":"2024-09-12T00:37:11.086295+0000","last_undegraded":"2024-09-12T00:37:11.086295+0000","last_fullsized":"2024-09-12T00:37:11.086295+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:03.307762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7211953,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":314,"num_read_kb":8089,"num_write":853,"num_write_kb":31185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615825+0000","last_change":"2024-09-12T00:02:01.152071+0000","last_active":"2024-09-12T00:34:34.615825+0000","last_peered":"2024-09-12T00:34:34.615825+0000","last_clean":"2024-09-12T00:34:34.615825+0000","last_became_active":"2024-09-12T00:02:01.151760+0000","last_became_peered":"2024-09-12T00:02:01.151760+0000","last_unstale":"2024-09-12T00:34:34.615825+0000","last_undegraded":"2024-09-12T00:34:34.615825+0000","last_fullsized":"2024-09-12T00:34:34.615825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:08.986013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'276","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.624371+0000","last_change":"2024-09-12T00:02:03.151005+0000","last_active":"2024-09-12T00:38:36.624371+0000","last_peered":"2024-09-12T00:38:36.624371+0000","last_clean":"2024-09-12T00:38:36.624371+0000","last_became_active":"2024-09-12T00:02:03.150714+0000","last_became_peered":"2024-09-12T00:02:03.150714+0000","last_unstale":"2024-09-12T00:38:36.624371+0000","last_undegraded":"2024-09-12T00:38:36.624371+0000","last_fullsized":"2024-09-12T00:38:36.624371+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:39.492995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52913,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1134,"num_write":392,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.393761+0000","last_change":"2024-09-12T00:02:05.171377+0000","last_active":"2024-09-12T00:35:59.393761+0000","last_peered":"2024-09-12T00:35:59.393761+0000","last_clean":"2024-09-12T00:35:59.393761+0000","last_became_active":"2024-09-12T00:02:05.170973+0000","last_became_peered":"2024-09-12T00:02:05.170973+0000","last_unstale":"2024-09-12T00:35:59.393761+0000","last_undegraded":"2024-09-12T00:35:59.393761+0000","last_fullsized":"2024-09-12T00:35:59.393761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:14.690020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'119","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:11.054534+0000","last_change":"2024-09-12T00:02:07.169559+0000","last_active":"2024-09-12T00:37:11.054534+0000","last_peered":"2024-09-12T00:37:11.054534+0000","last_clean":"2024-09-12T00:37:11.054534+0000","last_became_active":"2024-09-12T00:02:07.169266+0000","last_became_peered":"2024-09-12T00:02:07.169266+0000","last_unstale":"2024-09-12T00:37:11.054534+0000","last_undegraded":"2024-09-12T00:37:11.054534+0000","last_fullsized":"2024-09-12T00:37:11.054534+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:08.775255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":294,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'183","reported_seq":777,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:00.677198+0000","last_change":"2024-09-12T00:01:59.150196+0000","last_active":"2024-09-12T00:37:00.677198+0000","last_peered":"2024-09-12T00:37:00.677198+0000","last_clean":"2024-09-12T00:37:00.677198+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:37:00.677198+0000","last_undegraded":"2024-09-12T00:37:00.677198+0000","last_fullsized":"2024-09-12T00:37:00.677198+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:58.771289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":689,"num_write":284,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'370","reported_seq":1085,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.363565+0000","last_change":"2024-09-12T00:01:57.162027+0000","last_active":"2024-09-12T00:37:09.363565+0000","last_peered":"2024-09-12T00:37:09.363565+0000","last_clean":"2024-09-12T00:37:09.363565+0000","last_became_active":"2024-09-12T00:01:57.161612+0000","last_became_peered":"2024-09-12T00:01:57.161612+0000","last_unstale":"2024-09-12T00:37:09.363565+0000","last_undegraded":"2024-09-12T00:37:09.363565+0000","last_fullsized":"2024-09-12T00:37:09.363565+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:46.162850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6737995,"num_objects":82,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":696,"num_read_kb":15126,"num_write":1432,"num_write_kb":40840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:51.509280+0000","last_change":"2024-09-12T00:02:01.145374+0000","last_active":"2024-09-12T00:35:51.509280+0000","last_peered":"2024-09-12T00:35:51.509280+0000","last_clean":"2024-09-12T00:35:51.509280+0000","last_became_active":"2024-09-12T00:02:01.144558+0000","last_became_peered":"2024-09-12T00:02:01.144558+0000","last_unstale":"2024-09-12T00:35:51.509280+0000","last_undegraded":"2024-09-12T00:35:51.509280+0000","last_fullsized":"2024-09-12T00:35:51.509280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:59.388355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'258","reported_seq":800,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.519655+0000","last_change":"2024-09-12T00:02:03.154789+0000","last_active":"2024-09-12T00:37:04.519655+0000","last_peered":"2024-09-12T00:37:04.519655+0000","last_clean":"2024-09-12T00:37:04.519655+0000","last_became_active":"2024-09-12T00:02:03.154477+0000","last_became_peered":"2024-09-12T00:02:03.154477+0000","last_unstale":"2024-09-12T00:37:04.519655+0000","last_undegraded":"2024-09-12T00:37:04.519655+0000","last_fullsized":"2024-09-12T00:37:04.519655+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:25.591233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60035,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":949,"num_write":360,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.382052+0000","last_change":"2024-09-12T00:02:05.166486+0000","last_active":"2024-09-12T00:34:34.382052+0000","last_peered":"2024-09-12T00:34:34.382052+0000","last_clean":"2024-09-12T00:34:34.382052+0000","last_became_active":"2024-09-12T00:02:05.166141+0000","last_became_peered":"2024-09-12T00:02:05.166141+0000","last_unstale":"2024-09-12T00:34:34.382052+0000","last_undegraded":"2024-09-12T00:34:34.382052+0000","last_fullsized":"2024-09-12T00:34:34.382052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:12.751964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'186","reported_seq":1324,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.932224+0000","last_change":"2024-09-12T00:02:07.170137+0000","last_active":"2024-09-12T00:37:21.932224+0000","last_peered":"2024-09-12T00:37:21.932224+0000","last_clean":"2024-09-12T00:37:21.932224+0000","last_became_active":"2024-09-12T00:02:07.169812+0000","last_became_peered":"2024-09-12T00:02:07.169812+0000","last_unstale":"2024-09-12T00:37:21.932224+0000","last_undegraded":"2024-09-12T00:37:21.932224+0000","last_fullsized":"2024-09-12T00:37:21.932224+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:18.008023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1006,"num_read_kb":951,"num_write":452,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'117","reported_seq":665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.914183+0000","last_change":"2024-09-12T00:01:59.148574+0000","last_active":"2024-09-12T00:37:08.914183+0000","last_peered":"2024-09-12T00:37:08.914183+0000","last_clean":"2024-09-12T00:37:08.914183+0000","last_became_active":"2024-09-12T00:01:59.148253+0000","last_became_peered":"2024-09-12T00:01:59.148253+0000","last_unstale":"2024-09-12T00:37:08.914183+0000","last_undegraded":"2024-09-12T00:37:08.914183+0000","last_fullsized":"2024-09-12T00:37:08.914183+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:57.621477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":405,"num_write":165,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'320","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:38.904642+0000","last_change":"2024-09-12T00:01:57.138855+0000","last_active":"2024-09-12T00:36:38.904642+0000","last_peered":"2024-09-12T00:36:38.904642+0000","last_clean":"2024-09-12T00:36:38.904642+0000","last_became_active":"2024-09-12T00:01:57.138386+0000","last_became_peered":"2024-09-12T00:01:57.138386+0000","last_unstale":"2024-09-12T00:36:38.904642+0000","last_undegraded":"2024-09-12T00:36:38.904642+0000","last_fullsized":"2024-09-12T00:36:38.904642+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:56.658569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10748696,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":602,"num_read_kb":37451,"num_write":1125,"num_write_kb":32715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.513932+0000","last_change":"2024-09-12T00:02:01.153600+0000","last_active":"2024-09-12T00:35:57.513932+0000","last_peered":"2024-09-12T00:35:57.513932+0000","last_clean":"2024-09-12T00:35:57.513932+0000","last_became_active":"2024-09-12T00:02:01.153306+0000","last_became_peered":"2024-09-12T00:02:01.153306+0000","last_unstale":"2024-09-12T00:35:57.513932+0000","last_undegraded":"2024-09-12T00:35:57.513932+0000","last_fullsized":"2024-09-12T00:35:57.513932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:16.790631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'280","reported_seq":855,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.401570+0000","last_change":"2024-09-12T00:02:03.158753+0000","last_active":"2024-09-12T00:37:04.401570+0000","last_peered":"2024-09-12T00:37:04.401570+0000","last_clean":"2024-09-12T00:37:04.401570+0000","last_became_active":"2024-09-12T00:02:03.158379+0000","last_became_peered":"2024-09-12T00:02:03.158379+0000","last_unstale":"2024-09-12T00:37:04.401570+0000","last_undegraded":"2024-09-12T00:37:04.401570+0000","last_fullsized":"2024-09-12T00:37:04.401570+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:08.601813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60004,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":467,"num_read_kb":943,"num_write":374,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:37.502005+0000","last_change":"2024-09-12T00:02:05.160180+0000","last_active":"2024-09-12T00:34:37.502005+0000","last_peered":"2024-09-12T00:34:37.502005+0000","last_clean":"2024-09-12T00:34:37.502005+0000","last_became_active":"2024-09-12T00:02:05.159854+0000","last_became_peered":"2024-09-12T00:02:05.159854+0000","last_unstale":"2024-09-12T00:34:37.502005+0000","last_undegraded":"2024-09-12T00:34:37.502005+0000","last_fullsized":"2024-09-12T00:34:37.502005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.989519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'131","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.590853+0000","last_change":"2024-09-12T00:02:07.171050+0000","last_active":"2024-09-12T00:38:27.590853+0000","last_peered":"2024-09-12T00:38:27.590853+0000","last_clean":"2024-09-12T00:38:27.590853+0000","last_became_active":"2024-09-12T00:02:07.170727+0000","last_became_peered":"2024-09-12T00:02:07.170727+0000","last_unstale":"2024-09-12T00:38:27.590853+0000","last_undegraded":"2024-09-12T00:38:27.590853+0000","last_fullsized":"2024-09-12T00:38:27.590853+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:03.358486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":129,"num_write":315,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'247","reported_seq":907,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:49.863461+0000","last_change":"2024-09-12T00:01:59.145783+0000","last_active":"2024-09-12T00:36:49.863461+0000","last_peered":"2024-09-12T00:36:49.863461+0000","last_clean":"2024-09-12T00:36:49.863461+0000","last_became_active":"2024-09-12T00:01:59.145502+0000","last_became_peered":"2024-09-12T00:01:59.145502+0000","last_unstale":"2024-09-12T00:36:49.863461+0000","last_undegraded":"2024-09-12T00:36:49.863461+0000","last_fullsized":"2024-09-12T00:36:49.863461+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:15.171878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1128,"num_read_kb":927,"num_write":363,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'306","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:49.654143+0000","last_change":"2024-09-12T00:01:57.159976+0000","last_active":"2024-09-12T00:36:49.654143+0000","last_peered":"2024-09-12T00:36:49.654143+0000","last_clean":"2024-09-12T00:36:49.654143+0000","last_became_active":"2024-09-12T00:01:57.159487+0000","last_became_peered":"2024-09-12T00:01:57.159487+0000","last_unstale":"2024-09-12T00:36:49.654143+0000","last_undegraded":"2024-09-12T00:36:49.654143+0000","last_fullsized":"2024-09-12T00:36:49.654143+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:30.085074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16806712,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":510,"num_read_kb":54881,"num_write":1082,"num_write_kb":38301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'150","reported_seq":696,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.498309+0000","last_change":"2024-09-12T00:01:59.153656+0000","last_active":"2024-09-12T00:34:29.498309+0000","last_peered":"2024-09-12T00:34:29.498309+0000","last_clean":"2024-09-12T00:34:29.498309+0000","last_became_active":"2024-09-12T00:01:59.153340+0000","last_became_peered":"2024-09-12T00:01:59.153340+0000","last_unstale":"2024-09-12T00:34:29.498309+0000","last_undegraded":"2024-09-12T00:34:29.498309+0000","last_fullsized":"2024-09-12T00:34:29.498309+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:17.663369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":542,"num_write":243,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'257","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.292767+0000","last_change":"2024-09-12T00:01:57.152880+0000","last_active":"2024-09-12T00:37:07.292767+0000","last_peered":"2024-09-12T00:37:07.292767+0000","last_clean":"2024-09-12T00:37:07.292767+0000","last_became_active":"2024-09-12T00:01:57.152522+0000","last_became_peered":"2024-09-12T00:01:57.152522+0000","last_unstale":"2024-09-12T00:37:07.292767+0000","last_undegraded":"2024-09-12T00:37:07.292767+0000","last_fullsized":"2024-09-12T00:37:07.292767+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:20.467716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12224787,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":507,"num_read_kb":16299,"num_write":978,"num_write_kb":36902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'216","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:10.173233+0000","last_change":"2024-09-12T00:01:59.146252+0000","last_active":"2024-09-12T00:38:10.173233+0000","last_peered":"2024-09-12T00:38:10.173233+0000","last_clean":"2024-09-12T00:38:10.173233+0000","last_became_active":"2024-09-12T00:01:59.145971+0000","last_became_peered":"2024-09-12T00:01:59.145971+0000","last_unstale":"2024-09-12T00:38:10.173233+0000","last_undegraded":"2024-09-12T00:38:10.173233+0000","last_fullsized":"2024-09-12T00:38:10.173233+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:57.400027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":962,"num_read_kb":786,"num_write":321,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'290","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.821238+0000","last_change":"2024-09-12T00:01:57.168090+0000","last_active":"2024-09-12T00:36:56.821238+0000","last_peered":"2024-09-12T00:36:56.821238+0000","last_clean":"2024-09-12T00:36:56.821238+0000","last_became_active":"2024-09-12T00:01:57.167651+0000","last_became_peered":"2024-09-12T00:01:57.167651+0000","last_unstale":"2024-09-12T00:36:56.821238+0000","last_undegraded":"2024-09-12T00:36:56.821238+0000","last_fullsized":"2024-09-12T00:36:56.821238+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:47.430232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327545,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":424,"num_read_kb":6602,"num_write":1089,"num_write_kb":24145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'167","reported_seq":749,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.289614+0000","last_change":"2024-09-12T00:01:59.147316+0000","last_active":"2024-09-12T00:37:09.289614+0000","last_peered":"2024-09-12T00:37:09.289614+0000","last_clean":"2024-09-12T00:37:09.289614+0000","last_became_active":"2024-09-12T00:01:59.146794+0000","last_became_peered":"2024-09-12T00:01:59.146794+0000","last_unstale":"2024-09-12T00:37:09.289614+0000","last_undegraded":"2024-09-12T00:37:09.289614+0000","last_fullsized":"2024-09-12T00:37:09.289614+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:19.361635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":586,"num_write":261,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'231","reported_seq":837,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:26.672238+0000","last_change":"2024-09-12T00:01:57.145828+0000","last_active":"2024-09-12T00:36:26.672238+0000","last_peered":"2024-09-12T00:36:26.672238+0000","last_clean":"2024-09-12T00:36:26.672238+0000","last_became_active":"2024-09-12T00:01:57.145410+0000","last_became_peered":"2024-09-12T00:01:57.145410+0000","last_unstale":"2024-09-12T00:36:26.672238+0000","last_undegraded":"2024-09-12T00:36:26.672238+0000","last_fullsized":"2024-09-12T00:36:26.672238+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:43.346735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":472491,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":346,"num_read_kb":533,"num_write":894,"num_write_kb":14360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'571","reported_seq":1333,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.455576+0000","last_change":"2024-09-12T00:01:59.149108+0000","last_active":"2024-09-12T00:37:23.455576+0000","last_peered":"2024-09-12T00:37:23.455576+0000","last_clean":"2024-09-12T00:37:23.455576+0000","last_became_active":"2024-09-12T00:01:59.148605+0000","last_became_peered":"2024-09-12T00:01:59.148605+0000","last_unstale":"2024-09-12T00:37:23.455576+0000","last_undegraded":"2024-09-12T00:37:23.455576+0000","last_fullsized":"2024-09-12T00:37:23.455576+0000","mapping_epoch":26,"log_start":"261'500","ondisk_log_start":"261'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:43.891160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2664,"num_read_kb":2197,"num_write":993,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'265","reported_seq":907,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.346018+0000","last_change":"2024-09-12T00:02:32.865371+0000","last_active":"2024-09-12T00:37:21.346018+0000","last_peered":"2024-09-12T00:37:21.346018+0000","last_clean":"2024-09-12T00:37:21.346018+0000","last_became_active":"2024-09-12T00:02:32.864862+0000","last_became_peered":"2024-09-12T00:02:32.864862+0000","last_unstale":"2024-09-12T00:37:21.346018+0000","last_undegraded":"2024-09-12T00:37:21.346018+0000","last_fullsized":"2024-09-12T00:37:21.346018+0000","mapping_epoch":37,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:46.058961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7461216,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":433,"num_read_kb":62973,"num_write":1029,"num_write_kb":36662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7,3],"acting":[6,0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'192","reported_seq":809,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:28.041132+0000","last_change":"2024-09-12T00:01:59.141664+0000","last_active":"2024-09-12T00:36:28.041132+0000","last_peered":"2024-09-12T00:36:28.041132+0000","last_clean":"2024-09-12T00:36:28.041132+0000","last_became_active":"2024-09-12T00:01:59.141383+0000","last_became_peered":"2024-09-12T00:01:59.141383+0000","last_unstale":"2024-09-12T00:36:28.041132+0000","last_undegraded":"2024-09-12T00:36:28.041132+0000","last_fullsized":"2024-09-12T00:36:28.041132+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:49.143020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":715,"num_write":298,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'277","reported_seq":931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.389271+0000","last_change":"2024-09-12T00:01:57.152496+0000","last_active":"2024-09-12T00:37:02.389271+0000","last_peered":"2024-09-12T00:37:02.389271+0000","last_clean":"2024-09-12T00:37:02.389271+0000","last_became_active":"2024-09-12T00:01:57.152097+0000","last_became_peered":"2024-09-12T00:01:57.152097+0000","last_unstale":"2024-09-12T00:37:02.389271+0000","last_undegraded":"2024-09-12T00:37:02.389271+0000","last_fullsized":"2024-09-12T00:37:02.389271+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:44.525600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12512919,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":458,"num_read_kb":43886,"num_write":1015,"num_write_kb":36840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'430","reported_seq":1145,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:19.505287+0000","last_change":"2024-09-12T00:01:59.146420+0000","last_active":"2024-09-12T00:35:19.505287+0000","last_peered":"2024-09-12T00:35:19.505287+0000","last_clean":"2024-09-12T00:35:19.505287+0000","last_became_active":"2024-09-12T00:01:59.146117+0000","last_became_peered":"2024-09-12T00:01:59.146117+0000","last_unstale":"2024-09-12T00:35:19.505287+0000","last_undegraded":"2024-09-12T00:35:19.505287+0000","last_fullsized":"2024-09-12T00:35:19.505287+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:14.193284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2179,"num_read_kb":1868,"num_write":729,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'314","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.803528+0000","last_change":"2024-09-12T00:01:57.156353+0000","last_active":"2024-09-12T00:37:10.803528+0000","last_peered":"2024-09-12T00:37:10.803528+0000","last_clean":"2024-09-12T00:37:10.803528+0000","last_became_active":"2024-09-12T00:01:57.156002+0000","last_became_peered":"2024-09-12T00:01:57.156002+0000","last_unstale":"2024-09-12T00:37:10.803528+0000","last_undegraded":"2024-09-12T00:37:10.803528+0000","last_fullsized":"2024-09-12T00:37:10.803528+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:26.168398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19094454,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":607,"num_read_kb":79699,"num_write":1278,"num_write_kb":54312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'216","reported_seq":795,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.099261+0000","last_change":"2024-09-12T00:01:59.155738+0000","last_active":"2024-09-12T00:37:10.099261+0000","last_peered":"2024-09-12T00:37:10.099261+0000","last_clean":"2024-09-12T00:37:10.099261+0000","last_became_active":"2024-09-12T00:01:59.155003+0000","last_became_peered":"2024-09-12T00:01:59.155003+0000","last_unstale":"2024-09-12T00:37:10.099261+0000","last_undegraded":"2024-09-12T00:37:10.099261+0000","last_fullsized":"2024-09-12T00:37:10.099261+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:00.966411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":893,"num_read_kb":718,"num_write":326,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'297","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:55.558835+0000","last_change":"2024-09-12T00:01:57.145897+0000","last_active":"2024-09-12T00:36:55.558835+0000","last_peered":"2024-09-12T00:36:55.558835+0000","last_clean":"2024-09-12T00:36:55.558835+0000","last_became_active":"2024-09-12T00:01:57.145466+0000","last_became_peered":"2024-09-12T00:01:57.145466+0000","last_unstale":"2024-09-12T00:36:55.558835+0000","last_undegraded":"2024-09-12T00:36:55.558835+0000","last_fullsized":"2024-09-12T00:36:55.558835+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:37.023670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651566,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":418,"num_read_kb":3535,"num_write":1109,"num_write_kb":24926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'109","reported_seq":685,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.756770+0000","last_change":"2024-09-12T00:01:59.149307+0000","last_active":"2024-09-12T00:36:54.756770+0000","last_peered":"2024-09-12T00:36:54.756770+0000","last_clean":"2024-09-12T00:36:54.756770+0000","last_became_active":"2024-09-12T00:01:59.149014+0000","last_became_peered":"2024-09-12T00:01:59.149014+0000","last_unstale":"2024-09-12T00:36:54.756770+0000","last_undegraded":"2024-09-12T00:36:54.756770+0000","last_fullsized":"2024-09-12T00:36:54.756770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:10.536874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":492,"num_read_kb":416,"num_write":148,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'333","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.999463+0000","last_change":"2024-09-12T00:01:57.151349+0000","last_active":"2024-09-12T00:37:07.999463+0000","last_peered":"2024-09-12T00:37:07.999463+0000","last_clean":"2024-09-12T00:37:07.999463+0000","last_became_active":"2024-09-12T00:01:57.150980+0000","last_became_peered":"2024-09-12T00:01:57.150980+0000","last_unstale":"2024-09-12T00:37:07.999463+0000","last_undegraded":"2024-09-12T00:37:07.999463+0000","last_fullsized":"2024-09-12T00:37:07.999463+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:09.638039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307913,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":569,"num_read_kb":15521,"num_write":1217,"num_write_kb":17105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'109","reported_seq":703,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.368547+0000","last_change":"2024-09-12T00:01:59.150294+0000","last_active":"2024-09-12T00:37:06.368547+0000","last_peered":"2024-09-12T00:37:06.368547+0000","last_clean":"2024-09-12T00:37:06.368547+0000","last_became_active":"2024-09-12T00:01:59.149341+0000","last_became_peered":"2024-09-12T00:01:59.149341+0000","last_unstale":"2024-09-12T00:37:06.368547+0000","last_undegraded":"2024-09-12T00:37:06.368547+0000","last_fullsized":"2024-09-12T00:37:06.368547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:43.661734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":504,"num_read_kb":434,"num_write":171,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'286","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.566844+0000","last_change":"2024-09-12T00:02:32.863517+0000","last_active":"2024-09-12T00:37:10.566844+0000","last_peered":"2024-09-12T00:37:10.566844+0000","last_clean":"2024-09-12T00:37:10.566844+0000","last_became_active":"2024-09-12T00:02:32.863077+0000","last_became_peered":"2024-09-12T00:02:32.863077+0000","last_unstale":"2024-09-12T00:37:10.566844+0000","last_undegraded":"2024-09-12T00:37:10.566844+0000","last_fullsized":"2024-09-12T00:37:10.566844+0000","mapping_epoch":37,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:26.806451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2600321,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":473,"num_read_kb":11923,"num_write":1086,"num_write_kb":27282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,7],"acting":[5,6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'269","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.154723+0000","last_change":"2024-09-12T00:01:59.159517+0000","last_active":"2024-09-12T00:36:54.154723+0000","last_peered":"2024-09-12T00:36:54.154723+0000","last_clean":"2024-09-12T00:36:54.154723+0000","last_became_active":"2024-09-12T00:01:59.159226+0000","last_became_peered":"2024-09-12T00:01:59.159226+0000","last_unstale":"2024-09-12T00:36:54.154723+0000","last_undegraded":"2024-09-12T00:36:54.154723+0000","last_fullsized":"2024-09-12T00:36:54.154723+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:44.957681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1182,"num_read_kb":958,"num_write":434,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'317","reported_seq":977,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.460978+0000","last_change":"2024-09-12T00:01:57.148465+0000","last_active":"2024-09-12T00:38:36.460978+0000","last_peered":"2024-09-12T00:38:36.460978+0000","last_clean":"2024-09-12T00:38:36.460978+0000","last_became_active":"2024-09-12T00:01:57.148038+0000","last_became_peered":"2024-09-12T00:01:57.148038+0000","last_unstale":"2024-09-12T00:38:36.460978+0000","last_undegraded":"2024-09-12T00:38:36.460978+0000","last_fullsized":"2024-09-12T00:38:36.460978+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:42.798082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22023789,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":491,"num_read_kb":81303,"num_write":1097,"num_write_kb":56822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'244","reported_seq":815,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:17.296585+0000","last_change":"2024-09-12T00:01:59.154559+0000","last_active":"2024-09-12T00:36:17.296585+0000","last_peered":"2024-09-12T00:36:17.296585+0000","last_clean":"2024-09-12T00:36:17.296585+0000","last_became_active":"2024-09-12T00:01:59.154258+0000","last_became_peered":"2024-09-12T00:01:59.154258+0000","last_unstale":"2024-09-12T00:36:17.296585+0000","last_undegraded":"2024-09-12T00:36:17.296585+0000","last_fullsized":"2024-09-12T00:36:17.296585+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:13.431395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":900,"num_write":421,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'342","reported_seq":996,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.521995+0000","last_change":"2024-09-12T00:01:57.143175+0000","last_active":"2024-09-12T00:38:37.521995+0000","last_peered":"2024-09-12T00:38:37.521995+0000","last_clean":"2024-09-12T00:38:37.521995+0000","last_became_active":"2024-09-12T00:01:57.142713+0000","last_became_peered":"2024-09-12T00:01:57.142713+0000","last_unstale":"2024-09-12T00:38:37.521995+0000","last_undegraded":"2024-09-12T00:38:37.521995+0000","last_fullsized":"2024-09-12T00:38:37.521995+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:53.401721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11929727,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":492,"num_read_kb":36569,"num_write":1099,"num_write_kb":39253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'210","reported_seq":845,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:15.454384+0000","last_change":"2024-09-12T00:01:59.155267+0000","last_active":"2024-09-12T00:36:15.454384+0000","last_peered":"2024-09-12T00:36:15.454384+0000","last_clean":"2024-09-12T00:36:15.454384+0000","last_became_active":"2024-09-12T00:01:59.154931+0000","last_became_peered":"2024-09-12T00:01:59.154931+0000","last_unstale":"2024-09-12T00:36:15.454384+0000","last_undegraded":"2024-09-12T00:36:15.454384+0000","last_fullsized":"2024-09-12T00:36:15.454384+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:10.981627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":786,"num_write":317,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'288","reported_seq":983,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.160663+0000","last_change":"2024-09-12T00:01:57.142655+0000","last_active":"2024-09-12T00:37:06.160663+0000","last_peered":"2024-09-12T00:37:06.160663+0000","last_clean":"2024-09-12T00:37:06.160663+0000","last_became_active":"2024-09-12T00:01:57.142082+0000","last_became_peered":"2024-09-12T00:01:57.142082+0000","last_unstale":"2024-09-12T00:37:06.160663+0000","last_undegraded":"2024-09-12T00:37:06.160663+0000","last_fullsized":"2024-09-12T00:37:06.160663+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:37.032607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5484013,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":553,"num_read_kb":3429,"num_write":1130,"num_write_kb":16203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'205","reported_seq":791,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.958424+0000","last_change":"2024-09-12T00:01:59.146609+0000","last_active":"2024-09-12T00:36:50.958424+0000","last_peered":"2024-09-12T00:36:50.958424+0000","last_clean":"2024-09-12T00:36:50.958424+0000","last_became_active":"2024-09-12T00:01:59.146272+0000","last_became_peered":"2024-09-12T00:01:59.146272+0000","last_unstale":"2024-09-12T00:36:50.958424+0000","last_undegraded":"2024-09-12T00:36:50.958424+0000","last_fullsized":"2024-09-12T00:36:50.958424+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:31.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":905,"num_read_kb":736,"num_write":324,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'272","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.006825+0000","last_change":"2024-09-12T00:01:57.165561+0000","last_active":"2024-09-12T00:37:07.006825+0000","last_peered":"2024-09-12T00:37:07.006825+0000","last_clean":"2024-09-12T00:37:07.006825+0000","last_became_active":"2024-09-12T00:01:57.165139+0000","last_became_peered":"2024-09-12T00:01:57.165139+0000","last_unstale":"2024-09-12T00:37:07.006825+0000","last_undegraded":"2024-09-12T00:37:07.006825+0000","last_fullsized":"2024-09-12T00:37:07.006825+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:31.614666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16237229,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":396,"num_read_kb":34173,"num_write":1033,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'210","reported_seq":834,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:51.123390+0000","last_change":"2024-09-12T00:01:59.151886+0000","last_active":"2024-09-12T00:36:51.123390+0000","last_peered":"2024-09-12T00:36:51.123390+0000","last_clean":"2024-09-12T00:36:51.123390+0000","last_became_active":"2024-09-12T00:01:59.151627+0000","last_became_peered":"2024-09-12T00:01:59.151627+0000","last_unstale":"2024-09-12T00:36:51.123390+0000","last_undegraded":"2024-09-12T00:36:51.123390+0000","last_fullsized":"2024-09-12T00:36:51.123390+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:04.332533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":886,"num_read_kb":742,"num_write":315,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'316","reported_seq":1152,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.018590+0000","last_change":"2024-09-12T00:01:57.151733+0000","last_active":"2024-09-12T00:37:09.018590+0000","last_peered":"2024-09-12T00:37:09.018590+0000","last_clean":"2024-09-12T00:37:09.018590+0000","last_became_active":"2024-09-12T00:01:57.151346+0000","last_became_peered":"2024-09-12T00:01:57.151346+0000","last_unstale":"2024-09-12T00:37:09.018590+0000","last_undegraded":"2024-09-12T00:37:09.018590+0000","last_fullsized":"2024-09-12T00:37:09.018590+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:20.828358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":654085,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":896,"num_read_kb":6739,"num_write":1138,"num_write_kb":13731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'4140","reported_seq":4711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:03.256251+0000","last_change":"2024-09-12T00:01:59.158824+0000","last_active":"2024-09-12T00:36:03.256251+0000","last_peered":"2024-09-12T00:36:03.256251+0000","last_clean":"2024-09-12T00:36:03.256251+0000","last_became_active":"2024-09-12T00:01:59.157873+0000","last_became_peered":"2024-09-12T00:01:59.157873+0000","last_unstale":"2024-09-12T00:36:03.256251+0000","last_undegraded":"2024-09-12T00:36:03.256251+0000","last_fullsized":"2024-09-12T00:36:03.256251+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:18.182096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16645,"num_read_kb":13962,"num_write":6214,"num_write_kb":3111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'276","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.390513+0000","last_change":"2024-09-12T00:01:57.165394+0000","last_active":"2024-09-12T00:37:02.390513+0000","last_peered":"2024-09-12T00:37:02.390513+0000","last_clean":"2024-09-12T00:37:02.390513+0000","last_became_active":"2024-09-12T00:01:57.165016+0000","last_became_peered":"2024-09-12T00:01:57.165016+0000","last_unstale":"2024-09-12T00:37:02.390513+0000","last_undegraded":"2024-09-12T00:37:02.390513+0000","last_fullsized":"2024-09-12T00:37:02.390513+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:19.072293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6912807,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":529,"num_read_kb":10231,"num_write":1038,"num_write_kb":39602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'257","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.658178+0000","last_change":"2024-09-12T00:01:57.165458+0000","last_active":"2024-09-12T00:37:21.658178+0000","last_peered":"2024-09-12T00:37:21.658178+0000","last_clean":"2024-09-12T00:37:21.658178+0000","last_became_active":"2024-09-12T00:01:57.165046+0000","last_became_peered":"2024-09-12T00:01:57.165046+0000","last_unstale":"2024-09-12T00:37:21.658178+0000","last_undegraded":"2024-09-12T00:37:21.658178+0000","last_fullsized":"2024-09-12T00:37:21.658178+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:21.899432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9838564,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":540,"num_read_kb":41753,"num_write":920,"num_write_kb":31467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'110","reported_seq":711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.156763+0000","last_change":"2024-09-12T00:01:59.153747+0000","last_active":"2024-09-12T00:37:01.156763+0000","last_peered":"2024-09-12T00:37:01.156763+0000","last_clean":"2024-09-12T00:37:01.156763+0000","last_became_active":"2024-09-12T00:01:59.153454+0000","last_became_peered":"2024-09-12T00:01:59.153454+0000","last_unstale":"2024-09-12T00:37:01.156763+0000","last_undegraded":"2024-09-12T00:37:01.156763+0000","last_fullsized":"2024-09-12T00:37:01.156763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:03.025405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":439,"num_write":164,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'287","reported_seq":1134,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:55.824005+0000","last_change":"2024-09-12T00:01:57.146814+0000","last_active":"2024-09-12T00:36:55.824005+0000","last_peered":"2024-09-12T00:36:55.824005+0000","last_clean":"2024-09-12T00:36:55.824005+0000","last_became_active":"2024-09-12T00:01:57.146320+0000","last_became_peered":"2024-09-12T00:01:57.146320+0000","last_unstale":"2024-09-12T00:36:55.824005+0000","last_undegraded":"2024-09-12T00:36:55.824005+0000","last_fullsized":"2024-09-12T00:36:55.824005+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:48.705647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6392420,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":922,"num_read_kb":6700,"num_write":1115,"num_write_kb":43058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'174","reported_seq":769,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:51.509408+0000","last_change":"2024-09-12T00:01:59.147165+0000","last_active":"2024-09-12T00:35:51.509408+0000","last_peered":"2024-09-12T00:35:51.509408+0000","last_clean":"2024-09-12T00:35:51.509408+0000","last_became_active":"2024-09-12T00:01:59.146876+0000","last_became_peered":"2024-09-12T00:01:59.146876+0000","last_unstale":"2024-09-12T00:35:51.509408+0000","last_undegraded":"2024-09-12T00:35:51.509408+0000","last_fullsized":"2024-09-12T00:35:51.509408+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:19.079900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":808,"num_read_kb":667,"num_write":271,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5901,"num_read_kb":4223,"num_write":1957,"num_write_kb":855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1029,"ondisk_log_size":1029,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":14998,"num_read_kb":14670,"num_write":16815,"num_write_kb":4907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1464,"ondisk_log_size":1464,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":547,"ondisk_log_size":547,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1805913,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":16838,"num_read_kb":32859,"num_write":14199,"num_write_kb":11356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2895872,"data_stored":2407236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2215,"ondisk_log_size":2215,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102638,"num_read_kb":85737,"num_write":37205,"num_write_kb":18751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3973,"ondisk_log_size":3973,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":500731485,"num_objects":4037,"num_object_clones":0,"num_object_copies":16148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4037,"num_whiteouts":0,"num_read":32292,"num_read_kb":1881229,"num_write":68051,"num_write_kb":2075118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":712794112,"data_stored":712794112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4117,"ondisk_log_size":4117,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":75545895,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":126,"num_read_kb":208372,"num_write":142,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139509760,"data_stored":139509031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":82551576,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":118,"num_read_kb":193338,"num_write":140,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159150080,"data_stored":159146047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509887,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":362864,"kb_used_data":147104,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94008976,"statfs":{"total":96636764160,"available":96265191424,"internally_reserved":0,"allocated":150634496,"data_stored":148649093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":220920266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509886,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232772,"kb_used_data":125300,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94139068,"statfs":{"total":96636764160,"available":96398405632,"internally_reserved":0,"allocated":128307200,"data_stored":126300199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509888,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368636,"kb_used_data":120876,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94003204,"statfs":{"total":96636764160,"available":96259280896,"internally_reserved":0,"allocated":123777024,"data_stored":121763089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509886,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356960,"kb_used_data":145296,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94014880,"statfs":{"total":96636764160,"available":96271237120,"internally_reserved":0,"allocated":148783104,"data_stored":146785909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509888,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276212,"kb_used_data":154788,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94095628,"statfs":{"total":96636764160,"available":96353923072,"internally_reserved":0,"allocated":158502912,"data_stored":156515299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124320197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509887,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263680,"kb_used_data":142320,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94108160,"statfs":{"total":96636764160,"available":96366755840,"internally_reserved":0,"allocated":145735680,"data_stored":143725067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575294,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":357676,"kb_used_data":141868,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94014164,"statfs":{"total":96636764160,"available":96270503936,"internally_reserved":0,"allocated":145272832,"data_stored":143315716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575296,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":386088,"kb_used_data":102232,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":93985752,"statfs":{"total":96636764160,"available":96241410048,"internally_reserved":0,"allocated":104685568,"data_stored":102698639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290650565},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":101195776,"data_stored":101195776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82489344,"data_stored":82489344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":122732544,"data_stored":122732544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":107925504,"data_stored":107925504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61046784,"data_stored":61046784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":79736832,"data_stored":79736832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":82853888,"data_stored":82853888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":74813440,"data_stored":74813440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":483645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":430667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":123788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":246233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":97946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":390718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":350241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":283998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30076928,"data_stored":30074353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":19972096,"data_stored":19971367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36749312,"data_stored":36748583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6340608,"data_stored":6339879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":34603008,"data_stored":34603008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:38:38.788 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:38:39.142 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:38:39.154 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T00:38:39.156 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":1364,"stamp":"2024-09-12T00:38:37.627546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661242444,"num_objects":4425,"num_object_clones":0,"num_object_copies":16924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4425,"num_whiteouts":0,"num_read":175391,"num_read_kb":2423358,"num_write":138652,"num_write_kb":2382567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13600,"ondisk_log_size":13600,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2604888,"kb_used_data":1079784,"kb_used_omap":12,"kb_used_meta":1524915,"kb_avail":752369832,"statfs":{"total":773094113280,"available":770426707968,"internally_reserved":0,"allocated":1105698816,"data_stored":1089753011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1561513520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-31998863,"num_objects":-369,"num_object_clones":0,"num_object_copies":-1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-369,"num_whiteouts":0,"num_read":530,"num_read_kb":617,"num_write":436,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005642"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.383088+0000","last_change":"2024-09-12T00:27:17.580532+0000","last_active":"2024-09-12T00:34:49.383088+0000","last_peered":"2024-09-12T00:34:49.383088+0000","last_clean":"2024-09-12T00:34:49.383088+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:34:49.383088+0000","last_undegraded":"2024-09-12T00:34:49.383088+0000","last_fullsized":"2024-09-12T00:34:49.383088+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:42.988688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'10","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.315467+0000","last_change":"2024-09-12T00:17:03.214457+0000","last_active":"2024-09-12T00:38:36.315467+0000","last_peered":"2024-09-12T00:38:36.315467+0000","last_clean":"2024-09-12T00:38:36.315467+0000","last_became_active":"2024-09-12T00:17:03.213906+0000","last_became_peered":"2024-09-12T00:17:03.213906+0000","last_unstale":"2024-09-12T00:38:36.315467+0000","last_undegraded":"2024-09-12T00:38:36.315467+0000","last_fullsized":"2024-09-12T00:38:36.315467+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:43.554284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":18831,"num_write":10,"num_write_kb":11989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.498249+0000","last_change":"2024-09-12T00:17:00.182788+0000","last_active":"2024-09-12T00:34:29.498249+0000","last_peered":"2024-09-12T00:34:29.498249+0000","last_clean":"2024-09-12T00:34:29.498249+0000","last_became_active":"2024-09-12T00:17:00.182510+0000","last_became_peered":"2024-09-12T00:17:00.182510+0000","last_unstale":"2024-09-12T00:34:29.498249+0000","last_undegraded":"2024-09-12T00:34:29.498249+0000","last_fullsized":"2024-09-12T00:34:29.498249+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:10.766253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'18","reported_seq":91,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:27.517806+0000","last_change":"2024-09-12T00:15:34.415639+0000","last_active":"2024-09-12T00:36:27.517806+0000","last_peered":"2024-09-12T00:36:27.517806+0000","last_clean":"2024-09-12T00:36:27.517806+0000","last_became_active":"2024-09-12T00:15:34.415364+0000","last_became_peered":"2024-09-12T00:15:34.415364+0000","last_unstale":"2024-09-12T00:36:27.517806+0000","last_undegraded":"2024-09-12T00:36:27.517806+0000","last_fullsized":"2024-09-12T00:36:27.517806+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:04.462246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.500985+0000","last_change":"2024-09-12T00:27:17.581875+0000","last_active":"2024-09-12T00:34:49.500985+0000","last_peered":"2024-09-12T00:34:49.500985+0000","last_clean":"2024-09-12T00:34:49.500985+0000","last_became_active":"2024-09-12T00:27:17.581520+0000","last_became_peered":"2024-09-12T00:27:17.581520+0000","last_unstale":"2024-09-12T00:34:49.500985+0000","last_undegraded":"2024-09-12T00:34:49.500985+0000","last_fullsized":"2024-09-12T00:34:49.500985+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:28.315835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'1","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615836+0000","last_change":"2024-09-12T00:17:03.206913+0000","last_active":"2024-09-12T00:34:34.615836+0000","last_peered":"2024-09-12T00:34:34.615836+0000","last_clean":"2024-09-12T00:34:34.615836+0000","last_became_active":"2024-09-12T00:17:03.206566+0000","last_became_peered":"2024-09-12T00:17:03.206566+0000","last_unstale":"2024-09-12T00:34:34.615836+0000","last_undegraded":"2024-09-12T00:34:34.615836+0000","last_fullsized":"2024-09-12T00:34:34.615836+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.057828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'2","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.498577+0000","last_change":"2024-09-12T00:17:00.176346+0000","last_active":"2024-09-12T00:34:29.498577+0000","last_peered":"2024-09-12T00:34:29.498577+0000","last_clean":"2024-09-12T00:34:29.498577+0000","last_became_active":"2024-09-12T00:17:00.175196+0000","last_became_peered":"2024-09-12T00:17:00.175196+0000","last_unstale":"2024-09-12T00:34:29.498577+0000","last_undegraded":"2024-09-12T00:34:29.498577+0000","last_fullsized":"2024-09-12T00:34:29.498577+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:52.503715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"258'75","reported_seq":276,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:42.511663+0000","last_change":"2024-09-12T00:15:34.417010+0000","last_active":"2024-09-12T00:35:42.511663+0000","last_peered":"2024-09-12T00:35:42.511663+0000","last_clean":"2024-09-12T00:35:42.511663+0000","last_became_active":"2024-09-12T00:15:34.416706+0000","last_became_peered":"2024-09-12T00:15:34.416706+0000","last_unstale":"2024-09-12T00:35:42.511663+0000","last_undegraded":"2024-09-12T00:35:42.511663+0000","last_fullsized":"2024-09-12T00:35:42.511663+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:28.483679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":462,"num_read_kb":331,"num_write":93,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:31.497481+0000","last_change":"2024-09-12T00:27:17.573237+0000","last_active":"2024-09-12T00:34:31.497481+0000","last_peered":"2024-09-12T00:34:31.497481+0000","last_clean":"2024-09-12T00:34:31.497481+0000","last_became_active":"2024-09-12T00:27:17.572934+0000","last_became_peered":"2024-09-12T00:27:17.572934+0000","last_unstale":"2024-09-12T00:34:31.497481+0000","last_undegraded":"2024-09-12T00:34:31.497481+0000","last_fullsized":"2024-09-12T00:34:31.497481+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:52.238701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'2","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510306+0000","last_change":"2024-09-12T00:17:03.212082+0000","last_active":"2024-09-12T00:35:49.510306+0000","last_peered":"2024-09-12T00:35:49.510306+0000","last_clean":"2024-09-12T00:35:49.510306+0000","last_became_active":"2024-09-12T00:17:03.211755+0000","last_became_peered":"2024-09-12T00:17:03.211755+0000","last_unstale":"2024-09-12T00:35:49.510306+0000","last_undegraded":"2024-09-12T00:35:49.510306+0000","last_fullsized":"2024-09-12T00:35:49.510306+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:11.463541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503282+0000","last_change":"2024-09-12T00:17:00.181734+0000","last_active":"2024-09-12T00:35:04.503282+0000","last_peered":"2024-09-12T00:35:04.503282+0000","last_clean":"2024-09-12T00:35:04.503282+0000","last_became_active":"2024-09-12T00:17:00.181461+0000","last_became_peered":"2024-09-12T00:17:00.181461+0000","last_unstale":"2024-09-12T00:35:04.503282+0000","last_undegraded":"2024-09-12T00:35:04.503282+0000","last_fullsized":"2024-09-12T00:35:04.503282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:40.876171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'16","reported_seq":82,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:34.507625+0000","last_change":"2024-09-12T00:15:34.428333+0000","last_active":"2024-09-12T00:35:34.507625+0000","last_peered":"2024-09-12T00:35:34.507625+0000","last_clean":"2024-09-12T00:35:34.507625+0000","last_became_active":"2024-09-12T00:15:34.428023+0000","last_became_peered":"2024-09-12T00:15:34.428023+0000","last_unstale":"2024-09-12T00:35:34.507625+0000","last_undegraded":"2024-09-12T00:35:34.507625+0000","last_fullsized":"2024-09-12T00:35:34.507625+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:33.470085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499223+0000","last_change":"2024-09-12T00:27:17.577865+0000","last_active":"2024-09-12T00:34:34.499223+0000","last_peered":"2024-09-12T00:34:34.499223+0000","last_clean":"2024-09-12T00:34:34.499223+0000","last_became_active":"2024-09-12T00:27:17.577034+0000","last_became_peered":"2024-09-12T00:27:17.577034+0000","last_unstale":"2024-09-12T00:34:34.499223+0000","last_undegraded":"2024-09-12T00:34:34.499223+0000","last_fullsized":"2024-09-12T00:34:34.499223+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:24.642513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"261'2","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503652+0000","last_change":"2024-09-12T00:17:03.210262+0000","last_active":"2024-09-12T00:35:04.503652+0000","last_peered":"2024-09-12T00:35:04.503652+0000","last_clean":"2024-09-12T00:35:04.503652+0000","last_became_active":"2024-09-12T00:17:03.209945+0000","last_became_peered":"2024-09-12T00:17:03.209945+0000","last_unstale":"2024-09-12T00:35:04.503652+0000","last_undegraded":"2024-09-12T00:35:04.503652+0000","last_fullsized":"2024-09-12T00:35:04.503652+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:00.406310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:46.508609+0000","last_change":"2024-09-12T00:17:00.177502+0000","last_active":"2024-09-12T00:35:46.508609+0000","last_peered":"2024-09-12T00:35:46.508609+0000","last_clean":"2024-09-12T00:35:46.508609+0000","last_became_active":"2024-09-12T00:17:00.176151+0000","last_became_peered":"2024-09-12T00:17:00.176151+0000","last_unstale":"2024-09-12T00:35:46.508609+0000","last_undegraded":"2024-09-12T00:35:46.508609+0000","last_fullsized":"2024-09-12T00:35:46.508609+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:32.829277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'69","reported_seq":229,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.090824+0000","last_change":"2024-09-12T00:15:34.422703+0000","last_active":"2024-09-12T00:36:56.090824+0000","last_peered":"2024-09-12T00:36:56.090824+0000","last_clean":"2024-09-12T00:36:56.090824+0000","last_became_active":"2024-09-12T00:15:34.422426+0000","last_became_peered":"2024-09-12T00:15:34.422426+0000","last_unstale":"2024-09-12T00:36:56.090824+0000","last_undegraded":"2024-09-12T00:36:56.090824+0000","last_fullsized":"2024-09-12T00:36:56.090824+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:50.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":354,"num_read_kb":254,"num_write":121,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:19.505464+0000","last_change":"2024-09-12T00:27:17.579859+0000","last_active":"2024-09-12T00:35:19.505464+0000","last_peered":"2024-09-12T00:35:19.505464+0000","last_clean":"2024-09-12T00:35:19.505464+0000","last_became_active":"2024-09-12T00:27:17.579540+0000","last_became_peered":"2024-09-12T00:27:17.579540+0000","last_unstale":"2024-09-12T00:35:19.505464+0000","last_undegraded":"2024-09-12T00:35:19.505464+0000","last_fullsized":"2024-09-12T00:35:19.505464+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:23.867988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:04.377127+0000","last_change":"2024-09-12T00:17:03.220542+0000","last_active":"2024-09-12T00:34:04.377127+0000","last_peered":"2024-09-12T00:34:04.377127+0000","last_clean":"2024-09-12T00:34:04.377127+0000","last_became_active":"2024-09-12T00:17:03.218684+0000","last_became_peered":"2024-09-12T00:17:03.218684+0000","last_unstale":"2024-09-12T00:34:04.377127+0000","last_undegraded":"2024-09-12T00:34:04.377127+0000","last_fullsized":"2024-09-12T00:34:04.377127+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:18.120265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'16","reported_seq":71,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:54.493830+0000","last_change":"2024-09-12T00:17:00.186275+0000","last_active":"2024-09-12T00:33:54.493830+0000","last_peered":"2024-09-12T00:33:54.493830+0000","last_clean":"2024-09-12T00:33:54.493830+0000","last_became_active":"2024-09-12T00:17:00.185974+0000","last_became_peered":"2024-09-12T00:17:00.185974+0000","last_unstale":"2024-09-12T00:33:54.493830+0000","last_undegraded":"2024-09-12T00:33:54.493830+0000","last_fullsized":"2024-09-12T00:33:54.493830+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:40.351049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":38916,"num_write":31,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'44","reported_seq":155,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:34.507543+0000","last_change":"2024-09-12T00:15:34.423404+0000","last_active":"2024-09-12T00:35:34.507543+0000","last_peered":"2024-09-12T00:35:34.507543+0000","last_clean":"2024-09-12T00:35:34.507543+0000","last_became_active":"2024-09-12T00:15:34.423149+0000","last_became_peered":"2024-09-12T00:15:34.423149+0000","last_unstale":"2024-09-12T00:35:34.507543+0000","last_undegraded":"2024-09-12T00:35:34.507543+0000","last_fullsized":"2024-09-12T00:35:34.507543+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:23.508263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":150,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:37.510807+0000","last_change":"2024-09-12T00:27:17.575993+0000","last_active":"2024-09-12T00:35:37.510807+0000","last_peered":"2024-09-12T00:35:37.510807+0000","last_clean":"2024-09-12T00:35:37.510807+0000","last_became_active":"2024-09-12T00:27:17.575513+0000","last_became_peered":"2024-09-12T00:27:17.575513+0000","last_unstale":"2024-09-12T00:35:37.510807+0000","last_undegraded":"2024-09-12T00:35:37.510807+0000","last_fullsized":"2024-09-12T00:35:37.510807+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:31.106786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.376944+0000","last_change":"2024-09-12T00:17:03.220037+0000","last_active":"2024-09-12T00:33:59.376944+0000","last_peered":"2024-09-12T00:33:59.376944+0000","last_clean":"2024-09-12T00:33:59.376944+0000","last_became_active":"2024-09-12T00:17:03.219058+0000","last_became_peered":"2024-09-12T00:17:03.219058+0000","last_unstale":"2024-09-12T00:33:59.376944+0000","last_undegraded":"2024-09-12T00:33:59.376944+0000","last_fullsized":"2024-09-12T00:33:59.376944+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:44.822354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.377013+0000","last_change":"2024-09-12T00:17:00.183145+0000","last_active":"2024-09-12T00:33:59.377013+0000","last_peered":"2024-09-12T00:33:59.377013+0000","last_clean":"2024-09-12T00:33:59.377013+0000","last_became_active":"2024-09-12T00:17:00.182830+0000","last_became_peered":"2024-09-12T00:17:00.182830+0000","last_unstale":"2024-09-12T00:33:59.377013+0000","last_undegraded":"2024-09-12T00:33:59.377013+0000","last_fullsized":"2024-09-12T00:33:59.377013+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:04.640403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'10","reported_seq":67,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:34.625266+0000","last_change":"2024-09-12T00:15:34.421131+0000","last_active":"2024-09-12T00:35:34.625266+0000","last_peered":"2024-09-12T00:35:34.625266+0000","last_clean":"2024-09-12T00:35:34.625266+0000","last_became_active":"2024-09-12T00:15:34.420841+0000","last_became_peered":"2024-09-12T00:15:34.420841+0000","last_unstale":"2024-09-12T00:35:34.625266+0000","last_undegraded":"2024-09-12T00:35:34.625266+0000","last_fullsized":"2024-09-12T00:35:34.625266+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:18.021901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.618279+0000","last_change":"2024-09-12T00:27:17.583663+0000","last_active":"2024-09-12T00:34:49.618279+0000","last_peered":"2024-09-12T00:34:49.618279+0000","last_clean":"2024-09-12T00:34:49.618279+0000","last_became_active":"2024-09-12T00:27:17.583300+0000","last_became_peered":"2024-09-12T00:27:17.583300+0000","last_unstale":"2024-09-12T00:34:49.618279+0000","last_undegraded":"2024-09-12T00:34:49.618279+0000","last_fullsized":"2024-09-12T00:34:49.618279+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:10.632365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615804+0000","last_change":"2024-09-12T00:17:03.212176+0000","last_active":"2024-09-12T00:34:34.615804+0000","last_peered":"2024-09-12T00:34:34.615804+0000","last_clean":"2024-09-12T00:34:34.615804+0000","last_became_active":"2024-09-12T00:17:03.211869+0000","last_became_peered":"2024-09-12T00:17:03.211869+0000","last_unstale":"2024-09-12T00:34:34.615804+0000","last_undegraded":"2024-09-12T00:34:34.615804+0000","last_fullsized":"2024-09-12T00:34:34.615804+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:39.796531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.380585+0000","last_change":"2024-09-12T00:17:00.181340+0000","last_active":"2024-09-12T00:34:29.380585+0000","last_peered":"2024-09-12T00:34:29.380585+0000","last_clean":"2024-09-12T00:34:29.380585+0000","last_became_active":"2024-09-12T00:17:00.180995+0000","last_became_peered":"2024-09-12T00:17:00.180995+0000","last_unstale":"2024-09-12T00:34:29.380585+0000","last_undegraded":"2024-09-12T00:34:29.380585+0000","last_fullsized":"2024-09-12T00:34:29.380585+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:35.862245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"261'23","reported_seq":101,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.468546+0000","last_change":"2024-09-12T00:15:34.417460+0000","last_active":"2024-09-12T00:36:56.468546+0000","last_peered":"2024-09-12T00:36:56.468546+0000","last_clean":"2024-09-12T00:36:56.468546+0000","last_became_active":"2024-09-12T00:15:34.417149+0000","last_became_peered":"2024-09-12T00:15:34.417149+0000","last_unstale":"2024-09-12T00:36:56.468546+0000","last_undegraded":"2024-09-12T00:36:56.468546+0000","last_fullsized":"2024-09-12T00:36:56.468546+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:57.189731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.383151+0000","last_change":"2024-09-12T00:27:17.579098+0000","last_active":"2024-09-12T00:34:49.383151+0000","last_peered":"2024-09-12T00:34:49.383151+0000","last_clean":"2024-09-12T00:34:49.383151+0000","last_became_active":"2024-09-12T00:27:17.578739+0000","last_became_peered":"2024-09-12T00:27:17.578739+0000","last_unstale":"2024-09-12T00:34:49.383151+0000","last_undegraded":"2024-09-12T00:34:49.383151+0000","last_fullsized":"2024-09-12T00:34:49.383151+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:48.348663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498899+0000","last_change":"2024-09-12T00:17:03.213329+0000","last_active":"2024-09-12T00:34:34.498899+0000","last_peered":"2024-09-12T00:34:34.498899+0000","last_clean":"2024-09-12T00:34:34.498899+0000","last_became_active":"2024-09-12T00:17:03.213071+0000","last_became_peered":"2024-09-12T00:17:03.213071+0000","last_unstale":"2024-09-12T00:34:34.498899+0000","last_undegraded":"2024-09-12T00:34:34.498899+0000","last_fullsized":"2024-09-12T00:34:34.498899+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:46.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.497692+0000","last_change":"2024-09-12T00:17:00.178668+0000","last_active":"2024-09-12T00:34:29.497692+0000","last_peered":"2024-09-12T00:34:29.497692+0000","last_clean":"2024-09-12T00:34:29.497692+0000","last_became_active":"2024-09-12T00:17:00.178279+0000","last_became_peered":"2024-09-12T00:17:00.178279+0000","last_unstale":"2024-09-12T00:34:29.497692+0000","last_undegraded":"2024-09-12T00:34:29.497692+0000","last_fullsized":"2024-09-12T00:34:29.497692+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:59.897917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'24","reported_seq":104,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:54.501600+0000","last_change":"2024-09-12T00:15:34.420370+0000","last_active":"2024-09-12T00:34:54.501600+0000","last_peered":"2024-09-12T00:34:54.501600+0000","last_clean":"2024-09-12T00:34:54.501600+0000","last_became_active":"2024-09-12T00:15:34.420120+0000","last_became_peered":"2024-09-12T00:15:34.420120+0000","last_unstale":"2024-09-12T00:34:54.501600+0000","last_undegraded":"2024-09-12T00:34:54.501600+0000","last_fullsized":"2024-09-12T00:34:54.501600+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:10.354241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.497122+0000","last_change":"2024-09-12T00:27:17.578396+0000","last_active":"2024-09-12T00:34:19.497122+0000","last_peered":"2024-09-12T00:34:19.497122+0000","last_clean":"2024-09-12T00:34:19.497122+0000","last_became_active":"2024-09-12T00:27:17.577671+0000","last_became_peered":"2024-09-12T00:27:17.577671+0000","last_unstale":"2024-09-12T00:34:19.497122+0000","last_undegraded":"2024-09-12T00:34:19.497122+0000","last_fullsized":"2024-09-12T00:34:19.497122+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:02.287213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.494167+0000","last_change":"2024-09-12T00:17:03.214034+0000","last_active":"2024-09-12T00:33:59.494167+0000","last_peered":"2024-09-12T00:33:59.494167+0000","last_clean":"2024-09-12T00:33:59.494167+0000","last_became_active":"2024-09-12T00:17:03.213775+0000","last_became_peered":"2024-09-12T00:17:03.213775+0000","last_unstale":"2024-09-12T00:33:59.494167+0000","last_undegraded":"2024-09-12T00:33:59.494167+0000","last_fullsized":"2024-09-12T00:33:59.494167+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:03.713762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'4","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391598+0000","last_change":"2024-09-12T00:17:00.183189+0000","last_active":"2024-09-12T00:35:44.391598+0000","last_peered":"2024-09-12T00:35:44.391598+0000","last_clean":"2024-09-12T00:35:44.391598+0000","last_became_active":"2024-09-12T00:17:00.182842+0000","last_became_peered":"2024-09-12T00:17:00.182842+0000","last_unstale":"2024-09-12T00:35:44.391598+0000","last_undegraded":"2024-09-12T00:35:44.391598+0000","last_fullsized":"2024-09-12T00:35:44.391598+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:45.925037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'14","reported_seq":77,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:57.505085+0000","last_change":"2024-09-12T00:15:34.421873+0000","last_active":"2024-09-12T00:34:57.505085+0000","last_peered":"2024-09-12T00:34:57.505085+0000","last_clean":"2024-09-12T00:34:57.505085+0000","last_became_active":"2024-09-12T00:15:34.421585+0000","last_became_peered":"2024-09-12T00:15:34.421585+0000","last_unstale":"2024-09-12T00:34:57.505085+0000","last_undegraded":"2024-09-12T00:34:57.505085+0000","last_fullsized":"2024-09-12T00:34:57.505085+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:19.525663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.496362+0000","last_change":"2024-09-12T00:27:17.573564+0000","last_active":"2024-09-12T00:34:19.496362+0000","last_peered":"2024-09-12T00:34:19.496362+0000","last_clean":"2024-09-12T00:34:19.496362+0000","last_became_active":"2024-09-12T00:27:17.572899+0000","last_became_peered":"2024-09-12T00:27:17.572899+0000","last_unstale":"2024-09-12T00:34:19.496362+0000","last_undegraded":"2024-09-12T00:34:19.496362+0000","last_fullsized":"2024-09-12T00:34:19.496362+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.537722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509411+0000","last_change":"2024-09-12T00:17:03.217326+0000","last_active":"2024-09-12T00:35:44.509411+0000","last_peered":"2024-09-12T00:35:44.509411+0000","last_clean":"2024-09-12T00:35:44.509411+0000","last_became_active":"2024-09-12T00:17:03.217052+0000","last_became_peered":"2024-09-12T00:17:03.217052+0000","last_unstale":"2024-09-12T00:35:44.509411+0000","last_undegraded":"2024-09-12T00:35:44.509411+0000","last_fullsized":"2024-09-12T00:35:44.509411+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:57.870587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:54.375795+0000","last_change":"2024-09-12T00:17:00.181429+0000","last_active":"2024-09-12T00:33:54.375795+0000","last_peered":"2024-09-12T00:33:54.375795+0000","last_clean":"2024-09-12T00:33:54.375795+0000","last_became_active":"2024-09-12T00:17:00.181082+0000","last_became_peered":"2024-09-12T00:17:00.181082+0000","last_unstale":"2024-09-12T00:33:54.375795+0000","last_undegraded":"2024-09-12T00:33:54.375795+0000","last_fullsized":"2024-09-12T00:33:54.375795+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:14.637476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'32","reported_seq":127,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:57.505046+0000","last_change":"2024-09-12T00:15:34.414194+0000","last_active":"2024-09-12T00:34:57.505046+0000","last_peered":"2024-09-12T00:34:57.505046+0000","last_clean":"2024-09-12T00:34:57.505046+0000","last_became_active":"2024-09-12T00:15:34.413875+0000","last_became_peered":"2024-09-12T00:15:34.413875+0000","last_unstale":"2024-09-12T00:34:57.505046+0000","last_undegraded":"2024-09-12T00:34:57.505046+0000","last_fullsized":"2024-09-12T00:34:57.505046+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:38.268487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":63,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.613353+0000","last_change":"2024-09-12T00:27:17.577218+0000","last_active":"2024-09-12T00:34:19.613353+0000","last_peered":"2024-09-12T00:34:19.613353+0000","last_clean":"2024-09-12T00:34:19.613353+0000","last_became_active":"2024-09-12T00:27:17.576878+0000","last_became_peered":"2024-09-12T00:27:17.576878+0000","last_unstale":"2024-09-12T00:34:19.613353+0000","last_undegraded":"2024-09-12T00:34:19.613353+0000","last_fullsized":"2024-09-12T00:34:19.613353+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:47.322848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.494224+0000","last_change":"2024-09-12T00:17:03.216054+0000","last_active":"2024-09-12T00:33:59.494224+0000","last_peered":"2024-09-12T00:33:59.494224+0000","last_clean":"2024-09-12T00:33:59.494224+0000","last_became_active":"2024-09-12T00:17:03.215625+0000","last_became_peered":"2024-09-12T00:17:03.215625+0000","last_unstale":"2024-09-12T00:33:59.494224+0000","last_undegraded":"2024-09-12T00:33:59.494224+0000","last_fullsized":"2024-09-12T00:33:59.494224+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:53.227970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:54.493546+0000","last_change":"2024-09-12T00:17:00.182907+0000","last_active":"2024-09-12T00:33:54.493546+0000","last_peered":"2024-09-12T00:33:54.493546+0000","last_clean":"2024-09-12T00:33:54.493546+0000","last_became_active":"2024-09-12T00:17:00.182392+0000","last_became_peered":"2024-09-12T00:17:00.182392+0000","last_unstale":"2024-09-12T00:33:54.493546+0000","last_undegraded":"2024-09-12T00:33:54.493546+0000","last_fullsized":"2024-09-12T00:33:54.493546+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:13.824576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:54.501773+0000","last_change":"2024-09-12T00:15:34.419666+0000","last_active":"2024-09-12T00:34:54.501773+0000","last_peered":"2024-09-12T00:34:54.501773+0000","last_clean":"2024-09-12T00:34:54.501773+0000","last_became_active":"2024-09-12T00:15:34.419377+0000","last_became_peered":"2024-09-12T00:15:34.419377+0000","last_unstale":"2024-09-12T00:34:54.501773+0000","last_undegraded":"2024-09-12T00:34:54.501773+0000","last_fullsized":"2024-09-12T00:34:54.501773+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:00.834278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.379164+0000","last_change":"2024-09-12T00:27:17.580695+0000","last_active":"2024-09-12T00:34:19.379164+0000","last_peered":"2024-09-12T00:34:19.379164+0000","last_clean":"2024-09-12T00:34:19.379164+0000","last_became_active":"2024-09-12T00:27:17.580400+0000","last_became_peered":"2024-09-12T00:27:17.580400+0000","last_unstale":"2024-09-12T00:34:19.379164+0000","last_undegraded":"2024-09-12T00:34:19.379164+0000","last_fullsized":"2024-09-12T00:34:19.379164+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:32.333059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"258'5","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.376572+0000","last_change":"2024-09-12T00:17:03.224050+0000","last_active":"2024-09-12T00:33:59.376572+0000","last_peered":"2024-09-12T00:33:59.376572+0000","last_clean":"2024-09-12T00:33:59.376572+0000","last_became_active":"2024-09-12T00:17:03.223700+0000","last_became_peered":"2024-09-12T00:17:03.223700+0000","last_unstale":"2024-09-12T00:33:59.376572+0000","last_undegraded":"2024-09-12T00:33:59.376572+0000","last_fullsized":"2024-09-12T00:33:59.376572+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:20.435420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:54.493928+0000","last_change":"2024-09-12T00:17:00.170090+0000","last_active":"2024-09-12T00:33:54.493928+0000","last_peered":"2024-09-12T00:33:54.493928+0000","last_clean":"2024-09-12T00:33:54.493928+0000","last_became_active":"2024-09-12T00:17:00.169797+0000","last_became_peered":"2024-09-12T00:17:00.169797+0000","last_unstale":"2024-09-12T00:33:54.493928+0000","last_undegraded":"2024-09-12T00:33:54.493928+0000","last_fullsized":"2024-09-12T00:33:54.493928+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:21.374423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'40","reported_seq":151,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:53.994944+0000","last_change":"2024-09-12T00:15:34.422467+0000","last_active":"2024-09-12T00:36:53.994944+0000","last_peered":"2024-09-12T00:36:53.994944+0000","last_clean":"2024-09-12T00:36:53.994944+0000","last_became_active":"2024-09-12T00:15:34.422176+0000","last_became_peered":"2024-09-12T00:15:34.422176+0000","last_unstale":"2024-09-12T00:36:53.994944+0000","last_undegraded":"2024-09-12T00:36:53.994944+0000","last_fullsized":"2024-09-12T00:36:53.994944+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.956475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":149,"num_write":70,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499308+0000","last_change":"2024-09-12T00:27:17.579910+0000","last_active":"2024-09-12T00:34:34.499308+0000","last_peered":"2024-09-12T00:34:34.499308+0000","last_clean":"2024-09-12T00:34:34.499308+0000","last_became_active":"2024-09-12T00:27:17.579646+0000","last_became_peered":"2024-09-12T00:27:17.579646+0000","last_unstale":"2024-09-12T00:34:34.499308+0000","last_undegraded":"2024-09-12T00:34:34.499308+0000","last_fullsized":"2024-09-12T00:34:34.499308+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:11.016979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"261'5","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509340+0000","last_change":"2024-09-12T00:17:03.212032+0000","last_active":"2024-09-12T00:35:44.509340+0000","last_peered":"2024-09-12T00:35:44.509340+0000","last_clean":"2024-09-12T00:35:44.509340+0000","last_became_active":"2024-09-12T00:17:03.211732+0000","last_became_peered":"2024-09-12T00:17:03.211732+0000","last_unstale":"2024-09-12T00:35:44.509340+0000","last_undegraded":"2024-09-12T00:35:44.509340+0000","last_fullsized":"2024-09-12T00:35:44.509340+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:51.849541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:41.507507+0000","last_change":"2024-09-12T00:17:00.175751+0000","last_active":"2024-09-12T00:35:41.507507+0000","last_peered":"2024-09-12T00:35:41.507507+0000","last_clean":"2024-09-12T00:35:41.507507+0000","last_became_active":"2024-09-12T00:17:00.175460+0000","last_became_peered":"2024-09-12T00:17:00.175460+0000","last_unstale":"2024-09-12T00:35:41.507507+0000","last_undegraded":"2024-09-12T00:35:41.507507+0000","last_fullsized":"2024-09-12T00:35:41.507507+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:16.723140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'37","reported_seq":132,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.379113+0000","last_change":"2024-09-12T00:15:34.424716+0000","last_active":"2024-09-12T00:34:14.379113+0000","last_peered":"2024-09-12T00:34:14.379113+0000","last_clean":"2024-09-12T00:34:14.379113+0000","last_became_active":"2024-09-12T00:15:34.423734+0000","last_became_peered":"2024-09-12T00:15:34.423734+0000","last_unstale":"2024-09-12T00:34:14.379113+0000","last_undegraded":"2024-09-12T00:34:14.379113+0000","last_fullsized":"2024-09-12T00:34:14.379113+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:11.973619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":116,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498603+0000","last_change":"2024-09-12T00:27:17.574614+0000","last_active":"2024-09-12T00:34:34.498603+0000","last_peered":"2024-09-12T00:34:34.498603+0000","last_clean":"2024-09-12T00:34:34.498603+0000","last_became_active":"2024-09-12T00:27:17.574346+0000","last_became_peered":"2024-09-12T00:27:17.574346+0000","last_unstale":"2024-09-12T00:34:34.498603+0000","last_undegraded":"2024-09-12T00:34:34.498603+0000","last_fullsized":"2024-09-12T00:34:34.498603+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:58.931421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'2","reported_seq":30,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509305+0000","last_change":"2024-09-12T00:17:03.210709+0000","last_active":"2024-09-12T00:35:44.509305+0000","last_peered":"2024-09-12T00:35:44.509305+0000","last_clean":"2024-09-12T00:35:44.509305+0000","last_became_active":"2024-09-12T00:17:03.210439+0000","last_became_peered":"2024-09-12T00:17:03.210439+0000","last_unstale":"2024-09-12T00:35:44.509305+0000","last_undegraded":"2024-09-12T00:35:44.509305+0000","last_fullsized":"2024-09-12T00:35:44.509305+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:13.002169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'1","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.508520+0000","last_change":"2024-09-12T00:17:00.179628+0000","last_active":"2024-09-12T00:35:39.508520+0000","last_peered":"2024-09-12T00:35:39.508520+0000","last_clean":"2024-09-12T00:35:39.508520+0000","last_became_active":"2024-09-12T00:17:00.179337+0000","last_became_peered":"2024-09-12T00:17:00.179337+0000","last_unstale":"2024-09-12T00:35:39.508520+0000","last_undegraded":"2024-09-12T00:35:39.508520+0000","last_fullsized":"2024-09-12T00:35:39.508520+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:55.994787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'135","reported_seq":450,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.496301+0000","last_change":"2024-09-12T00:15:34.421442+0000","last_active":"2024-09-12T00:34:14.496301+0000","last_peered":"2024-09-12T00:34:14.496301+0000","last_clean":"2024-09-12T00:34:14.496301+0000","last_became_active":"2024-09-12T00:15:34.421180+0000","last_became_peered":"2024-09-12T00:15:34.421180+0000","last_unstale":"2024-09-12T00:34:14.496301+0000","last_undegraded":"2024-09-12T00:34:14.496301+0000","last_fullsized":"2024-09-12T00:34:14.496301+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:29.396389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":617,"num_write":164,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:17.499229+0000","last_change":"2024-09-12T00:27:17.575634+0000","last_active":"2024-09-12T00:34:17.499229+0000","last_peered":"2024-09-12T00:34:17.499229+0000","last_clean":"2024-09-12T00:34:17.499229+0000","last_became_active":"2024-09-12T00:27:17.575257+0000","last_became_peered":"2024-09-12T00:27:17.575257+0000","last_unstale":"2024-09-12T00:34:17.499229+0000","last_undegraded":"2024-09-12T00:34:17.499229+0000","last_fullsized":"2024-09-12T00:34:17.499229+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:49.548072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'1","reported_seq":30,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509194+0000","last_change":"2024-09-12T00:17:03.222496+0000","last_active":"2024-09-12T00:35:44.509194+0000","last_peered":"2024-09-12T00:35:44.509194+0000","last_clean":"2024-09-12T00:35:44.509194+0000","last_became_active":"2024-09-12T00:17:03.222110+0000","last_became_peered":"2024-09-12T00:17:03.222110+0000","last_unstale":"2024-09-12T00:35:44.509194+0000","last_undegraded":"2024-09-12T00:35:44.509194+0000","last_fullsized":"2024-09-12T00:35:44.509194+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:07.242934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:41.507584+0000","last_change":"2024-09-12T00:17:00.174832+0000","last_active":"2024-09-12T00:35:41.507584+0000","last_peered":"2024-09-12T00:35:41.507584+0000","last_clean":"2024-09-12T00:35:41.507584+0000","last_became_active":"2024-09-12T00:17:00.174537+0000","last_became_peered":"2024-09-12T00:17:00.174537+0000","last_unstale":"2024-09-12T00:35:41.507584+0000","last_undegraded":"2024-09-12T00:35:41.507584+0000","last_fullsized":"2024-09-12T00:35:41.507584+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:23.549160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"258'31","reported_seq":128,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.612667+0000","last_change":"2024-09-12T00:15:34.428066+0000","last_active":"2024-09-12T00:34:14.612667+0000","last_peered":"2024-09-12T00:34:14.612667+0000","last_clean":"2024-09-12T00:34:14.612667+0000","last_became_active":"2024-09-12T00:15:34.427756+0000","last_became_peered":"2024-09-12T00:15:34.427756+0000","last_unstale":"2024-09-12T00:34:14.612667+0000","last_undegraded":"2024-09-12T00:34:14.612667+0000","last_fullsized":"2024-09-12T00:34:14.612667+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:05.925579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":137,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498569+0000","last_change":"2024-09-12T00:27:17.577377+0000","last_active":"2024-09-12T00:34:34.498569+0000","last_peered":"2024-09-12T00:34:34.498569+0000","last_clean":"2024-09-12T00:34:34.498569+0000","last_became_active":"2024-09-12T00:27:17.577076+0000","last_became_peered":"2024-09-12T00:27:17.577076+0000","last_unstale":"2024-09-12T00:34:34.498569+0000","last_undegraded":"2024-09-12T00:34:34.498569+0000","last_fullsized":"2024-09-12T00:34:34.498569+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.624069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391561+0000","last_change":"2024-09-12T00:17:03.217429+0000","last_active":"2024-09-12T00:35:44.391561+0000","last_peered":"2024-09-12T00:35:44.391561+0000","last_clean":"2024-09-12T00:35:44.391561+0000","last_became_active":"2024-09-12T00:17:03.217101+0000","last_became_peered":"2024-09-12T00:17:03.217101+0000","last_unstale":"2024-09-12T00:35:44.391561+0000","last_undegraded":"2024-09-12T00:35:44.391561+0000","last_fullsized":"2024-09-12T00:35:44.391561+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:37.636780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:41.507635+0000","last_change":"2024-09-12T00:17:00.180771+0000","last_active":"2024-09-12T00:35:41.507635+0000","last_peered":"2024-09-12T00:35:41.507635+0000","last_clean":"2024-09-12T00:35:41.507635+0000","last_became_active":"2024-09-12T00:17:00.180475+0000","last_became_peered":"2024-09-12T00:17:00.180475+0000","last_unstale":"2024-09-12T00:35:41.507635+0000","last_undegraded":"2024-09-12T00:35:41.507635+0000","last_fullsized":"2024-09-12T00:35:41.507635+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:32.615984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'61","reported_seq":207,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.496260+0000","last_change":"2024-09-12T00:15:34.419120+0000","last_active":"2024-09-12T00:34:14.496260+0000","last_peered":"2024-09-12T00:34:14.496260+0000","last_clean":"2024-09-12T00:34:14.496260+0000","last_became_active":"2024-09-12T00:15:34.418831+0000","last_became_peered":"2024-09-12T00:15:34.418831+0000","last_unstale":"2024-09-12T00:34:14.496260+0000","last_undegraded":"2024-09-12T00:34:14.496260+0000","last_fullsized":"2024-09-12T00:34:14.496260+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:01.991294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":218,"num_write":105,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.511752+0000","last_change":"2024-09-12T00:27:17.579649+0000","last_active":"2024-09-12T00:35:59.511752+0000","last_peered":"2024-09-12T00:35:59.511752+0000","last_clean":"2024-09-12T00:35:59.511752+0000","last_became_active":"2024-09-12T00:27:17.579263+0000","last_became_peered":"2024-09-12T00:27:17.579263+0000","last_unstale":"2024-09-12T00:35:59.511752+0000","last_undegraded":"2024-09-12T00:35:59.511752+0000","last_fullsized":"2024-09-12T00:35:59.511752+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:10.487761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"258'2","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503243+0000","last_change":"2024-09-12T00:17:03.211987+0000","last_active":"2024-09-12T00:35:04.503243+0000","last_peered":"2024-09-12T00:35:04.503243+0000","last_clean":"2024-09-12T00:35:04.503243+0000","last_became_active":"2024-09-12T00:17:03.211582+0000","last_became_peered":"2024-09-12T00:17:03.211582+0000","last_unstale":"2024-09-12T00:35:04.503243+0000","last_undegraded":"2024-09-12T00:35:04.503243+0000","last_fullsized":"2024-09-12T00:35:04.503243+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:27.493123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"261'1","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.619883+0000","last_change":"2024-09-12T00:17:00.182834+0000","last_active":"2024-09-12T00:34:59.619883+0000","last_peered":"2024-09-12T00:34:59.619883+0000","last_clean":"2024-09-12T00:34:59.619883+0000","last_became_active":"2024-09-12T00:17:00.182477+0000","last_became_peered":"2024-09-12T00:17:00.182477+0000","last_unstale":"2024-09-12T00:34:59.619883+0000","last_undegraded":"2024-09-12T00:34:59.619883+0000","last_fullsized":"2024-09-12T00:34:59.619883+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:39.317297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"258'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.510828+0000","last_change":"2024-09-12T00:15:34.419921+0000","last_active":"2024-09-12T00:35:54.510828+0000","last_peered":"2024-09-12T00:35:54.510828+0000","last_clean":"2024-09-12T00:35:54.510828+0000","last_became_active":"2024-09-12T00:15:34.419584+0000","last_became_peered":"2024-09-12T00:15:34.419584+0000","last_unstale":"2024-09-12T00:35:54.510828+0000","last_undegraded":"2024-09-12T00:35:54.510828+0000","last_fullsized":"2024-09-12T00:35:54.510828+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:04.179967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:16.512831+0000","last_change":"2024-09-12T00:27:17.580152+0000","last_active":"2024-09-12T00:36:16.512831+0000","last_peered":"2024-09-12T00:36:16.512831+0000","last_clean":"2024-09-12T00:36:16.512831+0000","last_became_active":"2024-09-12T00:27:17.579859+0000","last_became_peered":"2024-09-12T00:27:17.579859+0000","last_unstale":"2024-09-12T00:36:16.512831+0000","last_undegraded":"2024-09-12T00:36:16.512831+0000","last_fullsized":"2024-09-12T00:36:16.512831+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:44.205082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'2","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503201+0000","last_change":"2024-09-12T00:17:03.216727+0000","last_active":"2024-09-12T00:35:04.503201+0000","last_peered":"2024-09-12T00:35:04.503201+0000","last_clean":"2024-09-12T00:35:04.503201+0000","last_became_active":"2024-09-12T00:17:03.216437+0000","last_became_peered":"2024-09-12T00:17:03.216437+0000","last_unstale":"2024-09-12T00:35:04.503201+0000","last_undegraded":"2024-09-12T00:35:04.503201+0000","last_fullsized":"2024-09-12T00:35:04.503201+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:54.699248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.502357+0000","last_change":"2024-09-12T00:17:00.179209+0000","last_active":"2024-09-12T00:34:59.502357+0000","last_peered":"2024-09-12T00:34:59.502357+0000","last_clean":"2024-09-12T00:34:59.502357+0000","last_became_active":"2024-09-12T00:17:00.178905+0000","last_became_peered":"2024-09-12T00:17:00.178905+0000","last_unstale":"2024-09-12T00:34:59.502357+0000","last_undegraded":"2024-09-12T00:34:59.502357+0000","last_fullsized":"2024-09-12T00:34:59.502357+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:09.052476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'17","reported_seq":81,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.392457+0000","last_change":"2024-09-12T00:15:34.419487+0000","last_active":"2024-09-12T00:35:49.392457+0000","last_peered":"2024-09-12T00:35:49.392457+0000","last_clean":"2024-09-12T00:35:49.392457+0000","last_became_active":"2024-09-12T00:15:34.418859+0000","last_became_peered":"2024-09-12T00:15:34.418859+0000","last_unstale":"2024-09-12T00:35:49.392457+0000","last_undegraded":"2024-09-12T00:35:49.392457+0000","last_fullsized":"2024-09-12T00:35:49.392457+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:58.036831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.393701+0000","last_change":"2024-09-12T00:27:17.579640+0000","last_active":"2024-09-12T00:35:59.393701+0000","last_peered":"2024-09-12T00:35:59.393701+0000","last_clean":"2024-09-12T00:35:59.393701+0000","last_became_active":"2024-09-12T00:27:17.577728+0000","last_became_peered":"2024-09-12T00:27:17.577728+0000","last_unstale":"2024-09-12T00:35:59.393701+0000","last_undegraded":"2024-09-12T00:35:59.393701+0000","last_fullsized":"2024-09-12T00:35:59.393701+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:51.317752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"261'10","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.504036+0000","last_change":"2024-09-12T00:17:03.215255+0000","last_active":"2024-09-12T00:35:09.504036+0000","last_peered":"2024-09-12T00:35:09.504036+0000","last_clean":"2024-09-12T00:35:09.504036+0000","last_became_active":"2024-09-12T00:17:03.214958+0000","last_became_peered":"2024-09-12T00:17:03.214958+0000","last_unstale":"2024-09-12T00:35:09.504036+0000","last_undegraded":"2024-09-12T00:35:09.504036+0000","last_fullsized":"2024-09-12T00:35:09.504036+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:24.067787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":25,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"261'6","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.502530+0000","last_change":"2024-09-12T00:17:00.184968+0000","last_active":"2024-09-12T00:34:59.502530+0000","last_peered":"2024-09-12T00:34:59.502530+0000","last_clean":"2024-09-12T00:34:59.502530+0000","last_became_active":"2024-09-12T00:17:00.184703+0000","last_became_peered":"2024-09-12T00:17:00.184703+0000","last_unstale":"2024-09-12T00:34:59.502530+0000","last_undegraded":"2024-09-12T00:34:59.502530+0000","last_fullsized":"2024-09-12T00:34:59.502530+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:09.775190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":24576,"num_write":6,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'12","reported_seq":74,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:51.509350+0000","last_change":"2024-09-12T00:15:34.424421+0000","last_active":"2024-09-12T00:35:51.509350+0000","last_peered":"2024-09-12T00:35:51.509350+0000","last_clean":"2024-09-12T00:35:51.509350+0000","last_became_active":"2024-09-12T00:15:34.424129+0000","last_became_peered":"2024-09-12T00:15:34.424129+0000","last_unstale":"2024-09-12T00:35:51.509350+0000","last_undegraded":"2024-09-12T00:35:51.509350+0000","last_fullsized":"2024-09-12T00:35:51.509350+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:19.458965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:56.510098+0000","last_change":"2024-09-12T00:27:17.571287+0000","last_active":"2024-09-12T00:35:56.510098+0000","last_peered":"2024-09-12T00:35:56.510098+0000","last_clean":"2024-09-12T00:35:56.510098+0000","last_became_active":"2024-09-12T00:27:17.570973+0000","last_became_peered":"2024-09-12T00:27:17.570973+0000","last_unstale":"2024-09-12T00:35:56.510098+0000","last_undegraded":"2024-09-12T00:35:56.510098+0000","last_fullsized":"2024-09-12T00:35:56.510098+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:28.959152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"258'5","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503609+0000","last_change":"2024-09-12T00:17:03.221266+0000","last_active":"2024-09-12T00:35:04.503609+0000","last_peered":"2024-09-12T00:35:04.503609+0000","last_clean":"2024-09-12T00:35:04.503609+0000","last_became_active":"2024-09-12T00:17:03.220961+0000","last_became_peered":"2024-09-12T00:17:03.220961+0000","last_unstale":"2024-09-12T00:35:04.503609+0000","last_undegraded":"2024-09-12T00:35:04.503609+0000","last_fullsized":"2024-09-12T00:35:04.503609+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:28.129316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503320+0000","last_change":"2024-09-12T00:17:00.178846+0000","last_active":"2024-09-12T00:35:04.503320+0000","last_peered":"2024-09-12T00:35:04.503320+0000","last_clean":"2024-09-12T00:35:04.503320+0000","last_became_active":"2024-09-12T00:17:00.178572+0000","last_became_peered":"2024-09-12T00:17:00.178572+0000","last_unstale":"2024-09-12T00:35:04.503320+0000","last_undegraded":"2024-09-12T00:35:04.503320+0000","last_fullsized":"2024-09-12T00:35:04.503320+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:24.934660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'26","reported_seq":111,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510002+0000","last_change":"2024-09-12T00:15:34.421329+0000","last_active":"2024-09-12T00:35:49.510002+0000","last_peered":"2024-09-12T00:35:49.510002+0000","last_clean":"2024-09-12T00:35:49.510002+0000","last_became_active":"2024-09-12T00:15:34.421019+0000","last_became_peered":"2024-09-12T00:15:34.421019+0000","last_unstale":"2024-09-12T00:35:49.510002+0000","last_undegraded":"2024-09-12T00:35:49.510002+0000","last_fullsized":"2024-09-12T00:35:49.510002+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:35.834745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":93,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.514214+0000","last_change":"2024-09-12T00:27:17.581884+0000","last_active":"2024-09-12T00:36:19.514214+0000","last_peered":"2024-09-12T00:36:19.514214+0000","last_clean":"2024-09-12T00:36:19.514214+0000","last_became_active":"2024-09-12T00:27:17.579926+0000","last_became_peered":"2024-09-12T00:27:17.579926+0000","last_unstale":"2024-09-12T00:36:19.514214+0000","last_undegraded":"2024-09-12T00:36:19.514214+0000","last_fullsized":"2024-09-12T00:36:19.514214+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:28.218032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:24.380499+0000","last_change":"2024-09-12T00:17:03.219491+0000","last_active":"2024-09-12T00:34:24.380499+0000","last_peered":"2024-09-12T00:34:24.380499+0000","last_clean":"2024-09-12T00:34:24.380499+0000","last_became_active":"2024-09-12T00:17:03.219156+0000","last_became_peered":"2024-09-12T00:17:03.219156+0000","last_unstale":"2024-09-12T00:34:24.380499+0000","last_undegraded":"2024-09-12T00:34:24.380499+0000","last_fullsized":"2024-09-12T00:34:24.380499+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:35.748043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"261'1","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.496969+0000","last_change":"2024-09-12T00:17:00.182726+0000","last_active":"2024-09-12T00:34:19.496969+0000","last_peered":"2024-09-12T00:34:19.496969+0000","last_clean":"2024-09-12T00:34:19.496969+0000","last_became_active":"2024-09-12T00:17:00.182424+0000","last_became_peered":"2024-09-12T00:17:00.182424+0000","last_unstale":"2024-09-12T00:34:19.496969+0000","last_undegraded":"2024-09-12T00:34:19.496969+0000","last_fullsized":"2024-09-12T00:34:19.496969+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:44.087656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"258'17","reported_seq":89,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.509911+0000","last_change":"2024-09-12T00:15:34.423351+0000","last_active":"2024-09-12T00:35:49.509911+0000","last_peered":"2024-09-12T00:35:49.509911+0000","last_clean":"2024-09-12T00:35:49.509911+0000","last_became_active":"2024-09-12T00:15:34.423037+0000","last_became_peered":"2024-09-12T00:15:34.423037+0000","last_unstale":"2024-09-12T00:35:49.509911+0000","last_undegraded":"2024-09-12T00:35:49.509911+0000","last_fullsized":"2024-09-12T00:35:49.509911+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:11.688876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":64,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:04.611481+0000","last_change":"2024-09-12T00:27:17.583413+0000","last_active":"2024-09-12T00:34:04.611481+0000","last_peered":"2024-09-12T00:34:04.611481+0000","last_clean":"2024-09-12T00:34:04.611481+0000","last_became_active":"2024-09-12T00:27:17.583096+0000","last_became_peered":"2024-09-12T00:27:17.583096+0000","last_unstale":"2024-09-12T00:34:04.611481+0000","last_undegraded":"2024-09-12T00:34:04.611481+0000","last_fullsized":"2024-09-12T00:34:04.611481+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:05.013570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'3","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:24.614128+0000","last_change":"2024-09-12T00:17:03.214309+0000","last_active":"2024-09-12T00:34:24.614128+0000","last_peered":"2024-09-12T00:34:24.614128+0000","last_clean":"2024-09-12T00:34:24.614128+0000","last_became_active":"2024-09-12T00:17:03.214023+0000","last_became_peered":"2024-09-12T00:17:03.214023+0000","last_unstale":"2024-09-12T00:34:24.614128+0000","last_undegraded":"2024-09-12T00:34:24.614128+0000","last_fullsized":"2024-09-12T00:34:24.614128+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.420166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'2","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.497088+0000","last_change":"2024-09-12T00:17:00.178739+0000","last_active":"2024-09-12T00:34:19.497088+0000","last_peered":"2024-09-12T00:34:19.497088+0000","last_clean":"2024-09-12T00:34:19.497088+0000","last_became_active":"2024-09-12T00:17:00.178465+0000","last_became_peered":"2024-09-12T00:17:00.178465+0000","last_unstale":"2024-09-12T00:34:19.497088+0000","last_undegraded":"2024-09-12T00:34:19.497088+0000","last_fullsized":"2024-09-12T00:34:19.497088+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:08.316507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'34","reported_seq":137,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:27.839282+0000","last_change":"2024-09-12T00:15:34.425982+0000","last_active":"2024-09-12T00:36:27.839282+0000","last_peered":"2024-09-12T00:36:27.839282+0000","last_clean":"2024-09-12T00:36:27.839282+0000","last_became_active":"2024-09-12T00:15:34.425540+0000","last_became_peered":"2024-09-12T00:15:34.425540+0000","last_unstale":"2024-09-12T00:36:27.839282+0000","last_undegraded":"2024-09-12T00:36:27.839282+0000","last_fullsized":"2024-09-12T00:36:27.839282+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:11.621389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":136,"num_write":51,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.394938+0000","last_change":"2024-09-12T00:27:17.582031+0000","last_active":"2024-09-12T00:36:19.394938+0000","last_peered":"2024-09-12T00:36:19.394938+0000","last_clean":"2024-09-12T00:36:19.394938+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:36:19.394938+0000","last_undegraded":"2024-09-12T00:36:19.394938+0000","last_fullsized":"2024-09-12T00:36:19.394938+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:26.824932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503080+0000","last_change":"2024-09-12T00:17:03.212419+0000","last_active":"2024-09-12T00:35:04.503080+0000","last_peered":"2024-09-12T00:35:04.503080+0000","last_clean":"2024-09-12T00:35:04.503080+0000","last_became_active":"2024-09-12T00:17:03.212150+0000","last_became_peered":"2024-09-12T00:17:03.212150+0000","last_unstale":"2024-09-12T00:35:04.503080+0000","last_undegraded":"2024-09-12T00:35:04.503080+0000","last_fullsized":"2024-09-12T00:35:04.503080+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:25.410634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"261'7","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:24.497626+0000","last_change":"2024-09-12T00:17:00.181254+0000","last_active":"2024-09-12T00:34:24.497626+0000","last_peered":"2024-09-12T00:34:24.497626+0000","last_clean":"2024-09-12T00:34:24.497626+0000","last_became_active":"2024-09-12T00:17:00.180944+0000","last_became_peered":"2024-09-12T00:17:00.180944+0000","last_unstale":"2024-09-12T00:34:24.497626+0000","last_undegraded":"2024-09-12T00:34:24.497626+0000","last_fullsized":"2024-09-12T00:34:24.497626+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:53.637952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6171,"num_write":12,"num_write_kb":11291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'34","reported_seq":126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.095497+0000","last_change":"2024-09-12T00:15:34.419063+0000","last_active":"2024-09-12T00:36:56.095497+0000","last_peered":"2024-09-12T00:36:56.095497+0000","last_clean":"2024-09-12T00:36:56.095497+0000","last_became_active":"2024-09-12T00:15:34.418474+0000","last_became_peered":"2024-09-12T00:15:34.418474+0000","last_unstale":"2024-09-12T00:36:56.095497+0000","last_undegraded":"2024-09-12T00:36:56.095497+0000","last_fullsized":"2024-09-12T00:36:56.095497+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:27.863297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.513761+0000","last_change":"2024-09-12T00:27:17.581423+0000","last_active":"2024-09-12T00:36:19.513761+0000","last_peered":"2024-09-12T00:36:19.513761+0000","last_clean":"2024-09-12T00:36:19.513761+0000","last_became_active":"2024-09-12T00:27:17.581149+0000","last_became_peered":"2024-09-12T00:27:17.581149+0000","last_unstale":"2024-09-12T00:36:19.513761+0000","last_undegraded":"2024-09-12T00:36:19.513761+0000","last_fullsized":"2024-09-12T00:36:19.513761+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:04.939255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.380608+0000","last_change":"2024-09-12T00:17:03.221232+0000","last_active":"2024-09-12T00:34:29.380608+0000","last_peered":"2024-09-12T00:34:29.380608+0000","last_clean":"2024-09-12T00:34:29.380608+0000","last_became_active":"2024-09-12T00:17:03.220965+0000","last_became_peered":"2024-09-12T00:17:03.220965+0000","last_unstale":"2024-09-12T00:34:29.380608+0000","last_undegraded":"2024-09-12T00:34:29.380608+0000","last_fullsized":"2024-09-12T00:34:29.380608+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:54.919281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'11","reported_seq":66,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.385612+0000","last_change":"2024-09-12T00:17:00.185880+0000","last_active":"2024-09-12T00:34:59.385612+0000","last_peered":"2024-09-12T00:34:59.385612+0000","last_clean":"2024-09-12T00:34:59.385612+0000","last_became_active":"2024-09-12T00:17:00.185600+0000","last_became_peered":"2024-09-12T00:17:00.185600+0000","last_unstale":"2024-09-12T00:34:59.385612+0000","last_undegraded":"2024-09-12T00:34:59.385612+0000","last_fullsized":"2024-09-12T00:34:59.385612+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.338622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":41662,"num_write":16,"num_write_kb":10938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'54","reported_seq":186,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:25.312227+0000","last_change":"2024-09-12T00:15:34.417774+0000","last_active":"2024-09-12T00:36:25.312227+0000","last_peered":"2024-09-12T00:36:25.312227+0000","last_clean":"2024-09-12T00:36:25.312227+0000","last_became_active":"2024-09-12T00:15:34.417393+0000","last_became_peered":"2024-09-12T00:15:34.417393+0000","last_unstale":"2024-09-12T00:36:25.312227+0000","last_undegraded":"2024-09-12T00:36:25.312227+0000","last_fullsized":"2024-09-12T00:36:25.312227+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:49.338246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":189,"num_write":107,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390022+0000","last_change":"2024-09-12T00:27:17.580912+0000","last_active":"2024-09-12T00:35:39.390022+0000","last_peered":"2024-09-12T00:35:39.390022+0000","last_clean":"2024-09-12T00:35:39.390022+0000","last_became_active":"2024-09-12T00:27:17.578983+0000","last_became_peered":"2024-09-12T00:27:17.578983+0000","last_unstale":"2024-09-12T00:35:39.390022+0000","last_undegraded":"2024-09-12T00:35:39.390022+0000","last_fullsized":"2024-09-12T00:35:39.390022+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.598333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"258'10","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510247+0000","last_change":"2024-09-12T00:17:03.210161+0000","last_active":"2024-09-12T00:35:49.510247+0000","last_peered":"2024-09-12T00:35:49.510247+0000","last_clean":"2024-09-12T00:35:49.510247+0000","last_became_active":"2024-09-12T00:17:03.209874+0000","last_became_peered":"2024-09-12T00:17:03.209874+0000","last_unstale":"2024-09-12T00:35:49.510247+0000","last_undegraded":"2024-09-12T00:35:49.510247+0000","last_fullsized":"2024-09-12T00:35:49.510247+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:07.562732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":41988,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"258'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391613+0000","last_change":"2024-09-12T00:17:00.186026+0000","last_active":"2024-09-12T00:35:44.391613+0000","last_peered":"2024-09-12T00:35:44.391613+0000","last_clean":"2024-09-12T00:35:44.391613+0000","last_became_active":"2024-09-12T00:17:00.185688+0000","last_became_peered":"2024-09-12T00:17:00.185688+0000","last_unstale":"2024-09-12T00:35:44.391613+0000","last_undegraded":"2024-09-12T00:35:44.391613+0000","last_fullsized":"2024-09-12T00:35:44.391613+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:40.682390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:15.301825+0000","last_change":"2024-09-12T00:15:34.412266+0000","last_active":"2024-09-12T00:36:15.301825+0000","last_peered":"2024-09-12T00:36:15.301825+0000","last_clean":"2024-09-12T00:36:15.301825+0000","last_became_active":"2024-09-12T00:15:34.411977+0000","last_became_peered":"2024-09-12T00:15:34.411977+0000","last_unstale":"2024-09-12T00:36:15.301825+0000","last_undegraded":"2024-09-12T00:36:15.301825+0000","last_fullsized":"2024-09-12T00:36:15.301825+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:53.336733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":161,"num_write":73,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390048+0000","last_change":"2024-09-12T00:27:17.579176+0000","last_active":"2024-09-12T00:35:39.390048+0000","last_peered":"2024-09-12T00:35:39.390048+0000","last_clean":"2024-09-12T00:35:39.390048+0000","last_became_active":"2024-09-12T00:27:17.578763+0000","last_became_peered":"2024-09-12T00:27:17.578763+0000","last_unstale":"2024-09-12T00:35:39.390048+0000","last_undegraded":"2024-09-12T00:35:39.390048+0000","last_fullsized":"2024-09-12T00:35:39.390048+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:54.867145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510203+0000","last_change":"2024-09-12T00:17:03.216611+0000","last_active":"2024-09-12T00:35:49.510203+0000","last_peered":"2024-09-12T00:35:49.510203+0000","last_clean":"2024-09-12T00:35:49.510203+0000","last_became_active":"2024-09-12T00:17:03.216349+0000","last_became_peered":"2024-09-12T00:17:03.216349+0000","last_unstale":"2024-09-12T00:35:49.510203+0000","last_undegraded":"2024-09-12T00:35:49.510203+0000","last_fullsized":"2024-09-12T00:35:49.510203+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:48.582027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:47.512361+0000","last_change":"2024-09-12T00:17:00.183051+0000","last_active":"2024-09-12T00:35:47.512361+0000","last_peered":"2024-09-12T00:35:47.512361+0000","last_clean":"2024-09-12T00:35:47.512361+0000","last_became_active":"2024-09-12T00:17:00.182780+0000","last_became_peered":"2024-09-12T00:17:00.182780+0000","last_unstale":"2024-09-12T00:35:47.512361+0000","last_undegraded":"2024-09-12T00:35:47.512361+0000","last_fullsized":"2024-09-12T00:35:47.512361+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:39.837277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'38","reported_seq":141,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.386303+0000","last_change":"2024-09-12T00:15:34.410030+0000","last_active":"2024-09-12T00:35:04.386303+0000","last_peered":"2024-09-12T00:35:04.386303+0000","last_clean":"2024-09-12T00:35:04.386303+0000","last_became_active":"2024-09-12T00:15:34.409622+0000","last_became_peered":"2024-09-12T00:15:34.409622+0000","last_unstale":"2024-09-12T00:35:04.386303+0000","last_undegraded":"2024-09-12T00:35:04.386303+0000","last_fullsized":"2024-09-12T00:35:04.386303+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:55.447920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":134,"num_write":65,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:19.505635+0000","last_change":"2024-09-12T00:27:17.582282+0000","last_active":"2024-09-12T00:35:19.505635+0000","last_peered":"2024-09-12T00:35:19.505635+0000","last_clean":"2024-09-12T00:35:19.505635+0000","last_became_active":"2024-09-12T00:27:17.581993+0000","last_became_peered":"2024-09-12T00:27:17.581993+0000","last_unstale":"2024-09-12T00:35:19.505635+0000","last_undegraded":"2024-09-12T00:35:19.505635+0000","last_fullsized":"2024-09-12T00:35:19.505635+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:14.848118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:24.379865+0000","last_change":"2024-09-12T00:17:03.220273+0000","last_active":"2024-09-12T00:34:24.379865+0000","last_peered":"2024-09-12T00:34:24.379865+0000","last_clean":"2024-09-12T00:34:24.379865+0000","last_became_active":"2024-09-12T00:17:03.219888+0000","last_became_peered":"2024-09-12T00:17:03.219888+0000","last_unstale":"2024-09-12T00:34:24.379865+0000","last_undegraded":"2024-09-12T00:34:24.379865+0000","last_fullsized":"2024-09-12T00:34:24.379865+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:38.861820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"258'3","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.613476+0000","last_change":"2024-09-12T00:17:00.170322+0000","last_active":"2024-09-12T00:34:19.613476+0000","last_peered":"2024-09-12T00:34:19.613476+0000","last_clean":"2024-09-12T00:34:19.613476+0000","last_became_active":"2024-09-12T00:17:00.169299+0000","last_became_peered":"2024-09-12T00:17:00.169299+0000","last_unstale":"2024-09-12T00:34:19.613476+0000","last_undegraded":"2024-09-12T00:34:19.613476+0000","last_fullsized":"2024-09-12T00:34:19.613476+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:43.905465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'48","reported_seq":176,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.631907+0000","last_change":"2024-09-12T00:15:34.428023+0000","last_active":"2024-09-12T00:36:24.631907+0000","last_peered":"2024-09-12T00:36:24.631907+0000","last_clean":"2024-09-12T00:36:24.631907+0000","last_became_active":"2024-09-12T00:15:34.427735+0000","last_became_peered":"2024-09-12T00:15:34.427735+0000","last_unstale":"2024-09-12T00:36:24.631907+0000","last_undegraded":"2024-09-12T00:36:24.631907+0000","last_fullsized":"2024-09-12T00:36:24.631907+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:09.348935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":182,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390825+0000","last_change":"2024-09-12T00:27:17.573147+0000","last_active":"2024-09-12T00:35:39.390825+0000","last_peered":"2024-09-12T00:35:39.390825+0000","last_clean":"2024-09-12T00:35:39.390825+0000","last_became_active":"2024-09-12T00:27:17.572817+0000","last_became_peered":"2024-09-12T00:27:17.572817+0000","last_unstale":"2024-09-12T00:35:39.390825+0000","last_undegraded":"2024-09-12T00:35:39.390825+0000","last_fullsized":"2024-09-12T00:35:39.390825+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:43.980881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"261'5","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:24.380607+0000","last_change":"2024-09-12T00:17:03.220324+0000","last_active":"2024-09-12T00:34:24.380607+0000","last_peered":"2024-09-12T00:34:24.380607+0000","last_clean":"2024-09-12T00:34:24.380607+0000","last_became_active":"2024-09-12T00:17:03.219129+0000","last_became_peered":"2024-09-12T00:17:03.219129+0000","last_unstale":"2024-09-12T00:34:24.380607+0000","last_undegraded":"2024-09-12T00:34:24.380607+0000","last_fullsized":"2024-09-12T00:34:24.380607+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:56.169527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'5","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.379929+0000","last_change":"2024-09-12T00:17:00.182941+0000","last_active":"2024-09-12T00:34:19.379929+0000","last_peered":"2024-09-12T00:34:19.379929+0000","last_clean":"2024-09-12T00:34:19.379929+0000","last_became_active":"2024-09-12T00:17:00.182301+0000","last_became_peered":"2024-09-12T00:17:00.182301+0000","last_unstale":"2024-09-12T00:34:19.379929+0000","last_undegraded":"2024-09-12T00:34:19.379929+0000","last_fullsized":"2024-09-12T00:34:19.379929+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:08.258223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'23","reported_seq":102,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.514235+0000","last_change":"2024-09-12T00:15:34.428381+0000","last_active":"2024-09-12T00:36:24.514235+0000","last_peered":"2024-09-12T00:36:24.514235+0000","last_clean":"2024-09-12T00:36:24.514235+0000","last_became_active":"2024-09-12T00:15:34.428056+0000","last_became_peered":"2024-09-12T00:15:34.428056+0000","last_unstale":"2024-09-12T00:36:24.514235+0000","last_undegraded":"2024-09-12T00:36:24.514235+0000","last_fullsized":"2024-09-12T00:36:24.514235+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:43.858120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.511476+0000","last_change":"2024-09-12T00:27:17.575634+0000","last_active":"2024-09-12T00:35:59.511476+0000","last_peered":"2024-09-12T00:35:59.511476+0000","last_clean":"2024-09-12T00:35:59.511476+0000","last_became_active":"2024-09-12T00:27:17.575332+0000","last_became_peered":"2024-09-12T00:27:17.575332+0000","last_unstale":"2024-09-12T00:35:59.511476+0000","last_undegraded":"2024-09-12T00:35:59.511476+0000","last_fullsized":"2024-09-12T00:35:59.511476+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:10.996773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"258'6","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:47.512261+0000","last_change":"2024-09-12T00:17:03.206898+0000","last_active":"2024-09-12T00:35:47.512261+0000","last_peered":"2024-09-12T00:35:47.512261+0000","last_clean":"2024-09-12T00:35:47.512261+0000","last_became_active":"2024-09-12T00:17:03.206580+0000","last_became_peered":"2024-09-12T00:17:03.206580+0000","last_unstale":"2024-09-12T00:35:47.512261+0000","last_undegraded":"2024-09-12T00:35:47.512261+0000","last_fullsized":"2024-09-12T00:35:47.512261+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:19.086717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'1","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.619797+0000","last_change":"2024-09-12T00:17:00.169805+0000","last_active":"2024-09-12T00:34:59.619797+0000","last_peered":"2024-09-12T00:34:59.619797+0000","last_clean":"2024-09-12T00:34:59.619797+0000","last_became_active":"2024-09-12T00:17:00.169464+0000","last_became_peered":"2024-09-12T00:17:00.169464+0000","last_unstale":"2024-09-12T00:34:59.619797+0000","last_undegraded":"2024-09-12T00:34:59.619797+0000","last_fullsized":"2024-09-12T00:34:59.619797+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:30.563501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'22","reported_seq":97,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.631855+0000","last_change":"2024-09-12T00:15:34.428025+0000","last_active":"2024-09-12T00:36:24.631855+0000","last_peered":"2024-09-12T00:36:24.631855+0000","last_clean":"2024-09-12T00:36:24.631855+0000","last_became_active":"2024-09-12T00:15:34.427661+0000","last_became_peered":"2024-09-12T00:15:34.427661+0000","last_unstale":"2024-09-12T00:36:24.631855+0000","last_undegraded":"2024-09-12T00:36:24.631855+0000","last_fullsized":"2024-09-12T00:36:24.631855+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:18.676590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":70,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.514020+0000","last_change":"2024-09-12T00:27:17.576241+0000","last_active":"2024-09-12T00:35:57.514020+0000","last_peered":"2024-09-12T00:35:57.514020+0000","last_clean":"2024-09-12T00:35:57.514020+0000","last_became_active":"2024-09-12T00:27:17.575941+0000","last_became_peered":"2024-09-12T00:27:17.575941+0000","last_unstale":"2024-09-12T00:35:57.514020+0000","last_undegraded":"2024-09-12T00:35:57.514020+0000","last_fullsized":"2024-09-12T00:35:57.514020+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:41.216300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'1","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.386837+0000","last_change":"2024-09-12T00:17:03.218016+0000","last_active":"2024-09-12T00:35:09.386837+0000","last_peered":"2024-09-12T00:35:09.386837+0000","last_clean":"2024-09-12T00:35:09.386837+0000","last_became_active":"2024-09-12T00:17:03.217678+0000","last_became_peered":"2024-09-12T00:17:03.217678+0000","last_unstale":"2024-09-12T00:35:09.386837+0000","last_undegraded":"2024-09-12T00:35:09.386837+0000","last_fullsized":"2024-09-12T00:35:09.386837+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:41.125288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'4","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391501+0000","last_change":"2024-09-12T00:17:00.186355+0000","last_active":"2024-09-12T00:35:44.391501+0000","last_peered":"2024-09-12T00:35:44.391501+0000","last_clean":"2024-09-12T00:35:44.391501+0000","last_became_active":"2024-09-12T00:17:00.185637+0000","last_became_peered":"2024-09-12T00:17:00.185637+0000","last_unstale":"2024-09-12T00:35:44.391501+0000","last_undegraded":"2024-09-12T00:35:44.391501+0000","last_fullsized":"2024-09-12T00:35:44.391501+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:36.584176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396562+0000","last_change":"2024-09-12T00:15:34.408975+0000","last_active":"2024-09-12T00:36:24.396562+0000","last_peered":"2024-09-12T00:36:24.396562+0000","last_clean":"2024-09-12T00:36:24.396562+0000","last_became_active":"2024-09-12T00:15:34.408612+0000","last_became_peered":"2024-09-12T00:15:34.408612+0000","last_unstale":"2024-09-12T00:36:24.396562+0000","last_undegraded":"2024-09-12T00:36:24.396562+0000","last_fullsized":"2024-09-12T00:36:24.396562+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:00.278541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":97,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.508580+0000","last_change":"2024-09-12T00:27:17.579650+0000","last_active":"2024-09-12T00:35:39.508580+0000","last_peered":"2024-09-12T00:35:39.508580+0000","last_clean":"2024-09-12T00:35:39.508580+0000","last_became_active":"2024-09-12T00:27:17.579332+0000","last_became_peered":"2024-09-12T00:27:17.579332+0000","last_unstale":"2024-09-12T00:35:39.508580+0000","last_undegraded":"2024-09-12T00:35:39.508580+0000","last_fullsized":"2024-09-12T00:35:39.508580+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:02.812642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627538+0000","last_change":"2024-09-12T00:17:03.203730+0000","last_active":"2024-09-12T00:35:49.627538+0000","last_peered":"2024-09-12T00:35:49.627538+0000","last_clean":"2024-09-12T00:35:49.627538+0000","last_became_active":"2024-09-12T00:17:03.203401+0000","last_became_peered":"2024-09-12T00:17:03.203401+0000","last_unstale":"2024-09-12T00:35:49.627538+0000","last_undegraded":"2024-09-12T00:35:49.627538+0000","last_fullsized":"2024-09-12T00:35:49.627538+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:07.999569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509116+0000","last_change":"2024-09-12T00:17:00.181373+0000","last_active":"2024-09-12T00:35:44.509116+0000","last_peered":"2024-09-12T00:35:44.509116+0000","last_clean":"2024-09-12T00:35:44.509116+0000","last_became_active":"2024-09-12T00:17:00.181095+0000","last_became_peered":"2024-09-12T00:17:00.181095+0000","last_unstale":"2024-09-12T00:35:44.509116+0000","last_undegraded":"2024-09-12T00:35:44.509116+0000","last_fullsized":"2024-09-12T00:35:44.509116+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:49.208397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'19","reported_seq":93,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396515+0000","last_change":"2024-09-12T00:15:34.421629+0000","last_active":"2024-09-12T00:36:24.396515+0000","last_peered":"2024-09-12T00:36:24.396515+0000","last_clean":"2024-09-12T00:36:24.396515+0000","last_became_active":"2024-09-12T00:15:34.420583+0000","last_became_peered":"2024-09-12T00:15:34.420583+0000","last_unstale":"2024-09-12T00:36:24.396515+0000","last_undegraded":"2024-09-12T00:36:24.396515+0000","last_fullsized":"2024-09-12T00:36:24.396515+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:19.714778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391630+0000","last_change":"2024-09-12T00:27:17.580218+0000","last_active":"2024-09-12T00:35:44.391630+0000","last_peered":"2024-09-12T00:35:44.391630+0000","last_clean":"2024-09-12T00:35:44.391630+0000","last_became_active":"2024-09-12T00:27:17.579957+0000","last_became_peered":"2024-09-12T00:27:17.579957+0000","last_unstale":"2024-09-12T00:35:44.391630+0000","last_undegraded":"2024-09-12T00:35:44.391630+0000","last_fullsized":"2024-09-12T00:35:44.391630+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:50.892944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627493+0000","last_change":"2024-09-12T00:17:03.222544+0000","last_active":"2024-09-12T00:35:49.627493+0000","last_peered":"2024-09-12T00:35:49.627493+0000","last_clean":"2024-09-12T00:35:49.627493+0000","last_became_active":"2024-09-12T00:17:03.222212+0000","last_became_peered":"2024-09-12T00:17:03.222212+0000","last_unstale":"2024-09-12T00:35:49.627493+0000","last_undegraded":"2024-09-12T00:35:49.627493+0000","last_fullsized":"2024-09-12T00:35:49.627493+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:51.034286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"258'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:46.508514+0000","last_change":"2024-09-12T00:17:00.184916+0000","last_active":"2024-09-12T00:35:46.508514+0000","last_peered":"2024-09-12T00:35:46.508514+0000","last_clean":"2024-09-12T00:35:46.508514+0000","last_became_active":"2024-09-12T00:17:00.184654+0000","last_became_peered":"2024-09-12T00:17:00.184654+0000","last_unstale":"2024-09-12T00:35:46.508514+0000","last_undegraded":"2024-09-12T00:35:46.508514+0000","last_fullsized":"2024-09-12T00:35:46.508514+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:59.225633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'33","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:55.935669+0000","last_change":"2024-09-12T00:15:34.425813+0000","last_active":"2024-09-12T00:36:55.935669+0000","last_peered":"2024-09-12T00:36:55.935669+0000","last_clean":"2024-09-12T00:36:55.935669+0000","last_became_active":"2024-09-12T00:15:34.425489+0000","last_became_peered":"2024-09-12T00:15:34.425489+0000","last_unstale":"2024-09-12T00:36:55.935669+0000","last_undegraded":"2024-09-12T00:36:55.935669+0000","last_fullsized":"2024-09-12T00:36:55.935669+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:24.112153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":114,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'272","reported_seq":915,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.758515+0000","last_change":"2024-09-12T00:01:57.152485+0000","last_active":"2024-09-12T00:36:56.758515+0000","last_peered":"2024-09-12T00:36:56.758515+0000","last_clean":"2024-09-12T00:36:56.758515+0000","last_became_active":"2024-09-12T00:01:57.152039+0000","last_became_peered":"2024-09-12T00:01:57.152039+0000","last_unstale":"2024-09-12T00:36:56.758515+0000","last_undegraded":"2024-09-12T00:36:56.758515+0000","last_fullsized":"2024-09-12T00:36:56.758515+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:46.339403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6862783,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":435,"num_read_kb":62278,"num_write":1063,"num_write_kb":40244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'78","reported_seq":659,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.458046+0000","last_change":"2024-09-12T00:01:59.156460+0000","last_active":"2024-09-12T00:37:01.458046+0000","last_peered":"2024-09-12T00:37:01.458046+0000","last_clean":"2024-09-12T00:37:01.458046+0000","last_became_active":"2024-09-12T00:01:59.156166+0000","last_became_peered":"2024-09-12T00:01:59.156166+0000","last_unstale":"2024-09-12T00:37:01.458046+0000","last_undegraded":"2024-09-12T00:37:01.458046+0000","last_fullsized":"2024-09-12T00:37:01.458046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:59.037812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":327,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'244","reported_seq":878,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:11.314967+0000","last_change":"2024-09-12T00:01:57.147898+0000","last_active":"2024-09-12T00:36:11.314967+0000","last_peered":"2024-09-12T00:36:11.314967+0000","last_clean":"2024-09-12T00:36:11.314967+0000","last_became_active":"2024-09-12T00:01:57.147519+0000","last_became_peered":"2024-09-12T00:01:57.147519+0000","last_unstale":"2024-09-12T00:36:11.314967+0000","last_undegraded":"2024-09-12T00:36:11.314967+0000","last_fullsized":"2024-09-12T00:36:11.314967+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:29.218354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23215665,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":387,"num_read_kb":64017,"num_write":932,"num_write_kb":35322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'285","reported_seq":942,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.878962+0000","last_change":"2024-09-12T00:01:59.140999+0000","last_active":"2024-09-12T00:36:58.878962+0000","last_peered":"2024-09-12T00:36:58.878962+0000","last_clean":"2024-09-12T00:36:58.878962+0000","last_became_active":"2024-09-12T00:01:59.140661+0000","last_became_peered":"2024-09-12T00:01:59.140661+0000","last_unstale":"2024-09-12T00:36:58.878962+0000","last_undegraded":"2024-09-12T00:36:58.878962+0000","last_fullsized":"2024-09-12T00:36:58.878962+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:42.180513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1344,"num_read_kb":1119,"num_write":493,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'291","reported_seq":915,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.992097+0000","last_change":"2024-09-12T00:01:57.141302+0000","last_active":"2024-09-12T00:36:58.992097+0000","last_peered":"2024-09-12T00:36:58.992097+0000","last_clean":"2024-09-12T00:36:58.992097+0000","last_became_active":"2024-09-12T00:01:57.140885+0000","last_became_peered":"2024-09-12T00:01:57.140885+0000","last_unstale":"2024-09-12T00:36:58.992097+0000","last_undegraded":"2024-09-12T00:36:58.992097+0000","last_fullsized":"2024-09-12T00:36:58.992097+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:07.324855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1047047,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":433,"num_read_kb":8971,"num_write":1057,"num_write_kb":33019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'357","reported_seq":997,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.252007+0000","last_change":"2024-09-12T00:01:59.145361+0000","last_active":"2024-09-12T00:36:59.252007+0000","last_peered":"2024-09-12T00:36:59.252007+0000","last_clean":"2024-09-12T00:36:59.252007+0000","last_became_active":"2024-09-12T00:01:59.144660+0000","last_became_peered":"2024-09-12T00:01:59.144660+0000","last_unstale":"2024-09-12T00:36:59.252007+0000","last_undegraded":"2024-09-12T00:36:59.252007+0000","last_fullsized":"2024-09-12T00:36:59.252007+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:56.723947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1585,"num_read_kb":1295,"num_write":589,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'296","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.005357+0000","last_change":"2024-09-12T00:01:57.155155+0000","last_active":"2024-09-12T00:37:07.005357+0000","last_peered":"2024-09-12T00:37:07.005357+0000","last_clean":"2024-09-12T00:37:07.005357+0000","last_became_active":"2024-09-12T00:01:57.154749+0000","last_became_peered":"2024-09-12T00:01:57.154749+0000","last_unstale":"2024-09-12T00:37:07.005357+0000","last_undegraded":"2024-09-12T00:37:07.005357+0000","last_fullsized":"2024-09-12T00:37:07.005357+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:49.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12585342,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":467,"num_read_kb":65052,"num_write":1070,"num_write_kb":38777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'303","reported_seq":925,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.238836+0000","last_change":"2024-09-12T00:01:59.147206+0000","last_active":"2024-09-12T00:37:08.238836+0000","last_peered":"2024-09-12T00:37:08.238836+0000","last_clean":"2024-09-12T00:37:08.238836+0000","last_became_active":"2024-09-12T00:01:59.146925+0000","last_became_peered":"2024-09-12T00:01:59.146925+0000","last_unstale":"2024-09-12T00:37:08.238836+0000","last_undegraded":"2024-09-12T00:37:08.238836+0000","last_fullsized":"2024-09-12T00:37:08.238836+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:07.011599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1201,"num_read_kb":972,"num_write":449,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'304","reported_seq":1040,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.889819+0000","last_change":"2024-09-12T00:01:57.151401+0000","last_active":"2024-09-12T00:37:01.889819+0000","last_peered":"2024-09-12T00:37:01.889819+0000","last_clean":"2024-09-12T00:37:01.889819+0000","last_became_active":"2024-09-12T00:01:57.151028+0000","last_became_peered":"2024-09-12T00:01:57.151028+0000","last_unstale":"2024-09-12T00:37:01.889819+0000","last_undegraded":"2024-09-12T00:37:01.889819+0000","last_fullsized":"2024-09-12T00:37:01.889819+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:42.442785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7677799,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":772,"num_read_kb":49842,"num_write":1089,"num_write_kb":22305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'253","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.591163+0000","last_change":"2024-09-12T00:01:59.150011+0000","last_active":"2024-09-12T00:38:27.591163+0000","last_peered":"2024-09-12T00:38:27.591163+0000","last_clean":"2024-09-12T00:38:27.591163+0000","last_became_active":"2024-09-12T00:01:59.149728+0000","last_became_peered":"2024-09-12T00:01:59.149728+0000","last_unstale":"2024-09-12T00:38:27.591163+0000","last_undegraded":"2024-09-12T00:38:27.591163+0000","last_fullsized":"2024-09-12T00:38:27.591163+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:46.169594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1186,"num_read_kb":981,"num_write":436,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'289","reported_seq":1031,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:21.555440+0000","last_change":"2024-09-12T00:01:57.153165+0000","last_active":"2024-09-12T00:38:21.555440+0000","last_peered":"2024-09-12T00:38:21.555440+0000","last_clean":"2024-09-12T00:38:21.555440+0000","last_became_active":"2024-09-12T00:01:57.152791+0000","last_became_peered":"2024-09-12T00:01:57.152791+0000","last_unstale":"2024-09-12T00:38:21.555440+0000","last_undegraded":"2024-09-12T00:38:21.555440+0000","last_fullsized":"2024-09-12T00:38:21.555440+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:34.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1812510,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":753,"num_read_kb":39077,"num_write":1127,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'276","reported_seq":864,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:10.033280+0000","last_change":"2024-09-12T00:01:59.151834+0000","last_active":"2024-09-12T00:36:10.033280+0000","last_peered":"2024-09-12T00:36:10.033280+0000","last_clean":"2024-09-12T00:36:10.033280+0000","last_became_active":"2024-09-12T00:01:59.151168+0000","last_became_peered":"2024-09-12T00:01:59.151168+0000","last_unstale":"2024-09-12T00:36:10.033280+0000","last_undegraded":"2024-09-12T00:36:10.033280+0000","last_fullsized":"2024-09-12T00:36:10.033280+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:07.026026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1184,"num_read_kb":963,"num_write":440,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'280","reported_seq":942,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:49.549636+0000","last_change":"2024-09-12T00:01:57.146987+0000","last_active":"2024-09-12T00:36:49.549636+0000","last_peered":"2024-09-12T00:36:49.549636+0000","last_clean":"2024-09-12T00:36:49.549636+0000","last_became_active":"2024-09-12T00:01:57.146592+0000","last_became_peered":"2024-09-12T00:01:57.146592+0000","last_unstale":"2024-09-12T00:36:49.549636+0000","last_undegraded":"2024-09-12T00:36:49.549636+0000","last_fullsized":"2024-09-12T00:36:49.549636+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:36.580016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5307031,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":486,"num_read_kb":36664,"num_write":1054,"num_write_kb":21178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'169","reported_seq":757,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.751860+0000","last_change":"2024-09-12T00:01:59.153636+0000","last_active":"2024-09-12T00:36:58.751860+0000","last_peered":"2024-09-12T00:36:58.751860+0000","last_clean":"2024-09-12T00:36:58.751860+0000","last_became_active":"2024-09-12T00:01:59.153277+0000","last_became_peered":"2024-09-12T00:01:59.153277+0000","last_unstale":"2024-09-12T00:36:58.751860+0000","last_undegraded":"2024-09-12T00:36:58.751860+0000","last_fullsized":"2024-09-12T00:36:58.751860+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:06.223418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":798,"num_read_kb":679,"num_write":291,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'288","reported_seq":901,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.720538+0000","last_change":"2024-09-12T00:01:57.152039+0000","last_active":"2024-09-12T00:37:06.720538+0000","last_peered":"2024-09-12T00:37:06.720538+0000","last_clean":"2024-09-12T00:37:06.720538+0000","last_became_active":"2024-09-12T00:01:57.151506+0000","last_became_peered":"2024-09-12T00:01:57.151506+0000","last_unstale":"2024-09-12T00:37:06.720538+0000","last_undegraded":"2024-09-12T00:37:06.720538+0000","last_fullsized":"2024-09-12T00:37:06.720538+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:02.754894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550480,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":450,"num_read_kb":7555,"num_write":1082,"num_write_kb":27882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'125","reported_seq":711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.323304+0000","last_change":"2024-09-12T00:01:59.149439+0000","last_active":"2024-09-12T00:36:54.323304+0000","last_peered":"2024-09-12T00:36:54.323304+0000","last_clean":"2024-09-12T00:36:54.323304+0000","last_became_active":"2024-09-12T00:01:59.148098+0000","last_became_peered":"2024-09-12T00:01:59.148098+0000","last_unstale":"2024-09-12T00:36:54.323304+0000","last_undegraded":"2024-09-12T00:36:54.323304+0000","last_fullsized":"2024-09-12T00:36:54.323304+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:18.916236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":439,"num_write":182,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'114","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.963544+0000","last_change":"2024-09-12T00:01:59.148279+0000","last_active":"2024-09-12T00:36:58.963544+0000","last_peered":"2024-09-12T00:36:58.963544+0000","last_clean":"2024-09-12T00:36:58.963544+0000","last_became_active":"2024-09-12T00:01:59.148017+0000","last_became_peered":"2024-09-12T00:01:59.148017+0000","last_unstale":"2024-09-12T00:36:58.963544+0000","last_undegraded":"2024-09-12T00:36:58.963544+0000","last_fullsized":"2024-09-12T00:36:58.963544+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:15.214488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":485,"num_read_kb":395,"num_write":184,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'289","reported_seq":972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.507580+0000","last_change":"2024-09-12T00:01:57.151683+0000","last_active":"2024-09-12T00:38:36.507580+0000","last_peered":"2024-09-12T00:38:36.507580+0000","last_clean":"2024-09-12T00:38:36.507580+0000","last_became_active":"2024-09-12T00:01:57.151116+0000","last_became_peered":"2024-09-12T00:01:57.151116+0000","last_unstale":"2024-09-12T00:38:36.507580+0000","last_undegraded":"2024-09-12T00:38:36.507580+0000","last_fullsized":"2024-09-12T00:38:36.507580+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:35.763246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15090525,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":523,"num_read_kb":78307,"num_write":1124,"num_write_kb":30055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'230","reported_seq":811,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:39.381829+0000","last_change":"2024-09-12T00:01:59.152420+0000","last_active":"2024-09-12T00:34:39.381829+0000","last_peered":"2024-09-12T00:34:39.381829+0000","last_clean":"2024-09-12T00:34:39.381829+0000","last_became_active":"2024-09-12T00:01:59.152131+0000","last_became_peered":"2024-09-12T00:01:59.152131+0000","last_unstale":"2024-09-12T00:34:39.381829+0000","last_undegraded":"2024-09-12T00:34:39.381829+0000","last_fullsized":"2024-09-12T00:34:39.381829+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:35.864717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":807,"num_write":370,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'272","reported_seq":903,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.990923+0000","last_change":"2024-09-12T00:01:57.145166+0000","last_active":"2024-09-12T00:36:58.990923+0000","last_peered":"2024-09-12T00:36:58.990923+0000","last_clean":"2024-09-12T00:36:58.990923+0000","last_became_active":"2024-09-12T00:01:57.143834+0000","last_became_peered":"2024-09-12T00:01:57.143834+0000","last_unstale":"2024-09-12T00:36:58.990923+0000","last_undegraded":"2024-09-12T00:36:58.990923+0000","last_fullsized":"2024-09-12T00:36:58.990923+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:52.588497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2710,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":461,"num_read_kb":1593,"num_write":1123,"num_write_kb":15734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'430","reported_seq":1135,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.136558+0000","last_change":"2024-09-12T00:01:59.153835+0000","last_active":"2024-09-12T00:36:52.136558+0000","last_peered":"2024-09-12T00:36:52.136558+0000","last_clean":"2024-09-12T00:36:52.136558+0000","last_became_active":"2024-09-12T00:01:59.153559+0000","last_became_peered":"2024-09-12T00:01:59.153559+0000","last_unstale":"2024-09-12T00:36:52.136558+0000","last_undegraded":"2024-09-12T00:36:52.136558+0000","last_fullsized":"2024-09-12T00:36:52.136558+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:14.763454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2074,"num_read_kb":1775,"num_write":771,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'252","reported_seq":861,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:23.551844+0000","last_change":"2024-09-12T00:01:57.151910+0000","last_active":"2024-09-12T00:38:23.551844+0000","last_peered":"2024-09-12T00:38:23.551844+0000","last_clean":"2024-09-12T00:38:23.551844+0000","last_became_active":"2024-09-12T00:01:57.150789+0000","last_became_peered":"2024-09-12T00:01:57.150789+0000","last_unstale":"2024-09-12T00:38:23.551844+0000","last_undegraded":"2024-09-12T00:38:23.551844+0000","last_fullsized":"2024-09-12T00:38:23.551844+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:08.148314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2191305,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":374,"num_read_kb":13160,"num_write":898,"num_write_kb":19470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'149","reported_seq":772,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.747639+0000","last_change":"2024-09-12T00:01:59.149460+0000","last_active":"2024-09-12T00:36:50.747639+0000","last_peered":"2024-09-12T00:36:50.747639+0000","last_clean":"2024-09-12T00:36:50.747639+0000","last_became_active":"2024-09-12T00:01:59.149195+0000","last_became_peered":"2024-09-12T00:01:59.149195+0000","last_unstale":"2024-09-12T00:36:50.747639+0000","last_undegraded":"2024-09-12T00:36:50.747639+0000","last_fullsized":"2024-09-12T00:36:50.747639+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:43.524528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":604,"num_write":216,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'291","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.622977+0000","last_change":"2024-09-12T00:01:57.158820+0000","last_active":"2024-09-12T00:37:21.622977+0000","last_peered":"2024-09-12T00:37:21.622977+0000","last_clean":"2024-09-12T00:37:21.622977+0000","last_became_active":"2024-09-12T00:01:57.157877+0000","last_became_peered":"2024-09-12T00:01:57.157877+0000","last_unstale":"2024-09-12T00:37:21.622977+0000","last_undegraded":"2024-09-12T00:37:21.622977+0000","last_fullsized":"2024-09-12T00:37:21.622977+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:52.712462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14341133,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":451,"num_read_kb":26576,"num_write":1041,"num_write_kb":46689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'164","reported_seq":755,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.250417+0000","last_change":"2024-09-12T00:01:59.159547+0000","last_active":"2024-09-12T00:37:02.250417+0000","last_peered":"2024-09-12T00:37:02.250417+0000","last_clean":"2024-09-12T00:37:02.250417+0000","last_became_active":"2024-09-12T00:01:59.159215+0000","last_became_peered":"2024-09-12T00:01:59.159215+0000","last_unstale":"2024-09-12T00:37:02.250417+0000","last_undegraded":"2024-09-12T00:37:02.250417+0000","last_fullsized":"2024-09-12T00:37:02.250417+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:31.759927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":584,"num_write":229,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'230","reported_seq":867,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.421114+0000","last_change":"2024-09-12T00:02:32.844919+0000","last_active":"2024-09-12T00:37:21.421114+0000","last_peered":"2024-09-12T00:37:21.421114+0000","last_clean":"2024-09-12T00:37:21.421114+0000","last_became_active":"2024-09-12T00:02:32.844466+0000","last_became_peered":"2024-09-12T00:02:32.844466+0000","last_unstale":"2024-09-12T00:37:21.421114+0000","last_undegraded":"2024-09-12T00:37:21.421114+0000","last_fullsized":"2024-09-12T00:37:21.421114+0000","mapping_epoch":37,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:09.241156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12118951,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":429,"num_read_kb":38682,"num_write":973,"num_write_kb":28786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'136","reported_seq":724,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.061425+0000","last_change":"2024-09-12T00:01:59.156382+0000","last_active":"2024-09-12T00:37:23.061425+0000","last_peered":"2024-09-12T00:37:23.061425+0000","last_clean":"2024-09-12T00:37:23.061425+0000","last_became_active":"2024-09-12T00:01:59.156058+0000","last_became_peered":"2024-09-12T00:01:59.156058+0000","last_unstale":"2024-09-12T00:37:23.061425+0000","last_undegraded":"2024-09-12T00:37:23.061425+0000","last_fullsized":"2024-09-12T00:37:23.061425+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:10.726145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":582,"num_read_kb":485,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'328","reported_seq":943,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:23.252947+0000","last_change":"2024-09-12T00:01:57.137262+0000","last_active":"2024-09-12T00:36:23.252947+0000","last_peered":"2024-09-12T00:36:23.252947+0000","last_clean":"2024-09-12T00:36:23.252947+0000","last_became_active":"2024-09-12T00:01:57.136872+0000","last_became_peered":"2024-09-12T00:01:57.136872+0000","last_unstale":"2024-09-12T00:36:23.252947+0000","last_undegraded":"2024-09-12T00:36:23.252947+0000","last_fullsized":"2024-09-12T00:36:23.252947+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:32.662213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8171851,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":434,"num_read_kb":28039,"num_write":1218,"num_write_kb":53988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'147","reported_seq":642,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.514493+0000","last_change":"2024-09-12T00:02:07.159622+0000","last_active":"2024-09-12T00:37:23.514493+0000","last_peered":"2024-09-12T00:37:23.514493+0000","last_clean":"2024-09-12T00:37:23.514493+0000","last_became_active":"2024-09-12T00:02:07.159308+0000","last_became_peered":"2024-09-12T00:02:07.159308+0000","last_unstale":"2024-09-12T00:37:23.514493+0000","last_undegraded":"2024-09-12T00:37:23.514493+0000","last_fullsized":"2024-09-12T00:37:23.514493+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:23.798981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'123","reported_seq":707,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.287204+0000","last_change":"2024-09-12T00:01:59.152275+0000","last_active":"2024-09-12T00:36:50.287204+0000","last_peered":"2024-09-12T00:36:50.287204+0000","last_clean":"2024-09-12T00:36:50.287204+0000","last_became_active":"2024-09-12T00:01:59.151773+0000","last_became_peered":"2024-09-12T00:01:59.151773+0000","last_unstale":"2024-09-12T00:36:50.287204+0000","last_undegraded":"2024-09-12T00:36:50.287204+0000","last_fullsized":"2024-09-12T00:36:50.287204+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:11.927074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":478,"num_write":204,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'261","reported_seq":948,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.888399+0000","last_change":"2024-09-12T00:01:57.166828+0000","last_active":"2024-09-12T00:37:01.888399+0000","last_peered":"2024-09-12T00:37:01.888399+0000","last_clean":"2024-09-12T00:37:01.888399+0000","last_became_active":"2024-09-12T00:01:57.165987+0000","last_became_peered":"2024-09-12T00:01:57.165987+0000","last_unstale":"2024-09-12T00:37:01.888399+0000","last_undegraded":"2024-09-12T00:37:01.888399+0000","last_fullsized":"2024-09-12T00:37:01.888399+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:40.754997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5864980,"num_objects":86,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":524,"num_read_kb":32539,"num_write":898,"num_write_kb":21474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.393143+0000","last_change":"2024-09-12T00:02:01.154807+0000","last_active":"2024-09-12T00:35:54.393143+0000","last_peered":"2024-09-12T00:35:54.393143+0000","last_clean":"2024-09-12T00:35:54.393143+0000","last_became_active":"2024-09-12T00:02:01.154464+0000","last_became_peered":"2024-09-12T00:02:01.154464+0000","last_unstale":"2024-09-12T00:35:54.393143+0000","last_undegraded":"2024-09-12T00:35:54.393143+0000","last_fullsized":"2024-09-12T00:35:54.393143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.047642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'356","reported_seq":955,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.920759+0000","last_change":"2024-09-12T00:02:03.156471+0000","last_active":"2024-09-12T00:38:28.920759+0000","last_peered":"2024-09-12T00:38:28.920759+0000","last_clean":"2024-09-12T00:38:28.920759+0000","last_became_active":"2024-09-12T00:02:03.156175+0000","last_became_peered":"2024-09-12T00:02:03.156175+0000","last_unstale":"2024-09-12T00:38:28.920759+0000","last_undegraded":"2024-09-12T00:38:28.920759+0000","last_fullsized":"2024-09-12T00:38:28.920759+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:33.670259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66861,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":1114,"num_write":466,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:56.510205+0000","last_change":"2024-09-12T00:02:05.165724+0000","last_active":"2024-09-12T00:35:56.510205+0000","last_peered":"2024-09-12T00:35:56.510205+0000","last_clean":"2024-09-12T00:35:56.510205+0000","last_became_active":"2024-09-12T00:02:05.165424+0000","last_became_peered":"2024-09-12T00:02:05.165424+0000","last_unstale":"2024-09-12T00:35:56.510205+0000","last_undegraded":"2024-09-12T00:35:56.510205+0000","last_fullsized":"2024-09-12T00:35:56.510205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:38.859922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'129","reported_seq":679,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.108575+0000","last_change":"2024-09-12T00:02:07.175107+0000","last_active":"2024-09-12T00:37:21.108575+0000","last_peered":"2024-09-12T00:37:21.108575+0000","last_clean":"2024-09-12T00:37:21.108575+0000","last_became_active":"2024-09-12T00:02:07.174795+0000","last_became_peered":"2024-09-12T00:02:07.174795+0000","last_unstale":"2024-09-12T00:37:21.108575+0000","last_undegraded":"2024-09-12T00:37:21.108575+0000","last_fullsized":"2024-09-12T00:37:21.108575+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.332589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":239,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'75","reported_seq":622,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.555629+0000","last_change":"2024-09-12T00:01:59.146503+0000","last_active":"2024-09-12T00:37:08.555629+0000","last_peered":"2024-09-12T00:37:08.555629+0000","last_clean":"2024-09-12T00:37:08.555629+0000","last_became_active":"2024-09-12T00:01:59.145411+0000","last_became_peered":"2024-09-12T00:01:59.145411+0000","last_unstale":"2024-09-12T00:37:08.555629+0000","last_undegraded":"2024-09-12T00:37:08.555629+0000","last_fullsized":"2024-09-12T00:37:08.555629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:33.082390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":104,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'300","reported_seq":944,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:23.003179+0000","last_change":"2024-09-12T00:01:57.147335+0000","last_active":"2024-09-12T00:38:23.003179+0000","last_peered":"2024-09-12T00:38:23.003179+0000","last_clean":"2024-09-12T00:38:23.003179+0000","last_became_active":"2024-09-12T00:01:57.146952+0000","last_became_peered":"2024-09-12T00:01:57.146952+0000","last_unstale":"2024-09-12T00:38:23.003179+0000","last_undegraded":"2024-09-12T00:38:23.003179+0000","last_fullsized":"2024-09-12T00:38:23.003179+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:11.335615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17404174,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":487,"num_read_kb":41499,"num_write":1191,"num_write_kb":32474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:47.503501+0000","last_change":"2024-09-12T00:02:01.156228+0000","last_active":"2024-09-12T00:34:47.503501+0000","last_peered":"2024-09-12T00:34:47.503501+0000","last_clean":"2024-09-12T00:34:47.503501+0000","last_became_active":"2024-09-12T00:02:01.155948+0000","last_became_peered":"2024-09-12T00:02:01.155948+0000","last_unstale":"2024-09-12T00:34:47.503501+0000","last_undegraded":"2024-09-12T00:34:47.503501+0000","last_fullsized":"2024-09-12T00:34:47.503501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:34.073281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'81","reported_seq":596,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:51.124923+0000","last_change":"2024-09-12T00:02:03.152995+0000","last_active":"2024-09-12T00:36:51.124923+0000","last_peered":"2024-09-12T00:36:51.124923+0000","last_clean":"2024-09-12T00:36:51.124923+0000","last_became_active":"2024-09-12T00:02:03.152708+0000","last_became_peered":"2024-09-12T00:02:03.152708+0000","last_unstale":"2024-09-12T00:36:51.124923+0000","last_undegraded":"2024-09-12T00:36:51.124923+0000","last_fullsized":"2024-09-12T00:36:51.124923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:00.923044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":85,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:56.510160+0000","last_change":"2024-09-12T00:02:05.163074+0000","last_active":"2024-09-12T00:35:56.510160+0000","last_peered":"2024-09-12T00:35:56.510160+0000","last_clean":"2024-09-12T00:35:56.510160+0000","last_became_active":"2024-09-12T00:02:05.162755+0000","last_became_peered":"2024-09-12T00:02:05.162755+0000","last_unstale":"2024-09-12T00:35:56.510160+0000","last_undegraded":"2024-09-12T00:35:56.510160+0000","last_fullsized":"2024-09-12T00:35:56.510160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:20.807313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'133","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.520320+0000","last_change":"2024-09-12T00:02:07.168207+0000","last_active":"2024-09-12T00:37:09.520320+0000","last_peered":"2024-09-12T00:37:09.520320+0000","last_clean":"2024-09-12T00:37:09.520320+0000","last_became_active":"2024-09-12T00:02:07.167851+0000","last_became_peered":"2024-09-12T00:02:07.167851+0000","last_unstale":"2024-09-12T00:37:09.520320+0000","last_undegraded":"2024-09-12T00:37:09.520320+0000","last_fullsized":"2024-09-12T00:37:09.520320+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:11.325627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":137,"num_write":333,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'4128","reported_seq":4726,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510282+0000","last_change":"2024-09-12T00:01:59.151349+0000","last_active":"2024-09-12T00:35:49.510282+0000","last_peered":"2024-09-12T00:35:49.510282+0000","last_clean":"2024-09-12T00:35:49.510282+0000","last_became_active":"2024-09-12T00:01:59.151026+0000","last_became_peered":"2024-09-12T00:01:59.151026+0000","last_unstale":"2024-09-12T00:35:49.510282+0000","last_undegraded":"2024-09-12T00:35:49.510282+0000","last_fullsized":"2024-09-12T00:35:49.510282+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":3000,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:16.187111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16602,"num_read_kb":13937,"num_write":6188,"num_write_kb":3085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'240","reported_seq":939,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.804729+0000","last_change":"2024-09-12T00:01:57.144752+0000","last_active":"2024-09-12T00:37:10.804729+0000","last_peered":"2024-09-12T00:37:10.804729+0000","last_clean":"2024-09-12T00:37:10.804729+0000","last_became_active":"2024-09-12T00:01:57.144269+0000","last_became_peered":"2024-09-12T00:01:57.144269+0000","last_unstale":"2024-09-12T00:37:10.804729+0000","last_undegraded":"2024-09-12T00:37:10.804729+0000","last_fullsized":"2024-09-12T00:37:10.804729+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:54.481149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":728542,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":647,"num_read_kb":1796,"num_write":865,"num_write_kb":33986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:52.513137+0000","last_change":"2024-09-12T00:02:01.155683+0000","last_active":"2024-09-12T00:35:52.513137+0000","last_peered":"2024-09-12T00:35:52.513137+0000","last_clean":"2024-09-12T00:35:52.513137+0000","last_became_active":"2024-09-12T00:02:01.155425+0000","last_became_peered":"2024-09-12T00:02:01.155425+0000","last_unstale":"2024-09-12T00:35:52.513137+0000","last_undegraded":"2024-09-12T00:35:52.513137+0000","last_fullsized":"2024-09-12T00:35:52.513137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:38.140909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'103","reported_seq":636,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.325100+0000","last_change":"2024-09-12T00:02:03.152143+0000","last_active":"2024-09-12T00:36:54.325100+0000","last_peered":"2024-09-12T00:36:54.325100+0000","last_clean":"2024-09-12T00:36:54.325100+0000","last_became_active":"2024-09-12T00:02:03.151839+0000","last_became_peered":"2024-09-12T00:02:03.151839+0000","last_unstale":"2024-09-12T00:36:54.325100+0000","last_undegraded":"2024-09-12T00:36:54.325100+0000","last_fullsized":"2024-09-12T00:36:54.325100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:56.820811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'751","reported_seq":2039,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.954004+0000","last_change":"2024-09-12T00:02:05.167777+0000","last_active":"2024-09-12T00:38:28.954004+0000","last_peered":"2024-09-12T00:38:28.954004+0000","last_clean":"2024-09-12T00:38:28.954004+0000","last_became_active":"2024-09-12T00:02:05.166985+0000","last_became_peered":"2024-09-12T00:02:05.166985+0000","last_unstale":"2024-09-12T00:38:28.954004+0000","last_undegraded":"2024-09-12T00:38:28.954004+0000","last_fullsized":"2024-09-12T00:38:28.954004+0000","mapping_epoch":32,"log_start":"261'701","ondisk_log_start":"261'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":701,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:46.965686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'217","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.117831+0000","last_change":"2024-09-12T00:02:07.167855+0000","last_active":"2024-09-12T00:37:23.117831+0000","last_peered":"2024-09-12T00:37:23.117831+0000","last_clean":"2024-09-12T00:37:23.117831+0000","last_became_active":"2024-09-12T00:02:07.167576+0000","last_became_peered":"2024-09-12T00:02:07.167576+0000","last_unstale":"2024-09-12T00:37:23.117831+0000","last_undegraded":"2024-09-12T00:37:23.117831+0000","last_fullsized":"2024-09-12T00:37:23.117831+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:16.693441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":605,"num_read_kb":603,"num_write":488,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'58","reported_seq":609,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:22.120801+0000","last_change":"2024-09-12T00:01:59.149396+0000","last_active":"2024-09-12T00:36:22.120801+0000","last_peered":"2024-09-12T00:36:22.120801+0000","last_clean":"2024-09-12T00:36:22.120801+0000","last_became_active":"2024-09-12T00:01:59.149087+0000","last_became_peered":"2024-09-12T00:01:59.149087+0000","last_unstale":"2024-09-12T00:36:22.120801+0000","last_undegraded":"2024-09-12T00:36:22.120801+0000","last_fullsized":"2024-09-12T00:36:22.120801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:13.031884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":233,"num_write":78,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'305","reported_seq":1002,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.507120+0000","last_change":"2024-09-12T00:01:57.153276+0000","last_active":"2024-09-12T00:38:36.507120+0000","last_peered":"2024-09-12T00:38:36.507120+0000","last_clean":"2024-09-12T00:38:36.507120+0000","last_became_active":"2024-09-12T00:01:57.152332+0000","last_became_peered":"2024-09-12T00:01:57.152332+0000","last_unstale":"2024-09-12T00:38:36.507120+0000","last_undegraded":"2024-09-12T00:38:36.507120+0000","last_fullsized":"2024-09-12T00:38:36.507120+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:07.357627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8905738,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":607,"num_read_kb":43786,"num_write":1133,"num_write_kb":39072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.393180+0000","last_change":"2024-09-12T00:02:01.154452+0000","last_active":"2024-09-12T00:35:54.393180+0000","last_peered":"2024-09-12T00:35:54.393180+0000","last_clean":"2024-09-12T00:35:54.393180+0000","last_became_active":"2024-09-12T00:02:01.154110+0000","last_became_peered":"2024-09-12T00:02:01.154110+0000","last_unstale":"2024-09-12T00:35:54.393180+0000","last_undegraded":"2024-09-12T00:35:54.393180+0000","last_fullsized":"2024-09-12T00:35:54.393180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:04.241524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'252","reported_seq":799,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:19.529625+0000","last_change":"2024-09-12T00:02:03.146008+0000","last_active":"2024-09-12T00:38:19.529625+0000","last_peered":"2024-09-12T00:38:19.529625+0000","last_clean":"2024-09-12T00:38:19.529625+0000","last_became_active":"2024-09-12T00:02:03.145673+0000","last_became_peered":"2024-09-12T00:02:03.145673+0000","last_unstale":"2024-09-12T00:38:19.529625+0000","last_undegraded":"2024-09-12T00:38:19.529625+0000","last_fullsized":"2024-09-12T00:38:19.529625+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:24.216453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51035,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":413,"num_read_kb":852,"num_write":342,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'777","reported_seq":2149,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.958358+0000","last_change":"2024-09-12T00:02:05.165636+0000","last_active":"2024-09-12T00:38:28.958358+0000","last_peered":"2024-09-12T00:38:28.958358+0000","last_clean":"2024-09-12T00:38:28.958358+0000","last_became_active":"2024-09-12T00:02:05.165283+0000","last_became_peered":"2024-09-12T00:02:05.165283+0000","last_unstale":"2024-09-12T00:38:28.958358+0000","last_undegraded":"2024-09-12T00:38:28.958358+0000","last_fullsized":"2024-09-12T00:38:28.958358+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:20.861078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'107","reported_seq":676,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:17.644092+0000","last_change":"2024-09-12T00:01:59.154031+0000","last_active":"2024-09-12T00:36:17.644092+0000","last_peered":"2024-09-12T00:36:17.644092+0000","last_clean":"2024-09-12T00:36:17.644092+0000","last_became_active":"2024-09-12T00:01:59.153704+0000","last_became_peered":"2024-09-12T00:01:59.153704+0000","last_unstale":"2024-09-12T00:36:17.644092+0000","last_undegraded":"2024-09-12T00:36:17.644092+0000","last_fullsized":"2024-09-12T00:36:17.644092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:25.468551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":389,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'278","reported_seq":917,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.568253+0000","last_change":"2024-09-12T00:01:57.155999+0000","last_active":"2024-09-12T00:37:10.568253+0000","last_peered":"2024-09-12T00:37:10.568253+0000","last_clean":"2024-09-12T00:37:10.568253+0000","last_became_active":"2024-09-12T00:01:57.154222+0000","last_became_peered":"2024-09-12T00:01:57.154222+0000","last_unstale":"2024-09-12T00:37:10.568253+0000","last_undegraded":"2024-09-12T00:37:10.568253+0000","last_fullsized":"2024-09-12T00:37:10.568253+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:34.043715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11402269,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":450,"num_read_kb":40357,"num_write":1089,"num_write_kb":32511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:31.497551+0000","last_change":"2024-09-12T00:02:01.144820+0000","last_active":"2024-09-12T00:34:31.497551+0000","last_peered":"2024-09-12T00:34:31.497551+0000","last_clean":"2024-09-12T00:34:31.497551+0000","last_became_active":"2024-09-12T00:02:01.144531+0000","last_became_peered":"2024-09-12T00:02:01.144531+0000","last_unstale":"2024-09-12T00:34:31.497551+0000","last_undegraded":"2024-09-12T00:34:31.497551+0000","last_fullsized":"2024-09-12T00:34:31.497551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:47.902602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'366","reported_seq":963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.399693+0000","last_change":"2024-09-12T00:02:03.155592+0000","last_active":"2024-09-12T00:36:54.399693+0000","last_peered":"2024-09-12T00:36:54.399693+0000","last_clean":"2024-09-12T00:36:54.399693+0000","last_became_active":"2024-09-12T00:02:03.155293+0000","last_became_peered":"2024-09-12T00:02:03.155293+0000","last_unstale":"2024-09-12T00:36:54.399693+0000","last_undegraded":"2024-09-12T00:36:54.399693+0000","last_fullsized":"2024-09-12T00:36:54.399693+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:29.029401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62749,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":1121,"num_write":476,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.509941+0000","last_change":"2024-09-12T00:02:05.168024+0000","last_active":"2024-09-12T00:35:49.509941+0000","last_peered":"2024-09-12T00:35:49.509941+0000","last_clean":"2024-09-12T00:35:49.509941+0000","last_became_active":"2024-09-12T00:02:05.167762+0000","last_became_peered":"2024-09-12T00:02:05.167762+0000","last_unstale":"2024-09-12T00:35:49.509941+0000","last_undegraded":"2024-09-12T00:35:49.509941+0000","last_fullsized":"2024-09-12T00:35:49.509941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:56.207387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'546","reported_seq":1342,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.940888+0000","last_change":"2024-09-12T00:02:07.172418+0000","last_active":"2024-09-12T00:38:28.940888+0000","last_peered":"2024-09-12T00:38:28.940888+0000","last_clean":"2024-09-12T00:38:28.940888+0000","last_became_active":"2024-09-12T00:02:07.172005+0000","last_became_peered":"2024-09-12T00:02:07.172005+0000","last_unstale":"2024-09-12T00:38:28.940888+0000","last_undegraded":"2024-09-12T00:38:28.940888+0000","last_fullsized":"2024-09-12T00:38:28.940888+0000","mapping_epoch":34,"log_start":"261'500","ondisk_log_start":"261'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:59.842808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1294,"num_read_kb":1285,"num_write":1129,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'119","reported_seq":688,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:49.065624+0000","last_change":"2024-09-12T00:01:59.152065+0000","last_active":"2024-09-12T00:36:49.065624+0000","last_peered":"2024-09-12T00:36:49.065624+0000","last_clean":"2024-09-12T00:36:49.065624+0000","last_became_active":"2024-09-12T00:01:59.151782+0000","last_became_peered":"2024-09-12T00:01:59.151782+0000","last_unstale":"2024-09-12T00:36:49.065624+0000","last_undegraded":"2024-09-12T00:36:49.065624+0000","last_fullsized":"2024-09-12T00:36:49.065624+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:29.853489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":439,"num_write":192,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'246","reported_seq":855,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.553989+0000","last_change":"2024-09-12T00:01:57.157778+0000","last_active":"2024-09-12T00:37:07.553989+0000","last_peered":"2024-09-12T00:37:07.553989+0000","last_clean":"2024-09-12T00:37:07.553989+0000","last_became_active":"2024-09-12T00:01:57.157370+0000","last_became_peered":"2024-09-12T00:01:57.157370+0000","last_unstale":"2024-09-12T00:37:07.553989+0000","last_undegraded":"2024-09-12T00:37:07.553989+0000","last_fullsized":"2024-09-12T00:37:07.553989+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:25.879830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":654605,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":382,"num_read_kb":3842,"num_write":909,"num_write_kb":16793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498474+0000","last_change":"2024-09-12T00:02:01.152227+0000","last_active":"2024-09-12T00:34:34.498474+0000","last_peered":"2024-09-12T00:34:34.498474+0000","last_clean":"2024-09-12T00:34:34.498474+0000","last_became_active":"2024-09-12T00:02:01.151914+0000","last_became_peered":"2024-09-12T00:02:01.151914+0000","last_unstale":"2024-09-12T00:34:34.498474+0000","last_undegraded":"2024-09-12T00:34:34.498474+0000","last_fullsized":"2024-09-12T00:34:34.498474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:15.461722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'276","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.700469+0000","last_change":"2024-09-12T00:02:03.155128+0000","last_active":"2024-09-12T00:38:36.700469+0000","last_peered":"2024-09-12T00:38:36.700469+0000","last_clean":"2024-09-12T00:38:36.700469+0000","last_became_active":"2024-09-12T00:02:03.154819+0000","last_became_peered":"2024-09-12T00:02:03.154819+0000","last_unstale":"2024-09-12T00:38:36.700469+0000","last_undegraded":"2024-09-12T00:38:36.700469+0000","last_fullsized":"2024-09-12T00:38:36.700469+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:47.375234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":1012,"num_write":362,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:42.502604+0000","last_change":"2024-09-12T00:02:05.168924+0000","last_active":"2024-09-12T00:34:42.502604+0000","last_peered":"2024-09-12T00:34:42.502604+0000","last_clean":"2024-09-12T00:34:42.502604+0000","last_became_active":"2024-09-12T00:02:05.168649+0000","last_became_peered":"2024-09-12T00:02:05.168649+0000","last_unstale":"2024-09-12T00:34:42.502604+0000","last_undegraded":"2024-09-12T00:34:42.502604+0000","last_fullsized":"2024-09-12T00:34:42.502604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:59.645822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2367","reported_seq":4178,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:10.204589+0000","last_change":"2024-09-12T00:02:07.175086+0000","last_active":"2024-09-12T00:38:10.204589+0000","last_peered":"2024-09-12T00:38:10.204589+0000","last_clean":"2024-09-12T00:38:10.204589+0000","last_became_active":"2024-09-12T00:02:07.174769+0000","last_became_peered":"2024-09-12T00:02:07.174769+0000","last_unstale":"2024-09-12T00:38:10.204589+0000","last_undegraded":"2024-09-12T00:38:10.204589+0000","last_fullsized":"2024-09-12T00:38:10.204589+0000","mapping_epoch":34,"log_start":"261'2300","ondisk_log_start":"261'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":2300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:04.650587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5961,"num_read_kb":5964,"num_write":4767,"num_write_kb":1768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'190","reported_seq":812,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.531588+0000","last_change":"2024-09-12T00:01:59.156546+0000","last_active":"2024-09-12T00:36:54.531588+0000","last_peered":"2024-09-12T00:36:54.531588+0000","last_clean":"2024-09-12T00:36:54.531588+0000","last_became_active":"2024-09-12T00:01:59.156252+0000","last_became_peered":"2024-09-12T00:01:59.156252+0000","last_unstale":"2024-09-12T00:36:54.531588+0000","last_undegraded":"2024-09-12T00:36:54.531588+0000","last_fullsized":"2024-09-12T00:36:54.531588+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:11.696792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":702,"num_write":296,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'306","reported_seq":945,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.552837+0000","last_change":"2024-09-12T00:01:57.158137+0000","last_active":"2024-09-12T00:37:07.552837+0000","last_peered":"2024-09-12T00:37:07.552837+0000","last_clean":"2024-09-12T00:37:07.552837+0000","last_became_active":"2024-09-12T00:01:57.157699+0000","last_became_peered":"2024-09-12T00:01:57.157699+0000","last_unstale":"2024-09-12T00:37:07.552837+0000","last_undegraded":"2024-09-12T00:37:07.552837+0000","last_fullsized":"2024-09-12T00:37:07.552837+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:28.312365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5571188,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":499,"num_read_kb":32954,"num_write":1159,"num_write_kb":41911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510167+0000","last_change":"2024-09-12T00:02:01.153356+0000","last_active":"2024-09-12T00:35:49.510167+0000","last_peered":"2024-09-12T00:35:49.510167+0000","last_clean":"2024-09-12T00:35:49.510167+0000","last_became_active":"2024-09-12T00:02:01.153090+0000","last_became_peered":"2024-09-12T00:02:01.153090+0000","last_unstale":"2024-09-12T00:35:49.510167+0000","last_undegraded":"2024-09-12T00:35:49.510167+0000","last_fullsized":"2024-09-12T00:35:49.510167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:13.705146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'316","reported_seq":889,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.457091+0000","last_change":"2024-09-12T00:02:03.153714+0000","last_active":"2024-09-12T00:37:23.457091+0000","last_peered":"2024-09-12T00:37:23.457091+0000","last_clean":"2024-09-12T00:37:23.457091+0000","last_became_active":"2024-09-12T00:02:03.153386+0000","last_became_peered":"2024-09-12T00:02:03.153386+0000","last_unstale":"2024-09-12T00:37:23.457091+0000","last_undegraded":"2024-09-12T00:37:23.457091+0000","last_fullsized":"2024-09-12T00:37:23.457091+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:33.982115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65188,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":520,"num_read_kb":1069,"num_write":432,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'777","reported_seq":2231,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.959436+0000","last_change":"2024-09-12T00:02:05.166163+0000","last_active":"2024-09-12T00:38:28.959436+0000","last_peered":"2024-09-12T00:38:28.959436+0000","last_clean":"2024-09-12T00:38:28.959436+0000","last_became_active":"2024-09-12T00:02:05.165892+0000","last_became_peered":"2024-09-12T00:02:05.165892+0000","last_unstale":"2024-09-12T00:38:28.959436+0000","last_undegraded":"2024-09-12T00:38:28.959436+0000","last_fullsized":"2024-09-12T00:38:28.959436+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:29.616858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'87","reported_seq":561,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.556657+0000","last_change":"2024-09-12T00:02:07.169522+0000","last_active":"2024-09-12T00:38:27.556657+0000","last_peered":"2024-09-12T00:38:27.556657+0000","last_clean":"2024-09-12T00:38:27.556657+0000","last_became_active":"2024-09-12T00:02:07.169216+0000","last_became_peered":"2024-09-12T00:02:07.169216+0000","last_unstale":"2024-09-12T00:38:27.556657+0000","last_undegraded":"2024-09-12T00:38:27.556657+0000","last_fullsized":"2024-09-12T00:38:27.556657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:40.757968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":199,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'131","reported_seq":707,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.791148+0000","last_change":"2024-09-12T00:01:59.153212+0000","last_active":"2024-09-12T00:37:01.791148+0000","last_peered":"2024-09-12T00:37:01.791148+0000","last_clean":"2024-09-12T00:37:01.791148+0000","last_became_active":"2024-09-12T00:01:59.152836+0000","last_became_peered":"2024-09-12T00:01:59.152836+0000","last_unstale":"2024-09-12T00:37:01.791148+0000","last_undegraded":"2024-09-12T00:37:01.791148+0000","last_fullsized":"2024-09-12T00:37:01.791148+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:52.164308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":483,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'271","reported_seq":908,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.009854+0000","last_change":"2024-09-12T00:01:57.143503+0000","last_active":"2024-09-12T00:37:08.009854+0000","last_peered":"2024-09-12T00:37:08.009854+0000","last_clean":"2024-09-12T00:37:08.009854+0000","last_became_active":"2024-09-12T00:01:57.143137+0000","last_became_peered":"2024-09-12T00:01:57.143137+0000","last_unstale":"2024-09-12T00:37:08.009854+0000","last_undegraded":"2024-09-12T00:37:08.009854+0000","last_fullsized":"2024-09-12T00:37:08.009854+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:29.714719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":958448,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":471,"num_read_kb":8103,"num_write":1014,"num_write_kb":32276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:39.499399+0000","last_change":"2024-09-12T00:02:01.144552+0000","last_active":"2024-09-12T00:34:39.499399+0000","last_peered":"2024-09-12T00:34:39.499399+0000","last_clean":"2024-09-12T00:34:39.499399+0000","last_became_active":"2024-09-12T00:02:01.144199+0000","last_became_peered":"2024-09-12T00:02:01.144199+0000","last_unstale":"2024-09-12T00:34:39.499399+0000","last_undegraded":"2024-09-12T00:34:39.499399+0000","last_fullsized":"2024-09-12T00:34:39.499399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:06.942666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'487","reported_seq":1119,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.934906+0000","last_change":"2024-09-12T00:02:03.155884+0000","last_active":"2024-09-12T00:38:36.934906+0000","last_peered":"2024-09-12T00:38:36.934906+0000","last_clean":"2024-09-12T00:38:36.934906+0000","last_became_active":"2024-09-12T00:02:03.155625+0000","last_became_peered":"2024-09-12T00:02:03.155625+0000","last_unstale":"2024-09-12T00:38:36.934906+0000","last_undegraded":"2024-09-12T00:38:36.934906+0000","last_fullsized":"2024-09-12T00:38:36.934906+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:38.186042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104418,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":868,"num_read_kb":2109,"num_write":716,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499199+0000","last_change":"2024-09-12T00:02:05.169143+0000","last_active":"2024-09-12T00:34:34.499199+0000","last_peered":"2024-09-12T00:34:34.499199+0000","last_clean":"2024-09-12T00:34:34.499199+0000","last_became_active":"2024-09-12T00:02:05.168816+0000","last_became_peered":"2024-09-12T00:02:05.168816+0000","last_unstale":"2024-09-12T00:34:34.499199+0000","last_undegraded":"2024-09-12T00:34:34.499199+0000","last_fullsized":"2024-09-12T00:34:34.499199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:06.783756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'158","reported_seq":651,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.701085+0000","last_change":"2024-09-12T00:02:07.172017+0000","last_active":"2024-09-12T00:37:07.701085+0000","last_peered":"2024-09-12T00:37:07.701085+0000","last_clean":"2024-09-12T00:37:07.701085+0000","last_became_active":"2024-09-12T00:02:07.171762+0000","last_became_peered":"2024-09-12T00:02:07.171762+0000","last_unstale":"2024-09-12T00:37:07.701085+0000","last_undegraded":"2024-09-12T00:37:07.701085+0000","last_fullsized":"2024-09-12T00:37:07.701085+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:23.109250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":181,"num_read_kb":171,"num_write":367,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'250","reported_seq":889,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.771797+0000","last_change":"2024-09-12T00:01:59.148026+0000","last_active":"2024-09-12T00:37:10.771797+0000","last_peered":"2024-09-12T00:37:10.771797+0000","last_clean":"2024-09-12T00:37:10.771797+0000","last_became_active":"2024-09-12T00:01:59.147762+0000","last_became_peered":"2024-09-12T00:01:59.147762+0000","last_unstale":"2024-09-12T00:37:10.771797+0000","last_undegraded":"2024-09-12T00:37:10.771797+0000","last_fullsized":"2024-09-12T00:37:10.771797+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:56.095727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1058,"num_read_kb":865,"num_write":369,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'254","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:06.955645+0000","last_change":"2024-09-12T00:01:57.140135+0000","last_active":"2024-09-12T00:36:06.955645+0000","last_peered":"2024-09-12T00:36:06.955645+0000","last_clean":"2024-09-12T00:36:06.955645+0000","last_became_active":"2024-09-12T00:01:57.139677+0000","last_became_peered":"2024-09-12T00:01:57.139677+0000","last_unstale":"2024-09-12T00:36:06.955645+0000","last_undegraded":"2024-09-12T00:36:06.955645+0000","last_fullsized":"2024-09-12T00:36:06.955645+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:12.642146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11620117,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":384,"num_read_kb":3669,"num_write":999,"num_write_kb":17146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510008+0000","last_change":"2024-09-12T00:02:01.151052+0000","last_active":"2024-09-12T00:35:49.510008+0000","last_peered":"2024-09-12T00:35:49.510008+0000","last_clean":"2024-09-12T00:35:49.510008+0000","last_became_active":"2024-09-12T00:02:01.150796+0000","last_became_peered":"2024-09-12T00:02:01.150796+0000","last_unstale":"2024-09-12T00:35:49.510008+0000","last_undegraded":"2024-09-12T00:35:49.510008+0000","last_fullsized":"2024-09-12T00:35:49.510008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:30.994773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'271","reported_seq":831,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.908210+0000","last_change":"2024-09-12T00:02:03.153772+0000","last_active":"2024-09-12T00:38:28.908210+0000","last_peered":"2024-09-12T00:38:28.908210+0000","last_clean":"2024-09-12T00:38:28.908210+0000","last_became_active":"2024-09-12T00:02:03.153447+0000","last_became_peered":"2024-09-12T00:02:03.153447+0000","last_unstale":"2024-09-12T00:38:28.908210+0000","last_undegraded":"2024-09-12T00:38:28.908210+0000","last_fullsized":"2024-09-12T00:38:28.908210+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:52.487542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52403,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":456,"num_read_kb":904,"num_write":414,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":471,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.510853+0000","last_change":"2024-09-12T00:02:05.163959+0000","last_active":"2024-09-12T00:35:54.510853+0000","last_peered":"2024-09-12T00:35:54.510853+0000","last_clean":"2024-09-12T00:35:54.510853+0000","last_became_active":"2024-09-12T00:02:05.163689+0000","last_became_peered":"2024-09-12T00:02:05.163689+0000","last_unstale":"2024-09-12T00:35:54.510853+0000","last_undegraded":"2024-09-12T00:35:54.510853+0000","last_fullsized":"2024-09-12T00:35:54.510853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:14.624849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'128","reported_seq":610,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:14.529969+0000","last_change":"2024-09-12T00:02:07.172273+0000","last_active":"2024-09-12T00:38:14.529969+0000","last_peered":"2024-09-12T00:38:14.529969+0000","last_clean":"2024-09-12T00:38:14.529969+0000","last_became_active":"2024-09-12T00:02:07.171942+0000","last_became_peered":"2024-09-12T00:02:07.171942+0000","last_unstale":"2024-09-12T00:38:14.529969+0000","last_undegraded":"2024-09-12T00:38:14.529969+0000","last_fullsized":"2024-09-12T00:38:14.529969+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:54.534357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'138","reported_seq":727,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.949864+0000","last_change":"2024-09-12T00:01:59.150356+0000","last_active":"2024-09-12T00:36:59.949864+0000","last_peered":"2024-09-12T00:36:59.949864+0000","last_clean":"2024-09-12T00:36:59.949864+0000","last_became_active":"2024-09-12T00:01:59.148534+0000","last_became_peered":"2024-09-12T00:01:59.148534+0000","last_unstale":"2024-09-12T00:36:59.949864+0000","last_undegraded":"2024-09-12T00:36:59.949864+0000","last_fullsized":"2024-09-12T00:36:59.949864+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:28.691183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":510,"num_write":211,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'303","reported_seq":944,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.857744+0000","last_change":"2024-09-12T00:01:57.167545+0000","last_active":"2024-09-12T00:37:09.857744+0000","last_peered":"2024-09-12T00:37:09.857744+0000","last_clean":"2024-09-12T00:37:09.857744+0000","last_became_active":"2024-09-12T00:01:57.165226+0000","last_became_peered":"2024-09-12T00:01:57.165226+0000","last_unstale":"2024-09-12T00:37:09.857744+0000","last_undegraded":"2024-09-12T00:37:09.857744+0000","last_fullsized":"2024-09-12T00:37:09.857744+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:33.371625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6032007,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":517,"num_read_kb":11178,"num_write":1159,"num_write_kb":42398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510231+0000","last_change":"2024-09-12T00:02:01.154098+0000","last_active":"2024-09-12T00:35:49.510231+0000","last_peered":"2024-09-12T00:35:49.510231+0000","last_clean":"2024-09-12T00:35:49.510231+0000","last_became_active":"2024-09-12T00:02:01.153818+0000","last_became_peered":"2024-09-12T00:02:01.153818+0000","last_unstale":"2024-09-12T00:35:49.510231+0000","last_undegraded":"2024-09-12T00:35:49.510231+0000","last_fullsized":"2024-09-12T00:35:49.510231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:57.741932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'287","reported_seq":846,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:09.529359+0000","last_change":"2024-09-12T00:02:03.152712+0000","last_active":"2024-09-12T00:38:09.529359+0000","last_peered":"2024-09-12T00:38:09.529359+0000","last_clean":"2024-09-12T00:38:09.529359+0000","last_became_active":"2024-09-12T00:02:03.152421+0000","last_became_peered":"2024-09-12T00:02:03.152421+0000","last_unstale":"2024-09-12T00:38:09.529359+0000","last_undegraded":"2024-09-12T00:38:09.529359+0000","last_fullsized":"2024-09-12T00:38:09.529359+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:06.190143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61953,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":1004,"num_write":396,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'757","reported_seq":2114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.955130+0000","last_change":"2024-09-12T00:02:05.164910+0000","last_active":"2024-09-12T00:38:28.955130+0000","last_peered":"2024-09-12T00:38:28.955130+0000","last_clean":"2024-09-12T00:38:28.955130+0000","last_became_active":"2024-09-12T00:02:05.164655+0000","last_became_peered":"2024-09-12T00:02:05.164655+0000","last_unstale":"2024-09-12T00:38:28.955130+0000","last_undegraded":"2024-09-12T00:38:28.955130+0000","last_fullsized":"2024-09-12T00:38:28.955130+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:28.772936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'95","reported_seq":570,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:00.719827+0000","last_change":"2024-09-12T00:02:07.165060+0000","last_active":"2024-09-12T00:37:00.719827+0000","last_peered":"2024-09-12T00:37:00.719827+0000","last_clean":"2024-09-12T00:37:00.719827+0000","last_became_active":"2024-09-12T00:02:07.164754+0000","last_became_peered":"2024-09-12T00:02:07.164754+0000","last_unstale":"2024-09-12T00:37:00.719827+0000","last_undegraded":"2024-09-12T00:37:00.719827+0000","last_fullsized":"2024-09-12T00:37:00.719827+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:35.892955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":233,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'85","reported_seq":639,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:21.919959+0000","last_change":"2024-09-12T00:01:59.157814+0000","last_active":"2024-09-12T00:36:21.919959+0000","last_peered":"2024-09-12T00:36:21.919959+0000","last_clean":"2024-09-12T00:36:21.919959+0000","last_became_active":"2024-09-12T00:01:59.157172+0000","last_became_peered":"2024-09-12T00:01:59.157172+0000","last_unstale":"2024-09-12T00:36:21.919959+0000","last_undegraded":"2024-09-12T00:36:21.919959+0000","last_fullsized":"2024-09-12T00:36:21.919959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:05.814891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":384,"num_read_kb":356,"num_write":138,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'315","reported_seq":965,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:19.008345+0000","last_change":"2024-09-12T00:01:57.146086+0000","last_active":"2024-09-12T00:38:19.008345+0000","last_peered":"2024-09-12T00:38:19.008345+0000","last_clean":"2024-09-12T00:38:19.008345+0000","last_became_active":"2024-09-12T00:01:57.145710+0000","last_became_peered":"2024-09-12T00:01:57.145710+0000","last_unstale":"2024-09-12T00:38:19.008345+0000","last_undegraded":"2024-09-12T00:38:19.008345+0000","last_fullsized":"2024-09-12T00:38:19.008345+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:34.573066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7008783,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":520,"num_read_kb":20016,"num_write":1232,"num_write_kb":22247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":1920,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.884434+0000","last_change":"2024-09-12T00:02:01.144164+0000","last_active":"2024-09-12T00:38:35.884434+0000","last_peered":"2024-09-12T00:38:35.884434+0000","last_clean":"2024-09-12T00:38:35.884434+0000","last_became_active":"2024-09-12T00:02:01.143823+0000","last_became_peered":"2024-09-12T00:02:01.143823+0000","last_unstale":"2024-09-12T00:38:35.884434+0000","last_undegraded":"2024-09-12T00:38:35.884434+0000","last_fullsized":"2024-09-12T00:38:35.884434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:46.468299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1676,"num_read_kb":1674,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'65","reported_seq":563,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:26.578538+0000","last_change":"2024-09-12T00:02:03.157279+0000","last_active":"2024-09-12T00:36:26.578538+0000","last_peered":"2024-09-12T00:36:26.578538+0000","last_clean":"2024-09-12T00:36:26.578538+0000","last_became_active":"2024-09-12T00:02:03.156680+0000","last_became_peered":"2024-09-12T00:02:03.156680+0000","last_unstale":"2024-09-12T00:36:26.578538+0000","last_undegraded":"2024-09-12T00:36:26.578538+0000","last_fullsized":"2024-09-12T00:36:26.578538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:51.959162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'774","reported_seq":2288,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.892384+0000","last_change":"2024-09-12T00:02:05.164449+0000","last_active":"2024-09-12T00:38:35.892384+0000","last_peered":"2024-09-12T00:38:35.892384+0000","last_clean":"2024-09-12T00:38:35.892384+0000","last_became_active":"2024-09-12T00:02:05.163596+0000","last_became_peered":"2024-09-12T00:02:05.163596+0000","last_unstale":"2024-09-12T00:38:35.892384+0000","last_undegraded":"2024-09-12T00:38:35.892384+0000","last_fullsized":"2024-09-12T00:38:35.892384+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:09.031568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'118","reported_seq":600,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.085766+0000","last_change":"2024-09-12T00:02:07.169460+0000","last_active":"2024-09-12T00:37:22.085766+0000","last_peered":"2024-09-12T00:37:22.085766+0000","last_clean":"2024-09-12T00:37:22.085766+0000","last_became_active":"2024-09-12T00:02:07.169160+0000","last_became_peered":"2024-09-12T00:02:07.169160+0000","last_unstale":"2024-09-12T00:37:22.085766+0000","last_undegraded":"2024-09-12T00:37:22.085766+0000","last_fullsized":"2024-09-12T00:37:22.085766+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:26.962721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":119,"num_write":276,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'226","reported_seq":785,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.164666+0000","last_change":"2024-09-12T00:01:59.152409+0000","last_active":"2024-09-12T00:37:07.164666+0000","last_peered":"2024-09-12T00:37:07.164666+0000","last_clean":"2024-09-12T00:37:07.164666+0000","last_became_active":"2024-09-12T00:01:59.152145+0000","last_became_peered":"2024-09-12T00:01:59.152145+0000","last_unstale":"2024-09-12T00:37:07.164666+0000","last_undegraded":"2024-09-12T00:37:07.164666+0000","last_fullsized":"2024-09-12T00:37:07.164666+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:24.656234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":744,"num_write":332,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'381","reported_seq":1086,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.378930+0000","last_change":"2024-09-12T00:01:57.141659+0000","last_active":"2024-09-12T00:38:37.378930+0000","last_peered":"2024-09-12T00:38:37.378930+0000","last_clean":"2024-09-12T00:38:37.378930+0000","last_became_active":"2024-09-12T00:01:57.140715+0000","last_became_peered":"2024-09-12T00:01:57.140715+0000","last_unstale":"2024-09-12T00:38:37.378930+0000","last_undegraded":"2024-09-12T00:38:37.378930+0000","last_fullsized":"2024-09-12T00:38:37.378930+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:50.244966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":346,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":671,"num_read_kb":94303,"num_write":1256,"num_write_kb":32809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.392478+0000","last_change":"2024-09-12T00:02:01.153751+0000","last_active":"2024-09-12T00:35:49.392478+0000","last_peered":"2024-09-12T00:35:49.392478+0000","last_clean":"2024-09-12T00:35:49.392478+0000","last_became_active":"2024-09-12T00:02:01.153347+0000","last_became_peered":"2024-09-12T00:02:01.153347+0000","last_unstale":"2024-09-12T00:35:49.392478+0000","last_undegraded":"2024-09-12T00:35:49.392478+0000","last_fullsized":"2024-09-12T00:35:49.392478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:05.059094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'312","reported_seq":894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.923474+0000","last_change":"2024-09-12T00:02:03.155029+0000","last_active":"2024-09-12T00:38:28.923474+0000","last_peered":"2024-09-12T00:38:28.923474+0000","last_clean":"2024-09-12T00:38:28.923474+0000","last_became_active":"2024-09-12T00:02:03.154752+0000","last_became_peered":"2024-09-12T00:02:03.154752+0000","last_unstale":"2024-09-12T00:38:28.923474+0000","last_undegraded":"2024-09-12T00:38:28.923474+0000","last_fullsized":"2024-09-12T00:38:28.923474+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:16.822889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56942,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":509,"num_read_kb":981,"num_write":406,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627588+0000","last_change":"2024-09-12T00:02:05.164441+0000","last_active":"2024-09-12T00:35:49.627588+0000","last_peered":"2024-09-12T00:35:49.627588+0000","last_clean":"2024-09-12T00:35:49.627588+0000","last_became_active":"2024-09-12T00:02:05.164108+0000","last_became_peered":"2024-09-12T00:02:05.164108+0000","last_unstale":"2024-09-12T00:35:49.627588+0000","last_undegraded":"2024-09-12T00:35:49.627588+0000","last_fullsized":"2024-09-12T00:35:49.627588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:12.635310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'159","reported_seq":633,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.847980+0000","last_change":"2024-09-12T00:02:07.169610+0000","last_active":"2024-09-12T00:36:52.847980+0000","last_peered":"2024-09-12T00:36:52.847980+0000","last_clean":"2024-09-12T00:36:52.847980+0000","last_became_active":"2024-09-12T00:02:07.169351+0000","last_became_peered":"2024-09-12T00:02:07.169351+0000","last_unstale":"2024-09-12T00:36:52.847980+0000","last_undegraded":"2024-09-12T00:36:52.847980+0000","last_fullsized":"2024-09-12T00:36:52.847980+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:28.308716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":164,"num_write":397,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'164","reported_seq":768,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:26.283270+0000","last_change":"2024-09-12T00:01:59.151096+0000","last_active":"2024-09-12T00:36:26.283270+0000","last_peered":"2024-09-12T00:36:26.283270+0000","last_clean":"2024-09-12T00:36:26.283270+0000","last_became_active":"2024-09-12T00:01:59.150072+0000","last_became_peered":"2024-09-12T00:01:59.150072+0000","last_unstale":"2024-09-12T00:36:26.283270+0000","last_undegraded":"2024-09-12T00:36:26.283270+0000","last_fullsized":"2024-09-12T00:36:26.283270+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:28.419527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":763,"num_read_kb":636,"num_write":273,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":605,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:46.508442+0000","last_change":"2024-09-12T00:01:39.721517+0000","last_active":"2024-09-12T00:35:46.508442+0000","last_peered":"2024-09-12T00:35:46.508442+0000","last_clean":"2024-09-12T00:35:46.508442+0000","last_became_active":"2024-09-12T00:01:39.720425+0000","last_became_peered":"2024-09-12T00:01:39.720425+0000","last_unstale":"2024-09-12T00:35:46.508442+0000","last_undegraded":"2024-09-12T00:35:46.508442+0000","last_fullsized":"2024-09-12T00:35:46.508442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:37.438834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:37.438834+0000","last_clean_scrub_stamp":"2024-09-12T00:01:37.438834+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:26.565085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":512,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.386954+0000","last_change":"2024-09-12T00:01:48.515868+0000","last_active":"2024-09-12T00:35:09.386954+0000","last_peered":"2024-09-12T00:35:09.386954+0000","last_clean":"2024-09-12T00:35:09.386954+0000","last_became_active":"2024-09-12T00:01:46.613916+0000","last_became_peered":"2024-09-12T00:01:46.613916+0000","last_unstale":"2024-09-12T00:35:09.386954+0000","last_undegraded":"2024-09-12T00:35:09.386954+0000","last_fullsized":"2024-09-12T00:35:09.386954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:23.127685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014566500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'350","reported_seq":1043,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.483073+0000","last_change":"2024-09-12T00:01:57.141951+0000","last_active":"2024-09-12T00:38:37.483073+0000","last_peered":"2024-09-12T00:38:37.483073+0000","last_clean":"2024-09-12T00:38:37.483073+0000","last_became_active":"2024-09-12T00:01:57.141553+0000","last_became_peered":"2024-09-12T00:01:57.141553+0000","last_unstale":"2024-09-12T00:38:37.483073+0000","last_undegraded":"2024-09-12T00:38:37.483073+0000","last_fullsized":"2024-09-12T00:38:37.483073+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:47.205119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11861347,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":681,"num_read_kb":51086,"num_write":1018,"num_write_kb":49735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.387995+0000","last_change":"2024-09-12T00:02:01.148969+0000","last_active":"2024-09-12T00:35:24.387995+0000","last_peered":"2024-09-12T00:35:24.387995+0000","last_clean":"2024-09-12T00:35:24.387995+0000","last_became_active":"2024-09-12T00:02:01.148696+0000","last_became_peered":"2024-09-12T00:02:01.148696+0000","last_unstale":"2024-09-12T00:35:24.387995+0000","last_undegraded":"2024-09-12T00:35:24.387995+0000","last_fullsized":"2024-09-12T00:35:24.387995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:28.294552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'675","reported_seq":1354,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.925680+0000","last_change":"2024-09-12T00:02:03.150355+0000","last_active":"2024-09-12T00:38:28.925680+0000","last_peered":"2024-09-12T00:38:28.925680+0000","last_clean":"2024-09-12T00:38:28.925680+0000","last_became_active":"2024-09-12T00:02:03.150075+0000","last_became_peered":"2024-09-12T00:02:03.150075+0000","last_unstale":"2024-09-12T00:38:28.925680+0000","last_undegraded":"2024-09-12T00:38:28.925680+0000","last_fullsized":"2024-09-12T00:38:28.925680+0000","mapping_epoch":30,"log_start":"261'600","ondisk_log_start":"261'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":600,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:08.116055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158560,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1315,"num_read_kb":2733,"num_write":1224,"num_write_kb":1081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499342+0000","last_change":"2024-09-12T00:02:05.162858+0000","last_active":"2024-09-12T00:34:34.499342+0000","last_peered":"2024-09-12T00:34:34.499342+0000","last_clean":"2024-09-12T00:34:34.499342+0000","last_became_active":"2024-09-12T00:02:05.162455+0000","last_became_peered":"2024-09-12T00:02:05.162455+0000","last_unstale":"2024-09-12T00:34:34.499342+0000","last_undegraded":"2024-09-12T00:34:34.499342+0000","last_fullsized":"2024-09-12T00:34:34.499342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.590391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'258","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.461047+0000","last_change":"2024-09-12T00:02:07.168139+0000","last_active":"2024-09-12T00:37:23.461047+0000","last_peered":"2024-09-12T00:37:23.461047+0000","last_clean":"2024-09-12T00:37:23.461047+0000","last_became_active":"2024-09-12T00:02:07.167844+0000","last_became_peered":"2024-09-12T00:02:07.167844+0000","last_unstale":"2024-09-12T00:37:23.461047+0000","last_undegraded":"2024-09-12T00:37:23.461047+0000","last_fullsized":"2024-09-12T00:37:23.461047+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:00.761039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":469,"num_read_kb":454,"num_write":531,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'172","reported_seq":761,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:10.423640+0000","last_change":"2024-09-12T00:01:59.149437+0000","last_active":"2024-09-12T00:36:10.423640+0000","last_peered":"2024-09-12T00:36:10.423640+0000","last_clean":"2024-09-12T00:36:10.423640+0000","last_became_active":"2024-09-12T00:01:59.149145+0000","last_became_peered":"2024-09-12T00:01:59.149145+0000","last_unstale":"2024-09-12T00:36:10.423640+0000","last_undegraded":"2024-09-12T00:36:10.423640+0000","last_fullsized":"2024-09-12T00:36:10.423640+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:31.451704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":604,"num_write":249,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.393043+0000","last_change":"2024-09-12T00:01:48.515091+0000","last_active":"2024-09-12T00:35:54.393043+0000","last_peered":"2024-09-12T00:35:54.393043+0000","last_clean":"2024-09-12T00:35:54.393043+0000","last_became_active":"2024-09-12T00:01:46.505677+0000","last_became_peered":"2024-09-12T00:01:46.505677+0000","last_unstale":"2024-09-12T00:35:54.393043+0000","last_undegraded":"2024-09-12T00:35:54.393043+0000","last_fullsized":"2024-09-12T00:35:54.393043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:07.430053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075102999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'264","reported_seq":882,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:28.001470+0000","last_change":"2024-09-12T00:01:57.152548+0000","last_active":"2024-09-12T00:36:28.001470+0000","last_peered":"2024-09-12T00:36:28.001470+0000","last_clean":"2024-09-12T00:36:28.001470+0000","last_became_active":"2024-09-12T00:01:57.152153+0000","last_became_peered":"2024-09-12T00:01:57.152153+0000","last_unstale":"2024-09-12T00:36:28.001470+0000","last_undegraded":"2024-09-12T00:36:28.001470+0000","last_fullsized":"2024-09-12T00:36:28.001470+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:18.135861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506847,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":438,"num_read_kb":31134,"num_write":931,"num_write_kb":29868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.382185+0000","last_change":"2024-09-12T00:02:01.153210+0000","last_active":"2024-09-12T00:34:34.382185+0000","last_peered":"2024-09-12T00:34:34.382185+0000","last_clean":"2024-09-12T00:34:34.382185+0000","last_became_active":"2024-09-12T00:02:01.152904+0000","last_became_peered":"2024-09-12T00:02:01.152904+0000","last_unstale":"2024-09-12T00:34:34.382185+0000","last_undegraded":"2024-09-12T00:34:34.382185+0000","last_fullsized":"2024-09-12T00:34:34.382185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:50.681148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1195","reported_seq":2538,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.950946+0000","last_change":"2024-09-12T00:02:03.153993+0000","last_active":"2024-09-12T00:38:28.950946+0000","last_peered":"2024-09-12T00:38:28.950946+0000","last_clean":"2024-09-12T00:38:28.950946+0000","last_became_active":"2024-09-12T00:02:03.153702+0000","last_became_peered":"2024-09-12T00:02:03.153702+0000","last_unstale":"2024-09-12T00:38:28.950946+0000","last_undegraded":"2024-09-12T00:38:28.950946+0000","last_fullsized":"2024-09-12T00:38:28.950946+0000","mapping_epoch":30,"log_start":"261'1100","ondisk_log_start":"261'1100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":1100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.693992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153682,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1878,"num_read_kb":3200,"num_write":996,"num_write_kb":845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:29.389647+0000","last_change":"2024-09-12T00:02:05.172331+0000","last_active":"2024-09-12T00:35:29.389647+0000","last_peered":"2024-09-12T00:35:29.389647+0000","last_clean":"2024-09-12T00:35:29.389647+0000","last_became_active":"2024-09-12T00:02:05.171787+0000","last_became_peered":"2024-09-12T00:02:05.171787+0000","last_unstale":"2024-09-12T00:35:29.389647+0000","last_undegraded":"2024-09-12T00:35:29.389647+0000","last_fullsized":"2024-09-12T00:35:29.389647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:38.114555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'217","reported_seq":737,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.191898+0000","last_change":"2024-09-12T00:02:07.169700+0000","last_active":"2024-09-12T00:36:56.191898+0000","last_peered":"2024-09-12T00:36:56.191898+0000","last_clean":"2024-09-12T00:36:56.191898+0000","last_became_active":"2024-09-12T00:02:07.169173+0000","last_became_peered":"2024-09-12T00:02:07.169173+0000","last_unstale":"2024-09-12T00:36:56.191898+0000","last_undegraded":"2024-09-12T00:36:56.191898+0000","last_fullsized":"2024-09-12T00:36:56.191898+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:07.710548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":374,"num_read_kb":362,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'88","reported_seq":639,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:20.939776+0000","last_change":"2024-09-12T00:01:59.139141+0000","last_active":"2024-09-12T00:37:20.939776+0000","last_peered":"2024-09-12T00:37:20.939776+0000","last_clean":"2024-09-12T00:37:20.939776+0000","last_became_active":"2024-09-12T00:01:59.138731+0000","last_became_peered":"2024-09-12T00:01:59.138731+0000","last_unstale":"2024-09-12T00:37:20.939776+0000","last_undegraded":"2024-09-12T00:37:20.939776+0000","last_fullsized":"2024-09-12T00:37:20.939776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:31.598716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":368,"num_read_kb":306,"num_write":121,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":503,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.503944+0000","last_change":"2024-09-12T00:01:50.044924+0000","last_active":"2024-09-12T00:35:09.503944+0000","last_peered":"2024-09-12T00:35:09.503944+0000","last_clean":"2024-09-12T00:35:09.503944+0000","last_became_active":"2024-09-12T00:01:46.505857+0000","last_became_peered":"2024-09-12T00:01:46.505857+0000","last_unstale":"2024-09-12T00:35:09.503944+0000","last_undegraded":"2024-09-12T00:35:09.503944+0000","last_fullsized":"2024-09-12T00:35:09.503944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:18.728534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039331300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'267","reported_seq":872,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.360496+0000","last_change":"2024-09-12T00:01:57.154563+0000","last_active":"2024-09-12T00:37:08.360496+0000","last_peered":"2024-09-12T00:37:08.360496+0000","last_clean":"2024-09-12T00:37:08.360496+0000","last_became_active":"2024-09-12T00:01:57.151644+0000","last_became_peered":"2024-09-12T00:01:57.151644+0000","last_unstale":"2024-09-12T00:37:08.360496+0000","last_undegraded":"2024-09-12T00:37:08.360496+0000","last_fullsized":"2024-09-12T00:37:08.360496+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:39.639241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11935188,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":393,"num_read_kb":2373,"num_write":1049,"num_write_kb":41035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498978+0000","last_change":"2024-09-12T00:02:01.151980+0000","last_active":"2024-09-12T00:34:34.498978+0000","last_peered":"2024-09-12T00:34:34.498978+0000","last_clean":"2024-09-12T00:34:34.498978+0000","last_became_active":"2024-09-12T00:02:01.151474+0000","last_became_peered":"2024-09-12T00:02:01.151474+0000","last_unstale":"2024-09-12T00:34:34.498978+0000","last_undegraded":"2024-09-12T00:34:34.498978+0000","last_fullsized":"2024-09-12T00:34:34.498978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:15.387013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'208","reported_seq":1181,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:25.299127+0000","last_change":"2024-09-12T00:02:03.155847+0000","last_active":"2024-09-12T00:38:25.299127+0000","last_peered":"2024-09-12T00:38:25.299127+0000","last_clean":"2024-09-12T00:38:25.299127+0000","last_became_active":"2024-09-12T00:02:03.155311+0000","last_became_peered":"2024-09-12T00:02:03.155311+0000","last_unstale":"2024-09-12T00:38:25.299127+0000","last_undegraded":"2024-09-12T00:38:25.299127+0000","last_fullsized":"2024-09-12T00:38:25.299127+0000","mapping_epoch":30,"log_start":"258'100","ondisk_log_start":"258'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:37.168360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":119,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:27.509399+0000","last_change":"2024-09-12T00:02:05.168343+0000","last_active":"2024-09-12T00:35:27.509399+0000","last_peered":"2024-09-12T00:35:27.509399+0000","last_clean":"2024-09-12T00:35:27.509399+0000","last_became_active":"2024-09-12T00:02:05.167874+0000","last_became_peered":"2024-09-12T00:02:05.167874+0000","last_unstale":"2024-09-12T00:35:27.509399+0000","last_undegraded":"2024-09-12T00:35:27.509399+0000","last_fullsized":"2024-09-12T00:35:27.509399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:12.012160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'262","reported_seq":856,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.604136+0000","last_change":"2024-09-12T00:02:07.162130+0000","last_active":"2024-09-12T00:37:23.604136+0000","last_peered":"2024-09-12T00:37:23.604136+0000","last_clean":"2024-09-12T00:37:23.604136+0000","last_became_active":"2024-09-12T00:02:07.161814+0000","last_became_peered":"2024-09-12T00:02:07.161814+0000","last_unstale":"2024-09-12T00:37:23.604136+0000","last_undegraded":"2024-09-12T00:37:23.604136+0000","last_fullsized":"2024-09-12T00:37:23.604136+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:02.767585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":499,"num_read_kb":517,"num_write":567,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'135","reported_seq":711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.489664+0000","last_change":"2024-09-12T00:01:59.153823+0000","last_active":"2024-09-12T00:37:10.489664+0000","last_peered":"2024-09-12T00:37:10.489664+0000","last_clean":"2024-09-12T00:37:10.489664+0000","last_became_active":"2024-09-12T00:01:59.153542+0000","last_became_peered":"2024-09-12T00:01:59.153542+0000","last_unstale":"2024-09-12T00:37:10.489664+0000","last_undegraded":"2024-09-12T00:37:10.489664+0000","last_fullsized":"2024-09-12T00:37:10.489664+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:16.930267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":619,"num_read_kb":513,"num_write":207,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":513,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.386923+0000","last_change":"2024-09-12T00:01:48.515810+0000","last_active":"2024-09-12T00:35:09.386923+0000","last_peered":"2024-09-12T00:35:09.386923+0000","last_clean":"2024-09-12T00:35:09.386923+0000","last_became_active":"2024-09-12T00:01:46.502428+0000","last_became_peered":"2024-09-12T00:01:46.502428+0000","last_unstale":"2024-09-12T00:35:09.386923+0000","last_undegraded":"2024-09-12T00:35:09.386923+0000","last_fullsized":"2024-09-12T00:35:09.386923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:13.947790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001414925,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'274","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:24.402749+0000","last_change":"2024-09-12T00:01:57.156552+0000","last_active":"2024-09-12T00:37:24.402749+0000","last_peered":"2024-09-12T00:37:24.402749+0000","last_clean":"2024-09-12T00:37:24.402749+0000","last_became_active":"2024-09-12T00:01:57.156172+0000","last_became_peered":"2024-09-12T00:01:57.156172+0000","last_unstale":"2024-09-12T00:37:24.402749+0000","last_undegraded":"2024-09-12T00:37:24.402749+0000","last_fullsized":"2024-09-12T00:37:24.402749+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:22.222372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8151797,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":384,"num_read_kb":22094,"num_write":1036,"num_write_kb":41486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:29.506844+0000","last_change":"2024-09-12T00:02:01.153018+0000","last_active":"2024-09-12T00:35:29.506844+0000","last_peered":"2024-09-12T00:35:29.506844+0000","last_clean":"2024-09-12T00:35:29.506844+0000","last_became_active":"2024-09-12T00:02:01.152752+0000","last_became_peered":"2024-09-12T00:02:01.152752+0000","last_unstale":"2024-09-12T00:35:29.506844+0000","last_undegraded":"2024-09-12T00:35:29.506844+0000","last_fullsized":"2024-09-12T00:35:29.506844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:50.379948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'112","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.961118+0000","last_change":"2024-09-12T00:02:03.152362+0000","last_active":"2024-09-12T00:36:50.961118+0000","last_peered":"2024-09-12T00:36:50.961118+0000","last_clean":"2024-09-12T00:36:50.961118+0000","last_became_active":"2024-09-12T00:02:03.152008+0000","last_became_peered":"2024-09-12T00:02:03.152008+0000","last_unstale":"2024-09-12T00:36:50.961118+0000","last_undegraded":"2024-09-12T00:36:50.961118+0000","last_fullsized":"2024-09-12T00:36:50.961118+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:40.412153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":94,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.382152+0000","last_change":"2024-09-12T00:02:05.170927+0000","last_active":"2024-09-12T00:34:34.382152+0000","last_peered":"2024-09-12T00:34:34.382152+0000","last_clean":"2024-09-12T00:34:34.382152+0000","last_became_active":"2024-09-12T00:02:05.170487+0000","last_became_peered":"2024-09-12T00:02:05.170487+0000","last_unstale":"2024-09-12T00:34:34.382152+0000","last_undegraded":"2024-09-12T00:34:34.382152+0000","last_fullsized":"2024-09-12T00:34:34.382152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:15.416030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":662,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.519983+0000","last_change":"2024-09-12T00:02:07.169125+0000","last_active":"2024-09-12T00:36:52.519983+0000","last_peered":"2024-09-12T00:36:52.519983+0000","last_clean":"2024-09-12T00:36:52.519983+0000","last_became_active":"2024-09-12T00:02:07.168820+0000","last_became_peered":"2024-09-12T00:02:07.168820+0000","last_unstale":"2024-09-12T00:36:52.519983+0000","last_undegraded":"2024-09-12T00:36:52.519983+0000","last_fullsized":"2024-09-12T00:36:52.519983+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:54.542834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":226,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'300","reported_seq":884,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.965247+0000","last_change":"2024-09-12T00:01:59.145724+0000","last_active":"2024-09-12T00:37:07.965247+0000","last_peered":"2024-09-12T00:37:07.965247+0000","last_clean":"2024-09-12T00:37:07.965247+0000","last_became_active":"2024-09-12T00:01:59.145273+0000","last_became_peered":"2024-09-12T00:01:59.145273+0000","last_unstale":"2024-09-12T00:37:07.965247+0000","last_undegraded":"2024-09-12T00:37:07.965247+0000","last_fullsized":"2024-09-12T00:37:07.965247+0000","mapping_epoch":26,"log_start":"258'200","ondisk_log_start":"258'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:10.954485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1215,"num_write":550,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'308","reported_seq":1003,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.263089+0000","last_change":"2024-09-12T00:01:57.154791+0000","last_active":"2024-09-12T00:37:10.263089+0000","last_peered":"2024-09-12T00:37:10.263089+0000","last_clean":"2024-09-12T00:37:10.263089+0000","last_became_active":"2024-09-12T00:01:57.154387+0000","last_became_peered":"2024-09-12T00:01:57.154387+0000","last_unstale":"2024-09-12T00:37:10.263089+0000","last_undegraded":"2024-09-12T00:37:10.263089+0000","last_fullsized":"2024-09-12T00:37:10.263089+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:15.020141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11674169,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":571,"num_read_kb":122441,"num_write":1093,"num_write_kb":43815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":509,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.504322+0000","last_change":"2024-09-12T00:01:49.473468+0000","last_active":"2024-09-12T00:35:09.504322+0000","last_peered":"2024-09-12T00:35:09.504322+0000","last_clean":"2024-09-12T00:35:09.504322+0000","last_became_active":"2024-09-12T00:01:46.505954+0000","last_became_peered":"2024-09-12T00:01:46.505954+0000","last_unstale":"2024-09-12T00:35:09.504322+0000","last_undegraded":"2024-09-12T00:35:09.504322+0000","last_fullsized":"2024-09-12T00:35:09.504322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:03.543109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050498000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:22.508574+0000","last_change":"2024-09-12T00:02:01.149787+0000","last_active":"2024-09-12T00:35:22.508574+0000","last_peered":"2024-09-12T00:35:22.508574+0000","last_clean":"2024-09-12T00:35:22.508574+0000","last_became_active":"2024-09-12T00:02:01.149529+0000","last_became_peered":"2024-09-12T00:02:01.149529+0000","last_unstale":"2024-09-12T00:35:22.508574+0000","last_undegraded":"2024-09-12T00:35:22.508574+0000","last_fullsized":"2024-09-12T00:35:22.508574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:38.924972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'547","reported_seq":1188,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.916250+0000","last_change":"2024-09-12T00:02:03.152903+0000","last_active":"2024-09-12T00:38:28.916250+0000","last_peered":"2024-09-12T00:38:28.916250+0000","last_clean":"2024-09-12T00:38:28.916250+0000","last_became_active":"2024-09-12T00:02:03.152535+0000","last_became_peered":"2024-09-12T00:02:03.152535+0000","last_unstale":"2024-09-12T00:38:28.916250+0000","last_undegraded":"2024-09-12T00:38:28.916250+0000","last_fullsized":"2024-09-12T00:38:28.916250+0000","mapping_epoch":30,"log_start":"261'500","ondisk_log_start":"261'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:26.014665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106310,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1504,"num_read_kb":2448,"num_write":1940,"num_write_kb":1778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":471,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.623486+0000","last_change":"2024-09-12T00:02:05.168263+0000","last_active":"2024-09-12T00:35:24.623486+0000","last_peered":"2024-09-12T00:35:24.623486+0000","last_clean":"2024-09-12T00:35:24.623486+0000","last_became_active":"2024-09-12T00:02:05.167998+0000","last_became_peered":"2024-09-12T00:02:05.167998+0000","last_unstale":"2024-09-12T00:35:24.623486+0000","last_undegraded":"2024-09-12T00:35:24.623486+0000","last_fullsized":"2024-09-12T00:35:24.623486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:50.635765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'161","reported_seq":644,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.451268+0000","last_change":"2024-09-12T00:02:07.168288+0000","last_active":"2024-09-12T00:37:23.451268+0000","last_peered":"2024-09-12T00:37:23.451268+0000","last_clean":"2024-09-12T00:37:23.451268+0000","last_became_active":"2024-09-12T00:02:07.168005+0000","last_became_peered":"2024-09-12T00:02:07.168005+0000","last_unstale":"2024-09-12T00:37:23.451268+0000","last_undegraded":"2024-09-12T00:37:23.451268+0000","last_fullsized":"2024-09-12T00:37:23.451268+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:33.779846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":133,"num_write":373,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'348","reported_seq":992,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.432202+0000","last_change":"2024-09-12T00:01:59.137316+0000","last_active":"2024-09-12T00:36:52.432202+0000","last_peered":"2024-09-12T00:36:52.432202+0000","last_clean":"2024-09-12T00:36:52.432202+0000","last_became_active":"2024-09-12T00:01:59.137020+0000","last_became_peered":"2024-09-12T00:01:59.137020+0000","last_unstale":"2024-09-12T00:36:52.432202+0000","last_undegraded":"2024-09-12T00:36:52.432202+0000","last_fullsized":"2024-09-12T00:36:52.432202+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:36.922276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1524,"num_read_kb":1224,"num_write":576,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'242","reported_seq":847,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.768424+0000","last_change":"2024-09-12T00:01:57.152881+0000","last_active":"2024-09-12T00:37:07.768424+0000","last_peered":"2024-09-12T00:37:07.768424+0000","last_clean":"2024-09-12T00:37:07.768424+0000","last_became_active":"2024-09-12T00:01:57.152021+0000","last_became_peered":"2024-09-12T00:01:57.152021+0000","last_unstale":"2024-09-12T00:37:07.768424+0000","last_undegraded":"2024-09-12T00:37:07.768424+0000","last_fullsized":"2024-09-12T00:37:07.768424+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:43.435665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11102901,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":378,"num_read_kb":13162,"num_write":897,"num_write_kb":28256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:14.387659+0000","last_change":"2024-09-12T00:01:48.515165+0000","last_active":"2024-09-12T00:35:14.387659+0000","last_peered":"2024-09-12T00:35:14.387659+0000","last_clean":"2024-09-12T00:35:14.387659+0000","last_became_active":"2024-09-12T00:01:46.505315+0000","last_became_peered":"2024-09-12T00:01:46.505315+0000","last_unstale":"2024-09-12T00:35:14.387659+0000","last_undegraded":"2024-09-12T00:35:14.387659+0000","last_fullsized":"2024-09-12T00:35:14.387659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:31.136294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079890600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.387917+0000","last_change":"2024-09-12T00:02:01.148940+0000","last_active":"2024-09-12T00:35:24.387917+0000","last_peered":"2024-09-12T00:35:24.387917+0000","last_clean":"2024-09-12T00:35:24.387917+0000","last_became_active":"2024-09-12T00:02:01.148650+0000","last_became_peered":"2024-09-12T00:02:01.148650+0000","last_unstale":"2024-09-12T00:35:24.387917+0000","last_undegraded":"2024-09-12T00:35:24.387917+0000","last_fullsized":"2024-09-12T00:35:24.387917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:11.664931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'162","reported_seq":707,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:29.523102+0000","last_change":"2024-09-12T00:02:03.153955+0000","last_active":"2024-09-12T00:37:29.523102+0000","last_peered":"2024-09-12T00:37:29.523102+0000","last_clean":"2024-09-12T00:37:29.523102+0000","last_became_active":"2024-09-12T00:02:03.153640+0000","last_became_peered":"2024-09-12T00:02:03.153640+0000","last_unstale":"2024-09-12T00:37:29.523102+0000","last_undegraded":"2024-09-12T00:37:29.523102+0000","last_fullsized":"2024-09-12T00:37:29.523102+0000","mapping_epoch":30,"log_start":"258'100","ondisk_log_start":"258'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:03.938144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":206,"num_read_kb":198,"num_write":166,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'774","reported_seq":2507,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.888775+0000","last_change":"2024-09-12T00:02:05.165645+0000","last_active":"2024-09-12T00:38:35.888775+0000","last_peered":"2024-09-12T00:38:35.888775+0000","last_clean":"2024-09-12T00:38:35.888775+0000","last_became_active":"2024-09-12T00:02:05.163720+0000","last_became_peered":"2024-09-12T00:02:05.163720+0000","last_unstale":"2024-09-12T00:38:35.888775+0000","last_undegraded":"2024-09-12T00:38:35.888775+0000","last_fullsized":"2024-09-12T00:38:35.888775+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:23.515740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'122","reported_seq":618,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:19.409311+0000","last_change":"2024-09-12T00:02:07.168152+0000","last_active":"2024-09-12T00:38:19.409311+0000","last_peered":"2024-09-12T00:38:19.409311+0000","last_clean":"2024-09-12T00:38:19.409311+0000","last_became_active":"2024-09-12T00:02:07.167797+0000","last_became_peered":"2024-09-12T00:02:07.167797+0000","last_unstale":"2024-09-12T00:38:19.409311+0000","last_undegraded":"2024-09-12T00:38:19.409311+0000","last_fullsized":"2024-09-12T00:38:19.409311+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:43.278651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":159,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'140","reported_seq":725,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:11.053276+0000","last_change":"2024-09-12T00:01:59.155408+0000","last_active":"2024-09-12T00:37:11.053276+0000","last_peered":"2024-09-12T00:37:11.053276+0000","last_clean":"2024-09-12T00:37:11.053276+0000","last_became_active":"2024-09-12T00:01:59.155117+0000","last_became_peered":"2024-09-12T00:01:59.155117+0000","last_unstale":"2024-09-12T00:37:11.053276+0000","last_undegraded":"2024-09-12T00:37:11.053276+0000","last_fullsized":"2024-09-12T00:37:11.053276+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:27.119934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":474,"num_write":223,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'336","reported_seq":996,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.521536+0000","last_change":"2024-09-12T00:01:57.134608+0000","last_active":"2024-09-12T00:38:37.521536+0000","last_peered":"2024-09-12T00:38:37.521536+0000","last_clean":"2024-09-12T00:38:37.521536+0000","last_became_active":"2024-09-12T00:01:57.134235+0000","last_became_peered":"2024-09-12T00:01:57.134235+0000","last_unstale":"2024-09-12T00:38:37.521536+0000","last_undegraded":"2024-09-12T00:38:37.521536+0000","last_fullsized":"2024-09-12T00:38:37.521536+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:42.049998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9470447,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":498,"num_read_kb":31500,"num_write":1159,"num_write_kb":36639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":514,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:27.517783+0000","last_change":"2024-09-12T00:01:48.511519+0000","last_active":"2024-09-12T00:36:27.517783+0000","last_peered":"2024-09-12T00:36:27.517783+0000","last_clean":"2024-09-12T00:36:27.517783+0000","last_became_active":"2024-09-12T00:01:46.508144+0000","last_became_peered":"2024-09-12T00:01:46.508144+0000","last_unstale":"2024-09-12T00:36:27.517783+0000","last_undegraded":"2024-09-12T00:36:27.517783+0000","last_fullsized":"2024-09-12T00:36:27.517783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:13.771631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045024799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.388920+0000","last_change":"2024-09-12T00:02:01.153487+0000","last_active":"2024-09-12T00:35:24.388920+0000","last_peered":"2024-09-12T00:35:24.388920+0000","last_clean":"2024-09-12T00:35:24.388920+0000","last_became_active":"2024-09-12T00:02:01.153207+0000","last_became_peered":"2024-09-12T00:02:01.153207+0000","last_unstale":"2024-09-12T00:35:24.388920+0000","last_undegraded":"2024-09-12T00:35:24.388920+0000","last_fullsized":"2024-09-12T00:35:24.388920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:46.459368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'107","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.666790+0000","last_change":"2024-09-12T00:02:03.151323+0000","last_active":"2024-09-12T00:36:24.666790+0000","last_peered":"2024-09-12T00:36:24.666790+0000","last_clean":"2024-09-12T00:36:24.666790+0000","last_became_active":"2024-09-12T00:02:03.151029+0000","last_became_peered":"2024-09-12T00:02:03.151029+0000","last_unstale":"2024-09-12T00:36:24.666790+0000","last_undegraded":"2024-09-12T00:36:24.666790+0000","last_fullsized":"2024-09-12T00:36:24.666790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:22.745763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":125,"num_read_kb":114,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'777","reported_seq":4554,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.957333+0000","last_change":"2024-09-12T00:02:05.164285+0000","last_active":"2024-09-12T00:38:28.957333+0000","last_peered":"2024-09-12T00:38:28.957333+0000","last_clean":"2024-09-12T00:38:28.957333+0000","last_became_active":"2024-09-12T00:02:05.162687+0000","last_became_peered":"2024-09-12T00:02:05.162687+0000","last_unstale":"2024-09-12T00:38:28.957333+0000","last_undegraded":"2024-09-12T00:38:28.957333+0000","last_fullsized":"2024-09-12T00:38:28.957333+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:19.706882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'155","reported_seq":657,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.251347+0000","last_change":"2024-09-12T00:02:07.166773+0000","last_active":"2024-09-12T00:37:02.251347+0000","last_peered":"2024-09-12T00:37:02.251347+0000","last_clean":"2024-09-12T00:37:02.251347+0000","last_became_active":"2024-09-12T00:02:07.166471+0000","last_became_peered":"2024-09-12T00:02:07.166471+0000","last_unstale":"2024-09-12T00:37:02.251347+0000","last_undegraded":"2024-09-12T00:37:02.251347+0000","last_fullsized":"2024-09-12T00:37:02.251347+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:15.572916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":126,"num_write":337,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'81","reported_seq":638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:51.799754+0000","last_change":"2024-09-12T00:01:59.157320+0000","last_active":"2024-09-12T00:36:51.799754+0000","last_peered":"2024-09-12T00:36:51.799754+0000","last_clean":"2024-09-12T00:36:51.799754+0000","last_became_active":"2024-09-12T00:01:59.157044+0000","last_became_peered":"2024-09-12T00:01:59.157044+0000","last_unstale":"2024-09-12T00:36:51.799754+0000","last_undegraded":"2024-09-12T00:36:51.799754+0000","last_fullsized":"2024-09-12T00:36:51.799754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:09.577038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":122,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'412","reported_seq":1046,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.413500+0000","last_change":"2024-09-12T00:01:57.134999+0000","last_active":"2024-09-12T00:38:37.413500+0000","last_peered":"2024-09-12T00:38:37.413500+0000","last_clean":"2024-09-12T00:38:37.413500+0000","last_became_active":"2024-09-12T00:01:57.134646+0000","last_became_peered":"2024-09-12T00:01:57.134646+0000","last_unstale":"2024-09-12T00:38:37.413500+0000","last_undegraded":"2024-09-12T00:38:37.413500+0000","last_fullsized":"2024-09-12T00:38:37.413500+0000","mapping_epoch":24,"log_start":"261'400","ondisk_log_start":"261'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:37.804939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2183609,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":719,"num_read_kb":1717,"num_write":1227,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":510,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.379940+0000","last_change":"2024-09-12T00:01:48.515417+0000","last_active":"2024-09-12T00:34:19.379940+0000","last_peered":"2024-09-12T00:34:19.379940+0000","last_clean":"2024-09-12T00:34:19.379940+0000","last_became_active":"2024-09-12T00:01:46.502847+0000","last_became_peered":"2024-09-12T00:01:46.502847+0000","last_unstale":"2024-09-12T00:34:19.379940+0000","last_undegraded":"2024-09-12T00:34:19.379940+0000","last_fullsized":"2024-09-12T00:34:19.379940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:49.727360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:07.515474+0000","last_change":"2024-09-12T00:02:01.152727+0000","last_active":"2024-09-12T00:36:07.515474+0000","last_peered":"2024-09-12T00:36:07.515474+0000","last_clean":"2024-09-12T00:36:07.515474+0000","last_became_active":"2024-09-12T00:02:01.152467+0000","last_became_peered":"2024-09-12T00:02:01.152467+0000","last_unstale":"2024-09-12T00:36:07.515474+0000","last_undegraded":"2024-09-12T00:36:07.515474+0000","last_fullsized":"2024-09-12T00:36:07.515474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:32.840264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'734","reported_seq":1432,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.912719+0000","last_change":"2024-09-12T00:02:03.151458+0000","last_active":"2024-09-12T00:38:28.912719+0000","last_peered":"2024-09-12T00:38:28.912719+0000","last_clean":"2024-09-12T00:38:28.912719+0000","last_became_active":"2024-09-12T00:02:03.151140+0000","last_became_peered":"2024-09-12T00:02:03.151140+0000","last_unstale":"2024-09-12T00:38:28.912719+0000","last_undegraded":"2024-09-12T00:38:28.912719+0000","last_fullsized":"2024-09-12T00:38:28.912719+0000","mapping_epoch":30,"log_start":"261'700","ondisk_log_start":"261'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:44.111850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174334,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1303,"num_read_kb":2810,"num_write":1090,"num_write_kb":924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:27.509341+0000","last_change":"2024-09-12T00:02:05.169087+0000","last_active":"2024-09-12T00:35:27.509341+0000","last_peered":"2024-09-12T00:35:27.509341+0000","last_clean":"2024-09-12T00:35:27.509341+0000","last_became_active":"2024-09-12T00:02:05.168419+0000","last_became_peered":"2024-09-12T00:02:05.168419+0000","last_unstale":"2024-09-12T00:35:27.509341+0000","last_undegraded":"2024-09-12T00:35:27.509341+0000","last_fullsized":"2024-09-12T00:35:27.509341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:37.208808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'139","reported_seq":629,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.772962+0000","last_change":"2024-09-12T00:02:07.170358+0000","last_active":"2024-09-12T00:37:10.772962+0000","last_peered":"2024-09-12T00:37:10.772962+0000","last_clean":"2024-09-12T00:37:10.772962+0000","last_became_active":"2024-09-12T00:02:07.169937+0000","last_became_peered":"2024-09-12T00:02:07.169937+0000","last_unstale":"2024-09-12T00:37:10.772962+0000","last_undegraded":"2024-09-12T00:37:10.772962+0000","last_fullsized":"2024-09-12T00:37:10.772962+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:08.055256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":184,"num_read_kb":169,"num_write":343,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'133","reported_seq":678,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.561260+0000","last_change":"2024-09-12T00:02:07.173368+0000","last_active":"2024-09-12T00:37:23.561260+0000","last_peered":"2024-09-12T00:37:23.561260+0000","last_clean":"2024-09-12T00:37:23.561260+0000","last_became_active":"2024-09-12T00:02:07.173094+0000","last_became_peered":"2024-09-12T00:02:07.173094+0000","last_unstale":"2024-09-12T00:37:23.561260+0000","last_undegraded":"2024-09-12T00:37:23.561260+0000","last_fullsized":"2024-09-12T00:37:23.561260+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:56.973946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":191,"num_read_kb":191,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'183","reported_seq":771,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:23.610776+0000","last_change":"2024-09-12T00:01:59.154754+0000","last_active":"2024-09-12T00:36:23.610776+0000","last_peered":"2024-09-12T00:36:23.610776+0000","last_clean":"2024-09-12T00:36:23.610776+0000","last_became_active":"2024-09-12T00:01:59.154463+0000","last_became_peered":"2024-09-12T00:01:59.154463+0000","last_unstale":"2024-09-12T00:36:23.610776+0000","last_undegraded":"2024-09-12T00:36:23.610776+0000","last_fullsized":"2024-09-12T00:36:23.610776+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:22.287932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":794,"num_read_kb":651,"num_write":258,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'276","reported_seq":912,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.416968+0000","last_change":"2024-09-12T00:01:57.164242+0000","last_active":"2024-09-12T00:37:21.416968+0000","last_peered":"2024-09-12T00:37:21.416968+0000","last_clean":"2024-09-12T00:37:21.416968+0000","last_became_active":"2024-09-12T00:01:57.163847+0000","last_became_peered":"2024-09-12T00:01:57.163847+0000","last_unstale":"2024-09-12T00:37:21.416968+0000","last_undegraded":"2024-09-12T00:37:21.416968+0000","last_fullsized":"2024-09-12T00:37:21.416968+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:14.319412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12961627,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":447,"num_read_kb":27210,"num_write":1041,"num_write_kb":33935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.500143+0000","last_change":"2024-09-12T00:02:01.144933+0000","last_active":"2024-09-12T00:34:44.500143+0000","last_peered":"2024-09-12T00:34:44.500143+0000","last_clean":"2024-09-12T00:34:44.500143+0000","last_became_active":"2024-09-12T00:02:01.144579+0000","last_became_peered":"2024-09-12T00:02:01.144579+0000","last_unstale":"2024-09-12T00:34:44.500143+0000","last_undegraded":"2024-09-12T00:34:44.500143+0000","last_fullsized":"2024-09-12T00:34:44.500143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:13.618101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'291","reported_seq":846,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.519550+0000","last_change":"2024-09-12T00:02:03.155013+0000","last_active":"2024-09-12T00:37:04.519550+0000","last_peered":"2024-09-12T00:37:04.519550+0000","last_clean":"2024-09-12T00:37:04.519550+0000","last_became_active":"2024-09-12T00:02:03.154710+0000","last_became_peered":"2024-09-12T00:02:03.154710+0000","last_unstale":"2024-09-12T00:37:04.519550+0000","last_undegraded":"2024-09-12T00:37:04.519550+0000","last_fullsized":"2024-09-12T00:37:04.519550+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:23.714644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55995,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":934,"num_write":382,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.500232+0000","last_change":"2024-09-12T00:02:05.163654+0000","last_active":"2024-09-12T00:34:44.500232+0000","last_peered":"2024-09-12T00:34:44.500232+0000","last_clean":"2024-09-12T00:34:44.500232+0000","last_became_active":"2024-09-12T00:02:05.163389+0000","last_became_peered":"2024-09-12T00:02:05.163389+0000","last_unstale":"2024-09-12T00:34:44.500232+0000","last_undegraded":"2024-09-12T00:34:44.500232+0000","last_fullsized":"2024-09-12T00:34:44.500232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:54.688629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'116","reported_seq":591,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.374469+0000","last_change":"2024-09-12T00:02:07.172652+0000","last_active":"2024-09-12T00:37:06.374469+0000","last_peered":"2024-09-12T00:37:06.374469+0000","last_clean":"2024-09-12T00:37:06.374469+0000","last_became_active":"2024-09-12T00:02:07.172360+0000","last_became_peered":"2024-09-12T00:02:07.172360+0000","last_unstale":"2024-09-12T00:37:06.374469+0000","last_undegraded":"2024-09-12T00:37:06.374469+0000","last_fullsized":"2024-09-12T00:37:06.374469+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:50.938865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'116","reported_seq":715,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:38.799905+0000","last_change":"2024-09-12T00:01:59.155610+0000","last_active":"2024-09-12T00:36:38.799905+0000","last_peered":"2024-09-12T00:36:38.799905+0000","last_clean":"2024-09-12T00:36:38.799905+0000","last_became_active":"2024-09-12T00:01:59.155287+0000","last_became_peered":"2024-09-12T00:01:59.155287+0000","last_unstale":"2024-09-12T00:36:38.799905+0000","last_undegraded":"2024-09-12T00:36:38.799905+0000","last_fullsized":"2024-09-12T00:36:38.799905+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:33.145869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":525,"num_read_kb":443,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'272","reported_seq":906,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.033160+0000","last_change":"2024-09-12T00:01:57.150227+0000","last_active":"2024-09-12T00:38:27.033160+0000","last_peered":"2024-09-12T00:38:27.033160+0000","last_clean":"2024-09-12T00:38:27.033160+0000","last_became_active":"2024-09-12T00:01:57.144743+0000","last_became_peered":"2024-09-12T00:01:57.144743+0000","last_unstale":"2024-09-12T00:38:27.033160+0000","last_undegraded":"2024-09-12T00:38:27.033160+0000","last_fullsized":"2024-09-12T00:38:27.033160+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:04.356175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6732343,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":428,"num_read_kb":7937,"num_write":966,"num_write_kb":13946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:42.502624+0000","last_change":"2024-09-12T00:02:01.151142+0000","last_active":"2024-09-12T00:34:42.502624+0000","last_peered":"2024-09-12T00:34:42.502624+0000","last_clean":"2024-09-12T00:34:42.502624+0000","last_became_active":"2024-09-12T00:02:01.150857+0000","last_became_peered":"2024-09-12T00:02:01.150857+0000","last_unstale":"2024-09-12T00:34:42.502624+0000","last_undegraded":"2024-09-12T00:34:42.502624+0000","last_fullsized":"2024-09-12T00:34:42.502624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:45.672680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'41","reported_seq":534,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:38.801722+0000","last_change":"2024-09-12T00:02:03.150541+0000","last_active":"2024-09-12T00:36:38.801722+0000","last_peered":"2024-09-12T00:36:38.801722+0000","last_clean":"2024-09-12T00:36:38.801722+0000","last_became_active":"2024-09-12T00:02:03.149558+0000","last_became_peered":"2024-09-12T00:02:03.149558+0000","last_unstale":"2024-09-12T00:36:38.801722+0000","last_undegraded":"2024-09-12T00:36:38.801722+0000","last_fullsized":"2024-09-12T00:36:38.801722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:42.429865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":469,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.617409+0000","last_change":"2024-09-12T00:02:05.171121+0000","last_active":"2024-09-12T00:34:44.617409+0000","last_peered":"2024-09-12T00:34:44.617409+0000","last_clean":"2024-09-12T00:34:44.617409+0000","last_became_active":"2024-09-12T00:02:05.170836+0000","last_became_peered":"2024-09-12T00:02:05.170836+0000","last_unstale":"2024-09-12T00:34:44.617409+0000","last_undegraded":"2024-09-12T00:34:44.617409+0000","last_fullsized":"2024-09-12T00:34:44.617409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:00.009417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'258","reported_seq":776,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.055886+0000","last_change":"2024-09-12T00:02:07.168954+0000","last_active":"2024-09-12T00:37:23.055886+0000","last_peered":"2024-09-12T00:37:23.055886+0000","last_clean":"2024-09-12T00:37:23.055886+0000","last_became_active":"2024-09-12T00:02:07.168678+0000","last_became_peered":"2024-09-12T00:02:07.168678+0000","last_unstale":"2024-09-12T00:37:23.055886+0000","last_undegraded":"2024-09-12T00:37:23.055886+0000","last_fullsized":"2024-09-12T00:37:23.055886+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:23.449987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":392,"num_read_kb":368,"num_write":602,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'4088","reported_seq":4638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:42.502575+0000","last_change":"2024-09-12T00:01:59.154536+0000","last_active":"2024-09-12T00:34:42.502575+0000","last_peered":"2024-09-12T00:34:42.502575+0000","last_clean":"2024-09-12T00:34:42.502575+0000","last_became_active":"2024-09-12T00:01:59.154260+0000","last_became_peered":"2024-09-12T00:01:59.154260+0000","last_unstale":"2024-09-12T00:34:42.502575+0000","last_undegraded":"2024-09-12T00:34:42.502575+0000","last_fullsized":"2024-09-12T00:34:42.502575+0000","mapping_epoch":26,"log_start":"261'4000","ondisk_log_start":"261'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:35.639955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16394,"num_read_kb":13744,"num_write":6133,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'238","reported_seq":832,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.060926+0000","last_change":"2024-09-12T00:01:57.160338+0000","last_active":"2024-09-12T00:37:09.060926+0000","last_peered":"2024-09-12T00:37:09.060926+0000","last_clean":"2024-09-12T00:37:09.060926+0000","last_became_active":"2024-09-12T00:01:57.158677+0000","last_became_peered":"2024-09-12T00:01:57.158677+0000","last_unstale":"2024-09-12T00:37:09.060926+0000","last_undegraded":"2024-09-12T00:37:09.060926+0000","last_fullsized":"2024-09-12T00:37:09.060926+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:16.844146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9635143,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":338,"num_read_kb":56505,"num_write":875,"num_write_kb":31346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.617371+0000","last_change":"2024-09-12T00:02:01.155814+0000","last_active":"2024-09-12T00:34:44.617371+0000","last_peered":"2024-09-12T00:34:44.617371+0000","last_clean":"2024-09-12T00:34:44.617371+0000","last_became_active":"2024-09-12T00:02:01.155490+0000","last_became_peered":"2024-09-12T00:02:01.155490+0000","last_unstale":"2024-09-12T00:34:44.617371+0000","last_undegraded":"2024-09-12T00:34:44.617371+0000","last_fullsized":"2024-09-12T00:34:44.617371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:27.105020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'279","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.519632+0000","last_change":"2024-09-12T00:02:03.149010+0000","last_active":"2024-09-12T00:37:04.519632+0000","last_peered":"2024-09-12T00:37:04.519632+0000","last_clean":"2024-09-12T00:37:04.519632+0000","last_became_active":"2024-09-12T00:02:03.148690+0000","last_became_peered":"2024-09-12T00:02:03.148690+0000","last_unstale":"2024-09-12T00:37:04.519632+0000","last_undegraded":"2024-09-12T00:37:04.519632+0000","last_fullsized":"2024-09-12T00:37:04.519632+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:39.130947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49452,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":914,"num_write":368,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:46.499667+0000","last_change":"2024-09-12T00:02:05.168740+0000","last_active":"2024-09-12T00:34:46.499667+0000","last_peered":"2024-09-12T00:34:46.499667+0000","last_clean":"2024-09-12T00:34:46.499667+0000","last_became_active":"2024-09-12T00:02:05.168232+0000","last_became_peered":"2024-09-12T00:02:05.168232+0000","last_unstale":"2024-09-12T00:34:46.499667+0000","last_undegraded":"2024-09-12T00:34:46.499667+0000","last_fullsized":"2024-09-12T00:34:46.499667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:43.713032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'134","reported_seq":667,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.879910+0000","last_change":"2024-09-12T00:02:07.169044+0000","last_active":"2024-09-12T00:36:58.879910+0000","last_peered":"2024-09-12T00:36:58.879910+0000","last_clean":"2024-09-12T00:36:58.879910+0000","last_became_active":"2024-09-12T00:02:07.168747+0000","last_became_peered":"2024-09-12T00:02:07.168747+0000","last_unstale":"2024-09-12T00:36:58.879910+0000","last_undegraded":"2024-09-12T00:36:58.879910+0000","last_fullsized":"2024-09-12T00:36:58.879910+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:23.448210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":291,"num_read_kb":255,"num_write":337,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'104","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.673042+0000","last_change":"2024-09-12T00:01:59.155125+0000","last_active":"2024-09-12T00:37:09.673042+0000","last_peered":"2024-09-12T00:37:09.673042+0000","last_clean":"2024-09-12T00:37:09.673042+0000","last_became_active":"2024-09-12T00:01:59.154848+0000","last_became_peered":"2024-09-12T00:01:59.154848+0000","last_unstale":"2024-09-12T00:37:09.673042+0000","last_undegraded":"2024-09-12T00:37:09.673042+0000","last_fullsized":"2024-09-12T00:37:09.673042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:47.132457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":392,"num_write":152,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'253","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:22.215022+0000","last_change":"2024-09-12T00:01:57.142768+0000","last_active":"2024-09-12T00:36:22.215022+0000","last_peered":"2024-09-12T00:36:22.215022+0000","last_clean":"2024-09-12T00:36:22.215022+0000","last_became_active":"2024-09-12T00:01:57.142385+0000","last_became_peered":"2024-09-12T00:01:57.142385+0000","last_unstale":"2024-09-12T00:36:22.215022+0000","last_undegraded":"2024-09-12T00:36:22.215022+0000","last_fullsized":"2024-09-12T00:36:22.215022+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:28.588091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2776446,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":554,"num_read_kb":9162,"num_write":973,"num_write_kb":16984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.383518+0000","last_change":"2024-09-12T00:02:01.154218+0000","last_active":"2024-09-12T00:34:44.383518+0000","last_peered":"2024-09-12T00:34:44.383518+0000","last_clean":"2024-09-12T00:34:44.383518+0000","last_became_active":"2024-09-12T00:02:01.153906+0000","last_became_peered":"2024-09-12T00:02:01.153906+0000","last_unstale":"2024-09-12T00:34:44.383518+0000","last_undegraded":"2024-09-12T00:34:44.383518+0000","last_fullsized":"2024-09-12T00:34:44.383518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:16.965088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'244","reported_seq":798,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.400722+0000","last_change":"2024-09-12T00:02:03.155251+0000","last_active":"2024-09-12T00:37:04.400722+0000","last_peered":"2024-09-12T00:37:04.400722+0000","last_clean":"2024-09-12T00:37:04.400722+0000","last_became_active":"2024-09-12T00:02:03.154896+0000","last_became_peered":"2024-09-12T00:02:03.154896+0000","last_unstale":"2024-09-12T00:37:04.400722+0000","last_undegraded":"2024-09-12T00:37:04.400722+0000","last_fullsized":"2024-09-12T00:37:04.400722+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:31.639970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54781,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":400,"num_read_kb":853,"num_write":328,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.500273+0000","last_change":"2024-09-12T00:02:05.162572+0000","last_active":"2024-09-12T00:34:44.500273+0000","last_peered":"2024-09-12T00:34:44.500273+0000","last_clean":"2024-09-12T00:34:44.500273+0000","last_became_active":"2024-09-12T00:02:05.162204+0000","last_became_peered":"2024-09-12T00:02:05.162204+0000","last_unstale":"2024-09-12T00:34:44.500273+0000","last_undegraded":"2024-09-12T00:34:44.500273+0000","last_fullsized":"2024-09-12T00:34:44.500273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:56.188492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'125","reported_seq":678,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:22.357033+0000","last_change":"2024-09-12T00:01:59.145758+0000","last_active":"2024-09-12T00:36:22.357033+0000","last_peered":"2024-09-12T00:36:22.357033+0000","last_clean":"2024-09-12T00:36:22.357033+0000","last_became_active":"2024-09-12T00:01:59.145456+0000","last_became_peered":"2024-09-12T00:01:59.145456+0000","last_unstale":"2024-09-12T00:36:22.357033+0000","last_undegraded":"2024-09-12T00:36:22.357033+0000","last_fullsized":"2024-09-12T00:36:22.357033+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:45.253029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":512,"num_read_kb":415,"num_write":196,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'302","reported_seq":933,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:25.575893+0000","last_change":"2024-09-12T00:01:57.144156+0000","last_active":"2024-09-12T00:36:25.575893+0000","last_peered":"2024-09-12T00:36:25.575893+0000","last_clean":"2024-09-12T00:36:25.575893+0000","last_became_active":"2024-09-12T00:01:57.143684+0000","last_became_peered":"2024-09-12T00:01:57.143684+0000","last_unstale":"2024-09-12T00:36:25.575893+0000","last_undegraded":"2024-09-12T00:36:25.575893+0000","last_fullsized":"2024-09-12T00:36:25.575893+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:44.165024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6831063,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":432,"num_read_kb":22065,"num_write":1132,"num_write_kb":32922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:09.512535+0000","last_change":"2024-09-12T00:02:01.154936+0000","last_active":"2024-09-12T00:36:09.512535+0000","last_peered":"2024-09-12T00:36:09.512535+0000","last_clean":"2024-09-12T00:36:09.512535+0000","last_became_active":"2024-09-12T00:02:01.154541+0000","last_became_peered":"2024-09-12T00:02:01.154541+0000","last_unstale":"2024-09-12T00:36:09.512535+0000","last_undegraded":"2024-09-12T00:36:09.512535+0000","last_fullsized":"2024-09-12T00:36:09.512535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:34.459769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'480","reported_seq":1086,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.909459+0000","last_change":"2024-09-12T00:02:03.158651+0000","last_active":"2024-09-12T00:38:28.909459+0000","last_peered":"2024-09-12T00:38:28.909459+0000","last_clean":"2024-09-12T00:38:28.909459+0000","last_became_active":"2024-09-12T00:02:03.158360+0000","last_became_peered":"2024-09-12T00:02:03.158360+0000","last_unstale":"2024-09-12T00:38:28.909459+0000","last_undegraded":"2024-09-12T00:38:28.909459+0000","last_fullsized":"2024-09-12T00:38:28.909459+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:44.063536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115135,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":865,"num_read_kb":1864,"num_write":756,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":468,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615861+0000","last_change":"2024-09-12T00:02:05.167419+0000","last_active":"2024-09-12T00:34:34.615861+0000","last_peered":"2024-09-12T00:34:34.615861+0000","last_clean":"2024-09-12T00:34:34.615861+0000","last_became_active":"2024-09-12T00:02:05.167052+0000","last_became_peered":"2024-09-12T00:02:05.167052+0000","last_unstale":"2024-09-12T00:34:34.615861+0000","last_undegraded":"2024-09-12T00:34:34.615861+0000","last_fullsized":"2024-09-12T00:34:34.615861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:41.679779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'206","reported_seq":704,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.939992+0000","last_change":"2024-09-12T00:02:07.167621+0000","last_active":"2024-09-12T00:37:22.939992+0000","last_peered":"2024-09-12T00:37:22.939992+0000","last_clean":"2024-09-12T00:37:22.939992+0000","last_became_active":"2024-09-12T00:02:07.167331+0000","last_became_peered":"2024-09-12T00:02:07.167331+0000","last_unstale":"2024-09-12T00:37:22.939992+0000","last_undegraded":"2024-09-12T00:37:22.939992+0000","last_fullsized":"2024-09-12T00:37:22.939992+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:21.029667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":483,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'398","reported_seq":1157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:57.885047+0000","last_change":"2024-09-12T00:01:59.150197+0000","last_active":"2024-09-12T00:36:57.885047+0000","last_peered":"2024-09-12T00:36:57.885047+0000","last_clean":"2024-09-12T00:36:57.885047+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:36:57.885047+0000","last_undegraded":"2024-09-12T00:36:57.885047+0000","last_fullsized":"2024-09-12T00:36:57.885047+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:47.950131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1910,"num_read_kb":1650,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'335","reported_seq":1011,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.489466+0000","last_change":"2024-09-12T00:01:57.142382+0000","last_active":"2024-09-12T00:38:37.489466+0000","last_peered":"2024-09-12T00:38:37.489466+0000","last_clean":"2024-09-12T00:38:37.489466+0000","last_became_active":"2024-09-12T00:01:57.141998+0000","last_became_peered":"2024-09-12T00:01:57.141998+0000","last_unstale":"2024-09-12T00:38:37.489466+0000","last_undegraded":"2024-09-12T00:38:37.489466+0000","last_fullsized":"2024-09-12T00:38:37.489466+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:28.887996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":587,"num_read_kb":1840,"num_write":1187,"num_write_kb":17126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.623582+0000","last_change":"2024-09-12T00:02:01.153965+0000","last_active":"2024-09-12T00:35:24.623582+0000","last_peered":"2024-09-12T00:35:24.623582+0000","last_clean":"2024-09-12T00:35:24.623582+0000","last_became_active":"2024-09-12T00:02:01.153611+0000","last_became_peered":"2024-09-12T00:02:01.153611+0000","last_unstale":"2024-09-12T00:35:24.623582+0000","last_undegraded":"2024-09-12T00:35:24.623582+0000","last_fullsized":"2024-09-12T00:35:24.623582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:43.203100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'279","reported_seq":838,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.598694+0000","last_change":"2024-09-12T00:02:03.155107+0000","last_active":"2024-09-12T00:38:27.598694+0000","last_peered":"2024-09-12T00:38:27.598694+0000","last_clean":"2024-09-12T00:38:27.598694+0000","last_became_active":"2024-09-12T00:02:03.154821+0000","last_became_peered":"2024-09-12T00:02:03.154821+0000","last_unstale":"2024-09-12T00:38:27.598694+0000","last_undegraded":"2024-09-12T00:38:27.598694+0000","last_fullsized":"2024-09-12T00:38:27.598694+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:25.034969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54123,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":452,"num_read_kb":904,"num_write":380,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":473,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499293+0000","last_change":"2024-09-12T00:02:05.170002+0000","last_active":"2024-09-12T00:34:34.499293+0000","last_peered":"2024-09-12T00:34:34.499293+0000","last_clean":"2024-09-12T00:34:34.499293+0000","last_became_active":"2024-09-12T00:02:05.169726+0000","last_became_peered":"2024-09-12T00:02:05.169726+0000","last_unstale":"2024-09-12T00:34:34.499293+0000","last_undegraded":"2024-09-12T00:34:34.499293+0000","last_fullsized":"2024-09-12T00:34:34.499293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:22.827175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'193","reported_seq":1061,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.503992+0000","last_change":"2024-09-12T00:02:07.175207+0000","last_active":"2024-09-12T00:37:22.503992+0000","last_peered":"2024-09-12T00:37:22.503992+0000","last_clean":"2024-09-12T00:37:22.503992+0000","last_became_active":"2024-09-12T00:02:07.174910+0000","last_became_peered":"2024-09-12T00:02:07.174910+0000","last_unstale":"2024-09-12T00:37:22.503992+0000","last_undegraded":"2024-09-12T00:37:22.503992+0000","last_fullsized":"2024-09-12T00:37:22.503992+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:19.459374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":668,"num_read_kb":649,"num_write":556,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'98","reported_seq":665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.598641+0000","last_change":"2024-09-12T00:01:59.151423+0000","last_active":"2024-09-12T00:37:02.598641+0000","last_peered":"2024-09-12T00:37:02.598641+0000","last_clean":"2024-09-12T00:37:02.598641+0000","last_became_active":"2024-09-12T00:01:59.151143+0000","last_became_peered":"2024-09-12T00:01:59.151143+0000","last_unstale":"2024-09-12T00:37:02.598641+0000","last_undegraded":"2024-09-12T00:37:02.598641+0000","last_fullsized":"2024-09-12T00:37:02.598641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:08.277331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":451,"num_read_kb":380,"num_write":139,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'251","reported_seq":839,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.489562+0000","last_change":"2024-09-12T00:01:57.142179+0000","last_active":"2024-09-12T00:38:36.489562+0000","last_peered":"2024-09-12T00:38:36.489562+0000","last_clean":"2024-09-12T00:38:36.489562+0000","last_became_active":"2024-09-12T00:01:57.141789+0000","last_became_peered":"2024-09-12T00:01:57.141789+0000","last_unstale":"2024-09-12T00:38:36.489562+0000","last_undegraded":"2024-09-12T00:38:36.489562+0000","last_fullsized":"2024-09-12T00:38:36.489562+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:44.370591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10815112,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":334,"num_read_kb":31078,"num_write":835,"num_write_kb":48318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615850+0000","last_change":"2024-09-12T00:02:01.154963+0000","last_active":"2024-09-12T00:34:34.615850+0000","last_peered":"2024-09-12T00:34:34.615850+0000","last_clean":"2024-09-12T00:34:34.615850+0000","last_became_active":"2024-09-12T00:02:01.154530+0000","last_became_peered":"2024-09-12T00:02:01.154530+0000","last_unstale":"2024-09-12T00:34:34.615850+0000","last_undegraded":"2024-09-12T00:34:34.615850+0000","last_fullsized":"2024-09-12T00:34:34.615850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:06.651100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'283","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:23.550648+0000","last_change":"2024-09-12T00:02:03.156889+0000","last_active":"2024-09-12T00:38:23.550648+0000","last_peered":"2024-09-12T00:38:23.550648+0000","last_clean":"2024-09-12T00:38:23.550648+0000","last_became_active":"2024-09-12T00:02:03.156529+0000","last_became_peered":"2024-09-12T00:02:03.156529+0000","last_unstale":"2024-09-12T00:38:23.550648+0000","last_undegraded":"2024-09-12T00:38:23.550648+0000","last_fullsized":"2024-09-12T00:38:23.550648+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:52.310627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66765,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":1019,"num_write":396,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":473,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:09.512584+0000","last_change":"2024-09-12T00:02:05.164244+0000","last_active":"2024-09-12T00:36:09.512584+0000","last_peered":"2024-09-12T00:36:09.512584+0000","last_clean":"2024-09-12T00:36:09.512584+0000","last_became_active":"2024-09-12T00:02:05.163956+0000","last_became_peered":"2024-09-12T00:02:05.163956+0000","last_unstale":"2024-09-12T00:36:09.512584+0000","last_undegraded":"2024-09-12T00:36:09.512584+0000","last_fullsized":"2024-09-12T00:36:09.512584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:58.031555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'127","reported_seq":603,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.940297+0000","last_change":"2024-09-12T00:02:07.172798+0000","last_active":"2024-09-12T00:38:28.940297+0000","last_peered":"2024-09-12T00:38:28.940297+0000","last_clean":"2024-09-12T00:38:28.940297+0000","last_became_active":"2024-09-12T00:02:07.172496+0000","last_became_peered":"2024-09-12T00:02:07.172496+0000","last_unstale":"2024-09-12T00:38:28.940297+0000","last_undegraded":"2024-09-12T00:38:28.940297+0000","last_fullsized":"2024-09-12T00:38:28.940297+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:11.813869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":307,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'198","reported_seq":828,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:13.741103+0000","last_change":"2024-09-12T00:01:59.149165+0000","last_active":"2024-09-12T00:36:13.741103+0000","last_peered":"2024-09-12T00:36:13.741103+0000","last_clean":"2024-09-12T00:36:13.741103+0000","last_became_active":"2024-09-12T00:01:59.148559+0000","last_became_peered":"2024-09-12T00:01:59.148559+0000","last_unstale":"2024-09-12T00:36:13.741103+0000","last_undegraded":"2024-09-12T00:36:13.741103+0000","last_fullsized":"2024-09-12T00:36:13.741103+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:56.810526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":733,"num_write":278,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'356","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.522107+0000","last_change":"2024-09-12T00:01:57.145004+0000","last_active":"2024-09-12T00:38:37.522107+0000","last_peered":"2024-09-12T00:38:37.522107+0000","last_clean":"2024-09-12T00:38:37.522107+0000","last_became_active":"2024-09-12T00:01:57.144397+0000","last_became_peered":"2024-09-12T00:01:57.144397+0000","last_unstale":"2024-09-12T00:38:37.522107+0000","last_undegraded":"2024-09-12T00:38:37.522107+0000","last_fullsized":"2024-09-12T00:38:37.522107+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:00.869585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293811,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":551,"num_read_kb":18154,"num_write":1202,"num_write_kb":40983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'5","reported_seq":968,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.454747+0000","last_change":"2024-09-12T00:02:01.152013+0000","last_active":"2024-09-12T00:38:35.454747+0000","last_peered":"2024-09-12T00:38:35.454747+0000","last_clean":"2024-09-12T00:38:35.454747+0000","last_became_active":"2024-09-12T00:02:01.151739+0000","last_became_peered":"2024-09-12T00:02:01.151739+0000","last_unstale":"2024-09-12T00:38:35.454747+0000","last_undegraded":"2024-09-12T00:38:35.454747+0000","last_fullsized":"2024-09-12T00:38:35.454747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:45.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'84","reported_seq":593,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.062825+0000","last_change":"2024-09-12T00:02:03.154234+0000","last_active":"2024-09-12T00:37:23.062825+0000","last_peered":"2024-09-12T00:37:23.062825+0000","last_clean":"2024-09-12T00:37:23.062825+0000","last_became_active":"2024-09-12T00:02:03.153948+0000","last_became_peered":"2024-09-12T00:02:03.153948+0000","last_unstale":"2024-09-12T00:37:23.062825+0000","last_undegraded":"2024-09-12T00:37:23.062825+0000","last_fullsized":"2024-09-12T00:37:23.062825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:26.035209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":128,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'761","reported_seq":4276,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.951944+0000","last_change":"2024-09-12T00:02:05.170722+0000","last_active":"2024-09-12T00:38:28.951944+0000","last_peered":"2024-09-12T00:38:28.951944+0000","last_clean":"2024-09-12T00:38:28.951944+0000","last_became_active":"2024-09-12T00:02:05.170399+0000","last_became_peered":"2024-09-12T00:02:05.170399+0000","last_unstale":"2024-09-12T00:38:28.951944+0000","last_undegraded":"2024-09-12T00:38:28.951944+0000","last_fullsized":"2024-09-12T00:38:28.951944+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:06.211117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'118","reported_seq":604,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.949325+0000","last_change":"2024-09-12T00:02:07.173296+0000","last_active":"2024-09-12T00:37:06.949325+0000","last_peered":"2024-09-12T00:37:06.949325+0000","last_clean":"2024-09-12T00:37:06.949325+0000","last_became_active":"2024-09-12T00:02:07.173030+0000","last_became_peered":"2024-09-12T00:02:07.173030+0000","last_unstale":"2024-09-12T00:37:06.949325+0000","last_undegraded":"2024-09-12T00:37:06.949325+0000","last_fullsized":"2024-09-12T00:37:06.949325+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:13.276457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":288,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'244","reported_seq":873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.077246+0000","last_change":"2024-09-12T00:01:59.152008+0000","last_active":"2024-09-12T00:36:50.077246+0000","last_peered":"2024-09-12T00:36:50.077246+0000","last_clean":"2024-09-12T00:36:50.077246+0000","last_became_active":"2024-09-12T00:01:59.151743+0000","last_became_peered":"2024-09-12T00:01:59.151743+0000","last_unstale":"2024-09-12T00:36:50.077246+0000","last_undegraded":"2024-09-12T00:36:50.077246+0000","last_fullsized":"2024-09-12T00:36:50.077246+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:35.993592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1082,"num_read_kb":884,"num_write":389,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'263","reported_seq":860,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.448347+0000","last_change":"2024-09-12T00:01:57.145465+0000","last_active":"2024-09-12T00:38:36.448347+0000","last_peered":"2024-09-12T00:38:36.448347+0000","last_clean":"2024-09-12T00:38:36.448347+0000","last_became_active":"2024-09-12T00:01:57.144946+0000","last_became_peered":"2024-09-12T00:01:57.144946+0000","last_unstale":"2024-09-12T00:38:36.448347+0000","last_undegraded":"2024-09-12T00:38:36.448347+0000","last_fullsized":"2024-09-12T00:38:36.448347+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:23.104871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41902,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":369,"num_read_kb":501,"num_write":918,"num_write_kb":20369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:31.497576+0000","last_change":"2024-09-12T00:02:01.152803+0000","last_active":"2024-09-12T00:34:31.497576+0000","last_peered":"2024-09-12T00:34:31.497576+0000","last_clean":"2024-09-12T00:34:31.497576+0000","last_became_active":"2024-09-12T00:02:01.152493+0000","last_became_peered":"2024-09-12T00:02:01.152493+0000","last_unstale":"2024-09-12T00:34:31.497576+0000","last_undegraded":"2024-09-12T00:34:31.497576+0000","last_fullsized":"2024-09-12T00:34:31.497576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:39.421026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'308","reported_seq":898,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.900764+0000","last_change":"2024-09-12T00:02:03.150973+0000","last_active":"2024-09-12T00:38:28.900764+0000","last_peered":"2024-09-12T00:38:28.900764+0000","last_clean":"2024-09-12T00:38:28.900764+0000","last_became_active":"2024-09-12T00:02:03.150631+0000","last_became_peered":"2024-09-12T00:02:03.150631+0000","last_unstale":"2024-09-12T00:38:28.900764+0000","last_undegraded":"2024-09-12T00:38:28.900764+0000","last_fullsized":"2024-09-12T00:38:28.900764+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:17.364587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78037,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":500,"num_read_kb":1028,"num_write":406,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.513886+0000","last_change":"2024-09-12T00:02:05.167377+0000","last_active":"2024-09-12T00:35:57.513886+0000","last_peered":"2024-09-12T00:35:57.513886+0000","last_clean":"2024-09-12T00:35:57.513886+0000","last_became_active":"2024-09-12T00:02:05.167082+0000","last_became_peered":"2024-09-12T00:02:05.167082+0000","last_unstale":"2024-09-12T00:35:57.513886+0000","last_undegraded":"2024-09-12T00:35:57.513886+0000","last_fullsized":"2024-09-12T00:35:57.513886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:04.610051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'123","reported_seq":614,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.557143+0000","last_change":"2024-09-12T00:02:07.173111+0000","last_active":"2024-09-12T00:38:27.557143+0000","last_peered":"2024-09-12T00:38:27.557143+0000","last_clean":"2024-09-12T00:38:27.557143+0000","last_became_active":"2024-09-12T00:02:07.172810+0000","last_became_peered":"2024-09-12T00:02:07.172810+0000","last_unstale":"2024-09-12T00:38:27.557143+0000","last_undegraded":"2024-09-12T00:38:27.557143+0000","last_fullsized":"2024-09-12T00:38:27.557143+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:47.728676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":135,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'223","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:25.779475+0000","last_change":"2024-09-12T00:01:59.147668+0000","last_active":"2024-09-12T00:36:25.779475+0000","last_peered":"2024-09-12T00:36:25.779475+0000","last_clean":"2024-09-12T00:36:25.779475+0000","last_became_active":"2024-09-12T00:01:59.147373+0000","last_became_peered":"2024-09-12T00:01:59.147373+0000","last_unstale":"2024-09-12T00:36:25.779475+0000","last_undegraded":"2024-09-12T00:36:25.779475+0000","last_fullsized":"2024-09-12T00:36:25.779475+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:21.257179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1007,"num_read_kb":830,"num_write":359,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'231","reported_seq":826,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:11.086295+0000","last_change":"2024-09-12T00:01:57.161842+0000","last_active":"2024-09-12T00:37:11.086295+0000","last_peered":"2024-09-12T00:37:11.086295+0000","last_clean":"2024-09-12T00:37:11.086295+0000","last_became_active":"2024-09-12T00:01:57.161414+0000","last_became_peered":"2024-09-12T00:01:57.161414+0000","last_unstale":"2024-09-12T00:37:11.086295+0000","last_undegraded":"2024-09-12T00:37:11.086295+0000","last_fullsized":"2024-09-12T00:37:11.086295+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:03.307762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7211953,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":314,"num_read_kb":8089,"num_write":853,"num_write_kb":31185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615825+0000","last_change":"2024-09-12T00:02:01.152071+0000","last_active":"2024-09-12T00:34:34.615825+0000","last_peered":"2024-09-12T00:34:34.615825+0000","last_clean":"2024-09-12T00:34:34.615825+0000","last_became_active":"2024-09-12T00:02:01.151760+0000","last_became_peered":"2024-09-12T00:02:01.151760+0000","last_unstale":"2024-09-12T00:34:34.615825+0000","last_undegraded":"2024-09-12T00:34:34.615825+0000","last_fullsized":"2024-09-12T00:34:34.615825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:08.986013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'276","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.624371+0000","last_change":"2024-09-12T00:02:03.151005+0000","last_active":"2024-09-12T00:38:36.624371+0000","last_peered":"2024-09-12T00:38:36.624371+0000","last_clean":"2024-09-12T00:38:36.624371+0000","last_became_active":"2024-09-12T00:02:03.150714+0000","last_became_peered":"2024-09-12T00:02:03.150714+0000","last_unstale":"2024-09-12T00:38:36.624371+0000","last_undegraded":"2024-09-12T00:38:36.624371+0000","last_fullsized":"2024-09-12T00:38:36.624371+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:39.492995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52913,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1134,"num_write":392,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.393761+0000","last_change":"2024-09-12T00:02:05.171377+0000","last_active":"2024-09-12T00:35:59.393761+0000","last_peered":"2024-09-12T00:35:59.393761+0000","last_clean":"2024-09-12T00:35:59.393761+0000","last_became_active":"2024-09-12T00:02:05.170973+0000","last_became_peered":"2024-09-12T00:02:05.170973+0000","last_unstale":"2024-09-12T00:35:59.393761+0000","last_undegraded":"2024-09-12T00:35:59.393761+0000","last_fullsized":"2024-09-12T00:35:59.393761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:14.690020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'119","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:11.054534+0000","last_change":"2024-09-12T00:02:07.169559+0000","last_active":"2024-09-12T00:37:11.054534+0000","last_peered":"2024-09-12T00:37:11.054534+0000","last_clean":"2024-09-12T00:37:11.054534+0000","last_became_active":"2024-09-12T00:02:07.169266+0000","last_became_peered":"2024-09-12T00:02:07.169266+0000","last_unstale":"2024-09-12T00:37:11.054534+0000","last_undegraded":"2024-09-12T00:37:11.054534+0000","last_fullsized":"2024-09-12T00:37:11.054534+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:08.775255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":294,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'183","reported_seq":777,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:00.677198+0000","last_change":"2024-09-12T00:01:59.150196+0000","last_active":"2024-09-12T00:37:00.677198+0000","last_peered":"2024-09-12T00:37:00.677198+0000","last_clean":"2024-09-12T00:37:00.677198+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:37:00.677198+0000","last_undegraded":"2024-09-12T00:37:00.677198+0000","last_fullsized":"2024-09-12T00:37:00.677198+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:58.771289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":689,"num_write":284,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'370","reported_seq":1085,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.363565+0000","last_change":"2024-09-12T00:01:57.162027+0000","last_active":"2024-09-12T00:37:09.363565+0000","last_peered":"2024-09-12T00:37:09.363565+0000","last_clean":"2024-09-12T00:37:09.363565+0000","last_became_active":"2024-09-12T00:01:57.161612+0000","last_became_peered":"2024-09-12T00:01:57.161612+0000","last_unstale":"2024-09-12T00:37:09.363565+0000","last_undegraded":"2024-09-12T00:37:09.363565+0000","last_fullsized":"2024-09-12T00:37:09.363565+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:46.162850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6737995,"num_objects":82,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":696,"num_read_kb":15126,"num_write":1432,"num_write_kb":40840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:51.509280+0000","last_change":"2024-09-12T00:02:01.145374+0000","last_active":"2024-09-12T00:35:51.509280+0000","last_peered":"2024-09-12T00:35:51.509280+0000","last_clean":"2024-09-12T00:35:51.509280+0000","last_became_active":"2024-09-12T00:02:01.144558+0000","last_became_peered":"2024-09-12T00:02:01.144558+0000","last_unstale":"2024-09-12T00:35:51.509280+0000","last_undegraded":"2024-09-12T00:35:51.509280+0000","last_fullsized":"2024-09-12T00:35:51.509280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:59.388355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'258","reported_seq":800,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.519655+0000","last_change":"2024-09-12T00:02:03.154789+0000","last_active":"2024-09-12T00:37:04.519655+0000","last_peered":"2024-09-12T00:37:04.519655+0000","last_clean":"2024-09-12T00:37:04.519655+0000","last_became_active":"2024-09-12T00:02:03.154477+0000","last_became_peered":"2024-09-12T00:02:03.154477+0000","last_unstale":"2024-09-12T00:37:04.519655+0000","last_undegraded":"2024-09-12T00:37:04.519655+0000","last_fullsized":"2024-09-12T00:37:04.519655+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:25.591233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60035,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":949,"num_write":360,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.382052+0000","last_change":"2024-09-12T00:02:05.166486+0000","last_active":"2024-09-12T00:34:34.382052+0000","last_peered":"2024-09-12T00:34:34.382052+0000","last_clean":"2024-09-12T00:34:34.382052+0000","last_became_active":"2024-09-12T00:02:05.166141+0000","last_became_peered":"2024-09-12T00:02:05.166141+0000","last_unstale":"2024-09-12T00:34:34.382052+0000","last_undegraded":"2024-09-12T00:34:34.382052+0000","last_fullsized":"2024-09-12T00:34:34.382052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:12.751964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'186","reported_seq":1324,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.932224+0000","last_change":"2024-09-12T00:02:07.170137+0000","last_active":"2024-09-12T00:37:21.932224+0000","last_peered":"2024-09-12T00:37:21.932224+0000","last_clean":"2024-09-12T00:37:21.932224+0000","last_became_active":"2024-09-12T00:02:07.169812+0000","last_became_peered":"2024-09-12T00:02:07.169812+0000","last_unstale":"2024-09-12T00:37:21.932224+0000","last_undegraded":"2024-09-12T00:37:21.932224+0000","last_fullsized":"2024-09-12T00:37:21.932224+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:18.008023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1006,"num_read_kb":951,"num_write":452,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'117","reported_seq":665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.914183+0000","last_change":"2024-09-12T00:01:59.148574+0000","last_active":"2024-09-12T00:37:08.914183+0000","last_peered":"2024-09-12T00:37:08.914183+0000","last_clean":"2024-09-12T00:37:08.914183+0000","last_became_active":"2024-09-12T00:01:59.148253+0000","last_became_peered":"2024-09-12T00:01:59.148253+0000","last_unstale":"2024-09-12T00:37:08.914183+0000","last_undegraded":"2024-09-12T00:37:08.914183+0000","last_fullsized":"2024-09-12T00:37:08.914183+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:57.621477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":405,"num_write":165,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'320","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:38.904642+0000","last_change":"2024-09-12T00:01:57.138855+0000","last_active":"2024-09-12T00:36:38.904642+0000","last_peered":"2024-09-12T00:36:38.904642+0000","last_clean":"2024-09-12T00:36:38.904642+0000","last_became_active":"2024-09-12T00:01:57.138386+0000","last_became_peered":"2024-09-12T00:01:57.138386+0000","last_unstale":"2024-09-12T00:36:38.904642+0000","last_undegraded":"2024-09-12T00:36:38.904642+0000","last_fullsized":"2024-09-12T00:36:38.904642+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:56.658569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10748696,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":602,"num_read_kb":37451,"num_write":1125,"num_write_kb":32715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.513932+0000","last_change":"2024-09-12T00:02:01.153600+0000","last_active":"2024-09-12T00:35:57.513932+0000","last_peered":"2024-09-12T00:35:57.513932+0000","last_clean":"2024-09-12T00:35:57.513932+0000","last_became_active":"2024-09-12T00:02:01.153306+0000","last_became_peered":"2024-09-12T00:02:01.153306+0000","last_unstale":"2024-09-12T00:35:57.513932+0000","last_undegraded":"2024-09-12T00:35:57.513932+0000","last_fullsized":"2024-09-12T00:35:57.513932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:16.790631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'280","reported_seq":855,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.401570+0000","last_change":"2024-09-12T00:02:03.158753+0000","last_active":"2024-09-12T00:37:04.401570+0000","last_peered":"2024-09-12T00:37:04.401570+0000","last_clean":"2024-09-12T00:37:04.401570+0000","last_became_active":"2024-09-12T00:02:03.158379+0000","last_became_peered":"2024-09-12T00:02:03.158379+0000","last_unstale":"2024-09-12T00:37:04.401570+0000","last_undegraded":"2024-09-12T00:37:04.401570+0000","last_fullsized":"2024-09-12T00:37:04.401570+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:08.601813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60004,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":467,"num_read_kb":943,"num_write":374,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:37.502005+0000","last_change":"2024-09-12T00:02:05.160180+0000","last_active":"2024-09-12T00:34:37.502005+0000","last_peered":"2024-09-12T00:34:37.502005+0000","last_clean":"2024-09-12T00:34:37.502005+0000","last_became_active":"2024-09-12T00:02:05.159854+0000","last_became_peered":"2024-09-12T00:02:05.159854+0000","last_unstale":"2024-09-12T00:34:37.502005+0000","last_undegraded":"2024-09-12T00:34:37.502005+0000","last_fullsized":"2024-09-12T00:34:37.502005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.989519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'131","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.590853+0000","last_change":"2024-09-12T00:02:07.171050+0000","last_active":"2024-09-12T00:38:27.590853+0000","last_peered":"2024-09-12T00:38:27.590853+0000","last_clean":"2024-09-12T00:38:27.590853+0000","last_became_active":"2024-09-12T00:02:07.170727+0000","last_became_peered":"2024-09-12T00:02:07.170727+0000","last_unstale":"2024-09-12T00:38:27.590853+0000","last_undegraded":"2024-09-12T00:38:27.590853+0000","last_fullsized":"2024-09-12T00:38:27.590853+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:03.358486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":129,"num_write":315,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'247","reported_seq":907,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:49.863461+0000","last_change":"2024-09-12T00:01:59.145783+0000","last_active":"2024-09-12T00:36:49.863461+0000","last_peered":"2024-09-12T00:36:49.863461+0000","last_clean":"2024-09-12T00:36:49.863461+0000","last_became_active":"2024-09-12T00:01:59.145502+0000","last_became_peered":"2024-09-12T00:01:59.145502+0000","last_unstale":"2024-09-12T00:36:49.863461+0000","last_undegraded":"2024-09-12T00:36:49.863461+0000","last_fullsized":"2024-09-12T00:36:49.863461+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:15.171878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1128,"num_read_kb":927,"num_write":363,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'306","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:49.654143+0000","last_change":"2024-09-12T00:01:57.159976+0000","last_active":"2024-09-12T00:36:49.654143+0000","last_peered":"2024-09-12T00:36:49.654143+0000","last_clean":"2024-09-12T00:36:49.654143+0000","last_became_active":"2024-09-12T00:01:57.159487+0000","last_became_peered":"2024-09-12T00:01:57.159487+0000","last_unstale":"2024-09-12T00:36:49.654143+0000","last_undegraded":"2024-09-12T00:36:49.654143+0000","last_fullsized":"2024-09-12T00:36:49.654143+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:30.085074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16806712,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":510,"num_read_kb":54881,"num_write":1082,"num_write_kb":38301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'150","reported_seq":696,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.498309+0000","last_change":"2024-09-12T00:01:59.153656+0000","last_active":"2024-09-12T00:34:29.498309+0000","last_peered":"2024-09-12T00:34:29.498309+0000","last_clean":"2024-09-12T00:34:29.498309+0000","last_became_active":"2024-09-12T00:01:59.153340+0000","last_became_peered":"2024-09-12T00:01:59.153340+0000","last_unstale":"2024-09-12T00:34:29.498309+0000","last_undegraded":"2024-09-12T00:34:29.498309+0000","last_fullsized":"2024-09-12T00:34:29.498309+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:17.663369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":542,"num_write":243,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'257","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.292767+0000","last_change":"2024-09-12T00:01:57.152880+0000","last_active":"2024-09-12T00:37:07.292767+0000","last_peered":"2024-09-12T00:37:07.292767+0000","last_clean":"2024-09-12T00:37:07.292767+0000","last_became_active":"2024-09-12T00:01:57.152522+0000","last_became_peered":"2024-09-12T00:01:57.152522+0000","last_unstale":"2024-09-12T00:37:07.292767+0000","last_undegraded":"2024-09-12T00:37:07.292767+0000","last_fullsized":"2024-09-12T00:37:07.292767+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:20.467716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12224787,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":507,"num_read_kb":16299,"num_write":978,"num_write_kb":36902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'216","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:10.173233+0000","last_change":"2024-09-12T00:01:59.146252+0000","last_active":"2024-09-12T00:38:10.173233+0000","last_peered":"2024-09-12T00:38:10.173233+0000","last_clean":"2024-09-12T00:38:10.173233+0000","last_became_active":"2024-09-12T00:01:59.145971+0000","last_became_peered":"2024-09-12T00:01:59.145971+0000","last_unstale":"2024-09-12T00:38:10.173233+0000","last_undegraded":"2024-09-12T00:38:10.173233+0000","last_fullsized":"2024-09-12T00:38:10.173233+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:57.400027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":962,"num_read_kb":786,"num_write":321,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'290","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.821238+0000","last_change":"2024-09-12T00:01:57.168090+0000","last_active":"2024-09-12T00:36:56.821238+0000","last_peered":"2024-09-12T00:36:56.821238+0000","last_clean":"2024-09-12T00:36:56.821238+0000","last_became_active":"2024-09-12T00:01:57.167651+0000","last_became_peered":"2024-09-12T00:01:57.167651+0000","last_unstale":"2024-09-12T00:36:56.821238+0000","last_undegraded":"2024-09-12T00:36:56.821238+0000","last_fullsized":"2024-09-12T00:36:56.821238+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:47.430232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327545,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":424,"num_read_kb":6602,"num_write":1089,"num_write_kb":24145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'167","reported_seq":749,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.289614+0000","last_change":"2024-09-12T00:01:59.147316+0000","last_active":"2024-09-12T00:37:09.289614+0000","last_peered":"2024-09-12T00:37:09.289614+0000","last_clean":"2024-09-12T00:37:09.289614+0000","last_became_active":"2024-09-12T00:01:59.146794+0000","last_became_peered":"2024-09-12T00:01:59.146794+0000","last_unstale":"2024-09-12T00:37:09.289614+0000","last_undegraded":"2024-09-12T00:37:09.289614+0000","last_fullsized":"2024-09-12T00:37:09.289614+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:19.361635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":586,"num_write":261,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'231","reported_seq":837,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:26.672238+0000","last_change":"2024-09-12T00:01:57.145828+0000","last_active":"2024-09-12T00:36:26.672238+0000","last_peered":"2024-09-12T00:36:26.672238+0000","last_clean":"2024-09-12T00:36:26.672238+0000","last_became_active":"2024-09-12T00:01:57.145410+0000","last_became_peered":"2024-09-12T00:01:57.145410+0000","last_unstale":"2024-09-12T00:36:26.672238+0000","last_undegraded":"2024-09-12T00:36:26.672238+0000","last_fullsized":"2024-09-12T00:36:26.672238+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:43.346735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":472491,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":346,"num_read_kb":533,"num_write":894,"num_write_kb":14360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'571","reported_seq":1333,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.455576+0000","last_change":"2024-09-12T00:01:59.149108+0000","last_active":"2024-09-12T00:37:23.455576+0000","last_peered":"2024-09-12T00:37:23.455576+0000","last_clean":"2024-09-12T00:37:23.455576+0000","last_became_active":"2024-09-12T00:01:59.148605+0000","last_became_peered":"2024-09-12T00:01:59.148605+0000","last_unstale":"2024-09-12T00:37:23.455576+0000","last_undegraded":"2024-09-12T00:37:23.455576+0000","last_fullsized":"2024-09-12T00:37:23.455576+0000","mapping_epoch":26,"log_start":"261'500","ondisk_log_start":"261'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:43.891160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2664,"num_read_kb":2197,"num_write":993,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'265","reported_seq":907,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.346018+0000","last_change":"2024-09-12T00:02:32.865371+0000","last_active":"2024-09-12T00:37:21.346018+0000","last_peered":"2024-09-12T00:37:21.346018+0000","last_clean":"2024-09-12T00:37:21.346018+0000","last_became_active":"2024-09-12T00:02:32.864862+0000","last_became_peered":"2024-09-12T00:02:32.864862+0000","last_unstale":"2024-09-12T00:37:21.346018+0000","last_undegraded":"2024-09-12T00:37:21.346018+0000","last_fullsized":"2024-09-12T00:37:21.346018+0000","mapping_epoch":37,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:46.058961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7461216,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":433,"num_read_kb":62973,"num_write":1029,"num_write_kb":36662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7,3],"acting":[6,0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'192","reported_seq":809,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:28.041132+0000","last_change":"2024-09-12T00:01:59.141664+0000","last_active":"2024-09-12T00:36:28.041132+0000","last_peered":"2024-09-12T00:36:28.041132+0000","last_clean":"2024-09-12T00:36:28.041132+0000","last_became_active":"2024-09-12T00:01:59.141383+0000","last_became_peered":"2024-09-12T00:01:59.141383+0000","last_unstale":"2024-09-12T00:36:28.041132+0000","last_undegraded":"2024-09-12T00:36:28.041132+0000","last_fullsized":"2024-09-12T00:36:28.041132+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:49.143020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":715,"num_write":298,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'277","reported_seq":931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.389271+0000","last_change":"2024-09-12T00:01:57.152496+0000","last_active":"2024-09-12T00:37:02.389271+0000","last_peered":"2024-09-12T00:37:02.389271+0000","last_clean":"2024-09-12T00:37:02.389271+0000","last_became_active":"2024-09-12T00:01:57.152097+0000","last_became_peered":"2024-09-12T00:01:57.152097+0000","last_unstale":"2024-09-12T00:37:02.389271+0000","last_undegraded":"2024-09-12T00:37:02.389271+0000","last_fullsized":"2024-09-12T00:37:02.389271+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:44.525600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12512919,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":458,"num_read_kb":43886,"num_write":1015,"num_write_kb":36840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'430","reported_seq":1145,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:19.505287+0000","last_change":"2024-09-12T00:01:59.146420+0000","last_active":"2024-09-12T00:35:19.505287+0000","last_peered":"2024-09-12T00:35:19.505287+0000","last_clean":"2024-09-12T00:35:19.505287+0000","last_became_active":"2024-09-12T00:01:59.146117+0000","last_became_peered":"2024-09-12T00:01:59.146117+0000","last_unstale":"2024-09-12T00:35:19.505287+0000","last_undegraded":"2024-09-12T00:35:19.505287+0000","last_fullsized":"2024-09-12T00:35:19.505287+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:14.193284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2179,"num_read_kb":1868,"num_write":729,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'314","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.803528+0000","last_change":"2024-09-12T00:01:57.156353+0000","last_active":"2024-09-12T00:37:10.803528+0000","last_peered":"2024-09-12T00:37:10.803528+0000","last_clean":"2024-09-12T00:37:10.803528+0000","last_became_active":"2024-09-12T00:01:57.156002+0000","last_became_peered":"2024-09-12T00:01:57.156002+0000","last_unstale":"2024-09-12T00:37:10.803528+0000","last_undegraded":"2024-09-12T00:37:10.803528+0000","last_fullsized":"2024-09-12T00:37:10.803528+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:26.168398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19094454,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":607,"num_read_kb":79699,"num_write":1278,"num_write_kb":54312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'216","reported_seq":795,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.099261+0000","last_change":"2024-09-12T00:01:59.155738+0000","last_active":"2024-09-12T00:37:10.099261+0000","last_peered":"2024-09-12T00:37:10.099261+0000","last_clean":"2024-09-12T00:37:10.099261+0000","last_became_active":"2024-09-12T00:01:59.155003+0000","last_became_peered":"2024-09-12T00:01:59.155003+0000","last_unstale":"2024-09-12T00:37:10.099261+0000","last_undegraded":"2024-09-12T00:37:10.099261+0000","last_fullsized":"2024-09-12T00:37:10.099261+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:00.966411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":893,"num_read_kb":718,"num_write":326,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'297","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:55.558835+0000","last_change":"2024-09-12T00:01:57.145897+0000","last_active":"2024-09-12T00:36:55.558835+0000","last_peered":"2024-09-12T00:36:55.558835+0000","last_clean":"2024-09-12T00:36:55.558835+0000","last_became_active":"2024-09-12T00:01:57.145466+0000","last_became_peered":"2024-09-12T00:01:57.145466+0000","last_unstale":"2024-09-12T00:36:55.558835+0000","last_undegraded":"2024-09-12T00:36:55.558835+0000","last_fullsized":"2024-09-12T00:36:55.558835+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:37.023670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651566,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":418,"num_read_kb":3535,"num_write":1109,"num_write_kb":24926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'109","reported_seq":685,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.756770+0000","last_change":"2024-09-12T00:01:59.149307+0000","last_active":"2024-09-12T00:36:54.756770+0000","last_peered":"2024-09-12T00:36:54.756770+0000","last_clean":"2024-09-12T00:36:54.756770+0000","last_became_active":"2024-09-12T00:01:59.149014+0000","last_became_peered":"2024-09-12T00:01:59.149014+0000","last_unstale":"2024-09-12T00:36:54.756770+0000","last_undegraded":"2024-09-12T00:36:54.756770+0000","last_fullsized":"2024-09-12T00:36:54.756770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:10.536874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":492,"num_read_kb":416,"num_write":148,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'333","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.999463+0000","last_change":"2024-09-12T00:01:57.151349+0000","last_active":"2024-09-12T00:37:07.999463+0000","last_peered":"2024-09-12T00:37:07.999463+0000","last_clean":"2024-09-12T00:37:07.999463+0000","last_became_active":"2024-09-12T00:01:57.150980+0000","last_became_peered":"2024-09-12T00:01:57.150980+0000","last_unstale":"2024-09-12T00:37:07.999463+0000","last_undegraded":"2024-09-12T00:37:07.999463+0000","last_fullsized":"2024-09-12T00:37:07.999463+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:09.638039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307913,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":569,"num_read_kb":15521,"num_write":1217,"num_write_kb":17105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'109","reported_seq":703,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.368547+0000","last_change":"2024-09-12T00:01:59.150294+0000","last_active":"2024-09-12T00:37:06.368547+0000","last_peered":"2024-09-12T00:37:06.368547+0000","last_clean":"2024-09-12T00:37:06.368547+0000","last_became_active":"2024-09-12T00:01:59.149341+0000","last_became_peered":"2024-09-12T00:01:59.149341+0000","last_unstale":"2024-09-12T00:37:06.368547+0000","last_undegraded":"2024-09-12T00:37:06.368547+0000","last_fullsized":"2024-09-12T00:37:06.368547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:43.661734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":504,"num_read_kb":434,"num_write":171,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'286","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.566844+0000","last_change":"2024-09-12T00:02:32.863517+0000","last_active":"2024-09-12T00:37:10.566844+0000","last_peered":"2024-09-12T00:37:10.566844+0000","last_clean":"2024-09-12T00:37:10.566844+0000","last_became_active":"2024-09-12T00:02:32.863077+0000","last_became_peered":"2024-09-12T00:02:32.863077+0000","last_unstale":"2024-09-12T00:37:10.566844+0000","last_undegraded":"2024-09-12T00:37:10.566844+0000","last_fullsized":"2024-09-12T00:37:10.566844+0000","mapping_epoch":37,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:26.806451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2600321,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":473,"num_read_kb":11923,"num_write":1086,"num_write_kb":27282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,7],"acting":[5,6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'269","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.154723+0000","last_change":"2024-09-12T00:01:59.159517+0000","last_active":"2024-09-12T00:36:54.154723+0000","last_peered":"2024-09-12T00:36:54.154723+0000","last_clean":"2024-09-12T00:36:54.154723+0000","last_became_active":"2024-09-12T00:01:59.159226+0000","last_became_peered":"2024-09-12T00:01:59.159226+0000","last_unstale":"2024-09-12T00:36:54.154723+0000","last_undegraded":"2024-09-12T00:36:54.154723+0000","last_fullsized":"2024-09-12T00:36:54.154723+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:44.957681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1182,"num_read_kb":958,"num_write":434,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'317","reported_seq":977,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.460978+0000","last_change":"2024-09-12T00:01:57.148465+0000","last_active":"2024-09-12T00:38:36.460978+0000","last_peered":"2024-09-12T00:38:36.460978+0000","last_clean":"2024-09-12T00:38:36.460978+0000","last_became_active":"2024-09-12T00:01:57.148038+0000","last_became_peered":"2024-09-12T00:01:57.148038+0000","last_unstale":"2024-09-12T00:38:36.460978+0000","last_undegraded":"2024-09-12T00:38:36.460978+0000","last_fullsized":"2024-09-12T00:38:36.460978+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:42.798082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22023789,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":491,"num_read_kb":81303,"num_write":1097,"num_write_kb":56822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'244","reported_seq":815,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:17.296585+0000","last_change":"2024-09-12T00:01:59.154559+0000","last_active":"2024-09-12T00:36:17.296585+0000","last_peered":"2024-09-12T00:36:17.296585+0000","last_clean":"2024-09-12T00:36:17.296585+0000","last_became_active":"2024-09-12T00:01:59.154258+0000","last_became_peered":"2024-09-12T00:01:59.154258+0000","last_unstale":"2024-09-12T00:36:17.296585+0000","last_undegraded":"2024-09-12T00:36:17.296585+0000","last_fullsized":"2024-09-12T00:36:17.296585+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:13.431395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":900,"num_write":421,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'342","reported_seq":996,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.521995+0000","last_change":"2024-09-12T00:01:57.143175+0000","last_active":"2024-09-12T00:38:37.521995+0000","last_peered":"2024-09-12T00:38:37.521995+0000","last_clean":"2024-09-12T00:38:37.521995+0000","last_became_active":"2024-09-12T00:01:57.142713+0000","last_became_peered":"2024-09-12T00:01:57.142713+0000","last_unstale":"2024-09-12T00:38:37.521995+0000","last_undegraded":"2024-09-12T00:38:37.521995+0000","last_fullsized":"2024-09-12T00:38:37.521995+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:53.401721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11929727,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":492,"num_read_kb":36569,"num_write":1099,"num_write_kb":39253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'210","reported_seq":845,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:15.454384+0000","last_change":"2024-09-12T00:01:59.155267+0000","last_active":"2024-09-12T00:36:15.454384+0000","last_peered":"2024-09-12T00:36:15.454384+0000","last_clean":"2024-09-12T00:36:15.454384+0000","last_became_active":"2024-09-12T00:01:59.154931+0000","last_became_peered":"2024-09-12T00:01:59.154931+0000","last_unstale":"2024-09-12T00:36:15.454384+0000","last_undegraded":"2024-09-12T00:36:15.454384+0000","last_fullsized":"2024-09-12T00:36:15.454384+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:10.981627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":786,"num_write":317,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'288","reported_seq":983,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.160663+0000","last_change":"2024-09-12T00:01:57.142655+0000","last_active":"2024-09-12T00:37:06.160663+0000","last_peered":"2024-09-12T00:37:06.160663+0000","last_clean":"2024-09-12T00:37:06.160663+0000","last_became_active":"2024-09-12T00:01:57.142082+0000","last_became_peered":"2024-09-12T00:01:57.142082+0000","last_unstale":"2024-09-12T00:37:06.160663+0000","last_undegraded":"2024-09-12T00:37:06.160663+0000","last_fullsized":"2024-09-12T00:37:06.160663+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:37.032607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5484013,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":553,"num_read_kb":3429,"num_write":1130,"num_write_kb":16203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'205","reported_seq":791,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.958424+0000","last_change":"2024-09-12T00:01:59.146609+0000","last_active":"2024-09-12T00:36:50.958424+0000","last_peered":"2024-09-12T00:36:50.958424+0000","last_clean":"2024-09-12T00:36:50.958424+0000","last_became_active":"2024-09-12T00:01:59.146272+0000","last_became_peered":"2024-09-12T00:01:59.146272+0000","last_unstale":"2024-09-12T00:36:50.958424+0000","last_undegraded":"2024-09-12T00:36:50.958424+0000","last_fullsized":"2024-09-12T00:36:50.958424+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:31.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":905,"num_read_kb":736,"num_write":324,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'272","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.006825+0000","last_change":"2024-09-12T00:01:57.165561+0000","last_active":"2024-09-12T00:37:07.006825+0000","last_peered":"2024-09-12T00:37:07.006825+0000","last_clean":"2024-09-12T00:37:07.006825+0000","last_became_active":"2024-09-12T00:01:57.165139+0000","last_became_peered":"2024-09-12T00:01:57.165139+0000","last_unstale":"2024-09-12T00:37:07.006825+0000","last_undegraded":"2024-09-12T00:37:07.006825+0000","last_fullsized":"2024-09-12T00:37:07.006825+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:31.614666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16237229,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":396,"num_read_kb":34173,"num_write":1033,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'210","reported_seq":834,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:51.123390+0000","last_change":"2024-09-12T00:01:59.151886+0000","last_active":"2024-09-12T00:36:51.123390+0000","last_peered":"2024-09-12T00:36:51.123390+0000","last_clean":"2024-09-12T00:36:51.123390+0000","last_became_active":"2024-09-12T00:01:59.151627+0000","last_became_peered":"2024-09-12T00:01:59.151627+0000","last_unstale":"2024-09-12T00:36:51.123390+0000","last_undegraded":"2024-09-12T00:36:51.123390+0000","last_fullsized":"2024-09-12T00:36:51.123390+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:04.332533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":886,"num_read_kb":742,"num_write":315,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'316","reported_seq":1152,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.018590+0000","last_change":"2024-09-12T00:01:57.151733+0000","last_active":"2024-09-12T00:37:09.018590+0000","last_peered":"2024-09-12T00:37:09.018590+0000","last_clean":"2024-09-12T00:37:09.018590+0000","last_became_active":"2024-09-12T00:01:57.151346+0000","last_became_peered":"2024-09-12T00:01:57.151346+0000","last_unstale":"2024-09-12T00:37:09.018590+0000","last_undegraded":"2024-09-12T00:37:09.018590+0000","last_fullsized":"2024-09-12T00:37:09.018590+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:20.828358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":654085,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":896,"num_read_kb":6739,"num_write":1138,"num_write_kb":13731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'4140","reported_seq":4711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:03.256251+0000","last_change":"2024-09-12T00:01:59.158824+0000","last_active":"2024-09-12T00:36:03.256251+0000","last_peered":"2024-09-12T00:36:03.256251+0000","last_clean":"2024-09-12T00:36:03.256251+0000","last_became_active":"2024-09-12T00:01:59.157873+0000","last_became_peered":"2024-09-12T00:01:59.157873+0000","last_unstale":"2024-09-12T00:36:03.256251+0000","last_undegraded":"2024-09-12T00:36:03.256251+0000","last_fullsized":"2024-09-12T00:36:03.256251+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:18.182096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16645,"num_read_kb":13962,"num_write":6214,"num_write_kb":3111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'276","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.390513+0000","last_change":"2024-09-12T00:01:57.165394+0000","last_active":"2024-09-12T00:37:02.390513+0000","last_peered":"2024-09-12T00:37:02.390513+0000","last_clean":"2024-09-12T00:37:02.390513+0000","last_became_active":"2024-09-12T00:01:57.165016+0000","last_became_peered":"2024-09-12T00:01:57.165016+0000","last_unstale":"2024-09-12T00:37:02.390513+0000","last_undegraded":"2024-09-12T00:37:02.390513+0000","last_fullsized":"2024-09-12T00:37:02.390513+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:19.072293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6912807,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":529,"num_read_kb":10231,"num_write":1038,"num_write_kb":39602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'257","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.658178+0000","last_change":"2024-09-12T00:01:57.165458+0000","last_active":"2024-09-12T00:37:21.658178+0000","last_peered":"2024-09-12T00:37:21.658178+0000","last_clean":"2024-09-12T00:37:21.658178+0000","last_became_active":"2024-09-12T00:01:57.165046+0000","last_became_peered":"2024-09-12T00:01:57.165046+0000","last_unstale":"2024-09-12T00:37:21.658178+0000","last_undegraded":"2024-09-12T00:37:21.658178+0000","last_fullsized":"2024-09-12T00:37:21.658178+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:21.899432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9838564,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":540,"num_read_kb":41753,"num_write":920,"num_write_kb":31467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'110","reported_seq":711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.156763+0000","last_change":"2024-09-12T00:01:59.153747+0000","last_active":"2024-09-12T00:37:01.156763+0000","last_peered":"2024-09-12T00:37:01.156763+0000","last_clean":"2024-09-12T00:37:01.156763+0000","last_became_active":"2024-09-12T00:01:59.153454+0000","last_became_peered":"2024-09-12T00:01:59.153454+0000","last_unstale":"2024-09-12T00:37:01.156763+0000","last_undegraded":"2024-09-12T00:37:01.156763+0000","last_fullsized":"2024-09-12T00:37:01.156763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:03.025405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":439,"num_write":164,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'287","reported_seq":1134,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:55.824005+0000","last_change":"2024-09-12T00:01:57.146814+0000","last_active":"2024-09-12T00:36:55.824005+0000","last_peered":"2024-09-12T00:36:55.824005+0000","last_clean":"2024-09-12T00:36:55.824005+0000","last_became_active":"2024-09-12T00:01:57.146320+0000","last_became_peered":"2024-09-12T00:01:57.146320+0000","last_unstale":"2024-09-12T00:36:55.824005+0000","last_undegraded":"2024-09-12T00:36:55.824005+0000","last_fullsized":"2024-09-12T00:36:55.824005+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:48.705647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6392420,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":922,"num_read_kb":6700,"num_write":1115,"num_write_kb":43058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'174","reported_seq":769,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:51.509408+0000","last_change":"2024-09-12T00:01:59.147165+0000","last_active":"2024-09-12T00:35:51.509408+0000","last_peered":"2024-09-12T00:35:51.509408+0000","last_clean":"2024-09-12T00:35:51.509408+0000","last_became_active":"2024-09-12T00:01:59.146876+0000","last_became_peered":"2024-09-12T00:01:59.146876+0000","last_unstale":"2024-09-12T00:35:51.509408+0000","last_undegraded":"2024-09-12T00:35:51.509408+0000","last_fullsized":"2024-09-12T00:35:51.509408+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:19.079900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":808,"num_read_kb":667,"num_write":271,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5901,"num_read_kb":4223,"num_write":1957,"num_write_kb":855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1029,"ondisk_log_size":1029,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":14998,"num_read_kb":14670,"num_write":16815,"num_write_kb":4907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1464,"ondisk_log_size":1464,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":547,"ondisk_log_size":547,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1805913,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":16838,"num_read_kb":32859,"num_write":14199,"num_write_kb":11356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2895872,"data_stored":2407236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2215,"ondisk_log_size":2215,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102638,"num_read_kb":85737,"num_write":37205,"num_write_kb":18751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3973,"ondisk_log_size":3973,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":500731485,"num_objects":4037,"num_object_clones":0,"num_object_copies":16148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4037,"num_whiteouts":0,"num_read":32292,"num_read_kb":1881229,"num_write":68051,"num_write_kb":2075118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":712794112,"data_stored":712794112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4117,"ondisk_log_size":4117,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":75545895,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":126,"num_read_kb":208372,"num_write":142,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139509760,"data_stored":139509031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":82551576,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":118,"num_read_kb":193338,"num_write":140,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159150080,"data_stored":159146047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509887,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":362864,"kb_used_data":147104,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94008976,"statfs":{"total":96636764160,"available":96265191424,"internally_reserved":0,"allocated":150634496,"data_stored":148649093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":220920266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509886,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232772,"kb_used_data":125300,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94139068,"statfs":{"total":96636764160,"available":96398405632,"internally_reserved":0,"allocated":128307200,"data_stored":126300199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509888,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368636,"kb_used_data":120876,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94003204,"statfs":{"total":96636764160,"available":96259280896,"internally_reserved":0,"allocated":123777024,"data_stored":121763089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509886,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356960,"kb_used_data":145296,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94014880,"statfs":{"total":96636764160,"available":96271237120,"internally_reserved":0,"allocated":148783104,"data_stored":146785909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509888,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276212,"kb_used_data":154788,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94095628,"statfs":{"total":96636764160,"available":96353923072,"internally_reserved":0,"allocated":158502912,"data_stored":156515299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124320197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509887,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263680,"kb_used_data":142320,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94108160,"statfs":{"total":96636764160,"available":96366755840,"internally_reserved":0,"allocated":145735680,"data_stored":143725067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575294,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":357676,"kb_used_data":141868,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94014164,"statfs":{"total":96636764160,"available":96270503936,"internally_reserved":0,"allocated":145272832,"data_stored":143315716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575296,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":386088,"kb_used_data":102232,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":93985752,"statfs":{"total":96636764160,"available":96241410048,"internally_reserved":0,"allocated":104685568,"data_stored":102698639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290650565},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":101195776,"data_stored":101195776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82489344,"data_stored":82489344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":122732544,"data_stored":122732544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":107925504,"data_stored":107925504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61046784,"data_stored":61046784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":79736832,"data_stored":79736832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":82853888,"data_stored":82853888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":74813440,"data_stored":74813440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":483645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":430667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":123788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":246233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":97946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":390718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":350241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":283998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30076928,"data_stored":30074353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":19972096,"data_stored":19971367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36749312,"data_stored":36748583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6340608,"data_stored":6339879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":34603008,"data_stored":34603008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:38:39.170 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:38:39.170 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:38:39.530 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:38:39.541 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T00:38:39.543 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":1364,"stamp":"2024-09-12T00:38:37.627546+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661242444,"num_objects":4425,"num_object_clones":0,"num_object_copies":16924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4425,"num_whiteouts":0,"num_read":175391,"num_read_kb":2423358,"num_write":138652,"num_write_kb":2382567,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13600,"ondisk_log_size":13600,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2604888,"kb_used_data":1079784,"kb_used_omap":12,"kb_used_meta":1524915,"kb_avail":752369832,"statfs":{"total":773094113280,"available":770426707968,"internally_reserved":0,"allocated":1105698816,"data_stored":1089753011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1561513520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-31998863,"num_objects":-369,"num_object_clones":0,"num_object_copies":-1458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-369,"num_whiteouts":0,"num_read":530,"num_read_kb":617,"num_write":436,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005642"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.383088+0000","last_change":"2024-09-12T00:27:17.580532+0000","last_active":"2024-09-12T00:34:49.383088+0000","last_peered":"2024-09-12T00:34:49.383088+0000","last_clean":"2024-09-12T00:34:49.383088+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:34:49.383088+0000","last_undegraded":"2024-09-12T00:34:49.383088+0000","last_fullsized":"2024-09-12T00:34:49.383088+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:42.988688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'10","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.315467+0000","last_change":"2024-09-12T00:17:03.214457+0000","last_active":"2024-09-12T00:38:36.315467+0000","last_peered":"2024-09-12T00:38:36.315467+0000","last_clean":"2024-09-12T00:38:36.315467+0000","last_became_active":"2024-09-12T00:17:03.213906+0000","last_became_peered":"2024-09-12T00:17:03.213906+0000","last_unstale":"2024-09-12T00:38:36.315467+0000","last_undegraded":"2024-09-12T00:38:36.315467+0000","last_fullsized":"2024-09-12T00:38:36.315467+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:43.554284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":18831,"num_write":10,"num_write_kb":11989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.498249+0000","last_change":"2024-09-12T00:17:00.182788+0000","last_active":"2024-09-12T00:34:29.498249+0000","last_peered":"2024-09-12T00:34:29.498249+0000","last_clean":"2024-09-12T00:34:29.498249+0000","last_became_active":"2024-09-12T00:17:00.182510+0000","last_became_peered":"2024-09-12T00:17:00.182510+0000","last_unstale":"2024-09-12T00:34:29.498249+0000","last_undegraded":"2024-09-12T00:34:29.498249+0000","last_fullsized":"2024-09-12T00:34:29.498249+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:10.766253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'18","reported_seq":91,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:27.517806+0000","last_change":"2024-09-12T00:15:34.415639+0000","last_active":"2024-09-12T00:36:27.517806+0000","last_peered":"2024-09-12T00:36:27.517806+0000","last_clean":"2024-09-12T00:36:27.517806+0000","last_became_active":"2024-09-12T00:15:34.415364+0000","last_became_peered":"2024-09-12T00:15:34.415364+0000","last_unstale":"2024-09-12T00:36:27.517806+0000","last_undegraded":"2024-09-12T00:36:27.517806+0000","last_fullsized":"2024-09-12T00:36:27.517806+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:04.462246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.500985+0000","last_change":"2024-09-12T00:27:17.581875+0000","last_active":"2024-09-12T00:34:49.500985+0000","last_peered":"2024-09-12T00:34:49.500985+0000","last_clean":"2024-09-12T00:34:49.500985+0000","last_became_active":"2024-09-12T00:27:17.581520+0000","last_became_peered":"2024-09-12T00:27:17.581520+0000","last_unstale":"2024-09-12T00:34:49.500985+0000","last_undegraded":"2024-09-12T00:34:49.500985+0000","last_fullsized":"2024-09-12T00:34:49.500985+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:28.315835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'1","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615836+0000","last_change":"2024-09-12T00:17:03.206913+0000","last_active":"2024-09-12T00:34:34.615836+0000","last_peered":"2024-09-12T00:34:34.615836+0000","last_clean":"2024-09-12T00:34:34.615836+0000","last_became_active":"2024-09-12T00:17:03.206566+0000","last_became_peered":"2024-09-12T00:17:03.206566+0000","last_unstale":"2024-09-12T00:34:34.615836+0000","last_undegraded":"2024-09-12T00:34:34.615836+0000","last_fullsized":"2024-09-12T00:34:34.615836+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.057828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'2","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.498577+0000","last_change":"2024-09-12T00:17:00.176346+0000","last_active":"2024-09-12T00:34:29.498577+0000","last_peered":"2024-09-12T00:34:29.498577+0000","last_clean":"2024-09-12T00:34:29.498577+0000","last_became_active":"2024-09-12T00:17:00.175196+0000","last_became_peered":"2024-09-12T00:17:00.175196+0000","last_unstale":"2024-09-12T00:34:29.498577+0000","last_undegraded":"2024-09-12T00:34:29.498577+0000","last_fullsized":"2024-09-12T00:34:29.498577+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:52.503715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"258'75","reported_seq":276,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:42.511663+0000","last_change":"2024-09-12T00:15:34.417010+0000","last_active":"2024-09-12T00:35:42.511663+0000","last_peered":"2024-09-12T00:35:42.511663+0000","last_clean":"2024-09-12T00:35:42.511663+0000","last_became_active":"2024-09-12T00:15:34.416706+0000","last_became_peered":"2024-09-12T00:15:34.416706+0000","last_unstale":"2024-09-12T00:35:42.511663+0000","last_undegraded":"2024-09-12T00:35:42.511663+0000","last_fullsized":"2024-09-12T00:35:42.511663+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:28.483679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":462,"num_read_kb":331,"num_write":93,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:31.497481+0000","last_change":"2024-09-12T00:27:17.573237+0000","last_active":"2024-09-12T00:34:31.497481+0000","last_peered":"2024-09-12T00:34:31.497481+0000","last_clean":"2024-09-12T00:34:31.497481+0000","last_became_active":"2024-09-12T00:27:17.572934+0000","last_became_peered":"2024-09-12T00:27:17.572934+0000","last_unstale":"2024-09-12T00:34:31.497481+0000","last_undegraded":"2024-09-12T00:34:31.497481+0000","last_fullsized":"2024-09-12T00:34:31.497481+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:52.238701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'2","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510306+0000","last_change":"2024-09-12T00:17:03.212082+0000","last_active":"2024-09-12T00:35:49.510306+0000","last_peered":"2024-09-12T00:35:49.510306+0000","last_clean":"2024-09-12T00:35:49.510306+0000","last_became_active":"2024-09-12T00:17:03.211755+0000","last_became_peered":"2024-09-12T00:17:03.211755+0000","last_unstale":"2024-09-12T00:35:49.510306+0000","last_undegraded":"2024-09-12T00:35:49.510306+0000","last_fullsized":"2024-09-12T00:35:49.510306+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:11.463541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503282+0000","last_change":"2024-09-12T00:17:00.181734+0000","last_active":"2024-09-12T00:35:04.503282+0000","last_peered":"2024-09-12T00:35:04.503282+0000","last_clean":"2024-09-12T00:35:04.503282+0000","last_became_active":"2024-09-12T00:17:00.181461+0000","last_became_peered":"2024-09-12T00:17:00.181461+0000","last_unstale":"2024-09-12T00:35:04.503282+0000","last_undegraded":"2024-09-12T00:35:04.503282+0000","last_fullsized":"2024-09-12T00:35:04.503282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:40.876171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'16","reported_seq":82,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:34.507625+0000","last_change":"2024-09-12T00:15:34.428333+0000","last_active":"2024-09-12T00:35:34.507625+0000","last_peered":"2024-09-12T00:35:34.507625+0000","last_clean":"2024-09-12T00:35:34.507625+0000","last_became_active":"2024-09-12T00:15:34.428023+0000","last_became_peered":"2024-09-12T00:15:34.428023+0000","last_unstale":"2024-09-12T00:35:34.507625+0000","last_undegraded":"2024-09-12T00:35:34.507625+0000","last_fullsized":"2024-09-12T00:35:34.507625+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:33.470085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499223+0000","last_change":"2024-09-12T00:27:17.577865+0000","last_active":"2024-09-12T00:34:34.499223+0000","last_peered":"2024-09-12T00:34:34.499223+0000","last_clean":"2024-09-12T00:34:34.499223+0000","last_became_active":"2024-09-12T00:27:17.577034+0000","last_became_peered":"2024-09-12T00:27:17.577034+0000","last_unstale":"2024-09-12T00:34:34.499223+0000","last_undegraded":"2024-09-12T00:34:34.499223+0000","last_fullsized":"2024-09-12T00:34:34.499223+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:24.642513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"261'2","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503652+0000","last_change":"2024-09-12T00:17:03.210262+0000","last_active":"2024-09-12T00:35:04.503652+0000","last_peered":"2024-09-12T00:35:04.503652+0000","last_clean":"2024-09-12T00:35:04.503652+0000","last_became_active":"2024-09-12T00:17:03.209945+0000","last_became_peered":"2024-09-12T00:17:03.209945+0000","last_unstale":"2024-09-12T00:35:04.503652+0000","last_undegraded":"2024-09-12T00:35:04.503652+0000","last_fullsized":"2024-09-12T00:35:04.503652+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:00.406310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:46.508609+0000","last_change":"2024-09-12T00:17:00.177502+0000","last_active":"2024-09-12T00:35:46.508609+0000","last_peered":"2024-09-12T00:35:46.508609+0000","last_clean":"2024-09-12T00:35:46.508609+0000","last_became_active":"2024-09-12T00:17:00.176151+0000","last_became_peered":"2024-09-12T00:17:00.176151+0000","last_unstale":"2024-09-12T00:35:46.508609+0000","last_undegraded":"2024-09-12T00:35:46.508609+0000","last_fullsized":"2024-09-12T00:35:46.508609+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:32.829277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'69","reported_seq":229,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.090824+0000","last_change":"2024-09-12T00:15:34.422703+0000","last_active":"2024-09-12T00:36:56.090824+0000","last_peered":"2024-09-12T00:36:56.090824+0000","last_clean":"2024-09-12T00:36:56.090824+0000","last_became_active":"2024-09-12T00:15:34.422426+0000","last_became_peered":"2024-09-12T00:15:34.422426+0000","last_unstale":"2024-09-12T00:36:56.090824+0000","last_undegraded":"2024-09-12T00:36:56.090824+0000","last_fullsized":"2024-09-12T00:36:56.090824+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:50.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":354,"num_read_kb":254,"num_write":121,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:19.505464+0000","last_change":"2024-09-12T00:27:17.579859+0000","last_active":"2024-09-12T00:35:19.505464+0000","last_peered":"2024-09-12T00:35:19.505464+0000","last_clean":"2024-09-12T00:35:19.505464+0000","last_became_active":"2024-09-12T00:27:17.579540+0000","last_became_peered":"2024-09-12T00:27:17.579540+0000","last_unstale":"2024-09-12T00:35:19.505464+0000","last_undegraded":"2024-09-12T00:35:19.505464+0000","last_fullsized":"2024-09-12T00:35:19.505464+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:23.867988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:04.377127+0000","last_change":"2024-09-12T00:17:03.220542+0000","last_active":"2024-09-12T00:34:04.377127+0000","last_peered":"2024-09-12T00:34:04.377127+0000","last_clean":"2024-09-12T00:34:04.377127+0000","last_became_active":"2024-09-12T00:17:03.218684+0000","last_became_peered":"2024-09-12T00:17:03.218684+0000","last_unstale":"2024-09-12T00:34:04.377127+0000","last_undegraded":"2024-09-12T00:34:04.377127+0000","last_fullsized":"2024-09-12T00:34:04.377127+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:18.120265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'16","reported_seq":71,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:54.493830+0000","last_change":"2024-09-12T00:17:00.186275+0000","last_active":"2024-09-12T00:33:54.493830+0000","last_peered":"2024-09-12T00:33:54.493830+0000","last_clean":"2024-09-12T00:33:54.493830+0000","last_became_active":"2024-09-12T00:17:00.185974+0000","last_became_peered":"2024-09-12T00:17:00.185974+0000","last_unstale":"2024-09-12T00:33:54.493830+0000","last_undegraded":"2024-09-12T00:33:54.493830+0000","last_fullsized":"2024-09-12T00:33:54.493830+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:40.351049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":38916,"num_write":31,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'44","reported_seq":155,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:34.507543+0000","last_change":"2024-09-12T00:15:34.423404+0000","last_active":"2024-09-12T00:35:34.507543+0000","last_peered":"2024-09-12T00:35:34.507543+0000","last_clean":"2024-09-12T00:35:34.507543+0000","last_became_active":"2024-09-12T00:15:34.423149+0000","last_became_peered":"2024-09-12T00:15:34.423149+0000","last_unstale":"2024-09-12T00:35:34.507543+0000","last_undegraded":"2024-09-12T00:35:34.507543+0000","last_fullsized":"2024-09-12T00:35:34.507543+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:23.508263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":150,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:37.510807+0000","last_change":"2024-09-12T00:27:17.575993+0000","last_active":"2024-09-12T00:35:37.510807+0000","last_peered":"2024-09-12T00:35:37.510807+0000","last_clean":"2024-09-12T00:35:37.510807+0000","last_became_active":"2024-09-12T00:27:17.575513+0000","last_became_peered":"2024-09-12T00:27:17.575513+0000","last_unstale":"2024-09-12T00:35:37.510807+0000","last_undegraded":"2024-09-12T00:35:37.510807+0000","last_fullsized":"2024-09-12T00:35:37.510807+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:31.106786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.376944+0000","last_change":"2024-09-12T00:17:03.220037+0000","last_active":"2024-09-12T00:33:59.376944+0000","last_peered":"2024-09-12T00:33:59.376944+0000","last_clean":"2024-09-12T00:33:59.376944+0000","last_became_active":"2024-09-12T00:17:03.219058+0000","last_became_peered":"2024-09-12T00:17:03.219058+0000","last_unstale":"2024-09-12T00:33:59.376944+0000","last_undegraded":"2024-09-12T00:33:59.376944+0000","last_fullsized":"2024-09-12T00:33:59.376944+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:44.822354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.377013+0000","last_change":"2024-09-12T00:17:00.183145+0000","last_active":"2024-09-12T00:33:59.377013+0000","last_peered":"2024-09-12T00:33:59.377013+0000","last_clean":"2024-09-12T00:33:59.377013+0000","last_became_active":"2024-09-12T00:17:00.182830+0000","last_became_peered":"2024-09-12T00:17:00.182830+0000","last_unstale":"2024-09-12T00:33:59.377013+0000","last_undegraded":"2024-09-12T00:33:59.377013+0000","last_fullsized":"2024-09-12T00:33:59.377013+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:04.640403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'10","reported_seq":67,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:34.625266+0000","last_change":"2024-09-12T00:15:34.421131+0000","last_active":"2024-09-12T00:35:34.625266+0000","last_peered":"2024-09-12T00:35:34.625266+0000","last_clean":"2024-09-12T00:35:34.625266+0000","last_became_active":"2024-09-12T00:15:34.420841+0000","last_became_peered":"2024-09-12T00:15:34.420841+0000","last_unstale":"2024-09-12T00:35:34.625266+0000","last_undegraded":"2024-09-12T00:35:34.625266+0000","last_fullsized":"2024-09-12T00:35:34.625266+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:18.021901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.618279+0000","last_change":"2024-09-12T00:27:17.583663+0000","last_active":"2024-09-12T00:34:49.618279+0000","last_peered":"2024-09-12T00:34:49.618279+0000","last_clean":"2024-09-12T00:34:49.618279+0000","last_became_active":"2024-09-12T00:27:17.583300+0000","last_became_peered":"2024-09-12T00:27:17.583300+0000","last_unstale":"2024-09-12T00:34:49.618279+0000","last_undegraded":"2024-09-12T00:34:49.618279+0000","last_fullsized":"2024-09-12T00:34:49.618279+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:10.632365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615804+0000","last_change":"2024-09-12T00:17:03.212176+0000","last_active":"2024-09-12T00:34:34.615804+0000","last_peered":"2024-09-12T00:34:34.615804+0000","last_clean":"2024-09-12T00:34:34.615804+0000","last_became_active":"2024-09-12T00:17:03.211869+0000","last_became_peered":"2024-09-12T00:17:03.211869+0000","last_unstale":"2024-09-12T00:34:34.615804+0000","last_undegraded":"2024-09-12T00:34:34.615804+0000","last_fullsized":"2024-09-12T00:34:34.615804+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:39.796531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.380585+0000","last_change":"2024-09-12T00:17:00.181340+0000","last_active":"2024-09-12T00:34:29.380585+0000","last_peered":"2024-09-12T00:34:29.380585+0000","last_clean":"2024-09-12T00:34:29.380585+0000","last_became_active":"2024-09-12T00:17:00.180995+0000","last_became_peered":"2024-09-12T00:17:00.180995+0000","last_unstale":"2024-09-12T00:34:29.380585+0000","last_undegraded":"2024-09-12T00:34:29.380585+0000","last_fullsized":"2024-09-12T00:34:29.380585+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:35.862245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"261'23","reported_seq":101,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.468546+0000","last_change":"2024-09-12T00:15:34.417460+0000","last_active":"2024-09-12T00:36:56.468546+0000","last_peered":"2024-09-12T00:36:56.468546+0000","last_clean":"2024-09-12T00:36:56.468546+0000","last_became_active":"2024-09-12T00:15:34.417149+0000","last_became_peered":"2024-09-12T00:15:34.417149+0000","last_unstale":"2024-09-12T00:36:56.468546+0000","last_undegraded":"2024-09-12T00:36:56.468546+0000","last_fullsized":"2024-09-12T00:36:56.468546+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:57.189731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.383151+0000","last_change":"2024-09-12T00:27:17.579098+0000","last_active":"2024-09-12T00:34:49.383151+0000","last_peered":"2024-09-12T00:34:49.383151+0000","last_clean":"2024-09-12T00:34:49.383151+0000","last_became_active":"2024-09-12T00:27:17.578739+0000","last_became_peered":"2024-09-12T00:27:17.578739+0000","last_unstale":"2024-09-12T00:34:49.383151+0000","last_undegraded":"2024-09-12T00:34:49.383151+0000","last_fullsized":"2024-09-12T00:34:49.383151+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:48.348663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'2","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498899+0000","last_change":"2024-09-12T00:17:03.213329+0000","last_active":"2024-09-12T00:34:34.498899+0000","last_peered":"2024-09-12T00:34:34.498899+0000","last_clean":"2024-09-12T00:34:34.498899+0000","last_became_active":"2024-09-12T00:17:03.213071+0000","last_became_peered":"2024-09-12T00:17:03.213071+0000","last_unstale":"2024-09-12T00:34:34.498899+0000","last_undegraded":"2024-09-12T00:34:34.498899+0000","last_fullsized":"2024-09-12T00:34:34.498899+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:46.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.497692+0000","last_change":"2024-09-12T00:17:00.178668+0000","last_active":"2024-09-12T00:34:29.497692+0000","last_peered":"2024-09-12T00:34:29.497692+0000","last_clean":"2024-09-12T00:34:29.497692+0000","last_became_active":"2024-09-12T00:17:00.178279+0000","last_became_peered":"2024-09-12T00:17:00.178279+0000","last_unstale":"2024-09-12T00:34:29.497692+0000","last_undegraded":"2024-09-12T00:34:29.497692+0000","last_fullsized":"2024-09-12T00:34:29.497692+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:59.897917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'24","reported_seq":104,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:54.501600+0000","last_change":"2024-09-12T00:15:34.420370+0000","last_active":"2024-09-12T00:34:54.501600+0000","last_peered":"2024-09-12T00:34:54.501600+0000","last_clean":"2024-09-12T00:34:54.501600+0000","last_became_active":"2024-09-12T00:15:34.420120+0000","last_became_peered":"2024-09-12T00:15:34.420120+0000","last_unstale":"2024-09-12T00:34:54.501600+0000","last_undegraded":"2024-09-12T00:34:54.501600+0000","last_fullsized":"2024-09-12T00:34:54.501600+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:10.354241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.497122+0000","last_change":"2024-09-12T00:27:17.578396+0000","last_active":"2024-09-12T00:34:19.497122+0000","last_peered":"2024-09-12T00:34:19.497122+0000","last_clean":"2024-09-12T00:34:19.497122+0000","last_became_active":"2024-09-12T00:27:17.577671+0000","last_became_peered":"2024-09-12T00:27:17.577671+0000","last_unstale":"2024-09-12T00:34:19.497122+0000","last_undegraded":"2024-09-12T00:34:19.497122+0000","last_fullsized":"2024-09-12T00:34:19.497122+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:02.287213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.494167+0000","last_change":"2024-09-12T00:17:03.214034+0000","last_active":"2024-09-12T00:33:59.494167+0000","last_peered":"2024-09-12T00:33:59.494167+0000","last_clean":"2024-09-12T00:33:59.494167+0000","last_became_active":"2024-09-12T00:17:03.213775+0000","last_became_peered":"2024-09-12T00:17:03.213775+0000","last_unstale":"2024-09-12T00:33:59.494167+0000","last_undegraded":"2024-09-12T00:33:59.494167+0000","last_fullsized":"2024-09-12T00:33:59.494167+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:03.713762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'4","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391598+0000","last_change":"2024-09-12T00:17:00.183189+0000","last_active":"2024-09-12T00:35:44.391598+0000","last_peered":"2024-09-12T00:35:44.391598+0000","last_clean":"2024-09-12T00:35:44.391598+0000","last_became_active":"2024-09-12T00:17:00.182842+0000","last_became_peered":"2024-09-12T00:17:00.182842+0000","last_unstale":"2024-09-12T00:35:44.391598+0000","last_undegraded":"2024-09-12T00:35:44.391598+0000","last_fullsized":"2024-09-12T00:35:44.391598+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:45.925037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'14","reported_seq":77,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:57.505085+0000","last_change":"2024-09-12T00:15:34.421873+0000","last_active":"2024-09-12T00:34:57.505085+0000","last_peered":"2024-09-12T00:34:57.505085+0000","last_clean":"2024-09-12T00:34:57.505085+0000","last_became_active":"2024-09-12T00:15:34.421585+0000","last_became_peered":"2024-09-12T00:15:34.421585+0000","last_unstale":"2024-09-12T00:34:57.505085+0000","last_undegraded":"2024-09-12T00:34:57.505085+0000","last_fullsized":"2024-09-12T00:34:57.505085+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:19.525663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.496362+0000","last_change":"2024-09-12T00:27:17.573564+0000","last_active":"2024-09-12T00:34:19.496362+0000","last_peered":"2024-09-12T00:34:19.496362+0000","last_clean":"2024-09-12T00:34:19.496362+0000","last_became_active":"2024-09-12T00:27:17.572899+0000","last_became_peered":"2024-09-12T00:27:17.572899+0000","last_unstale":"2024-09-12T00:34:19.496362+0000","last_undegraded":"2024-09-12T00:34:19.496362+0000","last_fullsized":"2024-09-12T00:34:19.496362+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.537722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509411+0000","last_change":"2024-09-12T00:17:03.217326+0000","last_active":"2024-09-12T00:35:44.509411+0000","last_peered":"2024-09-12T00:35:44.509411+0000","last_clean":"2024-09-12T00:35:44.509411+0000","last_became_active":"2024-09-12T00:17:03.217052+0000","last_became_peered":"2024-09-12T00:17:03.217052+0000","last_unstale":"2024-09-12T00:35:44.509411+0000","last_undegraded":"2024-09-12T00:35:44.509411+0000","last_fullsized":"2024-09-12T00:35:44.509411+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:57.870587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:54.375795+0000","last_change":"2024-09-12T00:17:00.181429+0000","last_active":"2024-09-12T00:33:54.375795+0000","last_peered":"2024-09-12T00:33:54.375795+0000","last_clean":"2024-09-12T00:33:54.375795+0000","last_became_active":"2024-09-12T00:17:00.181082+0000","last_became_peered":"2024-09-12T00:17:00.181082+0000","last_unstale":"2024-09-12T00:33:54.375795+0000","last_undegraded":"2024-09-12T00:33:54.375795+0000","last_fullsized":"2024-09-12T00:33:54.375795+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:14.637476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'32","reported_seq":127,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:57.505046+0000","last_change":"2024-09-12T00:15:34.414194+0000","last_active":"2024-09-12T00:34:57.505046+0000","last_peered":"2024-09-12T00:34:57.505046+0000","last_clean":"2024-09-12T00:34:57.505046+0000","last_became_active":"2024-09-12T00:15:34.413875+0000","last_became_peered":"2024-09-12T00:15:34.413875+0000","last_unstale":"2024-09-12T00:34:57.505046+0000","last_undegraded":"2024-09-12T00:34:57.505046+0000","last_fullsized":"2024-09-12T00:34:57.505046+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:38.268487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":63,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.613353+0000","last_change":"2024-09-12T00:27:17.577218+0000","last_active":"2024-09-12T00:34:19.613353+0000","last_peered":"2024-09-12T00:34:19.613353+0000","last_clean":"2024-09-12T00:34:19.613353+0000","last_became_active":"2024-09-12T00:27:17.576878+0000","last_became_peered":"2024-09-12T00:27:17.576878+0000","last_unstale":"2024-09-12T00:34:19.613353+0000","last_undegraded":"2024-09-12T00:34:19.613353+0000","last_fullsized":"2024-09-12T00:34:19.613353+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:47.322848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.494224+0000","last_change":"2024-09-12T00:17:03.216054+0000","last_active":"2024-09-12T00:33:59.494224+0000","last_peered":"2024-09-12T00:33:59.494224+0000","last_clean":"2024-09-12T00:33:59.494224+0000","last_became_active":"2024-09-12T00:17:03.215625+0000","last_became_peered":"2024-09-12T00:17:03.215625+0000","last_unstale":"2024-09-12T00:33:59.494224+0000","last_undegraded":"2024-09-12T00:33:59.494224+0000","last_fullsized":"2024-09-12T00:33:59.494224+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:53.227970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:54.493546+0000","last_change":"2024-09-12T00:17:00.182907+0000","last_active":"2024-09-12T00:33:54.493546+0000","last_peered":"2024-09-12T00:33:54.493546+0000","last_clean":"2024-09-12T00:33:54.493546+0000","last_became_active":"2024-09-12T00:17:00.182392+0000","last_became_peered":"2024-09-12T00:17:00.182392+0000","last_unstale":"2024-09-12T00:33:54.493546+0000","last_undegraded":"2024-09-12T00:33:54.493546+0000","last_fullsized":"2024-09-12T00:33:54.493546+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:13.824576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:54.501773+0000","last_change":"2024-09-12T00:15:34.419666+0000","last_active":"2024-09-12T00:34:54.501773+0000","last_peered":"2024-09-12T00:34:54.501773+0000","last_clean":"2024-09-12T00:34:54.501773+0000","last_became_active":"2024-09-12T00:15:34.419377+0000","last_became_peered":"2024-09-12T00:15:34.419377+0000","last_unstale":"2024-09-12T00:34:54.501773+0000","last_undegraded":"2024-09-12T00:34:54.501773+0000","last_fullsized":"2024-09-12T00:34:54.501773+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:00.834278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.379164+0000","last_change":"2024-09-12T00:27:17.580695+0000","last_active":"2024-09-12T00:34:19.379164+0000","last_peered":"2024-09-12T00:34:19.379164+0000","last_clean":"2024-09-12T00:34:19.379164+0000","last_became_active":"2024-09-12T00:27:17.580400+0000","last_became_peered":"2024-09-12T00:27:17.580400+0000","last_unstale":"2024-09-12T00:34:19.379164+0000","last_undegraded":"2024-09-12T00:34:19.379164+0000","last_fullsized":"2024-09-12T00:34:19.379164+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:32.333059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"258'5","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.376572+0000","last_change":"2024-09-12T00:17:03.224050+0000","last_active":"2024-09-12T00:33:59.376572+0000","last_peered":"2024-09-12T00:33:59.376572+0000","last_clean":"2024-09-12T00:33:59.376572+0000","last_became_active":"2024-09-12T00:17:03.223700+0000","last_became_peered":"2024-09-12T00:17:03.223700+0000","last_unstale":"2024-09-12T00:33:59.376572+0000","last_undegraded":"2024-09-12T00:33:59.376572+0000","last_fullsized":"2024-09-12T00:33:59.376572+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:20.435420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:54.493928+0000","last_change":"2024-09-12T00:17:00.170090+0000","last_active":"2024-09-12T00:33:54.493928+0000","last_peered":"2024-09-12T00:33:54.493928+0000","last_clean":"2024-09-12T00:33:54.493928+0000","last_became_active":"2024-09-12T00:17:00.169797+0000","last_became_peered":"2024-09-12T00:17:00.169797+0000","last_unstale":"2024-09-12T00:33:54.493928+0000","last_undegraded":"2024-09-12T00:33:54.493928+0000","last_fullsized":"2024-09-12T00:33:54.493928+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:21.374423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'40","reported_seq":151,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:53.994944+0000","last_change":"2024-09-12T00:15:34.422467+0000","last_active":"2024-09-12T00:36:53.994944+0000","last_peered":"2024-09-12T00:36:53.994944+0000","last_clean":"2024-09-12T00:36:53.994944+0000","last_became_active":"2024-09-12T00:15:34.422176+0000","last_became_peered":"2024-09-12T00:15:34.422176+0000","last_unstale":"2024-09-12T00:36:53.994944+0000","last_undegraded":"2024-09-12T00:36:53.994944+0000","last_fullsized":"2024-09-12T00:36:53.994944+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.956475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":149,"num_write":70,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499308+0000","last_change":"2024-09-12T00:27:17.579910+0000","last_active":"2024-09-12T00:34:34.499308+0000","last_peered":"2024-09-12T00:34:34.499308+0000","last_clean":"2024-09-12T00:34:34.499308+0000","last_became_active":"2024-09-12T00:27:17.579646+0000","last_became_peered":"2024-09-12T00:27:17.579646+0000","last_unstale":"2024-09-12T00:34:34.499308+0000","last_undegraded":"2024-09-12T00:34:34.499308+0000","last_fullsized":"2024-09-12T00:34:34.499308+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:11.016979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"261'5","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509340+0000","last_change":"2024-09-12T00:17:03.212032+0000","last_active":"2024-09-12T00:35:44.509340+0000","last_peered":"2024-09-12T00:35:44.509340+0000","last_clean":"2024-09-12T00:35:44.509340+0000","last_became_active":"2024-09-12T00:17:03.211732+0000","last_became_peered":"2024-09-12T00:17:03.211732+0000","last_unstale":"2024-09-12T00:35:44.509340+0000","last_undegraded":"2024-09-12T00:35:44.509340+0000","last_fullsized":"2024-09-12T00:35:44.509340+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:51.849541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:41.507507+0000","last_change":"2024-09-12T00:17:00.175751+0000","last_active":"2024-09-12T00:35:41.507507+0000","last_peered":"2024-09-12T00:35:41.507507+0000","last_clean":"2024-09-12T00:35:41.507507+0000","last_became_active":"2024-09-12T00:17:00.175460+0000","last_became_peered":"2024-09-12T00:17:00.175460+0000","last_unstale":"2024-09-12T00:35:41.507507+0000","last_undegraded":"2024-09-12T00:35:41.507507+0000","last_fullsized":"2024-09-12T00:35:41.507507+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:16.723140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'37","reported_seq":132,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.379113+0000","last_change":"2024-09-12T00:15:34.424716+0000","last_active":"2024-09-12T00:34:14.379113+0000","last_peered":"2024-09-12T00:34:14.379113+0000","last_clean":"2024-09-12T00:34:14.379113+0000","last_became_active":"2024-09-12T00:15:34.423734+0000","last_became_peered":"2024-09-12T00:15:34.423734+0000","last_unstale":"2024-09-12T00:34:14.379113+0000","last_undegraded":"2024-09-12T00:34:14.379113+0000","last_fullsized":"2024-09-12T00:34:14.379113+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:11.973619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":116,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498603+0000","last_change":"2024-09-12T00:27:17.574614+0000","last_active":"2024-09-12T00:34:34.498603+0000","last_peered":"2024-09-12T00:34:34.498603+0000","last_clean":"2024-09-12T00:34:34.498603+0000","last_became_active":"2024-09-12T00:27:17.574346+0000","last_became_peered":"2024-09-12T00:27:17.574346+0000","last_unstale":"2024-09-12T00:34:34.498603+0000","last_undegraded":"2024-09-12T00:34:34.498603+0000","last_fullsized":"2024-09-12T00:34:34.498603+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:58.931421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'2","reported_seq":30,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509305+0000","last_change":"2024-09-12T00:17:03.210709+0000","last_active":"2024-09-12T00:35:44.509305+0000","last_peered":"2024-09-12T00:35:44.509305+0000","last_clean":"2024-09-12T00:35:44.509305+0000","last_became_active":"2024-09-12T00:17:03.210439+0000","last_became_peered":"2024-09-12T00:17:03.210439+0000","last_unstale":"2024-09-12T00:35:44.509305+0000","last_undegraded":"2024-09-12T00:35:44.509305+0000","last_fullsized":"2024-09-12T00:35:44.509305+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:13.002169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'1","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.508520+0000","last_change":"2024-09-12T00:17:00.179628+0000","last_active":"2024-09-12T00:35:39.508520+0000","last_peered":"2024-09-12T00:35:39.508520+0000","last_clean":"2024-09-12T00:35:39.508520+0000","last_became_active":"2024-09-12T00:17:00.179337+0000","last_became_peered":"2024-09-12T00:17:00.179337+0000","last_unstale":"2024-09-12T00:35:39.508520+0000","last_undegraded":"2024-09-12T00:35:39.508520+0000","last_fullsized":"2024-09-12T00:35:39.508520+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:55.994787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'135","reported_seq":450,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.496301+0000","last_change":"2024-09-12T00:15:34.421442+0000","last_active":"2024-09-12T00:34:14.496301+0000","last_peered":"2024-09-12T00:34:14.496301+0000","last_clean":"2024-09-12T00:34:14.496301+0000","last_became_active":"2024-09-12T00:15:34.421180+0000","last_became_peered":"2024-09-12T00:15:34.421180+0000","last_unstale":"2024-09-12T00:34:14.496301+0000","last_undegraded":"2024-09-12T00:34:14.496301+0000","last_fullsized":"2024-09-12T00:34:14.496301+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:29.396389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":617,"num_write":164,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:17.499229+0000","last_change":"2024-09-12T00:27:17.575634+0000","last_active":"2024-09-12T00:34:17.499229+0000","last_peered":"2024-09-12T00:34:17.499229+0000","last_clean":"2024-09-12T00:34:17.499229+0000","last_became_active":"2024-09-12T00:27:17.575257+0000","last_became_peered":"2024-09-12T00:27:17.575257+0000","last_unstale":"2024-09-12T00:34:17.499229+0000","last_undegraded":"2024-09-12T00:34:17.499229+0000","last_fullsized":"2024-09-12T00:34:17.499229+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:49.548072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'1","reported_seq":30,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509194+0000","last_change":"2024-09-12T00:17:03.222496+0000","last_active":"2024-09-12T00:35:44.509194+0000","last_peered":"2024-09-12T00:35:44.509194+0000","last_clean":"2024-09-12T00:35:44.509194+0000","last_became_active":"2024-09-12T00:17:03.222110+0000","last_became_peered":"2024-09-12T00:17:03.222110+0000","last_unstale":"2024-09-12T00:35:44.509194+0000","last_undegraded":"2024-09-12T00:35:44.509194+0000","last_fullsized":"2024-09-12T00:35:44.509194+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:07.242934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:41.507584+0000","last_change":"2024-09-12T00:17:00.174832+0000","last_active":"2024-09-12T00:35:41.507584+0000","last_peered":"2024-09-12T00:35:41.507584+0000","last_clean":"2024-09-12T00:35:41.507584+0000","last_became_active":"2024-09-12T00:17:00.174537+0000","last_became_peered":"2024-09-12T00:17:00.174537+0000","last_unstale":"2024-09-12T00:35:41.507584+0000","last_undegraded":"2024-09-12T00:35:41.507584+0000","last_fullsized":"2024-09-12T00:35:41.507584+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:23.549160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"258'31","reported_seq":128,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.612667+0000","last_change":"2024-09-12T00:15:34.428066+0000","last_active":"2024-09-12T00:34:14.612667+0000","last_peered":"2024-09-12T00:34:14.612667+0000","last_clean":"2024-09-12T00:34:14.612667+0000","last_became_active":"2024-09-12T00:15:34.427756+0000","last_became_peered":"2024-09-12T00:15:34.427756+0000","last_unstale":"2024-09-12T00:34:14.612667+0000","last_undegraded":"2024-09-12T00:34:14.612667+0000","last_fullsized":"2024-09-12T00:34:14.612667+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:05.925579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":137,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498569+0000","last_change":"2024-09-12T00:27:17.577377+0000","last_active":"2024-09-12T00:34:34.498569+0000","last_peered":"2024-09-12T00:34:34.498569+0000","last_clean":"2024-09-12T00:34:34.498569+0000","last_became_active":"2024-09-12T00:27:17.577076+0000","last_became_peered":"2024-09-12T00:27:17.577076+0000","last_unstale":"2024-09-12T00:34:34.498569+0000","last_undegraded":"2024-09-12T00:34:34.498569+0000","last_fullsized":"2024-09-12T00:34:34.498569+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.624069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391561+0000","last_change":"2024-09-12T00:17:03.217429+0000","last_active":"2024-09-12T00:35:44.391561+0000","last_peered":"2024-09-12T00:35:44.391561+0000","last_clean":"2024-09-12T00:35:44.391561+0000","last_became_active":"2024-09-12T00:17:03.217101+0000","last_became_peered":"2024-09-12T00:17:03.217101+0000","last_unstale":"2024-09-12T00:35:44.391561+0000","last_undegraded":"2024-09-12T00:35:44.391561+0000","last_fullsized":"2024-09-12T00:35:44.391561+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:37.636780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:41.507635+0000","last_change":"2024-09-12T00:17:00.180771+0000","last_active":"2024-09-12T00:35:41.507635+0000","last_peered":"2024-09-12T00:35:41.507635+0000","last_clean":"2024-09-12T00:35:41.507635+0000","last_became_active":"2024-09-12T00:17:00.180475+0000","last_became_peered":"2024-09-12T00:17:00.180475+0000","last_unstale":"2024-09-12T00:35:41.507635+0000","last_undegraded":"2024-09-12T00:35:41.507635+0000","last_fullsized":"2024-09-12T00:35:41.507635+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:32.615984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'61","reported_seq":207,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.496260+0000","last_change":"2024-09-12T00:15:34.419120+0000","last_active":"2024-09-12T00:34:14.496260+0000","last_peered":"2024-09-12T00:34:14.496260+0000","last_clean":"2024-09-12T00:34:14.496260+0000","last_became_active":"2024-09-12T00:15:34.418831+0000","last_became_peered":"2024-09-12T00:15:34.418831+0000","last_unstale":"2024-09-12T00:34:14.496260+0000","last_undegraded":"2024-09-12T00:34:14.496260+0000","last_fullsized":"2024-09-12T00:34:14.496260+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:01.991294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":218,"num_write":105,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.511752+0000","last_change":"2024-09-12T00:27:17.579649+0000","last_active":"2024-09-12T00:35:59.511752+0000","last_peered":"2024-09-12T00:35:59.511752+0000","last_clean":"2024-09-12T00:35:59.511752+0000","last_became_active":"2024-09-12T00:27:17.579263+0000","last_became_peered":"2024-09-12T00:27:17.579263+0000","last_unstale":"2024-09-12T00:35:59.511752+0000","last_undegraded":"2024-09-12T00:35:59.511752+0000","last_fullsized":"2024-09-12T00:35:59.511752+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:10.487761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"258'2","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503243+0000","last_change":"2024-09-12T00:17:03.211987+0000","last_active":"2024-09-12T00:35:04.503243+0000","last_peered":"2024-09-12T00:35:04.503243+0000","last_clean":"2024-09-12T00:35:04.503243+0000","last_became_active":"2024-09-12T00:17:03.211582+0000","last_became_peered":"2024-09-12T00:17:03.211582+0000","last_unstale":"2024-09-12T00:35:04.503243+0000","last_undegraded":"2024-09-12T00:35:04.503243+0000","last_fullsized":"2024-09-12T00:35:04.503243+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:27.493123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"261'1","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.619883+0000","last_change":"2024-09-12T00:17:00.182834+0000","last_active":"2024-09-12T00:34:59.619883+0000","last_peered":"2024-09-12T00:34:59.619883+0000","last_clean":"2024-09-12T00:34:59.619883+0000","last_became_active":"2024-09-12T00:17:00.182477+0000","last_became_peered":"2024-09-12T00:17:00.182477+0000","last_unstale":"2024-09-12T00:34:59.619883+0000","last_undegraded":"2024-09-12T00:34:59.619883+0000","last_fullsized":"2024-09-12T00:34:59.619883+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:39.317297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"258'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.510828+0000","last_change":"2024-09-12T00:15:34.419921+0000","last_active":"2024-09-12T00:35:54.510828+0000","last_peered":"2024-09-12T00:35:54.510828+0000","last_clean":"2024-09-12T00:35:54.510828+0000","last_became_active":"2024-09-12T00:15:34.419584+0000","last_became_peered":"2024-09-12T00:15:34.419584+0000","last_unstale":"2024-09-12T00:35:54.510828+0000","last_undegraded":"2024-09-12T00:35:54.510828+0000","last_fullsized":"2024-09-12T00:35:54.510828+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:04.179967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:16.512831+0000","last_change":"2024-09-12T00:27:17.580152+0000","last_active":"2024-09-12T00:36:16.512831+0000","last_peered":"2024-09-12T00:36:16.512831+0000","last_clean":"2024-09-12T00:36:16.512831+0000","last_became_active":"2024-09-12T00:27:17.579859+0000","last_became_peered":"2024-09-12T00:27:17.579859+0000","last_unstale":"2024-09-12T00:36:16.512831+0000","last_undegraded":"2024-09-12T00:36:16.512831+0000","last_fullsized":"2024-09-12T00:36:16.512831+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:44.205082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'2","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503201+0000","last_change":"2024-09-12T00:17:03.216727+0000","last_active":"2024-09-12T00:35:04.503201+0000","last_peered":"2024-09-12T00:35:04.503201+0000","last_clean":"2024-09-12T00:35:04.503201+0000","last_became_active":"2024-09-12T00:17:03.216437+0000","last_became_peered":"2024-09-12T00:17:03.216437+0000","last_unstale":"2024-09-12T00:35:04.503201+0000","last_undegraded":"2024-09-12T00:35:04.503201+0000","last_fullsized":"2024-09-12T00:35:04.503201+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:54.699248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.502357+0000","last_change":"2024-09-12T00:17:00.179209+0000","last_active":"2024-09-12T00:34:59.502357+0000","last_peered":"2024-09-12T00:34:59.502357+0000","last_clean":"2024-09-12T00:34:59.502357+0000","last_became_active":"2024-09-12T00:17:00.178905+0000","last_became_peered":"2024-09-12T00:17:00.178905+0000","last_unstale":"2024-09-12T00:34:59.502357+0000","last_undegraded":"2024-09-12T00:34:59.502357+0000","last_fullsized":"2024-09-12T00:34:59.502357+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:09.052476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'17","reported_seq":81,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.392457+0000","last_change":"2024-09-12T00:15:34.419487+0000","last_active":"2024-09-12T00:35:49.392457+0000","last_peered":"2024-09-12T00:35:49.392457+0000","last_clean":"2024-09-12T00:35:49.392457+0000","last_became_active":"2024-09-12T00:15:34.418859+0000","last_became_peered":"2024-09-12T00:15:34.418859+0000","last_unstale":"2024-09-12T00:35:49.392457+0000","last_undegraded":"2024-09-12T00:35:49.392457+0000","last_fullsized":"2024-09-12T00:35:49.392457+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:58.036831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.393701+0000","last_change":"2024-09-12T00:27:17.579640+0000","last_active":"2024-09-12T00:35:59.393701+0000","last_peered":"2024-09-12T00:35:59.393701+0000","last_clean":"2024-09-12T00:35:59.393701+0000","last_became_active":"2024-09-12T00:27:17.577728+0000","last_became_peered":"2024-09-12T00:27:17.577728+0000","last_unstale":"2024-09-12T00:35:59.393701+0000","last_undegraded":"2024-09-12T00:35:59.393701+0000","last_fullsized":"2024-09-12T00:35:59.393701+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:51.317752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"261'10","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.504036+0000","last_change":"2024-09-12T00:17:03.215255+0000","last_active":"2024-09-12T00:35:09.504036+0000","last_peered":"2024-09-12T00:35:09.504036+0000","last_clean":"2024-09-12T00:35:09.504036+0000","last_became_active":"2024-09-12T00:17:03.214958+0000","last_became_peered":"2024-09-12T00:17:03.214958+0000","last_unstale":"2024-09-12T00:35:09.504036+0000","last_undegraded":"2024-09-12T00:35:09.504036+0000","last_fullsized":"2024-09-12T00:35:09.504036+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:24.067787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13631488,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":25,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"261'6","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.502530+0000","last_change":"2024-09-12T00:17:00.184968+0000","last_active":"2024-09-12T00:34:59.502530+0000","last_peered":"2024-09-12T00:34:59.502530+0000","last_clean":"2024-09-12T00:34:59.502530+0000","last_became_active":"2024-09-12T00:17:00.184703+0000","last_became_peered":"2024-09-12T00:17:00.184703+0000","last_unstale":"2024-09-12T00:34:59.502530+0000","last_undegraded":"2024-09-12T00:34:59.502530+0000","last_fullsized":"2024-09-12T00:34:59.502530+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:09.775190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":24576,"num_write":6,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'12","reported_seq":74,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:51.509350+0000","last_change":"2024-09-12T00:15:34.424421+0000","last_active":"2024-09-12T00:35:51.509350+0000","last_peered":"2024-09-12T00:35:51.509350+0000","last_clean":"2024-09-12T00:35:51.509350+0000","last_became_active":"2024-09-12T00:15:34.424129+0000","last_became_peered":"2024-09-12T00:15:34.424129+0000","last_unstale":"2024-09-12T00:35:51.509350+0000","last_undegraded":"2024-09-12T00:35:51.509350+0000","last_fullsized":"2024-09-12T00:35:51.509350+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:19.458965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:56.510098+0000","last_change":"2024-09-12T00:27:17.571287+0000","last_active":"2024-09-12T00:35:56.510098+0000","last_peered":"2024-09-12T00:35:56.510098+0000","last_clean":"2024-09-12T00:35:56.510098+0000","last_became_active":"2024-09-12T00:27:17.570973+0000","last_became_peered":"2024-09-12T00:27:17.570973+0000","last_unstale":"2024-09-12T00:35:56.510098+0000","last_undegraded":"2024-09-12T00:35:56.510098+0000","last_fullsized":"2024-09-12T00:35:56.510098+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:28.959152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"258'5","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503609+0000","last_change":"2024-09-12T00:17:03.221266+0000","last_active":"2024-09-12T00:35:04.503609+0000","last_peered":"2024-09-12T00:35:04.503609+0000","last_clean":"2024-09-12T00:35:04.503609+0000","last_became_active":"2024-09-12T00:17:03.220961+0000","last_became_peered":"2024-09-12T00:17:03.220961+0000","last_unstale":"2024-09-12T00:35:04.503609+0000","last_undegraded":"2024-09-12T00:35:04.503609+0000","last_fullsized":"2024-09-12T00:35:04.503609+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:28.129316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503320+0000","last_change":"2024-09-12T00:17:00.178846+0000","last_active":"2024-09-12T00:35:04.503320+0000","last_peered":"2024-09-12T00:35:04.503320+0000","last_clean":"2024-09-12T00:35:04.503320+0000","last_became_active":"2024-09-12T00:17:00.178572+0000","last_became_peered":"2024-09-12T00:17:00.178572+0000","last_unstale":"2024-09-12T00:35:04.503320+0000","last_undegraded":"2024-09-12T00:35:04.503320+0000","last_fullsized":"2024-09-12T00:35:04.503320+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:24.934660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'26","reported_seq":111,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510002+0000","last_change":"2024-09-12T00:15:34.421329+0000","last_active":"2024-09-12T00:35:49.510002+0000","last_peered":"2024-09-12T00:35:49.510002+0000","last_clean":"2024-09-12T00:35:49.510002+0000","last_became_active":"2024-09-12T00:15:34.421019+0000","last_became_peered":"2024-09-12T00:15:34.421019+0000","last_unstale":"2024-09-12T00:35:49.510002+0000","last_undegraded":"2024-09-12T00:35:49.510002+0000","last_fullsized":"2024-09-12T00:35:49.510002+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:35.834745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":93,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.514214+0000","last_change":"2024-09-12T00:27:17.581884+0000","last_active":"2024-09-12T00:36:19.514214+0000","last_peered":"2024-09-12T00:36:19.514214+0000","last_clean":"2024-09-12T00:36:19.514214+0000","last_became_active":"2024-09-12T00:27:17.579926+0000","last_became_peered":"2024-09-12T00:27:17.579926+0000","last_unstale":"2024-09-12T00:36:19.514214+0000","last_undegraded":"2024-09-12T00:36:19.514214+0000","last_fullsized":"2024-09-12T00:36:19.514214+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:28.218032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'2","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:24.380499+0000","last_change":"2024-09-12T00:17:03.219491+0000","last_active":"2024-09-12T00:34:24.380499+0000","last_peered":"2024-09-12T00:34:24.380499+0000","last_clean":"2024-09-12T00:34:24.380499+0000","last_became_active":"2024-09-12T00:17:03.219156+0000","last_became_peered":"2024-09-12T00:17:03.219156+0000","last_unstale":"2024-09-12T00:34:24.380499+0000","last_undegraded":"2024-09-12T00:34:24.380499+0000","last_fullsized":"2024-09-12T00:34:24.380499+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:35.748043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"261'1","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.496969+0000","last_change":"2024-09-12T00:17:00.182726+0000","last_active":"2024-09-12T00:34:19.496969+0000","last_peered":"2024-09-12T00:34:19.496969+0000","last_clean":"2024-09-12T00:34:19.496969+0000","last_became_active":"2024-09-12T00:17:00.182424+0000","last_became_peered":"2024-09-12T00:17:00.182424+0000","last_unstale":"2024-09-12T00:34:19.496969+0000","last_undegraded":"2024-09-12T00:34:19.496969+0000","last_fullsized":"2024-09-12T00:34:19.496969+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:44.087656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"258'17","reported_seq":89,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.509911+0000","last_change":"2024-09-12T00:15:34.423351+0000","last_active":"2024-09-12T00:35:49.509911+0000","last_peered":"2024-09-12T00:35:49.509911+0000","last_clean":"2024-09-12T00:35:49.509911+0000","last_became_active":"2024-09-12T00:15:34.423037+0000","last_became_peered":"2024-09-12T00:15:34.423037+0000","last_unstale":"2024-09-12T00:35:49.509911+0000","last_undegraded":"2024-09-12T00:35:49.509911+0000","last_fullsized":"2024-09-12T00:35:49.509911+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:11.688876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":64,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:04.611481+0000","last_change":"2024-09-12T00:27:17.583413+0000","last_active":"2024-09-12T00:34:04.611481+0000","last_peered":"2024-09-12T00:34:04.611481+0000","last_clean":"2024-09-12T00:34:04.611481+0000","last_became_active":"2024-09-12T00:27:17.583096+0000","last_became_peered":"2024-09-12T00:27:17.583096+0000","last_unstale":"2024-09-12T00:34:04.611481+0000","last_undegraded":"2024-09-12T00:34:04.611481+0000","last_fullsized":"2024-09-12T00:34:04.611481+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:05.013570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'3","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:24.614128+0000","last_change":"2024-09-12T00:17:03.214309+0000","last_active":"2024-09-12T00:34:24.614128+0000","last_peered":"2024-09-12T00:34:24.614128+0000","last_clean":"2024-09-12T00:34:24.614128+0000","last_became_active":"2024-09-12T00:17:03.214023+0000","last_became_peered":"2024-09-12T00:17:03.214023+0000","last_unstale":"2024-09-12T00:34:24.614128+0000","last_undegraded":"2024-09-12T00:34:24.614128+0000","last_fullsized":"2024-09-12T00:34:24.614128+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.420166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'2","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.497088+0000","last_change":"2024-09-12T00:17:00.178739+0000","last_active":"2024-09-12T00:34:19.497088+0000","last_peered":"2024-09-12T00:34:19.497088+0000","last_clean":"2024-09-12T00:34:19.497088+0000","last_became_active":"2024-09-12T00:17:00.178465+0000","last_became_peered":"2024-09-12T00:17:00.178465+0000","last_unstale":"2024-09-12T00:34:19.497088+0000","last_undegraded":"2024-09-12T00:34:19.497088+0000","last_fullsized":"2024-09-12T00:34:19.497088+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:08.316507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'34","reported_seq":137,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:27.839282+0000","last_change":"2024-09-12T00:15:34.425982+0000","last_active":"2024-09-12T00:36:27.839282+0000","last_peered":"2024-09-12T00:36:27.839282+0000","last_clean":"2024-09-12T00:36:27.839282+0000","last_became_active":"2024-09-12T00:15:34.425540+0000","last_became_peered":"2024-09-12T00:15:34.425540+0000","last_unstale":"2024-09-12T00:36:27.839282+0000","last_undegraded":"2024-09-12T00:36:27.839282+0000","last_fullsized":"2024-09-12T00:36:27.839282+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:11.621389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":136,"num_write":51,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.394938+0000","last_change":"2024-09-12T00:27:17.582031+0000","last_active":"2024-09-12T00:36:19.394938+0000","last_peered":"2024-09-12T00:36:19.394938+0000","last_clean":"2024-09-12T00:36:19.394938+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:36:19.394938+0000","last_undegraded":"2024-09-12T00:36:19.394938+0000","last_fullsized":"2024-09-12T00:36:19.394938+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:26.824932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503080+0000","last_change":"2024-09-12T00:17:03.212419+0000","last_active":"2024-09-12T00:35:04.503080+0000","last_peered":"2024-09-12T00:35:04.503080+0000","last_clean":"2024-09-12T00:35:04.503080+0000","last_became_active":"2024-09-12T00:17:03.212150+0000","last_became_peered":"2024-09-12T00:17:03.212150+0000","last_unstale":"2024-09-12T00:35:04.503080+0000","last_undegraded":"2024-09-12T00:35:04.503080+0000","last_fullsized":"2024-09-12T00:35:04.503080+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:25.410634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"261'7","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:24.497626+0000","last_change":"2024-09-12T00:17:00.181254+0000","last_active":"2024-09-12T00:34:24.497626+0000","last_peered":"2024-09-12T00:34:24.497626+0000","last_clean":"2024-09-12T00:34:24.497626+0000","last_became_active":"2024-09-12T00:17:00.180944+0000","last_became_peered":"2024-09-12T00:17:00.180944+0000","last_unstale":"2024-09-12T00:34:24.497626+0000","last_undegraded":"2024-09-12T00:34:24.497626+0000","last_fullsized":"2024-09-12T00:34:24.497626+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:53.637952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":6171,"num_write":12,"num_write_kb":11291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'34","reported_seq":126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.095497+0000","last_change":"2024-09-12T00:15:34.419063+0000","last_active":"2024-09-12T00:36:56.095497+0000","last_peered":"2024-09-12T00:36:56.095497+0000","last_clean":"2024-09-12T00:36:56.095497+0000","last_became_active":"2024-09-12T00:15:34.418474+0000","last_became_peered":"2024-09-12T00:15:34.418474+0000","last_unstale":"2024-09-12T00:36:56.095497+0000","last_undegraded":"2024-09-12T00:36:56.095497+0000","last_fullsized":"2024-09-12T00:36:56.095497+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:27.863297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.513761+0000","last_change":"2024-09-12T00:27:17.581423+0000","last_active":"2024-09-12T00:36:19.513761+0000","last_peered":"2024-09-12T00:36:19.513761+0000","last_clean":"2024-09-12T00:36:19.513761+0000","last_became_active":"2024-09-12T00:27:17.581149+0000","last_became_peered":"2024-09-12T00:27:17.581149+0000","last_unstale":"2024-09-12T00:36:19.513761+0000","last_undegraded":"2024-09-12T00:36:19.513761+0000","last_fullsized":"2024-09-12T00:36:19.513761+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:04.939255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.380608+0000","last_change":"2024-09-12T00:17:03.221232+0000","last_active":"2024-09-12T00:34:29.380608+0000","last_peered":"2024-09-12T00:34:29.380608+0000","last_clean":"2024-09-12T00:34:29.380608+0000","last_became_active":"2024-09-12T00:17:03.220965+0000","last_became_peered":"2024-09-12T00:17:03.220965+0000","last_unstale":"2024-09-12T00:34:29.380608+0000","last_undegraded":"2024-09-12T00:34:29.380608+0000","last_fullsized":"2024-09-12T00:34:29.380608+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:54.919281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'11","reported_seq":66,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.385612+0000","last_change":"2024-09-12T00:17:00.185880+0000","last_active":"2024-09-12T00:34:59.385612+0000","last_peered":"2024-09-12T00:34:59.385612+0000","last_clean":"2024-09-12T00:34:59.385612+0000","last_became_active":"2024-09-12T00:17:00.185600+0000","last_became_peered":"2024-09-12T00:17:00.185600+0000","last_unstale":"2024-09-12T00:34:59.385612+0000","last_undegraded":"2024-09-12T00:34:59.385612+0000","last_fullsized":"2024-09-12T00:34:59.385612+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.338622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":41662,"num_write":16,"num_write_kb":10938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'54","reported_seq":186,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:25.312227+0000","last_change":"2024-09-12T00:15:34.417774+0000","last_active":"2024-09-12T00:36:25.312227+0000","last_peered":"2024-09-12T00:36:25.312227+0000","last_clean":"2024-09-12T00:36:25.312227+0000","last_became_active":"2024-09-12T00:15:34.417393+0000","last_became_peered":"2024-09-12T00:15:34.417393+0000","last_unstale":"2024-09-12T00:36:25.312227+0000","last_undegraded":"2024-09-12T00:36:25.312227+0000","last_fullsized":"2024-09-12T00:36:25.312227+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:49.338246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":189,"num_write":107,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390022+0000","last_change":"2024-09-12T00:27:17.580912+0000","last_active":"2024-09-12T00:35:39.390022+0000","last_peered":"2024-09-12T00:35:39.390022+0000","last_clean":"2024-09-12T00:35:39.390022+0000","last_became_active":"2024-09-12T00:27:17.578983+0000","last_became_peered":"2024-09-12T00:27:17.578983+0000","last_unstale":"2024-09-12T00:35:39.390022+0000","last_undegraded":"2024-09-12T00:35:39.390022+0000","last_fullsized":"2024-09-12T00:35:39.390022+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.598333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"258'10","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510247+0000","last_change":"2024-09-12T00:17:03.210161+0000","last_active":"2024-09-12T00:35:49.510247+0000","last_peered":"2024-09-12T00:35:49.510247+0000","last_clean":"2024-09-12T00:35:49.510247+0000","last_became_active":"2024-09-12T00:17:03.209874+0000","last_became_peered":"2024-09-12T00:17:03.209874+0000","last_unstale":"2024-09-12T00:35:49.510247+0000","last_undegraded":"2024-09-12T00:35:49.510247+0000","last_fullsized":"2024-09-12T00:35:49.510247+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:07.562732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":41988,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"258'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391613+0000","last_change":"2024-09-12T00:17:00.186026+0000","last_active":"2024-09-12T00:35:44.391613+0000","last_peered":"2024-09-12T00:35:44.391613+0000","last_clean":"2024-09-12T00:35:44.391613+0000","last_became_active":"2024-09-12T00:17:00.185688+0000","last_became_peered":"2024-09-12T00:17:00.185688+0000","last_unstale":"2024-09-12T00:35:44.391613+0000","last_undegraded":"2024-09-12T00:35:44.391613+0000","last_fullsized":"2024-09-12T00:35:44.391613+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:40.682390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:15.301825+0000","last_change":"2024-09-12T00:15:34.412266+0000","last_active":"2024-09-12T00:36:15.301825+0000","last_peered":"2024-09-12T00:36:15.301825+0000","last_clean":"2024-09-12T00:36:15.301825+0000","last_became_active":"2024-09-12T00:15:34.411977+0000","last_became_peered":"2024-09-12T00:15:34.411977+0000","last_unstale":"2024-09-12T00:36:15.301825+0000","last_undegraded":"2024-09-12T00:36:15.301825+0000","last_fullsized":"2024-09-12T00:36:15.301825+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:53.336733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":161,"num_write":73,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390048+0000","last_change":"2024-09-12T00:27:17.579176+0000","last_active":"2024-09-12T00:35:39.390048+0000","last_peered":"2024-09-12T00:35:39.390048+0000","last_clean":"2024-09-12T00:35:39.390048+0000","last_became_active":"2024-09-12T00:27:17.578763+0000","last_became_peered":"2024-09-12T00:27:17.578763+0000","last_unstale":"2024-09-12T00:35:39.390048+0000","last_undegraded":"2024-09-12T00:35:39.390048+0000","last_fullsized":"2024-09-12T00:35:39.390048+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:54.867145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510203+0000","last_change":"2024-09-12T00:17:03.216611+0000","last_active":"2024-09-12T00:35:49.510203+0000","last_peered":"2024-09-12T00:35:49.510203+0000","last_clean":"2024-09-12T00:35:49.510203+0000","last_became_active":"2024-09-12T00:17:03.216349+0000","last_became_peered":"2024-09-12T00:17:03.216349+0000","last_unstale":"2024-09-12T00:35:49.510203+0000","last_undegraded":"2024-09-12T00:35:49.510203+0000","last_fullsized":"2024-09-12T00:35:49.510203+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:48.582027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:47.512361+0000","last_change":"2024-09-12T00:17:00.183051+0000","last_active":"2024-09-12T00:35:47.512361+0000","last_peered":"2024-09-12T00:35:47.512361+0000","last_clean":"2024-09-12T00:35:47.512361+0000","last_became_active":"2024-09-12T00:17:00.182780+0000","last_became_peered":"2024-09-12T00:17:00.182780+0000","last_unstale":"2024-09-12T00:35:47.512361+0000","last_undegraded":"2024-09-12T00:35:47.512361+0000","last_fullsized":"2024-09-12T00:35:47.512361+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:39.837277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'38","reported_seq":141,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.386303+0000","last_change":"2024-09-12T00:15:34.410030+0000","last_active":"2024-09-12T00:35:04.386303+0000","last_peered":"2024-09-12T00:35:04.386303+0000","last_clean":"2024-09-12T00:35:04.386303+0000","last_became_active":"2024-09-12T00:15:34.409622+0000","last_became_peered":"2024-09-12T00:15:34.409622+0000","last_unstale":"2024-09-12T00:35:04.386303+0000","last_undegraded":"2024-09-12T00:35:04.386303+0000","last_fullsized":"2024-09-12T00:35:04.386303+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:55.447920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":134,"num_write":65,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:19.505635+0000","last_change":"2024-09-12T00:27:17.582282+0000","last_active":"2024-09-12T00:35:19.505635+0000","last_peered":"2024-09-12T00:35:19.505635+0000","last_clean":"2024-09-12T00:35:19.505635+0000","last_became_active":"2024-09-12T00:27:17.581993+0000","last_became_peered":"2024-09-12T00:27:17.581993+0000","last_unstale":"2024-09-12T00:35:19.505635+0000","last_undegraded":"2024-09-12T00:35:19.505635+0000","last_fullsized":"2024-09-12T00:35:19.505635+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:14.848118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:24.379865+0000","last_change":"2024-09-12T00:17:03.220273+0000","last_active":"2024-09-12T00:34:24.379865+0000","last_peered":"2024-09-12T00:34:24.379865+0000","last_clean":"2024-09-12T00:34:24.379865+0000","last_became_active":"2024-09-12T00:17:03.219888+0000","last_became_peered":"2024-09-12T00:17:03.219888+0000","last_unstale":"2024-09-12T00:34:24.379865+0000","last_undegraded":"2024-09-12T00:34:24.379865+0000","last_fullsized":"2024-09-12T00:34:24.379865+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:38.861820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"258'3","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.613476+0000","last_change":"2024-09-12T00:17:00.170322+0000","last_active":"2024-09-12T00:34:19.613476+0000","last_peered":"2024-09-12T00:34:19.613476+0000","last_clean":"2024-09-12T00:34:19.613476+0000","last_became_active":"2024-09-12T00:17:00.169299+0000","last_became_peered":"2024-09-12T00:17:00.169299+0000","last_unstale":"2024-09-12T00:34:19.613476+0000","last_undegraded":"2024-09-12T00:34:19.613476+0000","last_fullsized":"2024-09-12T00:34:19.613476+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:43.905465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'48","reported_seq":176,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.631907+0000","last_change":"2024-09-12T00:15:34.428023+0000","last_active":"2024-09-12T00:36:24.631907+0000","last_peered":"2024-09-12T00:36:24.631907+0000","last_clean":"2024-09-12T00:36:24.631907+0000","last_became_active":"2024-09-12T00:15:34.427735+0000","last_became_peered":"2024-09-12T00:15:34.427735+0000","last_unstale":"2024-09-12T00:36:24.631907+0000","last_undegraded":"2024-09-12T00:36:24.631907+0000","last_fullsized":"2024-09-12T00:36:24.631907+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:09.348935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":182,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390825+0000","last_change":"2024-09-12T00:27:17.573147+0000","last_active":"2024-09-12T00:35:39.390825+0000","last_peered":"2024-09-12T00:35:39.390825+0000","last_clean":"2024-09-12T00:35:39.390825+0000","last_became_active":"2024-09-12T00:27:17.572817+0000","last_became_peered":"2024-09-12T00:27:17.572817+0000","last_unstale":"2024-09-12T00:35:39.390825+0000","last_undegraded":"2024-09-12T00:35:39.390825+0000","last_fullsized":"2024-09-12T00:35:39.390825+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:43.980881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"261'5","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:24.380607+0000","last_change":"2024-09-12T00:17:03.220324+0000","last_active":"2024-09-12T00:34:24.380607+0000","last_peered":"2024-09-12T00:34:24.380607+0000","last_clean":"2024-09-12T00:34:24.380607+0000","last_became_active":"2024-09-12T00:17:03.219129+0000","last_became_peered":"2024-09-12T00:17:03.219129+0000","last_unstale":"2024-09-12T00:34:24.380607+0000","last_undegraded":"2024-09-12T00:34:24.380607+0000","last_fullsized":"2024-09-12T00:34:24.380607+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:56.169527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'5","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.379929+0000","last_change":"2024-09-12T00:17:00.182941+0000","last_active":"2024-09-12T00:34:19.379929+0000","last_peered":"2024-09-12T00:34:19.379929+0000","last_clean":"2024-09-12T00:34:19.379929+0000","last_became_active":"2024-09-12T00:17:00.182301+0000","last_became_peered":"2024-09-12T00:17:00.182301+0000","last_unstale":"2024-09-12T00:34:19.379929+0000","last_undegraded":"2024-09-12T00:34:19.379929+0000","last_fullsized":"2024-09-12T00:34:19.379929+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:08.258223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'23","reported_seq":102,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.514235+0000","last_change":"2024-09-12T00:15:34.428381+0000","last_active":"2024-09-12T00:36:24.514235+0000","last_peered":"2024-09-12T00:36:24.514235+0000","last_clean":"2024-09-12T00:36:24.514235+0000","last_became_active":"2024-09-12T00:15:34.428056+0000","last_became_peered":"2024-09-12T00:15:34.428056+0000","last_unstale":"2024-09-12T00:36:24.514235+0000","last_undegraded":"2024-09-12T00:36:24.514235+0000","last_fullsized":"2024-09-12T00:36:24.514235+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:43.858120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.511476+0000","last_change":"2024-09-12T00:27:17.575634+0000","last_active":"2024-09-12T00:35:59.511476+0000","last_peered":"2024-09-12T00:35:59.511476+0000","last_clean":"2024-09-12T00:35:59.511476+0000","last_became_active":"2024-09-12T00:27:17.575332+0000","last_became_peered":"2024-09-12T00:27:17.575332+0000","last_unstale":"2024-09-12T00:35:59.511476+0000","last_undegraded":"2024-09-12T00:35:59.511476+0000","last_fullsized":"2024-09-12T00:35:59.511476+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:10.996773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"258'6","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:47.512261+0000","last_change":"2024-09-12T00:17:03.206898+0000","last_active":"2024-09-12T00:35:47.512261+0000","last_peered":"2024-09-12T00:35:47.512261+0000","last_clean":"2024-09-12T00:35:47.512261+0000","last_became_active":"2024-09-12T00:17:03.206580+0000","last_became_peered":"2024-09-12T00:17:03.206580+0000","last_unstale":"2024-09-12T00:35:47.512261+0000","last_undegraded":"2024-09-12T00:35:47.512261+0000","last_fullsized":"2024-09-12T00:35:47.512261+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:19.086717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'1","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.619797+0000","last_change":"2024-09-12T00:17:00.169805+0000","last_active":"2024-09-12T00:34:59.619797+0000","last_peered":"2024-09-12T00:34:59.619797+0000","last_clean":"2024-09-12T00:34:59.619797+0000","last_became_active":"2024-09-12T00:17:00.169464+0000","last_became_peered":"2024-09-12T00:17:00.169464+0000","last_unstale":"2024-09-12T00:34:59.619797+0000","last_undegraded":"2024-09-12T00:34:59.619797+0000","last_fullsized":"2024-09-12T00:34:59.619797+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:30.563501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'22","reported_seq":97,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.631855+0000","last_change":"2024-09-12T00:15:34.428025+0000","last_active":"2024-09-12T00:36:24.631855+0000","last_peered":"2024-09-12T00:36:24.631855+0000","last_clean":"2024-09-12T00:36:24.631855+0000","last_became_active":"2024-09-12T00:15:34.427661+0000","last_became_peered":"2024-09-12T00:15:34.427661+0000","last_unstale":"2024-09-12T00:36:24.631855+0000","last_undegraded":"2024-09-12T00:36:24.631855+0000","last_fullsized":"2024-09-12T00:36:24.631855+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:18.676590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":70,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.514020+0000","last_change":"2024-09-12T00:27:17.576241+0000","last_active":"2024-09-12T00:35:57.514020+0000","last_peered":"2024-09-12T00:35:57.514020+0000","last_clean":"2024-09-12T00:35:57.514020+0000","last_became_active":"2024-09-12T00:27:17.575941+0000","last_became_peered":"2024-09-12T00:27:17.575941+0000","last_unstale":"2024-09-12T00:35:57.514020+0000","last_undegraded":"2024-09-12T00:35:57.514020+0000","last_fullsized":"2024-09-12T00:35:57.514020+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:41.216300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'1","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.386837+0000","last_change":"2024-09-12T00:17:03.218016+0000","last_active":"2024-09-12T00:35:09.386837+0000","last_peered":"2024-09-12T00:35:09.386837+0000","last_clean":"2024-09-12T00:35:09.386837+0000","last_became_active":"2024-09-12T00:17:03.217678+0000","last_became_peered":"2024-09-12T00:17:03.217678+0000","last_unstale":"2024-09-12T00:35:09.386837+0000","last_undegraded":"2024-09-12T00:35:09.386837+0000","last_fullsized":"2024-09-12T00:35:09.386837+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:41.125288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'4","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391501+0000","last_change":"2024-09-12T00:17:00.186355+0000","last_active":"2024-09-12T00:35:44.391501+0000","last_peered":"2024-09-12T00:35:44.391501+0000","last_clean":"2024-09-12T00:35:44.391501+0000","last_became_active":"2024-09-12T00:17:00.185637+0000","last_became_peered":"2024-09-12T00:17:00.185637+0000","last_unstale":"2024-09-12T00:35:44.391501+0000","last_undegraded":"2024-09-12T00:35:44.391501+0000","last_fullsized":"2024-09-12T00:35:44.391501+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:36.584176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396562+0000","last_change":"2024-09-12T00:15:34.408975+0000","last_active":"2024-09-12T00:36:24.396562+0000","last_peered":"2024-09-12T00:36:24.396562+0000","last_clean":"2024-09-12T00:36:24.396562+0000","last_became_active":"2024-09-12T00:15:34.408612+0000","last_became_peered":"2024-09-12T00:15:34.408612+0000","last_unstale":"2024-09-12T00:36:24.396562+0000","last_undegraded":"2024-09-12T00:36:24.396562+0000","last_fullsized":"2024-09-12T00:36:24.396562+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:00.278541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":97,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.508580+0000","last_change":"2024-09-12T00:27:17.579650+0000","last_active":"2024-09-12T00:35:39.508580+0000","last_peered":"2024-09-12T00:35:39.508580+0000","last_clean":"2024-09-12T00:35:39.508580+0000","last_became_active":"2024-09-12T00:27:17.579332+0000","last_became_peered":"2024-09-12T00:27:17.579332+0000","last_unstale":"2024-09-12T00:35:39.508580+0000","last_undegraded":"2024-09-12T00:35:39.508580+0000","last_fullsized":"2024-09-12T00:35:39.508580+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:02.812642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627538+0000","last_change":"2024-09-12T00:17:03.203730+0000","last_active":"2024-09-12T00:35:49.627538+0000","last_peered":"2024-09-12T00:35:49.627538+0000","last_clean":"2024-09-12T00:35:49.627538+0000","last_became_active":"2024-09-12T00:17:03.203401+0000","last_became_peered":"2024-09-12T00:17:03.203401+0000","last_unstale":"2024-09-12T00:35:49.627538+0000","last_undegraded":"2024-09-12T00:35:49.627538+0000","last_fullsized":"2024-09-12T00:35:49.627538+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:07.999569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509116+0000","last_change":"2024-09-12T00:17:00.181373+0000","last_active":"2024-09-12T00:35:44.509116+0000","last_peered":"2024-09-12T00:35:44.509116+0000","last_clean":"2024-09-12T00:35:44.509116+0000","last_became_active":"2024-09-12T00:17:00.181095+0000","last_became_peered":"2024-09-12T00:17:00.181095+0000","last_unstale":"2024-09-12T00:35:44.509116+0000","last_undegraded":"2024-09-12T00:35:44.509116+0000","last_fullsized":"2024-09-12T00:35:44.509116+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:49.208397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'19","reported_seq":93,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396515+0000","last_change":"2024-09-12T00:15:34.421629+0000","last_active":"2024-09-12T00:36:24.396515+0000","last_peered":"2024-09-12T00:36:24.396515+0000","last_clean":"2024-09-12T00:36:24.396515+0000","last_became_active":"2024-09-12T00:15:34.420583+0000","last_became_peered":"2024-09-12T00:15:34.420583+0000","last_unstale":"2024-09-12T00:36:24.396515+0000","last_undegraded":"2024-09-12T00:36:24.396515+0000","last_fullsized":"2024-09-12T00:36:24.396515+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:19.714778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391630+0000","last_change":"2024-09-12T00:27:17.580218+0000","last_active":"2024-09-12T00:35:44.391630+0000","last_peered":"2024-09-12T00:35:44.391630+0000","last_clean":"2024-09-12T00:35:44.391630+0000","last_became_active":"2024-09-12T00:27:17.579957+0000","last_became_peered":"2024-09-12T00:27:17.579957+0000","last_unstale":"2024-09-12T00:35:44.391630+0000","last_undegraded":"2024-09-12T00:35:44.391630+0000","last_fullsized":"2024-09-12T00:35:44.391630+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:50.892944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627493+0000","last_change":"2024-09-12T00:17:03.222544+0000","last_active":"2024-09-12T00:35:49.627493+0000","last_peered":"2024-09-12T00:35:49.627493+0000","last_clean":"2024-09-12T00:35:49.627493+0000","last_became_active":"2024-09-12T00:17:03.222212+0000","last_became_peered":"2024-09-12T00:17:03.222212+0000","last_unstale":"2024-09-12T00:35:49.627493+0000","last_undegraded":"2024-09-12T00:35:49.627493+0000","last_fullsized":"2024-09-12T00:35:49.627493+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:51.034286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"258'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:46.508514+0000","last_change":"2024-09-12T00:17:00.184916+0000","last_active":"2024-09-12T00:35:46.508514+0000","last_peered":"2024-09-12T00:35:46.508514+0000","last_clean":"2024-09-12T00:35:46.508514+0000","last_became_active":"2024-09-12T00:17:00.184654+0000","last_became_peered":"2024-09-12T00:17:00.184654+0000","last_unstale":"2024-09-12T00:35:46.508514+0000","last_undegraded":"2024-09-12T00:35:46.508514+0000","last_fullsized":"2024-09-12T00:35:46.508514+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:59.225633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'33","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:55.935669+0000","last_change":"2024-09-12T00:15:34.425813+0000","last_active":"2024-09-12T00:36:55.935669+0000","last_peered":"2024-09-12T00:36:55.935669+0000","last_clean":"2024-09-12T00:36:55.935669+0000","last_became_active":"2024-09-12T00:15:34.425489+0000","last_became_peered":"2024-09-12T00:15:34.425489+0000","last_unstale":"2024-09-12T00:36:55.935669+0000","last_undegraded":"2024-09-12T00:36:55.935669+0000","last_fullsized":"2024-09-12T00:36:55.935669+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:24.112153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":114,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'272","reported_seq":915,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.758515+0000","last_change":"2024-09-12T00:01:57.152485+0000","last_active":"2024-09-12T00:36:56.758515+0000","last_peered":"2024-09-12T00:36:56.758515+0000","last_clean":"2024-09-12T00:36:56.758515+0000","last_became_active":"2024-09-12T00:01:57.152039+0000","last_became_peered":"2024-09-12T00:01:57.152039+0000","last_unstale":"2024-09-12T00:36:56.758515+0000","last_undegraded":"2024-09-12T00:36:56.758515+0000","last_fullsized":"2024-09-12T00:36:56.758515+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:46.339403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6862783,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":435,"num_read_kb":62278,"num_write":1063,"num_write_kb":40244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'78","reported_seq":659,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.458046+0000","last_change":"2024-09-12T00:01:59.156460+0000","last_active":"2024-09-12T00:37:01.458046+0000","last_peered":"2024-09-12T00:37:01.458046+0000","last_clean":"2024-09-12T00:37:01.458046+0000","last_became_active":"2024-09-12T00:01:59.156166+0000","last_became_peered":"2024-09-12T00:01:59.156166+0000","last_unstale":"2024-09-12T00:37:01.458046+0000","last_undegraded":"2024-09-12T00:37:01.458046+0000","last_fullsized":"2024-09-12T00:37:01.458046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:59.037812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":327,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'244","reported_seq":878,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:11.314967+0000","last_change":"2024-09-12T00:01:57.147898+0000","last_active":"2024-09-12T00:36:11.314967+0000","last_peered":"2024-09-12T00:36:11.314967+0000","last_clean":"2024-09-12T00:36:11.314967+0000","last_became_active":"2024-09-12T00:01:57.147519+0000","last_became_peered":"2024-09-12T00:01:57.147519+0000","last_unstale":"2024-09-12T00:36:11.314967+0000","last_undegraded":"2024-09-12T00:36:11.314967+0000","last_fullsized":"2024-09-12T00:36:11.314967+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:29.218354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23215665,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":387,"num_read_kb":64017,"num_write":932,"num_write_kb":35322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'285","reported_seq":942,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.878962+0000","last_change":"2024-09-12T00:01:59.140999+0000","last_active":"2024-09-12T00:36:58.878962+0000","last_peered":"2024-09-12T00:36:58.878962+0000","last_clean":"2024-09-12T00:36:58.878962+0000","last_became_active":"2024-09-12T00:01:59.140661+0000","last_became_peered":"2024-09-12T00:01:59.140661+0000","last_unstale":"2024-09-12T00:36:58.878962+0000","last_undegraded":"2024-09-12T00:36:58.878962+0000","last_fullsized":"2024-09-12T00:36:58.878962+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:42.180513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1344,"num_read_kb":1119,"num_write":493,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'291","reported_seq":915,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.992097+0000","last_change":"2024-09-12T00:01:57.141302+0000","last_active":"2024-09-12T00:36:58.992097+0000","last_peered":"2024-09-12T00:36:58.992097+0000","last_clean":"2024-09-12T00:36:58.992097+0000","last_became_active":"2024-09-12T00:01:57.140885+0000","last_became_peered":"2024-09-12T00:01:57.140885+0000","last_unstale":"2024-09-12T00:36:58.992097+0000","last_undegraded":"2024-09-12T00:36:58.992097+0000","last_fullsized":"2024-09-12T00:36:58.992097+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:07.324855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1047047,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":433,"num_read_kb":8971,"num_write":1057,"num_write_kb":33019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'357","reported_seq":997,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.252007+0000","last_change":"2024-09-12T00:01:59.145361+0000","last_active":"2024-09-12T00:36:59.252007+0000","last_peered":"2024-09-12T00:36:59.252007+0000","last_clean":"2024-09-12T00:36:59.252007+0000","last_became_active":"2024-09-12T00:01:59.144660+0000","last_became_peered":"2024-09-12T00:01:59.144660+0000","last_unstale":"2024-09-12T00:36:59.252007+0000","last_undegraded":"2024-09-12T00:36:59.252007+0000","last_fullsized":"2024-09-12T00:36:59.252007+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:56.723947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1585,"num_read_kb":1295,"num_write":589,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'296","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.005357+0000","last_change":"2024-09-12T00:01:57.155155+0000","last_active":"2024-09-12T00:37:07.005357+0000","last_peered":"2024-09-12T00:37:07.005357+0000","last_clean":"2024-09-12T00:37:07.005357+0000","last_became_active":"2024-09-12T00:01:57.154749+0000","last_became_peered":"2024-09-12T00:01:57.154749+0000","last_unstale":"2024-09-12T00:37:07.005357+0000","last_undegraded":"2024-09-12T00:37:07.005357+0000","last_fullsized":"2024-09-12T00:37:07.005357+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:49.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12585342,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":467,"num_read_kb":65052,"num_write":1070,"num_write_kb":38777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'303","reported_seq":925,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.238836+0000","last_change":"2024-09-12T00:01:59.147206+0000","last_active":"2024-09-12T00:37:08.238836+0000","last_peered":"2024-09-12T00:37:08.238836+0000","last_clean":"2024-09-12T00:37:08.238836+0000","last_became_active":"2024-09-12T00:01:59.146925+0000","last_became_peered":"2024-09-12T00:01:59.146925+0000","last_unstale":"2024-09-12T00:37:08.238836+0000","last_undegraded":"2024-09-12T00:37:08.238836+0000","last_fullsized":"2024-09-12T00:37:08.238836+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:07.011599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1201,"num_read_kb":972,"num_write":449,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'304","reported_seq":1040,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.889819+0000","last_change":"2024-09-12T00:01:57.151401+0000","last_active":"2024-09-12T00:37:01.889819+0000","last_peered":"2024-09-12T00:37:01.889819+0000","last_clean":"2024-09-12T00:37:01.889819+0000","last_became_active":"2024-09-12T00:01:57.151028+0000","last_became_peered":"2024-09-12T00:01:57.151028+0000","last_unstale":"2024-09-12T00:37:01.889819+0000","last_undegraded":"2024-09-12T00:37:01.889819+0000","last_fullsized":"2024-09-12T00:37:01.889819+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:42.442785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7677799,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":772,"num_read_kb":49842,"num_write":1089,"num_write_kb":22305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'253","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.591163+0000","last_change":"2024-09-12T00:01:59.150011+0000","last_active":"2024-09-12T00:38:27.591163+0000","last_peered":"2024-09-12T00:38:27.591163+0000","last_clean":"2024-09-12T00:38:27.591163+0000","last_became_active":"2024-09-12T00:01:59.149728+0000","last_became_peered":"2024-09-12T00:01:59.149728+0000","last_unstale":"2024-09-12T00:38:27.591163+0000","last_undegraded":"2024-09-12T00:38:27.591163+0000","last_fullsized":"2024-09-12T00:38:27.591163+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:46.169594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1186,"num_read_kb":981,"num_write":436,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'289","reported_seq":1031,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:21.555440+0000","last_change":"2024-09-12T00:01:57.153165+0000","last_active":"2024-09-12T00:38:21.555440+0000","last_peered":"2024-09-12T00:38:21.555440+0000","last_clean":"2024-09-12T00:38:21.555440+0000","last_became_active":"2024-09-12T00:01:57.152791+0000","last_became_peered":"2024-09-12T00:01:57.152791+0000","last_unstale":"2024-09-12T00:38:21.555440+0000","last_undegraded":"2024-09-12T00:38:21.555440+0000","last_fullsized":"2024-09-12T00:38:21.555440+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:34.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1812510,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":753,"num_read_kb":39077,"num_write":1127,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'276","reported_seq":864,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:10.033280+0000","last_change":"2024-09-12T00:01:59.151834+0000","last_active":"2024-09-12T00:36:10.033280+0000","last_peered":"2024-09-12T00:36:10.033280+0000","last_clean":"2024-09-12T00:36:10.033280+0000","last_became_active":"2024-09-12T00:01:59.151168+0000","last_became_peered":"2024-09-12T00:01:59.151168+0000","last_unstale":"2024-09-12T00:36:10.033280+0000","last_undegraded":"2024-09-12T00:36:10.033280+0000","last_fullsized":"2024-09-12T00:36:10.033280+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:07.026026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1184,"num_read_kb":963,"num_write":440,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'280","reported_seq":942,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:49.549636+0000","last_change":"2024-09-12T00:01:57.146987+0000","last_active":"2024-09-12T00:36:49.549636+0000","last_peered":"2024-09-12T00:36:49.549636+0000","last_clean":"2024-09-12T00:36:49.549636+0000","last_became_active":"2024-09-12T00:01:57.146592+0000","last_became_peered":"2024-09-12T00:01:57.146592+0000","last_unstale":"2024-09-12T00:36:49.549636+0000","last_undegraded":"2024-09-12T00:36:49.549636+0000","last_fullsized":"2024-09-12T00:36:49.549636+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:36.580016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5307031,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":486,"num_read_kb":36664,"num_write":1054,"num_write_kb":21178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'169","reported_seq":757,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.751860+0000","last_change":"2024-09-12T00:01:59.153636+0000","last_active":"2024-09-12T00:36:58.751860+0000","last_peered":"2024-09-12T00:36:58.751860+0000","last_clean":"2024-09-12T00:36:58.751860+0000","last_became_active":"2024-09-12T00:01:59.153277+0000","last_became_peered":"2024-09-12T00:01:59.153277+0000","last_unstale":"2024-09-12T00:36:58.751860+0000","last_undegraded":"2024-09-12T00:36:58.751860+0000","last_fullsized":"2024-09-12T00:36:58.751860+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:06.223418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":798,"num_read_kb":679,"num_write":291,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'288","reported_seq":901,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.720538+0000","last_change":"2024-09-12T00:01:57.152039+0000","last_active":"2024-09-12T00:37:06.720538+0000","last_peered":"2024-09-12T00:37:06.720538+0000","last_clean":"2024-09-12T00:37:06.720538+0000","last_became_active":"2024-09-12T00:01:57.151506+0000","last_became_peered":"2024-09-12T00:01:57.151506+0000","last_unstale":"2024-09-12T00:37:06.720538+0000","last_undegraded":"2024-09-12T00:37:06.720538+0000","last_fullsized":"2024-09-12T00:37:06.720538+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:02.754894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":550480,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":450,"num_read_kb":7555,"num_write":1082,"num_write_kb":27882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'125","reported_seq":711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.323304+0000","last_change":"2024-09-12T00:01:59.149439+0000","last_active":"2024-09-12T00:36:54.323304+0000","last_peered":"2024-09-12T00:36:54.323304+0000","last_clean":"2024-09-12T00:36:54.323304+0000","last_became_active":"2024-09-12T00:01:59.148098+0000","last_became_peered":"2024-09-12T00:01:59.148098+0000","last_unstale":"2024-09-12T00:36:54.323304+0000","last_undegraded":"2024-09-12T00:36:54.323304+0000","last_fullsized":"2024-09-12T00:36:54.323304+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:18.916236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":439,"num_write":182,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'114","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.963544+0000","last_change":"2024-09-12T00:01:59.148279+0000","last_active":"2024-09-12T00:36:58.963544+0000","last_peered":"2024-09-12T00:36:58.963544+0000","last_clean":"2024-09-12T00:36:58.963544+0000","last_became_active":"2024-09-12T00:01:59.148017+0000","last_became_peered":"2024-09-12T00:01:59.148017+0000","last_unstale":"2024-09-12T00:36:58.963544+0000","last_undegraded":"2024-09-12T00:36:58.963544+0000","last_fullsized":"2024-09-12T00:36:58.963544+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:15.214488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":485,"num_read_kb":395,"num_write":184,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'289","reported_seq":972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.507580+0000","last_change":"2024-09-12T00:01:57.151683+0000","last_active":"2024-09-12T00:38:36.507580+0000","last_peered":"2024-09-12T00:38:36.507580+0000","last_clean":"2024-09-12T00:38:36.507580+0000","last_became_active":"2024-09-12T00:01:57.151116+0000","last_became_peered":"2024-09-12T00:01:57.151116+0000","last_unstale":"2024-09-12T00:38:36.507580+0000","last_undegraded":"2024-09-12T00:38:36.507580+0000","last_fullsized":"2024-09-12T00:38:36.507580+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:35.763246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15090525,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":523,"num_read_kb":78307,"num_write":1124,"num_write_kb":30055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'230","reported_seq":811,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:39.381829+0000","last_change":"2024-09-12T00:01:59.152420+0000","last_active":"2024-09-12T00:34:39.381829+0000","last_peered":"2024-09-12T00:34:39.381829+0000","last_clean":"2024-09-12T00:34:39.381829+0000","last_became_active":"2024-09-12T00:01:59.152131+0000","last_became_peered":"2024-09-12T00:01:59.152131+0000","last_unstale":"2024-09-12T00:34:39.381829+0000","last_undegraded":"2024-09-12T00:34:39.381829+0000","last_fullsized":"2024-09-12T00:34:39.381829+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:35.864717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":807,"num_write":370,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'272","reported_seq":903,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.990923+0000","last_change":"2024-09-12T00:01:57.145166+0000","last_active":"2024-09-12T00:36:58.990923+0000","last_peered":"2024-09-12T00:36:58.990923+0000","last_clean":"2024-09-12T00:36:58.990923+0000","last_became_active":"2024-09-12T00:01:57.143834+0000","last_became_peered":"2024-09-12T00:01:57.143834+0000","last_unstale":"2024-09-12T00:36:58.990923+0000","last_undegraded":"2024-09-12T00:36:58.990923+0000","last_fullsized":"2024-09-12T00:36:58.990923+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:52.588497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2710,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":461,"num_read_kb":1593,"num_write":1123,"num_write_kb":15734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'430","reported_seq":1135,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.136558+0000","last_change":"2024-09-12T00:01:59.153835+0000","last_active":"2024-09-12T00:36:52.136558+0000","last_peered":"2024-09-12T00:36:52.136558+0000","last_clean":"2024-09-12T00:36:52.136558+0000","last_became_active":"2024-09-12T00:01:59.153559+0000","last_became_peered":"2024-09-12T00:01:59.153559+0000","last_unstale":"2024-09-12T00:36:52.136558+0000","last_undegraded":"2024-09-12T00:36:52.136558+0000","last_fullsized":"2024-09-12T00:36:52.136558+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:14.763454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2074,"num_read_kb":1775,"num_write":771,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'252","reported_seq":861,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:23.551844+0000","last_change":"2024-09-12T00:01:57.151910+0000","last_active":"2024-09-12T00:38:23.551844+0000","last_peered":"2024-09-12T00:38:23.551844+0000","last_clean":"2024-09-12T00:38:23.551844+0000","last_became_active":"2024-09-12T00:01:57.150789+0000","last_became_peered":"2024-09-12T00:01:57.150789+0000","last_unstale":"2024-09-12T00:38:23.551844+0000","last_undegraded":"2024-09-12T00:38:23.551844+0000","last_fullsized":"2024-09-12T00:38:23.551844+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:08.148314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2191305,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":374,"num_read_kb":13160,"num_write":898,"num_write_kb":19470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'149","reported_seq":772,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.747639+0000","last_change":"2024-09-12T00:01:59.149460+0000","last_active":"2024-09-12T00:36:50.747639+0000","last_peered":"2024-09-12T00:36:50.747639+0000","last_clean":"2024-09-12T00:36:50.747639+0000","last_became_active":"2024-09-12T00:01:59.149195+0000","last_became_peered":"2024-09-12T00:01:59.149195+0000","last_unstale":"2024-09-12T00:36:50.747639+0000","last_undegraded":"2024-09-12T00:36:50.747639+0000","last_fullsized":"2024-09-12T00:36:50.747639+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:43.524528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":604,"num_write":216,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'291","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.622977+0000","last_change":"2024-09-12T00:01:57.158820+0000","last_active":"2024-09-12T00:37:21.622977+0000","last_peered":"2024-09-12T00:37:21.622977+0000","last_clean":"2024-09-12T00:37:21.622977+0000","last_became_active":"2024-09-12T00:01:57.157877+0000","last_became_peered":"2024-09-12T00:01:57.157877+0000","last_unstale":"2024-09-12T00:37:21.622977+0000","last_undegraded":"2024-09-12T00:37:21.622977+0000","last_fullsized":"2024-09-12T00:37:21.622977+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:52.712462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14341133,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":451,"num_read_kb":26576,"num_write":1041,"num_write_kb":46689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'164","reported_seq":755,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.250417+0000","last_change":"2024-09-12T00:01:59.159547+0000","last_active":"2024-09-12T00:37:02.250417+0000","last_peered":"2024-09-12T00:37:02.250417+0000","last_clean":"2024-09-12T00:37:02.250417+0000","last_became_active":"2024-09-12T00:01:59.159215+0000","last_became_peered":"2024-09-12T00:01:59.159215+0000","last_unstale":"2024-09-12T00:37:02.250417+0000","last_undegraded":"2024-09-12T00:37:02.250417+0000","last_fullsized":"2024-09-12T00:37:02.250417+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:31.759927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":584,"num_write":229,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'230","reported_seq":867,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.421114+0000","last_change":"2024-09-12T00:02:32.844919+0000","last_active":"2024-09-12T00:37:21.421114+0000","last_peered":"2024-09-12T00:37:21.421114+0000","last_clean":"2024-09-12T00:37:21.421114+0000","last_became_active":"2024-09-12T00:02:32.844466+0000","last_became_peered":"2024-09-12T00:02:32.844466+0000","last_unstale":"2024-09-12T00:37:21.421114+0000","last_undegraded":"2024-09-12T00:37:21.421114+0000","last_fullsized":"2024-09-12T00:37:21.421114+0000","mapping_epoch":37,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:09.241156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12118951,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":429,"num_read_kb":38682,"num_write":973,"num_write_kb":28786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'136","reported_seq":724,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.061425+0000","last_change":"2024-09-12T00:01:59.156382+0000","last_active":"2024-09-12T00:37:23.061425+0000","last_peered":"2024-09-12T00:37:23.061425+0000","last_clean":"2024-09-12T00:37:23.061425+0000","last_became_active":"2024-09-12T00:01:59.156058+0000","last_became_peered":"2024-09-12T00:01:59.156058+0000","last_unstale":"2024-09-12T00:37:23.061425+0000","last_undegraded":"2024-09-12T00:37:23.061425+0000","last_fullsized":"2024-09-12T00:37:23.061425+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:10.726145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":582,"num_read_kb":485,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'328","reported_seq":943,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:23.252947+0000","last_change":"2024-09-12T00:01:57.137262+0000","last_active":"2024-09-12T00:36:23.252947+0000","last_peered":"2024-09-12T00:36:23.252947+0000","last_clean":"2024-09-12T00:36:23.252947+0000","last_became_active":"2024-09-12T00:01:57.136872+0000","last_became_peered":"2024-09-12T00:01:57.136872+0000","last_unstale":"2024-09-12T00:36:23.252947+0000","last_undegraded":"2024-09-12T00:36:23.252947+0000","last_fullsized":"2024-09-12T00:36:23.252947+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:32.662213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8171851,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":434,"num_read_kb":28039,"num_write":1218,"num_write_kb":53988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'147","reported_seq":642,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.514493+0000","last_change":"2024-09-12T00:02:07.159622+0000","last_active":"2024-09-12T00:37:23.514493+0000","last_peered":"2024-09-12T00:37:23.514493+0000","last_clean":"2024-09-12T00:37:23.514493+0000","last_became_active":"2024-09-12T00:02:07.159308+0000","last_became_peered":"2024-09-12T00:02:07.159308+0000","last_unstale":"2024-09-12T00:37:23.514493+0000","last_undegraded":"2024-09-12T00:37:23.514493+0000","last_fullsized":"2024-09-12T00:37:23.514493+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:23.798981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'123","reported_seq":707,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.287204+0000","last_change":"2024-09-12T00:01:59.152275+0000","last_active":"2024-09-12T00:36:50.287204+0000","last_peered":"2024-09-12T00:36:50.287204+0000","last_clean":"2024-09-12T00:36:50.287204+0000","last_became_active":"2024-09-12T00:01:59.151773+0000","last_became_peered":"2024-09-12T00:01:59.151773+0000","last_unstale":"2024-09-12T00:36:50.287204+0000","last_undegraded":"2024-09-12T00:36:50.287204+0000","last_fullsized":"2024-09-12T00:36:50.287204+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:11.927074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":478,"num_write":204,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'261","reported_seq":948,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.888399+0000","last_change":"2024-09-12T00:01:57.166828+0000","last_active":"2024-09-12T00:37:01.888399+0000","last_peered":"2024-09-12T00:37:01.888399+0000","last_clean":"2024-09-12T00:37:01.888399+0000","last_became_active":"2024-09-12T00:01:57.165987+0000","last_became_peered":"2024-09-12T00:01:57.165987+0000","last_unstale":"2024-09-12T00:37:01.888399+0000","last_undegraded":"2024-09-12T00:37:01.888399+0000","last_fullsized":"2024-09-12T00:37:01.888399+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:40.754997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5864980,"num_objects":86,"num_object_clones":0,"num_object_copies":344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":524,"num_read_kb":32539,"num_write":898,"num_write_kb":21474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.393143+0000","last_change":"2024-09-12T00:02:01.154807+0000","last_active":"2024-09-12T00:35:54.393143+0000","last_peered":"2024-09-12T00:35:54.393143+0000","last_clean":"2024-09-12T00:35:54.393143+0000","last_became_active":"2024-09-12T00:02:01.154464+0000","last_became_peered":"2024-09-12T00:02:01.154464+0000","last_unstale":"2024-09-12T00:35:54.393143+0000","last_undegraded":"2024-09-12T00:35:54.393143+0000","last_fullsized":"2024-09-12T00:35:54.393143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.047642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'356","reported_seq":955,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.920759+0000","last_change":"2024-09-12T00:02:03.156471+0000","last_active":"2024-09-12T00:38:28.920759+0000","last_peered":"2024-09-12T00:38:28.920759+0000","last_clean":"2024-09-12T00:38:28.920759+0000","last_became_active":"2024-09-12T00:02:03.156175+0000","last_became_peered":"2024-09-12T00:02:03.156175+0000","last_unstale":"2024-09-12T00:38:28.920759+0000","last_undegraded":"2024-09-12T00:38:28.920759+0000","last_fullsized":"2024-09-12T00:38:28.920759+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:33.670259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66861,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":571,"num_read_kb":1114,"num_write":466,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:56.510205+0000","last_change":"2024-09-12T00:02:05.165724+0000","last_active":"2024-09-12T00:35:56.510205+0000","last_peered":"2024-09-12T00:35:56.510205+0000","last_clean":"2024-09-12T00:35:56.510205+0000","last_became_active":"2024-09-12T00:02:05.165424+0000","last_became_peered":"2024-09-12T00:02:05.165424+0000","last_unstale":"2024-09-12T00:35:56.510205+0000","last_undegraded":"2024-09-12T00:35:56.510205+0000","last_fullsized":"2024-09-12T00:35:56.510205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:38.859922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'129","reported_seq":679,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.108575+0000","last_change":"2024-09-12T00:02:07.175107+0000","last_active":"2024-09-12T00:37:21.108575+0000","last_peered":"2024-09-12T00:37:21.108575+0000","last_clean":"2024-09-12T00:37:21.108575+0000","last_became_active":"2024-09-12T00:02:07.174795+0000","last_became_peered":"2024-09-12T00:02:07.174795+0000","last_unstale":"2024-09-12T00:37:21.108575+0000","last_undegraded":"2024-09-12T00:37:21.108575+0000","last_fullsized":"2024-09-12T00:37:21.108575+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.332589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":239,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'75","reported_seq":622,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.555629+0000","last_change":"2024-09-12T00:01:59.146503+0000","last_active":"2024-09-12T00:37:08.555629+0000","last_peered":"2024-09-12T00:37:08.555629+0000","last_clean":"2024-09-12T00:37:08.555629+0000","last_became_active":"2024-09-12T00:01:59.145411+0000","last_became_peered":"2024-09-12T00:01:59.145411+0000","last_unstale":"2024-09-12T00:37:08.555629+0000","last_undegraded":"2024-09-12T00:37:08.555629+0000","last_fullsized":"2024-09-12T00:37:08.555629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:33.082390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":104,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'300","reported_seq":944,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:23.003179+0000","last_change":"2024-09-12T00:01:57.147335+0000","last_active":"2024-09-12T00:38:23.003179+0000","last_peered":"2024-09-12T00:38:23.003179+0000","last_clean":"2024-09-12T00:38:23.003179+0000","last_became_active":"2024-09-12T00:01:57.146952+0000","last_became_peered":"2024-09-12T00:01:57.146952+0000","last_unstale":"2024-09-12T00:38:23.003179+0000","last_undegraded":"2024-09-12T00:38:23.003179+0000","last_fullsized":"2024-09-12T00:38:23.003179+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:11.335615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17404174,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":487,"num_read_kb":41499,"num_write":1191,"num_write_kb":32474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:47.503501+0000","last_change":"2024-09-12T00:02:01.156228+0000","last_active":"2024-09-12T00:34:47.503501+0000","last_peered":"2024-09-12T00:34:47.503501+0000","last_clean":"2024-09-12T00:34:47.503501+0000","last_became_active":"2024-09-12T00:02:01.155948+0000","last_became_peered":"2024-09-12T00:02:01.155948+0000","last_unstale":"2024-09-12T00:34:47.503501+0000","last_undegraded":"2024-09-12T00:34:47.503501+0000","last_fullsized":"2024-09-12T00:34:47.503501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:34.073281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'81","reported_seq":596,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:51.124923+0000","last_change":"2024-09-12T00:02:03.152995+0000","last_active":"2024-09-12T00:36:51.124923+0000","last_peered":"2024-09-12T00:36:51.124923+0000","last_clean":"2024-09-12T00:36:51.124923+0000","last_became_active":"2024-09-12T00:02:03.152708+0000","last_became_peered":"2024-09-12T00:02:03.152708+0000","last_unstale":"2024-09-12T00:36:51.124923+0000","last_undegraded":"2024-09-12T00:36:51.124923+0000","last_fullsized":"2024-09-12T00:36:51.124923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:00.923044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":85,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:56.510160+0000","last_change":"2024-09-12T00:02:05.163074+0000","last_active":"2024-09-12T00:35:56.510160+0000","last_peered":"2024-09-12T00:35:56.510160+0000","last_clean":"2024-09-12T00:35:56.510160+0000","last_became_active":"2024-09-12T00:02:05.162755+0000","last_became_peered":"2024-09-12T00:02:05.162755+0000","last_unstale":"2024-09-12T00:35:56.510160+0000","last_undegraded":"2024-09-12T00:35:56.510160+0000","last_fullsized":"2024-09-12T00:35:56.510160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:20.807313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'133","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.520320+0000","last_change":"2024-09-12T00:02:07.168207+0000","last_active":"2024-09-12T00:37:09.520320+0000","last_peered":"2024-09-12T00:37:09.520320+0000","last_clean":"2024-09-12T00:37:09.520320+0000","last_became_active":"2024-09-12T00:02:07.167851+0000","last_became_peered":"2024-09-12T00:02:07.167851+0000","last_unstale":"2024-09-12T00:37:09.520320+0000","last_undegraded":"2024-09-12T00:37:09.520320+0000","last_fullsized":"2024-09-12T00:37:09.520320+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:11.325627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":137,"num_write":333,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'4128","reported_seq":4726,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510282+0000","last_change":"2024-09-12T00:01:59.151349+0000","last_active":"2024-09-12T00:35:49.510282+0000","last_peered":"2024-09-12T00:35:49.510282+0000","last_clean":"2024-09-12T00:35:49.510282+0000","last_became_active":"2024-09-12T00:01:59.151026+0000","last_became_peered":"2024-09-12T00:01:59.151026+0000","last_unstale":"2024-09-12T00:35:49.510282+0000","last_undegraded":"2024-09-12T00:35:49.510282+0000","last_fullsized":"2024-09-12T00:35:49.510282+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":3000,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:16.187111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16602,"num_read_kb":13937,"num_write":6188,"num_write_kb":3085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'240","reported_seq":939,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.804729+0000","last_change":"2024-09-12T00:01:57.144752+0000","last_active":"2024-09-12T00:37:10.804729+0000","last_peered":"2024-09-12T00:37:10.804729+0000","last_clean":"2024-09-12T00:37:10.804729+0000","last_became_active":"2024-09-12T00:01:57.144269+0000","last_became_peered":"2024-09-12T00:01:57.144269+0000","last_unstale":"2024-09-12T00:37:10.804729+0000","last_undegraded":"2024-09-12T00:37:10.804729+0000","last_fullsized":"2024-09-12T00:37:10.804729+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:54.481149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":728542,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":647,"num_read_kb":1796,"num_write":865,"num_write_kb":33986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:52.513137+0000","last_change":"2024-09-12T00:02:01.155683+0000","last_active":"2024-09-12T00:35:52.513137+0000","last_peered":"2024-09-12T00:35:52.513137+0000","last_clean":"2024-09-12T00:35:52.513137+0000","last_became_active":"2024-09-12T00:02:01.155425+0000","last_became_peered":"2024-09-12T00:02:01.155425+0000","last_unstale":"2024-09-12T00:35:52.513137+0000","last_undegraded":"2024-09-12T00:35:52.513137+0000","last_fullsized":"2024-09-12T00:35:52.513137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:38.140909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'103","reported_seq":636,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.325100+0000","last_change":"2024-09-12T00:02:03.152143+0000","last_active":"2024-09-12T00:36:54.325100+0000","last_peered":"2024-09-12T00:36:54.325100+0000","last_clean":"2024-09-12T00:36:54.325100+0000","last_became_active":"2024-09-12T00:02:03.151839+0000","last_became_peered":"2024-09-12T00:02:03.151839+0000","last_unstale":"2024-09-12T00:36:54.325100+0000","last_undegraded":"2024-09-12T00:36:54.325100+0000","last_fullsized":"2024-09-12T00:36:54.325100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:56.820811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'751","reported_seq":2039,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.954004+0000","last_change":"2024-09-12T00:02:05.167777+0000","last_active":"2024-09-12T00:38:28.954004+0000","last_peered":"2024-09-12T00:38:28.954004+0000","last_clean":"2024-09-12T00:38:28.954004+0000","last_became_active":"2024-09-12T00:02:05.166985+0000","last_became_peered":"2024-09-12T00:02:05.166985+0000","last_unstale":"2024-09-12T00:38:28.954004+0000","last_undegraded":"2024-09-12T00:38:28.954004+0000","last_fullsized":"2024-09-12T00:38:28.954004+0000","mapping_epoch":32,"log_start":"261'701","ondisk_log_start":"261'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":701,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:46.965686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'217","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.117831+0000","last_change":"2024-09-12T00:02:07.167855+0000","last_active":"2024-09-12T00:37:23.117831+0000","last_peered":"2024-09-12T00:37:23.117831+0000","last_clean":"2024-09-12T00:37:23.117831+0000","last_became_active":"2024-09-12T00:02:07.167576+0000","last_became_peered":"2024-09-12T00:02:07.167576+0000","last_unstale":"2024-09-12T00:37:23.117831+0000","last_undegraded":"2024-09-12T00:37:23.117831+0000","last_fullsized":"2024-09-12T00:37:23.117831+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:16.693441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":605,"num_read_kb":603,"num_write":488,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'58","reported_seq":609,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:22.120801+0000","last_change":"2024-09-12T00:01:59.149396+0000","last_active":"2024-09-12T00:36:22.120801+0000","last_peered":"2024-09-12T00:36:22.120801+0000","last_clean":"2024-09-12T00:36:22.120801+0000","last_became_active":"2024-09-12T00:01:59.149087+0000","last_became_peered":"2024-09-12T00:01:59.149087+0000","last_unstale":"2024-09-12T00:36:22.120801+0000","last_undegraded":"2024-09-12T00:36:22.120801+0000","last_fullsized":"2024-09-12T00:36:22.120801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:13.031884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":233,"num_write":78,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'305","reported_seq":1002,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.507120+0000","last_change":"2024-09-12T00:01:57.153276+0000","last_active":"2024-09-12T00:38:36.507120+0000","last_peered":"2024-09-12T00:38:36.507120+0000","last_clean":"2024-09-12T00:38:36.507120+0000","last_became_active":"2024-09-12T00:01:57.152332+0000","last_became_peered":"2024-09-12T00:01:57.152332+0000","last_unstale":"2024-09-12T00:38:36.507120+0000","last_undegraded":"2024-09-12T00:38:36.507120+0000","last_fullsized":"2024-09-12T00:38:36.507120+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:07.357627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8905738,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":607,"num_read_kb":43786,"num_write":1133,"num_write_kb":39072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.393180+0000","last_change":"2024-09-12T00:02:01.154452+0000","last_active":"2024-09-12T00:35:54.393180+0000","last_peered":"2024-09-12T00:35:54.393180+0000","last_clean":"2024-09-12T00:35:54.393180+0000","last_became_active":"2024-09-12T00:02:01.154110+0000","last_became_peered":"2024-09-12T00:02:01.154110+0000","last_unstale":"2024-09-12T00:35:54.393180+0000","last_undegraded":"2024-09-12T00:35:54.393180+0000","last_fullsized":"2024-09-12T00:35:54.393180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:04.241524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'252","reported_seq":799,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:19.529625+0000","last_change":"2024-09-12T00:02:03.146008+0000","last_active":"2024-09-12T00:38:19.529625+0000","last_peered":"2024-09-12T00:38:19.529625+0000","last_clean":"2024-09-12T00:38:19.529625+0000","last_became_active":"2024-09-12T00:02:03.145673+0000","last_became_peered":"2024-09-12T00:02:03.145673+0000","last_unstale":"2024-09-12T00:38:19.529625+0000","last_undegraded":"2024-09-12T00:38:19.529625+0000","last_fullsized":"2024-09-12T00:38:19.529625+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:24.216453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51035,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":413,"num_read_kb":852,"num_write":342,"num_write_kb":269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'777","reported_seq":2149,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.958358+0000","last_change":"2024-09-12T00:02:05.165636+0000","last_active":"2024-09-12T00:38:28.958358+0000","last_peered":"2024-09-12T00:38:28.958358+0000","last_clean":"2024-09-12T00:38:28.958358+0000","last_became_active":"2024-09-12T00:02:05.165283+0000","last_became_peered":"2024-09-12T00:02:05.165283+0000","last_unstale":"2024-09-12T00:38:28.958358+0000","last_undegraded":"2024-09-12T00:38:28.958358+0000","last_fullsized":"2024-09-12T00:38:28.958358+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:20.861078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'107","reported_seq":676,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:17.644092+0000","last_change":"2024-09-12T00:01:59.154031+0000","last_active":"2024-09-12T00:36:17.644092+0000","last_peered":"2024-09-12T00:36:17.644092+0000","last_clean":"2024-09-12T00:36:17.644092+0000","last_became_active":"2024-09-12T00:01:59.153704+0000","last_became_peered":"2024-09-12T00:01:59.153704+0000","last_unstale":"2024-09-12T00:36:17.644092+0000","last_undegraded":"2024-09-12T00:36:17.644092+0000","last_fullsized":"2024-09-12T00:36:17.644092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:25.468551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":389,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'278","reported_seq":917,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.568253+0000","last_change":"2024-09-12T00:01:57.155999+0000","last_active":"2024-09-12T00:37:10.568253+0000","last_peered":"2024-09-12T00:37:10.568253+0000","last_clean":"2024-09-12T00:37:10.568253+0000","last_became_active":"2024-09-12T00:01:57.154222+0000","last_became_peered":"2024-09-12T00:01:57.154222+0000","last_unstale":"2024-09-12T00:37:10.568253+0000","last_undegraded":"2024-09-12T00:37:10.568253+0000","last_fullsized":"2024-09-12T00:37:10.568253+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:34.043715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11402269,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":450,"num_read_kb":40357,"num_write":1089,"num_write_kb":32511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:31.497551+0000","last_change":"2024-09-12T00:02:01.144820+0000","last_active":"2024-09-12T00:34:31.497551+0000","last_peered":"2024-09-12T00:34:31.497551+0000","last_clean":"2024-09-12T00:34:31.497551+0000","last_became_active":"2024-09-12T00:02:01.144531+0000","last_became_peered":"2024-09-12T00:02:01.144531+0000","last_unstale":"2024-09-12T00:34:31.497551+0000","last_undegraded":"2024-09-12T00:34:31.497551+0000","last_fullsized":"2024-09-12T00:34:31.497551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:47.902602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'366","reported_seq":963,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.399693+0000","last_change":"2024-09-12T00:02:03.155592+0000","last_active":"2024-09-12T00:36:54.399693+0000","last_peered":"2024-09-12T00:36:54.399693+0000","last_clean":"2024-09-12T00:36:54.399693+0000","last_became_active":"2024-09-12T00:02:03.155293+0000","last_became_peered":"2024-09-12T00:02:03.155293+0000","last_unstale":"2024-09-12T00:36:54.399693+0000","last_undegraded":"2024-09-12T00:36:54.399693+0000","last_fullsized":"2024-09-12T00:36:54.399693+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:29.029401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62749,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":1121,"num_write":476,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.509941+0000","last_change":"2024-09-12T00:02:05.168024+0000","last_active":"2024-09-12T00:35:49.509941+0000","last_peered":"2024-09-12T00:35:49.509941+0000","last_clean":"2024-09-12T00:35:49.509941+0000","last_became_active":"2024-09-12T00:02:05.167762+0000","last_became_peered":"2024-09-12T00:02:05.167762+0000","last_unstale":"2024-09-12T00:35:49.509941+0000","last_undegraded":"2024-09-12T00:35:49.509941+0000","last_fullsized":"2024-09-12T00:35:49.509941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:56.207387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'546","reported_seq":1342,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.940888+0000","last_change":"2024-09-12T00:02:07.172418+0000","last_active":"2024-09-12T00:38:28.940888+0000","last_peered":"2024-09-12T00:38:28.940888+0000","last_clean":"2024-09-12T00:38:28.940888+0000","last_became_active":"2024-09-12T00:02:07.172005+0000","last_became_peered":"2024-09-12T00:02:07.172005+0000","last_unstale":"2024-09-12T00:38:28.940888+0000","last_undegraded":"2024-09-12T00:38:28.940888+0000","last_fullsized":"2024-09-12T00:38:28.940888+0000","mapping_epoch":34,"log_start":"261'500","ondisk_log_start":"261'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:59.842808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1294,"num_read_kb":1285,"num_write":1129,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'119","reported_seq":688,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:49.065624+0000","last_change":"2024-09-12T00:01:59.152065+0000","last_active":"2024-09-12T00:36:49.065624+0000","last_peered":"2024-09-12T00:36:49.065624+0000","last_clean":"2024-09-12T00:36:49.065624+0000","last_became_active":"2024-09-12T00:01:59.151782+0000","last_became_peered":"2024-09-12T00:01:59.151782+0000","last_unstale":"2024-09-12T00:36:49.065624+0000","last_undegraded":"2024-09-12T00:36:49.065624+0000","last_fullsized":"2024-09-12T00:36:49.065624+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:29.853489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":439,"num_write":192,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'246","reported_seq":855,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.553989+0000","last_change":"2024-09-12T00:01:57.157778+0000","last_active":"2024-09-12T00:37:07.553989+0000","last_peered":"2024-09-12T00:37:07.553989+0000","last_clean":"2024-09-12T00:37:07.553989+0000","last_became_active":"2024-09-12T00:01:57.157370+0000","last_became_peered":"2024-09-12T00:01:57.157370+0000","last_unstale":"2024-09-12T00:37:07.553989+0000","last_undegraded":"2024-09-12T00:37:07.553989+0000","last_fullsized":"2024-09-12T00:37:07.553989+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:25.879830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":654605,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":382,"num_read_kb":3842,"num_write":909,"num_write_kb":16793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498474+0000","last_change":"2024-09-12T00:02:01.152227+0000","last_active":"2024-09-12T00:34:34.498474+0000","last_peered":"2024-09-12T00:34:34.498474+0000","last_clean":"2024-09-12T00:34:34.498474+0000","last_became_active":"2024-09-12T00:02:01.151914+0000","last_became_peered":"2024-09-12T00:02:01.151914+0000","last_unstale":"2024-09-12T00:34:34.498474+0000","last_undegraded":"2024-09-12T00:34:34.498474+0000","last_fullsized":"2024-09-12T00:34:34.498474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:15.461722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'276","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.700469+0000","last_change":"2024-09-12T00:02:03.155128+0000","last_active":"2024-09-12T00:38:36.700469+0000","last_peered":"2024-09-12T00:38:36.700469+0000","last_clean":"2024-09-12T00:38:36.700469+0000","last_became_active":"2024-09-12T00:02:03.154819+0000","last_became_peered":"2024-09-12T00:02:03.154819+0000","last_unstale":"2024-09-12T00:38:36.700469+0000","last_undegraded":"2024-09-12T00:38:36.700469+0000","last_fullsized":"2024-09-12T00:38:36.700469+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:47.375234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":1012,"num_write":362,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:42.502604+0000","last_change":"2024-09-12T00:02:05.168924+0000","last_active":"2024-09-12T00:34:42.502604+0000","last_peered":"2024-09-12T00:34:42.502604+0000","last_clean":"2024-09-12T00:34:42.502604+0000","last_became_active":"2024-09-12T00:02:05.168649+0000","last_became_peered":"2024-09-12T00:02:05.168649+0000","last_unstale":"2024-09-12T00:34:42.502604+0000","last_undegraded":"2024-09-12T00:34:42.502604+0000","last_fullsized":"2024-09-12T00:34:42.502604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:59.645822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2367","reported_seq":4178,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:10.204589+0000","last_change":"2024-09-12T00:02:07.175086+0000","last_active":"2024-09-12T00:38:10.204589+0000","last_peered":"2024-09-12T00:38:10.204589+0000","last_clean":"2024-09-12T00:38:10.204589+0000","last_became_active":"2024-09-12T00:02:07.174769+0000","last_became_peered":"2024-09-12T00:02:07.174769+0000","last_unstale":"2024-09-12T00:38:10.204589+0000","last_undegraded":"2024-09-12T00:38:10.204589+0000","last_fullsized":"2024-09-12T00:38:10.204589+0000","mapping_epoch":34,"log_start":"261'2300","ondisk_log_start":"261'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":2300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:04.650587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5961,"num_read_kb":5964,"num_write":4767,"num_write_kb":1768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'190","reported_seq":812,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.531588+0000","last_change":"2024-09-12T00:01:59.156546+0000","last_active":"2024-09-12T00:36:54.531588+0000","last_peered":"2024-09-12T00:36:54.531588+0000","last_clean":"2024-09-12T00:36:54.531588+0000","last_became_active":"2024-09-12T00:01:59.156252+0000","last_became_peered":"2024-09-12T00:01:59.156252+0000","last_unstale":"2024-09-12T00:36:54.531588+0000","last_undegraded":"2024-09-12T00:36:54.531588+0000","last_fullsized":"2024-09-12T00:36:54.531588+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:11.696792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":702,"num_write":296,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'306","reported_seq":945,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.552837+0000","last_change":"2024-09-12T00:01:57.158137+0000","last_active":"2024-09-12T00:37:07.552837+0000","last_peered":"2024-09-12T00:37:07.552837+0000","last_clean":"2024-09-12T00:37:07.552837+0000","last_became_active":"2024-09-12T00:01:57.157699+0000","last_became_peered":"2024-09-12T00:01:57.157699+0000","last_unstale":"2024-09-12T00:37:07.552837+0000","last_undegraded":"2024-09-12T00:37:07.552837+0000","last_fullsized":"2024-09-12T00:37:07.552837+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:28.312365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5571188,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":499,"num_read_kb":32954,"num_write":1159,"num_write_kb":41911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510167+0000","last_change":"2024-09-12T00:02:01.153356+0000","last_active":"2024-09-12T00:35:49.510167+0000","last_peered":"2024-09-12T00:35:49.510167+0000","last_clean":"2024-09-12T00:35:49.510167+0000","last_became_active":"2024-09-12T00:02:01.153090+0000","last_became_peered":"2024-09-12T00:02:01.153090+0000","last_unstale":"2024-09-12T00:35:49.510167+0000","last_undegraded":"2024-09-12T00:35:49.510167+0000","last_fullsized":"2024-09-12T00:35:49.510167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:13.705146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'316","reported_seq":889,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.457091+0000","last_change":"2024-09-12T00:02:03.153714+0000","last_active":"2024-09-12T00:37:23.457091+0000","last_peered":"2024-09-12T00:37:23.457091+0000","last_clean":"2024-09-12T00:37:23.457091+0000","last_became_active":"2024-09-12T00:02:03.153386+0000","last_became_peered":"2024-09-12T00:02:03.153386+0000","last_unstale":"2024-09-12T00:37:23.457091+0000","last_undegraded":"2024-09-12T00:37:23.457091+0000","last_fullsized":"2024-09-12T00:37:23.457091+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:33.982115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65188,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":520,"num_read_kb":1069,"num_write":432,"num_write_kb":339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'777","reported_seq":2231,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.959436+0000","last_change":"2024-09-12T00:02:05.166163+0000","last_active":"2024-09-12T00:38:28.959436+0000","last_peered":"2024-09-12T00:38:28.959436+0000","last_clean":"2024-09-12T00:38:28.959436+0000","last_became_active":"2024-09-12T00:02:05.165892+0000","last_became_peered":"2024-09-12T00:02:05.165892+0000","last_unstale":"2024-09-12T00:38:28.959436+0000","last_undegraded":"2024-09-12T00:38:28.959436+0000","last_fullsized":"2024-09-12T00:38:28.959436+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:29.616858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'87","reported_seq":561,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.556657+0000","last_change":"2024-09-12T00:02:07.169522+0000","last_active":"2024-09-12T00:38:27.556657+0000","last_peered":"2024-09-12T00:38:27.556657+0000","last_clean":"2024-09-12T00:38:27.556657+0000","last_became_active":"2024-09-12T00:02:07.169216+0000","last_became_peered":"2024-09-12T00:02:07.169216+0000","last_unstale":"2024-09-12T00:38:27.556657+0000","last_undegraded":"2024-09-12T00:38:27.556657+0000","last_fullsized":"2024-09-12T00:38:27.556657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:40.757968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":199,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'131","reported_seq":707,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.791148+0000","last_change":"2024-09-12T00:01:59.153212+0000","last_active":"2024-09-12T00:37:01.791148+0000","last_peered":"2024-09-12T00:37:01.791148+0000","last_clean":"2024-09-12T00:37:01.791148+0000","last_became_active":"2024-09-12T00:01:59.152836+0000","last_became_peered":"2024-09-12T00:01:59.152836+0000","last_unstale":"2024-09-12T00:37:01.791148+0000","last_undegraded":"2024-09-12T00:37:01.791148+0000","last_fullsized":"2024-09-12T00:37:01.791148+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:52.164308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":483,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'271","reported_seq":908,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.009854+0000","last_change":"2024-09-12T00:01:57.143503+0000","last_active":"2024-09-12T00:37:08.009854+0000","last_peered":"2024-09-12T00:37:08.009854+0000","last_clean":"2024-09-12T00:37:08.009854+0000","last_became_active":"2024-09-12T00:01:57.143137+0000","last_became_peered":"2024-09-12T00:01:57.143137+0000","last_unstale":"2024-09-12T00:37:08.009854+0000","last_undegraded":"2024-09-12T00:37:08.009854+0000","last_fullsized":"2024-09-12T00:37:08.009854+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:29.714719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":958448,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":471,"num_read_kb":8103,"num_write":1014,"num_write_kb":32276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:39.499399+0000","last_change":"2024-09-12T00:02:01.144552+0000","last_active":"2024-09-12T00:34:39.499399+0000","last_peered":"2024-09-12T00:34:39.499399+0000","last_clean":"2024-09-12T00:34:39.499399+0000","last_became_active":"2024-09-12T00:02:01.144199+0000","last_became_peered":"2024-09-12T00:02:01.144199+0000","last_unstale":"2024-09-12T00:34:39.499399+0000","last_undegraded":"2024-09-12T00:34:39.499399+0000","last_fullsized":"2024-09-12T00:34:39.499399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:06.942666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'487","reported_seq":1119,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.934906+0000","last_change":"2024-09-12T00:02:03.155884+0000","last_active":"2024-09-12T00:38:36.934906+0000","last_peered":"2024-09-12T00:38:36.934906+0000","last_clean":"2024-09-12T00:38:36.934906+0000","last_became_active":"2024-09-12T00:02:03.155625+0000","last_became_peered":"2024-09-12T00:02:03.155625+0000","last_unstale":"2024-09-12T00:38:36.934906+0000","last_undegraded":"2024-09-12T00:38:36.934906+0000","last_fullsized":"2024-09-12T00:38:36.934906+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:38.186042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104418,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":868,"num_read_kb":2109,"num_write":716,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499199+0000","last_change":"2024-09-12T00:02:05.169143+0000","last_active":"2024-09-12T00:34:34.499199+0000","last_peered":"2024-09-12T00:34:34.499199+0000","last_clean":"2024-09-12T00:34:34.499199+0000","last_became_active":"2024-09-12T00:02:05.168816+0000","last_became_peered":"2024-09-12T00:02:05.168816+0000","last_unstale":"2024-09-12T00:34:34.499199+0000","last_undegraded":"2024-09-12T00:34:34.499199+0000","last_fullsized":"2024-09-12T00:34:34.499199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:06.783756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'158","reported_seq":651,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.701085+0000","last_change":"2024-09-12T00:02:07.172017+0000","last_active":"2024-09-12T00:37:07.701085+0000","last_peered":"2024-09-12T00:37:07.701085+0000","last_clean":"2024-09-12T00:37:07.701085+0000","last_became_active":"2024-09-12T00:02:07.171762+0000","last_became_peered":"2024-09-12T00:02:07.171762+0000","last_unstale":"2024-09-12T00:37:07.701085+0000","last_undegraded":"2024-09-12T00:37:07.701085+0000","last_fullsized":"2024-09-12T00:37:07.701085+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:23.109250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":181,"num_read_kb":171,"num_write":367,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'250","reported_seq":889,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.771797+0000","last_change":"2024-09-12T00:01:59.148026+0000","last_active":"2024-09-12T00:37:10.771797+0000","last_peered":"2024-09-12T00:37:10.771797+0000","last_clean":"2024-09-12T00:37:10.771797+0000","last_became_active":"2024-09-12T00:01:59.147762+0000","last_became_peered":"2024-09-12T00:01:59.147762+0000","last_unstale":"2024-09-12T00:37:10.771797+0000","last_undegraded":"2024-09-12T00:37:10.771797+0000","last_fullsized":"2024-09-12T00:37:10.771797+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:56.095727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1058,"num_read_kb":865,"num_write":369,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'254","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:06.955645+0000","last_change":"2024-09-12T00:01:57.140135+0000","last_active":"2024-09-12T00:36:06.955645+0000","last_peered":"2024-09-12T00:36:06.955645+0000","last_clean":"2024-09-12T00:36:06.955645+0000","last_became_active":"2024-09-12T00:01:57.139677+0000","last_became_peered":"2024-09-12T00:01:57.139677+0000","last_unstale":"2024-09-12T00:36:06.955645+0000","last_undegraded":"2024-09-12T00:36:06.955645+0000","last_fullsized":"2024-09-12T00:36:06.955645+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:12.642146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11620117,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":384,"num_read_kb":3669,"num_write":999,"num_write_kb":17146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510008+0000","last_change":"2024-09-12T00:02:01.151052+0000","last_active":"2024-09-12T00:35:49.510008+0000","last_peered":"2024-09-12T00:35:49.510008+0000","last_clean":"2024-09-12T00:35:49.510008+0000","last_became_active":"2024-09-12T00:02:01.150796+0000","last_became_peered":"2024-09-12T00:02:01.150796+0000","last_unstale":"2024-09-12T00:35:49.510008+0000","last_undegraded":"2024-09-12T00:35:49.510008+0000","last_fullsized":"2024-09-12T00:35:49.510008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:30.994773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'271","reported_seq":831,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.908210+0000","last_change":"2024-09-12T00:02:03.153772+0000","last_active":"2024-09-12T00:38:28.908210+0000","last_peered":"2024-09-12T00:38:28.908210+0000","last_clean":"2024-09-12T00:38:28.908210+0000","last_became_active":"2024-09-12T00:02:03.153447+0000","last_became_peered":"2024-09-12T00:02:03.153447+0000","last_unstale":"2024-09-12T00:38:28.908210+0000","last_undegraded":"2024-09-12T00:38:28.908210+0000","last_fullsized":"2024-09-12T00:38:28.908210+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:52.487542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52403,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":456,"num_read_kb":904,"num_write":414,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":471,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.510853+0000","last_change":"2024-09-12T00:02:05.163959+0000","last_active":"2024-09-12T00:35:54.510853+0000","last_peered":"2024-09-12T00:35:54.510853+0000","last_clean":"2024-09-12T00:35:54.510853+0000","last_became_active":"2024-09-12T00:02:05.163689+0000","last_became_peered":"2024-09-12T00:02:05.163689+0000","last_unstale":"2024-09-12T00:35:54.510853+0000","last_undegraded":"2024-09-12T00:35:54.510853+0000","last_fullsized":"2024-09-12T00:35:54.510853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:14.624849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'128","reported_seq":610,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:14.529969+0000","last_change":"2024-09-12T00:02:07.172273+0000","last_active":"2024-09-12T00:38:14.529969+0000","last_peered":"2024-09-12T00:38:14.529969+0000","last_clean":"2024-09-12T00:38:14.529969+0000","last_became_active":"2024-09-12T00:02:07.171942+0000","last_became_peered":"2024-09-12T00:02:07.171942+0000","last_unstale":"2024-09-12T00:38:14.529969+0000","last_undegraded":"2024-09-12T00:38:14.529969+0000","last_fullsized":"2024-09-12T00:38:14.529969+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:54.534357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'138","reported_seq":727,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.949864+0000","last_change":"2024-09-12T00:01:59.150356+0000","last_active":"2024-09-12T00:36:59.949864+0000","last_peered":"2024-09-12T00:36:59.949864+0000","last_clean":"2024-09-12T00:36:59.949864+0000","last_became_active":"2024-09-12T00:01:59.148534+0000","last_became_peered":"2024-09-12T00:01:59.148534+0000","last_unstale":"2024-09-12T00:36:59.949864+0000","last_undegraded":"2024-09-12T00:36:59.949864+0000","last_fullsized":"2024-09-12T00:36:59.949864+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:28.691183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":510,"num_write":211,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'303","reported_seq":944,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.857744+0000","last_change":"2024-09-12T00:01:57.167545+0000","last_active":"2024-09-12T00:37:09.857744+0000","last_peered":"2024-09-12T00:37:09.857744+0000","last_clean":"2024-09-12T00:37:09.857744+0000","last_became_active":"2024-09-12T00:01:57.165226+0000","last_became_peered":"2024-09-12T00:01:57.165226+0000","last_unstale":"2024-09-12T00:37:09.857744+0000","last_undegraded":"2024-09-12T00:37:09.857744+0000","last_fullsized":"2024-09-12T00:37:09.857744+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:33.371625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6032007,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":517,"num_read_kb":11178,"num_write":1159,"num_write_kb":42398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510231+0000","last_change":"2024-09-12T00:02:01.154098+0000","last_active":"2024-09-12T00:35:49.510231+0000","last_peered":"2024-09-12T00:35:49.510231+0000","last_clean":"2024-09-12T00:35:49.510231+0000","last_became_active":"2024-09-12T00:02:01.153818+0000","last_became_peered":"2024-09-12T00:02:01.153818+0000","last_unstale":"2024-09-12T00:35:49.510231+0000","last_undegraded":"2024-09-12T00:35:49.510231+0000","last_fullsized":"2024-09-12T00:35:49.510231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:57.741932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'287","reported_seq":846,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:09.529359+0000","last_change":"2024-09-12T00:02:03.152712+0000","last_active":"2024-09-12T00:38:09.529359+0000","last_peered":"2024-09-12T00:38:09.529359+0000","last_clean":"2024-09-12T00:38:09.529359+0000","last_became_active":"2024-09-12T00:02:03.152421+0000","last_became_peered":"2024-09-12T00:02:03.152421+0000","last_unstale":"2024-09-12T00:38:09.529359+0000","last_undegraded":"2024-09-12T00:38:09.529359+0000","last_fullsized":"2024-09-12T00:38:09.529359+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:06.190143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61953,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":1004,"num_write":396,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'757","reported_seq":2114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.955130+0000","last_change":"2024-09-12T00:02:05.164910+0000","last_active":"2024-09-12T00:38:28.955130+0000","last_peered":"2024-09-12T00:38:28.955130+0000","last_clean":"2024-09-12T00:38:28.955130+0000","last_became_active":"2024-09-12T00:02:05.164655+0000","last_became_peered":"2024-09-12T00:02:05.164655+0000","last_unstale":"2024-09-12T00:38:28.955130+0000","last_undegraded":"2024-09-12T00:38:28.955130+0000","last_fullsized":"2024-09-12T00:38:28.955130+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:28.772936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'95","reported_seq":570,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:00.719827+0000","last_change":"2024-09-12T00:02:07.165060+0000","last_active":"2024-09-12T00:37:00.719827+0000","last_peered":"2024-09-12T00:37:00.719827+0000","last_clean":"2024-09-12T00:37:00.719827+0000","last_became_active":"2024-09-12T00:02:07.164754+0000","last_became_peered":"2024-09-12T00:02:07.164754+0000","last_unstale":"2024-09-12T00:37:00.719827+0000","last_undegraded":"2024-09-12T00:37:00.719827+0000","last_fullsized":"2024-09-12T00:37:00.719827+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:35.892955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":233,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'85","reported_seq":639,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:21.919959+0000","last_change":"2024-09-12T00:01:59.157814+0000","last_active":"2024-09-12T00:36:21.919959+0000","last_peered":"2024-09-12T00:36:21.919959+0000","last_clean":"2024-09-12T00:36:21.919959+0000","last_became_active":"2024-09-12T00:01:59.157172+0000","last_became_peered":"2024-09-12T00:01:59.157172+0000","last_unstale":"2024-09-12T00:36:21.919959+0000","last_undegraded":"2024-09-12T00:36:21.919959+0000","last_fullsized":"2024-09-12T00:36:21.919959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:05.814891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":384,"num_read_kb":356,"num_write":138,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'315","reported_seq":965,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:19.008345+0000","last_change":"2024-09-12T00:01:57.146086+0000","last_active":"2024-09-12T00:38:19.008345+0000","last_peered":"2024-09-12T00:38:19.008345+0000","last_clean":"2024-09-12T00:38:19.008345+0000","last_became_active":"2024-09-12T00:01:57.145710+0000","last_became_peered":"2024-09-12T00:01:57.145710+0000","last_unstale":"2024-09-12T00:38:19.008345+0000","last_undegraded":"2024-09-12T00:38:19.008345+0000","last_fullsized":"2024-09-12T00:38:19.008345+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:34.573066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7008783,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":520,"num_read_kb":20016,"num_write":1232,"num_write_kb":22247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":1920,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.884434+0000","last_change":"2024-09-12T00:02:01.144164+0000","last_active":"2024-09-12T00:38:35.884434+0000","last_peered":"2024-09-12T00:38:35.884434+0000","last_clean":"2024-09-12T00:38:35.884434+0000","last_became_active":"2024-09-12T00:02:01.143823+0000","last_became_peered":"2024-09-12T00:02:01.143823+0000","last_unstale":"2024-09-12T00:38:35.884434+0000","last_undegraded":"2024-09-12T00:38:35.884434+0000","last_fullsized":"2024-09-12T00:38:35.884434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:46.468299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1676,"num_read_kb":1674,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'65","reported_seq":563,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:26.578538+0000","last_change":"2024-09-12T00:02:03.157279+0000","last_active":"2024-09-12T00:36:26.578538+0000","last_peered":"2024-09-12T00:36:26.578538+0000","last_clean":"2024-09-12T00:36:26.578538+0000","last_became_active":"2024-09-12T00:02:03.156680+0000","last_became_peered":"2024-09-12T00:02:03.156680+0000","last_unstale":"2024-09-12T00:36:26.578538+0000","last_undegraded":"2024-09-12T00:36:26.578538+0000","last_fullsized":"2024-09-12T00:36:26.578538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:51.959162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'774","reported_seq":2288,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.892384+0000","last_change":"2024-09-12T00:02:05.164449+0000","last_active":"2024-09-12T00:38:35.892384+0000","last_peered":"2024-09-12T00:38:35.892384+0000","last_clean":"2024-09-12T00:38:35.892384+0000","last_became_active":"2024-09-12T00:02:05.163596+0000","last_became_peered":"2024-09-12T00:02:05.163596+0000","last_unstale":"2024-09-12T00:38:35.892384+0000","last_undegraded":"2024-09-12T00:38:35.892384+0000","last_fullsized":"2024-09-12T00:38:35.892384+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:09.031568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'118","reported_seq":600,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.085766+0000","last_change":"2024-09-12T00:02:07.169460+0000","last_active":"2024-09-12T00:37:22.085766+0000","last_peered":"2024-09-12T00:37:22.085766+0000","last_clean":"2024-09-12T00:37:22.085766+0000","last_became_active":"2024-09-12T00:02:07.169160+0000","last_became_peered":"2024-09-12T00:02:07.169160+0000","last_unstale":"2024-09-12T00:37:22.085766+0000","last_undegraded":"2024-09-12T00:37:22.085766+0000","last_fullsized":"2024-09-12T00:37:22.085766+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:26.962721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":119,"num_write":276,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'226","reported_seq":785,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.164666+0000","last_change":"2024-09-12T00:01:59.152409+0000","last_active":"2024-09-12T00:37:07.164666+0000","last_peered":"2024-09-12T00:37:07.164666+0000","last_clean":"2024-09-12T00:37:07.164666+0000","last_became_active":"2024-09-12T00:01:59.152145+0000","last_became_peered":"2024-09-12T00:01:59.152145+0000","last_unstale":"2024-09-12T00:37:07.164666+0000","last_undegraded":"2024-09-12T00:37:07.164666+0000","last_fullsized":"2024-09-12T00:37:07.164666+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:24.656234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":744,"num_write":332,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'381","reported_seq":1086,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.378930+0000","last_change":"2024-09-12T00:01:57.141659+0000","last_active":"2024-09-12T00:38:37.378930+0000","last_peered":"2024-09-12T00:38:37.378930+0000","last_clean":"2024-09-12T00:38:37.378930+0000","last_became_active":"2024-09-12T00:01:57.140715+0000","last_became_peered":"2024-09-12T00:01:57.140715+0000","last_unstale":"2024-09-12T00:38:37.378930+0000","last_undegraded":"2024-09-12T00:38:37.378930+0000","last_fullsized":"2024-09-12T00:38:37.378930+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:50.244966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":346,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":671,"num_read_kb":94303,"num_write":1256,"num_write_kb":32809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.392478+0000","last_change":"2024-09-12T00:02:01.153751+0000","last_active":"2024-09-12T00:35:49.392478+0000","last_peered":"2024-09-12T00:35:49.392478+0000","last_clean":"2024-09-12T00:35:49.392478+0000","last_became_active":"2024-09-12T00:02:01.153347+0000","last_became_peered":"2024-09-12T00:02:01.153347+0000","last_unstale":"2024-09-12T00:35:49.392478+0000","last_undegraded":"2024-09-12T00:35:49.392478+0000","last_fullsized":"2024-09-12T00:35:49.392478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:05.059094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'312","reported_seq":894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.923474+0000","last_change":"2024-09-12T00:02:03.155029+0000","last_active":"2024-09-12T00:38:28.923474+0000","last_peered":"2024-09-12T00:38:28.923474+0000","last_clean":"2024-09-12T00:38:28.923474+0000","last_became_active":"2024-09-12T00:02:03.154752+0000","last_became_peered":"2024-09-12T00:02:03.154752+0000","last_unstale":"2024-09-12T00:38:28.923474+0000","last_undegraded":"2024-09-12T00:38:28.923474+0000","last_fullsized":"2024-09-12T00:38:28.923474+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:16.822889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56942,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":509,"num_read_kb":981,"num_write":406,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627588+0000","last_change":"2024-09-12T00:02:05.164441+0000","last_active":"2024-09-12T00:35:49.627588+0000","last_peered":"2024-09-12T00:35:49.627588+0000","last_clean":"2024-09-12T00:35:49.627588+0000","last_became_active":"2024-09-12T00:02:05.164108+0000","last_became_peered":"2024-09-12T00:02:05.164108+0000","last_unstale":"2024-09-12T00:35:49.627588+0000","last_undegraded":"2024-09-12T00:35:49.627588+0000","last_fullsized":"2024-09-12T00:35:49.627588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:12.635310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'159","reported_seq":633,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.847980+0000","last_change":"2024-09-12T00:02:07.169610+0000","last_active":"2024-09-12T00:36:52.847980+0000","last_peered":"2024-09-12T00:36:52.847980+0000","last_clean":"2024-09-12T00:36:52.847980+0000","last_became_active":"2024-09-12T00:02:07.169351+0000","last_became_peered":"2024-09-12T00:02:07.169351+0000","last_unstale":"2024-09-12T00:36:52.847980+0000","last_undegraded":"2024-09-12T00:36:52.847980+0000","last_fullsized":"2024-09-12T00:36:52.847980+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:28.308716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":164,"num_write":397,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'164","reported_seq":768,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:26.283270+0000","last_change":"2024-09-12T00:01:59.151096+0000","last_active":"2024-09-12T00:36:26.283270+0000","last_peered":"2024-09-12T00:36:26.283270+0000","last_clean":"2024-09-12T00:36:26.283270+0000","last_became_active":"2024-09-12T00:01:59.150072+0000","last_became_peered":"2024-09-12T00:01:59.150072+0000","last_unstale":"2024-09-12T00:36:26.283270+0000","last_undegraded":"2024-09-12T00:36:26.283270+0000","last_fullsized":"2024-09-12T00:36:26.283270+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:28.419527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":763,"num_read_kb":636,"num_write":273,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":605,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:46.508442+0000","last_change":"2024-09-12T00:01:39.721517+0000","last_active":"2024-09-12T00:35:46.508442+0000","last_peered":"2024-09-12T00:35:46.508442+0000","last_clean":"2024-09-12T00:35:46.508442+0000","last_became_active":"2024-09-12T00:01:39.720425+0000","last_became_peered":"2024-09-12T00:01:39.720425+0000","last_unstale":"2024-09-12T00:35:46.508442+0000","last_undegraded":"2024-09-12T00:35:46.508442+0000","last_fullsized":"2024-09-12T00:35:46.508442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:37.438834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:37.438834+0000","last_clean_scrub_stamp":"2024-09-12T00:01:37.438834+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:26.565085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":512,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.386954+0000","last_change":"2024-09-12T00:01:48.515868+0000","last_active":"2024-09-12T00:35:09.386954+0000","last_peered":"2024-09-12T00:35:09.386954+0000","last_clean":"2024-09-12T00:35:09.386954+0000","last_became_active":"2024-09-12T00:01:46.613916+0000","last_became_peered":"2024-09-12T00:01:46.613916+0000","last_unstale":"2024-09-12T00:35:09.386954+0000","last_undegraded":"2024-09-12T00:35:09.386954+0000","last_fullsized":"2024-09-12T00:35:09.386954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:23.127685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014566500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'350","reported_seq":1043,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.483073+0000","last_change":"2024-09-12T00:01:57.141951+0000","last_active":"2024-09-12T00:38:37.483073+0000","last_peered":"2024-09-12T00:38:37.483073+0000","last_clean":"2024-09-12T00:38:37.483073+0000","last_became_active":"2024-09-12T00:01:57.141553+0000","last_became_peered":"2024-09-12T00:01:57.141553+0000","last_unstale":"2024-09-12T00:38:37.483073+0000","last_undegraded":"2024-09-12T00:38:37.483073+0000","last_fullsized":"2024-09-12T00:38:37.483073+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:47.205119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11861347,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":681,"num_read_kb":51086,"num_write":1018,"num_write_kb":49735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.387995+0000","last_change":"2024-09-12T00:02:01.148969+0000","last_active":"2024-09-12T00:35:24.387995+0000","last_peered":"2024-09-12T00:35:24.387995+0000","last_clean":"2024-09-12T00:35:24.387995+0000","last_became_active":"2024-09-12T00:02:01.148696+0000","last_became_peered":"2024-09-12T00:02:01.148696+0000","last_unstale":"2024-09-12T00:35:24.387995+0000","last_undegraded":"2024-09-12T00:35:24.387995+0000","last_fullsized":"2024-09-12T00:35:24.387995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:28.294552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'675","reported_seq":1354,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.925680+0000","last_change":"2024-09-12T00:02:03.150355+0000","last_active":"2024-09-12T00:38:28.925680+0000","last_peered":"2024-09-12T00:38:28.925680+0000","last_clean":"2024-09-12T00:38:28.925680+0000","last_became_active":"2024-09-12T00:02:03.150075+0000","last_became_peered":"2024-09-12T00:02:03.150075+0000","last_unstale":"2024-09-12T00:38:28.925680+0000","last_undegraded":"2024-09-12T00:38:28.925680+0000","last_fullsized":"2024-09-12T00:38:28.925680+0000","mapping_epoch":30,"log_start":"261'600","ondisk_log_start":"261'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":600,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:08.116055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158560,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1315,"num_read_kb":2733,"num_write":1224,"num_write_kb":1081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499342+0000","last_change":"2024-09-12T00:02:05.162858+0000","last_active":"2024-09-12T00:34:34.499342+0000","last_peered":"2024-09-12T00:34:34.499342+0000","last_clean":"2024-09-12T00:34:34.499342+0000","last_became_active":"2024-09-12T00:02:05.162455+0000","last_became_peered":"2024-09-12T00:02:05.162455+0000","last_unstale":"2024-09-12T00:34:34.499342+0000","last_undegraded":"2024-09-12T00:34:34.499342+0000","last_fullsized":"2024-09-12T00:34:34.499342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.590391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'258","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.461047+0000","last_change":"2024-09-12T00:02:07.168139+0000","last_active":"2024-09-12T00:37:23.461047+0000","last_peered":"2024-09-12T00:37:23.461047+0000","last_clean":"2024-09-12T00:37:23.461047+0000","last_became_active":"2024-09-12T00:02:07.167844+0000","last_became_peered":"2024-09-12T00:02:07.167844+0000","last_unstale":"2024-09-12T00:37:23.461047+0000","last_undegraded":"2024-09-12T00:37:23.461047+0000","last_fullsized":"2024-09-12T00:37:23.461047+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:00.761039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":469,"num_read_kb":454,"num_write":531,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'172","reported_seq":761,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:10.423640+0000","last_change":"2024-09-12T00:01:59.149437+0000","last_active":"2024-09-12T00:36:10.423640+0000","last_peered":"2024-09-12T00:36:10.423640+0000","last_clean":"2024-09-12T00:36:10.423640+0000","last_became_active":"2024-09-12T00:01:59.149145+0000","last_became_peered":"2024-09-12T00:01:59.149145+0000","last_unstale":"2024-09-12T00:36:10.423640+0000","last_undegraded":"2024-09-12T00:36:10.423640+0000","last_fullsized":"2024-09-12T00:36:10.423640+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:31.451704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":604,"num_write":249,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.393043+0000","last_change":"2024-09-12T00:01:48.515091+0000","last_active":"2024-09-12T00:35:54.393043+0000","last_peered":"2024-09-12T00:35:54.393043+0000","last_clean":"2024-09-12T00:35:54.393043+0000","last_became_active":"2024-09-12T00:01:46.505677+0000","last_became_peered":"2024-09-12T00:01:46.505677+0000","last_unstale":"2024-09-12T00:35:54.393043+0000","last_undegraded":"2024-09-12T00:35:54.393043+0000","last_fullsized":"2024-09-12T00:35:54.393043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:07.430053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075102999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'264","reported_seq":882,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:28.001470+0000","last_change":"2024-09-12T00:01:57.152548+0000","last_active":"2024-09-12T00:36:28.001470+0000","last_peered":"2024-09-12T00:36:28.001470+0000","last_clean":"2024-09-12T00:36:28.001470+0000","last_became_active":"2024-09-12T00:01:57.152153+0000","last_became_peered":"2024-09-12T00:01:57.152153+0000","last_unstale":"2024-09-12T00:36:28.001470+0000","last_undegraded":"2024-09-12T00:36:28.001470+0000","last_fullsized":"2024-09-12T00:36:28.001470+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:18.135861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506847,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":438,"num_read_kb":31134,"num_write":931,"num_write_kb":29868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.382185+0000","last_change":"2024-09-12T00:02:01.153210+0000","last_active":"2024-09-12T00:34:34.382185+0000","last_peered":"2024-09-12T00:34:34.382185+0000","last_clean":"2024-09-12T00:34:34.382185+0000","last_became_active":"2024-09-12T00:02:01.152904+0000","last_became_peered":"2024-09-12T00:02:01.152904+0000","last_unstale":"2024-09-12T00:34:34.382185+0000","last_undegraded":"2024-09-12T00:34:34.382185+0000","last_fullsized":"2024-09-12T00:34:34.382185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:50.681148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1195","reported_seq":2538,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.950946+0000","last_change":"2024-09-12T00:02:03.153993+0000","last_active":"2024-09-12T00:38:28.950946+0000","last_peered":"2024-09-12T00:38:28.950946+0000","last_clean":"2024-09-12T00:38:28.950946+0000","last_became_active":"2024-09-12T00:02:03.153702+0000","last_became_peered":"2024-09-12T00:02:03.153702+0000","last_unstale":"2024-09-12T00:38:28.950946+0000","last_undegraded":"2024-09-12T00:38:28.950946+0000","last_fullsized":"2024-09-12T00:38:28.950946+0000","mapping_epoch":30,"log_start":"261'1100","ondisk_log_start":"261'1100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":1100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.693992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153682,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1878,"num_read_kb":3200,"num_write":996,"num_write_kb":845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:29.389647+0000","last_change":"2024-09-12T00:02:05.172331+0000","last_active":"2024-09-12T00:35:29.389647+0000","last_peered":"2024-09-12T00:35:29.389647+0000","last_clean":"2024-09-12T00:35:29.389647+0000","last_became_active":"2024-09-12T00:02:05.171787+0000","last_became_peered":"2024-09-12T00:02:05.171787+0000","last_unstale":"2024-09-12T00:35:29.389647+0000","last_undegraded":"2024-09-12T00:35:29.389647+0000","last_fullsized":"2024-09-12T00:35:29.389647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:38.114555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'217","reported_seq":737,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.191898+0000","last_change":"2024-09-12T00:02:07.169700+0000","last_active":"2024-09-12T00:36:56.191898+0000","last_peered":"2024-09-12T00:36:56.191898+0000","last_clean":"2024-09-12T00:36:56.191898+0000","last_became_active":"2024-09-12T00:02:07.169173+0000","last_became_peered":"2024-09-12T00:02:07.169173+0000","last_unstale":"2024-09-12T00:36:56.191898+0000","last_undegraded":"2024-09-12T00:36:56.191898+0000","last_fullsized":"2024-09-12T00:36:56.191898+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:07.710548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":374,"num_read_kb":362,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'88","reported_seq":639,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:20.939776+0000","last_change":"2024-09-12T00:01:59.139141+0000","last_active":"2024-09-12T00:37:20.939776+0000","last_peered":"2024-09-12T00:37:20.939776+0000","last_clean":"2024-09-12T00:37:20.939776+0000","last_became_active":"2024-09-12T00:01:59.138731+0000","last_became_peered":"2024-09-12T00:01:59.138731+0000","last_unstale":"2024-09-12T00:37:20.939776+0000","last_undegraded":"2024-09-12T00:37:20.939776+0000","last_fullsized":"2024-09-12T00:37:20.939776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:31.598716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":368,"num_read_kb":306,"num_write":121,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":503,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.503944+0000","last_change":"2024-09-12T00:01:50.044924+0000","last_active":"2024-09-12T00:35:09.503944+0000","last_peered":"2024-09-12T00:35:09.503944+0000","last_clean":"2024-09-12T00:35:09.503944+0000","last_became_active":"2024-09-12T00:01:46.505857+0000","last_became_peered":"2024-09-12T00:01:46.505857+0000","last_unstale":"2024-09-12T00:35:09.503944+0000","last_undegraded":"2024-09-12T00:35:09.503944+0000","last_fullsized":"2024-09-12T00:35:09.503944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:18.728534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039331300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'267","reported_seq":872,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.360496+0000","last_change":"2024-09-12T00:01:57.154563+0000","last_active":"2024-09-12T00:37:08.360496+0000","last_peered":"2024-09-12T00:37:08.360496+0000","last_clean":"2024-09-12T00:37:08.360496+0000","last_became_active":"2024-09-12T00:01:57.151644+0000","last_became_peered":"2024-09-12T00:01:57.151644+0000","last_unstale":"2024-09-12T00:37:08.360496+0000","last_undegraded":"2024-09-12T00:37:08.360496+0000","last_fullsized":"2024-09-12T00:37:08.360496+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:39.639241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11935188,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":393,"num_read_kb":2373,"num_write":1049,"num_write_kb":41035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498978+0000","last_change":"2024-09-12T00:02:01.151980+0000","last_active":"2024-09-12T00:34:34.498978+0000","last_peered":"2024-09-12T00:34:34.498978+0000","last_clean":"2024-09-12T00:34:34.498978+0000","last_became_active":"2024-09-12T00:02:01.151474+0000","last_became_peered":"2024-09-12T00:02:01.151474+0000","last_unstale":"2024-09-12T00:34:34.498978+0000","last_undegraded":"2024-09-12T00:34:34.498978+0000","last_fullsized":"2024-09-12T00:34:34.498978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:15.387013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'208","reported_seq":1181,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:25.299127+0000","last_change":"2024-09-12T00:02:03.155847+0000","last_active":"2024-09-12T00:38:25.299127+0000","last_peered":"2024-09-12T00:38:25.299127+0000","last_clean":"2024-09-12T00:38:25.299127+0000","last_became_active":"2024-09-12T00:02:03.155311+0000","last_became_peered":"2024-09-12T00:02:03.155311+0000","last_unstale":"2024-09-12T00:38:25.299127+0000","last_undegraded":"2024-09-12T00:38:25.299127+0000","last_fullsized":"2024-09-12T00:38:25.299127+0000","mapping_epoch":30,"log_start":"258'100","ondisk_log_start":"258'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:37.168360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":119,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:27.509399+0000","last_change":"2024-09-12T00:02:05.168343+0000","last_active":"2024-09-12T00:35:27.509399+0000","last_peered":"2024-09-12T00:35:27.509399+0000","last_clean":"2024-09-12T00:35:27.509399+0000","last_became_active":"2024-09-12T00:02:05.167874+0000","last_became_peered":"2024-09-12T00:02:05.167874+0000","last_unstale":"2024-09-12T00:35:27.509399+0000","last_undegraded":"2024-09-12T00:35:27.509399+0000","last_fullsized":"2024-09-12T00:35:27.509399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:12.012160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'262","reported_seq":856,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.604136+0000","last_change":"2024-09-12T00:02:07.162130+0000","last_active":"2024-09-12T00:37:23.604136+0000","last_peered":"2024-09-12T00:37:23.604136+0000","last_clean":"2024-09-12T00:37:23.604136+0000","last_became_active":"2024-09-12T00:02:07.161814+0000","last_became_peered":"2024-09-12T00:02:07.161814+0000","last_unstale":"2024-09-12T00:37:23.604136+0000","last_undegraded":"2024-09-12T00:37:23.604136+0000","last_fullsized":"2024-09-12T00:37:23.604136+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:02.767585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":499,"num_read_kb":517,"num_write":567,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'135","reported_seq":711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.489664+0000","last_change":"2024-09-12T00:01:59.153823+0000","last_active":"2024-09-12T00:37:10.489664+0000","last_peered":"2024-09-12T00:37:10.489664+0000","last_clean":"2024-09-12T00:37:10.489664+0000","last_became_active":"2024-09-12T00:01:59.153542+0000","last_became_peered":"2024-09-12T00:01:59.153542+0000","last_unstale":"2024-09-12T00:37:10.489664+0000","last_undegraded":"2024-09-12T00:37:10.489664+0000","last_fullsized":"2024-09-12T00:37:10.489664+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:16.930267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":619,"num_read_kb":513,"num_write":207,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":513,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.386923+0000","last_change":"2024-09-12T00:01:48.515810+0000","last_active":"2024-09-12T00:35:09.386923+0000","last_peered":"2024-09-12T00:35:09.386923+0000","last_clean":"2024-09-12T00:35:09.386923+0000","last_became_active":"2024-09-12T00:01:46.502428+0000","last_became_peered":"2024-09-12T00:01:46.502428+0000","last_unstale":"2024-09-12T00:35:09.386923+0000","last_undegraded":"2024-09-12T00:35:09.386923+0000","last_fullsized":"2024-09-12T00:35:09.386923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:13.947790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001414925,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'274","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:24.402749+0000","last_change":"2024-09-12T00:01:57.156552+0000","last_active":"2024-09-12T00:37:24.402749+0000","last_peered":"2024-09-12T00:37:24.402749+0000","last_clean":"2024-09-12T00:37:24.402749+0000","last_became_active":"2024-09-12T00:01:57.156172+0000","last_became_peered":"2024-09-12T00:01:57.156172+0000","last_unstale":"2024-09-12T00:37:24.402749+0000","last_undegraded":"2024-09-12T00:37:24.402749+0000","last_fullsized":"2024-09-12T00:37:24.402749+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:22.222372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8151797,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":384,"num_read_kb":22094,"num_write":1036,"num_write_kb":41486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:29.506844+0000","last_change":"2024-09-12T00:02:01.153018+0000","last_active":"2024-09-12T00:35:29.506844+0000","last_peered":"2024-09-12T00:35:29.506844+0000","last_clean":"2024-09-12T00:35:29.506844+0000","last_became_active":"2024-09-12T00:02:01.152752+0000","last_became_peered":"2024-09-12T00:02:01.152752+0000","last_unstale":"2024-09-12T00:35:29.506844+0000","last_undegraded":"2024-09-12T00:35:29.506844+0000","last_fullsized":"2024-09-12T00:35:29.506844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:50.379948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'112","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.961118+0000","last_change":"2024-09-12T00:02:03.152362+0000","last_active":"2024-09-12T00:36:50.961118+0000","last_peered":"2024-09-12T00:36:50.961118+0000","last_clean":"2024-09-12T00:36:50.961118+0000","last_became_active":"2024-09-12T00:02:03.152008+0000","last_became_peered":"2024-09-12T00:02:03.152008+0000","last_unstale":"2024-09-12T00:36:50.961118+0000","last_undegraded":"2024-09-12T00:36:50.961118+0000","last_fullsized":"2024-09-12T00:36:50.961118+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:40.412153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":94,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.382152+0000","last_change":"2024-09-12T00:02:05.170927+0000","last_active":"2024-09-12T00:34:34.382152+0000","last_peered":"2024-09-12T00:34:34.382152+0000","last_clean":"2024-09-12T00:34:34.382152+0000","last_became_active":"2024-09-12T00:02:05.170487+0000","last_became_peered":"2024-09-12T00:02:05.170487+0000","last_unstale":"2024-09-12T00:34:34.382152+0000","last_undegraded":"2024-09-12T00:34:34.382152+0000","last_fullsized":"2024-09-12T00:34:34.382152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:15.416030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":662,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.519983+0000","last_change":"2024-09-12T00:02:07.169125+0000","last_active":"2024-09-12T00:36:52.519983+0000","last_peered":"2024-09-12T00:36:52.519983+0000","last_clean":"2024-09-12T00:36:52.519983+0000","last_became_active":"2024-09-12T00:02:07.168820+0000","last_became_peered":"2024-09-12T00:02:07.168820+0000","last_unstale":"2024-09-12T00:36:52.519983+0000","last_undegraded":"2024-09-12T00:36:52.519983+0000","last_fullsized":"2024-09-12T00:36:52.519983+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:54.542834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":226,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'300","reported_seq":884,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.965247+0000","last_change":"2024-09-12T00:01:59.145724+0000","last_active":"2024-09-12T00:37:07.965247+0000","last_peered":"2024-09-12T00:37:07.965247+0000","last_clean":"2024-09-12T00:37:07.965247+0000","last_became_active":"2024-09-12T00:01:59.145273+0000","last_became_peered":"2024-09-12T00:01:59.145273+0000","last_unstale":"2024-09-12T00:37:07.965247+0000","last_undegraded":"2024-09-12T00:37:07.965247+0000","last_fullsized":"2024-09-12T00:37:07.965247+0000","mapping_epoch":26,"log_start":"258'200","ondisk_log_start":"258'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:10.954485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1215,"num_write":550,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'308","reported_seq":1003,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.263089+0000","last_change":"2024-09-12T00:01:57.154791+0000","last_active":"2024-09-12T00:37:10.263089+0000","last_peered":"2024-09-12T00:37:10.263089+0000","last_clean":"2024-09-12T00:37:10.263089+0000","last_became_active":"2024-09-12T00:01:57.154387+0000","last_became_peered":"2024-09-12T00:01:57.154387+0000","last_unstale":"2024-09-12T00:37:10.263089+0000","last_undegraded":"2024-09-12T00:37:10.263089+0000","last_fullsized":"2024-09-12T00:37:10.263089+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:15.020141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11674169,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":571,"num_read_kb":122441,"num_write":1093,"num_write_kb":43815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":509,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.504322+0000","last_change":"2024-09-12T00:01:49.473468+0000","last_active":"2024-09-12T00:35:09.504322+0000","last_peered":"2024-09-12T00:35:09.504322+0000","last_clean":"2024-09-12T00:35:09.504322+0000","last_became_active":"2024-09-12T00:01:46.505954+0000","last_became_peered":"2024-09-12T00:01:46.505954+0000","last_unstale":"2024-09-12T00:35:09.504322+0000","last_undegraded":"2024-09-12T00:35:09.504322+0000","last_fullsized":"2024-09-12T00:35:09.504322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:03.543109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050498000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:22.508574+0000","last_change":"2024-09-12T00:02:01.149787+0000","last_active":"2024-09-12T00:35:22.508574+0000","last_peered":"2024-09-12T00:35:22.508574+0000","last_clean":"2024-09-12T00:35:22.508574+0000","last_became_active":"2024-09-12T00:02:01.149529+0000","last_became_peered":"2024-09-12T00:02:01.149529+0000","last_unstale":"2024-09-12T00:35:22.508574+0000","last_undegraded":"2024-09-12T00:35:22.508574+0000","last_fullsized":"2024-09-12T00:35:22.508574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:38.924972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'547","reported_seq":1188,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.916250+0000","last_change":"2024-09-12T00:02:03.152903+0000","last_active":"2024-09-12T00:38:28.916250+0000","last_peered":"2024-09-12T00:38:28.916250+0000","last_clean":"2024-09-12T00:38:28.916250+0000","last_became_active":"2024-09-12T00:02:03.152535+0000","last_became_peered":"2024-09-12T00:02:03.152535+0000","last_unstale":"2024-09-12T00:38:28.916250+0000","last_undegraded":"2024-09-12T00:38:28.916250+0000","last_fullsized":"2024-09-12T00:38:28.916250+0000","mapping_epoch":30,"log_start":"261'500","ondisk_log_start":"261'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:26.014665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106310,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1504,"num_read_kb":2448,"num_write":1940,"num_write_kb":1778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":471,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.623486+0000","last_change":"2024-09-12T00:02:05.168263+0000","last_active":"2024-09-12T00:35:24.623486+0000","last_peered":"2024-09-12T00:35:24.623486+0000","last_clean":"2024-09-12T00:35:24.623486+0000","last_became_active":"2024-09-12T00:02:05.167998+0000","last_became_peered":"2024-09-12T00:02:05.167998+0000","last_unstale":"2024-09-12T00:35:24.623486+0000","last_undegraded":"2024-09-12T00:35:24.623486+0000","last_fullsized":"2024-09-12T00:35:24.623486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:50.635765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'161","reported_seq":644,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.451268+0000","last_change":"2024-09-12T00:02:07.168288+0000","last_active":"2024-09-12T00:37:23.451268+0000","last_peered":"2024-09-12T00:37:23.451268+0000","last_clean":"2024-09-12T00:37:23.451268+0000","last_became_active":"2024-09-12T00:02:07.168005+0000","last_became_peered":"2024-09-12T00:02:07.168005+0000","last_unstale":"2024-09-12T00:37:23.451268+0000","last_undegraded":"2024-09-12T00:37:23.451268+0000","last_fullsized":"2024-09-12T00:37:23.451268+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:33.779846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":133,"num_write":373,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'348","reported_seq":992,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.432202+0000","last_change":"2024-09-12T00:01:59.137316+0000","last_active":"2024-09-12T00:36:52.432202+0000","last_peered":"2024-09-12T00:36:52.432202+0000","last_clean":"2024-09-12T00:36:52.432202+0000","last_became_active":"2024-09-12T00:01:59.137020+0000","last_became_peered":"2024-09-12T00:01:59.137020+0000","last_unstale":"2024-09-12T00:36:52.432202+0000","last_undegraded":"2024-09-12T00:36:52.432202+0000","last_fullsized":"2024-09-12T00:36:52.432202+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:36.922276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1524,"num_read_kb":1224,"num_write":576,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'242","reported_seq":847,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.768424+0000","last_change":"2024-09-12T00:01:57.152881+0000","last_active":"2024-09-12T00:37:07.768424+0000","last_peered":"2024-09-12T00:37:07.768424+0000","last_clean":"2024-09-12T00:37:07.768424+0000","last_became_active":"2024-09-12T00:01:57.152021+0000","last_became_peered":"2024-09-12T00:01:57.152021+0000","last_unstale":"2024-09-12T00:37:07.768424+0000","last_undegraded":"2024-09-12T00:37:07.768424+0000","last_fullsized":"2024-09-12T00:37:07.768424+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:43.435665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11102901,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":378,"num_read_kb":13162,"num_write":897,"num_write_kb":28256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:14.387659+0000","last_change":"2024-09-12T00:01:48.515165+0000","last_active":"2024-09-12T00:35:14.387659+0000","last_peered":"2024-09-12T00:35:14.387659+0000","last_clean":"2024-09-12T00:35:14.387659+0000","last_became_active":"2024-09-12T00:01:46.505315+0000","last_became_peered":"2024-09-12T00:01:46.505315+0000","last_unstale":"2024-09-12T00:35:14.387659+0000","last_undegraded":"2024-09-12T00:35:14.387659+0000","last_fullsized":"2024-09-12T00:35:14.387659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:31.136294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079890600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.387917+0000","last_change":"2024-09-12T00:02:01.148940+0000","last_active":"2024-09-12T00:35:24.387917+0000","last_peered":"2024-09-12T00:35:24.387917+0000","last_clean":"2024-09-12T00:35:24.387917+0000","last_became_active":"2024-09-12T00:02:01.148650+0000","last_became_peered":"2024-09-12T00:02:01.148650+0000","last_unstale":"2024-09-12T00:35:24.387917+0000","last_undegraded":"2024-09-12T00:35:24.387917+0000","last_fullsized":"2024-09-12T00:35:24.387917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:11.664931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'162","reported_seq":707,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:29.523102+0000","last_change":"2024-09-12T00:02:03.153955+0000","last_active":"2024-09-12T00:37:29.523102+0000","last_peered":"2024-09-12T00:37:29.523102+0000","last_clean":"2024-09-12T00:37:29.523102+0000","last_became_active":"2024-09-12T00:02:03.153640+0000","last_became_peered":"2024-09-12T00:02:03.153640+0000","last_unstale":"2024-09-12T00:37:29.523102+0000","last_undegraded":"2024-09-12T00:37:29.523102+0000","last_fullsized":"2024-09-12T00:37:29.523102+0000","mapping_epoch":30,"log_start":"258'100","ondisk_log_start":"258'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:03.938144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":206,"num_read_kb":198,"num_write":166,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'774","reported_seq":2507,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.888775+0000","last_change":"2024-09-12T00:02:05.165645+0000","last_active":"2024-09-12T00:38:35.888775+0000","last_peered":"2024-09-12T00:38:35.888775+0000","last_clean":"2024-09-12T00:38:35.888775+0000","last_became_active":"2024-09-12T00:02:05.163720+0000","last_became_peered":"2024-09-12T00:02:05.163720+0000","last_unstale":"2024-09-12T00:38:35.888775+0000","last_undegraded":"2024-09-12T00:38:35.888775+0000","last_fullsized":"2024-09-12T00:38:35.888775+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:23.515740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'122","reported_seq":618,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:19.409311+0000","last_change":"2024-09-12T00:02:07.168152+0000","last_active":"2024-09-12T00:38:19.409311+0000","last_peered":"2024-09-12T00:38:19.409311+0000","last_clean":"2024-09-12T00:38:19.409311+0000","last_became_active":"2024-09-12T00:02:07.167797+0000","last_became_peered":"2024-09-12T00:02:07.167797+0000","last_unstale":"2024-09-12T00:38:19.409311+0000","last_undegraded":"2024-09-12T00:38:19.409311+0000","last_fullsized":"2024-09-12T00:38:19.409311+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:43.278651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":159,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'140","reported_seq":725,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:11.053276+0000","last_change":"2024-09-12T00:01:59.155408+0000","last_active":"2024-09-12T00:37:11.053276+0000","last_peered":"2024-09-12T00:37:11.053276+0000","last_clean":"2024-09-12T00:37:11.053276+0000","last_became_active":"2024-09-12T00:01:59.155117+0000","last_became_peered":"2024-09-12T00:01:59.155117+0000","last_unstale":"2024-09-12T00:37:11.053276+0000","last_undegraded":"2024-09-12T00:37:11.053276+0000","last_fullsized":"2024-09-12T00:37:11.053276+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:27.119934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":474,"num_write":223,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'336","reported_seq":996,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.521536+0000","last_change":"2024-09-12T00:01:57.134608+0000","last_active":"2024-09-12T00:38:37.521536+0000","last_peered":"2024-09-12T00:38:37.521536+0000","last_clean":"2024-09-12T00:38:37.521536+0000","last_became_active":"2024-09-12T00:01:57.134235+0000","last_became_peered":"2024-09-12T00:01:57.134235+0000","last_unstale":"2024-09-12T00:38:37.521536+0000","last_undegraded":"2024-09-12T00:38:37.521536+0000","last_fullsized":"2024-09-12T00:38:37.521536+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:42.049998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9470447,"num_objects":35,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":498,"num_read_kb":31500,"num_write":1159,"num_write_kb":36639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":514,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:27.517783+0000","last_change":"2024-09-12T00:01:48.511519+0000","last_active":"2024-09-12T00:36:27.517783+0000","last_peered":"2024-09-12T00:36:27.517783+0000","last_clean":"2024-09-12T00:36:27.517783+0000","last_became_active":"2024-09-12T00:01:46.508144+0000","last_became_peered":"2024-09-12T00:01:46.508144+0000","last_unstale":"2024-09-12T00:36:27.517783+0000","last_undegraded":"2024-09-12T00:36:27.517783+0000","last_fullsized":"2024-09-12T00:36:27.517783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:13.771631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045024799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.388920+0000","last_change":"2024-09-12T00:02:01.153487+0000","last_active":"2024-09-12T00:35:24.388920+0000","last_peered":"2024-09-12T00:35:24.388920+0000","last_clean":"2024-09-12T00:35:24.388920+0000","last_became_active":"2024-09-12T00:02:01.153207+0000","last_became_peered":"2024-09-12T00:02:01.153207+0000","last_unstale":"2024-09-12T00:35:24.388920+0000","last_undegraded":"2024-09-12T00:35:24.388920+0000","last_fullsized":"2024-09-12T00:35:24.388920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:46.459368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'107","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.666790+0000","last_change":"2024-09-12T00:02:03.151323+0000","last_active":"2024-09-12T00:36:24.666790+0000","last_peered":"2024-09-12T00:36:24.666790+0000","last_clean":"2024-09-12T00:36:24.666790+0000","last_became_active":"2024-09-12T00:02:03.151029+0000","last_became_peered":"2024-09-12T00:02:03.151029+0000","last_unstale":"2024-09-12T00:36:24.666790+0000","last_undegraded":"2024-09-12T00:36:24.666790+0000","last_fullsized":"2024-09-12T00:36:24.666790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:22.745763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":125,"num_read_kb":114,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'777","reported_seq":4554,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.957333+0000","last_change":"2024-09-12T00:02:05.164285+0000","last_active":"2024-09-12T00:38:28.957333+0000","last_peered":"2024-09-12T00:38:28.957333+0000","last_clean":"2024-09-12T00:38:28.957333+0000","last_became_active":"2024-09-12T00:02:05.162687+0000","last_became_peered":"2024-09-12T00:02:05.162687+0000","last_unstale":"2024-09-12T00:38:28.957333+0000","last_undegraded":"2024-09-12T00:38:28.957333+0000","last_fullsized":"2024-09-12T00:38:28.957333+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:19.706882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'155","reported_seq":657,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.251347+0000","last_change":"2024-09-12T00:02:07.166773+0000","last_active":"2024-09-12T00:37:02.251347+0000","last_peered":"2024-09-12T00:37:02.251347+0000","last_clean":"2024-09-12T00:37:02.251347+0000","last_became_active":"2024-09-12T00:02:07.166471+0000","last_became_peered":"2024-09-12T00:02:07.166471+0000","last_unstale":"2024-09-12T00:37:02.251347+0000","last_undegraded":"2024-09-12T00:37:02.251347+0000","last_fullsized":"2024-09-12T00:37:02.251347+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:15.572916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":126,"num_write":337,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'81","reported_seq":638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:51.799754+0000","last_change":"2024-09-12T00:01:59.157320+0000","last_active":"2024-09-12T00:36:51.799754+0000","last_peered":"2024-09-12T00:36:51.799754+0000","last_clean":"2024-09-12T00:36:51.799754+0000","last_became_active":"2024-09-12T00:01:59.157044+0000","last_became_peered":"2024-09-12T00:01:59.157044+0000","last_unstale":"2024-09-12T00:36:51.799754+0000","last_undegraded":"2024-09-12T00:36:51.799754+0000","last_fullsized":"2024-09-12T00:36:51.799754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:09.577038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":122,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'412","reported_seq":1046,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.413500+0000","last_change":"2024-09-12T00:01:57.134999+0000","last_active":"2024-09-12T00:38:37.413500+0000","last_peered":"2024-09-12T00:38:37.413500+0000","last_clean":"2024-09-12T00:38:37.413500+0000","last_became_active":"2024-09-12T00:01:57.134646+0000","last_became_peered":"2024-09-12T00:01:57.134646+0000","last_unstale":"2024-09-12T00:38:37.413500+0000","last_undegraded":"2024-09-12T00:38:37.413500+0000","last_fullsized":"2024-09-12T00:38:37.413500+0000","mapping_epoch":24,"log_start":"261'400","ondisk_log_start":"261'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:37.804939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2183609,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":719,"num_read_kb":1717,"num_write":1227,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":510,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.379940+0000","last_change":"2024-09-12T00:01:48.515417+0000","last_active":"2024-09-12T00:34:19.379940+0000","last_peered":"2024-09-12T00:34:19.379940+0000","last_clean":"2024-09-12T00:34:19.379940+0000","last_became_active":"2024-09-12T00:01:46.502847+0000","last_became_peered":"2024-09-12T00:01:46.502847+0000","last_unstale":"2024-09-12T00:34:19.379940+0000","last_undegraded":"2024-09-12T00:34:19.379940+0000","last_fullsized":"2024-09-12T00:34:19.379940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:49.727360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:07.515474+0000","last_change":"2024-09-12T00:02:01.152727+0000","last_active":"2024-09-12T00:36:07.515474+0000","last_peered":"2024-09-12T00:36:07.515474+0000","last_clean":"2024-09-12T00:36:07.515474+0000","last_became_active":"2024-09-12T00:02:01.152467+0000","last_became_peered":"2024-09-12T00:02:01.152467+0000","last_unstale":"2024-09-12T00:36:07.515474+0000","last_undegraded":"2024-09-12T00:36:07.515474+0000","last_fullsized":"2024-09-12T00:36:07.515474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:32.840264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'734","reported_seq":1432,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.912719+0000","last_change":"2024-09-12T00:02:03.151458+0000","last_active":"2024-09-12T00:38:28.912719+0000","last_peered":"2024-09-12T00:38:28.912719+0000","last_clean":"2024-09-12T00:38:28.912719+0000","last_became_active":"2024-09-12T00:02:03.151140+0000","last_became_peered":"2024-09-12T00:02:03.151140+0000","last_unstale":"2024-09-12T00:38:28.912719+0000","last_undegraded":"2024-09-12T00:38:28.912719+0000","last_fullsized":"2024-09-12T00:38:28.912719+0000","mapping_epoch":30,"log_start":"261'700","ondisk_log_start":"261'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:44.111850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174334,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1303,"num_read_kb":2810,"num_write":1090,"num_write_kb":924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:27.509341+0000","last_change":"2024-09-12T00:02:05.169087+0000","last_active":"2024-09-12T00:35:27.509341+0000","last_peered":"2024-09-12T00:35:27.509341+0000","last_clean":"2024-09-12T00:35:27.509341+0000","last_became_active":"2024-09-12T00:02:05.168419+0000","last_became_peered":"2024-09-12T00:02:05.168419+0000","last_unstale":"2024-09-12T00:35:27.509341+0000","last_undegraded":"2024-09-12T00:35:27.509341+0000","last_fullsized":"2024-09-12T00:35:27.509341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:37.208808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'139","reported_seq":629,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.772962+0000","last_change":"2024-09-12T00:02:07.170358+0000","last_active":"2024-09-12T00:37:10.772962+0000","last_peered":"2024-09-12T00:37:10.772962+0000","last_clean":"2024-09-12T00:37:10.772962+0000","last_became_active":"2024-09-12T00:02:07.169937+0000","last_became_peered":"2024-09-12T00:02:07.169937+0000","last_unstale":"2024-09-12T00:37:10.772962+0000","last_undegraded":"2024-09-12T00:37:10.772962+0000","last_fullsized":"2024-09-12T00:37:10.772962+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:08.055256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":184,"num_read_kb":169,"num_write":343,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'133","reported_seq":678,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.561260+0000","last_change":"2024-09-12T00:02:07.173368+0000","last_active":"2024-09-12T00:37:23.561260+0000","last_peered":"2024-09-12T00:37:23.561260+0000","last_clean":"2024-09-12T00:37:23.561260+0000","last_became_active":"2024-09-12T00:02:07.173094+0000","last_became_peered":"2024-09-12T00:02:07.173094+0000","last_unstale":"2024-09-12T00:37:23.561260+0000","last_undegraded":"2024-09-12T00:37:23.561260+0000","last_fullsized":"2024-09-12T00:37:23.561260+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:56.973946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":191,"num_read_kb":191,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'183","reported_seq":771,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:23.610776+0000","last_change":"2024-09-12T00:01:59.154754+0000","last_active":"2024-09-12T00:36:23.610776+0000","last_peered":"2024-09-12T00:36:23.610776+0000","last_clean":"2024-09-12T00:36:23.610776+0000","last_became_active":"2024-09-12T00:01:59.154463+0000","last_became_peered":"2024-09-12T00:01:59.154463+0000","last_unstale":"2024-09-12T00:36:23.610776+0000","last_undegraded":"2024-09-12T00:36:23.610776+0000","last_fullsized":"2024-09-12T00:36:23.610776+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:22.287932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":794,"num_read_kb":651,"num_write":258,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'276","reported_seq":912,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.416968+0000","last_change":"2024-09-12T00:01:57.164242+0000","last_active":"2024-09-12T00:37:21.416968+0000","last_peered":"2024-09-12T00:37:21.416968+0000","last_clean":"2024-09-12T00:37:21.416968+0000","last_became_active":"2024-09-12T00:01:57.163847+0000","last_became_peered":"2024-09-12T00:01:57.163847+0000","last_unstale":"2024-09-12T00:37:21.416968+0000","last_undegraded":"2024-09-12T00:37:21.416968+0000","last_fullsized":"2024-09-12T00:37:21.416968+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:14.319412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12961627,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":447,"num_read_kb":27210,"num_write":1041,"num_write_kb":33935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.500143+0000","last_change":"2024-09-12T00:02:01.144933+0000","last_active":"2024-09-12T00:34:44.500143+0000","last_peered":"2024-09-12T00:34:44.500143+0000","last_clean":"2024-09-12T00:34:44.500143+0000","last_became_active":"2024-09-12T00:02:01.144579+0000","last_became_peered":"2024-09-12T00:02:01.144579+0000","last_unstale":"2024-09-12T00:34:44.500143+0000","last_undegraded":"2024-09-12T00:34:44.500143+0000","last_fullsized":"2024-09-12T00:34:44.500143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:13.618101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'291","reported_seq":846,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.519550+0000","last_change":"2024-09-12T00:02:03.155013+0000","last_active":"2024-09-12T00:37:04.519550+0000","last_peered":"2024-09-12T00:37:04.519550+0000","last_clean":"2024-09-12T00:37:04.519550+0000","last_became_active":"2024-09-12T00:02:03.154710+0000","last_became_peered":"2024-09-12T00:02:03.154710+0000","last_unstale":"2024-09-12T00:37:04.519550+0000","last_undegraded":"2024-09-12T00:37:04.519550+0000","last_fullsized":"2024-09-12T00:37:04.519550+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:23.714644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55995,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":456,"num_read_kb":934,"num_write":382,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.500232+0000","last_change":"2024-09-12T00:02:05.163654+0000","last_active":"2024-09-12T00:34:44.500232+0000","last_peered":"2024-09-12T00:34:44.500232+0000","last_clean":"2024-09-12T00:34:44.500232+0000","last_became_active":"2024-09-12T00:02:05.163389+0000","last_became_peered":"2024-09-12T00:02:05.163389+0000","last_unstale":"2024-09-12T00:34:44.500232+0000","last_undegraded":"2024-09-12T00:34:44.500232+0000","last_fullsized":"2024-09-12T00:34:44.500232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:54.688629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'116","reported_seq":591,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.374469+0000","last_change":"2024-09-12T00:02:07.172652+0000","last_active":"2024-09-12T00:37:06.374469+0000","last_peered":"2024-09-12T00:37:06.374469+0000","last_clean":"2024-09-12T00:37:06.374469+0000","last_became_active":"2024-09-12T00:02:07.172360+0000","last_became_peered":"2024-09-12T00:02:07.172360+0000","last_unstale":"2024-09-12T00:37:06.374469+0000","last_undegraded":"2024-09-12T00:37:06.374469+0000","last_fullsized":"2024-09-12T00:37:06.374469+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:50.938865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'116","reported_seq":715,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:38.799905+0000","last_change":"2024-09-12T00:01:59.155610+0000","last_active":"2024-09-12T00:36:38.799905+0000","last_peered":"2024-09-12T00:36:38.799905+0000","last_clean":"2024-09-12T00:36:38.799905+0000","last_became_active":"2024-09-12T00:01:59.155287+0000","last_became_peered":"2024-09-12T00:01:59.155287+0000","last_unstale":"2024-09-12T00:36:38.799905+0000","last_undegraded":"2024-09-12T00:36:38.799905+0000","last_fullsized":"2024-09-12T00:36:38.799905+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:33.145869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":525,"num_read_kb":443,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'272","reported_seq":906,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.033160+0000","last_change":"2024-09-12T00:01:57.150227+0000","last_active":"2024-09-12T00:38:27.033160+0000","last_peered":"2024-09-12T00:38:27.033160+0000","last_clean":"2024-09-12T00:38:27.033160+0000","last_became_active":"2024-09-12T00:01:57.144743+0000","last_became_peered":"2024-09-12T00:01:57.144743+0000","last_unstale":"2024-09-12T00:38:27.033160+0000","last_undegraded":"2024-09-12T00:38:27.033160+0000","last_fullsized":"2024-09-12T00:38:27.033160+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:04.356175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6732343,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":428,"num_read_kb":7937,"num_write":966,"num_write_kb":13946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:42.502624+0000","last_change":"2024-09-12T00:02:01.151142+0000","last_active":"2024-09-12T00:34:42.502624+0000","last_peered":"2024-09-12T00:34:42.502624+0000","last_clean":"2024-09-12T00:34:42.502624+0000","last_became_active":"2024-09-12T00:02:01.150857+0000","last_became_peered":"2024-09-12T00:02:01.150857+0000","last_unstale":"2024-09-12T00:34:42.502624+0000","last_undegraded":"2024-09-12T00:34:42.502624+0000","last_fullsized":"2024-09-12T00:34:42.502624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:45.672680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'41","reported_seq":534,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:38.801722+0000","last_change":"2024-09-12T00:02:03.150541+0000","last_active":"2024-09-12T00:36:38.801722+0000","last_peered":"2024-09-12T00:36:38.801722+0000","last_clean":"2024-09-12T00:36:38.801722+0000","last_became_active":"2024-09-12T00:02:03.149558+0000","last_became_peered":"2024-09-12T00:02:03.149558+0000","last_unstale":"2024-09-12T00:36:38.801722+0000","last_undegraded":"2024-09-12T00:36:38.801722+0000","last_fullsized":"2024-09-12T00:36:38.801722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:42.429865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":469,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.617409+0000","last_change":"2024-09-12T00:02:05.171121+0000","last_active":"2024-09-12T00:34:44.617409+0000","last_peered":"2024-09-12T00:34:44.617409+0000","last_clean":"2024-09-12T00:34:44.617409+0000","last_became_active":"2024-09-12T00:02:05.170836+0000","last_became_peered":"2024-09-12T00:02:05.170836+0000","last_unstale":"2024-09-12T00:34:44.617409+0000","last_undegraded":"2024-09-12T00:34:44.617409+0000","last_fullsized":"2024-09-12T00:34:44.617409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:00.009417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'258","reported_seq":776,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.055886+0000","last_change":"2024-09-12T00:02:07.168954+0000","last_active":"2024-09-12T00:37:23.055886+0000","last_peered":"2024-09-12T00:37:23.055886+0000","last_clean":"2024-09-12T00:37:23.055886+0000","last_became_active":"2024-09-12T00:02:07.168678+0000","last_became_peered":"2024-09-12T00:02:07.168678+0000","last_unstale":"2024-09-12T00:37:23.055886+0000","last_undegraded":"2024-09-12T00:37:23.055886+0000","last_fullsized":"2024-09-12T00:37:23.055886+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:23.449987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":392,"num_read_kb":368,"num_write":602,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'4088","reported_seq":4638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:42.502575+0000","last_change":"2024-09-12T00:01:59.154536+0000","last_active":"2024-09-12T00:34:42.502575+0000","last_peered":"2024-09-12T00:34:42.502575+0000","last_clean":"2024-09-12T00:34:42.502575+0000","last_became_active":"2024-09-12T00:01:59.154260+0000","last_became_peered":"2024-09-12T00:01:59.154260+0000","last_unstale":"2024-09-12T00:34:42.502575+0000","last_undegraded":"2024-09-12T00:34:42.502575+0000","last_fullsized":"2024-09-12T00:34:42.502575+0000","mapping_epoch":26,"log_start":"261'4000","ondisk_log_start":"261'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:35.639955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16394,"num_read_kb":13744,"num_write":6133,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'238","reported_seq":832,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.060926+0000","last_change":"2024-09-12T00:01:57.160338+0000","last_active":"2024-09-12T00:37:09.060926+0000","last_peered":"2024-09-12T00:37:09.060926+0000","last_clean":"2024-09-12T00:37:09.060926+0000","last_became_active":"2024-09-12T00:01:57.158677+0000","last_became_peered":"2024-09-12T00:01:57.158677+0000","last_unstale":"2024-09-12T00:37:09.060926+0000","last_undegraded":"2024-09-12T00:37:09.060926+0000","last_fullsized":"2024-09-12T00:37:09.060926+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:16.844146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9635143,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":338,"num_read_kb":56505,"num_write":875,"num_write_kb":31346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.617371+0000","last_change":"2024-09-12T00:02:01.155814+0000","last_active":"2024-09-12T00:34:44.617371+0000","last_peered":"2024-09-12T00:34:44.617371+0000","last_clean":"2024-09-12T00:34:44.617371+0000","last_became_active":"2024-09-12T00:02:01.155490+0000","last_became_peered":"2024-09-12T00:02:01.155490+0000","last_unstale":"2024-09-12T00:34:44.617371+0000","last_undegraded":"2024-09-12T00:34:44.617371+0000","last_fullsized":"2024-09-12T00:34:44.617371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:27.105020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'279","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.519632+0000","last_change":"2024-09-12T00:02:03.149010+0000","last_active":"2024-09-12T00:37:04.519632+0000","last_peered":"2024-09-12T00:37:04.519632+0000","last_clean":"2024-09-12T00:37:04.519632+0000","last_became_active":"2024-09-12T00:02:03.148690+0000","last_became_peered":"2024-09-12T00:02:03.148690+0000","last_unstale":"2024-09-12T00:37:04.519632+0000","last_undegraded":"2024-09-12T00:37:04.519632+0000","last_fullsized":"2024-09-12T00:37:04.519632+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:39.130947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49452,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":914,"num_write":368,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:46.499667+0000","last_change":"2024-09-12T00:02:05.168740+0000","last_active":"2024-09-12T00:34:46.499667+0000","last_peered":"2024-09-12T00:34:46.499667+0000","last_clean":"2024-09-12T00:34:46.499667+0000","last_became_active":"2024-09-12T00:02:05.168232+0000","last_became_peered":"2024-09-12T00:02:05.168232+0000","last_unstale":"2024-09-12T00:34:46.499667+0000","last_undegraded":"2024-09-12T00:34:46.499667+0000","last_fullsized":"2024-09-12T00:34:46.499667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:43.713032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'134","reported_seq":667,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.879910+0000","last_change":"2024-09-12T00:02:07.169044+0000","last_active":"2024-09-12T00:36:58.879910+0000","last_peered":"2024-09-12T00:36:58.879910+0000","last_clean":"2024-09-12T00:36:58.879910+0000","last_became_active":"2024-09-12T00:02:07.168747+0000","last_became_peered":"2024-09-12T00:02:07.168747+0000","last_unstale":"2024-09-12T00:36:58.879910+0000","last_undegraded":"2024-09-12T00:36:58.879910+0000","last_fullsized":"2024-09-12T00:36:58.879910+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:23.448210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":291,"num_read_kb":255,"num_write":337,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'104","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.673042+0000","last_change":"2024-09-12T00:01:59.155125+0000","last_active":"2024-09-12T00:37:09.673042+0000","last_peered":"2024-09-12T00:37:09.673042+0000","last_clean":"2024-09-12T00:37:09.673042+0000","last_became_active":"2024-09-12T00:01:59.154848+0000","last_became_peered":"2024-09-12T00:01:59.154848+0000","last_unstale":"2024-09-12T00:37:09.673042+0000","last_undegraded":"2024-09-12T00:37:09.673042+0000","last_fullsized":"2024-09-12T00:37:09.673042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:47.132457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":392,"num_write":152,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'253","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:22.215022+0000","last_change":"2024-09-12T00:01:57.142768+0000","last_active":"2024-09-12T00:36:22.215022+0000","last_peered":"2024-09-12T00:36:22.215022+0000","last_clean":"2024-09-12T00:36:22.215022+0000","last_became_active":"2024-09-12T00:01:57.142385+0000","last_became_peered":"2024-09-12T00:01:57.142385+0000","last_unstale":"2024-09-12T00:36:22.215022+0000","last_undegraded":"2024-09-12T00:36:22.215022+0000","last_fullsized":"2024-09-12T00:36:22.215022+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:28.588091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2776446,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":554,"num_read_kb":9162,"num_write":973,"num_write_kb":16984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.383518+0000","last_change":"2024-09-12T00:02:01.154218+0000","last_active":"2024-09-12T00:34:44.383518+0000","last_peered":"2024-09-12T00:34:44.383518+0000","last_clean":"2024-09-12T00:34:44.383518+0000","last_became_active":"2024-09-12T00:02:01.153906+0000","last_became_peered":"2024-09-12T00:02:01.153906+0000","last_unstale":"2024-09-12T00:34:44.383518+0000","last_undegraded":"2024-09-12T00:34:44.383518+0000","last_fullsized":"2024-09-12T00:34:44.383518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:16.965088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'244","reported_seq":798,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.400722+0000","last_change":"2024-09-12T00:02:03.155251+0000","last_active":"2024-09-12T00:37:04.400722+0000","last_peered":"2024-09-12T00:37:04.400722+0000","last_clean":"2024-09-12T00:37:04.400722+0000","last_became_active":"2024-09-12T00:02:03.154896+0000","last_became_peered":"2024-09-12T00:02:03.154896+0000","last_unstale":"2024-09-12T00:37:04.400722+0000","last_undegraded":"2024-09-12T00:37:04.400722+0000","last_fullsized":"2024-09-12T00:37:04.400722+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:31.639970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54781,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":400,"num_read_kb":853,"num_write":328,"num_write_kb":274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.500273+0000","last_change":"2024-09-12T00:02:05.162572+0000","last_active":"2024-09-12T00:34:44.500273+0000","last_peered":"2024-09-12T00:34:44.500273+0000","last_clean":"2024-09-12T00:34:44.500273+0000","last_became_active":"2024-09-12T00:02:05.162204+0000","last_became_peered":"2024-09-12T00:02:05.162204+0000","last_unstale":"2024-09-12T00:34:44.500273+0000","last_undegraded":"2024-09-12T00:34:44.500273+0000","last_fullsized":"2024-09-12T00:34:44.500273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:56.188492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'125","reported_seq":678,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:22.357033+0000","last_change":"2024-09-12T00:01:59.145758+0000","last_active":"2024-09-12T00:36:22.357033+0000","last_peered":"2024-09-12T00:36:22.357033+0000","last_clean":"2024-09-12T00:36:22.357033+0000","last_became_active":"2024-09-12T00:01:59.145456+0000","last_became_peered":"2024-09-12T00:01:59.145456+0000","last_unstale":"2024-09-12T00:36:22.357033+0000","last_undegraded":"2024-09-12T00:36:22.357033+0000","last_fullsized":"2024-09-12T00:36:22.357033+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:45.253029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":512,"num_read_kb":415,"num_write":196,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'302","reported_seq":933,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:25.575893+0000","last_change":"2024-09-12T00:01:57.144156+0000","last_active":"2024-09-12T00:36:25.575893+0000","last_peered":"2024-09-12T00:36:25.575893+0000","last_clean":"2024-09-12T00:36:25.575893+0000","last_became_active":"2024-09-12T00:01:57.143684+0000","last_became_peered":"2024-09-12T00:01:57.143684+0000","last_unstale":"2024-09-12T00:36:25.575893+0000","last_undegraded":"2024-09-12T00:36:25.575893+0000","last_fullsized":"2024-09-12T00:36:25.575893+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:44.165024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6831063,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":432,"num_read_kb":22065,"num_write":1132,"num_write_kb":32922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:09.512535+0000","last_change":"2024-09-12T00:02:01.154936+0000","last_active":"2024-09-12T00:36:09.512535+0000","last_peered":"2024-09-12T00:36:09.512535+0000","last_clean":"2024-09-12T00:36:09.512535+0000","last_became_active":"2024-09-12T00:02:01.154541+0000","last_became_peered":"2024-09-12T00:02:01.154541+0000","last_unstale":"2024-09-12T00:36:09.512535+0000","last_undegraded":"2024-09-12T00:36:09.512535+0000","last_fullsized":"2024-09-12T00:36:09.512535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:34.459769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'480","reported_seq":1086,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.909459+0000","last_change":"2024-09-12T00:02:03.158651+0000","last_active":"2024-09-12T00:38:28.909459+0000","last_peered":"2024-09-12T00:38:28.909459+0000","last_clean":"2024-09-12T00:38:28.909459+0000","last_became_active":"2024-09-12T00:02:03.158360+0000","last_became_peered":"2024-09-12T00:02:03.158360+0000","last_unstale":"2024-09-12T00:38:28.909459+0000","last_undegraded":"2024-09-12T00:38:28.909459+0000","last_fullsized":"2024-09-12T00:38:28.909459+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:44.063536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115135,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":865,"num_read_kb":1864,"num_write":756,"num_write_kb":679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":468,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615861+0000","last_change":"2024-09-12T00:02:05.167419+0000","last_active":"2024-09-12T00:34:34.615861+0000","last_peered":"2024-09-12T00:34:34.615861+0000","last_clean":"2024-09-12T00:34:34.615861+0000","last_became_active":"2024-09-12T00:02:05.167052+0000","last_became_peered":"2024-09-12T00:02:05.167052+0000","last_unstale":"2024-09-12T00:34:34.615861+0000","last_undegraded":"2024-09-12T00:34:34.615861+0000","last_fullsized":"2024-09-12T00:34:34.615861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:41.679779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'206","reported_seq":704,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.939992+0000","last_change":"2024-09-12T00:02:07.167621+0000","last_active":"2024-09-12T00:37:22.939992+0000","last_peered":"2024-09-12T00:37:22.939992+0000","last_clean":"2024-09-12T00:37:22.939992+0000","last_became_active":"2024-09-12T00:02:07.167331+0000","last_became_peered":"2024-09-12T00:02:07.167331+0000","last_unstale":"2024-09-12T00:37:22.939992+0000","last_undegraded":"2024-09-12T00:37:22.939992+0000","last_fullsized":"2024-09-12T00:37:22.939992+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:21.029667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":483,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'398","reported_seq":1157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:57.885047+0000","last_change":"2024-09-12T00:01:59.150197+0000","last_active":"2024-09-12T00:36:57.885047+0000","last_peered":"2024-09-12T00:36:57.885047+0000","last_clean":"2024-09-12T00:36:57.885047+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:36:57.885047+0000","last_undegraded":"2024-09-12T00:36:57.885047+0000","last_fullsized":"2024-09-12T00:36:57.885047+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:47.950131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1910,"num_read_kb":1650,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'335","reported_seq":1011,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.489466+0000","last_change":"2024-09-12T00:01:57.142382+0000","last_active":"2024-09-12T00:38:37.489466+0000","last_peered":"2024-09-12T00:38:37.489466+0000","last_clean":"2024-09-12T00:38:37.489466+0000","last_became_active":"2024-09-12T00:01:57.141998+0000","last_became_peered":"2024-09-12T00:01:57.141998+0000","last_unstale":"2024-09-12T00:38:37.489466+0000","last_undegraded":"2024-09-12T00:38:37.489466+0000","last_fullsized":"2024-09-12T00:38:37.489466+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:28.887996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":587,"num_read_kb":1840,"num_write":1187,"num_write_kb":17126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.623582+0000","last_change":"2024-09-12T00:02:01.153965+0000","last_active":"2024-09-12T00:35:24.623582+0000","last_peered":"2024-09-12T00:35:24.623582+0000","last_clean":"2024-09-12T00:35:24.623582+0000","last_became_active":"2024-09-12T00:02:01.153611+0000","last_became_peered":"2024-09-12T00:02:01.153611+0000","last_unstale":"2024-09-12T00:35:24.623582+0000","last_undegraded":"2024-09-12T00:35:24.623582+0000","last_fullsized":"2024-09-12T00:35:24.623582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:43.203100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'279","reported_seq":838,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.598694+0000","last_change":"2024-09-12T00:02:03.155107+0000","last_active":"2024-09-12T00:38:27.598694+0000","last_peered":"2024-09-12T00:38:27.598694+0000","last_clean":"2024-09-12T00:38:27.598694+0000","last_became_active":"2024-09-12T00:02:03.154821+0000","last_became_peered":"2024-09-12T00:02:03.154821+0000","last_unstale":"2024-09-12T00:38:27.598694+0000","last_undegraded":"2024-09-12T00:38:27.598694+0000","last_fullsized":"2024-09-12T00:38:27.598694+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:25.034969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54123,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":452,"num_read_kb":904,"num_write":380,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":473,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499293+0000","last_change":"2024-09-12T00:02:05.170002+0000","last_active":"2024-09-12T00:34:34.499293+0000","last_peered":"2024-09-12T00:34:34.499293+0000","last_clean":"2024-09-12T00:34:34.499293+0000","last_became_active":"2024-09-12T00:02:05.169726+0000","last_became_peered":"2024-09-12T00:02:05.169726+0000","last_unstale":"2024-09-12T00:34:34.499293+0000","last_undegraded":"2024-09-12T00:34:34.499293+0000","last_fullsized":"2024-09-12T00:34:34.499293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:22.827175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'193","reported_seq":1061,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.503992+0000","last_change":"2024-09-12T00:02:07.175207+0000","last_active":"2024-09-12T00:37:22.503992+0000","last_peered":"2024-09-12T00:37:22.503992+0000","last_clean":"2024-09-12T00:37:22.503992+0000","last_became_active":"2024-09-12T00:02:07.174910+0000","last_became_peered":"2024-09-12T00:02:07.174910+0000","last_unstale":"2024-09-12T00:37:22.503992+0000","last_undegraded":"2024-09-12T00:37:22.503992+0000","last_fullsized":"2024-09-12T00:37:22.503992+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:19.459374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":668,"num_read_kb":649,"num_write":556,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'98","reported_seq":665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.598641+0000","last_change":"2024-09-12T00:01:59.151423+0000","last_active":"2024-09-12T00:37:02.598641+0000","last_peered":"2024-09-12T00:37:02.598641+0000","last_clean":"2024-09-12T00:37:02.598641+0000","last_became_active":"2024-09-12T00:01:59.151143+0000","last_became_peered":"2024-09-12T00:01:59.151143+0000","last_unstale":"2024-09-12T00:37:02.598641+0000","last_undegraded":"2024-09-12T00:37:02.598641+0000","last_fullsized":"2024-09-12T00:37:02.598641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:08.277331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":451,"num_read_kb":380,"num_write":139,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'251","reported_seq":839,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.489562+0000","last_change":"2024-09-12T00:01:57.142179+0000","last_active":"2024-09-12T00:38:36.489562+0000","last_peered":"2024-09-12T00:38:36.489562+0000","last_clean":"2024-09-12T00:38:36.489562+0000","last_became_active":"2024-09-12T00:01:57.141789+0000","last_became_peered":"2024-09-12T00:01:57.141789+0000","last_unstale":"2024-09-12T00:38:36.489562+0000","last_undegraded":"2024-09-12T00:38:36.489562+0000","last_fullsized":"2024-09-12T00:38:36.489562+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:44.370591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10815112,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":334,"num_read_kb":31078,"num_write":835,"num_write_kb":48318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615850+0000","last_change":"2024-09-12T00:02:01.154963+0000","last_active":"2024-09-12T00:34:34.615850+0000","last_peered":"2024-09-12T00:34:34.615850+0000","last_clean":"2024-09-12T00:34:34.615850+0000","last_became_active":"2024-09-12T00:02:01.154530+0000","last_became_peered":"2024-09-12T00:02:01.154530+0000","last_unstale":"2024-09-12T00:34:34.615850+0000","last_undegraded":"2024-09-12T00:34:34.615850+0000","last_fullsized":"2024-09-12T00:34:34.615850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:06.651100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'283","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:23.550648+0000","last_change":"2024-09-12T00:02:03.156889+0000","last_active":"2024-09-12T00:38:23.550648+0000","last_peered":"2024-09-12T00:38:23.550648+0000","last_clean":"2024-09-12T00:38:23.550648+0000","last_became_active":"2024-09-12T00:02:03.156529+0000","last_became_peered":"2024-09-12T00:02:03.156529+0000","last_unstale":"2024-09-12T00:38:23.550648+0000","last_undegraded":"2024-09-12T00:38:23.550648+0000","last_fullsized":"2024-09-12T00:38:23.550648+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:52.310627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66765,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":1019,"num_write":396,"num_write_kb":333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":473,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:09.512584+0000","last_change":"2024-09-12T00:02:05.164244+0000","last_active":"2024-09-12T00:36:09.512584+0000","last_peered":"2024-09-12T00:36:09.512584+0000","last_clean":"2024-09-12T00:36:09.512584+0000","last_became_active":"2024-09-12T00:02:05.163956+0000","last_became_peered":"2024-09-12T00:02:05.163956+0000","last_unstale":"2024-09-12T00:36:09.512584+0000","last_undegraded":"2024-09-12T00:36:09.512584+0000","last_fullsized":"2024-09-12T00:36:09.512584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:58.031555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'127","reported_seq":603,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.940297+0000","last_change":"2024-09-12T00:02:07.172798+0000","last_active":"2024-09-12T00:38:28.940297+0000","last_peered":"2024-09-12T00:38:28.940297+0000","last_clean":"2024-09-12T00:38:28.940297+0000","last_became_active":"2024-09-12T00:02:07.172496+0000","last_became_peered":"2024-09-12T00:02:07.172496+0000","last_unstale":"2024-09-12T00:38:28.940297+0000","last_undegraded":"2024-09-12T00:38:28.940297+0000","last_fullsized":"2024-09-12T00:38:28.940297+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:11.813869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":307,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'198","reported_seq":828,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:13.741103+0000","last_change":"2024-09-12T00:01:59.149165+0000","last_active":"2024-09-12T00:36:13.741103+0000","last_peered":"2024-09-12T00:36:13.741103+0000","last_clean":"2024-09-12T00:36:13.741103+0000","last_became_active":"2024-09-12T00:01:59.148559+0000","last_became_peered":"2024-09-12T00:01:59.148559+0000","last_unstale":"2024-09-12T00:36:13.741103+0000","last_undegraded":"2024-09-12T00:36:13.741103+0000","last_fullsized":"2024-09-12T00:36:13.741103+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:56.810526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":733,"num_write":278,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'356","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.522107+0000","last_change":"2024-09-12T00:01:57.145004+0000","last_active":"2024-09-12T00:38:37.522107+0000","last_peered":"2024-09-12T00:38:37.522107+0000","last_clean":"2024-09-12T00:38:37.522107+0000","last_became_active":"2024-09-12T00:01:57.144397+0000","last_became_peered":"2024-09-12T00:01:57.144397+0000","last_unstale":"2024-09-12T00:38:37.522107+0000","last_undegraded":"2024-09-12T00:38:37.522107+0000","last_fullsized":"2024-09-12T00:38:37.522107+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:00.869585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293811,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":551,"num_read_kb":18154,"num_write":1202,"num_write_kb":40983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'5","reported_seq":968,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.454747+0000","last_change":"2024-09-12T00:02:01.152013+0000","last_active":"2024-09-12T00:38:35.454747+0000","last_peered":"2024-09-12T00:38:35.454747+0000","last_clean":"2024-09-12T00:38:35.454747+0000","last_became_active":"2024-09-12T00:02:01.151739+0000","last_became_peered":"2024-09-12T00:02:01.151739+0000","last_unstale":"2024-09-12T00:38:35.454747+0000","last_undegraded":"2024-09-12T00:38:35.454747+0000","last_fullsized":"2024-09-12T00:38:35.454747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:45.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'84","reported_seq":593,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.062825+0000","last_change":"2024-09-12T00:02:03.154234+0000","last_active":"2024-09-12T00:37:23.062825+0000","last_peered":"2024-09-12T00:37:23.062825+0000","last_clean":"2024-09-12T00:37:23.062825+0000","last_became_active":"2024-09-12T00:02:03.153948+0000","last_became_peered":"2024-09-12T00:02:03.153948+0000","last_unstale":"2024-09-12T00:37:23.062825+0000","last_undegraded":"2024-09-12T00:37:23.062825+0000","last_fullsized":"2024-09-12T00:37:23.062825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:26.035209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":128,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'761","reported_seq":4276,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.951944+0000","last_change":"2024-09-12T00:02:05.170722+0000","last_active":"2024-09-12T00:38:28.951944+0000","last_peered":"2024-09-12T00:38:28.951944+0000","last_clean":"2024-09-12T00:38:28.951944+0000","last_became_active":"2024-09-12T00:02:05.170399+0000","last_became_peered":"2024-09-12T00:02:05.170399+0000","last_unstale":"2024-09-12T00:38:28.951944+0000","last_undegraded":"2024-09-12T00:38:28.951944+0000","last_fullsized":"2024-09-12T00:38:28.951944+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:06.211117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'118","reported_seq":604,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.949325+0000","last_change":"2024-09-12T00:02:07.173296+0000","last_active":"2024-09-12T00:37:06.949325+0000","last_peered":"2024-09-12T00:37:06.949325+0000","last_clean":"2024-09-12T00:37:06.949325+0000","last_became_active":"2024-09-12T00:02:07.173030+0000","last_became_peered":"2024-09-12T00:02:07.173030+0000","last_unstale":"2024-09-12T00:37:06.949325+0000","last_undegraded":"2024-09-12T00:37:06.949325+0000","last_fullsized":"2024-09-12T00:37:06.949325+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:13.276457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":288,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'244","reported_seq":873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.077246+0000","last_change":"2024-09-12T00:01:59.152008+0000","last_active":"2024-09-12T00:36:50.077246+0000","last_peered":"2024-09-12T00:36:50.077246+0000","last_clean":"2024-09-12T00:36:50.077246+0000","last_became_active":"2024-09-12T00:01:59.151743+0000","last_became_peered":"2024-09-12T00:01:59.151743+0000","last_unstale":"2024-09-12T00:36:50.077246+0000","last_undegraded":"2024-09-12T00:36:50.077246+0000","last_fullsized":"2024-09-12T00:36:50.077246+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:35.993592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1082,"num_read_kb":884,"num_write":389,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'263","reported_seq":860,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.448347+0000","last_change":"2024-09-12T00:01:57.145465+0000","last_active":"2024-09-12T00:38:36.448347+0000","last_peered":"2024-09-12T00:38:36.448347+0000","last_clean":"2024-09-12T00:38:36.448347+0000","last_became_active":"2024-09-12T00:01:57.144946+0000","last_became_peered":"2024-09-12T00:01:57.144946+0000","last_unstale":"2024-09-12T00:38:36.448347+0000","last_undegraded":"2024-09-12T00:38:36.448347+0000","last_fullsized":"2024-09-12T00:38:36.448347+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:23.104871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41902,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":369,"num_read_kb":501,"num_write":918,"num_write_kb":20369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:31.497576+0000","last_change":"2024-09-12T00:02:01.152803+0000","last_active":"2024-09-12T00:34:31.497576+0000","last_peered":"2024-09-12T00:34:31.497576+0000","last_clean":"2024-09-12T00:34:31.497576+0000","last_became_active":"2024-09-12T00:02:01.152493+0000","last_became_peered":"2024-09-12T00:02:01.152493+0000","last_unstale":"2024-09-12T00:34:31.497576+0000","last_undegraded":"2024-09-12T00:34:31.497576+0000","last_fullsized":"2024-09-12T00:34:31.497576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:39.421026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'308","reported_seq":898,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.900764+0000","last_change":"2024-09-12T00:02:03.150973+0000","last_active":"2024-09-12T00:38:28.900764+0000","last_peered":"2024-09-12T00:38:28.900764+0000","last_clean":"2024-09-12T00:38:28.900764+0000","last_became_active":"2024-09-12T00:02:03.150631+0000","last_became_peered":"2024-09-12T00:02:03.150631+0000","last_unstale":"2024-09-12T00:38:28.900764+0000","last_undegraded":"2024-09-12T00:38:28.900764+0000","last_fullsized":"2024-09-12T00:38:28.900764+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:17.364587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78037,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":500,"num_read_kb":1028,"num_write":406,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.513886+0000","last_change":"2024-09-12T00:02:05.167377+0000","last_active":"2024-09-12T00:35:57.513886+0000","last_peered":"2024-09-12T00:35:57.513886+0000","last_clean":"2024-09-12T00:35:57.513886+0000","last_became_active":"2024-09-12T00:02:05.167082+0000","last_became_peered":"2024-09-12T00:02:05.167082+0000","last_unstale":"2024-09-12T00:35:57.513886+0000","last_undegraded":"2024-09-12T00:35:57.513886+0000","last_fullsized":"2024-09-12T00:35:57.513886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:04.610051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'123","reported_seq":614,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.557143+0000","last_change":"2024-09-12T00:02:07.173111+0000","last_active":"2024-09-12T00:38:27.557143+0000","last_peered":"2024-09-12T00:38:27.557143+0000","last_clean":"2024-09-12T00:38:27.557143+0000","last_became_active":"2024-09-12T00:02:07.172810+0000","last_became_peered":"2024-09-12T00:02:07.172810+0000","last_unstale":"2024-09-12T00:38:27.557143+0000","last_undegraded":"2024-09-12T00:38:27.557143+0000","last_fullsized":"2024-09-12T00:38:27.557143+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:47.728676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":135,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'223","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:25.779475+0000","last_change":"2024-09-12T00:01:59.147668+0000","last_active":"2024-09-12T00:36:25.779475+0000","last_peered":"2024-09-12T00:36:25.779475+0000","last_clean":"2024-09-12T00:36:25.779475+0000","last_became_active":"2024-09-12T00:01:59.147373+0000","last_became_peered":"2024-09-12T00:01:59.147373+0000","last_unstale":"2024-09-12T00:36:25.779475+0000","last_undegraded":"2024-09-12T00:36:25.779475+0000","last_fullsized":"2024-09-12T00:36:25.779475+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:21.257179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1007,"num_read_kb":830,"num_write":359,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'231","reported_seq":826,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:11.086295+0000","last_change":"2024-09-12T00:01:57.161842+0000","last_active":"2024-09-12T00:37:11.086295+0000","last_peered":"2024-09-12T00:37:11.086295+0000","last_clean":"2024-09-12T00:37:11.086295+0000","last_became_active":"2024-09-12T00:01:57.161414+0000","last_became_peered":"2024-09-12T00:01:57.161414+0000","last_unstale":"2024-09-12T00:37:11.086295+0000","last_undegraded":"2024-09-12T00:37:11.086295+0000","last_fullsized":"2024-09-12T00:37:11.086295+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:03.307762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7211953,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":314,"num_read_kb":8089,"num_write":853,"num_write_kb":31185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615825+0000","last_change":"2024-09-12T00:02:01.152071+0000","last_active":"2024-09-12T00:34:34.615825+0000","last_peered":"2024-09-12T00:34:34.615825+0000","last_clean":"2024-09-12T00:34:34.615825+0000","last_became_active":"2024-09-12T00:02:01.151760+0000","last_became_peered":"2024-09-12T00:02:01.151760+0000","last_unstale":"2024-09-12T00:34:34.615825+0000","last_undegraded":"2024-09-12T00:34:34.615825+0000","last_fullsized":"2024-09-12T00:34:34.615825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:08.986013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'276","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.624371+0000","last_change":"2024-09-12T00:02:03.151005+0000","last_active":"2024-09-12T00:38:36.624371+0000","last_peered":"2024-09-12T00:38:36.624371+0000","last_clean":"2024-09-12T00:38:36.624371+0000","last_became_active":"2024-09-12T00:02:03.150714+0000","last_became_peered":"2024-09-12T00:02:03.150714+0000","last_unstale":"2024-09-12T00:38:36.624371+0000","last_undegraded":"2024-09-12T00:38:36.624371+0000","last_fullsized":"2024-09-12T00:38:36.624371+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:39.492995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52913,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1134,"num_write":392,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.393761+0000","last_change":"2024-09-12T00:02:05.171377+0000","last_active":"2024-09-12T00:35:59.393761+0000","last_peered":"2024-09-12T00:35:59.393761+0000","last_clean":"2024-09-12T00:35:59.393761+0000","last_became_active":"2024-09-12T00:02:05.170973+0000","last_became_peered":"2024-09-12T00:02:05.170973+0000","last_unstale":"2024-09-12T00:35:59.393761+0000","last_undegraded":"2024-09-12T00:35:59.393761+0000","last_fullsized":"2024-09-12T00:35:59.393761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:14.690020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'119","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:11.054534+0000","last_change":"2024-09-12T00:02:07.169559+0000","last_active":"2024-09-12T00:37:11.054534+0000","last_peered":"2024-09-12T00:37:11.054534+0000","last_clean":"2024-09-12T00:37:11.054534+0000","last_became_active":"2024-09-12T00:02:07.169266+0000","last_became_peered":"2024-09-12T00:02:07.169266+0000","last_unstale":"2024-09-12T00:37:11.054534+0000","last_undegraded":"2024-09-12T00:37:11.054534+0000","last_fullsized":"2024-09-12T00:37:11.054534+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:08.775255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":294,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'183","reported_seq":777,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:00.677198+0000","last_change":"2024-09-12T00:01:59.150196+0000","last_active":"2024-09-12T00:37:00.677198+0000","last_peered":"2024-09-12T00:37:00.677198+0000","last_clean":"2024-09-12T00:37:00.677198+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:37:00.677198+0000","last_undegraded":"2024-09-12T00:37:00.677198+0000","last_fullsized":"2024-09-12T00:37:00.677198+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:58.771289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":689,"num_write":284,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'370","reported_seq":1085,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.363565+0000","last_change":"2024-09-12T00:01:57.162027+0000","last_active":"2024-09-12T00:37:09.363565+0000","last_peered":"2024-09-12T00:37:09.363565+0000","last_clean":"2024-09-12T00:37:09.363565+0000","last_became_active":"2024-09-12T00:01:57.161612+0000","last_became_peered":"2024-09-12T00:01:57.161612+0000","last_unstale":"2024-09-12T00:37:09.363565+0000","last_undegraded":"2024-09-12T00:37:09.363565+0000","last_fullsized":"2024-09-12T00:37:09.363565+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:46.162850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6737995,"num_objects":82,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":696,"num_read_kb":15126,"num_write":1432,"num_write_kb":40840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:51.509280+0000","last_change":"2024-09-12T00:02:01.145374+0000","last_active":"2024-09-12T00:35:51.509280+0000","last_peered":"2024-09-12T00:35:51.509280+0000","last_clean":"2024-09-12T00:35:51.509280+0000","last_became_active":"2024-09-12T00:02:01.144558+0000","last_became_peered":"2024-09-12T00:02:01.144558+0000","last_unstale":"2024-09-12T00:35:51.509280+0000","last_undegraded":"2024-09-12T00:35:51.509280+0000","last_fullsized":"2024-09-12T00:35:51.509280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:59.388355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'258","reported_seq":800,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.519655+0000","last_change":"2024-09-12T00:02:03.154789+0000","last_active":"2024-09-12T00:37:04.519655+0000","last_peered":"2024-09-12T00:37:04.519655+0000","last_clean":"2024-09-12T00:37:04.519655+0000","last_became_active":"2024-09-12T00:02:03.154477+0000","last_became_peered":"2024-09-12T00:02:03.154477+0000","last_unstale":"2024-09-12T00:37:04.519655+0000","last_undegraded":"2024-09-12T00:37:04.519655+0000","last_fullsized":"2024-09-12T00:37:04.519655+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:25.591233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60035,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":426,"num_read_kb":949,"num_write":360,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.382052+0000","last_change":"2024-09-12T00:02:05.166486+0000","last_active":"2024-09-12T00:34:34.382052+0000","last_peered":"2024-09-12T00:34:34.382052+0000","last_clean":"2024-09-12T00:34:34.382052+0000","last_became_active":"2024-09-12T00:02:05.166141+0000","last_became_peered":"2024-09-12T00:02:05.166141+0000","last_unstale":"2024-09-12T00:34:34.382052+0000","last_undegraded":"2024-09-12T00:34:34.382052+0000","last_fullsized":"2024-09-12T00:34:34.382052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:12.751964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'186","reported_seq":1324,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.932224+0000","last_change":"2024-09-12T00:02:07.170137+0000","last_active":"2024-09-12T00:37:21.932224+0000","last_peered":"2024-09-12T00:37:21.932224+0000","last_clean":"2024-09-12T00:37:21.932224+0000","last_became_active":"2024-09-12T00:02:07.169812+0000","last_became_peered":"2024-09-12T00:02:07.169812+0000","last_unstale":"2024-09-12T00:37:21.932224+0000","last_undegraded":"2024-09-12T00:37:21.932224+0000","last_fullsized":"2024-09-12T00:37:21.932224+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:18.008023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1006,"num_read_kb":951,"num_write":452,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'117","reported_seq":665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.914183+0000","last_change":"2024-09-12T00:01:59.148574+0000","last_active":"2024-09-12T00:37:08.914183+0000","last_peered":"2024-09-12T00:37:08.914183+0000","last_clean":"2024-09-12T00:37:08.914183+0000","last_became_active":"2024-09-12T00:01:59.148253+0000","last_became_peered":"2024-09-12T00:01:59.148253+0000","last_unstale":"2024-09-12T00:37:08.914183+0000","last_undegraded":"2024-09-12T00:37:08.914183+0000","last_fullsized":"2024-09-12T00:37:08.914183+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:57.621477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":405,"num_write":165,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'320","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:38.904642+0000","last_change":"2024-09-12T00:01:57.138855+0000","last_active":"2024-09-12T00:36:38.904642+0000","last_peered":"2024-09-12T00:36:38.904642+0000","last_clean":"2024-09-12T00:36:38.904642+0000","last_became_active":"2024-09-12T00:01:57.138386+0000","last_became_peered":"2024-09-12T00:01:57.138386+0000","last_unstale":"2024-09-12T00:36:38.904642+0000","last_undegraded":"2024-09-12T00:36:38.904642+0000","last_fullsized":"2024-09-12T00:36:38.904642+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:56.658569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10748696,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":602,"num_read_kb":37451,"num_write":1125,"num_write_kb":32715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.513932+0000","last_change":"2024-09-12T00:02:01.153600+0000","last_active":"2024-09-12T00:35:57.513932+0000","last_peered":"2024-09-12T00:35:57.513932+0000","last_clean":"2024-09-12T00:35:57.513932+0000","last_became_active":"2024-09-12T00:02:01.153306+0000","last_became_peered":"2024-09-12T00:02:01.153306+0000","last_unstale":"2024-09-12T00:35:57.513932+0000","last_undegraded":"2024-09-12T00:35:57.513932+0000","last_fullsized":"2024-09-12T00:35:57.513932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:16.790631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'280","reported_seq":855,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.401570+0000","last_change":"2024-09-12T00:02:03.158753+0000","last_active":"2024-09-12T00:37:04.401570+0000","last_peered":"2024-09-12T00:37:04.401570+0000","last_clean":"2024-09-12T00:37:04.401570+0000","last_became_active":"2024-09-12T00:02:03.158379+0000","last_became_peered":"2024-09-12T00:02:03.158379+0000","last_unstale":"2024-09-12T00:37:04.401570+0000","last_undegraded":"2024-09-12T00:37:04.401570+0000","last_fullsized":"2024-09-12T00:37:04.401570+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:08.601813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60004,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":467,"num_read_kb":943,"num_write":374,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:37.502005+0000","last_change":"2024-09-12T00:02:05.160180+0000","last_active":"2024-09-12T00:34:37.502005+0000","last_peered":"2024-09-12T00:34:37.502005+0000","last_clean":"2024-09-12T00:34:37.502005+0000","last_became_active":"2024-09-12T00:02:05.159854+0000","last_became_peered":"2024-09-12T00:02:05.159854+0000","last_unstale":"2024-09-12T00:34:37.502005+0000","last_undegraded":"2024-09-12T00:34:37.502005+0000","last_fullsized":"2024-09-12T00:34:37.502005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.989519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'131","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.590853+0000","last_change":"2024-09-12T00:02:07.171050+0000","last_active":"2024-09-12T00:38:27.590853+0000","last_peered":"2024-09-12T00:38:27.590853+0000","last_clean":"2024-09-12T00:38:27.590853+0000","last_became_active":"2024-09-12T00:02:07.170727+0000","last_became_peered":"2024-09-12T00:02:07.170727+0000","last_unstale":"2024-09-12T00:38:27.590853+0000","last_undegraded":"2024-09-12T00:38:27.590853+0000","last_fullsized":"2024-09-12T00:38:27.590853+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:03.358486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":129,"num_write":315,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'247","reported_seq":907,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:49.863461+0000","last_change":"2024-09-12T00:01:59.145783+0000","last_active":"2024-09-12T00:36:49.863461+0000","last_peered":"2024-09-12T00:36:49.863461+0000","last_clean":"2024-09-12T00:36:49.863461+0000","last_became_active":"2024-09-12T00:01:59.145502+0000","last_became_peered":"2024-09-12T00:01:59.145502+0000","last_unstale":"2024-09-12T00:36:49.863461+0000","last_undegraded":"2024-09-12T00:36:49.863461+0000","last_fullsized":"2024-09-12T00:36:49.863461+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:15.171878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1128,"num_read_kb":927,"num_write":363,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'306","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:49.654143+0000","last_change":"2024-09-12T00:01:57.159976+0000","last_active":"2024-09-12T00:36:49.654143+0000","last_peered":"2024-09-12T00:36:49.654143+0000","last_clean":"2024-09-12T00:36:49.654143+0000","last_became_active":"2024-09-12T00:01:57.159487+0000","last_became_peered":"2024-09-12T00:01:57.159487+0000","last_unstale":"2024-09-12T00:36:49.654143+0000","last_undegraded":"2024-09-12T00:36:49.654143+0000","last_fullsized":"2024-09-12T00:36:49.654143+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:30.085074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16806712,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":510,"num_read_kb":54881,"num_write":1082,"num_write_kb":38301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'150","reported_seq":696,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.498309+0000","last_change":"2024-09-12T00:01:59.153656+0000","last_active":"2024-09-12T00:34:29.498309+0000","last_peered":"2024-09-12T00:34:29.498309+0000","last_clean":"2024-09-12T00:34:29.498309+0000","last_became_active":"2024-09-12T00:01:59.153340+0000","last_became_peered":"2024-09-12T00:01:59.153340+0000","last_unstale":"2024-09-12T00:34:29.498309+0000","last_undegraded":"2024-09-12T00:34:29.498309+0000","last_fullsized":"2024-09-12T00:34:29.498309+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:17.663369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":542,"num_write":243,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'257","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.292767+0000","last_change":"2024-09-12T00:01:57.152880+0000","last_active":"2024-09-12T00:37:07.292767+0000","last_peered":"2024-09-12T00:37:07.292767+0000","last_clean":"2024-09-12T00:37:07.292767+0000","last_became_active":"2024-09-12T00:01:57.152522+0000","last_became_peered":"2024-09-12T00:01:57.152522+0000","last_unstale":"2024-09-12T00:37:07.292767+0000","last_undegraded":"2024-09-12T00:37:07.292767+0000","last_fullsized":"2024-09-12T00:37:07.292767+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:20.467716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12224787,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":507,"num_read_kb":16299,"num_write":978,"num_write_kb":36902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'216","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:10.173233+0000","last_change":"2024-09-12T00:01:59.146252+0000","last_active":"2024-09-12T00:38:10.173233+0000","last_peered":"2024-09-12T00:38:10.173233+0000","last_clean":"2024-09-12T00:38:10.173233+0000","last_became_active":"2024-09-12T00:01:59.145971+0000","last_became_peered":"2024-09-12T00:01:59.145971+0000","last_unstale":"2024-09-12T00:38:10.173233+0000","last_undegraded":"2024-09-12T00:38:10.173233+0000","last_fullsized":"2024-09-12T00:38:10.173233+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:57.400027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":962,"num_read_kb":786,"num_write":321,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'290","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.821238+0000","last_change":"2024-09-12T00:01:57.168090+0000","last_active":"2024-09-12T00:36:56.821238+0000","last_peered":"2024-09-12T00:36:56.821238+0000","last_clean":"2024-09-12T00:36:56.821238+0000","last_became_active":"2024-09-12T00:01:57.167651+0000","last_became_peered":"2024-09-12T00:01:57.167651+0000","last_unstale":"2024-09-12T00:36:56.821238+0000","last_undegraded":"2024-09-12T00:36:56.821238+0000","last_fullsized":"2024-09-12T00:36:56.821238+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:47.430232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327545,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":424,"num_read_kb":6602,"num_write":1089,"num_write_kb":24145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'167","reported_seq":749,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.289614+0000","last_change":"2024-09-12T00:01:59.147316+0000","last_active":"2024-09-12T00:37:09.289614+0000","last_peered":"2024-09-12T00:37:09.289614+0000","last_clean":"2024-09-12T00:37:09.289614+0000","last_became_active":"2024-09-12T00:01:59.146794+0000","last_became_peered":"2024-09-12T00:01:59.146794+0000","last_unstale":"2024-09-12T00:37:09.289614+0000","last_undegraded":"2024-09-12T00:37:09.289614+0000","last_fullsized":"2024-09-12T00:37:09.289614+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:19.361635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":586,"num_write":261,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'231","reported_seq":837,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:26.672238+0000","last_change":"2024-09-12T00:01:57.145828+0000","last_active":"2024-09-12T00:36:26.672238+0000","last_peered":"2024-09-12T00:36:26.672238+0000","last_clean":"2024-09-12T00:36:26.672238+0000","last_became_active":"2024-09-12T00:01:57.145410+0000","last_became_peered":"2024-09-12T00:01:57.145410+0000","last_unstale":"2024-09-12T00:36:26.672238+0000","last_undegraded":"2024-09-12T00:36:26.672238+0000","last_fullsized":"2024-09-12T00:36:26.672238+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:43.346735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":472491,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":346,"num_read_kb":533,"num_write":894,"num_write_kb":14360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'571","reported_seq":1333,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.455576+0000","last_change":"2024-09-12T00:01:59.149108+0000","last_active":"2024-09-12T00:37:23.455576+0000","last_peered":"2024-09-12T00:37:23.455576+0000","last_clean":"2024-09-12T00:37:23.455576+0000","last_became_active":"2024-09-12T00:01:59.148605+0000","last_became_peered":"2024-09-12T00:01:59.148605+0000","last_unstale":"2024-09-12T00:37:23.455576+0000","last_undegraded":"2024-09-12T00:37:23.455576+0000","last_fullsized":"2024-09-12T00:37:23.455576+0000","mapping_epoch":26,"log_start":"261'500","ondisk_log_start":"261'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:43.891160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2664,"num_read_kb":2197,"num_write":993,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'265","reported_seq":907,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.346018+0000","last_change":"2024-09-12T00:02:32.865371+0000","last_active":"2024-09-12T00:37:21.346018+0000","last_peered":"2024-09-12T00:37:21.346018+0000","last_clean":"2024-09-12T00:37:21.346018+0000","last_became_active":"2024-09-12T00:02:32.864862+0000","last_became_peered":"2024-09-12T00:02:32.864862+0000","last_unstale":"2024-09-12T00:37:21.346018+0000","last_undegraded":"2024-09-12T00:37:21.346018+0000","last_fullsized":"2024-09-12T00:37:21.346018+0000","mapping_epoch":37,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:46.058961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7461216,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":433,"num_read_kb":62973,"num_write":1029,"num_write_kb":36662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7,3],"acting":[6,0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'192","reported_seq":809,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:28.041132+0000","last_change":"2024-09-12T00:01:59.141664+0000","last_active":"2024-09-12T00:36:28.041132+0000","last_peered":"2024-09-12T00:36:28.041132+0000","last_clean":"2024-09-12T00:36:28.041132+0000","last_became_active":"2024-09-12T00:01:59.141383+0000","last_became_peered":"2024-09-12T00:01:59.141383+0000","last_unstale":"2024-09-12T00:36:28.041132+0000","last_undegraded":"2024-09-12T00:36:28.041132+0000","last_fullsized":"2024-09-12T00:36:28.041132+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:49.143020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":715,"num_write":298,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'277","reported_seq":931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.389271+0000","last_change":"2024-09-12T00:01:57.152496+0000","last_active":"2024-09-12T00:37:02.389271+0000","last_peered":"2024-09-12T00:37:02.389271+0000","last_clean":"2024-09-12T00:37:02.389271+0000","last_became_active":"2024-09-12T00:01:57.152097+0000","last_became_peered":"2024-09-12T00:01:57.152097+0000","last_unstale":"2024-09-12T00:37:02.389271+0000","last_undegraded":"2024-09-12T00:37:02.389271+0000","last_fullsized":"2024-09-12T00:37:02.389271+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:44.525600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12512919,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":458,"num_read_kb":43886,"num_write":1015,"num_write_kb":36840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'430","reported_seq":1145,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:19.505287+0000","last_change":"2024-09-12T00:01:59.146420+0000","last_active":"2024-09-12T00:35:19.505287+0000","last_peered":"2024-09-12T00:35:19.505287+0000","last_clean":"2024-09-12T00:35:19.505287+0000","last_became_active":"2024-09-12T00:01:59.146117+0000","last_became_peered":"2024-09-12T00:01:59.146117+0000","last_unstale":"2024-09-12T00:35:19.505287+0000","last_undegraded":"2024-09-12T00:35:19.505287+0000","last_fullsized":"2024-09-12T00:35:19.505287+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:14.193284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2179,"num_read_kb":1868,"num_write":729,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'314","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.803528+0000","last_change":"2024-09-12T00:01:57.156353+0000","last_active":"2024-09-12T00:37:10.803528+0000","last_peered":"2024-09-12T00:37:10.803528+0000","last_clean":"2024-09-12T00:37:10.803528+0000","last_became_active":"2024-09-12T00:01:57.156002+0000","last_became_peered":"2024-09-12T00:01:57.156002+0000","last_unstale":"2024-09-12T00:37:10.803528+0000","last_undegraded":"2024-09-12T00:37:10.803528+0000","last_fullsized":"2024-09-12T00:37:10.803528+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:26.168398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19094454,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":607,"num_read_kb":79699,"num_write":1278,"num_write_kb":54312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'216","reported_seq":795,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.099261+0000","last_change":"2024-09-12T00:01:59.155738+0000","last_active":"2024-09-12T00:37:10.099261+0000","last_peered":"2024-09-12T00:37:10.099261+0000","last_clean":"2024-09-12T00:37:10.099261+0000","last_became_active":"2024-09-12T00:01:59.155003+0000","last_became_peered":"2024-09-12T00:01:59.155003+0000","last_unstale":"2024-09-12T00:37:10.099261+0000","last_undegraded":"2024-09-12T00:37:10.099261+0000","last_fullsized":"2024-09-12T00:37:10.099261+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:00.966411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":893,"num_read_kb":718,"num_write":326,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'297","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:55.558835+0000","last_change":"2024-09-12T00:01:57.145897+0000","last_active":"2024-09-12T00:36:55.558835+0000","last_peered":"2024-09-12T00:36:55.558835+0000","last_clean":"2024-09-12T00:36:55.558835+0000","last_became_active":"2024-09-12T00:01:57.145466+0000","last_became_peered":"2024-09-12T00:01:57.145466+0000","last_unstale":"2024-09-12T00:36:55.558835+0000","last_undegraded":"2024-09-12T00:36:55.558835+0000","last_fullsized":"2024-09-12T00:36:55.558835+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:37.023670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8651566,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":418,"num_read_kb":3535,"num_write":1109,"num_write_kb":24926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'109","reported_seq":685,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.756770+0000","last_change":"2024-09-12T00:01:59.149307+0000","last_active":"2024-09-12T00:36:54.756770+0000","last_peered":"2024-09-12T00:36:54.756770+0000","last_clean":"2024-09-12T00:36:54.756770+0000","last_became_active":"2024-09-12T00:01:59.149014+0000","last_became_peered":"2024-09-12T00:01:59.149014+0000","last_unstale":"2024-09-12T00:36:54.756770+0000","last_undegraded":"2024-09-12T00:36:54.756770+0000","last_fullsized":"2024-09-12T00:36:54.756770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:10.536874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":492,"num_read_kb":416,"num_write":148,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'333","reported_seq":969,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.999463+0000","last_change":"2024-09-12T00:01:57.151349+0000","last_active":"2024-09-12T00:37:07.999463+0000","last_peered":"2024-09-12T00:37:07.999463+0000","last_clean":"2024-09-12T00:37:07.999463+0000","last_became_active":"2024-09-12T00:01:57.150980+0000","last_became_peered":"2024-09-12T00:01:57.150980+0000","last_unstale":"2024-09-12T00:37:07.999463+0000","last_undegraded":"2024-09-12T00:37:07.999463+0000","last_fullsized":"2024-09-12T00:37:07.999463+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:09.638039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1307913,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":569,"num_read_kb":15521,"num_write":1217,"num_write_kb":17105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'109","reported_seq":703,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.368547+0000","last_change":"2024-09-12T00:01:59.150294+0000","last_active":"2024-09-12T00:37:06.368547+0000","last_peered":"2024-09-12T00:37:06.368547+0000","last_clean":"2024-09-12T00:37:06.368547+0000","last_became_active":"2024-09-12T00:01:59.149341+0000","last_became_peered":"2024-09-12T00:01:59.149341+0000","last_unstale":"2024-09-12T00:37:06.368547+0000","last_undegraded":"2024-09-12T00:37:06.368547+0000","last_fullsized":"2024-09-12T00:37:06.368547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:43.661734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":504,"num_read_kb":434,"num_write":171,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'286","reported_seq":929,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.566844+0000","last_change":"2024-09-12T00:02:32.863517+0000","last_active":"2024-09-12T00:37:10.566844+0000","last_peered":"2024-09-12T00:37:10.566844+0000","last_clean":"2024-09-12T00:37:10.566844+0000","last_became_active":"2024-09-12T00:02:32.863077+0000","last_became_peered":"2024-09-12T00:02:32.863077+0000","last_unstale":"2024-09-12T00:37:10.566844+0000","last_undegraded":"2024-09-12T00:37:10.566844+0000","last_fullsized":"2024-09-12T00:37:10.566844+0000","mapping_epoch":37,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:26.806451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2600321,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":473,"num_read_kb":11923,"num_write":1086,"num_write_kb":27282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,7],"acting":[5,6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'269","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.154723+0000","last_change":"2024-09-12T00:01:59.159517+0000","last_active":"2024-09-12T00:36:54.154723+0000","last_peered":"2024-09-12T00:36:54.154723+0000","last_clean":"2024-09-12T00:36:54.154723+0000","last_became_active":"2024-09-12T00:01:59.159226+0000","last_became_peered":"2024-09-12T00:01:59.159226+0000","last_unstale":"2024-09-12T00:36:54.154723+0000","last_undegraded":"2024-09-12T00:36:54.154723+0000","last_fullsized":"2024-09-12T00:36:54.154723+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:44.957681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1182,"num_read_kb":958,"num_write":434,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'317","reported_seq":977,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.460978+0000","last_change":"2024-09-12T00:01:57.148465+0000","last_active":"2024-09-12T00:38:36.460978+0000","last_peered":"2024-09-12T00:38:36.460978+0000","last_clean":"2024-09-12T00:38:36.460978+0000","last_became_active":"2024-09-12T00:01:57.148038+0000","last_became_peered":"2024-09-12T00:01:57.148038+0000","last_unstale":"2024-09-12T00:38:36.460978+0000","last_undegraded":"2024-09-12T00:38:36.460978+0000","last_fullsized":"2024-09-12T00:38:36.460978+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:42.798082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22023789,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":491,"num_read_kb":81303,"num_write":1097,"num_write_kb":56822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'244","reported_seq":815,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:17.296585+0000","last_change":"2024-09-12T00:01:59.154559+0000","last_active":"2024-09-12T00:36:17.296585+0000","last_peered":"2024-09-12T00:36:17.296585+0000","last_clean":"2024-09-12T00:36:17.296585+0000","last_became_active":"2024-09-12T00:01:59.154258+0000","last_became_peered":"2024-09-12T00:01:59.154258+0000","last_unstale":"2024-09-12T00:36:17.296585+0000","last_undegraded":"2024-09-12T00:36:17.296585+0000","last_fullsized":"2024-09-12T00:36:17.296585+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:13.431395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":900,"num_write":421,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'342","reported_seq":996,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.521995+0000","last_change":"2024-09-12T00:01:57.143175+0000","last_active":"2024-09-12T00:38:37.521995+0000","last_peered":"2024-09-12T00:38:37.521995+0000","last_clean":"2024-09-12T00:38:37.521995+0000","last_became_active":"2024-09-12T00:01:57.142713+0000","last_became_peered":"2024-09-12T00:01:57.142713+0000","last_unstale":"2024-09-12T00:38:37.521995+0000","last_undegraded":"2024-09-12T00:38:37.521995+0000","last_fullsized":"2024-09-12T00:38:37.521995+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:53.401721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11929727,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":492,"num_read_kb":36569,"num_write":1099,"num_write_kb":39253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'210","reported_seq":845,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:15.454384+0000","last_change":"2024-09-12T00:01:59.155267+0000","last_active":"2024-09-12T00:36:15.454384+0000","last_peered":"2024-09-12T00:36:15.454384+0000","last_clean":"2024-09-12T00:36:15.454384+0000","last_became_active":"2024-09-12T00:01:59.154931+0000","last_became_peered":"2024-09-12T00:01:59.154931+0000","last_unstale":"2024-09-12T00:36:15.454384+0000","last_undegraded":"2024-09-12T00:36:15.454384+0000","last_fullsized":"2024-09-12T00:36:15.454384+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:10.981627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":786,"num_write":317,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'288","reported_seq":983,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.160663+0000","last_change":"2024-09-12T00:01:57.142655+0000","last_active":"2024-09-12T00:37:06.160663+0000","last_peered":"2024-09-12T00:37:06.160663+0000","last_clean":"2024-09-12T00:37:06.160663+0000","last_became_active":"2024-09-12T00:01:57.142082+0000","last_became_peered":"2024-09-12T00:01:57.142082+0000","last_unstale":"2024-09-12T00:37:06.160663+0000","last_undegraded":"2024-09-12T00:37:06.160663+0000","last_fullsized":"2024-09-12T00:37:06.160663+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:37.032607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5484013,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":553,"num_read_kb":3429,"num_write":1130,"num_write_kb":16203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'205","reported_seq":791,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.958424+0000","last_change":"2024-09-12T00:01:59.146609+0000","last_active":"2024-09-12T00:36:50.958424+0000","last_peered":"2024-09-12T00:36:50.958424+0000","last_clean":"2024-09-12T00:36:50.958424+0000","last_became_active":"2024-09-12T00:01:59.146272+0000","last_became_peered":"2024-09-12T00:01:59.146272+0000","last_unstale":"2024-09-12T00:36:50.958424+0000","last_undegraded":"2024-09-12T00:36:50.958424+0000","last_fullsized":"2024-09-12T00:36:50.958424+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:31.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":905,"num_read_kb":736,"num_write":324,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'272","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.006825+0000","last_change":"2024-09-12T00:01:57.165561+0000","last_active":"2024-09-12T00:37:07.006825+0000","last_peered":"2024-09-12T00:37:07.006825+0000","last_clean":"2024-09-12T00:37:07.006825+0000","last_became_active":"2024-09-12T00:01:57.165139+0000","last_became_peered":"2024-09-12T00:01:57.165139+0000","last_unstale":"2024-09-12T00:37:07.006825+0000","last_undegraded":"2024-09-12T00:37:07.006825+0000","last_fullsized":"2024-09-12T00:37:07.006825+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:31.614666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16237229,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":396,"num_read_kb":34173,"num_write":1033,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'210","reported_seq":834,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:51.123390+0000","last_change":"2024-09-12T00:01:59.151886+0000","last_active":"2024-09-12T00:36:51.123390+0000","last_peered":"2024-09-12T00:36:51.123390+0000","last_clean":"2024-09-12T00:36:51.123390+0000","last_became_active":"2024-09-12T00:01:59.151627+0000","last_became_peered":"2024-09-12T00:01:59.151627+0000","last_unstale":"2024-09-12T00:36:51.123390+0000","last_undegraded":"2024-09-12T00:36:51.123390+0000","last_fullsized":"2024-09-12T00:36:51.123390+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:04.332533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":886,"num_read_kb":742,"num_write":315,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'316","reported_seq":1152,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.018590+0000","last_change":"2024-09-12T00:01:57.151733+0000","last_active":"2024-09-12T00:37:09.018590+0000","last_peered":"2024-09-12T00:37:09.018590+0000","last_clean":"2024-09-12T00:37:09.018590+0000","last_became_active":"2024-09-12T00:01:57.151346+0000","last_became_peered":"2024-09-12T00:01:57.151346+0000","last_unstale":"2024-09-12T00:37:09.018590+0000","last_undegraded":"2024-09-12T00:37:09.018590+0000","last_fullsized":"2024-09-12T00:37:09.018590+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:20.828358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":654085,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":896,"num_read_kb":6739,"num_write":1138,"num_write_kb":13731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'4140","reported_seq":4711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:03.256251+0000","last_change":"2024-09-12T00:01:59.158824+0000","last_active":"2024-09-12T00:36:03.256251+0000","last_peered":"2024-09-12T00:36:03.256251+0000","last_clean":"2024-09-12T00:36:03.256251+0000","last_became_active":"2024-09-12T00:01:59.157873+0000","last_became_peered":"2024-09-12T00:01:59.157873+0000","last_unstale":"2024-09-12T00:36:03.256251+0000","last_undegraded":"2024-09-12T00:36:03.256251+0000","last_fullsized":"2024-09-12T00:36:03.256251+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:18.182096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16645,"num_read_kb":13962,"num_write":6214,"num_write_kb":3111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'276","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.390513+0000","last_change":"2024-09-12T00:01:57.165394+0000","last_active":"2024-09-12T00:37:02.390513+0000","last_peered":"2024-09-12T00:37:02.390513+0000","last_clean":"2024-09-12T00:37:02.390513+0000","last_became_active":"2024-09-12T00:01:57.165016+0000","last_became_peered":"2024-09-12T00:01:57.165016+0000","last_unstale":"2024-09-12T00:37:02.390513+0000","last_undegraded":"2024-09-12T00:37:02.390513+0000","last_fullsized":"2024-09-12T00:37:02.390513+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:19.072293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6912807,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":529,"num_read_kb":10231,"num_write":1038,"num_write_kb":39602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'257","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.658178+0000","last_change":"2024-09-12T00:01:57.165458+0000","last_active":"2024-09-12T00:37:21.658178+0000","last_peered":"2024-09-12T00:37:21.658178+0000","last_clean":"2024-09-12T00:37:21.658178+0000","last_became_active":"2024-09-12T00:01:57.165046+0000","last_became_peered":"2024-09-12T00:01:57.165046+0000","last_unstale":"2024-09-12T00:37:21.658178+0000","last_undegraded":"2024-09-12T00:37:21.658178+0000","last_fullsized":"2024-09-12T00:37:21.658178+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:21.899432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9838564,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":540,"num_read_kb":41753,"num_write":920,"num_write_kb":31467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'110","reported_seq":711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.156763+0000","last_change":"2024-09-12T00:01:59.153747+0000","last_active":"2024-09-12T00:37:01.156763+0000","last_peered":"2024-09-12T00:37:01.156763+0000","last_clean":"2024-09-12T00:37:01.156763+0000","last_became_active":"2024-09-12T00:01:59.153454+0000","last_became_peered":"2024-09-12T00:01:59.153454+0000","last_unstale":"2024-09-12T00:37:01.156763+0000","last_undegraded":"2024-09-12T00:37:01.156763+0000","last_fullsized":"2024-09-12T00:37:01.156763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:03.025405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":439,"num_write":164,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'287","reported_seq":1134,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:55.824005+0000","last_change":"2024-09-12T00:01:57.146814+0000","last_active":"2024-09-12T00:36:55.824005+0000","last_peered":"2024-09-12T00:36:55.824005+0000","last_clean":"2024-09-12T00:36:55.824005+0000","last_became_active":"2024-09-12T00:01:57.146320+0000","last_became_peered":"2024-09-12T00:01:57.146320+0000","last_unstale":"2024-09-12T00:36:55.824005+0000","last_undegraded":"2024-09-12T00:36:55.824005+0000","last_fullsized":"2024-09-12T00:36:55.824005+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:48.705647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6392420,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":922,"num_read_kb":6700,"num_write":1115,"num_write_kb":43058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'174","reported_seq":769,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:51.509408+0000","last_change":"2024-09-12T00:01:59.147165+0000","last_active":"2024-09-12T00:35:51.509408+0000","last_peered":"2024-09-12T00:35:51.509408+0000","last_clean":"2024-09-12T00:35:51.509408+0000","last_became_active":"2024-09-12T00:01:59.146876+0000","last_became_peered":"2024-09-12T00:01:59.146876+0000","last_unstale":"2024-09-12T00:35:51.509408+0000","last_undegraded":"2024-09-12T00:35:51.509408+0000","last_fullsized":"2024-09-12T00:35:51.509408+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:19.079900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":808,"num_read_kb":667,"num_write":271,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5901,"num_read_kb":4223,"num_write":1957,"num_write_kb":855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1029,"ondisk_log_size":1029,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":14998,"num_read_kb":14670,"num_write":16815,"num_write_kb":4907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1464,"ondisk_log_size":1464,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":547,"ondisk_log_size":547,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1805913,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":16838,"num_read_kb":32859,"num_write":14199,"num_write_kb":11356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2895872,"data_stored":2407236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2215,"ondisk_log_size":2215,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102638,"num_read_kb":85737,"num_write":37205,"num_write_kb":18751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3973,"ondisk_log_size":3973,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":500731485,"num_objects":4037,"num_object_clones":0,"num_object_copies":16148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4037,"num_whiteouts":0,"num_read":32292,"num_read_kb":1881229,"num_write":68051,"num_write_kb":2075118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":712794112,"data_stored":712794112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4117,"ondisk_log_size":4117,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":75545895,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":126,"num_read_kb":208372,"num_write":142,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139509760,"data_stored":139509031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":82551576,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":118,"num_read_kb":193338,"num_write":140,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159150080,"data_stored":159146047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509887,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":362864,"kb_used_data":147104,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94008976,"statfs":{"total":96636764160,"available":96265191424,"internally_reserved":0,"allocated":150634496,"data_stored":148649093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":220920266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509886,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232772,"kb_used_data":125300,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94139068,"statfs":{"total":96636764160,"available":96398405632,"internally_reserved":0,"allocated":128307200,"data_stored":126300199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110033350},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509888,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368636,"kb_used_data":120876,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":94003204,"statfs":{"total":96636764160,"available":96259280896,"internally_reserved":0,"allocated":123777024,"data_stored":121763089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":253688261},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509886,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356960,"kb_used_data":145296,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":94014880,"statfs":{"total":96636764160,"available":96271237120,"internally_reserved":0,"allocated":148783104,"data_stored":146785909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":216725959},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509888,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":276212,"kb_used_data":154788,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94095628,"statfs":{"total":96636764160,"available":96353923072,"internally_reserved":0,"allocated":158502912,"data_stored":156515299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124320197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509887,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263680,"kb_used_data":142320,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94108160,"statfs":{"total":96636764160,"available":96366755840,"internally_reserved":0,"allocated":145735680,"data_stored":143725067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575294,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":357676,"kb_used_data":141868,"kb_used_omap":1,"kb_used_meta":215742,"kb_avail":94014164,"statfs":{"total":96636764160,"available":96270503936,"internally_reserved":0,"allocated":145272832,"data_stored":143315716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":220920261},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575296,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":386088,"kb_used_data":102232,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":93985752,"statfs":{"total":96636764160,"available":96241410048,"internally_reserved":0,"allocated":104685568,"data_stored":102698639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":290650565},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":101195776,"data_stored":101195776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":82489344,"data_stored":82489344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":122732544,"data_stored":122732544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":107925504,"data_stored":107925504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61046784,"data_stored":61046784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":79736832,"data_stored":79736832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":82853888,"data_stored":82853888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":74813440,"data_stored":74813440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":483645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":512000,"data_stored":430667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":123788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":246233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":97946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":390718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":350241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":283998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":27262976,"data_stored":27262976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30076928,"data_stored":30074353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":19972096,"data_stored":19971367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36749312,"data_stored":36748583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6340608,"data_stored":6339879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":34603008,"data_stored":34603008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:38:39.557 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:38:39.893 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:38:39.893 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":261,"fsid":"e5cff671-9fc3-4411-a3b0-24fb92477a76","created":"2024-09-12T00:01:26.321068+0000","modified":"2024-09-12T00:27:18.556997+0000","last_up_change":"2024-09-12T00:01:38.454848+0000","last_in_change":"2024-09-12T00:01:28.868474+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:01:36.775566+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:01:44.766611+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:01:55.544837+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:01:57.486328+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:01:59.319230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:02:01.209979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:02:03.161895+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:02:05.237914+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T00:15:32.795845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"252","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T00:16:58.162497+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"255","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T00:17:01.263651+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T00:27:15.817105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"261","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1087d14-61a5-42e3-bc42-7339a6e0a250","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6809","nonce":758855525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6811","nonce":758855525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6815","nonce":758855525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":758855525},{"type":"v1","addr":"172.21.15.67:6813","nonce":758855525}]},"public_addr":"172.21.15.67:6809/758855525","cluster_addr":"172.21.15.67:6811/758855525","heartbeat_back_addr":"172.21.15.67:6815/758855525","heartbeat_front_addr":"172.21.15.67:6813/758855525","state":["exists","up"]},{"osd":1,"uuid":"ec8ef004-2562-4cf2-9f8c-240a040ec8f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6801","nonce":2522402523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6803","nonce":2522402523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6807","nonce":2522402523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":2522402523},{"type":"v1","addr":"172.21.15.67:6805","nonce":2522402523}]},"public_addr":"172.21.15.67:6801/2522402523","cluster_addr":"172.21.15.67:6803/2522402523","heartbeat_back_addr":"172.21.15.67:6807/2522402523","heartbeat_front_addr":"172.21.15.67:6805/2522402523","state":["exists","up"]},{"osd":2,"uuid":"3fe6450f-2a9c-4c28-a6df-d554afe1e0a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6825","nonce":2280959600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6827","nonce":2280959600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6831","nonce":2280959600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":2280959600},{"type":"v1","addr":"172.21.15.67:6829","nonce":2280959600}]},"public_addr":"172.21.15.67:6825/2280959600","cluster_addr":"172.21.15.67:6827/2280959600","heartbeat_back_addr":"172.21.15.67:6831/2280959600","heartbeat_front_addr":"172.21.15.67:6829/2280959600","state":["exists","up"]},{"osd":3,"uuid":"3a811d0a-3bec-472e-a10c-b944882030e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6817","nonce":1829992128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6819","nonce":1829992128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6823","nonce":1829992128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1829992128},{"type":"v1","addr":"172.21.15.67:6821","nonce":1829992128}]},"public_addr":"172.21.15.67:6817/1829992128","cluster_addr":"172.21.15.67:6819/1829992128","heartbeat_back_addr":"172.21.15.67:6823/1829992128","heartbeat_front_addr":"172.21.15.67:6821/1829992128","state":["exists","up"]},{"osd":4,"uuid":"c1039f7c-d131-421c-97cf-070ebb75dc7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6809","nonce":2113328631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6811","nonce":2113328631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6818","nonce":2113328631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2113328631},{"type":"v1","addr":"172.21.15.170:6814","nonce":2113328631}]},"public_addr":"172.21.15.170:6809/2113328631","cluster_addr":"172.21.15.170:6811/2113328631","heartbeat_back_addr":"172.21.15.170:6818/2113328631","heartbeat_front_addr":"172.21.15.170:6814/2113328631","state":["exists","up"]},{"osd":5,"uuid":"df8e4b1b-7090-42aa-a9d2-826af1c1934e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6801","nonce":3337629604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6803","nonce":3337629604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6807","nonce":3337629604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3337629604},{"type":"v1","addr":"172.21.15.170:6805","nonce":3337629604}]},"public_addr":"172.21.15.170:6801/3337629604","cluster_addr":"172.21.15.170:6803/3337629604","heartbeat_back_addr":"172.21.15.170:6807/3337629604","heartbeat_front_addr":"172.21.15.170:6805/3337629604","state":["exists","up"]},{"osd":6,"uuid":"69672dbb-ef65-46b8-9524-088a02d756e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6813","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6815","nonce":3583292503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6817","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6819","nonce":3583292503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6823","nonce":3583292503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":3583292503},{"type":"v1","addr":"172.21.15.170:6821","nonce":3583292503}]},"public_addr":"172.21.15.170:6815/3583292503","cluster_addr":"172.21.15.170:6819/3583292503","heartbeat_back_addr":"172.21.15.170:6823/3583292503","heartbeat_front_addr":"172.21.15.170:6821/3583292503","state":["exists","up"]},{"osd":7,"uuid":"61f72d21-51cf-4404-8086-77526b31ed44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":259,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6825","nonce":783534599}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6827","nonce":783534599}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6831","nonce":783534599}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":783534599},{"type":"v1","addr":"172.21.15.170:6829","nonce":783534599}]},"public_addr":"172.21.15.170:6825/783534599","cluster_addr":"172.21.15.170:6827/783534599","heartbeat_back_addr":"172.21.15.170:6831/783534599","heartbeat_front_addr":"172.21.15.170:6829/783534599","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.395612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.272627+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.707039+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.919876+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.158924+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.398876+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:36.176508+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:01:35.718470+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":2,"to":7}]},{"pgid":"3.29","mappings":[{"from":2,"to":6}]},{"pgid":"3.33","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:38:40.906 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T00:38:40.906 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:38:41.063 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:38:41.063 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:38:41.063 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:38:41.074 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T00:38:41.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-12T00:38:41.388 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T00:38:41.401 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T00:38:41.402 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:38:41.545 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:38:41.545 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:38:41.545 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:38:41.555 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T00:38:41.871 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T00:38:41.885 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T00:38:41.885 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:38:42.026 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:38:42.026 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:38:42.026 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:38:42.037 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T00:38:42.351 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T00:38:42.365 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T00:38:42.365 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:38:42.509 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:38:42.510 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:38:42.510 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:38:42.520 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T00:38:42.838 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T00:38:42.851 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T00:38:42.852 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:38:42.994 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:38:42.994 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:38:42.994 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:38:43.005 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T00:38:43.321 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T00:38:43.334 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T00:38:43.334 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:38:43.478 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:38:43.479 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:38:43.479 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:38:43.489 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T00:38:43.803 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T00:38:43.816 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T00:38:43.816 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:38:43.958 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:38:43.959 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:38:43.959 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:38:43.969 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T00:38:44.287 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T00:38:44.301 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T00:38:44.301 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:38:44.444 INFO:teuthology.orchestra.run.smithi067.stdout:{ 2024-09-12T00:38:44.444 INFO:teuthology.orchestra.run.smithi067.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:38:44.444 INFO:teuthology.orchestra.run.smithi067.stdout:} 2024-09-12T00:38:44.455 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T00:38:44.777 INFO:teuthology.orchestra.run.smithi067.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T00:38:44.790 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:38:45.131 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:38:45.143 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T00:38:45.145 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":1367,"stamp":"2024-09-12T00:38:43.629871+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89002200,"num_objects":716,"num_object_clones":0,"num_object_copies":2164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":716,"num_whiteouts":0,"num_read":179516,"num_read_kb":2426911,"num_write":142578,"num_write_kb":2382623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13231,"ondisk_log_size":13231,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1695072,"kb_used_data":149216,"kb_used_omap":12,"kb_used_meta":1544371,"kb_avail":753279648,"statfs":{"total":773094113280,"available":771358359552,"internally_reserved":0,"allocated":152797184,"data_stored":137081970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1581436464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-604237947,"num_objects":-4070,"num_object_clones":0,"num_object_copies":-16200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4070,"num_whiteouts":0,"num_read":4561,"num_read_kb":4081,"num_write":4321,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005016"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.383088+0000","last_change":"2024-09-12T00:27:17.580532+0000","last_active":"2024-09-12T00:34:49.383088+0000","last_peered":"2024-09-12T00:34:49.383088+0000","last_clean":"2024-09-12T00:34:49.383088+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:34:49.383088+0000","last_undegraded":"2024-09-12T00:34:49.383088+0000","last_fullsized":"2024-09-12T00:34:49.383088+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:42.988688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'10","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.315467+0000","last_change":"2024-09-12T00:17:03.214457+0000","last_active":"2024-09-12T00:38:36.315467+0000","last_peered":"2024-09-12T00:38:36.315467+0000","last_clean":"2024-09-12T00:38:36.315467+0000","last_became_active":"2024-09-12T00:17:03.213906+0000","last_became_peered":"2024-09-12T00:17:03.213906+0000","last_unstale":"2024-09-12T00:38:36.315467+0000","last_undegraded":"2024-09-12T00:38:36.315467+0000","last_fullsized":"2024-09-12T00:38:36.315467+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:43.554284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":18831,"num_write":10,"num_write_kb":11989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.498249+0000","last_change":"2024-09-12T00:17:00.182788+0000","last_active":"2024-09-12T00:34:29.498249+0000","last_peered":"2024-09-12T00:34:29.498249+0000","last_clean":"2024-09-12T00:34:29.498249+0000","last_became_active":"2024-09-12T00:17:00.182510+0000","last_became_peered":"2024-09-12T00:17:00.182510+0000","last_unstale":"2024-09-12T00:34:29.498249+0000","last_undegraded":"2024-09-12T00:34:29.498249+0000","last_fullsized":"2024-09-12T00:34:29.498249+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:10.766253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'18","reported_seq":91,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:27.517806+0000","last_change":"2024-09-12T00:15:34.415639+0000","last_active":"2024-09-12T00:36:27.517806+0000","last_peered":"2024-09-12T00:36:27.517806+0000","last_clean":"2024-09-12T00:36:27.517806+0000","last_became_active":"2024-09-12T00:15:34.415364+0000","last_became_peered":"2024-09-12T00:15:34.415364+0000","last_unstale":"2024-09-12T00:36:27.517806+0000","last_undegraded":"2024-09-12T00:36:27.517806+0000","last_fullsized":"2024-09-12T00:36:27.517806+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:04.462246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.500985+0000","last_change":"2024-09-12T00:27:17.581875+0000","last_active":"2024-09-12T00:34:49.500985+0000","last_peered":"2024-09-12T00:34:49.500985+0000","last_clean":"2024-09-12T00:34:49.500985+0000","last_became_active":"2024-09-12T00:27:17.581520+0000","last_became_peered":"2024-09-12T00:27:17.581520+0000","last_unstale":"2024-09-12T00:34:49.500985+0000","last_undegraded":"2024-09-12T00:34:49.500985+0000","last_fullsized":"2024-09-12T00:34:49.500985+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:28.315835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":30,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.637288+0000","last_change":"2024-09-12T00:17:03.206913+0000","last_active":"2024-09-12T00:37:04.637288+0000","last_peered":"2024-09-12T00:37:04.637288+0000","last_clean":"2024-09-12T00:37:04.637288+0000","last_became_active":"2024-09-12T00:17:03.206566+0000","last_became_peered":"2024-09-12T00:17:03.206566+0000","last_unstale":"2024-09-12T00:37:04.637288+0000","last_undegraded":"2024-09-12T00:37:04.637288+0000","last_fullsized":"2024-09-12T00:37:04.637288+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.057828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.519227+0000","last_change":"2024-09-12T00:17:00.176346+0000","last_active":"2024-09-12T00:36:59.519227+0000","last_peered":"2024-09-12T00:36:59.519227+0000","last_clean":"2024-09-12T00:36:59.519227+0000","last_became_active":"2024-09-12T00:17:00.175196+0000","last_became_peered":"2024-09-12T00:17:00.175196+0000","last_unstale":"2024-09-12T00:36:59.519227+0000","last_undegraded":"2024-09-12T00:36:59.519227+0000","last_fullsized":"2024-09-12T00:36:59.519227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:52.503715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"258'75","reported_seq":276,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:42.511663+0000","last_change":"2024-09-12T00:15:34.417010+0000","last_active":"2024-09-12T00:35:42.511663+0000","last_peered":"2024-09-12T00:35:42.511663+0000","last_clean":"2024-09-12T00:35:42.511663+0000","last_became_active":"2024-09-12T00:15:34.416706+0000","last_became_peered":"2024-09-12T00:15:34.416706+0000","last_unstale":"2024-09-12T00:35:42.511663+0000","last_undegraded":"2024-09-12T00:35:42.511663+0000","last_fullsized":"2024-09-12T00:35:42.511663+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:28.483679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":462,"num_read_kb":331,"num_write":93,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:31.497481+0000","last_change":"2024-09-12T00:27:17.573237+0000","last_active":"2024-09-12T00:34:31.497481+0000","last_peered":"2024-09-12T00:34:31.497481+0000","last_clean":"2024-09-12T00:34:31.497481+0000","last_became_active":"2024-09-12T00:27:17.572934+0000","last_became_peered":"2024-09-12T00:27:17.572934+0000","last_unstale":"2024-09-12T00:34:31.497481+0000","last_undegraded":"2024-09-12T00:34:31.497481+0000","last_fullsized":"2024-09-12T00:34:31.497481+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:52.238701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'3","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:54.527097+0000","last_change":"2024-09-12T00:17:03.212082+0000","last_active":"2024-09-12T00:37:54.527097+0000","last_peered":"2024-09-12T00:37:54.527097+0000","last_clean":"2024-09-12T00:37:54.527097+0000","last_became_active":"2024-09-12T00:17:03.211755+0000","last_became_peered":"2024-09-12T00:17:03.211755+0000","last_unstale":"2024-09-12T00:37:54.527097+0000","last_undegraded":"2024-09-12T00:37:54.527097+0000","last_fullsized":"2024-09-12T00:37:54.527097+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:11.463541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503282+0000","last_change":"2024-09-12T00:17:00.181734+0000","last_active":"2024-09-12T00:35:04.503282+0000","last_peered":"2024-09-12T00:35:04.503282+0000","last_clean":"2024-09-12T00:35:04.503282+0000","last_became_active":"2024-09-12T00:17:00.181461+0000","last_became_peered":"2024-09-12T00:17:00.181461+0000","last_unstale":"2024-09-12T00:35:04.503282+0000","last_undegraded":"2024-09-12T00:35:04.503282+0000","last_fullsized":"2024-09-12T00:35:04.503282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:40.876171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'16","reported_seq":82,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:34.507625+0000","last_change":"2024-09-12T00:15:34.428333+0000","last_active":"2024-09-12T00:35:34.507625+0000","last_peered":"2024-09-12T00:35:34.507625+0000","last_clean":"2024-09-12T00:35:34.507625+0000","last_became_active":"2024-09-12T00:15:34.428023+0000","last_became_peered":"2024-09-12T00:15:34.428023+0000","last_unstale":"2024-09-12T00:35:34.507625+0000","last_undegraded":"2024-09-12T00:35:34.507625+0000","last_fullsized":"2024-09-12T00:35:34.507625+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:33.470085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499223+0000","last_change":"2024-09-12T00:27:17.577865+0000","last_active":"2024-09-12T00:34:34.499223+0000","last_peered":"2024-09-12T00:34:34.499223+0000","last_clean":"2024-09-12T00:34:34.499223+0000","last_became_active":"2024-09-12T00:27:17.577034+0000","last_became_peered":"2024-09-12T00:27:17.577034+0000","last_unstale":"2024-09-12T00:34:34.499223+0000","last_undegraded":"2024-09-12T00:34:34.499223+0000","last_fullsized":"2024-09-12T00:34:34.499223+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:24.642513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"261'3","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.520057+0000","last_change":"2024-09-12T00:17:03.210262+0000","last_active":"2024-09-12T00:37:04.520057+0000","last_peered":"2024-09-12T00:37:04.520057+0000","last_clean":"2024-09-12T00:37:04.520057+0000","last_became_active":"2024-09-12T00:17:03.209945+0000","last_became_peered":"2024-09-12T00:17:03.209945+0000","last_unstale":"2024-09-12T00:37:04.520057+0000","last_undegraded":"2024-09-12T00:37:04.520057+0000","last_fullsized":"2024-09-12T00:37:04.520057+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:00.406310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:46.508609+0000","last_change":"2024-09-12T00:17:00.177502+0000","last_active":"2024-09-12T00:35:46.508609+0000","last_peered":"2024-09-12T00:35:46.508609+0000","last_clean":"2024-09-12T00:35:46.508609+0000","last_became_active":"2024-09-12T00:17:00.176151+0000","last_became_peered":"2024-09-12T00:17:00.176151+0000","last_unstale":"2024-09-12T00:35:46.508609+0000","last_undegraded":"2024-09-12T00:35:46.508609+0000","last_fullsized":"2024-09-12T00:35:46.508609+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:32.829277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'69","reported_seq":229,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.090824+0000","last_change":"2024-09-12T00:15:34.422703+0000","last_active":"2024-09-12T00:36:56.090824+0000","last_peered":"2024-09-12T00:36:56.090824+0000","last_clean":"2024-09-12T00:36:56.090824+0000","last_became_active":"2024-09-12T00:15:34.422426+0000","last_became_peered":"2024-09-12T00:15:34.422426+0000","last_unstale":"2024-09-12T00:36:56.090824+0000","last_undegraded":"2024-09-12T00:36:56.090824+0000","last_fullsized":"2024-09-12T00:36:56.090824+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:50.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":354,"num_read_kb":254,"num_write":121,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:19.505464+0000","last_change":"2024-09-12T00:27:17.579859+0000","last_active":"2024-09-12T00:35:19.505464+0000","last_peered":"2024-09-12T00:35:19.505464+0000","last_clean":"2024-09-12T00:35:19.505464+0000","last_became_active":"2024-09-12T00:27:17.579540+0000","last_became_peered":"2024-09-12T00:27:17.579540+0000","last_unstale":"2024-09-12T00:35:19.505464+0000","last_undegraded":"2024-09-12T00:35:19.505464+0000","last_fullsized":"2024-09-12T00:35:19.505464+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:23.867988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:04.377127+0000","last_change":"2024-09-12T00:17:03.220542+0000","last_active":"2024-09-12T00:34:04.377127+0000","last_peered":"2024-09-12T00:34:04.377127+0000","last_clean":"2024-09-12T00:34:04.377127+0000","last_became_active":"2024-09-12T00:17:03.218684+0000","last_became_peered":"2024-09-12T00:17:03.218684+0000","last_unstale":"2024-09-12T00:34:04.377127+0000","last_undegraded":"2024-09-12T00:34:04.377127+0000","last_fullsized":"2024-09-12T00:34:04.377127+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:18.120265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'18","reported_seq":73,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.581725+0000","last_change":"2024-09-12T00:17:00.186275+0000","last_active":"2024-09-12T00:38:37.581725+0000","last_peered":"2024-09-12T00:38:37.581725+0000","last_clean":"2024-09-12T00:38:37.581725+0000","last_became_active":"2024-09-12T00:17:00.185974+0000","last_became_peered":"2024-09-12T00:17:00.185974+0000","last_unstale":"2024-09-12T00:38:37.581725+0000","last_undegraded":"2024-09-12T00:38:37.581725+0000","last_fullsized":"2024-09-12T00:38:37.581725+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:40.351049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":38916,"num_write":33,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'44","reported_seq":155,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:34.507543+0000","last_change":"2024-09-12T00:15:34.423404+0000","last_active":"2024-09-12T00:35:34.507543+0000","last_peered":"2024-09-12T00:35:34.507543+0000","last_clean":"2024-09-12T00:35:34.507543+0000","last_became_active":"2024-09-12T00:15:34.423149+0000","last_became_peered":"2024-09-12T00:15:34.423149+0000","last_unstale":"2024-09-12T00:35:34.507543+0000","last_undegraded":"2024-09-12T00:35:34.507543+0000","last_fullsized":"2024-09-12T00:35:34.507543+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:23.508263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":150,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:37.510807+0000","last_change":"2024-09-12T00:27:17.575993+0000","last_active":"2024-09-12T00:35:37.510807+0000","last_peered":"2024-09-12T00:35:37.510807+0000","last_clean":"2024-09-12T00:35:37.510807+0000","last_became_active":"2024-09-12T00:27:17.575513+0000","last_became_peered":"2024-09-12T00:27:17.575513+0000","last_unstale":"2024-09-12T00:35:37.510807+0000","last_undegraded":"2024-09-12T00:35:37.510807+0000","last_fullsized":"2024-09-12T00:35:37.510807+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:31.106786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.376944+0000","last_change":"2024-09-12T00:17:03.220037+0000","last_active":"2024-09-12T00:33:59.376944+0000","last_peered":"2024-09-12T00:33:59.376944+0000","last_clean":"2024-09-12T00:33:59.376944+0000","last_became_active":"2024-09-12T00:17:03.219058+0000","last_became_peered":"2024-09-12T00:17:03.219058+0000","last_unstale":"2024-09-12T00:33:59.376944+0000","last_undegraded":"2024-09-12T00:33:59.376944+0000","last_fullsized":"2024-09-12T00:33:59.376944+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:44.822354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.377013+0000","last_change":"2024-09-12T00:17:00.183145+0000","last_active":"2024-09-12T00:33:59.377013+0000","last_peered":"2024-09-12T00:33:59.377013+0000","last_clean":"2024-09-12T00:33:59.377013+0000","last_became_active":"2024-09-12T00:17:00.182830+0000","last_became_peered":"2024-09-12T00:17:00.182830+0000","last_unstale":"2024-09-12T00:33:59.377013+0000","last_undegraded":"2024-09-12T00:33:59.377013+0000","last_fullsized":"2024-09-12T00:33:59.377013+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:04.640403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'10","reported_seq":67,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:34.625266+0000","last_change":"2024-09-12T00:15:34.421131+0000","last_active":"2024-09-12T00:35:34.625266+0000","last_peered":"2024-09-12T00:35:34.625266+0000","last_clean":"2024-09-12T00:35:34.625266+0000","last_became_active":"2024-09-12T00:15:34.420841+0000","last_became_peered":"2024-09-12T00:15:34.420841+0000","last_unstale":"2024-09-12T00:35:34.625266+0000","last_undegraded":"2024-09-12T00:35:34.625266+0000","last_fullsized":"2024-09-12T00:35:34.625266+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:18.021901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.618279+0000","last_change":"2024-09-12T00:27:17.583663+0000","last_active":"2024-09-12T00:34:49.618279+0000","last_peered":"2024-09-12T00:34:49.618279+0000","last_clean":"2024-09-12T00:34:49.618279+0000","last_became_active":"2024-09-12T00:27:17.583300+0000","last_became_peered":"2024-09-12T00:27:17.583300+0000","last_unstale":"2024-09-12T00:34:49.618279+0000","last_undegraded":"2024-09-12T00:34:49.618279+0000","last_fullsized":"2024-09-12T00:34:49.618279+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:10.632365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615804+0000","last_change":"2024-09-12T00:17:03.212176+0000","last_active":"2024-09-12T00:34:34.615804+0000","last_peered":"2024-09-12T00:34:34.615804+0000","last_clean":"2024-09-12T00:34:34.615804+0000","last_became_active":"2024-09-12T00:17:03.211869+0000","last_became_peered":"2024-09-12T00:17:03.211869+0000","last_unstale":"2024-09-12T00:34:34.615804+0000","last_undegraded":"2024-09-12T00:34:34.615804+0000","last_fullsized":"2024-09-12T00:34:34.615804+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:39.796531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'3","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.400202+0000","last_change":"2024-09-12T00:17:00.181340+0000","last_active":"2024-09-12T00:36:59.400202+0000","last_peered":"2024-09-12T00:36:59.400202+0000","last_clean":"2024-09-12T00:36:59.400202+0000","last_became_active":"2024-09-12T00:17:00.180995+0000","last_became_peered":"2024-09-12T00:17:00.180995+0000","last_unstale":"2024-09-12T00:36:59.400202+0000","last_undegraded":"2024-09-12T00:36:59.400202+0000","last_fullsized":"2024-09-12T00:36:59.400202+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:35.862245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"261'23","reported_seq":101,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.468546+0000","last_change":"2024-09-12T00:15:34.417460+0000","last_active":"2024-09-12T00:36:56.468546+0000","last_peered":"2024-09-12T00:36:56.468546+0000","last_clean":"2024-09-12T00:36:56.468546+0000","last_became_active":"2024-09-12T00:15:34.417149+0000","last_became_peered":"2024-09-12T00:15:34.417149+0000","last_unstale":"2024-09-12T00:36:56.468546+0000","last_undegraded":"2024-09-12T00:36:56.468546+0000","last_fullsized":"2024-09-12T00:36:56.468546+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:57.189731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.383151+0000","last_change":"2024-09-12T00:27:17.579098+0000","last_active":"2024-09-12T00:34:49.383151+0000","last_peered":"2024-09-12T00:34:49.383151+0000","last_clean":"2024-09-12T00:34:49.383151+0000","last_became_active":"2024-09-12T00:27:17.578739+0000","last_became_peered":"2024-09-12T00:27:17.578739+0000","last_unstale":"2024-09-12T00:34:49.383151+0000","last_undegraded":"2024-09-12T00:34:49.383151+0000","last_fullsized":"2024-09-12T00:34:49.383151+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:48.348663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'3","reported_seq":30,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.519599+0000","last_change":"2024-09-12T00:17:03.213329+0000","last_active":"2024-09-12T00:37:04.519599+0000","last_peered":"2024-09-12T00:37:04.519599+0000","last_clean":"2024-09-12T00:37:04.519599+0000","last_became_active":"2024-09-12T00:17:03.213071+0000","last_became_peered":"2024-09-12T00:17:03.213071+0000","last_unstale":"2024-09-12T00:37:04.519599+0000","last_undegraded":"2024-09-12T00:37:04.519599+0000","last_fullsized":"2024-09-12T00:37:04.519599+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:46.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.497692+0000","last_change":"2024-09-12T00:17:00.178668+0000","last_active":"2024-09-12T00:34:29.497692+0000","last_peered":"2024-09-12T00:34:29.497692+0000","last_clean":"2024-09-12T00:34:29.497692+0000","last_became_active":"2024-09-12T00:17:00.178279+0000","last_became_peered":"2024-09-12T00:17:00.178279+0000","last_unstale":"2024-09-12T00:34:29.497692+0000","last_undegraded":"2024-09-12T00:34:29.497692+0000","last_fullsized":"2024-09-12T00:34:29.497692+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:59.897917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'24","reported_seq":104,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:54.501600+0000","last_change":"2024-09-12T00:15:34.420370+0000","last_active":"2024-09-12T00:34:54.501600+0000","last_peered":"2024-09-12T00:34:54.501600+0000","last_clean":"2024-09-12T00:34:54.501600+0000","last_became_active":"2024-09-12T00:15:34.420120+0000","last_became_peered":"2024-09-12T00:15:34.420120+0000","last_unstale":"2024-09-12T00:34:54.501600+0000","last_undegraded":"2024-09-12T00:34:54.501600+0000","last_fullsized":"2024-09-12T00:34:54.501600+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:10.354241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.497122+0000","last_change":"2024-09-12T00:27:17.578396+0000","last_active":"2024-09-12T00:34:19.497122+0000","last_peered":"2024-09-12T00:34:19.497122+0000","last_clean":"2024-09-12T00:34:19.497122+0000","last_became_active":"2024-09-12T00:27:17.577671+0000","last_became_peered":"2024-09-12T00:27:17.577671+0000","last_unstale":"2024-09-12T00:34:19.497122+0000","last_undegraded":"2024-09-12T00:34:19.497122+0000","last_fullsized":"2024-09-12T00:34:19.497122+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:02.287213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.494167+0000","last_change":"2024-09-12T00:17:03.214034+0000","last_active":"2024-09-12T00:33:59.494167+0000","last_peered":"2024-09-12T00:33:59.494167+0000","last_clean":"2024-09-12T00:33:59.494167+0000","last_became_active":"2024-09-12T00:17:03.213775+0000","last_became_peered":"2024-09-12T00:17:03.213775+0000","last_unstale":"2024-09-12T00:33:59.494167+0000","last_undegraded":"2024-09-12T00:33:59.494167+0000","last_fullsized":"2024-09-12T00:33:59.494167+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:03.713762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'6","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.583918+0000","last_change":"2024-09-12T00:17:00.183189+0000","last_active":"2024-09-12T00:38:37.583918+0000","last_peered":"2024-09-12T00:38:37.583918+0000","last_clean":"2024-09-12T00:38:37.583918+0000","last_became_active":"2024-09-12T00:17:00.182842+0000","last_became_peered":"2024-09-12T00:17:00.182842+0000","last_unstale":"2024-09-12T00:38:37.583918+0000","last_undegraded":"2024-09-12T00:38:37.583918+0000","last_fullsized":"2024-09-12T00:38:37.583918+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:45.925037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'14","reported_seq":77,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:57.505085+0000","last_change":"2024-09-12T00:15:34.421873+0000","last_active":"2024-09-12T00:34:57.505085+0000","last_peered":"2024-09-12T00:34:57.505085+0000","last_clean":"2024-09-12T00:34:57.505085+0000","last_became_active":"2024-09-12T00:15:34.421585+0000","last_became_peered":"2024-09-12T00:15:34.421585+0000","last_unstale":"2024-09-12T00:34:57.505085+0000","last_undegraded":"2024-09-12T00:34:57.505085+0000","last_fullsized":"2024-09-12T00:34:57.505085+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:19.525663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.496362+0000","last_change":"2024-09-12T00:27:17.573564+0000","last_active":"2024-09-12T00:34:19.496362+0000","last_peered":"2024-09-12T00:34:19.496362+0000","last_clean":"2024-09-12T00:34:19.496362+0000","last_became_active":"2024-09-12T00:27:17.572899+0000","last_became_peered":"2024-09-12T00:27:17.572899+0000","last_unstale":"2024-09-12T00:34:19.496362+0000","last_undegraded":"2024-09-12T00:34:19.496362+0000","last_fullsized":"2024-09-12T00:34:19.496362+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:35.537722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509411+0000","last_change":"2024-09-12T00:17:03.217326+0000","last_active":"2024-09-12T00:35:44.509411+0000","last_peered":"2024-09-12T00:35:44.509411+0000","last_clean":"2024-09-12T00:35:44.509411+0000","last_became_active":"2024-09-12T00:17:03.217052+0000","last_became_peered":"2024-09-12T00:17:03.217052+0000","last_unstale":"2024-09-12T00:35:44.509411+0000","last_undegraded":"2024-09-12T00:35:44.509411+0000","last_fullsized":"2024-09-12T00:35:44.509411+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:57.870587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:54.375795+0000","last_change":"2024-09-12T00:17:00.181429+0000","last_active":"2024-09-12T00:33:54.375795+0000","last_peered":"2024-09-12T00:33:54.375795+0000","last_clean":"2024-09-12T00:33:54.375795+0000","last_became_active":"2024-09-12T00:17:00.181082+0000","last_became_peered":"2024-09-12T00:17:00.181082+0000","last_unstale":"2024-09-12T00:33:54.375795+0000","last_undegraded":"2024-09-12T00:33:54.375795+0000","last_fullsized":"2024-09-12T00:33:54.375795+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:14.637476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'32","reported_seq":127,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:57.505046+0000","last_change":"2024-09-12T00:15:34.414194+0000","last_active":"2024-09-12T00:34:57.505046+0000","last_peered":"2024-09-12T00:34:57.505046+0000","last_clean":"2024-09-12T00:34:57.505046+0000","last_became_active":"2024-09-12T00:15:34.413875+0000","last_became_peered":"2024-09-12T00:15:34.413875+0000","last_unstale":"2024-09-12T00:34:57.505046+0000","last_undegraded":"2024-09-12T00:34:57.505046+0000","last_fullsized":"2024-09-12T00:34:57.505046+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:38.268487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":63,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.613353+0000","last_change":"2024-09-12T00:27:17.577218+0000","last_active":"2024-09-12T00:34:19.613353+0000","last_peered":"2024-09-12T00:34:19.613353+0000","last_clean":"2024-09-12T00:34:19.613353+0000","last_became_active":"2024-09-12T00:27:17.576878+0000","last_became_peered":"2024-09-12T00:27:17.576878+0000","last_unstale":"2024-09-12T00:34:19.613353+0000","last_undegraded":"2024-09-12T00:34:19.613353+0000","last_fullsized":"2024-09-12T00:34:19.613353+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:47.322848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.494224+0000","last_change":"2024-09-12T00:17:03.216054+0000","last_active":"2024-09-12T00:33:59.494224+0000","last_peered":"2024-09-12T00:33:59.494224+0000","last_clean":"2024-09-12T00:33:59.494224+0000","last_became_active":"2024-09-12T00:17:03.215625+0000","last_became_peered":"2024-09-12T00:17:03.215625+0000","last_unstale":"2024-09-12T00:33:59.494224+0000","last_undegraded":"2024-09-12T00:33:59.494224+0000","last_fullsized":"2024-09-12T00:33:59.494224+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:53.227970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:54.493546+0000","last_change":"2024-09-12T00:17:00.182907+0000","last_active":"2024-09-12T00:33:54.493546+0000","last_peered":"2024-09-12T00:33:54.493546+0000","last_clean":"2024-09-12T00:33:54.493546+0000","last_became_active":"2024-09-12T00:17:00.182392+0000","last_became_peered":"2024-09-12T00:17:00.182392+0000","last_unstale":"2024-09-12T00:33:54.493546+0000","last_undegraded":"2024-09-12T00:33:54.493546+0000","last_fullsized":"2024-09-12T00:33:54.493546+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:13.824576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:54.501773+0000","last_change":"2024-09-12T00:15:34.419666+0000","last_active":"2024-09-12T00:34:54.501773+0000","last_peered":"2024-09-12T00:34:54.501773+0000","last_clean":"2024-09-12T00:34:54.501773+0000","last_became_active":"2024-09-12T00:15:34.419377+0000","last_became_peered":"2024-09-12T00:15:34.419377+0000","last_unstale":"2024-09-12T00:34:54.501773+0000","last_undegraded":"2024-09-12T00:34:54.501773+0000","last_fullsized":"2024-09-12T00:34:54.501773+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:00.834278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:19.379164+0000","last_change":"2024-09-12T00:27:17.580695+0000","last_active":"2024-09-12T00:34:19.379164+0000","last_peered":"2024-09-12T00:34:19.379164+0000","last_clean":"2024-09-12T00:34:19.379164+0000","last_became_active":"2024-09-12T00:27:17.580400+0000","last_became_peered":"2024-09-12T00:27:17.580400+0000","last_unstale":"2024-09-12T00:34:19.379164+0000","last_undegraded":"2024-09-12T00:34:19.379164+0000","last_fullsized":"2024-09-12T00:34:19.379164+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:32.333059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"258'5","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:59.376572+0000","last_change":"2024-09-12T00:17:03.224050+0000","last_active":"2024-09-12T00:33:59.376572+0000","last_peered":"2024-09-12T00:33:59.376572+0000","last_clean":"2024-09-12T00:33:59.376572+0000","last_became_active":"2024-09-12T00:17:03.223700+0000","last_became_peered":"2024-09-12T00:17:03.223700+0000","last_unstale":"2024-09-12T00:33:59.376572+0000","last_undegraded":"2024-09-12T00:33:59.376572+0000","last_fullsized":"2024-09-12T00:33:59.376572+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:20.435420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:33:54.493928+0000","last_change":"2024-09-12T00:17:00.170090+0000","last_active":"2024-09-12T00:33:54.493928+0000","last_peered":"2024-09-12T00:33:54.493928+0000","last_clean":"2024-09-12T00:33:54.493928+0000","last_became_active":"2024-09-12T00:17:00.169797+0000","last_became_peered":"2024-09-12T00:17:00.169797+0000","last_unstale":"2024-09-12T00:33:54.493928+0000","last_undegraded":"2024-09-12T00:33:54.493928+0000","last_fullsized":"2024-09-12T00:33:54.493928+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:21.374423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'40","reported_seq":151,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:53.994944+0000","last_change":"2024-09-12T00:15:34.422467+0000","last_active":"2024-09-12T00:36:53.994944+0000","last_peered":"2024-09-12T00:36:53.994944+0000","last_clean":"2024-09-12T00:36:53.994944+0000","last_became_active":"2024-09-12T00:15:34.422176+0000","last_became_peered":"2024-09-12T00:15:34.422176+0000","last_unstale":"2024-09-12T00:36:53.994944+0000","last_undegraded":"2024-09-12T00:36:53.994944+0000","last_fullsized":"2024-09-12T00:36:53.994944+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:33.956475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":149,"num_write":70,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499308+0000","last_change":"2024-09-12T00:27:17.579910+0000","last_active":"2024-09-12T00:34:34.499308+0000","last_peered":"2024-09-12T00:34:34.499308+0000","last_clean":"2024-09-12T00:34:34.499308+0000","last_became_active":"2024-09-12T00:27:17.579646+0000","last_became_peered":"2024-09-12T00:27:17.579646+0000","last_unstale":"2024-09-12T00:34:34.499308+0000","last_undegraded":"2024-09-12T00:34:34.499308+0000","last_fullsized":"2024-09-12T00:34:34.499308+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:11.016979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"261'6","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:04.528413+0000","last_change":"2024-09-12T00:17:03.212032+0000","last_active":"2024-09-12T00:38:04.528413+0000","last_peered":"2024-09-12T00:38:04.528413+0000","last_clean":"2024-09-12T00:38:04.528413+0000","last_became_active":"2024-09-12T00:17:03.211732+0000","last_became_peered":"2024-09-12T00:17:03.211732+0000","last_unstale":"2024-09-12T00:38:04.528413+0000","last_undegraded":"2024-09-12T00:38:04.528413+0000","last_fullsized":"2024-09-12T00:38:04.528413+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:51.849541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:41.507507+0000","last_change":"2024-09-12T00:17:00.175751+0000","last_active":"2024-09-12T00:35:41.507507+0000","last_peered":"2024-09-12T00:35:41.507507+0000","last_clean":"2024-09-12T00:35:41.507507+0000","last_became_active":"2024-09-12T00:17:00.175460+0000","last_became_peered":"2024-09-12T00:17:00.175460+0000","last_unstale":"2024-09-12T00:35:41.507507+0000","last_undegraded":"2024-09-12T00:35:41.507507+0000","last_fullsized":"2024-09-12T00:35:41.507507+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:16.723140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'37","reported_seq":132,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.379113+0000","last_change":"2024-09-12T00:15:34.424716+0000","last_active":"2024-09-12T00:34:14.379113+0000","last_peered":"2024-09-12T00:34:14.379113+0000","last_clean":"2024-09-12T00:34:14.379113+0000","last_became_active":"2024-09-12T00:15:34.423734+0000","last_became_peered":"2024-09-12T00:15:34.423734+0000","last_unstale":"2024-09-12T00:34:14.379113+0000","last_undegraded":"2024-09-12T00:34:14.379113+0000","last_fullsized":"2024-09-12T00:34:14.379113+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:11.973619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":116,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498603+0000","last_change":"2024-09-12T00:27:17.574614+0000","last_active":"2024-09-12T00:34:34.498603+0000","last_peered":"2024-09-12T00:34:34.498603+0000","last_clean":"2024-09-12T00:34:34.498603+0000","last_became_active":"2024-09-12T00:27:17.574346+0000","last_became_peered":"2024-09-12T00:27:17.574346+0000","last_unstale":"2024-09-12T00:34:34.498603+0000","last_undegraded":"2024-09-12T00:34:34.498603+0000","last_fullsized":"2024-09-12T00:34:34.498603+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:58.931421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:04.528366+0000","last_change":"2024-09-12T00:17:03.210709+0000","last_active":"2024-09-12T00:38:04.528366+0000","last_peered":"2024-09-12T00:38:04.528366+0000","last_clean":"2024-09-12T00:38:04.528366+0000","last_became_active":"2024-09-12T00:17:03.210439+0000","last_became_peered":"2024-09-12T00:17:03.210439+0000","last_unstale":"2024-09-12T00:38:04.528366+0000","last_undegraded":"2024-09-12T00:38:04.528366+0000","last_fullsized":"2024-09-12T00:38:04.528366+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:13.002169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'2","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:59.527639+0000","last_change":"2024-09-12T00:17:00.179628+0000","last_active":"2024-09-12T00:37:59.527639+0000","last_peered":"2024-09-12T00:37:59.527639+0000","last_clean":"2024-09-12T00:37:59.527639+0000","last_became_active":"2024-09-12T00:17:00.179337+0000","last_became_peered":"2024-09-12T00:17:00.179337+0000","last_unstale":"2024-09-12T00:37:59.527639+0000","last_undegraded":"2024-09-12T00:37:59.527639+0000","last_fullsized":"2024-09-12T00:37:59.527639+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:55.994787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'135","reported_seq":450,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.496301+0000","last_change":"2024-09-12T00:15:34.421442+0000","last_active":"2024-09-12T00:34:14.496301+0000","last_peered":"2024-09-12T00:34:14.496301+0000","last_clean":"2024-09-12T00:34:14.496301+0000","last_became_active":"2024-09-12T00:15:34.421180+0000","last_became_peered":"2024-09-12T00:15:34.421180+0000","last_unstale":"2024-09-12T00:34:14.496301+0000","last_undegraded":"2024-09-12T00:34:14.496301+0000","last_fullsized":"2024-09-12T00:34:14.496301+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:29.396389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":617,"num_write":164,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:17.499229+0000","last_change":"2024-09-12T00:27:17.575634+0000","last_active":"2024-09-12T00:34:17.499229+0000","last_peered":"2024-09-12T00:34:17.499229+0000","last_clean":"2024-09-12T00:34:17.499229+0000","last_became_active":"2024-09-12T00:27:17.575257+0000","last_became_peered":"2024-09-12T00:27:17.575257+0000","last_unstale":"2024-09-12T00:34:17.499229+0000","last_undegraded":"2024-09-12T00:34:17.499229+0000","last_fullsized":"2024-09-12T00:34:17.499229+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:49.548072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'2","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:04.406864+0000","last_change":"2024-09-12T00:17:03.222496+0000","last_active":"2024-09-12T00:38:04.406864+0000","last_peered":"2024-09-12T00:38:04.406864+0000","last_clean":"2024-09-12T00:38:04.406864+0000","last_became_active":"2024-09-12T00:17:03.222110+0000","last_became_peered":"2024-09-12T00:17:03.222110+0000","last_unstale":"2024-09-12T00:38:04.406864+0000","last_undegraded":"2024-09-12T00:38:04.406864+0000","last_fullsized":"2024-09-12T00:38:04.406864+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:07.242934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:41.507584+0000","last_change":"2024-09-12T00:17:00.174832+0000","last_active":"2024-09-12T00:35:41.507584+0000","last_peered":"2024-09-12T00:35:41.507584+0000","last_clean":"2024-09-12T00:35:41.507584+0000","last_became_active":"2024-09-12T00:17:00.174537+0000","last_became_peered":"2024-09-12T00:17:00.174537+0000","last_unstale":"2024-09-12T00:35:41.507584+0000","last_undegraded":"2024-09-12T00:35:41.507584+0000","last_fullsized":"2024-09-12T00:35:41.507584+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:23.549160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"258'31","reported_seq":128,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.612667+0000","last_change":"2024-09-12T00:15:34.428066+0000","last_active":"2024-09-12T00:34:14.612667+0000","last_peered":"2024-09-12T00:34:14.612667+0000","last_clean":"2024-09-12T00:34:14.612667+0000","last_became_active":"2024-09-12T00:15:34.427756+0000","last_became_peered":"2024-09-12T00:15:34.427756+0000","last_unstale":"2024-09-12T00:34:14.612667+0000","last_undegraded":"2024-09-12T00:34:14.612667+0000","last_fullsized":"2024-09-12T00:34:14.612667+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:05.925579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":137,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498569+0000","last_change":"2024-09-12T00:27:17.577377+0000","last_active":"2024-09-12T00:34:34.498569+0000","last_peered":"2024-09-12T00:34:34.498569+0000","last_clean":"2024-09-12T00:34:34.498569+0000","last_became_active":"2024-09-12T00:27:17.577076+0000","last_became_peered":"2024-09-12T00:27:17.577076+0000","last_unstale":"2024-09-12T00:34:34.498569+0000","last_undegraded":"2024-09-12T00:34:34.498569+0000","last_fullsized":"2024-09-12T00:34:34.498569+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.624069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391561+0000","last_change":"2024-09-12T00:17:03.217429+0000","last_active":"2024-09-12T00:35:44.391561+0000","last_peered":"2024-09-12T00:35:44.391561+0000","last_clean":"2024-09-12T00:35:44.391561+0000","last_became_active":"2024-09-12T00:17:03.217101+0000","last_became_peered":"2024-09-12T00:17:03.217101+0000","last_unstale":"2024-09-12T00:35:44.391561+0000","last_undegraded":"2024-09-12T00:35:44.391561+0000","last_fullsized":"2024-09-12T00:35:44.391561+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:37.636780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:41.507635+0000","last_change":"2024-09-12T00:17:00.180771+0000","last_active":"2024-09-12T00:35:41.507635+0000","last_peered":"2024-09-12T00:35:41.507635+0000","last_clean":"2024-09-12T00:35:41.507635+0000","last_became_active":"2024-09-12T00:17:00.180475+0000","last_became_peered":"2024-09-12T00:17:00.180475+0000","last_unstale":"2024-09-12T00:35:41.507635+0000","last_undegraded":"2024-09-12T00:35:41.507635+0000","last_fullsized":"2024-09-12T00:35:41.507635+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:32.615984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'61","reported_seq":207,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:14.496260+0000","last_change":"2024-09-12T00:15:34.419120+0000","last_active":"2024-09-12T00:34:14.496260+0000","last_peered":"2024-09-12T00:34:14.496260+0000","last_clean":"2024-09-12T00:34:14.496260+0000","last_became_active":"2024-09-12T00:15:34.418831+0000","last_became_peered":"2024-09-12T00:15:34.418831+0000","last_unstale":"2024-09-12T00:34:14.496260+0000","last_undegraded":"2024-09-12T00:34:14.496260+0000","last_fullsized":"2024-09-12T00:34:14.496260+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:01.991294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":218,"num_write":105,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.511752+0000","last_change":"2024-09-12T00:27:17.579649+0000","last_active":"2024-09-12T00:35:59.511752+0000","last_peered":"2024-09-12T00:35:59.511752+0000","last_clean":"2024-09-12T00:35:59.511752+0000","last_became_active":"2024-09-12T00:27:17.579263+0000","last_became_peered":"2024-09-12T00:27:17.579263+0000","last_unstale":"2024-09-12T00:35:59.511752+0000","last_undegraded":"2024-09-12T00:35:59.511752+0000","last_fullsized":"2024-09-12T00:35:59.511752+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:10.487761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"258'2","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503243+0000","last_change":"2024-09-12T00:17:03.211987+0000","last_active":"2024-09-12T00:35:04.503243+0000","last_peered":"2024-09-12T00:35:04.503243+0000","last_clean":"2024-09-12T00:35:04.503243+0000","last_became_active":"2024-09-12T00:17:03.211582+0000","last_became_peered":"2024-09-12T00:17:03.211582+0000","last_unstale":"2024-09-12T00:35:04.503243+0000","last_undegraded":"2024-09-12T00:35:04.503243+0000","last_fullsized":"2024-09-12T00:35:04.503243+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:27.493123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:14.638379+0000","last_change":"2024-09-12T00:17:00.182834+0000","last_active":"2024-09-12T00:37:14.638379+0000","last_peered":"2024-09-12T00:37:14.638379+0000","last_clean":"2024-09-12T00:37:14.638379+0000","last_became_active":"2024-09-12T00:17:00.182477+0000","last_became_peered":"2024-09-12T00:17:00.182477+0000","last_unstale":"2024-09-12T00:37:14.638379+0000","last_undegraded":"2024-09-12T00:37:14.638379+0000","last_fullsized":"2024-09-12T00:37:14.638379+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:39.317297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"258'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.510828+0000","last_change":"2024-09-12T00:15:34.419921+0000","last_active":"2024-09-12T00:35:54.510828+0000","last_peered":"2024-09-12T00:35:54.510828+0000","last_clean":"2024-09-12T00:35:54.510828+0000","last_became_active":"2024-09-12T00:15:34.419584+0000","last_became_peered":"2024-09-12T00:15:34.419584+0000","last_unstale":"2024-09-12T00:35:54.510828+0000","last_undegraded":"2024-09-12T00:35:54.510828+0000","last_fullsized":"2024-09-12T00:35:54.510828+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:04.179967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:16.512831+0000","last_change":"2024-09-12T00:27:17.580152+0000","last_active":"2024-09-12T00:36:16.512831+0000","last_peered":"2024-09-12T00:36:16.512831+0000","last_clean":"2024-09-12T00:36:16.512831+0000","last_became_active":"2024-09-12T00:27:17.579859+0000","last_became_peered":"2024-09-12T00:27:17.579859+0000","last_unstale":"2024-09-12T00:36:16.512831+0000","last_undegraded":"2024-09-12T00:36:16.512831+0000","last_fullsized":"2024-09-12T00:36:16.512831+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:44.205082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'3","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:19.521855+0000","last_change":"2024-09-12T00:17:03.216727+0000","last_active":"2024-09-12T00:37:19.521855+0000","last_peered":"2024-09-12T00:37:19.521855+0000","last_clean":"2024-09-12T00:37:19.521855+0000","last_became_active":"2024-09-12T00:17:03.216437+0000","last_became_peered":"2024-09-12T00:17:03.216437+0000","last_unstale":"2024-09-12T00:37:19.521855+0000","last_undegraded":"2024-09-12T00:37:19.521855+0000","last_fullsized":"2024-09-12T00:37:19.521855+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:54.699248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.502357+0000","last_change":"2024-09-12T00:17:00.179209+0000","last_active":"2024-09-12T00:34:59.502357+0000","last_peered":"2024-09-12T00:34:59.502357+0000","last_clean":"2024-09-12T00:34:59.502357+0000","last_became_active":"2024-09-12T00:17:00.178905+0000","last_became_peered":"2024-09-12T00:17:00.178905+0000","last_unstale":"2024-09-12T00:34:59.502357+0000","last_undegraded":"2024-09-12T00:34:59.502357+0000","last_fullsized":"2024-09-12T00:34:59.502357+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:09.052476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'17","reported_seq":81,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.392457+0000","last_change":"2024-09-12T00:15:34.419487+0000","last_active":"2024-09-12T00:35:49.392457+0000","last_peered":"2024-09-12T00:35:49.392457+0000","last_clean":"2024-09-12T00:35:49.392457+0000","last_became_active":"2024-09-12T00:15:34.418859+0000","last_became_peered":"2024-09-12T00:15:34.418859+0000","last_unstale":"2024-09-12T00:35:49.392457+0000","last_undegraded":"2024-09-12T00:35:49.392457+0000","last_fullsized":"2024-09-12T00:35:49.392457+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:58.036831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.393701+0000","last_change":"2024-09-12T00:27:17.579640+0000","last_active":"2024-09-12T00:35:59.393701+0000","last_peered":"2024-09-12T00:35:59.393701+0000","last_clean":"2024-09-12T00:35:59.393701+0000","last_became_active":"2024-09-12T00:27:17.577728+0000","last_became_peered":"2024-09-12T00:27:17.577728+0000","last_unstale":"2024-09-12T00:35:59.393701+0000","last_undegraded":"2024-09-12T00:35:59.393701+0000","last_fullsized":"2024-09-12T00:35:59.393701+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:51.317752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"261'13","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.732492+0000","last_change":"2024-09-12T00:17:03.215255+0000","last_active":"2024-09-12T00:38:37.732492+0000","last_peered":"2024-09-12T00:38:37.732492+0000","last_clean":"2024-09-12T00:38:37.732492+0000","last_became_active":"2024-09-12T00:17:03.214958+0000","last_became_peered":"2024-09-12T00:17:03.214958+0000","last_unstale":"2024-09-12T00:38:37.732492+0000","last_undegraded":"2024-09-12T00:38:37.732492+0000","last_fullsized":"2024-09-12T00:38:37.732492+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:24.067787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":22528,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"261'9","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.312475+0000","last_change":"2024-09-12T00:17:00.184968+0000","last_active":"2024-09-12T00:38:37.312475+0000","last_peered":"2024-09-12T00:38:37.312475+0000","last_clean":"2024-09-12T00:38:37.312475+0000","last_became_active":"2024-09-12T00:17:00.184703+0000","last_became_peered":"2024-09-12T00:17:00.184703+0000","last_unstale":"2024-09-12T00:38:37.312475+0000","last_undegraded":"2024-09-12T00:38:37.312475+0000","last_fullsized":"2024-09-12T00:38:37.312475+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:09.775190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":24576,"num_write":9,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'12","reported_seq":74,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:51.509350+0000","last_change":"2024-09-12T00:15:34.424421+0000","last_active":"2024-09-12T00:35:51.509350+0000","last_peered":"2024-09-12T00:35:51.509350+0000","last_clean":"2024-09-12T00:35:51.509350+0000","last_became_active":"2024-09-12T00:15:34.424129+0000","last_became_peered":"2024-09-12T00:15:34.424129+0000","last_unstale":"2024-09-12T00:35:51.509350+0000","last_undegraded":"2024-09-12T00:35:51.509350+0000","last_fullsized":"2024-09-12T00:35:51.509350+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:19.458965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:56.510098+0000","last_change":"2024-09-12T00:27:17.571287+0000","last_active":"2024-09-12T00:35:56.510098+0000","last_peered":"2024-09-12T00:35:56.510098+0000","last_clean":"2024-09-12T00:35:56.510098+0000","last_became_active":"2024-09-12T00:27:17.570973+0000","last_became_peered":"2024-09-12T00:27:17.570973+0000","last_unstale":"2024-09-12T00:35:56.510098+0000","last_undegraded":"2024-09-12T00:35:56.510098+0000","last_fullsized":"2024-09-12T00:35:56.510098+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:28.959152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"258'5","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503609+0000","last_change":"2024-09-12T00:17:03.221266+0000","last_active":"2024-09-12T00:35:04.503609+0000","last_peered":"2024-09-12T00:35:04.503609+0000","last_clean":"2024-09-12T00:35:04.503609+0000","last_became_active":"2024-09-12T00:17:03.220961+0000","last_became_peered":"2024-09-12T00:17:03.220961+0000","last_unstale":"2024-09-12T00:35:04.503609+0000","last_undegraded":"2024-09-12T00:35:04.503609+0000","last_fullsized":"2024-09-12T00:35:04.503609+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:28.129316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:19.521951+0000","last_change":"2024-09-12T00:17:00.178846+0000","last_active":"2024-09-12T00:37:19.521951+0000","last_peered":"2024-09-12T00:37:19.521951+0000","last_clean":"2024-09-12T00:37:19.521951+0000","last_became_active":"2024-09-12T00:17:00.178572+0000","last_became_peered":"2024-09-12T00:17:00.178572+0000","last_unstale":"2024-09-12T00:37:19.521951+0000","last_undegraded":"2024-09-12T00:37:19.521951+0000","last_fullsized":"2024-09-12T00:37:19.521951+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:24.934660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'26","reported_seq":111,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510002+0000","last_change":"2024-09-12T00:15:34.421329+0000","last_active":"2024-09-12T00:35:49.510002+0000","last_peered":"2024-09-12T00:35:49.510002+0000","last_clean":"2024-09-12T00:35:49.510002+0000","last_became_active":"2024-09-12T00:15:34.421019+0000","last_became_peered":"2024-09-12T00:15:34.421019+0000","last_unstale":"2024-09-12T00:35:49.510002+0000","last_undegraded":"2024-09-12T00:35:49.510002+0000","last_fullsized":"2024-09-12T00:35:49.510002+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:35.834745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":93,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.514214+0000","last_change":"2024-09-12T00:27:17.581884+0000","last_active":"2024-09-12T00:36:19.514214+0000","last_peered":"2024-09-12T00:36:19.514214+0000","last_clean":"2024-09-12T00:36:19.514214+0000","last_became_active":"2024-09-12T00:27:17.579926+0000","last_became_peered":"2024-09-12T00:27:17.579926+0000","last_unstale":"2024-09-12T00:36:19.514214+0000","last_undegraded":"2024-09-12T00:36:19.514214+0000","last_fullsized":"2024-09-12T00:36:19.514214+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:28.218032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'3","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:34.397751+0000","last_change":"2024-09-12T00:17:03.219491+0000","last_active":"2024-09-12T00:36:34.397751+0000","last_peered":"2024-09-12T00:36:34.397751+0000","last_clean":"2024-09-12T00:36:34.397751+0000","last_became_active":"2024-09-12T00:17:03.219156+0000","last_became_peered":"2024-09-12T00:17:03.219156+0000","last_unstale":"2024-09-12T00:36:34.397751+0000","last_undegraded":"2024-09-12T00:36:34.397751+0000","last_fullsized":"2024-09-12T00:36:34.397751+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:35.748043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.201727+0000","last_change":"2024-09-12T00:17:00.182726+0000","last_active":"2024-09-12T00:38:38.201727+0000","last_peered":"2024-09-12T00:38:38.201727+0000","last_clean":"2024-09-12T00:38:38.201727+0000","last_became_active":"2024-09-12T00:17:00.182424+0000","last_became_peered":"2024-09-12T00:17:00.182424+0000","last_unstale":"2024-09-12T00:38:38.201727+0000","last_undegraded":"2024-09-12T00:38:38.201727+0000","last_fullsized":"2024-09-12T00:38:38.201727+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:44.087656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"258'17","reported_seq":89,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.509911+0000","last_change":"2024-09-12T00:15:34.423351+0000","last_active":"2024-09-12T00:35:49.509911+0000","last_peered":"2024-09-12T00:35:49.509911+0000","last_clean":"2024-09-12T00:35:49.509911+0000","last_became_active":"2024-09-12T00:15:34.423037+0000","last_became_peered":"2024-09-12T00:15:34.423037+0000","last_unstale":"2024-09-12T00:35:49.509911+0000","last_undegraded":"2024-09-12T00:35:49.509911+0000","last_fullsized":"2024-09-12T00:35:49.509911+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:11.688876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":64,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.631221+0000","last_change":"2024-09-12T00:27:17.583413+0000","last_active":"2024-09-12T00:36:19.631221+0000","last_peered":"2024-09-12T00:36:19.631221+0000","last_clean":"2024-09-12T00:36:19.631221+0000","last_became_active":"2024-09-12T00:27:17.583096+0000","last_became_peered":"2024-09-12T00:27:17.583096+0000","last_unstale":"2024-09-12T00:36:19.631221+0000","last_undegraded":"2024-09-12T00:36:19.631221+0000","last_fullsized":"2024-09-12T00:36:19.631221+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:05.013570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.009126+0000","last_change":"2024-09-12T00:17:03.214309+0000","last_active":"2024-09-12T00:38:37.009126+0000","last_peered":"2024-09-12T00:38:37.009126+0000","last_clean":"2024-09-12T00:38:37.009126+0000","last_became_active":"2024-09-12T00:17:03.214023+0000","last_became_peered":"2024-09-12T00:17:03.214023+0000","last_unstale":"2024-09-12T00:38:37.009126+0000","last_undegraded":"2024-09-12T00:38:37.009126+0000","last_fullsized":"2024-09-12T00:38:37.009126+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:25.420166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.086781+0000","last_change":"2024-09-12T00:17:00.178739+0000","last_active":"2024-09-12T00:38:37.086781+0000","last_peered":"2024-09-12T00:38:37.086781+0000","last_clean":"2024-09-12T00:38:37.086781+0000","last_became_active":"2024-09-12T00:17:00.178465+0000","last_became_peered":"2024-09-12T00:17:00.178465+0000","last_unstale":"2024-09-12T00:38:37.086781+0000","last_undegraded":"2024-09-12T00:38:37.086781+0000","last_fullsized":"2024-09-12T00:38:37.086781+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:08.316507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'34","reported_seq":137,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:27.839282+0000","last_change":"2024-09-12T00:15:34.425982+0000","last_active":"2024-09-12T00:36:27.839282+0000","last_peered":"2024-09-12T00:36:27.839282+0000","last_clean":"2024-09-12T00:36:27.839282+0000","last_became_active":"2024-09-12T00:15:34.425540+0000","last_became_peered":"2024-09-12T00:15:34.425540+0000","last_unstale":"2024-09-12T00:36:27.839282+0000","last_undegraded":"2024-09-12T00:36:27.839282+0000","last_fullsized":"2024-09-12T00:36:27.839282+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:11.621389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":136,"num_write":51,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.394938+0000","last_change":"2024-09-12T00:27:17.582031+0000","last_active":"2024-09-12T00:36:19.394938+0000","last_peered":"2024-09-12T00:36:19.394938+0000","last_clean":"2024-09-12T00:36:19.394938+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:36:19.394938+0000","last_undegraded":"2024-09-12T00:36:19.394938+0000","last_fullsized":"2024-09-12T00:36:19.394938+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:26.824932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503080+0000","last_change":"2024-09-12T00:17:03.212419+0000","last_active":"2024-09-12T00:35:04.503080+0000","last_peered":"2024-09-12T00:35:04.503080+0000","last_clean":"2024-09-12T00:35:04.503080+0000","last_became_active":"2024-09-12T00:17:03.212150+0000","last_became_peered":"2024-09-12T00:17:03.212150+0000","last_unstale":"2024-09-12T00:35:04.503080+0000","last_undegraded":"2024-09-12T00:35:04.503080+0000","last_fullsized":"2024-09-12T00:35:04.503080+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:25.410634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"261'8","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:34.515465+0000","last_change":"2024-09-12T00:17:00.181254+0000","last_active":"2024-09-12T00:36:34.515465+0000","last_peered":"2024-09-12T00:36:34.515465+0000","last_clean":"2024-09-12T00:36:34.515465+0000","last_became_active":"2024-09-12T00:17:00.180944+0000","last_became_peered":"2024-09-12T00:17:00.180944+0000","last_unstale":"2024-09-12T00:36:34.515465+0000","last_undegraded":"2024-09-12T00:36:34.515465+0000","last_fullsized":"2024-09-12T00:36:34.515465+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:53.637952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6171,"num_write":13,"num_write_kb":11291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'34","reported_seq":126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.095497+0000","last_change":"2024-09-12T00:15:34.419063+0000","last_active":"2024-09-12T00:36:56.095497+0000","last_peered":"2024-09-12T00:36:56.095497+0000","last_clean":"2024-09-12T00:36:56.095497+0000","last_became_active":"2024-09-12T00:15:34.418474+0000","last_became_peered":"2024-09-12T00:15:34.418474+0000","last_unstale":"2024-09-12T00:36:56.095497+0000","last_undegraded":"2024-09-12T00:36:56.095497+0000","last_fullsized":"2024-09-12T00:36:56.095497+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:27.863297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.513761+0000","last_change":"2024-09-12T00:27:17.581423+0000","last_active":"2024-09-12T00:36:19.513761+0000","last_peered":"2024-09-12T00:36:19.513761+0000","last_clean":"2024-09-12T00:36:19.513761+0000","last_became_active":"2024-09-12T00:27:17.581149+0000","last_became_peered":"2024-09-12T00:27:17.581149+0000","last_unstale":"2024-09-12T00:36:19.513761+0000","last_undegraded":"2024-09-12T00:36:19.513761+0000","last_fullsized":"2024-09-12T00:36:19.513761+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:04.939255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.380608+0000","last_change":"2024-09-12T00:17:03.221232+0000","last_active":"2024-09-12T00:34:29.380608+0000","last_peered":"2024-09-12T00:34:29.380608+0000","last_clean":"2024-09-12T00:34:29.380608+0000","last_became_active":"2024-09-12T00:17:03.220965+0000","last_became_peered":"2024-09-12T00:17:03.220965+0000","last_unstale":"2024-09-12T00:34:29.380608+0000","last_undegraded":"2024-09-12T00:34:29.380608+0000","last_fullsized":"2024-09-12T00:34:29.380608+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:54.919281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'12","reported_seq":67,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:14.402675+0000","last_change":"2024-09-12T00:17:00.185880+0000","last_active":"2024-09-12T00:37:14.402675+0000","last_peered":"2024-09-12T00:37:14.402675+0000","last_clean":"2024-09-12T00:37:14.402675+0000","last_became_active":"2024-09-12T00:17:00.185600+0000","last_became_peered":"2024-09-12T00:17:00.185600+0000","last_unstale":"2024-09-12T00:37:14.402675+0000","last_undegraded":"2024-09-12T00:37:14.402675+0000","last_fullsized":"2024-09-12T00:37:14.402675+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.338622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":41662,"num_write":17,"num_write_kb":10938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'54","reported_seq":186,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:25.312227+0000","last_change":"2024-09-12T00:15:34.417774+0000","last_active":"2024-09-12T00:36:25.312227+0000","last_peered":"2024-09-12T00:36:25.312227+0000","last_clean":"2024-09-12T00:36:25.312227+0000","last_became_active":"2024-09-12T00:15:34.417393+0000","last_became_peered":"2024-09-12T00:15:34.417393+0000","last_unstale":"2024-09-12T00:36:25.312227+0000","last_undegraded":"2024-09-12T00:36:25.312227+0000","last_fullsized":"2024-09-12T00:36:25.312227+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:49.338246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":189,"num_write":107,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390022+0000","last_change":"2024-09-12T00:27:17.580912+0000","last_active":"2024-09-12T00:35:39.390022+0000","last_peered":"2024-09-12T00:35:39.390022+0000","last_clean":"2024-09-12T00:35:39.390022+0000","last_became_active":"2024-09-12T00:27:17.578983+0000","last_became_peered":"2024-09-12T00:27:17.578983+0000","last_unstale":"2024-09-12T00:35:39.390022+0000","last_undegraded":"2024-09-12T00:35:39.390022+0000","last_fullsized":"2024-09-12T00:35:39.390022+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.598333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"258'10","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510247+0000","last_change":"2024-09-12T00:17:03.210161+0000","last_active":"2024-09-12T00:35:49.510247+0000","last_peered":"2024-09-12T00:35:49.510247+0000","last_clean":"2024-09-12T00:35:49.510247+0000","last_became_active":"2024-09-12T00:17:03.209874+0000","last_became_peered":"2024-09-12T00:17:03.209874+0000","last_unstale":"2024-09-12T00:35:49.510247+0000","last_undegraded":"2024-09-12T00:35:49.510247+0000","last_fullsized":"2024-09-12T00:35:49.510247+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:07.562732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":41988,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"258'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391613+0000","last_change":"2024-09-12T00:17:00.186026+0000","last_active":"2024-09-12T00:35:44.391613+0000","last_peered":"2024-09-12T00:35:44.391613+0000","last_clean":"2024-09-12T00:35:44.391613+0000","last_became_active":"2024-09-12T00:17:00.185688+0000","last_became_peered":"2024-09-12T00:17:00.185688+0000","last_unstale":"2024-09-12T00:35:44.391613+0000","last_undegraded":"2024-09-12T00:35:44.391613+0000","last_fullsized":"2024-09-12T00:35:44.391613+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:40.682390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:15.301825+0000","last_change":"2024-09-12T00:15:34.412266+0000","last_active":"2024-09-12T00:36:15.301825+0000","last_peered":"2024-09-12T00:36:15.301825+0000","last_clean":"2024-09-12T00:36:15.301825+0000","last_became_active":"2024-09-12T00:15:34.411977+0000","last_became_peered":"2024-09-12T00:15:34.411977+0000","last_unstale":"2024-09-12T00:36:15.301825+0000","last_undegraded":"2024-09-12T00:36:15.301825+0000","last_fullsized":"2024-09-12T00:36:15.301825+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:53.336733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":161,"num_write":73,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390048+0000","last_change":"2024-09-12T00:27:17.579176+0000","last_active":"2024-09-12T00:35:39.390048+0000","last_peered":"2024-09-12T00:35:39.390048+0000","last_clean":"2024-09-12T00:35:39.390048+0000","last_became_active":"2024-09-12T00:27:17.578763+0000","last_became_peered":"2024-09-12T00:27:17.578763+0000","last_unstale":"2024-09-12T00:35:39.390048+0000","last_undegraded":"2024-09-12T00:35:39.390048+0000","last_fullsized":"2024-09-12T00:35:39.390048+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:54.867145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510203+0000","last_change":"2024-09-12T00:17:03.216611+0000","last_active":"2024-09-12T00:35:49.510203+0000","last_peered":"2024-09-12T00:35:49.510203+0000","last_clean":"2024-09-12T00:35:49.510203+0000","last_became_active":"2024-09-12T00:17:03.216349+0000","last_became_peered":"2024-09-12T00:17:03.216349+0000","last_unstale":"2024-09-12T00:35:49.510203+0000","last_undegraded":"2024-09-12T00:35:49.510203+0000","last_fullsized":"2024-09-12T00:35:49.510203+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:48.582027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'3","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:52.530059+0000","last_change":"2024-09-12T00:17:00.183051+0000","last_active":"2024-09-12T00:37:52.530059+0000","last_peered":"2024-09-12T00:37:52.530059+0000","last_clean":"2024-09-12T00:37:52.530059+0000","last_became_active":"2024-09-12T00:17:00.182780+0000","last_became_peered":"2024-09-12T00:17:00.182780+0000","last_unstale":"2024-09-12T00:37:52.530059+0000","last_undegraded":"2024-09-12T00:37:52.530059+0000","last_fullsized":"2024-09-12T00:37:52.530059+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:39.837277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'38","reported_seq":141,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.386303+0000","last_change":"2024-09-12T00:15:34.410030+0000","last_active":"2024-09-12T00:35:04.386303+0000","last_peered":"2024-09-12T00:35:04.386303+0000","last_clean":"2024-09-12T00:35:04.386303+0000","last_became_active":"2024-09-12T00:15:34.409622+0000","last_became_peered":"2024-09-12T00:15:34.409622+0000","last_unstale":"2024-09-12T00:35:04.386303+0000","last_undegraded":"2024-09-12T00:35:04.386303+0000","last_fullsized":"2024-09-12T00:35:04.386303+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:55.447920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":134,"num_write":65,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:19.505635+0000","last_change":"2024-09-12T00:27:17.582282+0000","last_active":"2024-09-12T00:35:19.505635+0000","last_peered":"2024-09-12T00:35:19.505635+0000","last_clean":"2024-09-12T00:35:19.505635+0000","last_became_active":"2024-09-12T00:27:17.581993+0000","last_became_peered":"2024-09-12T00:27:17.581993+0000","last_unstale":"2024-09-12T00:35:19.505635+0000","last_undegraded":"2024-09-12T00:35:19.505635+0000","last_fullsized":"2024-09-12T00:35:19.505635+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:14.848118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.020774+0000","last_change":"2024-09-12T00:17:03.220273+0000","last_active":"2024-09-12T00:38:36.020774+0000","last_peered":"2024-09-12T00:38:36.020774+0000","last_clean":"2024-09-12T00:38:36.020774+0000","last_became_active":"2024-09-12T00:17:03.219888+0000","last_became_peered":"2024-09-12T00:17:03.219888+0000","last_unstale":"2024-09-12T00:38:36.020774+0000","last_undegraded":"2024-09-12T00:38:36.020774+0000","last_fullsized":"2024-09-12T00:38:36.020774+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:38.861820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"258'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:29.632606+0000","last_change":"2024-09-12T00:17:00.170322+0000","last_active":"2024-09-12T00:36:29.632606+0000","last_peered":"2024-09-12T00:36:29.632606+0000","last_clean":"2024-09-12T00:36:29.632606+0000","last_became_active":"2024-09-12T00:17:00.169299+0000","last_became_peered":"2024-09-12T00:17:00.169299+0000","last_unstale":"2024-09-12T00:36:29.632606+0000","last_undegraded":"2024-09-12T00:36:29.632606+0000","last_fullsized":"2024-09-12T00:36:29.632606+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:43.905465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'48","reported_seq":176,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.631907+0000","last_change":"2024-09-12T00:15:34.428023+0000","last_active":"2024-09-12T00:36:24.631907+0000","last_peered":"2024-09-12T00:36:24.631907+0000","last_clean":"2024-09-12T00:36:24.631907+0000","last_became_active":"2024-09-12T00:15:34.427735+0000","last_became_peered":"2024-09-12T00:15:34.427735+0000","last_unstale":"2024-09-12T00:36:24.631907+0000","last_undegraded":"2024-09-12T00:36:24.631907+0000","last_fullsized":"2024-09-12T00:36:24.631907+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:09.348935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":182,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390825+0000","last_change":"2024-09-12T00:27:17.573147+0000","last_active":"2024-09-12T00:35:39.390825+0000","last_peered":"2024-09-12T00:35:39.390825+0000","last_clean":"2024-09-12T00:35:39.390825+0000","last_became_active":"2024-09-12T00:27:17.572817+0000","last_became_peered":"2024-09-12T00:27:17.572817+0000","last_unstale":"2024-09-12T00:35:39.390825+0000","last_undegraded":"2024-09-12T00:35:39.390825+0000","last_fullsized":"2024-09-12T00:35:39.390825+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:43.980881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"261'6","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:34.397887+0000","last_change":"2024-09-12T00:17:03.220324+0000","last_active":"2024-09-12T00:36:34.397887+0000","last_peered":"2024-09-12T00:36:34.397887+0000","last_clean":"2024-09-12T00:36:34.397887+0000","last_became_active":"2024-09-12T00:17:03.219129+0000","last_became_peered":"2024-09-12T00:17:03.219129+0000","last_unstale":"2024-09-12T00:36:34.397887+0000","last_undegraded":"2024-09-12T00:36:34.397887+0000","last_fullsized":"2024-09-12T00:36:34.397887+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:56.169527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'6","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.088297+0000","last_change":"2024-09-12T00:17:00.182941+0000","last_active":"2024-09-12T00:38:37.088297+0000","last_peered":"2024-09-12T00:38:37.088297+0000","last_clean":"2024-09-12T00:38:37.088297+0000","last_became_active":"2024-09-12T00:17:00.182301+0000","last_became_peered":"2024-09-12T00:17:00.182301+0000","last_unstale":"2024-09-12T00:38:37.088297+0000","last_undegraded":"2024-09-12T00:38:37.088297+0000","last_fullsized":"2024-09-12T00:38:37.088297+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:08.258223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'23","reported_seq":102,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.514235+0000","last_change":"2024-09-12T00:15:34.428381+0000","last_active":"2024-09-12T00:36:24.514235+0000","last_peered":"2024-09-12T00:36:24.514235+0000","last_clean":"2024-09-12T00:36:24.514235+0000","last_became_active":"2024-09-12T00:15:34.428056+0000","last_became_peered":"2024-09-12T00:15:34.428056+0000","last_unstale":"2024-09-12T00:36:24.514235+0000","last_undegraded":"2024-09-12T00:36:24.514235+0000","last_fullsized":"2024-09-12T00:36:24.514235+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:43.858120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.511476+0000","last_change":"2024-09-12T00:27:17.575634+0000","last_active":"2024-09-12T00:35:59.511476+0000","last_peered":"2024-09-12T00:35:59.511476+0000","last_clean":"2024-09-12T00:35:59.511476+0000","last_became_active":"2024-09-12T00:27:17.575332+0000","last_became_peered":"2024-09-12T00:27:17.575332+0000","last_unstale":"2024-09-12T00:35:59.511476+0000","last_undegraded":"2024-09-12T00:35:59.511476+0000","last_fullsized":"2024-09-12T00:35:59.511476+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:10.996773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"258'6","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:47.512261+0000","last_change":"2024-09-12T00:17:03.206898+0000","last_active":"2024-09-12T00:35:47.512261+0000","last_peered":"2024-09-12T00:35:47.512261+0000","last_clean":"2024-09-12T00:35:47.512261+0000","last_became_active":"2024-09-12T00:17:03.206580+0000","last_became_peered":"2024-09-12T00:17:03.206580+0000","last_unstale":"2024-09-12T00:35:47.512261+0000","last_undegraded":"2024-09-12T00:35:47.512261+0000","last_fullsized":"2024-09-12T00:35:47.512261+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:19.086717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.636512+0000","last_change":"2024-09-12T00:17:00.169805+0000","last_active":"2024-09-12T00:36:59.636512+0000","last_peered":"2024-09-12T00:36:59.636512+0000","last_clean":"2024-09-12T00:36:59.636512+0000","last_became_active":"2024-09-12T00:17:00.169464+0000","last_became_peered":"2024-09-12T00:17:00.169464+0000","last_unstale":"2024-09-12T00:36:59.636512+0000","last_undegraded":"2024-09-12T00:36:59.636512+0000","last_fullsized":"2024-09-12T00:36:59.636512+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:30.563501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'22","reported_seq":97,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.631855+0000","last_change":"2024-09-12T00:15:34.428025+0000","last_active":"2024-09-12T00:36:24.631855+0000","last_peered":"2024-09-12T00:36:24.631855+0000","last_clean":"2024-09-12T00:36:24.631855+0000","last_became_active":"2024-09-12T00:15:34.427661+0000","last_became_peered":"2024-09-12T00:15:34.427661+0000","last_unstale":"2024-09-12T00:36:24.631855+0000","last_undegraded":"2024-09-12T00:36:24.631855+0000","last_fullsized":"2024-09-12T00:36:24.631855+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:18.676590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":70,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.514020+0000","last_change":"2024-09-12T00:27:17.576241+0000","last_active":"2024-09-12T00:35:57.514020+0000","last_peered":"2024-09-12T00:35:57.514020+0000","last_clean":"2024-09-12T00:35:57.514020+0000","last_became_active":"2024-09-12T00:27:17.575941+0000","last_became_peered":"2024-09-12T00:27:17.575941+0000","last_unstale":"2024-09-12T00:35:57.514020+0000","last_undegraded":"2024-09-12T00:35:57.514020+0000","last_fullsized":"2024-09-12T00:35:57.514020+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:41.216300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'2","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.402055+0000","last_change":"2024-09-12T00:17:03.218016+0000","last_active":"2024-09-12T00:37:09.402055+0000","last_peered":"2024-09-12T00:37:09.402055+0000","last_clean":"2024-09-12T00:37:09.402055+0000","last_became_active":"2024-09-12T00:17:03.217678+0000","last_became_peered":"2024-09-12T00:17:03.217678+0000","last_unstale":"2024-09-12T00:37:09.402055+0000","last_undegraded":"2024-09-12T00:37:09.402055+0000","last_fullsized":"2024-09-12T00:37:09.402055+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:41.125288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'5","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:49.406773+0000","last_change":"2024-09-12T00:17:00.186355+0000","last_active":"2024-09-12T00:37:49.406773+0000","last_peered":"2024-09-12T00:37:49.406773+0000","last_clean":"2024-09-12T00:37:49.406773+0000","last_became_active":"2024-09-12T00:17:00.185637+0000","last_became_peered":"2024-09-12T00:17:00.185637+0000","last_unstale":"2024-09-12T00:37:49.406773+0000","last_undegraded":"2024-09-12T00:37:49.406773+0000","last_fullsized":"2024-09-12T00:37:49.406773+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:36.584176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396562+0000","last_change":"2024-09-12T00:15:34.408975+0000","last_active":"2024-09-12T00:36:24.396562+0000","last_peered":"2024-09-12T00:36:24.396562+0000","last_clean":"2024-09-12T00:36:24.396562+0000","last_became_active":"2024-09-12T00:15:34.408612+0000","last_became_peered":"2024-09-12T00:15:34.408612+0000","last_unstale":"2024-09-12T00:36:24.396562+0000","last_undegraded":"2024-09-12T00:36:24.396562+0000","last_fullsized":"2024-09-12T00:36:24.396562+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:00.278541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":97,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.508580+0000","last_change":"2024-09-12T00:27:17.579650+0000","last_active":"2024-09-12T00:35:39.508580+0000","last_peered":"2024-09-12T00:35:39.508580+0000","last_clean":"2024-09-12T00:35:39.508580+0000","last_became_active":"2024-09-12T00:27:17.579332+0000","last_became_peered":"2024-09-12T00:27:17.579332+0000","last_unstale":"2024-09-12T00:35:39.508580+0000","last_undegraded":"2024-09-12T00:35:39.508580+0000","last_fullsized":"2024-09-12T00:35:39.508580+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:02.812642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627538+0000","last_change":"2024-09-12T00:17:03.203730+0000","last_active":"2024-09-12T00:35:49.627538+0000","last_peered":"2024-09-12T00:35:49.627538+0000","last_clean":"2024-09-12T00:35:49.627538+0000","last_became_active":"2024-09-12T00:17:03.203401+0000","last_became_peered":"2024-09-12T00:17:03.203401+0000","last_unstale":"2024-09-12T00:35:49.627538+0000","last_undegraded":"2024-09-12T00:35:49.627538+0000","last_fullsized":"2024-09-12T00:35:49.627538+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:07.999569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509116+0000","last_change":"2024-09-12T00:17:00.181373+0000","last_active":"2024-09-12T00:35:44.509116+0000","last_peered":"2024-09-12T00:35:44.509116+0000","last_clean":"2024-09-12T00:35:44.509116+0000","last_became_active":"2024-09-12T00:17:00.181095+0000","last_became_peered":"2024-09-12T00:17:00.181095+0000","last_unstale":"2024-09-12T00:35:44.509116+0000","last_undegraded":"2024-09-12T00:35:44.509116+0000","last_fullsized":"2024-09-12T00:35:44.509116+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:49.208397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'19","reported_seq":93,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396515+0000","last_change":"2024-09-12T00:15:34.421629+0000","last_active":"2024-09-12T00:36:24.396515+0000","last_peered":"2024-09-12T00:36:24.396515+0000","last_clean":"2024-09-12T00:36:24.396515+0000","last_became_active":"2024-09-12T00:15:34.420583+0000","last_became_peered":"2024-09-12T00:15:34.420583+0000","last_unstale":"2024-09-12T00:36:24.396515+0000","last_undegraded":"2024-09-12T00:36:24.396515+0000","last_fullsized":"2024-09-12T00:36:24.396515+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:19.714778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391630+0000","last_change":"2024-09-12T00:27:17.580218+0000","last_active":"2024-09-12T00:35:44.391630+0000","last_peered":"2024-09-12T00:35:44.391630+0000","last_clean":"2024-09-12T00:35:44.391630+0000","last_became_active":"2024-09-12T00:27:17.579957+0000","last_became_peered":"2024-09-12T00:27:17.579957+0000","last_unstale":"2024-09-12T00:35:44.391630+0000","last_undegraded":"2024-09-12T00:35:44.391630+0000","last_fullsized":"2024-09-12T00:35:44.391630+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:50.892944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627493+0000","last_change":"2024-09-12T00:17:03.222544+0000","last_active":"2024-09-12T00:35:49.627493+0000","last_peered":"2024-09-12T00:35:49.627493+0000","last_clean":"2024-09-12T00:35:49.627493+0000","last_became_active":"2024-09-12T00:17:03.222212+0000","last_became_peered":"2024-09-12T00:17:03.222212+0000","last_unstale":"2024-09-12T00:35:49.627493+0000","last_undegraded":"2024-09-12T00:35:49.627493+0000","last_fullsized":"2024-09-12T00:35:49.627493+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:51.034286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"258'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:46.508514+0000","last_change":"2024-09-12T00:17:00.184916+0000","last_active":"2024-09-12T00:35:46.508514+0000","last_peered":"2024-09-12T00:35:46.508514+0000","last_clean":"2024-09-12T00:35:46.508514+0000","last_became_active":"2024-09-12T00:17:00.184654+0000","last_became_peered":"2024-09-12T00:17:00.184654+0000","last_unstale":"2024-09-12T00:35:46.508514+0000","last_undegraded":"2024-09-12T00:35:46.508514+0000","last_fullsized":"2024-09-12T00:35:46.508514+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:59.225633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'33","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:55.935669+0000","last_change":"2024-09-12T00:15:34.425813+0000","last_active":"2024-09-12T00:36:55.935669+0000","last_peered":"2024-09-12T00:36:55.935669+0000","last_clean":"2024-09-12T00:36:55.935669+0000","last_became_active":"2024-09-12T00:15:34.425489+0000","last_became_peered":"2024-09-12T00:15:34.425489+0000","last_unstale":"2024-09-12T00:36:55.935669+0000","last_undegraded":"2024-09-12T00:36:55.935669+0000","last_fullsized":"2024-09-12T00:36:55.935669+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:24.112153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":114,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'331","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.286502+0000","last_change":"2024-09-12T00:01:57.152485+0000","last_active":"2024-09-12T00:38:38.286502+0000","last_peered":"2024-09-12T00:38:38.286502+0000","last_clean":"2024-09-12T00:38:38.286502+0000","last_became_active":"2024-09-12T00:01:57.152039+0000","last_became_peered":"2024-09-12T00:01:57.152039+0000","last_unstale":"2024-09-12T00:38:38.286502+0000","last_undegraded":"2024-09-12T00:38:38.286502+0000","last_fullsized":"2024-09-12T00:38:38.286502+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:46.339403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":62278,"num_write":1122,"num_write_kb":40244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'78","reported_seq":659,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.458046+0000","last_change":"2024-09-12T00:01:59.156460+0000","last_active":"2024-09-12T00:37:01.458046+0000","last_peered":"2024-09-12T00:37:01.458046+0000","last_clean":"2024-09-12T00:37:01.458046+0000","last_became_active":"2024-09-12T00:01:59.156166+0000","last_became_peered":"2024-09-12T00:01:59.156166+0000","last_unstale":"2024-09-12T00:37:01.458046+0000","last_undegraded":"2024-09-12T00:37:01.458046+0000","last_fullsized":"2024-09-12T00:37:01.458046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:59.037812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":327,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'318","reported_seq":952,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.227940+0000","last_change":"2024-09-12T00:01:57.147898+0000","last_active":"2024-09-12T00:38:38.227940+0000","last_peered":"2024-09-12T00:38:38.227940+0000","last_clean":"2024-09-12T00:38:38.227940+0000","last_became_active":"2024-09-12T00:01:57.147519+0000","last_became_peered":"2024-09-12T00:01:57.147519+0000","last_unstale":"2024-09-12T00:38:38.227940+0000","last_undegraded":"2024-09-12T00:38:38.227940+0000","last_fullsized":"2024-09-12T00:38:38.227940+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:29.218354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":64019,"num_write":1006,"num_write_kb":35322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'285","reported_seq":942,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.878962+0000","last_change":"2024-09-12T00:01:59.140999+0000","last_active":"2024-09-12T00:36:58.878962+0000","last_peered":"2024-09-12T00:36:58.878962+0000","last_clean":"2024-09-12T00:36:58.878962+0000","last_became_active":"2024-09-12T00:01:59.140661+0000","last_became_peered":"2024-09-12T00:01:59.140661+0000","last_unstale":"2024-09-12T00:36:58.878962+0000","last_undegraded":"2024-09-12T00:36:58.878962+0000","last_fullsized":"2024-09-12T00:36:58.878962+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:42.180513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1344,"num_read_kb":1119,"num_write":493,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'353","reported_seq":977,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.314126+0000","last_change":"2024-09-12T00:01:57.141302+0000","last_active":"2024-09-12T00:38:38.314126+0000","last_peered":"2024-09-12T00:38:38.314126+0000","last_clean":"2024-09-12T00:38:38.314126+0000","last_became_active":"2024-09-12T00:01:57.140885+0000","last_became_peered":"2024-09-12T00:01:57.140885+0000","last_unstale":"2024-09-12T00:38:38.314126+0000","last_undegraded":"2024-09-12T00:38:38.314126+0000","last_fullsized":"2024-09-12T00:38:38.314126+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:07.324855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":495,"num_read_kb":8973,"num_write":1119,"num_write_kb":33019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'357","reported_seq":997,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.252007+0000","last_change":"2024-09-12T00:01:59.145361+0000","last_active":"2024-09-12T00:36:59.252007+0000","last_peered":"2024-09-12T00:36:59.252007+0000","last_clean":"2024-09-12T00:36:59.252007+0000","last_became_active":"2024-09-12T00:01:59.144660+0000","last_became_peered":"2024-09-12T00:01:59.144660+0000","last_unstale":"2024-09-12T00:36:59.252007+0000","last_undegraded":"2024-09-12T00:36:59.252007+0000","last_fullsized":"2024-09-12T00:36:59.252007+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:56.723947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1585,"num_read_kb":1295,"num_write":589,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'362","reported_seq":988,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.243600+0000","last_change":"2024-09-12T00:01:57.155155+0000","last_active":"2024-09-12T00:38:38.243600+0000","last_peered":"2024-09-12T00:38:38.243600+0000","last_clean":"2024-09-12T00:38:38.243600+0000","last_became_active":"2024-09-12T00:01:57.154749+0000","last_became_peered":"2024-09-12T00:01:57.154749+0000","last_unstale":"2024-09-12T00:38:38.243600+0000","last_undegraded":"2024-09-12T00:38:38.243600+0000","last_fullsized":"2024-09-12T00:38:38.243600+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:49.545526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":533,"num_read_kb":65054,"num_write":1136,"num_write_kb":38777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'303","reported_seq":925,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.238836+0000","last_change":"2024-09-12T00:01:59.147206+0000","last_active":"2024-09-12T00:37:08.238836+0000","last_peered":"2024-09-12T00:37:08.238836+0000","last_clean":"2024-09-12T00:37:08.238836+0000","last_became_active":"2024-09-12T00:01:59.146925+0000","last_became_peered":"2024-09-12T00:01:59.146925+0000","last_unstale":"2024-09-12T00:37:08.238836+0000","last_undegraded":"2024-09-12T00:37:08.238836+0000","last_fullsized":"2024-09-12T00:37:08.238836+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:07.011599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1201,"num_read_kb":972,"num_write":449,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'361","reported_seq":1097,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.243516+0000","last_change":"2024-09-12T00:01:57.151401+0000","last_active":"2024-09-12T00:38:38.243516+0000","last_peered":"2024-09-12T00:38:38.243516+0000","last_clean":"2024-09-12T00:38:38.243516+0000","last_became_active":"2024-09-12T00:01:57.151028+0000","last_became_peered":"2024-09-12T00:01:57.151028+0000","last_unstale":"2024-09-12T00:38:38.243516+0000","last_undegraded":"2024-09-12T00:38:38.243516+0000","last_fullsized":"2024-09-12T00:38:38.243516+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:42.442785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2337543,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":829,"num_read_kb":49842,"num_write":1146,"num_write_kb":22305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'253","reported_seq":909,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.591163+0000","last_change":"2024-09-12T00:01:59.150011+0000","last_active":"2024-09-12T00:38:27.591163+0000","last_peered":"2024-09-12T00:38:27.591163+0000","last_clean":"2024-09-12T00:38:27.591163+0000","last_became_active":"2024-09-12T00:01:59.149728+0000","last_became_peered":"2024-09-12T00:01:59.149728+0000","last_unstale":"2024-09-12T00:38:27.591163+0000","last_undegraded":"2024-09-12T00:38:27.591163+0000","last_fullsized":"2024-09-12T00:38:27.591163+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:46.169594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1186,"num_read_kb":981,"num_write":436,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'351","reported_seq":1093,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.345917+0000","last_change":"2024-09-12T00:01:57.153165+0000","last_active":"2024-09-12T00:38:38.345917+0000","last_peered":"2024-09-12T00:38:38.345917+0000","last_clean":"2024-09-12T00:38:38.345917+0000","last_became_active":"2024-09-12T00:01:57.152791+0000","last_became_peered":"2024-09-12T00:01:57.152791+0000","last_unstale":"2024-09-12T00:38:38.345917+0000","last_undegraded":"2024-09-12T00:38:38.345917+0000","last_fullsized":"2024-09-12T00:38:38.345917+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:34.891667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133707,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":815,"num_read_kb":39083,"num_write":1189,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'276","reported_seq":864,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:10.033280+0000","last_change":"2024-09-12T00:01:59.151834+0000","last_active":"2024-09-12T00:36:10.033280+0000","last_peered":"2024-09-12T00:36:10.033280+0000","last_clean":"2024-09-12T00:36:10.033280+0000","last_became_active":"2024-09-12T00:01:59.151168+0000","last_became_peered":"2024-09-12T00:01:59.151168+0000","last_unstale":"2024-09-12T00:36:10.033280+0000","last_undegraded":"2024-09-12T00:36:10.033280+0000","last_fullsized":"2024-09-12T00:36:10.033280+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:07.026026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1184,"num_read_kb":963,"num_write":440,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'354","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.247705+0000","last_change":"2024-09-12T00:01:57.146987+0000","last_active":"2024-09-12T00:38:38.247705+0000","last_peered":"2024-09-12T00:38:38.247705+0000","last_clean":"2024-09-12T00:38:38.247705+0000","last_became_active":"2024-09-12T00:01:57.146592+0000","last_became_peered":"2024-09-12T00:01:57.146592+0000","last_unstale":"2024-09-12T00:38:38.247705+0000","last_undegraded":"2024-09-12T00:38:38.247705+0000","last_fullsized":"2024-09-12T00:38:38.247705+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:36.580016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":36666,"num_write":1128,"num_write_kb":21178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'169","reported_seq":757,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.751860+0000","last_change":"2024-09-12T00:01:59.153636+0000","last_active":"2024-09-12T00:36:58.751860+0000","last_peered":"2024-09-12T00:36:58.751860+0000","last_clean":"2024-09-12T00:36:58.751860+0000","last_became_active":"2024-09-12T00:01:59.153277+0000","last_became_peered":"2024-09-12T00:01:59.153277+0000","last_unstale":"2024-09-12T00:36:58.751860+0000","last_undegraded":"2024-09-12T00:36:58.751860+0000","last_fullsized":"2024-09-12T00:36:58.751860+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:06.223418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":798,"num_read_kb":679,"num_write":291,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'362","reported_seq":975,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.262005+0000","last_change":"2024-09-12T00:01:57.152039+0000","last_active":"2024-09-12T00:38:38.262005+0000","last_peered":"2024-09-12T00:38:38.262005+0000","last_clean":"2024-09-12T00:38:38.262005+0000","last_became_active":"2024-09-12T00:01:57.151506+0000","last_became_peered":"2024-09-12T00:01:57.151506+0000","last_unstale":"2024-09-12T00:38:38.262005+0000","last_undegraded":"2024-09-12T00:38:38.262005+0000","last_fullsized":"2024-09-12T00:38:38.262005+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:02.754894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549580,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":524,"num_read_kb":7555,"num_write":1156,"num_write_kb":27882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'125","reported_seq":711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.323304+0000","last_change":"2024-09-12T00:01:59.149439+0000","last_active":"2024-09-12T00:36:54.323304+0000","last_peered":"2024-09-12T00:36:54.323304+0000","last_clean":"2024-09-12T00:36:54.323304+0000","last_became_active":"2024-09-12T00:01:59.148098+0000","last_became_peered":"2024-09-12T00:01:59.148098+0000","last_unstale":"2024-09-12T00:36:54.323304+0000","last_undegraded":"2024-09-12T00:36:54.323304+0000","last_fullsized":"2024-09-12T00:36:54.323304+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:18.916236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":439,"num_write":182,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'114","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.963544+0000","last_change":"2024-09-12T00:01:59.148279+0000","last_active":"2024-09-12T00:36:58.963544+0000","last_peered":"2024-09-12T00:36:58.963544+0000","last_clean":"2024-09-12T00:36:58.963544+0000","last_became_active":"2024-09-12T00:01:59.148017+0000","last_became_peered":"2024-09-12T00:01:59.148017+0000","last_unstale":"2024-09-12T00:36:58.963544+0000","last_undegraded":"2024-09-12T00:36:58.963544+0000","last_fullsized":"2024-09-12T00:36:58.963544+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:15.214488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":485,"num_read_kb":395,"num_write":184,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'329","reported_seq":1012,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.139242+0000","last_change":"2024-09-12T00:01:57.151683+0000","last_active":"2024-09-12T00:38:38.139242+0000","last_peered":"2024-09-12T00:38:38.139242+0000","last_clean":"2024-09-12T00:38:38.139242+0000","last_became_active":"2024-09-12T00:01:57.151116+0000","last_became_peered":"2024-09-12T00:01:57.151116+0000","last_unstale":"2024-09-12T00:38:38.139242+0000","last_undegraded":"2024-09-12T00:38:38.139242+0000","last_fullsized":"2024-09-12T00:38:38.139242+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:35.763246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":563,"num_read_kb":78307,"num_write":1164,"num_write_kb":30055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'230","reported_seq":811,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:39.381829+0000","last_change":"2024-09-12T00:01:59.152420+0000","last_active":"2024-09-12T00:34:39.381829+0000","last_peered":"2024-09-12T00:34:39.381829+0000","last_clean":"2024-09-12T00:34:39.381829+0000","last_became_active":"2024-09-12T00:01:59.152131+0000","last_became_peered":"2024-09-12T00:01:59.152131+0000","last_unstale":"2024-09-12T00:34:39.381829+0000","last_undegraded":"2024-09-12T00:34:39.381829+0000","last_fullsized":"2024-09-12T00:34:39.381829+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:35.864717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":807,"num_write":370,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'333","reported_seq":964,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.338539+0000","last_change":"2024-09-12T00:01:57.145166+0000","last_active":"2024-09-12T00:38:38.338539+0000","last_peered":"2024-09-12T00:38:38.338539+0000","last_clean":"2024-09-12T00:38:38.338539+0000","last_became_active":"2024-09-12T00:01:57.143834+0000","last_became_peered":"2024-09-12T00:01:57.143834+0000","last_unstale":"2024-09-12T00:38:38.338539+0000","last_undegraded":"2024-09-12T00:38:38.338539+0000","last_fullsized":"2024-09-12T00:38:38.338539+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:52.588497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":522,"num_read_kb":1599,"num_write":1184,"num_write_kb":15734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'430","reported_seq":1135,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.136558+0000","last_change":"2024-09-12T00:01:59.153835+0000","last_active":"2024-09-12T00:36:52.136558+0000","last_peered":"2024-09-12T00:36:52.136558+0000","last_clean":"2024-09-12T00:36:52.136558+0000","last_became_active":"2024-09-12T00:01:59.153559+0000","last_became_peered":"2024-09-12T00:01:59.153559+0000","last_unstale":"2024-09-12T00:36:52.136558+0000","last_undegraded":"2024-09-12T00:36:52.136558+0000","last_fullsized":"2024-09-12T00:36:52.136558+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:14.763454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2074,"num_read_kb":1775,"num_write":771,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'321","reported_seq":930,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.304053+0000","last_change":"2024-09-12T00:01:57.151910+0000","last_active":"2024-09-12T00:38:38.304053+0000","last_peered":"2024-09-12T00:38:38.304053+0000","last_clean":"2024-09-12T00:38:38.304053+0000","last_became_active":"2024-09-12T00:01:57.150789+0000","last_became_peered":"2024-09-12T00:01:57.150789+0000","last_unstale":"2024-09-12T00:38:38.304053+0000","last_undegraded":"2024-09-12T00:38:38.304053+0000","last_fullsized":"2024-09-12T00:38:38.304053+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:08.148314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162197,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":13162,"num_write":967,"num_write_kb":19470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'149","reported_seq":772,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.747639+0000","last_change":"2024-09-12T00:01:59.149460+0000","last_active":"2024-09-12T00:36:50.747639+0000","last_peered":"2024-09-12T00:36:50.747639+0000","last_clean":"2024-09-12T00:36:50.747639+0000","last_became_active":"2024-09-12T00:01:59.149195+0000","last_became_peered":"2024-09-12T00:01:59.149195+0000","last_unstale":"2024-09-12T00:36:50.747639+0000","last_undegraded":"2024-09-12T00:36:50.747639+0000","last_fullsized":"2024-09-12T00:36:50.747639+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:43.524528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":604,"num_write":216,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'359","reported_seq":1006,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.270567+0000","last_change":"2024-09-12T00:01:57.158820+0000","last_active":"2024-09-12T00:38:38.270567+0000","last_peered":"2024-09-12T00:38:38.270567+0000","last_clean":"2024-09-12T00:38:38.270567+0000","last_became_active":"2024-09-12T00:01:57.157877+0000","last_became_peered":"2024-09-12T00:01:57.157877+0000","last_unstale":"2024-09-12T00:38:38.270567+0000","last_undegraded":"2024-09-12T00:38:38.270567+0000","last_fullsized":"2024-09-12T00:38:38.270567+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:52.712462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7687320,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":26582,"num_write":1109,"num_write_kb":46689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'164","reported_seq":755,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.250417+0000","last_change":"2024-09-12T00:01:59.159547+0000","last_active":"2024-09-12T00:37:02.250417+0000","last_peered":"2024-09-12T00:37:02.250417+0000","last_clean":"2024-09-12T00:37:02.250417+0000","last_became_active":"2024-09-12T00:01:59.159215+0000","last_became_peered":"2024-09-12T00:01:59.159215+0000","last_unstale":"2024-09-12T00:37:02.250417+0000","last_undegraded":"2024-09-12T00:37:02.250417+0000","last_fullsized":"2024-09-12T00:37:02.250417+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:31.759927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":584,"num_write":229,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'277","reported_seq":914,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.247477+0000","last_change":"2024-09-12T00:02:32.844919+0000","last_active":"2024-09-12T00:38:38.247477+0000","last_peered":"2024-09-12T00:38:38.247477+0000","last_clean":"2024-09-12T00:38:38.247477+0000","last_became_active":"2024-09-12T00:02:32.844466+0000","last_became_peered":"2024-09-12T00:02:32.844466+0000","last_unstale":"2024-09-12T00:38:38.247477+0000","last_undegraded":"2024-09-12T00:38:38.247477+0000","last_fullsized":"2024-09-12T00:38:38.247477+0000","mapping_epoch":37,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:09.241156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291469,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":38682,"num_write":1020,"num_write_kb":28786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'136","reported_seq":724,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.061425+0000","last_change":"2024-09-12T00:01:59.156382+0000","last_active":"2024-09-12T00:37:23.061425+0000","last_peered":"2024-09-12T00:37:23.061425+0000","last_clean":"2024-09-12T00:37:23.061425+0000","last_became_active":"2024-09-12T00:01:59.156058+0000","last_became_peered":"2024-09-12T00:01:59.156058+0000","last_unstale":"2024-09-12T00:37:23.061425+0000","last_undegraded":"2024-09-12T00:37:23.061425+0000","last_fullsized":"2024-09-12T00:37:23.061425+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:10.726145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":582,"num_read_kb":485,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'395","reported_seq":1010,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.337665+0000","last_change":"2024-09-12T00:01:57.137262+0000","last_active":"2024-09-12T00:38:38.337665+0000","last_peered":"2024-09-12T00:38:38.337665+0000","last_clean":"2024-09-12T00:38:38.337665+0000","last_became_active":"2024-09-12T00:01:57.136872+0000","last_became_peered":"2024-09-12T00:01:57.136872+0000","last_unstale":"2024-09-12T00:38:38.337665+0000","last_undegraded":"2024-09-12T00:38:38.337665+0000","last_fullsized":"2024-09-12T00:38:38.337665+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:32.662213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133748,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":28039,"num_write":1285,"num_write_kb":53988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'147","reported_seq":642,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.514493+0000","last_change":"2024-09-12T00:02:07.159622+0000","last_active":"2024-09-12T00:37:23.514493+0000","last_peered":"2024-09-12T00:37:23.514493+0000","last_clean":"2024-09-12T00:37:23.514493+0000","last_became_active":"2024-09-12T00:02:07.159308+0000","last_became_peered":"2024-09-12T00:02:07.159308+0000","last_unstale":"2024-09-12T00:37:23.514493+0000","last_undegraded":"2024-09-12T00:37:23.514493+0000","last_fullsized":"2024-09-12T00:37:23.514493+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:23.798981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'123","reported_seq":707,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.287204+0000","last_change":"2024-09-12T00:01:59.152275+0000","last_active":"2024-09-12T00:36:50.287204+0000","last_peered":"2024-09-12T00:36:50.287204+0000","last_clean":"2024-09-12T00:36:50.287204+0000","last_became_active":"2024-09-12T00:01:59.151773+0000","last_became_peered":"2024-09-12T00:01:59.151773+0000","last_unstale":"2024-09-12T00:36:50.287204+0000","last_undegraded":"2024-09-12T00:36:50.287204+0000","last_fullsized":"2024-09-12T00:36:50.287204+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:11.927074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":478,"num_write":204,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'341","reported_seq":1028,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.314193+0000","last_change":"2024-09-12T00:01:57.166828+0000","last_active":"2024-09-12T00:38:38.314193+0000","last_peered":"2024-09-12T00:38:38.314193+0000","last_clean":"2024-09-12T00:38:38.314193+0000","last_became_active":"2024-09-12T00:01:57.165987+0000","last_became_peered":"2024-09-12T00:01:57.165987+0000","last_unstale":"2024-09-12T00:38:38.314193+0000","last_undegraded":"2024-09-12T00:38:38.314193+0000","last_fullsized":"2024-09-12T00:38:38.314193+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:40.754997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":604,"num_read_kb":32539,"num_write":978,"num_write_kb":21474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.393143+0000","last_change":"2024-09-12T00:02:01.154807+0000","last_active":"2024-09-12T00:35:54.393143+0000","last_peered":"2024-09-12T00:35:54.393143+0000","last_clean":"2024-09-12T00:35:54.393143+0000","last_became_active":"2024-09-12T00:02:01.154464+0000","last_became_peered":"2024-09-12T00:02:01.154464+0000","last_unstale":"2024-09-12T00:35:54.393143+0000","last_undegraded":"2024-09-12T00:35:54.393143+0000","last_fullsized":"2024-09-12T00:35:54.393143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.047642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'360","reported_seq":964,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.815344+0000","last_change":"2024-09-12T00:02:03.156471+0000","last_active":"2024-09-12T00:38:37.815344+0000","last_peered":"2024-09-12T00:38:37.815344+0000","last_clean":"2024-09-12T00:38:37.815344+0000","last_became_active":"2024-09-12T00:02:03.156175+0000","last_became_peered":"2024-09-12T00:02:03.156175+0000","last_unstale":"2024-09-12T00:38:37.815344+0000","last_undegraded":"2024-09-12T00:38:37.815344+0000","last_fullsized":"2024-09-12T00:38:37.815344+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:33.670259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51076,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":584,"num_read_kb":1265,"num_write":472,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:56.510205+0000","last_change":"2024-09-12T00:02:05.165724+0000","last_active":"2024-09-12T00:35:56.510205+0000","last_peered":"2024-09-12T00:35:56.510205+0000","last_clean":"2024-09-12T00:35:56.510205+0000","last_became_active":"2024-09-12T00:02:05.165424+0000","last_became_peered":"2024-09-12T00:02:05.165424+0000","last_unstale":"2024-09-12T00:35:56.510205+0000","last_undegraded":"2024-09-12T00:35:56.510205+0000","last_fullsized":"2024-09-12T00:35:56.510205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:38.859922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'129","reported_seq":679,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.108575+0000","last_change":"2024-09-12T00:02:07.175107+0000","last_active":"2024-09-12T00:37:21.108575+0000","last_peered":"2024-09-12T00:37:21.108575+0000","last_clean":"2024-09-12T00:37:21.108575+0000","last_became_active":"2024-09-12T00:02:07.174795+0000","last_became_peered":"2024-09-12T00:02:07.174795+0000","last_unstale":"2024-09-12T00:37:21.108575+0000","last_undegraded":"2024-09-12T00:37:21.108575+0000","last_fullsized":"2024-09-12T00:37:21.108575+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.332589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":239,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'75","reported_seq":622,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.555629+0000","last_change":"2024-09-12T00:01:59.146503+0000","last_active":"2024-09-12T00:37:08.555629+0000","last_peered":"2024-09-12T00:37:08.555629+0000","last_clean":"2024-09-12T00:37:08.555629+0000","last_became_active":"2024-09-12T00:01:59.145411+0000","last_became_peered":"2024-09-12T00:01:59.145411+0000","last_unstale":"2024-09-12T00:37:08.555629+0000","last_undegraded":"2024-09-12T00:37:08.555629+0000","last_fullsized":"2024-09-12T00:37:08.555629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:33.082390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":104,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'371","reported_seq":1015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.273543+0000","last_change":"2024-09-12T00:01:57.147335+0000","last_active":"2024-09-12T00:38:38.273543+0000","last_peered":"2024-09-12T00:38:38.273543+0000","last_clean":"2024-09-12T00:38:38.273543+0000","last_became_active":"2024-09-12T00:01:57.146952+0000","last_became_peered":"2024-09-12T00:01:57.146952+0000","last_unstale":"2024-09-12T00:38:38.273543+0000","last_undegraded":"2024-09-12T00:38:38.273543+0000","last_fullsized":"2024-09-12T00:38:38.273543+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:11.335615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":558,"num_read_kb":41499,"num_write":1262,"num_write_kb":32474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:47.503501+0000","last_change":"2024-09-12T00:02:01.156228+0000","last_active":"2024-09-12T00:34:47.503501+0000","last_peered":"2024-09-12T00:34:47.503501+0000","last_clean":"2024-09-12T00:34:47.503501+0000","last_became_active":"2024-09-12T00:02:01.155948+0000","last_became_peered":"2024-09-12T00:02:01.155948+0000","last_unstale":"2024-09-12T00:34:47.503501+0000","last_undegraded":"2024-09-12T00:34:47.503501+0000","last_fullsized":"2024-09-12T00:34:47.503501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:34.073281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'81","reported_seq":596,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:51.124923+0000","last_change":"2024-09-12T00:02:03.152995+0000","last_active":"2024-09-12T00:36:51.124923+0000","last_peered":"2024-09-12T00:36:51.124923+0000","last_clean":"2024-09-12T00:36:51.124923+0000","last_became_active":"2024-09-12T00:02:03.152708+0000","last_became_peered":"2024-09-12T00:02:03.152708+0000","last_unstale":"2024-09-12T00:36:51.124923+0000","last_undegraded":"2024-09-12T00:36:51.124923+0000","last_fullsized":"2024-09-12T00:36:51.124923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:00.923044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":85,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:56.510160+0000","last_change":"2024-09-12T00:02:05.163074+0000","last_active":"2024-09-12T00:35:56.510160+0000","last_peered":"2024-09-12T00:35:56.510160+0000","last_clean":"2024-09-12T00:35:56.510160+0000","last_became_active":"2024-09-12T00:02:05.162755+0000","last_became_peered":"2024-09-12T00:02:05.162755+0000","last_unstale":"2024-09-12T00:35:56.510160+0000","last_undegraded":"2024-09-12T00:35:56.510160+0000","last_fullsized":"2024-09-12T00:35:56.510160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:20.807313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'133","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.520320+0000","last_change":"2024-09-12T00:02:07.168207+0000","last_active":"2024-09-12T00:37:09.520320+0000","last_peered":"2024-09-12T00:37:09.520320+0000","last_clean":"2024-09-12T00:37:09.520320+0000","last_became_active":"2024-09-12T00:02:07.167851+0000","last_became_peered":"2024-09-12T00:02:07.167851+0000","last_unstale":"2024-09-12T00:37:09.520320+0000","last_undegraded":"2024-09-12T00:37:09.520320+0000","last_fullsized":"2024-09-12T00:37:09.520320+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:11.325627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":137,"num_write":333,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'4128","reported_seq":4726,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510282+0000","last_change":"2024-09-12T00:01:59.151349+0000","last_active":"2024-09-12T00:35:49.510282+0000","last_peered":"2024-09-12T00:35:49.510282+0000","last_clean":"2024-09-12T00:35:49.510282+0000","last_became_active":"2024-09-12T00:01:59.151026+0000","last_became_peered":"2024-09-12T00:01:59.151026+0000","last_unstale":"2024-09-12T00:35:49.510282+0000","last_undegraded":"2024-09-12T00:35:49.510282+0000","last_fullsized":"2024-09-12T00:35:49.510282+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":3000,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:16.187111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16602,"num_read_kb":13937,"num_write":6188,"num_write_kb":3085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'296","reported_seq":995,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.321791+0000","last_change":"2024-09-12T00:01:57.144752+0000","last_active":"2024-09-12T00:38:38.321791+0000","last_peered":"2024-09-12T00:38:38.321791+0000","last_clean":"2024-09-12T00:38:38.321791+0000","last_became_active":"2024-09-12T00:01:57.144269+0000","last_became_peered":"2024-09-12T00:01:57.144269+0000","last_unstale":"2024-09-12T00:38:38.321791+0000","last_undegraded":"2024-09-12T00:38:38.321791+0000","last_fullsized":"2024-09-12T00:38:38.321791+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:54.481149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399069,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":703,"num_read_kb":1796,"num_write":921,"num_write_kb":33986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:52.513137+0000","last_change":"2024-09-12T00:02:01.155683+0000","last_active":"2024-09-12T00:35:52.513137+0000","last_peered":"2024-09-12T00:35:52.513137+0000","last_clean":"2024-09-12T00:35:52.513137+0000","last_became_active":"2024-09-12T00:02:01.155425+0000","last_became_peered":"2024-09-12T00:02:01.155425+0000","last_unstale":"2024-09-12T00:35:52.513137+0000","last_undegraded":"2024-09-12T00:35:52.513137+0000","last_fullsized":"2024-09-12T00:35:52.513137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:38.140909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'103","reported_seq":636,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.325100+0000","last_change":"2024-09-12T00:02:03.152143+0000","last_active":"2024-09-12T00:36:54.325100+0000","last_peered":"2024-09-12T00:36:54.325100+0000","last_clean":"2024-09-12T00:36:54.325100+0000","last_became_active":"2024-09-12T00:02:03.151839+0000","last_became_peered":"2024-09-12T00:02:03.151839+0000","last_unstale":"2024-09-12T00:36:54.325100+0000","last_undegraded":"2024-09-12T00:36:54.325100+0000","last_fullsized":"2024-09-12T00:36:54.325100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:56.820811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'758","reported_seq":2046,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.042074+0000","last_change":"2024-09-12T00:02:05.167777+0000","last_active":"2024-09-12T00:38:38.042074+0000","last_peered":"2024-09-12T00:38:38.042074+0000","last_clean":"2024-09-12T00:38:38.042074+0000","last_became_active":"2024-09-12T00:02:05.166985+0000","last_became_peered":"2024-09-12T00:02:05.166985+0000","last_unstale":"2024-09-12T00:38:38.042074+0000","last_undegraded":"2024-09-12T00:38:38.042074+0000","last_fullsized":"2024-09-12T00:38:38.042074+0000","mapping_epoch":32,"log_start":"261'701","ondisk_log_start":"261'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":701,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:46.965686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'217","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.117831+0000","last_change":"2024-09-12T00:02:07.167855+0000","last_active":"2024-09-12T00:37:23.117831+0000","last_peered":"2024-09-12T00:37:23.117831+0000","last_clean":"2024-09-12T00:37:23.117831+0000","last_became_active":"2024-09-12T00:02:07.167576+0000","last_became_peered":"2024-09-12T00:02:07.167576+0000","last_unstale":"2024-09-12T00:37:23.117831+0000","last_undegraded":"2024-09-12T00:37:23.117831+0000","last_fullsized":"2024-09-12T00:37:23.117831+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:16.693441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":605,"num_read_kb":603,"num_write":488,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'58","reported_seq":609,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:22.120801+0000","last_change":"2024-09-12T00:01:59.149396+0000","last_active":"2024-09-12T00:36:22.120801+0000","last_peered":"2024-09-12T00:36:22.120801+0000","last_clean":"2024-09-12T00:36:22.120801+0000","last_became_active":"2024-09-12T00:01:59.149087+0000","last_became_peered":"2024-09-12T00:01:59.149087+0000","last_unstale":"2024-09-12T00:36:22.120801+0000","last_undegraded":"2024-09-12T00:36:22.120801+0000","last_fullsized":"2024-09-12T00:36:22.120801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:13.031884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":233,"num_write":78,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'349","reported_seq":1046,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.290133+0000","last_change":"2024-09-12T00:01:57.153276+0000","last_active":"2024-09-12T00:38:38.290133+0000","last_peered":"2024-09-12T00:38:38.290133+0000","last_clean":"2024-09-12T00:38:38.290133+0000","last_became_active":"2024-09-12T00:01:57.152332+0000","last_became_peered":"2024-09-12T00:01:57.152332+0000","last_unstale":"2024-09-12T00:38:38.290133+0000","last_undegraded":"2024-09-12T00:38:38.290133+0000","last_fullsized":"2024-09-12T00:38:38.290133+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:07.357627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516615,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":651,"num_read_kb":43786,"num_write":1177,"num_write_kb":39072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.393180+0000","last_change":"2024-09-12T00:02:01.154452+0000","last_active":"2024-09-12T00:35:54.393180+0000","last_peered":"2024-09-12T00:35:54.393180+0000","last_clean":"2024-09-12T00:35:54.393180+0000","last_became_active":"2024-09-12T00:02:01.154110+0000","last_became_peered":"2024-09-12T00:02:01.154110+0000","last_unstale":"2024-09-12T00:35:54.393180+0000","last_undegraded":"2024-09-12T00:35:54.393180+0000","last_fullsized":"2024-09-12T00:35:54.393180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:04.241524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'257","reported_seq":809,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.439647+0000","last_change":"2024-09-12T00:02:03.146008+0000","last_active":"2024-09-12T00:38:37.439647+0000","last_peered":"2024-09-12T00:38:37.439647+0000","last_clean":"2024-09-12T00:38:37.439647+0000","last_became_active":"2024-09-12T00:02:03.145673+0000","last_became_peered":"2024-09-12T00:02:03.145673+0000","last_unstale":"2024-09-12T00:38:37.439647+0000","last_undegraded":"2024-09-12T00:38:37.439647+0000","last_fullsized":"2024-09-12T00:38:37.439647+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:24.216453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47470,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":957,"num_write":348,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'782","reported_seq":2154,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.129841+0000","last_change":"2024-09-12T00:02:05.165636+0000","last_active":"2024-09-12T00:38:37.129841+0000","last_peered":"2024-09-12T00:38:37.129841+0000","last_clean":"2024-09-12T00:38:37.129841+0000","last_became_active":"2024-09-12T00:02:05.165283+0000","last_became_peered":"2024-09-12T00:02:05.165283+0000","last_unstale":"2024-09-12T00:38:37.129841+0000","last_undegraded":"2024-09-12T00:38:37.129841+0000","last_fullsized":"2024-09-12T00:38:37.129841+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:20.861078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'107","reported_seq":676,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:17.644092+0000","last_change":"2024-09-12T00:01:59.154031+0000","last_active":"2024-09-12T00:36:17.644092+0000","last_peered":"2024-09-12T00:36:17.644092+0000","last_clean":"2024-09-12T00:36:17.644092+0000","last_became_active":"2024-09-12T00:01:59.153704+0000","last_became_peered":"2024-09-12T00:01:59.153704+0000","last_unstale":"2024-09-12T00:36:17.644092+0000","last_undegraded":"2024-09-12T00:36:17.644092+0000","last_fullsized":"2024-09-12T00:36:17.644092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:25.468551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":389,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'347","reported_seq":986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.302403+0000","last_change":"2024-09-12T00:01:57.155999+0000","last_active":"2024-09-12T00:38:38.302403+0000","last_peered":"2024-09-12T00:38:38.302403+0000","last_clean":"2024-09-12T00:38:38.302403+0000","last_became_active":"2024-09-12T00:01:57.154222+0000","last_became_peered":"2024-09-12T00:01:57.154222+0000","last_unstale":"2024-09-12T00:38:38.302403+0000","last_undegraded":"2024-09-12T00:38:38.302403+0000","last_fullsized":"2024-09-12T00:38:38.302403+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:34.043715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589724,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":40360,"num_write":1158,"num_write_kb":32511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:31.497551+0000","last_change":"2024-09-12T00:02:01.144820+0000","last_active":"2024-09-12T00:34:31.497551+0000","last_peered":"2024-09-12T00:34:31.497551+0000","last_clean":"2024-09-12T00:34:31.497551+0000","last_became_active":"2024-09-12T00:02:01.144531+0000","last_became_peered":"2024-09-12T00:02:01.144531+0000","last_unstale":"2024-09-12T00:34:31.497551+0000","last_undegraded":"2024-09-12T00:34:31.497551+0000","last_fullsized":"2024-09-12T00:34:31.497551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:47.902602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'371","reported_seq":973,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.119846+0000","last_change":"2024-09-12T00:02:03.155592+0000","last_active":"2024-09-12T00:38:38.119846+0000","last_peered":"2024-09-12T00:38:38.119846+0000","last_clean":"2024-09-12T00:38:38.119846+0000","last_became_active":"2024-09-12T00:02:03.155293+0000","last_became_peered":"2024-09-12T00:02:03.155293+0000","last_unstale":"2024-09-12T00:38:38.119846+0000","last_undegraded":"2024-09-12T00:38:38.119846+0000","last_fullsized":"2024-09-12T00:38:38.119846+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:29.029401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50160,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":1260,"num_write":482,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.509941+0000","last_change":"2024-09-12T00:02:05.168024+0000","last_active":"2024-09-12T00:35:49.509941+0000","last_peered":"2024-09-12T00:35:49.509941+0000","last_clean":"2024-09-12T00:35:49.509941+0000","last_became_active":"2024-09-12T00:02:05.167762+0000","last_became_peered":"2024-09-12T00:02:05.167762+0000","last_unstale":"2024-09-12T00:35:49.509941+0000","last_undegraded":"2024-09-12T00:35:49.509941+0000","last_fullsized":"2024-09-12T00:35:49.509941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:56.207387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'546","reported_seq":1342,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.940888+0000","last_change":"2024-09-12T00:02:07.172418+0000","last_active":"2024-09-12T00:38:28.940888+0000","last_peered":"2024-09-12T00:38:28.940888+0000","last_clean":"2024-09-12T00:38:28.940888+0000","last_became_active":"2024-09-12T00:02:07.172005+0000","last_became_peered":"2024-09-12T00:02:07.172005+0000","last_unstale":"2024-09-12T00:38:28.940888+0000","last_undegraded":"2024-09-12T00:38:28.940888+0000","last_fullsized":"2024-09-12T00:38:28.940888+0000","mapping_epoch":34,"log_start":"261'500","ondisk_log_start":"261'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:59.842808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1294,"num_read_kb":1285,"num_write":1129,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'119","reported_seq":688,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:49.065624+0000","last_change":"2024-09-12T00:01:59.152065+0000","last_active":"2024-09-12T00:36:49.065624+0000","last_peered":"2024-09-12T00:36:49.065624+0000","last_clean":"2024-09-12T00:36:49.065624+0000","last_became_active":"2024-09-12T00:01:59.151782+0000","last_became_peered":"2024-09-12T00:01:59.151782+0000","last_unstale":"2024-09-12T00:36:49.065624+0000","last_undegraded":"2024-09-12T00:36:49.065624+0000","last_fullsized":"2024-09-12T00:36:49.065624+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:29.853489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":439,"num_write":192,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'305","reported_seq":914,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.319451+0000","last_change":"2024-09-12T00:01:57.157778+0000","last_active":"2024-09-12T00:38:38.319451+0000","last_peered":"2024-09-12T00:38:38.319451+0000","last_clean":"2024-09-12T00:38:38.319451+0000","last_became_active":"2024-09-12T00:01:57.157370+0000","last_became_peered":"2024-09-12T00:01:57.157370+0000","last_unstale":"2024-09-12T00:38:38.319451+0000","last_undegraded":"2024-09-12T00:38:38.319451+0000","last_fullsized":"2024-09-12T00:38:38.319451+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:25.879830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327243,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":441,"num_read_kb":3842,"num_write":968,"num_write_kb":16793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498474+0000","last_change":"2024-09-12T00:02:01.152227+0000","last_active":"2024-09-12T00:34:34.498474+0000","last_peered":"2024-09-12T00:34:34.498474+0000","last_clean":"2024-09-12T00:34:34.498474+0000","last_became_active":"2024-09-12T00:02:01.151914+0000","last_became_peered":"2024-09-12T00:02:01.151914+0000","last_unstale":"2024-09-12T00:34:34.498474+0000","last_undegraded":"2024-09-12T00:34:34.498474+0000","last_fullsized":"2024-09-12T00:34:34.498474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:15.461722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'276","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.700469+0000","last_change":"2024-09-12T00:02:03.155128+0000","last_active":"2024-09-12T00:38:36.700469+0000","last_peered":"2024-09-12T00:38:36.700469+0000","last_clean":"2024-09-12T00:38:36.700469+0000","last_became_active":"2024-09-12T00:02:03.154819+0000","last_became_peered":"2024-09-12T00:02:03.154819+0000","last_unstale":"2024-09-12T00:38:36.700469+0000","last_undegraded":"2024-09-12T00:38:36.700469+0000","last_fullsized":"2024-09-12T00:38:36.700469+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:47.375234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":1012,"num_write":362,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:42.502604+0000","last_change":"2024-09-12T00:02:05.168924+0000","last_active":"2024-09-12T00:34:42.502604+0000","last_peered":"2024-09-12T00:34:42.502604+0000","last_clean":"2024-09-12T00:34:42.502604+0000","last_became_active":"2024-09-12T00:02:05.168649+0000","last_became_peered":"2024-09-12T00:02:05.168649+0000","last_unstale":"2024-09-12T00:34:42.502604+0000","last_undegraded":"2024-09-12T00:34:42.502604+0000","last_fullsized":"2024-09-12T00:34:42.502604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:59.645822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2367","reported_seq":4178,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:10.204589+0000","last_change":"2024-09-12T00:02:07.175086+0000","last_active":"2024-09-12T00:38:10.204589+0000","last_peered":"2024-09-12T00:38:10.204589+0000","last_clean":"2024-09-12T00:38:10.204589+0000","last_became_active":"2024-09-12T00:02:07.174769+0000","last_became_peered":"2024-09-12T00:02:07.174769+0000","last_unstale":"2024-09-12T00:38:10.204589+0000","last_undegraded":"2024-09-12T00:38:10.204589+0000","last_fullsized":"2024-09-12T00:38:10.204589+0000","mapping_epoch":34,"log_start":"261'2300","ondisk_log_start":"261'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":2300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:04.650587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5961,"num_read_kb":5964,"num_write":4767,"num_write_kb":1768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'190","reported_seq":812,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.531588+0000","last_change":"2024-09-12T00:01:59.156546+0000","last_active":"2024-09-12T00:36:54.531588+0000","last_peered":"2024-09-12T00:36:54.531588+0000","last_clean":"2024-09-12T00:36:54.531588+0000","last_became_active":"2024-09-12T00:01:59.156252+0000","last_became_peered":"2024-09-12T00:01:59.156252+0000","last_unstale":"2024-09-12T00:36:54.531588+0000","last_undegraded":"2024-09-12T00:36:54.531588+0000","last_fullsized":"2024-09-12T00:36:54.531588+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:11.696792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":702,"num_write":296,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'368","reported_seq":1007,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.339298+0000","last_change":"2024-09-12T00:01:57.158137+0000","last_active":"2024-09-12T00:38:38.339298+0000","last_peered":"2024-09-12T00:38:38.339298+0000","last_clean":"2024-09-12T00:38:38.339298+0000","last_became_active":"2024-09-12T00:01:57.157699+0000","last_became_peered":"2024-09-12T00:01:57.157699+0000","last_unstale":"2024-09-12T00:38:38.339298+0000","last_undegraded":"2024-09-12T00:38:38.339298+0000","last_fullsized":"2024-09-12T00:38:38.339298+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:28.312365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":32954,"num_write":1221,"num_write_kb":41911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510167+0000","last_change":"2024-09-12T00:02:01.153356+0000","last_active":"2024-09-12T00:35:49.510167+0000","last_peered":"2024-09-12T00:35:49.510167+0000","last_clean":"2024-09-12T00:35:49.510167+0000","last_became_active":"2024-09-12T00:02:01.153090+0000","last_became_peered":"2024-09-12T00:02:01.153090+0000","last_unstale":"2024-09-12T00:35:49.510167+0000","last_undegraded":"2024-09-12T00:35:49.510167+0000","last_fullsized":"2024-09-12T00:35:49.510167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:13.705146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'321","reported_seq":899,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.277352+0000","last_change":"2024-09-12T00:02:03.153714+0000","last_active":"2024-09-12T00:38:38.277352+0000","last_peered":"2024-09-12T00:38:38.277352+0000","last_clean":"2024-09-12T00:38:38.277352+0000","last_became_active":"2024-09-12T00:02:03.153386+0000","last_became_peered":"2024-09-12T00:02:03.153386+0000","last_unstale":"2024-09-12T00:38:38.277352+0000","last_undegraded":"2024-09-12T00:38:38.277352+0000","last_fullsized":"2024-09-12T00:38:38.277352+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:33.982115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50481,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":533,"num_read_kb":1216,"num_write":438,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'782","reported_seq":2236,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.130233+0000","last_change":"2024-09-12T00:02:05.166163+0000","last_active":"2024-09-12T00:38:37.130233+0000","last_peered":"2024-09-12T00:38:37.130233+0000","last_clean":"2024-09-12T00:38:37.130233+0000","last_became_active":"2024-09-12T00:02:05.165892+0000","last_became_peered":"2024-09-12T00:02:05.165892+0000","last_unstale":"2024-09-12T00:38:37.130233+0000","last_undegraded":"2024-09-12T00:38:37.130233+0000","last_fullsized":"2024-09-12T00:38:37.130233+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:29.616858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'87","reported_seq":561,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.556657+0000","last_change":"2024-09-12T00:02:07.169522+0000","last_active":"2024-09-12T00:38:27.556657+0000","last_peered":"2024-09-12T00:38:27.556657+0000","last_clean":"2024-09-12T00:38:27.556657+0000","last_became_active":"2024-09-12T00:02:07.169216+0000","last_became_peered":"2024-09-12T00:02:07.169216+0000","last_unstale":"2024-09-12T00:38:27.556657+0000","last_undegraded":"2024-09-12T00:38:27.556657+0000","last_fullsized":"2024-09-12T00:38:27.556657+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:40.757968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":199,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'131","reported_seq":707,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.791148+0000","last_change":"2024-09-12T00:01:59.153212+0000","last_active":"2024-09-12T00:37:01.791148+0000","last_peered":"2024-09-12T00:37:01.791148+0000","last_clean":"2024-09-12T00:37:01.791148+0000","last_became_active":"2024-09-12T00:01:59.152836+0000","last_became_peered":"2024-09-12T00:01:59.152836+0000","last_unstale":"2024-09-12T00:37:01.791148+0000","last_undegraded":"2024-09-12T00:37:01.791148+0000","last_fullsized":"2024-09-12T00:37:01.791148+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:52.164308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":483,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'320","reported_seq":957,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.313108+0000","last_change":"2024-09-12T00:01:57.143503+0000","last_active":"2024-09-12T00:38:38.313108+0000","last_peered":"2024-09-12T00:38:38.313108+0000","last_clean":"2024-09-12T00:38:38.313108+0000","last_became_active":"2024-09-12T00:01:57.143137+0000","last_became_peered":"2024-09-12T00:01:57.143137+0000","last_unstale":"2024-09-12T00:38:38.313108+0000","last_undegraded":"2024-09-12T00:38:38.313108+0000","last_fullsized":"2024-09-12T00:38:38.313108+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:29.714719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286939,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":8103,"num_write":1063,"num_write_kb":32276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:39.499399+0000","last_change":"2024-09-12T00:02:01.144552+0000","last_active":"2024-09-12T00:34:39.499399+0000","last_peered":"2024-09-12T00:34:39.499399+0000","last_clean":"2024-09-12T00:34:39.499399+0000","last_became_active":"2024-09-12T00:02:01.144199+0000","last_became_peered":"2024-09-12T00:02:01.144199+0000","last_unstale":"2024-09-12T00:34:39.499399+0000","last_undegraded":"2024-09-12T00:34:39.499399+0000","last_fullsized":"2024-09-12T00:34:39.499399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:06.942666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'487","reported_seq":1119,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.934906+0000","last_change":"2024-09-12T00:02:03.155884+0000","last_active":"2024-09-12T00:38:36.934906+0000","last_peered":"2024-09-12T00:38:36.934906+0000","last_clean":"2024-09-12T00:38:36.934906+0000","last_became_active":"2024-09-12T00:02:03.155625+0000","last_became_peered":"2024-09-12T00:02:03.155625+0000","last_unstale":"2024-09-12T00:38:36.934906+0000","last_undegraded":"2024-09-12T00:38:36.934906+0000","last_fullsized":"2024-09-12T00:38:36.934906+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:38.186042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104418,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":868,"num_read_kb":2109,"num_write":716,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499199+0000","last_change":"2024-09-12T00:02:05.169143+0000","last_active":"2024-09-12T00:34:34.499199+0000","last_peered":"2024-09-12T00:34:34.499199+0000","last_clean":"2024-09-12T00:34:34.499199+0000","last_became_active":"2024-09-12T00:02:05.168816+0000","last_became_peered":"2024-09-12T00:02:05.168816+0000","last_unstale":"2024-09-12T00:34:34.499199+0000","last_undegraded":"2024-09-12T00:34:34.499199+0000","last_fullsized":"2024-09-12T00:34:34.499199+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:06.783756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'158","reported_seq":651,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.701085+0000","last_change":"2024-09-12T00:02:07.172017+0000","last_active":"2024-09-12T00:37:07.701085+0000","last_peered":"2024-09-12T00:37:07.701085+0000","last_clean":"2024-09-12T00:37:07.701085+0000","last_became_active":"2024-09-12T00:02:07.171762+0000","last_became_peered":"2024-09-12T00:02:07.171762+0000","last_unstale":"2024-09-12T00:37:07.701085+0000","last_undegraded":"2024-09-12T00:37:07.701085+0000","last_fullsized":"2024-09-12T00:37:07.701085+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:23.109250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":181,"num_read_kb":171,"num_write":367,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'250","reported_seq":889,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.771797+0000","last_change":"2024-09-12T00:01:59.148026+0000","last_active":"2024-09-12T00:37:10.771797+0000","last_peered":"2024-09-12T00:37:10.771797+0000","last_clean":"2024-09-12T00:37:10.771797+0000","last_became_active":"2024-09-12T00:01:59.147762+0000","last_became_peered":"2024-09-12T00:01:59.147762+0000","last_unstale":"2024-09-12T00:37:10.771797+0000","last_undegraded":"2024-09-12T00:37:10.771797+0000","last_fullsized":"2024-09-12T00:37:10.771797+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:56.095727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1058,"num_read_kb":865,"num_write":369,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'311","reported_seq":911,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.230788+0000","last_change":"2024-09-12T00:01:57.140135+0000","last_active":"2024-09-12T00:38:38.230788+0000","last_peered":"2024-09-12T00:38:38.230788+0000","last_clean":"2024-09-12T00:38:38.230788+0000","last_became_active":"2024-09-12T00:01:57.139677+0000","last_became_peered":"2024-09-12T00:01:57.139677+0000","last_unstale":"2024-09-12T00:38:38.230788+0000","last_undegraded":"2024-09-12T00:38:38.230788+0000","last_fullsized":"2024-09-12T00:38:38.230788+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:12.642146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":3669,"num_write":1056,"num_write_kb":17146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510008+0000","last_change":"2024-09-12T00:02:01.151052+0000","last_active":"2024-09-12T00:35:49.510008+0000","last_peered":"2024-09-12T00:35:49.510008+0000","last_clean":"2024-09-12T00:35:49.510008+0000","last_became_active":"2024-09-12T00:02:01.150796+0000","last_became_peered":"2024-09-12T00:02:01.150796+0000","last_unstale":"2024-09-12T00:35:49.510008+0000","last_undegraded":"2024-09-12T00:35:49.510008+0000","last_fullsized":"2024-09-12T00:35:49.510008+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:30.994773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'275","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.002679+0000","last_change":"2024-09-12T00:02:03.153772+0000","last_active":"2024-09-12T00:38:37.002679+0000","last_peered":"2024-09-12T00:38:37.002679+0000","last_clean":"2024-09-12T00:38:37.002679+0000","last_became_active":"2024-09-12T00:02:03.153447+0000","last_became_peered":"2024-09-12T00:02:03.153447+0000","last_unstale":"2024-09-12T00:38:37.002679+0000","last_undegraded":"2024-09-12T00:38:37.002679+0000","last_fullsized":"2024-09-12T00:38:37.002679+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:52.487542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49756,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":469,"num_read_kb":1005,"num_write":420,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":471,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.510853+0000","last_change":"2024-09-12T00:02:05.163959+0000","last_active":"2024-09-12T00:35:54.510853+0000","last_peered":"2024-09-12T00:35:54.510853+0000","last_clean":"2024-09-12T00:35:54.510853+0000","last_became_active":"2024-09-12T00:02:05.163689+0000","last_became_peered":"2024-09-12T00:02:05.163689+0000","last_unstale":"2024-09-12T00:35:54.510853+0000","last_undegraded":"2024-09-12T00:35:54.510853+0000","last_fullsized":"2024-09-12T00:35:54.510853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:14.624849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'128","reported_seq":610,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:14.529969+0000","last_change":"2024-09-12T00:02:07.172273+0000","last_active":"2024-09-12T00:38:14.529969+0000","last_peered":"2024-09-12T00:38:14.529969+0000","last_clean":"2024-09-12T00:38:14.529969+0000","last_became_active":"2024-09-12T00:02:07.171942+0000","last_became_peered":"2024-09-12T00:02:07.171942+0000","last_unstale":"2024-09-12T00:38:14.529969+0000","last_undegraded":"2024-09-12T00:38:14.529969+0000","last_fullsized":"2024-09-12T00:38:14.529969+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:54.534357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'138","reported_seq":727,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.949864+0000","last_change":"2024-09-12T00:01:59.150356+0000","last_active":"2024-09-12T00:36:59.949864+0000","last_peered":"2024-09-12T00:36:59.949864+0000","last_clean":"2024-09-12T00:36:59.949864+0000","last_became_active":"2024-09-12T00:01:59.148534+0000","last_became_peered":"2024-09-12T00:01:59.148534+0000","last_unstale":"2024-09-12T00:36:59.949864+0000","last_undegraded":"2024-09-12T00:36:59.949864+0000","last_fullsized":"2024-09-12T00:36:59.949864+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:28.691183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":510,"num_write":211,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'366","reported_seq":1007,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.327166+0000","last_change":"2024-09-12T00:01:57.167545+0000","last_active":"2024-09-12T00:38:38.327166+0000","last_peered":"2024-09-12T00:38:38.327166+0000","last_clean":"2024-09-12T00:38:38.327166+0000","last_became_active":"2024-09-12T00:01:57.165226+0000","last_became_peered":"2024-09-12T00:01:57.165226+0000","last_unstale":"2024-09-12T00:38:38.327166+0000","last_undegraded":"2024-09-12T00:38:38.327166+0000","last_fullsized":"2024-09-12T00:38:38.327166+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:33.371625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436889,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":580,"num_read_kb":11178,"num_write":1222,"num_write_kb":42398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510231+0000","last_change":"2024-09-12T00:02:01.154098+0000","last_active":"2024-09-12T00:35:49.510231+0000","last_peered":"2024-09-12T00:35:49.510231+0000","last_clean":"2024-09-12T00:35:49.510231+0000","last_became_active":"2024-09-12T00:02:01.153818+0000","last_became_peered":"2024-09-12T00:02:01.153818+0000","last_unstale":"2024-09-12T00:35:49.510231+0000","last_undegraded":"2024-09-12T00:35:49.510231+0000","last_fullsized":"2024-09-12T00:35:49.510231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:57.741932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'292","reported_seq":856,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.466483+0000","last_change":"2024-09-12T00:02:03.152712+0000","last_active":"2024-09-12T00:38:36.466483+0000","last_peered":"2024-09-12T00:38:36.466483+0000","last_clean":"2024-09-12T00:38:36.466483+0000","last_became_active":"2024-09-12T00:02:03.152421+0000","last_became_peered":"2024-09-12T00:02:03.152421+0000","last_unstale":"2024-09-12T00:38:36.466483+0000","last_undegraded":"2024-09-12T00:38:36.466483+0000","last_fullsized":"2024-09-12T00:38:36.466483+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:06.190143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49051,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":1143,"num_write":402,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'761","reported_seq":2118,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.745299+0000","last_change":"2024-09-12T00:02:05.164910+0000","last_active":"2024-09-12T00:38:37.745299+0000","last_peered":"2024-09-12T00:38:37.745299+0000","last_clean":"2024-09-12T00:38:37.745299+0000","last_became_active":"2024-09-12T00:02:05.164655+0000","last_became_peered":"2024-09-12T00:02:05.164655+0000","last_unstale":"2024-09-12T00:38:37.745299+0000","last_undegraded":"2024-09-12T00:38:37.745299+0000","last_fullsized":"2024-09-12T00:38:37.745299+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:28.772936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'95","reported_seq":570,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:00.719827+0000","last_change":"2024-09-12T00:02:07.165060+0000","last_active":"2024-09-12T00:37:00.719827+0000","last_peered":"2024-09-12T00:37:00.719827+0000","last_clean":"2024-09-12T00:37:00.719827+0000","last_became_active":"2024-09-12T00:02:07.164754+0000","last_became_peered":"2024-09-12T00:02:07.164754+0000","last_unstale":"2024-09-12T00:37:00.719827+0000","last_undegraded":"2024-09-12T00:37:00.719827+0000","last_fullsized":"2024-09-12T00:37:00.719827+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:35.892955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":233,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'85","reported_seq":639,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:21.919959+0000","last_change":"2024-09-12T00:01:59.157814+0000","last_active":"2024-09-12T00:36:21.919959+0000","last_peered":"2024-09-12T00:36:21.919959+0000","last_clean":"2024-09-12T00:36:21.919959+0000","last_became_active":"2024-09-12T00:01:59.157172+0000","last_became_peered":"2024-09-12T00:01:59.157172+0000","last_unstale":"2024-09-12T00:36:21.919959+0000","last_undegraded":"2024-09-12T00:36:21.919959+0000","last_fullsized":"2024-09-12T00:36:21.919959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:05.814891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":384,"num_read_kb":356,"num_write":138,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'377","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.349887+0000","last_change":"2024-09-12T00:01:57.146086+0000","last_active":"2024-09-12T00:38:38.349887+0000","last_peered":"2024-09-12T00:38:38.349887+0000","last_clean":"2024-09-12T00:38:38.349887+0000","last_became_active":"2024-09-12T00:01:57.145710+0000","last_became_peered":"2024-09-12T00:01:57.145710+0000","last_unstale":"2024-09-12T00:38:38.349887+0000","last_undegraded":"2024-09-12T00:38:38.349887+0000","last_fullsized":"2024-09-12T00:38:38.349887+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:34.573066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1440158,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":582,"num_read_kb":20019,"num_write":1294,"num_write_kb":22247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":1920,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.884434+0000","last_change":"2024-09-12T00:02:01.144164+0000","last_active":"2024-09-12T00:38:35.884434+0000","last_peered":"2024-09-12T00:38:35.884434+0000","last_clean":"2024-09-12T00:38:35.884434+0000","last_became_active":"2024-09-12T00:02:01.143823+0000","last_became_peered":"2024-09-12T00:02:01.143823+0000","last_unstale":"2024-09-12T00:38:35.884434+0000","last_undegraded":"2024-09-12T00:38:35.884434+0000","last_fullsized":"2024-09-12T00:38:35.884434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:46.468299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1676,"num_read_kb":1674,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'65","reported_seq":563,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:26.578538+0000","last_change":"2024-09-12T00:02:03.157279+0000","last_active":"2024-09-12T00:36:26.578538+0000","last_peered":"2024-09-12T00:36:26.578538+0000","last_clean":"2024-09-12T00:36:26.578538+0000","last_became_active":"2024-09-12T00:02:03.156680+0000","last_became_peered":"2024-09-12T00:02:03.156680+0000","last_unstale":"2024-09-12T00:36:26.578538+0000","last_undegraded":"2024-09-12T00:36:26.578538+0000","last_fullsized":"2024-09-12T00:36:26.578538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:51.959162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'775","reported_seq":2289,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.893501+0000","last_change":"2024-09-12T00:02:05.164449+0000","last_active":"2024-09-12T00:38:35.893501+0000","last_peered":"2024-09-12T00:38:35.893501+0000","last_clean":"2024-09-12T00:38:35.893501+0000","last_became_active":"2024-09-12T00:02:05.163596+0000","last_became_peered":"2024-09-12T00:02:05.163596+0000","last_unstale":"2024-09-12T00:38:35.893501+0000","last_undegraded":"2024-09-12T00:38:35.893501+0000","last_fullsized":"2024-09-12T00:38:35.893501+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:09.031568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'118","reported_seq":600,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.085766+0000","last_change":"2024-09-12T00:02:07.169460+0000","last_active":"2024-09-12T00:37:22.085766+0000","last_peered":"2024-09-12T00:37:22.085766+0000","last_clean":"2024-09-12T00:37:22.085766+0000","last_became_active":"2024-09-12T00:02:07.169160+0000","last_became_peered":"2024-09-12T00:02:07.169160+0000","last_unstale":"2024-09-12T00:37:22.085766+0000","last_undegraded":"2024-09-12T00:37:22.085766+0000","last_fullsized":"2024-09-12T00:37:22.085766+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:26.962721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":119,"num_write":276,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'226","reported_seq":785,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.164666+0000","last_change":"2024-09-12T00:01:59.152409+0000","last_active":"2024-09-12T00:37:07.164666+0000","last_peered":"2024-09-12T00:37:07.164666+0000","last_clean":"2024-09-12T00:37:07.164666+0000","last_became_active":"2024-09-12T00:01:59.152145+0000","last_became_peered":"2024-09-12T00:01:59.152145+0000","last_unstale":"2024-09-12T00:37:07.164666+0000","last_undegraded":"2024-09-12T00:37:07.164666+0000","last_fullsized":"2024-09-12T00:37:07.164666+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:24.656234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":744,"num_write":332,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'404","reported_seq":1109,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.297449+0000","last_change":"2024-09-12T00:01:57.141659+0000","last_active":"2024-09-12T00:38:38.297449+0000","last_peered":"2024-09-12T00:38:38.297449+0000","last_clean":"2024-09-12T00:38:38.297449+0000","last_became_active":"2024-09-12T00:01:57.140715+0000","last_became_peered":"2024-09-12T00:01:57.140715+0000","last_unstale":"2024-09-12T00:38:38.297449+0000","last_undegraded":"2024-09-12T00:38:38.297449+0000","last_fullsized":"2024-09-12T00:38:38.297449+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:50.244966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":94303,"num_write":1279,"num_write_kb":32809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.392478+0000","last_change":"2024-09-12T00:02:01.153751+0000","last_active":"2024-09-12T00:35:49.392478+0000","last_peered":"2024-09-12T00:35:49.392478+0000","last_clean":"2024-09-12T00:35:49.392478+0000","last_became_active":"2024-09-12T00:02:01.153347+0000","last_became_peered":"2024-09-12T00:02:01.153347+0000","last_unstale":"2024-09-12T00:35:49.392478+0000","last_undegraded":"2024-09-12T00:35:49.392478+0000","last_fullsized":"2024-09-12T00:35:49.392478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:05.059094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'316","reported_seq":903,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.897567+0000","last_change":"2024-09-12T00:02:03.155029+0000","last_active":"2024-09-12T00:38:37.897567+0000","last_peered":"2024-09-12T00:38:37.897567+0000","last_clean":"2024-09-12T00:38:37.897567+0000","last_became_active":"2024-09-12T00:02:03.154752+0000","last_became_peered":"2024-09-12T00:02:03.154752+0000","last_unstale":"2024-09-12T00:38:37.897567+0000","last_undegraded":"2024-09-12T00:38:37.897567+0000","last_fullsized":"2024-09-12T00:38:37.897567+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:16.822889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43947,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1120,"num_write":412,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627588+0000","last_change":"2024-09-12T00:02:05.164441+0000","last_active":"2024-09-12T00:35:49.627588+0000","last_peered":"2024-09-12T00:35:49.627588+0000","last_clean":"2024-09-12T00:35:49.627588+0000","last_became_active":"2024-09-12T00:02:05.164108+0000","last_became_peered":"2024-09-12T00:02:05.164108+0000","last_unstale":"2024-09-12T00:35:49.627588+0000","last_undegraded":"2024-09-12T00:35:49.627588+0000","last_fullsized":"2024-09-12T00:35:49.627588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:12.635310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'159","reported_seq":633,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.847980+0000","last_change":"2024-09-12T00:02:07.169610+0000","last_active":"2024-09-12T00:36:52.847980+0000","last_peered":"2024-09-12T00:36:52.847980+0000","last_clean":"2024-09-12T00:36:52.847980+0000","last_became_active":"2024-09-12T00:02:07.169351+0000","last_became_peered":"2024-09-12T00:02:07.169351+0000","last_unstale":"2024-09-12T00:36:52.847980+0000","last_undegraded":"2024-09-12T00:36:52.847980+0000","last_fullsized":"2024-09-12T00:36:52.847980+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:28.308716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":164,"num_write":397,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'164","reported_seq":768,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:26.283270+0000","last_change":"2024-09-12T00:01:59.151096+0000","last_active":"2024-09-12T00:36:26.283270+0000","last_peered":"2024-09-12T00:36:26.283270+0000","last_clean":"2024-09-12T00:36:26.283270+0000","last_became_active":"2024-09-12T00:01:59.150072+0000","last_became_peered":"2024-09-12T00:01:59.150072+0000","last_unstale":"2024-09-12T00:36:26.283270+0000","last_undegraded":"2024-09-12T00:36:26.283270+0000","last_fullsized":"2024-09-12T00:36:26.283270+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:28.419527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":763,"num_read_kb":636,"num_write":273,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":605,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:46.508442+0000","last_change":"2024-09-12T00:01:39.721517+0000","last_active":"2024-09-12T00:35:46.508442+0000","last_peered":"2024-09-12T00:35:46.508442+0000","last_clean":"2024-09-12T00:35:46.508442+0000","last_became_active":"2024-09-12T00:01:39.720425+0000","last_became_peered":"2024-09-12T00:01:39.720425+0000","last_unstale":"2024-09-12T00:35:46.508442+0000","last_undegraded":"2024-09-12T00:35:46.508442+0000","last_fullsized":"2024-09-12T00:35:46.508442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:37.438834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:37.438834+0000","last_clean_scrub_stamp":"2024-09-12T00:01:37.438834+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:26.565085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":512,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.386954+0000","last_change":"2024-09-12T00:01:48.515868+0000","last_active":"2024-09-12T00:35:09.386954+0000","last_peered":"2024-09-12T00:35:09.386954+0000","last_clean":"2024-09-12T00:35:09.386954+0000","last_became_active":"2024-09-12T00:01:46.613916+0000","last_became_peered":"2024-09-12T00:01:46.613916+0000","last_unstale":"2024-09-12T00:35:09.386954+0000","last_undegraded":"2024-09-12T00:35:09.386954+0000","last_fullsized":"2024-09-12T00:35:09.386954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:23.127685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014566500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'375","reported_seq":1068,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.313307+0000","last_change":"2024-09-12T00:01:57.141951+0000","last_active":"2024-09-12T00:38:38.313307+0000","last_peered":"2024-09-12T00:38:38.313307+0000","last_clean":"2024-09-12T00:38:38.313307+0000","last_became_active":"2024-09-12T00:01:57.141553+0000","last_became_peered":"2024-09-12T00:01:57.141553+0000","last_unstale":"2024-09-12T00:38:38.313307+0000","last_undegraded":"2024-09-12T00:38:38.313307+0000","last_fullsized":"2024-09-12T00:38:38.313307+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:47.205119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":706,"num_read_kb":51090,"num_write":1043,"num_write_kb":49735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.387995+0000","last_change":"2024-09-12T00:02:01.148969+0000","last_active":"2024-09-12T00:35:24.387995+0000","last_peered":"2024-09-12T00:35:24.387995+0000","last_clean":"2024-09-12T00:35:24.387995+0000","last_became_active":"2024-09-12T00:02:01.148696+0000","last_became_peered":"2024-09-12T00:02:01.148696+0000","last_unstale":"2024-09-12T00:35:24.387995+0000","last_undegraded":"2024-09-12T00:35:24.387995+0000","last_fullsized":"2024-09-12T00:35:24.387995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:28.294552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'690","reported_seq":1384,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.041890+0000","last_change":"2024-09-12T00:02:03.150355+0000","last_active":"2024-09-12T00:38:38.041890+0000","last_peered":"2024-09-12T00:38:38.041890+0000","last_clean":"2024-09-12T00:38:38.041890+0000","last_became_active":"2024-09-12T00:02:03.150075+0000","last_became_peered":"2024-09-12T00:02:03.150075+0000","last_unstale":"2024-09-12T00:38:38.041890+0000","last_undegraded":"2024-09-12T00:38:38.041890+0000","last_fullsized":"2024-09-12T00:38:38.041890+0000","mapping_epoch":30,"log_start":"261'600","ondisk_log_start":"261'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:08.116055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141385,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1354,"num_read_kb":3064,"num_write":1242,"num_write_kb":1087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499342+0000","last_change":"2024-09-12T00:02:05.162858+0000","last_active":"2024-09-12T00:34:34.499342+0000","last_peered":"2024-09-12T00:34:34.499342+0000","last_clean":"2024-09-12T00:34:34.499342+0000","last_became_active":"2024-09-12T00:02:05.162455+0000","last_became_peered":"2024-09-12T00:02:05.162455+0000","last_unstale":"2024-09-12T00:34:34.499342+0000","last_undegraded":"2024-09-12T00:34:34.499342+0000","last_fullsized":"2024-09-12T00:34:34.499342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.590391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'258","reported_seq":959,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.461047+0000","last_change":"2024-09-12T00:02:07.168139+0000","last_active":"2024-09-12T00:37:23.461047+0000","last_peered":"2024-09-12T00:37:23.461047+0000","last_clean":"2024-09-12T00:37:23.461047+0000","last_became_active":"2024-09-12T00:02:07.167844+0000","last_became_peered":"2024-09-12T00:02:07.167844+0000","last_unstale":"2024-09-12T00:37:23.461047+0000","last_undegraded":"2024-09-12T00:37:23.461047+0000","last_fullsized":"2024-09-12T00:37:23.461047+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:00.761039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":469,"num_read_kb":454,"num_write":531,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'172","reported_seq":761,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:10.423640+0000","last_change":"2024-09-12T00:01:59.149437+0000","last_active":"2024-09-12T00:36:10.423640+0000","last_peered":"2024-09-12T00:36:10.423640+0000","last_clean":"2024-09-12T00:36:10.423640+0000","last_became_active":"2024-09-12T00:01:59.149145+0000","last_became_peered":"2024-09-12T00:01:59.149145+0000","last_unstale":"2024-09-12T00:36:10.423640+0000","last_undegraded":"2024-09-12T00:36:10.423640+0000","last_fullsized":"2024-09-12T00:36:10.423640+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:31.451704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":604,"num_write":249,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.393043+0000","last_change":"2024-09-12T00:01:48.515091+0000","last_active":"2024-09-12T00:35:54.393043+0000","last_peered":"2024-09-12T00:35:54.393043+0000","last_clean":"2024-09-12T00:35:54.393043+0000","last_became_active":"2024-09-12T00:01:46.505677+0000","last_became_peered":"2024-09-12T00:01:46.505677+0000","last_unstale":"2024-09-12T00:35:54.393043+0000","last_undegraded":"2024-09-12T00:35:54.393043+0000","last_fullsized":"2024-09-12T00:35:54.393043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:07.430053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075102999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'327","reported_seq":945,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.344143+0000","last_change":"2024-09-12T00:01:57.152548+0000","last_active":"2024-09-12T00:38:38.344143+0000","last_peered":"2024-09-12T00:38:38.344143+0000","last_clean":"2024-09-12T00:38:38.344143+0000","last_became_active":"2024-09-12T00:01:57.152153+0000","last_became_peered":"2024-09-12T00:01:57.152153+0000","last_unstale":"2024-09-12T00:38:38.344143+0000","last_undegraded":"2024-09-12T00:38:38.344143+0000","last_fullsized":"2024-09-12T00:38:38.344143+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:18.135861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263237,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":31136,"num_write":994,"num_write_kb":29868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.382185+0000","last_change":"2024-09-12T00:02:01.153210+0000","last_active":"2024-09-12T00:34:34.382185+0000","last_peered":"2024-09-12T00:34:34.382185+0000","last_clean":"2024-09-12T00:34:34.382185+0000","last_became_active":"2024-09-12T00:02:01.152904+0000","last_became_peered":"2024-09-12T00:02:01.152904+0000","last_unstale":"2024-09-12T00:34:34.382185+0000","last_undegraded":"2024-09-12T00:34:34.382185+0000","last_fullsized":"2024-09-12T00:34:34.382185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:50.681148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1213","reported_seq":2572,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.975535+0000","last_change":"2024-09-12T00:02:03.153993+0000","last_active":"2024-09-12T00:38:37.975535+0000","last_peered":"2024-09-12T00:38:37.975535+0000","last_clean":"2024-09-12T00:38:37.975535+0000","last_became_active":"2024-09-12T00:02:03.153702+0000","last_became_peered":"2024-09-12T00:02:03.153702+0000","last_unstale":"2024-09-12T00:38:37.975535+0000","last_undegraded":"2024-09-12T00:38:37.975535+0000","last_fullsized":"2024-09-12T00:38:37.975535+0000","mapping_epoch":30,"log_start":"261'1200","ondisk_log_start":"261'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.693992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137303,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1920,"num_read_kb":3540,"num_write":1014,"num_write_kb":851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:29.389647+0000","last_change":"2024-09-12T00:02:05.172331+0000","last_active":"2024-09-12T00:35:29.389647+0000","last_peered":"2024-09-12T00:35:29.389647+0000","last_clean":"2024-09-12T00:35:29.389647+0000","last_became_active":"2024-09-12T00:02:05.171787+0000","last_became_peered":"2024-09-12T00:02:05.171787+0000","last_unstale":"2024-09-12T00:35:29.389647+0000","last_undegraded":"2024-09-12T00:35:29.389647+0000","last_fullsized":"2024-09-12T00:35:29.389647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:38.114555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'217","reported_seq":737,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.191898+0000","last_change":"2024-09-12T00:02:07.169700+0000","last_active":"2024-09-12T00:36:56.191898+0000","last_peered":"2024-09-12T00:36:56.191898+0000","last_clean":"2024-09-12T00:36:56.191898+0000","last_became_active":"2024-09-12T00:02:07.169173+0000","last_became_peered":"2024-09-12T00:02:07.169173+0000","last_unstale":"2024-09-12T00:36:56.191898+0000","last_undegraded":"2024-09-12T00:36:56.191898+0000","last_fullsized":"2024-09-12T00:36:56.191898+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:07.710548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":374,"num_read_kb":362,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'88","reported_seq":639,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:20.939776+0000","last_change":"2024-09-12T00:01:59.139141+0000","last_active":"2024-09-12T00:37:20.939776+0000","last_peered":"2024-09-12T00:37:20.939776+0000","last_clean":"2024-09-12T00:37:20.939776+0000","last_became_active":"2024-09-12T00:01:59.138731+0000","last_became_peered":"2024-09-12T00:01:59.138731+0000","last_unstale":"2024-09-12T00:37:20.939776+0000","last_undegraded":"2024-09-12T00:37:20.939776+0000","last_fullsized":"2024-09-12T00:37:20.939776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:31.598716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":368,"num_read_kb":306,"num_write":121,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":503,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.503944+0000","last_change":"2024-09-12T00:01:50.044924+0000","last_active":"2024-09-12T00:35:09.503944+0000","last_peered":"2024-09-12T00:35:09.503944+0000","last_clean":"2024-09-12T00:35:09.503944+0000","last_became_active":"2024-09-12T00:01:46.505857+0000","last_became_peered":"2024-09-12T00:01:46.505857+0000","last_unstale":"2024-09-12T00:35:09.503944+0000","last_undegraded":"2024-09-12T00:35:09.503944+0000","last_fullsized":"2024-09-12T00:35:09.503944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:18.728534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039331300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'325","reported_seq":930,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.217695+0000","last_change":"2024-09-12T00:01:57.154563+0000","last_active":"2024-09-12T00:38:38.217695+0000","last_peered":"2024-09-12T00:38:38.217695+0000","last_clean":"2024-09-12T00:38:38.217695+0000","last_became_active":"2024-09-12T00:01:57.151644+0000","last_became_peered":"2024-09-12T00:01:57.151644+0000","last_unstale":"2024-09-12T00:38:38.217695+0000","last_undegraded":"2024-09-12T00:38:38.217695+0000","last_fullsized":"2024-09-12T00:38:38.217695+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:39.639241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399150,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":451,"num_read_kb":2375,"num_write":1107,"num_write_kb":41035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498978+0000","last_change":"2024-09-12T00:02:01.151980+0000","last_active":"2024-09-12T00:34:34.498978+0000","last_peered":"2024-09-12T00:34:34.498978+0000","last_clean":"2024-09-12T00:34:34.498978+0000","last_became_active":"2024-09-12T00:02:01.151474+0000","last_became_peered":"2024-09-12T00:02:01.151474+0000","last_unstale":"2024-09-12T00:34:34.498978+0000","last_undegraded":"2024-09-12T00:34:34.498978+0000","last_fullsized":"2024-09-12T00:34:34.498978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:15.387013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'208","reported_seq":1181,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:25.299127+0000","last_change":"2024-09-12T00:02:03.155847+0000","last_active":"2024-09-12T00:38:25.299127+0000","last_peered":"2024-09-12T00:38:25.299127+0000","last_clean":"2024-09-12T00:38:25.299127+0000","last_became_active":"2024-09-12T00:02:03.155311+0000","last_became_peered":"2024-09-12T00:02:03.155311+0000","last_unstale":"2024-09-12T00:38:25.299127+0000","last_undegraded":"2024-09-12T00:38:25.299127+0000","last_fullsized":"2024-09-12T00:38:25.299127+0000","mapping_epoch":30,"log_start":"258'100","ondisk_log_start":"258'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:37.168360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":119,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:27.509399+0000","last_change":"2024-09-12T00:02:05.168343+0000","last_active":"2024-09-12T00:35:27.509399+0000","last_peered":"2024-09-12T00:35:27.509399+0000","last_clean":"2024-09-12T00:35:27.509399+0000","last_became_active":"2024-09-12T00:02:05.167874+0000","last_became_peered":"2024-09-12T00:02:05.167874+0000","last_unstale":"2024-09-12T00:35:27.509399+0000","last_undegraded":"2024-09-12T00:35:27.509399+0000","last_fullsized":"2024-09-12T00:35:27.509399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:12.012160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'262","reported_seq":856,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.604136+0000","last_change":"2024-09-12T00:02:07.162130+0000","last_active":"2024-09-12T00:37:23.604136+0000","last_peered":"2024-09-12T00:37:23.604136+0000","last_clean":"2024-09-12T00:37:23.604136+0000","last_became_active":"2024-09-12T00:02:07.161814+0000","last_became_peered":"2024-09-12T00:02:07.161814+0000","last_unstale":"2024-09-12T00:37:23.604136+0000","last_undegraded":"2024-09-12T00:37:23.604136+0000","last_fullsized":"2024-09-12T00:37:23.604136+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:02.767585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":499,"num_read_kb":517,"num_write":567,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'135","reported_seq":711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.489664+0000","last_change":"2024-09-12T00:01:59.153823+0000","last_active":"2024-09-12T00:37:10.489664+0000","last_peered":"2024-09-12T00:37:10.489664+0000","last_clean":"2024-09-12T00:37:10.489664+0000","last_became_active":"2024-09-12T00:01:59.153542+0000","last_became_peered":"2024-09-12T00:01:59.153542+0000","last_unstale":"2024-09-12T00:37:10.489664+0000","last_undegraded":"2024-09-12T00:37:10.489664+0000","last_fullsized":"2024-09-12T00:37:10.489664+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:16.930267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":619,"num_read_kb":513,"num_write":207,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":513,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.386923+0000","last_change":"2024-09-12T00:01:48.515810+0000","last_active":"2024-09-12T00:35:09.386923+0000","last_peered":"2024-09-12T00:35:09.386923+0000","last_clean":"2024-09-12T00:35:09.386923+0000","last_became_active":"2024-09-12T00:01:46.502428+0000","last_became_peered":"2024-09-12T00:01:46.502428+0000","last_unstale":"2024-09-12T00:35:09.386923+0000","last_undegraded":"2024-09-12T00:35:09.386923+0000","last_fullsized":"2024-09-12T00:35:09.386923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:13.947790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001414925,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'334","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.307850+0000","last_change":"2024-09-12T00:01:57.156552+0000","last_active":"2024-09-12T00:38:38.307850+0000","last_peered":"2024-09-12T00:38:38.307850+0000","last_clean":"2024-09-12T00:38:38.307850+0000","last_became_active":"2024-09-12T00:01:57.156172+0000","last_became_peered":"2024-09-12T00:01:57.156172+0000","last_unstale":"2024-09-12T00:38:38.307850+0000","last_undegraded":"2024-09-12T00:38:38.307850+0000","last_fullsized":"2024-09-12T00:38:38.307850+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:22.222372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7788939,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":443,"num_read_kb":22094,"num_write":1095,"num_write_kb":41486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:29.506844+0000","last_change":"2024-09-12T00:02:01.153018+0000","last_active":"2024-09-12T00:35:29.506844+0000","last_peered":"2024-09-12T00:35:29.506844+0000","last_clean":"2024-09-12T00:35:29.506844+0000","last_became_active":"2024-09-12T00:02:01.152752+0000","last_became_peered":"2024-09-12T00:02:01.152752+0000","last_unstale":"2024-09-12T00:35:29.506844+0000","last_undegraded":"2024-09-12T00:35:29.506844+0000","last_fullsized":"2024-09-12T00:35:29.506844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:50.379948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'112","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.961118+0000","last_change":"2024-09-12T00:02:03.152362+0000","last_active":"2024-09-12T00:36:50.961118+0000","last_peered":"2024-09-12T00:36:50.961118+0000","last_clean":"2024-09-12T00:36:50.961118+0000","last_became_active":"2024-09-12T00:02:03.152008+0000","last_became_peered":"2024-09-12T00:02:03.152008+0000","last_unstale":"2024-09-12T00:36:50.961118+0000","last_undegraded":"2024-09-12T00:36:50.961118+0000","last_fullsized":"2024-09-12T00:36:50.961118+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:40.412153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":94,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.382152+0000","last_change":"2024-09-12T00:02:05.170927+0000","last_active":"2024-09-12T00:34:34.382152+0000","last_peered":"2024-09-12T00:34:34.382152+0000","last_clean":"2024-09-12T00:34:34.382152+0000","last_became_active":"2024-09-12T00:02:05.170487+0000","last_became_peered":"2024-09-12T00:02:05.170487+0000","last_unstale":"2024-09-12T00:34:34.382152+0000","last_undegraded":"2024-09-12T00:34:34.382152+0000","last_fullsized":"2024-09-12T00:34:34.382152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:15.416030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":662,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.519983+0000","last_change":"2024-09-12T00:02:07.169125+0000","last_active":"2024-09-12T00:36:52.519983+0000","last_peered":"2024-09-12T00:36:52.519983+0000","last_clean":"2024-09-12T00:36:52.519983+0000","last_became_active":"2024-09-12T00:02:07.168820+0000","last_became_peered":"2024-09-12T00:02:07.168820+0000","last_unstale":"2024-09-12T00:36:52.519983+0000","last_undegraded":"2024-09-12T00:36:52.519983+0000","last_fullsized":"2024-09-12T00:36:52.519983+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:54.542834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":226,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'300","reported_seq":884,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:07.965247+0000","last_change":"2024-09-12T00:01:59.145724+0000","last_active":"2024-09-12T00:37:07.965247+0000","last_peered":"2024-09-12T00:37:07.965247+0000","last_clean":"2024-09-12T00:37:07.965247+0000","last_became_active":"2024-09-12T00:01:59.145273+0000","last_became_peered":"2024-09-12T00:01:59.145273+0000","last_unstale":"2024-09-12T00:37:07.965247+0000","last_undegraded":"2024-09-12T00:37:07.965247+0000","last_fullsized":"2024-09-12T00:37:07.965247+0000","mapping_epoch":26,"log_start":"258'200","ondisk_log_start":"258'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:10.954485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1215,"num_write":550,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'372","reported_seq":1067,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.331053+0000","last_change":"2024-09-12T00:01:57.154791+0000","last_active":"2024-09-12T00:38:38.331053+0000","last_peered":"2024-09-12T00:38:38.331053+0000","last_clean":"2024-09-12T00:38:38.331053+0000","last_became_active":"2024-09-12T00:01:57.154387+0000","last_became_peered":"2024-09-12T00:01:57.154387+0000","last_unstale":"2024-09-12T00:38:38.331053+0000","last_undegraded":"2024-09-12T00:38:38.331053+0000","last_fullsized":"2024-09-12T00:38:38.331053+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:15.020141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6404752,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":635,"num_read_kb":122441,"num_write":1157,"num_write_kb":43815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":509,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:09.504322+0000","last_change":"2024-09-12T00:01:49.473468+0000","last_active":"2024-09-12T00:35:09.504322+0000","last_peered":"2024-09-12T00:35:09.504322+0000","last_clean":"2024-09-12T00:35:09.504322+0000","last_became_active":"2024-09-12T00:01:46.505954+0000","last_became_peered":"2024-09-12T00:01:46.505954+0000","last_unstale":"2024-09-12T00:35:09.504322+0000","last_undegraded":"2024-09-12T00:35:09.504322+0000","last_fullsized":"2024-09-12T00:35:09.504322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:03.543109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050498000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:22.508574+0000","last_change":"2024-09-12T00:02:01.149787+0000","last_active":"2024-09-12T00:35:22.508574+0000","last_peered":"2024-09-12T00:35:22.508574+0000","last_clean":"2024-09-12T00:35:22.508574+0000","last_became_active":"2024-09-12T00:02:01.149529+0000","last_became_peered":"2024-09-12T00:02:01.149529+0000","last_unstale":"2024-09-12T00:35:22.508574+0000","last_undegraded":"2024-09-12T00:35:22.508574+0000","last_fullsized":"2024-09-12T00:35:22.508574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:38.924972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'557","reported_seq":1208,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.507890+0000","last_change":"2024-09-12T00:02:03.152903+0000","last_active":"2024-09-12T00:38:37.507890+0000","last_peered":"2024-09-12T00:38:37.507890+0000","last_clean":"2024-09-12T00:38:37.507890+0000","last_became_active":"2024-09-12T00:02:03.152535+0000","last_became_peered":"2024-09-12T00:02:03.152535+0000","last_unstale":"2024-09-12T00:38:37.507890+0000","last_undegraded":"2024-09-12T00:38:37.507890+0000","last_fullsized":"2024-09-12T00:38:37.507890+0000","mapping_epoch":30,"log_start":"261'500","ondisk_log_start":"261'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:26.014665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88538,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1530,"num_read_kb":2694,"num_write":1952,"num_write_kb":1782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":471,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.623486+0000","last_change":"2024-09-12T00:02:05.168263+0000","last_active":"2024-09-12T00:35:24.623486+0000","last_peered":"2024-09-12T00:35:24.623486+0000","last_clean":"2024-09-12T00:35:24.623486+0000","last_became_active":"2024-09-12T00:02:05.167998+0000","last_became_peered":"2024-09-12T00:02:05.167998+0000","last_unstale":"2024-09-12T00:35:24.623486+0000","last_undegraded":"2024-09-12T00:35:24.623486+0000","last_fullsized":"2024-09-12T00:35:24.623486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:50.635765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'161","reported_seq":644,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.451268+0000","last_change":"2024-09-12T00:02:07.168288+0000","last_active":"2024-09-12T00:37:23.451268+0000","last_peered":"2024-09-12T00:37:23.451268+0000","last_clean":"2024-09-12T00:37:23.451268+0000","last_became_active":"2024-09-12T00:02:07.168005+0000","last_became_peered":"2024-09-12T00:02:07.168005+0000","last_unstale":"2024-09-12T00:37:23.451268+0000","last_undegraded":"2024-09-12T00:37:23.451268+0000","last_fullsized":"2024-09-12T00:37:23.451268+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:33.779846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":133,"num_write":373,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'348","reported_seq":992,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.432202+0000","last_change":"2024-09-12T00:01:59.137316+0000","last_active":"2024-09-12T00:36:52.432202+0000","last_peered":"2024-09-12T00:36:52.432202+0000","last_clean":"2024-09-12T00:36:52.432202+0000","last_became_active":"2024-09-12T00:01:59.137020+0000","last_became_peered":"2024-09-12T00:01:59.137020+0000","last_unstale":"2024-09-12T00:36:52.432202+0000","last_undegraded":"2024-09-12T00:36:52.432202+0000","last_fullsized":"2024-09-12T00:36:52.432202+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:36.922276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1524,"num_read_kb":1224,"num_write":576,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'301","reported_seq":906,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.351092+0000","last_change":"2024-09-12T00:01:57.152881+0000","last_active":"2024-09-12T00:38:38.351092+0000","last_peered":"2024-09-12T00:38:38.351092+0000","last_clean":"2024-09-12T00:38:38.351092+0000","last_became_active":"2024-09-12T00:01:57.152021+0000","last_became_peered":"2024-09-12T00:01:57.152021+0000","last_unstale":"2024-09-12T00:38:38.351092+0000","last_undegraded":"2024-09-12T00:38:38.351092+0000","last_fullsized":"2024-09-12T00:38:38.351092+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:43.435665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288035,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":437,"num_read_kb":13162,"num_write":956,"num_write_kb":28256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:14.387659+0000","last_change":"2024-09-12T00:01:48.515165+0000","last_active":"2024-09-12T00:35:14.387659+0000","last_peered":"2024-09-12T00:35:14.387659+0000","last_clean":"2024-09-12T00:35:14.387659+0000","last_became_active":"2024-09-12T00:01:46.505315+0000","last_became_peered":"2024-09-12T00:01:46.505315+0000","last_unstale":"2024-09-12T00:35:14.387659+0000","last_undegraded":"2024-09-12T00:35:14.387659+0000","last_fullsized":"2024-09-12T00:35:14.387659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:31.136294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079890600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.387917+0000","last_change":"2024-09-12T00:02:01.148940+0000","last_active":"2024-09-12T00:35:24.387917+0000","last_peered":"2024-09-12T00:35:24.387917+0000","last_clean":"2024-09-12T00:35:24.387917+0000","last_became_active":"2024-09-12T00:02:01.148650+0000","last_became_peered":"2024-09-12T00:02:01.148650+0000","last_unstale":"2024-09-12T00:35:24.387917+0000","last_undegraded":"2024-09-12T00:35:24.387917+0000","last_fullsized":"2024-09-12T00:35:24.387917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:11.664931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'162","reported_seq":707,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:29.523102+0000","last_change":"2024-09-12T00:02:03.153955+0000","last_active":"2024-09-12T00:37:29.523102+0000","last_peered":"2024-09-12T00:37:29.523102+0000","last_clean":"2024-09-12T00:37:29.523102+0000","last_became_active":"2024-09-12T00:02:03.153640+0000","last_became_peered":"2024-09-12T00:02:03.153640+0000","last_unstale":"2024-09-12T00:37:29.523102+0000","last_undegraded":"2024-09-12T00:37:29.523102+0000","last_fullsized":"2024-09-12T00:37:29.523102+0000","mapping_epoch":30,"log_start":"258'100","ondisk_log_start":"258'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:03.938144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":206,"num_read_kb":198,"num_write":166,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'775","reported_seq":2508,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.890054+0000","last_change":"2024-09-12T00:02:05.165645+0000","last_active":"2024-09-12T00:38:35.890054+0000","last_peered":"2024-09-12T00:38:35.890054+0000","last_clean":"2024-09-12T00:38:35.890054+0000","last_became_active":"2024-09-12T00:02:05.163720+0000","last_became_peered":"2024-09-12T00:02:05.163720+0000","last_unstale":"2024-09-12T00:38:35.890054+0000","last_undegraded":"2024-09-12T00:38:35.890054+0000","last_fullsized":"2024-09-12T00:38:35.890054+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:23.515740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'122","reported_seq":618,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:19.409311+0000","last_change":"2024-09-12T00:02:07.168152+0000","last_active":"2024-09-12T00:38:19.409311+0000","last_peered":"2024-09-12T00:38:19.409311+0000","last_clean":"2024-09-12T00:38:19.409311+0000","last_became_active":"2024-09-12T00:02:07.167797+0000","last_became_peered":"2024-09-12T00:02:07.167797+0000","last_unstale":"2024-09-12T00:38:19.409311+0000","last_undegraded":"2024-09-12T00:38:19.409311+0000","last_fullsized":"2024-09-12T00:38:19.409311+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:43.278651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":159,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'140","reported_seq":725,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:11.053276+0000","last_change":"2024-09-12T00:01:59.155408+0000","last_active":"2024-09-12T00:37:11.053276+0000","last_peered":"2024-09-12T00:37:11.053276+0000","last_clean":"2024-09-12T00:37:11.053276+0000","last_became_active":"2024-09-12T00:01:59.155117+0000","last_became_peered":"2024-09-12T00:01:59.155117+0000","last_unstale":"2024-09-12T00:37:11.053276+0000","last_undegraded":"2024-09-12T00:37:11.053276+0000","last_fullsized":"2024-09-12T00:37:11.053276+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:27.119934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":474,"num_write":223,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'363","reported_seq":1023,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.317095+0000","last_change":"2024-09-12T00:01:57.134608+0000","last_active":"2024-09-12T00:38:38.317095+0000","last_peered":"2024-09-12T00:38:38.317095+0000","last_clean":"2024-09-12T00:38:38.317095+0000","last_became_active":"2024-09-12T00:01:57.134235+0000","last_became_peered":"2024-09-12T00:01:57.134235+0000","last_unstale":"2024-09-12T00:38:38.317095+0000","last_undegraded":"2024-09-12T00:38:38.317095+0000","last_fullsized":"2024-09-12T00:38:38.317095+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:42.049998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":525,"num_read_kb":31500,"num_write":1186,"num_write_kb":36639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":514,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:27.517783+0000","last_change":"2024-09-12T00:01:48.511519+0000","last_active":"2024-09-12T00:36:27.517783+0000","last_peered":"2024-09-12T00:36:27.517783+0000","last_clean":"2024-09-12T00:36:27.517783+0000","last_became_active":"2024-09-12T00:01:46.508144+0000","last_became_peered":"2024-09-12T00:01:46.508144+0000","last_unstale":"2024-09-12T00:36:27.517783+0000","last_undegraded":"2024-09-12T00:36:27.517783+0000","last_fullsized":"2024-09-12T00:36:27.517783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:13.771631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045024799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.388920+0000","last_change":"2024-09-12T00:02:01.153487+0000","last_active":"2024-09-12T00:35:24.388920+0000","last_peered":"2024-09-12T00:35:24.388920+0000","last_clean":"2024-09-12T00:35:24.388920+0000","last_became_active":"2024-09-12T00:02:01.153207+0000","last_became_peered":"2024-09-12T00:02:01.153207+0000","last_unstale":"2024-09-12T00:35:24.388920+0000","last_undegraded":"2024-09-12T00:35:24.388920+0000","last_fullsized":"2024-09-12T00:35:24.388920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:46.459368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'107","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.666790+0000","last_change":"2024-09-12T00:02:03.151323+0000","last_active":"2024-09-12T00:36:24.666790+0000","last_peered":"2024-09-12T00:36:24.666790+0000","last_clean":"2024-09-12T00:36:24.666790+0000","last_became_active":"2024-09-12T00:02:03.151029+0000","last_became_peered":"2024-09-12T00:02:03.151029+0000","last_unstale":"2024-09-12T00:36:24.666790+0000","last_undegraded":"2024-09-12T00:36:24.666790+0000","last_fullsized":"2024-09-12T00:36:24.666790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:22.745763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":125,"num_read_kb":114,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'782","reported_seq":4559,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.130103+0000","last_change":"2024-09-12T00:02:05.164285+0000","last_active":"2024-09-12T00:38:37.130103+0000","last_peered":"2024-09-12T00:38:37.130103+0000","last_clean":"2024-09-12T00:38:37.130103+0000","last_became_active":"2024-09-12T00:02:05.162687+0000","last_became_peered":"2024-09-12T00:02:05.162687+0000","last_unstale":"2024-09-12T00:38:37.130103+0000","last_undegraded":"2024-09-12T00:38:37.130103+0000","last_fullsized":"2024-09-12T00:38:37.130103+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:19.706882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'155","reported_seq":657,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.251347+0000","last_change":"2024-09-12T00:02:07.166773+0000","last_active":"2024-09-12T00:37:02.251347+0000","last_peered":"2024-09-12T00:37:02.251347+0000","last_clean":"2024-09-12T00:37:02.251347+0000","last_became_active":"2024-09-12T00:02:07.166471+0000","last_became_peered":"2024-09-12T00:02:07.166471+0000","last_unstale":"2024-09-12T00:37:02.251347+0000","last_undegraded":"2024-09-12T00:37:02.251347+0000","last_fullsized":"2024-09-12T00:37:02.251347+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:15.572916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":126,"num_write":337,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'81","reported_seq":638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:51.799754+0000","last_change":"2024-09-12T00:01:59.157320+0000","last_active":"2024-09-12T00:36:51.799754+0000","last_peered":"2024-09-12T00:36:51.799754+0000","last_clean":"2024-09-12T00:36:51.799754+0000","last_became_active":"2024-09-12T00:01:59.157044+0000","last_became_peered":"2024-09-12T00:01:59.157044+0000","last_unstale":"2024-09-12T00:36:51.799754+0000","last_undegraded":"2024-09-12T00:36:51.799754+0000","last_fullsized":"2024-09-12T00:36:51.799754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:09.577038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":122,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'433","reported_seq":1067,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.305792+0000","last_change":"2024-09-12T00:01:57.134999+0000","last_active":"2024-09-12T00:38:38.305792+0000","last_peered":"2024-09-12T00:38:38.305792+0000","last_clean":"2024-09-12T00:38:38.305792+0000","last_became_active":"2024-09-12T00:01:57.134646+0000","last_became_peered":"2024-09-12T00:01:57.134646+0000","last_unstale":"2024-09-12T00:38:38.305792+0000","last_undegraded":"2024-09-12T00:38:38.305792+0000","last_fullsized":"2024-09-12T00:38:38.305792+0000","mapping_epoch":24,"log_start":"261'400","ondisk_log_start":"261'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:37.804939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":740,"num_read_kb":1717,"num_write":1248,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":511,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:29.397178+0000","last_change":"2024-09-12T00:01:48.515417+0000","last_active":"2024-09-12T00:36:29.397178+0000","last_peered":"2024-09-12T00:36:29.397178+0000","last_clean":"2024-09-12T00:36:29.397178+0000","last_became_active":"2024-09-12T00:01:46.502847+0000","last_became_peered":"2024-09-12T00:01:46.502847+0000","last_unstale":"2024-09-12T00:36:29.397178+0000","last_undegraded":"2024-09-12T00:36:29.397178+0000","last_fullsized":"2024-09-12T00:36:29.397178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:45.489723+0000","last_clean_scrub_stamp":"2024-09-12T00:01:45.489723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:49.727360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:07.515474+0000","last_change":"2024-09-12T00:02:01.152727+0000","last_active":"2024-09-12T00:36:07.515474+0000","last_peered":"2024-09-12T00:36:07.515474+0000","last_clean":"2024-09-12T00:36:07.515474+0000","last_became_active":"2024-09-12T00:02:01.152467+0000","last_became_peered":"2024-09-12T00:02:01.152467+0000","last_unstale":"2024-09-12T00:36:07.515474+0000","last_undegraded":"2024-09-12T00:36:07.515474+0000","last_fullsized":"2024-09-12T00:36:07.515474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:32.840264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'749","reported_seq":1462,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.725657+0000","last_change":"2024-09-12T00:02:03.151458+0000","last_active":"2024-09-12T00:38:37.725657+0000","last_peered":"2024-09-12T00:38:37.725657+0000","last_clean":"2024-09-12T00:38:37.725657+0000","last_became_active":"2024-09-12T00:02:03.151140+0000","last_became_peered":"2024-09-12T00:02:03.151140+0000","last_unstale":"2024-09-12T00:38:37.725657+0000","last_undegraded":"2024-09-12T00:38:37.725657+0000","last_fullsized":"2024-09-12T00:38:37.725657+0000","mapping_epoch":30,"log_start":"261'700","ondisk_log_start":"261'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:44.111850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136648,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1342,"num_read_kb":3221,"num_write":1108,"num_write_kb":930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:27.509341+0000","last_change":"2024-09-12T00:02:05.169087+0000","last_active":"2024-09-12T00:35:27.509341+0000","last_peered":"2024-09-12T00:35:27.509341+0000","last_clean":"2024-09-12T00:35:27.509341+0000","last_became_active":"2024-09-12T00:02:05.168419+0000","last_became_peered":"2024-09-12T00:02:05.168419+0000","last_unstale":"2024-09-12T00:35:27.509341+0000","last_undegraded":"2024-09-12T00:35:27.509341+0000","last_fullsized":"2024-09-12T00:35:27.509341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:37.208808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'139","reported_seq":629,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.772962+0000","last_change":"2024-09-12T00:02:07.170358+0000","last_active":"2024-09-12T00:37:10.772962+0000","last_peered":"2024-09-12T00:37:10.772962+0000","last_clean":"2024-09-12T00:37:10.772962+0000","last_became_active":"2024-09-12T00:02:07.169937+0000","last_became_peered":"2024-09-12T00:02:07.169937+0000","last_unstale":"2024-09-12T00:37:10.772962+0000","last_undegraded":"2024-09-12T00:37:10.772962+0000","last_fullsized":"2024-09-12T00:37:10.772962+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:08.055256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":184,"num_read_kb":169,"num_write":343,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'133","reported_seq":678,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.561260+0000","last_change":"2024-09-12T00:02:07.173368+0000","last_active":"2024-09-12T00:37:23.561260+0000","last_peered":"2024-09-12T00:37:23.561260+0000","last_clean":"2024-09-12T00:37:23.561260+0000","last_became_active":"2024-09-12T00:02:07.173094+0000","last_became_peered":"2024-09-12T00:02:07.173094+0000","last_unstale":"2024-09-12T00:37:23.561260+0000","last_undegraded":"2024-09-12T00:37:23.561260+0000","last_fullsized":"2024-09-12T00:37:23.561260+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:56.973946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":191,"num_read_kb":191,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'183","reported_seq":771,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:23.610776+0000","last_change":"2024-09-12T00:01:59.154754+0000","last_active":"2024-09-12T00:36:23.610776+0000","last_peered":"2024-09-12T00:36:23.610776+0000","last_clean":"2024-09-12T00:36:23.610776+0000","last_became_active":"2024-09-12T00:01:59.154463+0000","last_became_peered":"2024-09-12T00:01:59.154463+0000","last_unstale":"2024-09-12T00:36:23.610776+0000","last_undegraded":"2024-09-12T00:36:23.610776+0000","last_fullsized":"2024-09-12T00:36:23.610776+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:22.287932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":794,"num_read_kb":651,"num_write":258,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'344","reported_seq":980,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.344581+0000","last_change":"2024-09-12T00:01:57.164242+0000","last_active":"2024-09-12T00:38:38.344581+0000","last_peered":"2024-09-12T00:38:38.344581+0000","last_clean":"2024-09-12T00:38:38.344581+0000","last_became_active":"2024-09-12T00:01:57.163847+0000","last_became_peered":"2024-09-12T00:01:57.163847+0000","last_unstale":"2024-09-12T00:38:38.344581+0000","last_undegraded":"2024-09-12T00:38:38.344581+0000","last_fullsized":"2024-09-12T00:38:38.344581+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:14.319412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291524,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":515,"num_read_kb":27216,"num_write":1109,"num_write_kb":33935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.500143+0000","last_change":"2024-09-12T00:02:01.144933+0000","last_active":"2024-09-12T00:34:44.500143+0000","last_peered":"2024-09-12T00:34:44.500143+0000","last_clean":"2024-09-12T00:34:44.500143+0000","last_became_active":"2024-09-12T00:02:01.144579+0000","last_became_peered":"2024-09-12T00:02:01.144579+0000","last_unstale":"2024-09-12T00:34:44.500143+0000","last_undegraded":"2024-09-12T00:34:44.500143+0000","last_fullsized":"2024-09-12T00:34:44.500143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:13.618101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'296","reported_seq":856,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.195562+0000","last_change":"2024-09-12T00:02:03.155013+0000","last_active":"2024-09-12T00:38:38.195562+0000","last_peered":"2024-09-12T00:38:38.195562+0000","last_clean":"2024-09-12T00:38:38.195562+0000","last_became_active":"2024-09-12T00:02:03.154710+0000","last_became_peered":"2024-09-12T00:02:03.154710+0000","last_unstale":"2024-09-12T00:38:38.195562+0000","last_undegraded":"2024-09-12T00:38:38.195562+0000","last_fullsized":"2024-09-12T00:38:38.195562+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:23.714644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46247,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":469,"num_read_kb":1061,"num_write":388,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.500232+0000","last_change":"2024-09-12T00:02:05.163654+0000","last_active":"2024-09-12T00:34:44.500232+0000","last_peered":"2024-09-12T00:34:44.500232+0000","last_clean":"2024-09-12T00:34:44.500232+0000","last_became_active":"2024-09-12T00:02:05.163389+0000","last_became_peered":"2024-09-12T00:02:05.163389+0000","last_unstale":"2024-09-12T00:34:44.500232+0000","last_undegraded":"2024-09-12T00:34:44.500232+0000","last_fullsized":"2024-09-12T00:34:44.500232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:54.688629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'116","reported_seq":591,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.374469+0000","last_change":"2024-09-12T00:02:07.172652+0000","last_active":"2024-09-12T00:37:06.374469+0000","last_peered":"2024-09-12T00:37:06.374469+0000","last_clean":"2024-09-12T00:37:06.374469+0000","last_became_active":"2024-09-12T00:02:07.172360+0000","last_became_peered":"2024-09-12T00:02:07.172360+0000","last_unstale":"2024-09-12T00:37:06.374469+0000","last_undegraded":"2024-09-12T00:37:06.374469+0000","last_fullsized":"2024-09-12T00:37:06.374469+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:50.938865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'116","reported_seq":715,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:38.799905+0000","last_change":"2024-09-12T00:01:59.155610+0000","last_active":"2024-09-12T00:36:38.799905+0000","last_peered":"2024-09-12T00:36:38.799905+0000","last_clean":"2024-09-12T00:36:38.799905+0000","last_became_active":"2024-09-12T00:01:59.155287+0000","last_became_peered":"2024-09-12T00:01:59.155287+0000","last_unstale":"2024-09-12T00:36:38.799905+0000","last_undegraded":"2024-09-12T00:36:38.799905+0000","last_fullsized":"2024-09-12T00:36:38.799905+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:33.145869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":525,"num_read_kb":443,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'336","reported_seq":970,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.328257+0000","last_change":"2024-09-12T00:01:57.150227+0000","last_active":"2024-09-12T00:38:38.328257+0000","last_peered":"2024-09-12T00:38:38.328257+0000","last_clean":"2024-09-12T00:38:38.328257+0000","last_became_active":"2024-09-12T00:01:57.144743+0000","last_became_peered":"2024-09-12T00:01:57.144743+0000","last_unstale":"2024-09-12T00:38:38.328257+0000","last_undegraded":"2024-09-12T00:38:38.328257+0000","last_fullsized":"2024-09-12T00:38:38.328257+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:04.356175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":7939,"num_write":1030,"num_write_kb":13946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:42.502624+0000","last_change":"2024-09-12T00:02:01.151142+0000","last_active":"2024-09-12T00:34:42.502624+0000","last_peered":"2024-09-12T00:34:42.502624+0000","last_clean":"2024-09-12T00:34:42.502624+0000","last_became_active":"2024-09-12T00:02:01.150857+0000","last_became_peered":"2024-09-12T00:02:01.150857+0000","last_unstale":"2024-09-12T00:34:42.502624+0000","last_undegraded":"2024-09-12T00:34:42.502624+0000","last_fullsized":"2024-09-12T00:34:42.502624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:45.672680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'41","reported_seq":534,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:38.801722+0000","last_change":"2024-09-12T00:02:03.150541+0000","last_active":"2024-09-12T00:36:38.801722+0000","last_peered":"2024-09-12T00:36:38.801722+0000","last_clean":"2024-09-12T00:36:38.801722+0000","last_became_active":"2024-09-12T00:02:03.149558+0000","last_became_peered":"2024-09-12T00:02:03.149558+0000","last_unstale":"2024-09-12T00:36:38.801722+0000","last_undegraded":"2024-09-12T00:36:38.801722+0000","last_fullsized":"2024-09-12T00:36:38.801722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:42.429865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":469,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.617409+0000","last_change":"2024-09-12T00:02:05.171121+0000","last_active":"2024-09-12T00:34:44.617409+0000","last_peered":"2024-09-12T00:34:44.617409+0000","last_clean":"2024-09-12T00:34:44.617409+0000","last_became_active":"2024-09-12T00:02:05.170836+0000","last_became_peered":"2024-09-12T00:02:05.170836+0000","last_unstale":"2024-09-12T00:34:44.617409+0000","last_undegraded":"2024-09-12T00:34:44.617409+0000","last_fullsized":"2024-09-12T00:34:44.617409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:00.009417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'258","reported_seq":776,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.055886+0000","last_change":"2024-09-12T00:02:07.168954+0000","last_active":"2024-09-12T00:37:23.055886+0000","last_peered":"2024-09-12T00:37:23.055886+0000","last_clean":"2024-09-12T00:37:23.055886+0000","last_became_active":"2024-09-12T00:02:07.168678+0000","last_became_peered":"2024-09-12T00:02:07.168678+0000","last_unstale":"2024-09-12T00:37:23.055886+0000","last_undegraded":"2024-09-12T00:37:23.055886+0000","last_fullsized":"2024-09-12T00:37:23.055886+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:23.449987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":392,"num_read_kb":368,"num_write":602,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'4088","reported_seq":4638,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:42.502575+0000","last_change":"2024-09-12T00:01:59.154536+0000","last_active":"2024-09-12T00:34:42.502575+0000","last_peered":"2024-09-12T00:34:42.502575+0000","last_clean":"2024-09-12T00:34:42.502575+0000","last_became_active":"2024-09-12T00:01:59.154260+0000","last_became_peered":"2024-09-12T00:01:59.154260+0000","last_unstale":"2024-09-12T00:34:42.502575+0000","last_undegraded":"2024-09-12T00:34:42.502575+0000","last_fullsized":"2024-09-12T00:34:42.502575+0000","mapping_epoch":26,"log_start":"261'4000","ondisk_log_start":"261'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:35.639955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16394,"num_read_kb":13744,"num_write":6133,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'298","reported_seq":892,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.309038+0000","last_change":"2024-09-12T00:01:57.160338+0000","last_active":"2024-09-12T00:38:38.309038+0000","last_peered":"2024-09-12T00:38:38.309038+0000","last_clean":"2024-09-12T00:38:38.309038+0000","last_became_active":"2024-09-12T00:01:57.158677+0000","last_became_peered":"2024-09-12T00:01:57.158677+0000","last_unstale":"2024-09-12T00:38:38.309038+0000","last_undegraded":"2024-09-12T00:38:38.309038+0000","last_fullsized":"2024-09-12T00:38:38.309038+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:16.844146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174545,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":398,"num_read_kb":56505,"num_write":935,"num_write_kb":31346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.617371+0000","last_change":"2024-09-12T00:02:01.155814+0000","last_active":"2024-09-12T00:34:44.617371+0000","last_peered":"2024-09-12T00:34:44.617371+0000","last_clean":"2024-09-12T00:34:44.617371+0000","last_became_active":"2024-09-12T00:02:01.155490+0000","last_became_peered":"2024-09-12T00:02:01.155490+0000","last_unstale":"2024-09-12T00:34:44.617371+0000","last_undegraded":"2024-09-12T00:34:44.617371+0000","last_fullsized":"2024-09-12T00:34:44.617371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:27.105020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'284","reported_seq":851,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.371284+0000","last_change":"2024-09-12T00:02:03.149010+0000","last_active":"2024-09-12T00:38:37.371284+0000","last_peered":"2024-09-12T00:38:37.371284+0000","last_clean":"2024-09-12T00:38:37.371284+0000","last_became_active":"2024-09-12T00:02:03.148690+0000","last_became_peered":"2024-09-12T00:02:03.148690+0000","last_unstale":"2024-09-12T00:38:37.371284+0000","last_undegraded":"2024-09-12T00:38:37.371284+0000","last_fullsized":"2024-09-12T00:38:37.371284+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:39.130947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45068,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1019,"num_write":374,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:46.499667+0000","last_change":"2024-09-12T00:02:05.168740+0000","last_active":"2024-09-12T00:34:46.499667+0000","last_peered":"2024-09-12T00:34:46.499667+0000","last_clean":"2024-09-12T00:34:46.499667+0000","last_became_active":"2024-09-12T00:02:05.168232+0000","last_became_peered":"2024-09-12T00:02:05.168232+0000","last_unstale":"2024-09-12T00:34:46.499667+0000","last_undegraded":"2024-09-12T00:34:46.499667+0000","last_fullsized":"2024-09-12T00:34:46.499667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:43.713032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'134","reported_seq":667,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.879910+0000","last_change":"2024-09-12T00:02:07.169044+0000","last_active":"2024-09-12T00:36:58.879910+0000","last_peered":"2024-09-12T00:36:58.879910+0000","last_clean":"2024-09-12T00:36:58.879910+0000","last_became_active":"2024-09-12T00:02:07.168747+0000","last_became_peered":"2024-09-12T00:02:07.168747+0000","last_unstale":"2024-09-12T00:36:58.879910+0000","last_undegraded":"2024-09-12T00:36:58.879910+0000","last_fullsized":"2024-09-12T00:36:58.879910+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:23.448210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":291,"num_read_kb":255,"num_write":337,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'104","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.673042+0000","last_change":"2024-09-12T00:01:59.155125+0000","last_active":"2024-09-12T00:37:09.673042+0000","last_peered":"2024-09-12T00:37:09.673042+0000","last_clean":"2024-09-12T00:37:09.673042+0000","last_became_active":"2024-09-12T00:01:59.154848+0000","last_became_peered":"2024-09-12T00:01:59.154848+0000","last_unstale":"2024-09-12T00:37:09.673042+0000","last_undegraded":"2024-09-12T00:37:09.673042+0000","last_fullsized":"2024-09-12T00:37:09.673042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:47.132457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":392,"num_write":152,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'307","reported_seq":992,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.302299+0000","last_change":"2024-09-12T00:01:57.142768+0000","last_active":"2024-09-12T00:38:38.302299+0000","last_peered":"2024-09-12T00:38:38.302299+0000","last_clean":"2024-09-12T00:38:38.302299+0000","last_became_active":"2024-09-12T00:01:57.142385+0000","last_became_peered":"2024-09-12T00:01:57.142385+0000","last_unstale":"2024-09-12T00:38:38.302299+0000","last_undegraded":"2024-09-12T00:38:38.302299+0000","last_fullsized":"2024-09-12T00:38:38.302299+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:28.588091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267376,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":608,"num_read_kb":9162,"num_write":1027,"num_write_kb":16984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.383518+0000","last_change":"2024-09-12T00:02:01.154218+0000","last_active":"2024-09-12T00:34:44.383518+0000","last_peered":"2024-09-12T00:34:44.383518+0000","last_clean":"2024-09-12T00:34:44.383518+0000","last_became_active":"2024-09-12T00:02:01.153906+0000","last_became_peered":"2024-09-12T00:02:01.153906+0000","last_unstale":"2024-09-12T00:34:44.383518+0000","last_undegraded":"2024-09-12T00:34:44.383518+0000","last_fullsized":"2024-09-12T00:34:44.383518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:16.965088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'249","reported_seq":808,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.153839+0000","last_change":"2024-09-12T00:02:03.155251+0000","last_active":"2024-09-12T00:38:37.153839+0000","last_peered":"2024-09-12T00:38:37.153839+0000","last_clean":"2024-09-12T00:38:37.153839+0000","last_became_active":"2024-09-12T00:02:03.154896+0000","last_became_peered":"2024-09-12T00:02:03.154896+0000","last_unstale":"2024-09-12T00:38:37.153839+0000","last_undegraded":"2024-09-12T00:38:37.153839+0000","last_fullsized":"2024-09-12T00:38:37.153839+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:31.639970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":962,"num_write":334,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.500273+0000","last_change":"2024-09-12T00:02:05.162572+0000","last_active":"2024-09-12T00:34:44.500273+0000","last_peered":"2024-09-12T00:34:44.500273+0000","last_clean":"2024-09-12T00:34:44.500273+0000","last_became_active":"2024-09-12T00:02:05.162204+0000","last_became_peered":"2024-09-12T00:02:05.162204+0000","last_unstale":"2024-09-12T00:34:44.500273+0000","last_undegraded":"2024-09-12T00:34:44.500273+0000","last_fullsized":"2024-09-12T00:34:44.500273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:56.188492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'125","reported_seq":678,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:22.357033+0000","last_change":"2024-09-12T00:01:59.145758+0000","last_active":"2024-09-12T00:36:22.357033+0000","last_peered":"2024-09-12T00:36:22.357033+0000","last_clean":"2024-09-12T00:36:22.357033+0000","last_became_active":"2024-09-12T00:01:59.145456+0000","last_became_peered":"2024-09-12T00:01:59.145456+0000","last_unstale":"2024-09-12T00:36:22.357033+0000","last_undegraded":"2024-09-12T00:36:22.357033+0000","last_fullsized":"2024-09-12T00:36:22.357033+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:45.253029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":512,"num_read_kb":415,"num_write":196,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'379","reported_seq":1010,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.315228+0000","last_change":"2024-09-12T00:01:57.144156+0000","last_active":"2024-09-12T00:38:38.315228+0000","last_peered":"2024-09-12T00:38:38.315228+0000","last_clean":"2024-09-12T00:38:38.315228+0000","last_became_active":"2024-09-12T00:01:57.143684+0000","last_became_peered":"2024-09-12T00:01:57.143684+0000","last_unstale":"2024-09-12T00:38:38.315228+0000","last_undegraded":"2024-09-12T00:38:38.315228+0000","last_fullsized":"2024-09-12T00:38:38.315228+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:44.165024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":509,"num_read_kb":22065,"num_write":1209,"num_write_kb":32922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:09.512535+0000","last_change":"2024-09-12T00:02:01.154936+0000","last_active":"2024-09-12T00:36:09.512535+0000","last_peered":"2024-09-12T00:36:09.512535+0000","last_clean":"2024-09-12T00:36:09.512535+0000","last_became_active":"2024-09-12T00:02:01.154541+0000","last_became_peered":"2024-09-12T00:02:01.154541+0000","last_unstale":"2024-09-12T00:36:09.512535+0000","last_undegraded":"2024-09-12T00:36:09.512535+0000","last_fullsized":"2024-09-12T00:36:09.512535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:34.459769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'490","reported_seq":1106,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.079671+0000","last_change":"2024-09-12T00:02:03.158651+0000","last_active":"2024-09-12T00:38:37.079671+0000","last_peered":"2024-09-12T00:38:37.079671+0000","last_clean":"2024-09-12T00:38:37.079671+0000","last_became_active":"2024-09-12T00:02:03.158360+0000","last_became_peered":"2024-09-12T00:02:03.158360+0000","last_unstale":"2024-09-12T00:38:37.079671+0000","last_undegraded":"2024-09-12T00:38:37.079671+0000","last_fullsized":"2024-09-12T00:38:37.079671+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:44.063536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92045,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":891,"num_read_kb":2130,"num_write":768,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":468,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615861+0000","last_change":"2024-09-12T00:02:05.167419+0000","last_active":"2024-09-12T00:34:34.615861+0000","last_peered":"2024-09-12T00:34:34.615861+0000","last_clean":"2024-09-12T00:34:34.615861+0000","last_became_active":"2024-09-12T00:02:05.167052+0000","last_became_peered":"2024-09-12T00:02:05.167052+0000","last_unstale":"2024-09-12T00:34:34.615861+0000","last_undegraded":"2024-09-12T00:34:34.615861+0000","last_fullsized":"2024-09-12T00:34:34.615861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:41.679779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'206","reported_seq":704,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.939992+0000","last_change":"2024-09-12T00:02:07.167621+0000","last_active":"2024-09-12T00:37:22.939992+0000","last_peered":"2024-09-12T00:37:22.939992+0000","last_clean":"2024-09-12T00:37:22.939992+0000","last_became_active":"2024-09-12T00:02:07.167331+0000","last_became_peered":"2024-09-12T00:02:07.167331+0000","last_unstale":"2024-09-12T00:37:22.939992+0000","last_undegraded":"2024-09-12T00:37:22.939992+0000","last_fullsized":"2024-09-12T00:37:22.939992+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:21.029667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":483,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'398","reported_seq":1157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:57.885047+0000","last_change":"2024-09-12T00:01:59.150197+0000","last_active":"2024-09-12T00:36:57.885047+0000","last_peered":"2024-09-12T00:36:57.885047+0000","last_clean":"2024-09-12T00:36:57.885047+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:36:57.885047+0000","last_undegraded":"2024-09-12T00:36:57.885047+0000","last_fullsized":"2024-09-12T00:36:57.885047+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:47.950131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1910,"num_read_kb":1650,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'351","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.261518+0000","last_change":"2024-09-12T00:01:57.142382+0000","last_active":"2024-09-12T00:38:38.261518+0000","last_peered":"2024-09-12T00:38:38.261518+0000","last_clean":"2024-09-12T00:38:38.261518+0000","last_became_active":"2024-09-12T00:01:57.141998+0000","last_became_peered":"2024-09-12T00:01:57.141998+0000","last_unstale":"2024-09-12T00:38:38.261518+0000","last_undegraded":"2024-09-12T00:38:38.261518+0000","last_fullsized":"2024-09-12T00:38:38.261518+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:28.887996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":1840,"num_write":1203,"num_write_kb":17126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.623582+0000","last_change":"2024-09-12T00:02:01.153965+0000","last_active":"2024-09-12T00:35:24.623582+0000","last_peered":"2024-09-12T00:35:24.623582+0000","last_clean":"2024-09-12T00:35:24.623582+0000","last_became_active":"2024-09-12T00:02:01.153611+0000","last_became_peered":"2024-09-12T00:02:01.153611+0000","last_unstale":"2024-09-12T00:35:24.623582+0000","last_undegraded":"2024-09-12T00:35:24.623582+0000","last_fullsized":"2024-09-12T00:35:24.623582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:43.203100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'284","reported_seq":848,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.221785+0000","last_change":"2024-09-12T00:02:03.155107+0000","last_active":"2024-09-12T00:38:37.221785+0000","last_peered":"2024-09-12T00:38:37.221785+0000","last_clean":"2024-09-12T00:38:37.221785+0000","last_became_active":"2024-09-12T00:02:03.154821+0000","last_became_peered":"2024-09-12T00:02:03.154821+0000","last_unstale":"2024-09-12T00:38:37.221785+0000","last_undegraded":"2024-09-12T00:38:37.221785+0000","last_fullsized":"2024-09-12T00:38:37.221785+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:25.034969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49647,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":1013,"num_write":386,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":473,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499293+0000","last_change":"2024-09-12T00:02:05.170002+0000","last_active":"2024-09-12T00:34:34.499293+0000","last_peered":"2024-09-12T00:34:34.499293+0000","last_clean":"2024-09-12T00:34:34.499293+0000","last_became_active":"2024-09-12T00:02:05.169726+0000","last_became_peered":"2024-09-12T00:02:05.169726+0000","last_unstale":"2024-09-12T00:34:34.499293+0000","last_undegraded":"2024-09-12T00:34:34.499293+0000","last_fullsized":"2024-09-12T00:34:34.499293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:22.827175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'193","reported_seq":1061,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.503992+0000","last_change":"2024-09-12T00:02:07.175207+0000","last_active":"2024-09-12T00:37:22.503992+0000","last_peered":"2024-09-12T00:37:22.503992+0000","last_clean":"2024-09-12T00:37:22.503992+0000","last_became_active":"2024-09-12T00:02:07.174910+0000","last_became_peered":"2024-09-12T00:02:07.174910+0000","last_unstale":"2024-09-12T00:37:22.503992+0000","last_undegraded":"2024-09-12T00:37:22.503992+0000","last_fullsized":"2024-09-12T00:37:22.503992+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:19.459374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":668,"num_read_kb":649,"num_write":556,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'98","reported_seq":665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.598641+0000","last_change":"2024-09-12T00:01:59.151423+0000","last_active":"2024-09-12T00:37:02.598641+0000","last_peered":"2024-09-12T00:37:02.598641+0000","last_clean":"2024-09-12T00:37:02.598641+0000","last_became_active":"2024-09-12T00:01:59.151143+0000","last_became_peered":"2024-09-12T00:01:59.151143+0000","last_unstale":"2024-09-12T00:37:02.598641+0000","last_undegraded":"2024-09-12T00:37:02.598641+0000","last_fullsized":"2024-09-12T00:37:02.598641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:08.277331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":451,"num_read_kb":380,"num_write":139,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'298","reported_seq":886,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.262358+0000","last_change":"2024-09-12T00:01:57.142179+0000","last_active":"2024-09-12T00:38:38.262358+0000","last_peered":"2024-09-12T00:38:38.262358+0000","last_clean":"2024-09-12T00:38:38.262358+0000","last_became_active":"2024-09-12T00:01:57.141789+0000","last_became_peered":"2024-09-12T00:01:57.141789+0000","last_unstale":"2024-09-12T00:38:38.262358+0000","last_undegraded":"2024-09-12T00:38:38.262358+0000","last_fullsized":"2024-09-12T00:38:38.262358+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:44.370591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":381,"num_read_kb":31078,"num_write":882,"num_write_kb":48318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615850+0000","last_change":"2024-09-12T00:02:01.154963+0000","last_active":"2024-09-12T00:34:34.615850+0000","last_peered":"2024-09-12T00:34:34.615850+0000","last_clean":"2024-09-12T00:34:34.615850+0000","last_became_active":"2024-09-12T00:02:01.154530+0000","last_became_peered":"2024-09-12T00:02:01.154530+0000","last_unstale":"2024-09-12T00:34:34.615850+0000","last_undegraded":"2024-09-12T00:34:34.615850+0000","last_fullsized":"2024-09-12T00:34:34.615850+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:06.651100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'288","reported_seq":850,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.090315+0000","last_change":"2024-09-12T00:02:03.156889+0000","last_active":"2024-09-12T00:38:36.090315+0000","last_peered":"2024-09-12T00:38:36.090315+0000","last_clean":"2024-09-12T00:38:36.090315+0000","last_became_active":"2024-09-12T00:02:03.156529+0000","last_became_peered":"2024-09-12T00:02:03.156529+0000","last_unstale":"2024-09-12T00:38:36.090315+0000","last_undegraded":"2024-09-12T00:38:36.090315+0000","last_fullsized":"2024-09-12T00:38:36.090315+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:52.310627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53504,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":1158,"num_write":402,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":473,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:09.512584+0000","last_change":"2024-09-12T00:02:05.164244+0000","last_active":"2024-09-12T00:36:09.512584+0000","last_peered":"2024-09-12T00:36:09.512584+0000","last_clean":"2024-09-12T00:36:09.512584+0000","last_became_active":"2024-09-12T00:02:05.163956+0000","last_became_peered":"2024-09-12T00:02:05.163956+0000","last_unstale":"2024-09-12T00:36:09.512584+0000","last_undegraded":"2024-09-12T00:36:09.512584+0000","last_fullsized":"2024-09-12T00:36:09.512584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:58.031555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'127","reported_seq":603,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.940297+0000","last_change":"2024-09-12T00:02:07.172798+0000","last_active":"2024-09-12T00:38:28.940297+0000","last_peered":"2024-09-12T00:38:28.940297+0000","last_clean":"2024-09-12T00:38:28.940297+0000","last_became_active":"2024-09-12T00:02:07.172496+0000","last_became_peered":"2024-09-12T00:02:07.172496+0000","last_unstale":"2024-09-12T00:38:28.940297+0000","last_undegraded":"2024-09-12T00:38:28.940297+0000","last_fullsized":"2024-09-12T00:38:28.940297+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:11.813869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":307,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'198","reported_seq":828,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:13.741103+0000","last_change":"2024-09-12T00:01:59.149165+0000","last_active":"2024-09-12T00:36:13.741103+0000","last_peered":"2024-09-12T00:36:13.741103+0000","last_clean":"2024-09-12T00:36:13.741103+0000","last_became_active":"2024-09-12T00:01:59.148559+0000","last_became_peered":"2024-09-12T00:01:59.148559+0000","last_unstale":"2024-09-12T00:36:13.741103+0000","last_undegraded":"2024-09-12T00:36:13.741103+0000","last_fullsized":"2024-09-12T00:36:13.741103+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:56.810526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":733,"num_write":278,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'382","reported_seq":1030,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.338557+0000","last_change":"2024-09-12T00:01:57.145004+0000","last_active":"2024-09-12T00:38:38.338557+0000","last_peered":"2024-09-12T00:38:38.338557+0000","last_clean":"2024-09-12T00:38:38.338557+0000","last_became_active":"2024-09-12T00:01:57.144397+0000","last_became_peered":"2024-09-12T00:01:57.144397+0000","last_unstale":"2024-09-12T00:38:38.338557+0000","last_undegraded":"2024-09-12T00:38:38.338557+0000","last_fullsized":"2024-09-12T00:38:38.338557+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:00.869585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":577,"num_read_kb":18157,"num_write":1228,"num_write_kb":40983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'5","reported_seq":968,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.454747+0000","last_change":"2024-09-12T00:02:01.152013+0000","last_active":"2024-09-12T00:38:35.454747+0000","last_peered":"2024-09-12T00:38:35.454747+0000","last_clean":"2024-09-12T00:38:35.454747+0000","last_became_active":"2024-09-12T00:02:01.151739+0000","last_became_peered":"2024-09-12T00:02:01.151739+0000","last_unstale":"2024-09-12T00:38:35.454747+0000","last_undegraded":"2024-09-12T00:38:35.454747+0000","last_fullsized":"2024-09-12T00:38:35.454747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:45.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'84","reported_seq":593,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.062825+0000","last_change":"2024-09-12T00:02:03.154234+0000","last_active":"2024-09-12T00:37:23.062825+0000","last_peered":"2024-09-12T00:37:23.062825+0000","last_clean":"2024-09-12T00:37:23.062825+0000","last_became_active":"2024-09-12T00:02:03.153948+0000","last_became_peered":"2024-09-12T00:02:03.153948+0000","last_unstale":"2024-09-12T00:37:23.062825+0000","last_undegraded":"2024-09-12T00:37:23.062825+0000","last_fullsized":"2024-09-12T00:37:23.062825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:26.035209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":128,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'765","reported_seq":4280,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.671492+0000","last_change":"2024-09-12T00:02:05.170722+0000","last_active":"2024-09-12T00:38:37.671492+0000","last_peered":"2024-09-12T00:38:37.671492+0000","last_clean":"2024-09-12T00:38:37.671492+0000","last_became_active":"2024-09-12T00:02:05.170399+0000","last_became_peered":"2024-09-12T00:02:05.170399+0000","last_unstale":"2024-09-12T00:38:37.671492+0000","last_undegraded":"2024-09-12T00:38:37.671492+0000","last_fullsized":"2024-09-12T00:38:37.671492+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:06.211117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'118","reported_seq":604,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.949325+0000","last_change":"2024-09-12T00:02:07.173296+0000","last_active":"2024-09-12T00:37:06.949325+0000","last_peered":"2024-09-12T00:37:06.949325+0000","last_clean":"2024-09-12T00:37:06.949325+0000","last_became_active":"2024-09-12T00:02:07.173030+0000","last_became_peered":"2024-09-12T00:02:07.173030+0000","last_unstale":"2024-09-12T00:37:06.949325+0000","last_undegraded":"2024-09-12T00:37:06.949325+0000","last_fullsized":"2024-09-12T00:37:06.949325+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:13.276457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":288,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'244","reported_seq":873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.077246+0000","last_change":"2024-09-12T00:01:59.152008+0000","last_active":"2024-09-12T00:36:50.077246+0000","last_peered":"2024-09-12T00:36:50.077246+0000","last_clean":"2024-09-12T00:36:50.077246+0000","last_became_active":"2024-09-12T00:01:59.151743+0000","last_became_peered":"2024-09-12T00:01:59.151743+0000","last_unstale":"2024-09-12T00:36:50.077246+0000","last_undegraded":"2024-09-12T00:36:50.077246+0000","last_fullsized":"2024-09-12T00:36:50.077246+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:35.993592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1082,"num_read_kb":884,"num_write":389,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'313","reported_seq":910,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.298362+0000","last_change":"2024-09-12T00:01:57.145465+0000","last_active":"2024-09-12T00:38:38.298362+0000","last_peered":"2024-09-12T00:38:38.298362+0000","last_clean":"2024-09-12T00:38:38.298362+0000","last_became_active":"2024-09-12T00:01:57.144946+0000","last_became_peered":"2024-09-12T00:01:57.144946+0000","last_unstale":"2024-09-12T00:38:38.298362+0000","last_undegraded":"2024-09-12T00:38:38.298362+0000","last_fullsized":"2024-09-12T00:38:38.298362+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:23.104871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":419,"num_read_kb":503,"num_write":968,"num_write_kb":20369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:31.497576+0000","last_change":"2024-09-12T00:02:01.152803+0000","last_active":"2024-09-12T00:34:31.497576+0000","last_peered":"2024-09-12T00:34:31.497576+0000","last_clean":"2024-09-12T00:34:31.497576+0000","last_became_active":"2024-09-12T00:02:01.152493+0000","last_became_peered":"2024-09-12T00:02:01.152493+0000","last_unstale":"2024-09-12T00:34:31.497576+0000","last_undegraded":"2024-09-12T00:34:31.497576+0000","last_fullsized":"2024-09-12T00:34:31.497576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:39.421026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'313","reported_seq":908,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.540809+0000","last_change":"2024-09-12T00:02:03.150973+0000","last_active":"2024-09-12T00:38:36.540809+0000","last_peered":"2024-09-12T00:38:36.540809+0000","last_clean":"2024-09-12T00:38:36.540809+0000","last_became_active":"2024-09-12T00:02:03.150631+0000","last_became_peered":"2024-09-12T00:02:03.150631+0000","last_unstale":"2024-09-12T00:38:36.540809+0000","last_undegraded":"2024-09-12T00:38:36.540809+0000","last_fullsized":"2024-09-12T00:38:36.540809+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:17.364587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68885,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":513,"num_read_kb":1151,"num_write":412,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.513886+0000","last_change":"2024-09-12T00:02:05.167377+0000","last_active":"2024-09-12T00:35:57.513886+0000","last_peered":"2024-09-12T00:35:57.513886+0000","last_clean":"2024-09-12T00:35:57.513886+0000","last_became_active":"2024-09-12T00:02:05.167082+0000","last_became_peered":"2024-09-12T00:02:05.167082+0000","last_unstale":"2024-09-12T00:35:57.513886+0000","last_undegraded":"2024-09-12T00:35:57.513886+0000","last_fullsized":"2024-09-12T00:35:57.513886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:04.610051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'123","reported_seq":614,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.557143+0000","last_change":"2024-09-12T00:02:07.173111+0000","last_active":"2024-09-12T00:38:27.557143+0000","last_peered":"2024-09-12T00:38:27.557143+0000","last_clean":"2024-09-12T00:38:27.557143+0000","last_became_active":"2024-09-12T00:02:07.172810+0000","last_became_peered":"2024-09-12T00:02:07.172810+0000","last_unstale":"2024-09-12T00:38:27.557143+0000","last_undegraded":"2024-09-12T00:38:27.557143+0000","last_fullsized":"2024-09-12T00:38:27.557143+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:47.728676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":135,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'223","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:25.779475+0000","last_change":"2024-09-12T00:01:59.147668+0000","last_active":"2024-09-12T00:36:25.779475+0000","last_peered":"2024-09-12T00:36:25.779475+0000","last_clean":"2024-09-12T00:36:25.779475+0000","last_became_active":"2024-09-12T00:01:59.147373+0000","last_became_peered":"2024-09-12T00:01:59.147373+0000","last_unstale":"2024-09-12T00:36:25.779475+0000","last_undegraded":"2024-09-12T00:36:25.779475+0000","last_fullsized":"2024-09-12T00:36:25.779475+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:21.257179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1007,"num_read_kb":830,"num_write":359,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'297","reported_seq":892,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.350802+0000","last_change":"2024-09-12T00:01:57.161842+0000","last_active":"2024-09-12T00:38:38.350802+0000","last_peered":"2024-09-12T00:38:38.350802+0000","last_clean":"2024-09-12T00:38:38.350802+0000","last_became_active":"2024-09-12T00:01:57.161414+0000","last_became_peered":"2024-09-12T00:01:57.161414+0000","last_unstale":"2024-09-12T00:38:38.350802+0000","last_undegraded":"2024-09-12T00:38:38.350802+0000","last_fullsized":"2024-09-12T00:38:38.350802+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:03.307762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174757,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":380,"num_read_kb":8089,"num_write":919,"num_write_kb":31185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615825+0000","last_change":"2024-09-12T00:02:01.152071+0000","last_active":"2024-09-12T00:34:34.615825+0000","last_peered":"2024-09-12T00:34:34.615825+0000","last_clean":"2024-09-12T00:34:34.615825+0000","last_became_active":"2024-09-12T00:02:01.151760+0000","last_became_peered":"2024-09-12T00:02:01.151760+0000","last_unstale":"2024-09-12T00:34:34.615825+0000","last_undegraded":"2024-09-12T00:34:34.615825+0000","last_fullsized":"2024-09-12T00:34:34.615825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:08.986013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'276","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.624371+0000","last_change":"2024-09-12T00:02:03.151005+0000","last_active":"2024-09-12T00:38:36.624371+0000","last_peered":"2024-09-12T00:38:36.624371+0000","last_clean":"2024-09-12T00:38:36.624371+0000","last_became_active":"2024-09-12T00:02:03.150714+0000","last_became_peered":"2024-09-12T00:02:03.150714+0000","last_unstale":"2024-09-12T00:38:36.624371+0000","last_undegraded":"2024-09-12T00:38:36.624371+0000","last_fullsized":"2024-09-12T00:38:36.624371+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:39.492995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52913,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1134,"num_write":392,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.393761+0000","last_change":"2024-09-12T00:02:05.171377+0000","last_active":"2024-09-12T00:35:59.393761+0000","last_peered":"2024-09-12T00:35:59.393761+0000","last_clean":"2024-09-12T00:35:59.393761+0000","last_became_active":"2024-09-12T00:02:05.170973+0000","last_became_peered":"2024-09-12T00:02:05.170973+0000","last_unstale":"2024-09-12T00:35:59.393761+0000","last_undegraded":"2024-09-12T00:35:59.393761+0000","last_fullsized":"2024-09-12T00:35:59.393761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:14.690020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'119","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:11.054534+0000","last_change":"2024-09-12T00:02:07.169559+0000","last_active":"2024-09-12T00:37:11.054534+0000","last_peered":"2024-09-12T00:37:11.054534+0000","last_clean":"2024-09-12T00:37:11.054534+0000","last_became_active":"2024-09-12T00:02:07.169266+0000","last_became_peered":"2024-09-12T00:02:07.169266+0000","last_unstale":"2024-09-12T00:37:11.054534+0000","last_undegraded":"2024-09-12T00:37:11.054534+0000","last_fullsized":"2024-09-12T00:37:11.054534+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:08.775255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":294,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'183","reported_seq":777,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:00.677198+0000","last_change":"2024-09-12T00:01:59.150196+0000","last_active":"2024-09-12T00:37:00.677198+0000","last_peered":"2024-09-12T00:37:00.677198+0000","last_clean":"2024-09-12T00:37:00.677198+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:37:00.677198+0000","last_undegraded":"2024-09-12T00:37:00.677198+0000","last_fullsized":"2024-09-12T00:37:00.677198+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:58.771289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":689,"num_write":284,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'446","reported_seq":1161,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.268366+0000","last_change":"2024-09-12T00:01:57.162027+0000","last_active":"2024-09-12T00:38:38.268366+0000","last_peered":"2024-09-12T00:38:38.268366+0000","last_clean":"2024-09-12T00:38:38.268366+0000","last_became_active":"2024-09-12T00:01:57.161612+0000","last_became_peered":"2024-09-12T00:01:57.161612+0000","last_unstale":"2024-09-12T00:38:38.268366+0000","last_undegraded":"2024-09-12T00:38:38.268366+0000","last_fullsized":"2024-09-12T00:38:38.268366+0000","mapping_epoch":24,"log_start":"261'400","ondisk_log_start":"261'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:46.162850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":772,"num_read_kb":15126,"num_write":1508,"num_write_kb":40840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:51.509280+0000","last_change":"2024-09-12T00:02:01.145374+0000","last_active":"2024-09-12T00:35:51.509280+0000","last_peered":"2024-09-12T00:35:51.509280+0000","last_clean":"2024-09-12T00:35:51.509280+0000","last_became_active":"2024-09-12T00:02:01.144558+0000","last_became_peered":"2024-09-12T00:02:01.144558+0000","last_unstale":"2024-09-12T00:35:51.509280+0000","last_undegraded":"2024-09-12T00:35:51.509280+0000","last_fullsized":"2024-09-12T00:35:51.509280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:59.388355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'263","reported_seq":810,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.358146+0000","last_change":"2024-09-12T00:02:03.154789+0000","last_active":"2024-09-12T00:38:38.358146+0000","last_peered":"2024-09-12T00:38:38.358146+0000","last_clean":"2024-09-12T00:38:38.358146+0000","last_became_active":"2024-09-12T00:02:03.154477+0000","last_became_peered":"2024-09-12T00:02:03.154477+0000","last_unstale":"2024-09-12T00:38:38.358146+0000","last_undegraded":"2024-09-12T00:38:38.358146+0000","last_fullsized":"2024-09-12T00:38:38.358146+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:25.591233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47465,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":439,"num_read_kb":1086,"num_write":366,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.382052+0000","last_change":"2024-09-12T00:02:05.166486+0000","last_active":"2024-09-12T00:34:34.382052+0000","last_peered":"2024-09-12T00:34:34.382052+0000","last_clean":"2024-09-12T00:34:34.382052+0000","last_became_active":"2024-09-12T00:02:05.166141+0000","last_became_peered":"2024-09-12T00:02:05.166141+0000","last_unstale":"2024-09-12T00:34:34.382052+0000","last_undegraded":"2024-09-12T00:34:34.382052+0000","last_fullsized":"2024-09-12T00:34:34.382052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:12.751964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'186","reported_seq":1324,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.932224+0000","last_change":"2024-09-12T00:02:07.170137+0000","last_active":"2024-09-12T00:37:21.932224+0000","last_peered":"2024-09-12T00:37:21.932224+0000","last_clean":"2024-09-12T00:37:21.932224+0000","last_became_active":"2024-09-12T00:02:07.169812+0000","last_became_peered":"2024-09-12T00:02:07.169812+0000","last_unstale":"2024-09-12T00:37:21.932224+0000","last_undegraded":"2024-09-12T00:37:21.932224+0000","last_fullsized":"2024-09-12T00:37:21.932224+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:18.008023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1006,"num_read_kb":951,"num_write":452,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'117","reported_seq":665,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.914183+0000","last_change":"2024-09-12T00:01:59.148574+0000","last_active":"2024-09-12T00:37:08.914183+0000","last_peered":"2024-09-12T00:37:08.914183+0000","last_clean":"2024-09-12T00:37:08.914183+0000","last_became_active":"2024-09-12T00:01:59.148253+0000","last_became_peered":"2024-09-12T00:01:59.148253+0000","last_unstale":"2024-09-12T00:37:08.914183+0000","last_undegraded":"2024-09-12T00:37:08.914183+0000","last_fullsized":"2024-09-12T00:37:08.914183+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:57.621477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":405,"num_write":165,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'378","reported_seq":1040,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.324783+0000","last_change":"2024-09-12T00:01:57.138855+0000","last_active":"2024-09-12T00:38:38.324783+0000","last_peered":"2024-09-12T00:38:38.324783+0000","last_clean":"2024-09-12T00:38:38.324783+0000","last_became_active":"2024-09-12T00:01:57.138386+0000","last_became_peered":"2024-09-12T00:01:57.138386+0000","last_unstale":"2024-09-12T00:38:38.324783+0000","last_undegraded":"2024-09-12T00:38:38.324783+0000","last_fullsized":"2024-09-12T00:38:38.324783+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:56.658569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":660,"num_read_kb":37451,"num_write":1183,"num_write_kb":32715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.513932+0000","last_change":"2024-09-12T00:02:01.153600+0000","last_active":"2024-09-12T00:35:57.513932+0000","last_peered":"2024-09-12T00:35:57.513932+0000","last_clean":"2024-09-12T00:35:57.513932+0000","last_became_active":"2024-09-12T00:02:01.153306+0000","last_became_peered":"2024-09-12T00:02:01.153306+0000","last_unstale":"2024-09-12T00:35:57.513932+0000","last_undegraded":"2024-09-12T00:35:57.513932+0000","last_fullsized":"2024-09-12T00:35:57.513932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:16.790631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'285","reported_seq":865,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.164155+0000","last_change":"2024-09-12T00:02:03.158753+0000","last_active":"2024-09-12T00:38:36.164155+0000","last_peered":"2024-09-12T00:38:36.164155+0000","last_clean":"2024-09-12T00:38:36.164155+0000","last_became_active":"2024-09-12T00:02:03.158379+0000","last_became_peered":"2024-09-12T00:02:03.158379+0000","last_unstale":"2024-09-12T00:38:36.164155+0000","last_undegraded":"2024-09-12T00:38:36.164155+0000","last_fullsized":"2024-09-12T00:38:36.164155+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:08.601813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53226,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":1058,"num_write":380,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:37.502005+0000","last_change":"2024-09-12T00:02:05.160180+0000","last_active":"2024-09-12T00:34:37.502005+0000","last_peered":"2024-09-12T00:34:37.502005+0000","last_clean":"2024-09-12T00:34:37.502005+0000","last_became_active":"2024-09-12T00:02:05.159854+0000","last_became_peered":"2024-09-12T00:02:05.159854+0000","last_unstale":"2024-09-12T00:34:37.502005+0000","last_undegraded":"2024-09-12T00:34:37.502005+0000","last_fullsized":"2024-09-12T00:34:37.502005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.989519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'131","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.590853+0000","last_change":"2024-09-12T00:02:07.171050+0000","last_active":"2024-09-12T00:38:27.590853+0000","last_peered":"2024-09-12T00:38:27.590853+0000","last_clean":"2024-09-12T00:38:27.590853+0000","last_became_active":"2024-09-12T00:02:07.170727+0000","last_became_peered":"2024-09-12T00:02:07.170727+0000","last_unstale":"2024-09-12T00:38:27.590853+0000","last_undegraded":"2024-09-12T00:38:27.590853+0000","last_fullsized":"2024-09-12T00:38:27.590853+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:03.358486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":129,"num_write":315,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'247","reported_seq":907,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:49.863461+0000","last_change":"2024-09-12T00:01:59.145783+0000","last_active":"2024-09-12T00:36:49.863461+0000","last_peered":"2024-09-12T00:36:49.863461+0000","last_clean":"2024-09-12T00:36:49.863461+0000","last_became_active":"2024-09-12T00:01:59.145502+0000","last_became_peered":"2024-09-12T00:01:59.145502+0000","last_unstale":"2024-09-12T00:36:49.863461+0000","last_undegraded":"2024-09-12T00:36:49.863461+0000","last_fullsized":"2024-09-12T00:36:49.863461+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:15.171878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1128,"num_read_kb":927,"num_write":363,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'365","reported_seq":1017,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.063943+0000","last_change":"2024-09-12T00:01:57.159976+0000","last_active":"2024-09-12T00:38:38.063943+0000","last_peered":"2024-09-12T00:38:38.063943+0000","last_clean":"2024-09-12T00:38:38.063943+0000","last_became_active":"2024-09-12T00:01:57.159487+0000","last_became_peered":"2024-09-12T00:01:57.159487+0000","last_unstale":"2024-09-12T00:38:38.063943+0000","last_undegraded":"2024-09-12T00:38:38.063943+0000","last_fullsized":"2024-09-12T00:38:38.063943+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:30.085074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":54883,"num_write":1141,"num_write_kb":38301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'150","reported_seq":696,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.498309+0000","last_change":"2024-09-12T00:01:59.153656+0000","last_active":"2024-09-12T00:34:29.498309+0000","last_peered":"2024-09-12T00:34:29.498309+0000","last_clean":"2024-09-12T00:34:29.498309+0000","last_became_active":"2024-09-12T00:01:59.153340+0000","last_became_peered":"2024-09-12T00:01:59.153340+0000","last_unstale":"2024-09-12T00:34:29.498309+0000","last_undegraded":"2024-09-12T00:34:29.498309+0000","last_fullsized":"2024-09-12T00:34:29.498309+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:17.663369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":542,"num_write":243,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'317","reported_seq":1038,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.236348+0000","last_change":"2024-09-12T00:01:57.152880+0000","last_active":"2024-09-12T00:38:38.236348+0000","last_peered":"2024-09-12T00:38:38.236348+0000","last_clean":"2024-09-12T00:38:38.236348+0000","last_became_active":"2024-09-12T00:01:57.152522+0000","last_became_peered":"2024-09-12T00:01:57.152522+0000","last_unstale":"2024-09-12T00:38:38.236348+0000","last_undegraded":"2024-09-12T00:38:38.236348+0000","last_fullsized":"2024-09-12T00:38:38.236348+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:20.467716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":990709,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":567,"num_read_kb":16299,"num_write":1038,"num_write_kb":36902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'216","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:10.173233+0000","last_change":"2024-09-12T00:01:59.146252+0000","last_active":"2024-09-12T00:38:10.173233+0000","last_peered":"2024-09-12T00:38:10.173233+0000","last_clean":"2024-09-12T00:38:10.173233+0000","last_became_active":"2024-09-12T00:01:59.145971+0000","last_became_peered":"2024-09-12T00:01:59.145971+0000","last_unstale":"2024-09-12T00:38:10.173233+0000","last_undegraded":"2024-09-12T00:38:10.173233+0000","last_fullsized":"2024-09-12T00:38:10.173233+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:57.400027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":962,"num_read_kb":786,"num_write":321,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'356","reported_seq":966,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.320891+0000","last_change":"2024-09-12T00:01:57.168090+0000","last_active":"2024-09-12T00:38:38.320891+0000","last_peered":"2024-09-12T00:38:38.320891+0000","last_clean":"2024-09-12T00:38:38.320891+0000","last_became_active":"2024-09-12T00:01:57.167651+0000","last_became_peered":"2024-09-12T00:01:57.167651+0000","last_unstale":"2024-09-12T00:38:38.320891+0000","last_undegraded":"2024-09-12T00:38:38.320891+0000","last_fullsized":"2024-09-12T00:38:38.320891+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:47.430232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":490,"num_read_kb":6602,"num_write":1155,"num_write_kb":24145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'167","reported_seq":749,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.289614+0000","last_change":"2024-09-12T00:01:59.147316+0000","last_active":"2024-09-12T00:37:09.289614+0000","last_peered":"2024-09-12T00:37:09.289614+0000","last_clean":"2024-09-12T00:37:09.289614+0000","last_became_active":"2024-09-12T00:01:59.146794+0000","last_became_peered":"2024-09-12T00:01:59.146794+0000","last_unstale":"2024-09-12T00:37:09.289614+0000","last_undegraded":"2024-09-12T00:37:09.289614+0000","last_fullsized":"2024-09-12T00:37:09.289614+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:19.361635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":586,"num_write":261,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'291","reported_seq":897,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.156532+0000","last_change":"2024-09-12T00:01:57.145828+0000","last_active":"2024-09-12T00:38:38.156532+0000","last_peered":"2024-09-12T00:38:38.156532+0000","last_clean":"2024-09-12T00:38:38.156532+0000","last_became_active":"2024-09-12T00:01:57.145410+0000","last_became_peered":"2024-09-12T00:01:57.145410+0000","last_unstale":"2024-09-12T00:38:38.156532+0000","last_undegraded":"2024-09-12T00:38:38.156532+0000","last_fullsized":"2024-09-12T00:38:38.156532+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:43.346735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":406,"num_read_kb":533,"num_write":954,"num_write_kb":14360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'571","reported_seq":1333,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.455576+0000","last_change":"2024-09-12T00:01:59.149108+0000","last_active":"2024-09-12T00:37:23.455576+0000","last_peered":"2024-09-12T00:37:23.455576+0000","last_clean":"2024-09-12T00:37:23.455576+0000","last_became_active":"2024-09-12T00:01:59.148605+0000","last_became_peered":"2024-09-12T00:01:59.148605+0000","last_unstale":"2024-09-12T00:37:23.455576+0000","last_undegraded":"2024-09-12T00:37:23.455576+0000","last_fullsized":"2024-09-12T00:37:23.455576+0000","mapping_epoch":26,"log_start":"261'500","ondisk_log_start":"261'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:43.891160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2664,"num_read_kb":2197,"num_write":993,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'328","reported_seq":970,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.223768+0000","last_change":"2024-09-12T00:02:32.865371+0000","last_active":"2024-09-12T00:38:38.223768+0000","last_peered":"2024-09-12T00:38:38.223768+0000","last_clean":"2024-09-12T00:38:38.223768+0000","last_became_active":"2024-09-12T00:02:32.864862+0000","last_became_peered":"2024-09-12T00:02:32.864862+0000","last_unstale":"2024-09-12T00:38:38.223768+0000","last_undegraded":"2024-09-12T00:38:38.223768+0000","last_fullsized":"2024-09-12T00:38:38.223768+0000","mapping_epoch":37,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:46.058961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":496,"num_read_kb":62973,"num_write":1092,"num_write_kb":36662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7,3],"acting":[6,0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'192","reported_seq":809,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:28.041132+0000","last_change":"2024-09-12T00:01:59.141664+0000","last_active":"2024-09-12T00:36:28.041132+0000","last_peered":"2024-09-12T00:36:28.041132+0000","last_clean":"2024-09-12T00:36:28.041132+0000","last_became_active":"2024-09-12T00:01:59.141383+0000","last_became_peered":"2024-09-12T00:01:59.141383+0000","last_unstale":"2024-09-12T00:36:28.041132+0000","last_undegraded":"2024-09-12T00:36:28.041132+0000","last_fullsized":"2024-09-12T00:36:28.041132+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:49.143020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":715,"num_write":298,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'342","reported_seq":996,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.239883+0000","last_change":"2024-09-12T00:01:57.152496+0000","last_active":"2024-09-12T00:38:38.239883+0000","last_peered":"2024-09-12T00:38:38.239883+0000","last_clean":"2024-09-12T00:38:38.239883+0000","last_became_active":"2024-09-12T00:01:57.152097+0000","last_became_peered":"2024-09-12T00:01:57.152097+0000","last_unstale":"2024-09-12T00:38:38.239883+0000","last_undegraded":"2024-09-12T00:38:38.239883+0000","last_fullsized":"2024-09-12T00:38:38.239883+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:44.525600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399285,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":523,"num_read_kb":43886,"num_write":1080,"num_write_kb":36840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'430","reported_seq":1145,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:19.505287+0000","last_change":"2024-09-12T00:01:59.146420+0000","last_active":"2024-09-12T00:35:19.505287+0000","last_peered":"2024-09-12T00:35:19.505287+0000","last_clean":"2024-09-12T00:35:19.505287+0000","last_became_active":"2024-09-12T00:01:59.146117+0000","last_became_peered":"2024-09-12T00:01:59.146117+0000","last_unstale":"2024-09-12T00:35:19.505287+0000","last_undegraded":"2024-09-12T00:35:19.505287+0000","last_fullsized":"2024-09-12T00:35:19.505287+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:14.193284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2179,"num_read_kb":1868,"num_write":729,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'382","reported_seq":1072,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.268580+0000","last_change":"2024-09-12T00:01:57.156353+0000","last_active":"2024-09-12T00:38:38.268580+0000","last_peered":"2024-09-12T00:38:38.268580+0000","last_clean":"2024-09-12T00:38:38.268580+0000","last_became_active":"2024-09-12T00:01:57.156002+0000","last_became_peered":"2024-09-12T00:01:57.156002+0000","last_unstale":"2024-09-12T00:38:38.268580+0000","last_undegraded":"2024-09-12T00:38:38.268580+0000","last_fullsized":"2024-09-12T00:38:38.268580+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:26.168398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":675,"num_read_kb":79699,"num_write":1346,"num_write_kb":54312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'216","reported_seq":795,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.099261+0000","last_change":"2024-09-12T00:01:59.155738+0000","last_active":"2024-09-12T00:37:10.099261+0000","last_peered":"2024-09-12T00:37:10.099261+0000","last_clean":"2024-09-12T00:37:10.099261+0000","last_became_active":"2024-09-12T00:01:59.155003+0000","last_became_peered":"2024-09-12T00:01:59.155003+0000","last_unstale":"2024-09-12T00:37:10.099261+0000","last_undegraded":"2024-09-12T00:37:10.099261+0000","last_fullsized":"2024-09-12T00:37:10.099261+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:00.966411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":893,"num_read_kb":718,"num_write":326,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'362","reported_seq":965,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.313325+0000","last_change":"2024-09-12T00:01:57.145897+0000","last_active":"2024-09-12T00:38:38.313325+0000","last_peered":"2024-09-12T00:38:38.313325+0000","last_clean":"2024-09-12T00:38:38.313325+0000","last_became_active":"2024-09-12T00:01:57.145466+0000","last_became_peered":"2024-09-12T00:01:57.145466+0000","last_unstale":"2024-09-12T00:38:38.313325+0000","last_undegraded":"2024-09-12T00:38:38.313325+0000","last_fullsized":"2024-09-12T00:38:38.313325+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:37.023670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262160,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":3535,"num_write":1174,"num_write_kb":24926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'109","reported_seq":685,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.756770+0000","last_change":"2024-09-12T00:01:59.149307+0000","last_active":"2024-09-12T00:36:54.756770+0000","last_peered":"2024-09-12T00:36:54.756770+0000","last_clean":"2024-09-12T00:36:54.756770+0000","last_became_active":"2024-09-12T00:01:59.149014+0000","last_became_peered":"2024-09-12T00:01:59.149014+0000","last_unstale":"2024-09-12T00:36:54.756770+0000","last_undegraded":"2024-09-12T00:36:54.756770+0000","last_fullsized":"2024-09-12T00:36:54.756770+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:10.536874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":492,"num_read_kb":416,"num_write":148,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'402","reported_seq":1038,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.297424+0000","last_change":"2024-09-12T00:01:57.151349+0000","last_active":"2024-09-12T00:38:38.297424+0000","last_peered":"2024-09-12T00:38:38.297424+0000","last_clean":"2024-09-12T00:38:38.297424+0000","last_became_active":"2024-09-12T00:01:57.150980+0000","last_became_peered":"2024-09-12T00:01:57.150980+0000","last_unstale":"2024-09-12T00:38:38.297424+0000","last_undegraded":"2024-09-12T00:38:38.297424+0000","last_fullsized":"2024-09-12T00:38:38.297424+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:09.638039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1303915,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":638,"num_read_kb":15523,"num_write":1286,"num_write_kb":17105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'109","reported_seq":703,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.368547+0000","last_change":"2024-09-12T00:01:59.150294+0000","last_active":"2024-09-12T00:37:06.368547+0000","last_peered":"2024-09-12T00:37:06.368547+0000","last_clean":"2024-09-12T00:37:06.368547+0000","last_became_active":"2024-09-12T00:01:59.149341+0000","last_became_peered":"2024-09-12T00:01:59.149341+0000","last_unstale":"2024-09-12T00:37:06.368547+0000","last_undegraded":"2024-09-12T00:37:06.368547+0000","last_fullsized":"2024-09-12T00:37:06.368547+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:43.661734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":504,"num_read_kb":434,"num_write":171,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'343","reported_seq":986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.305970+0000","last_change":"2024-09-12T00:02:32.863517+0000","last_active":"2024-09-12T00:38:38.305970+0000","last_peered":"2024-09-12T00:38:38.305970+0000","last_clean":"2024-09-12T00:38:38.305970+0000","last_became_active":"2024-09-12T00:02:32.863077+0000","last_became_peered":"2024-09-12T00:02:32.863077+0000","last_unstale":"2024-09-12T00:38:38.305970+0000","last_undegraded":"2024-09-12T00:38:38.305970+0000","last_fullsized":"2024-09-12T00:38:38.305970+0000","mapping_epoch":37,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:26.806451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267332,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":11923,"num_write":1143,"num_write_kb":27282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,7],"acting":[5,6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'269","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.154723+0000","last_change":"2024-09-12T00:01:59.159517+0000","last_active":"2024-09-12T00:36:54.154723+0000","last_peered":"2024-09-12T00:36:54.154723+0000","last_clean":"2024-09-12T00:36:54.154723+0000","last_became_active":"2024-09-12T00:01:59.159226+0000","last_became_peered":"2024-09-12T00:01:59.159226+0000","last_unstale":"2024-09-12T00:36:54.154723+0000","last_undegraded":"2024-09-12T00:36:54.154723+0000","last_fullsized":"2024-09-12T00:36:54.154723+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:44.957681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1182,"num_read_kb":958,"num_write":434,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'384","reported_seq":1044,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.189668+0000","last_change":"2024-09-12T00:01:57.148465+0000","last_active":"2024-09-12T00:38:38.189668+0000","last_peered":"2024-09-12T00:38:38.189668+0000","last_clean":"2024-09-12T00:38:38.189668+0000","last_became_active":"2024-09-12T00:01:57.148038+0000","last_became_peered":"2024-09-12T00:01:57.148038+0000","last_unstale":"2024-09-12T00:38:38.189668+0000","last_undegraded":"2024-09-12T00:38:38.189668+0000","last_fullsized":"2024-09-12T00:38:38.189668+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:42.798082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6690610,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":558,"num_read_kb":81305,"num_write":1164,"num_write_kb":56822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'244","reported_seq":815,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:17.296585+0000","last_change":"2024-09-12T00:01:59.154559+0000","last_active":"2024-09-12T00:36:17.296585+0000","last_peered":"2024-09-12T00:36:17.296585+0000","last_clean":"2024-09-12T00:36:17.296585+0000","last_became_active":"2024-09-12T00:01:59.154258+0000","last_became_peered":"2024-09-12T00:01:59.154258+0000","last_unstale":"2024-09-12T00:36:17.296585+0000","last_undegraded":"2024-09-12T00:36:17.296585+0000","last_fullsized":"2024-09-12T00:36:17.296585+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:13.431395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":900,"num_write":421,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'365","reported_seq":1019,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.240816+0000","last_change":"2024-09-12T00:01:57.143175+0000","last_active":"2024-09-12T00:38:38.240816+0000","last_peered":"2024-09-12T00:38:38.240816+0000","last_clean":"2024-09-12T00:38:38.240816+0000","last_became_active":"2024-09-12T00:01:57.142713+0000","last_became_peered":"2024-09-12T00:01:57.142713+0000","last_unstale":"2024-09-12T00:38:38.240816+0000","last_undegraded":"2024-09-12T00:38:38.240816+0000","last_fullsized":"2024-09-12T00:38:38.240816+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:53.401721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244498,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":36570,"num_write":1122,"num_write_kb":39253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'210","reported_seq":845,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:15.454384+0000","last_change":"2024-09-12T00:01:59.155267+0000","last_active":"2024-09-12T00:36:15.454384+0000","last_peered":"2024-09-12T00:36:15.454384+0000","last_clean":"2024-09-12T00:36:15.454384+0000","last_became_active":"2024-09-12T00:01:59.154931+0000","last_became_peered":"2024-09-12T00:01:59.154931+0000","last_unstale":"2024-09-12T00:36:15.454384+0000","last_undegraded":"2024-09-12T00:36:15.454384+0000","last_fullsized":"2024-09-12T00:36:15.454384+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:10.981627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":786,"num_write":317,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'344","reported_seq":1039,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.254913+0000","last_change":"2024-09-12T00:01:57.142655+0000","last_active":"2024-09-12T00:38:38.254913+0000","last_peered":"2024-09-12T00:38:38.254913+0000","last_clean":"2024-09-12T00:38:38.254913+0000","last_became_active":"2024-09-12T00:01:57.142082+0000","last_became_peered":"2024-09-12T00:01:57.142082+0000","last_unstale":"2024-09-12T00:38:38.254913+0000","last_undegraded":"2024-09-12T00:38:38.254913+0000","last_fullsized":"2024-09-12T00:38:38.254913+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:37.032607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138779,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":3429,"num_write":1186,"num_write_kb":16203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'205","reported_seq":791,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:50.958424+0000","last_change":"2024-09-12T00:01:59.146609+0000","last_active":"2024-09-12T00:36:50.958424+0000","last_peered":"2024-09-12T00:36:50.958424+0000","last_clean":"2024-09-12T00:36:50.958424+0000","last_became_active":"2024-09-12T00:01:59.146272+0000","last_became_peered":"2024-09-12T00:01:59.146272+0000","last_unstale":"2024-09-12T00:36:50.958424+0000","last_undegraded":"2024-09-12T00:36:50.958424+0000","last_fullsized":"2024-09-12T00:36:50.958424+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:31.336134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":905,"num_read_kb":736,"num_write":324,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'329","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.308948+0000","last_change":"2024-09-12T00:01:57.165561+0000","last_active":"2024-09-12T00:38:38.308948+0000","last_peered":"2024-09-12T00:38:38.308948+0000","last_clean":"2024-09-12T00:38:38.308948+0000","last_became_active":"2024-09-12T00:01:57.165139+0000","last_became_peered":"2024-09-12T00:01:57.165139+0000","last_unstale":"2024-09-12T00:38:38.308948+0000","last_undegraded":"2024-09-12T00:38:38.308948+0000","last_fullsized":"2024-09-12T00:38:38.308948+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:31.614666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174794,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":34175,"num_write":1090,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'210","reported_seq":834,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:51.123390+0000","last_change":"2024-09-12T00:01:59.151886+0000","last_active":"2024-09-12T00:36:51.123390+0000","last_peered":"2024-09-12T00:36:51.123390+0000","last_clean":"2024-09-12T00:36:51.123390+0000","last_became_active":"2024-09-12T00:01:59.151627+0000","last_became_peered":"2024-09-12T00:01:59.151627+0000","last_unstale":"2024-09-12T00:36:51.123390+0000","last_undegraded":"2024-09-12T00:36:51.123390+0000","last_fullsized":"2024-09-12T00:36:51.123390+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:04.332533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":886,"num_read_kb":742,"num_write":315,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'378","reported_seq":1214,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.285019+0000","last_change":"2024-09-12T00:01:57.151733+0000","last_active":"2024-09-12T00:38:38.285019+0000","last_peered":"2024-09-12T00:38:38.285019+0000","last_clean":"2024-09-12T00:38:38.285019+0000","last_became_active":"2024-09-12T00:01:57.151346+0000","last_became_peered":"2024-09-12T00:01:57.151346+0000","last_unstale":"2024-09-12T00:38:38.285019+0000","last_undegraded":"2024-09-12T00:38:38.285019+0000","last_fullsized":"2024-09-12T00:38:38.285019+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:20.828358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":958,"num_read_kb":6741,"num_write":1200,"num_write_kb":13731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'4140","reported_seq":4711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:03.256251+0000","last_change":"2024-09-12T00:01:59.158824+0000","last_active":"2024-09-12T00:36:03.256251+0000","last_peered":"2024-09-12T00:36:03.256251+0000","last_clean":"2024-09-12T00:36:03.256251+0000","last_became_active":"2024-09-12T00:01:59.157873+0000","last_became_peered":"2024-09-12T00:01:59.157873+0000","last_unstale":"2024-09-12T00:36:03.256251+0000","last_undegraded":"2024-09-12T00:36:03.256251+0000","last_fullsized":"2024-09-12T00:36:03.256251+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:18.182096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16645,"num_read_kb":13962,"num_write":6214,"num_write_kb":3111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'347","reported_seq":1029,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.223895+0000","last_change":"2024-09-12T00:01:57.165394+0000","last_active":"2024-09-12T00:38:38.223895+0000","last_peered":"2024-09-12T00:38:38.223895+0000","last_clean":"2024-09-12T00:38:38.223895+0000","last_became_active":"2024-09-12T00:01:57.165016+0000","last_became_peered":"2024-09-12T00:01:57.165016+0000","last_unstale":"2024-09-12T00:38:38.223895+0000","last_undegraded":"2024-09-12T00:38:38.223895+0000","last_fullsized":"2024-09-12T00:38:38.223895+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:19.072293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568671,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":600,"num_read_kb":10239,"num_write":1109,"num_write_kb":39602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'330","reported_seq":1026,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.330816+0000","last_change":"2024-09-12T00:01:57.165458+0000","last_active":"2024-09-12T00:38:38.330816+0000","last_peered":"2024-09-12T00:38:38.330816+0000","last_clean":"2024-09-12T00:38:38.330816+0000","last_became_active":"2024-09-12T00:01:57.165046+0000","last_became_peered":"2024-09-12T00:01:57.165046+0000","last_unstale":"2024-09-12T00:38:38.330816+0000","last_undegraded":"2024-09-12T00:38:38.330816+0000","last_fullsized":"2024-09-12T00:38:38.330816+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:21.899432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8464405,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":613,"num_read_kb":41753,"num_write":993,"num_write_kb":31467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'110","reported_seq":711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:01.156763+0000","last_change":"2024-09-12T00:01:59.153747+0000","last_active":"2024-09-12T00:37:01.156763+0000","last_peered":"2024-09-12T00:37:01.156763+0000","last_clean":"2024-09-12T00:37:01.156763+0000","last_became_active":"2024-09-12T00:01:59.153454+0000","last_became_peered":"2024-09-12T00:01:59.153454+0000","last_unstale":"2024-09-12T00:37:01.156763+0000","last_undegraded":"2024-09-12T00:37:01.156763+0000","last_fullsized":"2024-09-12T00:37:01.156763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:03.025405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":439,"num_write":164,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'353","reported_seq":1200,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.291794+0000","last_change":"2024-09-12T00:01:57.146814+0000","last_active":"2024-09-12T00:38:38.291794+0000","last_peered":"2024-09-12T00:38:38.291794+0000","last_clean":"2024-09-12T00:38:38.291794+0000","last_became_active":"2024-09-12T00:01:57.146320+0000","last_became_peered":"2024-09-12T00:01:57.146320+0000","last_unstale":"2024-09-12T00:38:38.291794+0000","last_undegraded":"2024-09-12T00:38:38.291794+0000","last_fullsized":"2024-09-12T00:38:38.291794+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:48.705647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":988,"num_read_kb":6700,"num_write":1181,"num_write_kb":43058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'174","reported_seq":769,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:51.509408+0000","last_change":"2024-09-12T00:01:59.147165+0000","last_active":"2024-09-12T00:35:51.509408+0000","last_peered":"2024-09-12T00:35:51.509408+0000","last_clean":"2024-09-12T00:35:51.509408+0000","last_became_active":"2024-09-12T00:01:59.146876+0000","last_became_peered":"2024-09-12T00:01:59.146876+0000","last_unstale":"2024-09-12T00:35:51.509408+0000","last_undegraded":"2024-09-12T00:35:51.509408+0000","last_fullsized":"2024-09-12T00:35:51.509408+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:19.079900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":808,"num_read_kb":667,"num_write":271,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5901,"num_read_kb":4223,"num_write":1957,"num_write_kb":855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1029,"ondisk_log_size":1029,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":14998,"num_read_kb":14670,"num_write":16815,"num_write_kb":4907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1464,"ondisk_log_size":1464,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":579,"ondisk_log_size":579,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1554453,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17205,"num_read_kb":36338,"num_write":14367,"num_write_kb":11412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2155,"ondisk_log_size":2155,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102638,"num_read_kb":85737,"num_write":37205,"num_write_kb":18751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3973,"ondisk_log_size":3973,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":86840172,"num_objects":366,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":36012,"num_read_kb":1881303,"num_write":71771,"num_write_kb":2075118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":118292480,"data_stored":118292480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3738,"ondisk_log_size":3738,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":208372,"num_write":160,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":193338,"num_write":160,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509888,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":223916,"kb_used_data":12104,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":94147924,"statfs":{"total":96636764160,"available":96407474176,"internally_reserved":0,"allocated":12394496,"data_stored":10437918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":216660426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509887,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116940,"kb_used_data":17788,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94254900,"statfs":{"total":96636764160,"available":96517017600,"internally_reserved":0,"allocated":18214912,"data_stored":16235382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509889,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256656,"kb_used_data":12824,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94115184,"statfs":{"total":96636764160,"available":96373948416,"internally_reserved":0,"allocated":13131776,"data_stored":11163018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249428421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509887,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239608,"kb_used_data":19356,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94132232,"statfs":{"total":96636764160,"available":96391405568,"internally_reserved":0,"allocated":19820544,"data_stored":17855512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":225245639},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,4,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509889,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143412,"kb_used_data":26016,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94228428,"statfs":{"total":96636764160,"available":96489910272,"internally_reserved":0,"allocated":26640384,"data_stored":24664481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509888,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136860,"kb_used_data":19528,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94234980,"statfs":{"total":96636764160,"available":96496619520,"internally_reserved":0,"allocated":19996672,"data_stored":18028066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575295,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":234032,"kb_used_data":26316,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94137808,"statfs":{"total":96636764160,"available":96397115392,"internally_reserved":0,"allocated":26947584,"data_stored":25004229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212400581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575297,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":343648,"kb_used_data":15284,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94028192,"statfs":{"total":96636764160,"available":96284868608,"internally_reserved":0,"allocated":15650816,"data_stored":13693364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15826944,"data_stored":15826944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10903552,"data_stored":10903552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22462464,"data_stored":22462464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15654912,"data_stored":15654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22802432,"data_stored":22802432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8372224,"data_stored":8372224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14032896,"data_stored":14032896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8237056,"data_stored":8237056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:38:45.163 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.164 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.164 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.164 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.164 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.164 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.164 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.164 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.164 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.165 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.165 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.165 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.165 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.165 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.165 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.165 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.165 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.166 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.166 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.166 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.166 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.166 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.166 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.166 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.166 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.166 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.167 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.167 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.167 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.167 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.167 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.167 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.167 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.167 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.167 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.168 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.168 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.168 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.168 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.168 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.168 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.168 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.168 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.168 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.169 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.169 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.169 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.169 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.169 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.169 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.169 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.169 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.169 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.170 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.170 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.170 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.170 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.170 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.170 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.170 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.170 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.170 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.170 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.171 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.171 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.171 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.171 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.171 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.171 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.171 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.171 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.171 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.172 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.172 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.172 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.172 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.172 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.172 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.172 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.172 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.172 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.173 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.173 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.173 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.173 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.173 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.173 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.173 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.173 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.173 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.174 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.174 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.174 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.174 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.174 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.174 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.174 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.174 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.174 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.175 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.175 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.175 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.175 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.175 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.175 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.175 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.175 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.175 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.175 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.176 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.176 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.176 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.176 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.176 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.176 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.176 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.176 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.176 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.177 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.177 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.177 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.177 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.177 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.177 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.177 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.177 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.177 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.178 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.178 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.178 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.178 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.178 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.178 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.178 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.178 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.178 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.179 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.179 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.179 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.179 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.179 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.179 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.179 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.179 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.179 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.180 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.180 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.180 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.180 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.180 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.180 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.180 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.180 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.180 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.181 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.181 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.181 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.181 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.181 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.181 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.181 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.181 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.182 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.182 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.182 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.182 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.182 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.182 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.182 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.182 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.182 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.183 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.183 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.183 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.183 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.183 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.183 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.183 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.183 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.183 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.184 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.184 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.184 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.184 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.184 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.184 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.184 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.184 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.184 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.185 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.185 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.185 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.185 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.185 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.185 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.185 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.185 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.185 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.186 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.186 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.186 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.186 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.186 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.186 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.186 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.186 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.186 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.186 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.187 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.187 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.187 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.187 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.187 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.187 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.187 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.187 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.187 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.188 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.188 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.188 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.188 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.188 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.188 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.188 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.188 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.188 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.189 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.189 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.189 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.189 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T00:01:37.438834+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.189 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:01:45.489723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.189 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.189 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.189 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.190 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.190 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.190 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.190 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T00:01:45.489723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.190 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.190 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.190 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.190 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.190 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.190 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.191 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T00:01:45.489723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.191 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.191 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.191 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.191 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.191 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.191 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.191 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T00:01:45.489723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.191 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.192 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.192 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.192 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.192 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.192 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.192 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.192 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T00:01:45.489723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.193 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.193 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.193 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.193 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.193 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.193 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.193 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:01:45.489723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.193 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.194 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.194 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.194 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.194 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.194 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.194 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T00:01:45.489723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.194 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.194 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.194 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.195 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.195 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.195 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.195 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:01:45.489723+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.195 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.195 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.195 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.195 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.195 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.196 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.196 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.196 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.196 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.196 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.196 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.196 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.196 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.196 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.197 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.197 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.197 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.197 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.197 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.197 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.197 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.197 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.197 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.198 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.198 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.198 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.198 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.198 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.198 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.198 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.198 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.198 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.199 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.199 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.199 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.199 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.199 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.199 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.199 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.199 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.199 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.200 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.200 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.200 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.200 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.200 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.200 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.200 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.200 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.200 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.201 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.201 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.201 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.201 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.201 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.201 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.201 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.201 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.201 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.202 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.202 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.202 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.202 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.202 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.202 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.202 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.202 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.202 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.203 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.203 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.203 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.203 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.203 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.203 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.203 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.203 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.203 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.204 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.204 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.204 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.204 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.204 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.204 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.204 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.204 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.204 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.205 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.205 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.205 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.205 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.205 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.205 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.205 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.205 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.206 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.206 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.206 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.206 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.206 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.206 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.206 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.206 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.206 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.207 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.207 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.207 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.207 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.207 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.207 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.207 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.207 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.207 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:38:45.207 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:39:05.208 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:39:05.565 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:39:05.576 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T00:39:05.579 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":1377,"stamp":"2024-09-12T00:39:03.638844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89002200,"num_objects":716,"num_object_clones":0,"num_object_copies":2164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":716,"num_whiteouts":0,"num_read":179516,"num_read_kb":2426911,"num_write":142578,"num_write_kb":2382623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":535793,"num_omap_keys":1273,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13264,"ondisk_log_size":13264,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1693728,"kb_used_data":149216,"kb_used_omap":12,"kb_used_meta":1544371,"kb_avail":753280992,"statfs":{"total":773094113280,"available":771359735808,"internally_reserved":0,"allocated":152797184,"data_stored":137081970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1581436464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":531790,"num_omap_keys":1255,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005094"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.383088+0000","last_change":"2024-09-12T00:27:17.580532+0000","last_active":"2024-09-12T00:34:49.383088+0000","last_peered":"2024-09-12T00:34:49.383088+0000","last_clean":"2024-09-12T00:34:49.383088+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:34:49.383088+0000","last_undegraded":"2024-09-12T00:34:49.383088+0000","last_fullsized":"2024-09-12T00:34:49.383088+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:42.988688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'10","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.315467+0000","last_change":"2024-09-12T00:17:03.214457+0000","last_active":"2024-09-12T00:38:36.315467+0000","last_peered":"2024-09-12T00:38:36.315467+0000","last_clean":"2024-09-12T00:38:36.315467+0000","last_became_active":"2024-09-12T00:17:03.213906+0000","last_became_peered":"2024-09-12T00:17:03.213906+0000","last_unstale":"2024-09-12T00:38:36.315467+0000","last_undegraded":"2024-09-12T00:38:36.315467+0000","last_fullsized":"2024-09-12T00:38:36.315467+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:43.554284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":18831,"num_write":10,"num_write_kb":11989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.498249+0000","last_change":"2024-09-12T00:17:00.182788+0000","last_active":"2024-09-12T00:34:29.498249+0000","last_peered":"2024-09-12T00:34:29.498249+0000","last_clean":"2024-09-12T00:34:29.498249+0000","last_became_active":"2024-09-12T00:17:00.182510+0000","last_became_peered":"2024-09-12T00:17:00.182510+0000","last_unstale":"2024-09-12T00:34:29.498249+0000","last_undegraded":"2024-09-12T00:34:29.498249+0000","last_fullsized":"2024-09-12T00:34:29.498249+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:10.766253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'18","reported_seq":91,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:27.517806+0000","last_change":"2024-09-12T00:15:34.415639+0000","last_active":"2024-09-12T00:36:27.517806+0000","last_peered":"2024-09-12T00:36:27.517806+0000","last_clean":"2024-09-12T00:36:27.517806+0000","last_became_active":"2024-09-12T00:15:34.415364+0000","last_became_peered":"2024-09-12T00:15:34.415364+0000","last_unstale":"2024-09-12T00:36:27.517806+0000","last_undegraded":"2024-09-12T00:36:27.517806+0000","last_fullsized":"2024-09-12T00:36:27.517806+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:04.462246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.500985+0000","last_change":"2024-09-12T00:27:17.581875+0000","last_active":"2024-09-12T00:34:49.500985+0000","last_peered":"2024-09-12T00:34:49.500985+0000","last_clean":"2024-09-12T00:34:49.500985+0000","last_became_active":"2024-09-12T00:27:17.581520+0000","last_became_peered":"2024-09-12T00:27:17.581520+0000","last_unstale":"2024-09-12T00:34:49.500985+0000","last_undegraded":"2024-09-12T00:34:49.500985+0000","last_fullsized":"2024-09-12T00:34:49.500985+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:28.315835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":30,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.637288+0000","last_change":"2024-09-12T00:17:03.206913+0000","last_active":"2024-09-12T00:37:04.637288+0000","last_peered":"2024-09-12T00:37:04.637288+0000","last_clean":"2024-09-12T00:37:04.637288+0000","last_became_active":"2024-09-12T00:17:03.206566+0000","last_became_peered":"2024-09-12T00:17:03.206566+0000","last_unstale":"2024-09-12T00:37:04.637288+0000","last_undegraded":"2024-09-12T00:37:04.637288+0000","last_fullsized":"2024-09-12T00:37:04.637288+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:38.057828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.519227+0000","last_change":"2024-09-12T00:17:00.176346+0000","last_active":"2024-09-12T00:36:59.519227+0000","last_peered":"2024-09-12T00:36:59.519227+0000","last_clean":"2024-09-12T00:36:59.519227+0000","last_became_active":"2024-09-12T00:17:00.175196+0000","last_became_peered":"2024-09-12T00:17:00.175196+0000","last_unstale":"2024-09-12T00:36:59.519227+0000","last_undegraded":"2024-09-12T00:36:59.519227+0000","last_fullsized":"2024-09-12T00:36:59.519227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:52.503715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"258'75","reported_seq":276,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:42.511663+0000","last_change":"2024-09-12T00:15:34.417010+0000","last_active":"2024-09-12T00:35:42.511663+0000","last_peered":"2024-09-12T00:35:42.511663+0000","last_clean":"2024-09-12T00:35:42.511663+0000","last_became_active":"2024-09-12T00:15:34.416706+0000","last_became_peered":"2024-09-12T00:15:34.416706+0000","last_unstale":"2024-09-12T00:35:42.511663+0000","last_undegraded":"2024-09-12T00:35:42.511663+0000","last_fullsized":"2024-09-12T00:35:42.511663+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:28.483679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":462,"num_read_kb":331,"num_write":93,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:31.497481+0000","last_change":"2024-09-12T00:27:17.573237+0000","last_active":"2024-09-12T00:34:31.497481+0000","last_peered":"2024-09-12T00:34:31.497481+0000","last_clean":"2024-09-12T00:34:31.497481+0000","last_became_active":"2024-09-12T00:27:17.572934+0000","last_became_peered":"2024-09-12T00:27:17.572934+0000","last_unstale":"2024-09-12T00:34:31.497481+0000","last_undegraded":"2024-09-12T00:34:31.497481+0000","last_fullsized":"2024-09-12T00:34:31.497481+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:52.238701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'3","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:54.527097+0000","last_change":"2024-09-12T00:17:03.212082+0000","last_active":"2024-09-12T00:37:54.527097+0000","last_peered":"2024-09-12T00:37:54.527097+0000","last_clean":"2024-09-12T00:37:54.527097+0000","last_became_active":"2024-09-12T00:17:03.211755+0000","last_became_peered":"2024-09-12T00:17:03.211755+0000","last_unstale":"2024-09-12T00:37:54.527097+0000","last_undegraded":"2024-09-12T00:37:54.527097+0000","last_fullsized":"2024-09-12T00:37:54.527097+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:11.463541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503282+0000","last_change":"2024-09-12T00:17:00.181734+0000","last_active":"2024-09-12T00:35:04.503282+0000","last_peered":"2024-09-12T00:35:04.503282+0000","last_clean":"2024-09-12T00:35:04.503282+0000","last_became_active":"2024-09-12T00:17:00.181461+0000","last_became_peered":"2024-09-12T00:17:00.181461+0000","last_unstale":"2024-09-12T00:35:04.503282+0000","last_undegraded":"2024-09-12T00:35:04.503282+0000","last_fullsized":"2024-09-12T00:35:04.503282+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:40.876171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'16","reported_seq":82,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:34.507625+0000","last_change":"2024-09-12T00:15:34.428333+0000","last_active":"2024-09-12T00:35:34.507625+0000","last_peered":"2024-09-12T00:35:34.507625+0000","last_clean":"2024-09-12T00:35:34.507625+0000","last_became_active":"2024-09-12T00:15:34.428023+0000","last_became_peered":"2024-09-12T00:15:34.428023+0000","last_unstale":"2024-09-12T00:35:34.507625+0000","last_undegraded":"2024-09-12T00:35:34.507625+0000","last_fullsized":"2024-09-12T00:35:34.507625+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:33.470085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499223+0000","last_change":"2024-09-12T00:27:17.577865+0000","last_active":"2024-09-12T00:34:34.499223+0000","last_peered":"2024-09-12T00:34:34.499223+0000","last_clean":"2024-09-12T00:34:34.499223+0000","last_became_active":"2024-09-12T00:27:17.577034+0000","last_became_peered":"2024-09-12T00:27:17.577034+0000","last_unstale":"2024-09-12T00:34:34.499223+0000","last_undegraded":"2024-09-12T00:34:34.499223+0000","last_fullsized":"2024-09-12T00:34:34.499223+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:24.642513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"261'3","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.520057+0000","last_change":"2024-09-12T00:17:03.210262+0000","last_active":"2024-09-12T00:37:04.520057+0000","last_peered":"2024-09-12T00:37:04.520057+0000","last_clean":"2024-09-12T00:37:04.520057+0000","last_became_active":"2024-09-12T00:17:03.209945+0000","last_became_peered":"2024-09-12T00:17:03.209945+0000","last_unstale":"2024-09-12T00:37:04.520057+0000","last_undegraded":"2024-09-12T00:37:04.520057+0000","last_fullsized":"2024-09-12T00:37:04.520057+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:00.406310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:46.508609+0000","last_change":"2024-09-12T00:17:00.177502+0000","last_active":"2024-09-12T00:35:46.508609+0000","last_peered":"2024-09-12T00:35:46.508609+0000","last_clean":"2024-09-12T00:35:46.508609+0000","last_became_active":"2024-09-12T00:17:00.176151+0000","last_became_peered":"2024-09-12T00:17:00.176151+0000","last_unstale":"2024-09-12T00:35:46.508609+0000","last_undegraded":"2024-09-12T00:35:46.508609+0000","last_fullsized":"2024-09-12T00:35:46.508609+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:32.829277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'69","reported_seq":229,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.090824+0000","last_change":"2024-09-12T00:15:34.422703+0000","last_active":"2024-09-12T00:36:56.090824+0000","last_peered":"2024-09-12T00:36:56.090824+0000","last_clean":"2024-09-12T00:36:56.090824+0000","last_became_active":"2024-09-12T00:15:34.422426+0000","last_became_peered":"2024-09-12T00:15:34.422426+0000","last_unstale":"2024-09-12T00:36:56.090824+0000","last_undegraded":"2024-09-12T00:36:56.090824+0000","last_fullsized":"2024-09-12T00:36:56.090824+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:50.908243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":354,"num_read_kb":254,"num_write":121,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:19.505464+0000","last_change":"2024-09-12T00:27:17.579859+0000","last_active":"2024-09-12T00:35:19.505464+0000","last_peered":"2024-09-12T00:35:19.505464+0000","last_clean":"2024-09-12T00:35:19.505464+0000","last_became_active":"2024-09-12T00:27:17.579540+0000","last_became_peered":"2024-09-12T00:27:17.579540+0000","last_unstale":"2024-09-12T00:35:19.505464+0000","last_undegraded":"2024-09-12T00:35:19.505464+0000","last_fullsized":"2024-09-12T00:35:19.505464+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:23.867988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:29.396141+0000","last_change":"2024-09-12T00:17:03.220542+0000","last_active":"2024-09-12T00:36:29.396141+0000","last_peered":"2024-09-12T00:36:29.396141+0000","last_clean":"2024-09-12T00:36:29.396141+0000","last_became_active":"2024-09-12T00:17:03.218684+0000","last_became_peered":"2024-09-12T00:17:03.218684+0000","last_unstale":"2024-09-12T00:36:29.396141+0000","last_undegraded":"2024-09-12T00:36:29.396141+0000","last_fullsized":"2024-09-12T00:36:29.396141+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'18","reported_seq":74,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.204856+0000","last_change":"2024-09-12T00:17:00.186275+0000","last_active":"2024-09-12T00:38:38.204856+0000","last_peered":"2024-09-12T00:38:38.204856+0000","last_clean":"2024-09-12T00:38:38.204856+0000","last_became_active":"2024-09-12T00:17:00.185974+0000","last_became_peered":"2024-09-12T00:17:00.185974+0000","last_unstale":"2024-09-12T00:38:38.204856+0000","last_undegraded":"2024-09-12T00:38:38.204856+0000","last_fullsized":"2024-09-12T00:38:38.204856+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":38916,"num_write":33,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'44","reported_seq":155,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:34.507543+0000","last_change":"2024-09-12T00:15:34.423404+0000","last_active":"2024-09-12T00:35:34.507543+0000","last_peered":"2024-09-12T00:35:34.507543+0000","last_clean":"2024-09-12T00:35:34.507543+0000","last_became_active":"2024-09-12T00:15:34.423149+0000","last_became_peered":"2024-09-12T00:15:34.423149+0000","last_unstale":"2024-09-12T00:35:34.507543+0000","last_undegraded":"2024-09-12T00:35:34.507543+0000","last_fullsized":"2024-09-12T00:35:34.507543+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:23.508263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":150,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:37.510807+0000","last_change":"2024-09-12T00:27:17.575993+0000","last_active":"2024-09-12T00:35:37.510807+0000","last_peered":"2024-09-12T00:35:37.510807+0000","last_clean":"2024-09-12T00:35:37.510807+0000","last_became_active":"2024-09-12T00:27:17.575513+0000","last_became_peered":"2024-09-12T00:27:17.575513+0000","last_unstale":"2024-09-12T00:35:37.510807+0000","last_undegraded":"2024-09-12T00:35:37.510807+0000","last_fullsized":"2024-09-12T00:35:37.510807+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:31.106786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396470+0000","last_change":"2024-09-12T00:17:03.220037+0000","last_active":"2024-09-12T00:36:24.396470+0000","last_peered":"2024-09-12T00:36:24.396470+0000","last_clean":"2024-09-12T00:36:24.396470+0000","last_became_active":"2024-09-12T00:17:03.219058+0000","last_became_peered":"2024-09-12T00:17:03.219058+0000","last_unstale":"2024-09-12T00:36:24.396470+0000","last_undegraded":"2024-09-12T00:36:24.396470+0000","last_fullsized":"2024-09-12T00:36:24.396470+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396546+0000","last_change":"2024-09-12T00:17:00.183145+0000","last_active":"2024-09-12T00:36:24.396546+0000","last_peered":"2024-09-12T00:36:24.396546+0000","last_clean":"2024-09-12T00:36:24.396546+0000","last_became_active":"2024-09-12T00:17:00.182830+0000","last_became_peered":"2024-09-12T00:17:00.182830+0000","last_unstale":"2024-09-12T00:36:24.396546+0000","last_undegraded":"2024-09-12T00:36:24.396546+0000","last_fullsized":"2024-09-12T00:36:24.396546+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'10","reported_seq":67,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:34.625266+0000","last_change":"2024-09-12T00:15:34.421131+0000","last_active":"2024-09-12T00:35:34.625266+0000","last_peered":"2024-09-12T00:35:34.625266+0000","last_clean":"2024-09-12T00:35:34.625266+0000","last_became_active":"2024-09-12T00:15:34.420841+0000","last_became_peered":"2024-09-12T00:15:34.420841+0000","last_unstale":"2024-09-12T00:35:34.625266+0000","last_undegraded":"2024-09-12T00:35:34.625266+0000","last_fullsized":"2024-09-12T00:35:34.625266+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:18.021901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.618279+0000","last_change":"2024-09-12T00:27:17.583663+0000","last_active":"2024-09-12T00:34:49.618279+0000","last_peered":"2024-09-12T00:34:49.618279+0000","last_clean":"2024-09-12T00:34:49.618279+0000","last_became_active":"2024-09-12T00:27:17.583300+0000","last_became_peered":"2024-09-12T00:27:17.583300+0000","last_unstale":"2024-09-12T00:34:49.618279+0000","last_undegraded":"2024-09-12T00:34:49.618279+0000","last_fullsized":"2024-09-12T00:34:49.618279+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:10.632365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615804+0000","last_change":"2024-09-12T00:17:03.212176+0000","last_active":"2024-09-12T00:34:34.615804+0000","last_peered":"2024-09-12T00:34:34.615804+0000","last_clean":"2024-09-12T00:34:34.615804+0000","last_became_active":"2024-09-12T00:17:03.211869+0000","last_became_peered":"2024-09-12T00:17:03.211869+0000","last_unstale":"2024-09-12T00:34:34.615804+0000","last_undegraded":"2024-09-12T00:34:34.615804+0000","last_fullsized":"2024-09-12T00:34:34.615804+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:39.796531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'3","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.400202+0000","last_change":"2024-09-12T00:17:00.181340+0000","last_active":"2024-09-12T00:36:59.400202+0000","last_peered":"2024-09-12T00:36:59.400202+0000","last_clean":"2024-09-12T00:36:59.400202+0000","last_became_active":"2024-09-12T00:17:00.180995+0000","last_became_peered":"2024-09-12T00:17:00.180995+0000","last_unstale":"2024-09-12T00:36:59.400202+0000","last_undegraded":"2024-09-12T00:36:59.400202+0000","last_fullsized":"2024-09-12T00:36:59.400202+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:35.862245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"261'23","reported_seq":101,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.468546+0000","last_change":"2024-09-12T00:15:34.417460+0000","last_active":"2024-09-12T00:36:56.468546+0000","last_peered":"2024-09-12T00:36:56.468546+0000","last_clean":"2024-09-12T00:36:56.468546+0000","last_became_active":"2024-09-12T00:15:34.417149+0000","last_became_peered":"2024-09-12T00:15:34.417149+0000","last_unstale":"2024-09-12T00:36:56.468546+0000","last_undegraded":"2024-09-12T00:36:56.468546+0000","last_fullsized":"2024-09-12T00:36:56.468546+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:57.189731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.383151+0000","last_change":"2024-09-12T00:27:17.579098+0000","last_active":"2024-09-12T00:34:49.383151+0000","last_peered":"2024-09-12T00:34:49.383151+0000","last_clean":"2024-09-12T00:34:49.383151+0000","last_became_active":"2024-09-12T00:27:17.578739+0000","last_became_peered":"2024-09-12T00:27:17.578739+0000","last_unstale":"2024-09-12T00:34:49.383151+0000","last_undegraded":"2024-09-12T00:34:49.383151+0000","last_fullsized":"2024-09-12T00:34:49.383151+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:48.348663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'3","reported_seq":30,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.519599+0000","last_change":"2024-09-12T00:17:03.213329+0000","last_active":"2024-09-12T00:37:04.519599+0000","last_peered":"2024-09-12T00:37:04.519599+0000","last_clean":"2024-09-12T00:37:04.519599+0000","last_became_active":"2024-09-12T00:17:03.213071+0000","last_became_peered":"2024-09-12T00:17:03.213071+0000","last_unstale":"2024-09-12T00:37:04.519599+0000","last_undegraded":"2024-09-12T00:37:04.519599+0000","last_fullsized":"2024-09-12T00:37:04.519599+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:46.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:29.497692+0000","last_change":"2024-09-12T00:17:00.178668+0000","last_active":"2024-09-12T00:34:29.497692+0000","last_peered":"2024-09-12T00:34:29.497692+0000","last_clean":"2024-09-12T00:34:29.497692+0000","last_became_active":"2024-09-12T00:17:00.178279+0000","last_became_peered":"2024-09-12T00:17:00.178279+0000","last_unstale":"2024-09-12T00:34:29.497692+0000","last_undegraded":"2024-09-12T00:34:29.497692+0000","last_fullsized":"2024-09-12T00:34:29.497692+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:59.897917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'24","reported_seq":104,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:54.501600+0000","last_change":"2024-09-12T00:15:34.420370+0000","last_active":"2024-09-12T00:34:54.501600+0000","last_peered":"2024-09-12T00:34:54.501600+0000","last_clean":"2024-09-12T00:34:54.501600+0000","last_became_active":"2024-09-12T00:15:34.420120+0000","last_became_peered":"2024-09-12T00:15:34.420120+0000","last_unstale":"2024-09-12T00:34:54.501600+0000","last_undegraded":"2024-09-12T00:34:54.501600+0000","last_fullsized":"2024-09-12T00:34:54.501600+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:10.354241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:39.516479+0000","last_change":"2024-09-12T00:27:17.578396+0000","last_active":"2024-09-12T00:36:39.516479+0000","last_peered":"2024-09-12T00:36:39.516479+0000","last_clean":"2024-09-12T00:36:39.516479+0000","last_became_active":"2024-09-12T00:27:17.577671+0000","last_became_peered":"2024-09-12T00:27:17.577671+0000","last_unstale":"2024-09-12T00:36:39.516479+0000","last_undegraded":"2024-09-12T00:36:39.516479+0000","last_fullsized":"2024-09-12T00:36:39.516479+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.514253+0000","last_change":"2024-09-12T00:17:03.214034+0000","last_active":"2024-09-12T00:36:24.514253+0000","last_peered":"2024-09-12T00:36:24.514253+0000","last_clean":"2024-09-12T00:36:24.514253+0000","last_became_active":"2024-09-12T00:17:03.213775+0000","last_became_peered":"2024-09-12T00:17:03.213775+0000","last_unstale":"2024-09-12T00:36:24.514253+0000","last_undegraded":"2024-09-12T00:36:24.514253+0000","last_fullsized":"2024-09-12T00:36:24.514253+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'6","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.583918+0000","last_change":"2024-09-12T00:17:00.183189+0000","last_active":"2024-09-12T00:38:37.583918+0000","last_peered":"2024-09-12T00:38:37.583918+0000","last_clean":"2024-09-12T00:38:37.583918+0000","last_became_active":"2024-09-12T00:17:00.182842+0000","last_became_peered":"2024-09-12T00:17:00.182842+0000","last_unstale":"2024-09-12T00:38:37.583918+0000","last_undegraded":"2024-09-12T00:38:37.583918+0000","last_fullsized":"2024-09-12T00:38:37.583918+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:45.925037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'14","reported_seq":77,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:57.505085+0000","last_change":"2024-09-12T00:15:34.421873+0000","last_active":"2024-09-12T00:34:57.505085+0000","last_peered":"2024-09-12T00:34:57.505085+0000","last_clean":"2024-09-12T00:34:57.505085+0000","last_became_active":"2024-09-12T00:15:34.421585+0000","last_became_peered":"2024-09-12T00:15:34.421585+0000","last_unstale":"2024-09-12T00:34:57.505085+0000","last_undegraded":"2024-09-12T00:34:57.505085+0000","last_fullsized":"2024-09-12T00:34:57.505085+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:19.525663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:39.516096+0000","last_change":"2024-09-12T00:27:17.573564+0000","last_active":"2024-09-12T00:36:39.516096+0000","last_peered":"2024-09-12T00:36:39.516096+0000","last_clean":"2024-09-12T00:36:39.516096+0000","last_became_active":"2024-09-12T00:27:17.572899+0000","last_became_peered":"2024-09-12T00:27:17.572899+0000","last_unstale":"2024-09-12T00:36:39.516096+0000","last_undegraded":"2024-09-12T00:36:39.516096+0000","last_fullsized":"2024-09-12T00:36:39.516096+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509411+0000","last_change":"2024-09-12T00:17:03.217326+0000","last_active":"2024-09-12T00:35:44.509411+0000","last_peered":"2024-09-12T00:35:44.509411+0000","last_clean":"2024-09-12T00:35:44.509411+0000","last_became_active":"2024-09-12T00:17:03.217052+0000","last_became_peered":"2024-09-12T00:17:03.217052+0000","last_unstale":"2024-09-12T00:35:44.509411+0000","last_undegraded":"2024-09-12T00:35:44.509411+0000","last_fullsized":"2024-09-12T00:35:44.509411+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:57.870587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.394974+0000","last_change":"2024-09-12T00:17:00.181429+0000","last_active":"2024-09-12T00:36:19.394974+0000","last_peered":"2024-09-12T00:36:19.394974+0000","last_clean":"2024-09-12T00:36:19.394974+0000","last_became_active":"2024-09-12T00:17:00.181082+0000","last_became_peered":"2024-09-12T00:17:00.181082+0000","last_unstale":"2024-09-12T00:36:19.394974+0000","last_undegraded":"2024-09-12T00:36:19.394974+0000","last_fullsized":"2024-09-12T00:36:19.394974+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'32","reported_seq":127,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:57.505046+0000","last_change":"2024-09-12T00:15:34.414194+0000","last_active":"2024-09-12T00:34:57.505046+0000","last_peered":"2024-09-12T00:34:57.505046+0000","last_clean":"2024-09-12T00:34:57.505046+0000","last_became_active":"2024-09-12T00:15:34.413875+0000","last_became_peered":"2024-09-12T00:15:34.413875+0000","last_unstale":"2024-09-12T00:34:57.505046+0000","last_undegraded":"2024-09-12T00:34:57.505046+0000","last_fullsized":"2024-09-12T00:34:57.505046+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:38.268487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":63,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:39.633876+0000","last_change":"2024-09-12T00:27:17.577218+0000","last_active":"2024-09-12T00:36:39.633876+0000","last_peered":"2024-09-12T00:36:39.633876+0000","last_clean":"2024-09-12T00:36:39.633876+0000","last_became_active":"2024-09-12T00:27:17.576878+0000","last_became_peered":"2024-09-12T00:27:17.576878+0000","last_unstale":"2024-09-12T00:36:39.633876+0000","last_undegraded":"2024-09-12T00:36:39.633876+0000","last_fullsized":"2024-09-12T00:36:39.633876+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.514295+0000","last_change":"2024-09-12T00:17:03.216054+0000","last_active":"2024-09-12T00:36:24.514295+0000","last_peered":"2024-09-12T00:36:24.514295+0000","last_clean":"2024-09-12T00:36:24.514295+0000","last_became_active":"2024-09-12T00:17:03.215625+0000","last_became_peered":"2024-09-12T00:17:03.215625+0000","last_unstale":"2024-09-12T00:36:24.514295+0000","last_undegraded":"2024-09-12T00:36:24.514295+0000","last_fullsized":"2024-09-12T00:36:24.514295+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.513783+0000","last_change":"2024-09-12T00:17:00.182907+0000","last_active":"2024-09-12T00:36:19.513783+0000","last_peered":"2024-09-12T00:36:19.513783+0000","last_clean":"2024-09-12T00:36:19.513783+0000","last_became_active":"2024-09-12T00:17:00.182392+0000","last_became_peered":"2024-09-12T00:17:00.182392+0000","last_unstale":"2024-09-12T00:36:19.513783+0000","last_undegraded":"2024-09-12T00:36:19.513783+0000","last_fullsized":"2024-09-12T00:36:19.513783+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:13.824576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:54.501773+0000","last_change":"2024-09-12T00:15:34.419666+0000","last_active":"2024-09-12T00:34:54.501773+0000","last_peered":"2024-09-12T00:34:54.501773+0000","last_clean":"2024-09-12T00:34:54.501773+0000","last_became_active":"2024-09-12T00:15:34.419377+0000","last_became_peered":"2024-09-12T00:15:34.419377+0000","last_unstale":"2024-09-12T00:34:54.501773+0000","last_undegraded":"2024-09-12T00:34:54.501773+0000","last_fullsized":"2024-09-12T00:34:54.501773+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:00.834278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:39.397479+0000","last_change":"2024-09-12T00:27:17.580695+0000","last_active":"2024-09-12T00:36:39.397479+0000","last_peered":"2024-09-12T00:36:39.397479+0000","last_clean":"2024-09-12T00:36:39.397479+0000","last_became_active":"2024-09-12T00:27:17.580400+0000","last_became_peered":"2024-09-12T00:27:17.580400+0000","last_unstale":"2024-09-12T00:36:39.397479+0000","last_undegraded":"2024-09-12T00:36:39.397479+0000","last_fullsized":"2024-09-12T00:36:39.397479+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"258'5","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.395465+0000","last_change":"2024-09-12T00:17:03.224050+0000","last_active":"2024-09-12T00:36:24.395465+0000","last_peered":"2024-09-12T00:36:24.395465+0000","last_clean":"2024-09-12T00:36:24.395465+0000","last_became_active":"2024-09-12T00:17:03.223700+0000","last_became_peered":"2024-09-12T00:17:03.223700+0000","last_unstale":"2024-09-12T00:36:24.395465+0000","last_undegraded":"2024-09-12T00:36:24.395465+0000","last_fullsized":"2024-09-12T00:36:24.395465+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.514252+0000","last_change":"2024-09-12T00:17:00.170090+0000","last_active":"2024-09-12T00:36:19.514252+0000","last_peered":"2024-09-12T00:36:19.514252+0000","last_clean":"2024-09-12T00:36:19.514252+0000","last_became_active":"2024-09-12T00:17:00.169797+0000","last_became_peered":"2024-09-12T00:17:00.169797+0000","last_unstale":"2024-09-12T00:36:19.514252+0000","last_undegraded":"2024-09-12T00:36:19.514252+0000","last_fullsized":"2024-09-12T00:36:19.514252+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'40","reported_seq":152,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.001555+0000","last_change":"2024-09-12T00:15:34.422467+0000","last_active":"2024-09-12T00:36:54.001555+0000","last_peered":"2024-09-12T00:36:54.001555+0000","last_clean":"2024-09-12T00:36:54.001555+0000","last_became_active":"2024-09-12T00:15:34.422176+0000","last_became_peered":"2024-09-12T00:15:34.422176+0000","last_unstale":"2024-09-12T00:36:54.001555+0000","last_undegraded":"2024-09-12T00:36:54.001555+0000","last_fullsized":"2024-09-12T00:36:54.001555+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":149,"num_write":70,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499308+0000","last_change":"2024-09-12T00:27:17.579910+0000","last_active":"2024-09-12T00:34:34.499308+0000","last_peered":"2024-09-12T00:34:34.499308+0000","last_clean":"2024-09-12T00:34:34.499308+0000","last_became_active":"2024-09-12T00:27:17.579646+0000","last_became_peered":"2024-09-12T00:27:17.579646+0000","last_unstale":"2024-09-12T00:34:34.499308+0000","last_undegraded":"2024-09-12T00:34:34.499308+0000","last_fullsized":"2024-09-12T00:34:34.499308+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:11.016979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"261'6","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:04.528413+0000","last_change":"2024-09-12T00:17:03.212032+0000","last_active":"2024-09-12T00:38:04.528413+0000","last_peered":"2024-09-12T00:38:04.528413+0000","last_clean":"2024-09-12T00:38:04.528413+0000","last_became_active":"2024-09-12T00:17:03.211732+0000","last_became_peered":"2024-09-12T00:17:03.211732+0000","last_unstale":"2024-09-12T00:38:04.528413+0000","last_undegraded":"2024-09-12T00:38:04.528413+0000","last_fullsized":"2024-09-12T00:38:04.528413+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:51.849541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"258'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:41.507507+0000","last_change":"2024-09-12T00:17:00.175751+0000","last_active":"2024-09-12T00:35:41.507507+0000","last_peered":"2024-09-12T00:35:41.507507+0000","last_clean":"2024-09-12T00:35:41.507507+0000","last_became_active":"2024-09-12T00:17:00.175460+0000","last_became_peered":"2024-09-12T00:17:00.175460+0000","last_unstale":"2024-09-12T00:35:41.507507+0000","last_undegraded":"2024-09-12T00:35:41.507507+0000","last_fullsized":"2024-09-12T00:35:41.507507+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:16.723140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'37","reported_seq":133,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:34.397817+0000","last_change":"2024-09-12T00:15:34.424716+0000","last_active":"2024-09-12T00:36:34.397817+0000","last_peered":"2024-09-12T00:36:34.397817+0000","last_clean":"2024-09-12T00:36:34.397817+0000","last_became_active":"2024-09-12T00:15:34.423734+0000","last_became_peered":"2024-09-12T00:15:34.423734+0000","last_unstale":"2024-09-12T00:36:34.397817+0000","last_undegraded":"2024-09-12T00:36:34.397817+0000","last_fullsized":"2024-09-12T00:36:34.397817+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":116,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498603+0000","last_change":"2024-09-12T00:27:17.574614+0000","last_active":"2024-09-12T00:34:34.498603+0000","last_peered":"2024-09-12T00:34:34.498603+0000","last_clean":"2024-09-12T00:34:34.498603+0000","last_became_active":"2024-09-12T00:27:17.574346+0000","last_became_peered":"2024-09-12T00:27:17.574346+0000","last_unstale":"2024-09-12T00:34:34.498603+0000","last_undegraded":"2024-09-12T00:34:34.498603+0000","last_fullsized":"2024-09-12T00:34:34.498603+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:58.931421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:04.528366+0000","last_change":"2024-09-12T00:17:03.210709+0000","last_active":"2024-09-12T00:38:04.528366+0000","last_peered":"2024-09-12T00:38:04.528366+0000","last_clean":"2024-09-12T00:38:04.528366+0000","last_became_active":"2024-09-12T00:17:03.210439+0000","last_became_peered":"2024-09-12T00:17:03.210439+0000","last_unstale":"2024-09-12T00:38:04.528366+0000","last_undegraded":"2024-09-12T00:38:04.528366+0000","last_fullsized":"2024-09-12T00:38:04.528366+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:13.002169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'2","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:59.527639+0000","last_change":"2024-09-12T00:17:00.179628+0000","last_active":"2024-09-12T00:37:59.527639+0000","last_peered":"2024-09-12T00:37:59.527639+0000","last_clean":"2024-09-12T00:37:59.527639+0000","last_became_active":"2024-09-12T00:17:00.179337+0000","last_became_peered":"2024-09-12T00:17:00.179337+0000","last_unstale":"2024-09-12T00:37:59.527639+0000","last_undegraded":"2024-09-12T00:37:59.527639+0000","last_fullsized":"2024-09-12T00:37:59.527639+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:55.994787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'135","reported_seq":451,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:34.515477+0000","last_change":"2024-09-12T00:15:34.421442+0000","last_active":"2024-09-12T00:36:34.515477+0000","last_peered":"2024-09-12T00:36:34.515477+0000","last_clean":"2024-09-12T00:36:34.515477+0000","last_became_active":"2024-09-12T00:15:34.421180+0000","last_became_peered":"2024-09-12T00:15:34.421180+0000","last_unstale":"2024-09-12T00:36:34.515477+0000","last_undegraded":"2024-09-12T00:36:34.515477+0000","last_fullsized":"2024-09-12T00:36:34.515477+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":617,"num_write":164,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:37.519416+0000","last_change":"2024-09-12T00:27:17.575634+0000","last_active":"2024-09-12T00:36:37.519416+0000","last_peered":"2024-09-12T00:36:37.519416+0000","last_clean":"2024-09-12T00:36:37.519416+0000","last_became_active":"2024-09-12T00:27:17.575257+0000","last_became_peered":"2024-09-12T00:27:17.575257+0000","last_unstale":"2024-09-12T00:36:37.519416+0000","last_undegraded":"2024-09-12T00:36:37.519416+0000","last_fullsized":"2024-09-12T00:36:37.519416+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'2","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:04.406864+0000","last_change":"2024-09-12T00:17:03.222496+0000","last_active":"2024-09-12T00:38:04.406864+0000","last_peered":"2024-09-12T00:38:04.406864+0000","last_clean":"2024-09-12T00:38:04.406864+0000","last_became_active":"2024-09-12T00:17:03.222110+0000","last_became_peered":"2024-09-12T00:17:03.222110+0000","last_unstale":"2024-09-12T00:38:04.406864+0000","last_undegraded":"2024-09-12T00:38:04.406864+0000","last_fullsized":"2024-09-12T00:38:04.406864+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:07.242934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:41.507584+0000","last_change":"2024-09-12T00:17:00.174832+0000","last_active":"2024-09-12T00:35:41.507584+0000","last_peered":"2024-09-12T00:35:41.507584+0000","last_clean":"2024-09-12T00:35:41.507584+0000","last_became_active":"2024-09-12T00:17:00.174537+0000","last_became_peered":"2024-09-12T00:17:00.174537+0000","last_unstale":"2024-09-12T00:35:41.507584+0000","last_undegraded":"2024-09-12T00:35:41.507584+0000","last_fullsized":"2024-09-12T00:35:41.507584+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:23.549160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"258'31","reported_seq":129,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:34.633348+0000","last_change":"2024-09-12T00:15:34.428066+0000","last_active":"2024-09-12T00:36:34.633348+0000","last_peered":"2024-09-12T00:36:34.633348+0000","last_clean":"2024-09-12T00:36:34.633348+0000","last_became_active":"2024-09-12T00:15:34.427756+0000","last_became_peered":"2024-09-12T00:15:34.427756+0000","last_unstale":"2024-09-12T00:36:34.633348+0000","last_undegraded":"2024-09-12T00:36:34.633348+0000","last_fullsized":"2024-09-12T00:36:34.633348+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":137,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.498569+0000","last_change":"2024-09-12T00:27:17.577377+0000","last_active":"2024-09-12T00:34:34.498569+0000","last_peered":"2024-09-12T00:34:34.498569+0000","last_clean":"2024-09-12T00:34:34.498569+0000","last_became_active":"2024-09-12T00:27:17.577076+0000","last_became_peered":"2024-09-12T00:27:17.577076+0000","last_unstale":"2024-09-12T00:34:34.498569+0000","last_undegraded":"2024-09-12T00:34:34.498569+0000","last_fullsized":"2024-09-12T00:34:34.498569+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:53.624069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391561+0000","last_change":"2024-09-12T00:17:03.217429+0000","last_active":"2024-09-12T00:35:44.391561+0000","last_peered":"2024-09-12T00:35:44.391561+0000","last_clean":"2024-09-12T00:35:44.391561+0000","last_became_active":"2024-09-12T00:17:03.217101+0000","last_became_peered":"2024-09-12T00:17:03.217101+0000","last_unstale":"2024-09-12T00:35:44.391561+0000","last_undegraded":"2024-09-12T00:35:44.391561+0000","last_fullsized":"2024-09-12T00:35:44.391561+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:37.636780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:41.507635+0000","last_change":"2024-09-12T00:17:00.180771+0000","last_active":"2024-09-12T00:35:41.507635+0000","last_peered":"2024-09-12T00:35:41.507635+0000","last_clean":"2024-09-12T00:35:41.507635+0000","last_became_active":"2024-09-12T00:17:00.180475+0000","last_became_peered":"2024-09-12T00:17:00.180475+0000","last_unstale":"2024-09-12T00:35:41.507635+0000","last_undegraded":"2024-09-12T00:35:41.507635+0000","last_fullsized":"2024-09-12T00:35:41.507635+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:32.615984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'61","reported_seq":208,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:34.515407+0000","last_change":"2024-09-12T00:15:34.419120+0000","last_active":"2024-09-12T00:36:34.515407+0000","last_peered":"2024-09-12T00:36:34.515407+0000","last_clean":"2024-09-12T00:36:34.515407+0000","last_became_active":"2024-09-12T00:15:34.418831+0000","last_became_peered":"2024-09-12T00:15:34.418831+0000","last_unstale":"2024-09-12T00:36:34.515407+0000","last_undegraded":"2024-09-12T00:36:34.515407+0000","last_fullsized":"2024-09-12T00:36:34.515407+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":218,"num_write":105,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.511752+0000","last_change":"2024-09-12T00:27:17.579649+0000","last_active":"2024-09-12T00:35:59.511752+0000","last_peered":"2024-09-12T00:35:59.511752+0000","last_clean":"2024-09-12T00:35:59.511752+0000","last_became_active":"2024-09-12T00:27:17.579263+0000","last_became_peered":"2024-09-12T00:27:17.579263+0000","last_unstale":"2024-09-12T00:35:59.511752+0000","last_undegraded":"2024-09-12T00:35:59.511752+0000","last_fullsized":"2024-09-12T00:35:59.511752+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:10.487761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"258'2","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503243+0000","last_change":"2024-09-12T00:17:03.211987+0000","last_active":"2024-09-12T00:35:04.503243+0000","last_peered":"2024-09-12T00:35:04.503243+0000","last_clean":"2024-09-12T00:35:04.503243+0000","last_became_active":"2024-09-12T00:17:03.211582+0000","last_became_peered":"2024-09-12T00:17:03.211582+0000","last_unstale":"2024-09-12T00:35:04.503243+0000","last_undegraded":"2024-09-12T00:35:04.503243+0000","last_fullsized":"2024-09-12T00:35:04.503243+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:27.493123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:14.638379+0000","last_change":"2024-09-12T00:17:00.182834+0000","last_active":"2024-09-12T00:37:14.638379+0000","last_peered":"2024-09-12T00:37:14.638379+0000","last_clean":"2024-09-12T00:37:14.638379+0000","last_became_active":"2024-09-12T00:17:00.182477+0000","last_became_peered":"2024-09-12T00:17:00.182477+0000","last_unstale":"2024-09-12T00:37:14.638379+0000","last_undegraded":"2024-09-12T00:37:14.638379+0000","last_fullsized":"2024-09-12T00:37:14.638379+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:39.317297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"258'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.510828+0000","last_change":"2024-09-12T00:15:34.419921+0000","last_active":"2024-09-12T00:35:54.510828+0000","last_peered":"2024-09-12T00:35:54.510828+0000","last_clean":"2024-09-12T00:35:54.510828+0000","last_became_active":"2024-09-12T00:15:34.419584+0000","last_became_peered":"2024-09-12T00:15:34.419584+0000","last_unstale":"2024-09-12T00:35:54.510828+0000","last_undegraded":"2024-09-12T00:35:54.510828+0000","last_fullsized":"2024-09-12T00:35:54.510828+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:04.179967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:16.512831+0000","last_change":"2024-09-12T00:27:17.580152+0000","last_active":"2024-09-12T00:36:16.512831+0000","last_peered":"2024-09-12T00:36:16.512831+0000","last_clean":"2024-09-12T00:36:16.512831+0000","last_became_active":"2024-09-12T00:27:17.579859+0000","last_became_peered":"2024-09-12T00:27:17.579859+0000","last_unstale":"2024-09-12T00:36:16.512831+0000","last_undegraded":"2024-09-12T00:36:16.512831+0000","last_fullsized":"2024-09-12T00:36:16.512831+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:44.205082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'3","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:19.521855+0000","last_change":"2024-09-12T00:17:03.216727+0000","last_active":"2024-09-12T00:37:19.521855+0000","last_peered":"2024-09-12T00:37:19.521855+0000","last_clean":"2024-09-12T00:37:19.521855+0000","last_became_active":"2024-09-12T00:17:03.216437+0000","last_became_peered":"2024-09-12T00:17:03.216437+0000","last_unstale":"2024-09-12T00:37:19.521855+0000","last_undegraded":"2024-09-12T00:37:19.521855+0000","last_fullsized":"2024-09-12T00:37:19.521855+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:54.699248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:59.502357+0000","last_change":"2024-09-12T00:17:00.179209+0000","last_active":"2024-09-12T00:34:59.502357+0000","last_peered":"2024-09-12T00:34:59.502357+0000","last_clean":"2024-09-12T00:34:59.502357+0000","last_became_active":"2024-09-12T00:17:00.178905+0000","last_became_peered":"2024-09-12T00:17:00.178905+0000","last_unstale":"2024-09-12T00:34:59.502357+0000","last_undegraded":"2024-09-12T00:34:59.502357+0000","last_fullsized":"2024-09-12T00:34:59.502357+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:09.052476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'17","reported_seq":81,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.392457+0000","last_change":"2024-09-12T00:15:34.419487+0000","last_active":"2024-09-12T00:35:49.392457+0000","last_peered":"2024-09-12T00:35:49.392457+0000","last_clean":"2024-09-12T00:35:49.392457+0000","last_became_active":"2024-09-12T00:15:34.418859+0000","last_became_peered":"2024-09-12T00:15:34.418859+0000","last_unstale":"2024-09-12T00:35:49.392457+0000","last_undegraded":"2024-09-12T00:35:49.392457+0000","last_fullsized":"2024-09-12T00:35:49.392457+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:58.036831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.393701+0000","last_change":"2024-09-12T00:27:17.579640+0000","last_active":"2024-09-12T00:35:59.393701+0000","last_peered":"2024-09-12T00:35:59.393701+0000","last_clean":"2024-09-12T00:35:59.393701+0000","last_became_active":"2024-09-12T00:27:17.577728+0000","last_became_peered":"2024-09-12T00:27:17.577728+0000","last_unstale":"2024-09-12T00:35:59.393701+0000","last_undegraded":"2024-09-12T00:35:59.393701+0000","last_fullsized":"2024-09-12T00:35:59.393701+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:51.317752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"261'13","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.732492+0000","last_change":"2024-09-12T00:17:03.215255+0000","last_active":"2024-09-12T00:38:37.732492+0000","last_peered":"2024-09-12T00:38:37.732492+0000","last_clean":"2024-09-12T00:38:37.732492+0000","last_became_active":"2024-09-12T00:17:03.214958+0000","last_became_peered":"2024-09-12T00:17:03.214958+0000","last_unstale":"2024-09-12T00:38:37.732492+0000","last_undegraded":"2024-09-12T00:38:37.732492+0000","last_fullsized":"2024-09-12T00:38:37.732492+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:24.067787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":22528,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"261'9","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.312475+0000","last_change":"2024-09-12T00:17:00.184968+0000","last_active":"2024-09-12T00:38:37.312475+0000","last_peered":"2024-09-12T00:38:37.312475+0000","last_clean":"2024-09-12T00:38:37.312475+0000","last_became_active":"2024-09-12T00:17:00.184703+0000","last_became_peered":"2024-09-12T00:17:00.184703+0000","last_unstale":"2024-09-12T00:38:37.312475+0000","last_undegraded":"2024-09-12T00:38:37.312475+0000","last_fullsized":"2024-09-12T00:38:37.312475+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:09.775190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":24576,"num_write":9,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'12","reported_seq":74,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:51.509350+0000","last_change":"2024-09-12T00:15:34.424421+0000","last_active":"2024-09-12T00:35:51.509350+0000","last_peered":"2024-09-12T00:35:51.509350+0000","last_clean":"2024-09-12T00:35:51.509350+0000","last_became_active":"2024-09-12T00:15:34.424129+0000","last_became_peered":"2024-09-12T00:15:34.424129+0000","last_unstale":"2024-09-12T00:35:51.509350+0000","last_undegraded":"2024-09-12T00:35:51.509350+0000","last_fullsized":"2024-09-12T00:35:51.509350+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:19.458965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:56.510098+0000","last_change":"2024-09-12T00:27:17.571287+0000","last_active":"2024-09-12T00:35:56.510098+0000","last_peered":"2024-09-12T00:35:56.510098+0000","last_clean":"2024-09-12T00:35:56.510098+0000","last_became_active":"2024-09-12T00:27:17.570973+0000","last_became_peered":"2024-09-12T00:27:17.570973+0000","last_unstale":"2024-09-12T00:35:56.510098+0000","last_undegraded":"2024-09-12T00:35:56.510098+0000","last_fullsized":"2024-09-12T00:35:56.510098+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:28.959152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"258'5","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503609+0000","last_change":"2024-09-12T00:17:03.221266+0000","last_active":"2024-09-12T00:35:04.503609+0000","last_peered":"2024-09-12T00:35:04.503609+0000","last_clean":"2024-09-12T00:35:04.503609+0000","last_became_active":"2024-09-12T00:17:03.220961+0000","last_became_peered":"2024-09-12T00:17:03.220961+0000","last_unstale":"2024-09-12T00:35:04.503609+0000","last_undegraded":"2024-09-12T00:35:04.503609+0000","last_fullsized":"2024-09-12T00:35:04.503609+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:28.129316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:19.521951+0000","last_change":"2024-09-12T00:17:00.178846+0000","last_active":"2024-09-12T00:37:19.521951+0000","last_peered":"2024-09-12T00:37:19.521951+0000","last_clean":"2024-09-12T00:37:19.521951+0000","last_became_active":"2024-09-12T00:17:00.178572+0000","last_became_peered":"2024-09-12T00:17:00.178572+0000","last_unstale":"2024-09-12T00:37:19.521951+0000","last_undegraded":"2024-09-12T00:37:19.521951+0000","last_fullsized":"2024-09-12T00:37:19.521951+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:24.934660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'26","reported_seq":111,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510002+0000","last_change":"2024-09-12T00:15:34.421329+0000","last_active":"2024-09-12T00:35:49.510002+0000","last_peered":"2024-09-12T00:35:49.510002+0000","last_clean":"2024-09-12T00:35:49.510002+0000","last_became_active":"2024-09-12T00:15:34.421019+0000","last_became_peered":"2024-09-12T00:15:34.421019+0000","last_unstale":"2024-09-12T00:35:49.510002+0000","last_undegraded":"2024-09-12T00:35:49.510002+0000","last_fullsized":"2024-09-12T00:35:49.510002+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:35.834745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":93,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.514214+0000","last_change":"2024-09-12T00:27:17.581884+0000","last_active":"2024-09-12T00:36:19.514214+0000","last_peered":"2024-09-12T00:36:19.514214+0000","last_clean":"2024-09-12T00:36:19.514214+0000","last_became_active":"2024-09-12T00:27:17.579926+0000","last_became_peered":"2024-09-12T00:27:17.579926+0000","last_unstale":"2024-09-12T00:36:19.514214+0000","last_undegraded":"2024-09-12T00:36:19.514214+0000","last_fullsized":"2024-09-12T00:36:19.514214+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:28.218032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'3","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.941017+0000","last_change":"2024-09-12T00:17:03.219491+0000","last_active":"2024-09-12T00:38:36.941017+0000","last_peered":"2024-09-12T00:38:36.941017+0000","last_clean":"2024-09-12T00:38:36.941017+0000","last_became_active":"2024-09-12T00:17:03.219156+0000","last_became_peered":"2024-09-12T00:17:03.219156+0000","last_unstale":"2024-09-12T00:38:36.941017+0000","last_undegraded":"2024-09-12T00:38:36.941017+0000","last_fullsized":"2024-09-12T00:38:36.941017+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.201727+0000","last_change":"2024-09-12T00:17:00.182726+0000","last_active":"2024-09-12T00:38:38.201727+0000","last_peered":"2024-09-12T00:38:38.201727+0000","last_clean":"2024-09-12T00:38:38.201727+0000","last_became_active":"2024-09-12T00:17:00.182424+0000","last_became_peered":"2024-09-12T00:17:00.182424+0000","last_unstale":"2024-09-12T00:38:38.201727+0000","last_undegraded":"2024-09-12T00:38:38.201727+0000","last_fullsized":"2024-09-12T00:38:38.201727+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:44.087656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"258'17","reported_seq":89,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.509911+0000","last_change":"2024-09-12T00:15:34.423351+0000","last_active":"2024-09-12T00:35:49.509911+0000","last_peered":"2024-09-12T00:35:49.509911+0000","last_clean":"2024-09-12T00:35:49.509911+0000","last_became_active":"2024-09-12T00:15:34.423037+0000","last_became_peered":"2024-09-12T00:15:34.423037+0000","last_unstale":"2024-09-12T00:35:49.509911+0000","last_undegraded":"2024-09-12T00:35:49.509911+0000","last_fullsized":"2024-09-12T00:35:49.509911+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:11.688876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":64,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.631221+0000","last_change":"2024-09-12T00:27:17.583413+0000","last_active":"2024-09-12T00:36:19.631221+0000","last_peered":"2024-09-12T00:36:19.631221+0000","last_clean":"2024-09-12T00:36:19.631221+0000","last_became_active":"2024-09-12T00:27:17.583096+0000","last_became_peered":"2024-09-12T00:27:17.583096+0000","last_unstale":"2024-09-12T00:36:19.631221+0000","last_undegraded":"2024-09-12T00:36:19.631221+0000","last_fullsized":"2024-09-12T00:36:19.631221+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:05.013570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.448506+0000","last_change":"2024-09-12T00:17:03.214309+0000","last_active":"2024-09-12T00:38:37.448506+0000","last_peered":"2024-09-12T00:38:37.448506+0000","last_clean":"2024-09-12T00:38:37.448506+0000","last_became_active":"2024-09-12T00:17:03.214023+0000","last_became_peered":"2024-09-12T00:17:03.214023+0000","last_unstale":"2024-09-12T00:38:37.448506+0000","last_undegraded":"2024-09-12T00:38:37.448506+0000","last_fullsized":"2024-09-12T00:38:37.448506+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.086781+0000","last_change":"2024-09-12T00:17:00.178739+0000","last_active":"2024-09-12T00:38:37.086781+0000","last_peered":"2024-09-12T00:38:37.086781+0000","last_clean":"2024-09-12T00:38:37.086781+0000","last_became_active":"2024-09-12T00:17:00.178465+0000","last_became_peered":"2024-09-12T00:17:00.178465+0000","last_unstale":"2024-09-12T00:38:37.086781+0000","last_undegraded":"2024-09-12T00:38:37.086781+0000","last_fullsized":"2024-09-12T00:38:37.086781+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:08.316507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'34","reported_seq":137,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:27.839282+0000","last_change":"2024-09-12T00:15:34.425982+0000","last_active":"2024-09-12T00:36:27.839282+0000","last_peered":"2024-09-12T00:36:27.839282+0000","last_clean":"2024-09-12T00:36:27.839282+0000","last_became_active":"2024-09-12T00:15:34.425540+0000","last_became_peered":"2024-09-12T00:15:34.425540+0000","last_unstale":"2024-09-12T00:36:27.839282+0000","last_undegraded":"2024-09-12T00:36:27.839282+0000","last_fullsized":"2024-09-12T00:36:27.839282+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:11.621389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":136,"num_write":51,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.394938+0000","last_change":"2024-09-12T00:27:17.582031+0000","last_active":"2024-09-12T00:36:19.394938+0000","last_peered":"2024-09-12T00:36:19.394938+0000","last_clean":"2024-09-12T00:36:19.394938+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:36:19.394938+0000","last_undegraded":"2024-09-12T00:36:19.394938+0000","last_fullsized":"2024-09-12T00:36:19.394938+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:26.824932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503080+0000","last_change":"2024-09-12T00:17:03.212419+0000","last_active":"2024-09-12T00:35:04.503080+0000","last_peered":"2024-09-12T00:35:04.503080+0000","last_clean":"2024-09-12T00:35:04.503080+0000","last_became_active":"2024-09-12T00:17:03.212150+0000","last_became_peered":"2024-09-12T00:17:03.212150+0000","last_unstale":"2024-09-12T00:35:04.503080+0000","last_undegraded":"2024-09-12T00:35:04.503080+0000","last_fullsized":"2024-09-12T00:35:04.503080+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:25.410634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"261'8","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.086918+0000","last_change":"2024-09-12T00:17:00.181254+0000","last_active":"2024-09-12T00:38:37.086918+0000","last_peered":"2024-09-12T00:38:37.086918+0000","last_clean":"2024-09-12T00:38:37.086918+0000","last_became_active":"2024-09-12T00:17:00.180944+0000","last_became_peered":"2024-09-12T00:17:00.180944+0000","last_unstale":"2024-09-12T00:38:37.086918+0000","last_undegraded":"2024-09-12T00:38:37.086918+0000","last_fullsized":"2024-09-12T00:38:37.086918+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6171,"num_write":13,"num_write_kb":11291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'34","reported_seq":126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.095497+0000","last_change":"2024-09-12T00:15:34.419063+0000","last_active":"2024-09-12T00:36:56.095497+0000","last_peered":"2024-09-12T00:36:56.095497+0000","last_clean":"2024-09-12T00:36:56.095497+0000","last_became_active":"2024-09-12T00:15:34.418474+0000","last_became_peered":"2024-09-12T00:15:34.418474+0000","last_unstale":"2024-09-12T00:36:56.095497+0000","last_undegraded":"2024-09-12T00:36:56.095497+0000","last_fullsized":"2024-09-12T00:36:56.095497+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:27.863297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.513761+0000","last_change":"2024-09-12T00:27:17.581423+0000","last_active":"2024-09-12T00:36:19.513761+0000","last_peered":"2024-09-12T00:36:19.513761+0000","last_clean":"2024-09-12T00:36:19.513761+0000","last_became_active":"2024-09-12T00:27:17.581149+0000","last_became_peered":"2024-09-12T00:27:17.581149+0000","last_unstale":"2024-09-12T00:36:19.513761+0000","last_undegraded":"2024-09-12T00:36:19.513761+0000","last_fullsized":"2024-09-12T00:36:19.513761+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:04.939255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:39.397512+0000","last_change":"2024-09-12T00:17:03.221232+0000","last_active":"2024-09-12T00:36:39.397512+0000","last_peered":"2024-09-12T00:36:39.397512+0000","last_clean":"2024-09-12T00:36:39.397512+0000","last_became_active":"2024-09-12T00:17:03.220965+0000","last_became_peered":"2024-09-12T00:17:03.220965+0000","last_unstale":"2024-09-12T00:36:39.397512+0000","last_undegraded":"2024-09-12T00:36:39.397512+0000","last_fullsized":"2024-09-12T00:36:39.397512+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'12","reported_seq":67,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:14.402675+0000","last_change":"2024-09-12T00:17:00.185880+0000","last_active":"2024-09-12T00:37:14.402675+0000","last_peered":"2024-09-12T00:37:14.402675+0000","last_clean":"2024-09-12T00:37:14.402675+0000","last_became_active":"2024-09-12T00:17:00.185600+0000","last_became_peered":"2024-09-12T00:17:00.185600+0000","last_unstale":"2024-09-12T00:37:14.402675+0000","last_undegraded":"2024-09-12T00:37:14.402675+0000","last_fullsized":"2024-09-12T00:37:14.402675+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.338622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":41662,"num_write":17,"num_write_kb":10938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'54","reported_seq":186,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:25.312227+0000","last_change":"2024-09-12T00:15:34.417774+0000","last_active":"2024-09-12T00:36:25.312227+0000","last_peered":"2024-09-12T00:36:25.312227+0000","last_clean":"2024-09-12T00:36:25.312227+0000","last_became_active":"2024-09-12T00:15:34.417393+0000","last_became_peered":"2024-09-12T00:15:34.417393+0000","last_unstale":"2024-09-12T00:36:25.312227+0000","last_undegraded":"2024-09-12T00:36:25.312227+0000","last_fullsized":"2024-09-12T00:36:25.312227+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:49.338246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":189,"num_write":107,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390022+0000","last_change":"2024-09-12T00:27:17.580912+0000","last_active":"2024-09-12T00:35:39.390022+0000","last_peered":"2024-09-12T00:35:39.390022+0000","last_clean":"2024-09-12T00:35:39.390022+0000","last_became_active":"2024-09-12T00:27:17.578983+0000","last_became_peered":"2024-09-12T00:27:17.578983+0000","last_unstale":"2024-09-12T00:35:39.390022+0000","last_undegraded":"2024-09-12T00:35:39.390022+0000","last_fullsized":"2024-09-12T00:35:39.390022+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.598333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"258'10","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510247+0000","last_change":"2024-09-12T00:17:03.210161+0000","last_active":"2024-09-12T00:35:49.510247+0000","last_peered":"2024-09-12T00:35:49.510247+0000","last_clean":"2024-09-12T00:35:49.510247+0000","last_became_active":"2024-09-12T00:17:03.209874+0000","last_became_peered":"2024-09-12T00:17:03.209874+0000","last_unstale":"2024-09-12T00:35:49.510247+0000","last_undegraded":"2024-09-12T00:35:49.510247+0000","last_fullsized":"2024-09-12T00:35:49.510247+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:07.562732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":41988,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"258'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391613+0000","last_change":"2024-09-12T00:17:00.186026+0000","last_active":"2024-09-12T00:35:44.391613+0000","last_peered":"2024-09-12T00:35:44.391613+0000","last_clean":"2024-09-12T00:35:44.391613+0000","last_became_active":"2024-09-12T00:17:00.185688+0000","last_became_peered":"2024-09-12T00:17:00.185688+0000","last_unstale":"2024-09-12T00:35:44.391613+0000","last_undegraded":"2024-09-12T00:35:44.391613+0000","last_fullsized":"2024-09-12T00:35:44.391613+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:40.682390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":157,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:15.301825+0000","last_change":"2024-09-12T00:15:34.412266+0000","last_active":"2024-09-12T00:36:15.301825+0000","last_peered":"2024-09-12T00:36:15.301825+0000","last_clean":"2024-09-12T00:36:15.301825+0000","last_became_active":"2024-09-12T00:15:34.411977+0000","last_became_peered":"2024-09-12T00:15:34.411977+0000","last_unstale":"2024-09-12T00:36:15.301825+0000","last_undegraded":"2024-09-12T00:36:15.301825+0000","last_fullsized":"2024-09-12T00:36:15.301825+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:53.336733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":161,"num_write":73,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390048+0000","last_change":"2024-09-12T00:27:17.579176+0000","last_active":"2024-09-12T00:35:39.390048+0000","last_peered":"2024-09-12T00:35:39.390048+0000","last_clean":"2024-09-12T00:35:39.390048+0000","last_became_active":"2024-09-12T00:27:17.578763+0000","last_became_peered":"2024-09-12T00:27:17.578763+0000","last_unstale":"2024-09-12T00:35:39.390048+0000","last_undegraded":"2024-09-12T00:35:39.390048+0000","last_fullsized":"2024-09-12T00:35:39.390048+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:54.867145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510203+0000","last_change":"2024-09-12T00:17:03.216611+0000","last_active":"2024-09-12T00:35:49.510203+0000","last_peered":"2024-09-12T00:35:49.510203+0000","last_clean":"2024-09-12T00:35:49.510203+0000","last_became_active":"2024-09-12T00:17:03.216349+0000","last_became_peered":"2024-09-12T00:17:03.216349+0000","last_unstale":"2024-09-12T00:35:49.510203+0000","last_undegraded":"2024-09-12T00:35:49.510203+0000","last_fullsized":"2024-09-12T00:35:49.510203+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:48.582027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'3","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:52.530059+0000","last_change":"2024-09-12T00:17:00.183051+0000","last_active":"2024-09-12T00:37:52.530059+0000","last_peered":"2024-09-12T00:37:52.530059+0000","last_clean":"2024-09-12T00:37:52.530059+0000","last_became_active":"2024-09-12T00:17:00.182780+0000","last_became_peered":"2024-09-12T00:17:00.182780+0000","last_unstale":"2024-09-12T00:37:52.530059+0000","last_undegraded":"2024-09-12T00:37:52.530059+0000","last_fullsized":"2024-09-12T00:37:52.530059+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:39.837277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'38","reported_seq":141,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.386303+0000","last_change":"2024-09-12T00:15:34.410030+0000","last_active":"2024-09-12T00:35:04.386303+0000","last_peered":"2024-09-12T00:35:04.386303+0000","last_clean":"2024-09-12T00:35:04.386303+0000","last_became_active":"2024-09-12T00:15:34.409622+0000","last_became_peered":"2024-09-12T00:15:34.409622+0000","last_unstale":"2024-09-12T00:35:04.386303+0000","last_undegraded":"2024-09-12T00:35:04.386303+0000","last_fullsized":"2024-09-12T00:35:04.386303+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:55.447920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":134,"num_write":65,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:19.505635+0000","last_change":"2024-09-12T00:27:17.582282+0000","last_active":"2024-09-12T00:35:19.505635+0000","last_peered":"2024-09-12T00:35:19.505635+0000","last_clean":"2024-09-12T00:35:19.505635+0000","last_became_active":"2024-09-12T00:27:17.581993+0000","last_became_peered":"2024-09-12T00:27:17.581993+0000","last_unstale":"2024-09-12T00:35:19.505635+0000","last_undegraded":"2024-09-12T00:35:19.505635+0000","last_fullsized":"2024-09-12T00:35:19.505635+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:14.848118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.473845+0000","last_change":"2024-09-12T00:17:03.220273+0000","last_active":"2024-09-12T00:38:36.473845+0000","last_peered":"2024-09-12T00:38:36.473845+0000","last_clean":"2024-09-12T00:38:36.473845+0000","last_became_active":"2024-09-12T00:17:03.219888+0000","last_became_peered":"2024-09-12T00:17:03.219888+0000","last_unstale":"2024-09-12T00:38:36.473845+0000","last_undegraded":"2024-09-12T00:38:36.473845+0000","last_fullsized":"2024-09-12T00:38:36.473845+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"258'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:29.632606+0000","last_change":"2024-09-12T00:17:00.170322+0000","last_active":"2024-09-12T00:36:29.632606+0000","last_peered":"2024-09-12T00:36:29.632606+0000","last_clean":"2024-09-12T00:36:29.632606+0000","last_became_active":"2024-09-12T00:17:00.169299+0000","last_became_peered":"2024-09-12T00:17:00.169299+0000","last_unstale":"2024-09-12T00:36:29.632606+0000","last_undegraded":"2024-09-12T00:36:29.632606+0000","last_fullsized":"2024-09-12T00:36:29.632606+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:43.905465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'48","reported_seq":176,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.631907+0000","last_change":"2024-09-12T00:15:34.428023+0000","last_active":"2024-09-12T00:36:24.631907+0000","last_peered":"2024-09-12T00:36:24.631907+0000","last_clean":"2024-09-12T00:36:24.631907+0000","last_became_active":"2024-09-12T00:15:34.427735+0000","last_became_peered":"2024-09-12T00:15:34.427735+0000","last_unstale":"2024-09-12T00:36:24.631907+0000","last_undegraded":"2024-09-12T00:36:24.631907+0000","last_fullsized":"2024-09-12T00:36:24.631907+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:09.348935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":182,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390825+0000","last_change":"2024-09-12T00:27:17.573147+0000","last_active":"2024-09-12T00:35:39.390825+0000","last_peered":"2024-09-12T00:35:39.390825+0000","last_clean":"2024-09-12T00:35:39.390825+0000","last_became_active":"2024-09-12T00:27:17.572817+0000","last_became_peered":"2024-09-12T00:27:17.572817+0000","last_unstale":"2024-09-12T00:35:39.390825+0000","last_undegraded":"2024-09-12T00:35:39.390825+0000","last_fullsized":"2024-09-12T00:35:39.390825+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:43.980881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"261'6","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.447617+0000","last_change":"2024-09-12T00:17:03.220324+0000","last_active":"2024-09-12T00:38:37.447617+0000","last_peered":"2024-09-12T00:38:37.447617+0000","last_clean":"2024-09-12T00:38:37.447617+0000","last_became_active":"2024-09-12T00:17:03.219129+0000","last_became_peered":"2024-09-12T00:17:03.219129+0000","last_unstale":"2024-09-12T00:38:37.447617+0000","last_undegraded":"2024-09-12T00:38:37.447617+0000","last_fullsized":"2024-09-12T00:38:37.447617+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'6","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.088297+0000","last_change":"2024-09-12T00:17:00.182941+0000","last_active":"2024-09-12T00:38:37.088297+0000","last_peered":"2024-09-12T00:38:37.088297+0000","last_clean":"2024-09-12T00:38:37.088297+0000","last_became_active":"2024-09-12T00:17:00.182301+0000","last_became_peered":"2024-09-12T00:17:00.182301+0000","last_unstale":"2024-09-12T00:38:37.088297+0000","last_undegraded":"2024-09-12T00:38:37.088297+0000","last_fullsized":"2024-09-12T00:38:37.088297+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:08.258223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'23","reported_seq":102,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.514235+0000","last_change":"2024-09-12T00:15:34.428381+0000","last_active":"2024-09-12T00:36:24.514235+0000","last_peered":"2024-09-12T00:36:24.514235+0000","last_clean":"2024-09-12T00:36:24.514235+0000","last_became_active":"2024-09-12T00:15:34.428056+0000","last_became_peered":"2024-09-12T00:15:34.428056+0000","last_unstale":"2024-09-12T00:36:24.514235+0000","last_undegraded":"2024-09-12T00:36:24.514235+0000","last_fullsized":"2024-09-12T00:36:24.514235+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:43.858120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.511476+0000","last_change":"2024-09-12T00:27:17.575634+0000","last_active":"2024-09-12T00:35:59.511476+0000","last_peered":"2024-09-12T00:35:59.511476+0000","last_clean":"2024-09-12T00:35:59.511476+0000","last_became_active":"2024-09-12T00:27:17.575332+0000","last_became_peered":"2024-09-12T00:27:17.575332+0000","last_unstale":"2024-09-12T00:35:59.511476+0000","last_undegraded":"2024-09-12T00:35:59.511476+0000","last_fullsized":"2024-09-12T00:35:59.511476+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:10.996773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"258'6","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:47.512261+0000","last_change":"2024-09-12T00:17:03.206898+0000","last_active":"2024-09-12T00:35:47.512261+0000","last_peered":"2024-09-12T00:35:47.512261+0000","last_clean":"2024-09-12T00:35:47.512261+0000","last_became_active":"2024-09-12T00:17:03.206580+0000","last_became_peered":"2024-09-12T00:17:03.206580+0000","last_unstale":"2024-09-12T00:35:47.512261+0000","last_undegraded":"2024-09-12T00:35:47.512261+0000","last_fullsized":"2024-09-12T00:35:47.512261+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:19.086717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.636512+0000","last_change":"2024-09-12T00:17:00.169805+0000","last_active":"2024-09-12T00:36:59.636512+0000","last_peered":"2024-09-12T00:36:59.636512+0000","last_clean":"2024-09-12T00:36:59.636512+0000","last_became_active":"2024-09-12T00:17:00.169464+0000","last_became_peered":"2024-09-12T00:17:00.169464+0000","last_unstale":"2024-09-12T00:36:59.636512+0000","last_undegraded":"2024-09-12T00:36:59.636512+0000","last_fullsized":"2024-09-12T00:36:59.636512+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:30.563501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'22","reported_seq":97,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.631855+0000","last_change":"2024-09-12T00:15:34.428025+0000","last_active":"2024-09-12T00:36:24.631855+0000","last_peered":"2024-09-12T00:36:24.631855+0000","last_clean":"2024-09-12T00:36:24.631855+0000","last_became_active":"2024-09-12T00:15:34.427661+0000","last_became_peered":"2024-09-12T00:15:34.427661+0000","last_unstale":"2024-09-12T00:36:24.631855+0000","last_undegraded":"2024-09-12T00:36:24.631855+0000","last_fullsized":"2024-09-12T00:36:24.631855+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:18.676590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":70,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.514020+0000","last_change":"2024-09-12T00:27:17.576241+0000","last_active":"2024-09-12T00:35:57.514020+0000","last_peered":"2024-09-12T00:35:57.514020+0000","last_clean":"2024-09-12T00:35:57.514020+0000","last_became_active":"2024-09-12T00:27:17.575941+0000","last_became_peered":"2024-09-12T00:27:17.575941+0000","last_unstale":"2024-09-12T00:35:57.514020+0000","last_undegraded":"2024-09-12T00:35:57.514020+0000","last_fullsized":"2024-09-12T00:35:57.514020+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:41.216300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'2","reported_seq":32,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.402055+0000","last_change":"2024-09-12T00:17:03.218016+0000","last_active":"2024-09-12T00:37:09.402055+0000","last_peered":"2024-09-12T00:37:09.402055+0000","last_clean":"2024-09-12T00:37:09.402055+0000","last_became_active":"2024-09-12T00:17:03.217678+0000","last_became_peered":"2024-09-12T00:17:03.217678+0000","last_unstale":"2024-09-12T00:37:09.402055+0000","last_undegraded":"2024-09-12T00:37:09.402055+0000","last_fullsized":"2024-09-12T00:37:09.402055+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:41.125288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'5","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:49.406773+0000","last_change":"2024-09-12T00:17:00.186355+0000","last_active":"2024-09-12T00:37:49.406773+0000","last_peered":"2024-09-12T00:37:49.406773+0000","last_clean":"2024-09-12T00:37:49.406773+0000","last_became_active":"2024-09-12T00:17:00.185637+0000","last_became_peered":"2024-09-12T00:17:00.185637+0000","last_unstale":"2024-09-12T00:37:49.406773+0000","last_undegraded":"2024-09-12T00:37:49.406773+0000","last_fullsized":"2024-09-12T00:37:49.406773+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:36.584176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396562+0000","last_change":"2024-09-12T00:15:34.408975+0000","last_active":"2024-09-12T00:36:24.396562+0000","last_peered":"2024-09-12T00:36:24.396562+0000","last_clean":"2024-09-12T00:36:24.396562+0000","last_became_active":"2024-09-12T00:15:34.408612+0000","last_became_peered":"2024-09-12T00:15:34.408612+0000","last_unstale":"2024-09-12T00:36:24.396562+0000","last_undegraded":"2024-09-12T00:36:24.396562+0000","last_fullsized":"2024-09-12T00:36:24.396562+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:00.278541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":97,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.508580+0000","last_change":"2024-09-12T00:27:17.579650+0000","last_active":"2024-09-12T00:35:39.508580+0000","last_peered":"2024-09-12T00:35:39.508580+0000","last_clean":"2024-09-12T00:35:39.508580+0000","last_became_active":"2024-09-12T00:27:17.579332+0000","last_became_peered":"2024-09-12T00:27:17.579332+0000","last_unstale":"2024-09-12T00:35:39.508580+0000","last_undegraded":"2024-09-12T00:35:39.508580+0000","last_fullsized":"2024-09-12T00:35:39.508580+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:02.812642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627538+0000","last_change":"2024-09-12T00:17:03.203730+0000","last_active":"2024-09-12T00:35:49.627538+0000","last_peered":"2024-09-12T00:35:49.627538+0000","last_clean":"2024-09-12T00:35:49.627538+0000","last_became_active":"2024-09-12T00:17:03.203401+0000","last_became_peered":"2024-09-12T00:17:03.203401+0000","last_unstale":"2024-09-12T00:35:49.627538+0000","last_undegraded":"2024-09-12T00:35:49.627538+0000","last_fullsized":"2024-09-12T00:35:49.627538+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:07.999569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509116+0000","last_change":"2024-09-12T00:17:00.181373+0000","last_active":"2024-09-12T00:35:44.509116+0000","last_peered":"2024-09-12T00:35:44.509116+0000","last_clean":"2024-09-12T00:35:44.509116+0000","last_became_active":"2024-09-12T00:17:00.181095+0000","last_became_peered":"2024-09-12T00:17:00.181095+0000","last_unstale":"2024-09-12T00:35:44.509116+0000","last_undegraded":"2024-09-12T00:35:44.509116+0000","last_fullsized":"2024-09-12T00:35:44.509116+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:49.208397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'19","reported_seq":93,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396515+0000","last_change":"2024-09-12T00:15:34.421629+0000","last_active":"2024-09-12T00:36:24.396515+0000","last_peered":"2024-09-12T00:36:24.396515+0000","last_clean":"2024-09-12T00:36:24.396515+0000","last_became_active":"2024-09-12T00:15:34.420583+0000","last_became_peered":"2024-09-12T00:15:34.420583+0000","last_unstale":"2024-09-12T00:36:24.396515+0000","last_undegraded":"2024-09-12T00:36:24.396515+0000","last_fullsized":"2024-09-12T00:36:24.396515+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:19.714778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391630+0000","last_change":"2024-09-12T00:27:17.580218+0000","last_active":"2024-09-12T00:35:44.391630+0000","last_peered":"2024-09-12T00:35:44.391630+0000","last_clean":"2024-09-12T00:35:44.391630+0000","last_became_active":"2024-09-12T00:27:17.579957+0000","last_became_peered":"2024-09-12T00:27:17.579957+0000","last_unstale":"2024-09-12T00:35:44.391630+0000","last_undegraded":"2024-09-12T00:35:44.391630+0000","last_fullsized":"2024-09-12T00:35:44.391630+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:50.892944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627493+0000","last_change":"2024-09-12T00:17:03.222544+0000","last_active":"2024-09-12T00:35:49.627493+0000","last_peered":"2024-09-12T00:35:49.627493+0000","last_clean":"2024-09-12T00:35:49.627493+0000","last_became_active":"2024-09-12T00:17:03.222212+0000","last_became_peered":"2024-09-12T00:17:03.222212+0000","last_unstale":"2024-09-12T00:35:49.627493+0000","last_undegraded":"2024-09-12T00:35:49.627493+0000","last_fullsized":"2024-09-12T00:35:49.627493+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:51.034286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"258'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:46.508514+0000","last_change":"2024-09-12T00:17:00.184916+0000","last_active":"2024-09-12T00:35:46.508514+0000","last_peered":"2024-09-12T00:35:46.508514+0000","last_clean":"2024-09-12T00:35:46.508514+0000","last_became_active":"2024-09-12T00:17:00.184654+0000","last_became_peered":"2024-09-12T00:17:00.184654+0000","last_unstale":"2024-09-12T00:35:46.508514+0000","last_undegraded":"2024-09-12T00:35:46.508514+0000","last_fullsized":"2024-09-12T00:35:46.508514+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:59.225633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'33","reported_seq":130,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:55.935669+0000","last_change":"2024-09-12T00:15:34.425813+0000","last_active":"2024-09-12T00:36:55.935669+0000","last_peered":"2024-09-12T00:36:55.935669+0000","last_clean":"2024-09-12T00:36:55.935669+0000","last_became_active":"2024-09-12T00:15:34.425489+0000","last_became_peered":"2024-09-12T00:15:34.425489+0000","last_unstale":"2024-09-12T00:36:55.935669+0000","last_undegraded":"2024-09-12T00:36:55.935669+0000","last_fullsized":"2024-09-12T00:36:55.935669+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:24.112153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":114,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'331","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.232372+0000","last_change":"2024-09-12T00:38:52.232372+0000","last_active":"2024-09-12T00:38:52.232372+0000","last_peered":"2024-09-12T00:38:52.232372+0000","last_clean":"2024-09-12T00:38:52.232372+0000","last_became_active":"2024-09-12T00:01:57.152039+0000","last_became_peered":"2024-09-12T00:01:57.152039+0000","last_unstale":"2024-09-12T00:38:52.232372+0000","last_undegraded":"2024-09-12T00:38:52.232372+0000","last_fullsized":"2024-09-12T00:38:52.232372+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'331","last_scrub_stamp":"2024-09-12T00:38:52.232200+0000","last_deep_scrub":"261'331","last_deep_scrub_stamp":"2024-09-12T00:38:52.232200+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.232200+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:40.965953+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":62278,"num_write":1122,"num_write_kb":40244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'78","reported_seq":667,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.421103+0000","last_change":"2024-09-12T00:38:58.421103+0000","last_active":"2024-09-12T00:38:58.421103+0000","last_peered":"2024-09-12T00:38:58.421103+0000","last_clean":"2024-09-12T00:38:58.421103+0000","last_became_active":"2024-09-12T00:01:59.156166+0000","last_became_peered":"2024-09-12T00:01:59.156166+0000","last_unstale":"2024-09-12T00:38:58.421103+0000","last_undegraded":"2024-09-12T00:38:58.421103+0000","last_fullsized":"2024-09-12T00:38:58.421103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'78","last_scrub_stamp":"2024-09-12T00:38:58.421001+0000","last_deep_scrub":"261'78","last_deep_scrub_stamp":"2024-09-12T00:38:58.421001+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.421001+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:08.530267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":327,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'318","reported_seq":960,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.805750+0000","last_change":"2024-09-12T00:38:57.805750+0000","last_active":"2024-09-12T00:38:57.805750+0000","last_peered":"2024-09-12T00:38:57.805750+0000","last_clean":"2024-09-12T00:38:57.805750+0000","last_became_active":"2024-09-12T00:01:57.147519+0000","last_became_peered":"2024-09-12T00:01:57.147519+0000","last_unstale":"2024-09-12T00:38:57.805750+0000","last_undegraded":"2024-09-12T00:38:57.805750+0000","last_fullsized":"2024-09-12T00:38:57.805750+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'318","last_scrub_stamp":"2024-09-12T00:38:57.805642+0000","last_deep_scrub":"261'318","last_deep_scrub_stamp":"2024-09-12T00:38:57.805642+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.805642+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:55.449630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":64019,"num_write":1006,"num_write_kb":35322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'285","reported_seq":942,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.878962+0000","last_change":"2024-09-12T00:01:59.140999+0000","last_active":"2024-09-12T00:36:58.878962+0000","last_peered":"2024-09-12T00:36:58.878962+0000","last_clean":"2024-09-12T00:36:58.878962+0000","last_became_active":"2024-09-12T00:01:59.140661+0000","last_became_peered":"2024-09-12T00:01:59.140661+0000","last_unstale":"2024-09-12T00:36:58.878962+0000","last_undegraded":"2024-09-12T00:36:58.878962+0000","last_fullsized":"2024-09-12T00:36:58.878962+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:42.180513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1344,"num_read_kb":1119,"num_write":493,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'353","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.803618+0000","last_change":"2024-09-12T00:38:55.803618+0000","last_active":"2024-09-12T00:38:55.803618+0000","last_peered":"2024-09-12T00:38:55.803618+0000","last_clean":"2024-09-12T00:38:55.803618+0000","last_became_active":"2024-09-12T00:01:57.140885+0000","last_became_peered":"2024-09-12T00:01:57.140885+0000","last_unstale":"2024-09-12T00:38:55.803618+0000","last_undegraded":"2024-09-12T00:38:55.803618+0000","last_fullsized":"2024-09-12T00:38:55.803618+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T00:38:55.803496+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T00:38:55.803496+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.803496+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:39.294089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":495,"num_read_kb":8973,"num_write":1119,"num_write_kb":33019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'357","reported_seq":997,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.252007+0000","last_change":"2024-09-12T00:01:59.145361+0000","last_active":"2024-09-12T00:36:59.252007+0000","last_peered":"2024-09-12T00:36:59.252007+0000","last_clean":"2024-09-12T00:36:59.252007+0000","last_became_active":"2024-09-12T00:01:59.144660+0000","last_became_peered":"2024-09-12T00:01:59.144660+0000","last_unstale":"2024-09-12T00:36:59.252007+0000","last_undegraded":"2024-09-12T00:36:59.252007+0000","last_fullsized":"2024-09-12T00:36:59.252007+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:56.723947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1585,"num_read_kb":1295,"num_write":589,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'362","reported_seq":996,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.044672+0000","last_change":"2024-09-12T00:38:48.044672+0000","last_active":"2024-09-12T00:38:48.044672+0000","last_peered":"2024-09-12T00:38:48.044672+0000","last_clean":"2024-09-12T00:38:48.044672+0000","last_became_active":"2024-09-12T00:01:57.154749+0000","last_became_peered":"2024-09-12T00:01:57.154749+0000","last_unstale":"2024-09-12T00:38:48.044672+0000","last_undegraded":"2024-09-12T00:38:48.044672+0000","last_fullsized":"2024-09-12T00:38:48.044672+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'362","last_scrub_stamp":"2024-09-12T00:38:48.044510+0000","last_deep_scrub":"261'362","last_deep_scrub_stamp":"2024-09-12T00:38:48.044510+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.044510+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:47.176239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":533,"num_read_kb":65054,"num_write":1136,"num_write_kb":38777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'303","reported_seq":933,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.535670+0000","last_change":"2024-09-12T00:39:00.535670+0000","last_active":"2024-09-12T00:39:00.535670+0000","last_peered":"2024-09-12T00:39:00.535670+0000","last_clean":"2024-09-12T00:39:00.535670+0000","last_became_active":"2024-09-12T00:01:59.146925+0000","last_became_peered":"2024-09-12T00:01:59.146925+0000","last_unstale":"2024-09-12T00:39:00.535670+0000","last_undegraded":"2024-09-12T00:39:00.535670+0000","last_fullsized":"2024-09-12T00:39:00.535670+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'303","last_scrub_stamp":"2024-09-12T00:39:00.535589+0000","last_deep_scrub":"261'303","last_deep_scrub_stamp":"2024-09-12T00:39:00.535589+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.535589+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:53.374654+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1201,"num_read_kb":972,"num_write":449,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'361","reported_seq":1105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.196352+0000","last_change":"2024-09-12T00:38:51.196352+0000","last_active":"2024-09-12T00:38:51.196352+0000","last_peered":"2024-09-12T00:38:51.196352+0000","last_clean":"2024-09-12T00:38:51.196352+0000","last_became_active":"2024-09-12T00:01:57.151028+0000","last_became_peered":"2024-09-12T00:01:57.151028+0000","last_unstale":"2024-09-12T00:38:51.196352+0000","last_undegraded":"2024-09-12T00:38:51.196352+0000","last_fullsized":"2024-09-12T00:38:51.196352+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'361","last_scrub_stamp":"2024-09-12T00:38:51.196229+0000","last_deep_scrub":"261'361","last_deep_scrub_stamp":"2024-09-12T00:38:51.196229+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.196229+0000","objects_scrubbed":10,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:50.130757+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2337543,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":829,"num_read_kb":49842,"num_write":1146,"num_write_kb":22305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'253","reported_seq":917,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.297540+0000","last_change":"2024-09-12T00:38:57.297540+0000","last_active":"2024-09-12T00:38:57.297540+0000","last_peered":"2024-09-12T00:38:57.297540+0000","last_clean":"2024-09-12T00:38:57.297540+0000","last_became_active":"2024-09-12T00:01:59.149728+0000","last_became_peered":"2024-09-12T00:01:59.149728+0000","last_unstale":"2024-09-12T00:38:57.297540+0000","last_undegraded":"2024-09-12T00:38:57.297540+0000","last_fullsized":"2024-09-12T00:38:57.297540+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'253","last_scrub_stamp":"2024-09-12T00:38:57.297444+0000","last_deep_scrub":"261'253","last_deep_scrub_stamp":"2024-09-12T00:38:57.297444+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.297444+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:04.300911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1186,"num_read_kb":981,"num_write":436,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'351","reported_seq":1101,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.044743+0000","last_change":"2024-09-12T00:38:47.044743+0000","last_active":"2024-09-12T00:38:47.044743+0000","last_peered":"2024-09-12T00:38:47.044743+0000","last_clean":"2024-09-12T00:38:47.044743+0000","last_became_active":"2024-09-12T00:01:57.152791+0000","last_became_peered":"2024-09-12T00:01:57.152791+0000","last_unstale":"2024-09-12T00:38:47.044743+0000","last_undegraded":"2024-09-12T00:38:47.044743+0000","last_fullsized":"2024-09-12T00:38:47.044743+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'351","last_scrub_stamp":"2024-09-12T00:38:47.044625+0000","last_deep_scrub":"261'351","last_deep_scrub_stamp":"2024-09-12T00:38:47.044625+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.044625+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:39.302097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133707,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":815,"num_read_kb":39083,"num_write":1189,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'276","reported_seq":872,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.325938+0000","last_change":"2024-09-12T00:38:58.325938+0000","last_active":"2024-09-12T00:38:58.325938+0000","last_peered":"2024-09-12T00:38:58.325938+0000","last_clean":"2024-09-12T00:38:58.325938+0000","last_became_active":"2024-09-12T00:01:59.151168+0000","last_became_peered":"2024-09-12T00:01:59.151168+0000","last_unstale":"2024-09-12T00:38:58.325938+0000","last_undegraded":"2024-09-12T00:38:58.325938+0000","last_fullsized":"2024-09-12T00:38:58.325938+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'276","last_scrub_stamp":"2024-09-12T00:38:58.325822+0000","last_deep_scrub":"261'276","last_deep_scrub_stamp":"2024-09-12T00:38:58.325822+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.325822+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:47.632687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1184,"num_read_kb":963,"num_write":440,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'354","reported_seq":1024,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.192429+0000","last_change":"2024-09-12T00:38:50.192429+0000","last_active":"2024-09-12T00:38:50.192429+0000","last_peered":"2024-09-12T00:38:50.192429+0000","last_clean":"2024-09-12T00:38:50.192429+0000","last_became_active":"2024-09-12T00:01:57.146592+0000","last_became_peered":"2024-09-12T00:01:57.146592+0000","last_unstale":"2024-09-12T00:38:50.192429+0000","last_undegraded":"2024-09-12T00:38:50.192429+0000","last_fullsized":"2024-09-12T00:38:50.192429+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-12T00:38:50.192316+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-12T00:38:50.192316+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.192316+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:49.228766+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":36666,"num_write":1128,"num_write_kb":21178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'169","reported_seq":757,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.751860+0000","last_change":"2024-09-12T00:01:59.153636+0000","last_active":"2024-09-12T00:36:58.751860+0000","last_peered":"2024-09-12T00:36:58.751860+0000","last_clean":"2024-09-12T00:36:58.751860+0000","last_became_active":"2024-09-12T00:01:59.153277+0000","last_became_peered":"2024-09-12T00:01:59.153277+0000","last_unstale":"2024-09-12T00:36:58.751860+0000","last_undegraded":"2024-09-12T00:36:58.751860+0000","last_fullsized":"2024-09-12T00:36:58.751860+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:06.223418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":798,"num_read_kb":679,"num_write":291,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'362","reported_seq":983,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.753683+0000","last_change":"2024-09-12T00:38:53.753683+0000","last_active":"2024-09-12T00:38:53.753683+0000","last_peered":"2024-09-12T00:38:53.753683+0000","last_clean":"2024-09-12T00:38:53.753683+0000","last_became_active":"2024-09-12T00:01:57.151506+0000","last_became_peered":"2024-09-12T00:01:57.151506+0000","last_unstale":"2024-09-12T00:38:53.753683+0000","last_undegraded":"2024-09-12T00:38:53.753683+0000","last_fullsized":"2024-09-12T00:38:53.753683+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'362","last_scrub_stamp":"2024-09-12T00:38:53.753574+0000","last_deep_scrub":"261'362","last_deep_scrub_stamp":"2024-09-12T00:38:53.753574+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.753574+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:42.419681+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549580,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":524,"num_read_kb":7555,"num_write":1156,"num_write_kb":27882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'125","reported_seq":711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.323304+0000","last_change":"2024-09-12T00:01:59.149439+0000","last_active":"2024-09-12T00:36:54.323304+0000","last_peered":"2024-09-12T00:36:54.323304+0000","last_clean":"2024-09-12T00:36:54.323304+0000","last_became_active":"2024-09-12T00:01:59.148098+0000","last_became_peered":"2024-09-12T00:01:59.148098+0000","last_unstale":"2024-09-12T00:36:54.323304+0000","last_undegraded":"2024-09-12T00:36:54.323304+0000","last_fullsized":"2024-09-12T00:36:54.323304+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:18.916236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":439,"num_write":182,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'114","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.963544+0000","last_change":"2024-09-12T00:01:59.148279+0000","last_active":"2024-09-12T00:36:58.963544+0000","last_peered":"2024-09-12T00:36:58.963544+0000","last_clean":"2024-09-12T00:36:58.963544+0000","last_became_active":"2024-09-12T00:01:59.148017+0000","last_became_peered":"2024-09-12T00:01:59.148017+0000","last_unstale":"2024-09-12T00:36:58.963544+0000","last_undegraded":"2024-09-12T00:36:58.963544+0000","last_fullsized":"2024-09-12T00:36:58.963544+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:15.214488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":485,"num_read_kb":395,"num_write":184,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'329","reported_seq":1020,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.439185+0000","last_change":"2024-09-12T00:38:55.439185+0000","last_active":"2024-09-12T00:38:55.439185+0000","last_peered":"2024-09-12T00:38:55.439185+0000","last_clean":"2024-09-12T00:38:55.439185+0000","last_became_active":"2024-09-12T00:01:57.151116+0000","last_became_peered":"2024-09-12T00:01:57.151116+0000","last_unstale":"2024-09-12T00:38:55.439185+0000","last_undegraded":"2024-09-12T00:38:55.439185+0000","last_fullsized":"2024-09-12T00:38:55.439185+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-12T00:38:55.439011+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-12T00:38:55.439011+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.439011+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:22.277921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":563,"num_read_kb":78307,"num_write":1164,"num_write_kb":30055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'230","reported_seq":819,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.256197+0000","last_change":"2024-09-12T00:38:56.256197+0000","last_active":"2024-09-12T00:38:56.256197+0000","last_peered":"2024-09-12T00:38:56.256197+0000","last_clean":"2024-09-12T00:38:56.256197+0000","last_became_active":"2024-09-12T00:01:59.152131+0000","last_became_peered":"2024-09-12T00:01:59.152131+0000","last_unstale":"2024-09-12T00:38:56.256197+0000","last_undegraded":"2024-09-12T00:38:56.256197+0000","last_fullsized":"2024-09-12T00:38:56.256197+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'230","last_scrub_stamp":"2024-09-12T00:38:56.256111+0000","last_deep_scrub":"261'230","last_deep_scrub_stamp":"2024-09-12T00:38:56.256111+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.256111+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:30.034301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":807,"num_write":370,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'333","reported_seq":972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.162288+0000","last_change":"2024-09-12T00:38:49.162288+0000","last_active":"2024-09-12T00:38:49.162288+0000","last_peered":"2024-09-12T00:38:49.162288+0000","last_clean":"2024-09-12T00:38:49.162288+0000","last_became_active":"2024-09-12T00:01:57.143834+0000","last_became_peered":"2024-09-12T00:01:57.143834+0000","last_unstale":"2024-09-12T00:38:49.162288+0000","last_undegraded":"2024-09-12T00:38:49.162288+0000","last_fullsized":"2024-09-12T00:38:49.162288+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'333","last_scrub_stamp":"2024-09-12T00:38:49.162133+0000","last_deep_scrub":"261'333","last_deep_scrub_stamp":"2024-09-12T00:38:49.162133+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.162133+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:54.670647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":522,"num_read_kb":1599,"num_write":1184,"num_write_kb":15734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'430","reported_seq":1143,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.414160+0000","last_change":"2024-09-12T00:38:51.414160+0000","last_active":"2024-09-12T00:38:51.414160+0000","last_peered":"2024-09-12T00:38:51.414160+0000","last_clean":"2024-09-12T00:38:51.414160+0000","last_became_active":"2024-09-12T00:01:59.153559+0000","last_became_peered":"2024-09-12T00:01:59.153559+0000","last_unstale":"2024-09-12T00:38:51.414160+0000","last_undegraded":"2024-09-12T00:38:51.414160+0000","last_fullsized":"2024-09-12T00:38:51.414160+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'430","last_scrub_stamp":"2024-09-12T00:38:51.414063+0000","last_deep_scrub":"261'430","last_deep_scrub_stamp":"2024-09-12T00:38:51.414063+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.414063+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:14.420551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2074,"num_read_kb":1775,"num_write":771,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'321","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.159055+0000","last_change":"2024-09-12T00:38:48.159055+0000","last_active":"2024-09-12T00:38:48.159055+0000","last_peered":"2024-09-12T00:38:48.159055+0000","last_clean":"2024-09-12T00:38:48.159055+0000","last_became_active":"2024-09-12T00:01:57.150789+0000","last_became_peered":"2024-09-12T00:01:57.150789+0000","last_unstale":"2024-09-12T00:38:48.159055+0000","last_undegraded":"2024-09-12T00:38:48.159055+0000","last_fullsized":"2024-09-12T00:38:48.159055+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'321","last_scrub_stamp":"2024-09-12T00:38:48.158943+0000","last_deep_scrub":"261'321","last_deep_scrub_stamp":"2024-09-12T00:38:48.158943+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.158943+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:48.677325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162197,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":13162,"num_write":967,"num_write_kb":19470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'149","reported_seq":780,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.946690+0000","last_change":"2024-09-12T00:38:57.946690+0000","last_active":"2024-09-12T00:38:57.946690+0000","last_peered":"2024-09-12T00:38:57.946690+0000","last_clean":"2024-09-12T00:38:57.946690+0000","last_became_active":"2024-09-12T00:01:59.149195+0000","last_became_peered":"2024-09-12T00:01:59.149195+0000","last_unstale":"2024-09-12T00:38:57.946690+0000","last_undegraded":"2024-09-12T00:38:57.946690+0000","last_fullsized":"2024-09-12T00:38:57.946690+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'149","last_scrub_stamp":"2024-09-12T00:38:57.946609+0000","last_deep_scrub":"261'149","last_deep_scrub_stamp":"2024-09-12T00:38:57.946609+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.946609+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:33.117967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":604,"num_write":216,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'359","reported_seq":1014,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.205052+0000","last_change":"2024-09-12T00:38:47.205052+0000","last_active":"2024-09-12T00:38:47.205052+0000","last_peered":"2024-09-12T00:38:47.205052+0000","last_clean":"2024-09-12T00:38:47.205052+0000","last_became_active":"2024-09-12T00:01:57.157877+0000","last_became_peered":"2024-09-12T00:01:57.157877+0000","last_unstale":"2024-09-12T00:38:47.205052+0000","last_undegraded":"2024-09-12T00:38:47.205052+0000","last_fullsized":"2024-09-12T00:38:47.205052+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'359","last_scrub_stamp":"2024-09-12T00:38:47.204901+0000","last_deep_scrub":"261'359","last_deep_scrub_stamp":"2024-09-12T00:38:47.204901+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.204901+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:27.995396+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7687320,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":26582,"num_write":1109,"num_write_kb":46689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'164","reported_seq":755,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.250417+0000","last_change":"2024-09-12T00:01:59.159547+0000","last_active":"2024-09-12T00:37:02.250417+0000","last_peered":"2024-09-12T00:37:02.250417+0000","last_clean":"2024-09-12T00:37:02.250417+0000","last_became_active":"2024-09-12T00:01:59.159215+0000","last_became_peered":"2024-09-12T00:01:59.159215+0000","last_unstale":"2024-09-12T00:37:02.250417+0000","last_undegraded":"2024-09-12T00:37:02.250417+0000","last_fullsized":"2024-09-12T00:37:02.250417+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:31.759927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":584,"num_write":229,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'277","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.027690+0000","last_change":"2024-09-12T00:38:51.027690+0000","last_active":"2024-09-12T00:38:51.027690+0000","last_peered":"2024-09-12T00:38:51.027690+0000","last_clean":"2024-09-12T00:38:51.027690+0000","last_became_active":"2024-09-12T00:02:32.844466+0000","last_became_peered":"2024-09-12T00:02:32.844466+0000","last_unstale":"2024-09-12T00:38:51.027690+0000","last_undegraded":"2024-09-12T00:38:51.027690+0000","last_fullsized":"2024-09-12T00:38:51.027690+0000","mapping_epoch":37,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'277","last_scrub_stamp":"2024-09-12T00:38:51.027531+0000","last_deep_scrub":"261'277","last_deep_scrub_stamp":"2024-09-12T00:38:51.027531+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.027531+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:53.754319+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291469,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":38682,"num_write":1020,"num_write_kb":28786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'136","reported_seq":732,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.417987+0000","last_change":"2024-09-12T00:38:53.417987+0000","last_active":"2024-09-12T00:38:53.417987+0000","last_peered":"2024-09-12T00:38:53.417987+0000","last_clean":"2024-09-12T00:38:53.417987+0000","last_became_active":"2024-09-12T00:01:59.156058+0000","last_became_peered":"2024-09-12T00:01:59.156058+0000","last_unstale":"2024-09-12T00:38:53.417987+0000","last_undegraded":"2024-09-12T00:38:53.417987+0000","last_fullsized":"2024-09-12T00:38:53.417987+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'136","last_scrub_stamp":"2024-09-12T00:38:53.417890+0000","last_deep_scrub":"261'136","last_deep_scrub_stamp":"2024-09-12T00:38:53.417890+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.417890+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:53.404919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":582,"num_read_kb":485,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'395","reported_seq":1018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.055055+0000","last_change":"2024-09-12T00:38:50.055055+0000","last_active":"2024-09-12T00:38:50.055055+0000","last_peered":"2024-09-12T00:38:50.055055+0000","last_clean":"2024-09-12T00:38:50.055055+0000","last_became_active":"2024-09-12T00:01:57.136872+0000","last_became_peered":"2024-09-12T00:01:57.136872+0000","last_unstale":"2024-09-12T00:38:50.055055+0000","last_undegraded":"2024-09-12T00:38:50.055055+0000","last_fullsized":"2024-09-12T00:38:50.055055+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'395","last_scrub_stamp":"2024-09-12T00:38:50.054891+0000","last_deep_scrub":"261'395","last_deep_scrub_stamp":"2024-09-12T00:38:50.054891+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.054891+0000","objects_scrubbed":9,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:04.646670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133748,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":28039,"num_write":1285,"num_write_kb":53988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'147","reported_seq":642,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.514493+0000","last_change":"2024-09-12T00:02:07.159622+0000","last_active":"2024-09-12T00:37:23.514493+0000","last_peered":"2024-09-12T00:37:23.514493+0000","last_clean":"2024-09-12T00:37:23.514493+0000","last_became_active":"2024-09-12T00:02:07.159308+0000","last_became_peered":"2024-09-12T00:02:07.159308+0000","last_unstale":"2024-09-12T00:37:23.514493+0000","last_undegraded":"2024-09-12T00:37:23.514493+0000","last_fullsized":"2024-09-12T00:37:23.514493+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:23.798981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'123","reported_seq":715,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.958150+0000","last_change":"2024-09-12T00:38:54.958150+0000","last_active":"2024-09-12T00:38:54.958150+0000","last_peered":"2024-09-12T00:38:54.958150+0000","last_clean":"2024-09-12T00:38:54.958150+0000","last_became_active":"2024-09-12T00:01:59.151773+0000","last_became_peered":"2024-09-12T00:01:59.151773+0000","last_unstale":"2024-09-12T00:38:54.958150+0000","last_undegraded":"2024-09-12T00:38:54.958150+0000","last_fullsized":"2024-09-12T00:38:54.958150+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'123","last_scrub_stamp":"2024-09-12T00:38:54.958046+0000","last_deep_scrub":"261'123","last_deep_scrub_stamp":"2024-09-12T00:38:54.958046+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.958046+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:49.574148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":478,"num_write":204,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'341","reported_seq":1036,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.231474+0000","last_change":"2024-09-12T00:38:52.231474+0000","last_active":"2024-09-12T00:38:52.231474+0000","last_peered":"2024-09-12T00:38:52.231474+0000","last_clean":"2024-09-12T00:38:52.231474+0000","last_became_active":"2024-09-12T00:01:57.165987+0000","last_became_peered":"2024-09-12T00:01:57.165987+0000","last_unstale":"2024-09-12T00:38:52.231474+0000","last_undegraded":"2024-09-12T00:38:52.231474+0000","last_fullsized":"2024-09-12T00:38:52.231474+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'341","last_scrub_stamp":"2024-09-12T00:38:52.231282+0000","last_deep_scrub":"261'341","last_deep_scrub_stamp":"2024-09-12T00:38:52.231282+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.231282+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:26.787977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":604,"num_read_kb":32539,"num_write":978,"num_write_kb":21474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.393143+0000","last_change":"2024-09-12T00:02:01.154807+0000","last_active":"2024-09-12T00:35:54.393143+0000","last_peered":"2024-09-12T00:35:54.393143+0000","last_clean":"2024-09-12T00:35:54.393143+0000","last_became_active":"2024-09-12T00:02:01.154464+0000","last_became_peered":"2024-09-12T00:02:01.154464+0000","last_unstale":"2024-09-12T00:35:54.393143+0000","last_undegraded":"2024-09-12T00:35:54.393143+0000","last_fullsized":"2024-09-12T00:35:54.393143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:35.047642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'360","reported_seq":964,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.815344+0000","last_change":"2024-09-12T00:02:03.156471+0000","last_active":"2024-09-12T00:38:37.815344+0000","last_peered":"2024-09-12T00:38:37.815344+0000","last_clean":"2024-09-12T00:38:37.815344+0000","last_became_active":"2024-09-12T00:02:03.156175+0000","last_became_peered":"2024-09-12T00:02:03.156175+0000","last_unstale":"2024-09-12T00:38:37.815344+0000","last_undegraded":"2024-09-12T00:38:37.815344+0000","last_fullsized":"2024-09-12T00:38:37.815344+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:33.670259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51076,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":584,"num_read_kb":1265,"num_write":472,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:56.510205+0000","last_change":"2024-09-12T00:02:05.165724+0000","last_active":"2024-09-12T00:35:56.510205+0000","last_peered":"2024-09-12T00:35:56.510205+0000","last_clean":"2024-09-12T00:35:56.510205+0000","last_became_active":"2024-09-12T00:02:05.165424+0000","last_became_peered":"2024-09-12T00:02:05.165424+0000","last_unstale":"2024-09-12T00:35:56.510205+0000","last_undegraded":"2024-09-12T00:35:56.510205+0000","last_fullsized":"2024-09-12T00:35:56.510205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:38.859922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'129","reported_seq":679,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.108575+0000","last_change":"2024-09-12T00:02:07.175107+0000","last_active":"2024-09-12T00:37:21.108575+0000","last_peered":"2024-09-12T00:37:21.108575+0000","last_clean":"2024-09-12T00:37:21.108575+0000","last_became_active":"2024-09-12T00:02:07.174795+0000","last_became_peered":"2024-09-12T00:02:07.174795+0000","last_unstale":"2024-09-12T00:37:21.108575+0000","last_undegraded":"2024-09-12T00:37:21.108575+0000","last_fullsized":"2024-09-12T00:37:21.108575+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.332589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":239,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'75","reported_seq":622,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:08.555629+0000","last_change":"2024-09-12T00:01:59.146503+0000","last_active":"2024-09-12T00:37:08.555629+0000","last_peered":"2024-09-12T00:37:08.555629+0000","last_clean":"2024-09-12T00:37:08.555629+0000","last_became_active":"2024-09-12T00:01:59.145411+0000","last_became_peered":"2024-09-12T00:01:59.145411+0000","last_unstale":"2024-09-12T00:37:08.555629+0000","last_undegraded":"2024-09-12T00:37:08.555629+0000","last_fullsized":"2024-09-12T00:37:08.555629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:33.082390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":104,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'371","reported_seq":1023,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.109874+0000","last_change":"2024-09-12T00:38:46.109874+0000","last_active":"2024-09-12T00:38:46.109874+0000","last_peered":"2024-09-12T00:38:46.109874+0000","last_clean":"2024-09-12T00:38:46.109874+0000","last_became_active":"2024-09-12T00:01:57.146952+0000","last_became_peered":"2024-09-12T00:01:57.146952+0000","last_unstale":"2024-09-12T00:38:46.109874+0000","last_undegraded":"2024-09-12T00:38:46.109874+0000","last_fullsized":"2024-09-12T00:38:46.109874+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T00:38:46.109709+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T00:38:46.109709+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.109709+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:43.843194+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":558,"num_read_kb":41499,"num_write":1262,"num_write_kb":32474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:47.503501+0000","last_change":"2024-09-12T00:02:01.156228+0000","last_active":"2024-09-12T00:34:47.503501+0000","last_peered":"2024-09-12T00:34:47.503501+0000","last_clean":"2024-09-12T00:34:47.503501+0000","last_became_active":"2024-09-12T00:02:01.155948+0000","last_became_peered":"2024-09-12T00:02:01.155948+0000","last_unstale":"2024-09-12T00:34:47.503501+0000","last_undegraded":"2024-09-12T00:34:47.503501+0000","last_fullsized":"2024-09-12T00:34:47.503501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:34.073281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'81","reported_seq":596,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:51.124923+0000","last_change":"2024-09-12T00:02:03.152995+0000","last_active":"2024-09-12T00:36:51.124923+0000","last_peered":"2024-09-12T00:36:51.124923+0000","last_clean":"2024-09-12T00:36:51.124923+0000","last_became_active":"2024-09-12T00:02:03.152708+0000","last_became_peered":"2024-09-12T00:02:03.152708+0000","last_unstale":"2024-09-12T00:36:51.124923+0000","last_undegraded":"2024-09-12T00:36:51.124923+0000","last_fullsized":"2024-09-12T00:36:51.124923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:00.923044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":85,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:56.510160+0000","last_change":"2024-09-12T00:02:05.163074+0000","last_active":"2024-09-12T00:35:56.510160+0000","last_peered":"2024-09-12T00:35:56.510160+0000","last_clean":"2024-09-12T00:35:56.510160+0000","last_became_active":"2024-09-12T00:02:05.162755+0000","last_became_peered":"2024-09-12T00:02:05.162755+0000","last_unstale":"2024-09-12T00:35:56.510160+0000","last_undegraded":"2024-09-12T00:35:56.510160+0000","last_fullsized":"2024-09-12T00:35:56.510160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:20.807313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'133","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.520320+0000","last_change":"2024-09-12T00:02:07.168207+0000","last_active":"2024-09-12T00:37:09.520320+0000","last_peered":"2024-09-12T00:37:09.520320+0000","last_clean":"2024-09-12T00:37:09.520320+0000","last_became_active":"2024-09-12T00:02:07.167851+0000","last_became_peered":"2024-09-12T00:02:07.167851+0000","last_unstale":"2024-09-12T00:37:09.520320+0000","last_undegraded":"2024-09-12T00:37:09.520320+0000","last_fullsized":"2024-09-12T00:37:09.520320+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:11.325627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":137,"num_write":333,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'4128","reported_seq":4726,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510282+0000","last_change":"2024-09-12T00:01:59.151349+0000","last_active":"2024-09-12T00:35:49.510282+0000","last_peered":"2024-09-12T00:35:49.510282+0000","last_clean":"2024-09-12T00:35:49.510282+0000","last_became_active":"2024-09-12T00:01:59.151026+0000","last_became_peered":"2024-09-12T00:01:59.151026+0000","last_unstale":"2024-09-12T00:35:49.510282+0000","last_undegraded":"2024-09-12T00:35:49.510282+0000","last_fullsized":"2024-09-12T00:35:49.510282+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":3000,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:16.187111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16602,"num_read_kb":13937,"num_write":6188,"num_write_kb":3085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'296","reported_seq":1003,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.273199+0000","last_change":"2024-09-12T00:38:51.273199+0000","last_active":"2024-09-12T00:38:51.273199+0000","last_peered":"2024-09-12T00:38:51.273199+0000","last_clean":"2024-09-12T00:38:51.273199+0000","last_became_active":"2024-09-12T00:01:57.144269+0000","last_became_peered":"2024-09-12T00:01:57.144269+0000","last_unstale":"2024-09-12T00:38:51.273199+0000","last_undegraded":"2024-09-12T00:38:51.273199+0000","last_fullsized":"2024-09-12T00:38:51.273199+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'296","last_scrub_stamp":"2024-09-12T00:38:51.273042+0000","last_deep_scrub":"261'296","last_deep_scrub_stamp":"2024-09-12T00:38:51.273042+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.273042+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:27.864647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399069,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":703,"num_read_kb":1796,"num_write":921,"num_write_kb":33986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:52.513137+0000","last_change":"2024-09-12T00:02:01.155683+0000","last_active":"2024-09-12T00:35:52.513137+0000","last_peered":"2024-09-12T00:35:52.513137+0000","last_clean":"2024-09-12T00:35:52.513137+0000","last_became_active":"2024-09-12T00:02:01.155425+0000","last_became_peered":"2024-09-12T00:02:01.155425+0000","last_unstale":"2024-09-12T00:35:52.513137+0000","last_undegraded":"2024-09-12T00:35:52.513137+0000","last_fullsized":"2024-09-12T00:35:52.513137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:38.140909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'103","reported_seq":636,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.325100+0000","last_change":"2024-09-12T00:02:03.152143+0000","last_active":"2024-09-12T00:36:54.325100+0000","last_peered":"2024-09-12T00:36:54.325100+0000","last_clean":"2024-09-12T00:36:54.325100+0000","last_became_active":"2024-09-12T00:02:03.151839+0000","last_became_peered":"2024-09-12T00:02:03.151839+0000","last_unstale":"2024-09-12T00:36:54.325100+0000","last_undegraded":"2024-09-12T00:36:54.325100+0000","last_fullsized":"2024-09-12T00:36:54.325100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:17:56.820811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'758","reported_seq":2046,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.042074+0000","last_change":"2024-09-12T00:02:05.167777+0000","last_active":"2024-09-12T00:38:38.042074+0000","last_peered":"2024-09-12T00:38:38.042074+0000","last_clean":"2024-09-12T00:38:38.042074+0000","last_became_active":"2024-09-12T00:02:05.166985+0000","last_became_peered":"2024-09-12T00:02:05.166985+0000","last_unstale":"2024-09-12T00:38:38.042074+0000","last_undegraded":"2024-09-12T00:38:38.042074+0000","last_fullsized":"2024-09-12T00:38:38.042074+0000","mapping_epoch":32,"log_start":"261'701","ondisk_log_start":"261'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":701,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:46.965686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'217","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.117831+0000","last_change":"2024-09-12T00:02:07.167855+0000","last_active":"2024-09-12T00:37:23.117831+0000","last_peered":"2024-09-12T00:37:23.117831+0000","last_clean":"2024-09-12T00:37:23.117831+0000","last_became_active":"2024-09-12T00:02:07.167576+0000","last_became_peered":"2024-09-12T00:02:07.167576+0000","last_unstale":"2024-09-12T00:37:23.117831+0000","last_undegraded":"2024-09-12T00:37:23.117831+0000","last_fullsized":"2024-09-12T00:37:23.117831+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:16.693441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":605,"num_read_kb":603,"num_write":488,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'58","reported_seq":609,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:22.120801+0000","last_change":"2024-09-12T00:01:59.149396+0000","last_active":"2024-09-12T00:36:22.120801+0000","last_peered":"2024-09-12T00:36:22.120801+0000","last_clean":"2024-09-12T00:36:22.120801+0000","last_became_active":"2024-09-12T00:01:59.149087+0000","last_became_peered":"2024-09-12T00:01:59.149087+0000","last_unstale":"2024-09-12T00:36:22.120801+0000","last_undegraded":"2024-09-12T00:36:22.120801+0000","last_fullsized":"2024-09-12T00:36:22.120801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:13.031884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":233,"num_write":78,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'349","reported_seq":1054,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.537092+0000","last_change":"2024-09-12T00:38:44.537092+0000","last_active":"2024-09-12T00:38:44.537092+0000","last_peered":"2024-09-12T00:38:44.537092+0000","last_clean":"2024-09-12T00:38:44.537092+0000","last_became_active":"2024-09-12T00:01:57.152332+0000","last_became_peered":"2024-09-12T00:01:57.152332+0000","last_unstale":"2024-09-12T00:38:44.537092+0000","last_undegraded":"2024-09-12T00:38:44.537092+0000","last_fullsized":"2024-09-12T00:38:44.537092+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T00:38:44.536985+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T00:38:44.536985+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.536985+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:37.312381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516615,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":651,"num_read_kb":43786,"num_write":1177,"num_write_kb":39072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.393180+0000","last_change":"2024-09-12T00:02:01.154452+0000","last_active":"2024-09-12T00:35:54.393180+0000","last_peered":"2024-09-12T00:35:54.393180+0000","last_clean":"2024-09-12T00:35:54.393180+0000","last_became_active":"2024-09-12T00:02:01.154110+0000","last_became_peered":"2024-09-12T00:02:01.154110+0000","last_unstale":"2024-09-12T00:35:54.393180+0000","last_undegraded":"2024-09-12T00:35:54.393180+0000","last_fullsized":"2024-09-12T00:35:54.393180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:16:04.241524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'257","reported_seq":809,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.439647+0000","last_change":"2024-09-12T00:02:03.146008+0000","last_active":"2024-09-12T00:38:37.439647+0000","last_peered":"2024-09-12T00:38:37.439647+0000","last_clean":"2024-09-12T00:38:37.439647+0000","last_became_active":"2024-09-12T00:02:03.145673+0000","last_became_peered":"2024-09-12T00:02:03.145673+0000","last_unstale":"2024-09-12T00:38:37.439647+0000","last_undegraded":"2024-09-12T00:38:37.439647+0000","last_fullsized":"2024-09-12T00:38:37.439647+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:24.216453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47470,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":957,"num_write":348,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'782","reported_seq":2154,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.129841+0000","last_change":"2024-09-12T00:02:05.165636+0000","last_active":"2024-09-12T00:38:37.129841+0000","last_peered":"2024-09-12T00:38:37.129841+0000","last_clean":"2024-09-12T00:38:37.129841+0000","last_became_active":"2024-09-12T00:02:05.165283+0000","last_became_peered":"2024-09-12T00:02:05.165283+0000","last_unstale":"2024-09-12T00:38:37.129841+0000","last_undegraded":"2024-09-12T00:38:37.129841+0000","last_fullsized":"2024-09-12T00:38:37.129841+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:20.861078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'107","reported_seq":685,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.191153+0000","last_change":"2024-09-12T00:38:59.191153+0000","last_active":"2024-09-12T00:38:59.191153+0000","last_peered":"2024-09-12T00:38:59.191153+0000","last_clean":"2024-09-12T00:38:59.191153+0000","last_became_active":"2024-09-12T00:01:59.153704+0000","last_became_peered":"2024-09-12T00:01:59.153704+0000","last_unstale":"2024-09-12T00:38:59.191153+0000","last_undegraded":"2024-09-12T00:38:59.191153+0000","last_fullsized":"2024-09-12T00:38:59.191153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'107","last_scrub_stamp":"2024-09-12T00:38:59.191064+0000","last_deep_scrub":"261'107","last_deep_scrub_stamp":"2024-09-12T00:38:59.191064+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.191064+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:10.002119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":389,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'347","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:42.111293+0000","last_change":"2024-09-12T00:38:42.111293+0000","last_active":"2024-09-12T00:38:42.111293+0000","last_peered":"2024-09-12T00:38:42.111293+0000","last_clean":"2024-09-12T00:38:42.111293+0000","last_became_active":"2024-09-12T00:01:57.154222+0000","last_became_peered":"2024-09-12T00:01:57.154222+0000","last_unstale":"2024-09-12T00:38:42.111293+0000","last_undegraded":"2024-09-12T00:38:42.111293+0000","last_fullsized":"2024-09-12T00:38:42.111293+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'347","last_scrub_stamp":"2024-09-12T00:38:42.111118+0000","last_deep_scrub":"261'347","last_deep_scrub_stamp":"2024-09-12T00:38:42.111118+0000","last_clean_scrub_stamp":"2024-09-12T00:38:42.111118+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:20.798122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589724,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":40360,"num_write":1158,"num_write_kb":32511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.459099+0000","last_change":"2024-09-12T00:38:57.459099+0000","last_active":"2024-09-12T00:38:57.459099+0000","last_peered":"2024-09-12T00:38:57.459099+0000","last_clean":"2024-09-12T00:38:57.459099+0000","last_became_active":"2024-09-12T00:02:01.144531+0000","last_became_peered":"2024-09-12T00:02:01.144531+0000","last_unstale":"2024-09-12T00:38:57.459099+0000","last_undegraded":"2024-09-12T00:38:57.459099+0000","last_fullsized":"2024-09-12T00:38:57.459099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:57.459009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:57.459009+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.459009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:40.876686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'371","reported_seq":973,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.119846+0000","last_change":"2024-09-12T00:02:03.155592+0000","last_active":"2024-09-12T00:38:38.119846+0000","last_peered":"2024-09-12T00:38:38.119846+0000","last_clean":"2024-09-12T00:38:38.119846+0000","last_became_active":"2024-09-12T00:02:03.155293+0000","last_became_peered":"2024-09-12T00:02:03.155293+0000","last_unstale":"2024-09-12T00:38:38.119846+0000","last_undegraded":"2024-09-12T00:38:38.119846+0000","last_fullsized":"2024-09-12T00:38:38.119846+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:29.029401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50160,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":1260,"num_write":482,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":474,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.509941+0000","last_change":"2024-09-12T00:02:05.168024+0000","last_active":"2024-09-12T00:35:49.509941+0000","last_peered":"2024-09-12T00:35:49.509941+0000","last_clean":"2024-09-12T00:35:49.509941+0000","last_became_active":"2024-09-12T00:02:05.167762+0000","last_became_peered":"2024-09-12T00:02:05.167762+0000","last_unstale":"2024-09-12T00:35:49.509941+0000","last_undegraded":"2024-09-12T00:35:49.509941+0000","last_fullsized":"2024-09-12T00:35:49.509941+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:56.207387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'546","reported_seq":1342,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.940888+0000","last_change":"2024-09-12T00:02:07.172418+0000","last_active":"2024-09-12T00:38:28.940888+0000","last_peered":"2024-09-12T00:38:28.940888+0000","last_clean":"2024-09-12T00:38:28.940888+0000","last_became_active":"2024-09-12T00:02:07.172005+0000","last_became_peered":"2024-09-12T00:02:07.172005+0000","last_unstale":"2024-09-12T00:38:28.940888+0000","last_undegraded":"2024-09-12T00:38:28.940888+0000","last_fullsized":"2024-09-12T00:38:28.940888+0000","mapping_epoch":34,"log_start":"261'500","ondisk_log_start":"261'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:59.842808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1294,"num_read_kb":1285,"num_write":1129,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'119","reported_seq":697,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.449096+0000","last_change":"2024-09-12T00:38:54.449096+0000","last_active":"2024-09-12T00:38:54.449096+0000","last_peered":"2024-09-12T00:38:54.449096+0000","last_clean":"2024-09-12T00:38:54.449096+0000","last_became_active":"2024-09-12T00:01:59.151782+0000","last_became_peered":"2024-09-12T00:01:59.151782+0000","last_unstale":"2024-09-12T00:38:54.449096+0000","last_undegraded":"2024-09-12T00:38:54.449096+0000","last_fullsized":"2024-09-12T00:38:54.449096+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'119","last_scrub_stamp":"2024-09-12T00:38:54.449006+0000","last_deep_scrub":"261'119","last_deep_scrub_stamp":"2024-09-12T00:38:54.449006+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.449006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:43.707307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":439,"num_write":192,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'305","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:42.998047+0000","last_change":"2024-09-12T00:38:42.998047+0000","last_active":"2024-09-12T00:38:42.998047+0000","last_peered":"2024-09-12T00:38:42.998047+0000","last_clean":"2024-09-12T00:38:42.998047+0000","last_became_active":"2024-09-12T00:01:57.157370+0000","last_became_peered":"2024-09-12T00:01:57.157370+0000","last_unstale":"2024-09-12T00:38:42.998047+0000","last_undegraded":"2024-09-12T00:38:42.998047+0000","last_fullsized":"2024-09-12T00:38:42.998047+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-12T00:38:42.997918+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-12T00:38:42.997918+0000","last_clean_scrub_stamp":"2024-09-12T00:38:42.997918+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:53.007422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327243,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":441,"num_read_kb":3842,"num_write":968,"num_write_kb":16793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.950968+0000","last_change":"2024-09-12T00:38:58.950968+0000","last_active":"2024-09-12T00:38:58.950968+0000","last_peered":"2024-09-12T00:38:58.950968+0000","last_clean":"2024-09-12T00:38:58.950968+0000","last_became_active":"2024-09-12T00:02:01.151914+0000","last_became_peered":"2024-09-12T00:02:01.151914+0000","last_unstale":"2024-09-12T00:38:58.950968+0000","last_undegraded":"2024-09-12T00:38:58.950968+0000","last_fullsized":"2024-09-12T00:38:58.950968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:58.950859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:58.950859+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.950859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:32.731979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'276","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.700469+0000","last_change":"2024-09-12T00:02:03.155128+0000","last_active":"2024-09-12T00:38:36.700469+0000","last_peered":"2024-09-12T00:38:36.700469+0000","last_clean":"2024-09-12T00:38:36.700469+0000","last_became_active":"2024-09-12T00:02:03.154819+0000","last_became_peered":"2024-09-12T00:02:03.154819+0000","last_unstale":"2024-09-12T00:38:36.700469+0000","last_undegraded":"2024-09-12T00:38:36.700469+0000","last_fullsized":"2024-09-12T00:38:36.700469+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:47.375234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":1012,"num_write":362,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.521442+0000","last_change":"2024-09-12T00:02:05.168924+0000","last_active":"2024-09-12T00:36:52.521442+0000","last_peered":"2024-09-12T00:36:52.521442+0000","last_clean":"2024-09-12T00:36:52.521442+0000","last_became_active":"2024-09-12T00:02:05.168649+0000","last_became_peered":"2024-09-12T00:02:05.168649+0000","last_unstale":"2024-09-12T00:36:52.521442+0000","last_undegraded":"2024-09-12T00:36:52.521442+0000","last_fullsized":"2024-09-12T00:36:52.521442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2367","reported_seq":4178,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:10.204589+0000","last_change":"2024-09-12T00:02:07.175086+0000","last_active":"2024-09-12T00:38:10.204589+0000","last_peered":"2024-09-12T00:38:10.204589+0000","last_clean":"2024-09-12T00:38:10.204589+0000","last_became_active":"2024-09-12T00:02:07.174769+0000","last_became_peered":"2024-09-12T00:02:07.174769+0000","last_unstale":"2024-09-12T00:38:10.204589+0000","last_undegraded":"2024-09-12T00:38:10.204589+0000","last_fullsized":"2024-09-12T00:38:10.204589+0000","mapping_epoch":34,"log_start":"261'2300","ondisk_log_start":"261'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":2300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:04.650587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5961,"num_read_kb":5964,"num_write":4767,"num_write_kb":1768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'190","reported_seq":821,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.093622+0000","last_change":"2024-09-12T00:38:51.093560+0000","last_active":"2024-09-12T00:38:51.093622+0000","last_peered":"2024-09-12T00:38:51.093622+0000","last_clean":"2024-09-12T00:38:51.093622+0000","last_became_active":"2024-09-12T00:01:59.156252+0000","last_became_peered":"2024-09-12T00:01:59.156252+0000","last_unstale":"2024-09-12T00:38:51.093622+0000","last_undegraded":"2024-09-12T00:38:51.093622+0000","last_fullsized":"2024-09-12T00:38:51.093622+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'190","last_scrub_stamp":"2024-09-12T00:38:51.093465+0000","last_deep_scrub":"261'190","last_deep_scrub_stamp":"2024-09-12T00:38:51.093465+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.093465+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:31.896004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":702,"num_write":296,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'368","reported_seq":1015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.261298+0000","last_change":"2024-09-12T00:38:50.261298+0000","last_active":"2024-09-12T00:38:50.261298+0000","last_peered":"2024-09-12T00:38:50.261298+0000","last_clean":"2024-09-12T00:38:50.261298+0000","last_became_active":"2024-09-12T00:01:57.157699+0000","last_became_peered":"2024-09-12T00:01:57.157699+0000","last_unstale":"2024-09-12T00:38:50.261298+0000","last_undegraded":"2024-09-12T00:38:50.261298+0000","last_fullsized":"2024-09-12T00:38:50.261298+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'368","last_scrub_stamp":"2024-09-12T00:38:50.261168+0000","last_deep_scrub":"261'368","last_deep_scrub_stamp":"2024-09-12T00:38:50.261168+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.261168+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:19.208333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":32954,"num_write":1221,"num_write_kb":41911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510167+0000","last_change":"2024-09-12T00:02:01.153356+0000","last_active":"2024-09-12T00:35:49.510167+0000","last_peered":"2024-09-12T00:35:49.510167+0000","last_clean":"2024-09-12T00:35:49.510167+0000","last_became_active":"2024-09-12T00:02:01.153090+0000","last_became_peered":"2024-09-12T00:02:01.153090+0000","last_unstale":"2024-09-12T00:35:49.510167+0000","last_undegraded":"2024-09-12T00:35:49.510167+0000","last_fullsized":"2024-09-12T00:35:49.510167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:13.705146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'321","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.278283+0000","last_change":"2024-09-12T00:02:03.153714+0000","last_active":"2024-09-12T00:38:38.278283+0000","last_peered":"2024-09-12T00:38:38.278283+0000","last_clean":"2024-09-12T00:38:38.278283+0000","last_became_active":"2024-09-12T00:02:03.153386+0000","last_became_peered":"2024-09-12T00:02:03.153386+0000","last_unstale":"2024-09-12T00:38:38.278283+0000","last_undegraded":"2024-09-12T00:38:38.278283+0000","last_fullsized":"2024-09-12T00:38:38.278283+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50481,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":533,"num_read_kb":1216,"num_write":438,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'782","reported_seq":2237,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.369173+0000","last_change":"2024-09-12T00:02:05.166163+0000","last_active":"2024-09-12T00:38:38.369173+0000","last_peered":"2024-09-12T00:38:38.369173+0000","last_clean":"2024-09-12T00:38:38.369173+0000","last_became_active":"2024-09-12T00:02:05.165892+0000","last_became_peered":"2024-09-12T00:02:05.165892+0000","last_unstale":"2024-09-12T00:38:38.369173+0000","last_undegraded":"2024-09-12T00:38:38.369173+0000","last_fullsized":"2024-09-12T00:38:38.369173+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'87","reported_seq":562,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.593217+0000","last_change":"2024-09-12T00:02:07.169522+0000","last_active":"2024-09-12T00:38:27.593217+0000","last_peered":"2024-09-12T00:38:27.593217+0000","last_clean":"2024-09-12T00:38:27.593217+0000","last_became_active":"2024-09-12T00:02:07.169216+0000","last_became_peered":"2024-09-12T00:02:07.169216+0000","last_unstale":"2024-09-12T00:38:27.593217+0000","last_undegraded":"2024-09-12T00:38:27.593217+0000","last_fullsized":"2024-09-12T00:38:27.593217+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":199,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'131","reported_seq":715,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.837599+0000","last_change":"2024-09-12T00:38:56.837599+0000","last_active":"2024-09-12T00:38:56.837599+0000","last_peered":"2024-09-12T00:38:56.837599+0000","last_clean":"2024-09-12T00:38:56.837599+0000","last_became_active":"2024-09-12T00:01:59.152836+0000","last_became_peered":"2024-09-12T00:01:59.152836+0000","last_unstale":"2024-09-12T00:38:56.837599+0000","last_undegraded":"2024-09-12T00:38:56.837599+0000","last_fullsized":"2024-09-12T00:38:56.837599+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'131","last_scrub_stamp":"2024-09-12T00:38:56.837464+0000","last_deep_scrub":"261'131","last_deep_scrub_stamp":"2024-09-12T00:38:56.837464+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.837464+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:06.526573+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":483,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'320","reported_seq":965,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.128035+0000","last_change":"2024-09-12T00:38:43.128035+0000","last_active":"2024-09-12T00:38:43.128035+0000","last_peered":"2024-09-12T00:38:43.128035+0000","last_clean":"2024-09-12T00:38:43.128035+0000","last_became_active":"2024-09-12T00:01:57.143137+0000","last_became_peered":"2024-09-12T00:01:57.143137+0000","last_unstale":"2024-09-12T00:38:43.128035+0000","last_undegraded":"2024-09-12T00:38:43.128035+0000","last_fullsized":"2024-09-12T00:38:43.128035+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'320","last_scrub_stamp":"2024-09-12T00:38:43.127908+0000","last_deep_scrub":"261'320","last_deep_scrub_stamp":"2024-09-12T00:38:43.127908+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.127908+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:53.536834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286939,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":8103,"num_write":1063,"num_write_kb":32276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:49.517628+0000","last_change":"2024-09-12T00:02:01.144552+0000","last_active":"2024-09-12T00:36:49.517628+0000","last_peered":"2024-09-12T00:36:49.517628+0000","last_clean":"2024-09-12T00:36:49.517628+0000","last_became_active":"2024-09-12T00:02:01.144199+0000","last_became_peered":"2024-09-12T00:02:01.144199+0000","last_unstale":"2024-09-12T00:36:49.517628+0000","last_undegraded":"2024-09-12T00:36:49.517628+0000","last_fullsized":"2024-09-12T00:36:49.517628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'487","reported_seq":1120,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.935851+0000","last_change":"2024-09-12T00:02:03.155884+0000","last_active":"2024-09-12T00:38:36.935851+0000","last_peered":"2024-09-12T00:38:36.935851+0000","last_clean":"2024-09-12T00:38:36.935851+0000","last_became_active":"2024-09-12T00:02:03.155625+0000","last_became_peered":"2024-09-12T00:02:03.155625+0000","last_unstale":"2024-09-12T00:38:36.935851+0000","last_undegraded":"2024-09-12T00:38:36.935851+0000","last_fullsized":"2024-09-12T00:38:36.935851+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104418,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":868,"num_read_kb":2109,"num_write":716,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:44.517206+0000","last_change":"2024-09-12T00:02:05.169143+0000","last_active":"2024-09-12T00:36:44.517206+0000","last_peered":"2024-09-12T00:36:44.517206+0000","last_clean":"2024-09-12T00:36:44.517206+0000","last_became_active":"2024-09-12T00:02:05.168816+0000","last_became_peered":"2024-09-12T00:02:05.168816+0000","last_unstale":"2024-09-12T00:36:44.517206+0000","last_undegraded":"2024-09-12T00:36:44.517206+0000","last_fullsized":"2024-09-12T00:36:44.517206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'158","reported_seq":652,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.942372+0000","last_change":"2024-09-12T00:02:07.172017+0000","last_active":"2024-09-12T00:38:28.942372+0000","last_peered":"2024-09-12T00:38:28.942372+0000","last_clean":"2024-09-12T00:38:28.942372+0000","last_became_active":"2024-09-12T00:02:07.171762+0000","last_became_peered":"2024-09-12T00:02:07.171762+0000","last_unstale":"2024-09-12T00:38:28.942372+0000","last_undegraded":"2024-09-12T00:38:28.942372+0000","last_fullsized":"2024-09-12T00:38:28.942372+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":181,"num_read_kb":171,"num_write":367,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'251","reported_seq":898,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.196650+0000","last_change":"2024-09-12T00:38:53.196650+0000","last_active":"2024-09-12T00:38:53.196650+0000","last_peered":"2024-09-12T00:38:53.196650+0000","last_clean":"2024-09-12T00:38:53.196650+0000","last_became_active":"2024-09-12T00:01:59.147762+0000","last_became_peered":"2024-09-12T00:01:59.147762+0000","last_unstale":"2024-09-12T00:38:53.196650+0000","last_undegraded":"2024-09-12T00:38:53.196650+0000","last_fullsized":"2024-09-12T00:38:53.196650+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'251","last_scrub_stamp":"2024-09-12T00:38:53.196559+0000","last_deep_scrub":"261'251","last_deep_scrub_stamp":"2024-09-12T00:38:53.196559+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.196559+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:22.688918+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1058,"num_read_kb":865,"num_write":369,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'311","reported_seq":919,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.806433+0000","last_change":"2024-09-12T00:38:45.806433+0000","last_active":"2024-09-12T00:38:45.806433+0000","last_peered":"2024-09-12T00:38:45.806433+0000","last_clean":"2024-09-12T00:38:45.806433+0000","last_became_active":"2024-09-12T00:01:57.139677+0000","last_became_peered":"2024-09-12T00:01:57.139677+0000","last_unstale":"2024-09-12T00:38:45.806433+0000","last_undegraded":"2024-09-12T00:38:45.806433+0000","last_fullsized":"2024-09-12T00:38:45.806433+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'311","last_scrub_stamp":"2024-09-12T00:38:45.806294+0000","last_deep_scrub":"261'311","last_deep_scrub_stamp":"2024-09-12T00:38:45.806294+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.806294+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:02.113023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":3669,"num_write":1056,"num_write_kb":17146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.890918+0000","last_change":"2024-09-12T00:38:58.890918+0000","last_active":"2024-09-12T00:38:58.890918+0000","last_peered":"2024-09-12T00:38:58.890918+0000","last_clean":"2024-09-12T00:38:58.890918+0000","last_became_active":"2024-09-12T00:02:01.150796+0000","last_became_peered":"2024-09-12T00:02:01.150796+0000","last_unstale":"2024-09-12T00:38:58.890918+0000","last_undegraded":"2024-09-12T00:38:58.890918+0000","last_fullsized":"2024-09-12T00:38:58.890918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:58.890832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:58.890832+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.890832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:05.434384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'275","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.002679+0000","last_change":"2024-09-12T00:02:03.153772+0000","last_active":"2024-09-12T00:38:37.002679+0000","last_peered":"2024-09-12T00:38:37.002679+0000","last_clean":"2024-09-12T00:38:37.002679+0000","last_became_active":"2024-09-12T00:02:03.153447+0000","last_became_peered":"2024-09-12T00:02:03.153447+0000","last_unstale":"2024-09-12T00:38:37.002679+0000","last_undegraded":"2024-09-12T00:38:37.002679+0000","last_fullsized":"2024-09-12T00:38:37.002679+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:52.487542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49756,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":469,"num_read_kb":1005,"num_write":420,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":471,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:54.510853+0000","last_change":"2024-09-12T00:02:05.163959+0000","last_active":"2024-09-12T00:35:54.510853+0000","last_peered":"2024-09-12T00:35:54.510853+0000","last_clean":"2024-09-12T00:35:54.510853+0000","last_became_active":"2024-09-12T00:02:05.163689+0000","last_became_peered":"2024-09-12T00:02:05.163689+0000","last_unstale":"2024-09-12T00:35:54.510853+0000","last_undegraded":"2024-09-12T00:35:54.510853+0000","last_fullsized":"2024-09-12T00:35:54.510853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:14.624849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'128","reported_seq":610,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:14.529969+0000","last_change":"2024-09-12T00:02:07.172273+0000","last_active":"2024-09-12T00:38:14.529969+0000","last_peered":"2024-09-12T00:38:14.529969+0000","last_clean":"2024-09-12T00:38:14.529969+0000","last_became_active":"2024-09-12T00:02:07.171942+0000","last_became_peered":"2024-09-12T00:02:07.171942+0000","last_unstale":"2024-09-12T00:38:14.529969+0000","last_undegraded":"2024-09-12T00:38:14.529969+0000","last_fullsized":"2024-09-12T00:38:14.529969+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:54.534357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'138","reported_seq":727,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.949864+0000","last_change":"2024-09-12T00:01:59.150356+0000","last_active":"2024-09-12T00:36:59.949864+0000","last_peered":"2024-09-12T00:36:59.949864+0000","last_clean":"2024-09-12T00:36:59.949864+0000","last_became_active":"2024-09-12T00:01:59.148534+0000","last_became_peered":"2024-09-12T00:01:59.148534+0000","last_unstale":"2024-09-12T00:36:59.949864+0000","last_undegraded":"2024-09-12T00:36:59.949864+0000","last_fullsized":"2024-09-12T00:36:59.949864+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:28.691183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":510,"num_write":211,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'366","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.281853+0000","last_change":"2024-09-12T00:38:49.281790+0000","last_active":"2024-09-12T00:38:49.281853+0000","last_peered":"2024-09-12T00:38:49.281853+0000","last_clean":"2024-09-12T00:38:49.281853+0000","last_became_active":"2024-09-12T00:01:57.165226+0000","last_became_peered":"2024-09-12T00:01:57.165226+0000","last_unstale":"2024-09-12T00:38:49.281853+0000","last_undegraded":"2024-09-12T00:38:49.281853+0000","last_fullsized":"2024-09-12T00:38:49.281853+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'366","last_scrub_stamp":"2024-09-12T00:38:49.281653+0000","last_deep_scrub":"261'366","last_deep_scrub_stamp":"2024-09-12T00:38:49.281653+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.281653+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:38.107200+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436889,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":580,"num_read_kb":11178,"num_write":1222,"num_write_kb":42398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510231+0000","last_change":"2024-09-12T00:02:01.154098+0000","last_active":"2024-09-12T00:35:49.510231+0000","last_peered":"2024-09-12T00:35:49.510231+0000","last_clean":"2024-09-12T00:35:49.510231+0000","last_became_active":"2024-09-12T00:02:01.153818+0000","last_became_peered":"2024-09-12T00:02:01.153818+0000","last_unstale":"2024-09-12T00:35:49.510231+0000","last_undegraded":"2024-09-12T00:35:49.510231+0000","last_fullsized":"2024-09-12T00:35:49.510231+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:57.741932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'292","reported_seq":856,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.466483+0000","last_change":"2024-09-12T00:02:03.152712+0000","last_active":"2024-09-12T00:38:36.466483+0000","last_peered":"2024-09-12T00:38:36.466483+0000","last_clean":"2024-09-12T00:38:36.466483+0000","last_became_active":"2024-09-12T00:02:03.152421+0000","last_became_peered":"2024-09-12T00:02:03.152421+0000","last_unstale":"2024-09-12T00:38:36.466483+0000","last_undegraded":"2024-09-12T00:38:36.466483+0000","last_fullsized":"2024-09-12T00:38:36.466483+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:06.190143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49051,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":1143,"num_write":402,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'761","reported_seq":2118,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.745299+0000","last_change":"2024-09-12T00:02:05.164910+0000","last_active":"2024-09-12T00:38:37.745299+0000","last_peered":"2024-09-12T00:38:37.745299+0000","last_clean":"2024-09-12T00:38:37.745299+0000","last_became_active":"2024-09-12T00:02:05.164655+0000","last_became_peered":"2024-09-12T00:02:05.164655+0000","last_unstale":"2024-09-12T00:38:37.745299+0000","last_undegraded":"2024-09-12T00:38:37.745299+0000","last_fullsized":"2024-09-12T00:38:37.745299+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:28.772936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'95","reported_seq":570,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:00.719827+0000","last_change":"2024-09-12T00:02:07.165060+0000","last_active":"2024-09-12T00:37:00.719827+0000","last_peered":"2024-09-12T00:37:00.719827+0000","last_clean":"2024-09-12T00:37:00.719827+0000","last_became_active":"2024-09-12T00:02:07.164754+0000","last_became_peered":"2024-09-12T00:02:07.164754+0000","last_unstale":"2024-09-12T00:37:00.719827+0000","last_undegraded":"2024-09-12T00:37:00.719827+0000","last_fullsized":"2024-09-12T00:37:00.719827+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:35.892955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":233,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'86","reported_seq":648,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.080211+0000","last_change":"2024-09-12T00:38:52.080211+0000","last_active":"2024-09-12T00:38:52.080211+0000","last_peered":"2024-09-12T00:38:52.080211+0000","last_clean":"2024-09-12T00:38:52.080211+0000","last_became_active":"2024-09-12T00:01:59.157172+0000","last_became_peered":"2024-09-12T00:01:59.157172+0000","last_unstale":"2024-09-12T00:38:52.080211+0000","last_undegraded":"2024-09-12T00:38:52.080211+0000","last_fullsized":"2024-09-12T00:38:52.080211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'86","last_scrub_stamp":"2024-09-12T00:38:52.080123+0000","last_deep_scrub":"261'86","last_deep_scrub_stamp":"2024-09-12T00:38:52.080123+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.080123+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:17.189295+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":384,"num_read_kb":356,"num_write":138,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2877,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'377","reported_seq":1036,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.321918+0000","last_change":"2024-09-12T00:38:48.321852+0000","last_active":"2024-09-12T00:38:48.321918+0000","last_peered":"2024-09-12T00:38:48.321918+0000","last_clean":"2024-09-12T00:38:48.321918+0000","last_became_active":"2024-09-12T00:01:57.145710+0000","last_became_peered":"2024-09-12T00:01:57.145710+0000","last_unstale":"2024-09-12T00:38:48.321918+0000","last_undegraded":"2024-09-12T00:38:48.321918+0000","last_fullsized":"2024-09-12T00:38:48.321918+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'377","last_scrub_stamp":"2024-09-12T00:38:48.321674+0000","last_deep_scrub":"261'377","last_deep_scrub_stamp":"2024-09-12T00:38:48.321674+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.321674+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:27.181005+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1440158,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":582,"num_read_kb":20019,"num_write":1294,"num_write_kb":22247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"261'8","reported_seq":1931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.449113+0000","last_change":"2024-09-12T00:38:56.449113+0000","last_active":"2024-09-12T00:38:56.449113+0000","last_peered":"2024-09-12T00:38:56.449113+0000","last_clean":"2024-09-12T00:38:56.449113+0000","last_became_active":"2024-09-12T00:02:01.143823+0000","last_became_peered":"2024-09-12T00:02:01.143823+0000","last_unstale":"2024-09-12T00:38:56.449113+0000","last_undegraded":"2024-09-12T00:38:56.449113+0000","last_fullsized":"2024-09-12T00:38:56.449113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T00:38:56.449020+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T00:38:56.449020+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.449020+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:41.425744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1676,"num_read_kb":1674,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'65","reported_seq":563,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:26.578538+0000","last_change":"2024-09-12T00:02:03.157279+0000","last_active":"2024-09-12T00:36:26.578538+0000","last_peered":"2024-09-12T00:36:26.578538+0000","last_clean":"2024-09-12T00:36:26.578538+0000","last_became_active":"2024-09-12T00:02:03.156680+0000","last_became_peered":"2024-09-12T00:02:03.156680+0000","last_unstale":"2024-09-12T00:36:26.578538+0000","last_undegraded":"2024-09-12T00:36:26.578538+0000","last_fullsized":"2024-09-12T00:36:26.578538+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:51.959162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'775","reported_seq":2289,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.893501+0000","last_change":"2024-09-12T00:02:05.164449+0000","last_active":"2024-09-12T00:38:35.893501+0000","last_peered":"2024-09-12T00:38:35.893501+0000","last_clean":"2024-09-12T00:38:35.893501+0000","last_became_active":"2024-09-12T00:02:05.163596+0000","last_became_peered":"2024-09-12T00:02:05.163596+0000","last_unstale":"2024-09-12T00:38:35.893501+0000","last_undegraded":"2024-09-12T00:38:35.893501+0000","last_fullsized":"2024-09-12T00:38:35.893501+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:08:09.031568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'118","reported_seq":600,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.085766+0000","last_change":"2024-09-12T00:02:07.169460+0000","last_active":"2024-09-12T00:37:22.085766+0000","last_peered":"2024-09-12T00:37:22.085766+0000","last_clean":"2024-09-12T00:37:22.085766+0000","last_became_active":"2024-09-12T00:02:07.169160+0000","last_became_peered":"2024-09-12T00:02:07.169160+0000","last_unstale":"2024-09-12T00:37:22.085766+0000","last_undegraded":"2024-09-12T00:37:22.085766+0000","last_fullsized":"2024-09-12T00:37:22.085766+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:26.962721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":119,"num_write":276,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'226","reported_seq":793,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.777724+0000","last_change":"2024-09-12T00:38:48.777724+0000","last_active":"2024-09-12T00:38:48.777724+0000","last_peered":"2024-09-12T00:38:48.777724+0000","last_clean":"2024-09-12T00:38:48.777724+0000","last_became_active":"2024-09-12T00:01:59.152145+0000","last_became_peered":"2024-09-12T00:01:59.152145+0000","last_unstale":"2024-09-12T00:38:48.777724+0000","last_undegraded":"2024-09-12T00:38:48.777724+0000","last_fullsized":"2024-09-12T00:38:48.777724+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'226","last_scrub_stamp":"2024-09-12T00:38:48.777643+0000","last_deep_scrub":"261'226","last_deep_scrub_stamp":"2024-09-12T00:38:48.777643+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.777643+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:12.164018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":744,"num_write":332,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'404","reported_seq":1118,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.557690+0000","last_change":"2024-09-12T00:38:48.557690+0000","last_active":"2024-09-12T00:38:48.557690+0000","last_peered":"2024-09-12T00:38:48.557690+0000","last_clean":"2024-09-12T00:38:48.557690+0000","last_became_active":"2024-09-12T00:01:57.140715+0000","last_became_peered":"2024-09-12T00:01:57.140715+0000","last_unstale":"2024-09-12T00:38:48.557690+0000","last_undegraded":"2024-09-12T00:38:48.557690+0000","last_fullsized":"2024-09-12T00:38:48.557690+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'404","last_scrub_stamp":"2024-09-12T00:38:48.557572+0000","last_deep_scrub":"261'404","last_deep_scrub_stamp":"2024-09-12T00:38:48.557572+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.557572+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.419290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":94303,"num_write":1279,"num_write_kb":32809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.392478+0000","last_change":"2024-09-12T00:02:01.153751+0000","last_active":"2024-09-12T00:35:49.392478+0000","last_peered":"2024-09-12T00:35:49.392478+0000","last_clean":"2024-09-12T00:35:49.392478+0000","last_became_active":"2024-09-12T00:02:01.153347+0000","last_became_peered":"2024-09-12T00:02:01.153347+0000","last_unstale":"2024-09-12T00:35:49.392478+0000","last_undegraded":"2024-09-12T00:35:49.392478+0000","last_fullsized":"2024-09-12T00:35:49.392478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:05.059094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'323","reported_seq":918,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.413073+0000","last_change":"2024-09-12T00:39:01.413073+0000","last_active":"2024-09-12T00:39:01.413073+0000","last_peered":"2024-09-12T00:39:01.413073+0000","last_clean":"2024-09-12T00:39:01.413073+0000","last_became_active":"2024-09-12T00:02:03.154752+0000","last_became_peered":"2024-09-12T00:02:03.154752+0000","last_unstale":"2024-09-12T00:39:01.413073+0000","last_undegraded":"2024-09-12T00:39:01.413073+0000","last_fullsized":"2024-09-12T00:39:01.413073+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-12T00:39:01.412937+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-12T00:39:01.412937+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.412937+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:32.529380+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43947,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1120,"num_write":412,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627588+0000","last_change":"2024-09-12T00:02:05.164441+0000","last_active":"2024-09-12T00:35:49.627588+0000","last_peered":"2024-09-12T00:35:49.627588+0000","last_clean":"2024-09-12T00:35:49.627588+0000","last_became_active":"2024-09-12T00:02:05.164108+0000","last_became_peered":"2024-09-12T00:02:05.164108+0000","last_unstale":"2024-09-12T00:35:49.627588+0000","last_undegraded":"2024-09-12T00:35:49.627588+0000","last_fullsized":"2024-09-12T00:35:49.627588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:12.635310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'159","reported_seq":633,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.847980+0000","last_change":"2024-09-12T00:02:07.169610+0000","last_active":"2024-09-12T00:36:52.847980+0000","last_peered":"2024-09-12T00:36:52.847980+0000","last_clean":"2024-09-12T00:36:52.847980+0000","last_became_active":"2024-09-12T00:02:07.169351+0000","last_became_peered":"2024-09-12T00:02:07.169351+0000","last_unstale":"2024-09-12T00:36:52.847980+0000","last_undegraded":"2024-09-12T00:36:52.847980+0000","last_fullsized":"2024-09-12T00:36:52.847980+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:28.308716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":164,"num_write":397,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'164","reported_seq":768,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:26.283270+0000","last_change":"2024-09-12T00:01:59.151096+0000","last_active":"2024-09-12T00:36:26.283270+0000","last_peered":"2024-09-12T00:36:26.283270+0000","last_clean":"2024-09-12T00:36:26.283270+0000","last_became_active":"2024-09-12T00:01:59.150072+0000","last_became_peered":"2024-09-12T00:01:59.150072+0000","last_unstale":"2024-09-12T00:36:26.283270+0000","last_undegraded":"2024-09-12T00:36:26.283270+0000","last_fullsized":"2024-09-12T00:36:26.283270+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:28.419527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":763,"num_read_kb":636,"num_write":273,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"261'74","reported_seq":615,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:42.491365+0000","last_change":"2024-09-12T00:38:42.491365+0000","last_active":"2024-09-12T00:38:42.491365+0000","last_peered":"2024-09-12T00:38:42.491365+0000","last_clean":"2024-09-12T00:38:42.491365+0000","last_became_active":"2024-09-12T00:01:39.720425+0000","last_became_peered":"2024-09-12T00:01:39.720425+0000","last_unstale":"2024-09-12T00:38:42.491365+0000","last_undegraded":"2024-09-12T00:38:42.491365+0000","last_fullsized":"2024-09-12T00:38:42.491365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'74","last_scrub_stamp":"2024-09-12T00:38:42.491259+0000","last_deep_scrub":"261'74","last_deep_scrub_stamp":"2024-09-12T00:38:42.491259+0000","last_clean_scrub_stamp":"2024-09-12T00:38:42.491259+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:28.887567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"261'2","reported_seq":521,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.331659+0000","last_change":"2024-09-12T00:38:44.331659+0000","last_active":"2024-09-12T00:38:44.331659+0000","last_peered":"2024-09-12T00:38:44.331659+0000","last_clean":"2024-09-12T00:38:44.331659+0000","last_became_active":"2024-09-12T00:01:46.613916+0000","last_became_peered":"2024-09-12T00:01:46.613916+0000","last_unstale":"2024-09-12T00:38:44.331659+0000","last_undegraded":"2024-09-12T00:38:44.331659+0000","last_fullsized":"2024-09-12T00:38:44.331659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:38:44.331592+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:38:44.331592+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.331592+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:42.535188+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0014566500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'375","reported_seq":1076,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.581469+0000","last_change":"2024-09-12T00:38:46.581469+0000","last_active":"2024-09-12T00:38:46.581469+0000","last_peered":"2024-09-12T00:38:46.581469+0000","last_clean":"2024-09-12T00:38:46.581469+0000","last_became_active":"2024-09-12T00:01:57.141553+0000","last_became_peered":"2024-09-12T00:01:57.141553+0000","last_unstale":"2024-09-12T00:38:46.581469+0000","last_undegraded":"2024-09-12T00:38:46.581469+0000","last_fullsized":"2024-09-12T00:38:46.581469+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'375","last_scrub_stamp":"2024-09-12T00:38:46.581372+0000","last_deep_scrub":"261'375","last_deep_scrub_stamp":"2024-09-12T00:38:46.581372+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.581372+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:35.589907+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":706,"num_read_kb":51090,"num_write":1043,"num_write_kb":49735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.387995+0000","last_change":"2024-09-12T00:02:01.148969+0000","last_active":"2024-09-12T00:35:24.387995+0000","last_peered":"2024-09-12T00:35:24.387995+0000","last_clean":"2024-09-12T00:35:24.387995+0000","last_became_active":"2024-09-12T00:02:01.148696+0000","last_became_peered":"2024-09-12T00:02:01.148696+0000","last_unstale":"2024-09-12T00:35:24.387995+0000","last_undegraded":"2024-09-12T00:35:24.387995+0000","last_fullsized":"2024-09-12T00:35:24.387995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:28.294552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'690","reported_seq":1385,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.042734+0000","last_change":"2024-09-12T00:02:03.150355+0000","last_active":"2024-09-12T00:38:38.042734+0000","last_peered":"2024-09-12T00:38:38.042734+0000","last_clean":"2024-09-12T00:38:38.042734+0000","last_became_active":"2024-09-12T00:02:03.150075+0000","last_became_peered":"2024-09-12T00:02:03.150075+0000","last_unstale":"2024-09-12T00:38:38.042734+0000","last_undegraded":"2024-09-12T00:38:38.042734+0000","last_fullsized":"2024-09-12T00:38:38.042734+0000","mapping_epoch":30,"log_start":"261'600","ondisk_log_start":"261'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141385,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1354,"num_read_kb":3064,"num_write":1242,"num_write_kb":1087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:44.517342+0000","last_change":"2024-09-12T00:02:05.162858+0000","last_active":"2024-09-12T00:36:44.517342+0000","last_peered":"2024-09-12T00:36:44.517342+0000","last_clean":"2024-09-12T00:36:44.517342+0000","last_became_active":"2024-09-12T00:02:05.162455+0000","last_became_peered":"2024-09-12T00:02:05.162455+0000","last_unstale":"2024-09-12T00:36:44.517342+0000","last_undegraded":"2024-09-12T00:36:44.517342+0000","last_fullsized":"2024-09-12T00:36:44.517342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'258","reported_seq":960,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.510166+0000","last_change":"2024-09-12T00:02:07.168139+0000","last_active":"2024-09-12T00:37:23.510166+0000","last_peered":"2024-09-12T00:37:23.510166+0000","last_clean":"2024-09-12T00:37:23.510166+0000","last_became_active":"2024-09-12T00:02:07.167844+0000","last_became_peered":"2024-09-12T00:02:07.167844+0000","last_unstale":"2024-09-12T00:37:23.510166+0000","last_undegraded":"2024-09-12T00:37:23.510166+0000","last_fullsized":"2024-09-12T00:37:23.510166+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":469,"num_read_kb":454,"num_write":531,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'172","reported_seq":770,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.825993+0000","last_change":"2024-09-12T00:38:58.825993+0000","last_active":"2024-09-12T00:38:58.825993+0000","last_peered":"2024-09-12T00:38:58.825993+0000","last_clean":"2024-09-12T00:38:58.825993+0000","last_became_active":"2024-09-12T00:01:59.149145+0000","last_became_peered":"2024-09-12T00:01:59.149145+0000","last_unstale":"2024-09-12T00:38:58.825993+0000","last_undegraded":"2024-09-12T00:38:58.825993+0000","last_fullsized":"2024-09-12T00:38:58.825993+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'172","last_scrub_stamp":"2024-09-12T00:38:58.825895+0000","last_deep_scrub":"261'172","last_deep_scrub_stamp":"2024-09-12T00:38:58.825895+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.825895+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:12.181956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":604,"num_write":249,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.344663+0000","last_change":"2024-09-12T00:38:43.344663+0000","last_active":"2024-09-12T00:38:43.344663+0000","last_peered":"2024-09-12T00:38:43.344663+0000","last_clean":"2024-09-12T00:38:43.344663+0000","last_became_active":"2024-09-12T00:01:46.505677+0000","last_became_peered":"2024-09-12T00:01:46.505677+0000","last_unstale":"2024-09-12T00:38:43.344663+0000","last_undegraded":"2024-09-12T00:38:43.344663+0000","last_fullsized":"2024-09-12T00:38:43.344663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:43.344592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:43.344592+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.344592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:02.518245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00075102999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'327","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.034002+0000","last_change":"2024-09-12T00:38:48.034002+0000","last_active":"2024-09-12T00:38:48.034002+0000","last_peered":"2024-09-12T00:38:48.034002+0000","last_clean":"2024-09-12T00:38:48.034002+0000","last_became_active":"2024-09-12T00:01:57.152153+0000","last_became_peered":"2024-09-12T00:01:57.152153+0000","last_unstale":"2024-09-12T00:38:48.034002+0000","last_undegraded":"2024-09-12T00:38:48.034002+0000","last_fullsized":"2024-09-12T00:38:48.034002+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'327","last_scrub_stamp":"2024-09-12T00:38:48.033865+0000","last_deep_scrub":"261'327","last_deep_scrub_stamp":"2024-09-12T00:38:48.033865+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.033865+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:01.645214+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263237,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":31136,"num_write":994,"num_write_kb":29868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:44.399327+0000","last_change":"2024-09-12T00:02:01.153210+0000","last_active":"2024-09-12T00:36:44.399327+0000","last_peered":"2024-09-12T00:36:44.399327+0000","last_clean":"2024-09-12T00:36:44.399327+0000","last_became_active":"2024-09-12T00:02:01.152904+0000","last_became_peered":"2024-09-12T00:02:01.152904+0000","last_unstale":"2024-09-12T00:36:44.399327+0000","last_undegraded":"2024-09-12T00:36:44.399327+0000","last_fullsized":"2024-09-12T00:36:44.399327+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1213","reported_seq":2572,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.975535+0000","last_change":"2024-09-12T00:02:03.153993+0000","last_active":"2024-09-12T00:38:37.975535+0000","last_peered":"2024-09-12T00:38:37.975535+0000","last_clean":"2024-09-12T00:38:37.975535+0000","last_became_active":"2024-09-12T00:02:03.153702+0000","last_became_peered":"2024-09-12T00:02:03.153702+0000","last_unstale":"2024-09-12T00:38:37.975535+0000","last_undegraded":"2024-09-12T00:38:37.975535+0000","last_fullsized":"2024-09-12T00:38:37.975535+0000","mapping_epoch":30,"log_start":"261'1200","ondisk_log_start":"261'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.693992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137303,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1920,"num_read_kb":3540,"num_write":1014,"num_write_kb":851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:29.389647+0000","last_change":"2024-09-12T00:02:05.172331+0000","last_active":"2024-09-12T00:35:29.389647+0000","last_peered":"2024-09-12T00:35:29.389647+0000","last_clean":"2024-09-12T00:35:29.389647+0000","last_became_active":"2024-09-12T00:02:05.171787+0000","last_became_peered":"2024-09-12T00:02:05.171787+0000","last_unstale":"2024-09-12T00:35:29.389647+0000","last_undegraded":"2024-09-12T00:35:29.389647+0000","last_fullsized":"2024-09-12T00:35:29.389647+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:38.114555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'217","reported_seq":737,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.191898+0000","last_change":"2024-09-12T00:02:07.169700+0000","last_active":"2024-09-12T00:36:56.191898+0000","last_peered":"2024-09-12T00:36:56.191898+0000","last_clean":"2024-09-12T00:36:56.191898+0000","last_became_active":"2024-09-12T00:02:07.169173+0000","last_became_peered":"2024-09-12T00:02:07.169173+0000","last_unstale":"2024-09-12T00:36:56.191898+0000","last_undegraded":"2024-09-12T00:36:56.191898+0000","last_fullsized":"2024-09-12T00:36:56.191898+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:07.710548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":374,"num_read_kb":362,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'89","reported_seq":649,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.951095+0000","last_change":"2024-09-12T00:38:56.951095+0000","last_active":"2024-09-12T00:38:56.951095+0000","last_peered":"2024-09-12T00:38:56.951095+0000","last_clean":"2024-09-12T00:38:56.951095+0000","last_became_active":"2024-09-12T00:01:59.138731+0000","last_became_peered":"2024-09-12T00:01:59.138731+0000","last_unstale":"2024-09-12T00:38:56.951095+0000","last_undegraded":"2024-09-12T00:38:56.951095+0000","last_fullsized":"2024-09-12T00:38:56.951095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'89","last_scrub_stamp":"2024-09-12T00:38:56.950966+0000","last_deep_scrub":"261'89","last_deep_scrub_stamp":"2024-09-12T00:38:56.950966+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.950966+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:18.408760+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":368,"num_read_kb":306,"num_write":121,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":511,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.785441+0000","last_change":"2024-09-12T00:38:44.785441+0000","last_active":"2024-09-12T00:38:44.785441+0000","last_peered":"2024-09-12T00:38:44.785441+0000","last_clean":"2024-09-12T00:38:44.785441+0000","last_became_active":"2024-09-12T00:01:46.505857+0000","last_became_peered":"2024-09-12T00:01:46.505857+0000","last_unstale":"2024-09-12T00:38:44.785441+0000","last_undegraded":"2024-09-12T00:38:44.785441+0000","last_fullsized":"2024-09-12T00:38:44.785441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:44.785356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:44.785356+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.785356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:13.579766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039331300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'325","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.790044+0000","last_change":"2024-09-12T00:38:46.790044+0000","last_active":"2024-09-12T00:38:46.790044+0000","last_peered":"2024-09-12T00:38:46.790044+0000","last_clean":"2024-09-12T00:38:46.790044+0000","last_became_active":"2024-09-12T00:01:57.151644+0000","last_became_peered":"2024-09-12T00:01:57.151644+0000","last_unstale":"2024-09-12T00:38:46.790044+0000","last_undegraded":"2024-09-12T00:38:46.790044+0000","last_fullsized":"2024-09-12T00:38:46.790044+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'325","last_scrub_stamp":"2024-09-12T00:38:46.789939+0000","last_deep_scrub":"261'325","last_deep_scrub_stamp":"2024-09-12T00:38:46.789939+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.789939+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:00.959710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399150,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":451,"num_read_kb":2375,"num_write":1107,"num_write_kb":41035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"261'2","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.895506+0000","last_change":"2024-09-12T00:38:56.895506+0000","last_active":"2024-09-12T00:38:56.895506+0000","last_peered":"2024-09-12T00:38:56.895506+0000","last_clean":"2024-09-12T00:38:56.895506+0000","last_became_active":"2024-09-12T00:02:01.151474+0000","last_became_peered":"2024-09-12T00:02:01.151474+0000","last_unstale":"2024-09-12T00:38:56.895506+0000","last_undegraded":"2024-09-12T00:38:56.895506+0000","last_fullsized":"2024-09-12T00:38:56.895506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:38:56.895390+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:38:56.895390+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.895390+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:45.952295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'208","reported_seq":1181,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:25.299127+0000","last_change":"2024-09-12T00:02:03.155847+0000","last_active":"2024-09-12T00:38:25.299127+0000","last_peered":"2024-09-12T00:38:25.299127+0000","last_clean":"2024-09-12T00:38:25.299127+0000","last_became_active":"2024-09-12T00:02:03.155311+0000","last_became_peered":"2024-09-12T00:02:03.155311+0000","last_unstale":"2024-09-12T00:38:25.299127+0000","last_undegraded":"2024-09-12T00:38:25.299127+0000","last_fullsized":"2024-09-12T00:38:25.299127+0000","mapping_epoch":30,"log_start":"258'100","ondisk_log_start":"258'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:37.168360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":119,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:27.509399+0000","last_change":"2024-09-12T00:02:05.168343+0000","last_active":"2024-09-12T00:35:27.509399+0000","last_peered":"2024-09-12T00:35:27.509399+0000","last_clean":"2024-09-12T00:35:27.509399+0000","last_became_active":"2024-09-12T00:02:05.167874+0000","last_became_peered":"2024-09-12T00:02:05.167874+0000","last_unstale":"2024-09-12T00:35:27.509399+0000","last_undegraded":"2024-09-12T00:35:27.509399+0000","last_fullsized":"2024-09-12T00:35:27.509399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:12.012160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'262","reported_seq":856,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.604136+0000","last_change":"2024-09-12T00:02:07.162130+0000","last_active":"2024-09-12T00:37:23.604136+0000","last_peered":"2024-09-12T00:37:23.604136+0000","last_clean":"2024-09-12T00:37:23.604136+0000","last_became_active":"2024-09-12T00:02:07.161814+0000","last_became_peered":"2024-09-12T00:02:07.161814+0000","last_unstale":"2024-09-12T00:37:23.604136+0000","last_undegraded":"2024-09-12T00:37:23.604136+0000","last_fullsized":"2024-09-12T00:37:23.604136+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:02.767585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":499,"num_read_kb":517,"num_write":567,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'136","reported_seq":720,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.975704+0000","last_change":"2024-09-12T00:38:53.975704+0000","last_active":"2024-09-12T00:38:53.975704+0000","last_peered":"2024-09-12T00:38:53.975704+0000","last_clean":"2024-09-12T00:38:53.975704+0000","last_became_active":"2024-09-12T00:01:59.153542+0000","last_became_peered":"2024-09-12T00:01:59.153542+0000","last_unstale":"2024-09-12T00:38:53.975704+0000","last_undegraded":"2024-09-12T00:38:53.975704+0000","last_fullsized":"2024-09-12T00:38:53.975704+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'136","last_scrub_stamp":"2024-09-12T00:38:53.975609+0000","last_deep_scrub":"261'136","last_deep_scrub_stamp":"2024-09-12T00:38:53.975609+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.975609+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:02.481618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":619,"num_read_kb":513,"num_write":207,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"261'3","reported_seq":522,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.339714+0000","last_change":"2024-09-12T00:38:45.339714+0000","last_active":"2024-09-12T00:38:45.339714+0000","last_peered":"2024-09-12T00:38:45.339714+0000","last_clean":"2024-09-12T00:38:45.339714+0000","last_became_active":"2024-09-12T00:01:46.502428+0000","last_became_peered":"2024-09-12T00:01:46.502428+0000","last_unstale":"2024-09-12T00:38:45.339714+0000","last_undegraded":"2024-09-12T00:38:45.339714+0000","last_fullsized":"2024-09-12T00:38:45.339714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:38:45.339643+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:38:45.339643+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.339643+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:28.135971+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001414925,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'334","reported_seq":961,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.197753+0000","last_change":"2024-09-12T00:38:45.197753+0000","last_active":"2024-09-12T00:38:45.197753+0000","last_peered":"2024-09-12T00:38:45.197753+0000","last_clean":"2024-09-12T00:38:45.197753+0000","last_became_active":"2024-09-12T00:01:57.156172+0000","last_became_peered":"2024-09-12T00:01:57.156172+0000","last_unstale":"2024-09-12T00:38:45.197753+0000","last_undegraded":"2024-09-12T00:38:45.197753+0000","last_fullsized":"2024-09-12T00:38:45.197753+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'334","last_scrub_stamp":"2024-09-12T00:38:45.197636+0000","last_deep_scrub":"261'334","last_deep_scrub_stamp":"2024-09-12T00:38:45.197636+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.197636+0000","objects_scrubbed":10,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:41.388701+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7788939,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":443,"num_read_kb":22094,"num_write":1095,"num_write_kb":41486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.899831+0000","last_change":"2024-09-12T00:38:55.899831+0000","last_active":"2024-09-12T00:38:55.899831+0000","last_peered":"2024-09-12T00:38:55.899831+0000","last_clean":"2024-09-12T00:38:55.899831+0000","last_became_active":"2024-09-12T00:02:01.152752+0000","last_became_peered":"2024-09-12T00:02:01.152752+0000","last_unstale":"2024-09-12T00:38:55.899831+0000","last_undegraded":"2024-09-12T00:38:55.899831+0000","last_fullsized":"2024-09-12T00:38:55.899831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:55.899739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:55.899739+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.899739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:27.345544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'112","reported_seq":632,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:29.063314+0000","last_change":"2024-09-12T00:02:03.152362+0000","last_active":"2024-09-12T00:38:29.063314+0000","last_peered":"2024-09-12T00:38:29.063314+0000","last_clean":"2024-09-12T00:38:29.063314+0000","last_became_active":"2024-09-12T00:02:03.152008+0000","last_became_peered":"2024-09-12T00:02:03.152008+0000","last_unstale":"2024-09-12T00:38:29.063314+0000","last_undegraded":"2024-09-12T00:38:29.063314+0000","last_fullsized":"2024-09-12T00:38:29.063314+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":94,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:44.399292+0000","last_change":"2024-09-12T00:02:05.170927+0000","last_active":"2024-09-12T00:36:44.399292+0000","last_peered":"2024-09-12T00:36:44.399292+0000","last_clean":"2024-09-12T00:36:44.399292+0000","last_became_active":"2024-09-12T00:02:05.170487+0000","last_became_peered":"2024-09-12T00:02:05.170487+0000","last_unstale":"2024-09-12T00:36:44.399292+0000","last_undegraded":"2024-09-12T00:36:44.399292+0000","last_fullsized":"2024-09-12T00:36:44.399292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":663,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:52.638704+0000","last_change":"2024-09-12T00:02:07.169125+0000","last_active":"2024-09-12T00:36:52.638704+0000","last_peered":"2024-09-12T00:36:52.638704+0000","last_clean":"2024-09-12T00:36:52.638704+0000","last_became_active":"2024-09-12T00:02:07.168820+0000","last_became_peered":"2024-09-12T00:02:07.168820+0000","last_unstale":"2024-09-12T00:36:52.638704+0000","last_undegraded":"2024-09-12T00:36:52.638704+0000","last_fullsized":"2024-09-12T00:36:52.638704+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":226,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'300","reported_seq":892,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.984514+0000","last_change":"2024-09-12T00:38:51.984514+0000","last_active":"2024-09-12T00:38:51.984514+0000","last_peered":"2024-09-12T00:38:51.984514+0000","last_clean":"2024-09-12T00:38:51.984514+0000","last_became_active":"2024-09-12T00:01:59.145273+0000","last_became_peered":"2024-09-12T00:01:59.145273+0000","last_unstale":"2024-09-12T00:38:51.984514+0000","last_undegraded":"2024-09-12T00:38:51.984514+0000","last_fullsized":"2024-09-12T00:38:51.984514+0000","mapping_epoch":26,"log_start":"258'200","ondisk_log_start":"258'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'300","last_scrub_stamp":"2024-09-12T00:38:51.984415+0000","last_deep_scrub":"261'300","last_deep_scrub_stamp":"2024-09-12T00:38:51.984415+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.984415+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:31.222270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1215,"num_write":550,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'372","reported_seq":1075,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.014947+0000","last_change":"2024-09-12T00:38:44.014947+0000","last_active":"2024-09-12T00:38:44.014947+0000","last_peered":"2024-09-12T00:38:44.014947+0000","last_clean":"2024-09-12T00:38:44.014947+0000","last_became_active":"2024-09-12T00:01:57.154387+0000","last_became_peered":"2024-09-12T00:01:57.154387+0000","last_unstale":"2024-09-12T00:38:44.014947+0000","last_undegraded":"2024-09-12T00:38:44.014947+0000","last_fullsized":"2024-09-12T00:38:44.014947+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'372","last_scrub_stamp":"2024-09-12T00:38:44.014836+0000","last_deep_scrub":"261'372","last_deep_scrub_stamp":"2024-09-12T00:38:44.014836+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.014836+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:12.072171+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6404752,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":635,"num_read_kb":122441,"num_write":1157,"num_write_kb":43815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":517,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.795387+0000","last_change":"2024-09-12T00:38:44.795387+0000","last_active":"2024-09-12T00:38:44.795387+0000","last_peered":"2024-09-12T00:38:44.795387+0000","last_clean":"2024-09-12T00:38:44.795387+0000","last_became_active":"2024-09-12T00:01:46.505954+0000","last_became_peered":"2024-09-12T00:01:46.505954+0000","last_unstale":"2024-09-12T00:38:44.795387+0000","last_undegraded":"2024-09-12T00:38:44.795387+0000","last_fullsized":"2024-09-12T00:38:44.795387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:44.795256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:44.795256+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.795256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:45.361353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050498000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.578391+0000","last_change":"2024-09-12T00:39:01.578391+0000","last_active":"2024-09-12T00:39:01.578391+0000","last_peered":"2024-09-12T00:39:01.578391+0000","last_clean":"2024-09-12T00:39:01.578391+0000","last_became_active":"2024-09-12T00:02:01.149529+0000","last_became_peered":"2024-09-12T00:02:01.149529+0000","last_unstale":"2024-09-12T00:39:01.578391+0000","last_undegraded":"2024-09-12T00:39:01.578391+0000","last_fullsized":"2024-09-12T00:39:01.578391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:01.578285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:01.578285+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.578285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:50.557711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'566","reported_seq":1225,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.918702+0000","last_change":"2024-09-12T00:38:57.918702+0000","last_active":"2024-09-12T00:38:57.918702+0000","last_peered":"2024-09-12T00:38:57.918702+0000","last_clean":"2024-09-12T00:38:57.918702+0000","last_became_active":"2024-09-12T00:02:03.152535+0000","last_became_peered":"2024-09-12T00:02:03.152535+0000","last_unstale":"2024-09-12T00:38:57.918702+0000","last_undegraded":"2024-09-12T00:38:57.918702+0000","last_fullsized":"2024-09-12T00:38:57.918702+0000","mapping_epoch":30,"log_start":"261'500","ondisk_log_start":"261'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'566","last_scrub_stamp":"2024-09-12T00:38:57.918575+0000","last_deep_scrub":"261'566","last_deep_scrub_stamp":"2024-09-12T00:38:57.918575+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.918575+0000","objects_scrubbed":11,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:11.867915+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88538,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1530,"num_read_kb":2694,"num_write":1952,"num_write_kb":1782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500800,"num_omap_keys":1132,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":471,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.623486+0000","last_change":"2024-09-12T00:02:05.168263+0000","last_active":"2024-09-12T00:35:24.623486+0000","last_peered":"2024-09-12T00:35:24.623486+0000","last_clean":"2024-09-12T00:35:24.623486+0000","last_became_active":"2024-09-12T00:02:05.167998+0000","last_became_peered":"2024-09-12T00:02:05.167998+0000","last_unstale":"2024-09-12T00:35:24.623486+0000","last_undegraded":"2024-09-12T00:35:24.623486+0000","last_fullsized":"2024-09-12T00:35:24.623486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:50.635765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'161","reported_seq":644,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.451268+0000","last_change":"2024-09-12T00:02:07.168288+0000","last_active":"2024-09-12T00:37:23.451268+0000","last_peered":"2024-09-12T00:37:23.451268+0000","last_clean":"2024-09-12T00:37:23.451268+0000","last_became_active":"2024-09-12T00:02:07.168005+0000","last_became_peered":"2024-09-12T00:02:07.168005+0000","last_unstale":"2024-09-12T00:37:23.451268+0000","last_undegraded":"2024-09-12T00:37:23.451268+0000","last_fullsized":"2024-09-12T00:37:23.451268+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:33.779846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":133,"num_write":373,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'349","reported_seq":1001,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.984694+0000","last_change":"2024-09-12T00:38:52.984694+0000","last_active":"2024-09-12T00:38:52.984694+0000","last_peered":"2024-09-12T00:38:52.984694+0000","last_clean":"2024-09-12T00:38:52.984694+0000","last_became_active":"2024-09-12T00:01:59.137020+0000","last_became_peered":"2024-09-12T00:01:59.137020+0000","last_unstale":"2024-09-12T00:38:52.984694+0000","last_undegraded":"2024-09-12T00:38:52.984694+0000","last_fullsized":"2024-09-12T00:38:52.984694+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T00:38:52.984578+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T00:38:52.984578+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.984578+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:32.899963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1524,"num_read_kb":1224,"num_write":576,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'301","reported_seq":914,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.139945+0000","last_change":"2024-09-12T00:38:45.139945+0000","last_active":"2024-09-12T00:38:45.139945+0000","last_peered":"2024-09-12T00:38:45.139945+0000","last_clean":"2024-09-12T00:38:45.139945+0000","last_became_active":"2024-09-12T00:01:57.152021+0000","last_became_peered":"2024-09-12T00:01:57.152021+0000","last_unstale":"2024-09-12T00:38:45.139945+0000","last_undegraded":"2024-09-12T00:38:45.139945+0000","last_fullsized":"2024-09-12T00:38:45.139945+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'301","last_scrub_stamp":"2024-09-12T00:38:45.139770+0000","last_deep_scrub":"261'301","last_deep_scrub_stamp":"2024-09-12T00:38:45.139770+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.139770+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:52.526654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288035,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":437,"num_read_kb":13162,"num_write":956,"num_write_kb":28256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.292979+0000","last_change":"2024-09-12T00:38:46.292979+0000","last_active":"2024-09-12T00:38:46.292979+0000","last_peered":"2024-09-12T00:38:46.292979+0000","last_clean":"2024-09-12T00:38:46.292979+0000","last_became_active":"2024-09-12T00:01:46.505315+0000","last_became_peered":"2024-09-12T00:01:46.505315+0000","last_unstale":"2024-09-12T00:38:46.292979+0000","last_undegraded":"2024-09-12T00:38:46.292979+0000","last_fullsized":"2024-09-12T00:38:46.292979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:46.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:46.292895+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:49.074578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079890600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.350339+0000","last_change":"2024-09-12T00:38:59.350339+0000","last_active":"2024-09-12T00:38:59.350339+0000","last_peered":"2024-09-12T00:38:59.350339+0000","last_clean":"2024-09-12T00:38:59.350339+0000","last_became_active":"2024-09-12T00:02:01.148650+0000","last_became_peered":"2024-09-12T00:02:01.148650+0000","last_unstale":"2024-09-12T00:38:59.350339+0000","last_undegraded":"2024-09-12T00:38:59.350339+0000","last_fullsized":"2024-09-12T00:38:59.350339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.350248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.350248+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.350248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:16.730657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'162","reported_seq":707,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:29.523102+0000","last_change":"2024-09-12T00:02:03.153955+0000","last_active":"2024-09-12T00:37:29.523102+0000","last_peered":"2024-09-12T00:37:29.523102+0000","last_clean":"2024-09-12T00:37:29.523102+0000","last_became_active":"2024-09-12T00:02:03.153640+0000","last_became_peered":"2024-09-12T00:02:03.153640+0000","last_unstale":"2024-09-12T00:37:29.523102+0000","last_undegraded":"2024-09-12T00:37:29.523102+0000","last_fullsized":"2024-09-12T00:37:29.523102+0000","mapping_epoch":30,"log_start":"258'100","ondisk_log_start":"258'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:03.938144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":206,"num_read_kb":198,"num_write":166,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'775","reported_seq":2508,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.890054+0000","last_change":"2024-09-12T00:02:05.165645+0000","last_active":"2024-09-12T00:38:35.890054+0000","last_peered":"2024-09-12T00:38:35.890054+0000","last_clean":"2024-09-12T00:38:35.890054+0000","last_became_active":"2024-09-12T00:02:05.163720+0000","last_became_peered":"2024-09-12T00:02:05.163720+0000","last_unstale":"2024-09-12T00:38:35.890054+0000","last_undegraded":"2024-09-12T00:38:35.890054+0000","last_fullsized":"2024-09-12T00:38:35.890054+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:23.515740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'122","reported_seq":618,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:19.409311+0000","last_change":"2024-09-12T00:02:07.168152+0000","last_active":"2024-09-12T00:38:19.409311+0000","last_peered":"2024-09-12T00:38:19.409311+0000","last_clean":"2024-09-12T00:38:19.409311+0000","last_became_active":"2024-09-12T00:02:07.167797+0000","last_became_peered":"2024-09-12T00:02:07.167797+0000","last_unstale":"2024-09-12T00:38:19.409311+0000","last_undegraded":"2024-09-12T00:38:19.409311+0000","last_fullsized":"2024-09-12T00:38:19.409311+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:43.278651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":159,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'140","reported_seq":733,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.505700+0000","last_change":"2024-09-12T00:38:56.505700+0000","last_active":"2024-09-12T00:38:56.505700+0000","last_peered":"2024-09-12T00:38:56.505700+0000","last_clean":"2024-09-12T00:38:56.505700+0000","last_became_active":"2024-09-12T00:01:59.155117+0000","last_became_peered":"2024-09-12T00:01:59.155117+0000","last_unstale":"2024-09-12T00:38:56.505700+0000","last_undegraded":"2024-09-12T00:38:56.505700+0000","last_fullsized":"2024-09-12T00:38:56.505700+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'140","last_scrub_stamp":"2024-09-12T00:38:56.505585+0000","last_deep_scrub":"261'140","last_deep_scrub_stamp":"2024-09-12T00:38:56.505585+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.505585+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:27.206689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":474,"num_write":223,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'363","reported_seq":1032,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.665051+0000","last_change":"2024-09-12T00:38:44.664927+0000","last_active":"2024-09-12T00:38:44.665051+0000","last_peered":"2024-09-12T00:38:44.665051+0000","last_clean":"2024-09-12T00:38:44.665051+0000","last_became_active":"2024-09-12T00:01:57.134235+0000","last_became_peered":"2024-09-12T00:01:57.134235+0000","last_unstale":"2024-09-12T00:38:44.665051+0000","last_undegraded":"2024-09-12T00:38:44.665051+0000","last_fullsized":"2024-09-12T00:38:44.665051+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'363","last_scrub_stamp":"2024-09-12T00:38:44.664703+0000","last_deep_scrub":"261'363","last_deep_scrub_stamp":"2024-09-12T00:38:44.664703+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.664703+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:21.197836+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":525,"num_read_kb":31500,"num_write":1186,"num_write_kb":36639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":522,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.616652+0000","last_change":"2024-09-12T00:38:43.616652+0000","last_active":"2024-09-12T00:38:43.616652+0000","last_peered":"2024-09-12T00:38:43.616652+0000","last_clean":"2024-09-12T00:38:43.616652+0000","last_became_active":"2024-09-12T00:01:46.508144+0000","last_became_peered":"2024-09-12T00:01:46.508144+0000","last_unstale":"2024-09-12T00:38:43.616652+0000","last_undegraded":"2024-09-12T00:38:43.616652+0000","last_fullsized":"2024-09-12T00:38:43.616652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:43.616556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:43.616556+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.616556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:21.006725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045024799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.388920+0000","last_change":"2024-09-12T00:02:01.153487+0000","last_active":"2024-09-12T00:35:24.388920+0000","last_peered":"2024-09-12T00:35:24.388920+0000","last_clean":"2024-09-12T00:35:24.388920+0000","last_became_active":"2024-09-12T00:02:01.153207+0000","last_became_peered":"2024-09-12T00:02:01.153207+0000","last_unstale":"2024-09-12T00:35:24.388920+0000","last_undegraded":"2024-09-12T00:35:24.388920+0000","last_fullsized":"2024-09-12T00:35:24.388920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:46.459368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'107","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.666790+0000","last_change":"2024-09-12T00:02:03.151323+0000","last_active":"2024-09-12T00:36:24.666790+0000","last_peered":"2024-09-12T00:36:24.666790+0000","last_clean":"2024-09-12T00:36:24.666790+0000","last_became_active":"2024-09-12T00:02:03.151029+0000","last_became_peered":"2024-09-12T00:02:03.151029+0000","last_unstale":"2024-09-12T00:36:24.666790+0000","last_undegraded":"2024-09-12T00:36:24.666790+0000","last_fullsized":"2024-09-12T00:36:24.666790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:22.745763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":125,"num_read_kb":114,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'782","reported_seq":4559,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.130103+0000","last_change":"2024-09-12T00:02:05.164285+0000","last_active":"2024-09-12T00:38:37.130103+0000","last_peered":"2024-09-12T00:38:37.130103+0000","last_clean":"2024-09-12T00:38:37.130103+0000","last_became_active":"2024-09-12T00:02:05.162687+0000","last_became_peered":"2024-09-12T00:02:05.162687+0000","last_unstale":"2024-09-12T00:38:37.130103+0000","last_undegraded":"2024-09-12T00:38:37.130103+0000","last_fullsized":"2024-09-12T00:38:37.130103+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:19.706882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'155","reported_seq":657,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:02.251347+0000","last_change":"2024-09-12T00:02:07.166773+0000","last_active":"2024-09-12T00:37:02.251347+0000","last_peered":"2024-09-12T00:37:02.251347+0000","last_clean":"2024-09-12T00:37:02.251347+0000","last_became_active":"2024-09-12T00:02:07.166471+0000","last_became_peered":"2024-09-12T00:02:07.166471+0000","last_unstale":"2024-09-12T00:37:02.251347+0000","last_undegraded":"2024-09-12T00:37:02.251347+0000","last_fullsized":"2024-09-12T00:37:02.251347+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:15.572916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":126,"num_write":337,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'82","reported_seq":647,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.050312+0000","last_change":"2024-09-12T00:38:50.050312+0000","last_active":"2024-09-12T00:38:50.050312+0000","last_peered":"2024-09-12T00:38:50.050312+0000","last_clean":"2024-09-12T00:38:50.050312+0000","last_became_active":"2024-09-12T00:01:59.157044+0000","last_became_peered":"2024-09-12T00:01:59.157044+0000","last_unstale":"2024-09-12T00:38:50.050312+0000","last_undegraded":"2024-09-12T00:38:50.050312+0000","last_fullsized":"2024-09-12T00:38:50.050312+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'82","last_scrub_stamp":"2024-09-12T00:38:50.050227+0000","last_deep_scrub":"261'82","last_deep_scrub_stamp":"2024-09-12T00:38:50.050227+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.050227+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:56.828569+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":122,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'433","reported_seq":1076,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.511299+0000","last_change":"2024-09-12T00:38:51.511299+0000","last_active":"2024-09-12T00:38:51.511299+0000","last_peered":"2024-09-12T00:38:51.511299+0000","last_clean":"2024-09-12T00:38:51.511299+0000","last_became_active":"2024-09-12T00:01:57.134646+0000","last_became_peered":"2024-09-12T00:01:57.134646+0000","last_unstale":"2024-09-12T00:38:51.511299+0000","last_undegraded":"2024-09-12T00:38:51.511299+0000","last_fullsized":"2024-09-12T00:38:51.511299+0000","mapping_epoch":24,"log_start":"261'400","ondisk_log_start":"261'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-12T00:38:51.511171+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-12T00:38:51.511171+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.511171+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:11.090003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":740,"num_read_kb":1717,"num_write":1248,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.334916+0000","last_change":"2024-09-12T00:38:47.334916+0000","last_active":"2024-09-12T00:38:47.334916+0000","last_peered":"2024-09-12T00:38:47.334916+0000","last_clean":"2024-09-12T00:38:47.334916+0000","last_became_active":"2024-09-12T00:01:46.502847+0000","last_became_peered":"2024-09-12T00:01:46.502847+0000","last_unstale":"2024-09-12T00:38:47.334916+0000","last_undegraded":"2024-09-12T00:38:47.334916+0000","last_fullsized":"2024-09-12T00:38:47.334916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:47.334821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:47.334821+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.334821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:23.467970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.585235+0000","last_change":"2024-09-12T00:38:59.585235+0000","last_active":"2024-09-12T00:38:59.585235+0000","last_peered":"2024-09-12T00:38:59.585235+0000","last_clean":"2024-09-12T00:38:59.585235+0000","last_became_active":"2024-09-12T00:02:01.152467+0000","last_became_peered":"2024-09-12T00:02:01.152467+0000","last_unstale":"2024-09-12T00:38:59.585235+0000","last_undegraded":"2024-09-12T00:38:59.585235+0000","last_fullsized":"2024-09-12T00:38:59.585235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.585108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.585108+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.585108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:47.921762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'749","reported_seq":1462,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.725657+0000","last_change":"2024-09-12T00:02:03.151458+0000","last_active":"2024-09-12T00:38:37.725657+0000","last_peered":"2024-09-12T00:38:37.725657+0000","last_clean":"2024-09-12T00:38:37.725657+0000","last_became_active":"2024-09-12T00:02:03.151140+0000","last_became_peered":"2024-09-12T00:02:03.151140+0000","last_unstale":"2024-09-12T00:38:37.725657+0000","last_undegraded":"2024-09-12T00:38:37.725657+0000","last_fullsized":"2024-09-12T00:38:37.725657+0000","mapping_epoch":30,"log_start":"261'700","ondisk_log_start":"261'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":700,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:44.111850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136648,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1342,"num_read_kb":3221,"num_write":1108,"num_write_kb":930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:27.509341+0000","last_change":"2024-09-12T00:02:05.169087+0000","last_active":"2024-09-12T00:35:27.509341+0000","last_peered":"2024-09-12T00:35:27.509341+0000","last_clean":"2024-09-12T00:35:27.509341+0000","last_became_active":"2024-09-12T00:02:05.168419+0000","last_became_peered":"2024-09-12T00:02:05.168419+0000","last_unstale":"2024-09-12T00:35:27.509341+0000","last_undegraded":"2024-09-12T00:35:27.509341+0000","last_fullsized":"2024-09-12T00:35:27.509341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:37.208808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'139","reported_seq":629,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:10.772962+0000","last_change":"2024-09-12T00:02:07.170358+0000","last_active":"2024-09-12T00:37:10.772962+0000","last_peered":"2024-09-12T00:37:10.772962+0000","last_clean":"2024-09-12T00:37:10.772962+0000","last_became_active":"2024-09-12T00:02:07.169937+0000","last_became_peered":"2024-09-12T00:02:07.169937+0000","last_unstale":"2024-09-12T00:37:10.772962+0000","last_undegraded":"2024-09-12T00:37:10.772962+0000","last_fullsized":"2024-09-12T00:37:10.772962+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:08.055256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":184,"num_read_kb":169,"num_write":343,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'133","reported_seq":678,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.561260+0000","last_change":"2024-09-12T00:02:07.173368+0000","last_active":"2024-09-12T00:37:23.561260+0000","last_peered":"2024-09-12T00:37:23.561260+0000","last_clean":"2024-09-12T00:37:23.561260+0000","last_became_active":"2024-09-12T00:02:07.173094+0000","last_became_peered":"2024-09-12T00:02:07.173094+0000","last_unstale":"2024-09-12T00:37:23.561260+0000","last_undegraded":"2024-09-12T00:37:23.561260+0000","last_fullsized":"2024-09-12T00:37:23.561260+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:56.973946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":191,"num_read_kb":191,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'183","reported_seq":779,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.104304+0000","last_change":"2024-09-12T00:38:53.104304+0000","last_active":"2024-09-12T00:38:53.104304+0000","last_peered":"2024-09-12T00:38:53.104304+0000","last_clean":"2024-09-12T00:38:53.104304+0000","last_became_active":"2024-09-12T00:01:59.154463+0000","last_became_peered":"2024-09-12T00:01:59.154463+0000","last_unstale":"2024-09-12T00:38:53.104304+0000","last_undegraded":"2024-09-12T00:38:53.104304+0000","last_fullsized":"2024-09-12T00:38:53.104304+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'183","last_scrub_stamp":"2024-09-12T00:38:53.104215+0000","last_deep_scrub":"261'183","last_deep_scrub_stamp":"2024-09-12T00:38:53.104215+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.104215+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:44.019441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":794,"num_read_kb":651,"num_write":258,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'344","reported_seq":988,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.245956+0000","last_change":"2024-09-12T00:38:53.245956+0000","last_active":"2024-09-12T00:38:53.245956+0000","last_peered":"2024-09-12T00:38:53.245956+0000","last_clean":"2024-09-12T00:38:53.245956+0000","last_became_active":"2024-09-12T00:01:57.163847+0000","last_became_peered":"2024-09-12T00:01:57.163847+0000","last_unstale":"2024-09-12T00:38:53.245956+0000","last_undegraded":"2024-09-12T00:38:53.245956+0000","last_fullsized":"2024-09-12T00:38:53.245956+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'344","last_scrub_stamp":"2024-09-12T00:38:53.245846+0000","last_deep_scrub":"261'344","last_deep_scrub_stamp":"2024-09-12T00:38:53.245846+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.245846+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:07.900488+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291524,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":515,"num_read_kb":27216,"num_write":1109,"num_write_kb":33935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.500143+0000","last_change":"2024-09-12T00:02:01.144933+0000","last_active":"2024-09-12T00:34:44.500143+0000","last_peered":"2024-09-12T00:34:44.500143+0000","last_clean":"2024-09-12T00:34:44.500143+0000","last_became_active":"2024-09-12T00:02:01.144579+0000","last_became_peered":"2024-09-12T00:02:01.144579+0000","last_unstale":"2024-09-12T00:34:44.500143+0000","last_undegraded":"2024-09-12T00:34:44.500143+0000","last_fullsized":"2024-09-12T00:34:44.500143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:13.618101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'296","reported_seq":856,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.195562+0000","last_change":"2024-09-12T00:02:03.155013+0000","last_active":"2024-09-12T00:38:38.195562+0000","last_peered":"2024-09-12T00:38:38.195562+0000","last_clean":"2024-09-12T00:38:38.195562+0000","last_became_active":"2024-09-12T00:02:03.154710+0000","last_became_peered":"2024-09-12T00:02:03.154710+0000","last_unstale":"2024-09-12T00:38:38.195562+0000","last_undegraded":"2024-09-12T00:38:38.195562+0000","last_fullsized":"2024-09-12T00:38:38.195562+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:23.714644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46247,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":469,"num_read_kb":1061,"num_write":388,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.500232+0000","last_change":"2024-09-12T00:02:05.163654+0000","last_active":"2024-09-12T00:34:44.500232+0000","last_peered":"2024-09-12T00:34:44.500232+0000","last_clean":"2024-09-12T00:34:44.500232+0000","last_became_active":"2024-09-12T00:02:05.163389+0000","last_became_peered":"2024-09-12T00:02:05.163389+0000","last_unstale":"2024-09-12T00:34:44.500232+0000","last_undegraded":"2024-09-12T00:34:44.500232+0000","last_fullsized":"2024-09-12T00:34:44.500232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:54.688629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'116","reported_seq":591,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.374469+0000","last_change":"2024-09-12T00:02:07.172652+0000","last_active":"2024-09-12T00:37:06.374469+0000","last_peered":"2024-09-12T00:37:06.374469+0000","last_clean":"2024-09-12T00:37:06.374469+0000","last_became_active":"2024-09-12T00:02:07.172360+0000","last_became_peered":"2024-09-12T00:02:07.172360+0000","last_unstale":"2024-09-12T00:37:06.374469+0000","last_undegraded":"2024-09-12T00:37:06.374469+0000","last_fullsized":"2024-09-12T00:37:06.374469+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:50.938865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'116","reported_seq":723,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.463997+0000","last_change":"2024-09-12T00:38:53.463997+0000","last_active":"2024-09-12T00:38:53.463997+0000","last_peered":"2024-09-12T00:38:53.463997+0000","last_clean":"2024-09-12T00:38:53.463997+0000","last_became_active":"2024-09-12T00:01:59.155287+0000","last_became_peered":"2024-09-12T00:01:59.155287+0000","last_unstale":"2024-09-12T00:38:53.463997+0000","last_undegraded":"2024-09-12T00:38:53.463997+0000","last_fullsized":"2024-09-12T00:38:53.463997+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'116","last_scrub_stamp":"2024-09-12T00:38:53.463870+0000","last_deep_scrub":"261'116","last_deep_scrub_stamp":"2024-09-12T00:38:53.463870+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.463870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:51.953337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":525,"num_read_kb":443,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'336","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.145933+0000","last_change":"2024-09-12T00:38:44.145933+0000","last_active":"2024-09-12T00:38:44.145933+0000","last_peered":"2024-09-12T00:38:44.145933+0000","last_clean":"2024-09-12T00:38:44.145933+0000","last_became_active":"2024-09-12T00:01:57.144743+0000","last_became_peered":"2024-09-12T00:01:57.144743+0000","last_unstale":"2024-09-12T00:38:44.145933+0000","last_undegraded":"2024-09-12T00:38:44.145933+0000","last_fullsized":"2024-09-12T00:38:44.145933+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'336","last_scrub_stamp":"2024-09-12T00:38:44.145810+0000","last_deep_scrub":"261'336","last_deep_scrub_stamp":"2024-09-12T00:38:44.145810+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.145810+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:50.608602+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":7939,"num_write":1030,"num_write_kb":13946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:42.502624+0000","last_change":"2024-09-12T00:02:01.151142+0000","last_active":"2024-09-12T00:34:42.502624+0000","last_peered":"2024-09-12T00:34:42.502624+0000","last_clean":"2024-09-12T00:34:42.502624+0000","last_became_active":"2024-09-12T00:02:01.150857+0000","last_became_peered":"2024-09-12T00:02:01.150857+0000","last_unstale":"2024-09-12T00:34:42.502624+0000","last_undegraded":"2024-09-12T00:34:42.502624+0000","last_fullsized":"2024-09-12T00:34:42.502624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:45.672680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'41","reported_seq":534,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:38.801722+0000","last_change":"2024-09-12T00:02:03.150541+0000","last_active":"2024-09-12T00:36:38.801722+0000","last_peered":"2024-09-12T00:36:38.801722+0000","last_clean":"2024-09-12T00:36:38.801722+0000","last_became_active":"2024-09-12T00:02:03.149558+0000","last_became_peered":"2024-09-12T00:02:03.149558+0000","last_unstale":"2024-09-12T00:36:38.801722+0000","last_undegraded":"2024-09-12T00:36:38.801722+0000","last_fullsized":"2024-09-12T00:36:38.801722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:42.429865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":469,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.617409+0000","last_change":"2024-09-12T00:02:05.171121+0000","last_active":"2024-09-12T00:34:44.617409+0000","last_peered":"2024-09-12T00:34:44.617409+0000","last_clean":"2024-09-12T00:34:44.617409+0000","last_became_active":"2024-09-12T00:02:05.170836+0000","last_became_peered":"2024-09-12T00:02:05.170836+0000","last_unstale":"2024-09-12T00:34:44.617409+0000","last_undegraded":"2024-09-12T00:34:44.617409+0000","last_fullsized":"2024-09-12T00:34:44.617409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:00.009417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'258","reported_seq":776,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.055886+0000","last_change":"2024-09-12T00:02:07.168954+0000","last_active":"2024-09-12T00:37:23.055886+0000","last_peered":"2024-09-12T00:37:23.055886+0000","last_clean":"2024-09-12T00:37:23.055886+0000","last_became_active":"2024-09-12T00:02:07.168678+0000","last_became_peered":"2024-09-12T00:02:07.168678+0000","last_unstale":"2024-09-12T00:37:23.055886+0000","last_undegraded":"2024-09-12T00:37:23.055886+0000","last_fullsized":"2024-09-12T00:37:23.055886+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:23.449987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":392,"num_read_kb":368,"num_write":602,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'4088","reported_seq":4646,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.469941+0000","last_change":"2024-09-12T00:38:52.469941+0000","last_active":"2024-09-12T00:38:52.469941+0000","last_peered":"2024-09-12T00:38:52.469941+0000","last_clean":"2024-09-12T00:38:52.469941+0000","last_became_active":"2024-09-12T00:01:59.154260+0000","last_became_peered":"2024-09-12T00:01:59.154260+0000","last_unstale":"2024-09-12T00:38:52.469941+0000","last_undegraded":"2024-09-12T00:38:52.469941+0000","last_fullsized":"2024-09-12T00:38:52.469941+0000","mapping_epoch":26,"log_start":"261'4000","ondisk_log_start":"261'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4088","last_scrub_stamp":"2024-09-12T00:38:52.469853+0000","last_deep_scrub":"261'4088","last_deep_scrub_stamp":"2024-09-12T00:38:52.469853+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.469853+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:37.050318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16394,"num_read_kb":13744,"num_write":6133,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'298","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.977235+0000","last_change":"2024-09-12T00:38:44.977235+0000","last_active":"2024-09-12T00:38:44.977235+0000","last_peered":"2024-09-12T00:38:44.977235+0000","last_clean":"2024-09-12T00:38:44.977235+0000","last_became_active":"2024-09-12T00:01:57.158677+0000","last_became_peered":"2024-09-12T00:01:57.158677+0000","last_unstale":"2024-09-12T00:38:44.977235+0000","last_undegraded":"2024-09-12T00:38:44.977235+0000","last_fullsized":"2024-09-12T00:38:44.977235+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'298","last_scrub_stamp":"2024-09-12T00:38:44.977107+0000","last_deep_scrub":"261'298","last_deep_scrub_stamp":"2024-09-12T00:38:44.977107+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.977107+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:41.638070+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174545,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":398,"num_read_kb":56505,"num_write":935,"num_write_kb":31346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.205604+0000","last_change":"2024-09-12T00:38:58.205604+0000","last_active":"2024-09-12T00:38:58.205604+0000","last_peered":"2024-09-12T00:38:58.205604+0000","last_clean":"2024-09-12T00:38:58.205604+0000","last_became_active":"2024-09-12T00:02:01.155490+0000","last_became_peered":"2024-09-12T00:02:01.155490+0000","last_unstale":"2024-09-12T00:38:58.205604+0000","last_undegraded":"2024-09-12T00:38:58.205604+0000","last_fullsized":"2024-09-12T00:38:58.205604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:58.205501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:58.205501+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.205501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:52.049489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'284","reported_seq":851,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.371284+0000","last_change":"2024-09-12T00:02:03.149010+0000","last_active":"2024-09-12T00:38:37.371284+0000","last_peered":"2024-09-12T00:38:37.371284+0000","last_clean":"2024-09-12T00:38:37.371284+0000","last_became_active":"2024-09-12T00:02:03.148690+0000","last_became_peered":"2024-09-12T00:02:03.148690+0000","last_unstale":"2024-09-12T00:38:37.371284+0000","last_undegraded":"2024-09-12T00:38:37.371284+0000","last_fullsized":"2024-09-12T00:38:37.371284+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:39.130947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45068,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1019,"num_write":374,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:46.499667+0000","last_change":"2024-09-12T00:02:05.168740+0000","last_active":"2024-09-12T00:34:46.499667+0000","last_peered":"2024-09-12T00:34:46.499667+0000","last_clean":"2024-09-12T00:34:46.499667+0000","last_became_active":"2024-09-12T00:02:05.168232+0000","last_became_peered":"2024-09-12T00:02:05.168232+0000","last_unstale":"2024-09-12T00:34:46.499667+0000","last_undegraded":"2024-09-12T00:34:46.499667+0000","last_fullsized":"2024-09-12T00:34:46.499667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:43.713032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'134","reported_seq":667,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.879910+0000","last_change":"2024-09-12T00:02:07.169044+0000","last_active":"2024-09-12T00:36:58.879910+0000","last_peered":"2024-09-12T00:36:58.879910+0000","last_clean":"2024-09-12T00:36:58.879910+0000","last_became_active":"2024-09-12T00:02:07.168747+0000","last_became_peered":"2024-09-12T00:02:07.168747+0000","last_unstale":"2024-09-12T00:36:58.879910+0000","last_undegraded":"2024-09-12T00:36:58.879910+0000","last_fullsized":"2024-09-12T00:36:58.879910+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:23.448210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":291,"num_read_kb":255,"num_write":337,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'104","reported_seq":681,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.791694+0000","last_change":"2024-09-12T00:38:49.791694+0000","last_active":"2024-09-12T00:38:49.791694+0000","last_peered":"2024-09-12T00:38:49.791694+0000","last_clean":"2024-09-12T00:38:49.791694+0000","last_became_active":"2024-09-12T00:01:59.154848+0000","last_became_peered":"2024-09-12T00:01:59.154848+0000","last_unstale":"2024-09-12T00:38:49.791694+0000","last_undegraded":"2024-09-12T00:38:49.791694+0000","last_fullsized":"2024-09-12T00:38:49.791694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'104","last_scrub_stamp":"2024-09-12T00:38:49.791355+0000","last_deep_scrub":"261'104","last_deep_scrub_stamp":"2024-09-12T00:38:49.791355+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.791355+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:55.148174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":392,"num_write":152,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'307","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.779506+0000","last_change":"2024-09-12T00:38:45.779506+0000","last_active":"2024-09-12T00:38:45.779506+0000","last_peered":"2024-09-12T00:38:45.779506+0000","last_clean":"2024-09-12T00:38:45.779506+0000","last_became_active":"2024-09-12T00:01:57.142385+0000","last_became_peered":"2024-09-12T00:01:57.142385+0000","last_unstale":"2024-09-12T00:38:45.779506+0000","last_undegraded":"2024-09-12T00:38:45.779506+0000","last_fullsized":"2024-09-12T00:38:45.779506+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'307","last_scrub_stamp":"2024-09-12T00:38:45.779328+0000","last_deep_scrub":"261'307","last_deep_scrub_stamp":"2024-09-12T00:38:45.779328+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.779328+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:38.402035+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267376,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":608,"num_read_kb":9162,"num_write":1027,"num_write_kb":16984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.383518+0000","last_change":"2024-09-12T00:02:01.154218+0000","last_active":"2024-09-12T00:34:44.383518+0000","last_peered":"2024-09-12T00:34:44.383518+0000","last_clean":"2024-09-12T00:34:44.383518+0000","last_became_active":"2024-09-12T00:02:01.153906+0000","last_became_peered":"2024-09-12T00:02:01.153906+0000","last_unstale":"2024-09-12T00:34:44.383518+0000","last_undegraded":"2024-09-12T00:34:44.383518+0000","last_fullsized":"2024-09-12T00:34:44.383518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:16.965088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'249","reported_seq":808,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.153839+0000","last_change":"2024-09-12T00:02:03.155251+0000","last_active":"2024-09-12T00:38:37.153839+0000","last_peered":"2024-09-12T00:38:37.153839+0000","last_clean":"2024-09-12T00:38:37.153839+0000","last_became_active":"2024-09-12T00:02:03.154896+0000","last_became_peered":"2024-09-12T00:02:03.154896+0000","last_unstale":"2024-09-12T00:38:37.153839+0000","last_undegraded":"2024-09-12T00:38:37.153839+0000","last_fullsized":"2024-09-12T00:38:37.153839+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:31.639970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":962,"num_write":334,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":470,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:44.500273+0000","last_change":"2024-09-12T00:02:05.162572+0000","last_active":"2024-09-12T00:34:44.500273+0000","last_peered":"2024-09-12T00:34:44.500273+0000","last_clean":"2024-09-12T00:34:44.500273+0000","last_became_active":"2024-09-12T00:02:05.162204+0000","last_became_peered":"2024-09-12T00:02:05.162204+0000","last_unstale":"2024-09-12T00:34:44.500273+0000","last_undegraded":"2024-09-12T00:34:44.500273+0000","last_fullsized":"2024-09-12T00:34:44.500273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:56.188492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'125","reported_seq":678,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:22.357033+0000","last_change":"2024-09-12T00:01:59.145758+0000","last_active":"2024-09-12T00:36:22.357033+0000","last_peered":"2024-09-12T00:36:22.357033+0000","last_clean":"2024-09-12T00:36:22.357033+0000","last_became_active":"2024-09-12T00:01:59.145456+0000","last_became_peered":"2024-09-12T00:01:59.145456+0000","last_unstale":"2024-09-12T00:36:22.357033+0000","last_undegraded":"2024-09-12T00:36:22.357033+0000","last_fullsized":"2024-09-12T00:36:22.357033+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:45.253029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":512,"num_read_kb":415,"num_write":196,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'379","reported_seq":1018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.785930+0000","last_change":"2024-09-12T00:38:47.785930+0000","last_active":"2024-09-12T00:38:47.785930+0000","last_peered":"2024-09-12T00:38:47.785930+0000","last_clean":"2024-09-12T00:38:47.785930+0000","last_became_active":"2024-09-12T00:01:57.143684+0000","last_became_peered":"2024-09-12T00:01:57.143684+0000","last_unstale":"2024-09-12T00:38:47.785930+0000","last_undegraded":"2024-09-12T00:38:47.785930+0000","last_fullsized":"2024-09-12T00:38:47.785930+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'379","last_scrub_stamp":"2024-09-12T00:38:47.785711+0000","last_deep_scrub":"261'379","last_deep_scrub_stamp":"2024-09-12T00:38:47.785711+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.785711+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:31.165040+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":509,"num_read_kb":22065,"num_write":1209,"num_write_kb":32922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:09.512535+0000","last_change":"2024-09-12T00:02:01.154936+0000","last_active":"2024-09-12T00:36:09.512535+0000","last_peered":"2024-09-12T00:36:09.512535+0000","last_clean":"2024-09-12T00:36:09.512535+0000","last_became_active":"2024-09-12T00:02:01.154541+0000","last_became_peered":"2024-09-12T00:02:01.154541+0000","last_unstale":"2024-09-12T00:36:09.512535+0000","last_undegraded":"2024-09-12T00:36:09.512535+0000","last_fullsized":"2024-09-12T00:36:09.512535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:34.459769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'490","reported_seq":1106,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.079671+0000","last_change":"2024-09-12T00:02:03.158651+0000","last_active":"2024-09-12T00:38:37.079671+0000","last_peered":"2024-09-12T00:38:37.079671+0000","last_clean":"2024-09-12T00:38:37.079671+0000","last_became_active":"2024-09-12T00:02:03.158360+0000","last_became_peered":"2024-09-12T00:02:03.158360+0000","last_unstale":"2024-09-12T00:38:37.079671+0000","last_undegraded":"2024-09-12T00:38:37.079671+0000","last_fullsized":"2024-09-12T00:38:37.079671+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:44.063536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92045,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":891,"num_read_kb":2130,"num_write":768,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":468,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.615861+0000","last_change":"2024-09-12T00:02:05.167419+0000","last_active":"2024-09-12T00:34:34.615861+0000","last_peered":"2024-09-12T00:34:34.615861+0000","last_clean":"2024-09-12T00:34:34.615861+0000","last_became_active":"2024-09-12T00:02:05.167052+0000","last_became_peered":"2024-09-12T00:02:05.167052+0000","last_unstale":"2024-09-12T00:34:34.615861+0000","last_undegraded":"2024-09-12T00:34:34.615861+0000","last_fullsized":"2024-09-12T00:34:34.615861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:41.679779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'206","reported_seq":704,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.939992+0000","last_change":"2024-09-12T00:02:07.167621+0000","last_active":"2024-09-12T00:37:22.939992+0000","last_peered":"2024-09-12T00:37:22.939992+0000","last_clean":"2024-09-12T00:37:22.939992+0000","last_became_active":"2024-09-12T00:02:07.167331+0000","last_became_peered":"2024-09-12T00:02:07.167331+0000","last_unstale":"2024-09-12T00:37:22.939992+0000","last_undegraded":"2024-09-12T00:37:22.939992+0000","last_fullsized":"2024-09-12T00:37:22.939992+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:21.029667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":483,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'399","reported_seq":1166,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.501525+0000","last_change":"2024-09-12T00:38:55.501525+0000","last_active":"2024-09-12T00:38:55.501525+0000","last_peered":"2024-09-12T00:38:55.501525+0000","last_clean":"2024-09-12T00:38:55.501525+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:38:55.501525+0000","last_undegraded":"2024-09-12T00:38:55.501525+0000","last_fullsized":"2024-09-12T00:38:55.501525+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'399","last_scrub_stamp":"2024-09-12T00:38:55.501439+0000","last_deep_scrub":"261'399","last_deep_scrub_stamp":"2024-09-12T00:38:55.501439+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.501439+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:17.884111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1910,"num_read_kb":1650,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25748,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'351","reported_seq":1035,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.618535+0000","last_change":"2024-09-12T00:38:45.618535+0000","last_active":"2024-09-12T00:38:45.618535+0000","last_peered":"2024-09-12T00:38:45.618535+0000","last_clean":"2024-09-12T00:38:45.618535+0000","last_became_active":"2024-09-12T00:01:57.141998+0000","last_became_peered":"2024-09-12T00:01:57.141998+0000","last_unstale":"2024-09-12T00:38:45.618535+0000","last_undegraded":"2024-09-12T00:38:45.618535+0000","last_fullsized":"2024-09-12T00:38:45.618535+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'351","last_scrub_stamp":"2024-09-12T00:38:45.618369+0000","last_deep_scrub":"261'351","last_deep_scrub_stamp":"2024-09-12T00:38:45.618369+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.618369+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:31.142149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":1840,"num_write":1203,"num_write_kb":17126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:24.623582+0000","last_change":"2024-09-12T00:02:01.153965+0000","last_active":"2024-09-12T00:35:24.623582+0000","last_peered":"2024-09-12T00:35:24.623582+0000","last_clean":"2024-09-12T00:35:24.623582+0000","last_became_active":"2024-09-12T00:02:01.153611+0000","last_became_peered":"2024-09-12T00:02:01.153611+0000","last_unstale":"2024-09-12T00:35:24.623582+0000","last_undegraded":"2024-09-12T00:35:24.623582+0000","last_fullsized":"2024-09-12T00:35:24.623582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:43.203100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'284","reported_seq":848,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.221785+0000","last_change":"2024-09-12T00:02:03.155107+0000","last_active":"2024-09-12T00:38:37.221785+0000","last_peered":"2024-09-12T00:38:37.221785+0000","last_clean":"2024-09-12T00:38:37.221785+0000","last_became_active":"2024-09-12T00:02:03.154821+0000","last_became_peered":"2024-09-12T00:02:03.154821+0000","last_unstale":"2024-09-12T00:38:37.221785+0000","last_undegraded":"2024-09-12T00:38:37.221785+0000","last_fullsized":"2024-09-12T00:38:37.221785+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:25.034969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49647,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":1013,"num_write":386,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":473,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.499293+0000","last_change":"2024-09-12T00:02:05.170002+0000","last_active":"2024-09-12T00:34:34.499293+0000","last_peered":"2024-09-12T00:34:34.499293+0000","last_clean":"2024-09-12T00:34:34.499293+0000","last_became_active":"2024-09-12T00:02:05.169726+0000","last_became_peered":"2024-09-12T00:02:05.169726+0000","last_unstale":"2024-09-12T00:34:34.499293+0000","last_undegraded":"2024-09-12T00:34:34.499293+0000","last_fullsized":"2024-09-12T00:34:34.499293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:22.827175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'193","reported_seq":1061,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.503992+0000","last_change":"2024-09-12T00:02:07.175207+0000","last_active":"2024-09-12T00:37:22.503992+0000","last_peered":"2024-09-12T00:37:22.503992+0000","last_clean":"2024-09-12T00:37:22.503992+0000","last_became_active":"2024-09-12T00:02:07.174910+0000","last_became_peered":"2024-09-12T00:02:07.174910+0000","last_unstale":"2024-09-12T00:37:22.503992+0000","last_undegraded":"2024-09-12T00:37:22.503992+0000","last_fullsized":"2024-09-12T00:37:22.503992+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:19.459374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":668,"num_read_kb":649,"num_write":556,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'98","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.867630+0000","last_change":"2024-09-12T00:38:51.867630+0000","last_active":"2024-09-12T00:38:51.867630+0000","last_peered":"2024-09-12T00:38:51.867630+0000","last_clean":"2024-09-12T00:38:51.867630+0000","last_became_active":"2024-09-12T00:01:59.151143+0000","last_became_peered":"2024-09-12T00:01:59.151143+0000","last_unstale":"2024-09-12T00:38:51.867630+0000","last_undegraded":"2024-09-12T00:38:51.867630+0000","last_fullsized":"2024-09-12T00:38:51.867630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'98","last_scrub_stamp":"2024-09-12T00:38:51.867545+0000","last_deep_scrub":"261'98","last_deep_scrub_stamp":"2024-09-12T00:38:51.867545+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.867545+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:31.009419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":451,"num_read_kb":380,"num_write":139,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'298","reported_seq":894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.494768+0000","last_change":"2024-09-12T00:38:45.494768+0000","last_active":"2024-09-12T00:38:45.494768+0000","last_peered":"2024-09-12T00:38:45.494768+0000","last_clean":"2024-09-12T00:38:45.494768+0000","last_became_active":"2024-09-12T00:01:57.141789+0000","last_became_peered":"2024-09-12T00:01:57.141789+0000","last_unstale":"2024-09-12T00:38:45.494768+0000","last_undegraded":"2024-09-12T00:38:45.494768+0000","last_fullsized":"2024-09-12T00:38:45.494768+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'298","last_scrub_stamp":"2024-09-12T00:38:45.494662+0000","last_deep_scrub":"261'298","last_deep_scrub_stamp":"2024-09-12T00:38:45.494662+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.494662+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:00.002183+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":381,"num_read_kb":31078,"num_write":882,"num_write_kb":48318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.170256+0000","last_change":"2024-09-12T00:38:59.170256+0000","last_active":"2024-09-12T00:38:59.170256+0000","last_peered":"2024-09-12T00:38:59.170256+0000","last_clean":"2024-09-12T00:38:59.170256+0000","last_became_active":"2024-09-12T00:02:01.154530+0000","last_became_peered":"2024-09-12T00:02:01.154530+0000","last_unstale":"2024-09-12T00:38:59.170256+0000","last_undegraded":"2024-09-12T00:38:59.170256+0000","last_fullsized":"2024-09-12T00:38:59.170256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.170165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.170165+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.170165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:21.430019+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'288","reported_seq":850,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.090315+0000","last_change":"2024-09-12T00:02:03.156889+0000","last_active":"2024-09-12T00:38:36.090315+0000","last_peered":"2024-09-12T00:38:36.090315+0000","last_clean":"2024-09-12T00:38:36.090315+0000","last_became_active":"2024-09-12T00:02:03.156529+0000","last_became_peered":"2024-09-12T00:02:03.156529+0000","last_unstale":"2024-09-12T00:38:36.090315+0000","last_undegraded":"2024-09-12T00:38:36.090315+0000","last_fullsized":"2024-09-12T00:38:36.090315+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:52.310627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53504,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":1158,"num_write":402,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":473,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:09.512584+0000","last_change":"2024-09-12T00:02:05.164244+0000","last_active":"2024-09-12T00:36:09.512584+0000","last_peered":"2024-09-12T00:36:09.512584+0000","last_clean":"2024-09-12T00:36:09.512584+0000","last_became_active":"2024-09-12T00:02:05.163956+0000","last_became_peered":"2024-09-12T00:02:05.163956+0000","last_unstale":"2024-09-12T00:36:09.512584+0000","last_undegraded":"2024-09-12T00:36:09.512584+0000","last_fullsized":"2024-09-12T00:36:09.512584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:58.031555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'127","reported_seq":603,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.940297+0000","last_change":"2024-09-12T00:02:07.172798+0000","last_active":"2024-09-12T00:38:28.940297+0000","last_peered":"2024-09-12T00:38:28.940297+0000","last_clean":"2024-09-12T00:38:28.940297+0000","last_became_active":"2024-09-12T00:02:07.172496+0000","last_became_peered":"2024-09-12T00:02:07.172496+0000","last_unstale":"2024-09-12T00:38:28.940297+0000","last_undegraded":"2024-09-12T00:38:28.940297+0000","last_fullsized":"2024-09-12T00:38:28.940297+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:11.813869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":307,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'198","reported_seq":836,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.529914+0000","last_change":"2024-09-12T00:38:49.529914+0000","last_active":"2024-09-12T00:38:49.529914+0000","last_peered":"2024-09-12T00:38:49.529914+0000","last_clean":"2024-09-12T00:38:49.529914+0000","last_became_active":"2024-09-12T00:01:59.148559+0000","last_became_peered":"2024-09-12T00:01:59.148559+0000","last_unstale":"2024-09-12T00:38:49.529914+0000","last_undegraded":"2024-09-12T00:38:49.529914+0000","last_fullsized":"2024-09-12T00:38:49.529914+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'198","last_scrub_stamp":"2024-09-12T00:38:49.529821+0000","last_deep_scrub":"261'198","last_deep_scrub_stamp":"2024-09-12T00:38:49.529821+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.529821+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:16.013027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":733,"num_write":278,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'382","reported_seq":1038,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.599821+0000","last_change":"2024-09-12T00:38:47.599821+0000","last_active":"2024-09-12T00:38:47.599821+0000","last_peered":"2024-09-12T00:38:47.599821+0000","last_clean":"2024-09-12T00:38:47.599821+0000","last_became_active":"2024-09-12T00:01:57.144397+0000","last_became_peered":"2024-09-12T00:01:57.144397+0000","last_unstale":"2024-09-12T00:38:47.599821+0000","last_undegraded":"2024-09-12T00:38:47.599821+0000","last_fullsized":"2024-09-12T00:38:47.599821+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'382","last_scrub_stamp":"2024-09-12T00:38:47.599641+0000","last_deep_scrub":"261'382","last_deep_scrub_stamp":"2024-09-12T00:38:47.599641+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.599641+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:34.445067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":577,"num_read_kb":18157,"num_write":1228,"num_write_kb":40983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'5","reported_seq":968,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:35.454747+0000","last_change":"2024-09-12T00:02:01.152013+0000","last_active":"2024-09-12T00:38:35.454747+0000","last_peered":"2024-09-12T00:38:35.454747+0000","last_clean":"2024-09-12T00:38:35.454747+0000","last_became_active":"2024-09-12T00:02:01.151739+0000","last_became_peered":"2024-09-12T00:02:01.151739+0000","last_unstale":"2024-09-12T00:38:35.454747+0000","last_undegraded":"2024-09-12T00:38:35.454747+0000","last_fullsized":"2024-09-12T00:38:35.454747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:45.599390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'84","reported_seq":593,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.062825+0000","last_change":"2024-09-12T00:02:03.154234+0000","last_active":"2024-09-12T00:37:23.062825+0000","last_peered":"2024-09-12T00:37:23.062825+0000","last_clean":"2024-09-12T00:37:23.062825+0000","last_became_active":"2024-09-12T00:02:03.153948+0000","last_became_peered":"2024-09-12T00:02:03.153948+0000","last_unstale":"2024-09-12T00:37:23.062825+0000","last_undegraded":"2024-09-12T00:37:23.062825+0000","last_fullsized":"2024-09-12T00:37:23.062825+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:26.035209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":128,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'765","reported_seq":4280,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.671492+0000","last_change":"2024-09-12T00:02:05.170722+0000","last_active":"2024-09-12T00:38:37.671492+0000","last_peered":"2024-09-12T00:38:37.671492+0000","last_clean":"2024-09-12T00:38:37.671492+0000","last_became_active":"2024-09-12T00:02:05.170399+0000","last_became_peered":"2024-09-12T00:02:05.170399+0000","last_unstale":"2024-09-12T00:38:37.671492+0000","last_undegraded":"2024-09-12T00:38:37.671492+0000","last_fullsized":"2024-09-12T00:38:37.671492+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:06.211117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'118","reported_seq":604,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.949325+0000","last_change":"2024-09-12T00:02:07.173296+0000","last_active":"2024-09-12T00:37:06.949325+0000","last_peered":"2024-09-12T00:37:06.949325+0000","last_clean":"2024-09-12T00:37:06.949325+0000","last_became_active":"2024-09-12T00:02:07.173030+0000","last_became_peered":"2024-09-12T00:02:07.173030+0000","last_unstale":"2024-09-12T00:37:06.949325+0000","last_undegraded":"2024-09-12T00:37:06.949325+0000","last_fullsized":"2024-09-12T00:37:06.949325+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:13.276457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":288,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'244","reported_seq":881,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.158718+0000","last_change":"2024-09-12T00:38:56.158718+0000","last_active":"2024-09-12T00:38:56.158718+0000","last_peered":"2024-09-12T00:38:56.158718+0000","last_clean":"2024-09-12T00:38:56.158718+0000","last_became_active":"2024-09-12T00:01:59.151743+0000","last_became_peered":"2024-09-12T00:01:59.151743+0000","last_unstale":"2024-09-12T00:38:56.158718+0000","last_undegraded":"2024-09-12T00:38:56.158718+0000","last_fullsized":"2024-09-12T00:38:56.158718+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'244","last_scrub_stamp":"2024-09-12T00:38:56.158624+0000","last_deep_scrub":"261'244","last_deep_scrub_stamp":"2024-09-12T00:38:56.158624+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.158624+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:33.327253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1082,"num_read_kb":884,"num_write":389,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'313","reported_seq":918,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.492902+0000","last_change":"2024-09-12T00:38:43.492902+0000","last_active":"2024-09-12T00:38:43.492902+0000","last_peered":"2024-09-12T00:38:43.492902+0000","last_clean":"2024-09-12T00:38:43.492902+0000","last_became_active":"2024-09-12T00:01:57.144946+0000","last_became_peered":"2024-09-12T00:01:57.144946+0000","last_unstale":"2024-09-12T00:38:43.492902+0000","last_undegraded":"2024-09-12T00:38:43.492902+0000","last_fullsized":"2024-09-12T00:38:43.492902+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'313","last_scrub_stamp":"2024-09-12T00:38:43.492802+0000","last_deep_scrub":"261'313","last_deep_scrub_stamp":"2024-09-12T00:38:43.492802+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.492802+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:17.143075+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":419,"num_read_kb":503,"num_write":968,"num_write_kb":20369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.426009+0000","last_change":"2024-09-12T00:39:00.426009+0000","last_active":"2024-09-12T00:39:00.426009+0000","last_peered":"2024-09-12T00:39:00.426009+0000","last_clean":"2024-09-12T00:39:00.426009+0000","last_became_active":"2024-09-12T00:02:01.152493+0000","last_became_peered":"2024-09-12T00:02:01.152493+0000","last_unstale":"2024-09-12T00:39:00.426009+0000","last_undegraded":"2024-09-12T00:39:00.426009+0000","last_fullsized":"2024-09-12T00:39:00.426009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:00.425924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:00.425924+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.425924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.528302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'313","reported_seq":908,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.540809+0000","last_change":"2024-09-12T00:02:03.150973+0000","last_active":"2024-09-12T00:38:36.540809+0000","last_peered":"2024-09-12T00:38:36.540809+0000","last_clean":"2024-09-12T00:38:36.540809+0000","last_became_active":"2024-09-12T00:02:03.150631+0000","last_became_peered":"2024-09-12T00:02:03.150631+0000","last_unstale":"2024-09-12T00:38:36.540809+0000","last_undegraded":"2024-09-12T00:38:36.540809+0000","last_fullsized":"2024-09-12T00:38:36.540809+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:17.364587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68885,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":513,"num_read_kb":1151,"num_write":412,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.513886+0000","last_change":"2024-09-12T00:02:05.167377+0000","last_active":"2024-09-12T00:35:57.513886+0000","last_peered":"2024-09-12T00:35:57.513886+0000","last_clean":"2024-09-12T00:35:57.513886+0000","last_became_active":"2024-09-12T00:02:05.167082+0000","last_became_peered":"2024-09-12T00:02:05.167082+0000","last_unstale":"2024-09-12T00:35:57.513886+0000","last_undegraded":"2024-09-12T00:35:57.513886+0000","last_fullsized":"2024-09-12T00:35:57.513886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:04.610051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'123","reported_seq":614,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.557143+0000","last_change":"2024-09-12T00:02:07.173111+0000","last_active":"2024-09-12T00:38:27.557143+0000","last_peered":"2024-09-12T00:38:27.557143+0000","last_clean":"2024-09-12T00:38:27.557143+0000","last_became_active":"2024-09-12T00:02:07.172810+0000","last_became_peered":"2024-09-12T00:02:07.172810+0000","last_unstale":"2024-09-12T00:38:27.557143+0000","last_undegraded":"2024-09-12T00:38:27.557143+0000","last_fullsized":"2024-09-12T00:38:27.557143+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:47.728676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":135,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'223","reported_seq":849,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.135529+0000","last_change":"2024-09-12T00:38:55.135529+0000","last_active":"2024-09-12T00:38:55.135529+0000","last_peered":"2024-09-12T00:38:55.135529+0000","last_clean":"2024-09-12T00:38:55.135529+0000","last_became_active":"2024-09-12T00:01:59.147373+0000","last_became_peered":"2024-09-12T00:01:59.147373+0000","last_unstale":"2024-09-12T00:38:55.135529+0000","last_undegraded":"2024-09-12T00:38:55.135529+0000","last_fullsized":"2024-09-12T00:38:55.135529+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'223","last_scrub_stamp":"2024-09-12T00:38:55.135426+0000","last_deep_scrub":"261'223","last_deep_scrub_stamp":"2024-09-12T00:38:55.135426+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.135426+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:54.183644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1007,"num_read_kb":830,"num_write":359,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'297","reported_seq":892,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.350802+0000","last_change":"2024-09-12T00:01:57.161842+0000","last_active":"2024-09-12T00:38:38.350802+0000","last_peered":"2024-09-12T00:38:38.350802+0000","last_clean":"2024-09-12T00:38:38.350802+0000","last_became_active":"2024-09-12T00:01:57.161414+0000","last_became_peered":"2024-09-12T00:01:57.161414+0000","last_unstale":"2024-09-12T00:38:38.350802+0000","last_undegraded":"2024-09-12T00:38:38.350802+0000","last_fullsized":"2024-09-12T00:38:38.350802+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:56.109080+0000","last_clean_scrub_stamp":"2024-09-12T00:01:56.109080+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:03.307762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174757,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":380,"num_read_kb":8089,"num_write":919,"num_write_kb":31185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.179570+0000","last_change":"2024-09-12T00:38:57.179570+0000","last_active":"2024-09-12T00:38:57.179570+0000","last_peered":"2024-09-12T00:38:57.179570+0000","last_clean":"2024-09-12T00:38:57.179570+0000","last_became_active":"2024-09-12T00:02:01.151760+0000","last_became_peered":"2024-09-12T00:02:01.151760+0000","last_unstale":"2024-09-12T00:38:57.179570+0000","last_undegraded":"2024-09-12T00:38:57.179570+0000","last_fullsized":"2024-09-12T00:38:57.179570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:57.179464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:57.179464+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.179464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:03.467030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'276","reported_seq":840,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.624371+0000","last_change":"2024-09-12T00:02:03.151005+0000","last_active":"2024-09-12T00:38:36.624371+0000","last_peered":"2024-09-12T00:38:36.624371+0000","last_clean":"2024-09-12T00:38:36.624371+0000","last_became_active":"2024-09-12T00:02:03.150714+0000","last_became_peered":"2024-09-12T00:02:03.150714+0000","last_unstale":"2024-09-12T00:38:36.624371+0000","last_undegraded":"2024-09-12T00:38:36.624371+0000","last_fullsized":"2024-09-12T00:38:36.624371+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:39.492995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52913,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1134,"num_write":392,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.393761+0000","last_change":"2024-09-12T00:02:05.171377+0000","last_active":"2024-09-12T00:35:59.393761+0000","last_peered":"2024-09-12T00:35:59.393761+0000","last_clean":"2024-09-12T00:35:59.393761+0000","last_became_active":"2024-09-12T00:02:05.170973+0000","last_became_peered":"2024-09-12T00:02:05.170973+0000","last_unstale":"2024-09-12T00:35:59.393761+0000","last_undegraded":"2024-09-12T00:35:59.393761+0000","last_fullsized":"2024-09-12T00:35:59.393761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:14.690020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'119","reported_seq":625,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:11.054534+0000","last_change":"2024-09-12T00:02:07.169559+0000","last_active":"2024-09-12T00:37:11.054534+0000","last_peered":"2024-09-12T00:37:11.054534+0000","last_clean":"2024-09-12T00:37:11.054534+0000","last_became_active":"2024-09-12T00:02:07.169266+0000","last_became_peered":"2024-09-12T00:02:07.169266+0000","last_unstale":"2024-09-12T00:37:11.054534+0000","last_undegraded":"2024-09-12T00:37:11.054534+0000","last_fullsized":"2024-09-12T00:37:11.054534+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:10:08.775255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":294,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'183","reported_seq":785,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.841083+0000","last_change":"2024-09-12T00:38:50.841083+0000","last_active":"2024-09-12T00:38:50.841083+0000","last_peered":"2024-09-12T00:38:50.841083+0000","last_clean":"2024-09-12T00:38:50.841083+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:38:50.841083+0000","last_undegraded":"2024-09-12T00:38:50.841083+0000","last_fullsized":"2024-09-12T00:38:50.841083+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'183","last_scrub_stamp":"2024-09-12T00:38:50.840994+0000","last_deep_scrub":"261'183","last_deep_scrub_stamp":"2024-09-12T00:38:50.840994+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.840994+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:07.476170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":689,"num_write":284,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'446","reported_seq":1169,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.764952+0000","last_change":"2024-09-12T00:38:48.764952+0000","last_active":"2024-09-12T00:38:48.764952+0000","last_peered":"2024-09-12T00:38:48.764952+0000","last_clean":"2024-09-12T00:38:48.764952+0000","last_became_active":"2024-09-12T00:01:57.161612+0000","last_became_peered":"2024-09-12T00:01:57.161612+0000","last_unstale":"2024-09-12T00:38:48.764952+0000","last_undegraded":"2024-09-12T00:38:48.764952+0000","last_fullsized":"2024-09-12T00:38:48.764952+0000","mapping_epoch":24,"log_start":"261'400","ondisk_log_start":"261'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'446","last_scrub_stamp":"2024-09-12T00:38:48.764718+0000","last_deep_scrub":"261'446","last_deep_scrub_stamp":"2024-09-12T00:38:48.764718+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.764718+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:21.363677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":772,"num_read_kb":15126,"num_write":1508,"num_write_kb":40840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.430557+0000","last_change":"2024-09-12T00:38:59.430557+0000","last_active":"2024-09-12T00:38:59.430557+0000","last_peered":"2024-09-12T00:38:59.430557+0000","last_clean":"2024-09-12T00:38:59.430557+0000","last_became_active":"2024-09-12T00:02:01.144558+0000","last_became_peered":"2024-09-12T00:02:01.144558+0000","last_unstale":"2024-09-12T00:38:59.430557+0000","last_undegraded":"2024-09-12T00:38:59.430557+0000","last_fullsized":"2024-09-12T00:38:59.430557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.430450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.430450+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.430450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:54.397837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'263","reported_seq":810,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.358146+0000","last_change":"2024-09-12T00:02:03.154789+0000","last_active":"2024-09-12T00:38:38.358146+0000","last_peered":"2024-09-12T00:38:38.358146+0000","last_clean":"2024-09-12T00:38:38.358146+0000","last_became_active":"2024-09-12T00:02:03.154477+0000","last_became_peered":"2024-09-12T00:02:03.154477+0000","last_unstale":"2024-09-12T00:38:38.358146+0000","last_undegraded":"2024-09-12T00:38:38.358146+0000","last_fullsized":"2024-09-12T00:38:38.358146+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:25.591233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47465,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":439,"num_read_kb":1086,"num_write":366,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.382052+0000","last_change":"2024-09-12T00:02:05.166486+0000","last_active":"2024-09-12T00:34:34.382052+0000","last_peered":"2024-09-12T00:34:34.382052+0000","last_clean":"2024-09-12T00:34:34.382052+0000","last_became_active":"2024-09-12T00:02:05.166141+0000","last_became_peered":"2024-09-12T00:02:05.166141+0000","last_unstale":"2024-09-12T00:34:34.382052+0000","last_undegraded":"2024-09-12T00:34:34.382052+0000","last_fullsized":"2024-09-12T00:34:34.382052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:12.751964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'186","reported_seq":1324,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.932224+0000","last_change":"2024-09-12T00:02:07.170137+0000","last_active":"2024-09-12T00:37:21.932224+0000","last_peered":"2024-09-12T00:37:21.932224+0000","last_clean":"2024-09-12T00:37:21.932224+0000","last_became_active":"2024-09-12T00:02:07.169812+0000","last_became_peered":"2024-09-12T00:02:07.169812+0000","last_unstale":"2024-09-12T00:37:21.932224+0000","last_undegraded":"2024-09-12T00:37:21.932224+0000","last_fullsized":"2024-09-12T00:37:21.932224+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:18.008023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1006,"num_read_kb":951,"num_write":452,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'117","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.094187+0000","last_change":"2024-09-12T00:38:54.094187+0000","last_active":"2024-09-12T00:38:54.094187+0000","last_peered":"2024-09-12T00:38:54.094187+0000","last_clean":"2024-09-12T00:38:54.094187+0000","last_became_active":"2024-09-12T00:01:59.148253+0000","last_became_peered":"2024-09-12T00:01:59.148253+0000","last_unstale":"2024-09-12T00:38:54.094187+0000","last_undegraded":"2024-09-12T00:38:54.094187+0000","last_fullsized":"2024-09-12T00:38:54.094187+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'117","last_scrub_stamp":"2024-09-12T00:38:54.094084+0000","last_deep_scrub":"261'117","last_deep_scrub_stamp":"2024-09-12T00:38:54.094084+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.094084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:55.052129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":405,"num_write":165,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'378","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.791277+0000","last_change":"2024-09-12T00:38:49.791277+0000","last_active":"2024-09-12T00:38:49.791277+0000","last_peered":"2024-09-12T00:38:49.791277+0000","last_clean":"2024-09-12T00:38:49.791277+0000","last_became_active":"2024-09-12T00:01:57.138386+0000","last_became_peered":"2024-09-12T00:01:57.138386+0000","last_unstale":"2024-09-12T00:38:49.791277+0000","last_undegraded":"2024-09-12T00:38:49.791277+0000","last_fullsized":"2024-09-12T00:38:49.791277+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T00:38:49.791164+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T00:38:49.791164+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.791164+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:45.569391+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":660,"num_read_kb":37451,"num_write":1183,"num_write_kb":32715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.513932+0000","last_change":"2024-09-12T00:02:01.153600+0000","last_active":"2024-09-12T00:35:57.513932+0000","last_peered":"2024-09-12T00:35:57.513932+0000","last_clean":"2024-09-12T00:35:57.513932+0000","last_became_active":"2024-09-12T00:02:01.153306+0000","last_became_peered":"2024-09-12T00:02:01.153306+0000","last_unstale":"2024-09-12T00:35:57.513932+0000","last_undegraded":"2024-09-12T00:35:57.513932+0000","last_fullsized":"2024-09-12T00:35:57.513932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:00.129868+0000","last_clean_scrub_stamp":"2024-09-12T00:02:00.129868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:16.790631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'285","reported_seq":865,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.164155+0000","last_change":"2024-09-12T00:02:03.158753+0000","last_active":"2024-09-12T00:38:36.164155+0000","last_peered":"2024-09-12T00:38:36.164155+0000","last_clean":"2024-09-12T00:38:36.164155+0000","last_became_active":"2024-09-12T00:02:03.158379+0000","last_became_peered":"2024-09-12T00:02:03.158379+0000","last_unstale":"2024-09-12T00:38:36.164155+0000","last_undegraded":"2024-09-12T00:38:36.164155+0000","last_fullsized":"2024-09-12T00:38:36.164155+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:02.133472+0000","last_clean_scrub_stamp":"2024-09-12T00:02:02.133472+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:08.601813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53226,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":1058,"num_write":380,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:37.502005+0000","last_change":"2024-09-12T00:02:05.160180+0000","last_active":"2024-09-12T00:34:37.502005+0000","last_peered":"2024-09-12T00:34:37.502005+0000","last_clean":"2024-09-12T00:34:37.502005+0000","last_became_active":"2024-09-12T00:02:05.159854+0000","last_became_peered":"2024-09-12T00:02:05.159854+0000","last_unstale":"2024-09-12T00:34:37.502005+0000","last_undegraded":"2024-09-12T00:34:37.502005+0000","last_fullsized":"2024-09-12T00:34:37.502005+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.989519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'131","reported_seq":621,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:27.590853+0000","last_change":"2024-09-12T00:02:07.171050+0000","last_active":"2024-09-12T00:38:27.590853+0000","last_peered":"2024-09-12T00:38:27.590853+0000","last_clean":"2024-09-12T00:38:27.590853+0000","last_became_active":"2024-09-12T00:02:07.170727+0000","last_became_peered":"2024-09-12T00:02:07.170727+0000","last_unstale":"2024-09-12T00:38:27.590853+0000","last_undegraded":"2024-09-12T00:38:27.590853+0000","last_fullsized":"2024-09-12T00:38:27.590853+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:03.358486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":129,"num_write":315,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'247","reported_seq":916,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.507541+0000","last_change":"2024-09-12T00:38:54.507541+0000","last_active":"2024-09-12T00:38:54.507541+0000","last_peered":"2024-09-12T00:38:54.507541+0000","last_clean":"2024-09-12T00:38:54.507541+0000","last_became_active":"2024-09-12T00:01:59.145502+0000","last_became_peered":"2024-09-12T00:01:59.145502+0000","last_unstale":"2024-09-12T00:38:54.507541+0000","last_undegraded":"2024-09-12T00:38:54.507541+0000","last_fullsized":"2024-09-12T00:38:54.507541+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'247","last_scrub_stamp":"2024-09-12T00:38:54.507456+0000","last_deep_scrub":"261'247","last_deep_scrub_stamp":"2024-09-12T00:38:54.507456+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.507456+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:33.111923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1128,"num_read_kb":927,"num_write":363,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'365","reported_seq":1025,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.026415+0000","last_change":"2024-09-12T00:38:46.026415+0000","last_active":"2024-09-12T00:38:46.026415+0000","last_peered":"2024-09-12T00:38:46.026415+0000","last_clean":"2024-09-12T00:38:46.026415+0000","last_became_active":"2024-09-12T00:01:57.159487+0000","last_became_peered":"2024-09-12T00:01:57.159487+0000","last_unstale":"2024-09-12T00:38:46.026415+0000","last_undegraded":"2024-09-12T00:38:46.026415+0000","last_fullsized":"2024-09-12T00:38:46.026415+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'365","last_scrub_stamp":"2024-09-12T00:38:46.026277+0000","last_deep_scrub":"261'365","last_deep_scrub_stamp":"2024-09-12T00:38:46.026277+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.026277+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:55.022589+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":54883,"num_write":1141,"num_write_kb":38301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'151","reported_seq":706,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.830942+0000","last_change":"2024-09-12T00:38:52.830942+0000","last_active":"2024-09-12T00:38:52.830942+0000","last_peered":"2024-09-12T00:38:52.830942+0000","last_clean":"2024-09-12T00:38:52.830942+0000","last_became_active":"2024-09-12T00:01:59.153340+0000","last_became_peered":"2024-09-12T00:01:59.153340+0000","last_unstale":"2024-09-12T00:38:52.830942+0000","last_undegraded":"2024-09-12T00:38:52.830942+0000","last_fullsized":"2024-09-12T00:38:52.830942+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'151","last_scrub_stamp":"2024-09-12T00:38:52.830858+0000","last_deep_scrub":"261'151","last_deep_scrub_stamp":"2024-09-12T00:38:52.830858+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.830858+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:38.477609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":542,"num_write":243,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'317","reported_seq":1046,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.771139+0000","last_change":"2024-09-12T00:38:46.771139+0000","last_active":"2024-09-12T00:38:46.771139+0000","last_peered":"2024-09-12T00:38:46.771139+0000","last_clean":"2024-09-12T00:38:46.771139+0000","last_became_active":"2024-09-12T00:01:57.152522+0000","last_became_peered":"2024-09-12T00:01:57.152522+0000","last_unstale":"2024-09-12T00:38:46.771139+0000","last_undegraded":"2024-09-12T00:38:46.771139+0000","last_fullsized":"2024-09-12T00:38:46.771139+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'317","last_scrub_stamp":"2024-09-12T00:38:46.770967+0000","last_deep_scrub":"261'317","last_deep_scrub_stamp":"2024-09-12T00:38:46.770967+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.770967+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.575296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":990709,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":567,"num_read_kb":16299,"num_write":1038,"num_write_kb":36902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'216","reported_seq":841,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:10.203364+0000","last_change":"2024-09-12T00:01:59.146252+0000","last_active":"2024-09-12T00:38:10.203364+0000","last_peered":"2024-09-12T00:38:10.203364+0000","last_clean":"2024-09-12T00:38:10.203364+0000","last_became_active":"2024-09-12T00:01:59.145971+0000","last_became_peered":"2024-09-12T00:01:59.145971+0000","last_unstale":"2024-09-12T00:38:10.203364+0000","last_undegraded":"2024-09-12T00:38:10.203364+0000","last_fullsized":"2024-09-12T00:38:10.203364+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":962,"num_read_kb":786,"num_write":321,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'356","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.269575+0000","last_change":"2024-09-12T00:38:54.269575+0000","last_active":"2024-09-12T00:38:54.269575+0000","last_peered":"2024-09-12T00:38:54.269575+0000","last_clean":"2024-09-12T00:38:54.269575+0000","last_became_active":"2024-09-12T00:01:57.167651+0000","last_became_peered":"2024-09-12T00:01:57.167651+0000","last_unstale":"2024-09-12T00:38:54.269575+0000","last_undegraded":"2024-09-12T00:38:54.269575+0000","last_fullsized":"2024-09-12T00:38:54.269575+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'356","last_scrub_stamp":"2024-09-12T00:38:54.269448+0000","last_deep_scrub":"261'356","last_deep_scrub_stamp":"2024-09-12T00:38:54.269448+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.269448+0000","objects_scrubbed":6,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:35.410380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":490,"num_read_kb":6602,"num_write":1155,"num_write_kb":24145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'167","reported_seq":750,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:09.294340+0000","last_change":"2024-09-12T00:01:59.147316+0000","last_active":"2024-09-12T00:37:09.294340+0000","last_peered":"2024-09-12T00:37:09.294340+0000","last_clean":"2024-09-12T00:37:09.294340+0000","last_became_active":"2024-09-12T00:01:59.146794+0000","last_became_peered":"2024-09-12T00:01:59.146794+0000","last_unstale":"2024-09-12T00:37:09.294340+0000","last_undegraded":"2024-09-12T00:37:09.294340+0000","last_fullsized":"2024-09-12T00:37:09.294340+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":586,"num_write":261,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'291","reported_seq":905,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.812669+0000","last_change":"2024-09-12T00:38:50.812669+0000","last_active":"2024-09-12T00:38:50.812669+0000","last_peered":"2024-09-12T00:38:50.812669+0000","last_clean":"2024-09-12T00:38:50.812669+0000","last_became_active":"2024-09-12T00:01:57.145410+0000","last_became_peered":"2024-09-12T00:01:57.145410+0000","last_unstale":"2024-09-12T00:38:50.812669+0000","last_undegraded":"2024-09-12T00:38:50.812669+0000","last_fullsized":"2024-09-12T00:38:50.812669+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'291","last_scrub_stamp":"2024-09-12T00:38:50.812479+0000","last_deep_scrub":"261'291","last_deep_scrub_stamp":"2024-09-12T00:38:50.812479+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.812479+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:54.529596+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":406,"num_read_kb":533,"num_write":954,"num_write_kb":14360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'571","reported_seq":1333,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:23.455576+0000","last_change":"2024-09-12T00:01:59.149108+0000","last_active":"2024-09-12T00:37:23.455576+0000","last_peered":"2024-09-12T00:37:23.455576+0000","last_clean":"2024-09-12T00:37:23.455576+0000","last_became_active":"2024-09-12T00:01:59.148605+0000","last_became_peered":"2024-09-12T00:01:59.148605+0000","last_unstale":"2024-09-12T00:37:23.455576+0000","last_undegraded":"2024-09-12T00:37:23.455576+0000","last_fullsized":"2024-09-12T00:37:23.455576+0000","mapping_epoch":26,"log_start":"261'500","ondisk_log_start":"261'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:43.891160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2664,"num_read_kb":2197,"num_write":993,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'328","reported_seq":979,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.076699+0000","last_change":"2024-09-12T00:38:47.076584+0000","last_active":"2024-09-12T00:38:47.076699+0000","last_peered":"2024-09-12T00:38:47.076699+0000","last_clean":"2024-09-12T00:38:47.076699+0000","last_became_active":"2024-09-12T00:02:32.864862+0000","last_became_peered":"2024-09-12T00:02:32.864862+0000","last_unstale":"2024-09-12T00:38:47.076699+0000","last_undegraded":"2024-09-12T00:38:47.076699+0000","last_fullsized":"2024-09-12T00:38:47.076699+0000","mapping_epoch":37,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'328","last_scrub_stamp":"2024-09-12T00:38:47.076409+0000","last_deep_scrub":"261'328","last_deep_scrub_stamp":"2024-09-12T00:38:47.076409+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.076409+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:26.756457+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":496,"num_read_kb":62973,"num_write":1092,"num_write_kb":36662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7,3],"acting":[6,0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'192","reported_seq":817,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.208785+0000","last_change":"2024-09-12T00:38:54.208785+0000","last_active":"2024-09-12T00:38:54.208785+0000","last_peered":"2024-09-12T00:38:54.208785+0000","last_clean":"2024-09-12T00:38:54.208785+0000","last_became_active":"2024-09-12T00:01:59.141383+0000","last_became_peered":"2024-09-12T00:01:59.141383+0000","last_unstale":"2024-09-12T00:38:54.208785+0000","last_undegraded":"2024-09-12T00:38:54.208785+0000","last_fullsized":"2024-09-12T00:38:54.208785+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'192","last_scrub_stamp":"2024-09-12T00:38:54.208696+0000","last_deep_scrub":"261'192","last_deep_scrub_stamp":"2024-09-12T00:38:54.208696+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.208696+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:40.694440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":715,"num_write":298,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'342","reported_seq":1005,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.046217+0000","last_change":"2024-09-12T00:38:49.046108+0000","last_active":"2024-09-12T00:38:49.046217+0000","last_peered":"2024-09-12T00:38:49.046217+0000","last_clean":"2024-09-12T00:38:49.046217+0000","last_became_active":"2024-09-12T00:01:57.152097+0000","last_became_peered":"2024-09-12T00:01:57.152097+0000","last_unstale":"2024-09-12T00:38:49.046217+0000","last_undegraded":"2024-09-12T00:38:49.046217+0000","last_fullsized":"2024-09-12T00:38:49.046217+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'342","last_scrub_stamp":"2024-09-12T00:38:49.045971+0000","last_deep_scrub":"261'342","last_deep_scrub_stamp":"2024-09-12T00:38:49.045971+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.045971+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:14.819908+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399285,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":523,"num_read_kb":43886,"num_write":1080,"num_write_kb":36840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'430","reported_seq":1153,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.913482+0000","last_change":"2024-09-12T00:38:55.913482+0000","last_active":"2024-09-12T00:38:55.913482+0000","last_peered":"2024-09-12T00:38:55.913482+0000","last_clean":"2024-09-12T00:38:55.913482+0000","last_became_active":"2024-09-12T00:01:59.146117+0000","last_became_peered":"2024-09-12T00:01:59.146117+0000","last_unstale":"2024-09-12T00:38:55.913482+0000","last_undegraded":"2024-09-12T00:38:55.913482+0000","last_fullsized":"2024-09-12T00:38:55.913482+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'430","last_scrub_stamp":"2024-09-12T00:38:55.913381+0000","last_deep_scrub":"261'430","last_deep_scrub_stamp":"2024-09-12T00:38:55.913381+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.913381+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:25.825297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2179,"num_read_kb":1868,"num_write":729,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'382","reported_seq":1081,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.029173+0000","last_change":"2024-09-12T00:38:49.029107+0000","last_active":"2024-09-12T00:38:49.029173+0000","last_peered":"2024-09-12T00:38:49.029173+0000","last_clean":"2024-09-12T00:38:49.029173+0000","last_became_active":"2024-09-12T00:01:57.156002+0000","last_became_peered":"2024-09-12T00:01:57.156002+0000","last_unstale":"2024-09-12T00:38:49.029173+0000","last_undegraded":"2024-09-12T00:38:49.029173+0000","last_fullsized":"2024-09-12T00:38:49.029173+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'382","last_scrub_stamp":"2024-09-12T00:38:49.028963+0000","last_deep_scrub":"261'382","last_deep_scrub_stamp":"2024-09-12T00:38:49.028963+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.028963+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:41.518318+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":675,"num_read_kb":79699,"num_write":1346,"num_write_kb":54312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'216","reported_seq":803,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.470623+0000","last_change":"2024-09-12T00:38:47.470623+0000","last_active":"2024-09-12T00:38:47.470623+0000","last_peered":"2024-09-12T00:38:47.470623+0000","last_clean":"2024-09-12T00:38:47.470623+0000","last_became_active":"2024-09-12T00:01:59.155003+0000","last_became_peered":"2024-09-12T00:01:59.155003+0000","last_unstale":"2024-09-12T00:38:47.470623+0000","last_undegraded":"2024-09-12T00:38:47.470623+0000","last_fullsized":"2024-09-12T00:38:47.470623+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'216","last_scrub_stamp":"2024-09-12T00:38:47.470513+0000","last_deep_scrub":"261'216","last_deep_scrub_stamp":"2024-09-12T00:38:47.470513+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.470513+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:16.481869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":893,"num_read_kb":718,"num_write":326,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'362","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.779864+0000","last_change":"2024-09-12T00:38:51.779864+0000","last_active":"2024-09-12T00:38:51.779864+0000","last_peered":"2024-09-12T00:38:51.779864+0000","last_clean":"2024-09-12T00:38:51.779864+0000","last_became_active":"2024-09-12T00:01:57.145466+0000","last_became_peered":"2024-09-12T00:01:57.145466+0000","last_unstale":"2024-09-12T00:38:51.779864+0000","last_undegraded":"2024-09-12T00:38:51.779864+0000","last_fullsized":"2024-09-12T00:38:51.779864+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'362","last_scrub_stamp":"2024-09-12T00:38:51.779755+0000","last_deep_scrub":"261'362","last_deep_scrub_stamp":"2024-09-12T00:38:51.779755+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.779755+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:46.528330+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262160,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":3535,"num_write":1174,"num_write_kb":24926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'109","reported_seq":693,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.899756+0000","last_change":"2024-09-12T00:38:54.899756+0000","last_active":"2024-09-12T00:38:54.899756+0000","last_peered":"2024-09-12T00:38:54.899756+0000","last_clean":"2024-09-12T00:38:54.899756+0000","last_became_active":"2024-09-12T00:01:59.149014+0000","last_became_peered":"2024-09-12T00:01:59.149014+0000","last_unstale":"2024-09-12T00:38:54.899756+0000","last_undegraded":"2024-09-12T00:38:54.899756+0000","last_fullsized":"2024-09-12T00:38:54.899756+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'109","last_scrub_stamp":"2024-09-12T00:38:54.899674+0000","last_deep_scrub":"261'109","last_deep_scrub_stamp":"2024-09-12T00:38:54.899674+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.899674+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:24.146722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":492,"num_read_kb":416,"num_write":148,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'402","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.242136+0000","last_change":"2024-09-12T00:38:56.242136+0000","last_active":"2024-09-12T00:38:56.242136+0000","last_peered":"2024-09-12T00:38:56.242136+0000","last_clean":"2024-09-12T00:38:56.242136+0000","last_became_active":"2024-09-12T00:01:57.150980+0000","last_became_peered":"2024-09-12T00:01:57.150980+0000","last_unstale":"2024-09-12T00:38:56.242136+0000","last_undegraded":"2024-09-12T00:38:56.242136+0000","last_fullsized":"2024-09-12T00:38:56.242136+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'402","last_scrub_stamp":"2024-09-12T00:38:56.241977+0000","last_deep_scrub":"261'402","last_deep_scrub_stamp":"2024-09-12T00:38:56.241977+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.241977+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:40.615576+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1303915,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":638,"num_read_kb":15523,"num_write":1286,"num_write_kb":17105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'109","reported_seq":711,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.238054+0000","last_change":"2024-09-12T00:38:55.238054+0000","last_active":"2024-09-12T00:38:55.238054+0000","last_peered":"2024-09-12T00:38:55.238054+0000","last_clean":"2024-09-12T00:38:55.238054+0000","last_became_active":"2024-09-12T00:01:59.149341+0000","last_became_peered":"2024-09-12T00:01:59.149341+0000","last_unstale":"2024-09-12T00:38:55.238054+0000","last_undegraded":"2024-09-12T00:38:55.238054+0000","last_fullsized":"2024-09-12T00:38:55.238054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'109","last_scrub_stamp":"2024-09-12T00:38:55.237937+0000","last_deep_scrub":"261'109","last_deep_scrub_stamp":"2024-09-12T00:38:55.237937+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.237937+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:39.737518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":504,"num_read_kb":434,"num_write":171,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'343","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.738562+0000","last_change":"2024-09-12T00:38:52.738562+0000","last_active":"2024-09-12T00:38:52.738562+0000","last_peered":"2024-09-12T00:38:52.738562+0000","last_clean":"2024-09-12T00:38:52.738562+0000","last_became_active":"2024-09-12T00:02:32.863077+0000","last_became_peered":"2024-09-12T00:02:32.863077+0000","last_unstale":"2024-09-12T00:38:52.738562+0000","last_undegraded":"2024-09-12T00:38:52.738562+0000","last_fullsized":"2024-09-12T00:38:52.738562+0000","mapping_epoch":37,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'343","last_scrub_stamp":"2024-09-12T00:38:52.738425+0000","last_deep_scrub":"261'343","last_deep_scrub_stamp":"2024-09-12T00:38:52.738425+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.738425+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:23.042537+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267332,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":11923,"num_write":1143,"num_write_kb":27282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,7],"acting":[5,6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'269","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.154723+0000","last_change":"2024-09-12T00:01:59.159517+0000","last_active":"2024-09-12T00:36:54.154723+0000","last_peered":"2024-09-12T00:36:54.154723+0000","last_clean":"2024-09-12T00:36:54.154723+0000","last_became_active":"2024-09-12T00:01:59.159226+0000","last_became_peered":"2024-09-12T00:01:59.159226+0000","last_unstale":"2024-09-12T00:36:54.154723+0000","last_undegraded":"2024-09-12T00:36:54.154723+0000","last_fullsized":"2024-09-12T00:36:54.154723+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:01:58.113650+0000","last_clean_scrub_stamp":"2024-09-12T00:01:58.113650+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:44.957681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1182,"num_read_kb":958,"num_write":434,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'384","reported_seq":1052,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.429903+0000","last_change":"2024-09-12T00:38:48.429903+0000","last_active":"2024-09-12T00:38:48.429903+0000","last_peered":"2024-09-12T00:38:48.429903+0000","last_clean":"2024-09-12T00:38:48.429903+0000","last_became_active":"2024-09-12T00:01:57.148038+0000","last_became_peered":"2024-09-12T00:01:57.148038+0000","last_unstale":"2024-09-12T00:38:48.429903+0000","last_undegraded":"2024-09-12T00:38:48.429903+0000","last_fullsized":"2024-09-12T00:38:48.429903+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'384","last_scrub_stamp":"2024-09-12T00:38:48.429770+0000","last_deep_scrub":"261'384","last_deep_scrub_stamp":"2024-09-12T00:38:48.429770+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.429770+0000","objects_scrubbed":9,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:30.722756+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6690610,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":558,"num_read_kb":81305,"num_write":1164,"num_write_kb":56822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'244","reported_seq":823,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.463575+0000","last_change":"2024-09-12T00:38:46.463575+0000","last_active":"2024-09-12T00:38:46.463575+0000","last_peered":"2024-09-12T00:38:46.463575+0000","last_clean":"2024-09-12T00:38:46.463575+0000","last_became_active":"2024-09-12T00:01:59.154258+0000","last_became_peered":"2024-09-12T00:01:59.154258+0000","last_unstale":"2024-09-12T00:38:46.463575+0000","last_undegraded":"2024-09-12T00:38:46.463575+0000","last_fullsized":"2024-09-12T00:38:46.463575+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'244","last_scrub_stamp":"2024-09-12T00:38:46.463482+0000","last_deep_scrub":"261'244","last_deep_scrub_stamp":"2024-09-12T00:38:46.463482+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.463482+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:14.252384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":900,"num_write":421,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'365","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.560924+0000","last_change":"2024-09-12T00:38:50.560924+0000","last_active":"2024-09-12T00:38:50.560924+0000","last_peered":"2024-09-12T00:38:50.560924+0000","last_clean":"2024-09-12T00:38:50.560924+0000","last_became_active":"2024-09-12T00:01:57.142713+0000","last_became_peered":"2024-09-12T00:01:57.142713+0000","last_unstale":"2024-09-12T00:38:50.560924+0000","last_undegraded":"2024-09-12T00:38:50.560924+0000","last_fullsized":"2024-09-12T00:38:50.560924+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'365","last_scrub_stamp":"2024-09-12T00:38:50.560759+0000","last_deep_scrub":"261'365","last_deep_scrub_stamp":"2024-09-12T00:38:50.560759+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.560759+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:30.948385+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244498,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":36570,"num_write":1122,"num_write_kb":39253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'211","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.457433+0000","last_change":"2024-09-12T00:38:49.457433+0000","last_active":"2024-09-12T00:38:49.457433+0000","last_peered":"2024-09-12T00:38:49.457433+0000","last_clean":"2024-09-12T00:38:49.457433+0000","last_became_active":"2024-09-12T00:01:59.154931+0000","last_became_peered":"2024-09-12T00:01:59.154931+0000","last_unstale":"2024-09-12T00:38:49.457433+0000","last_undegraded":"2024-09-12T00:38:49.457433+0000","last_fullsized":"2024-09-12T00:38:49.457433+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'211","last_scrub_stamp":"2024-09-12T00:38:49.457304+0000","last_deep_scrub":"261'211","last_deep_scrub_stamp":"2024-09-12T00:38:49.457304+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.457304+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":100,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:34.654587+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":786,"num_write":317,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4003,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'344","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.223372+0000","last_change":"2024-09-12T00:38:46.223372+0000","last_active":"2024-09-12T00:38:46.223372+0000","last_peered":"2024-09-12T00:38:46.223372+0000","last_clean":"2024-09-12T00:38:46.223372+0000","last_became_active":"2024-09-12T00:01:57.142082+0000","last_became_peered":"2024-09-12T00:01:57.142082+0000","last_unstale":"2024-09-12T00:38:46.223372+0000","last_undegraded":"2024-09-12T00:38:46.223372+0000","last_fullsized":"2024-09-12T00:38:46.223372+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'344","last_scrub_stamp":"2024-09-12T00:38:46.223232+0000","last_deep_scrub":"261'344","last_deep_scrub_stamp":"2024-09-12T00:38:46.223232+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.223232+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:33.212306+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138779,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":3429,"num_write":1186,"num_write_kb":16203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'205","reported_seq":799,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.867815+0000","last_change":"2024-09-12T00:38:53.867815+0000","last_active":"2024-09-12T00:38:53.867815+0000","last_peered":"2024-09-12T00:38:53.867815+0000","last_clean":"2024-09-12T00:38:53.867815+0000","last_became_active":"2024-09-12T00:01:59.146272+0000","last_became_peered":"2024-09-12T00:01:59.146272+0000","last_unstale":"2024-09-12T00:38:53.867815+0000","last_undegraded":"2024-09-12T00:38:53.867815+0000","last_fullsized":"2024-09-12T00:38:53.867815+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'205","last_scrub_stamp":"2024-09-12T00:38:53.867730+0000","last_deep_scrub":"261'205","last_deep_scrub_stamp":"2024-09-12T00:38:53.867730+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.867730+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:40.417582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":905,"num_read_kb":736,"num_write":324,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'329","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.276744+0000","last_change":"2024-09-12T00:38:55.276744+0000","last_active":"2024-09-12T00:38:55.276744+0000","last_peered":"2024-09-12T00:38:55.276744+0000","last_clean":"2024-09-12T00:38:55.276744+0000","last_became_active":"2024-09-12T00:01:57.165139+0000","last_became_peered":"2024-09-12T00:01:57.165139+0000","last_unstale":"2024-09-12T00:38:55.276744+0000","last_undegraded":"2024-09-12T00:38:55.276744+0000","last_fullsized":"2024-09-12T00:38:55.276744+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-12T00:38:55.276619+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-12T00:38:55.276619+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.276619+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:46.561228+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174794,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":34175,"num_write":1090,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'210","reported_seq":842,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.545408+0000","last_change":"2024-09-12T00:38:57.545408+0000","last_active":"2024-09-12T00:38:57.545408+0000","last_peered":"2024-09-12T00:38:57.545408+0000","last_clean":"2024-09-12T00:38:57.545408+0000","last_became_active":"2024-09-12T00:01:59.151627+0000","last_became_peered":"2024-09-12T00:01:59.151627+0000","last_unstale":"2024-09-12T00:38:57.545408+0000","last_undegraded":"2024-09-12T00:38:57.545408+0000","last_fullsized":"2024-09-12T00:38:57.545408+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'210","last_scrub_stamp":"2024-09-12T00:38:57.545317+0000","last_deep_scrub":"261'210","last_deep_scrub_stamp":"2024-09-12T00:38:57.545317+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.545317+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:03.981223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":886,"num_read_kb":742,"num_write":315,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'378","reported_seq":1222,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.759679+0000","last_change":"2024-09-12T00:38:47.759679+0000","last_active":"2024-09-12T00:38:47.759679+0000","last_peered":"2024-09-12T00:38:47.759679+0000","last_clean":"2024-09-12T00:38:47.759679+0000","last_became_active":"2024-09-12T00:01:57.151346+0000","last_became_peered":"2024-09-12T00:01:57.151346+0000","last_unstale":"2024-09-12T00:38:47.759679+0000","last_undegraded":"2024-09-12T00:38:47.759679+0000","last_fullsized":"2024-09-12T00:38:47.759679+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T00:38:47.759548+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T00:38:47.759548+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.759548+0000","objects_scrubbed":14,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:22.136361+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":958,"num_read_kb":6741,"num_write":1200,"num_write_kb":13731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'4140","reported_seq":4720,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.378785+0000","last_change":"2024-09-12T00:38:52.378714+0000","last_active":"2024-09-12T00:38:52.378785+0000","last_peered":"2024-09-12T00:38:52.378785+0000","last_clean":"2024-09-12T00:38:52.378785+0000","last_became_active":"2024-09-12T00:01:59.157873+0000","last_became_peered":"2024-09-12T00:01:59.157873+0000","last_unstale":"2024-09-12T00:38:52.378785+0000","last_undegraded":"2024-09-12T00:38:52.378785+0000","last_fullsized":"2024-09-12T00:38:52.378785+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4140","last_scrub_stamp":"2024-09-12T00:38:52.378628+0000","last_deep_scrub":"261'4140","last_deep_scrub_stamp":"2024-09-12T00:38:52.378628+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.378628+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:17.479490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16645,"num_read_kb":13962,"num_write":6214,"num_write_kb":3111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'347","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.198261+0000","last_change":"2024-09-12T00:38:57.198261+0000","last_active":"2024-09-12T00:38:57.198261+0000","last_peered":"2024-09-12T00:38:57.198261+0000","last_clean":"2024-09-12T00:38:57.198261+0000","last_became_active":"2024-09-12T00:01:57.165016+0000","last_became_peered":"2024-09-12T00:01:57.165016+0000","last_unstale":"2024-09-12T00:38:57.198261+0000","last_undegraded":"2024-09-12T00:38:57.198261+0000","last_fullsized":"2024-09-12T00:38:57.198261+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'347","last_scrub_stamp":"2024-09-12T00:38:57.198110+0000","last_deep_scrub":"261'347","last_deep_scrub_stamp":"2024-09-12T00:38:57.198110+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.198110+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:33.940316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568671,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":600,"num_read_kb":10239,"num_write":1109,"num_write_kb":39602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'330","reported_seq":1034,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.167887+0000","last_change":"2024-09-12T00:38:58.167887+0000","last_active":"2024-09-12T00:38:58.167887+0000","last_peered":"2024-09-12T00:38:58.167887+0000","last_clean":"2024-09-12T00:38:58.167887+0000","last_became_active":"2024-09-12T00:01:57.165046+0000","last_became_peered":"2024-09-12T00:01:57.165046+0000","last_unstale":"2024-09-12T00:38:58.167887+0000","last_undegraded":"2024-09-12T00:38:58.167887+0000","last_fullsized":"2024-09-12T00:38:58.167887+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'330","last_scrub_stamp":"2024-09-12T00:38:58.167667+0000","last_deep_scrub":"261'330","last_deep_scrub_stamp":"2024-09-12T00:38:58.167667+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.167667+0000","objects_scrubbed":15,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:49.796703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8464405,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":613,"num_read_kb":41753,"num_write":993,"num_write_kb":31467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'110","reported_seq":719,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.565416+0000","last_change":"2024-09-12T00:38:58.565416+0000","last_active":"2024-09-12T00:38:58.565416+0000","last_peered":"2024-09-12T00:38:58.565416+0000","last_clean":"2024-09-12T00:38:58.565416+0000","last_became_active":"2024-09-12T00:01:59.153454+0000","last_became_peered":"2024-09-12T00:01:59.153454+0000","last_unstale":"2024-09-12T00:38:58.565416+0000","last_undegraded":"2024-09-12T00:38:58.565416+0000","last_fullsized":"2024-09-12T00:38:58.565416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'110","last_scrub_stamp":"2024-09-12T00:38:58.565298+0000","last_deep_scrub":"261'110","last_deep_scrub_stamp":"2024-09-12T00:38:58.565298+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.565298+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:54.941401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":439,"num_write":164,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'353","reported_seq":1208,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.787595+0000","last_change":"2024-09-12T00:38:54.787595+0000","last_active":"2024-09-12T00:38:54.787595+0000","last_peered":"2024-09-12T00:38:54.787595+0000","last_clean":"2024-09-12T00:38:54.787595+0000","last_became_active":"2024-09-12T00:01:57.146320+0000","last_became_peered":"2024-09-12T00:01:57.146320+0000","last_unstale":"2024-09-12T00:38:54.787595+0000","last_undegraded":"2024-09-12T00:38:54.787595+0000","last_fullsized":"2024-09-12T00:38:54.787595+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T00:38:54.787503+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T00:38:54.787503+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.787503+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:52.554107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":988,"num_read_kb":6700,"num_write":1181,"num_write_kb":43058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'174","reported_seq":777,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.462924+0000","last_change":"2024-09-12T00:38:50.462924+0000","last_active":"2024-09-12T00:38:50.462924+0000","last_peered":"2024-09-12T00:38:50.462924+0000","last_clean":"2024-09-12T00:38:50.462924+0000","last_became_active":"2024-09-12T00:01:59.146876+0000","last_became_peered":"2024-09-12T00:01:59.146876+0000","last_unstale":"2024-09-12T00:38:50.462924+0000","last_undegraded":"2024-09-12T00:38:50.462924+0000","last_fullsized":"2024-09-12T00:38:50.462924+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'174","last_scrub_stamp":"2024-09-12T00:38:50.462833+0000","last_deep_scrub":"261'174","last_deep_scrub_stamp":"2024-09-12T00:38:50.462833+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.462833+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:16.424671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":808,"num_read_kb":667,"num_write":271,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5901,"num_read_kb":4223,"num_write":1957,"num_write_kb":855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1029,"ondisk_log_size":1029,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":14998,"num_read_kb":14670,"num_write":16815,"num_write_kb":4907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1464,"ondisk_log_size":1464,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":579,"ondisk_log_size":579,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1554453,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17205,"num_read_kb":36338,"num_write":14367,"num_write_kb":11412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500800,"num_omap_keys":1132,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2171,"ondisk_log_size":2171,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102638,"num_read_kb":85737,"num_write":37205,"num_write_kb":18751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34993,"num_omap_keys":141,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3982,"ondisk_log_size":3982,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":86840172,"num_objects":366,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":36012,"num_read_kb":1881303,"num_write":71771,"num_write_kb":2075118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":118292480,"data_stored":118292480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3738,"ondisk_log_size":3738,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":208372,"num_write":160,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":193338,"num_write":160,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509892,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":223704,"kb_used_data":12104,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":94148136,"statfs":{"total":96636764160,"available":96407691264,"internally_reserved":0,"allocated":12394496,"data_stored":10437918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":216660426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509891,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116940,"kb_used_data":17788,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94254900,"statfs":{"total":96636764160,"available":96517017600,"internally_reserved":0,"allocated":18214912,"data_stored":16235382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101513670},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509893,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256424,"kb_used_data":12824,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94115416,"statfs":{"total":96636764160,"available":96374185984,"internally_reserved":0,"allocated":13131776,"data_stored":11163018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249428421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509891,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239340,"kb_used_data":19356,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94132500,"statfs":{"total":96636764160,"available":96391680000,"internally_reserved":0,"allocated":19820544,"data_stored":17855512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":225245639},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509893,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143280,"kb_used_data":26016,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94228560,"statfs":{"total":96636764160,"available":96490045440,"internally_reserved":0,"allocated":26640384,"data_stored":24664481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509892,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136728,"kb_used_data":19528,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94235112,"statfs":{"total":96636764160,"available":96496754688,"internally_reserved":0,"allocated":19996672,"data_stored":18028066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575299,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":233756,"kb_used_data":26316,"kb_used_omap":1,"kb_used_meta":207422,"kb_avail":94138084,"statfs":{"total":96636764160,"available":96397398016,"internally_reserved":0,"allocated":26947584,"data_stored":25004229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":212400581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575301,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":343556,"kb_used_data":15284,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94028284,"statfs":{"total":96636764160,"available":96284962816,"internally_reserved":0,"allocated":15650816,"data_stored":13693364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15826944,"data_stored":15826944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10903552,"data_stored":10903552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22462464,"data_stored":22462464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15654912,"data_stored":15654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22802432,"data_stored":22802432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8372224,"data_stored":8372224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14032896,"data_stored":14032896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8237056,"data_stored":8237056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:39:05.660 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.660 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.661 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.661 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.661 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.661 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.661 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.661 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.661 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.661 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.661 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.662 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.662 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.662 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.662 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.662 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.662 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.662 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.662 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.662 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.663 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.663 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.663 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.663 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.663 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.663 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.663 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.663 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.663 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.664 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.664 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.664 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.664 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.664 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.664 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.664 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.664 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.664 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.665 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.665 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.665 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.665 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.665 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.665 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.665 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.665 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.665 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.666 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.666 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.666 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.666 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.666 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.666 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.666 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.666 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.666 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.667 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.667 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.667 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.667 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.667 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.667 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.667 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.667 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.667 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.667 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.668 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.668 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.668 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.668 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.668 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.668 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.668 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.668 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.668 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.669 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.669 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.669 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.669 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.669 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.669 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.669 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.669 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.669 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.670 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.670 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.670 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.670 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.670 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.670 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.670 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.670 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.671 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.671 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.671 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.671 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.671 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.671 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.672 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.672 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.672 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.672 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.672 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.672 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.672 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.672 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.672 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.673 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.673 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.673 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.673 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.673 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.673 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.673 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.673 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.673 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.674 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.674 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.674 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.674 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.674 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.674 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.674 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.674 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.674 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.675 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.675 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.675 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.675 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.675 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.675 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.675 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.675 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.676 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.676 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.676 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.676 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.676 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.676 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.676 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.677 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.677 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.677 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.677 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.677 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.677 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.677 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.677 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.677 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.678 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.678 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.678 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.678 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.678 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.678 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.678 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.678 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.679 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.679 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.679 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.679 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.679 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.679 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.679 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.679 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.680 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.680 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.680 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.680 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.680 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.680 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.680 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.680 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.680 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.681 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.681 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.681 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.681 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.681 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.681 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.681 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.681 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.682 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.682 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.682 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.682 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.682 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.682 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.682 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.682 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.683 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.683 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.683 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.683 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.683 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.683 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.683 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.683 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.684 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.684 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.684 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.684 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.684 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.684 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.684 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.684 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.685 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.685 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.685 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.685 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.685 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.685 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.685 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.685 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.685 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.686 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.686 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.686 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.686 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.686 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.686 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.686 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.686 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.687 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.687 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.687 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.687 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.687 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.687 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.687 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.687 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.687 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.688 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.688 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.688 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.688 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.688 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.688 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.688 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.688 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.689 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.689 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.689 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:01:56.109080+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.689 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.689 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.689 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.689 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.689 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.689 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.690 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:02:00.129868+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.690 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:02:02.133472+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.690 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.690 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.690 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.690 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.690 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.691 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:01:58.113650+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=1, tm_sec=58, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:05.691 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:39:25.692 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:39:26.046 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:39:26.058 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T00:39:26.061 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":1388,"stamp":"2024-09-12T00:39:25.648914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89002200,"num_objects":716,"num_object_clones":0,"num_object_copies":2164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":716,"num_whiteouts":0,"num_read":179516,"num_read_kb":2426911,"num_write":142578,"num_write_kb":2382623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":728035,"num_omap_keys":1751,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13337,"ondisk_log_size":13337,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1702048,"kb_used_data":149216,"kb_used_omap":12,"kb_used_meta":1552691,"kb_avail":753272672,"statfs":{"total":773094113280,"available":771351216128,"internally_reserved":0,"allocated":152797184,"data_stored":137081970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1589956144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":130599,"num_omap_keys":339,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005281"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.282207+0000","last_change":"2024-09-12T00:39:20.282207+0000","last_active":"2024-09-12T00:39:20.282207+0000","last_peered":"2024-09-12T00:39:20.282207+0000","last_clean":"2024-09-12T00:39:20.282207+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:39:20.282207+0000","last_undegraded":"2024-09-12T00:39:20.282207+0000","last_fullsized":"2024-09-12T00:39:20.282207+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:20.282107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:20.282107+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.282107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:02.419166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'10","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.368762+0000","last_change":"2024-09-12T00:39:19.368762+0000","last_active":"2024-09-12T00:39:19.368762+0000","last_peered":"2024-09-12T00:39:19.368762+0000","last_clean":"2024-09-12T00:39:19.368762+0000","last_became_active":"2024-09-12T00:17:03.213906+0000","last_became_peered":"2024-09-12T00:17:03.213906+0000","last_unstale":"2024-09-12T00:39:19.368762+0000","last_undegraded":"2024-09-12T00:39:19.368762+0000","last_fullsized":"2024-09-12T00:39:19.368762+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'10","last_scrub_stamp":"2024-09-12T00:39:19.368659+0000","last_deep_scrub":"261'10","last_deep_scrub_stamp":"2024-09-12T00:39:19.368659+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.368659+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:36.783100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":18831,"num_write":10,"num_write_kb":11989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.047359+0000","last_change":"2024-09-12T00:39:22.047359+0000","last_active":"2024-09-12T00:39:22.047359+0000","last_peered":"2024-09-12T00:39:22.047359+0000","last_clean":"2024-09-12T00:39:22.047359+0000","last_became_active":"2024-09-12T00:17:00.182510+0000","last_became_peered":"2024-09-12T00:17:00.182510+0000","last_unstale":"2024-09-12T00:39:22.047359+0000","last_undegraded":"2024-09-12T00:39:22.047359+0000","last_fullsized":"2024-09-12T00:39:22.047359+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:22.047271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:22.047271+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.047271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:40.094437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'18","reported_seq":91,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:27.517806+0000","last_change":"2024-09-12T00:15:34.415639+0000","last_active":"2024-09-12T00:36:27.517806+0000","last_peered":"2024-09-12T00:36:27.517806+0000","last_clean":"2024-09-12T00:36:27.517806+0000","last_became_active":"2024-09-12T00:15:34.415364+0000","last_became_peered":"2024-09-12T00:15:34.415364+0000","last_unstale":"2024-09-12T00:36:27.517806+0000","last_undegraded":"2024-09-12T00:36:27.517806+0000","last_fullsized":"2024-09-12T00:36:27.517806+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:04.462246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":17,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:49.500985+0000","last_change":"2024-09-12T00:27:17.581875+0000","last_active":"2024-09-12T00:34:49.500985+0000","last_peered":"2024-09-12T00:34:49.500985+0000","last_clean":"2024-09-12T00:34:49.500985+0000","last_became_active":"2024-09-12T00:27:17.581520+0000","last_became_peered":"2024-09-12T00:27:17.581520+0000","last_unstale":"2024-09-12T00:34:49.500985+0000","last_undegraded":"2024-09-12T00:34:49.500985+0000","last_fullsized":"2024-09-12T00:34:49.500985+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:28.315835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.103669+0000","last_change":"2024-09-12T00:39:22.103669+0000","last_active":"2024-09-12T00:39:22.103669+0000","last_peered":"2024-09-12T00:39:22.103669+0000","last_clean":"2024-09-12T00:39:22.103669+0000","last_became_active":"2024-09-12T00:17:03.206566+0000","last_became_peered":"2024-09-12T00:17:03.206566+0000","last_unstale":"2024-09-12T00:39:22.103669+0000","last_undegraded":"2024-09-12T00:39:22.103669+0000","last_fullsized":"2024-09-12T00:39:22.103669+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:22.103578+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:22.103578+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.103578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:36.235087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.519227+0000","last_change":"2024-09-12T00:17:00.176346+0000","last_active":"2024-09-12T00:36:59.519227+0000","last_peered":"2024-09-12T00:36:59.519227+0000","last_clean":"2024-09-12T00:36:59.519227+0000","last_became_active":"2024-09-12T00:17:00.175196+0000","last_became_peered":"2024-09-12T00:17:00.175196+0000","last_unstale":"2024-09-12T00:36:59.519227+0000","last_undegraded":"2024-09-12T00:36:59.519227+0000","last_fullsized":"2024-09-12T00:36:59.519227+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:52.503715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"258'75","reported_seq":276,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:42.511663+0000","last_change":"2024-09-12T00:15:34.417010+0000","last_active":"2024-09-12T00:35:42.511663+0000","last_peered":"2024-09-12T00:35:42.511663+0000","last_clean":"2024-09-12T00:35:42.511663+0000","last_became_active":"2024-09-12T00:15:34.416706+0000","last_became_peered":"2024-09-12T00:15:34.416706+0000","last_unstale":"2024-09-12T00:35:42.511663+0000","last_undegraded":"2024-09-12T00:35:42.511663+0000","last_fullsized":"2024-09-12T00:35:42.511663+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:28.483679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":462,"num_read_kb":331,"num_write":93,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:56.517752+0000","last_change":"2024-09-12T00:27:17.573237+0000","last_active":"2024-09-12T00:36:56.517752+0000","last_peered":"2024-09-12T00:36:56.517752+0000","last_clean":"2024-09-12T00:36:56.517752+0000","last_became_active":"2024-09-12T00:27:17.572934+0000","last_became_peered":"2024-09-12T00:27:17.572934+0000","last_unstale":"2024-09-12T00:36:56.517752+0000","last_undegraded":"2024-09-12T00:36:56.517752+0000","last_fullsized":"2024-09-12T00:36:56.517752+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'3","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:54.527097+0000","last_change":"2024-09-12T00:17:03.212082+0000","last_active":"2024-09-12T00:37:54.527097+0000","last_peered":"2024-09-12T00:37:54.527097+0000","last_clean":"2024-09-12T00:37:54.527097+0000","last_became_active":"2024-09-12T00:17:03.211755+0000","last_became_peered":"2024-09-12T00:17:03.211755+0000","last_unstale":"2024-09-12T00:37:54.527097+0000","last_undegraded":"2024-09-12T00:37:54.527097+0000","last_fullsized":"2024-09-12T00:37:54.527097+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:11.463541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.519673+0000","last_change":"2024-09-12T00:17:00.181734+0000","last_active":"2024-09-12T00:37:04.519673+0000","last_peered":"2024-09-12T00:37:04.519673+0000","last_clean":"2024-09-12T00:37:04.519673+0000","last_became_active":"2024-09-12T00:17:00.181461+0000","last_became_peered":"2024-09-12T00:17:00.181461+0000","last_unstale":"2024-09-12T00:37:04.519673+0000","last_undegraded":"2024-09-12T00:37:04.519673+0000","last_fullsized":"2024-09-12T00:37:04.519673+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'16","reported_seq":90,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.927488+0000","last_change":"2024-09-12T00:39:18.927488+0000","last_active":"2024-09-12T00:39:18.927488+0000","last_peered":"2024-09-12T00:39:18.927488+0000","last_clean":"2024-09-12T00:39:18.927488+0000","last_became_active":"2024-09-12T00:15:34.428023+0000","last_became_peered":"2024-09-12T00:15:34.428023+0000","last_unstale":"2024-09-12T00:39:18.927488+0000","last_undegraded":"2024-09-12T00:39:18.927488+0000","last_fullsized":"2024-09-12T00:39:18.927488+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'16","last_scrub_stamp":"2024-09-12T00:39:18.927402+0000","last_deep_scrub":"261'16","last_deep_scrub_stamp":"2024-09-12T00:39:18.927402+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.927402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:56.772211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.519165+0000","last_change":"2024-09-12T00:27:17.577865+0000","last_active":"2024-09-12T00:36:59.519165+0000","last_peered":"2024-09-12T00:36:59.519165+0000","last_clean":"2024-09-12T00:36:59.519165+0000","last_became_active":"2024-09-12T00:27:17.577034+0000","last_became_peered":"2024-09-12T00:27:17.577034+0000","last_unstale":"2024-09-12T00:36:59.519165+0000","last_undegraded":"2024-09-12T00:36:59.519165+0000","last_fullsized":"2024-09-12T00:36:59.519165+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"261'3","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.009823+0000","last_change":"2024-09-12T00:17:03.210262+0000","last_active":"2024-09-12T00:38:37.009823+0000","last_peered":"2024-09-12T00:38:37.009823+0000","last_clean":"2024-09-12T00:38:37.009823+0000","last_became_active":"2024-09-12T00:17:03.209945+0000","last_became_peered":"2024-09-12T00:17:03.209945+0000","last_unstale":"2024-09-12T00:38:37.009823+0000","last_undegraded":"2024-09-12T00:38:37.009823+0000","last_fullsized":"2024-09-12T00:38:37.009823+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.396026+0000","last_change":"2024-09-12T00:39:15.396026+0000","last_active":"2024-09-12T00:39:15.396026+0000","last_peered":"2024-09-12T00:39:15.396026+0000","last_clean":"2024-09-12T00:39:15.396026+0000","last_became_active":"2024-09-12T00:17:00.176151+0000","last_became_peered":"2024-09-12T00:17:00.176151+0000","last_unstale":"2024-09-12T00:39:15.396026+0000","last_undegraded":"2024-09-12T00:39:15.396026+0000","last_fullsized":"2024-09-12T00:39:15.396026+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:15.395938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:15.395938+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.395938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:59.127563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'69","reported_seq":237,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.973168+0000","last_change":"2024-09-12T00:39:17.973168+0000","last_active":"2024-09-12T00:39:17.973168+0000","last_peered":"2024-09-12T00:39:17.973168+0000","last_clean":"2024-09-12T00:39:17.973168+0000","last_became_active":"2024-09-12T00:15:34.422426+0000","last_became_peered":"2024-09-12T00:15:34.422426+0000","last_unstale":"2024-09-12T00:39:17.973168+0000","last_undegraded":"2024-09-12T00:39:17.973168+0000","last_fullsized":"2024-09-12T00:39:17.973168+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'69","last_scrub_stamp":"2024-09-12T00:39:17.973075+0000","last_deep_scrub":"261'69","last_deep_scrub_stamp":"2024-09-12T00:39:17.973075+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.973075+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:24.383265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":354,"num_read_kb":254,"num_write":121,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:19.521930+0000","last_change":"2024-09-12T00:27:17.579859+0000","last_active":"2024-09-12T00:37:19.521930+0000","last_peered":"2024-09-12T00:37:19.521930+0000","last_clean":"2024-09-12T00:37:19.521930+0000","last_became_active":"2024-09-12T00:27:17.579540+0000","last_became_peered":"2024-09-12T00:27:17.579540+0000","last_unstale":"2024-09-12T00:37:19.521930+0000","last_undegraded":"2024-09-12T00:37:19.521930+0000","last_fullsized":"2024-09-12T00:37:19.521930+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.300900+0000","last_change":"2024-09-12T00:39:16.300900+0000","last_active":"2024-09-12T00:39:16.300900+0000","last_peered":"2024-09-12T00:39:16.300900+0000","last_clean":"2024-09-12T00:39:16.300900+0000","last_became_active":"2024-09-12T00:17:03.218684+0000","last_became_peered":"2024-09-12T00:17:03.218684+0000","last_unstale":"2024-09-12T00:39:16.300900+0000","last_undegraded":"2024-09-12T00:39:16.300900+0000","last_fullsized":"2024-09-12T00:39:16.300900+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T00:39:16.300799+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T00:39:16.300799+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.300799+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:40.707352+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'18","reported_seq":74,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:38.204856+0000","last_change":"2024-09-12T00:17:00.186275+0000","last_active":"2024-09-12T00:38:38.204856+0000","last_peered":"2024-09-12T00:38:38.204856+0000","last_clean":"2024-09-12T00:38:38.204856+0000","last_became_active":"2024-09-12T00:17:00.185974+0000","last_became_peered":"2024-09-12T00:17:00.185974+0000","last_unstale":"2024-09-12T00:38:38.204856+0000","last_undegraded":"2024-09-12T00:38:38.204856+0000","last_fullsized":"2024-09-12T00:38:38.204856+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":38916,"num_write":33,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'44","reported_seq":163,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.978260+0000","last_change":"2024-09-12T00:39:15.978260+0000","last_active":"2024-09-12T00:39:15.978260+0000","last_peered":"2024-09-12T00:39:15.978260+0000","last_clean":"2024-09-12T00:39:15.978260+0000","last_became_active":"2024-09-12T00:15:34.423149+0000","last_became_peered":"2024-09-12T00:15:34.423149+0000","last_unstale":"2024-09-12T00:39:15.978260+0000","last_undegraded":"2024-09-12T00:39:15.978260+0000","last_fullsized":"2024-09-12T00:39:15.978260+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'44","last_scrub_stamp":"2024-09-12T00:39:15.978169+0000","last_deep_scrub":"261'44","last_deep_scrub_stamp":"2024-09-12T00:39:15.978169+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.978169+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:01.886044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":150,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:37.510807+0000","last_change":"2024-09-12T00:27:17.575993+0000","last_active":"2024-09-12T00:35:37.510807+0000","last_peered":"2024-09-12T00:35:37.510807+0000","last_clean":"2024-09-12T00:35:37.510807+0000","last_became_active":"2024-09-12T00:27:17.575513+0000","last_became_peered":"2024-09-12T00:27:17.575513+0000","last_unstale":"2024-09-12T00:35:37.510807+0000","last_undegraded":"2024-09-12T00:35:37.510807+0000","last_fullsized":"2024-09-12T00:35:37.510807+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:31.106786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396470+0000","last_change":"2024-09-12T00:17:03.220037+0000","last_active":"2024-09-12T00:36:24.396470+0000","last_peered":"2024-09-12T00:36:24.396470+0000","last_clean":"2024-09-12T00:36:24.396470+0000","last_became_active":"2024-09-12T00:17:03.219058+0000","last_became_peered":"2024-09-12T00:17:03.219058+0000","last_unstale":"2024-09-12T00:36:24.396470+0000","last_undegraded":"2024-09-12T00:36:24.396470+0000","last_fullsized":"2024-09-12T00:36:24.396470+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396546+0000","last_change":"2024-09-12T00:17:00.183145+0000","last_active":"2024-09-12T00:36:24.396546+0000","last_peered":"2024-09-12T00:36:24.396546+0000","last_clean":"2024-09-12T00:36:24.396546+0000","last_became_active":"2024-09-12T00:17:00.182830+0000","last_became_peered":"2024-09-12T00:17:00.182830+0000","last_unstale":"2024-09-12T00:36:24.396546+0000","last_undegraded":"2024-09-12T00:36:24.396546+0000","last_fullsized":"2024-09-12T00:36:24.396546+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'10","reported_seq":75,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.154400+0000","last_change":"2024-09-12T00:39:16.154400+0000","last_active":"2024-09-12T00:39:16.154400+0000","last_peered":"2024-09-12T00:39:16.154400+0000","last_clean":"2024-09-12T00:39:16.154400+0000","last_became_active":"2024-09-12T00:15:34.420841+0000","last_became_peered":"2024-09-12T00:15:34.420841+0000","last_unstale":"2024-09-12T00:39:16.154400+0000","last_undegraded":"2024-09-12T00:39:16.154400+0000","last_fullsized":"2024-09-12T00:39:16.154400+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'10","last_scrub_stamp":"2024-09-12T00:39:16.154315+0000","last_deep_scrub":"261'10","last_deep_scrub_stamp":"2024-09-12T00:39:16.154315+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.154315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:36.510847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'2","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:24.179565+0000","last_change":"2024-09-12T00:39:24.179565+0000","last_active":"2024-09-12T00:39:24.179565+0000","last_peered":"2024-09-12T00:39:24.179565+0000","last_clean":"2024-09-12T00:39:24.179565+0000","last_became_active":"2024-09-12T00:27:17.583300+0000","last_became_peered":"2024-09-12T00:27:17.583300+0000","last_unstale":"2024-09-12T00:39:24.179565+0000","last_undegraded":"2024-09-12T00:39:24.179565+0000","last_fullsized":"2024-09-12T00:39:24.179565+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:24.179468+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:24.179468+0000","last_clean_scrub_stamp":"2024-09-12T00:39:24.179468+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:24.077004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":35,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.071341+0000","last_change":"2024-09-12T00:39:20.071341+0000","last_active":"2024-09-12T00:39:20.071341+0000","last_peered":"2024-09-12T00:39:20.071341+0000","last_clean":"2024-09-12T00:39:20.071341+0000","last_became_active":"2024-09-12T00:17:03.211869+0000","last_became_peered":"2024-09-12T00:17:03.211869+0000","last_unstale":"2024-09-12T00:39:20.071341+0000","last_undegraded":"2024-09-12T00:39:20.071341+0000","last_fullsized":"2024-09-12T00:39:20.071341+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:20.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:20.071249+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:22.469297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.223498+0000","last_change":"2024-09-12T00:39:12.223498+0000","last_active":"2024-09-12T00:39:12.223498+0000","last_peered":"2024-09-12T00:39:12.223498+0000","last_clean":"2024-09-12T00:39:12.223498+0000","last_became_active":"2024-09-12T00:17:00.180995+0000","last_became_peered":"2024-09-12T00:17:00.180995+0000","last_unstale":"2024-09-12T00:39:12.223498+0000","last_undegraded":"2024-09-12T00:39:12.223498+0000","last_fullsized":"2024-09-12T00:39:12.223498+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:12.223413+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:12.223413+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.223413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.095258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"261'23","reported_seq":109,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.060964+0000","last_change":"2024-09-12T00:39:16.060964+0000","last_active":"2024-09-12T00:39:16.060964+0000","last_peered":"2024-09-12T00:39:16.060964+0000","last_clean":"2024-09-12T00:39:16.060964+0000","last_became_active":"2024-09-12T00:15:34.417149+0000","last_became_peered":"2024-09-12T00:15:34.417149+0000","last_unstale":"2024-09-12T00:39:16.060964+0000","last_undegraded":"2024-09-12T00:39:16.060964+0000","last_fullsized":"2024-09-12T00:39:16.060964+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'23","last_scrub_stamp":"2024-09-12T00:39:16.060880+0000","last_deep_scrub":"261'23","last_deep_scrub_stamp":"2024-09-12T00:39:16.060880+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.060880+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:52.936909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.325383+0000","last_change":"2024-09-12T00:39:22.325383+0000","last_active":"2024-09-12T00:39:22.325383+0000","last_peered":"2024-09-12T00:39:22.325383+0000","last_clean":"2024-09-12T00:39:22.325383+0000","last_became_active":"2024-09-12T00:27:17.578739+0000","last_became_peered":"2024-09-12T00:27:17.578739+0000","last_unstale":"2024-09-12T00:39:22.325383+0000","last_undegraded":"2024-09-12T00:39:22.325383+0000","last_fullsized":"2024-09-12T00:39:22.325383+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:22.325281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:22.325281+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.325281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:07.198322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'3","reported_seq":30,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:04.519599+0000","last_change":"2024-09-12T00:17:03.213329+0000","last_active":"2024-09-12T00:37:04.519599+0000","last_peered":"2024-09-12T00:37:04.519599+0000","last_clean":"2024-09-12T00:37:04.519599+0000","last_became_active":"2024-09-12T00:17:03.213071+0000","last_became_peered":"2024-09-12T00:17:03.213071+0000","last_unstale":"2024-09-12T00:37:04.519599+0000","last_undegraded":"2024-09-12T00:37:04.519599+0000","last_fullsized":"2024-09-12T00:37:04.519599+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:46.816595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.949645+0000","last_change":"2024-09-12T00:39:21.949645+0000","last_active":"2024-09-12T00:39:21.949645+0000","last_peered":"2024-09-12T00:39:21.949645+0000","last_clean":"2024-09-12T00:39:21.949645+0000","last_became_active":"2024-09-12T00:17:00.178279+0000","last_became_peered":"2024-09-12T00:17:00.178279+0000","last_unstale":"2024-09-12T00:39:21.949645+0000","last_undegraded":"2024-09-12T00:39:21.949645+0000","last_fullsized":"2024-09-12T00:39:21.949645+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:21.949558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:21.949558+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.949558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:32.421262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'24","reported_seq":112,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.931136+0000","last_change":"2024-09-12T00:39:16.931136+0000","last_active":"2024-09-12T00:39:16.931136+0000","last_peered":"2024-09-12T00:39:16.931136+0000","last_clean":"2024-09-12T00:39:16.931136+0000","last_became_active":"2024-09-12T00:15:34.420120+0000","last_became_peered":"2024-09-12T00:15:34.420120+0000","last_unstale":"2024-09-12T00:39:16.931136+0000","last_undegraded":"2024-09-12T00:39:16.931136+0000","last_fullsized":"2024-09-12T00:39:16.931136+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'24","last_scrub_stamp":"2024-09-12T00:39:16.931040+0000","last_deep_scrub":"261'24","last_deep_scrub_stamp":"2024-09-12T00:39:16.931040+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.931040+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:15.253627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:39.516479+0000","last_change":"2024-09-12T00:27:17.578396+0000","last_active":"2024-09-12T00:36:39.516479+0000","last_peered":"2024-09-12T00:36:39.516479+0000","last_clean":"2024-09-12T00:36:39.516479+0000","last_became_active":"2024-09-12T00:27:17.577671+0000","last_became_peered":"2024-09-12T00:27:17.577671+0000","last_unstale":"2024-09-12T00:36:39.516479+0000","last_undegraded":"2024-09-12T00:36:39.516479+0000","last_fullsized":"2024-09-12T00:36:39.516479+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.514253+0000","last_change":"2024-09-12T00:17:03.214034+0000","last_active":"2024-09-12T00:36:24.514253+0000","last_peered":"2024-09-12T00:36:24.514253+0000","last_clean":"2024-09-12T00:36:24.514253+0000","last_became_active":"2024-09-12T00:17:03.213775+0000","last_became_peered":"2024-09-12T00:17:03.213775+0000","last_unstale":"2024-09-12T00:36:24.514253+0000","last_undegraded":"2024-09-12T00:36:24.514253+0000","last_fullsized":"2024-09-12T00:36:24.514253+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'6","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.583918+0000","last_change":"2024-09-12T00:17:00.183189+0000","last_active":"2024-09-12T00:38:37.583918+0000","last_peered":"2024-09-12T00:38:37.583918+0000","last_clean":"2024-09-12T00:38:37.583918+0000","last_became_active":"2024-09-12T00:17:00.182842+0000","last_became_peered":"2024-09-12T00:17:00.182842+0000","last_unstale":"2024-09-12T00:38:37.583918+0000","last_undegraded":"2024-09-12T00:38:37.583918+0000","last_fullsized":"2024-09-12T00:38:37.583918+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:45.925037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'14","reported_seq":77,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:57.505085+0000","last_change":"2024-09-12T00:15:34.421873+0000","last_active":"2024-09-12T00:34:57.505085+0000","last_peered":"2024-09-12T00:34:57.505085+0000","last_clean":"2024-09-12T00:34:57.505085+0000","last_became_active":"2024-09-12T00:15:34.421585+0000","last_became_peered":"2024-09-12T00:15:34.421585+0000","last_unstale":"2024-09-12T00:34:57.505085+0000","last_undegraded":"2024-09-12T00:34:57.505085+0000","last_fullsized":"2024-09-12T00:34:57.505085+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:19.525663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.952052+0000","last_change":"2024-09-12T00:39:23.952052+0000","last_active":"2024-09-12T00:39:23.952052+0000","last_peered":"2024-09-12T00:39:23.952052+0000","last_clean":"2024-09-12T00:39:23.952052+0000","last_became_active":"2024-09-12T00:27:17.572899+0000","last_became_peered":"2024-09-12T00:27:17.572899+0000","last_unstale":"2024-09-12T00:39:23.952052+0000","last_undegraded":"2024-09-12T00:39:23.952052+0000","last_fullsized":"2024-09-12T00:39:23.952052+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:23.951961+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:23.951961+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.951961+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:01.714398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.509411+0000","last_change":"2024-09-12T00:17:03.217326+0000","last_active":"2024-09-12T00:35:44.509411+0000","last_peered":"2024-09-12T00:35:44.509411+0000","last_clean":"2024-09-12T00:35:44.509411+0000","last_became_active":"2024-09-12T00:17:03.217052+0000","last_became_peered":"2024-09-12T00:17:03.217052+0000","last_unstale":"2024-09-12T00:35:44.509411+0000","last_undegraded":"2024-09-12T00:35:44.509411+0000","last_fullsized":"2024-09-12T00:35:44.509411+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:57.870587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.212364+0000","last_change":"2024-09-12T00:39:11.212364+0000","last_active":"2024-09-12T00:39:11.212364+0000","last_peered":"2024-09-12T00:39:11.212364+0000","last_clean":"2024-09-12T00:39:11.212364+0000","last_became_active":"2024-09-12T00:17:00.181082+0000","last_became_peered":"2024-09-12T00:17:00.181082+0000","last_unstale":"2024-09-12T00:39:11.212364+0000","last_undegraded":"2024-09-12T00:39:11.212364+0000","last_fullsized":"2024-09-12T00:39:11.212364+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:11.212247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:11.212247+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.212247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:13.398319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'32","reported_seq":135,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.610029+0000","last_change":"2024-09-12T00:39:21.610029+0000","last_active":"2024-09-12T00:39:21.610029+0000","last_peered":"2024-09-12T00:39:21.610029+0000","last_clean":"2024-09-12T00:39:21.610029+0000","last_became_active":"2024-09-12T00:15:34.413875+0000","last_became_peered":"2024-09-12T00:15:34.413875+0000","last_unstale":"2024-09-12T00:39:21.610029+0000","last_undegraded":"2024-09-12T00:39:21.610029+0000","last_fullsized":"2024-09-12T00:39:21.610029+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'32","last_scrub_stamp":"2024-09-12T00:39:21.609933+0000","last_deep_scrub":"261'32","last_deep_scrub_stamp":"2024-09-12T00:39:21.609933+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.609933+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:57.723093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":63,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:39.633876+0000","last_change":"2024-09-12T00:27:17.577218+0000","last_active":"2024-09-12T00:36:39.633876+0000","last_peered":"2024-09-12T00:36:39.633876+0000","last_clean":"2024-09-12T00:36:39.633876+0000","last_became_active":"2024-09-12T00:27:17.576878+0000","last_became_peered":"2024-09-12T00:27:17.576878+0000","last_unstale":"2024-09-12T00:36:39.633876+0000","last_undegraded":"2024-09-12T00:36:39.633876+0000","last_fullsized":"2024-09-12T00:36:39.633876+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.514295+0000","last_change":"2024-09-12T00:17:03.216054+0000","last_active":"2024-09-12T00:36:24.514295+0000","last_peered":"2024-09-12T00:36:24.514295+0000","last_clean":"2024-09-12T00:36:24.514295+0000","last_became_active":"2024-09-12T00:17:03.215625+0000","last_became_peered":"2024-09-12T00:17:03.215625+0000","last_unstale":"2024-09-12T00:36:24.514295+0000","last_undegraded":"2024-09-12T00:36:24.514295+0000","last_fullsized":"2024-09-12T00:36:24.514295+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.057043+0000","last_change":"2024-09-12T00:39:21.057043+0000","last_active":"2024-09-12T00:39:21.057043+0000","last_peered":"2024-09-12T00:39:21.057043+0000","last_clean":"2024-09-12T00:39:21.057043+0000","last_became_active":"2024-09-12T00:17:00.182392+0000","last_became_peered":"2024-09-12T00:17:00.182392+0000","last_unstale":"2024-09-12T00:39:21.057043+0000","last_undegraded":"2024-09-12T00:39:21.057043+0000","last_fullsized":"2024-09-12T00:39:21.057043+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:21.056958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:21.056958+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.056958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.276177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'27","reported_seq":122,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.023909+0000","last_change":"2024-09-12T00:39:15.023909+0000","last_active":"2024-09-12T00:39:15.023909+0000","last_peered":"2024-09-12T00:39:15.023909+0000","last_clean":"2024-09-12T00:39:15.023909+0000","last_became_active":"2024-09-12T00:15:34.419377+0000","last_became_peered":"2024-09-12T00:15:34.419377+0000","last_unstale":"2024-09-12T00:39:15.023909+0000","last_undegraded":"2024-09-12T00:39:15.023909+0000","last_fullsized":"2024-09-12T00:39:15.023909+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'27","last_scrub_stamp":"2024-09-12T00:39:15.023824+0000","last_deep_scrub":"261'27","last_deep_scrub_stamp":"2024-09-12T00:39:15.023824+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.023824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:56.671649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.301615+0000","last_change":"2024-09-12T00:39:19.301615+0000","last_active":"2024-09-12T00:39:19.301615+0000","last_peered":"2024-09-12T00:39:19.301615+0000","last_clean":"2024-09-12T00:39:19.301615+0000","last_became_active":"2024-09-12T00:27:17.580400+0000","last_became_peered":"2024-09-12T00:27:17.580400+0000","last_unstale":"2024-09-12T00:39:19.301615+0000","last_undegraded":"2024-09-12T00:39:19.301615+0000","last_fullsized":"2024-09-12T00:39:19.301615+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:19.301514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:19.301514+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.301514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:10.691672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"258'5","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.302196+0000","last_change":"2024-09-12T00:39:15.302196+0000","last_active":"2024-09-12T00:39:15.302196+0000","last_peered":"2024-09-12T00:39:15.302196+0000","last_clean":"2024-09-12T00:39:15.302196+0000","last_became_active":"2024-09-12T00:17:03.223700+0000","last_became_peered":"2024-09-12T00:17:03.223700+0000","last_unstale":"2024-09-12T00:39:15.302196+0000","last_undegraded":"2024-09-12T00:39:15.302196+0000","last_fullsized":"2024-09-12T00:39:15.302196+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'5","last_scrub_stamp":"2024-09-12T00:39:15.302095+0000","last_deep_scrub":"258'5","last_deep_scrub_stamp":"2024-09-12T00:39:15.302095+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.302095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:40.693894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.514252+0000","last_change":"2024-09-12T00:17:00.170090+0000","last_active":"2024-09-12T00:36:19.514252+0000","last_peered":"2024-09-12T00:36:19.514252+0000","last_clean":"2024-09-12T00:36:19.514252+0000","last_became_active":"2024-09-12T00:17:00.169797+0000","last_became_peered":"2024-09-12T00:17:00.169797+0000","last_unstale":"2024-09-12T00:36:19.514252+0000","last_undegraded":"2024-09-12T00:36:19.514252+0000","last_fullsized":"2024-09-12T00:36:19.514252+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'40","reported_seq":152,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:54.001555+0000","last_change":"2024-09-12T00:15:34.422467+0000","last_active":"2024-09-12T00:36:54.001555+0000","last_peered":"2024-09-12T00:36:54.001555+0000","last_clean":"2024-09-12T00:36:54.001555+0000","last_became_active":"2024-09-12T00:15:34.422176+0000","last_became_peered":"2024-09-12T00:15:34.422176+0000","last_unstale":"2024-09-12T00:36:54.001555+0000","last_undegraded":"2024-09-12T00:36:54.001555+0000","last_fullsized":"2024-09-12T00:36:54.001555+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":149,"num_write":70,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.519242+0000","last_change":"2024-09-12T00:27:17.579910+0000","last_active":"2024-09-12T00:36:59.519242+0000","last_peered":"2024-09-12T00:36:59.519242+0000","last_clean":"2024-09-12T00:36:59.519242+0000","last_became_active":"2024-09-12T00:27:17.579646+0000","last_became_peered":"2024-09-12T00:27:17.579646+0000","last_unstale":"2024-09-12T00:36:59.519242+0000","last_undegraded":"2024-09-12T00:36:59.519242+0000","last_fullsized":"2024-09-12T00:36:59.519242+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"261'6","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:04.528413+0000","last_change":"2024-09-12T00:17:03.212032+0000","last_active":"2024-09-12T00:38:04.528413+0000","last_peered":"2024-09-12T00:38:04.528413+0000","last_clean":"2024-09-12T00:38:04.528413+0000","last_became_active":"2024-09-12T00:17:03.211732+0000","last_became_peered":"2024-09-12T00:17:03.211732+0000","last_unstale":"2024-09-12T00:38:04.528413+0000","last_undegraded":"2024-09-12T00:38:04.528413+0000","last_fullsized":"2024-09-12T00:38:04.528413+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:51.849541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"258'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.396472+0000","last_change":"2024-09-12T00:39:13.396472+0000","last_active":"2024-09-12T00:39:13.396472+0000","last_peered":"2024-09-12T00:39:13.396472+0000","last_clean":"2024-09-12T00:39:13.396472+0000","last_became_active":"2024-09-12T00:17:00.175460+0000","last_became_peered":"2024-09-12T00:17:00.175460+0000","last_unstale":"2024-09-12T00:39:13.396472+0000","last_undegraded":"2024-09-12T00:39:13.396472+0000","last_fullsized":"2024-09-12T00:39:13.396472+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T00:39:13.396374+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T00:39:13.396374+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.396374+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:35.156823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'37","reported_seq":133,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:34.397817+0000","last_change":"2024-09-12T00:15:34.424716+0000","last_active":"2024-09-12T00:36:34.397817+0000","last_peered":"2024-09-12T00:36:34.397817+0000","last_clean":"2024-09-12T00:36:34.397817+0000","last_became_active":"2024-09-12T00:15:34.423734+0000","last_became_peered":"2024-09-12T00:15:34.423734+0000","last_unstale":"2024-09-12T00:36:34.397817+0000","last_undegraded":"2024-09-12T00:36:34.397817+0000","last_fullsized":"2024-09-12T00:36:34.397817+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":116,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.518800+0000","last_change":"2024-09-12T00:27:17.574614+0000","last_active":"2024-09-12T00:36:59.518800+0000","last_peered":"2024-09-12T00:36:59.518800+0000","last_clean":"2024-09-12T00:36:59.518800+0000","last_became_active":"2024-09-12T00:27:17.574346+0000","last_became_peered":"2024-09-12T00:27:17.574346+0000","last_unstale":"2024-09-12T00:36:59.518800+0000","last_undegraded":"2024-09-12T00:36:59.518800+0000","last_fullsized":"2024-09-12T00:36:59.518800+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:04.528366+0000","last_change":"2024-09-12T00:17:03.210709+0000","last_active":"2024-09-12T00:38:04.528366+0000","last_peered":"2024-09-12T00:38:04.528366+0000","last_clean":"2024-09-12T00:38:04.528366+0000","last_became_active":"2024-09-12T00:17:03.210439+0000","last_became_peered":"2024-09-12T00:17:03.210439+0000","last_unstale":"2024-09-12T00:38:04.528366+0000","last_undegraded":"2024-09-12T00:38:04.528366+0000","last_fullsized":"2024-09-12T00:38:04.528366+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:13.002169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'2","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:59.527639+0000","last_change":"2024-09-12T00:17:00.179628+0000","last_active":"2024-09-12T00:37:59.527639+0000","last_peered":"2024-09-12T00:37:59.527639+0000","last_clean":"2024-09-12T00:37:59.527639+0000","last_became_active":"2024-09-12T00:17:00.179337+0000","last_became_peered":"2024-09-12T00:17:00.179337+0000","last_unstale":"2024-09-12T00:37:59.527639+0000","last_undegraded":"2024-09-12T00:37:59.527639+0000","last_fullsized":"2024-09-12T00:37:59.527639+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:55.994787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'135","reported_seq":459,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.025901+0000","last_change":"2024-09-12T00:39:14.025901+0000","last_active":"2024-09-12T00:39:14.025901+0000","last_peered":"2024-09-12T00:39:14.025901+0000","last_clean":"2024-09-12T00:39:14.025901+0000","last_became_active":"2024-09-12T00:15:34.421180+0000","last_became_peered":"2024-09-12T00:15:34.421180+0000","last_unstale":"2024-09-12T00:39:14.025901+0000","last_undegraded":"2024-09-12T00:39:14.025901+0000","last_fullsized":"2024-09-12T00:39:14.025901+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'135","last_scrub_stamp":"2024-09-12T00:39:14.025808+0000","last_deep_scrub":"261'135","last_deep_scrub_stamp":"2024-09-12T00:39:14.025808+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.025808+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:28.688390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":617,"num_write":164,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"260'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:37.519416+0000","last_change":"2024-09-12T00:27:17.575634+0000","last_active":"2024-09-12T00:36:37.519416+0000","last_peered":"2024-09-12T00:36:37.519416+0000","last_clean":"2024-09-12T00:36:37.519416+0000","last_became_active":"2024-09-12T00:27:17.575257+0000","last_became_peered":"2024-09-12T00:27:17.575257+0000","last_unstale":"2024-09-12T00:36:37.519416+0000","last_undegraded":"2024-09-12T00:36:37.519416+0000","last_fullsized":"2024-09-12T00:36:37.519416+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'2","reported_seq":31,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:04.406864+0000","last_change":"2024-09-12T00:17:03.222496+0000","last_active":"2024-09-12T00:38:04.406864+0000","last_peered":"2024-09-12T00:38:04.406864+0000","last_clean":"2024-09-12T00:38:04.406864+0000","last_became_active":"2024-09-12T00:17:03.222110+0000","last_became_peered":"2024-09-12T00:17:03.222110+0000","last_unstale":"2024-09-12T00:38:04.406864+0000","last_undegraded":"2024-09-12T00:38:04.406864+0000","last_fullsized":"2024-09-12T00:38:04.406864+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:07.242934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.400803+0000","last_change":"2024-09-12T00:39:18.400803+0000","last_active":"2024-09-12T00:39:18.400803+0000","last_peered":"2024-09-12T00:39:18.400803+0000","last_clean":"2024-09-12T00:39:18.400803+0000","last_became_active":"2024-09-12T00:17:00.174537+0000","last_became_peered":"2024-09-12T00:17:00.174537+0000","last_unstale":"2024-09-12T00:39:18.400803+0000","last_undegraded":"2024-09-12T00:39:18.400803+0000","last_fullsized":"2024-09-12T00:39:18.400803+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:18.400703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:18.400703+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.400703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:29.217889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"258'31","reported_seq":137,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.112159+0000","last_change":"2024-09-12T00:39:15.112159+0000","last_active":"2024-09-12T00:39:15.112159+0000","last_peered":"2024-09-12T00:39:15.112159+0000","last_clean":"2024-09-12T00:39:15.112159+0000","last_became_active":"2024-09-12T00:15:34.427756+0000","last_became_peered":"2024-09-12T00:15:34.427756+0000","last_unstale":"2024-09-12T00:39:15.112159+0000","last_undegraded":"2024-09-12T00:39:15.112159+0000","last_fullsized":"2024-09-12T00:39:15.112159+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'31","last_scrub_stamp":"2024-09-12T00:39:15.112070+0000","last_deep_scrub":"258'31","last_deep_scrub_stamp":"2024-09-12T00:39:15.112070+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.112070+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:09.070217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":137,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:59.518777+0000","last_change":"2024-09-12T00:27:17.577377+0000","last_active":"2024-09-12T00:36:59.518777+0000","last_peered":"2024-09-12T00:36:59.518777+0000","last_clean":"2024-09-12T00:36:59.518777+0000","last_became_active":"2024-09-12T00:27:17.577076+0000","last_became_peered":"2024-09-12T00:27:17.577076+0000","last_unstale":"2024-09-12T00:36:59.518777+0000","last_undegraded":"2024-09-12T00:36:59.518777+0000","last_fullsized":"2024-09-12T00:36:59.518777+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391561+0000","last_change":"2024-09-12T00:17:03.217429+0000","last_active":"2024-09-12T00:35:44.391561+0000","last_peered":"2024-09-12T00:35:44.391561+0000","last_clean":"2024-09-12T00:35:44.391561+0000","last_became_active":"2024-09-12T00:17:03.217101+0000","last_became_peered":"2024-09-12T00:17:03.217101+0000","last_unstale":"2024-09-12T00:35:44.391561+0000","last_undegraded":"2024-09-12T00:35:44.391561+0000","last_fullsized":"2024-09-12T00:35:44.391561+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:37.636780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.378101+0000","last_change":"2024-09-12T00:39:17.378101+0000","last_active":"2024-09-12T00:39:17.378101+0000","last_peered":"2024-09-12T00:39:17.378101+0000","last_clean":"2024-09-12T00:39:17.378101+0000","last_became_active":"2024-09-12T00:17:00.180475+0000","last_became_peered":"2024-09-12T00:17:00.180475+0000","last_unstale":"2024-09-12T00:39:17.378101+0000","last_undegraded":"2024-09-12T00:39:17.378101+0000","last_fullsized":"2024-09-12T00:39:17.378101+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:17.378008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:17.378008+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.378008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:33.410671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'61","reported_seq":216,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.016460+0000","last_change":"2024-09-12T00:39:13.016460+0000","last_active":"2024-09-12T00:39:13.016460+0000","last_peered":"2024-09-12T00:39:13.016460+0000","last_clean":"2024-09-12T00:39:13.016460+0000","last_became_active":"2024-09-12T00:15:34.418831+0000","last_became_peered":"2024-09-12T00:15:34.418831+0000","last_unstale":"2024-09-12T00:39:13.016460+0000","last_undegraded":"2024-09-12T00:39:13.016460+0000","last_fullsized":"2024-09-12T00:39:13.016460+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'61","last_scrub_stamp":"2024-09-12T00:39:13.016345+0000","last_deep_scrub":"261'61","last_deep_scrub_stamp":"2024-09-12T00:39:13.016345+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.016345+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:38.538047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":218,"num_write":105,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.511752+0000","last_change":"2024-09-12T00:27:17.579649+0000","last_active":"2024-09-12T00:35:59.511752+0000","last_peered":"2024-09-12T00:35:59.511752+0000","last_clean":"2024-09-12T00:35:59.511752+0000","last_became_active":"2024-09-12T00:27:17.579263+0000","last_became_peered":"2024-09-12T00:27:17.579263+0000","last_unstale":"2024-09-12T00:35:59.511752+0000","last_undegraded":"2024-09-12T00:35:59.511752+0000","last_fullsized":"2024-09-12T00:35:59.511752+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:10.487761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"258'2","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:24.028543+0000","last_change":"2024-09-12T00:39:24.028543+0000","last_active":"2024-09-12T00:39:24.028543+0000","last_peered":"2024-09-12T00:39:24.028543+0000","last_clean":"2024-09-12T00:39:24.028543+0000","last_became_active":"2024-09-12T00:17:03.211582+0000","last_became_peered":"2024-09-12T00:17:03.211582+0000","last_unstale":"2024-09-12T00:39:24.028543+0000","last_undegraded":"2024-09-12T00:39:24.028543+0000","last_fullsized":"2024-09-12T00:39:24.028543+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-12T00:39:24.028459+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-12T00:39:24.028459+0000","last_clean_scrub_stamp":"2024-09-12T00:39:24.028459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:24.840219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"261'2","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.129345+0000","last_change":"2024-09-12T00:39:18.129345+0000","last_active":"2024-09-12T00:39:18.129345+0000","last_peered":"2024-09-12T00:39:18.129345+0000","last_clean":"2024-09-12T00:39:18.129345+0000","last_became_active":"2024-09-12T00:17:00.182477+0000","last_became_peered":"2024-09-12T00:17:00.182477+0000","last_unstale":"2024-09-12T00:39:18.129345+0000","last_undegraded":"2024-09-12T00:39:18.129345+0000","last_fullsized":"2024-09-12T00:39:18.129345+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:18.129254+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:18.129254+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.129254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:36.933434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"258'27","reported_seq":122,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.977672+0000","last_change":"2024-09-12T00:39:11.977672+0000","last_active":"2024-09-12T00:39:11.977672+0000","last_peered":"2024-09-12T00:39:11.977672+0000","last_clean":"2024-09-12T00:39:11.977672+0000","last_became_active":"2024-09-12T00:15:34.419584+0000","last_became_peered":"2024-09-12T00:15:34.419584+0000","last_unstale":"2024-09-12T00:39:11.977672+0000","last_undegraded":"2024-09-12T00:39:11.977672+0000","last_fullsized":"2024-09-12T00:39:11.977672+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'27","last_scrub_stamp":"2024-09-12T00:39:11.977587+0000","last_deep_scrub":"258'27","last_deep_scrub_stamp":"2024-09-12T00:39:11.977587+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.977587+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:48.748257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.408371+0000","last_change":"2024-09-12T00:39:20.408371+0000","last_active":"2024-09-12T00:39:20.408371+0000","last_peered":"2024-09-12T00:39:20.408371+0000","last_clean":"2024-09-12T00:39:20.408371+0000","last_became_active":"2024-09-12T00:27:17.579859+0000","last_became_peered":"2024-09-12T00:27:17.579859+0000","last_unstale":"2024-09-12T00:39:20.408371+0000","last_undegraded":"2024-09-12T00:39:20.408371+0000","last_fullsized":"2024-09-12T00:39:20.408371+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:20.408277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:20.408277+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.408277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:02.264015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'3","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.035247+0000","last_change":"2024-09-12T00:39:23.035247+0000","last_active":"2024-09-12T00:39:23.035247+0000","last_peered":"2024-09-12T00:39:23.035247+0000","last_clean":"2024-09-12T00:39:23.035247+0000","last_became_active":"2024-09-12T00:17:03.216437+0000","last_became_peered":"2024-09-12T00:17:03.216437+0000","last_unstale":"2024-09-12T00:39:23.035247+0000","last_undegraded":"2024-09-12T00:39:23.035247+0000","last_fullsized":"2024-09-12T00:39:23.035247+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:23.035158+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:23.035158+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.035158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:11.091155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'2","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.955899+0000","last_change":"2024-09-12T00:39:19.955899+0000","last_active":"2024-09-12T00:39:19.955899+0000","last_peered":"2024-09-12T00:39:19.955899+0000","last_clean":"2024-09-12T00:39:19.955899+0000","last_became_active":"2024-09-12T00:17:00.178905+0000","last_became_peered":"2024-09-12T00:17:00.178905+0000","last_unstale":"2024-09-12T00:39:19.955899+0000","last_undegraded":"2024-09-12T00:39:19.955899+0000","last_fullsized":"2024-09-12T00:39:19.955899+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-12T00:39:19.955799+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-12T00:39:19.955799+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.955799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:41.399375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'17","reported_seq":81,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.392457+0000","last_change":"2024-09-12T00:15:34.419487+0000","last_active":"2024-09-12T00:35:49.392457+0000","last_peered":"2024-09-12T00:35:49.392457+0000","last_clean":"2024-09-12T00:35:49.392457+0000","last_became_active":"2024-09-12T00:15:34.418859+0000","last_became_peered":"2024-09-12T00:15:34.418859+0000","last_unstale":"2024-09-12T00:35:49.392457+0000","last_undegraded":"2024-09-12T00:35:49.392457+0000","last_fullsized":"2024-09-12T00:35:49.392457+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:58.036831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.393701+0000","last_change":"2024-09-12T00:27:17.579640+0000","last_active":"2024-09-12T00:35:59.393701+0000","last_peered":"2024-09-12T00:35:59.393701+0000","last_clean":"2024-09-12T00:35:59.393701+0000","last_became_active":"2024-09-12T00:27:17.577728+0000","last_became_peered":"2024-09-12T00:27:17.577728+0000","last_unstale":"2024-09-12T00:35:59.393701+0000","last_undegraded":"2024-09-12T00:35:59.393701+0000","last_fullsized":"2024-09-12T00:35:59.393701+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:51.317752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"261'13","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.732492+0000","last_change":"2024-09-12T00:17:03.215255+0000","last_active":"2024-09-12T00:38:37.732492+0000","last_peered":"2024-09-12T00:38:37.732492+0000","last_clean":"2024-09-12T00:38:37.732492+0000","last_became_active":"2024-09-12T00:17:03.214958+0000","last_became_peered":"2024-09-12T00:17:03.214958+0000","last_unstale":"2024-09-12T00:38:37.732492+0000","last_undegraded":"2024-09-12T00:38:37.732492+0000","last_fullsized":"2024-09-12T00:38:37.732492+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:24.067787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":22528,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"261'9","reported_seq":59,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.048410+0000","last_change":"2024-09-12T00:39:19.048410+0000","last_active":"2024-09-12T00:39:19.048410+0000","last_peered":"2024-09-12T00:39:19.048410+0000","last_clean":"2024-09-12T00:39:19.048410+0000","last_became_active":"2024-09-12T00:17:00.184703+0000","last_became_peered":"2024-09-12T00:17:00.184703+0000","last_unstale":"2024-09-12T00:39:19.048410+0000","last_undegraded":"2024-09-12T00:39:19.048410+0000","last_fullsized":"2024-09-12T00:39:19.048410+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'9","last_scrub_stamp":"2024-09-12T00:39:19.048321+0000","last_deep_scrub":"261'9","last_deep_scrub_stamp":"2024-09-12T00:39:19.048321+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.048321+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.887918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":24576,"num_write":9,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'12","reported_seq":82,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.417002+0000","last_change":"2024-09-12T00:39:11.417002+0000","last_active":"2024-09-12T00:39:11.417002+0000","last_peered":"2024-09-12T00:39:11.417002+0000","last_clean":"2024-09-12T00:39:11.417002+0000","last_became_active":"2024-09-12T00:15:34.424129+0000","last_became_peered":"2024-09-12T00:15:34.424129+0000","last_unstale":"2024-09-12T00:39:11.417002+0000","last_undegraded":"2024-09-12T00:39:11.417002+0000","last_fullsized":"2024-09-12T00:39:11.417002+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'12","last_scrub_stamp":"2024-09-12T00:39:11.416889+0000","last_deep_scrub":"261'12","last_deep_scrub_stamp":"2024-09-12T00:39:11.416889+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.416889+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:57.677881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.441202+0000","last_change":"2024-09-12T00:39:21.441202+0000","last_active":"2024-09-12T00:39:21.441202+0000","last_peered":"2024-09-12T00:39:21.441202+0000","last_clean":"2024-09-12T00:39:21.441202+0000","last_became_active":"2024-09-12T00:27:17.570973+0000","last_became_peered":"2024-09-12T00:27:17.570973+0000","last_unstale":"2024-09-12T00:39:21.441202+0000","last_undegraded":"2024-09-12T00:39:21.441202+0000","last_fullsized":"2024-09-12T00:39:21.441202+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:21.441114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:21.441114+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.441114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:21.220765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"258'5","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:04.503609+0000","last_change":"2024-09-12T00:17:03.221266+0000","last_active":"2024-09-12T00:35:04.503609+0000","last_peered":"2024-09-12T00:35:04.503609+0000","last_clean":"2024-09-12T00:35:04.503609+0000","last_became_active":"2024-09-12T00:17:03.220961+0000","last_became_peered":"2024-09-12T00:17:03.220961+0000","last_unstale":"2024-09-12T00:35:04.503609+0000","last_undegraded":"2024-09-12T00:35:04.503609+0000","last_fullsized":"2024-09-12T00:35:04.503609+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:28.129316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.031501+0000","last_change":"2024-09-12T00:39:20.031501+0000","last_active":"2024-09-12T00:39:20.031501+0000","last_peered":"2024-09-12T00:39:20.031501+0000","last_clean":"2024-09-12T00:39:20.031501+0000","last_became_active":"2024-09-12T00:17:00.178572+0000","last_became_peered":"2024-09-12T00:17:00.178572+0000","last_unstale":"2024-09-12T00:39:20.031501+0000","last_undegraded":"2024-09-12T00:39:20.031501+0000","last_fullsized":"2024-09-12T00:39:20.031501+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:20.031417+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:20.031417+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.031417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:17.968948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'26","reported_seq":119,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.939225+0000","last_change":"2024-09-12T00:39:14.939225+0000","last_active":"2024-09-12T00:39:14.939225+0000","last_peered":"2024-09-12T00:39:14.939225+0000","last_clean":"2024-09-12T00:39:14.939225+0000","last_became_active":"2024-09-12T00:15:34.421019+0000","last_became_peered":"2024-09-12T00:15:34.421019+0000","last_unstale":"2024-09-12T00:39:14.939225+0000","last_undegraded":"2024-09-12T00:39:14.939225+0000","last_fullsized":"2024-09-12T00:39:14.939225+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'26","last_scrub_stamp":"2024-09-12T00:39:14.939128+0000","last_deep_scrub":"261'26","last_deep_scrub_stamp":"2024-09-12T00:39:14.939128+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.939128+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:34.447686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":93,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.514214+0000","last_change":"2024-09-12T00:27:17.581884+0000","last_active":"2024-09-12T00:36:19.514214+0000","last_peered":"2024-09-12T00:36:19.514214+0000","last_clean":"2024-09-12T00:36:19.514214+0000","last_became_active":"2024-09-12T00:27:17.579926+0000","last_became_peered":"2024-09-12T00:27:17.579926+0000","last_unstale":"2024-09-12T00:36:19.514214+0000","last_undegraded":"2024-09-12T00:36:19.514214+0000","last_fullsized":"2024-09-12T00:36:19.514214+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:28.218032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'3","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.941017+0000","last_change":"2024-09-12T00:17:03.219491+0000","last_active":"2024-09-12T00:38:36.941017+0000","last_peered":"2024-09-12T00:38:36.941017+0000","last_clean":"2024-09-12T00:38:36.941017+0000","last_became_active":"2024-09-12T00:17:03.219156+0000","last_became_peered":"2024-09-12T00:17:03.219156+0000","last_unstale":"2024-09-12T00:38:36.941017+0000","last_undegraded":"2024-09-12T00:38:36.941017+0000","last_fullsized":"2024-09-12T00:38:36.941017+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"261'2","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.044818+0000","last_change":"2024-09-12T00:39:17.044818+0000","last_active":"2024-09-12T00:39:17.044818+0000","last_peered":"2024-09-12T00:39:17.044818+0000","last_clean":"2024-09-12T00:39:17.044818+0000","last_became_active":"2024-09-12T00:17:00.182424+0000","last_became_peered":"2024-09-12T00:17:00.182424+0000","last_unstale":"2024-09-12T00:39:17.044818+0000","last_undegraded":"2024-09-12T00:39:17.044818+0000","last_fullsized":"2024-09-12T00:39:17.044818+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:17.044731+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:17.044731+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.044731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:47.954689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"258'17","reported_seq":97,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.986370+0000","last_change":"2024-09-12T00:39:13.986370+0000","last_active":"2024-09-12T00:39:13.986370+0000","last_peered":"2024-09-12T00:39:13.986370+0000","last_clean":"2024-09-12T00:39:13.986370+0000","last_became_active":"2024-09-12T00:15:34.423037+0000","last_became_peered":"2024-09-12T00:15:34.423037+0000","last_unstale":"2024-09-12T00:39:13.986370+0000","last_undegraded":"2024-09-12T00:39:13.986370+0000","last_fullsized":"2024-09-12T00:39:13.986370+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'17","last_scrub_stamp":"2024-09-12T00:39:13.986286+0000","last_deep_scrub":"258'17","last_deep_scrub_stamp":"2024-09-12T00:39:13.986286+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.986286+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:20.113567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":64,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.135757+0000","last_change":"2024-09-12T00:39:23.135757+0000","last_active":"2024-09-12T00:39:23.135757+0000","last_peered":"2024-09-12T00:39:23.135757+0000","last_clean":"2024-09-12T00:39:23.135757+0000","last_became_active":"2024-09-12T00:27:17.583096+0000","last_became_peered":"2024-09-12T00:27:17.583096+0000","last_unstale":"2024-09-12T00:39:23.135757+0000","last_undegraded":"2024-09-12T00:39:23.135757+0000","last_fullsized":"2024-09-12T00:39:23.135757+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:23.135671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:23.135671+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.135671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:18.515232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.448506+0000","last_change":"2024-09-12T00:17:03.214309+0000","last_active":"2024-09-12T00:38:37.448506+0000","last_peered":"2024-09-12T00:38:37.448506+0000","last_clean":"2024-09-12T00:38:37.448506+0000","last_became_active":"2024-09-12T00:17:03.214023+0000","last_became_peered":"2024-09-12T00:17:03.214023+0000","last_unstale":"2024-09-12T00:38:37.448506+0000","last_undegraded":"2024-09-12T00:38:37.448506+0000","last_fullsized":"2024-09-12T00:38:37.448506+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.849557+0000","last_change":"2024-09-12T00:39:23.849557+0000","last_active":"2024-09-12T00:39:23.849557+0000","last_peered":"2024-09-12T00:39:23.849557+0000","last_clean":"2024-09-12T00:39:23.849557+0000","last_became_active":"2024-09-12T00:17:00.178465+0000","last_became_peered":"2024-09-12T00:17:00.178465+0000","last_unstale":"2024-09-12T00:39:23.849557+0000","last_undegraded":"2024-09-12T00:39:23.849557+0000","last_fullsized":"2024-09-12T00:39:23.849557+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:23.849455+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:23.849455+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.849455+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:05.484492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'34","reported_seq":145,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.070090+0000","last_change":"2024-09-12T00:39:13.070090+0000","last_active":"2024-09-12T00:39:13.070090+0000","last_peered":"2024-09-12T00:39:13.070090+0000","last_clean":"2024-09-12T00:39:13.070090+0000","last_became_active":"2024-09-12T00:15:34.425540+0000","last_became_peered":"2024-09-12T00:15:34.425540+0000","last_unstale":"2024-09-12T00:39:13.070090+0000","last_undegraded":"2024-09-12T00:39:13.070090+0000","last_fullsized":"2024-09-12T00:39:13.070090+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'34","last_scrub_stamp":"2024-09-12T00:39:13.069969+0000","last_deep_scrub":"261'34","last_deep_scrub_stamp":"2024-09-12T00:39:13.069969+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.069969+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:02.805302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":136,"num_write":51,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.295921+0000","last_change":"2024-09-12T00:39:21.295921+0000","last_active":"2024-09-12T00:39:21.295921+0000","last_peered":"2024-09-12T00:39:21.295921+0000","last_clean":"2024-09-12T00:39:21.295921+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:39:21.295921+0000","last_undegraded":"2024-09-12T00:39:21.295921+0000","last_fullsized":"2024-09-12T00:39:21.295921+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:21.295829+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:21.295829+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.295829+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:44.991704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.917618+0000","last_change":"2024-09-12T00:39:22.917618+0000","last_active":"2024-09-12T00:39:22.917618+0000","last_peered":"2024-09-12T00:39:22.917618+0000","last_clean":"2024-09-12T00:39:22.917618+0000","last_became_active":"2024-09-12T00:17:03.212150+0000","last_became_peered":"2024-09-12T00:17:03.212150+0000","last_unstale":"2024-09-12T00:39:22.917618+0000","last_undegraded":"2024-09-12T00:39:22.917618+0000","last_fullsized":"2024-09-12T00:39:22.917618+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:22.917533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:22.917533+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.917533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:43.890615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"261'8","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.069399+0000","last_change":"2024-09-12T00:39:18.069399+0000","last_active":"2024-09-12T00:39:18.069399+0000","last_peered":"2024-09-12T00:39:18.069399+0000","last_clean":"2024-09-12T00:39:18.069399+0000","last_became_active":"2024-09-12T00:17:00.180944+0000","last_became_peered":"2024-09-12T00:17:00.180944+0000","last_unstale":"2024-09-12T00:39:18.069399+0000","last_undegraded":"2024-09-12T00:39:18.069399+0000","last_fullsized":"2024-09-12T00:39:18.069399+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T00:39:18.069314+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T00:39:18.069314+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.069314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:21.041688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6171,"num_write":13,"num_write_kb":11291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'34","reported_seq":135,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.876845+0000","last_change":"2024-09-12T00:39:22.876785+0000","last_active":"2024-09-12T00:39:22.876845+0000","last_peered":"2024-09-12T00:39:22.876845+0000","last_clean":"2024-09-12T00:39:22.876845+0000","last_became_active":"2024-09-12T00:15:34.418474+0000","last_became_peered":"2024-09-12T00:15:34.418474+0000","last_unstale":"2024-09-12T00:39:22.876845+0000","last_undegraded":"2024-09-12T00:39:22.876845+0000","last_fullsized":"2024-09-12T00:39:22.876845+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'34","last_scrub_stamp":"2024-09-12T00:39:22.876679+0000","last_deep_scrub":"261'34","last_deep_scrub_stamp":"2024-09-12T00:39:22.876679+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.876679+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:43.170752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:19.513761+0000","last_change":"2024-09-12T00:27:17.581423+0000","last_active":"2024-09-12T00:36:19.513761+0000","last_peered":"2024-09-12T00:36:19.513761+0000","last_clean":"2024-09-12T00:36:19.513761+0000","last_became_active":"2024-09-12T00:27:17.581149+0000","last_became_peered":"2024-09-12T00:27:17.581149+0000","last_unstale":"2024-09-12T00:36:19.513761+0000","last_undegraded":"2024-09-12T00:36:19.513761+0000","last_fullsized":"2024-09-12T00:36:19.513761+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:04.939255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.300369+0000","last_change":"2024-09-12T00:39:14.300369+0000","last_active":"2024-09-12T00:39:14.300369+0000","last_peered":"2024-09-12T00:39:14.300369+0000","last_clean":"2024-09-12T00:39:14.300369+0000","last_became_active":"2024-09-12T00:17:03.220965+0000","last_became_peered":"2024-09-12T00:17:03.220965+0000","last_unstale":"2024-09-12T00:39:14.300369+0000","last_undegraded":"2024-09-12T00:39:14.300369+0000","last_fullsized":"2024-09-12T00:39:14.300369+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:14.300284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:14.300284+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.300284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:29.449310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'12","reported_seq":67,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:14.402675+0000","last_change":"2024-09-12T00:17:00.185880+0000","last_active":"2024-09-12T00:37:14.402675+0000","last_peered":"2024-09-12T00:37:14.402675+0000","last_clean":"2024-09-12T00:37:14.402675+0000","last_became_active":"2024-09-12T00:17:00.185600+0000","last_became_peered":"2024-09-12T00:17:00.185600+0000","last_unstale":"2024-09-12T00:37:14.402675+0000","last_undegraded":"2024-09-12T00:37:14.402675+0000","last_fullsized":"2024-09-12T00:37:14.402675+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:51.338622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":41662,"num_write":17,"num_write_kb":10938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'54","reported_seq":195,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.206476+0000","last_change":"2024-09-12T00:39:10.206403+0000","last_active":"2024-09-12T00:39:10.206476+0000","last_peered":"2024-09-12T00:39:10.206476+0000","last_clean":"2024-09-12T00:39:10.206476+0000","last_became_active":"2024-09-12T00:15:34.417393+0000","last_became_peered":"2024-09-12T00:15:34.417393+0000","last_unstale":"2024-09-12T00:39:10.206476+0000","last_undegraded":"2024-09-12T00:39:10.206476+0000","last_fullsized":"2024-09-12T00:39:10.206476+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'54","last_scrub_stamp":"2024-09-12T00:39:10.206325+0000","last_deep_scrub":"261'54","last_deep_scrub_stamp":"2024-09-12T00:39:10.206325+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.206325+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:46.829987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":189,"num_write":107,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.344516+0000","last_change":"2024-09-12T00:39:18.344516+0000","last_active":"2024-09-12T00:39:18.344516+0000","last_peered":"2024-09-12T00:39:18.344516+0000","last_clean":"2024-09-12T00:39:18.344516+0000","last_became_active":"2024-09-12T00:27:17.578983+0000","last_became_peered":"2024-09-12T00:27:17.578983+0000","last_unstale":"2024-09-12T00:39:18.344516+0000","last_undegraded":"2024-09-12T00:39:18.344516+0000","last_fullsized":"2024-09-12T00:39:18.344516+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:18.344432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:18.344432+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.344432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:54.440611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"258'10","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510247+0000","last_change":"2024-09-12T00:17:03.210161+0000","last_active":"2024-09-12T00:35:49.510247+0000","last_peered":"2024-09-12T00:35:49.510247+0000","last_clean":"2024-09-12T00:35:49.510247+0000","last_became_active":"2024-09-12T00:17:03.209874+0000","last_became_peered":"2024-09-12T00:17:03.209874+0000","last_unstale":"2024-09-12T00:35:49.510247+0000","last_undegraded":"2024-09-12T00:35:49.510247+0000","last_fullsized":"2024-09-12T00:35:49.510247+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:07.562732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":41988,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"258'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391613+0000","last_change":"2024-09-12T00:17:00.186026+0000","last_active":"2024-09-12T00:35:44.391613+0000","last_peered":"2024-09-12T00:35:44.391613+0000","last_clean":"2024-09-12T00:35:44.391613+0000","last_became_active":"2024-09-12T00:17:00.185688+0000","last_became_peered":"2024-09-12T00:17:00.185688+0000","last_unstale":"2024-09-12T00:35:44.391613+0000","last_undegraded":"2024-09-12T00:35:44.391613+0000","last_fullsized":"2024-09-12T00:35:44.391613+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:40.682390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":165,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.651781+0000","last_change":"2024-09-12T00:39:20.651781+0000","last_active":"2024-09-12T00:39:20.651781+0000","last_peered":"2024-09-12T00:39:20.651781+0000","last_clean":"2024-09-12T00:39:20.651781+0000","last_became_active":"2024-09-12T00:15:34.411977+0000","last_became_peered":"2024-09-12T00:15:34.411977+0000","last_unstale":"2024-09-12T00:39:20.651781+0000","last_undegraded":"2024-09-12T00:39:20.651781+0000","last_fullsized":"2024-09-12T00:39:20.651781+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'42","last_scrub_stamp":"2024-09-12T00:39:20.651681+0000","last_deep_scrub":"261'42","last_deep_scrub_stamp":"2024-09-12T00:39:20.651681+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.651681+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:11.401803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":161,"num_write":73,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.315691+0000","last_change":"2024-09-12T00:39:17.315691+0000","last_active":"2024-09-12T00:39:17.315691+0000","last_peered":"2024-09-12T00:39:17.315691+0000","last_clean":"2024-09-12T00:39:17.315691+0000","last_became_active":"2024-09-12T00:27:17.578763+0000","last_became_peered":"2024-09-12T00:27:17.578763+0000","last_unstale":"2024-09-12T00:39:17.315691+0000","last_undegraded":"2024-09-12T00:39:17.315691+0000","last_fullsized":"2024-09-12T00:39:17.315691+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:17.315599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:17.315599+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.315599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:52.904813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.510203+0000","last_change":"2024-09-12T00:17:03.216611+0000","last_active":"2024-09-12T00:35:49.510203+0000","last_peered":"2024-09-12T00:35:49.510203+0000","last_clean":"2024-09-12T00:35:49.510203+0000","last_became_active":"2024-09-12T00:17:03.216349+0000","last_became_peered":"2024-09-12T00:17:03.216349+0000","last_unstale":"2024-09-12T00:35:49.510203+0000","last_undegraded":"2024-09-12T00:35:49.510203+0000","last_fullsized":"2024-09-12T00:35:49.510203+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:48.582027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'3","reported_seq":40,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:52.530059+0000","last_change":"2024-09-12T00:17:00.183051+0000","last_active":"2024-09-12T00:37:52.530059+0000","last_peered":"2024-09-12T00:37:52.530059+0000","last_clean":"2024-09-12T00:37:52.530059+0000","last_became_active":"2024-09-12T00:17:00.182780+0000","last_became_peered":"2024-09-12T00:17:00.182780+0000","last_unstale":"2024-09-12T00:37:52.530059+0000","last_undegraded":"2024-09-12T00:37:52.530059+0000","last_fullsized":"2024-09-12T00:37:52.530059+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:39.837277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'38","reported_seq":142,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:14.402749+0000","last_change":"2024-09-12T00:15:34.410030+0000","last_active":"2024-09-12T00:37:14.402749+0000","last_peered":"2024-09-12T00:37:14.402749+0000","last_clean":"2024-09-12T00:37:14.402749+0000","last_became_active":"2024-09-12T00:15:34.409622+0000","last_became_peered":"2024-09-12T00:15:34.409622+0000","last_unstale":"2024-09-12T00:37:14.402749+0000","last_undegraded":"2024-09-12T00:37:14.402749+0000","last_fullsized":"2024-09-12T00:37:14.402749+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":134,"num_write":65,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:19.522035+0000","last_change":"2024-09-12T00:27:17.582282+0000","last_active":"2024-09-12T00:37:19.522035+0000","last_peered":"2024-09-12T00:37:19.522035+0000","last_clean":"2024-09-12T00:37:19.522035+0000","last_became_active":"2024-09-12T00:27:17.581993+0000","last_became_peered":"2024-09-12T00:27:17.581993+0000","last_unstale":"2024-09-12T00:37:19.522035+0000","last_undegraded":"2024-09-12T00:37:19.522035+0000","last_fullsized":"2024-09-12T00:37:19.522035+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.267690+0000","last_change":"2024-09-12T00:39:13.267690+0000","last_active":"2024-09-12T00:39:13.267690+0000","last_peered":"2024-09-12T00:39:13.267690+0000","last_clean":"2024-09-12T00:39:13.267690+0000","last_became_active":"2024-09-12T00:17:03.219888+0000","last_became_peered":"2024-09-12T00:17:03.219888+0000","last_unstale":"2024-09-12T00:39:13.267690+0000","last_undegraded":"2024-09-12T00:39:13.267690+0000","last_fullsized":"2024-09-12T00:39:13.267690+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T00:39:13.267608+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T00:39:13.267608+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.267608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:16.563967+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"258'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.100296+0000","last_change":"2024-09-12T00:39:19.100296+0000","last_active":"2024-09-12T00:39:19.100296+0000","last_peered":"2024-09-12T00:39:19.100296+0000","last_clean":"2024-09-12T00:39:19.100296+0000","last_became_active":"2024-09-12T00:17:00.169299+0000","last_became_peered":"2024-09-12T00:17:00.169299+0000","last_unstale":"2024-09-12T00:39:19.100296+0000","last_undegraded":"2024-09-12T00:39:19.100296+0000","last_fullsized":"2024-09-12T00:39:19.100296+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T00:39:19.100206+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T00:39:19.100206+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.100206+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:28.788232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'48","reported_seq":184,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.108535+0000","last_change":"2024-09-12T00:39:14.108535+0000","last_active":"2024-09-12T00:39:14.108535+0000","last_peered":"2024-09-12T00:39:14.108535+0000","last_clean":"2024-09-12T00:39:14.108535+0000","last_became_active":"2024-09-12T00:15:34.427735+0000","last_became_peered":"2024-09-12T00:15:34.427735+0000","last_unstale":"2024-09-12T00:39:14.108535+0000","last_undegraded":"2024-09-12T00:39:14.108535+0000","last_fullsized":"2024-09-12T00:39:14.108535+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'48","last_scrub_stamp":"2024-09-12T00:39:14.108432+0000","last_deep_scrub":"261'48","last_deep_scrub_stamp":"2024-09-12T00:39:14.108432+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.108432+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:05.307096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":182,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390825+0000","last_change":"2024-09-12T00:27:17.573147+0000","last_active":"2024-09-12T00:35:39.390825+0000","last_peered":"2024-09-12T00:35:39.390825+0000","last_clean":"2024-09-12T00:35:39.390825+0000","last_became_active":"2024-09-12T00:27:17.572817+0000","last_became_peered":"2024-09-12T00:27:17.572817+0000","last_unstale":"2024-09-12T00:35:39.390825+0000","last_undegraded":"2024-09-12T00:35:39.390825+0000","last_fullsized":"2024-09-12T00:35:39.390825+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:43.980881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"261'6","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.447617+0000","last_change":"2024-09-12T00:17:03.220324+0000","last_active":"2024-09-12T00:38:37.447617+0000","last_peered":"2024-09-12T00:38:37.447617+0000","last_clean":"2024-09-12T00:38:37.447617+0000","last_became_active":"2024-09-12T00:17:03.219129+0000","last_became_peered":"2024-09-12T00:17:03.219129+0000","last_unstale":"2024-09-12T00:38:37.447617+0000","last_undegraded":"2024-09-12T00:38:37.447617+0000","last_fullsized":"2024-09-12T00:38:37.447617+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'6","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.088297+0000","last_change":"2024-09-12T00:17:00.182941+0000","last_active":"2024-09-12T00:38:37.088297+0000","last_peered":"2024-09-12T00:38:37.088297+0000","last_clean":"2024-09-12T00:38:37.088297+0000","last_became_active":"2024-09-12T00:17:00.182301+0000","last_became_peered":"2024-09-12T00:17:00.182301+0000","last_unstale":"2024-09-12T00:38:37.088297+0000","last_undegraded":"2024-09-12T00:38:37.088297+0000","last_fullsized":"2024-09-12T00:38:37.088297+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:08.258223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'23","reported_seq":110,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.943059+0000","last_change":"2024-09-12T00:39:10.943059+0000","last_active":"2024-09-12T00:39:10.943059+0000","last_peered":"2024-09-12T00:39:10.943059+0000","last_clean":"2024-09-12T00:39:10.943059+0000","last_became_active":"2024-09-12T00:15:34.428056+0000","last_became_peered":"2024-09-12T00:15:34.428056+0000","last_unstale":"2024-09-12T00:39:10.943059+0000","last_undegraded":"2024-09-12T00:39:10.943059+0000","last_fullsized":"2024-09-12T00:39:10.943059+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'23","last_scrub_stamp":"2024-09-12T00:39:10.942970+0000","last_deep_scrub":"261'23","last_deep_scrub_stamp":"2024-09-12T00:39:10.942970+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.942970+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:15.519299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"260'1","reported_seq":19,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.511476+0000","last_change":"2024-09-12T00:27:17.575634+0000","last_active":"2024-09-12T00:35:59.511476+0000","last_peered":"2024-09-12T00:35:59.511476+0000","last_clean":"2024-09-12T00:35:59.511476+0000","last_became_active":"2024-09-12T00:27:17.575332+0000","last_became_peered":"2024-09-12T00:27:17.575332+0000","last_unstale":"2024-09-12T00:35:59.511476+0000","last_undegraded":"2024-09-12T00:35:59.511476+0000","last_fullsized":"2024-09-12T00:35:59.511476+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:10.996773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"258'6","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:47.512261+0000","last_change":"2024-09-12T00:17:03.206898+0000","last_active":"2024-09-12T00:35:47.512261+0000","last_peered":"2024-09-12T00:35:47.512261+0000","last_clean":"2024-09-12T00:35:47.512261+0000","last_became_active":"2024-09-12T00:17:03.206580+0000","last_became_peered":"2024-09-12T00:17:03.206580+0000","last_unstale":"2024-09-12T00:35:47.512261+0000","last_undegraded":"2024-09-12T00:35:47.512261+0000","last_fullsized":"2024-09-12T00:35:47.512261+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:19.086717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.139871+0000","last_change":"2024-09-12T00:39:17.139871+0000","last_active":"2024-09-12T00:39:17.139871+0000","last_peered":"2024-09-12T00:39:17.139871+0000","last_clean":"2024-09-12T00:39:17.139871+0000","last_became_active":"2024-09-12T00:17:00.169464+0000","last_became_peered":"2024-09-12T00:17:00.169464+0000","last_unstale":"2024-09-12T00:39:17.139871+0000","last_undegraded":"2024-09-12T00:39:17.139871+0000","last_fullsized":"2024-09-12T00:39:17.139871+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:17.139788+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:17.139788+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.139788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:49.246363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'22","reported_seq":105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.048186+0000","last_change":"2024-09-12T00:39:12.048186+0000","last_active":"2024-09-12T00:39:12.048186+0000","last_peered":"2024-09-12T00:39:12.048186+0000","last_clean":"2024-09-12T00:39:12.048186+0000","last_became_active":"2024-09-12T00:15:34.427661+0000","last_became_peered":"2024-09-12T00:15:34.427661+0000","last_unstale":"2024-09-12T00:39:12.048186+0000","last_undegraded":"2024-09-12T00:39:12.048186+0000","last_fullsized":"2024-09-12T00:39:12.048186+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'22","last_scrub_stamp":"2024-09-12T00:39:12.048102+0000","last_deep_scrub":"261'22","last_deep_scrub_stamp":"2024-09-12T00:39:12.048102+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.048102+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:33.795502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":70,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:57.514020+0000","last_change":"2024-09-12T00:27:17.576241+0000","last_active":"2024-09-12T00:35:57.514020+0000","last_peered":"2024-09-12T00:35:57.514020+0000","last_clean":"2024-09-12T00:35:57.514020+0000","last_became_active":"2024-09-12T00:27:17.575941+0000","last_became_peered":"2024-09-12T00:27:17.575941+0000","last_unstale":"2024-09-12T00:35:57.514020+0000","last_undegraded":"2024-09-12T00:35:57.514020+0000","last_fullsized":"2024-09-12T00:35:57.514020+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:41.216300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'2","reported_seq":33,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.021272+0000","last_change":"2024-09-12T00:17:03.218016+0000","last_active":"2024-09-12T00:38:36.021272+0000","last_peered":"2024-09-12T00:38:36.021272+0000","last_clean":"2024-09-12T00:38:36.021272+0000","last_became_active":"2024-09-12T00:17:03.217678+0000","last_became_peered":"2024-09-12T00:17:03.217678+0000","last_unstale":"2024-09-12T00:38:36.021272+0000","last_undegraded":"2024-09-12T00:38:36.021272+0000","last_fullsized":"2024-09-12T00:38:36.021272+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'5","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:49.406773+0000","last_change":"2024-09-12T00:17:00.186355+0000","last_active":"2024-09-12T00:37:49.406773+0000","last_peered":"2024-09-12T00:37:49.406773+0000","last_clean":"2024-09-12T00:37:49.406773+0000","last_became_active":"2024-09-12T00:17:00.185637+0000","last_became_peered":"2024-09-12T00:17:00.185637+0000","last_unstale":"2024-09-12T00:37:49.406773+0000","last_undegraded":"2024-09-12T00:37:49.406773+0000","last_fullsized":"2024-09-12T00:37:49.406773+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:36.584176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'27","reported_seq":114,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396562+0000","last_change":"2024-09-12T00:15:34.408975+0000","last_active":"2024-09-12T00:36:24.396562+0000","last_peered":"2024-09-12T00:36:24.396562+0000","last_clean":"2024-09-12T00:36:24.396562+0000","last_became_active":"2024-09-12T00:15:34.408612+0000","last_became_peered":"2024-09-12T00:15:34.408612+0000","last_unstale":"2024-09-12T00:36:24.396562+0000","last_undegraded":"2024-09-12T00:36:24.396562+0000","last_fullsized":"2024-09-12T00:36:24.396562+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:00.278541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":97,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.508580+0000","last_change":"2024-09-12T00:27:17.579650+0000","last_active":"2024-09-12T00:35:39.508580+0000","last_peered":"2024-09-12T00:35:39.508580+0000","last_clean":"2024-09-12T00:35:39.508580+0000","last_became_active":"2024-09-12T00:27:17.579332+0000","last_became_peered":"2024-09-12T00:27:17.579332+0000","last_unstale":"2024-09-12T00:35:39.508580+0000","last_undegraded":"2024-09-12T00:35:39.508580+0000","last_fullsized":"2024-09-12T00:35:39.508580+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:02.812642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":29,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:49.627538+0000","last_change":"2024-09-12T00:17:03.203730+0000","last_active":"2024-09-12T00:35:49.627538+0000","last_peered":"2024-09-12T00:35:49.627538+0000","last_clean":"2024-09-12T00:35:49.627538+0000","last_became_active":"2024-09-12T00:17:03.203401+0000","last_became_peered":"2024-09-12T00:17:03.203401+0000","last_unstale":"2024-09-12T00:35:49.627538+0000","last_undegraded":"2024-09-12T00:35:49.627538+0000","last_fullsized":"2024-09-12T00:35:49.627538+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:07.999569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.976116+0000","last_change":"2024-09-12T00:39:20.976116+0000","last_active":"2024-09-12T00:39:20.976116+0000","last_peered":"2024-09-12T00:39:20.976116+0000","last_clean":"2024-09-12T00:39:20.976116+0000","last_became_active":"2024-09-12T00:17:00.181095+0000","last_became_peered":"2024-09-12T00:17:00.181095+0000","last_unstale":"2024-09-12T00:39:20.976116+0000","last_undegraded":"2024-09-12T00:39:20.976116+0000","last_fullsized":"2024-09-12T00:39:20.976116+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:20.976002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:20.976002+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.976002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:41.988221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'19","reported_seq":93,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396515+0000","last_change":"2024-09-12T00:15:34.421629+0000","last_active":"2024-09-12T00:36:24.396515+0000","last_peered":"2024-09-12T00:36:24.396515+0000","last_clean":"2024-09-12T00:36:24.396515+0000","last_became_active":"2024-09-12T00:15:34.420583+0000","last_became_peered":"2024-09-12T00:15:34.420583+0000","last_unstale":"2024-09-12T00:36:24.396515+0000","last_undegraded":"2024-09-12T00:36:24.396515+0000","last_fullsized":"2024-09-12T00:36:24.396515+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.394911+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.394911+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:27:19.714778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391630+0000","last_change":"2024-09-12T00:27:17.580218+0000","last_active":"2024-09-12T00:35:44.391630+0000","last_peered":"2024-09-12T00:35:44.391630+0000","last_clean":"2024-09-12T00:35:44.391630+0000","last_became_active":"2024-09-12T00:27:17.579957+0000","last_became_peered":"2024-09-12T00:27:17.579957+0000","last_unstale":"2024-09-12T00:35:44.391630+0000","last_undegraded":"2024-09-12T00:35:44.391630+0000","last_fullsized":"2024-09-12T00:35:44.391630+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:50.892944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.087682+0000","last_change":"2024-09-12T00:39:21.087682+0000","last_active":"2024-09-12T00:39:21.087682+0000","last_peered":"2024-09-12T00:39:21.087682+0000","last_clean":"2024-09-12T00:39:21.087682+0000","last_became_active":"2024-09-12T00:17:03.222212+0000","last_became_peered":"2024-09-12T00:17:03.222212+0000","last_unstale":"2024-09-12T00:39:21.087682+0000","last_undegraded":"2024-09-12T00:39:21.087682+0000","last_fullsized":"2024-09-12T00:39:21.087682+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:21.087582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:21.087582+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.087582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:14.366113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"258'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.363628+0000","last_change":"2024-09-12T00:39:14.363628+0000","last_active":"2024-09-12T00:39:14.363628+0000","last_peered":"2024-09-12T00:39:14.363628+0000","last_clean":"2024-09-12T00:39:14.363628+0000","last_became_active":"2024-09-12T00:17:00.184654+0000","last_became_peered":"2024-09-12T00:17:00.184654+0000","last_unstale":"2024-09-12T00:39:14.363628+0000","last_undegraded":"2024-09-12T00:39:14.363628+0000","last_fullsized":"2024-09-12T00:39:14.363628+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T00:39:14.363541+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T00:39:14.363541+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.363541+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:52.973589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'33","reported_seq":138,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.095923+0000","last_change":"2024-09-12T00:39:09.095923+0000","last_active":"2024-09-12T00:39:09.095923+0000","last_peered":"2024-09-12T00:39:09.095923+0000","last_clean":"2024-09-12T00:39:09.095923+0000","last_became_active":"2024-09-12T00:15:34.425489+0000","last_became_peered":"2024-09-12T00:15:34.425489+0000","last_unstale":"2024-09-12T00:39:09.095923+0000","last_undegraded":"2024-09-12T00:39:09.095923+0000","last_fullsized":"2024-09-12T00:39:09.095923+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'33","last_scrub_stamp":"2024-09-12T00:39:09.095823+0000","last_deep_scrub":"261'33","last_deep_scrub_stamp":"2024-09-12T00:39:09.095823+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.095823+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:00.657525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":114,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'331","reported_seq":982,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.232372+0000","last_change":"2024-09-12T00:38:52.232372+0000","last_active":"2024-09-12T00:38:52.232372+0000","last_peered":"2024-09-12T00:38:52.232372+0000","last_clean":"2024-09-12T00:38:52.232372+0000","last_became_active":"2024-09-12T00:01:57.152039+0000","last_became_peered":"2024-09-12T00:01:57.152039+0000","last_unstale":"2024-09-12T00:38:52.232372+0000","last_undegraded":"2024-09-12T00:38:52.232372+0000","last_fullsized":"2024-09-12T00:38:52.232372+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'331","last_scrub_stamp":"2024-09-12T00:38:52.232200+0000","last_deep_scrub":"261'331","last_deep_scrub_stamp":"2024-09-12T00:38:52.232200+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.232200+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:40.965953+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":62278,"num_write":1122,"num_write_kb":40244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'78","reported_seq":667,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.421103+0000","last_change":"2024-09-12T00:38:58.421103+0000","last_active":"2024-09-12T00:38:58.421103+0000","last_peered":"2024-09-12T00:38:58.421103+0000","last_clean":"2024-09-12T00:38:58.421103+0000","last_became_active":"2024-09-12T00:01:59.156166+0000","last_became_peered":"2024-09-12T00:01:59.156166+0000","last_unstale":"2024-09-12T00:38:58.421103+0000","last_undegraded":"2024-09-12T00:38:58.421103+0000","last_fullsized":"2024-09-12T00:38:58.421103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'78","last_scrub_stamp":"2024-09-12T00:38:58.421001+0000","last_deep_scrub":"261'78","last_deep_scrub_stamp":"2024-09-12T00:38:58.421001+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.421001+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:08.530267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":327,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'318","reported_seq":960,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.805750+0000","last_change":"2024-09-12T00:38:57.805750+0000","last_active":"2024-09-12T00:38:57.805750+0000","last_peered":"2024-09-12T00:38:57.805750+0000","last_clean":"2024-09-12T00:38:57.805750+0000","last_became_active":"2024-09-12T00:01:57.147519+0000","last_became_peered":"2024-09-12T00:01:57.147519+0000","last_unstale":"2024-09-12T00:38:57.805750+0000","last_undegraded":"2024-09-12T00:38:57.805750+0000","last_fullsized":"2024-09-12T00:38:57.805750+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'318","last_scrub_stamp":"2024-09-12T00:38:57.805642+0000","last_deep_scrub":"261'318","last_deep_scrub_stamp":"2024-09-12T00:38:57.805642+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.805642+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:55.449630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":64019,"num_write":1006,"num_write_kb":35322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'285","reported_seq":950,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.290734+0000","last_change":"2024-09-12T00:39:11.290734+0000","last_active":"2024-09-12T00:39:11.290734+0000","last_peered":"2024-09-12T00:39:11.290734+0000","last_clean":"2024-09-12T00:39:11.290734+0000","last_became_active":"2024-09-12T00:01:59.140661+0000","last_became_peered":"2024-09-12T00:01:59.140661+0000","last_unstale":"2024-09-12T00:39:11.290734+0000","last_undegraded":"2024-09-12T00:39:11.290734+0000","last_fullsized":"2024-09-12T00:39:11.290734+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'285","last_scrub_stamp":"2024-09-12T00:39:11.290598+0000","last_deep_scrub":"261'285","last_deep_scrub_stamp":"2024-09-12T00:39:11.290598+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.290598+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:27.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1344,"num_read_kb":1119,"num_write":493,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'353","reported_seq":985,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.803618+0000","last_change":"2024-09-12T00:38:55.803618+0000","last_active":"2024-09-12T00:38:55.803618+0000","last_peered":"2024-09-12T00:38:55.803618+0000","last_clean":"2024-09-12T00:38:55.803618+0000","last_became_active":"2024-09-12T00:01:57.140885+0000","last_became_peered":"2024-09-12T00:01:57.140885+0000","last_unstale":"2024-09-12T00:38:55.803618+0000","last_undegraded":"2024-09-12T00:38:55.803618+0000","last_fullsized":"2024-09-12T00:38:55.803618+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T00:38:55.803496+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T00:38:55.803496+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.803496+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:39.294089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":495,"num_read_kb":8973,"num_write":1119,"num_write_kb":33019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'357","reported_seq":1005,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.218036+0000","last_change":"2024-09-12T00:39:06.218036+0000","last_active":"2024-09-12T00:39:06.218036+0000","last_peered":"2024-09-12T00:39:06.218036+0000","last_clean":"2024-09-12T00:39:06.218036+0000","last_became_active":"2024-09-12T00:01:59.144660+0000","last_became_peered":"2024-09-12T00:01:59.144660+0000","last_unstale":"2024-09-12T00:39:06.218036+0000","last_undegraded":"2024-09-12T00:39:06.218036+0000","last_fullsized":"2024-09-12T00:39:06.218036+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'357","last_scrub_stamp":"2024-09-12T00:39:06.217962+0000","last_deep_scrub":"261'357","last_deep_scrub_stamp":"2024-09-12T00:39:06.217962+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.217962+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:12.487208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1585,"num_read_kb":1295,"num_write":589,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'362","reported_seq":996,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.044672+0000","last_change":"2024-09-12T00:38:48.044672+0000","last_active":"2024-09-12T00:38:48.044672+0000","last_peered":"2024-09-12T00:38:48.044672+0000","last_clean":"2024-09-12T00:38:48.044672+0000","last_became_active":"2024-09-12T00:01:57.154749+0000","last_became_peered":"2024-09-12T00:01:57.154749+0000","last_unstale":"2024-09-12T00:38:48.044672+0000","last_undegraded":"2024-09-12T00:38:48.044672+0000","last_fullsized":"2024-09-12T00:38:48.044672+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'362","last_scrub_stamp":"2024-09-12T00:38:48.044510+0000","last_deep_scrub":"261'362","last_deep_scrub_stamp":"2024-09-12T00:38:48.044510+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.044510+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:47.176239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":533,"num_read_kb":65054,"num_write":1136,"num_write_kb":38777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'303","reported_seq":933,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.535670+0000","last_change":"2024-09-12T00:39:00.535670+0000","last_active":"2024-09-12T00:39:00.535670+0000","last_peered":"2024-09-12T00:39:00.535670+0000","last_clean":"2024-09-12T00:39:00.535670+0000","last_became_active":"2024-09-12T00:01:59.146925+0000","last_became_peered":"2024-09-12T00:01:59.146925+0000","last_unstale":"2024-09-12T00:39:00.535670+0000","last_undegraded":"2024-09-12T00:39:00.535670+0000","last_fullsized":"2024-09-12T00:39:00.535670+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'303","last_scrub_stamp":"2024-09-12T00:39:00.535589+0000","last_deep_scrub":"261'303","last_deep_scrub_stamp":"2024-09-12T00:39:00.535589+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.535589+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:53.374654+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1201,"num_read_kb":972,"num_write":449,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'361","reported_seq":1105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.196352+0000","last_change":"2024-09-12T00:38:51.196352+0000","last_active":"2024-09-12T00:38:51.196352+0000","last_peered":"2024-09-12T00:38:51.196352+0000","last_clean":"2024-09-12T00:38:51.196352+0000","last_became_active":"2024-09-12T00:01:57.151028+0000","last_became_peered":"2024-09-12T00:01:57.151028+0000","last_unstale":"2024-09-12T00:38:51.196352+0000","last_undegraded":"2024-09-12T00:38:51.196352+0000","last_fullsized":"2024-09-12T00:38:51.196352+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'361","last_scrub_stamp":"2024-09-12T00:38:51.196229+0000","last_deep_scrub":"261'361","last_deep_scrub_stamp":"2024-09-12T00:38:51.196229+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.196229+0000","objects_scrubbed":10,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:50.130757+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2337543,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":829,"num_read_kb":49842,"num_write":1146,"num_write_kb":22305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'253","reported_seq":917,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.297540+0000","last_change":"2024-09-12T00:38:57.297540+0000","last_active":"2024-09-12T00:38:57.297540+0000","last_peered":"2024-09-12T00:38:57.297540+0000","last_clean":"2024-09-12T00:38:57.297540+0000","last_became_active":"2024-09-12T00:01:59.149728+0000","last_became_peered":"2024-09-12T00:01:59.149728+0000","last_unstale":"2024-09-12T00:38:57.297540+0000","last_undegraded":"2024-09-12T00:38:57.297540+0000","last_fullsized":"2024-09-12T00:38:57.297540+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'253","last_scrub_stamp":"2024-09-12T00:38:57.297444+0000","last_deep_scrub":"261'253","last_deep_scrub_stamp":"2024-09-12T00:38:57.297444+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.297444+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:04.300911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1186,"num_read_kb":981,"num_write":436,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'351","reported_seq":1101,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.044743+0000","last_change":"2024-09-12T00:38:47.044743+0000","last_active":"2024-09-12T00:38:47.044743+0000","last_peered":"2024-09-12T00:38:47.044743+0000","last_clean":"2024-09-12T00:38:47.044743+0000","last_became_active":"2024-09-12T00:01:57.152791+0000","last_became_peered":"2024-09-12T00:01:57.152791+0000","last_unstale":"2024-09-12T00:38:47.044743+0000","last_undegraded":"2024-09-12T00:38:47.044743+0000","last_fullsized":"2024-09-12T00:38:47.044743+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'351","last_scrub_stamp":"2024-09-12T00:38:47.044625+0000","last_deep_scrub":"261'351","last_deep_scrub_stamp":"2024-09-12T00:38:47.044625+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.044625+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:39.302097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133707,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":815,"num_read_kb":39083,"num_write":1189,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'276","reported_seq":872,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.325938+0000","last_change":"2024-09-12T00:38:58.325938+0000","last_active":"2024-09-12T00:38:58.325938+0000","last_peered":"2024-09-12T00:38:58.325938+0000","last_clean":"2024-09-12T00:38:58.325938+0000","last_became_active":"2024-09-12T00:01:59.151168+0000","last_became_peered":"2024-09-12T00:01:59.151168+0000","last_unstale":"2024-09-12T00:38:58.325938+0000","last_undegraded":"2024-09-12T00:38:58.325938+0000","last_fullsized":"2024-09-12T00:38:58.325938+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'276","last_scrub_stamp":"2024-09-12T00:38:58.325822+0000","last_deep_scrub":"261'276","last_deep_scrub_stamp":"2024-09-12T00:38:58.325822+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.325822+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:47.632687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1184,"num_read_kb":963,"num_write":440,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'354","reported_seq":1024,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.192429+0000","last_change":"2024-09-12T00:38:50.192429+0000","last_active":"2024-09-12T00:38:50.192429+0000","last_peered":"2024-09-12T00:38:50.192429+0000","last_clean":"2024-09-12T00:38:50.192429+0000","last_became_active":"2024-09-12T00:01:57.146592+0000","last_became_peered":"2024-09-12T00:01:57.146592+0000","last_unstale":"2024-09-12T00:38:50.192429+0000","last_undegraded":"2024-09-12T00:38:50.192429+0000","last_fullsized":"2024-09-12T00:38:50.192429+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-12T00:38:50.192316+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-12T00:38:50.192316+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.192316+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:49.228766+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":36666,"num_write":1128,"num_write_kb":21178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'169","reported_seq":765,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.194024+0000","last_change":"2024-09-12T00:39:01.194024+0000","last_active":"2024-09-12T00:39:01.194024+0000","last_peered":"2024-09-12T00:39:01.194024+0000","last_clean":"2024-09-12T00:39:01.194024+0000","last_became_active":"2024-09-12T00:01:59.153277+0000","last_became_peered":"2024-09-12T00:01:59.153277+0000","last_unstale":"2024-09-12T00:39:01.194024+0000","last_undegraded":"2024-09-12T00:39:01.194024+0000","last_fullsized":"2024-09-12T00:39:01.194024+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'169","last_scrub_stamp":"2024-09-12T00:39:01.193932+0000","last_deep_scrub":"261'169","last_deep_scrub_stamp":"2024-09-12T00:39:01.193932+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.193932+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:25.959222+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":798,"num_read_kb":679,"num_write":291,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'362","reported_seq":983,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.753683+0000","last_change":"2024-09-12T00:38:53.753683+0000","last_active":"2024-09-12T00:38:53.753683+0000","last_peered":"2024-09-12T00:38:53.753683+0000","last_clean":"2024-09-12T00:38:53.753683+0000","last_became_active":"2024-09-12T00:01:57.151506+0000","last_became_peered":"2024-09-12T00:01:57.151506+0000","last_unstale":"2024-09-12T00:38:53.753683+0000","last_undegraded":"2024-09-12T00:38:53.753683+0000","last_fullsized":"2024-09-12T00:38:53.753683+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'362","last_scrub_stamp":"2024-09-12T00:38:53.753574+0000","last_deep_scrub":"261'362","last_deep_scrub_stamp":"2024-09-12T00:38:53.753574+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.753574+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:42.419681+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549580,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":524,"num_read_kb":7555,"num_write":1156,"num_write_kb":27882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'125","reported_seq":719,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.796381+0000","last_change":"2024-09-12T00:39:05.796381+0000","last_active":"2024-09-12T00:39:05.796381+0000","last_peered":"2024-09-12T00:39:05.796381+0000","last_clean":"2024-09-12T00:39:05.796381+0000","last_became_active":"2024-09-12T00:01:59.148098+0000","last_became_peered":"2024-09-12T00:01:59.148098+0000","last_unstale":"2024-09-12T00:39:05.796381+0000","last_undegraded":"2024-09-12T00:39:05.796381+0000","last_fullsized":"2024-09-12T00:39:05.796381+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'125","last_scrub_stamp":"2024-09-12T00:39:05.796284+0000","last_deep_scrub":"261'125","last_deep_scrub_stamp":"2024-09-12T00:39:05.796284+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.796284+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:09.512775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":439,"num_write":182,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'114","reported_seq":682,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.176239+0000","last_change":"2024-09-12T00:39:02.176174+0000","last_active":"2024-09-12T00:39:02.176239+0000","last_peered":"2024-09-12T00:39:02.176239+0000","last_clean":"2024-09-12T00:39:02.176239+0000","last_became_active":"2024-09-12T00:01:59.148017+0000","last_became_peered":"2024-09-12T00:01:59.148017+0000","last_unstale":"2024-09-12T00:39:02.176239+0000","last_undegraded":"2024-09-12T00:39:02.176239+0000","last_fullsized":"2024-09-12T00:39:02.176239+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'114","last_scrub_stamp":"2024-09-12T00:39:02.176085+0000","last_deep_scrub":"261'114","last_deep_scrub_stamp":"2024-09-12T00:39:02.176085+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.176085+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:35.656310+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":485,"num_read_kb":395,"num_write":184,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'329","reported_seq":1020,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.439185+0000","last_change":"2024-09-12T00:38:55.439185+0000","last_active":"2024-09-12T00:38:55.439185+0000","last_peered":"2024-09-12T00:38:55.439185+0000","last_clean":"2024-09-12T00:38:55.439185+0000","last_became_active":"2024-09-12T00:01:57.151116+0000","last_became_peered":"2024-09-12T00:01:57.151116+0000","last_unstale":"2024-09-12T00:38:55.439185+0000","last_undegraded":"2024-09-12T00:38:55.439185+0000","last_fullsized":"2024-09-12T00:38:55.439185+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-12T00:38:55.439011+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-12T00:38:55.439011+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.439011+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:22.277921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":563,"num_read_kb":78307,"num_write":1164,"num_write_kb":30055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'230","reported_seq":820,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.256265+0000","last_change":"2024-09-12T00:38:56.256197+0000","last_active":"2024-09-12T00:38:56.256265+0000","last_peered":"2024-09-12T00:38:56.256265+0000","last_clean":"2024-09-12T00:38:56.256265+0000","last_became_active":"2024-09-12T00:01:59.152131+0000","last_became_peered":"2024-09-12T00:01:59.152131+0000","last_unstale":"2024-09-12T00:38:56.256265+0000","last_undegraded":"2024-09-12T00:38:56.256265+0000","last_fullsized":"2024-09-12T00:38:56.256265+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'230","last_scrub_stamp":"2024-09-12T00:38:56.256111+0000","last_deep_scrub":"261'230","last_deep_scrub_stamp":"2024-09-12T00:38:56.256111+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.256111+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:30.034301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":807,"num_write":370,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'333","reported_seq":972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.162288+0000","last_change":"2024-09-12T00:38:49.162288+0000","last_active":"2024-09-12T00:38:49.162288+0000","last_peered":"2024-09-12T00:38:49.162288+0000","last_clean":"2024-09-12T00:38:49.162288+0000","last_became_active":"2024-09-12T00:01:57.143834+0000","last_became_peered":"2024-09-12T00:01:57.143834+0000","last_unstale":"2024-09-12T00:38:49.162288+0000","last_undegraded":"2024-09-12T00:38:49.162288+0000","last_fullsized":"2024-09-12T00:38:49.162288+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'333","last_scrub_stamp":"2024-09-12T00:38:49.162133+0000","last_deep_scrub":"261'333","last_deep_scrub_stamp":"2024-09-12T00:38:49.162133+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.162133+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:54.670647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":522,"num_read_kb":1599,"num_write":1184,"num_write_kb":15734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'430","reported_seq":1143,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.414160+0000","last_change":"2024-09-12T00:38:51.414160+0000","last_active":"2024-09-12T00:38:51.414160+0000","last_peered":"2024-09-12T00:38:51.414160+0000","last_clean":"2024-09-12T00:38:51.414160+0000","last_became_active":"2024-09-12T00:01:59.153559+0000","last_became_peered":"2024-09-12T00:01:59.153559+0000","last_unstale":"2024-09-12T00:38:51.414160+0000","last_undegraded":"2024-09-12T00:38:51.414160+0000","last_fullsized":"2024-09-12T00:38:51.414160+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'430","last_scrub_stamp":"2024-09-12T00:38:51.414063+0000","last_deep_scrub":"261'430","last_deep_scrub_stamp":"2024-09-12T00:38:51.414063+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.414063+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:14.420551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2074,"num_read_kb":1775,"num_write":771,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'321","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.159055+0000","last_change":"2024-09-12T00:38:48.159055+0000","last_active":"2024-09-12T00:38:48.159055+0000","last_peered":"2024-09-12T00:38:48.159055+0000","last_clean":"2024-09-12T00:38:48.159055+0000","last_became_active":"2024-09-12T00:01:57.150789+0000","last_became_peered":"2024-09-12T00:01:57.150789+0000","last_unstale":"2024-09-12T00:38:48.159055+0000","last_undegraded":"2024-09-12T00:38:48.159055+0000","last_fullsized":"2024-09-12T00:38:48.159055+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'321","last_scrub_stamp":"2024-09-12T00:38:48.158943+0000","last_deep_scrub":"261'321","last_deep_scrub_stamp":"2024-09-12T00:38:48.158943+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.158943+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:48.677325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162197,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":13162,"num_write":967,"num_write_kb":19470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'149","reported_seq":780,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.946690+0000","last_change":"2024-09-12T00:38:57.946690+0000","last_active":"2024-09-12T00:38:57.946690+0000","last_peered":"2024-09-12T00:38:57.946690+0000","last_clean":"2024-09-12T00:38:57.946690+0000","last_became_active":"2024-09-12T00:01:59.149195+0000","last_became_peered":"2024-09-12T00:01:59.149195+0000","last_unstale":"2024-09-12T00:38:57.946690+0000","last_undegraded":"2024-09-12T00:38:57.946690+0000","last_fullsized":"2024-09-12T00:38:57.946690+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'149","last_scrub_stamp":"2024-09-12T00:38:57.946609+0000","last_deep_scrub":"261'149","last_deep_scrub_stamp":"2024-09-12T00:38:57.946609+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.946609+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:33.117967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":604,"num_write":216,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'359","reported_seq":1014,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.205052+0000","last_change":"2024-09-12T00:38:47.205052+0000","last_active":"2024-09-12T00:38:47.205052+0000","last_peered":"2024-09-12T00:38:47.205052+0000","last_clean":"2024-09-12T00:38:47.205052+0000","last_became_active":"2024-09-12T00:01:57.157877+0000","last_became_peered":"2024-09-12T00:01:57.157877+0000","last_unstale":"2024-09-12T00:38:47.205052+0000","last_undegraded":"2024-09-12T00:38:47.205052+0000","last_fullsized":"2024-09-12T00:38:47.205052+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'359","last_scrub_stamp":"2024-09-12T00:38:47.204901+0000","last_deep_scrub":"261'359","last_deep_scrub_stamp":"2024-09-12T00:38:47.204901+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.204901+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:27.995396+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7687320,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":26582,"num_write":1109,"num_write_kb":46689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'164","reported_seq":763,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.796833+0000","last_change":"2024-09-12T00:39:04.796833+0000","last_active":"2024-09-12T00:39:04.796833+0000","last_peered":"2024-09-12T00:39:04.796833+0000","last_clean":"2024-09-12T00:39:04.796833+0000","last_became_active":"2024-09-12T00:01:59.159215+0000","last_became_peered":"2024-09-12T00:01:59.159215+0000","last_unstale":"2024-09-12T00:39:04.796833+0000","last_undegraded":"2024-09-12T00:39:04.796833+0000","last_fullsized":"2024-09-12T00:39:04.796833+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'164","last_scrub_stamp":"2024-09-12T00:39:04.796746+0000","last_deep_scrub":"261'164","last_deep_scrub_stamp":"2024-09-12T00:39:04.796746+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.796746+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:07.277612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":584,"num_write":229,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'277","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.027690+0000","last_change":"2024-09-12T00:38:51.027690+0000","last_active":"2024-09-12T00:38:51.027690+0000","last_peered":"2024-09-12T00:38:51.027690+0000","last_clean":"2024-09-12T00:38:51.027690+0000","last_became_active":"2024-09-12T00:02:32.844466+0000","last_became_peered":"2024-09-12T00:02:32.844466+0000","last_unstale":"2024-09-12T00:38:51.027690+0000","last_undegraded":"2024-09-12T00:38:51.027690+0000","last_fullsized":"2024-09-12T00:38:51.027690+0000","mapping_epoch":37,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'277","last_scrub_stamp":"2024-09-12T00:38:51.027531+0000","last_deep_scrub":"261'277","last_deep_scrub_stamp":"2024-09-12T00:38:51.027531+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.027531+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:53.754319+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291469,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":38682,"num_write":1020,"num_write_kb":28786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'136","reported_seq":732,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.417987+0000","last_change":"2024-09-12T00:38:53.417987+0000","last_active":"2024-09-12T00:38:53.417987+0000","last_peered":"2024-09-12T00:38:53.417987+0000","last_clean":"2024-09-12T00:38:53.417987+0000","last_became_active":"2024-09-12T00:01:59.156058+0000","last_became_peered":"2024-09-12T00:01:59.156058+0000","last_unstale":"2024-09-12T00:38:53.417987+0000","last_undegraded":"2024-09-12T00:38:53.417987+0000","last_fullsized":"2024-09-12T00:38:53.417987+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'136","last_scrub_stamp":"2024-09-12T00:38:53.417890+0000","last_deep_scrub":"261'136","last_deep_scrub_stamp":"2024-09-12T00:38:53.417890+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.417890+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:53.404919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":582,"num_read_kb":485,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'395","reported_seq":1019,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.055140+0000","last_change":"2024-09-12T00:38:50.055055+0000","last_active":"2024-09-12T00:38:50.055140+0000","last_peered":"2024-09-12T00:38:50.055140+0000","last_clean":"2024-09-12T00:38:50.055140+0000","last_became_active":"2024-09-12T00:01:57.136872+0000","last_became_peered":"2024-09-12T00:01:57.136872+0000","last_unstale":"2024-09-12T00:38:50.055140+0000","last_undegraded":"2024-09-12T00:38:50.055140+0000","last_fullsized":"2024-09-12T00:38:50.055140+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'395","last_scrub_stamp":"2024-09-12T00:38:50.054891+0000","last_deep_scrub":"261'395","last_deep_scrub_stamp":"2024-09-12T00:38:50.054891+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.054891+0000","objects_scrubbed":9,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:04.646670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133748,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":28039,"num_write":1285,"num_write_kb":53988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'149","reported_seq":652,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.231078+0000","last_change":"2024-09-12T00:39:09.231078+0000","last_active":"2024-09-12T00:39:09.231078+0000","last_peered":"2024-09-12T00:39:09.231078+0000","last_clean":"2024-09-12T00:39:09.231078+0000","last_became_active":"2024-09-12T00:02:07.159308+0000","last_became_peered":"2024-09-12T00:02:07.159308+0000","last_unstale":"2024-09-12T00:39:09.231078+0000","last_undegraded":"2024-09-12T00:39:09.231078+0000","last_fullsized":"2024-09-12T00:39:09.231078+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'149","last_scrub_stamp":"2024-09-12T00:39:09.230977+0000","last_deep_scrub":"261'149","last_deep_scrub_stamp":"2024-09-12T00:39:09.230977+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.230977+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:34.505126+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'123","reported_seq":716,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.958244+0000","last_change":"2024-09-12T00:38:54.958150+0000","last_active":"2024-09-12T00:38:54.958244+0000","last_peered":"2024-09-12T00:38:54.958244+0000","last_clean":"2024-09-12T00:38:54.958244+0000","last_became_active":"2024-09-12T00:01:59.151773+0000","last_became_peered":"2024-09-12T00:01:59.151773+0000","last_unstale":"2024-09-12T00:38:54.958244+0000","last_undegraded":"2024-09-12T00:38:54.958244+0000","last_fullsized":"2024-09-12T00:38:54.958244+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'123","last_scrub_stamp":"2024-09-12T00:38:54.958046+0000","last_deep_scrub":"261'123","last_deep_scrub_stamp":"2024-09-12T00:38:54.958046+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.958046+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:49.574148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":478,"num_write":204,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'341","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.231600+0000","last_change":"2024-09-12T00:38:52.231474+0000","last_active":"2024-09-12T00:38:52.231600+0000","last_peered":"2024-09-12T00:38:52.231600+0000","last_clean":"2024-09-12T00:38:52.231600+0000","last_became_active":"2024-09-12T00:01:57.165987+0000","last_became_peered":"2024-09-12T00:01:57.165987+0000","last_unstale":"2024-09-12T00:38:52.231600+0000","last_undegraded":"2024-09-12T00:38:52.231600+0000","last_fullsized":"2024-09-12T00:38:52.231600+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'341","last_scrub_stamp":"2024-09-12T00:38:52.231282+0000","last_deep_scrub":"261'341","last_deep_scrub_stamp":"2024-09-12T00:38:52.231282+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.231282+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:26.787977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":604,"num_read_kb":32539,"num_write":978,"num_write_kb":21474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.160571+0000","last_change":"2024-09-12T00:39:19.160571+0000","last_active":"2024-09-12T00:39:19.160571+0000","last_peered":"2024-09-12T00:39:19.160571+0000","last_clean":"2024-09-12T00:39:19.160571+0000","last_became_active":"2024-09-12T00:02:01.154464+0000","last_became_peered":"2024-09-12T00:02:01.154464+0000","last_unstale":"2024-09-12T00:39:19.160571+0000","last_undegraded":"2024-09-12T00:39:19.160571+0000","last_fullsized":"2024-09-12T00:39:19.160571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:19.160468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:19.160468+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.160468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:19.341255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'366","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.737006+0000","last_change":"2024-09-12T00:39:10.737006+0000","last_active":"2024-09-12T00:39:10.737006+0000","last_peered":"2024-09-12T00:39:10.737006+0000","last_clean":"2024-09-12T00:39:10.737006+0000","last_became_active":"2024-09-12T00:02:03.156175+0000","last_became_peered":"2024-09-12T00:02:03.156175+0000","last_unstale":"2024-09-12T00:39:10.737006+0000","last_undegraded":"2024-09-12T00:39:10.737006+0000","last_fullsized":"2024-09-12T00:39:10.737006+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'366","last_scrub_stamp":"2024-09-12T00:39:10.736881+0000","last_deep_scrub":"261'366","last_deep_scrub_stamp":"2024-09-12T00:39:10.736881+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.736881+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:27.441999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51076,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":584,"num_read_kb":1265,"num_write":472,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.440175+0000","last_change":"2024-09-12T00:39:07.440175+0000","last_active":"2024-09-12T00:39:07.440175+0000","last_peered":"2024-09-12T00:39:07.440175+0000","last_clean":"2024-09-12T00:39:07.440175+0000","last_became_active":"2024-09-12T00:02:05.165424+0000","last_became_peered":"2024-09-12T00:02:05.165424+0000","last_unstale":"2024-09-12T00:39:07.440175+0000","last_undegraded":"2024-09-12T00:39:07.440175+0000","last_fullsized":"2024-09-12T00:39:07.440175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:07.440077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:07.440077+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.440077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:31.618520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'131","reported_seq":689,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.476249+0000","last_change":"2024-09-12T00:39:09.476249+0000","last_active":"2024-09-12T00:39:09.476249+0000","last_peered":"2024-09-12T00:39:09.476249+0000","last_clean":"2024-09-12T00:39:09.476249+0000","last_became_active":"2024-09-12T00:02:07.174795+0000","last_became_peered":"2024-09-12T00:02:07.174795+0000","last_unstale":"2024-09-12T00:39:09.476249+0000","last_undegraded":"2024-09-12T00:39:09.476249+0000","last_fullsized":"2024-09-12T00:39:09.476249+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'131","last_scrub_stamp":"2024-09-12T00:39:09.476131+0000","last_deep_scrub":"261'131","last_deep_scrub_stamp":"2024-09-12T00:39:09.476131+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.476131+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:58.746588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":239,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'76","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.248559+0000","last_change":"2024-09-12T00:39:10.248559+0000","last_active":"2024-09-12T00:39:10.248559+0000","last_peered":"2024-09-12T00:39:10.248559+0000","last_clean":"2024-09-12T00:39:10.248559+0000","last_became_active":"2024-09-12T00:01:59.145411+0000","last_became_peered":"2024-09-12T00:01:59.145411+0000","last_unstale":"2024-09-12T00:39:10.248559+0000","last_undegraded":"2024-09-12T00:39:10.248559+0000","last_fullsized":"2024-09-12T00:39:10.248559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'76","last_scrub_stamp":"2024-09-12T00:39:10.248448+0000","last_deep_scrub":"261'76","last_deep_scrub_stamp":"2024-09-12T00:39:10.248448+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.248448+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:06.953323+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":104,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'371","reported_seq":1024,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.109970+0000","last_change":"2024-09-12T00:38:46.109874+0000","last_active":"2024-09-12T00:38:46.109970+0000","last_peered":"2024-09-12T00:38:46.109970+0000","last_clean":"2024-09-12T00:38:46.109970+0000","last_became_active":"2024-09-12T00:01:57.146952+0000","last_became_peered":"2024-09-12T00:01:57.146952+0000","last_unstale":"2024-09-12T00:38:46.109970+0000","last_undegraded":"2024-09-12T00:38:46.109970+0000","last_fullsized":"2024-09-12T00:38:46.109970+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T00:38:46.109709+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T00:38:46.109709+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.109709+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:43.843194+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":558,"num_read_kb":41499,"num_write":1262,"num_write_kb":32474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.584991+0000","last_change":"2024-09-12T00:39:02.584991+0000","last_active":"2024-09-12T00:39:02.584991+0000","last_peered":"2024-09-12T00:39:02.584991+0000","last_clean":"2024-09-12T00:39:02.584991+0000","last_became_active":"2024-09-12T00:02:01.155948+0000","last_became_peered":"2024-09-12T00:02:01.155948+0000","last_unstale":"2024-09-12T00:39:02.584991+0000","last_undegraded":"2024-09-12T00:39:02.584991+0000","last_fullsized":"2024-09-12T00:39:02.584991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:02.584900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:02.584900+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.584900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:43.353221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'85","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.430510+0000","last_change":"2024-09-12T00:39:03.430510+0000","last_active":"2024-09-12T00:39:03.430510+0000","last_peered":"2024-09-12T00:39:03.430510+0000","last_clean":"2024-09-12T00:39:03.430510+0000","last_became_active":"2024-09-12T00:02:03.152708+0000","last_became_peered":"2024-09-12T00:02:03.152708+0000","last_unstale":"2024-09-12T00:39:03.430510+0000","last_undegraded":"2024-09-12T00:39:03.430510+0000","last_fullsized":"2024-09-12T00:39:03.430510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'85","last_scrub_stamp":"2024-09-12T00:39:03.430417+0000","last_deep_scrub":"261'85","last_deep_scrub_stamp":"2024-09-12T00:39:03.430417+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.430417+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:01.332863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":85,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.446125+0000","last_change":"2024-09-12T00:39:06.446125+0000","last_active":"2024-09-12T00:39:06.446125+0000","last_peered":"2024-09-12T00:39:06.446125+0000","last_clean":"2024-09-12T00:39:06.446125+0000","last_became_active":"2024-09-12T00:02:05.162755+0000","last_became_peered":"2024-09-12T00:02:05.162755+0000","last_unstale":"2024-09-12T00:39:06.446125+0000","last_undegraded":"2024-09-12T00:39:06.446125+0000","last_fullsized":"2024-09-12T00:39:06.446125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:06.446044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:06.446044+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.446044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:19.043077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'138","reported_seq":630,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.028646+0000","last_change":"2024-09-12T00:39:10.028646+0000","last_active":"2024-09-12T00:39:10.028646+0000","last_peered":"2024-09-12T00:39:10.028646+0000","last_clean":"2024-09-12T00:39:10.028646+0000","last_became_active":"2024-09-12T00:02:07.167851+0000","last_became_peered":"2024-09-12T00:02:07.167851+0000","last_unstale":"2024-09-12T00:39:10.028646+0000","last_undegraded":"2024-09-12T00:39:10.028646+0000","last_fullsized":"2024-09-12T00:39:10.028646+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'138","last_scrub_stamp":"2024-09-12T00:39:10.028536+0000","last_deep_scrub":"261'138","last_deep_scrub_stamp":"2024-09-12T00:39:10.028536+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.028536+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:48.170223+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":137,"num_write":333,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'4129","reported_seq":4735,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.880211+0000","last_change":"2024-09-12T00:39:01.880211+0000","last_active":"2024-09-12T00:39:01.880211+0000","last_peered":"2024-09-12T00:39:01.880211+0000","last_clean":"2024-09-12T00:39:01.880211+0000","last_became_active":"2024-09-12T00:01:59.151026+0000","last_became_peered":"2024-09-12T00:01:59.151026+0000","last_unstale":"2024-09-12T00:39:01.880211+0000","last_undegraded":"2024-09-12T00:39:01.880211+0000","last_fullsized":"2024-09-12T00:39:01.880211+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4129","last_scrub_stamp":"2024-09-12T00:39:01.880122+0000","last_deep_scrub":"261'4129","last_deep_scrub_stamp":"2024-09-12T00:39:01.880122+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.880122+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":3000,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:04.626954+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16602,"num_read_kb":13937,"num_write":6188,"num_write_kb":3085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'296","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.273302+0000","last_change":"2024-09-12T00:38:51.273199+0000","last_active":"2024-09-12T00:38:51.273302+0000","last_peered":"2024-09-12T00:38:51.273302+0000","last_clean":"2024-09-12T00:38:51.273302+0000","last_became_active":"2024-09-12T00:01:57.144269+0000","last_became_peered":"2024-09-12T00:01:57.144269+0000","last_unstale":"2024-09-12T00:38:51.273302+0000","last_undegraded":"2024-09-12T00:38:51.273302+0000","last_fullsized":"2024-09-12T00:38:51.273302+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'296","last_scrub_stamp":"2024-09-12T00:38:51.273042+0000","last_deep_scrub":"261'296","last_deep_scrub_stamp":"2024-09-12T00:38:51.273042+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.273042+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:27.864647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399069,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":703,"num_read_kb":1796,"num_write":921,"num_write_kb":33986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.634681+0000","last_change":"2024-09-12T00:39:03.634681+0000","last_active":"2024-09-12T00:39:03.634681+0000","last_peered":"2024-09-12T00:39:03.634681+0000","last_clean":"2024-09-12T00:39:03.634681+0000","last_became_active":"2024-09-12T00:02:01.155425+0000","last_became_peered":"2024-09-12T00:02:01.155425+0000","last_unstale":"2024-09-12T00:39:03.634681+0000","last_undegraded":"2024-09-12T00:39:03.634681+0000","last_fullsized":"2024-09-12T00:39:03.634681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:03.634589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:03.634589+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.634589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:12.318839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'110","reported_seq":651,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.739057+0000","last_change":"2024-09-12T00:39:09.739057+0000","last_active":"2024-09-12T00:39:09.739057+0000","last_peered":"2024-09-12T00:39:09.739057+0000","last_clean":"2024-09-12T00:39:09.739057+0000","last_became_active":"2024-09-12T00:02:03.151839+0000","last_became_peered":"2024-09-12T00:02:03.151839+0000","last_unstale":"2024-09-12T00:39:09.739057+0000","last_undegraded":"2024-09-12T00:39:09.739057+0000","last_fullsized":"2024-09-12T00:39:09.739057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'110","last_scrub_stamp":"2024-09-12T00:39:09.738938+0000","last_deep_scrub":"261'110","last_deep_scrub_stamp":"2024-09-12T00:39:09.738938+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.738938+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:36.714767+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'759","reported_seq":2055,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.107685+0000","last_change":"2024-09-12T00:39:23.107685+0000","last_active":"2024-09-12T00:39:23.107685+0000","last_peered":"2024-09-12T00:39:23.107685+0000","last_clean":"2024-09-12T00:39:23.107685+0000","last_became_active":"2024-09-12T00:02:05.166985+0000","last_became_peered":"2024-09-12T00:02:05.166985+0000","last_unstale":"2024-09-12T00:39:23.107685+0000","last_undegraded":"2024-09-12T00:39:23.107685+0000","last_fullsized":"2024-09-12T00:39:23.107685+0000","mapping_epoch":32,"log_start":"261'701","ondisk_log_start":"261'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'759","last_scrub_stamp":"2024-09-12T00:39:23.107584+0000","last_deep_scrub":"261'759","last_deep_scrub_stamp":"2024-09-12T00:39:23.107584+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.107584+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":701,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:14.468840+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'219","reported_seq":1026,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.059760+0000","last_change":"2024-09-12T00:39:10.059760+0000","last_active":"2024-09-12T00:39:10.059760+0000","last_peered":"2024-09-12T00:39:10.059760+0000","last_clean":"2024-09-12T00:39:10.059760+0000","last_became_active":"2024-09-12T00:02:07.167576+0000","last_became_peered":"2024-09-12T00:02:07.167576+0000","last_unstale":"2024-09-12T00:39:10.059760+0000","last_undegraded":"2024-09-12T00:39:10.059760+0000","last_fullsized":"2024-09-12T00:39:10.059760+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'219","last_scrub_stamp":"2024-09-12T00:39:10.059666+0000","last_deep_scrub":"261'219","last_deep_scrub_stamp":"2024-09-12T00:39:10.059666+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.059666+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:24.213624+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":605,"num_read_kb":603,"num_write":488,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'58","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.869456+0000","last_change":"2024-09-12T00:38:59.869456+0000","last_active":"2024-09-12T00:38:59.869456+0000","last_peered":"2024-09-12T00:38:59.869456+0000","last_clean":"2024-09-12T00:38:59.869456+0000","last_became_active":"2024-09-12T00:01:59.149087+0000","last_became_peered":"2024-09-12T00:01:59.149087+0000","last_unstale":"2024-09-12T00:38:59.869456+0000","last_undegraded":"2024-09-12T00:38:59.869456+0000","last_fullsized":"2024-09-12T00:38:59.869456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'58","last_scrub_stamp":"2024-09-12T00:38:59.869337+0000","last_deep_scrub":"261'58","last_deep_scrub_stamp":"2024-09-12T00:38:59.869337+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.869337+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:41.875669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":233,"num_write":78,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'349","reported_seq":1055,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.537155+0000","last_change":"2024-09-12T00:38:44.537092+0000","last_active":"2024-09-12T00:38:44.537155+0000","last_peered":"2024-09-12T00:38:44.537155+0000","last_clean":"2024-09-12T00:38:44.537155+0000","last_became_active":"2024-09-12T00:01:57.152332+0000","last_became_peered":"2024-09-12T00:01:57.152332+0000","last_unstale":"2024-09-12T00:38:44.537155+0000","last_undegraded":"2024-09-12T00:38:44.537155+0000","last_fullsized":"2024-09-12T00:38:44.537155+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T00:38:44.536985+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T00:38:44.536985+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.536985+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:37.312381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516615,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":651,"num_read_kb":43786,"num_write":1177,"num_write_kb":39072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.332992+0000","last_change":"2024-09-12T00:39:12.332992+0000","last_active":"2024-09-12T00:39:12.332992+0000","last_peered":"2024-09-12T00:39:12.332992+0000","last_clean":"2024-09-12T00:39:12.332992+0000","last_became_active":"2024-09-12T00:02:01.154110+0000","last_became_peered":"2024-09-12T00:02:01.154110+0000","last_unstale":"2024-09-12T00:39:12.332992+0000","last_undegraded":"2024-09-12T00:39:12.332992+0000","last_fullsized":"2024-09-12T00:39:12.332992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:12.332907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:12.332907+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.332907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:30.728183+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'261","reported_seq":821,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.207586+0000","last_change":"2024-09-12T00:39:04.207586+0000","last_active":"2024-09-12T00:39:04.207586+0000","last_peered":"2024-09-12T00:39:04.207586+0000","last_clean":"2024-09-12T00:39:04.207586+0000","last_became_active":"2024-09-12T00:02:03.145673+0000","last_became_peered":"2024-09-12T00:02:03.145673+0000","last_unstale":"2024-09-12T00:39:04.207586+0000","last_undegraded":"2024-09-12T00:39:04.207586+0000","last_fullsized":"2024-09-12T00:39:04.207586+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'261","last_scrub_stamp":"2024-09-12T00:39:04.207480+0000","last_deep_scrub":"261'261","last_deep_scrub_stamp":"2024-09-12T00:39:04.207480+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.207480+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:22.980209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47470,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":957,"num_write":348,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'783","reported_seq":2163,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.746273+0000","last_change":"2024-09-12T00:39:15.746273+0000","last_active":"2024-09-12T00:39:15.746273+0000","last_peered":"2024-09-12T00:39:15.746273+0000","last_clean":"2024-09-12T00:39:15.746273+0000","last_became_active":"2024-09-12T00:02:05.165283+0000","last_became_peered":"2024-09-12T00:02:05.165283+0000","last_unstale":"2024-09-12T00:39:15.746273+0000","last_undegraded":"2024-09-12T00:39:15.746273+0000","last_fullsized":"2024-09-12T00:39:15.746273+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'783","last_scrub_stamp":"2024-09-12T00:39:15.746188+0000","last_deep_scrub":"261'783","last_deep_scrub_stamp":"2024-09-12T00:39:15.746188+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.746188+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:59.792273+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'107","reported_seq":685,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.191153+0000","last_change":"2024-09-12T00:38:59.191153+0000","last_active":"2024-09-12T00:38:59.191153+0000","last_peered":"2024-09-12T00:38:59.191153+0000","last_clean":"2024-09-12T00:38:59.191153+0000","last_became_active":"2024-09-12T00:01:59.153704+0000","last_became_peered":"2024-09-12T00:01:59.153704+0000","last_unstale":"2024-09-12T00:38:59.191153+0000","last_undegraded":"2024-09-12T00:38:59.191153+0000","last_fullsized":"2024-09-12T00:38:59.191153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'107","last_scrub_stamp":"2024-09-12T00:38:59.191064+0000","last_deep_scrub":"261'107","last_deep_scrub_stamp":"2024-09-12T00:38:59.191064+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.191064+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:10.002119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":389,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'347","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:42.111293+0000","last_change":"2024-09-12T00:38:42.111293+0000","last_active":"2024-09-12T00:38:42.111293+0000","last_peered":"2024-09-12T00:38:42.111293+0000","last_clean":"2024-09-12T00:38:42.111293+0000","last_became_active":"2024-09-12T00:01:57.154222+0000","last_became_peered":"2024-09-12T00:01:57.154222+0000","last_unstale":"2024-09-12T00:38:42.111293+0000","last_undegraded":"2024-09-12T00:38:42.111293+0000","last_fullsized":"2024-09-12T00:38:42.111293+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'347","last_scrub_stamp":"2024-09-12T00:38:42.111118+0000","last_deep_scrub":"261'347","last_deep_scrub_stamp":"2024-09-12T00:38:42.111118+0000","last_clean_scrub_stamp":"2024-09-12T00:38:42.111118+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:20.798122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589724,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":40360,"num_write":1158,"num_write_kb":32511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.459099+0000","last_change":"2024-09-12T00:38:57.459099+0000","last_active":"2024-09-12T00:38:57.459099+0000","last_peered":"2024-09-12T00:38:57.459099+0000","last_clean":"2024-09-12T00:38:57.459099+0000","last_became_active":"2024-09-12T00:02:01.144531+0000","last_became_peered":"2024-09-12T00:02:01.144531+0000","last_unstale":"2024-09-12T00:38:57.459099+0000","last_undegraded":"2024-09-12T00:38:57.459099+0000","last_fullsized":"2024-09-12T00:38:57.459099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:57.459009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:57.459009+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.459009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:40.876686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'380","reported_seq":991,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.338811+0000","last_change":"2024-09-12T00:39:03.338712+0000","last_active":"2024-09-12T00:39:03.338811+0000","last_peered":"2024-09-12T00:39:03.338811+0000","last_clean":"2024-09-12T00:39:03.338811+0000","last_became_active":"2024-09-12T00:02:03.155293+0000","last_became_peered":"2024-09-12T00:02:03.155293+0000","last_unstale":"2024-09-12T00:39:03.338811+0000","last_undegraded":"2024-09-12T00:39:03.338811+0000","last_fullsized":"2024-09-12T00:39:03.338811+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'380","last_scrub_stamp":"2024-09-12T00:39:03.338549+0000","last_deep_scrub":"261'380","last_deep_scrub_stamp":"2024-09-12T00:39:03.338549+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.338549+0000","objects_scrubbed":10,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:48.702607+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50160,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":1260,"num_write":482,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.976348+0000","last_change":"2024-09-12T00:39:08.976348+0000","last_active":"2024-09-12T00:39:08.976348+0000","last_peered":"2024-09-12T00:39:08.976348+0000","last_clean":"2024-09-12T00:39:08.976348+0000","last_became_active":"2024-09-12T00:02:05.167762+0000","last_became_peered":"2024-09-12T00:02:05.167762+0000","last_unstale":"2024-09-12T00:39:08.976348+0000","last_undegraded":"2024-09-12T00:39:08.976348+0000","last_fullsized":"2024-09-12T00:39:08.976348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:08.976252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:08.976252+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.976252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:00.360348+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'550","reported_seq":1354,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.025639+0000","last_change":"2024-09-12T00:39:11.025639+0000","last_active":"2024-09-12T00:39:11.025639+0000","last_peered":"2024-09-12T00:39:11.025639+0000","last_clean":"2024-09-12T00:39:11.025639+0000","last_became_active":"2024-09-12T00:02:07.172005+0000","last_became_peered":"2024-09-12T00:02:07.172005+0000","last_unstale":"2024-09-12T00:39:11.025639+0000","last_undegraded":"2024-09-12T00:39:11.025639+0000","last_fullsized":"2024-09-12T00:39:11.025639+0000","mapping_epoch":34,"log_start":"261'500","ondisk_log_start":"261'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'550","last_scrub_stamp":"2024-09-12T00:39:11.025541+0000","last_deep_scrub":"261'550","last_deep_scrub_stamp":"2024-09-12T00:39:11.025541+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.025541+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:05.710518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1294,"num_read_kb":1285,"num_write":1129,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'119","reported_seq":697,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.449096+0000","last_change":"2024-09-12T00:38:54.449096+0000","last_active":"2024-09-12T00:38:54.449096+0000","last_peered":"2024-09-12T00:38:54.449096+0000","last_clean":"2024-09-12T00:38:54.449096+0000","last_became_active":"2024-09-12T00:01:59.151782+0000","last_became_peered":"2024-09-12T00:01:59.151782+0000","last_unstale":"2024-09-12T00:38:54.449096+0000","last_undegraded":"2024-09-12T00:38:54.449096+0000","last_fullsized":"2024-09-12T00:38:54.449096+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'119","last_scrub_stamp":"2024-09-12T00:38:54.449006+0000","last_deep_scrub":"261'119","last_deep_scrub_stamp":"2024-09-12T00:38:54.449006+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.449006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:43.707307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":439,"num_write":192,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'305","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:42.998047+0000","last_change":"2024-09-12T00:38:42.998047+0000","last_active":"2024-09-12T00:38:42.998047+0000","last_peered":"2024-09-12T00:38:42.998047+0000","last_clean":"2024-09-12T00:38:42.998047+0000","last_became_active":"2024-09-12T00:01:57.157370+0000","last_became_peered":"2024-09-12T00:01:57.157370+0000","last_unstale":"2024-09-12T00:38:42.998047+0000","last_undegraded":"2024-09-12T00:38:42.998047+0000","last_fullsized":"2024-09-12T00:38:42.998047+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-12T00:38:42.997918+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-12T00:38:42.997918+0000","last_clean_scrub_stamp":"2024-09-12T00:38:42.997918+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:53.007422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327243,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":441,"num_read_kb":3842,"num_write":968,"num_write_kb":16793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.950968+0000","last_change":"2024-09-12T00:38:58.950968+0000","last_active":"2024-09-12T00:38:58.950968+0000","last_peered":"2024-09-12T00:38:58.950968+0000","last_clean":"2024-09-12T00:38:58.950968+0000","last_became_active":"2024-09-12T00:02:01.151914+0000","last_became_peered":"2024-09-12T00:02:01.151914+0000","last_unstale":"2024-09-12T00:38:58.950968+0000","last_undegraded":"2024-09-12T00:38:58.950968+0000","last_fullsized":"2024-09-12T00:38:58.950968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:58.950859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:58.950859+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.950859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:32.731979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'281","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.703738+0000","last_change":"2024-09-12T00:39:11.703738+0000","last_active":"2024-09-12T00:39:11.703738+0000","last_peered":"2024-09-12T00:39:11.703738+0000","last_clean":"2024-09-12T00:39:11.703738+0000","last_became_active":"2024-09-12T00:02:03.154819+0000","last_became_peered":"2024-09-12T00:02:03.154819+0000","last_unstale":"2024-09-12T00:39:11.703738+0000","last_undegraded":"2024-09-12T00:39:11.703738+0000","last_fullsized":"2024-09-12T00:39:11.703738+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'281","last_scrub_stamp":"2024-09-12T00:39:11.703649+0000","last_deep_scrub":"261'281","last_deep_scrub_stamp":"2024-09-12T00:39:11.703649+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.703649+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:00.342091+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":1012,"num_write":362,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.663396+0000","last_change":"2024-09-12T00:39:15.663396+0000","last_active":"2024-09-12T00:39:15.663396+0000","last_peered":"2024-09-12T00:39:15.663396+0000","last_clean":"2024-09-12T00:39:15.663396+0000","last_became_active":"2024-09-12T00:02:05.168649+0000","last_became_peered":"2024-09-12T00:02:05.168649+0000","last_unstale":"2024-09-12T00:39:15.663396+0000","last_undegraded":"2024-09-12T00:39:15.663396+0000","last_fullsized":"2024-09-12T00:39:15.663396+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:15.663305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:15.663305+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.663305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:34.742904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2370","reported_seq":4189,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.380760+0000","last_change":"2024-09-12T00:39:12.380760+0000","last_active":"2024-09-12T00:39:12.380760+0000","last_peered":"2024-09-12T00:39:12.380760+0000","last_clean":"2024-09-12T00:39:12.380760+0000","last_became_active":"2024-09-12T00:02:07.174769+0000","last_became_peered":"2024-09-12T00:02:07.174769+0000","last_unstale":"2024-09-12T00:39:12.380760+0000","last_undegraded":"2024-09-12T00:39:12.380760+0000","last_fullsized":"2024-09-12T00:39:12.380760+0000","mapping_epoch":34,"log_start":"261'2300","ondisk_log_start":"261'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2370","last_scrub_stamp":"2024-09-12T00:39:12.380674+0000","last_deep_scrub":"261'2370","last_deep_scrub_stamp":"2024-09-12T00:39:12.380674+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.380674+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":2300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:27.782085+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5961,"num_read_kb":5964,"num_write":4767,"num_write_kb":1768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'190","reported_seq":821,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.093622+0000","last_change":"2024-09-12T00:38:51.093560+0000","last_active":"2024-09-12T00:38:51.093622+0000","last_peered":"2024-09-12T00:38:51.093622+0000","last_clean":"2024-09-12T00:38:51.093622+0000","last_became_active":"2024-09-12T00:01:59.156252+0000","last_became_peered":"2024-09-12T00:01:59.156252+0000","last_unstale":"2024-09-12T00:38:51.093622+0000","last_undegraded":"2024-09-12T00:38:51.093622+0000","last_fullsized":"2024-09-12T00:38:51.093622+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'190","last_scrub_stamp":"2024-09-12T00:38:51.093465+0000","last_deep_scrub":"261'190","last_deep_scrub_stamp":"2024-09-12T00:38:51.093465+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.093465+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:31.896004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":702,"num_write":296,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'368","reported_seq":1015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.261298+0000","last_change":"2024-09-12T00:38:50.261298+0000","last_active":"2024-09-12T00:38:50.261298+0000","last_peered":"2024-09-12T00:38:50.261298+0000","last_clean":"2024-09-12T00:38:50.261298+0000","last_became_active":"2024-09-12T00:01:57.157699+0000","last_became_peered":"2024-09-12T00:01:57.157699+0000","last_unstale":"2024-09-12T00:38:50.261298+0000","last_undegraded":"2024-09-12T00:38:50.261298+0000","last_fullsized":"2024-09-12T00:38:50.261298+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'368","last_scrub_stamp":"2024-09-12T00:38:50.261168+0000","last_deep_scrub":"261'368","last_deep_scrub_stamp":"2024-09-12T00:38:50.261168+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.261168+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:19.208333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":32954,"num_write":1221,"num_write_kb":41911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.805229+0000","last_change":"2024-09-12T00:39:06.805229+0000","last_active":"2024-09-12T00:39:06.805229+0000","last_peered":"2024-09-12T00:39:06.805229+0000","last_clean":"2024-09-12T00:39:06.805229+0000","last_became_active":"2024-09-12T00:02:01.153090+0000","last_became_peered":"2024-09-12T00:02:01.153090+0000","last_unstale":"2024-09-12T00:39:06.805229+0000","last_undegraded":"2024-09-12T00:39:06.805229+0000","last_fullsized":"2024-09-12T00:39:06.805229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:06.805116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:06.805116+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.805116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:16.685921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'330","reported_seq":917,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.260723+0000","last_change":"2024-09-12T00:39:14.260723+0000","last_active":"2024-09-12T00:39:14.260723+0000","last_peered":"2024-09-12T00:39:14.260723+0000","last_clean":"2024-09-12T00:39:14.260723+0000","last_became_active":"2024-09-12T00:02:03.153386+0000","last_became_peered":"2024-09-12T00:02:03.153386+0000","last_unstale":"2024-09-12T00:39:14.260723+0000","last_undegraded":"2024-09-12T00:39:14.260723+0000","last_fullsized":"2024-09-12T00:39:14.260723+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'330","last_scrub_stamp":"2024-09-12T00:39:14.260607+0000","last_deep_scrub":"261'330","last_deep_scrub_stamp":"2024-09-12T00:39:14.260607+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.260607+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:42.018666+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50481,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":533,"num_read_kb":1216,"num_write":438,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'783","reported_seq":2246,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.699412+0000","last_change":"2024-09-12T00:39:13.699412+0000","last_active":"2024-09-12T00:39:13.699412+0000","last_peered":"2024-09-12T00:39:13.699412+0000","last_clean":"2024-09-12T00:39:13.699412+0000","last_became_active":"2024-09-12T00:02:05.165892+0000","last_became_peered":"2024-09-12T00:02:05.165892+0000","last_unstale":"2024-09-12T00:39:13.699412+0000","last_undegraded":"2024-09-12T00:39:13.699412+0000","last_fullsized":"2024-09-12T00:39:13.699412+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'783","last_scrub_stamp":"2024-09-12T00:39:13.699327+0000","last_deep_scrub":"261'783","last_deep_scrub_stamp":"2024-09-12T00:39:13.699327+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.699327+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:11.908777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'90","reported_seq":573,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.992321+0000","last_change":"2024-09-12T00:39:11.992321+0000","last_active":"2024-09-12T00:39:11.992321+0000","last_peered":"2024-09-12T00:39:11.992321+0000","last_clean":"2024-09-12T00:39:11.992321+0000","last_became_active":"2024-09-12T00:02:07.169216+0000","last_became_peered":"2024-09-12T00:02:07.169216+0000","last_unstale":"2024-09-12T00:39:11.992321+0000","last_undegraded":"2024-09-12T00:39:11.992321+0000","last_fullsized":"2024-09-12T00:39:11.992321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'90","last_scrub_stamp":"2024-09-12T00:39:11.992219+0000","last_deep_scrub":"261'90","last_deep_scrub_stamp":"2024-09-12T00:39:11.992219+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.992219+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:31.425358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":199,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'131","reported_seq":715,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.837599+0000","last_change":"2024-09-12T00:38:56.837599+0000","last_active":"2024-09-12T00:38:56.837599+0000","last_peered":"2024-09-12T00:38:56.837599+0000","last_clean":"2024-09-12T00:38:56.837599+0000","last_became_active":"2024-09-12T00:01:59.152836+0000","last_became_peered":"2024-09-12T00:01:59.152836+0000","last_unstale":"2024-09-12T00:38:56.837599+0000","last_undegraded":"2024-09-12T00:38:56.837599+0000","last_fullsized":"2024-09-12T00:38:56.837599+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'131","last_scrub_stamp":"2024-09-12T00:38:56.837464+0000","last_deep_scrub":"261'131","last_deep_scrub_stamp":"2024-09-12T00:38:56.837464+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.837464+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:06.526573+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":483,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'320","reported_seq":965,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.128035+0000","last_change":"2024-09-12T00:38:43.128035+0000","last_active":"2024-09-12T00:38:43.128035+0000","last_peered":"2024-09-12T00:38:43.128035+0000","last_clean":"2024-09-12T00:38:43.128035+0000","last_became_active":"2024-09-12T00:01:57.143137+0000","last_became_peered":"2024-09-12T00:01:57.143137+0000","last_unstale":"2024-09-12T00:38:43.128035+0000","last_undegraded":"2024-09-12T00:38:43.128035+0000","last_fullsized":"2024-09-12T00:38:43.128035+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'320","last_scrub_stamp":"2024-09-12T00:38:43.127908+0000","last_deep_scrub":"261'320","last_deep_scrub_stamp":"2024-09-12T00:38:43.127908+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.127908+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:53.536834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286939,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":8103,"num_write":1063,"num_write_kb":32276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.930140+0000","last_change":"2024-09-12T00:38:59.930140+0000","last_active":"2024-09-12T00:38:59.930140+0000","last_peered":"2024-09-12T00:38:59.930140+0000","last_clean":"2024-09-12T00:38:59.930140+0000","last_became_active":"2024-09-12T00:02:01.144199+0000","last_became_peered":"2024-09-12T00:02:01.144199+0000","last_unstale":"2024-09-12T00:38:59.930140+0000","last_undegraded":"2024-09-12T00:38:59.930140+0000","last_fullsized":"2024-09-12T00:38:59.930140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.930003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.930003+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.930003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:43.802037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'493","reported_seq":1134,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.697135+0000","last_change":"2024-09-12T00:39:06.697135+0000","last_active":"2024-09-12T00:39:06.697135+0000","last_peered":"2024-09-12T00:39:06.697135+0000","last_clean":"2024-09-12T00:39:06.697135+0000","last_became_active":"2024-09-12T00:02:03.155625+0000","last_became_peered":"2024-09-12T00:02:03.155625+0000","last_unstale":"2024-09-12T00:39:06.697135+0000","last_undegraded":"2024-09-12T00:39:06.697135+0000","last_fullsized":"2024-09-12T00:39:06.697135+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'493","last_scrub_stamp":"2024-09-12T00:39:06.697030+0000","last_deep_scrub":"261'493","last_deep_scrub_stamp":"2024-09-12T00:39:06.697030+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.697030+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:53.918945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104418,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":868,"num_read_kb":2109,"num_write":716,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.717324+0000","last_change":"2024-09-12T00:39:12.717324+0000","last_active":"2024-09-12T00:39:12.717324+0000","last_peered":"2024-09-12T00:39:12.717324+0000","last_clean":"2024-09-12T00:39:12.717324+0000","last_became_active":"2024-09-12T00:02:05.168816+0000","last_became_peered":"2024-09-12T00:02:05.168816+0000","last_unstale":"2024-09-12T00:39:12.717324+0000","last_undegraded":"2024-09-12T00:39:12.717324+0000","last_fullsized":"2024-09-12T00:39:12.717324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:12.717233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:12.717233+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.717233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:01.788155+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'160","reported_seq":662,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.947174+0000","last_change":"2024-09-12T00:39:07.947174+0000","last_active":"2024-09-12T00:39:07.947174+0000","last_peered":"2024-09-12T00:39:07.947174+0000","last_clean":"2024-09-12T00:39:07.947174+0000","last_became_active":"2024-09-12T00:02:07.171762+0000","last_became_peered":"2024-09-12T00:02:07.171762+0000","last_unstale":"2024-09-12T00:39:07.947174+0000","last_undegraded":"2024-09-12T00:39:07.947174+0000","last_fullsized":"2024-09-12T00:39:07.947174+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'160","last_scrub_stamp":"2024-09-12T00:39:07.947071+0000","last_deep_scrub":"261'160","last_deep_scrub_stamp":"2024-09-12T00:39:07.947071+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.947071+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:16.042433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":181,"num_read_kb":171,"num_write":367,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'251","reported_seq":898,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.196650+0000","last_change":"2024-09-12T00:38:53.196650+0000","last_active":"2024-09-12T00:38:53.196650+0000","last_peered":"2024-09-12T00:38:53.196650+0000","last_clean":"2024-09-12T00:38:53.196650+0000","last_became_active":"2024-09-12T00:01:59.147762+0000","last_became_peered":"2024-09-12T00:01:59.147762+0000","last_unstale":"2024-09-12T00:38:53.196650+0000","last_undegraded":"2024-09-12T00:38:53.196650+0000","last_fullsized":"2024-09-12T00:38:53.196650+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'251","last_scrub_stamp":"2024-09-12T00:38:53.196559+0000","last_deep_scrub":"261'251","last_deep_scrub_stamp":"2024-09-12T00:38:53.196559+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.196559+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:22.688918+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1058,"num_read_kb":865,"num_write":369,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'311","reported_seq":919,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.806433+0000","last_change":"2024-09-12T00:38:45.806433+0000","last_active":"2024-09-12T00:38:45.806433+0000","last_peered":"2024-09-12T00:38:45.806433+0000","last_clean":"2024-09-12T00:38:45.806433+0000","last_became_active":"2024-09-12T00:01:57.139677+0000","last_became_peered":"2024-09-12T00:01:57.139677+0000","last_unstale":"2024-09-12T00:38:45.806433+0000","last_undegraded":"2024-09-12T00:38:45.806433+0000","last_fullsized":"2024-09-12T00:38:45.806433+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'311","last_scrub_stamp":"2024-09-12T00:38:45.806294+0000","last_deep_scrub":"261'311","last_deep_scrub_stamp":"2024-09-12T00:38:45.806294+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.806294+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:02.113023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":3669,"num_write":1056,"num_write_kb":17146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.890918+0000","last_change":"2024-09-12T00:38:58.890918+0000","last_active":"2024-09-12T00:38:58.890918+0000","last_peered":"2024-09-12T00:38:58.890918+0000","last_clean":"2024-09-12T00:38:58.890918+0000","last_became_active":"2024-09-12T00:02:01.150796+0000","last_became_peered":"2024-09-12T00:02:01.150796+0000","last_unstale":"2024-09-12T00:38:58.890918+0000","last_undegraded":"2024-09-12T00:38:58.890918+0000","last_fullsized":"2024-09-12T00:38:58.890918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:58.890832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:58.890832+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.890832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:05.434384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'281","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.402828+0000","last_change":"2024-09-12T00:39:02.402828+0000","last_active":"2024-09-12T00:39:02.402828+0000","last_peered":"2024-09-12T00:39:02.402828+0000","last_clean":"2024-09-12T00:39:02.402828+0000","last_became_active":"2024-09-12T00:02:03.153447+0000","last_became_peered":"2024-09-12T00:02:03.153447+0000","last_unstale":"2024-09-12T00:39:02.402828+0000","last_undegraded":"2024-09-12T00:39:02.402828+0000","last_fullsized":"2024-09-12T00:39:02.402828+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'281","last_scrub_stamp":"2024-09-12T00:39:02.402726+0000","last_deep_scrub":"261'281","last_deep_scrub_stamp":"2024-09-12T00:39:02.402726+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.402726+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:26.074688+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49756,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":469,"num_read_kb":1005,"num_write":420,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.948843+0000","last_change":"2024-09-12T00:39:02.948843+0000","last_active":"2024-09-12T00:39:02.948843+0000","last_peered":"2024-09-12T00:39:02.948843+0000","last_clean":"2024-09-12T00:39:02.948843+0000","last_became_active":"2024-09-12T00:02:05.163689+0000","last_became_peered":"2024-09-12T00:02:05.163689+0000","last_unstale":"2024-09-12T00:39:02.948843+0000","last_undegraded":"2024-09-12T00:39:02.948843+0000","last_fullsized":"2024-09-12T00:39:02.948843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:02.948756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:02.948756+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.948756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:26.562845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'132","reported_seq":622,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.793463+0000","last_change":"2024-09-12T00:39:17.793463+0000","last_active":"2024-09-12T00:39:17.793463+0000","last_peered":"2024-09-12T00:39:17.793463+0000","last_clean":"2024-09-12T00:39:17.793463+0000","last_became_active":"2024-09-12T00:02:07.171942+0000","last_became_peered":"2024-09-12T00:02:07.171942+0000","last_unstale":"2024-09-12T00:39:17.793463+0000","last_undegraded":"2024-09-12T00:39:17.793463+0000","last_fullsized":"2024-09-12T00:39:17.793463+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'132","last_scrub_stamp":"2024-09-12T00:39:17.793369+0000","last_deep_scrub":"261'132","last_deep_scrub_stamp":"2024-09-12T00:39:17.793369+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.793369+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:30.465139+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'138","reported_seq":735,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.199034+0000","last_change":"2024-09-12T00:39:05.199034+0000","last_active":"2024-09-12T00:39:05.199034+0000","last_peered":"2024-09-12T00:39:05.199034+0000","last_clean":"2024-09-12T00:39:05.199034+0000","last_became_active":"2024-09-12T00:01:59.148534+0000","last_became_peered":"2024-09-12T00:01:59.148534+0000","last_unstale":"2024-09-12T00:39:05.199034+0000","last_undegraded":"2024-09-12T00:39:05.199034+0000","last_fullsized":"2024-09-12T00:39:05.199034+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'138","last_scrub_stamp":"2024-09-12T00:39:05.198946+0000","last_deep_scrub":"261'138","last_deep_scrub_stamp":"2024-09-12T00:39:05.198946+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.198946+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:16.549918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":510,"num_write":211,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'366","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.281853+0000","last_change":"2024-09-12T00:38:49.281790+0000","last_active":"2024-09-12T00:38:49.281853+0000","last_peered":"2024-09-12T00:38:49.281853+0000","last_clean":"2024-09-12T00:38:49.281853+0000","last_became_active":"2024-09-12T00:01:57.165226+0000","last_became_peered":"2024-09-12T00:01:57.165226+0000","last_unstale":"2024-09-12T00:38:49.281853+0000","last_undegraded":"2024-09-12T00:38:49.281853+0000","last_fullsized":"2024-09-12T00:38:49.281853+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'366","last_scrub_stamp":"2024-09-12T00:38:49.281653+0000","last_deep_scrub":"261'366","last_deep_scrub_stamp":"2024-09-12T00:38:49.281653+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.281653+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:38.107200+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436889,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":580,"num_read_kb":11178,"num_write":1222,"num_write_kb":42398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.853856+0000","last_change":"2024-09-12T00:39:07.853856+0000","last_active":"2024-09-12T00:39:07.853856+0000","last_peered":"2024-09-12T00:39:07.853856+0000","last_clean":"2024-09-12T00:39:07.853856+0000","last_became_active":"2024-09-12T00:02:01.153818+0000","last_became_peered":"2024-09-12T00:02:01.153818+0000","last_unstale":"2024-09-12T00:39:07.853856+0000","last_undegraded":"2024-09-12T00:39:07.853856+0000","last_fullsized":"2024-09-12T00:39:07.853856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:07.853730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:07.853730+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.853730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:19.668987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'299","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.805022+0000","last_change":"2024-09-12T00:39:09.805022+0000","last_active":"2024-09-12T00:39:09.805022+0000","last_peered":"2024-09-12T00:39:09.805022+0000","last_clean":"2024-09-12T00:39:09.805022+0000","last_became_active":"2024-09-12T00:02:03.152421+0000","last_became_peered":"2024-09-12T00:02:03.152421+0000","last_unstale":"2024-09-12T00:39:09.805022+0000","last_undegraded":"2024-09-12T00:39:09.805022+0000","last_fullsized":"2024-09-12T00:39:09.805022+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'299","last_scrub_stamp":"2024-09-12T00:39:09.804926+0000","last_deep_scrub":"261'299","last_deep_scrub_stamp":"2024-09-12T00:39:09.804926+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.804926+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:51.784383+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49051,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":1143,"num_write":402,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'761","reported_seq":2126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.915452+0000","last_change":"2024-09-12T00:39:01.915452+0000","last_active":"2024-09-12T00:39:01.915452+0000","last_peered":"2024-09-12T00:39:01.915452+0000","last_clean":"2024-09-12T00:39:01.915452+0000","last_became_active":"2024-09-12T00:02:05.164655+0000","last_became_peered":"2024-09-12T00:02:05.164655+0000","last_unstale":"2024-09-12T00:39:01.915452+0000","last_undegraded":"2024-09-12T00:39:01.915452+0000","last_fullsized":"2024-09-12T00:39:01.915452+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'761","last_scrub_stamp":"2024-09-12T00:39:01.915354+0000","last_deep_scrub":"261'761","last_deep_scrub_stamp":"2024-09-12T00:39:01.915354+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.915354+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:26.039431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'98","reported_seq":581,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.989947+0000","last_change":"2024-09-12T00:39:10.989947+0000","last_active":"2024-09-12T00:39:10.989947+0000","last_peered":"2024-09-12T00:39:10.989947+0000","last_clean":"2024-09-12T00:39:10.989947+0000","last_became_active":"2024-09-12T00:02:07.164754+0000","last_became_peered":"2024-09-12T00:02:07.164754+0000","last_unstale":"2024-09-12T00:39:10.989947+0000","last_undegraded":"2024-09-12T00:39:10.989947+0000","last_fullsized":"2024-09-12T00:39:10.989947+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'98","last_scrub_stamp":"2024-09-12T00:39:10.989857+0000","last_deep_scrub":"261'98","last_deep_scrub_stamp":"2024-09-12T00:39:10.989857+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.989857+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:41.380480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":233,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'86","reported_seq":648,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.080211+0000","last_change":"2024-09-12T00:38:52.080211+0000","last_active":"2024-09-12T00:38:52.080211+0000","last_peered":"2024-09-12T00:38:52.080211+0000","last_clean":"2024-09-12T00:38:52.080211+0000","last_became_active":"2024-09-12T00:01:59.157172+0000","last_became_peered":"2024-09-12T00:01:59.157172+0000","last_unstale":"2024-09-12T00:38:52.080211+0000","last_undegraded":"2024-09-12T00:38:52.080211+0000","last_fullsized":"2024-09-12T00:38:52.080211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'86","last_scrub_stamp":"2024-09-12T00:38:52.080123+0000","last_deep_scrub":"261'86","last_deep_scrub_stamp":"2024-09-12T00:38:52.080123+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.080123+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:17.189295+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":384,"num_read_kb":356,"num_write":138,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2877,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'377","reported_seq":1036,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.321918+0000","last_change":"2024-09-12T00:38:48.321852+0000","last_active":"2024-09-12T00:38:48.321918+0000","last_peered":"2024-09-12T00:38:48.321918+0000","last_clean":"2024-09-12T00:38:48.321918+0000","last_became_active":"2024-09-12T00:01:57.145710+0000","last_became_peered":"2024-09-12T00:01:57.145710+0000","last_unstale":"2024-09-12T00:38:48.321918+0000","last_undegraded":"2024-09-12T00:38:48.321918+0000","last_fullsized":"2024-09-12T00:38:48.321918+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'377","last_scrub_stamp":"2024-09-12T00:38:48.321674+0000","last_deep_scrub":"261'377","last_deep_scrub_stamp":"2024-09-12T00:38:48.321674+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.321674+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:27.181005+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1440158,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":582,"num_read_kb":20019,"num_write":1294,"num_write_kb":22247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"261'8","reported_seq":1931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.449113+0000","last_change":"2024-09-12T00:38:56.449113+0000","last_active":"2024-09-12T00:38:56.449113+0000","last_peered":"2024-09-12T00:38:56.449113+0000","last_clean":"2024-09-12T00:38:56.449113+0000","last_became_active":"2024-09-12T00:02:01.143823+0000","last_became_peered":"2024-09-12T00:02:01.143823+0000","last_unstale":"2024-09-12T00:38:56.449113+0000","last_undegraded":"2024-09-12T00:38:56.449113+0000","last_fullsized":"2024-09-12T00:38:56.449113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T00:38:56.449020+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T00:38:56.449020+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.449020+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:41.425744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1676,"num_read_kb":1674,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'70","reported_seq":576,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.957192+0000","last_change":"2024-09-12T00:39:03.957192+0000","last_active":"2024-09-12T00:39:03.957192+0000","last_peered":"2024-09-12T00:39:03.957192+0000","last_clean":"2024-09-12T00:39:03.957192+0000","last_became_active":"2024-09-12T00:02:03.156680+0000","last_became_peered":"2024-09-12T00:02:03.156680+0000","last_unstale":"2024-09-12T00:39:03.957192+0000","last_undegraded":"2024-09-12T00:39:03.957192+0000","last_fullsized":"2024-09-12T00:39:03.957192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'70","last_scrub_stamp":"2024-09-12T00:39:03.957096+0000","last_deep_scrub":"261'70","last_deep_scrub_stamp":"2024-09-12T00:39:03.957096+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.957096+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:33.811930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'775","reported_seq":2297,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.492424+0000","last_change":"2024-09-12T00:39:05.492424+0000","last_active":"2024-09-12T00:39:05.492424+0000","last_peered":"2024-09-12T00:39:05.492424+0000","last_clean":"2024-09-12T00:39:05.492424+0000","last_became_active":"2024-09-12T00:02:05.163596+0000","last_became_peered":"2024-09-12T00:02:05.163596+0000","last_unstale":"2024-09-12T00:39:05.492424+0000","last_undegraded":"2024-09-12T00:39:05.492424+0000","last_fullsized":"2024-09-12T00:39:05.492424+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'775","last_scrub_stamp":"2024-09-12T00:39:05.492347+0000","last_deep_scrub":"261'775","last_deep_scrub_stamp":"2024-09-12T00:39:05.492347+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.492347+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:33.359858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'120","reported_seq":610,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.180688+0000","last_change":"2024-09-12T00:39:06.180688+0000","last_active":"2024-09-12T00:39:06.180688+0000","last_peered":"2024-09-12T00:39:06.180688+0000","last_clean":"2024-09-12T00:39:06.180688+0000","last_became_active":"2024-09-12T00:02:07.169160+0000","last_became_peered":"2024-09-12T00:02:07.169160+0000","last_unstale":"2024-09-12T00:39:06.180688+0000","last_undegraded":"2024-09-12T00:39:06.180688+0000","last_fullsized":"2024-09-12T00:39:06.180688+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'120","last_scrub_stamp":"2024-09-12T00:39:06.180617+0000","last_deep_scrub":"261'120","last_deep_scrub_stamp":"2024-09-12T00:39:06.180617+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.180617+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:53.593418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":119,"num_write":276,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'226","reported_seq":793,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.777724+0000","last_change":"2024-09-12T00:38:48.777724+0000","last_active":"2024-09-12T00:38:48.777724+0000","last_peered":"2024-09-12T00:38:48.777724+0000","last_clean":"2024-09-12T00:38:48.777724+0000","last_became_active":"2024-09-12T00:01:59.152145+0000","last_became_peered":"2024-09-12T00:01:59.152145+0000","last_unstale":"2024-09-12T00:38:48.777724+0000","last_undegraded":"2024-09-12T00:38:48.777724+0000","last_fullsized":"2024-09-12T00:38:48.777724+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'226","last_scrub_stamp":"2024-09-12T00:38:48.777643+0000","last_deep_scrub":"261'226","last_deep_scrub_stamp":"2024-09-12T00:38:48.777643+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.777643+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:12.164018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":744,"num_write":332,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'404","reported_seq":1118,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.557690+0000","last_change":"2024-09-12T00:38:48.557690+0000","last_active":"2024-09-12T00:38:48.557690+0000","last_peered":"2024-09-12T00:38:48.557690+0000","last_clean":"2024-09-12T00:38:48.557690+0000","last_became_active":"2024-09-12T00:01:57.140715+0000","last_became_peered":"2024-09-12T00:01:57.140715+0000","last_unstale":"2024-09-12T00:38:48.557690+0000","last_undegraded":"2024-09-12T00:38:48.557690+0000","last_fullsized":"2024-09-12T00:38:48.557690+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'404","last_scrub_stamp":"2024-09-12T00:38:48.557572+0000","last_deep_scrub":"261'404","last_deep_scrub_stamp":"2024-09-12T00:38:48.557572+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.557572+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.419290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":94303,"num_write":1279,"num_write_kb":32809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.216913+0000","last_change":"2024-09-12T00:39:08.216913+0000","last_active":"2024-09-12T00:39:08.216913+0000","last_peered":"2024-09-12T00:39:08.216913+0000","last_clean":"2024-09-12T00:39:08.216913+0000","last_became_active":"2024-09-12T00:02:01.153347+0000","last_became_peered":"2024-09-12T00:02:01.153347+0000","last_unstale":"2024-09-12T00:39:08.216913+0000","last_undegraded":"2024-09-12T00:39:08.216913+0000","last_fullsized":"2024-09-12T00:39:08.216913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:08.216830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:08.216830+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.216830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:23.658033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'323","reported_seq":918,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.413073+0000","last_change":"2024-09-12T00:39:01.413073+0000","last_active":"2024-09-12T00:39:01.413073+0000","last_peered":"2024-09-12T00:39:01.413073+0000","last_clean":"2024-09-12T00:39:01.413073+0000","last_became_active":"2024-09-12T00:02:03.154752+0000","last_became_peered":"2024-09-12T00:02:03.154752+0000","last_unstale":"2024-09-12T00:39:01.413073+0000","last_undegraded":"2024-09-12T00:39:01.413073+0000","last_fullsized":"2024-09-12T00:39:01.413073+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-12T00:39:01.412937+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-12T00:39:01.412937+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.412937+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:32.529380+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43947,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1120,"num_write":412,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.228503+0000","last_change":"2024-09-12T00:39:02.228503+0000","last_active":"2024-09-12T00:39:02.228503+0000","last_peered":"2024-09-12T00:39:02.228503+0000","last_clean":"2024-09-12T00:39:02.228503+0000","last_became_active":"2024-09-12T00:02:05.164108+0000","last_became_peered":"2024-09-12T00:02:05.164108+0000","last_unstale":"2024-09-12T00:39:02.228503+0000","last_undegraded":"2024-09-12T00:39:02.228503+0000","last_fullsized":"2024-09-12T00:39:02.228503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:02.228412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:02.228412+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.228412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:17.624723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'162","reported_seq":644,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.920217+0000","last_change":"2024-09-12T00:39:06.920217+0000","last_active":"2024-09-12T00:39:06.920217+0000","last_peered":"2024-09-12T00:39:06.920217+0000","last_clean":"2024-09-12T00:39:06.920217+0000","last_became_active":"2024-09-12T00:02:07.169351+0000","last_became_peered":"2024-09-12T00:02:07.169351+0000","last_unstale":"2024-09-12T00:39:06.920217+0000","last_undegraded":"2024-09-12T00:39:06.920217+0000","last_fullsized":"2024-09-12T00:39:06.920217+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'162","last_scrub_stamp":"2024-09-12T00:39:06.920126+0000","last_deep_scrub":"261'162","last_deep_scrub_stamp":"2024-09-12T00:39:06.920126+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.920126+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:14.572324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":164,"num_write":397,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'164","reported_seq":776,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.144037+0000","last_change":"2024-09-12T00:39:01.144037+0000","last_active":"2024-09-12T00:39:01.144037+0000","last_peered":"2024-09-12T00:39:01.144037+0000","last_clean":"2024-09-12T00:39:01.144037+0000","last_became_active":"2024-09-12T00:01:59.150072+0000","last_became_peered":"2024-09-12T00:01:59.150072+0000","last_unstale":"2024-09-12T00:39:01.144037+0000","last_undegraded":"2024-09-12T00:39:01.144037+0000","last_fullsized":"2024-09-12T00:39:01.144037+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'164","last_scrub_stamp":"2024-09-12T00:39:01.143943+0000","last_deep_scrub":"261'164","last_deep_scrub_stamp":"2024-09-12T00:39:01.143943+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.143943+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:32.032700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":763,"num_read_kb":636,"num_write":273,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"261'74","reported_seq":615,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:42.491365+0000","last_change":"2024-09-12T00:38:42.491365+0000","last_active":"2024-09-12T00:38:42.491365+0000","last_peered":"2024-09-12T00:38:42.491365+0000","last_clean":"2024-09-12T00:38:42.491365+0000","last_became_active":"2024-09-12T00:01:39.720425+0000","last_became_peered":"2024-09-12T00:01:39.720425+0000","last_unstale":"2024-09-12T00:38:42.491365+0000","last_undegraded":"2024-09-12T00:38:42.491365+0000","last_fullsized":"2024-09-12T00:38:42.491365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'74","last_scrub_stamp":"2024-09-12T00:38:42.491259+0000","last_deep_scrub":"261'74","last_deep_scrub_stamp":"2024-09-12T00:38:42.491259+0000","last_clean_scrub_stamp":"2024-09-12T00:38:42.491259+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:28.887567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"261'2","reported_seq":522,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.331718+0000","last_change":"2024-09-12T00:38:44.331659+0000","last_active":"2024-09-12T00:38:44.331718+0000","last_peered":"2024-09-12T00:38:44.331718+0000","last_clean":"2024-09-12T00:38:44.331718+0000","last_became_active":"2024-09-12T00:01:46.613916+0000","last_became_peered":"2024-09-12T00:01:46.613916+0000","last_unstale":"2024-09-12T00:38:44.331718+0000","last_undegraded":"2024-09-12T00:38:44.331718+0000","last_fullsized":"2024-09-12T00:38:44.331718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:38:44.331592+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:38:44.331592+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.331592+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:42.535188+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0014566500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'375","reported_seq":1076,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.581469+0000","last_change":"2024-09-12T00:38:46.581469+0000","last_active":"2024-09-12T00:38:46.581469+0000","last_peered":"2024-09-12T00:38:46.581469+0000","last_clean":"2024-09-12T00:38:46.581469+0000","last_became_active":"2024-09-12T00:01:57.141553+0000","last_became_peered":"2024-09-12T00:01:57.141553+0000","last_unstale":"2024-09-12T00:38:46.581469+0000","last_undegraded":"2024-09-12T00:38:46.581469+0000","last_fullsized":"2024-09-12T00:38:46.581469+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'375","last_scrub_stamp":"2024-09-12T00:38:46.581372+0000","last_deep_scrub":"261'375","last_deep_scrub_stamp":"2024-09-12T00:38:46.581372+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.581372+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:35.589907+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":706,"num_read_kb":51090,"num_write":1043,"num_write_kb":49735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.339133+0000","last_change":"2024-09-12T00:39:00.339133+0000","last_active":"2024-09-12T00:39:00.339133+0000","last_peered":"2024-09-12T00:39:00.339133+0000","last_clean":"2024-09-12T00:39:00.339133+0000","last_became_active":"2024-09-12T00:02:01.148696+0000","last_became_peered":"2024-09-12T00:02:01.148696+0000","last_unstale":"2024-09-12T00:39:00.339133+0000","last_undegraded":"2024-09-12T00:39:00.339133+0000","last_fullsized":"2024-09-12T00:39:00.339133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:00.339045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:00.339045+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.339045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:12.664460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'697","reported_seq":1400,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.303323+0000","last_change":"2024-09-12T00:39:13.303323+0000","last_active":"2024-09-12T00:39:13.303323+0000","last_peered":"2024-09-12T00:39:13.303323+0000","last_clean":"2024-09-12T00:39:13.303323+0000","last_became_active":"2024-09-12T00:02:03.150075+0000","last_became_peered":"2024-09-12T00:02:03.150075+0000","last_unstale":"2024-09-12T00:39:13.303323+0000","last_undegraded":"2024-09-12T00:39:13.303323+0000","last_fullsized":"2024-09-12T00:39:13.303323+0000","mapping_epoch":30,"log_start":"261'600","ondisk_log_start":"261'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'697","last_scrub_stamp":"2024-09-12T00:39:13.303195+0000","last_deep_scrub":"261'697","last_deep_scrub_stamp":"2024-09-12T00:39:13.303195+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.303195+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:50.182425+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141385,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1354,"num_read_kb":3064,"num_write":1242,"num_write_kb":1087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89192,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.761131+0000","last_change":"2024-09-12T00:39:10.761131+0000","last_active":"2024-09-12T00:39:10.761131+0000","last_peered":"2024-09-12T00:39:10.761131+0000","last_clean":"2024-09-12T00:39:10.761131+0000","last_became_active":"2024-09-12T00:02:05.162455+0000","last_became_peered":"2024-09-12T00:02:05.162455+0000","last_unstale":"2024-09-12T00:39:10.761131+0000","last_undegraded":"2024-09-12T00:39:10.761131+0000","last_fullsized":"2024-09-12T00:39:10.761131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:10.761046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:10.761046+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.761046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:28.012050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'261","reported_seq":971,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.193142+0000","last_change":"2024-09-12T00:39:07.193142+0000","last_active":"2024-09-12T00:39:07.193142+0000","last_peered":"2024-09-12T00:39:07.193142+0000","last_clean":"2024-09-12T00:39:07.193142+0000","last_became_active":"2024-09-12T00:02:07.167844+0000","last_became_peered":"2024-09-12T00:02:07.167844+0000","last_unstale":"2024-09-12T00:39:07.193142+0000","last_undegraded":"2024-09-12T00:39:07.193142+0000","last_fullsized":"2024-09-12T00:39:07.193142+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'261","last_scrub_stamp":"2024-09-12T00:39:07.193014+0000","last_deep_scrub":"261'261","last_deep_scrub_stamp":"2024-09-12T00:39:07.193014+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.193014+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:50.781535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":469,"num_read_kb":454,"num_write":531,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'172","reported_seq":770,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.825993+0000","last_change":"2024-09-12T00:38:58.825993+0000","last_active":"2024-09-12T00:38:58.825993+0000","last_peered":"2024-09-12T00:38:58.825993+0000","last_clean":"2024-09-12T00:38:58.825993+0000","last_became_active":"2024-09-12T00:01:59.149145+0000","last_became_peered":"2024-09-12T00:01:59.149145+0000","last_unstale":"2024-09-12T00:38:58.825993+0000","last_undegraded":"2024-09-12T00:38:58.825993+0000","last_fullsized":"2024-09-12T00:38:58.825993+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'172","last_scrub_stamp":"2024-09-12T00:38:58.825895+0000","last_deep_scrub":"261'172","last_deep_scrub_stamp":"2024-09-12T00:38:58.825895+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.825895+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:12.181956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":604,"num_write":249,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.344663+0000","last_change":"2024-09-12T00:38:43.344663+0000","last_active":"2024-09-12T00:38:43.344663+0000","last_peered":"2024-09-12T00:38:43.344663+0000","last_clean":"2024-09-12T00:38:43.344663+0000","last_became_active":"2024-09-12T00:01:46.505677+0000","last_became_peered":"2024-09-12T00:01:46.505677+0000","last_unstale":"2024-09-12T00:38:43.344663+0000","last_undegraded":"2024-09-12T00:38:43.344663+0000","last_fullsized":"2024-09-12T00:38:43.344663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:43.344592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:43.344592+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.344592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:02.518245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00075102999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'327","reported_seq":953,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.034002+0000","last_change":"2024-09-12T00:38:48.034002+0000","last_active":"2024-09-12T00:38:48.034002+0000","last_peered":"2024-09-12T00:38:48.034002+0000","last_clean":"2024-09-12T00:38:48.034002+0000","last_became_active":"2024-09-12T00:01:57.152153+0000","last_became_peered":"2024-09-12T00:01:57.152153+0000","last_unstale":"2024-09-12T00:38:48.034002+0000","last_undegraded":"2024-09-12T00:38:48.034002+0000","last_fullsized":"2024-09-12T00:38:48.034002+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'327","last_scrub_stamp":"2024-09-12T00:38:48.033865+0000","last_deep_scrub":"261'327","last_deep_scrub_stamp":"2024-09-12T00:38:48.033865+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.033865+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:01.645214+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263237,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":31136,"num_write":994,"num_write_kb":29868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.149402+0000","last_change":"2024-09-12T00:39:03.149402+0000","last_active":"2024-09-12T00:39:03.149402+0000","last_peered":"2024-09-12T00:39:03.149402+0000","last_clean":"2024-09-12T00:39:03.149402+0000","last_became_active":"2024-09-12T00:02:01.152904+0000","last_became_peered":"2024-09-12T00:02:01.152904+0000","last_unstale":"2024-09-12T00:39:03.149402+0000","last_undegraded":"2024-09-12T00:39:03.149402+0000","last_fullsized":"2024-09-12T00:39:03.149402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:03.149318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:03.149318+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.149318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:56.022423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1221","reported_seq":2588,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.930294+0000","last_change":"2024-09-12T00:38:59.930294+0000","last_active":"2024-09-12T00:38:59.930294+0000","last_peered":"2024-09-12T00:38:59.930294+0000","last_clean":"2024-09-12T00:38:59.930294+0000","last_became_active":"2024-09-12T00:02:03.153702+0000","last_became_peered":"2024-09-12T00:02:03.153702+0000","last_unstale":"2024-09-12T00:38:59.930294+0000","last_undegraded":"2024-09-12T00:38:59.930294+0000","last_fullsized":"2024-09-12T00:38:59.930294+0000","mapping_epoch":30,"log_start":"261'1200","ondisk_log_start":"261'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1221","last_scrub_stamp":"2024-09-12T00:38:59.930107+0000","last_deep_scrub":"261'1221","last_deep_scrub_stamp":"2024-09-12T00:38:59.930107+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.930107+0000","objects_scrubbed":12,"log_size":21,"log_dups_size":1200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:26.162750+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137303,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1920,"num_read_kb":3540,"num_write":1014,"num_write_kb":851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.094888+0000","last_change":"2024-09-12T00:39:21.094888+0000","last_active":"2024-09-12T00:39:21.094888+0000","last_peered":"2024-09-12T00:39:21.094888+0000","last_clean":"2024-09-12T00:39:21.094888+0000","last_became_active":"2024-09-12T00:02:05.171787+0000","last_became_peered":"2024-09-12T00:02:05.171787+0000","last_unstale":"2024-09-12T00:39:21.094888+0000","last_undegraded":"2024-09-12T00:39:21.094888+0000","last_fullsized":"2024-09-12T00:39:21.094888+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:21.094797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:21.094797+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.094797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:30.711629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'220","reported_seq":749,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.768691+0000","last_change":"2024-09-12T00:39:16.768691+0000","last_active":"2024-09-12T00:39:16.768691+0000","last_peered":"2024-09-12T00:39:16.768691+0000","last_clean":"2024-09-12T00:39:16.768691+0000","last_became_active":"2024-09-12T00:02:07.169173+0000","last_became_peered":"2024-09-12T00:02:07.169173+0000","last_unstale":"2024-09-12T00:39:16.768691+0000","last_undegraded":"2024-09-12T00:39:16.768691+0000","last_fullsized":"2024-09-12T00:39:16.768691+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'220","last_scrub_stamp":"2024-09-12T00:39:16.768578+0000","last_deep_scrub":"261'220","last_deep_scrub_stamp":"2024-09-12T00:39:16.768578+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.768578+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:30.964212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":374,"num_read_kb":362,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'89","reported_seq":649,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.951095+0000","last_change":"2024-09-12T00:38:56.951095+0000","last_active":"2024-09-12T00:38:56.951095+0000","last_peered":"2024-09-12T00:38:56.951095+0000","last_clean":"2024-09-12T00:38:56.951095+0000","last_became_active":"2024-09-12T00:01:59.138731+0000","last_became_peered":"2024-09-12T00:01:59.138731+0000","last_unstale":"2024-09-12T00:38:56.951095+0000","last_undegraded":"2024-09-12T00:38:56.951095+0000","last_fullsized":"2024-09-12T00:38:56.951095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'89","last_scrub_stamp":"2024-09-12T00:38:56.950966+0000","last_deep_scrub":"261'89","last_deep_scrub_stamp":"2024-09-12T00:38:56.950966+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.950966+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:18.408760+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":368,"num_read_kb":306,"num_write":121,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":512,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.785510+0000","last_change":"2024-09-12T00:38:44.785441+0000","last_active":"2024-09-12T00:38:44.785510+0000","last_peered":"2024-09-12T00:38:44.785510+0000","last_clean":"2024-09-12T00:38:44.785510+0000","last_became_active":"2024-09-12T00:01:46.505857+0000","last_became_peered":"2024-09-12T00:01:46.505857+0000","last_unstale":"2024-09-12T00:38:44.785510+0000","last_undegraded":"2024-09-12T00:38:44.785510+0000","last_fullsized":"2024-09-12T00:38:44.785510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:44.785356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:44.785356+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.785356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:13.579766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039331300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'325","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.790044+0000","last_change":"2024-09-12T00:38:46.790044+0000","last_active":"2024-09-12T00:38:46.790044+0000","last_peered":"2024-09-12T00:38:46.790044+0000","last_clean":"2024-09-12T00:38:46.790044+0000","last_became_active":"2024-09-12T00:01:57.151644+0000","last_became_peered":"2024-09-12T00:01:57.151644+0000","last_unstale":"2024-09-12T00:38:46.790044+0000","last_undegraded":"2024-09-12T00:38:46.790044+0000","last_fullsized":"2024-09-12T00:38:46.790044+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'325","last_scrub_stamp":"2024-09-12T00:38:46.789939+0000","last_deep_scrub":"261'325","last_deep_scrub_stamp":"2024-09-12T00:38:46.789939+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.789939+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:00.959710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399150,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":451,"num_read_kb":2375,"num_write":1107,"num_write_kb":41035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"261'2","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.895506+0000","last_change":"2024-09-12T00:38:56.895506+0000","last_active":"2024-09-12T00:38:56.895506+0000","last_peered":"2024-09-12T00:38:56.895506+0000","last_clean":"2024-09-12T00:38:56.895506+0000","last_became_active":"2024-09-12T00:02:01.151474+0000","last_became_peered":"2024-09-12T00:02:01.151474+0000","last_unstale":"2024-09-12T00:38:56.895506+0000","last_undegraded":"2024-09-12T00:38:56.895506+0000","last_fullsized":"2024-09-12T00:38:56.895506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:38:56.895390+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:38:56.895390+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.895390+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:45.952295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'217","reported_seq":1198,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.312925+0000","last_change":"2024-09-12T00:39:02.312925+0000","last_active":"2024-09-12T00:39:02.312925+0000","last_peered":"2024-09-12T00:39:02.312925+0000","last_clean":"2024-09-12T00:39:02.312925+0000","last_became_active":"2024-09-12T00:02:03.155311+0000","last_became_peered":"2024-09-12T00:02:03.155311+0000","last_unstale":"2024-09-12T00:39:02.312925+0000","last_undegraded":"2024-09-12T00:39:02.312925+0000","last_fullsized":"2024-09-12T00:39:02.312925+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'217","last_scrub_stamp":"2024-09-12T00:39:02.312818+0000","last_deep_scrub":"261'217","last_deep_scrub_stamp":"2024-09-12T00:39:02.312818+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.312818+0000","objects_scrubbed":9,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:20.910589+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":119,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.716999+0000","last_change":"2024-09-12T00:39:12.716999+0000","last_active":"2024-09-12T00:39:12.716999+0000","last_peered":"2024-09-12T00:39:12.716999+0000","last_clean":"2024-09-12T00:39:12.716999+0000","last_became_active":"2024-09-12T00:02:05.167874+0000","last_became_peered":"2024-09-12T00:02:05.167874+0000","last_unstale":"2024-09-12T00:39:12.716999+0000","last_undegraded":"2024-09-12T00:39:12.716999+0000","last_fullsized":"2024-09-12T00:39:12.716999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:12.716899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:12.716899+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.716899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:53.352781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'264","reported_seq":866,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.659200+0000","last_change":"2024-09-12T00:39:18.659200+0000","last_active":"2024-09-12T00:39:18.659200+0000","last_peered":"2024-09-12T00:39:18.659200+0000","last_clean":"2024-09-12T00:39:18.659200+0000","last_became_active":"2024-09-12T00:02:07.161814+0000","last_became_peered":"2024-09-12T00:02:07.161814+0000","last_unstale":"2024-09-12T00:39:18.659200+0000","last_undegraded":"2024-09-12T00:39:18.659200+0000","last_fullsized":"2024-09-12T00:39:18.659200+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'264","last_scrub_stamp":"2024-09-12T00:39:18.659118+0000","last_deep_scrub":"261'264","last_deep_scrub_stamp":"2024-09-12T00:39:18.659118+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.659118+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:52.481023+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":499,"num_read_kb":517,"num_write":567,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'136","reported_seq":720,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.975704+0000","last_change":"2024-09-12T00:38:53.975704+0000","last_active":"2024-09-12T00:38:53.975704+0000","last_peered":"2024-09-12T00:38:53.975704+0000","last_clean":"2024-09-12T00:38:53.975704+0000","last_became_active":"2024-09-12T00:01:59.153542+0000","last_became_peered":"2024-09-12T00:01:59.153542+0000","last_unstale":"2024-09-12T00:38:53.975704+0000","last_undegraded":"2024-09-12T00:38:53.975704+0000","last_fullsized":"2024-09-12T00:38:53.975704+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'136","last_scrub_stamp":"2024-09-12T00:38:53.975609+0000","last_deep_scrub":"261'136","last_deep_scrub_stamp":"2024-09-12T00:38:53.975609+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.975609+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:02.481618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":619,"num_read_kb":513,"num_write":207,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"261'3","reported_seq":523,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.339780+0000","last_change":"2024-09-12T00:38:45.339714+0000","last_active":"2024-09-12T00:38:45.339780+0000","last_peered":"2024-09-12T00:38:45.339780+0000","last_clean":"2024-09-12T00:38:45.339780+0000","last_became_active":"2024-09-12T00:01:46.502428+0000","last_became_peered":"2024-09-12T00:01:46.502428+0000","last_unstale":"2024-09-12T00:38:45.339780+0000","last_undegraded":"2024-09-12T00:38:45.339780+0000","last_fullsized":"2024-09-12T00:38:45.339780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:38:45.339643+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:38:45.339643+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.339643+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:28.135971+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001414925,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'334","reported_seq":961,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.197753+0000","last_change":"2024-09-12T00:38:45.197753+0000","last_active":"2024-09-12T00:38:45.197753+0000","last_peered":"2024-09-12T00:38:45.197753+0000","last_clean":"2024-09-12T00:38:45.197753+0000","last_became_active":"2024-09-12T00:01:57.156172+0000","last_became_peered":"2024-09-12T00:01:57.156172+0000","last_unstale":"2024-09-12T00:38:45.197753+0000","last_undegraded":"2024-09-12T00:38:45.197753+0000","last_fullsized":"2024-09-12T00:38:45.197753+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'334","last_scrub_stamp":"2024-09-12T00:38:45.197636+0000","last_deep_scrub":"261'334","last_deep_scrub_stamp":"2024-09-12T00:38:45.197636+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.197636+0000","objects_scrubbed":10,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:41.388701+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7788939,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":443,"num_read_kb":22094,"num_write":1095,"num_write_kb":41486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.899831+0000","last_change":"2024-09-12T00:38:55.899831+0000","last_active":"2024-09-12T00:38:55.899831+0000","last_peered":"2024-09-12T00:38:55.899831+0000","last_clean":"2024-09-12T00:38:55.899831+0000","last_became_active":"2024-09-12T00:02:01.152752+0000","last_became_peered":"2024-09-12T00:02:01.152752+0000","last_unstale":"2024-09-12T00:38:55.899831+0000","last_undegraded":"2024-09-12T00:38:55.899831+0000","last_fullsized":"2024-09-12T00:38:55.899831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:55.899739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:55.899739+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.899739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:27.345544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'119","reported_seq":647,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.824049+0000","last_change":"2024-09-12T00:39:08.824049+0000","last_active":"2024-09-12T00:39:08.824049+0000","last_peered":"2024-09-12T00:39:08.824049+0000","last_clean":"2024-09-12T00:39:08.824049+0000","last_became_active":"2024-09-12T00:02:03.152008+0000","last_became_peered":"2024-09-12T00:02:03.152008+0000","last_unstale":"2024-09-12T00:39:08.824049+0000","last_undegraded":"2024-09-12T00:39:08.824049+0000","last_fullsized":"2024-09-12T00:39:08.824049+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'119","last_scrub_stamp":"2024-09-12T00:39:08.823956+0000","last_deep_scrub":"261'119","last_deep_scrub_stamp":"2024-09-12T00:39:08.823956+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.823956+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:46.719748+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":94,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.057365+0000","last_change":"2024-09-12T00:39:22.057365+0000","last_active":"2024-09-12T00:39:22.057365+0000","last_peered":"2024-09-12T00:39:22.057365+0000","last_clean":"2024-09-12T00:39:22.057365+0000","last_became_active":"2024-09-12T00:02:05.170487+0000","last_became_peered":"2024-09-12T00:02:05.170487+0000","last_unstale":"2024-09-12T00:39:22.057365+0000","last_undegraded":"2024-09-12T00:39:22.057365+0000","last_fullsized":"2024-09-12T00:39:22.057365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:22.057217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:22.057217+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.057217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:14.738952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":671,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.431387+0000","last_change":"2024-09-12T00:39:08.431387+0000","last_active":"2024-09-12T00:39:08.431387+0000","last_peered":"2024-09-12T00:39:08.431387+0000","last_clean":"2024-09-12T00:39:08.431387+0000","last_became_active":"2024-09-12T00:02:07.168820+0000","last_became_peered":"2024-09-12T00:02:07.168820+0000","last_unstale":"2024-09-12T00:39:08.431387+0000","last_undegraded":"2024-09-12T00:39:08.431387+0000","last_fullsized":"2024-09-12T00:39:08.431387+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'122","last_scrub_stamp":"2024-09-12T00:39:08.431306+0000","last_deep_scrub":"261'122","last_deep_scrub_stamp":"2024-09-12T00:39:08.431306+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.431306+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:45.683565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":226,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'300","reported_seq":892,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.984514+0000","last_change":"2024-09-12T00:38:51.984514+0000","last_active":"2024-09-12T00:38:51.984514+0000","last_peered":"2024-09-12T00:38:51.984514+0000","last_clean":"2024-09-12T00:38:51.984514+0000","last_became_active":"2024-09-12T00:01:59.145273+0000","last_became_peered":"2024-09-12T00:01:59.145273+0000","last_unstale":"2024-09-12T00:38:51.984514+0000","last_undegraded":"2024-09-12T00:38:51.984514+0000","last_fullsized":"2024-09-12T00:38:51.984514+0000","mapping_epoch":26,"log_start":"258'200","ondisk_log_start":"258'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'300","last_scrub_stamp":"2024-09-12T00:38:51.984415+0000","last_deep_scrub":"261'300","last_deep_scrub_stamp":"2024-09-12T00:38:51.984415+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.984415+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:31.222270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1215,"num_write":550,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'372","reported_seq":1075,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.014947+0000","last_change":"2024-09-12T00:38:44.014947+0000","last_active":"2024-09-12T00:38:44.014947+0000","last_peered":"2024-09-12T00:38:44.014947+0000","last_clean":"2024-09-12T00:38:44.014947+0000","last_became_active":"2024-09-12T00:01:57.154387+0000","last_became_peered":"2024-09-12T00:01:57.154387+0000","last_unstale":"2024-09-12T00:38:44.014947+0000","last_undegraded":"2024-09-12T00:38:44.014947+0000","last_fullsized":"2024-09-12T00:38:44.014947+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'372","last_scrub_stamp":"2024-09-12T00:38:44.014836+0000","last_deep_scrub":"261'372","last_deep_scrub_stamp":"2024-09-12T00:38:44.014836+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.014836+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:12.072171+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6404752,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":635,"num_read_kb":122441,"num_write":1157,"num_write_kb":43815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":518,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.795449+0000","last_change":"2024-09-12T00:38:44.795387+0000","last_active":"2024-09-12T00:38:44.795449+0000","last_peered":"2024-09-12T00:38:44.795449+0000","last_clean":"2024-09-12T00:38:44.795449+0000","last_became_active":"2024-09-12T00:01:46.505954+0000","last_became_peered":"2024-09-12T00:01:46.505954+0000","last_unstale":"2024-09-12T00:38:44.795449+0000","last_undegraded":"2024-09-12T00:38:44.795449+0000","last_fullsized":"2024-09-12T00:38:44.795449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:44.795256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:44.795256+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.795256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:45.361353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050498000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.578391+0000","last_change":"2024-09-12T00:39:01.578391+0000","last_active":"2024-09-12T00:39:01.578391+0000","last_peered":"2024-09-12T00:39:01.578391+0000","last_clean":"2024-09-12T00:39:01.578391+0000","last_became_active":"2024-09-12T00:02:01.149529+0000","last_became_peered":"2024-09-12T00:02:01.149529+0000","last_unstale":"2024-09-12T00:39:01.578391+0000","last_undegraded":"2024-09-12T00:39:01.578391+0000","last_fullsized":"2024-09-12T00:39:01.578391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:01.578285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:01.578285+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.578285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:50.557711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'566","reported_seq":1225,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.918702+0000","last_change":"2024-09-12T00:38:57.918702+0000","last_active":"2024-09-12T00:38:57.918702+0000","last_peered":"2024-09-12T00:38:57.918702+0000","last_clean":"2024-09-12T00:38:57.918702+0000","last_became_active":"2024-09-12T00:02:03.152535+0000","last_became_peered":"2024-09-12T00:02:03.152535+0000","last_unstale":"2024-09-12T00:38:57.918702+0000","last_undegraded":"2024-09-12T00:38:57.918702+0000","last_fullsized":"2024-09-12T00:38:57.918702+0000","mapping_epoch":30,"log_start":"261'500","ondisk_log_start":"261'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'566","last_scrub_stamp":"2024-09-12T00:38:57.918575+0000","last_deep_scrub":"261'566","last_deep_scrub_stamp":"2024-09-12T00:38:57.918575+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.918575+0000","objects_scrubbed":11,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:11.867915+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88538,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1530,"num_read_kb":2694,"num_write":1952,"num_write_kb":1782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500800,"num_omap_keys":1132,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.219544+0000","last_change":"2024-09-12T00:39:03.219544+0000","last_active":"2024-09-12T00:39:03.219544+0000","last_peered":"2024-09-12T00:39:03.219544+0000","last_clean":"2024-09-12T00:39:03.219544+0000","last_became_active":"2024-09-12T00:02:05.167998+0000","last_became_peered":"2024-09-12T00:02:05.167998+0000","last_unstale":"2024-09-12T00:39:03.219544+0000","last_undegraded":"2024-09-12T00:39:03.219544+0000","last_fullsized":"2024-09-12T00:39:03.219544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:03.219425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:03.219425+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.219425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.818422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'164","reported_seq":655,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.802847+0000","last_change":"2024-09-12T00:39:19.802847+0000","last_active":"2024-09-12T00:39:19.802847+0000","last_peered":"2024-09-12T00:39:19.802847+0000","last_clean":"2024-09-12T00:39:19.802847+0000","last_became_active":"2024-09-12T00:02:07.168005+0000","last_became_peered":"2024-09-12T00:02:07.168005+0000","last_unstale":"2024-09-12T00:39:19.802847+0000","last_undegraded":"2024-09-12T00:39:19.802847+0000","last_fullsized":"2024-09-12T00:39:19.802847+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'164","last_scrub_stamp":"2024-09-12T00:39:19.802748+0000","last_deep_scrub":"261'164","last_deep_scrub_stamp":"2024-09-12T00:39:19.802748+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.802748+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:04.761071+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":133,"num_write":373,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'349","reported_seq":1001,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.984694+0000","last_change":"2024-09-12T00:38:52.984694+0000","last_active":"2024-09-12T00:38:52.984694+0000","last_peered":"2024-09-12T00:38:52.984694+0000","last_clean":"2024-09-12T00:38:52.984694+0000","last_became_active":"2024-09-12T00:01:59.137020+0000","last_became_peered":"2024-09-12T00:01:59.137020+0000","last_unstale":"2024-09-12T00:38:52.984694+0000","last_undegraded":"2024-09-12T00:38:52.984694+0000","last_fullsized":"2024-09-12T00:38:52.984694+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T00:38:52.984578+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T00:38:52.984578+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.984578+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:32.899963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1524,"num_read_kb":1224,"num_write":576,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'301","reported_seq":914,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.139945+0000","last_change":"2024-09-12T00:38:45.139945+0000","last_active":"2024-09-12T00:38:45.139945+0000","last_peered":"2024-09-12T00:38:45.139945+0000","last_clean":"2024-09-12T00:38:45.139945+0000","last_became_active":"2024-09-12T00:01:57.152021+0000","last_became_peered":"2024-09-12T00:01:57.152021+0000","last_unstale":"2024-09-12T00:38:45.139945+0000","last_undegraded":"2024-09-12T00:38:45.139945+0000","last_fullsized":"2024-09-12T00:38:45.139945+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'301","last_scrub_stamp":"2024-09-12T00:38:45.139770+0000","last_deep_scrub":"261'301","last_deep_scrub_stamp":"2024-09-12T00:38:45.139770+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.139770+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:52.526654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288035,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":437,"num_read_kb":13162,"num_write":956,"num_write_kb":28256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.293031+0000","last_change":"2024-09-12T00:38:46.292979+0000","last_active":"2024-09-12T00:38:46.293031+0000","last_peered":"2024-09-12T00:38:46.293031+0000","last_clean":"2024-09-12T00:38:46.293031+0000","last_became_active":"2024-09-12T00:01:46.505315+0000","last_became_peered":"2024-09-12T00:01:46.505315+0000","last_unstale":"2024-09-12T00:38:46.293031+0000","last_undegraded":"2024-09-12T00:38:46.293031+0000","last_fullsized":"2024-09-12T00:38:46.293031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:46.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:46.292895+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:49.074578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079890600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.350339+0000","last_change":"2024-09-12T00:38:59.350339+0000","last_active":"2024-09-12T00:38:59.350339+0000","last_peered":"2024-09-12T00:38:59.350339+0000","last_clean":"2024-09-12T00:38:59.350339+0000","last_became_active":"2024-09-12T00:02:01.148650+0000","last_became_peered":"2024-09-12T00:02:01.148650+0000","last_unstale":"2024-09-12T00:38:59.350339+0000","last_undegraded":"2024-09-12T00:38:59.350339+0000","last_fullsized":"2024-09-12T00:38:59.350339+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.350248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.350248+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.350248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:16.730657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'171","reported_seq":724,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.977304+0000","last_change":"2024-09-12T00:39:02.977304+0000","last_active":"2024-09-12T00:39:02.977304+0000","last_peered":"2024-09-12T00:39:02.977304+0000","last_clean":"2024-09-12T00:39:02.977304+0000","last_became_active":"2024-09-12T00:02:03.153640+0000","last_became_peered":"2024-09-12T00:02:03.153640+0000","last_unstale":"2024-09-12T00:39:02.977304+0000","last_undegraded":"2024-09-12T00:39:02.977304+0000","last_fullsized":"2024-09-12T00:39:02.977304+0000","mapping_epoch":30,"log_start":"258'100","ondisk_log_start":"258'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'171","last_scrub_stamp":"2024-09-12T00:39:02.977209+0000","last_deep_scrub":"261'171","last_deep_scrub_stamp":"2024-09-12T00:39:02.977209+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.977209+0000","objects_scrubbed":9,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:04.239995+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":206,"num_read_kb":198,"num_write":166,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'775","reported_seq":2516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.457205+0000","last_change":"2024-09-12T00:39:04.457205+0000","last_active":"2024-09-12T00:39:04.457205+0000","last_peered":"2024-09-12T00:39:04.457205+0000","last_clean":"2024-09-12T00:39:04.457205+0000","last_became_active":"2024-09-12T00:02:05.163720+0000","last_became_peered":"2024-09-12T00:02:05.163720+0000","last_unstale":"2024-09-12T00:39:04.457205+0000","last_undegraded":"2024-09-12T00:39:04.457205+0000","last_fullsized":"2024-09-12T00:39:04.457205+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'775","last_scrub_stamp":"2024-09-12T00:39:04.457118+0000","last_deep_scrub":"261'775","last_deep_scrub_stamp":"2024-09-12T00:39:04.457118+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.457118+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:32.148688+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'126","reported_seq":630,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.987695+0000","last_change":"2024-09-12T00:39:08.987695+0000","last_active":"2024-09-12T00:39:08.987695+0000","last_peered":"2024-09-12T00:39:08.987695+0000","last_clean":"2024-09-12T00:39:08.987695+0000","last_became_active":"2024-09-12T00:02:07.167797+0000","last_became_peered":"2024-09-12T00:02:07.167797+0000","last_unstale":"2024-09-12T00:39:08.987695+0000","last_undegraded":"2024-09-12T00:39:08.987695+0000","last_fullsized":"2024-09-12T00:39:08.987695+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'126","last_scrub_stamp":"2024-09-12T00:39:08.987597+0000","last_deep_scrub":"261'126","last_deep_scrub_stamp":"2024-09-12T00:39:08.987597+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.987597+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:50.893548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":159,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'140","reported_seq":733,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.505700+0000","last_change":"2024-09-12T00:38:56.505700+0000","last_active":"2024-09-12T00:38:56.505700+0000","last_peered":"2024-09-12T00:38:56.505700+0000","last_clean":"2024-09-12T00:38:56.505700+0000","last_became_active":"2024-09-12T00:01:59.155117+0000","last_became_peered":"2024-09-12T00:01:59.155117+0000","last_unstale":"2024-09-12T00:38:56.505700+0000","last_undegraded":"2024-09-12T00:38:56.505700+0000","last_fullsized":"2024-09-12T00:38:56.505700+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'140","last_scrub_stamp":"2024-09-12T00:38:56.505585+0000","last_deep_scrub":"261'140","last_deep_scrub_stamp":"2024-09-12T00:38:56.505585+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.505585+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:27.206689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":474,"num_write":223,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'363","reported_seq":1032,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.665051+0000","last_change":"2024-09-12T00:38:44.664927+0000","last_active":"2024-09-12T00:38:44.665051+0000","last_peered":"2024-09-12T00:38:44.665051+0000","last_clean":"2024-09-12T00:38:44.665051+0000","last_became_active":"2024-09-12T00:01:57.134235+0000","last_became_peered":"2024-09-12T00:01:57.134235+0000","last_unstale":"2024-09-12T00:38:44.665051+0000","last_undegraded":"2024-09-12T00:38:44.665051+0000","last_fullsized":"2024-09-12T00:38:44.665051+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'363","last_scrub_stamp":"2024-09-12T00:38:44.664703+0000","last_deep_scrub":"261'363","last_deep_scrub_stamp":"2024-09-12T00:38:44.664703+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.664703+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:21.197836+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":525,"num_read_kb":31500,"num_write":1186,"num_write_kb":36639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":522,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.616652+0000","last_change":"2024-09-12T00:38:43.616652+0000","last_active":"2024-09-12T00:38:43.616652+0000","last_peered":"2024-09-12T00:38:43.616652+0000","last_clean":"2024-09-12T00:38:43.616652+0000","last_became_active":"2024-09-12T00:01:46.508144+0000","last_became_peered":"2024-09-12T00:01:46.508144+0000","last_unstale":"2024-09-12T00:38:43.616652+0000","last_undegraded":"2024-09-12T00:38:43.616652+0000","last_fullsized":"2024-09-12T00:38:43.616652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:43.616556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:43.616556+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.616556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:21.006725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045024799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.192851+0000","last_change":"2024-09-12T00:39:04.192851+0000","last_active":"2024-09-12T00:39:04.192851+0000","last_peered":"2024-09-12T00:39:04.192851+0000","last_clean":"2024-09-12T00:39:04.192851+0000","last_became_active":"2024-09-12T00:02:01.153207+0000","last_became_peered":"2024-09-12T00:02:01.153207+0000","last_unstale":"2024-09-12T00:39:04.192851+0000","last_undegraded":"2024-09-12T00:39:04.192851+0000","last_fullsized":"2024-09-12T00:39:04.192851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:04.192765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:04.192765+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.192765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:13.276069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'113","reported_seq":645,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.218869+0000","last_change":"2024-09-12T00:39:15.218869+0000","last_active":"2024-09-12T00:39:15.218869+0000","last_peered":"2024-09-12T00:39:15.218869+0000","last_clean":"2024-09-12T00:39:15.218869+0000","last_became_active":"2024-09-12T00:02:03.151029+0000","last_became_peered":"2024-09-12T00:02:03.151029+0000","last_unstale":"2024-09-12T00:39:15.218869+0000","last_undegraded":"2024-09-12T00:39:15.218869+0000","last_fullsized":"2024-09-12T00:39:15.218869+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'113","last_scrub_stamp":"2024-09-12T00:39:15.218665+0000","last_deep_scrub":"261'113","last_deep_scrub_stamp":"2024-09-12T00:39:15.218665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.218665+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:05.358020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":125,"num_read_kb":114,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'783","reported_seq":4568,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.721571+0000","last_change":"2024-09-12T00:39:11.721571+0000","last_active":"2024-09-12T00:39:11.721571+0000","last_peered":"2024-09-12T00:39:11.721571+0000","last_clean":"2024-09-12T00:39:11.721571+0000","last_became_active":"2024-09-12T00:02:05.162687+0000","last_became_peered":"2024-09-12T00:02:05.162687+0000","last_unstale":"2024-09-12T00:39:11.721571+0000","last_undegraded":"2024-09-12T00:39:11.721571+0000","last_fullsized":"2024-09-12T00:39:11.721571+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'783","last_scrub_stamp":"2024-09-12T00:39:11.721483+0000","last_deep_scrub":"261'783","last_deep_scrub_stamp":"2024-09-12T00:39:11.721483+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.721483+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:21.670225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'160","reported_seq":670,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.839184+0000","last_change":"2024-09-12T00:39:18.839184+0000","last_active":"2024-09-12T00:39:18.839184+0000","last_peered":"2024-09-12T00:39:18.839184+0000","last_clean":"2024-09-12T00:39:18.839184+0000","last_became_active":"2024-09-12T00:02:07.166471+0000","last_became_peered":"2024-09-12T00:02:07.166471+0000","last_unstale":"2024-09-12T00:39:18.839184+0000","last_undegraded":"2024-09-12T00:39:18.839184+0000","last_fullsized":"2024-09-12T00:39:18.839184+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'160","last_scrub_stamp":"2024-09-12T00:39:18.839083+0000","last_deep_scrub":"261'160","last_deep_scrub_stamp":"2024-09-12T00:39:18.839083+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.839083+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:11.339915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":126,"num_write":337,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'82","reported_seq":647,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.050312+0000","last_change":"2024-09-12T00:38:50.050312+0000","last_active":"2024-09-12T00:38:50.050312+0000","last_peered":"2024-09-12T00:38:50.050312+0000","last_clean":"2024-09-12T00:38:50.050312+0000","last_became_active":"2024-09-12T00:01:59.157044+0000","last_became_peered":"2024-09-12T00:01:59.157044+0000","last_unstale":"2024-09-12T00:38:50.050312+0000","last_undegraded":"2024-09-12T00:38:50.050312+0000","last_fullsized":"2024-09-12T00:38:50.050312+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'82","last_scrub_stamp":"2024-09-12T00:38:50.050227+0000","last_deep_scrub":"261'82","last_deep_scrub_stamp":"2024-09-12T00:38:50.050227+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.050227+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:56.828569+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":122,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'433","reported_seq":1076,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.511299+0000","last_change":"2024-09-12T00:38:51.511299+0000","last_active":"2024-09-12T00:38:51.511299+0000","last_peered":"2024-09-12T00:38:51.511299+0000","last_clean":"2024-09-12T00:38:51.511299+0000","last_became_active":"2024-09-12T00:01:57.134646+0000","last_became_peered":"2024-09-12T00:01:57.134646+0000","last_unstale":"2024-09-12T00:38:51.511299+0000","last_undegraded":"2024-09-12T00:38:51.511299+0000","last_fullsized":"2024-09-12T00:38:51.511299+0000","mapping_epoch":24,"log_start":"261'400","ondisk_log_start":"261'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-12T00:38:51.511171+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-12T00:38:51.511171+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.511171+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:11.090003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":740,"num_read_kb":1717,"num_write":1248,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.334916+0000","last_change":"2024-09-12T00:38:47.334916+0000","last_active":"2024-09-12T00:38:47.334916+0000","last_peered":"2024-09-12T00:38:47.334916+0000","last_clean":"2024-09-12T00:38:47.334916+0000","last_became_active":"2024-09-12T00:01:46.502847+0000","last_became_peered":"2024-09-12T00:01:46.502847+0000","last_unstale":"2024-09-12T00:38:47.334916+0000","last_undegraded":"2024-09-12T00:38:47.334916+0000","last_fullsized":"2024-09-12T00:38:47.334916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:47.334821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:47.334821+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.334821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:23.467970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.585235+0000","last_change":"2024-09-12T00:38:59.585235+0000","last_active":"2024-09-12T00:38:59.585235+0000","last_peered":"2024-09-12T00:38:59.585235+0000","last_clean":"2024-09-12T00:38:59.585235+0000","last_became_active":"2024-09-12T00:02:01.152467+0000","last_became_peered":"2024-09-12T00:02:01.152467+0000","last_unstale":"2024-09-12T00:38:59.585235+0000","last_undegraded":"2024-09-12T00:38:59.585235+0000","last_fullsized":"2024-09-12T00:38:59.585235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.585108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.585108+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.585108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:47.921762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'755","reported_seq":1476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.334341+0000","last_change":"2024-09-12T00:39:01.334341+0000","last_active":"2024-09-12T00:39:01.334341+0000","last_peered":"2024-09-12T00:39:01.334341+0000","last_clean":"2024-09-12T00:39:01.334341+0000","last_became_active":"2024-09-12T00:02:03.151140+0000","last_became_peered":"2024-09-12T00:02:03.151140+0000","last_unstale":"2024-09-12T00:39:01.334341+0000","last_undegraded":"2024-09-12T00:39:01.334341+0000","last_fullsized":"2024-09-12T00:39:01.334341+0000","mapping_epoch":30,"log_start":"261'700","ondisk_log_start":"261'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'755","last_scrub_stamp":"2024-09-12T00:39:01.334248+0000","last_deep_scrub":"261'755","last_deep_scrub_stamp":"2024-09-12T00:39:01.334248+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.334248+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:13.575310+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136648,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1342,"num_read_kb":3221,"num_write":1108,"num_write_kb":930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.706319+0000","last_change":"2024-09-12T00:39:14.706319+0000","last_active":"2024-09-12T00:39:14.706319+0000","last_peered":"2024-09-12T00:39:14.706319+0000","last_clean":"2024-09-12T00:39:14.706319+0000","last_became_active":"2024-09-12T00:02:05.168419+0000","last_became_peered":"2024-09-12T00:02:05.168419+0000","last_unstale":"2024-09-12T00:39:14.706319+0000","last_undegraded":"2024-09-12T00:39:14.706319+0000","last_fullsized":"2024-09-12T00:39:14.706319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:14.706224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:14.706224+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.706224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:02.583767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'143","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.153063+0000","last_change":"2024-09-12T00:39:07.153063+0000","last_active":"2024-09-12T00:39:07.153063+0000","last_peered":"2024-09-12T00:39:07.153063+0000","last_clean":"2024-09-12T00:39:07.153063+0000","last_became_active":"2024-09-12T00:02:07.169937+0000","last_became_peered":"2024-09-12T00:02:07.169937+0000","last_unstale":"2024-09-12T00:39:07.153063+0000","last_undegraded":"2024-09-12T00:39:07.153063+0000","last_fullsized":"2024-09-12T00:39:07.153063+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'143","last_scrub_stamp":"2024-09-12T00:39:07.152972+0000","last_deep_scrub":"261'143","last_deep_scrub_stamp":"2024-09-12T00:39:07.152972+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.152972+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:09.115364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":184,"num_read_kb":169,"num_write":343,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'134","reported_seq":687,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.680171+0000","last_change":"2024-09-12T00:39:19.680171+0000","last_active":"2024-09-12T00:39:19.680171+0000","last_peered":"2024-09-12T00:39:19.680171+0000","last_clean":"2024-09-12T00:39:19.680171+0000","last_became_active":"2024-09-12T00:02:07.173094+0000","last_became_peered":"2024-09-12T00:02:07.173094+0000","last_unstale":"2024-09-12T00:39:19.680171+0000","last_undegraded":"2024-09-12T00:39:19.680171+0000","last_fullsized":"2024-09-12T00:39:19.680171+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'134","last_scrub_stamp":"2024-09-12T00:39:19.680058+0000","last_deep_scrub":"261'134","last_deep_scrub_stamp":"2024-09-12T00:39:19.680058+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.680058+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:25.672209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":191,"num_read_kb":191,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'183","reported_seq":780,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.104367+0000","last_change":"2024-09-12T00:38:53.104304+0000","last_active":"2024-09-12T00:38:53.104367+0000","last_peered":"2024-09-12T00:38:53.104367+0000","last_clean":"2024-09-12T00:38:53.104367+0000","last_became_active":"2024-09-12T00:01:59.154463+0000","last_became_peered":"2024-09-12T00:01:59.154463+0000","last_unstale":"2024-09-12T00:38:53.104367+0000","last_undegraded":"2024-09-12T00:38:53.104367+0000","last_fullsized":"2024-09-12T00:38:53.104367+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'183","last_scrub_stamp":"2024-09-12T00:38:53.104215+0000","last_deep_scrub":"261'183","last_deep_scrub_stamp":"2024-09-12T00:38:53.104215+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.104215+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:44.019441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":794,"num_read_kb":651,"num_write":258,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'344","reported_seq":989,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.246016+0000","last_change":"2024-09-12T00:38:53.245956+0000","last_active":"2024-09-12T00:38:53.246016+0000","last_peered":"2024-09-12T00:38:53.246016+0000","last_clean":"2024-09-12T00:38:53.246016+0000","last_became_active":"2024-09-12T00:01:57.163847+0000","last_became_peered":"2024-09-12T00:01:57.163847+0000","last_unstale":"2024-09-12T00:38:53.246016+0000","last_undegraded":"2024-09-12T00:38:53.246016+0000","last_fullsized":"2024-09-12T00:38:53.246016+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'344","last_scrub_stamp":"2024-09-12T00:38:53.245846+0000","last_deep_scrub":"261'344","last_deep_scrub_stamp":"2024-09-12T00:38:53.245846+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.245846+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:07.900488+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291524,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":515,"num_read_kb":27216,"num_write":1109,"num_write_kb":33935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.933276+0000","last_change":"2024-09-12T00:39:00.933189+0000","last_active":"2024-09-12T00:39:00.933276+0000","last_peered":"2024-09-12T00:39:00.933276+0000","last_clean":"2024-09-12T00:39:00.933276+0000","last_became_active":"2024-09-12T00:02:01.144579+0000","last_became_peered":"2024-09-12T00:02:01.144579+0000","last_unstale":"2024-09-12T00:39:00.933276+0000","last_undegraded":"2024-09-12T00:39:00.933276+0000","last_fullsized":"2024-09-12T00:39:00.933276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:00.933071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:00.933071+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.933071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:49.735936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'301","reported_seq":870,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.984892+0000","last_change":"2024-09-12T00:39:04.984786+0000","last_active":"2024-09-12T00:39:04.984892+0000","last_peered":"2024-09-12T00:39:04.984892+0000","last_clean":"2024-09-12T00:39:04.984892+0000","last_became_active":"2024-09-12T00:02:03.154710+0000","last_became_peered":"2024-09-12T00:02:03.154710+0000","last_unstale":"2024-09-12T00:39:04.984892+0000","last_undegraded":"2024-09-12T00:39:04.984892+0000","last_fullsized":"2024-09-12T00:39:04.984892+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'301","last_scrub_stamp":"2024-09-12T00:39:04.984680+0000","last_deep_scrub":"261'301","last_deep_scrub_stamp":"2024-09-12T00:39:04.984680+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.984680+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:02.248554+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46247,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":469,"num_read_kb":1061,"num_write":388,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.953824+0000","last_change":"2024-09-12T00:39:03.953737+0000","last_active":"2024-09-12T00:39:03.953824+0000","last_peered":"2024-09-12T00:39:03.953824+0000","last_clean":"2024-09-12T00:39:03.953824+0000","last_became_active":"2024-09-12T00:02:05.163389+0000","last_became_peered":"2024-09-12T00:02:05.163389+0000","last_unstale":"2024-09-12T00:39:03.953824+0000","last_undegraded":"2024-09-12T00:39:03.953824+0000","last_fullsized":"2024-09-12T00:39:03.953824+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:03.953638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:03.953638+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.953638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:00.527480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'118","reported_seq":601,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.938839+0000","last_change":"2024-09-12T00:39:09.938839+0000","last_active":"2024-09-12T00:39:09.938839+0000","last_peered":"2024-09-12T00:39:09.938839+0000","last_clean":"2024-09-12T00:39:09.938839+0000","last_became_active":"2024-09-12T00:02:07.172360+0000","last_became_peered":"2024-09-12T00:02:07.172360+0000","last_unstale":"2024-09-12T00:39:09.938839+0000","last_undegraded":"2024-09-12T00:39:09.938839+0000","last_fullsized":"2024-09-12T00:39:09.938839+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'118","last_scrub_stamp":"2024-09-12T00:39:09.938737+0000","last_deep_scrub":"261'118","last_deep_scrub_stamp":"2024-09-12T00:39:09.938737+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.938737+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:26.730532+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'116","reported_seq":724,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.464113+0000","last_change":"2024-09-12T00:38:53.463997+0000","last_active":"2024-09-12T00:38:53.464113+0000","last_peered":"2024-09-12T00:38:53.464113+0000","last_clean":"2024-09-12T00:38:53.464113+0000","last_became_active":"2024-09-12T00:01:59.155287+0000","last_became_peered":"2024-09-12T00:01:59.155287+0000","last_unstale":"2024-09-12T00:38:53.464113+0000","last_undegraded":"2024-09-12T00:38:53.464113+0000","last_fullsized":"2024-09-12T00:38:53.464113+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'116","last_scrub_stamp":"2024-09-12T00:38:53.463870+0000","last_deep_scrub":"261'116","last_deep_scrub_stamp":"2024-09-12T00:38:53.463870+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.463870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:51.953337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":525,"num_read_kb":443,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'336","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.145933+0000","last_change":"2024-09-12T00:38:44.145933+0000","last_active":"2024-09-12T00:38:44.145933+0000","last_peered":"2024-09-12T00:38:44.145933+0000","last_clean":"2024-09-12T00:38:44.145933+0000","last_became_active":"2024-09-12T00:01:57.144743+0000","last_became_peered":"2024-09-12T00:01:57.144743+0000","last_unstale":"2024-09-12T00:38:44.145933+0000","last_undegraded":"2024-09-12T00:38:44.145933+0000","last_fullsized":"2024-09-12T00:38:44.145933+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'336","last_scrub_stamp":"2024-09-12T00:38:44.145810+0000","last_deep_scrub":"261'336","last_deep_scrub_stamp":"2024-09-12T00:38:44.145810+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.145810+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:50.608602+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":7939,"num_write":1030,"num_write_kb":13946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.613371+0000","last_change":"2024-09-12T00:39:04.613308+0000","last_active":"2024-09-12T00:39:04.613371+0000","last_peered":"2024-09-12T00:39:04.613371+0000","last_clean":"2024-09-12T00:39:04.613371+0000","last_became_active":"2024-09-12T00:02:01.150857+0000","last_became_peered":"2024-09-12T00:02:01.150857+0000","last_unstale":"2024-09-12T00:39:04.613371+0000","last_undegraded":"2024-09-12T00:39:04.613371+0000","last_fullsized":"2024-09-12T00:39:04.613371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:04.613218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:04.613218+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.613218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:32.659843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'44","reported_seq":546,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.773124+0000","last_change":"2024-09-12T00:39:08.773044+0000","last_active":"2024-09-12T00:39:08.773124+0000","last_peered":"2024-09-12T00:39:08.773124+0000","last_clean":"2024-09-12T00:39:08.773124+0000","last_became_active":"2024-09-12T00:02:03.149558+0000","last_became_peered":"2024-09-12T00:02:03.149558+0000","last_unstale":"2024-09-12T00:39:08.773124+0000","last_undegraded":"2024-09-12T00:39:08.773124+0000","last_fullsized":"2024-09-12T00:39:08.773124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'44","last_scrub_stamp":"2024-09-12T00:39:08.772942+0000","last_deep_scrub":"261'44","last_deep_scrub_stamp":"2024-09-12T00:39:08.772942+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.772942+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:11.724806+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.142589+0000","last_change":"2024-09-12T00:39:08.142463+0000","last_active":"2024-09-12T00:39:08.142589+0000","last_peered":"2024-09-12T00:39:08.142589+0000","last_clean":"2024-09-12T00:39:08.142589+0000","last_became_active":"2024-09-12T00:02:05.170836+0000","last_became_peered":"2024-09-12T00:02:05.170836+0000","last_unstale":"2024-09-12T00:39:08.142589+0000","last_undegraded":"2024-09-12T00:39:08.142589+0000","last_fullsized":"2024-09-12T00:39:08.142589+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:08.142365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:08.142365+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.142365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:14.885052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'260","reported_seq":786,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.004131+0000","last_change":"2024-09-12T00:39:13.004131+0000","last_active":"2024-09-12T00:39:13.004131+0000","last_peered":"2024-09-12T00:39:13.004131+0000","last_clean":"2024-09-12T00:39:13.004131+0000","last_became_active":"2024-09-12T00:02:07.168678+0000","last_became_peered":"2024-09-12T00:02:07.168678+0000","last_unstale":"2024-09-12T00:39:13.004131+0000","last_undegraded":"2024-09-12T00:39:13.004131+0000","last_fullsized":"2024-09-12T00:39:13.004131+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'260","last_scrub_stamp":"2024-09-12T00:39:13.004011+0000","last_deep_scrub":"261'260","last_deep_scrub_stamp":"2024-09-12T00:39:13.004011+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.004011+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:28.806126+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":392,"num_read_kb":368,"num_write":602,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'4088","reported_seq":4647,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.470038+0000","last_change":"2024-09-12T00:38:52.469941+0000","last_active":"2024-09-12T00:38:52.470038+0000","last_peered":"2024-09-12T00:38:52.470038+0000","last_clean":"2024-09-12T00:38:52.470038+0000","last_became_active":"2024-09-12T00:01:59.154260+0000","last_became_peered":"2024-09-12T00:01:59.154260+0000","last_unstale":"2024-09-12T00:38:52.470038+0000","last_undegraded":"2024-09-12T00:38:52.470038+0000","last_fullsized":"2024-09-12T00:38:52.470038+0000","mapping_epoch":26,"log_start":"261'4000","ondisk_log_start":"261'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4088","last_scrub_stamp":"2024-09-12T00:38:52.469853+0000","last_deep_scrub":"261'4088","last_deep_scrub_stamp":"2024-09-12T00:38:52.469853+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.469853+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:37.050318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16394,"num_read_kb":13744,"num_write":6133,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'298","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.977235+0000","last_change":"2024-09-12T00:38:44.977235+0000","last_active":"2024-09-12T00:38:44.977235+0000","last_peered":"2024-09-12T00:38:44.977235+0000","last_clean":"2024-09-12T00:38:44.977235+0000","last_became_active":"2024-09-12T00:01:57.158677+0000","last_became_peered":"2024-09-12T00:01:57.158677+0000","last_unstale":"2024-09-12T00:38:44.977235+0000","last_undegraded":"2024-09-12T00:38:44.977235+0000","last_fullsized":"2024-09-12T00:38:44.977235+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'298","last_scrub_stamp":"2024-09-12T00:38:44.977107+0000","last_deep_scrub":"261'298","last_deep_scrub_stamp":"2024-09-12T00:38:44.977107+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.977107+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:41.638070+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174545,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":398,"num_read_kb":56505,"num_write":935,"num_write_kb":31346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.205696+0000","last_change":"2024-09-12T00:38:58.205604+0000","last_active":"2024-09-12T00:38:58.205696+0000","last_peered":"2024-09-12T00:38:58.205696+0000","last_clean":"2024-09-12T00:38:58.205696+0000","last_became_active":"2024-09-12T00:02:01.155490+0000","last_became_peered":"2024-09-12T00:02:01.155490+0000","last_unstale":"2024-09-12T00:38:58.205696+0000","last_undegraded":"2024-09-12T00:38:58.205696+0000","last_fullsized":"2024-09-12T00:38:58.205696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:58.205501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:58.205501+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.205501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:52.049489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'288","reported_seq":864,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.896792+0000","last_change":"2024-09-12T00:39:00.896733+0000","last_active":"2024-09-12T00:39:00.896792+0000","last_peered":"2024-09-12T00:39:00.896792+0000","last_clean":"2024-09-12T00:39:00.896792+0000","last_became_active":"2024-09-12T00:02:03.148690+0000","last_became_peered":"2024-09-12T00:02:03.148690+0000","last_unstale":"2024-09-12T00:39:00.896792+0000","last_undegraded":"2024-09-12T00:39:00.896792+0000","last_fullsized":"2024-09-12T00:39:00.896792+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'288","last_scrub_stamp":"2024-09-12T00:39:00.896639+0000","last_deep_scrub":"261'288","last_deep_scrub_stamp":"2024-09-12T00:39:00.896639+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.896639+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:17.219963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45068,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1019,"num_write":374,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.367739+0000","last_change":"2024-09-12T00:39:16.367739+0000","last_active":"2024-09-12T00:39:16.367739+0000","last_peered":"2024-09-12T00:39:16.367739+0000","last_clean":"2024-09-12T00:39:16.367739+0000","last_became_active":"2024-09-12T00:02:05.168232+0000","last_became_peered":"2024-09-12T00:02:05.168232+0000","last_unstale":"2024-09-12T00:39:16.367739+0000","last_undegraded":"2024-09-12T00:39:16.367739+0000","last_fullsized":"2024-09-12T00:39:16.367739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.367631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.367631+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.367631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:41.610148+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'134","reported_seq":667,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:58.879910+0000","last_change":"2024-09-12T00:02:07.169044+0000","last_active":"2024-09-12T00:36:58.879910+0000","last_peered":"2024-09-12T00:36:58.879910+0000","last_clean":"2024-09-12T00:36:58.879910+0000","last_became_active":"2024-09-12T00:02:07.168747+0000","last_became_peered":"2024-09-12T00:02:07.168747+0000","last_unstale":"2024-09-12T00:36:58.879910+0000","last_undegraded":"2024-09-12T00:36:58.879910+0000","last_fullsized":"2024-09-12T00:36:58.879910+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:23.448210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":291,"num_read_kb":255,"num_write":337,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'104","reported_seq":682,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.791782+0000","last_change":"2024-09-12T00:38:49.791694+0000","last_active":"2024-09-12T00:38:49.791782+0000","last_peered":"2024-09-12T00:38:49.791782+0000","last_clean":"2024-09-12T00:38:49.791782+0000","last_became_active":"2024-09-12T00:01:59.154848+0000","last_became_peered":"2024-09-12T00:01:59.154848+0000","last_unstale":"2024-09-12T00:38:49.791782+0000","last_undegraded":"2024-09-12T00:38:49.791782+0000","last_fullsized":"2024-09-12T00:38:49.791782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'104","last_scrub_stamp":"2024-09-12T00:38:49.791355+0000","last_deep_scrub":"261'104","last_deep_scrub_stamp":"2024-09-12T00:38:49.791355+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.791355+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:55.148174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":392,"num_write":152,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'307","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.779506+0000","last_change":"2024-09-12T00:38:45.779506+0000","last_active":"2024-09-12T00:38:45.779506+0000","last_peered":"2024-09-12T00:38:45.779506+0000","last_clean":"2024-09-12T00:38:45.779506+0000","last_became_active":"2024-09-12T00:01:57.142385+0000","last_became_peered":"2024-09-12T00:01:57.142385+0000","last_unstale":"2024-09-12T00:38:45.779506+0000","last_undegraded":"2024-09-12T00:38:45.779506+0000","last_fullsized":"2024-09-12T00:38:45.779506+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'307","last_scrub_stamp":"2024-09-12T00:38:45.779328+0000","last_deep_scrub":"261'307","last_deep_scrub_stamp":"2024-09-12T00:38:45.779328+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.779328+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:38.402035+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267376,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":608,"num_read_kb":9162,"num_write":1027,"num_write_kb":16984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.264896+0000","last_change":"2024-09-12T00:39:09.264827+0000","last_active":"2024-09-12T00:39:09.264896+0000","last_peered":"2024-09-12T00:39:09.264896+0000","last_clean":"2024-09-12T00:39:09.264896+0000","last_became_active":"2024-09-12T00:02:01.153906+0000","last_became_peered":"2024-09-12T00:02:01.153906+0000","last_unstale":"2024-09-12T00:39:09.264896+0000","last_undegraded":"2024-09-12T00:39:09.264896+0000","last_fullsized":"2024-09-12T00:39:09.264896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:09.264735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:09.264735+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.264735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:09.765221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'252","reported_seq":820,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.318052+0000","last_change":"2024-09-12T00:39:04.317979+0000","last_active":"2024-09-12T00:39:04.318052+0000","last_peered":"2024-09-12T00:39:04.318052+0000","last_clean":"2024-09-12T00:39:04.318052+0000","last_became_active":"2024-09-12T00:02:03.154896+0000","last_became_peered":"2024-09-12T00:02:03.154896+0000","last_unstale":"2024-09-12T00:39:04.318052+0000","last_undegraded":"2024-09-12T00:39:04.318052+0000","last_fullsized":"2024-09-12T00:39:04.318052+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'252","last_scrub_stamp":"2024-09-12T00:39:04.317880+0000","last_deep_scrub":"261'252","last_deep_scrub_stamp":"2024-09-12T00:39:04.317880+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.317880+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:18.759091+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":962,"num_write":334,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.944979+0000","last_change":"2024-09-12T00:39:04.944929+0000","last_active":"2024-09-12T00:39:04.944979+0000","last_peered":"2024-09-12T00:39:04.944979+0000","last_clean":"2024-09-12T00:39:04.944979+0000","last_became_active":"2024-09-12T00:02:05.162204+0000","last_became_peered":"2024-09-12T00:02:05.162204+0000","last_unstale":"2024-09-12T00:39:04.944979+0000","last_undegraded":"2024-09-12T00:39:04.944979+0000","last_fullsized":"2024-09-12T00:39:04.944979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:04.944845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:04.944845+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.944845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:13.193383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'126","reported_seq":687,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.158511+0000","last_change":"2024-09-12T00:39:00.158511+0000","last_active":"2024-09-12T00:39:00.158511+0000","last_peered":"2024-09-12T00:39:00.158511+0000","last_clean":"2024-09-12T00:39:00.158511+0000","last_became_active":"2024-09-12T00:01:59.145456+0000","last_became_peered":"2024-09-12T00:01:59.145456+0000","last_unstale":"2024-09-12T00:39:00.158511+0000","last_undegraded":"2024-09-12T00:39:00.158511+0000","last_fullsized":"2024-09-12T00:39:00.158511+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'126","last_scrub_stamp":"2024-09-12T00:39:00.158426+0000","last_deep_scrub":"261'126","last_deep_scrub_stamp":"2024-09-12T00:39:00.158426+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.158426+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:15.829990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":512,"num_read_kb":415,"num_write":196,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'379","reported_seq":1018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.785930+0000","last_change":"2024-09-12T00:38:47.785930+0000","last_active":"2024-09-12T00:38:47.785930+0000","last_peered":"2024-09-12T00:38:47.785930+0000","last_clean":"2024-09-12T00:38:47.785930+0000","last_became_active":"2024-09-12T00:01:57.143684+0000","last_became_peered":"2024-09-12T00:01:57.143684+0000","last_unstale":"2024-09-12T00:38:47.785930+0000","last_undegraded":"2024-09-12T00:38:47.785930+0000","last_fullsized":"2024-09-12T00:38:47.785930+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'379","last_scrub_stamp":"2024-09-12T00:38:47.785711+0000","last_deep_scrub":"261'379","last_deep_scrub_stamp":"2024-09-12T00:38:47.785711+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.785711+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:31.165040+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":509,"num_read_kb":22065,"num_write":1209,"num_write_kb":32922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.933001+0000","last_change":"2024-09-12T00:39:01.933001+0000","last_active":"2024-09-12T00:39:01.933001+0000","last_peered":"2024-09-12T00:39:01.933001+0000","last_clean":"2024-09-12T00:39:01.933001+0000","last_became_active":"2024-09-12T00:02:01.154541+0000","last_became_peered":"2024-09-12T00:02:01.154541+0000","last_unstale":"2024-09-12T00:39:01.933001+0000","last_undegraded":"2024-09-12T00:39:01.933001+0000","last_fullsized":"2024-09-12T00:39:01.933001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:01.932891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:01.932891+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.932891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:16.732784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'496","reported_seq":1120,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.005218+0000","last_change":"2024-09-12T00:39:07.005218+0000","last_active":"2024-09-12T00:39:07.005218+0000","last_peered":"2024-09-12T00:39:07.005218+0000","last_clean":"2024-09-12T00:39:07.005218+0000","last_became_active":"2024-09-12T00:02:03.158360+0000","last_became_peered":"2024-09-12T00:02:03.158360+0000","last_unstale":"2024-09-12T00:39:07.005218+0000","last_undegraded":"2024-09-12T00:39:07.005218+0000","last_fullsized":"2024-09-12T00:39:07.005218+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'496","last_scrub_stamp":"2024-09-12T00:39:07.005126+0000","last_deep_scrub":"261'496","last_deep_scrub_stamp":"2024-09-12T00:39:07.005126+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.005126+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:16.952892+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92045,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":891,"num_read_kb":2130,"num_write":768,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":476,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.203260+0000","last_change":"2024-09-12T00:39:05.203260+0000","last_active":"2024-09-12T00:39:05.203260+0000","last_peered":"2024-09-12T00:39:05.203260+0000","last_clean":"2024-09-12T00:39:05.203260+0000","last_became_active":"2024-09-12T00:02:05.167052+0000","last_became_peered":"2024-09-12T00:02:05.167052+0000","last_unstale":"2024-09-12T00:39:05.203260+0000","last_undegraded":"2024-09-12T00:39:05.203260+0000","last_fullsized":"2024-09-12T00:39:05.203260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:05.203162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:05.203162+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.203162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:33.095842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'208","reported_seq":714,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.814996+0000","last_change":"2024-09-12T00:39:20.814996+0000","last_active":"2024-09-12T00:39:20.814996+0000","last_peered":"2024-09-12T00:39:20.814996+0000","last_clean":"2024-09-12T00:39:20.814996+0000","last_became_active":"2024-09-12T00:02:07.167331+0000","last_became_peered":"2024-09-12T00:02:07.167331+0000","last_unstale":"2024-09-12T00:39:20.814996+0000","last_undegraded":"2024-09-12T00:39:20.814996+0000","last_fullsized":"2024-09-12T00:39:20.814996+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'208","last_scrub_stamp":"2024-09-12T00:39:20.814891+0000","last_deep_scrub":"261'208","last_deep_scrub_stamp":"2024-09-12T00:39:20.814891+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.814891+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:29.301110+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":483,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'399","reported_seq":1166,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.501525+0000","last_change":"2024-09-12T00:38:55.501525+0000","last_active":"2024-09-12T00:38:55.501525+0000","last_peered":"2024-09-12T00:38:55.501525+0000","last_clean":"2024-09-12T00:38:55.501525+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:38:55.501525+0000","last_undegraded":"2024-09-12T00:38:55.501525+0000","last_fullsized":"2024-09-12T00:38:55.501525+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'399","last_scrub_stamp":"2024-09-12T00:38:55.501439+0000","last_deep_scrub":"261'399","last_deep_scrub_stamp":"2024-09-12T00:38:55.501439+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.501439+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:17.884111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1910,"num_read_kb":1650,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25748,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'351","reported_seq":1035,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.618535+0000","last_change":"2024-09-12T00:38:45.618535+0000","last_active":"2024-09-12T00:38:45.618535+0000","last_peered":"2024-09-12T00:38:45.618535+0000","last_clean":"2024-09-12T00:38:45.618535+0000","last_became_active":"2024-09-12T00:01:57.141998+0000","last_became_peered":"2024-09-12T00:01:57.141998+0000","last_unstale":"2024-09-12T00:38:45.618535+0000","last_undegraded":"2024-09-12T00:38:45.618535+0000","last_fullsized":"2024-09-12T00:38:45.618535+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'351","last_scrub_stamp":"2024-09-12T00:38:45.618369+0000","last_deep_scrub":"261'351","last_deep_scrub_stamp":"2024-09-12T00:38:45.618369+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.618369+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:31.142149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":1840,"num_write":1203,"num_write_kb":17126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.212928+0000","last_change":"2024-09-12T00:39:00.212928+0000","last_active":"2024-09-12T00:39:00.212928+0000","last_peered":"2024-09-12T00:39:00.212928+0000","last_clean":"2024-09-12T00:39:00.212928+0000","last_became_active":"2024-09-12T00:02:01.153611+0000","last_became_peered":"2024-09-12T00:02:01.153611+0000","last_unstale":"2024-09-12T00:39:00.212928+0000","last_undegraded":"2024-09-12T00:39:00.212928+0000","last_fullsized":"2024-09-12T00:39:00.212928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:00.212821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:00.212821+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.212821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:09.175487+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'292","reported_seq":864,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.196205+0000","last_change":"2024-09-12T00:39:16.196205+0000","last_active":"2024-09-12T00:39:16.196205+0000","last_peered":"2024-09-12T00:39:16.196205+0000","last_clean":"2024-09-12T00:39:16.196205+0000","last_became_active":"2024-09-12T00:02:03.154821+0000","last_became_peered":"2024-09-12T00:02:03.154821+0000","last_unstale":"2024-09-12T00:39:16.196205+0000","last_undegraded":"2024-09-12T00:39:16.196205+0000","last_fullsized":"2024-09-12T00:39:16.196205+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'292","last_scrub_stamp":"2024-09-12T00:39:16.196072+0000","last_deep_scrub":"261'292","last_deep_scrub_stamp":"2024-09-12T00:39:16.196072+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.196072+0000","objects_scrubbed":8,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:49.625222+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49647,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":1013,"num_write":386,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.742699+0000","last_change":"2024-09-12T00:39:14.742699+0000","last_active":"2024-09-12T00:39:14.742699+0000","last_peered":"2024-09-12T00:39:14.742699+0000","last_clean":"2024-09-12T00:39:14.742699+0000","last_became_active":"2024-09-12T00:02:05.169726+0000","last_became_peered":"2024-09-12T00:02:05.169726+0000","last_unstale":"2024-09-12T00:39:14.742699+0000","last_undegraded":"2024-09-12T00:39:14.742699+0000","last_fullsized":"2024-09-12T00:39:14.742699+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:14.742597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:14.742597+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.742597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:05.171472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'193","reported_seq":1061,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:22.503992+0000","last_change":"2024-09-12T00:02:07.175207+0000","last_active":"2024-09-12T00:37:22.503992+0000","last_peered":"2024-09-12T00:37:22.503992+0000","last_clean":"2024-09-12T00:37:22.503992+0000","last_became_active":"2024-09-12T00:02:07.174910+0000","last_became_peered":"2024-09-12T00:02:07.174910+0000","last_unstale":"2024-09-12T00:37:22.503992+0000","last_undegraded":"2024-09-12T00:37:22.503992+0000","last_fullsized":"2024-09-12T00:37:22.503992+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:19.459374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":668,"num_read_kb":649,"num_write":556,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'98","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.867630+0000","last_change":"2024-09-12T00:38:51.867630+0000","last_active":"2024-09-12T00:38:51.867630+0000","last_peered":"2024-09-12T00:38:51.867630+0000","last_clean":"2024-09-12T00:38:51.867630+0000","last_became_active":"2024-09-12T00:01:59.151143+0000","last_became_peered":"2024-09-12T00:01:59.151143+0000","last_unstale":"2024-09-12T00:38:51.867630+0000","last_undegraded":"2024-09-12T00:38:51.867630+0000","last_fullsized":"2024-09-12T00:38:51.867630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'98","last_scrub_stamp":"2024-09-12T00:38:51.867545+0000","last_deep_scrub":"261'98","last_deep_scrub_stamp":"2024-09-12T00:38:51.867545+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.867545+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:31.009419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":451,"num_read_kb":380,"num_write":139,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'298","reported_seq":894,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.494768+0000","last_change":"2024-09-12T00:38:45.494768+0000","last_active":"2024-09-12T00:38:45.494768+0000","last_peered":"2024-09-12T00:38:45.494768+0000","last_clean":"2024-09-12T00:38:45.494768+0000","last_became_active":"2024-09-12T00:01:57.141789+0000","last_became_peered":"2024-09-12T00:01:57.141789+0000","last_unstale":"2024-09-12T00:38:45.494768+0000","last_undegraded":"2024-09-12T00:38:45.494768+0000","last_fullsized":"2024-09-12T00:38:45.494768+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'298","last_scrub_stamp":"2024-09-12T00:38:45.494662+0000","last_deep_scrub":"261'298","last_deep_scrub_stamp":"2024-09-12T00:38:45.494662+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.494662+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:00.002183+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":381,"num_read_kb":31078,"num_write":882,"num_write_kb":48318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.170256+0000","last_change":"2024-09-12T00:38:59.170256+0000","last_active":"2024-09-12T00:38:59.170256+0000","last_peered":"2024-09-12T00:38:59.170256+0000","last_clean":"2024-09-12T00:38:59.170256+0000","last_became_active":"2024-09-12T00:02:01.154530+0000","last_became_peered":"2024-09-12T00:02:01.154530+0000","last_unstale":"2024-09-12T00:38:59.170256+0000","last_undegraded":"2024-09-12T00:38:59.170256+0000","last_fullsized":"2024-09-12T00:38:59.170256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.170165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.170165+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.170165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:21.430019+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'294","reported_seq":864,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.000618+0000","last_change":"2024-09-12T00:39:08.000618+0000","last_active":"2024-09-12T00:39:08.000618+0000","last_peered":"2024-09-12T00:39:08.000618+0000","last_clean":"2024-09-12T00:39:08.000618+0000","last_became_active":"2024-09-12T00:02:03.156529+0000","last_became_peered":"2024-09-12T00:02:03.156529+0000","last_unstale":"2024-09-12T00:39:08.000618+0000","last_undegraded":"2024-09-12T00:39:08.000618+0000","last_fullsized":"2024-09-12T00:39:08.000618+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'294","last_scrub_stamp":"2024-09-12T00:39:08.000522+0000","last_deep_scrub":"261'294","last_deep_scrub_stamp":"2024-09-12T00:39:08.000522+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.000522+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:58.166295+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53504,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":1158,"num_write":402,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.902267+0000","last_change":"2024-09-12T00:39:05.902267+0000","last_active":"2024-09-12T00:39:05.902267+0000","last_peered":"2024-09-12T00:39:05.902267+0000","last_clean":"2024-09-12T00:39:05.902267+0000","last_became_active":"2024-09-12T00:02:05.163956+0000","last_became_peered":"2024-09-12T00:02:05.163956+0000","last_unstale":"2024-09-12T00:39:05.902267+0000","last_undegraded":"2024-09-12T00:39:05.902267+0000","last_fullsized":"2024-09-12T00:39:05.902267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:05.902175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:05.902175+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.902175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:32.967076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'127","reported_seq":603,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:28.940297+0000","last_change":"2024-09-12T00:02:07.172798+0000","last_active":"2024-09-12T00:38:28.940297+0000","last_peered":"2024-09-12T00:38:28.940297+0000","last_clean":"2024-09-12T00:38:28.940297+0000","last_became_active":"2024-09-12T00:02:07.172496+0000","last_became_peered":"2024-09-12T00:02:07.172496+0000","last_unstale":"2024-09-12T00:38:28.940297+0000","last_undegraded":"2024-09-12T00:38:28.940297+0000","last_fullsized":"2024-09-12T00:38:28.940297+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:11.813869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":307,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'198","reported_seq":836,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.529914+0000","last_change":"2024-09-12T00:38:49.529914+0000","last_active":"2024-09-12T00:38:49.529914+0000","last_peered":"2024-09-12T00:38:49.529914+0000","last_clean":"2024-09-12T00:38:49.529914+0000","last_became_active":"2024-09-12T00:01:59.148559+0000","last_became_peered":"2024-09-12T00:01:59.148559+0000","last_unstale":"2024-09-12T00:38:49.529914+0000","last_undegraded":"2024-09-12T00:38:49.529914+0000","last_fullsized":"2024-09-12T00:38:49.529914+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'198","last_scrub_stamp":"2024-09-12T00:38:49.529821+0000","last_deep_scrub":"261'198","last_deep_scrub_stamp":"2024-09-12T00:38:49.529821+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.529821+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:16.013027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":733,"num_write":278,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'382","reported_seq":1038,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.599821+0000","last_change":"2024-09-12T00:38:47.599821+0000","last_active":"2024-09-12T00:38:47.599821+0000","last_peered":"2024-09-12T00:38:47.599821+0000","last_clean":"2024-09-12T00:38:47.599821+0000","last_became_active":"2024-09-12T00:01:57.144397+0000","last_became_peered":"2024-09-12T00:01:57.144397+0000","last_unstale":"2024-09-12T00:38:47.599821+0000","last_undegraded":"2024-09-12T00:38:47.599821+0000","last_fullsized":"2024-09-12T00:38:47.599821+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'382","last_scrub_stamp":"2024-09-12T00:38:47.599641+0000","last_deep_scrub":"261'382","last_deep_scrub_stamp":"2024-09-12T00:38:47.599641+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.599641+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:34.445067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":577,"num_read_kb":18157,"num_write":1228,"num_write_kb":40983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"261'6","reported_seq":977,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.730359+0000","last_change":"2024-09-12T00:39:07.730359+0000","last_active":"2024-09-12T00:39:07.730359+0000","last_peered":"2024-09-12T00:39:07.730359+0000","last_clean":"2024-09-12T00:39:07.730359+0000","last_became_active":"2024-09-12T00:02:01.151739+0000","last_became_peered":"2024-09-12T00:02:01.151739+0000","last_unstale":"2024-09-12T00:39:07.730359+0000","last_undegraded":"2024-09-12T00:39:07.730359+0000","last_fullsized":"2024-09-12T00:39:07.730359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T00:39:07.730267+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T00:39:07.730267+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.730267+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:55.627773+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'92","reported_seq":609,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.135230+0000","last_change":"2024-09-12T00:39:20.135230+0000","last_active":"2024-09-12T00:39:20.135230+0000","last_peered":"2024-09-12T00:39:20.135230+0000","last_clean":"2024-09-12T00:39:20.135230+0000","last_became_active":"2024-09-12T00:02:03.153948+0000","last_became_peered":"2024-09-12T00:02:03.153948+0000","last_unstale":"2024-09-12T00:39:20.135230+0000","last_undegraded":"2024-09-12T00:39:20.135230+0000","last_fullsized":"2024-09-12T00:39:20.135230+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'92","last_scrub_stamp":"2024-09-12T00:39:20.135116+0000","last_deep_scrub":"261'92","last_deep_scrub_stamp":"2024-09-12T00:39:20.135116+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.135116+0000","objects_scrubbed":8,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:54.634202+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":128,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'765","reported_seq":4288,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.234365+0000","last_change":"2024-09-12T00:39:06.234365+0000","last_active":"2024-09-12T00:39:06.234365+0000","last_peered":"2024-09-12T00:39:06.234365+0000","last_clean":"2024-09-12T00:39:06.234365+0000","last_became_active":"2024-09-12T00:02:05.170399+0000","last_became_peered":"2024-09-12T00:02:05.170399+0000","last_unstale":"2024-09-12T00:39:06.234365+0000","last_undegraded":"2024-09-12T00:39:06.234365+0000","last_fullsized":"2024-09-12T00:39:06.234365+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'765","last_scrub_stamp":"2024-09-12T00:39:06.234288+0000","last_deep_scrub":"261'765","last_deep_scrub_stamp":"2024-09-12T00:39:06.234288+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.234288+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:39.555335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'118","reported_seq":604,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:06.949325+0000","last_change":"2024-09-12T00:02:07.173296+0000","last_active":"2024-09-12T00:37:06.949325+0000","last_peered":"2024-09-12T00:37:06.949325+0000","last_clean":"2024-09-12T00:37:06.949325+0000","last_became_active":"2024-09-12T00:02:07.173030+0000","last_became_peered":"2024-09-12T00:02:07.173030+0000","last_unstale":"2024-09-12T00:37:06.949325+0000","last_undegraded":"2024-09-12T00:37:06.949325+0000","last_fullsized":"2024-09-12T00:37:06.949325+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:13.276457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":288,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'244","reported_seq":881,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.158718+0000","last_change":"2024-09-12T00:38:56.158718+0000","last_active":"2024-09-12T00:38:56.158718+0000","last_peered":"2024-09-12T00:38:56.158718+0000","last_clean":"2024-09-12T00:38:56.158718+0000","last_became_active":"2024-09-12T00:01:59.151743+0000","last_became_peered":"2024-09-12T00:01:59.151743+0000","last_unstale":"2024-09-12T00:38:56.158718+0000","last_undegraded":"2024-09-12T00:38:56.158718+0000","last_fullsized":"2024-09-12T00:38:56.158718+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'244","last_scrub_stamp":"2024-09-12T00:38:56.158624+0000","last_deep_scrub":"261'244","last_deep_scrub_stamp":"2024-09-12T00:38:56.158624+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.158624+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:33.327253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1082,"num_read_kb":884,"num_write":389,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'313","reported_seq":918,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.492902+0000","last_change":"2024-09-12T00:38:43.492902+0000","last_active":"2024-09-12T00:38:43.492902+0000","last_peered":"2024-09-12T00:38:43.492902+0000","last_clean":"2024-09-12T00:38:43.492902+0000","last_became_active":"2024-09-12T00:01:57.144946+0000","last_became_peered":"2024-09-12T00:01:57.144946+0000","last_unstale":"2024-09-12T00:38:43.492902+0000","last_undegraded":"2024-09-12T00:38:43.492902+0000","last_fullsized":"2024-09-12T00:38:43.492902+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'313","last_scrub_stamp":"2024-09-12T00:38:43.492802+0000","last_deep_scrub":"261'313","last_deep_scrub_stamp":"2024-09-12T00:38:43.492802+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.492802+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:17.143075+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":419,"num_read_kb":503,"num_write":968,"num_write_kb":20369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.426009+0000","last_change":"2024-09-12T00:39:00.426009+0000","last_active":"2024-09-12T00:39:00.426009+0000","last_peered":"2024-09-12T00:39:00.426009+0000","last_clean":"2024-09-12T00:39:00.426009+0000","last_became_active":"2024-09-12T00:02:01.152493+0000","last_became_peered":"2024-09-12T00:02:01.152493+0000","last_unstale":"2024-09-12T00:39:00.426009+0000","last_undegraded":"2024-09-12T00:39:00.426009+0000","last_fullsized":"2024-09-12T00:39:00.426009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:00.425924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:00.425924+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.425924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.528302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'323","reported_seq":926,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.285422+0000","last_change":"2024-09-12T00:39:05.285422+0000","last_active":"2024-09-12T00:39:05.285422+0000","last_peered":"2024-09-12T00:39:05.285422+0000","last_clean":"2024-09-12T00:39:05.285422+0000","last_became_active":"2024-09-12T00:02:03.150631+0000","last_became_peered":"2024-09-12T00:02:03.150631+0000","last_unstale":"2024-09-12T00:39:05.285422+0000","last_undegraded":"2024-09-12T00:39:05.285422+0000","last_fullsized":"2024-09-12T00:39:05.285422+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-12T00:39:05.285268+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-12T00:39:05.285268+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.285268+0000","objects_scrubbed":11,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:00.830128+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68885,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":513,"num_read_kb":1151,"num_write":412,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.697322+0000","last_change":"2024-09-12T00:39:16.697322+0000","last_active":"2024-09-12T00:39:16.697322+0000","last_peered":"2024-09-12T00:39:16.697322+0000","last_clean":"2024-09-12T00:39:16.697322+0000","last_became_active":"2024-09-12T00:02:05.167082+0000","last_became_peered":"2024-09-12T00:02:05.167082+0000","last_unstale":"2024-09-12T00:39:16.697322+0000","last_undegraded":"2024-09-12T00:39:16.697322+0000","last_fullsized":"2024-09-12T00:39:16.697322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.697225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.697225+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.697225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:31.751498+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'125","reported_seq":624,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.461692+0000","last_change":"2024-09-12T00:39:10.461692+0000","last_active":"2024-09-12T00:39:10.461692+0000","last_peered":"2024-09-12T00:39:10.461692+0000","last_clean":"2024-09-12T00:39:10.461692+0000","last_became_active":"2024-09-12T00:02:07.172810+0000","last_became_peered":"2024-09-12T00:02:07.172810+0000","last_unstale":"2024-09-12T00:39:10.461692+0000","last_undegraded":"2024-09-12T00:39:10.461692+0000","last_fullsized":"2024-09-12T00:39:10.461692+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'125","last_scrub_stamp":"2024-09-12T00:39:10.461579+0000","last_deep_scrub":"261'125","last_deep_scrub_stamp":"2024-09-12T00:39:10.461579+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.461579+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:41.729868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":135,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'223","reported_seq":849,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.135529+0000","last_change":"2024-09-12T00:38:55.135529+0000","last_active":"2024-09-12T00:38:55.135529+0000","last_peered":"2024-09-12T00:38:55.135529+0000","last_clean":"2024-09-12T00:38:55.135529+0000","last_became_active":"2024-09-12T00:01:59.147373+0000","last_became_peered":"2024-09-12T00:01:59.147373+0000","last_unstale":"2024-09-12T00:38:55.135529+0000","last_undegraded":"2024-09-12T00:38:55.135529+0000","last_fullsized":"2024-09-12T00:38:55.135529+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'223","last_scrub_stamp":"2024-09-12T00:38:55.135426+0000","last_deep_scrub":"261'223","last_deep_scrub_stamp":"2024-09-12T00:38:55.135426+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.135426+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:54.183644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1007,"num_read_kb":830,"num_write":359,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'297","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.195766+0000","last_change":"2024-09-12T00:39:07.195766+0000","last_active":"2024-09-12T00:39:07.195766+0000","last_peered":"2024-09-12T00:39:07.195766+0000","last_clean":"2024-09-12T00:39:07.195766+0000","last_became_active":"2024-09-12T00:01:57.161414+0000","last_became_peered":"2024-09-12T00:01:57.161414+0000","last_unstale":"2024-09-12T00:39:07.195766+0000","last_undegraded":"2024-09-12T00:39:07.195766+0000","last_fullsized":"2024-09-12T00:39:07.195766+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'297","last_scrub_stamp":"2024-09-12T00:39:07.195639+0000","last_deep_scrub":"261'297","last_deep_scrub_stamp":"2024-09-12T00:39:07.195639+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.195639+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:54.938996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174757,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":380,"num_read_kb":8089,"num_write":919,"num_write_kb":31185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.179570+0000","last_change":"2024-09-12T00:38:57.179570+0000","last_active":"2024-09-12T00:38:57.179570+0000","last_peered":"2024-09-12T00:38:57.179570+0000","last_clean":"2024-09-12T00:38:57.179570+0000","last_became_active":"2024-09-12T00:02:01.151760+0000","last_became_peered":"2024-09-12T00:02:01.151760+0000","last_unstale":"2024-09-12T00:38:57.179570+0000","last_undegraded":"2024-09-12T00:38:57.179570+0000","last_fullsized":"2024-09-12T00:38:57.179570+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:57.179464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:57.179464+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.179464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:03.467030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'281","reported_seq":853,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.735036+0000","last_change":"2024-09-12T00:39:13.735036+0000","last_active":"2024-09-12T00:39:13.735036+0000","last_peered":"2024-09-12T00:39:13.735036+0000","last_clean":"2024-09-12T00:39:13.735036+0000","last_became_active":"2024-09-12T00:02:03.150714+0000","last_became_peered":"2024-09-12T00:02:03.150714+0000","last_unstale":"2024-09-12T00:39:13.735036+0000","last_undegraded":"2024-09-12T00:39:13.735036+0000","last_fullsized":"2024-09-12T00:39:13.735036+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'281","last_scrub_stamp":"2024-09-12T00:39:13.734932+0000","last_deep_scrub":"261'281","last_deep_scrub_stamp":"2024-09-12T00:39:13.734932+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.734932+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:14.733788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52913,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1134,"num_write":392,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:24.119460+0000","last_change":"2024-09-12T00:39:24.119460+0000","last_active":"2024-09-12T00:39:24.119460+0000","last_peered":"2024-09-12T00:39:24.119460+0000","last_clean":"2024-09-12T00:39:24.119460+0000","last_became_active":"2024-09-12T00:02:05.170973+0000","last_became_peered":"2024-09-12T00:02:05.170973+0000","last_unstale":"2024-09-12T00:39:24.119460+0000","last_undegraded":"2024-09-12T00:39:24.119460+0000","last_fullsized":"2024-09-12T00:39:24.119460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:24.119377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:24.119377+0000","last_clean_scrub_stamp":"2024-09-12T00:39:24.119377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:28.955427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'120","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.852653+0000","last_change":"2024-09-12T00:39:21.852653+0000","last_active":"2024-09-12T00:39:21.852653+0000","last_peered":"2024-09-12T00:39:21.852653+0000","last_clean":"2024-09-12T00:39:21.852653+0000","last_became_active":"2024-09-12T00:02:07.169266+0000","last_became_peered":"2024-09-12T00:02:07.169266+0000","last_unstale":"2024-09-12T00:39:21.852653+0000","last_undegraded":"2024-09-12T00:39:21.852653+0000","last_fullsized":"2024-09-12T00:39:21.852653+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'120","last_scrub_stamp":"2024-09-12T00:39:21.852565+0000","last_deep_scrub":"261'120","last_deep_scrub_stamp":"2024-09-12T00:39:21.852565+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.852565+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:55.302107+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":294,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'183","reported_seq":785,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.841083+0000","last_change":"2024-09-12T00:38:50.841083+0000","last_active":"2024-09-12T00:38:50.841083+0000","last_peered":"2024-09-12T00:38:50.841083+0000","last_clean":"2024-09-12T00:38:50.841083+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:38:50.841083+0000","last_undegraded":"2024-09-12T00:38:50.841083+0000","last_fullsized":"2024-09-12T00:38:50.841083+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'183","last_scrub_stamp":"2024-09-12T00:38:50.840994+0000","last_deep_scrub":"261'183","last_deep_scrub_stamp":"2024-09-12T00:38:50.840994+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.840994+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:07.476170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":689,"num_write":284,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'446","reported_seq":1169,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.764952+0000","last_change":"2024-09-12T00:38:48.764952+0000","last_active":"2024-09-12T00:38:48.764952+0000","last_peered":"2024-09-12T00:38:48.764952+0000","last_clean":"2024-09-12T00:38:48.764952+0000","last_became_active":"2024-09-12T00:01:57.161612+0000","last_became_peered":"2024-09-12T00:01:57.161612+0000","last_unstale":"2024-09-12T00:38:48.764952+0000","last_undegraded":"2024-09-12T00:38:48.764952+0000","last_fullsized":"2024-09-12T00:38:48.764952+0000","mapping_epoch":24,"log_start":"261'400","ondisk_log_start":"261'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'446","last_scrub_stamp":"2024-09-12T00:38:48.764718+0000","last_deep_scrub":"261'446","last_deep_scrub_stamp":"2024-09-12T00:38:48.764718+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.764718+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:21.363677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":772,"num_read_kb":15126,"num_write":1508,"num_write_kb":40840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.430557+0000","last_change":"2024-09-12T00:38:59.430557+0000","last_active":"2024-09-12T00:38:59.430557+0000","last_peered":"2024-09-12T00:38:59.430557+0000","last_clean":"2024-09-12T00:38:59.430557+0000","last_became_active":"2024-09-12T00:02:01.144558+0000","last_became_peered":"2024-09-12T00:02:01.144558+0000","last_unstale":"2024-09-12T00:38:59.430557+0000","last_undegraded":"2024-09-12T00:38:59.430557+0000","last_fullsized":"2024-09-12T00:38:59.430557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.430450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.430450+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.430450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:54.397837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'265","reported_seq":820,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.959752+0000","last_change":"2024-09-12T00:39:05.959752+0000","last_active":"2024-09-12T00:39:05.959752+0000","last_peered":"2024-09-12T00:39:05.959752+0000","last_clean":"2024-09-12T00:39:05.959752+0000","last_became_active":"2024-09-12T00:02:03.154477+0000","last_became_peered":"2024-09-12T00:02:03.154477+0000","last_unstale":"2024-09-12T00:39:05.959752+0000","last_undegraded":"2024-09-12T00:39:05.959752+0000","last_fullsized":"2024-09-12T00:39:05.959752+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'265","last_scrub_stamp":"2024-09-12T00:39:05.959667+0000","last_deep_scrub":"261'265","last_deep_scrub_stamp":"2024-09-12T00:39:05.959667+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.959667+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:09.262831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47465,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":439,"num_read_kb":1086,"num_write":366,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":475,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:34:34.382052+0000","last_change":"2024-09-12T00:02:05.166486+0000","last_active":"2024-09-12T00:34:34.382052+0000","last_peered":"2024-09-12T00:34:34.382052+0000","last_clean":"2024-09-12T00:34:34.382052+0000","last_became_active":"2024-09-12T00:02:05.166141+0000","last_became_peered":"2024-09-12T00:02:05.166141+0000","last_unstale":"2024-09-12T00:34:34.382052+0000","last_undegraded":"2024-09-12T00:34:34.382052+0000","last_fullsized":"2024-09-12T00:34:34.382052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:04.137349+0000","last_clean_scrub_stamp":"2024-09-12T00:02:04.137349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:03:12.751964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'186","reported_seq":1324,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:37:21.932224+0000","last_change":"2024-09-12T00:02:07.170137+0000","last_active":"2024-09-12T00:37:21.932224+0000","last_peered":"2024-09-12T00:37:21.932224+0000","last_clean":"2024-09-12T00:37:21.932224+0000","last_became_active":"2024-09-12T00:02:07.169812+0000","last_became_peered":"2024-09-12T00:02:07.169812+0000","last_unstale":"2024-09-12T00:37:21.932224+0000","last_undegraded":"2024-09-12T00:37:21.932224+0000","last_fullsized":"2024-09-12T00:37:21.932224+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:02:06.148341+0000","last_clean_scrub_stamp":"2024-09-12T00:02:06.148341+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:18.008023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1006,"num_read_kb":951,"num_write":452,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'117","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.094187+0000","last_change":"2024-09-12T00:38:54.094187+0000","last_active":"2024-09-12T00:38:54.094187+0000","last_peered":"2024-09-12T00:38:54.094187+0000","last_clean":"2024-09-12T00:38:54.094187+0000","last_became_active":"2024-09-12T00:01:59.148253+0000","last_became_peered":"2024-09-12T00:01:59.148253+0000","last_unstale":"2024-09-12T00:38:54.094187+0000","last_undegraded":"2024-09-12T00:38:54.094187+0000","last_fullsized":"2024-09-12T00:38:54.094187+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'117","last_scrub_stamp":"2024-09-12T00:38:54.094084+0000","last_deep_scrub":"261'117","last_deep_scrub_stamp":"2024-09-12T00:38:54.094084+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.094084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:55.052129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":405,"num_write":165,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'378","reported_seq":1048,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.791277+0000","last_change":"2024-09-12T00:38:49.791277+0000","last_active":"2024-09-12T00:38:49.791277+0000","last_peered":"2024-09-12T00:38:49.791277+0000","last_clean":"2024-09-12T00:38:49.791277+0000","last_became_active":"2024-09-12T00:01:57.138386+0000","last_became_peered":"2024-09-12T00:01:57.138386+0000","last_unstale":"2024-09-12T00:38:49.791277+0000","last_undegraded":"2024-09-12T00:38:49.791277+0000","last_fullsized":"2024-09-12T00:38:49.791277+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T00:38:49.791164+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T00:38:49.791164+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.791164+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:45.569391+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":660,"num_read_kb":37451,"num_write":1183,"num_write_kb":32715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"261'2","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.659936+0000","last_change":"2024-09-12T00:39:05.659936+0000","last_active":"2024-09-12T00:39:05.659936+0000","last_peered":"2024-09-12T00:39:05.659936+0000","last_clean":"2024-09-12T00:39:05.659936+0000","last_became_active":"2024-09-12T00:02:01.153306+0000","last_became_peered":"2024-09-12T00:02:01.153306+0000","last_unstale":"2024-09-12T00:39:05.659936+0000","last_undegraded":"2024-09-12T00:39:05.659936+0000","last_fullsized":"2024-09-12T00:39:05.659936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:05.659851+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:05.659851+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.659851+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:10.733284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'291","reported_seq":879,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.170584+0000","last_change":"2024-09-12T00:39:17.170584+0000","last_active":"2024-09-12T00:39:17.170584+0000","last_peered":"2024-09-12T00:39:17.170584+0000","last_clean":"2024-09-12T00:39:17.170584+0000","last_became_active":"2024-09-12T00:02:03.158379+0000","last_became_peered":"2024-09-12T00:02:03.158379+0000","last_unstale":"2024-09-12T00:39:17.170584+0000","last_undegraded":"2024-09-12T00:39:17.170584+0000","last_fullsized":"2024-09-12T00:39:17.170584+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'291","last_scrub_stamp":"2024-09-12T00:39:17.170478+0000","last_deep_scrub":"261'291","last_deep_scrub_stamp":"2024-09-12T00:39:17.170478+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.170478+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:51.871807+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53226,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":1058,"num_write":380,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.681924+0000","last_change":"2024-09-12T00:39:17.681924+0000","last_active":"2024-09-12T00:39:17.681924+0000","last_peered":"2024-09-12T00:39:17.681924+0000","last_clean":"2024-09-12T00:39:17.681924+0000","last_became_active":"2024-09-12T00:02:05.159854+0000","last_became_peered":"2024-09-12T00:02:05.159854+0000","last_unstale":"2024-09-12T00:39:17.681924+0000","last_undegraded":"2024-09-12T00:39:17.681924+0000","last_fullsized":"2024-09-12T00:39:17.681924+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:17.681837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:17.681837+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.681837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:12.161647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'135","reported_seq":633,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.239477+0000","last_change":"2024-09-12T00:39:08.239477+0000","last_active":"2024-09-12T00:39:08.239477+0000","last_peered":"2024-09-12T00:39:08.239477+0000","last_clean":"2024-09-12T00:39:08.239477+0000","last_became_active":"2024-09-12T00:02:07.170727+0000","last_became_peered":"2024-09-12T00:02:07.170727+0000","last_unstale":"2024-09-12T00:39:08.239477+0000","last_undegraded":"2024-09-12T00:39:08.239477+0000","last_fullsized":"2024-09-12T00:39:08.239477+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'135","last_scrub_stamp":"2024-09-12T00:39:08.239382+0000","last_deep_scrub":"261'135","last_deep_scrub_stamp":"2024-09-12T00:39:08.239382+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.239382+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:08.116527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":129,"num_write":315,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'247","reported_seq":916,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.507541+0000","last_change":"2024-09-12T00:38:54.507541+0000","last_active":"2024-09-12T00:38:54.507541+0000","last_peered":"2024-09-12T00:38:54.507541+0000","last_clean":"2024-09-12T00:38:54.507541+0000","last_became_active":"2024-09-12T00:01:59.145502+0000","last_became_peered":"2024-09-12T00:01:59.145502+0000","last_unstale":"2024-09-12T00:38:54.507541+0000","last_undegraded":"2024-09-12T00:38:54.507541+0000","last_fullsized":"2024-09-12T00:38:54.507541+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'247","last_scrub_stamp":"2024-09-12T00:38:54.507456+0000","last_deep_scrub":"261'247","last_deep_scrub_stamp":"2024-09-12T00:38:54.507456+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.507456+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:33.111923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1128,"num_read_kb":927,"num_write":363,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'365","reported_seq":1025,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.026415+0000","last_change":"2024-09-12T00:38:46.026415+0000","last_active":"2024-09-12T00:38:46.026415+0000","last_peered":"2024-09-12T00:38:46.026415+0000","last_clean":"2024-09-12T00:38:46.026415+0000","last_became_active":"2024-09-12T00:01:57.159487+0000","last_became_peered":"2024-09-12T00:01:57.159487+0000","last_unstale":"2024-09-12T00:38:46.026415+0000","last_undegraded":"2024-09-12T00:38:46.026415+0000","last_fullsized":"2024-09-12T00:38:46.026415+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'365","last_scrub_stamp":"2024-09-12T00:38:46.026277+0000","last_deep_scrub":"261'365","last_deep_scrub_stamp":"2024-09-12T00:38:46.026277+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.026277+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:55.022589+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":54883,"num_write":1141,"num_write_kb":38301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'151","reported_seq":706,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.830942+0000","last_change":"2024-09-12T00:38:52.830942+0000","last_active":"2024-09-12T00:38:52.830942+0000","last_peered":"2024-09-12T00:38:52.830942+0000","last_clean":"2024-09-12T00:38:52.830942+0000","last_became_active":"2024-09-12T00:01:59.153340+0000","last_became_peered":"2024-09-12T00:01:59.153340+0000","last_unstale":"2024-09-12T00:38:52.830942+0000","last_undegraded":"2024-09-12T00:38:52.830942+0000","last_fullsized":"2024-09-12T00:38:52.830942+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'151","last_scrub_stamp":"2024-09-12T00:38:52.830858+0000","last_deep_scrub":"261'151","last_deep_scrub_stamp":"2024-09-12T00:38:52.830858+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.830858+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:38.477609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":542,"num_write":243,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'317","reported_seq":1046,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.771139+0000","last_change":"2024-09-12T00:38:46.771139+0000","last_active":"2024-09-12T00:38:46.771139+0000","last_peered":"2024-09-12T00:38:46.771139+0000","last_clean":"2024-09-12T00:38:46.771139+0000","last_became_active":"2024-09-12T00:01:57.152522+0000","last_became_peered":"2024-09-12T00:01:57.152522+0000","last_unstale":"2024-09-12T00:38:46.771139+0000","last_undegraded":"2024-09-12T00:38:46.771139+0000","last_fullsized":"2024-09-12T00:38:46.771139+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'317","last_scrub_stamp":"2024-09-12T00:38:46.770967+0000","last_deep_scrub":"261'317","last_deep_scrub_stamp":"2024-09-12T00:38:46.770967+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.770967+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.575296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":990709,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":567,"num_read_kb":16299,"num_write":1038,"num_write_kb":36902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'218","reported_seq":851,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.208392+0000","last_change":"2024-09-12T00:39:18.208392+0000","last_active":"2024-09-12T00:39:18.208392+0000","last_peered":"2024-09-12T00:39:18.208392+0000","last_clean":"2024-09-12T00:39:18.208392+0000","last_became_active":"2024-09-12T00:01:59.145971+0000","last_became_peered":"2024-09-12T00:01:59.145971+0000","last_unstale":"2024-09-12T00:39:18.208392+0000","last_undegraded":"2024-09-12T00:39:18.208392+0000","last_fullsized":"2024-09-12T00:39:18.208392+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'218","last_scrub_stamp":"2024-09-12T00:39:18.208265+0000","last_deep_scrub":"261'218","last_deep_scrub_stamp":"2024-09-12T00:39:18.208265+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.208265+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:34.095704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":962,"num_read_kb":786,"num_write":321,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8590,"num_omap_keys":34,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'356","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.269575+0000","last_change":"2024-09-12T00:38:54.269575+0000","last_active":"2024-09-12T00:38:54.269575+0000","last_peered":"2024-09-12T00:38:54.269575+0000","last_clean":"2024-09-12T00:38:54.269575+0000","last_became_active":"2024-09-12T00:01:57.167651+0000","last_became_peered":"2024-09-12T00:01:57.167651+0000","last_unstale":"2024-09-12T00:38:54.269575+0000","last_undegraded":"2024-09-12T00:38:54.269575+0000","last_fullsized":"2024-09-12T00:38:54.269575+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'356","last_scrub_stamp":"2024-09-12T00:38:54.269448+0000","last_deep_scrub":"261'356","last_deep_scrub_stamp":"2024-09-12T00:38:54.269448+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.269448+0000","objects_scrubbed":6,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:35.410380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":490,"num_read_kb":6602,"num_write":1155,"num_write_kb":24145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'167","reported_seq":758,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.843569+0000","last_change":"2024-09-12T00:39:02.843569+0000","last_active":"2024-09-12T00:39:02.843569+0000","last_peered":"2024-09-12T00:39:02.843569+0000","last_clean":"2024-09-12T00:39:02.843569+0000","last_became_active":"2024-09-12T00:01:59.146794+0000","last_became_peered":"2024-09-12T00:01:59.146794+0000","last_unstale":"2024-09-12T00:39:02.843569+0000","last_undegraded":"2024-09-12T00:39:02.843569+0000","last_fullsized":"2024-09-12T00:39:02.843569+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'167","last_scrub_stamp":"2024-09-12T00:39:02.843486+0000","last_deep_scrub":"261'167","last_deep_scrub_stamp":"2024-09-12T00:39:02.843486+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.843486+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:31.785008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":586,"num_write":261,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'291","reported_seq":905,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.812669+0000","last_change":"2024-09-12T00:38:50.812669+0000","last_active":"2024-09-12T00:38:50.812669+0000","last_peered":"2024-09-12T00:38:50.812669+0000","last_clean":"2024-09-12T00:38:50.812669+0000","last_became_active":"2024-09-12T00:01:57.145410+0000","last_became_peered":"2024-09-12T00:01:57.145410+0000","last_unstale":"2024-09-12T00:38:50.812669+0000","last_undegraded":"2024-09-12T00:38:50.812669+0000","last_fullsized":"2024-09-12T00:38:50.812669+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'291","last_scrub_stamp":"2024-09-12T00:38:50.812479+0000","last_deep_scrub":"261'291","last_deep_scrub_stamp":"2024-09-12T00:38:50.812479+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.812479+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:54.529596+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":406,"num_read_kb":533,"num_write":954,"num_write_kb":14360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'571","reported_seq":1341,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.831886+0000","last_change":"2024-09-12T00:39:00.831886+0000","last_active":"2024-09-12T00:39:00.831886+0000","last_peered":"2024-09-12T00:39:00.831886+0000","last_clean":"2024-09-12T00:39:00.831886+0000","last_became_active":"2024-09-12T00:01:59.148605+0000","last_became_peered":"2024-09-12T00:01:59.148605+0000","last_unstale":"2024-09-12T00:39:00.831886+0000","last_undegraded":"2024-09-12T00:39:00.831886+0000","last_fullsized":"2024-09-12T00:39:00.831886+0000","mapping_epoch":26,"log_start":"261'500","ondisk_log_start":"261'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'571","last_scrub_stamp":"2024-09-12T00:39:00.831790+0000","last_deep_scrub":"261'571","last_deep_scrub_stamp":"2024-09-12T00:39:00.831790+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.831790+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:07.829005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2664,"num_read_kb":2197,"num_write":993,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'328","reported_seq":979,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.076699+0000","last_change":"2024-09-12T00:38:47.076584+0000","last_active":"2024-09-12T00:38:47.076699+0000","last_peered":"2024-09-12T00:38:47.076699+0000","last_clean":"2024-09-12T00:38:47.076699+0000","last_became_active":"2024-09-12T00:02:32.864862+0000","last_became_peered":"2024-09-12T00:02:32.864862+0000","last_unstale":"2024-09-12T00:38:47.076699+0000","last_undegraded":"2024-09-12T00:38:47.076699+0000","last_fullsized":"2024-09-12T00:38:47.076699+0000","mapping_epoch":37,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'328","last_scrub_stamp":"2024-09-12T00:38:47.076409+0000","last_deep_scrub":"261'328","last_deep_scrub_stamp":"2024-09-12T00:38:47.076409+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.076409+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:26.756457+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":496,"num_read_kb":62973,"num_write":1092,"num_write_kb":36662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7,3],"acting":[6,0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'192","reported_seq":817,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.208785+0000","last_change":"2024-09-12T00:38:54.208785+0000","last_active":"2024-09-12T00:38:54.208785+0000","last_peered":"2024-09-12T00:38:54.208785+0000","last_clean":"2024-09-12T00:38:54.208785+0000","last_became_active":"2024-09-12T00:01:59.141383+0000","last_became_peered":"2024-09-12T00:01:59.141383+0000","last_unstale":"2024-09-12T00:38:54.208785+0000","last_undegraded":"2024-09-12T00:38:54.208785+0000","last_fullsized":"2024-09-12T00:38:54.208785+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'192","last_scrub_stamp":"2024-09-12T00:38:54.208696+0000","last_deep_scrub":"261'192","last_deep_scrub_stamp":"2024-09-12T00:38:54.208696+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.208696+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:40.694440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":715,"num_write":298,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'342","reported_seq":1005,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.046217+0000","last_change":"2024-09-12T00:38:49.046108+0000","last_active":"2024-09-12T00:38:49.046217+0000","last_peered":"2024-09-12T00:38:49.046217+0000","last_clean":"2024-09-12T00:38:49.046217+0000","last_became_active":"2024-09-12T00:01:57.152097+0000","last_became_peered":"2024-09-12T00:01:57.152097+0000","last_unstale":"2024-09-12T00:38:49.046217+0000","last_undegraded":"2024-09-12T00:38:49.046217+0000","last_fullsized":"2024-09-12T00:38:49.046217+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'342","last_scrub_stamp":"2024-09-12T00:38:49.045971+0000","last_deep_scrub":"261'342","last_deep_scrub_stamp":"2024-09-12T00:38:49.045971+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.045971+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:14.819908+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399285,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":523,"num_read_kb":43886,"num_write":1080,"num_write_kb":36840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'430","reported_seq":1153,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.913482+0000","last_change":"2024-09-12T00:38:55.913482+0000","last_active":"2024-09-12T00:38:55.913482+0000","last_peered":"2024-09-12T00:38:55.913482+0000","last_clean":"2024-09-12T00:38:55.913482+0000","last_became_active":"2024-09-12T00:01:59.146117+0000","last_became_peered":"2024-09-12T00:01:59.146117+0000","last_unstale":"2024-09-12T00:38:55.913482+0000","last_undegraded":"2024-09-12T00:38:55.913482+0000","last_fullsized":"2024-09-12T00:38:55.913482+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'430","last_scrub_stamp":"2024-09-12T00:38:55.913381+0000","last_deep_scrub":"261'430","last_deep_scrub_stamp":"2024-09-12T00:38:55.913381+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.913381+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:25.825297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2179,"num_read_kb":1868,"num_write":729,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'382","reported_seq":1081,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.029173+0000","last_change":"2024-09-12T00:38:49.029107+0000","last_active":"2024-09-12T00:38:49.029173+0000","last_peered":"2024-09-12T00:38:49.029173+0000","last_clean":"2024-09-12T00:38:49.029173+0000","last_became_active":"2024-09-12T00:01:57.156002+0000","last_became_peered":"2024-09-12T00:01:57.156002+0000","last_unstale":"2024-09-12T00:38:49.029173+0000","last_undegraded":"2024-09-12T00:38:49.029173+0000","last_fullsized":"2024-09-12T00:38:49.029173+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'382","last_scrub_stamp":"2024-09-12T00:38:49.028963+0000","last_deep_scrub":"261'382","last_deep_scrub_stamp":"2024-09-12T00:38:49.028963+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.028963+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:41.518318+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":675,"num_read_kb":79699,"num_write":1346,"num_write_kb":54312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'216","reported_seq":803,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.470623+0000","last_change":"2024-09-12T00:38:47.470623+0000","last_active":"2024-09-12T00:38:47.470623+0000","last_peered":"2024-09-12T00:38:47.470623+0000","last_clean":"2024-09-12T00:38:47.470623+0000","last_became_active":"2024-09-12T00:01:59.155003+0000","last_became_peered":"2024-09-12T00:01:59.155003+0000","last_unstale":"2024-09-12T00:38:47.470623+0000","last_undegraded":"2024-09-12T00:38:47.470623+0000","last_fullsized":"2024-09-12T00:38:47.470623+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'216","last_scrub_stamp":"2024-09-12T00:38:47.470513+0000","last_deep_scrub":"261'216","last_deep_scrub_stamp":"2024-09-12T00:38:47.470513+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.470513+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:16.481869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":893,"num_read_kb":718,"num_write":326,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'362","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.779864+0000","last_change":"2024-09-12T00:38:51.779864+0000","last_active":"2024-09-12T00:38:51.779864+0000","last_peered":"2024-09-12T00:38:51.779864+0000","last_clean":"2024-09-12T00:38:51.779864+0000","last_became_active":"2024-09-12T00:01:57.145466+0000","last_became_peered":"2024-09-12T00:01:57.145466+0000","last_unstale":"2024-09-12T00:38:51.779864+0000","last_undegraded":"2024-09-12T00:38:51.779864+0000","last_fullsized":"2024-09-12T00:38:51.779864+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'362","last_scrub_stamp":"2024-09-12T00:38:51.779755+0000","last_deep_scrub":"261'362","last_deep_scrub_stamp":"2024-09-12T00:38:51.779755+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.779755+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:46.528330+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262160,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":3535,"num_write":1174,"num_write_kb":24926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'109","reported_seq":694,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.899825+0000","last_change":"2024-09-12T00:38:54.899756+0000","last_active":"2024-09-12T00:38:54.899825+0000","last_peered":"2024-09-12T00:38:54.899825+0000","last_clean":"2024-09-12T00:38:54.899825+0000","last_became_active":"2024-09-12T00:01:59.149014+0000","last_became_peered":"2024-09-12T00:01:59.149014+0000","last_unstale":"2024-09-12T00:38:54.899825+0000","last_undegraded":"2024-09-12T00:38:54.899825+0000","last_fullsized":"2024-09-12T00:38:54.899825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'109","last_scrub_stamp":"2024-09-12T00:38:54.899674+0000","last_deep_scrub":"261'109","last_deep_scrub_stamp":"2024-09-12T00:38:54.899674+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.899674+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:24.146722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":492,"num_read_kb":416,"num_write":148,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'402","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.242136+0000","last_change":"2024-09-12T00:38:56.242136+0000","last_active":"2024-09-12T00:38:56.242136+0000","last_peered":"2024-09-12T00:38:56.242136+0000","last_clean":"2024-09-12T00:38:56.242136+0000","last_became_active":"2024-09-12T00:01:57.150980+0000","last_became_peered":"2024-09-12T00:01:57.150980+0000","last_unstale":"2024-09-12T00:38:56.242136+0000","last_undegraded":"2024-09-12T00:38:56.242136+0000","last_fullsized":"2024-09-12T00:38:56.242136+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'402","last_scrub_stamp":"2024-09-12T00:38:56.241977+0000","last_deep_scrub":"261'402","last_deep_scrub_stamp":"2024-09-12T00:38:56.241977+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.241977+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:40.615576+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1303915,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":638,"num_read_kb":15523,"num_write":1286,"num_write_kb":17105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'109","reported_seq":712,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.238124+0000","last_change":"2024-09-12T00:38:55.238054+0000","last_active":"2024-09-12T00:38:55.238124+0000","last_peered":"2024-09-12T00:38:55.238124+0000","last_clean":"2024-09-12T00:38:55.238124+0000","last_became_active":"2024-09-12T00:01:59.149341+0000","last_became_peered":"2024-09-12T00:01:59.149341+0000","last_unstale":"2024-09-12T00:38:55.238124+0000","last_undegraded":"2024-09-12T00:38:55.238124+0000","last_fullsized":"2024-09-12T00:38:55.238124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'109","last_scrub_stamp":"2024-09-12T00:38:55.237937+0000","last_deep_scrub":"261'109","last_deep_scrub_stamp":"2024-09-12T00:38:55.237937+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.237937+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:39.737518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":504,"num_read_kb":434,"num_write":171,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'343","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.738562+0000","last_change":"2024-09-12T00:38:52.738562+0000","last_active":"2024-09-12T00:38:52.738562+0000","last_peered":"2024-09-12T00:38:52.738562+0000","last_clean":"2024-09-12T00:38:52.738562+0000","last_became_active":"2024-09-12T00:02:32.863077+0000","last_became_peered":"2024-09-12T00:02:32.863077+0000","last_unstale":"2024-09-12T00:38:52.738562+0000","last_undegraded":"2024-09-12T00:38:52.738562+0000","last_fullsized":"2024-09-12T00:38:52.738562+0000","mapping_epoch":37,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'343","last_scrub_stamp":"2024-09-12T00:38:52.738425+0000","last_deep_scrub":"261'343","last_deep_scrub_stamp":"2024-09-12T00:38:52.738425+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.738425+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:23.042537+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267332,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":11923,"num_write":1143,"num_write_kb":27282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,7],"acting":[5,6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'269","reported_seq":901,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.807917+0000","last_change":"2024-09-12T00:39:03.807917+0000","last_active":"2024-09-12T00:39:03.807917+0000","last_peered":"2024-09-12T00:39:03.807917+0000","last_clean":"2024-09-12T00:39:03.807917+0000","last_became_active":"2024-09-12T00:01:59.159226+0000","last_became_peered":"2024-09-12T00:01:59.159226+0000","last_unstale":"2024-09-12T00:39:03.807917+0000","last_undegraded":"2024-09-12T00:39:03.807917+0000","last_fullsized":"2024-09-12T00:39:03.807917+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'269","last_scrub_stamp":"2024-09-12T00:39:03.807792+0000","last_deep_scrub":"261'269","last_deep_scrub_stamp":"2024-09-12T00:39:03.807792+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.807792+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:26.022277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1182,"num_read_kb":958,"num_write":434,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'384","reported_seq":1052,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.429903+0000","last_change":"2024-09-12T00:38:48.429903+0000","last_active":"2024-09-12T00:38:48.429903+0000","last_peered":"2024-09-12T00:38:48.429903+0000","last_clean":"2024-09-12T00:38:48.429903+0000","last_became_active":"2024-09-12T00:01:57.148038+0000","last_became_peered":"2024-09-12T00:01:57.148038+0000","last_unstale":"2024-09-12T00:38:48.429903+0000","last_undegraded":"2024-09-12T00:38:48.429903+0000","last_fullsized":"2024-09-12T00:38:48.429903+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'384","last_scrub_stamp":"2024-09-12T00:38:48.429770+0000","last_deep_scrub":"261'384","last_deep_scrub_stamp":"2024-09-12T00:38:48.429770+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.429770+0000","objects_scrubbed":9,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:30.722756+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6690610,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":558,"num_read_kb":81305,"num_write":1164,"num_write_kb":56822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'244","reported_seq":823,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.463575+0000","last_change":"2024-09-12T00:38:46.463575+0000","last_active":"2024-09-12T00:38:46.463575+0000","last_peered":"2024-09-12T00:38:46.463575+0000","last_clean":"2024-09-12T00:38:46.463575+0000","last_became_active":"2024-09-12T00:01:59.154258+0000","last_became_peered":"2024-09-12T00:01:59.154258+0000","last_unstale":"2024-09-12T00:38:46.463575+0000","last_undegraded":"2024-09-12T00:38:46.463575+0000","last_fullsized":"2024-09-12T00:38:46.463575+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'244","last_scrub_stamp":"2024-09-12T00:38:46.463482+0000","last_deep_scrub":"261'244","last_deep_scrub_stamp":"2024-09-12T00:38:46.463482+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.463482+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:14.252384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":900,"num_write":421,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'365","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.560924+0000","last_change":"2024-09-12T00:38:50.560924+0000","last_active":"2024-09-12T00:38:50.560924+0000","last_peered":"2024-09-12T00:38:50.560924+0000","last_clean":"2024-09-12T00:38:50.560924+0000","last_became_active":"2024-09-12T00:01:57.142713+0000","last_became_peered":"2024-09-12T00:01:57.142713+0000","last_unstale":"2024-09-12T00:38:50.560924+0000","last_undegraded":"2024-09-12T00:38:50.560924+0000","last_fullsized":"2024-09-12T00:38:50.560924+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'365","last_scrub_stamp":"2024-09-12T00:38:50.560759+0000","last_deep_scrub":"261'365","last_deep_scrub_stamp":"2024-09-12T00:38:50.560759+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.560759+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:30.948385+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244498,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":36570,"num_write":1122,"num_write_kb":39253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'211","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.457433+0000","last_change":"2024-09-12T00:38:49.457433+0000","last_active":"2024-09-12T00:38:49.457433+0000","last_peered":"2024-09-12T00:38:49.457433+0000","last_clean":"2024-09-12T00:38:49.457433+0000","last_became_active":"2024-09-12T00:01:59.154931+0000","last_became_peered":"2024-09-12T00:01:59.154931+0000","last_unstale":"2024-09-12T00:38:49.457433+0000","last_undegraded":"2024-09-12T00:38:49.457433+0000","last_fullsized":"2024-09-12T00:38:49.457433+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'211","last_scrub_stamp":"2024-09-12T00:38:49.457304+0000","last_deep_scrub":"261'211","last_deep_scrub_stamp":"2024-09-12T00:38:49.457304+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.457304+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":100,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:34.654587+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":786,"num_write":317,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4003,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'344","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.223372+0000","last_change":"2024-09-12T00:38:46.223372+0000","last_active":"2024-09-12T00:38:46.223372+0000","last_peered":"2024-09-12T00:38:46.223372+0000","last_clean":"2024-09-12T00:38:46.223372+0000","last_became_active":"2024-09-12T00:01:57.142082+0000","last_became_peered":"2024-09-12T00:01:57.142082+0000","last_unstale":"2024-09-12T00:38:46.223372+0000","last_undegraded":"2024-09-12T00:38:46.223372+0000","last_fullsized":"2024-09-12T00:38:46.223372+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'344","last_scrub_stamp":"2024-09-12T00:38:46.223232+0000","last_deep_scrub":"261'344","last_deep_scrub_stamp":"2024-09-12T00:38:46.223232+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.223232+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:33.212306+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138779,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":3429,"num_write":1186,"num_write_kb":16203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'205","reported_seq":799,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.867815+0000","last_change":"2024-09-12T00:38:53.867815+0000","last_active":"2024-09-12T00:38:53.867815+0000","last_peered":"2024-09-12T00:38:53.867815+0000","last_clean":"2024-09-12T00:38:53.867815+0000","last_became_active":"2024-09-12T00:01:59.146272+0000","last_became_peered":"2024-09-12T00:01:59.146272+0000","last_unstale":"2024-09-12T00:38:53.867815+0000","last_undegraded":"2024-09-12T00:38:53.867815+0000","last_fullsized":"2024-09-12T00:38:53.867815+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'205","last_scrub_stamp":"2024-09-12T00:38:53.867730+0000","last_deep_scrub":"261'205","last_deep_scrub_stamp":"2024-09-12T00:38:53.867730+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.867730+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:40.417582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":905,"num_read_kb":736,"num_write":324,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'329","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.276744+0000","last_change":"2024-09-12T00:38:55.276744+0000","last_active":"2024-09-12T00:38:55.276744+0000","last_peered":"2024-09-12T00:38:55.276744+0000","last_clean":"2024-09-12T00:38:55.276744+0000","last_became_active":"2024-09-12T00:01:57.165139+0000","last_became_peered":"2024-09-12T00:01:57.165139+0000","last_unstale":"2024-09-12T00:38:55.276744+0000","last_undegraded":"2024-09-12T00:38:55.276744+0000","last_fullsized":"2024-09-12T00:38:55.276744+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-12T00:38:55.276619+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-12T00:38:55.276619+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.276619+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:46.561228+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174794,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":34175,"num_write":1090,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'210","reported_seq":842,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.545408+0000","last_change":"2024-09-12T00:38:57.545408+0000","last_active":"2024-09-12T00:38:57.545408+0000","last_peered":"2024-09-12T00:38:57.545408+0000","last_clean":"2024-09-12T00:38:57.545408+0000","last_became_active":"2024-09-12T00:01:59.151627+0000","last_became_peered":"2024-09-12T00:01:59.151627+0000","last_unstale":"2024-09-12T00:38:57.545408+0000","last_undegraded":"2024-09-12T00:38:57.545408+0000","last_fullsized":"2024-09-12T00:38:57.545408+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'210","last_scrub_stamp":"2024-09-12T00:38:57.545317+0000","last_deep_scrub":"261'210","last_deep_scrub_stamp":"2024-09-12T00:38:57.545317+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.545317+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:03.981223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":886,"num_read_kb":742,"num_write":315,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'378","reported_seq":1223,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.759737+0000","last_change":"2024-09-12T00:38:47.759679+0000","last_active":"2024-09-12T00:38:47.759737+0000","last_peered":"2024-09-12T00:38:47.759737+0000","last_clean":"2024-09-12T00:38:47.759737+0000","last_became_active":"2024-09-12T00:01:57.151346+0000","last_became_peered":"2024-09-12T00:01:57.151346+0000","last_unstale":"2024-09-12T00:38:47.759737+0000","last_undegraded":"2024-09-12T00:38:47.759737+0000","last_fullsized":"2024-09-12T00:38:47.759737+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T00:38:47.759548+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T00:38:47.759548+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.759548+0000","objects_scrubbed":14,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:22.136361+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":958,"num_read_kb":6741,"num_write":1200,"num_write_kb":13731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'4140","reported_seq":4720,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.378785+0000","last_change":"2024-09-12T00:38:52.378714+0000","last_active":"2024-09-12T00:38:52.378785+0000","last_peered":"2024-09-12T00:38:52.378785+0000","last_clean":"2024-09-12T00:38:52.378785+0000","last_became_active":"2024-09-12T00:01:59.157873+0000","last_became_peered":"2024-09-12T00:01:59.157873+0000","last_unstale":"2024-09-12T00:38:52.378785+0000","last_undegraded":"2024-09-12T00:38:52.378785+0000","last_fullsized":"2024-09-12T00:38:52.378785+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4140","last_scrub_stamp":"2024-09-12T00:38:52.378628+0000","last_deep_scrub":"261'4140","last_deep_scrub_stamp":"2024-09-12T00:38:52.378628+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.378628+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:17.479490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16645,"num_read_kb":13962,"num_write":6214,"num_write_kb":3111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'347","reported_seq":1038,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.198324+0000","last_change":"2024-09-12T00:38:57.198261+0000","last_active":"2024-09-12T00:38:57.198324+0000","last_peered":"2024-09-12T00:38:57.198324+0000","last_clean":"2024-09-12T00:38:57.198324+0000","last_became_active":"2024-09-12T00:01:57.165016+0000","last_became_peered":"2024-09-12T00:01:57.165016+0000","last_unstale":"2024-09-12T00:38:57.198324+0000","last_undegraded":"2024-09-12T00:38:57.198324+0000","last_fullsized":"2024-09-12T00:38:57.198324+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'347","last_scrub_stamp":"2024-09-12T00:38:57.198110+0000","last_deep_scrub":"261'347","last_deep_scrub_stamp":"2024-09-12T00:38:57.198110+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.198110+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:33.940316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568671,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":600,"num_read_kb":10239,"num_write":1109,"num_write_kb":39602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'330","reported_seq":1035,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.167988+0000","last_change":"2024-09-12T00:38:58.167887+0000","last_active":"2024-09-12T00:38:58.167988+0000","last_peered":"2024-09-12T00:38:58.167988+0000","last_clean":"2024-09-12T00:38:58.167988+0000","last_became_active":"2024-09-12T00:01:57.165046+0000","last_became_peered":"2024-09-12T00:01:57.165046+0000","last_unstale":"2024-09-12T00:38:58.167988+0000","last_undegraded":"2024-09-12T00:38:58.167988+0000","last_fullsized":"2024-09-12T00:38:58.167988+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'330","last_scrub_stamp":"2024-09-12T00:38:58.167667+0000","last_deep_scrub":"261'330","last_deep_scrub_stamp":"2024-09-12T00:38:58.167667+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.167667+0000","objects_scrubbed":15,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:49.796703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8464405,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":613,"num_read_kb":41753,"num_write":993,"num_write_kb":31467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'110","reported_seq":719,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.565416+0000","last_change":"2024-09-12T00:38:58.565416+0000","last_active":"2024-09-12T00:38:58.565416+0000","last_peered":"2024-09-12T00:38:58.565416+0000","last_clean":"2024-09-12T00:38:58.565416+0000","last_became_active":"2024-09-12T00:01:59.153454+0000","last_became_peered":"2024-09-12T00:01:59.153454+0000","last_unstale":"2024-09-12T00:38:58.565416+0000","last_undegraded":"2024-09-12T00:38:58.565416+0000","last_fullsized":"2024-09-12T00:38:58.565416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'110","last_scrub_stamp":"2024-09-12T00:38:58.565298+0000","last_deep_scrub":"261'110","last_deep_scrub_stamp":"2024-09-12T00:38:58.565298+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.565298+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:54.941401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":439,"num_write":164,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'353","reported_seq":1209,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.787677+0000","last_change":"2024-09-12T00:38:54.787595+0000","last_active":"2024-09-12T00:38:54.787677+0000","last_peered":"2024-09-12T00:38:54.787677+0000","last_clean":"2024-09-12T00:38:54.787677+0000","last_became_active":"2024-09-12T00:01:57.146320+0000","last_became_peered":"2024-09-12T00:01:57.146320+0000","last_unstale":"2024-09-12T00:38:54.787677+0000","last_undegraded":"2024-09-12T00:38:54.787677+0000","last_fullsized":"2024-09-12T00:38:54.787677+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T00:38:54.787503+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T00:38:54.787503+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.787503+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:52.554107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":988,"num_read_kb":6700,"num_write":1181,"num_write_kb":43058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'174","reported_seq":777,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.462924+0000","last_change":"2024-09-12T00:38:50.462924+0000","last_active":"2024-09-12T00:38:50.462924+0000","last_peered":"2024-09-12T00:38:50.462924+0000","last_clean":"2024-09-12T00:38:50.462924+0000","last_became_active":"2024-09-12T00:01:59.146876+0000","last_became_peered":"2024-09-12T00:01:59.146876+0000","last_unstale":"2024-09-12T00:38:50.462924+0000","last_undegraded":"2024-09-12T00:38:50.462924+0000","last_fullsized":"2024-09-12T00:38:50.462924+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'174","last_scrub_stamp":"2024-09-12T00:38:50.462833+0000","last_deep_scrub":"261'174","last_deep_scrub_stamp":"2024-09-12T00:38:50.462833+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.462833+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:16.424671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":808,"num_read_kb":667,"num_write":271,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5901,"num_read_kb":4223,"num_write":1957,"num_write_kb":855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1029,"ondisk_log_size":1029,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":14998,"num_read_kb":14670,"num_write":16815,"num_write_kb":4907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2683,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1537,"ondisk_log_size":1537,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":583,"ondisk_log_size":583,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1554453,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17205,"num_read_kb":36338,"num_write":14367,"num_write_kb":11412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":680986,"num_omap_keys":1552,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2157,"ondisk_log_size":2157,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102638,"num_read_kb":85737,"num_write":37205,"num_write_kb":18751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43802,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3987,"ondisk_log_size":3987,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":86840172,"num_objects":366,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":36012,"num_read_kb":1881303,"num_write":71771,"num_write_kb":2075118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":118292480,"data_stored":118292480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3738,"ondisk_log_size":3738,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":208372,"num_write":160,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":193338,"num_write":160,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509897,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":223704,"kb_used_data":12104,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":94148136,"statfs":{"total":96636764160,"available":96407691264,"internally_reserved":0,"allocated":12394496,"data_stored":10437918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":216660426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509896,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121100,"kb_used_data":17788,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94250740,"statfs":{"total":96636764160,"available":96512757760,"internally_reserved":0,"allocated":18214912,"data_stored":16235382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509898,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256424,"kb_used_data":12824,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94115416,"statfs":{"total":96636764160,"available":96374185984,"internally_reserved":0,"allocated":13131776,"data_stored":11163018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249428421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509896,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239340,"kb_used_data":19356,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94132500,"statfs":{"total":96636764160,"available":96391680000,"internally_reserved":0,"allocated":19820544,"data_stored":17855512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":225245639},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509898,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143280,"kb_used_data":26016,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94228560,"statfs":{"total":96636764160,"available":96490045440,"internally_reserved":0,"allocated":26640384,"data_stored":24664481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509897,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136728,"kb_used_data":19528,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94235112,"statfs":{"total":96636764160,"available":96496754688,"internally_reserved":0,"allocated":19996672,"data_stored":18028066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575303,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":237916,"kb_used_data":26316,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":94133924,"statfs":{"total":96636764160,"available":96393138176,"internally_reserved":0,"allocated":26947584,"data_stored":25004229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216660421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575305,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":343556,"kb_used_data":15284,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94028284,"statfs":{"total":96636764160,"available":96284962816,"internally_reserved":0,"allocated":15650816,"data_stored":13693364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15826944,"data_stored":15826944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10903552,"data_stored":10903552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22462464,"data_stored":22462464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15654912,"data_stored":15654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22802432,"data_stored":22802432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8372224,"data_stored":8372224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14032896,"data_stored":14032896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8237056,"data_stored":8237056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:39:26.078 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.079 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.079 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.079 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.079 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.079 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.079 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.079 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.080 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.080 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.080 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.080 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.080 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.080 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.081 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.081 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.081 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.081 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.081 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.081 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.082 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.082 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.082 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.082 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.082 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.082 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.082 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.082 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.083 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.083 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.083 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.083 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.083 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.083 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.083 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.084 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.084 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.084 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.084 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.084 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.084 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.085 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.085 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.085 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.085 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.085 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.085 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.086 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.086 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.086 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.086 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.086 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.086 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.086 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.086 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.086 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.087 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.087 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.087 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.087 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.087 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.087 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:15:33.394911+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.087 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.089 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.090 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.090 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.090 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.090 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:02:04.137349+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.090 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:02:06.148341+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=2, tm_sec=6, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:26.091 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:39:46.092 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:39:46.445 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:39:46.457 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T00:39:46.460 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":1398,"stamp":"2024-09-12T00:39:45.658125+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89002200,"num_objects":716,"num_object_clones":0,"num_object_copies":2164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":716,"num_whiteouts":0,"num_read":179516,"num_read_kb":2426911,"num_write":142578,"num_write_kb":2382623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":730939,"num_omap_keys":1762,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13357,"ondisk_log_size":13357,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1702048,"kb_used_data":149216,"kb_used_omap":12,"kb_used_meta":1552691,"kb_avail":753272672,"statfs":{"total":773094113280,"available":771351216128,"internally_reserved":0,"allocated":152797184,"data_stored":137081970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1589956144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005308"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.282207+0000","last_change":"2024-09-12T00:39:20.282207+0000","last_active":"2024-09-12T00:39:20.282207+0000","last_peered":"2024-09-12T00:39:20.282207+0000","last_clean":"2024-09-12T00:39:20.282207+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:39:20.282207+0000","last_undegraded":"2024-09-12T00:39:20.282207+0000","last_fullsized":"2024-09-12T00:39:20.282207+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:20.282107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:20.282107+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.282107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:02.419166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'10","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.368874+0000","last_change":"2024-09-12T00:39:19.368762+0000","last_active":"2024-09-12T00:39:19.368874+0000","last_peered":"2024-09-12T00:39:19.368874+0000","last_clean":"2024-09-12T00:39:19.368874+0000","last_became_active":"2024-09-12T00:17:03.213906+0000","last_became_peered":"2024-09-12T00:17:03.213906+0000","last_unstale":"2024-09-12T00:39:19.368874+0000","last_undegraded":"2024-09-12T00:39:19.368874+0000","last_fullsized":"2024-09-12T00:39:19.368874+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'10","last_scrub_stamp":"2024-09-12T00:39:19.368659+0000","last_deep_scrub":"261'10","last_deep_scrub_stamp":"2024-09-12T00:39:19.368659+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.368659+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:36.783100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":18831,"num_write":10,"num_write_kb":11989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.047417+0000","last_change":"2024-09-12T00:39:22.047359+0000","last_active":"2024-09-12T00:39:22.047417+0000","last_peered":"2024-09-12T00:39:22.047417+0000","last_clean":"2024-09-12T00:39:22.047417+0000","last_became_active":"2024-09-12T00:17:00.182510+0000","last_became_peered":"2024-09-12T00:17:00.182510+0000","last_unstale":"2024-09-12T00:39:22.047417+0000","last_undegraded":"2024-09-12T00:39:22.047417+0000","last_fullsized":"2024-09-12T00:39:22.047417+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:22.047271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:22.047271+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.047271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:40.094437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'18","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:24.577254+0000","last_change":"2024-09-12T00:39:24.577254+0000","last_active":"2024-09-12T00:39:24.577254+0000","last_peered":"2024-09-12T00:39:24.577254+0000","last_clean":"2024-09-12T00:39:24.577254+0000","last_became_active":"2024-09-12T00:15:34.415364+0000","last_became_peered":"2024-09-12T00:15:34.415364+0000","last_unstale":"2024-09-12T00:39:24.577254+0000","last_undegraded":"2024-09-12T00:39:24.577254+0000","last_fullsized":"2024-09-12T00:39:24.577254+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'18","last_scrub_stamp":"2024-09-12T00:39:24.577148+0000","last_deep_scrub":"261'18","last_deep_scrub_stamp":"2024-09-12T00:39:24.577148+0000","last_clean_scrub_stamp":"2024-09-12T00:39:24.577148+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:55.637554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:25.971370+0000","last_change":"2024-09-12T00:39:25.971370+0000","last_active":"2024-09-12T00:39:25.971370+0000","last_peered":"2024-09-12T00:39:25.971370+0000","last_clean":"2024-09-12T00:39:25.971370+0000","last_became_active":"2024-09-12T00:27:17.581520+0000","last_became_peered":"2024-09-12T00:27:17.581520+0000","last_unstale":"2024-09-12T00:39:25.971370+0000","last_undegraded":"2024-09-12T00:39:25.971370+0000","last_fullsized":"2024-09-12T00:39:25.971370+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.971281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.971281+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.971281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:11.187930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.103732+0000","last_change":"2024-09-12T00:39:22.103669+0000","last_active":"2024-09-12T00:39:22.103732+0000","last_peered":"2024-09-12T00:39:22.103732+0000","last_clean":"2024-09-12T00:39:22.103732+0000","last_became_active":"2024-09-12T00:17:03.206566+0000","last_became_peered":"2024-09-12T00:17:03.206566+0000","last_unstale":"2024-09-12T00:39:22.103732+0000","last_undegraded":"2024-09-12T00:39:22.103732+0000","last_fullsized":"2024-09-12T00:39:22.103732+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:22.103578+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:22.103578+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.103578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:36.235087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:27.849035+0000","last_change":"2024-09-12T00:39:27.848945+0000","last_active":"2024-09-12T00:39:27.849035+0000","last_peered":"2024-09-12T00:39:27.849035+0000","last_clean":"2024-09-12T00:39:27.849035+0000","last_became_active":"2024-09-12T00:17:00.175196+0000","last_became_peered":"2024-09-12T00:17:00.175196+0000","last_unstale":"2024-09-12T00:39:27.849035+0000","last_undegraded":"2024-09-12T00:39:27.849035+0000","last_fullsized":"2024-09-12T00:39:27.849035+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:27.848821+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:27.848821+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.848821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:04.930158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"261'76","reported_seq":286,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.561291+0000","last_change":"2024-09-12T00:39:23.561192+0000","last_active":"2024-09-12T00:39:23.561291+0000","last_peered":"2024-09-12T00:39:23.561291+0000","last_clean":"2024-09-12T00:39:23.561291+0000","last_became_active":"2024-09-12T00:15:34.416706+0000","last_became_peered":"2024-09-12T00:15:34.416706+0000","last_unstale":"2024-09-12T00:39:23.561291+0000","last_undegraded":"2024-09-12T00:39:23.561291+0000","last_fullsized":"2024-09-12T00:39:23.561291+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'76","last_scrub_stamp":"2024-09-12T00:39:23.561057+0000","last_deep_scrub":"261'76","last_deep_scrub_stamp":"2024-09-12T00:39:23.561057+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.561057+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:20.628848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":462,"num_read_kb":331,"num_write":93,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2340,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.430734+0000","last_change":"2024-09-12T00:39:22.430734+0000","last_active":"2024-09-12T00:39:22.430734+0000","last_peered":"2024-09-12T00:39:22.430734+0000","last_clean":"2024-09-12T00:39:22.430734+0000","last_became_active":"2024-09-12T00:27:17.572934+0000","last_became_peered":"2024-09-12T00:27:17.572934+0000","last_unstale":"2024-09-12T00:39:22.430734+0000","last_undegraded":"2024-09-12T00:39:22.430734+0000","last_fullsized":"2024-09-12T00:39:22.430734+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:22.430641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:22.430641+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.430641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:29.753060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:35.878152+0000","last_change":"2024-09-12T00:39:35.878152+0000","last_active":"2024-09-12T00:39:35.878152+0000","last_peered":"2024-09-12T00:39:35.878152+0000","last_clean":"2024-09-12T00:39:35.878152+0000","last_became_active":"2024-09-12T00:17:03.211755+0000","last_became_peered":"2024-09-12T00:17:03.211755+0000","last_unstale":"2024-09-12T00:39:35.878152+0000","last_undegraded":"2024-09-12T00:39:35.878152+0000","last_fullsized":"2024-09-12T00:39:35.878152+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:35.878057+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:35.878057+0000","last_clean_scrub_stamp":"2024-09-12T00:39:35.878057+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:29.247181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:25.036153+0000","last_change":"2024-09-12T00:39:25.036153+0000","last_active":"2024-09-12T00:39:25.036153+0000","last_peered":"2024-09-12T00:39:25.036153+0000","last_clean":"2024-09-12T00:39:25.036153+0000","last_became_active":"2024-09-12T00:17:00.181461+0000","last_became_peered":"2024-09-12T00:17:00.181461+0000","last_unstale":"2024-09-12T00:39:25.036153+0000","last_undegraded":"2024-09-12T00:39:25.036153+0000","last_fullsized":"2024-09-12T00:39:25.036153+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.036059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.036059+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.036059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:46.053672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'16","reported_seq":90,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.927488+0000","last_change":"2024-09-12T00:39:18.927488+0000","last_active":"2024-09-12T00:39:18.927488+0000","last_peered":"2024-09-12T00:39:18.927488+0000","last_clean":"2024-09-12T00:39:18.927488+0000","last_became_active":"2024-09-12T00:15:34.428023+0000","last_became_peered":"2024-09-12T00:15:34.428023+0000","last_unstale":"2024-09-12T00:39:18.927488+0000","last_undegraded":"2024-09-12T00:39:18.927488+0000","last_fullsized":"2024-09-12T00:39:18.927488+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'16","last_scrub_stamp":"2024-09-12T00:39:18.927402+0000","last_deep_scrub":"261'16","last_deep_scrub_stamp":"2024-09-12T00:39:18.927402+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.927402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:56.772211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:42.801928+0000","last_change":"2024-09-12T00:39:42.801928+0000","last_active":"2024-09-12T00:39:42.801928+0000","last_peered":"2024-09-12T00:39:42.801928+0000","last_clean":"2024-09-12T00:39:42.801928+0000","last_became_active":"2024-09-12T00:27:17.577034+0000","last_became_peered":"2024-09-12T00:27:17.577034+0000","last_unstale":"2024-09-12T00:39:42.801928+0000","last_undegraded":"2024-09-12T00:39:42.801928+0000","last_fullsized":"2024-09-12T00:39:42.801928+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:42.801808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:42.801808+0000","last_clean_scrub_stamp":"2024-09-12T00:39:42.801808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:28.280315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"261'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:34.829909+0000","last_change":"2024-09-12T00:39:34.829909+0000","last_active":"2024-09-12T00:39:34.829909+0000","last_peered":"2024-09-12T00:39:34.829909+0000","last_clean":"2024-09-12T00:39:34.829909+0000","last_became_active":"2024-09-12T00:17:03.209945+0000","last_became_peered":"2024-09-12T00:17:03.209945+0000","last_unstale":"2024-09-12T00:39:34.829909+0000","last_undegraded":"2024-09-12T00:39:34.829909+0000","last_fullsized":"2024-09-12T00:39:34.829909+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:34.829820+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:34.829820+0000","last_clean_scrub_stamp":"2024-09-12T00:39:34.829820+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:29.324698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.396026+0000","last_change":"2024-09-12T00:39:15.396026+0000","last_active":"2024-09-12T00:39:15.396026+0000","last_peered":"2024-09-12T00:39:15.396026+0000","last_clean":"2024-09-12T00:39:15.396026+0000","last_became_active":"2024-09-12T00:17:00.176151+0000","last_became_peered":"2024-09-12T00:17:00.176151+0000","last_unstale":"2024-09-12T00:39:15.396026+0000","last_undegraded":"2024-09-12T00:39:15.396026+0000","last_fullsized":"2024-09-12T00:39:15.396026+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:15.395938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:15.395938+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.395938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:59.127563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'69","reported_seq":237,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.973168+0000","last_change":"2024-09-12T00:39:17.973168+0000","last_active":"2024-09-12T00:39:17.973168+0000","last_peered":"2024-09-12T00:39:17.973168+0000","last_clean":"2024-09-12T00:39:17.973168+0000","last_became_active":"2024-09-12T00:15:34.422426+0000","last_became_peered":"2024-09-12T00:15:34.422426+0000","last_unstale":"2024-09-12T00:39:17.973168+0000","last_undegraded":"2024-09-12T00:39:17.973168+0000","last_fullsized":"2024-09-12T00:39:17.973168+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'69","last_scrub_stamp":"2024-09-12T00:39:17.973075+0000","last_deep_scrub":"261'69","last_deep_scrub_stamp":"2024-09-12T00:39:17.973075+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.973075+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:24.383265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":354,"num_read_kb":254,"num_write":121,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:32.963637+0000","last_change":"2024-09-12T00:39:32.963637+0000","last_active":"2024-09-12T00:39:32.963637+0000","last_peered":"2024-09-12T00:39:32.963637+0000","last_clean":"2024-09-12T00:39:32.963637+0000","last_became_active":"2024-09-12T00:27:17.579540+0000","last_became_peered":"2024-09-12T00:27:17.579540+0000","last_unstale":"2024-09-12T00:39:32.963637+0000","last_undegraded":"2024-09-12T00:39:32.963637+0000","last_fullsized":"2024-09-12T00:39:32.963637+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:32.963544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:32.963544+0000","last_clean_scrub_stamp":"2024-09-12T00:39:32.963544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:13.555712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.300900+0000","last_change":"2024-09-12T00:39:16.300900+0000","last_active":"2024-09-12T00:39:16.300900+0000","last_peered":"2024-09-12T00:39:16.300900+0000","last_clean":"2024-09-12T00:39:16.300900+0000","last_became_active":"2024-09-12T00:17:03.218684+0000","last_became_peered":"2024-09-12T00:17:03.218684+0000","last_unstale":"2024-09-12T00:39:16.300900+0000","last_undegraded":"2024-09-12T00:39:16.300900+0000","last_fullsized":"2024-09-12T00:39:16.300900+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T00:39:16.300799+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T00:39:16.300799+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.300799+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:40.707352+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'18","reported_seq":82,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:26.880444+0000","last_change":"2024-09-12T00:39:26.880444+0000","last_active":"2024-09-12T00:39:26.880444+0000","last_peered":"2024-09-12T00:39:26.880444+0000","last_clean":"2024-09-12T00:39:26.880444+0000","last_became_active":"2024-09-12T00:17:00.185974+0000","last_became_peered":"2024-09-12T00:17:00.185974+0000","last_unstale":"2024-09-12T00:39:26.880444+0000","last_undegraded":"2024-09-12T00:39:26.880444+0000","last_fullsized":"2024-09-12T00:39:26.880444+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'18","last_scrub_stamp":"2024-09-12T00:39:26.880313+0000","last_deep_scrub":"261'18","last_deep_scrub_stamp":"2024-09-12T00:39:26.880313+0000","last_clean_scrub_stamp":"2024-09-12T00:39:26.880313+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:29.342810+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":38916,"num_write":33,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'44","reported_seq":163,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.978260+0000","last_change":"2024-09-12T00:39:15.978260+0000","last_active":"2024-09-12T00:39:15.978260+0000","last_peered":"2024-09-12T00:39:15.978260+0000","last_clean":"2024-09-12T00:39:15.978260+0000","last_became_active":"2024-09-12T00:15:34.423149+0000","last_became_peered":"2024-09-12T00:15:34.423149+0000","last_unstale":"2024-09-12T00:39:15.978260+0000","last_undegraded":"2024-09-12T00:39:15.978260+0000","last_fullsized":"2024-09-12T00:39:15.978260+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'44","last_scrub_stamp":"2024-09-12T00:39:15.978169+0000","last_deep_scrub":"261'44","last_deep_scrub_stamp":"2024-09-12T00:39:15.978169+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.978169+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:01.886044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":150,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:29.487128+0000","last_change":"2024-09-12T00:39:29.487128+0000","last_active":"2024-09-12T00:39:29.487128+0000","last_peered":"2024-09-12T00:39:29.487128+0000","last_clean":"2024-09-12T00:39:29.487128+0000","last_became_active":"2024-09-12T00:27:17.575513+0000","last_became_peered":"2024-09-12T00:27:17.575513+0000","last_unstale":"2024-09-12T00:39:29.487128+0000","last_undegraded":"2024-09-12T00:39:29.487128+0000","last_fullsized":"2024-09-12T00:39:29.487128+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:29.487023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:29.487023+0000","last_clean_scrub_stamp":"2024-09-12T00:39:29.487023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:16.420719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:43.987114+0000","last_change":"2024-09-12T00:39:43.987114+0000","last_active":"2024-09-12T00:39:43.987114+0000","last_peered":"2024-09-12T00:39:43.987114+0000","last_clean":"2024-09-12T00:39:43.987114+0000","last_became_active":"2024-09-12T00:17:03.219058+0000","last_became_peered":"2024-09-12T00:17:03.219058+0000","last_unstale":"2024-09-12T00:39:43.987114+0000","last_undegraded":"2024-09-12T00:39:43.987114+0000","last_fullsized":"2024-09-12T00:39:43.987114+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:43.987017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:43.987017+0000","last_clean_scrub_stamp":"2024-09-12T00:39:43.987017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:52.568868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:36:24.396546+0000","last_change":"2024-09-12T00:17:00.183145+0000","last_active":"2024-09-12T00:36:24.396546+0000","last_peered":"2024-09-12T00:36:24.396546+0000","last_clean":"2024-09-12T00:36:24.396546+0000","last_became_active":"2024-09-12T00:17:00.182830+0000","last_became_peered":"2024-09-12T00:17:00.182830+0000","last_unstale":"2024-09-12T00:36:24.396546+0000","last_undegraded":"2024-09-12T00:36:24.396546+0000","last_fullsized":"2024-09-12T00:36:24.396546+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:59.153582+0000","last_clean_scrub_stamp":"2024-09-12T00:16:59.153582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'10","reported_seq":75,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.154400+0000","last_change":"2024-09-12T00:39:16.154400+0000","last_active":"2024-09-12T00:39:16.154400+0000","last_peered":"2024-09-12T00:39:16.154400+0000","last_clean":"2024-09-12T00:39:16.154400+0000","last_became_active":"2024-09-12T00:15:34.420841+0000","last_became_peered":"2024-09-12T00:15:34.420841+0000","last_unstale":"2024-09-12T00:39:16.154400+0000","last_undegraded":"2024-09-12T00:39:16.154400+0000","last_fullsized":"2024-09-12T00:39:16.154400+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'10","last_scrub_stamp":"2024-09-12T00:39:16.154315+0000","last_deep_scrub":"261'10","last_deep_scrub_stamp":"2024-09-12T00:39:16.154315+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.154315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:36.510847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'2","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:24.179565+0000","last_change":"2024-09-12T00:39:24.179565+0000","last_active":"2024-09-12T00:39:24.179565+0000","last_peered":"2024-09-12T00:39:24.179565+0000","last_clean":"2024-09-12T00:39:24.179565+0000","last_became_active":"2024-09-12T00:27:17.583300+0000","last_became_peered":"2024-09-12T00:27:17.583300+0000","last_unstale":"2024-09-12T00:39:24.179565+0000","last_undegraded":"2024-09-12T00:39:24.179565+0000","last_fullsized":"2024-09-12T00:39:24.179565+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:24.179468+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:24.179468+0000","last_clean_scrub_stamp":"2024-09-12T00:39:24.179468+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:24.077004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.071425+0000","last_change":"2024-09-12T00:39:20.071341+0000","last_active":"2024-09-12T00:39:20.071425+0000","last_peered":"2024-09-12T00:39:20.071425+0000","last_clean":"2024-09-12T00:39:20.071425+0000","last_became_active":"2024-09-12T00:17:03.211869+0000","last_became_peered":"2024-09-12T00:17:03.211869+0000","last_unstale":"2024-09-12T00:39:20.071425+0000","last_undegraded":"2024-09-12T00:39:20.071425+0000","last_fullsized":"2024-09-12T00:39:20.071425+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:20.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:20.071249+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:22.469297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.223575+0000","last_change":"2024-09-12T00:39:12.223498+0000","last_active":"2024-09-12T00:39:12.223575+0000","last_peered":"2024-09-12T00:39:12.223575+0000","last_clean":"2024-09-12T00:39:12.223575+0000","last_became_active":"2024-09-12T00:17:00.180995+0000","last_became_peered":"2024-09-12T00:17:00.180995+0000","last_unstale":"2024-09-12T00:39:12.223575+0000","last_undegraded":"2024-09-12T00:39:12.223575+0000","last_fullsized":"2024-09-12T00:39:12.223575+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:12.223413+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:12.223413+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.223413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.095258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"261'23","reported_seq":109,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.060964+0000","last_change":"2024-09-12T00:39:16.060964+0000","last_active":"2024-09-12T00:39:16.060964+0000","last_peered":"2024-09-12T00:39:16.060964+0000","last_clean":"2024-09-12T00:39:16.060964+0000","last_became_active":"2024-09-12T00:15:34.417149+0000","last_became_peered":"2024-09-12T00:15:34.417149+0000","last_unstale":"2024-09-12T00:39:16.060964+0000","last_undegraded":"2024-09-12T00:39:16.060964+0000","last_fullsized":"2024-09-12T00:39:16.060964+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'23","last_scrub_stamp":"2024-09-12T00:39:16.060880+0000","last_deep_scrub":"261'23","last_deep_scrub_stamp":"2024-09-12T00:39:16.060880+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.060880+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:52.936909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":25,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.325383+0000","last_change":"2024-09-12T00:39:22.325383+0000","last_active":"2024-09-12T00:39:22.325383+0000","last_peered":"2024-09-12T00:39:22.325383+0000","last_clean":"2024-09-12T00:39:22.325383+0000","last_became_active":"2024-09-12T00:27:17.578739+0000","last_became_peered":"2024-09-12T00:27:17.578739+0000","last_unstale":"2024-09-12T00:39:22.325383+0000","last_undegraded":"2024-09-12T00:39:22.325383+0000","last_fullsized":"2024-09-12T00:39:22.325383+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:22.325281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:22.325281+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.325281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:07.198322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:29.988391+0000","last_change":"2024-09-12T00:39:29.988335+0000","last_active":"2024-09-12T00:39:29.988391+0000","last_peered":"2024-09-12T00:39:29.988391+0000","last_clean":"2024-09-12T00:39:29.988391+0000","last_became_active":"2024-09-12T00:17:03.213071+0000","last_became_peered":"2024-09-12T00:17:03.213071+0000","last_unstale":"2024-09-12T00:39:29.988391+0000","last_undegraded":"2024-09-12T00:39:29.988391+0000","last_fullsized":"2024-09-12T00:39:29.988391+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:29.988246+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:29.988246+0000","last_clean_scrub_stamp":"2024-09-12T00:39:29.988246+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:46.255406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.949710+0000","last_change":"2024-09-12T00:39:21.949645+0000","last_active":"2024-09-12T00:39:21.949710+0000","last_peered":"2024-09-12T00:39:21.949710+0000","last_clean":"2024-09-12T00:39:21.949710+0000","last_became_active":"2024-09-12T00:17:00.178279+0000","last_became_peered":"2024-09-12T00:17:00.178279+0000","last_unstale":"2024-09-12T00:39:21.949710+0000","last_undegraded":"2024-09-12T00:39:21.949710+0000","last_fullsized":"2024-09-12T00:39:21.949710+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:21.949558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:21.949558+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.949558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:32.421262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'24","reported_seq":113,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.931195+0000","last_change":"2024-09-12T00:39:16.931136+0000","last_active":"2024-09-12T00:39:16.931195+0000","last_peered":"2024-09-12T00:39:16.931195+0000","last_clean":"2024-09-12T00:39:16.931195+0000","last_became_active":"2024-09-12T00:15:34.420120+0000","last_became_peered":"2024-09-12T00:15:34.420120+0000","last_unstale":"2024-09-12T00:39:16.931195+0000","last_undegraded":"2024-09-12T00:39:16.931195+0000","last_fullsized":"2024-09-12T00:39:16.931195+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'24","last_scrub_stamp":"2024-09-12T00:39:16.931040+0000","last_deep_scrub":"261'24","last_deep_scrub_stamp":"2024-09-12T00:39:16.931040+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.931040+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:15.253627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:39.834835+0000","last_change":"2024-09-12T00:39:39.834835+0000","last_active":"2024-09-12T00:39:39.834835+0000","last_peered":"2024-09-12T00:39:39.834835+0000","last_clean":"2024-09-12T00:39:39.834835+0000","last_became_active":"2024-09-12T00:27:17.577671+0000","last_became_peered":"2024-09-12T00:27:17.577671+0000","last_unstale":"2024-09-12T00:39:39.834835+0000","last_undegraded":"2024-09-12T00:39:39.834835+0000","last_fullsized":"2024-09-12T00:39:39.834835+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:39.834735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:39.834735+0000","last_clean_scrub_stamp":"2024-09-12T00:39:39.834735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:05.391219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:28.021083+0000","last_change":"2024-09-12T00:39:28.021083+0000","last_active":"2024-09-12T00:39:28.021083+0000","last_peered":"2024-09-12T00:39:28.021083+0000","last_clean":"2024-09-12T00:39:28.021083+0000","last_became_active":"2024-09-12T00:17:03.213775+0000","last_became_peered":"2024-09-12T00:17:03.213775+0000","last_unstale":"2024-09-12T00:39:28.021083+0000","last_undegraded":"2024-09-12T00:39:28.021083+0000","last_fullsized":"2024-09-12T00:39:28.021083+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:28.020979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:28.020979+0000","last_clean_scrub_stamp":"2024-09-12T00:39:28.020979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:47.649123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'6","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:43.007750+0000","last_change":"2024-09-12T00:39:43.007750+0000","last_active":"2024-09-12T00:39:43.007750+0000","last_peered":"2024-09-12T00:39:43.007750+0000","last_clean":"2024-09-12T00:39:43.007750+0000","last_became_active":"2024-09-12T00:17:00.182842+0000","last_became_peered":"2024-09-12T00:17:00.182842+0000","last_unstale":"2024-09-12T00:39:43.007750+0000","last_undegraded":"2024-09-12T00:39:43.007750+0000","last_fullsized":"2024-09-12T00:39:43.007750+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T00:39:43.007649+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T00:39:43.007649+0000","last_clean_scrub_stamp":"2024-09-12T00:39:43.007649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:48.254904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'14","reported_seq":85,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.608728+0000","last_change":"2024-09-12T00:39:22.608728+0000","last_active":"2024-09-12T00:39:22.608728+0000","last_peered":"2024-09-12T00:39:22.608728+0000","last_clean":"2024-09-12T00:39:22.608728+0000","last_became_active":"2024-09-12T00:15:34.421585+0000","last_became_peered":"2024-09-12T00:15:34.421585+0000","last_unstale":"2024-09-12T00:39:22.608728+0000","last_undegraded":"2024-09-12T00:39:22.608728+0000","last_fullsized":"2024-09-12T00:39:22.608728+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'14","last_scrub_stamp":"2024-09-12T00:39:22.608648+0000","last_deep_scrub":"261'14","last_deep_scrub_stamp":"2024-09-12T00:39:22.608648+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.608648+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:32.898916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.952052+0000","last_change":"2024-09-12T00:39:23.952052+0000","last_active":"2024-09-12T00:39:23.952052+0000","last_peered":"2024-09-12T00:39:23.952052+0000","last_clean":"2024-09-12T00:39:23.952052+0000","last_became_active":"2024-09-12T00:27:17.572899+0000","last_became_peered":"2024-09-12T00:27:17.572899+0000","last_unstale":"2024-09-12T00:39:23.952052+0000","last_undegraded":"2024-09-12T00:39:23.952052+0000","last_fullsized":"2024-09-12T00:39:23.952052+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:23.951961+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:23.951961+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.951961+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:01.714398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:33.799368+0000","last_change":"2024-09-12T00:39:33.799368+0000","last_active":"2024-09-12T00:39:33.799368+0000","last_peered":"2024-09-12T00:39:33.799368+0000","last_clean":"2024-09-12T00:39:33.799368+0000","last_became_active":"2024-09-12T00:17:03.217052+0000","last_became_peered":"2024-09-12T00:17:03.217052+0000","last_unstale":"2024-09-12T00:39:33.799368+0000","last_undegraded":"2024-09-12T00:39:33.799368+0000","last_fullsized":"2024-09-12T00:39:33.799368+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:33.799279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:33.799279+0000","last_clean_scrub_stamp":"2024-09-12T00:39:33.799279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:57.298081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.212364+0000","last_change":"2024-09-12T00:39:11.212364+0000","last_active":"2024-09-12T00:39:11.212364+0000","last_peered":"2024-09-12T00:39:11.212364+0000","last_clean":"2024-09-12T00:39:11.212364+0000","last_became_active":"2024-09-12T00:17:00.181082+0000","last_became_peered":"2024-09-12T00:17:00.181082+0000","last_unstale":"2024-09-12T00:39:11.212364+0000","last_undegraded":"2024-09-12T00:39:11.212364+0000","last_fullsized":"2024-09-12T00:39:11.212364+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:11.212247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:11.212247+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.212247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:13.398319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'32","reported_seq":135,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.610029+0000","last_change":"2024-09-12T00:39:21.610029+0000","last_active":"2024-09-12T00:39:21.610029+0000","last_peered":"2024-09-12T00:39:21.610029+0000","last_clean":"2024-09-12T00:39:21.610029+0000","last_became_active":"2024-09-12T00:15:34.413875+0000","last_became_peered":"2024-09-12T00:15:34.413875+0000","last_unstale":"2024-09-12T00:39:21.610029+0000","last_undegraded":"2024-09-12T00:39:21.610029+0000","last_fullsized":"2024-09-12T00:39:21.610029+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'32","last_scrub_stamp":"2024-09-12T00:39:21.609933+0000","last_deep_scrub":"261'32","last_deep_scrub_stamp":"2024-09-12T00:39:21.609933+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.609933+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:57.723093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":63,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:27.071879+0000","last_change":"2024-09-12T00:39:27.071879+0000","last_active":"2024-09-12T00:39:27.071879+0000","last_peered":"2024-09-12T00:39:27.071879+0000","last_clean":"2024-09-12T00:39:27.071879+0000","last_became_active":"2024-09-12T00:27:17.576878+0000","last_became_peered":"2024-09-12T00:27:17.576878+0000","last_unstale":"2024-09-12T00:39:27.071879+0000","last_undegraded":"2024-09-12T00:39:27.071879+0000","last_fullsized":"2024-09-12T00:39:27.071879+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.071775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.071775+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.071775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:54.807735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:29.005220+0000","last_change":"2024-09-12T00:39:29.005220+0000","last_active":"2024-09-12T00:39:29.005220+0000","last_peered":"2024-09-12T00:39:29.005220+0000","last_clean":"2024-09-12T00:39:29.005220+0000","last_became_active":"2024-09-12T00:17:03.215625+0000","last_became_peered":"2024-09-12T00:17:03.215625+0000","last_unstale":"2024-09-12T00:39:29.005220+0000","last_undegraded":"2024-09-12T00:39:29.005220+0000","last_fullsized":"2024-09-12T00:39:29.005220+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:29.005129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:29.005129+0000","last_clean_scrub_stamp":"2024-09-12T00:39:29.005129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:51.430342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.057043+0000","last_change":"2024-09-12T00:39:21.057043+0000","last_active":"2024-09-12T00:39:21.057043+0000","last_peered":"2024-09-12T00:39:21.057043+0000","last_clean":"2024-09-12T00:39:21.057043+0000","last_became_active":"2024-09-12T00:17:00.182392+0000","last_became_peered":"2024-09-12T00:17:00.182392+0000","last_unstale":"2024-09-12T00:39:21.057043+0000","last_undegraded":"2024-09-12T00:39:21.057043+0000","last_fullsized":"2024-09-12T00:39:21.057043+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:21.056958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:21.056958+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.056958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.276177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'27","reported_seq":123,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.023977+0000","last_change":"2024-09-12T00:39:15.023909+0000","last_active":"2024-09-12T00:39:15.023977+0000","last_peered":"2024-09-12T00:39:15.023977+0000","last_clean":"2024-09-12T00:39:15.023977+0000","last_became_active":"2024-09-12T00:15:34.419377+0000","last_became_peered":"2024-09-12T00:15:34.419377+0000","last_unstale":"2024-09-12T00:39:15.023977+0000","last_undegraded":"2024-09-12T00:39:15.023977+0000","last_fullsized":"2024-09-12T00:39:15.023977+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'27","last_scrub_stamp":"2024-09-12T00:39:15.023824+0000","last_deep_scrub":"261'27","last_deep_scrub_stamp":"2024-09-12T00:39:15.023824+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.023824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:56.671649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.301615+0000","last_change":"2024-09-12T00:39:19.301615+0000","last_active":"2024-09-12T00:39:19.301615+0000","last_peered":"2024-09-12T00:39:19.301615+0000","last_clean":"2024-09-12T00:39:19.301615+0000","last_became_active":"2024-09-12T00:27:17.580400+0000","last_became_peered":"2024-09-12T00:27:17.580400+0000","last_unstale":"2024-09-12T00:39:19.301615+0000","last_undegraded":"2024-09-12T00:39:19.301615+0000","last_fullsized":"2024-09-12T00:39:19.301615+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:19.301514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:19.301514+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.301514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:10.691672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"258'5","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.302196+0000","last_change":"2024-09-12T00:39:15.302196+0000","last_active":"2024-09-12T00:39:15.302196+0000","last_peered":"2024-09-12T00:39:15.302196+0000","last_clean":"2024-09-12T00:39:15.302196+0000","last_became_active":"2024-09-12T00:17:03.223700+0000","last_became_peered":"2024-09-12T00:17:03.223700+0000","last_unstale":"2024-09-12T00:39:15.302196+0000","last_undegraded":"2024-09-12T00:39:15.302196+0000","last_fullsized":"2024-09-12T00:39:15.302196+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'5","last_scrub_stamp":"2024-09-12T00:39:15.302095+0000","last_deep_scrub":"258'5","last_deep_scrub_stamp":"2024-09-12T00:39:15.302095+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.302095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:40.693894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:25.868555+0000","last_change":"2024-09-12T00:39:25.868555+0000","last_active":"2024-09-12T00:39:25.868555+0000","last_peered":"2024-09-12T00:39:25.868555+0000","last_clean":"2024-09-12T00:39:25.868555+0000","last_became_active":"2024-09-12T00:17:00.169797+0000","last_became_peered":"2024-09-12T00:17:00.169797+0000","last_unstale":"2024-09-12T00:39:25.868555+0000","last_undegraded":"2024-09-12T00:39:25.868555+0000","last_fullsized":"2024-09-12T00:39:25.868555+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.868460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.868460+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.868460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:44.339341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'40","reported_seq":160,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:36.005783+0000","last_change":"2024-09-12T00:39:36.005783+0000","last_active":"2024-09-12T00:39:36.005783+0000","last_peered":"2024-09-12T00:39:36.005783+0000","last_clean":"2024-09-12T00:39:36.005783+0000","last_became_active":"2024-09-12T00:15:34.422176+0000","last_became_peered":"2024-09-12T00:15:34.422176+0000","last_unstale":"2024-09-12T00:39:36.005783+0000","last_undegraded":"2024-09-12T00:39:36.005783+0000","last_fullsized":"2024-09-12T00:39:36.005783+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'40","last_scrub_stamp":"2024-09-12T00:39:36.005690+0000","last_deep_scrub":"261'40","last_deep_scrub_stamp":"2024-09-12T00:39:36.005690+0000","last_clean_scrub_stamp":"2024-09-12T00:39:36.005690+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:08.715897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":149,"num_write":70,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:41.841598+0000","last_change":"2024-09-12T00:39:41.841598+0000","last_active":"2024-09-12T00:39:41.841598+0000","last_peered":"2024-09-12T00:39:41.841598+0000","last_clean":"2024-09-12T00:39:41.841598+0000","last_became_active":"2024-09-12T00:27:17.579646+0000","last_became_peered":"2024-09-12T00:27:17.579646+0000","last_unstale":"2024-09-12T00:39:41.841598+0000","last_undegraded":"2024-09-12T00:39:41.841598+0000","last_fullsized":"2024-09-12T00:39:41.841598+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:41.841502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:41.841502+0000","last_clean_scrub_stamp":"2024-09-12T00:39:41.841502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:45.365784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"261'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:31.809675+0000","last_change":"2024-09-12T00:39:31.809675+0000","last_active":"2024-09-12T00:39:31.809675+0000","last_peered":"2024-09-12T00:39:31.809675+0000","last_clean":"2024-09-12T00:39:31.809675+0000","last_became_active":"2024-09-12T00:17:03.211732+0000","last_became_peered":"2024-09-12T00:17:03.211732+0000","last_unstale":"2024-09-12T00:39:31.809675+0000","last_undegraded":"2024-09-12T00:39:31.809675+0000","last_fullsized":"2024-09-12T00:39:31.809675+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T00:39:31.809584+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T00:39:31.809584+0000","last_clean_scrub_stamp":"2024-09-12T00:39:31.809584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:52.272821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"258'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.396472+0000","last_change":"2024-09-12T00:39:13.396472+0000","last_active":"2024-09-12T00:39:13.396472+0000","last_peered":"2024-09-12T00:39:13.396472+0000","last_clean":"2024-09-12T00:39:13.396472+0000","last_became_active":"2024-09-12T00:17:00.175460+0000","last_became_peered":"2024-09-12T00:17:00.175460+0000","last_unstale":"2024-09-12T00:39:13.396472+0000","last_undegraded":"2024-09-12T00:39:13.396472+0000","last_fullsized":"2024-09-12T00:39:13.396472+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T00:39:13.396374+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T00:39:13.396374+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.396374+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:35.156823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'37","reported_seq":141,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:33.966048+0000","last_change":"2024-09-12T00:39:33.966048+0000","last_active":"2024-09-12T00:39:33.966048+0000","last_peered":"2024-09-12T00:39:33.966048+0000","last_clean":"2024-09-12T00:39:33.966048+0000","last_became_active":"2024-09-12T00:15:34.423734+0000","last_became_peered":"2024-09-12T00:15:34.423734+0000","last_unstale":"2024-09-12T00:39:33.966048+0000","last_undegraded":"2024-09-12T00:39:33.966048+0000","last_fullsized":"2024-09-12T00:39:33.966048+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'37","last_scrub_stamp":"2024-09-12T00:39:33.965960+0000","last_deep_scrub":"261'37","last_deep_scrub_stamp":"2024-09-12T00:39:33.965960+0000","last_clean_scrub_stamp":"2024-09-12T00:39:33.965960+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:38.158176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":116,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:26.978506+0000","last_change":"2024-09-12T00:39:26.978506+0000","last_active":"2024-09-12T00:39:26.978506+0000","last_peered":"2024-09-12T00:39:26.978506+0000","last_clean":"2024-09-12T00:39:26.978506+0000","last_became_active":"2024-09-12T00:27:17.574346+0000","last_became_peered":"2024-09-12T00:27:17.574346+0000","last_unstale":"2024-09-12T00:39:26.978506+0000","last_undegraded":"2024-09-12T00:39:26.978506+0000","last_fullsized":"2024-09-12T00:39:26.978506+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:26.978399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:26.978399+0000","last_clean_scrub_stamp":"2024-09-12T00:39:26.978399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:58.339937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:32.795428+0000","last_change":"2024-09-12T00:39:32.795428+0000","last_active":"2024-09-12T00:39:32.795428+0000","last_peered":"2024-09-12T00:39:32.795428+0000","last_clean":"2024-09-12T00:39:32.795428+0000","last_became_active":"2024-09-12T00:17:03.210439+0000","last_became_peered":"2024-09-12T00:17:03.210439+0000","last_unstale":"2024-09-12T00:39:32.795428+0000","last_undegraded":"2024-09-12T00:39:32.795428+0000","last_fullsized":"2024-09-12T00:39:32.795428+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:32.795303+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:32.795303+0000","last_clean_scrub_stamp":"2024-09-12T00:39:32.795303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:57.655220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'2","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:24.850342+0000","last_change":"2024-09-12T00:39:24.850342+0000","last_active":"2024-09-12T00:39:24.850342+0000","last_peered":"2024-09-12T00:39:24.850342+0000","last_clean":"2024-09-12T00:39:24.850342+0000","last_became_active":"2024-09-12T00:17:00.179337+0000","last_became_peered":"2024-09-12T00:17:00.179337+0000","last_unstale":"2024-09-12T00:39:24.850342+0000","last_undegraded":"2024-09-12T00:39:24.850342+0000","last_fullsized":"2024-09-12T00:39:24.850342+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:24.850258+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:24.850258+0000","last_clean_scrub_stamp":"2024-09-12T00:39:24.850258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:30.990936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'135","reported_seq":459,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.025901+0000","last_change":"2024-09-12T00:39:14.025901+0000","last_active":"2024-09-12T00:39:14.025901+0000","last_peered":"2024-09-12T00:39:14.025901+0000","last_clean":"2024-09-12T00:39:14.025901+0000","last_became_active":"2024-09-12T00:15:34.421180+0000","last_became_peered":"2024-09-12T00:15:34.421180+0000","last_unstale":"2024-09-12T00:39:14.025901+0000","last_undegraded":"2024-09-12T00:39:14.025901+0000","last_fullsized":"2024-09-12T00:39:14.025901+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'135","last_scrub_stamp":"2024-09-12T00:39:14.025808+0000","last_deep_scrub":"261'135","last_deep_scrub_stamp":"2024-09-12T00:39:14.025808+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.025808+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:28.688390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":617,"num_write":164,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:28.518811+0000","last_change":"2024-09-12T00:39:28.518811+0000","last_active":"2024-09-12T00:39:28.518811+0000","last_peered":"2024-09-12T00:39:28.518811+0000","last_clean":"2024-09-12T00:39:28.518811+0000","last_became_active":"2024-09-12T00:27:17.575257+0000","last_became_peered":"2024-09-12T00:27:17.575257+0000","last_unstale":"2024-09-12T00:39:28.518811+0000","last_undegraded":"2024-09-12T00:39:28.518811+0000","last_fullsized":"2024-09-12T00:39:28.518811+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:28.518720+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:28.518720+0000","last_clean_scrub_stamp":"2024-09-12T00:39:28.518720+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:52.821312+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:26.996209+0000","last_change":"2024-09-12T00:39:26.996209+0000","last_active":"2024-09-12T00:39:26.996209+0000","last_peered":"2024-09-12T00:39:26.996209+0000","last_clean":"2024-09-12T00:39:26.996209+0000","last_became_active":"2024-09-12T00:17:03.222110+0000","last_became_peered":"2024-09-12T00:17:03.222110+0000","last_unstale":"2024-09-12T00:39:26.996209+0000","last_undegraded":"2024-09-12T00:39:26.996209+0000","last_fullsized":"2024-09-12T00:39:26.996209+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:26.996123+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:26.996123+0000","last_clean_scrub_stamp":"2024-09-12T00:39:26.996123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:11.241966+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.400803+0000","last_change":"2024-09-12T00:39:18.400803+0000","last_active":"2024-09-12T00:39:18.400803+0000","last_peered":"2024-09-12T00:39:18.400803+0000","last_clean":"2024-09-12T00:39:18.400803+0000","last_became_active":"2024-09-12T00:17:00.174537+0000","last_became_peered":"2024-09-12T00:17:00.174537+0000","last_unstale":"2024-09-12T00:39:18.400803+0000","last_undegraded":"2024-09-12T00:39:18.400803+0000","last_fullsized":"2024-09-12T00:39:18.400803+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:18.400703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:18.400703+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.400703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:29.217889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"258'31","reported_seq":137,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.112159+0000","last_change":"2024-09-12T00:39:15.112159+0000","last_active":"2024-09-12T00:39:15.112159+0000","last_peered":"2024-09-12T00:39:15.112159+0000","last_clean":"2024-09-12T00:39:15.112159+0000","last_became_active":"2024-09-12T00:15:34.427756+0000","last_became_peered":"2024-09-12T00:15:34.427756+0000","last_unstale":"2024-09-12T00:39:15.112159+0000","last_undegraded":"2024-09-12T00:39:15.112159+0000","last_fullsized":"2024-09-12T00:39:15.112159+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'31","last_scrub_stamp":"2024-09-12T00:39:15.112070+0000","last_deep_scrub":"258'31","last_deep_scrub_stamp":"2024-09-12T00:39:15.112070+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.112070+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:09.070217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":137,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:24.946896+0000","last_change":"2024-09-12T00:39:24.946896+0000","last_active":"2024-09-12T00:39:24.946896+0000","last_peered":"2024-09-12T00:39:24.946896+0000","last_clean":"2024-09-12T00:39:24.946896+0000","last_became_active":"2024-09-12T00:27:17.577076+0000","last_became_peered":"2024-09-12T00:27:17.577076+0000","last_unstale":"2024-09-12T00:39:24.946896+0000","last_undegraded":"2024-09-12T00:39:24.946896+0000","last_fullsized":"2024-09-12T00:39:24.946896+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:24.946814+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:24.946814+0000","last_clean_scrub_stamp":"2024-09-12T00:39:24.946814+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:36.210164+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:40.973432+0000","last_change":"2024-09-12T00:39:40.973432+0000","last_active":"2024-09-12T00:39:40.973432+0000","last_peered":"2024-09-12T00:39:40.973432+0000","last_clean":"2024-09-12T00:39:40.973432+0000","last_became_active":"2024-09-12T00:17:03.217101+0000","last_became_peered":"2024-09-12T00:17:03.217101+0000","last_unstale":"2024-09-12T00:39:40.973432+0000","last_undegraded":"2024-09-12T00:39:40.973432+0000","last_fullsized":"2024-09-12T00:39:40.973432+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:40.973339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:40.973339+0000","last_clean_scrub_stamp":"2024-09-12T00:39:40.973339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:42.174021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.378101+0000","last_change":"2024-09-12T00:39:17.378101+0000","last_active":"2024-09-12T00:39:17.378101+0000","last_peered":"2024-09-12T00:39:17.378101+0000","last_clean":"2024-09-12T00:39:17.378101+0000","last_became_active":"2024-09-12T00:17:00.180475+0000","last_became_peered":"2024-09-12T00:17:00.180475+0000","last_unstale":"2024-09-12T00:39:17.378101+0000","last_undegraded":"2024-09-12T00:39:17.378101+0000","last_fullsized":"2024-09-12T00:39:17.378101+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:17.378008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:17.378008+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.378008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:33.410671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'61","reported_seq":216,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.016460+0000","last_change":"2024-09-12T00:39:13.016460+0000","last_active":"2024-09-12T00:39:13.016460+0000","last_peered":"2024-09-12T00:39:13.016460+0000","last_clean":"2024-09-12T00:39:13.016460+0000","last_became_active":"2024-09-12T00:15:34.418831+0000","last_became_peered":"2024-09-12T00:15:34.418831+0000","last_unstale":"2024-09-12T00:39:13.016460+0000","last_undegraded":"2024-09-12T00:39:13.016460+0000","last_fullsized":"2024-09-12T00:39:13.016460+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'61","last_scrub_stamp":"2024-09-12T00:39:13.016345+0000","last_deep_scrub":"261'61","last_deep_scrub_stamp":"2024-09-12T00:39:13.016345+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.016345+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:38.538047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":218,"num_write":105,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:38.873883+0000","last_change":"2024-09-12T00:39:38.873883+0000","last_active":"2024-09-12T00:39:38.873883+0000","last_peered":"2024-09-12T00:39:38.873883+0000","last_clean":"2024-09-12T00:39:38.873883+0000","last_became_active":"2024-09-12T00:27:17.579263+0000","last_became_peered":"2024-09-12T00:27:17.579263+0000","last_unstale":"2024-09-12T00:39:38.873883+0000","last_undegraded":"2024-09-12T00:39:38.873883+0000","last_fullsized":"2024-09-12T00:39:38.873883+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:38.873769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:38.873769+0000","last_clean_scrub_stamp":"2024-09-12T00:39:38.873769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:30.509064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"258'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:24.028597+0000","last_change":"2024-09-12T00:39:24.028543+0000","last_active":"2024-09-12T00:39:24.028597+0000","last_peered":"2024-09-12T00:39:24.028597+0000","last_clean":"2024-09-12T00:39:24.028597+0000","last_became_active":"2024-09-12T00:17:03.211582+0000","last_became_peered":"2024-09-12T00:17:03.211582+0000","last_unstale":"2024-09-12T00:39:24.028597+0000","last_undegraded":"2024-09-12T00:39:24.028597+0000","last_fullsized":"2024-09-12T00:39:24.028597+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-12T00:39:24.028459+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-12T00:39:24.028459+0000","last_clean_scrub_stamp":"2024-09-12T00:39:24.028459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:24.840219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"261'2","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.129408+0000","last_change":"2024-09-12T00:39:18.129345+0000","last_active":"2024-09-12T00:39:18.129408+0000","last_peered":"2024-09-12T00:39:18.129408+0000","last_clean":"2024-09-12T00:39:18.129408+0000","last_became_active":"2024-09-12T00:17:00.182477+0000","last_became_peered":"2024-09-12T00:17:00.182477+0000","last_unstale":"2024-09-12T00:39:18.129408+0000","last_undegraded":"2024-09-12T00:39:18.129408+0000","last_fullsized":"2024-09-12T00:39:18.129408+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:18.129254+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:18.129254+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.129254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:36.933434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"258'27","reported_seq":122,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.977672+0000","last_change":"2024-09-12T00:39:11.977672+0000","last_active":"2024-09-12T00:39:11.977672+0000","last_peered":"2024-09-12T00:39:11.977672+0000","last_clean":"2024-09-12T00:39:11.977672+0000","last_became_active":"2024-09-12T00:15:34.419584+0000","last_became_peered":"2024-09-12T00:15:34.419584+0000","last_unstale":"2024-09-12T00:39:11.977672+0000","last_undegraded":"2024-09-12T00:39:11.977672+0000","last_fullsized":"2024-09-12T00:39:11.977672+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'27","last_scrub_stamp":"2024-09-12T00:39:11.977587+0000","last_deep_scrub":"258'27","last_deep_scrub_stamp":"2024-09-12T00:39:11.977587+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.977587+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:48.748257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.408371+0000","last_change":"2024-09-12T00:39:20.408371+0000","last_active":"2024-09-12T00:39:20.408371+0000","last_peered":"2024-09-12T00:39:20.408371+0000","last_clean":"2024-09-12T00:39:20.408371+0000","last_became_active":"2024-09-12T00:27:17.579859+0000","last_became_peered":"2024-09-12T00:27:17.579859+0000","last_unstale":"2024-09-12T00:39:20.408371+0000","last_undegraded":"2024-09-12T00:39:20.408371+0000","last_fullsized":"2024-09-12T00:39:20.408371+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:20.408277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:20.408277+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.408277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:02.264015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.035303+0000","last_change":"2024-09-12T00:39:23.035247+0000","last_active":"2024-09-12T00:39:23.035303+0000","last_peered":"2024-09-12T00:39:23.035303+0000","last_clean":"2024-09-12T00:39:23.035303+0000","last_became_active":"2024-09-12T00:17:03.216437+0000","last_became_peered":"2024-09-12T00:17:03.216437+0000","last_unstale":"2024-09-12T00:39:23.035303+0000","last_undegraded":"2024-09-12T00:39:23.035303+0000","last_fullsized":"2024-09-12T00:39:23.035303+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:23.035158+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:23.035158+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.035158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:11.091155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'2","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.956001+0000","last_change":"2024-09-12T00:39:19.955899+0000","last_active":"2024-09-12T00:39:19.956001+0000","last_peered":"2024-09-12T00:39:19.956001+0000","last_clean":"2024-09-12T00:39:19.956001+0000","last_became_active":"2024-09-12T00:17:00.178905+0000","last_became_peered":"2024-09-12T00:17:00.178905+0000","last_unstale":"2024-09-12T00:39:19.956001+0000","last_undegraded":"2024-09-12T00:39:19.956001+0000","last_fullsized":"2024-09-12T00:39:19.956001+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-12T00:39:19.955799+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-12T00:39:19.955799+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.955799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:41.399375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'17","reported_seq":89,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:34.968417+0000","last_change":"2024-09-12T00:39:34.968417+0000","last_active":"2024-09-12T00:39:34.968417+0000","last_peered":"2024-09-12T00:39:34.968417+0000","last_clean":"2024-09-12T00:39:34.968417+0000","last_became_active":"2024-09-12T00:15:34.418859+0000","last_became_peered":"2024-09-12T00:15:34.418859+0000","last_unstale":"2024-09-12T00:39:34.968417+0000","last_undegraded":"2024-09-12T00:39:34.968417+0000","last_fullsized":"2024-09-12T00:39:34.968417+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'17","last_scrub_stamp":"2024-09-12T00:39:34.968321+0000","last_deep_scrub":"261'17","last_deep_scrub_stamp":"2024-09-12T00:39:34.968321+0000","last_clean_scrub_stamp":"2024-09-12T00:39:34.968321+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:48.109459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:59.393701+0000","last_change":"2024-09-12T00:27:17.579640+0000","last_active":"2024-09-12T00:35:59.393701+0000","last_peered":"2024-09-12T00:35:59.393701+0000","last_clean":"2024-09-12T00:35:59.393701+0000","last_became_active":"2024-09-12T00:27:17.577728+0000","last_became_peered":"2024-09-12T00:27:17.577728+0000","last_unstale":"2024-09-12T00:35:59.393701+0000","last_undegraded":"2024-09-12T00:35:59.393701+0000","last_fullsized":"2024-09-12T00:35:59.393701+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:51.317752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"261'13","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:26.032749+0000","last_change":"2024-09-12T00:39:26.032692+0000","last_active":"2024-09-12T00:39:26.032749+0000","last_peered":"2024-09-12T00:39:26.032749+0000","last_clean":"2024-09-12T00:39:26.032749+0000","last_became_active":"2024-09-12T00:17:03.214958+0000","last_became_peered":"2024-09-12T00:17:03.214958+0000","last_unstale":"2024-09-12T00:39:26.032749+0000","last_undegraded":"2024-09-12T00:39:26.032749+0000","last_fullsized":"2024-09-12T00:39:26.032749+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'13","last_scrub_stamp":"2024-09-12T00:39:26.032607+0000","last_deep_scrub":"261'13","last_deep_scrub_stamp":"2024-09-12T00:39:26.032607+0000","last_clean_scrub_stamp":"2024-09-12T00:39:26.032607+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:40.981181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":22528,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"261'9","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.048505+0000","last_change":"2024-09-12T00:39:19.048410+0000","last_active":"2024-09-12T00:39:19.048505+0000","last_peered":"2024-09-12T00:39:19.048505+0000","last_clean":"2024-09-12T00:39:19.048505+0000","last_became_active":"2024-09-12T00:17:00.184703+0000","last_became_peered":"2024-09-12T00:17:00.184703+0000","last_unstale":"2024-09-12T00:39:19.048505+0000","last_undegraded":"2024-09-12T00:39:19.048505+0000","last_fullsized":"2024-09-12T00:39:19.048505+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'9","last_scrub_stamp":"2024-09-12T00:39:19.048321+0000","last_deep_scrub":"261'9","last_deep_scrub_stamp":"2024-09-12T00:39:19.048321+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.048321+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.887918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":24576,"num_write":9,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'12","reported_seq":82,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.417002+0000","last_change":"2024-09-12T00:39:11.417002+0000","last_active":"2024-09-12T00:39:11.417002+0000","last_peered":"2024-09-12T00:39:11.417002+0000","last_clean":"2024-09-12T00:39:11.417002+0000","last_became_active":"2024-09-12T00:15:34.424129+0000","last_became_peered":"2024-09-12T00:15:34.424129+0000","last_unstale":"2024-09-12T00:39:11.417002+0000","last_undegraded":"2024-09-12T00:39:11.417002+0000","last_fullsized":"2024-09-12T00:39:11.417002+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'12","last_scrub_stamp":"2024-09-12T00:39:11.416889+0000","last_deep_scrub":"261'12","last_deep_scrub_stamp":"2024-09-12T00:39:11.416889+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.416889+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:57.677881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.441202+0000","last_change":"2024-09-12T00:39:21.441202+0000","last_active":"2024-09-12T00:39:21.441202+0000","last_peered":"2024-09-12T00:39:21.441202+0000","last_clean":"2024-09-12T00:39:21.441202+0000","last_became_active":"2024-09-12T00:27:17.570973+0000","last_became_peered":"2024-09-12T00:27:17.570973+0000","last_unstale":"2024-09-12T00:39:21.441202+0000","last_undegraded":"2024-09-12T00:39:21.441202+0000","last_fullsized":"2024-09-12T00:39:21.441202+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:21.441114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:21.441114+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.441114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:21.220765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"258'5","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:30.831023+0000","last_change":"2024-09-12T00:39:30.830962+0000","last_active":"2024-09-12T00:39:30.831023+0000","last_peered":"2024-09-12T00:39:30.831023+0000","last_clean":"2024-09-12T00:39:30.831023+0000","last_became_active":"2024-09-12T00:17:03.220961+0000","last_became_peered":"2024-09-12T00:17:03.220961+0000","last_unstale":"2024-09-12T00:39:30.831023+0000","last_undegraded":"2024-09-12T00:39:30.831023+0000","last_fullsized":"2024-09-12T00:39:30.831023+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'5","last_scrub_stamp":"2024-09-12T00:39:30.830852+0000","last_deep_scrub":"258'5","last_deep_scrub_stamp":"2024-09-12T00:39:30.830852+0000","last_clean_scrub_stamp":"2024-09-12T00:39:30.830852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:19.392172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.031567+0000","last_change":"2024-09-12T00:39:20.031501+0000","last_active":"2024-09-12T00:39:20.031567+0000","last_peered":"2024-09-12T00:39:20.031567+0000","last_clean":"2024-09-12T00:39:20.031567+0000","last_became_active":"2024-09-12T00:17:00.178572+0000","last_became_peered":"2024-09-12T00:17:00.178572+0000","last_unstale":"2024-09-12T00:39:20.031567+0000","last_undegraded":"2024-09-12T00:39:20.031567+0000","last_fullsized":"2024-09-12T00:39:20.031567+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:20.031417+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:20.031417+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.031417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:17.968948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'26","reported_seq":119,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.939225+0000","last_change":"2024-09-12T00:39:14.939225+0000","last_active":"2024-09-12T00:39:14.939225+0000","last_peered":"2024-09-12T00:39:14.939225+0000","last_clean":"2024-09-12T00:39:14.939225+0000","last_became_active":"2024-09-12T00:15:34.421019+0000","last_became_peered":"2024-09-12T00:15:34.421019+0000","last_unstale":"2024-09-12T00:39:14.939225+0000","last_undegraded":"2024-09-12T00:39:14.939225+0000","last_fullsized":"2024-09-12T00:39:14.939225+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'26","last_scrub_stamp":"2024-09-12T00:39:14.939128+0000","last_deep_scrub":"261'26","last_deep_scrub_stamp":"2024-09-12T00:39:14.939128+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.939128+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:34.447686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":93,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:37.859932+0000","last_change":"2024-09-12T00:39:37.859932+0000","last_active":"2024-09-12T00:39:37.859932+0000","last_peered":"2024-09-12T00:39:37.859932+0000","last_clean":"2024-09-12T00:39:37.859932+0000","last_became_active":"2024-09-12T00:27:17.579926+0000","last_became_peered":"2024-09-12T00:27:17.579926+0000","last_unstale":"2024-09-12T00:39:37.859932+0000","last_undegraded":"2024-09-12T00:39:37.859932+0000","last_fullsized":"2024-09-12T00:39:37.859932+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:37.859838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:37.859838+0000","last_clean_scrub_stamp":"2024-09-12T00:39:37.859838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:44.772682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'3","reported_seq":34,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:36.941017+0000","last_change":"2024-09-12T00:17:03.219491+0000","last_active":"2024-09-12T00:38:36.941017+0000","last_peered":"2024-09-12T00:38:36.941017+0000","last_clean":"2024-09-12T00:38:36.941017+0000","last_became_active":"2024-09-12T00:17:03.219156+0000","last_became_peered":"2024-09-12T00:17:03.219156+0000","last_unstale":"2024-09-12T00:38:36.941017+0000","last_undegraded":"2024-09-12T00:38:36.941017+0000","last_fullsized":"2024-09-12T00:38:36.941017+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"261'2","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.044818+0000","last_change":"2024-09-12T00:39:17.044818+0000","last_active":"2024-09-12T00:39:17.044818+0000","last_peered":"2024-09-12T00:39:17.044818+0000","last_clean":"2024-09-12T00:39:17.044818+0000","last_became_active":"2024-09-12T00:17:00.182424+0000","last_became_peered":"2024-09-12T00:17:00.182424+0000","last_unstale":"2024-09-12T00:39:17.044818+0000","last_undegraded":"2024-09-12T00:39:17.044818+0000","last_fullsized":"2024-09-12T00:39:17.044818+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:17.044731+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:17.044731+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.044731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:47.954689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"258'17","reported_seq":97,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.986370+0000","last_change":"2024-09-12T00:39:13.986370+0000","last_active":"2024-09-12T00:39:13.986370+0000","last_peered":"2024-09-12T00:39:13.986370+0000","last_clean":"2024-09-12T00:39:13.986370+0000","last_became_active":"2024-09-12T00:15:34.423037+0000","last_became_peered":"2024-09-12T00:15:34.423037+0000","last_unstale":"2024-09-12T00:39:13.986370+0000","last_undegraded":"2024-09-12T00:39:13.986370+0000","last_fullsized":"2024-09-12T00:39:13.986370+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'17","last_scrub_stamp":"2024-09-12T00:39:13.986286+0000","last_deep_scrub":"258'17","last_deep_scrub_stamp":"2024-09-12T00:39:13.986286+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.986286+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:20.113567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":64,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.135757+0000","last_change":"2024-09-12T00:39:23.135757+0000","last_active":"2024-09-12T00:39:23.135757+0000","last_peered":"2024-09-12T00:39:23.135757+0000","last_clean":"2024-09-12T00:39:23.135757+0000","last_became_active":"2024-09-12T00:27:17.583096+0000","last_became_peered":"2024-09-12T00:27:17.583096+0000","last_unstale":"2024-09-12T00:39:23.135757+0000","last_undegraded":"2024-09-12T00:39:23.135757+0000","last_fullsized":"2024-09-12T00:39:23.135757+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:23.135671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:23.135671+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.135671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:18.515232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:26.106678+0000","last_change":"2024-09-12T00:39:26.106678+0000","last_active":"2024-09-12T00:39:26.106678+0000","last_peered":"2024-09-12T00:39:26.106678+0000","last_clean":"2024-09-12T00:39:26.106678+0000","last_became_active":"2024-09-12T00:17:03.214023+0000","last_became_peered":"2024-09-12T00:17:03.214023+0000","last_unstale":"2024-09-12T00:39:26.106678+0000","last_undegraded":"2024-09-12T00:39:26.106678+0000","last_fullsized":"2024-09-12T00:39:26.106678+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T00:39:26.106614+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T00:39:26.106614+0000","last_clean_scrub_stamp":"2024-09-12T00:39:26.106614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:43.680728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.849557+0000","last_change":"2024-09-12T00:39:23.849557+0000","last_active":"2024-09-12T00:39:23.849557+0000","last_peered":"2024-09-12T00:39:23.849557+0000","last_clean":"2024-09-12T00:39:23.849557+0000","last_became_active":"2024-09-12T00:17:00.178465+0000","last_became_peered":"2024-09-12T00:17:00.178465+0000","last_unstale":"2024-09-12T00:39:23.849557+0000","last_undegraded":"2024-09-12T00:39:23.849557+0000","last_fullsized":"2024-09-12T00:39:23.849557+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:23.849455+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:23.849455+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.849455+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:05.484492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'34","reported_seq":146,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.070187+0000","last_change":"2024-09-12T00:39:13.070090+0000","last_active":"2024-09-12T00:39:13.070187+0000","last_peered":"2024-09-12T00:39:13.070187+0000","last_clean":"2024-09-12T00:39:13.070187+0000","last_became_active":"2024-09-12T00:15:34.425540+0000","last_became_peered":"2024-09-12T00:15:34.425540+0000","last_unstale":"2024-09-12T00:39:13.070187+0000","last_undegraded":"2024-09-12T00:39:13.070187+0000","last_fullsized":"2024-09-12T00:39:13.070187+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'34","last_scrub_stamp":"2024-09-12T00:39:13.069969+0000","last_deep_scrub":"261'34","last_deep_scrub_stamp":"2024-09-12T00:39:13.069969+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.069969+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:02.805302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":136,"num_write":51,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.295921+0000","last_change":"2024-09-12T00:39:21.295921+0000","last_active":"2024-09-12T00:39:21.295921+0000","last_peered":"2024-09-12T00:39:21.295921+0000","last_clean":"2024-09-12T00:39:21.295921+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:39:21.295921+0000","last_undegraded":"2024-09-12T00:39:21.295921+0000","last_fullsized":"2024-09-12T00:39:21.295921+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:21.295829+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:21.295829+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.295829+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:44.991704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.917676+0000","last_change":"2024-09-12T00:39:22.917618+0000","last_active":"2024-09-12T00:39:22.917676+0000","last_peered":"2024-09-12T00:39:22.917676+0000","last_clean":"2024-09-12T00:39:22.917676+0000","last_became_active":"2024-09-12T00:17:03.212150+0000","last_became_peered":"2024-09-12T00:17:03.212150+0000","last_unstale":"2024-09-12T00:39:22.917676+0000","last_undegraded":"2024-09-12T00:39:22.917676+0000","last_fullsized":"2024-09-12T00:39:22.917676+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:22.917533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:22.917533+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.917533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:43.890615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"261'8","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.069399+0000","last_change":"2024-09-12T00:39:18.069399+0000","last_active":"2024-09-12T00:39:18.069399+0000","last_peered":"2024-09-12T00:39:18.069399+0000","last_clean":"2024-09-12T00:39:18.069399+0000","last_became_active":"2024-09-12T00:17:00.180944+0000","last_became_peered":"2024-09-12T00:17:00.180944+0000","last_unstale":"2024-09-12T00:39:18.069399+0000","last_undegraded":"2024-09-12T00:39:18.069399+0000","last_fullsized":"2024-09-12T00:39:18.069399+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T00:39:18.069314+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T00:39:18.069314+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.069314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:21.041688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6171,"num_write":13,"num_write_kb":11291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'34","reported_seq":135,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.876845+0000","last_change":"2024-09-12T00:39:22.876785+0000","last_active":"2024-09-12T00:39:22.876845+0000","last_peered":"2024-09-12T00:39:22.876845+0000","last_clean":"2024-09-12T00:39:22.876845+0000","last_became_active":"2024-09-12T00:15:34.418474+0000","last_became_peered":"2024-09-12T00:15:34.418474+0000","last_unstale":"2024-09-12T00:39:22.876845+0000","last_undegraded":"2024-09-12T00:39:22.876845+0000","last_fullsized":"2024-09-12T00:39:22.876845+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'34","last_scrub_stamp":"2024-09-12T00:39:22.876679+0000","last_deep_scrub":"261'34","last_deep_scrub_stamp":"2024-09-12T00:39:22.876679+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.876679+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:43.170752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:31.966866+0000","last_change":"2024-09-12T00:39:31.966866+0000","last_active":"2024-09-12T00:39:31.966866+0000","last_peered":"2024-09-12T00:39:31.966866+0000","last_clean":"2024-09-12T00:39:31.966866+0000","last_became_active":"2024-09-12T00:27:17.581149+0000","last_became_peered":"2024-09-12T00:27:17.581149+0000","last_unstale":"2024-09-12T00:39:31.966866+0000","last_undegraded":"2024-09-12T00:39:31.966866+0000","last_fullsized":"2024-09-12T00:39:31.966866+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:31.966754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:31.966754+0000","last_clean_scrub_stamp":"2024-09-12T00:39:31.966754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:49.625556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.300369+0000","last_change":"2024-09-12T00:39:14.300369+0000","last_active":"2024-09-12T00:39:14.300369+0000","last_peered":"2024-09-12T00:39:14.300369+0000","last_clean":"2024-09-12T00:39:14.300369+0000","last_became_active":"2024-09-12T00:17:03.220965+0000","last_became_peered":"2024-09-12T00:17:03.220965+0000","last_unstale":"2024-09-12T00:39:14.300369+0000","last_undegraded":"2024-09-12T00:39:14.300369+0000","last_fullsized":"2024-09-12T00:39:14.300369+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:14.300284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:14.300284+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.300284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:29.449310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'12","reported_seq":76,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:38.030781+0000","last_change":"2024-09-12T00:39:38.030781+0000","last_active":"2024-09-12T00:39:38.030781+0000","last_peered":"2024-09-12T00:39:38.030781+0000","last_clean":"2024-09-12T00:39:38.030781+0000","last_became_active":"2024-09-12T00:17:00.185600+0000","last_became_peered":"2024-09-12T00:17:00.185600+0000","last_unstale":"2024-09-12T00:39:38.030781+0000","last_undegraded":"2024-09-12T00:39:38.030781+0000","last_fullsized":"2024-09-12T00:39:38.030781+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'12","last_scrub_stamp":"2024-09-12T00:39:38.030685+0000","last_deep_scrub":"261'12","last_deep_scrub_stamp":"2024-09-12T00:39:38.030685+0000","last_clean_scrub_stamp":"2024-09-12T00:39:38.030685+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:07.642687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":41662,"num_write":17,"num_write_kb":10938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'54","reported_seq":195,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.206476+0000","last_change":"2024-09-12T00:39:10.206403+0000","last_active":"2024-09-12T00:39:10.206476+0000","last_peered":"2024-09-12T00:39:10.206476+0000","last_clean":"2024-09-12T00:39:10.206476+0000","last_became_active":"2024-09-12T00:15:34.417393+0000","last_became_peered":"2024-09-12T00:15:34.417393+0000","last_unstale":"2024-09-12T00:39:10.206476+0000","last_undegraded":"2024-09-12T00:39:10.206476+0000","last_fullsized":"2024-09-12T00:39:10.206476+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'54","last_scrub_stamp":"2024-09-12T00:39:10.206325+0000","last_deep_scrub":"261'54","last_deep_scrub_stamp":"2024-09-12T00:39:10.206325+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.206325+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:46.829987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":189,"num_write":107,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.344516+0000","last_change":"2024-09-12T00:39:18.344516+0000","last_active":"2024-09-12T00:39:18.344516+0000","last_peered":"2024-09-12T00:39:18.344516+0000","last_clean":"2024-09-12T00:39:18.344516+0000","last_became_active":"2024-09-12T00:27:17.578983+0000","last_became_peered":"2024-09-12T00:27:17.578983+0000","last_unstale":"2024-09-12T00:39:18.344516+0000","last_undegraded":"2024-09-12T00:39:18.344516+0000","last_fullsized":"2024-09-12T00:39:18.344516+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:18.344432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:18.344432+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.344432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:54.440611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"258'10","reported_seq":68,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:29.813546+0000","last_change":"2024-09-12T00:39:29.813546+0000","last_active":"2024-09-12T00:39:29.813546+0000","last_peered":"2024-09-12T00:39:29.813546+0000","last_clean":"2024-09-12T00:39:29.813546+0000","last_became_active":"2024-09-12T00:17:03.209874+0000","last_became_peered":"2024-09-12T00:17:03.209874+0000","last_unstale":"2024-09-12T00:39:29.813546+0000","last_undegraded":"2024-09-12T00:39:29.813546+0000","last_fullsized":"2024-09-12T00:39:29.813546+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'10","last_scrub_stamp":"2024-09-12T00:39:29.813450+0000","last_deep_scrub":"258'10","last_deep_scrub_stamp":"2024-09-12T00:39:29.813450+0000","last_clean_scrub_stamp":"2024-09-12T00:39:29.813450+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:32.346279+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":41988,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"258'2","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:39.960276+0000","last_change":"2024-09-12T00:39:39.960276+0000","last_active":"2024-09-12T00:39:39.960276+0000","last_peered":"2024-09-12T00:39:39.960276+0000","last_clean":"2024-09-12T00:39:39.960276+0000","last_became_active":"2024-09-12T00:17:00.185688+0000","last_became_peered":"2024-09-12T00:17:00.185688+0000","last_unstale":"2024-09-12T00:39:39.960276+0000","last_undegraded":"2024-09-12T00:39:39.960276+0000","last_fullsized":"2024-09-12T00:39:39.960276+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-12T00:39:39.960181+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-12T00:39:39.960181+0000","last_clean_scrub_stamp":"2024-09-12T00:39:39.960181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:57.105051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":166,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.651847+0000","last_change":"2024-09-12T00:39:20.651781+0000","last_active":"2024-09-12T00:39:20.651847+0000","last_peered":"2024-09-12T00:39:20.651847+0000","last_clean":"2024-09-12T00:39:20.651847+0000","last_became_active":"2024-09-12T00:15:34.411977+0000","last_became_peered":"2024-09-12T00:15:34.411977+0000","last_unstale":"2024-09-12T00:39:20.651847+0000","last_undegraded":"2024-09-12T00:39:20.651847+0000","last_fullsized":"2024-09-12T00:39:20.651847+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'42","last_scrub_stamp":"2024-09-12T00:39:20.651681+0000","last_deep_scrub":"261'42","last_deep_scrub_stamp":"2024-09-12T00:39:20.651681+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.651681+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:11.401803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":161,"num_write":73,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.315691+0000","last_change":"2024-09-12T00:39:17.315691+0000","last_active":"2024-09-12T00:39:17.315691+0000","last_peered":"2024-09-12T00:39:17.315691+0000","last_clean":"2024-09-12T00:39:17.315691+0000","last_became_active":"2024-09-12T00:27:17.578763+0000","last_became_peered":"2024-09-12T00:27:17.578763+0000","last_unstale":"2024-09-12T00:39:17.315691+0000","last_undegraded":"2024-09-12T00:39:17.315691+0000","last_fullsized":"2024-09-12T00:39:17.315691+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:17.315599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:17.315599+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.315599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:52.904813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:28.838076+0000","last_change":"2024-09-12T00:39:28.838076+0000","last_active":"2024-09-12T00:39:28.838076+0000","last_peered":"2024-09-12T00:39:28.838076+0000","last_clean":"2024-09-12T00:39:28.838076+0000","last_became_active":"2024-09-12T00:17:03.216349+0000","last_became_peered":"2024-09-12T00:17:03.216349+0000","last_unstale":"2024-09-12T00:39:28.838076+0000","last_undegraded":"2024-09-12T00:39:28.838076+0000","last_fullsized":"2024-09-12T00:39:28.838076+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:28.837972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:28.837972+0000","last_clean_scrub_stamp":"2024-09-12T00:39:28.837972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:55.788182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:26.570331+0000","last_change":"2024-09-12T00:39:26.570331+0000","last_active":"2024-09-12T00:39:26.570331+0000","last_peered":"2024-09-12T00:39:26.570331+0000","last_clean":"2024-09-12T00:39:26.570331+0000","last_became_active":"2024-09-12T00:17:00.182780+0000","last_became_peered":"2024-09-12T00:17:00.182780+0000","last_unstale":"2024-09-12T00:39:26.570331+0000","last_undegraded":"2024-09-12T00:39:26.570331+0000","last_fullsized":"2024-09-12T00:39:26.570331+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:26.570238+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:26.570238+0000","last_clean_scrub_stamp":"2024-09-12T00:39:26.570238+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:11.331834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'38","reported_seq":150,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:32.980602+0000","last_change":"2024-09-12T00:39:32.980602+0000","last_active":"2024-09-12T00:39:32.980602+0000","last_peered":"2024-09-12T00:39:32.980602+0000","last_clean":"2024-09-12T00:39:32.980602+0000","last_became_active":"2024-09-12T00:15:34.409622+0000","last_became_peered":"2024-09-12T00:15:34.409622+0000","last_unstale":"2024-09-12T00:39:32.980602+0000","last_undegraded":"2024-09-12T00:39:32.980602+0000","last_fullsized":"2024-09-12T00:39:32.980602+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'38","last_scrub_stamp":"2024-09-12T00:39:32.980473+0000","last_deep_scrub":"261'38","last_deep_scrub_stamp":"2024-09-12T00:39:32.980473+0000","last_clean_scrub_stamp":"2024-09-12T00:39:32.980473+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:42.538186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":134,"num_write":65,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:40.794089+0000","last_change":"2024-09-12T00:39:40.794089+0000","last_active":"2024-09-12T00:39:40.794089+0000","last_peered":"2024-09-12T00:39:40.794089+0000","last_clean":"2024-09-12T00:39:40.794089+0000","last_became_active":"2024-09-12T00:27:17.581993+0000","last_became_peered":"2024-09-12T00:27:17.581993+0000","last_unstale":"2024-09-12T00:39:40.794089+0000","last_undegraded":"2024-09-12T00:39:40.794089+0000","last_fullsized":"2024-09-12T00:39:40.794089+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:40.793978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:40.793978+0000","last_clean_scrub_stamp":"2024-09-12T00:39:40.793978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:31.151862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.267690+0000","last_change":"2024-09-12T00:39:13.267690+0000","last_active":"2024-09-12T00:39:13.267690+0000","last_peered":"2024-09-12T00:39:13.267690+0000","last_clean":"2024-09-12T00:39:13.267690+0000","last_became_active":"2024-09-12T00:17:03.219888+0000","last_became_peered":"2024-09-12T00:17:03.219888+0000","last_unstale":"2024-09-12T00:39:13.267690+0000","last_undegraded":"2024-09-12T00:39:13.267690+0000","last_fullsized":"2024-09-12T00:39:13.267690+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T00:39:13.267608+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T00:39:13.267608+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.267608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:16.563967+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"258'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.100296+0000","last_change":"2024-09-12T00:39:19.100296+0000","last_active":"2024-09-12T00:39:19.100296+0000","last_peered":"2024-09-12T00:39:19.100296+0000","last_clean":"2024-09-12T00:39:19.100296+0000","last_became_active":"2024-09-12T00:17:00.169299+0000","last_became_peered":"2024-09-12T00:17:00.169299+0000","last_unstale":"2024-09-12T00:39:19.100296+0000","last_undegraded":"2024-09-12T00:39:19.100296+0000","last_fullsized":"2024-09-12T00:39:19.100296+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T00:39:19.100206+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T00:39:19.100206+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.100206+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:28.788232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'48","reported_seq":184,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.108535+0000","last_change":"2024-09-12T00:39:14.108535+0000","last_active":"2024-09-12T00:39:14.108535+0000","last_peered":"2024-09-12T00:39:14.108535+0000","last_clean":"2024-09-12T00:39:14.108535+0000","last_became_active":"2024-09-12T00:15:34.427735+0000","last_became_peered":"2024-09-12T00:15:34.427735+0000","last_unstale":"2024-09-12T00:39:14.108535+0000","last_undegraded":"2024-09-12T00:39:14.108535+0000","last_fullsized":"2024-09-12T00:39:14.108535+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'48","last_scrub_stamp":"2024-09-12T00:39:14.108432+0000","last_deep_scrub":"261'48","last_deep_scrub_stamp":"2024-09-12T00:39:14.108432+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.108432+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:05.307096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":182,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:39.390825+0000","last_change":"2024-09-12T00:27:17.573147+0000","last_active":"2024-09-12T00:35:39.390825+0000","last_peered":"2024-09-12T00:35:39.390825+0000","last_clean":"2024-09-12T00:35:39.390825+0000","last_became_active":"2024-09-12T00:27:17.572817+0000","last_became_peered":"2024-09-12T00:27:17.572817+0000","last_unstale":"2024-09-12T00:35:39.390825+0000","last_undegraded":"2024-09-12T00:35:39.390825+0000","last_fullsized":"2024-09-12T00:35:39.390825+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:43.980881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"261'6","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:37.447617+0000","last_change":"2024-09-12T00:17:03.220324+0000","last_active":"2024-09-12T00:38:37.447617+0000","last_peered":"2024-09-12T00:38:37.447617+0000","last_clean":"2024-09-12T00:38:37.447617+0000","last_became_active":"2024-09-12T00:17:03.219129+0000","last_became_peered":"2024-09-12T00:17:03.219129+0000","last_unstale":"2024-09-12T00:38:37.447617+0000","last_undegraded":"2024-09-12T00:38:37.447617+0000","last_fullsized":"2024-09-12T00:38:37.447617+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:02.180677+0000","last_clean_scrub_stamp":"2024-09-12T00:17:02.180677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'6","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:37.018947+0000","last_change":"2024-09-12T00:39:37.018947+0000","last_active":"2024-09-12T00:39:37.018947+0000","last_peered":"2024-09-12T00:39:37.018947+0000","last_clean":"2024-09-12T00:39:37.018947+0000","last_became_active":"2024-09-12T00:17:00.182301+0000","last_became_peered":"2024-09-12T00:17:00.182301+0000","last_unstale":"2024-09-12T00:39:37.018947+0000","last_undegraded":"2024-09-12T00:39:37.018947+0000","last_fullsized":"2024-09-12T00:39:37.018947+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T00:39:37.018853+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T00:39:37.018853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:37.018853+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:51.530479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'23","reported_seq":110,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.943059+0000","last_change":"2024-09-12T00:39:10.943059+0000","last_active":"2024-09-12T00:39:10.943059+0000","last_peered":"2024-09-12T00:39:10.943059+0000","last_clean":"2024-09-12T00:39:10.943059+0000","last_became_active":"2024-09-12T00:15:34.428056+0000","last_became_peered":"2024-09-12T00:15:34.428056+0000","last_unstale":"2024-09-12T00:39:10.943059+0000","last_undegraded":"2024-09-12T00:39:10.943059+0000","last_fullsized":"2024-09-12T00:39:10.943059+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'23","last_scrub_stamp":"2024-09-12T00:39:10.942970+0000","last_deep_scrub":"261'23","last_deep_scrub_stamp":"2024-09-12T00:39:10.942970+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.942970+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:15.519299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:31.006273+0000","last_change":"2024-09-12T00:39:31.006273+0000","last_active":"2024-09-12T00:39:31.006273+0000","last_peered":"2024-09-12T00:39:31.006273+0000","last_clean":"2024-09-12T00:39:31.006273+0000","last_became_active":"2024-09-12T00:27:17.575332+0000","last_became_peered":"2024-09-12T00:27:17.575332+0000","last_unstale":"2024-09-12T00:39:31.006273+0000","last_undegraded":"2024-09-12T00:39:31.006273+0000","last_fullsized":"2024-09-12T00:39:31.006273+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:31.006184+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:31.006184+0000","last_clean_scrub_stamp":"2024-09-12T00:39:31.006184+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:48.941556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"258'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:25.612999+0000","last_change":"2024-09-12T00:39:25.612999+0000","last_active":"2024-09-12T00:39:25.612999+0000","last_peered":"2024-09-12T00:39:25.612999+0000","last_clean":"2024-09-12T00:39:25.612999+0000","last_became_active":"2024-09-12T00:17:03.206580+0000","last_became_peered":"2024-09-12T00:17:03.206580+0000","last_unstale":"2024-09-12T00:39:25.612999+0000","last_undegraded":"2024-09-12T00:39:25.612999+0000","last_fullsized":"2024-09-12T00:39:25.612999+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'6","last_scrub_stamp":"2024-09-12T00:39:25.612911+0000","last_deep_scrub":"258'6","last_deep_scrub_stamp":"2024-09-12T00:39:25.612911+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.612911+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:54.268773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.139871+0000","last_change":"2024-09-12T00:39:17.139871+0000","last_active":"2024-09-12T00:39:17.139871+0000","last_peered":"2024-09-12T00:39:17.139871+0000","last_clean":"2024-09-12T00:39:17.139871+0000","last_became_active":"2024-09-12T00:17:00.169464+0000","last_became_peered":"2024-09-12T00:17:00.169464+0000","last_unstale":"2024-09-12T00:39:17.139871+0000","last_undegraded":"2024-09-12T00:39:17.139871+0000","last_fullsized":"2024-09-12T00:39:17.139871+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:17.139788+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:17.139788+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.139788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:49.246363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'22","reported_seq":105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.048186+0000","last_change":"2024-09-12T00:39:12.048186+0000","last_active":"2024-09-12T00:39:12.048186+0000","last_peered":"2024-09-12T00:39:12.048186+0000","last_clean":"2024-09-12T00:39:12.048186+0000","last_became_active":"2024-09-12T00:15:34.427661+0000","last_became_peered":"2024-09-12T00:15:34.427661+0000","last_unstale":"2024-09-12T00:39:12.048186+0000","last_undegraded":"2024-09-12T00:39:12.048186+0000","last_fullsized":"2024-09-12T00:39:12.048186+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'22","last_scrub_stamp":"2024-09-12T00:39:12.048102+0000","last_deep_scrub":"261'22","last_deep_scrub_stamp":"2024-09-12T00:39:12.048102+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.048102+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:33.795502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":70,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:27.551016+0000","last_change":"2024-09-12T00:39:27.551016+0000","last_active":"2024-09-12T00:39:27.551016+0000","last_peered":"2024-09-12T00:39:27.551016+0000","last_clean":"2024-09-12T00:39:27.551016+0000","last_became_active":"2024-09-12T00:27:17.575941+0000","last_became_peered":"2024-09-12T00:27:17.575941+0000","last_unstale":"2024-09-12T00:39:27.551016+0000","last_undegraded":"2024-09-12T00:39:27.551016+0000","last_fullsized":"2024-09-12T00:39:27.551016+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.550929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.550929+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.550929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:38.045680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:39.006967+0000","last_change":"2024-09-12T00:39:39.006967+0000","last_active":"2024-09-12T00:39:39.006967+0000","last_peered":"2024-09-12T00:39:39.006967+0000","last_clean":"2024-09-12T00:39:39.006967+0000","last_became_active":"2024-09-12T00:17:03.217678+0000","last_became_peered":"2024-09-12T00:17:03.217678+0000","last_unstale":"2024-09-12T00:39:39.006967+0000","last_undegraded":"2024-09-12T00:39:39.006967+0000","last_fullsized":"2024-09-12T00:39:39.006967+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:39.006884+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:39.006884+0000","last_clean_scrub_stamp":"2024-09-12T00:39:39.006884+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:44.022962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'5","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:41.992600+0000","last_change":"2024-09-12T00:39:41.992600+0000","last_active":"2024-09-12T00:39:41.992600+0000","last_peered":"2024-09-12T00:39:41.992600+0000","last_clean":"2024-09-12T00:39:41.992600+0000","last_became_active":"2024-09-12T00:17:00.185637+0000","last_became_peered":"2024-09-12T00:17:00.185637+0000","last_unstale":"2024-09-12T00:39:41.992600+0000","last_undegraded":"2024-09-12T00:39:41.992600+0000","last_fullsized":"2024-09-12T00:39:41.992600+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T00:39:41.992501+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T00:39:41.992501+0000","last_clean_scrub_stamp":"2024-09-12T00:39:41.992501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:42.462935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'27","reported_seq":122,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:31.005049+0000","last_change":"2024-09-12T00:39:31.005049+0000","last_active":"2024-09-12T00:39:31.005049+0000","last_peered":"2024-09-12T00:39:31.005049+0000","last_clean":"2024-09-12T00:39:31.005049+0000","last_became_active":"2024-09-12T00:15:34.408612+0000","last_became_peered":"2024-09-12T00:15:34.408612+0000","last_unstale":"2024-09-12T00:39:31.005049+0000","last_undegraded":"2024-09-12T00:39:31.005049+0000","last_fullsized":"2024-09-12T00:39:31.005049+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'27","last_scrub_stamp":"2024-09-12T00:39:31.004924+0000","last_deep_scrub":"261'27","last_deep_scrub_stamp":"2024-09-12T00:39:31.004924+0000","last_clean_scrub_stamp":"2024-09-12T00:39:31.004924+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:00.069040+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":97,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:36.907278+0000","last_change":"2024-09-12T00:39:36.907278+0000","last_active":"2024-09-12T00:39:36.907278+0000","last_peered":"2024-09-12T00:39:36.907278+0000","last_clean":"2024-09-12T00:39:36.907278+0000","last_became_active":"2024-09-12T00:27:17.579332+0000","last_became_peered":"2024-09-12T00:27:17.579332+0000","last_unstale":"2024-09-12T00:39:36.907278+0000","last_undegraded":"2024-09-12T00:39:36.907278+0000","last_fullsized":"2024-09-12T00:39:36.907278+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:36.907182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:36.907182+0000","last_clean_scrub_stamp":"2024-09-12T00:39:36.907182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:02.827220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:25.133646+0000","last_change":"2024-09-12T00:39:25.133646+0000","last_active":"2024-09-12T00:39:25.133646+0000","last_peered":"2024-09-12T00:39:25.133646+0000","last_clean":"2024-09-12T00:39:25.133646+0000","last_became_active":"2024-09-12T00:17:03.203401+0000","last_became_peered":"2024-09-12T00:17:03.203401+0000","last_unstale":"2024-09-12T00:39:25.133646+0000","last_undegraded":"2024-09-12T00:39:25.133646+0000","last_fullsized":"2024-09-12T00:39:25.133646+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.133557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.133557+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.133557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:27.542813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.976116+0000","last_change":"2024-09-12T00:39:20.976116+0000","last_active":"2024-09-12T00:39:20.976116+0000","last_peered":"2024-09-12T00:39:20.976116+0000","last_clean":"2024-09-12T00:39:20.976116+0000","last_became_active":"2024-09-12T00:17:00.181095+0000","last_became_peered":"2024-09-12T00:17:00.181095+0000","last_unstale":"2024-09-12T00:39:20.976116+0000","last_undegraded":"2024-09-12T00:39:20.976116+0000","last_fullsized":"2024-09-12T00:39:20.976116+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:20.976002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:20.976002+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.976002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:41.988221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'19","reported_seq":101,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:29.958283+0000","last_change":"2024-09-12T00:39:29.958283+0000","last_active":"2024-09-12T00:39:29.958283+0000","last_peered":"2024-09-12T00:39:29.958283+0000","last_clean":"2024-09-12T00:39:29.958283+0000","last_became_active":"2024-09-12T00:15:34.420583+0000","last_became_peered":"2024-09-12T00:15:34.420583+0000","last_unstale":"2024-09-12T00:39:29.958283+0000","last_undegraded":"2024-09-12T00:39:29.958283+0000","last_fullsized":"2024-09-12T00:39:29.958283+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'19","last_scrub_stamp":"2024-09-12T00:39:29.958192+0000","last_deep_scrub":"261'19","last_deep_scrub_stamp":"2024-09-12T00:39:29.958192+0000","last_clean_scrub_stamp":"2024-09-12T00:39:29.958192+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:24.388006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":18,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:35:44.391630+0000","last_change":"2024-09-12T00:27:17.580218+0000","last_active":"2024-09-12T00:35:44.391630+0000","last_peered":"2024-09-12T00:35:44.391630+0000","last_clean":"2024-09-12T00:35:44.391630+0000","last_became_active":"2024-09-12T00:27:17.579957+0000","last_became_peered":"2024-09-12T00:27:17.579957+0000","last_unstale":"2024-09-12T00:35:44.391630+0000","last_undegraded":"2024-09-12T00:35:44.391630+0000","last_fullsized":"2024-09-12T00:35:44.391630+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:27:16.542944+0000","last_clean_scrub_stamp":"2024-09-12T00:27:16.542944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:50.892944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.087682+0000","last_change":"2024-09-12T00:39:21.087682+0000","last_active":"2024-09-12T00:39:21.087682+0000","last_peered":"2024-09-12T00:39:21.087682+0000","last_clean":"2024-09-12T00:39:21.087682+0000","last_became_active":"2024-09-12T00:17:03.222212+0000","last_became_peered":"2024-09-12T00:17:03.222212+0000","last_unstale":"2024-09-12T00:39:21.087682+0000","last_undegraded":"2024-09-12T00:39:21.087682+0000","last_fullsized":"2024-09-12T00:39:21.087682+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:21.087582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:21.087582+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.087582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:14.366113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"258'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.363628+0000","last_change":"2024-09-12T00:39:14.363628+0000","last_active":"2024-09-12T00:39:14.363628+0000","last_peered":"2024-09-12T00:39:14.363628+0000","last_clean":"2024-09-12T00:39:14.363628+0000","last_became_active":"2024-09-12T00:17:00.184654+0000","last_became_peered":"2024-09-12T00:17:00.184654+0000","last_unstale":"2024-09-12T00:39:14.363628+0000","last_undegraded":"2024-09-12T00:39:14.363628+0000","last_fullsized":"2024-09-12T00:39:14.363628+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T00:39:14.363541+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T00:39:14.363541+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.363541+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:52.973589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'33","reported_seq":139,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.096033+0000","last_change":"2024-09-12T00:39:09.095923+0000","last_active":"2024-09-12T00:39:09.096033+0000","last_peered":"2024-09-12T00:39:09.096033+0000","last_clean":"2024-09-12T00:39:09.096033+0000","last_became_active":"2024-09-12T00:15:34.425489+0000","last_became_peered":"2024-09-12T00:15:34.425489+0000","last_unstale":"2024-09-12T00:39:09.096033+0000","last_undegraded":"2024-09-12T00:39:09.096033+0000","last_fullsized":"2024-09-12T00:39:09.096033+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'33","last_scrub_stamp":"2024-09-12T00:39:09.095823+0000","last_deep_scrub":"261'33","last_deep_scrub_stamp":"2024-09-12T00:39:09.095823+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.095823+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:00.657525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":114,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'331","reported_seq":983,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.232491+0000","last_change":"2024-09-12T00:38:52.232372+0000","last_active":"2024-09-12T00:38:52.232491+0000","last_peered":"2024-09-12T00:38:52.232491+0000","last_clean":"2024-09-12T00:38:52.232491+0000","last_became_active":"2024-09-12T00:01:57.152039+0000","last_became_peered":"2024-09-12T00:01:57.152039+0000","last_unstale":"2024-09-12T00:38:52.232491+0000","last_undegraded":"2024-09-12T00:38:52.232491+0000","last_fullsized":"2024-09-12T00:38:52.232491+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'331","last_scrub_stamp":"2024-09-12T00:38:52.232200+0000","last_deep_scrub":"261'331","last_deep_scrub_stamp":"2024-09-12T00:38:52.232200+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.232200+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:40.965953+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":62278,"num_write":1122,"num_write_kb":40244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'78","reported_seq":668,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.421208+0000","last_change":"2024-09-12T00:38:58.421103+0000","last_active":"2024-09-12T00:38:58.421208+0000","last_peered":"2024-09-12T00:38:58.421208+0000","last_clean":"2024-09-12T00:38:58.421208+0000","last_became_active":"2024-09-12T00:01:59.156166+0000","last_became_peered":"2024-09-12T00:01:59.156166+0000","last_unstale":"2024-09-12T00:38:58.421208+0000","last_undegraded":"2024-09-12T00:38:58.421208+0000","last_fullsized":"2024-09-12T00:38:58.421208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'78","last_scrub_stamp":"2024-09-12T00:38:58.421001+0000","last_deep_scrub":"261'78","last_deep_scrub_stamp":"2024-09-12T00:38:58.421001+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.421001+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:08.530267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":327,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'318","reported_seq":961,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.805829+0000","last_change":"2024-09-12T00:38:57.805750+0000","last_active":"2024-09-12T00:38:57.805829+0000","last_peered":"2024-09-12T00:38:57.805829+0000","last_clean":"2024-09-12T00:38:57.805829+0000","last_became_active":"2024-09-12T00:01:57.147519+0000","last_became_peered":"2024-09-12T00:01:57.147519+0000","last_unstale":"2024-09-12T00:38:57.805829+0000","last_undegraded":"2024-09-12T00:38:57.805829+0000","last_fullsized":"2024-09-12T00:38:57.805829+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'318","last_scrub_stamp":"2024-09-12T00:38:57.805642+0000","last_deep_scrub":"261'318","last_deep_scrub_stamp":"2024-09-12T00:38:57.805642+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.805642+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:55.449630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":64019,"num_write":1006,"num_write_kb":35322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'285","reported_seq":951,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.290833+0000","last_change":"2024-09-12T00:39:11.290734+0000","last_active":"2024-09-12T00:39:11.290833+0000","last_peered":"2024-09-12T00:39:11.290833+0000","last_clean":"2024-09-12T00:39:11.290833+0000","last_became_active":"2024-09-12T00:01:59.140661+0000","last_became_peered":"2024-09-12T00:01:59.140661+0000","last_unstale":"2024-09-12T00:39:11.290833+0000","last_undegraded":"2024-09-12T00:39:11.290833+0000","last_fullsized":"2024-09-12T00:39:11.290833+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'285","last_scrub_stamp":"2024-09-12T00:39:11.290598+0000","last_deep_scrub":"261'285","last_deep_scrub_stamp":"2024-09-12T00:39:11.290598+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.290598+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:27.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1344,"num_read_kb":1119,"num_write":493,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'353","reported_seq":986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.803680+0000","last_change":"2024-09-12T00:38:55.803618+0000","last_active":"2024-09-12T00:38:55.803680+0000","last_peered":"2024-09-12T00:38:55.803680+0000","last_clean":"2024-09-12T00:38:55.803680+0000","last_became_active":"2024-09-12T00:01:57.140885+0000","last_became_peered":"2024-09-12T00:01:57.140885+0000","last_unstale":"2024-09-12T00:38:55.803680+0000","last_undegraded":"2024-09-12T00:38:55.803680+0000","last_fullsized":"2024-09-12T00:38:55.803680+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T00:38:55.803496+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T00:38:55.803496+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.803496+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:39.294089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":495,"num_read_kb":8973,"num_write":1119,"num_write_kb":33019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'357","reported_seq":1006,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.218099+0000","last_change":"2024-09-12T00:39:06.218036+0000","last_active":"2024-09-12T00:39:06.218099+0000","last_peered":"2024-09-12T00:39:06.218099+0000","last_clean":"2024-09-12T00:39:06.218099+0000","last_became_active":"2024-09-12T00:01:59.144660+0000","last_became_peered":"2024-09-12T00:01:59.144660+0000","last_unstale":"2024-09-12T00:39:06.218099+0000","last_undegraded":"2024-09-12T00:39:06.218099+0000","last_fullsized":"2024-09-12T00:39:06.218099+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'357","last_scrub_stamp":"2024-09-12T00:39:06.217962+0000","last_deep_scrub":"261'357","last_deep_scrub_stamp":"2024-09-12T00:39:06.217962+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.217962+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:12.487208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1585,"num_read_kb":1295,"num_write":589,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'362","reported_seq":996,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.044672+0000","last_change":"2024-09-12T00:38:48.044672+0000","last_active":"2024-09-12T00:38:48.044672+0000","last_peered":"2024-09-12T00:38:48.044672+0000","last_clean":"2024-09-12T00:38:48.044672+0000","last_became_active":"2024-09-12T00:01:57.154749+0000","last_became_peered":"2024-09-12T00:01:57.154749+0000","last_unstale":"2024-09-12T00:38:48.044672+0000","last_undegraded":"2024-09-12T00:38:48.044672+0000","last_fullsized":"2024-09-12T00:38:48.044672+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'362","last_scrub_stamp":"2024-09-12T00:38:48.044510+0000","last_deep_scrub":"261'362","last_deep_scrub_stamp":"2024-09-12T00:38:48.044510+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.044510+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:47.176239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":533,"num_read_kb":65054,"num_write":1136,"num_write_kb":38777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'303","reported_seq":934,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.535738+0000","last_change":"2024-09-12T00:39:00.535670+0000","last_active":"2024-09-12T00:39:00.535738+0000","last_peered":"2024-09-12T00:39:00.535738+0000","last_clean":"2024-09-12T00:39:00.535738+0000","last_became_active":"2024-09-12T00:01:59.146925+0000","last_became_peered":"2024-09-12T00:01:59.146925+0000","last_unstale":"2024-09-12T00:39:00.535738+0000","last_undegraded":"2024-09-12T00:39:00.535738+0000","last_fullsized":"2024-09-12T00:39:00.535738+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'303","last_scrub_stamp":"2024-09-12T00:39:00.535589+0000","last_deep_scrub":"261'303","last_deep_scrub_stamp":"2024-09-12T00:39:00.535589+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.535589+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:53.374654+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1201,"num_read_kb":972,"num_write":449,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'361","reported_seq":1106,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.196418+0000","last_change":"2024-09-12T00:38:51.196352+0000","last_active":"2024-09-12T00:38:51.196418+0000","last_peered":"2024-09-12T00:38:51.196418+0000","last_clean":"2024-09-12T00:38:51.196418+0000","last_became_active":"2024-09-12T00:01:57.151028+0000","last_became_peered":"2024-09-12T00:01:57.151028+0000","last_unstale":"2024-09-12T00:38:51.196418+0000","last_undegraded":"2024-09-12T00:38:51.196418+0000","last_fullsized":"2024-09-12T00:38:51.196418+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'361","last_scrub_stamp":"2024-09-12T00:38:51.196229+0000","last_deep_scrub":"261'361","last_deep_scrub_stamp":"2024-09-12T00:38:51.196229+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.196229+0000","objects_scrubbed":10,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:50.130757+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2337543,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":829,"num_read_kb":49842,"num_write":1146,"num_write_kb":22305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'253","reported_seq":917,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.297540+0000","last_change":"2024-09-12T00:38:57.297540+0000","last_active":"2024-09-12T00:38:57.297540+0000","last_peered":"2024-09-12T00:38:57.297540+0000","last_clean":"2024-09-12T00:38:57.297540+0000","last_became_active":"2024-09-12T00:01:59.149728+0000","last_became_peered":"2024-09-12T00:01:59.149728+0000","last_unstale":"2024-09-12T00:38:57.297540+0000","last_undegraded":"2024-09-12T00:38:57.297540+0000","last_fullsized":"2024-09-12T00:38:57.297540+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'253","last_scrub_stamp":"2024-09-12T00:38:57.297444+0000","last_deep_scrub":"261'253","last_deep_scrub_stamp":"2024-09-12T00:38:57.297444+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.297444+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:04.300911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1186,"num_read_kb":981,"num_write":436,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'351","reported_seq":1102,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.044817+0000","last_change":"2024-09-12T00:38:47.044743+0000","last_active":"2024-09-12T00:38:47.044817+0000","last_peered":"2024-09-12T00:38:47.044817+0000","last_clean":"2024-09-12T00:38:47.044817+0000","last_became_active":"2024-09-12T00:01:57.152791+0000","last_became_peered":"2024-09-12T00:01:57.152791+0000","last_unstale":"2024-09-12T00:38:47.044817+0000","last_undegraded":"2024-09-12T00:38:47.044817+0000","last_fullsized":"2024-09-12T00:38:47.044817+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'351","last_scrub_stamp":"2024-09-12T00:38:47.044625+0000","last_deep_scrub":"261'351","last_deep_scrub_stamp":"2024-09-12T00:38:47.044625+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.044625+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:39.302097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133707,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":815,"num_read_kb":39083,"num_write":1189,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'276","reported_seq":873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.326031+0000","last_change":"2024-09-12T00:38:58.325938+0000","last_active":"2024-09-12T00:38:58.326031+0000","last_peered":"2024-09-12T00:38:58.326031+0000","last_clean":"2024-09-12T00:38:58.326031+0000","last_became_active":"2024-09-12T00:01:59.151168+0000","last_became_peered":"2024-09-12T00:01:59.151168+0000","last_unstale":"2024-09-12T00:38:58.326031+0000","last_undegraded":"2024-09-12T00:38:58.326031+0000","last_fullsized":"2024-09-12T00:38:58.326031+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'276","last_scrub_stamp":"2024-09-12T00:38:58.325822+0000","last_deep_scrub":"261'276","last_deep_scrub_stamp":"2024-09-12T00:38:58.325822+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.325822+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:47.632687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1184,"num_read_kb":963,"num_write":440,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'354","reported_seq":1025,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.192504+0000","last_change":"2024-09-12T00:38:50.192429+0000","last_active":"2024-09-12T00:38:50.192504+0000","last_peered":"2024-09-12T00:38:50.192504+0000","last_clean":"2024-09-12T00:38:50.192504+0000","last_became_active":"2024-09-12T00:01:57.146592+0000","last_became_peered":"2024-09-12T00:01:57.146592+0000","last_unstale":"2024-09-12T00:38:50.192504+0000","last_undegraded":"2024-09-12T00:38:50.192504+0000","last_fullsized":"2024-09-12T00:38:50.192504+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-12T00:38:50.192316+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-12T00:38:50.192316+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.192316+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:49.228766+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":36666,"num_write":1128,"num_write_kb":21178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'169","reported_seq":766,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.194086+0000","last_change":"2024-09-12T00:39:01.194024+0000","last_active":"2024-09-12T00:39:01.194086+0000","last_peered":"2024-09-12T00:39:01.194086+0000","last_clean":"2024-09-12T00:39:01.194086+0000","last_became_active":"2024-09-12T00:01:59.153277+0000","last_became_peered":"2024-09-12T00:01:59.153277+0000","last_unstale":"2024-09-12T00:39:01.194086+0000","last_undegraded":"2024-09-12T00:39:01.194086+0000","last_fullsized":"2024-09-12T00:39:01.194086+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'169","last_scrub_stamp":"2024-09-12T00:39:01.193932+0000","last_deep_scrub":"261'169","last_deep_scrub_stamp":"2024-09-12T00:39:01.193932+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.193932+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:25.959222+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":798,"num_read_kb":679,"num_write":291,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'362","reported_seq":984,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.753758+0000","last_change":"2024-09-12T00:38:53.753683+0000","last_active":"2024-09-12T00:38:53.753758+0000","last_peered":"2024-09-12T00:38:53.753758+0000","last_clean":"2024-09-12T00:38:53.753758+0000","last_became_active":"2024-09-12T00:01:57.151506+0000","last_became_peered":"2024-09-12T00:01:57.151506+0000","last_unstale":"2024-09-12T00:38:53.753758+0000","last_undegraded":"2024-09-12T00:38:53.753758+0000","last_fullsized":"2024-09-12T00:38:53.753758+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'362","last_scrub_stamp":"2024-09-12T00:38:53.753574+0000","last_deep_scrub":"261'362","last_deep_scrub_stamp":"2024-09-12T00:38:53.753574+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.753574+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:42.419681+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549580,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":524,"num_read_kb":7555,"num_write":1156,"num_write_kb":27882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'125","reported_seq":720,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.796487+0000","last_change":"2024-09-12T00:39:05.796381+0000","last_active":"2024-09-12T00:39:05.796487+0000","last_peered":"2024-09-12T00:39:05.796487+0000","last_clean":"2024-09-12T00:39:05.796487+0000","last_became_active":"2024-09-12T00:01:59.148098+0000","last_became_peered":"2024-09-12T00:01:59.148098+0000","last_unstale":"2024-09-12T00:39:05.796487+0000","last_undegraded":"2024-09-12T00:39:05.796487+0000","last_fullsized":"2024-09-12T00:39:05.796487+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'125","last_scrub_stamp":"2024-09-12T00:39:05.796284+0000","last_deep_scrub":"261'125","last_deep_scrub_stamp":"2024-09-12T00:39:05.796284+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.796284+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:09.512775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":439,"num_write":182,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'114","reported_seq":682,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.176239+0000","last_change":"2024-09-12T00:39:02.176174+0000","last_active":"2024-09-12T00:39:02.176239+0000","last_peered":"2024-09-12T00:39:02.176239+0000","last_clean":"2024-09-12T00:39:02.176239+0000","last_became_active":"2024-09-12T00:01:59.148017+0000","last_became_peered":"2024-09-12T00:01:59.148017+0000","last_unstale":"2024-09-12T00:39:02.176239+0000","last_undegraded":"2024-09-12T00:39:02.176239+0000","last_fullsized":"2024-09-12T00:39:02.176239+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'114","last_scrub_stamp":"2024-09-12T00:39:02.176085+0000","last_deep_scrub":"261'114","last_deep_scrub_stamp":"2024-09-12T00:39:02.176085+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.176085+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:35.656310+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":485,"num_read_kb":395,"num_write":184,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'329","reported_seq":1020,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.439185+0000","last_change":"2024-09-12T00:38:55.439185+0000","last_active":"2024-09-12T00:38:55.439185+0000","last_peered":"2024-09-12T00:38:55.439185+0000","last_clean":"2024-09-12T00:38:55.439185+0000","last_became_active":"2024-09-12T00:01:57.151116+0000","last_became_peered":"2024-09-12T00:01:57.151116+0000","last_unstale":"2024-09-12T00:38:55.439185+0000","last_undegraded":"2024-09-12T00:38:55.439185+0000","last_fullsized":"2024-09-12T00:38:55.439185+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-12T00:38:55.439011+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-12T00:38:55.439011+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.439011+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:22.277921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":563,"num_read_kb":78307,"num_write":1164,"num_write_kb":30055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'230","reported_seq":820,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.256265+0000","last_change":"2024-09-12T00:38:56.256197+0000","last_active":"2024-09-12T00:38:56.256265+0000","last_peered":"2024-09-12T00:38:56.256265+0000","last_clean":"2024-09-12T00:38:56.256265+0000","last_became_active":"2024-09-12T00:01:59.152131+0000","last_became_peered":"2024-09-12T00:01:59.152131+0000","last_unstale":"2024-09-12T00:38:56.256265+0000","last_undegraded":"2024-09-12T00:38:56.256265+0000","last_fullsized":"2024-09-12T00:38:56.256265+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'230","last_scrub_stamp":"2024-09-12T00:38:56.256111+0000","last_deep_scrub":"261'230","last_deep_scrub_stamp":"2024-09-12T00:38:56.256111+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.256111+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:30.034301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":807,"num_write":370,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'333","reported_seq":972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.162288+0000","last_change":"2024-09-12T00:38:49.162288+0000","last_active":"2024-09-12T00:38:49.162288+0000","last_peered":"2024-09-12T00:38:49.162288+0000","last_clean":"2024-09-12T00:38:49.162288+0000","last_became_active":"2024-09-12T00:01:57.143834+0000","last_became_peered":"2024-09-12T00:01:57.143834+0000","last_unstale":"2024-09-12T00:38:49.162288+0000","last_undegraded":"2024-09-12T00:38:49.162288+0000","last_fullsized":"2024-09-12T00:38:49.162288+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'333","last_scrub_stamp":"2024-09-12T00:38:49.162133+0000","last_deep_scrub":"261'333","last_deep_scrub_stamp":"2024-09-12T00:38:49.162133+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.162133+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:54.670647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":522,"num_read_kb":1599,"num_write":1184,"num_write_kb":15734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'430","reported_seq":1144,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.414267+0000","last_change":"2024-09-12T00:38:51.414160+0000","last_active":"2024-09-12T00:38:51.414267+0000","last_peered":"2024-09-12T00:38:51.414267+0000","last_clean":"2024-09-12T00:38:51.414267+0000","last_became_active":"2024-09-12T00:01:59.153559+0000","last_became_peered":"2024-09-12T00:01:59.153559+0000","last_unstale":"2024-09-12T00:38:51.414267+0000","last_undegraded":"2024-09-12T00:38:51.414267+0000","last_fullsized":"2024-09-12T00:38:51.414267+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'430","last_scrub_stamp":"2024-09-12T00:38:51.414063+0000","last_deep_scrub":"261'430","last_deep_scrub_stamp":"2024-09-12T00:38:51.414063+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.414063+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:14.420551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2074,"num_read_kb":1775,"num_write":771,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'321","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.159055+0000","last_change":"2024-09-12T00:38:48.159055+0000","last_active":"2024-09-12T00:38:48.159055+0000","last_peered":"2024-09-12T00:38:48.159055+0000","last_clean":"2024-09-12T00:38:48.159055+0000","last_became_active":"2024-09-12T00:01:57.150789+0000","last_became_peered":"2024-09-12T00:01:57.150789+0000","last_unstale":"2024-09-12T00:38:48.159055+0000","last_undegraded":"2024-09-12T00:38:48.159055+0000","last_fullsized":"2024-09-12T00:38:48.159055+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'321","last_scrub_stamp":"2024-09-12T00:38:48.158943+0000","last_deep_scrub":"261'321","last_deep_scrub_stamp":"2024-09-12T00:38:48.158943+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.158943+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:48.677325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162197,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":13162,"num_write":967,"num_write_kb":19470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'149","reported_seq":780,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.946690+0000","last_change":"2024-09-12T00:38:57.946690+0000","last_active":"2024-09-12T00:38:57.946690+0000","last_peered":"2024-09-12T00:38:57.946690+0000","last_clean":"2024-09-12T00:38:57.946690+0000","last_became_active":"2024-09-12T00:01:59.149195+0000","last_became_peered":"2024-09-12T00:01:59.149195+0000","last_unstale":"2024-09-12T00:38:57.946690+0000","last_undegraded":"2024-09-12T00:38:57.946690+0000","last_fullsized":"2024-09-12T00:38:57.946690+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'149","last_scrub_stamp":"2024-09-12T00:38:57.946609+0000","last_deep_scrub":"261'149","last_deep_scrub_stamp":"2024-09-12T00:38:57.946609+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.946609+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:33.117967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":604,"num_write":216,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'359","reported_seq":1014,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.205052+0000","last_change":"2024-09-12T00:38:47.205052+0000","last_active":"2024-09-12T00:38:47.205052+0000","last_peered":"2024-09-12T00:38:47.205052+0000","last_clean":"2024-09-12T00:38:47.205052+0000","last_became_active":"2024-09-12T00:01:57.157877+0000","last_became_peered":"2024-09-12T00:01:57.157877+0000","last_unstale":"2024-09-12T00:38:47.205052+0000","last_undegraded":"2024-09-12T00:38:47.205052+0000","last_fullsized":"2024-09-12T00:38:47.205052+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'359","last_scrub_stamp":"2024-09-12T00:38:47.204901+0000","last_deep_scrub":"261'359","last_deep_scrub_stamp":"2024-09-12T00:38:47.204901+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.204901+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:27.995396+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7687320,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":26582,"num_write":1109,"num_write_kb":46689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'164","reported_seq":763,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.796833+0000","last_change":"2024-09-12T00:39:04.796833+0000","last_active":"2024-09-12T00:39:04.796833+0000","last_peered":"2024-09-12T00:39:04.796833+0000","last_clean":"2024-09-12T00:39:04.796833+0000","last_became_active":"2024-09-12T00:01:59.159215+0000","last_became_peered":"2024-09-12T00:01:59.159215+0000","last_unstale":"2024-09-12T00:39:04.796833+0000","last_undegraded":"2024-09-12T00:39:04.796833+0000","last_fullsized":"2024-09-12T00:39:04.796833+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'164","last_scrub_stamp":"2024-09-12T00:39:04.796746+0000","last_deep_scrub":"261'164","last_deep_scrub_stamp":"2024-09-12T00:39:04.796746+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.796746+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:07.277612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":584,"num_write":229,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'277","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.027690+0000","last_change":"2024-09-12T00:38:51.027690+0000","last_active":"2024-09-12T00:38:51.027690+0000","last_peered":"2024-09-12T00:38:51.027690+0000","last_clean":"2024-09-12T00:38:51.027690+0000","last_became_active":"2024-09-12T00:02:32.844466+0000","last_became_peered":"2024-09-12T00:02:32.844466+0000","last_unstale":"2024-09-12T00:38:51.027690+0000","last_undegraded":"2024-09-12T00:38:51.027690+0000","last_fullsized":"2024-09-12T00:38:51.027690+0000","mapping_epoch":37,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'277","last_scrub_stamp":"2024-09-12T00:38:51.027531+0000","last_deep_scrub":"261'277","last_deep_scrub_stamp":"2024-09-12T00:38:51.027531+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.027531+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:53.754319+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291469,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":38682,"num_write":1020,"num_write_kb":28786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'136","reported_seq":732,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.417987+0000","last_change":"2024-09-12T00:38:53.417987+0000","last_active":"2024-09-12T00:38:53.417987+0000","last_peered":"2024-09-12T00:38:53.417987+0000","last_clean":"2024-09-12T00:38:53.417987+0000","last_became_active":"2024-09-12T00:01:59.156058+0000","last_became_peered":"2024-09-12T00:01:59.156058+0000","last_unstale":"2024-09-12T00:38:53.417987+0000","last_undegraded":"2024-09-12T00:38:53.417987+0000","last_fullsized":"2024-09-12T00:38:53.417987+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'136","last_scrub_stamp":"2024-09-12T00:38:53.417890+0000","last_deep_scrub":"261'136","last_deep_scrub_stamp":"2024-09-12T00:38:53.417890+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.417890+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:53.404919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":582,"num_read_kb":485,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'395","reported_seq":1019,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.055140+0000","last_change":"2024-09-12T00:38:50.055055+0000","last_active":"2024-09-12T00:38:50.055140+0000","last_peered":"2024-09-12T00:38:50.055140+0000","last_clean":"2024-09-12T00:38:50.055140+0000","last_became_active":"2024-09-12T00:01:57.136872+0000","last_became_peered":"2024-09-12T00:01:57.136872+0000","last_unstale":"2024-09-12T00:38:50.055140+0000","last_undegraded":"2024-09-12T00:38:50.055140+0000","last_fullsized":"2024-09-12T00:38:50.055140+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'395","last_scrub_stamp":"2024-09-12T00:38:50.054891+0000","last_deep_scrub":"261'395","last_deep_scrub_stamp":"2024-09-12T00:38:50.054891+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.054891+0000","objects_scrubbed":9,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:04.646670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133748,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":28039,"num_write":1285,"num_write_kb":53988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'149","reported_seq":652,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.231078+0000","last_change":"2024-09-12T00:39:09.231078+0000","last_active":"2024-09-12T00:39:09.231078+0000","last_peered":"2024-09-12T00:39:09.231078+0000","last_clean":"2024-09-12T00:39:09.231078+0000","last_became_active":"2024-09-12T00:02:07.159308+0000","last_became_peered":"2024-09-12T00:02:07.159308+0000","last_unstale":"2024-09-12T00:39:09.231078+0000","last_undegraded":"2024-09-12T00:39:09.231078+0000","last_fullsized":"2024-09-12T00:39:09.231078+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'149","last_scrub_stamp":"2024-09-12T00:39:09.230977+0000","last_deep_scrub":"261'149","last_deep_scrub_stamp":"2024-09-12T00:39:09.230977+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.230977+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:34.505126+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'123","reported_seq":716,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.958244+0000","last_change":"2024-09-12T00:38:54.958150+0000","last_active":"2024-09-12T00:38:54.958244+0000","last_peered":"2024-09-12T00:38:54.958244+0000","last_clean":"2024-09-12T00:38:54.958244+0000","last_became_active":"2024-09-12T00:01:59.151773+0000","last_became_peered":"2024-09-12T00:01:59.151773+0000","last_unstale":"2024-09-12T00:38:54.958244+0000","last_undegraded":"2024-09-12T00:38:54.958244+0000","last_fullsized":"2024-09-12T00:38:54.958244+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'123","last_scrub_stamp":"2024-09-12T00:38:54.958046+0000","last_deep_scrub":"261'123","last_deep_scrub_stamp":"2024-09-12T00:38:54.958046+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.958046+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:49.574148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":478,"num_write":204,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'341","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.231600+0000","last_change":"2024-09-12T00:38:52.231474+0000","last_active":"2024-09-12T00:38:52.231600+0000","last_peered":"2024-09-12T00:38:52.231600+0000","last_clean":"2024-09-12T00:38:52.231600+0000","last_became_active":"2024-09-12T00:01:57.165987+0000","last_became_peered":"2024-09-12T00:01:57.165987+0000","last_unstale":"2024-09-12T00:38:52.231600+0000","last_undegraded":"2024-09-12T00:38:52.231600+0000","last_fullsized":"2024-09-12T00:38:52.231600+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'341","last_scrub_stamp":"2024-09-12T00:38:52.231282+0000","last_deep_scrub":"261'341","last_deep_scrub_stamp":"2024-09-12T00:38:52.231282+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.231282+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:26.787977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":604,"num_read_kb":32539,"num_write":978,"num_write_kb":21474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.160571+0000","last_change":"2024-09-12T00:39:19.160571+0000","last_active":"2024-09-12T00:39:19.160571+0000","last_peered":"2024-09-12T00:39:19.160571+0000","last_clean":"2024-09-12T00:39:19.160571+0000","last_became_active":"2024-09-12T00:02:01.154464+0000","last_became_peered":"2024-09-12T00:02:01.154464+0000","last_unstale":"2024-09-12T00:39:19.160571+0000","last_undegraded":"2024-09-12T00:39:19.160571+0000","last_fullsized":"2024-09-12T00:39:19.160571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:19.160468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:19.160468+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.160468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:19.341255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'366","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.737006+0000","last_change":"2024-09-12T00:39:10.737006+0000","last_active":"2024-09-12T00:39:10.737006+0000","last_peered":"2024-09-12T00:39:10.737006+0000","last_clean":"2024-09-12T00:39:10.737006+0000","last_became_active":"2024-09-12T00:02:03.156175+0000","last_became_peered":"2024-09-12T00:02:03.156175+0000","last_unstale":"2024-09-12T00:39:10.737006+0000","last_undegraded":"2024-09-12T00:39:10.737006+0000","last_fullsized":"2024-09-12T00:39:10.737006+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'366","last_scrub_stamp":"2024-09-12T00:39:10.736881+0000","last_deep_scrub":"261'366","last_deep_scrub_stamp":"2024-09-12T00:39:10.736881+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.736881+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:27.441999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51076,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":584,"num_read_kb":1265,"num_write":472,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.440175+0000","last_change":"2024-09-12T00:39:07.440175+0000","last_active":"2024-09-12T00:39:07.440175+0000","last_peered":"2024-09-12T00:39:07.440175+0000","last_clean":"2024-09-12T00:39:07.440175+0000","last_became_active":"2024-09-12T00:02:05.165424+0000","last_became_peered":"2024-09-12T00:02:05.165424+0000","last_unstale":"2024-09-12T00:39:07.440175+0000","last_undegraded":"2024-09-12T00:39:07.440175+0000","last_fullsized":"2024-09-12T00:39:07.440175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:07.440077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:07.440077+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.440077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:31.618520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'131","reported_seq":689,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.476249+0000","last_change":"2024-09-12T00:39:09.476249+0000","last_active":"2024-09-12T00:39:09.476249+0000","last_peered":"2024-09-12T00:39:09.476249+0000","last_clean":"2024-09-12T00:39:09.476249+0000","last_became_active":"2024-09-12T00:02:07.174795+0000","last_became_peered":"2024-09-12T00:02:07.174795+0000","last_unstale":"2024-09-12T00:39:09.476249+0000","last_undegraded":"2024-09-12T00:39:09.476249+0000","last_fullsized":"2024-09-12T00:39:09.476249+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'131","last_scrub_stamp":"2024-09-12T00:39:09.476131+0000","last_deep_scrub":"261'131","last_deep_scrub_stamp":"2024-09-12T00:39:09.476131+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.476131+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:58.746588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":239,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'76","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.248559+0000","last_change":"2024-09-12T00:39:10.248559+0000","last_active":"2024-09-12T00:39:10.248559+0000","last_peered":"2024-09-12T00:39:10.248559+0000","last_clean":"2024-09-12T00:39:10.248559+0000","last_became_active":"2024-09-12T00:01:59.145411+0000","last_became_peered":"2024-09-12T00:01:59.145411+0000","last_unstale":"2024-09-12T00:39:10.248559+0000","last_undegraded":"2024-09-12T00:39:10.248559+0000","last_fullsized":"2024-09-12T00:39:10.248559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'76","last_scrub_stamp":"2024-09-12T00:39:10.248448+0000","last_deep_scrub":"261'76","last_deep_scrub_stamp":"2024-09-12T00:39:10.248448+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.248448+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:06.953323+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":104,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'371","reported_seq":1024,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.109970+0000","last_change":"2024-09-12T00:38:46.109874+0000","last_active":"2024-09-12T00:38:46.109970+0000","last_peered":"2024-09-12T00:38:46.109970+0000","last_clean":"2024-09-12T00:38:46.109970+0000","last_became_active":"2024-09-12T00:01:57.146952+0000","last_became_peered":"2024-09-12T00:01:57.146952+0000","last_unstale":"2024-09-12T00:38:46.109970+0000","last_undegraded":"2024-09-12T00:38:46.109970+0000","last_fullsized":"2024-09-12T00:38:46.109970+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T00:38:46.109709+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T00:38:46.109709+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.109709+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:43.843194+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":558,"num_read_kb":41499,"num_write":1262,"num_write_kb":32474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.585048+0000","last_change":"2024-09-12T00:39:02.584991+0000","last_active":"2024-09-12T00:39:02.585048+0000","last_peered":"2024-09-12T00:39:02.585048+0000","last_clean":"2024-09-12T00:39:02.585048+0000","last_became_active":"2024-09-12T00:02:01.155948+0000","last_became_peered":"2024-09-12T00:02:01.155948+0000","last_unstale":"2024-09-12T00:39:02.585048+0000","last_undegraded":"2024-09-12T00:39:02.585048+0000","last_fullsized":"2024-09-12T00:39:02.585048+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:02.584900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:02.584900+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.584900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:43.353221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'85","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.430510+0000","last_change":"2024-09-12T00:39:03.430510+0000","last_active":"2024-09-12T00:39:03.430510+0000","last_peered":"2024-09-12T00:39:03.430510+0000","last_clean":"2024-09-12T00:39:03.430510+0000","last_became_active":"2024-09-12T00:02:03.152708+0000","last_became_peered":"2024-09-12T00:02:03.152708+0000","last_unstale":"2024-09-12T00:39:03.430510+0000","last_undegraded":"2024-09-12T00:39:03.430510+0000","last_fullsized":"2024-09-12T00:39:03.430510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'85","last_scrub_stamp":"2024-09-12T00:39:03.430417+0000","last_deep_scrub":"261'85","last_deep_scrub_stamp":"2024-09-12T00:39:03.430417+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.430417+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:01.332863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":85,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.446125+0000","last_change":"2024-09-12T00:39:06.446125+0000","last_active":"2024-09-12T00:39:06.446125+0000","last_peered":"2024-09-12T00:39:06.446125+0000","last_clean":"2024-09-12T00:39:06.446125+0000","last_became_active":"2024-09-12T00:02:05.162755+0000","last_became_peered":"2024-09-12T00:02:05.162755+0000","last_unstale":"2024-09-12T00:39:06.446125+0000","last_undegraded":"2024-09-12T00:39:06.446125+0000","last_fullsized":"2024-09-12T00:39:06.446125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:06.446044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:06.446044+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.446044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:19.043077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'138","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.028736+0000","last_change":"2024-09-12T00:39:10.028646+0000","last_active":"2024-09-12T00:39:10.028736+0000","last_peered":"2024-09-12T00:39:10.028736+0000","last_clean":"2024-09-12T00:39:10.028736+0000","last_became_active":"2024-09-12T00:02:07.167851+0000","last_became_peered":"2024-09-12T00:02:07.167851+0000","last_unstale":"2024-09-12T00:39:10.028736+0000","last_undegraded":"2024-09-12T00:39:10.028736+0000","last_fullsized":"2024-09-12T00:39:10.028736+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'138","last_scrub_stamp":"2024-09-12T00:39:10.028536+0000","last_deep_scrub":"261'138","last_deep_scrub_stamp":"2024-09-12T00:39:10.028536+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.028536+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:48.170223+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":137,"num_write":333,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'4129","reported_seq":4735,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.880211+0000","last_change":"2024-09-12T00:39:01.880211+0000","last_active":"2024-09-12T00:39:01.880211+0000","last_peered":"2024-09-12T00:39:01.880211+0000","last_clean":"2024-09-12T00:39:01.880211+0000","last_became_active":"2024-09-12T00:01:59.151026+0000","last_became_peered":"2024-09-12T00:01:59.151026+0000","last_unstale":"2024-09-12T00:39:01.880211+0000","last_undegraded":"2024-09-12T00:39:01.880211+0000","last_fullsized":"2024-09-12T00:39:01.880211+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4129","last_scrub_stamp":"2024-09-12T00:39:01.880122+0000","last_deep_scrub":"261'4129","last_deep_scrub_stamp":"2024-09-12T00:39:01.880122+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.880122+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":3000,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:04.626954+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16602,"num_read_kb":13937,"num_write":6188,"num_write_kb":3085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'296","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.273302+0000","last_change":"2024-09-12T00:38:51.273199+0000","last_active":"2024-09-12T00:38:51.273302+0000","last_peered":"2024-09-12T00:38:51.273302+0000","last_clean":"2024-09-12T00:38:51.273302+0000","last_became_active":"2024-09-12T00:01:57.144269+0000","last_became_peered":"2024-09-12T00:01:57.144269+0000","last_unstale":"2024-09-12T00:38:51.273302+0000","last_undegraded":"2024-09-12T00:38:51.273302+0000","last_fullsized":"2024-09-12T00:38:51.273302+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'296","last_scrub_stamp":"2024-09-12T00:38:51.273042+0000","last_deep_scrub":"261'296","last_deep_scrub_stamp":"2024-09-12T00:38:51.273042+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.273042+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:27.864647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399069,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":703,"num_read_kb":1796,"num_write":921,"num_write_kb":33986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.634681+0000","last_change":"2024-09-12T00:39:03.634681+0000","last_active":"2024-09-12T00:39:03.634681+0000","last_peered":"2024-09-12T00:39:03.634681+0000","last_clean":"2024-09-12T00:39:03.634681+0000","last_became_active":"2024-09-12T00:02:01.155425+0000","last_became_peered":"2024-09-12T00:02:01.155425+0000","last_unstale":"2024-09-12T00:39:03.634681+0000","last_undegraded":"2024-09-12T00:39:03.634681+0000","last_fullsized":"2024-09-12T00:39:03.634681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:03.634589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:03.634589+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.634589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:12.318839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'110","reported_seq":652,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.739203+0000","last_change":"2024-09-12T00:39:09.739057+0000","last_active":"2024-09-12T00:39:09.739203+0000","last_peered":"2024-09-12T00:39:09.739203+0000","last_clean":"2024-09-12T00:39:09.739203+0000","last_became_active":"2024-09-12T00:02:03.151839+0000","last_became_peered":"2024-09-12T00:02:03.151839+0000","last_unstale":"2024-09-12T00:39:09.739203+0000","last_undegraded":"2024-09-12T00:39:09.739203+0000","last_fullsized":"2024-09-12T00:39:09.739203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'110","last_scrub_stamp":"2024-09-12T00:39:09.738938+0000","last_deep_scrub":"261'110","last_deep_scrub_stamp":"2024-09-12T00:39:09.738938+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.738938+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:36.714767+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'759","reported_seq":2055,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.107685+0000","last_change":"2024-09-12T00:39:23.107685+0000","last_active":"2024-09-12T00:39:23.107685+0000","last_peered":"2024-09-12T00:39:23.107685+0000","last_clean":"2024-09-12T00:39:23.107685+0000","last_became_active":"2024-09-12T00:02:05.166985+0000","last_became_peered":"2024-09-12T00:02:05.166985+0000","last_unstale":"2024-09-12T00:39:23.107685+0000","last_undegraded":"2024-09-12T00:39:23.107685+0000","last_fullsized":"2024-09-12T00:39:23.107685+0000","mapping_epoch":32,"log_start":"261'701","ondisk_log_start":"261'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'759","last_scrub_stamp":"2024-09-12T00:39:23.107584+0000","last_deep_scrub":"261'759","last_deep_scrub_stamp":"2024-09-12T00:39:23.107584+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.107584+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":701,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:14.468840+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'219","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.059825+0000","last_change":"2024-09-12T00:39:10.059760+0000","last_active":"2024-09-12T00:39:10.059825+0000","last_peered":"2024-09-12T00:39:10.059825+0000","last_clean":"2024-09-12T00:39:10.059825+0000","last_became_active":"2024-09-12T00:02:07.167576+0000","last_became_peered":"2024-09-12T00:02:07.167576+0000","last_unstale":"2024-09-12T00:39:10.059825+0000","last_undegraded":"2024-09-12T00:39:10.059825+0000","last_fullsized":"2024-09-12T00:39:10.059825+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'219","last_scrub_stamp":"2024-09-12T00:39:10.059666+0000","last_deep_scrub":"261'219","last_deep_scrub_stamp":"2024-09-12T00:39:10.059666+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.059666+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:24.213624+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":605,"num_read_kb":603,"num_write":488,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'58","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.869456+0000","last_change":"2024-09-12T00:38:59.869456+0000","last_active":"2024-09-12T00:38:59.869456+0000","last_peered":"2024-09-12T00:38:59.869456+0000","last_clean":"2024-09-12T00:38:59.869456+0000","last_became_active":"2024-09-12T00:01:59.149087+0000","last_became_peered":"2024-09-12T00:01:59.149087+0000","last_unstale":"2024-09-12T00:38:59.869456+0000","last_undegraded":"2024-09-12T00:38:59.869456+0000","last_fullsized":"2024-09-12T00:38:59.869456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'58","last_scrub_stamp":"2024-09-12T00:38:59.869337+0000","last_deep_scrub":"261'58","last_deep_scrub_stamp":"2024-09-12T00:38:59.869337+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.869337+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:41.875669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":233,"num_write":78,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'349","reported_seq":1055,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.537155+0000","last_change":"2024-09-12T00:38:44.537092+0000","last_active":"2024-09-12T00:38:44.537155+0000","last_peered":"2024-09-12T00:38:44.537155+0000","last_clean":"2024-09-12T00:38:44.537155+0000","last_became_active":"2024-09-12T00:01:57.152332+0000","last_became_peered":"2024-09-12T00:01:57.152332+0000","last_unstale":"2024-09-12T00:38:44.537155+0000","last_undegraded":"2024-09-12T00:38:44.537155+0000","last_fullsized":"2024-09-12T00:38:44.537155+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T00:38:44.536985+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T00:38:44.536985+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.536985+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:37.312381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516615,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":651,"num_read_kb":43786,"num_write":1177,"num_write_kb":39072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.332992+0000","last_change":"2024-09-12T00:39:12.332992+0000","last_active":"2024-09-12T00:39:12.332992+0000","last_peered":"2024-09-12T00:39:12.332992+0000","last_clean":"2024-09-12T00:39:12.332992+0000","last_became_active":"2024-09-12T00:02:01.154110+0000","last_became_peered":"2024-09-12T00:02:01.154110+0000","last_unstale":"2024-09-12T00:39:12.332992+0000","last_undegraded":"2024-09-12T00:39:12.332992+0000","last_fullsized":"2024-09-12T00:39:12.332992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:12.332907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:12.332907+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.332907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:30.728183+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'261","reported_seq":821,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.207586+0000","last_change":"2024-09-12T00:39:04.207586+0000","last_active":"2024-09-12T00:39:04.207586+0000","last_peered":"2024-09-12T00:39:04.207586+0000","last_clean":"2024-09-12T00:39:04.207586+0000","last_became_active":"2024-09-12T00:02:03.145673+0000","last_became_peered":"2024-09-12T00:02:03.145673+0000","last_unstale":"2024-09-12T00:39:04.207586+0000","last_undegraded":"2024-09-12T00:39:04.207586+0000","last_fullsized":"2024-09-12T00:39:04.207586+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'261","last_scrub_stamp":"2024-09-12T00:39:04.207480+0000","last_deep_scrub":"261'261","last_deep_scrub_stamp":"2024-09-12T00:39:04.207480+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.207480+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:22.980209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47470,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":957,"num_write":348,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'783","reported_seq":2164,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.746343+0000","last_change":"2024-09-12T00:39:15.746273+0000","last_active":"2024-09-12T00:39:15.746343+0000","last_peered":"2024-09-12T00:39:15.746343+0000","last_clean":"2024-09-12T00:39:15.746343+0000","last_became_active":"2024-09-12T00:02:05.165283+0000","last_became_peered":"2024-09-12T00:02:05.165283+0000","last_unstale":"2024-09-12T00:39:15.746343+0000","last_undegraded":"2024-09-12T00:39:15.746343+0000","last_fullsized":"2024-09-12T00:39:15.746343+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'783","last_scrub_stamp":"2024-09-12T00:39:15.746188+0000","last_deep_scrub":"261'783","last_deep_scrub_stamp":"2024-09-12T00:39:15.746188+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.746188+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:59.792273+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'107","reported_seq":685,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.191153+0000","last_change":"2024-09-12T00:38:59.191153+0000","last_active":"2024-09-12T00:38:59.191153+0000","last_peered":"2024-09-12T00:38:59.191153+0000","last_clean":"2024-09-12T00:38:59.191153+0000","last_became_active":"2024-09-12T00:01:59.153704+0000","last_became_peered":"2024-09-12T00:01:59.153704+0000","last_unstale":"2024-09-12T00:38:59.191153+0000","last_undegraded":"2024-09-12T00:38:59.191153+0000","last_fullsized":"2024-09-12T00:38:59.191153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'107","last_scrub_stamp":"2024-09-12T00:38:59.191064+0000","last_deep_scrub":"261'107","last_deep_scrub_stamp":"2024-09-12T00:38:59.191064+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.191064+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:10.002119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":389,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'347","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:42.111293+0000","last_change":"2024-09-12T00:38:42.111293+0000","last_active":"2024-09-12T00:38:42.111293+0000","last_peered":"2024-09-12T00:38:42.111293+0000","last_clean":"2024-09-12T00:38:42.111293+0000","last_became_active":"2024-09-12T00:01:57.154222+0000","last_became_peered":"2024-09-12T00:01:57.154222+0000","last_unstale":"2024-09-12T00:38:42.111293+0000","last_undegraded":"2024-09-12T00:38:42.111293+0000","last_fullsized":"2024-09-12T00:38:42.111293+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'347","last_scrub_stamp":"2024-09-12T00:38:42.111118+0000","last_deep_scrub":"261'347","last_deep_scrub_stamp":"2024-09-12T00:38:42.111118+0000","last_clean_scrub_stamp":"2024-09-12T00:38:42.111118+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:20.798122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589724,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":40360,"num_write":1158,"num_write_kb":32511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.459099+0000","last_change":"2024-09-12T00:38:57.459099+0000","last_active":"2024-09-12T00:38:57.459099+0000","last_peered":"2024-09-12T00:38:57.459099+0000","last_clean":"2024-09-12T00:38:57.459099+0000","last_became_active":"2024-09-12T00:02:01.144531+0000","last_became_peered":"2024-09-12T00:02:01.144531+0000","last_unstale":"2024-09-12T00:38:57.459099+0000","last_undegraded":"2024-09-12T00:38:57.459099+0000","last_fullsized":"2024-09-12T00:38:57.459099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:57.459009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:57.459009+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.459009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:40.876686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'380","reported_seq":991,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.338811+0000","last_change":"2024-09-12T00:39:03.338712+0000","last_active":"2024-09-12T00:39:03.338811+0000","last_peered":"2024-09-12T00:39:03.338811+0000","last_clean":"2024-09-12T00:39:03.338811+0000","last_became_active":"2024-09-12T00:02:03.155293+0000","last_became_peered":"2024-09-12T00:02:03.155293+0000","last_unstale":"2024-09-12T00:39:03.338811+0000","last_undegraded":"2024-09-12T00:39:03.338811+0000","last_fullsized":"2024-09-12T00:39:03.338811+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'380","last_scrub_stamp":"2024-09-12T00:39:03.338549+0000","last_deep_scrub":"261'380","last_deep_scrub_stamp":"2024-09-12T00:39:03.338549+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.338549+0000","objects_scrubbed":10,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:48.702607+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50160,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":1260,"num_write":482,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.976348+0000","last_change":"2024-09-12T00:39:08.976348+0000","last_active":"2024-09-12T00:39:08.976348+0000","last_peered":"2024-09-12T00:39:08.976348+0000","last_clean":"2024-09-12T00:39:08.976348+0000","last_became_active":"2024-09-12T00:02:05.167762+0000","last_became_peered":"2024-09-12T00:02:05.167762+0000","last_unstale":"2024-09-12T00:39:08.976348+0000","last_undegraded":"2024-09-12T00:39:08.976348+0000","last_fullsized":"2024-09-12T00:39:08.976348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:08.976252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:08.976252+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.976252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:00.360348+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'550","reported_seq":1355,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.025702+0000","last_change":"2024-09-12T00:39:11.025639+0000","last_active":"2024-09-12T00:39:11.025702+0000","last_peered":"2024-09-12T00:39:11.025702+0000","last_clean":"2024-09-12T00:39:11.025702+0000","last_became_active":"2024-09-12T00:02:07.172005+0000","last_became_peered":"2024-09-12T00:02:07.172005+0000","last_unstale":"2024-09-12T00:39:11.025702+0000","last_undegraded":"2024-09-12T00:39:11.025702+0000","last_fullsized":"2024-09-12T00:39:11.025702+0000","mapping_epoch":34,"log_start":"261'500","ondisk_log_start":"261'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'550","last_scrub_stamp":"2024-09-12T00:39:11.025541+0000","last_deep_scrub":"261'550","last_deep_scrub_stamp":"2024-09-12T00:39:11.025541+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.025541+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:05.710518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1294,"num_read_kb":1285,"num_write":1129,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'119","reported_seq":697,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.449096+0000","last_change":"2024-09-12T00:38:54.449096+0000","last_active":"2024-09-12T00:38:54.449096+0000","last_peered":"2024-09-12T00:38:54.449096+0000","last_clean":"2024-09-12T00:38:54.449096+0000","last_became_active":"2024-09-12T00:01:59.151782+0000","last_became_peered":"2024-09-12T00:01:59.151782+0000","last_unstale":"2024-09-12T00:38:54.449096+0000","last_undegraded":"2024-09-12T00:38:54.449096+0000","last_fullsized":"2024-09-12T00:38:54.449096+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'119","last_scrub_stamp":"2024-09-12T00:38:54.449006+0000","last_deep_scrub":"261'119","last_deep_scrub_stamp":"2024-09-12T00:38:54.449006+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.449006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:43.707307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":439,"num_write":192,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'305","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:42.998047+0000","last_change":"2024-09-12T00:38:42.998047+0000","last_active":"2024-09-12T00:38:42.998047+0000","last_peered":"2024-09-12T00:38:42.998047+0000","last_clean":"2024-09-12T00:38:42.998047+0000","last_became_active":"2024-09-12T00:01:57.157370+0000","last_became_peered":"2024-09-12T00:01:57.157370+0000","last_unstale":"2024-09-12T00:38:42.998047+0000","last_undegraded":"2024-09-12T00:38:42.998047+0000","last_fullsized":"2024-09-12T00:38:42.998047+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-12T00:38:42.997918+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-12T00:38:42.997918+0000","last_clean_scrub_stamp":"2024-09-12T00:38:42.997918+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:53.007422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327243,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":441,"num_read_kb":3842,"num_write":968,"num_write_kb":16793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.950968+0000","last_change":"2024-09-12T00:38:58.950968+0000","last_active":"2024-09-12T00:38:58.950968+0000","last_peered":"2024-09-12T00:38:58.950968+0000","last_clean":"2024-09-12T00:38:58.950968+0000","last_became_active":"2024-09-12T00:02:01.151914+0000","last_became_peered":"2024-09-12T00:02:01.151914+0000","last_unstale":"2024-09-12T00:38:58.950968+0000","last_undegraded":"2024-09-12T00:38:58.950968+0000","last_fullsized":"2024-09-12T00:38:58.950968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:58.950859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:58.950859+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.950859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:32.731979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'281","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.703738+0000","last_change":"2024-09-12T00:39:11.703738+0000","last_active":"2024-09-12T00:39:11.703738+0000","last_peered":"2024-09-12T00:39:11.703738+0000","last_clean":"2024-09-12T00:39:11.703738+0000","last_became_active":"2024-09-12T00:02:03.154819+0000","last_became_peered":"2024-09-12T00:02:03.154819+0000","last_unstale":"2024-09-12T00:39:11.703738+0000","last_undegraded":"2024-09-12T00:39:11.703738+0000","last_fullsized":"2024-09-12T00:39:11.703738+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'281","last_scrub_stamp":"2024-09-12T00:39:11.703649+0000","last_deep_scrub":"261'281","last_deep_scrub_stamp":"2024-09-12T00:39:11.703649+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.703649+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:00.342091+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":1012,"num_write":362,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.663396+0000","last_change":"2024-09-12T00:39:15.663396+0000","last_active":"2024-09-12T00:39:15.663396+0000","last_peered":"2024-09-12T00:39:15.663396+0000","last_clean":"2024-09-12T00:39:15.663396+0000","last_became_active":"2024-09-12T00:02:05.168649+0000","last_became_peered":"2024-09-12T00:02:05.168649+0000","last_unstale":"2024-09-12T00:39:15.663396+0000","last_undegraded":"2024-09-12T00:39:15.663396+0000","last_fullsized":"2024-09-12T00:39:15.663396+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:15.663305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:15.663305+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.663305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:34.742904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2370","reported_seq":4190,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.380832+0000","last_change":"2024-09-12T00:39:12.380760+0000","last_active":"2024-09-12T00:39:12.380832+0000","last_peered":"2024-09-12T00:39:12.380832+0000","last_clean":"2024-09-12T00:39:12.380832+0000","last_became_active":"2024-09-12T00:02:07.174769+0000","last_became_peered":"2024-09-12T00:02:07.174769+0000","last_unstale":"2024-09-12T00:39:12.380832+0000","last_undegraded":"2024-09-12T00:39:12.380832+0000","last_fullsized":"2024-09-12T00:39:12.380832+0000","mapping_epoch":34,"log_start":"261'2300","ondisk_log_start":"261'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2370","last_scrub_stamp":"2024-09-12T00:39:12.380674+0000","last_deep_scrub":"261'2370","last_deep_scrub_stamp":"2024-09-12T00:39:12.380674+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.380674+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":2300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:27.782085+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5961,"num_read_kb":5964,"num_write":4767,"num_write_kb":1768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'190","reported_seq":821,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.093622+0000","last_change":"2024-09-12T00:38:51.093560+0000","last_active":"2024-09-12T00:38:51.093622+0000","last_peered":"2024-09-12T00:38:51.093622+0000","last_clean":"2024-09-12T00:38:51.093622+0000","last_became_active":"2024-09-12T00:01:59.156252+0000","last_became_peered":"2024-09-12T00:01:59.156252+0000","last_unstale":"2024-09-12T00:38:51.093622+0000","last_undegraded":"2024-09-12T00:38:51.093622+0000","last_fullsized":"2024-09-12T00:38:51.093622+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'190","last_scrub_stamp":"2024-09-12T00:38:51.093465+0000","last_deep_scrub":"261'190","last_deep_scrub_stamp":"2024-09-12T00:38:51.093465+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.093465+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:31.896004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":702,"num_write":296,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'368","reported_seq":1015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.261298+0000","last_change":"2024-09-12T00:38:50.261298+0000","last_active":"2024-09-12T00:38:50.261298+0000","last_peered":"2024-09-12T00:38:50.261298+0000","last_clean":"2024-09-12T00:38:50.261298+0000","last_became_active":"2024-09-12T00:01:57.157699+0000","last_became_peered":"2024-09-12T00:01:57.157699+0000","last_unstale":"2024-09-12T00:38:50.261298+0000","last_undegraded":"2024-09-12T00:38:50.261298+0000","last_fullsized":"2024-09-12T00:38:50.261298+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'368","last_scrub_stamp":"2024-09-12T00:38:50.261168+0000","last_deep_scrub":"261'368","last_deep_scrub_stamp":"2024-09-12T00:38:50.261168+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.261168+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:19.208333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":32954,"num_write":1221,"num_write_kb":41911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.805229+0000","last_change":"2024-09-12T00:39:06.805229+0000","last_active":"2024-09-12T00:39:06.805229+0000","last_peered":"2024-09-12T00:39:06.805229+0000","last_clean":"2024-09-12T00:39:06.805229+0000","last_became_active":"2024-09-12T00:02:01.153090+0000","last_became_peered":"2024-09-12T00:02:01.153090+0000","last_unstale":"2024-09-12T00:39:06.805229+0000","last_undegraded":"2024-09-12T00:39:06.805229+0000","last_fullsized":"2024-09-12T00:39:06.805229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:06.805116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:06.805116+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.805116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:16.685921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'330","reported_seq":917,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.260723+0000","last_change":"2024-09-12T00:39:14.260723+0000","last_active":"2024-09-12T00:39:14.260723+0000","last_peered":"2024-09-12T00:39:14.260723+0000","last_clean":"2024-09-12T00:39:14.260723+0000","last_became_active":"2024-09-12T00:02:03.153386+0000","last_became_peered":"2024-09-12T00:02:03.153386+0000","last_unstale":"2024-09-12T00:39:14.260723+0000","last_undegraded":"2024-09-12T00:39:14.260723+0000","last_fullsized":"2024-09-12T00:39:14.260723+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'330","last_scrub_stamp":"2024-09-12T00:39:14.260607+0000","last_deep_scrub":"261'330","last_deep_scrub_stamp":"2024-09-12T00:39:14.260607+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.260607+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:42.018666+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50481,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":533,"num_read_kb":1216,"num_write":438,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'783","reported_seq":2246,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.699412+0000","last_change":"2024-09-12T00:39:13.699412+0000","last_active":"2024-09-12T00:39:13.699412+0000","last_peered":"2024-09-12T00:39:13.699412+0000","last_clean":"2024-09-12T00:39:13.699412+0000","last_became_active":"2024-09-12T00:02:05.165892+0000","last_became_peered":"2024-09-12T00:02:05.165892+0000","last_unstale":"2024-09-12T00:39:13.699412+0000","last_undegraded":"2024-09-12T00:39:13.699412+0000","last_fullsized":"2024-09-12T00:39:13.699412+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'783","last_scrub_stamp":"2024-09-12T00:39:13.699327+0000","last_deep_scrub":"261'783","last_deep_scrub_stamp":"2024-09-12T00:39:13.699327+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.699327+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:11.908777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'90","reported_seq":573,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.992321+0000","last_change":"2024-09-12T00:39:11.992321+0000","last_active":"2024-09-12T00:39:11.992321+0000","last_peered":"2024-09-12T00:39:11.992321+0000","last_clean":"2024-09-12T00:39:11.992321+0000","last_became_active":"2024-09-12T00:02:07.169216+0000","last_became_peered":"2024-09-12T00:02:07.169216+0000","last_unstale":"2024-09-12T00:39:11.992321+0000","last_undegraded":"2024-09-12T00:39:11.992321+0000","last_fullsized":"2024-09-12T00:39:11.992321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'90","last_scrub_stamp":"2024-09-12T00:39:11.992219+0000","last_deep_scrub":"261'90","last_deep_scrub_stamp":"2024-09-12T00:39:11.992219+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.992219+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:31.425358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":199,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'131","reported_seq":715,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.837599+0000","last_change":"2024-09-12T00:38:56.837599+0000","last_active":"2024-09-12T00:38:56.837599+0000","last_peered":"2024-09-12T00:38:56.837599+0000","last_clean":"2024-09-12T00:38:56.837599+0000","last_became_active":"2024-09-12T00:01:59.152836+0000","last_became_peered":"2024-09-12T00:01:59.152836+0000","last_unstale":"2024-09-12T00:38:56.837599+0000","last_undegraded":"2024-09-12T00:38:56.837599+0000","last_fullsized":"2024-09-12T00:38:56.837599+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'131","last_scrub_stamp":"2024-09-12T00:38:56.837464+0000","last_deep_scrub":"261'131","last_deep_scrub_stamp":"2024-09-12T00:38:56.837464+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.837464+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:06.526573+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":483,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'320","reported_seq":965,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.128035+0000","last_change":"2024-09-12T00:38:43.128035+0000","last_active":"2024-09-12T00:38:43.128035+0000","last_peered":"2024-09-12T00:38:43.128035+0000","last_clean":"2024-09-12T00:38:43.128035+0000","last_became_active":"2024-09-12T00:01:57.143137+0000","last_became_peered":"2024-09-12T00:01:57.143137+0000","last_unstale":"2024-09-12T00:38:43.128035+0000","last_undegraded":"2024-09-12T00:38:43.128035+0000","last_fullsized":"2024-09-12T00:38:43.128035+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'320","last_scrub_stamp":"2024-09-12T00:38:43.127908+0000","last_deep_scrub":"261'320","last_deep_scrub_stamp":"2024-09-12T00:38:43.127908+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.127908+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:53.536834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286939,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":8103,"num_write":1063,"num_write_kb":32276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.930140+0000","last_change":"2024-09-12T00:38:59.930140+0000","last_active":"2024-09-12T00:38:59.930140+0000","last_peered":"2024-09-12T00:38:59.930140+0000","last_clean":"2024-09-12T00:38:59.930140+0000","last_became_active":"2024-09-12T00:02:01.144199+0000","last_became_peered":"2024-09-12T00:02:01.144199+0000","last_unstale":"2024-09-12T00:38:59.930140+0000","last_undegraded":"2024-09-12T00:38:59.930140+0000","last_fullsized":"2024-09-12T00:38:59.930140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.930003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.930003+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.930003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:43.802037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'493","reported_seq":1134,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.697135+0000","last_change":"2024-09-12T00:39:06.697135+0000","last_active":"2024-09-12T00:39:06.697135+0000","last_peered":"2024-09-12T00:39:06.697135+0000","last_clean":"2024-09-12T00:39:06.697135+0000","last_became_active":"2024-09-12T00:02:03.155625+0000","last_became_peered":"2024-09-12T00:02:03.155625+0000","last_unstale":"2024-09-12T00:39:06.697135+0000","last_undegraded":"2024-09-12T00:39:06.697135+0000","last_fullsized":"2024-09-12T00:39:06.697135+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'493","last_scrub_stamp":"2024-09-12T00:39:06.697030+0000","last_deep_scrub":"261'493","last_deep_scrub_stamp":"2024-09-12T00:39:06.697030+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.697030+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:53.918945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104418,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":868,"num_read_kb":2109,"num_write":716,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.717324+0000","last_change":"2024-09-12T00:39:12.717324+0000","last_active":"2024-09-12T00:39:12.717324+0000","last_peered":"2024-09-12T00:39:12.717324+0000","last_clean":"2024-09-12T00:39:12.717324+0000","last_became_active":"2024-09-12T00:02:05.168816+0000","last_became_peered":"2024-09-12T00:02:05.168816+0000","last_unstale":"2024-09-12T00:39:12.717324+0000","last_undegraded":"2024-09-12T00:39:12.717324+0000","last_fullsized":"2024-09-12T00:39:12.717324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:12.717233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:12.717233+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.717233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:01.788155+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'160","reported_seq":662,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.947174+0000","last_change":"2024-09-12T00:39:07.947174+0000","last_active":"2024-09-12T00:39:07.947174+0000","last_peered":"2024-09-12T00:39:07.947174+0000","last_clean":"2024-09-12T00:39:07.947174+0000","last_became_active":"2024-09-12T00:02:07.171762+0000","last_became_peered":"2024-09-12T00:02:07.171762+0000","last_unstale":"2024-09-12T00:39:07.947174+0000","last_undegraded":"2024-09-12T00:39:07.947174+0000","last_fullsized":"2024-09-12T00:39:07.947174+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'160","last_scrub_stamp":"2024-09-12T00:39:07.947071+0000","last_deep_scrub":"261'160","last_deep_scrub_stamp":"2024-09-12T00:39:07.947071+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.947071+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:16.042433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":181,"num_read_kb":171,"num_write":367,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'251","reported_seq":898,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.196650+0000","last_change":"2024-09-12T00:38:53.196650+0000","last_active":"2024-09-12T00:38:53.196650+0000","last_peered":"2024-09-12T00:38:53.196650+0000","last_clean":"2024-09-12T00:38:53.196650+0000","last_became_active":"2024-09-12T00:01:59.147762+0000","last_became_peered":"2024-09-12T00:01:59.147762+0000","last_unstale":"2024-09-12T00:38:53.196650+0000","last_undegraded":"2024-09-12T00:38:53.196650+0000","last_fullsized":"2024-09-12T00:38:53.196650+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'251","last_scrub_stamp":"2024-09-12T00:38:53.196559+0000","last_deep_scrub":"261'251","last_deep_scrub_stamp":"2024-09-12T00:38:53.196559+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.196559+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:22.688918+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1058,"num_read_kb":865,"num_write":369,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'311","reported_seq":919,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.806433+0000","last_change":"2024-09-12T00:38:45.806433+0000","last_active":"2024-09-12T00:38:45.806433+0000","last_peered":"2024-09-12T00:38:45.806433+0000","last_clean":"2024-09-12T00:38:45.806433+0000","last_became_active":"2024-09-12T00:01:57.139677+0000","last_became_peered":"2024-09-12T00:01:57.139677+0000","last_unstale":"2024-09-12T00:38:45.806433+0000","last_undegraded":"2024-09-12T00:38:45.806433+0000","last_fullsized":"2024-09-12T00:38:45.806433+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'311","last_scrub_stamp":"2024-09-12T00:38:45.806294+0000","last_deep_scrub":"261'311","last_deep_scrub_stamp":"2024-09-12T00:38:45.806294+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.806294+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:02.113023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":3669,"num_write":1056,"num_write_kb":17146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.890918+0000","last_change":"2024-09-12T00:38:58.890918+0000","last_active":"2024-09-12T00:38:58.890918+0000","last_peered":"2024-09-12T00:38:58.890918+0000","last_clean":"2024-09-12T00:38:58.890918+0000","last_became_active":"2024-09-12T00:02:01.150796+0000","last_became_peered":"2024-09-12T00:02:01.150796+0000","last_unstale":"2024-09-12T00:38:58.890918+0000","last_undegraded":"2024-09-12T00:38:58.890918+0000","last_fullsized":"2024-09-12T00:38:58.890918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:58.890832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:58.890832+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.890832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:05.434384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'281","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.402828+0000","last_change":"2024-09-12T00:39:02.402828+0000","last_active":"2024-09-12T00:39:02.402828+0000","last_peered":"2024-09-12T00:39:02.402828+0000","last_clean":"2024-09-12T00:39:02.402828+0000","last_became_active":"2024-09-12T00:02:03.153447+0000","last_became_peered":"2024-09-12T00:02:03.153447+0000","last_unstale":"2024-09-12T00:39:02.402828+0000","last_undegraded":"2024-09-12T00:39:02.402828+0000","last_fullsized":"2024-09-12T00:39:02.402828+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'281","last_scrub_stamp":"2024-09-12T00:39:02.402726+0000","last_deep_scrub":"261'281","last_deep_scrub_stamp":"2024-09-12T00:39:02.402726+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.402726+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:26.074688+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49756,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":469,"num_read_kb":1005,"num_write":420,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.948843+0000","last_change":"2024-09-12T00:39:02.948843+0000","last_active":"2024-09-12T00:39:02.948843+0000","last_peered":"2024-09-12T00:39:02.948843+0000","last_clean":"2024-09-12T00:39:02.948843+0000","last_became_active":"2024-09-12T00:02:05.163689+0000","last_became_peered":"2024-09-12T00:02:05.163689+0000","last_unstale":"2024-09-12T00:39:02.948843+0000","last_undegraded":"2024-09-12T00:39:02.948843+0000","last_fullsized":"2024-09-12T00:39:02.948843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:02.948756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:02.948756+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.948756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:26.562845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'132","reported_seq":622,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.793463+0000","last_change":"2024-09-12T00:39:17.793463+0000","last_active":"2024-09-12T00:39:17.793463+0000","last_peered":"2024-09-12T00:39:17.793463+0000","last_clean":"2024-09-12T00:39:17.793463+0000","last_became_active":"2024-09-12T00:02:07.171942+0000","last_became_peered":"2024-09-12T00:02:07.171942+0000","last_unstale":"2024-09-12T00:39:17.793463+0000","last_undegraded":"2024-09-12T00:39:17.793463+0000","last_fullsized":"2024-09-12T00:39:17.793463+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'132","last_scrub_stamp":"2024-09-12T00:39:17.793369+0000","last_deep_scrub":"261'132","last_deep_scrub_stamp":"2024-09-12T00:39:17.793369+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.793369+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:30.465139+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'138","reported_seq":735,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.199034+0000","last_change":"2024-09-12T00:39:05.199034+0000","last_active":"2024-09-12T00:39:05.199034+0000","last_peered":"2024-09-12T00:39:05.199034+0000","last_clean":"2024-09-12T00:39:05.199034+0000","last_became_active":"2024-09-12T00:01:59.148534+0000","last_became_peered":"2024-09-12T00:01:59.148534+0000","last_unstale":"2024-09-12T00:39:05.199034+0000","last_undegraded":"2024-09-12T00:39:05.199034+0000","last_fullsized":"2024-09-12T00:39:05.199034+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'138","last_scrub_stamp":"2024-09-12T00:39:05.198946+0000","last_deep_scrub":"261'138","last_deep_scrub_stamp":"2024-09-12T00:39:05.198946+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.198946+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:16.549918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":510,"num_write":211,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'366","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.281853+0000","last_change":"2024-09-12T00:38:49.281790+0000","last_active":"2024-09-12T00:38:49.281853+0000","last_peered":"2024-09-12T00:38:49.281853+0000","last_clean":"2024-09-12T00:38:49.281853+0000","last_became_active":"2024-09-12T00:01:57.165226+0000","last_became_peered":"2024-09-12T00:01:57.165226+0000","last_unstale":"2024-09-12T00:38:49.281853+0000","last_undegraded":"2024-09-12T00:38:49.281853+0000","last_fullsized":"2024-09-12T00:38:49.281853+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'366","last_scrub_stamp":"2024-09-12T00:38:49.281653+0000","last_deep_scrub":"261'366","last_deep_scrub_stamp":"2024-09-12T00:38:49.281653+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.281653+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:38.107200+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436889,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":580,"num_read_kb":11178,"num_write":1222,"num_write_kb":42398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.853856+0000","last_change":"2024-09-12T00:39:07.853856+0000","last_active":"2024-09-12T00:39:07.853856+0000","last_peered":"2024-09-12T00:39:07.853856+0000","last_clean":"2024-09-12T00:39:07.853856+0000","last_became_active":"2024-09-12T00:02:01.153818+0000","last_became_peered":"2024-09-12T00:02:01.153818+0000","last_unstale":"2024-09-12T00:39:07.853856+0000","last_undegraded":"2024-09-12T00:39:07.853856+0000","last_fullsized":"2024-09-12T00:39:07.853856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:07.853730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:07.853730+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.853730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:19.668987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'299","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.805022+0000","last_change":"2024-09-12T00:39:09.805022+0000","last_active":"2024-09-12T00:39:09.805022+0000","last_peered":"2024-09-12T00:39:09.805022+0000","last_clean":"2024-09-12T00:39:09.805022+0000","last_became_active":"2024-09-12T00:02:03.152421+0000","last_became_peered":"2024-09-12T00:02:03.152421+0000","last_unstale":"2024-09-12T00:39:09.805022+0000","last_undegraded":"2024-09-12T00:39:09.805022+0000","last_fullsized":"2024-09-12T00:39:09.805022+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'299","last_scrub_stamp":"2024-09-12T00:39:09.804926+0000","last_deep_scrub":"261'299","last_deep_scrub_stamp":"2024-09-12T00:39:09.804926+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.804926+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:51.784383+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49051,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":1143,"num_write":402,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'761","reported_seq":2126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.915452+0000","last_change":"2024-09-12T00:39:01.915452+0000","last_active":"2024-09-12T00:39:01.915452+0000","last_peered":"2024-09-12T00:39:01.915452+0000","last_clean":"2024-09-12T00:39:01.915452+0000","last_became_active":"2024-09-12T00:02:05.164655+0000","last_became_peered":"2024-09-12T00:02:05.164655+0000","last_unstale":"2024-09-12T00:39:01.915452+0000","last_undegraded":"2024-09-12T00:39:01.915452+0000","last_fullsized":"2024-09-12T00:39:01.915452+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'761","last_scrub_stamp":"2024-09-12T00:39:01.915354+0000","last_deep_scrub":"261'761","last_deep_scrub_stamp":"2024-09-12T00:39:01.915354+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.915354+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:26.039431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'98","reported_seq":582,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.990011+0000","last_change":"2024-09-12T00:39:10.989947+0000","last_active":"2024-09-12T00:39:10.990011+0000","last_peered":"2024-09-12T00:39:10.990011+0000","last_clean":"2024-09-12T00:39:10.990011+0000","last_became_active":"2024-09-12T00:02:07.164754+0000","last_became_peered":"2024-09-12T00:02:07.164754+0000","last_unstale":"2024-09-12T00:39:10.990011+0000","last_undegraded":"2024-09-12T00:39:10.990011+0000","last_fullsized":"2024-09-12T00:39:10.990011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'98","last_scrub_stamp":"2024-09-12T00:39:10.989857+0000","last_deep_scrub":"261'98","last_deep_scrub_stamp":"2024-09-12T00:39:10.989857+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.989857+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:41.380480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":233,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'86","reported_seq":648,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.080211+0000","last_change":"2024-09-12T00:38:52.080211+0000","last_active":"2024-09-12T00:38:52.080211+0000","last_peered":"2024-09-12T00:38:52.080211+0000","last_clean":"2024-09-12T00:38:52.080211+0000","last_became_active":"2024-09-12T00:01:59.157172+0000","last_became_peered":"2024-09-12T00:01:59.157172+0000","last_unstale":"2024-09-12T00:38:52.080211+0000","last_undegraded":"2024-09-12T00:38:52.080211+0000","last_fullsized":"2024-09-12T00:38:52.080211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'86","last_scrub_stamp":"2024-09-12T00:38:52.080123+0000","last_deep_scrub":"261'86","last_deep_scrub_stamp":"2024-09-12T00:38:52.080123+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.080123+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:17.189295+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":384,"num_read_kb":356,"num_write":138,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2877,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'377","reported_seq":1036,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.321918+0000","last_change":"2024-09-12T00:38:48.321852+0000","last_active":"2024-09-12T00:38:48.321918+0000","last_peered":"2024-09-12T00:38:48.321918+0000","last_clean":"2024-09-12T00:38:48.321918+0000","last_became_active":"2024-09-12T00:01:57.145710+0000","last_became_peered":"2024-09-12T00:01:57.145710+0000","last_unstale":"2024-09-12T00:38:48.321918+0000","last_undegraded":"2024-09-12T00:38:48.321918+0000","last_fullsized":"2024-09-12T00:38:48.321918+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'377","last_scrub_stamp":"2024-09-12T00:38:48.321674+0000","last_deep_scrub":"261'377","last_deep_scrub_stamp":"2024-09-12T00:38:48.321674+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.321674+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:27.181005+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1440158,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":582,"num_read_kb":20019,"num_write":1294,"num_write_kb":22247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"261'8","reported_seq":1931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.449113+0000","last_change":"2024-09-12T00:38:56.449113+0000","last_active":"2024-09-12T00:38:56.449113+0000","last_peered":"2024-09-12T00:38:56.449113+0000","last_clean":"2024-09-12T00:38:56.449113+0000","last_became_active":"2024-09-12T00:02:01.143823+0000","last_became_peered":"2024-09-12T00:02:01.143823+0000","last_unstale":"2024-09-12T00:38:56.449113+0000","last_undegraded":"2024-09-12T00:38:56.449113+0000","last_fullsized":"2024-09-12T00:38:56.449113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T00:38:56.449020+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T00:38:56.449020+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.449020+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:41.425744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1676,"num_read_kb":1674,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'70","reported_seq":576,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.957192+0000","last_change":"2024-09-12T00:39:03.957192+0000","last_active":"2024-09-12T00:39:03.957192+0000","last_peered":"2024-09-12T00:39:03.957192+0000","last_clean":"2024-09-12T00:39:03.957192+0000","last_became_active":"2024-09-12T00:02:03.156680+0000","last_became_peered":"2024-09-12T00:02:03.156680+0000","last_unstale":"2024-09-12T00:39:03.957192+0000","last_undegraded":"2024-09-12T00:39:03.957192+0000","last_fullsized":"2024-09-12T00:39:03.957192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'70","last_scrub_stamp":"2024-09-12T00:39:03.957096+0000","last_deep_scrub":"261'70","last_deep_scrub_stamp":"2024-09-12T00:39:03.957096+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.957096+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:33.811930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'775","reported_seq":2297,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.492424+0000","last_change":"2024-09-12T00:39:05.492424+0000","last_active":"2024-09-12T00:39:05.492424+0000","last_peered":"2024-09-12T00:39:05.492424+0000","last_clean":"2024-09-12T00:39:05.492424+0000","last_became_active":"2024-09-12T00:02:05.163596+0000","last_became_peered":"2024-09-12T00:02:05.163596+0000","last_unstale":"2024-09-12T00:39:05.492424+0000","last_undegraded":"2024-09-12T00:39:05.492424+0000","last_fullsized":"2024-09-12T00:39:05.492424+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'775","last_scrub_stamp":"2024-09-12T00:39:05.492347+0000","last_deep_scrub":"261'775","last_deep_scrub_stamp":"2024-09-12T00:39:05.492347+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.492347+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:33.359858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'120","reported_seq":611,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.180752+0000","last_change":"2024-09-12T00:39:06.180688+0000","last_active":"2024-09-12T00:39:06.180752+0000","last_peered":"2024-09-12T00:39:06.180752+0000","last_clean":"2024-09-12T00:39:06.180752+0000","last_became_active":"2024-09-12T00:02:07.169160+0000","last_became_peered":"2024-09-12T00:02:07.169160+0000","last_unstale":"2024-09-12T00:39:06.180752+0000","last_undegraded":"2024-09-12T00:39:06.180752+0000","last_fullsized":"2024-09-12T00:39:06.180752+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'120","last_scrub_stamp":"2024-09-12T00:39:06.180617+0000","last_deep_scrub":"261'120","last_deep_scrub_stamp":"2024-09-12T00:39:06.180617+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.180617+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:53.593418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":119,"num_write":276,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'226","reported_seq":793,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.777724+0000","last_change":"2024-09-12T00:38:48.777724+0000","last_active":"2024-09-12T00:38:48.777724+0000","last_peered":"2024-09-12T00:38:48.777724+0000","last_clean":"2024-09-12T00:38:48.777724+0000","last_became_active":"2024-09-12T00:01:59.152145+0000","last_became_peered":"2024-09-12T00:01:59.152145+0000","last_unstale":"2024-09-12T00:38:48.777724+0000","last_undegraded":"2024-09-12T00:38:48.777724+0000","last_fullsized":"2024-09-12T00:38:48.777724+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'226","last_scrub_stamp":"2024-09-12T00:38:48.777643+0000","last_deep_scrub":"261'226","last_deep_scrub_stamp":"2024-09-12T00:38:48.777643+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.777643+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:12.164018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":744,"num_write":332,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'404","reported_seq":1118,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.557690+0000","last_change":"2024-09-12T00:38:48.557690+0000","last_active":"2024-09-12T00:38:48.557690+0000","last_peered":"2024-09-12T00:38:48.557690+0000","last_clean":"2024-09-12T00:38:48.557690+0000","last_became_active":"2024-09-12T00:01:57.140715+0000","last_became_peered":"2024-09-12T00:01:57.140715+0000","last_unstale":"2024-09-12T00:38:48.557690+0000","last_undegraded":"2024-09-12T00:38:48.557690+0000","last_fullsized":"2024-09-12T00:38:48.557690+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'404","last_scrub_stamp":"2024-09-12T00:38:48.557572+0000","last_deep_scrub":"261'404","last_deep_scrub_stamp":"2024-09-12T00:38:48.557572+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.557572+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.419290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":94303,"num_write":1279,"num_write_kb":32809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.216913+0000","last_change":"2024-09-12T00:39:08.216913+0000","last_active":"2024-09-12T00:39:08.216913+0000","last_peered":"2024-09-12T00:39:08.216913+0000","last_clean":"2024-09-12T00:39:08.216913+0000","last_became_active":"2024-09-12T00:02:01.153347+0000","last_became_peered":"2024-09-12T00:02:01.153347+0000","last_unstale":"2024-09-12T00:39:08.216913+0000","last_undegraded":"2024-09-12T00:39:08.216913+0000","last_fullsized":"2024-09-12T00:39:08.216913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:08.216830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:08.216830+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.216830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:23.658033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'323","reported_seq":918,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.413073+0000","last_change":"2024-09-12T00:39:01.413073+0000","last_active":"2024-09-12T00:39:01.413073+0000","last_peered":"2024-09-12T00:39:01.413073+0000","last_clean":"2024-09-12T00:39:01.413073+0000","last_became_active":"2024-09-12T00:02:03.154752+0000","last_became_peered":"2024-09-12T00:02:03.154752+0000","last_unstale":"2024-09-12T00:39:01.413073+0000","last_undegraded":"2024-09-12T00:39:01.413073+0000","last_fullsized":"2024-09-12T00:39:01.413073+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-12T00:39:01.412937+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-12T00:39:01.412937+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.412937+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:32.529380+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43947,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1120,"num_write":412,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.228503+0000","last_change":"2024-09-12T00:39:02.228503+0000","last_active":"2024-09-12T00:39:02.228503+0000","last_peered":"2024-09-12T00:39:02.228503+0000","last_clean":"2024-09-12T00:39:02.228503+0000","last_became_active":"2024-09-12T00:02:05.164108+0000","last_became_peered":"2024-09-12T00:02:05.164108+0000","last_unstale":"2024-09-12T00:39:02.228503+0000","last_undegraded":"2024-09-12T00:39:02.228503+0000","last_fullsized":"2024-09-12T00:39:02.228503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:02.228412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:02.228412+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.228412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:17.624723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'162","reported_seq":645,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.920278+0000","last_change":"2024-09-12T00:39:06.920217+0000","last_active":"2024-09-12T00:39:06.920278+0000","last_peered":"2024-09-12T00:39:06.920278+0000","last_clean":"2024-09-12T00:39:06.920278+0000","last_became_active":"2024-09-12T00:02:07.169351+0000","last_became_peered":"2024-09-12T00:02:07.169351+0000","last_unstale":"2024-09-12T00:39:06.920278+0000","last_undegraded":"2024-09-12T00:39:06.920278+0000","last_fullsized":"2024-09-12T00:39:06.920278+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'162","last_scrub_stamp":"2024-09-12T00:39:06.920126+0000","last_deep_scrub":"261'162","last_deep_scrub_stamp":"2024-09-12T00:39:06.920126+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.920126+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:14.572324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":164,"num_write":397,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'164","reported_seq":777,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.144115+0000","last_change":"2024-09-12T00:39:01.144037+0000","last_active":"2024-09-12T00:39:01.144115+0000","last_peered":"2024-09-12T00:39:01.144115+0000","last_clean":"2024-09-12T00:39:01.144115+0000","last_became_active":"2024-09-12T00:01:59.150072+0000","last_became_peered":"2024-09-12T00:01:59.150072+0000","last_unstale":"2024-09-12T00:39:01.144115+0000","last_undegraded":"2024-09-12T00:39:01.144115+0000","last_fullsized":"2024-09-12T00:39:01.144115+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'164","last_scrub_stamp":"2024-09-12T00:39:01.143943+0000","last_deep_scrub":"261'164","last_deep_scrub_stamp":"2024-09-12T00:39:01.143943+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.143943+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:32.032700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":763,"num_read_kb":636,"num_write":273,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"261'74","reported_seq":615,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:42.491365+0000","last_change":"2024-09-12T00:38:42.491365+0000","last_active":"2024-09-12T00:38:42.491365+0000","last_peered":"2024-09-12T00:38:42.491365+0000","last_clean":"2024-09-12T00:38:42.491365+0000","last_became_active":"2024-09-12T00:01:39.720425+0000","last_became_peered":"2024-09-12T00:01:39.720425+0000","last_unstale":"2024-09-12T00:38:42.491365+0000","last_undegraded":"2024-09-12T00:38:42.491365+0000","last_fullsized":"2024-09-12T00:38:42.491365+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'74","last_scrub_stamp":"2024-09-12T00:38:42.491259+0000","last_deep_scrub":"261'74","last_deep_scrub_stamp":"2024-09-12T00:38:42.491259+0000","last_clean_scrub_stamp":"2024-09-12T00:38:42.491259+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:28.887567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"261'2","reported_seq":522,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.331718+0000","last_change":"2024-09-12T00:38:44.331659+0000","last_active":"2024-09-12T00:38:44.331718+0000","last_peered":"2024-09-12T00:38:44.331718+0000","last_clean":"2024-09-12T00:38:44.331718+0000","last_became_active":"2024-09-12T00:01:46.613916+0000","last_became_peered":"2024-09-12T00:01:46.613916+0000","last_unstale":"2024-09-12T00:38:44.331718+0000","last_undegraded":"2024-09-12T00:38:44.331718+0000","last_fullsized":"2024-09-12T00:38:44.331718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:38:44.331592+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:38:44.331592+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.331592+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:42.535188+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0014566500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'375","reported_seq":1077,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.581530+0000","last_change":"2024-09-12T00:38:46.581469+0000","last_active":"2024-09-12T00:38:46.581530+0000","last_peered":"2024-09-12T00:38:46.581530+0000","last_clean":"2024-09-12T00:38:46.581530+0000","last_became_active":"2024-09-12T00:01:57.141553+0000","last_became_peered":"2024-09-12T00:01:57.141553+0000","last_unstale":"2024-09-12T00:38:46.581530+0000","last_undegraded":"2024-09-12T00:38:46.581530+0000","last_fullsized":"2024-09-12T00:38:46.581530+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'375","last_scrub_stamp":"2024-09-12T00:38:46.581372+0000","last_deep_scrub":"261'375","last_deep_scrub_stamp":"2024-09-12T00:38:46.581372+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.581372+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:35.589907+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":706,"num_read_kb":51090,"num_write":1043,"num_write_kb":49735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":501,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.339193+0000","last_change":"2024-09-12T00:39:00.339133+0000","last_active":"2024-09-12T00:39:00.339193+0000","last_peered":"2024-09-12T00:39:00.339193+0000","last_clean":"2024-09-12T00:39:00.339193+0000","last_became_active":"2024-09-12T00:02:01.148696+0000","last_became_peered":"2024-09-12T00:02:01.148696+0000","last_unstale":"2024-09-12T00:39:00.339193+0000","last_undegraded":"2024-09-12T00:39:00.339193+0000","last_fullsized":"2024-09-12T00:39:00.339193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:00.339045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:00.339045+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.339045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:12.664460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'697","reported_seq":1400,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.303323+0000","last_change":"2024-09-12T00:39:13.303323+0000","last_active":"2024-09-12T00:39:13.303323+0000","last_peered":"2024-09-12T00:39:13.303323+0000","last_clean":"2024-09-12T00:39:13.303323+0000","last_became_active":"2024-09-12T00:02:03.150075+0000","last_became_peered":"2024-09-12T00:02:03.150075+0000","last_unstale":"2024-09-12T00:39:13.303323+0000","last_undegraded":"2024-09-12T00:39:13.303323+0000","last_fullsized":"2024-09-12T00:39:13.303323+0000","mapping_epoch":30,"log_start":"261'600","ondisk_log_start":"261'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'697","last_scrub_stamp":"2024-09-12T00:39:13.303195+0000","last_deep_scrub":"261'697","last_deep_scrub_stamp":"2024-09-12T00:39:13.303195+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.303195+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:50.182425+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141385,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1354,"num_read_kb":3064,"num_write":1242,"num_write_kb":1087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89192,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.761131+0000","last_change":"2024-09-12T00:39:10.761131+0000","last_active":"2024-09-12T00:39:10.761131+0000","last_peered":"2024-09-12T00:39:10.761131+0000","last_clean":"2024-09-12T00:39:10.761131+0000","last_became_active":"2024-09-12T00:02:05.162455+0000","last_became_peered":"2024-09-12T00:02:05.162455+0000","last_unstale":"2024-09-12T00:39:10.761131+0000","last_undegraded":"2024-09-12T00:39:10.761131+0000","last_fullsized":"2024-09-12T00:39:10.761131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:10.761046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:10.761046+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.761046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:28.012050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'261","reported_seq":971,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.193142+0000","last_change":"2024-09-12T00:39:07.193142+0000","last_active":"2024-09-12T00:39:07.193142+0000","last_peered":"2024-09-12T00:39:07.193142+0000","last_clean":"2024-09-12T00:39:07.193142+0000","last_became_active":"2024-09-12T00:02:07.167844+0000","last_became_peered":"2024-09-12T00:02:07.167844+0000","last_unstale":"2024-09-12T00:39:07.193142+0000","last_undegraded":"2024-09-12T00:39:07.193142+0000","last_fullsized":"2024-09-12T00:39:07.193142+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'261","last_scrub_stamp":"2024-09-12T00:39:07.193014+0000","last_deep_scrub":"261'261","last_deep_scrub_stamp":"2024-09-12T00:39:07.193014+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.193014+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:50.781535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":469,"num_read_kb":454,"num_write":531,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'172","reported_seq":770,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.825993+0000","last_change":"2024-09-12T00:38:58.825993+0000","last_active":"2024-09-12T00:38:58.825993+0000","last_peered":"2024-09-12T00:38:58.825993+0000","last_clean":"2024-09-12T00:38:58.825993+0000","last_became_active":"2024-09-12T00:01:59.149145+0000","last_became_peered":"2024-09-12T00:01:59.149145+0000","last_unstale":"2024-09-12T00:38:58.825993+0000","last_undegraded":"2024-09-12T00:38:58.825993+0000","last_fullsized":"2024-09-12T00:38:58.825993+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'172","last_scrub_stamp":"2024-09-12T00:38:58.825895+0000","last_deep_scrub":"261'172","last_deep_scrub_stamp":"2024-09-12T00:38:58.825895+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.825895+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:12.181956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":604,"num_write":249,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.344663+0000","last_change":"2024-09-12T00:38:43.344663+0000","last_active":"2024-09-12T00:38:43.344663+0000","last_peered":"2024-09-12T00:38:43.344663+0000","last_clean":"2024-09-12T00:38:43.344663+0000","last_became_active":"2024-09-12T00:01:46.505677+0000","last_became_peered":"2024-09-12T00:01:46.505677+0000","last_unstale":"2024-09-12T00:38:43.344663+0000","last_undegraded":"2024-09-12T00:38:43.344663+0000","last_fullsized":"2024-09-12T00:38:43.344663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:43.344592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:43.344592+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.344592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:02.518245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00075102999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'327","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.034108+0000","last_change":"2024-09-12T00:38:48.034002+0000","last_active":"2024-09-12T00:38:48.034108+0000","last_peered":"2024-09-12T00:38:48.034108+0000","last_clean":"2024-09-12T00:38:48.034108+0000","last_became_active":"2024-09-12T00:01:57.152153+0000","last_became_peered":"2024-09-12T00:01:57.152153+0000","last_unstale":"2024-09-12T00:38:48.034108+0000","last_undegraded":"2024-09-12T00:38:48.034108+0000","last_fullsized":"2024-09-12T00:38:48.034108+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'327","last_scrub_stamp":"2024-09-12T00:38:48.033865+0000","last_deep_scrub":"261'327","last_deep_scrub_stamp":"2024-09-12T00:38:48.033865+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.033865+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:01.645214+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263237,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":31136,"num_write":994,"num_write_kb":29868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.149402+0000","last_change":"2024-09-12T00:39:03.149402+0000","last_active":"2024-09-12T00:39:03.149402+0000","last_peered":"2024-09-12T00:39:03.149402+0000","last_clean":"2024-09-12T00:39:03.149402+0000","last_became_active":"2024-09-12T00:02:01.152904+0000","last_became_peered":"2024-09-12T00:02:01.152904+0000","last_unstale":"2024-09-12T00:39:03.149402+0000","last_undegraded":"2024-09-12T00:39:03.149402+0000","last_fullsized":"2024-09-12T00:39:03.149402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:03.149318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:03.149318+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.149318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:56.022423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1221","reported_seq":2589,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.930393+0000","last_change":"2024-09-12T00:38:59.930294+0000","last_active":"2024-09-12T00:38:59.930393+0000","last_peered":"2024-09-12T00:38:59.930393+0000","last_clean":"2024-09-12T00:38:59.930393+0000","last_became_active":"2024-09-12T00:02:03.153702+0000","last_became_peered":"2024-09-12T00:02:03.153702+0000","last_unstale":"2024-09-12T00:38:59.930393+0000","last_undegraded":"2024-09-12T00:38:59.930393+0000","last_fullsized":"2024-09-12T00:38:59.930393+0000","mapping_epoch":30,"log_start":"261'1200","ondisk_log_start":"261'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1221","last_scrub_stamp":"2024-09-12T00:38:59.930107+0000","last_deep_scrub":"261'1221","last_deep_scrub_stamp":"2024-09-12T00:38:59.930107+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.930107+0000","objects_scrubbed":12,"log_size":21,"log_dups_size":1200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:26.162750+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137303,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1920,"num_read_kb":3540,"num_write":1014,"num_write_kb":851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.094948+0000","last_change":"2024-09-12T00:39:21.094888+0000","last_active":"2024-09-12T00:39:21.094948+0000","last_peered":"2024-09-12T00:39:21.094948+0000","last_clean":"2024-09-12T00:39:21.094948+0000","last_became_active":"2024-09-12T00:02:05.171787+0000","last_became_peered":"2024-09-12T00:02:05.171787+0000","last_unstale":"2024-09-12T00:39:21.094948+0000","last_undegraded":"2024-09-12T00:39:21.094948+0000","last_fullsized":"2024-09-12T00:39:21.094948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:21.094797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:21.094797+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.094797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:30.711629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'220","reported_seq":749,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.768691+0000","last_change":"2024-09-12T00:39:16.768691+0000","last_active":"2024-09-12T00:39:16.768691+0000","last_peered":"2024-09-12T00:39:16.768691+0000","last_clean":"2024-09-12T00:39:16.768691+0000","last_became_active":"2024-09-12T00:02:07.169173+0000","last_became_peered":"2024-09-12T00:02:07.169173+0000","last_unstale":"2024-09-12T00:39:16.768691+0000","last_undegraded":"2024-09-12T00:39:16.768691+0000","last_fullsized":"2024-09-12T00:39:16.768691+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'220","last_scrub_stamp":"2024-09-12T00:39:16.768578+0000","last_deep_scrub":"261'220","last_deep_scrub_stamp":"2024-09-12T00:39:16.768578+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.768578+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:30.964212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":374,"num_read_kb":362,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'89","reported_seq":649,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.951095+0000","last_change":"2024-09-12T00:38:56.951095+0000","last_active":"2024-09-12T00:38:56.951095+0000","last_peered":"2024-09-12T00:38:56.951095+0000","last_clean":"2024-09-12T00:38:56.951095+0000","last_became_active":"2024-09-12T00:01:59.138731+0000","last_became_peered":"2024-09-12T00:01:59.138731+0000","last_unstale":"2024-09-12T00:38:56.951095+0000","last_undegraded":"2024-09-12T00:38:56.951095+0000","last_fullsized":"2024-09-12T00:38:56.951095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'89","last_scrub_stamp":"2024-09-12T00:38:56.950966+0000","last_deep_scrub":"261'89","last_deep_scrub_stamp":"2024-09-12T00:38:56.950966+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.950966+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:18.408760+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":368,"num_read_kb":306,"num_write":121,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":512,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.785510+0000","last_change":"2024-09-12T00:38:44.785441+0000","last_active":"2024-09-12T00:38:44.785510+0000","last_peered":"2024-09-12T00:38:44.785510+0000","last_clean":"2024-09-12T00:38:44.785510+0000","last_became_active":"2024-09-12T00:01:46.505857+0000","last_became_peered":"2024-09-12T00:01:46.505857+0000","last_unstale":"2024-09-12T00:38:44.785510+0000","last_undegraded":"2024-09-12T00:38:44.785510+0000","last_fullsized":"2024-09-12T00:38:44.785510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:44.785356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:44.785356+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.785356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:13.579766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039331300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'325","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.790044+0000","last_change":"2024-09-12T00:38:46.790044+0000","last_active":"2024-09-12T00:38:46.790044+0000","last_peered":"2024-09-12T00:38:46.790044+0000","last_clean":"2024-09-12T00:38:46.790044+0000","last_became_active":"2024-09-12T00:01:57.151644+0000","last_became_peered":"2024-09-12T00:01:57.151644+0000","last_unstale":"2024-09-12T00:38:46.790044+0000","last_undegraded":"2024-09-12T00:38:46.790044+0000","last_fullsized":"2024-09-12T00:38:46.790044+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'325","last_scrub_stamp":"2024-09-12T00:38:46.789939+0000","last_deep_scrub":"261'325","last_deep_scrub_stamp":"2024-09-12T00:38:46.789939+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.789939+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:00.959710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399150,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":451,"num_read_kb":2375,"num_write":1107,"num_write_kb":41035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"261'2","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.895506+0000","last_change":"2024-09-12T00:38:56.895506+0000","last_active":"2024-09-12T00:38:56.895506+0000","last_peered":"2024-09-12T00:38:56.895506+0000","last_clean":"2024-09-12T00:38:56.895506+0000","last_became_active":"2024-09-12T00:02:01.151474+0000","last_became_peered":"2024-09-12T00:02:01.151474+0000","last_unstale":"2024-09-12T00:38:56.895506+0000","last_undegraded":"2024-09-12T00:38:56.895506+0000","last_fullsized":"2024-09-12T00:38:56.895506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:38:56.895390+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:38:56.895390+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.895390+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:45.952295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'217","reported_seq":1199,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.312988+0000","last_change":"2024-09-12T00:39:02.312925+0000","last_active":"2024-09-12T00:39:02.312988+0000","last_peered":"2024-09-12T00:39:02.312988+0000","last_clean":"2024-09-12T00:39:02.312988+0000","last_became_active":"2024-09-12T00:02:03.155311+0000","last_became_peered":"2024-09-12T00:02:03.155311+0000","last_unstale":"2024-09-12T00:39:02.312988+0000","last_undegraded":"2024-09-12T00:39:02.312988+0000","last_fullsized":"2024-09-12T00:39:02.312988+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'217","last_scrub_stamp":"2024-09-12T00:39:02.312818+0000","last_deep_scrub":"261'217","last_deep_scrub_stamp":"2024-09-12T00:39:02.312818+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.312818+0000","objects_scrubbed":9,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:20.910589+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":119,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.717083+0000","last_change":"2024-09-12T00:39:12.716999+0000","last_active":"2024-09-12T00:39:12.717083+0000","last_peered":"2024-09-12T00:39:12.717083+0000","last_clean":"2024-09-12T00:39:12.717083+0000","last_became_active":"2024-09-12T00:02:05.167874+0000","last_became_peered":"2024-09-12T00:02:05.167874+0000","last_unstale":"2024-09-12T00:39:12.717083+0000","last_undegraded":"2024-09-12T00:39:12.717083+0000","last_fullsized":"2024-09-12T00:39:12.717083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:12.716899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:12.716899+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.716899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:53.352781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'264","reported_seq":866,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.659200+0000","last_change":"2024-09-12T00:39:18.659200+0000","last_active":"2024-09-12T00:39:18.659200+0000","last_peered":"2024-09-12T00:39:18.659200+0000","last_clean":"2024-09-12T00:39:18.659200+0000","last_became_active":"2024-09-12T00:02:07.161814+0000","last_became_peered":"2024-09-12T00:02:07.161814+0000","last_unstale":"2024-09-12T00:39:18.659200+0000","last_undegraded":"2024-09-12T00:39:18.659200+0000","last_fullsized":"2024-09-12T00:39:18.659200+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'264","last_scrub_stamp":"2024-09-12T00:39:18.659118+0000","last_deep_scrub":"261'264","last_deep_scrub_stamp":"2024-09-12T00:39:18.659118+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.659118+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:52.481023+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":499,"num_read_kb":517,"num_write":567,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'136","reported_seq":721,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.975764+0000","last_change":"2024-09-12T00:38:53.975704+0000","last_active":"2024-09-12T00:38:53.975764+0000","last_peered":"2024-09-12T00:38:53.975764+0000","last_clean":"2024-09-12T00:38:53.975764+0000","last_became_active":"2024-09-12T00:01:59.153542+0000","last_became_peered":"2024-09-12T00:01:59.153542+0000","last_unstale":"2024-09-12T00:38:53.975764+0000","last_undegraded":"2024-09-12T00:38:53.975764+0000","last_fullsized":"2024-09-12T00:38:53.975764+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'136","last_scrub_stamp":"2024-09-12T00:38:53.975609+0000","last_deep_scrub":"261'136","last_deep_scrub_stamp":"2024-09-12T00:38:53.975609+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.975609+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:02.481618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":619,"num_read_kb":513,"num_write":207,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"261'3","reported_seq":523,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.339780+0000","last_change":"2024-09-12T00:38:45.339714+0000","last_active":"2024-09-12T00:38:45.339780+0000","last_peered":"2024-09-12T00:38:45.339780+0000","last_clean":"2024-09-12T00:38:45.339780+0000","last_became_active":"2024-09-12T00:01:46.502428+0000","last_became_peered":"2024-09-12T00:01:46.502428+0000","last_unstale":"2024-09-12T00:38:45.339780+0000","last_undegraded":"2024-09-12T00:38:45.339780+0000","last_fullsized":"2024-09-12T00:38:45.339780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:38:45.339643+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:38:45.339643+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.339643+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:28.135971+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001414925,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'334","reported_seq":962,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.197811+0000","last_change":"2024-09-12T00:38:45.197753+0000","last_active":"2024-09-12T00:38:45.197811+0000","last_peered":"2024-09-12T00:38:45.197811+0000","last_clean":"2024-09-12T00:38:45.197811+0000","last_became_active":"2024-09-12T00:01:57.156172+0000","last_became_peered":"2024-09-12T00:01:57.156172+0000","last_unstale":"2024-09-12T00:38:45.197811+0000","last_undegraded":"2024-09-12T00:38:45.197811+0000","last_fullsized":"2024-09-12T00:38:45.197811+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'334","last_scrub_stamp":"2024-09-12T00:38:45.197636+0000","last_deep_scrub":"261'334","last_deep_scrub_stamp":"2024-09-12T00:38:45.197636+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.197636+0000","objects_scrubbed":10,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:41.388701+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7788939,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":443,"num_read_kb":22094,"num_write":1095,"num_write_kb":41486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.899891+0000","last_change":"2024-09-12T00:38:55.899831+0000","last_active":"2024-09-12T00:38:55.899891+0000","last_peered":"2024-09-12T00:38:55.899891+0000","last_clean":"2024-09-12T00:38:55.899891+0000","last_became_active":"2024-09-12T00:02:01.152752+0000","last_became_peered":"2024-09-12T00:02:01.152752+0000","last_unstale":"2024-09-12T00:38:55.899891+0000","last_undegraded":"2024-09-12T00:38:55.899891+0000","last_fullsized":"2024-09-12T00:38:55.899891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:55.899739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:55.899739+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.899739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:27.345544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'119","reported_seq":647,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.824049+0000","last_change":"2024-09-12T00:39:08.824049+0000","last_active":"2024-09-12T00:39:08.824049+0000","last_peered":"2024-09-12T00:39:08.824049+0000","last_clean":"2024-09-12T00:39:08.824049+0000","last_became_active":"2024-09-12T00:02:03.152008+0000","last_became_peered":"2024-09-12T00:02:03.152008+0000","last_unstale":"2024-09-12T00:39:08.824049+0000","last_undegraded":"2024-09-12T00:39:08.824049+0000","last_fullsized":"2024-09-12T00:39:08.824049+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'119","last_scrub_stamp":"2024-09-12T00:39:08.823956+0000","last_deep_scrub":"261'119","last_deep_scrub_stamp":"2024-09-12T00:39:08.823956+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.823956+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:46.719748+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":94,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.057365+0000","last_change":"2024-09-12T00:39:22.057365+0000","last_active":"2024-09-12T00:39:22.057365+0000","last_peered":"2024-09-12T00:39:22.057365+0000","last_clean":"2024-09-12T00:39:22.057365+0000","last_became_active":"2024-09-12T00:02:05.170487+0000","last_became_peered":"2024-09-12T00:02:05.170487+0000","last_unstale":"2024-09-12T00:39:22.057365+0000","last_undegraded":"2024-09-12T00:39:22.057365+0000","last_fullsized":"2024-09-12T00:39:22.057365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:22.057217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:22.057217+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.057217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:14.738952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":671,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.431387+0000","last_change":"2024-09-12T00:39:08.431387+0000","last_active":"2024-09-12T00:39:08.431387+0000","last_peered":"2024-09-12T00:39:08.431387+0000","last_clean":"2024-09-12T00:39:08.431387+0000","last_became_active":"2024-09-12T00:02:07.168820+0000","last_became_peered":"2024-09-12T00:02:07.168820+0000","last_unstale":"2024-09-12T00:39:08.431387+0000","last_undegraded":"2024-09-12T00:39:08.431387+0000","last_fullsized":"2024-09-12T00:39:08.431387+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'122","last_scrub_stamp":"2024-09-12T00:39:08.431306+0000","last_deep_scrub":"261'122","last_deep_scrub_stamp":"2024-09-12T00:39:08.431306+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.431306+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:45.683565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":226,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'300","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.984567+0000","last_change":"2024-09-12T00:38:51.984514+0000","last_active":"2024-09-12T00:38:51.984567+0000","last_peered":"2024-09-12T00:38:51.984567+0000","last_clean":"2024-09-12T00:38:51.984567+0000","last_became_active":"2024-09-12T00:01:59.145273+0000","last_became_peered":"2024-09-12T00:01:59.145273+0000","last_unstale":"2024-09-12T00:38:51.984567+0000","last_undegraded":"2024-09-12T00:38:51.984567+0000","last_fullsized":"2024-09-12T00:38:51.984567+0000","mapping_epoch":26,"log_start":"258'200","ondisk_log_start":"258'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'300","last_scrub_stamp":"2024-09-12T00:38:51.984415+0000","last_deep_scrub":"261'300","last_deep_scrub_stamp":"2024-09-12T00:38:51.984415+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.984415+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:31.222270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1215,"num_write":550,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'372","reported_seq":1076,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.015004+0000","last_change":"2024-09-12T00:38:44.014947+0000","last_active":"2024-09-12T00:38:44.015004+0000","last_peered":"2024-09-12T00:38:44.015004+0000","last_clean":"2024-09-12T00:38:44.015004+0000","last_became_active":"2024-09-12T00:01:57.154387+0000","last_became_peered":"2024-09-12T00:01:57.154387+0000","last_unstale":"2024-09-12T00:38:44.015004+0000","last_undegraded":"2024-09-12T00:38:44.015004+0000","last_fullsized":"2024-09-12T00:38:44.015004+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'372","last_scrub_stamp":"2024-09-12T00:38:44.014836+0000","last_deep_scrub":"261'372","last_deep_scrub_stamp":"2024-09-12T00:38:44.014836+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.014836+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:12.072171+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6404752,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":635,"num_read_kb":122441,"num_write":1157,"num_write_kb":43815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":518,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.795449+0000","last_change":"2024-09-12T00:38:44.795387+0000","last_active":"2024-09-12T00:38:44.795449+0000","last_peered":"2024-09-12T00:38:44.795449+0000","last_clean":"2024-09-12T00:38:44.795449+0000","last_became_active":"2024-09-12T00:01:46.505954+0000","last_became_peered":"2024-09-12T00:01:46.505954+0000","last_unstale":"2024-09-12T00:38:44.795449+0000","last_undegraded":"2024-09-12T00:38:44.795449+0000","last_fullsized":"2024-09-12T00:38:44.795449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:44.795256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:44.795256+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.795256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:45.361353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050498000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.578486+0000","last_change":"2024-09-12T00:39:01.578391+0000","last_active":"2024-09-12T00:39:01.578486+0000","last_peered":"2024-09-12T00:39:01.578486+0000","last_clean":"2024-09-12T00:39:01.578486+0000","last_became_active":"2024-09-12T00:02:01.149529+0000","last_became_peered":"2024-09-12T00:02:01.149529+0000","last_unstale":"2024-09-12T00:39:01.578486+0000","last_undegraded":"2024-09-12T00:39:01.578486+0000","last_fullsized":"2024-09-12T00:39:01.578486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:01.578285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:01.578285+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.578285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:50.557711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'566","reported_seq":1225,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.918702+0000","last_change":"2024-09-12T00:38:57.918702+0000","last_active":"2024-09-12T00:38:57.918702+0000","last_peered":"2024-09-12T00:38:57.918702+0000","last_clean":"2024-09-12T00:38:57.918702+0000","last_became_active":"2024-09-12T00:02:03.152535+0000","last_became_peered":"2024-09-12T00:02:03.152535+0000","last_unstale":"2024-09-12T00:38:57.918702+0000","last_undegraded":"2024-09-12T00:38:57.918702+0000","last_fullsized":"2024-09-12T00:38:57.918702+0000","mapping_epoch":30,"log_start":"261'500","ondisk_log_start":"261'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'566","last_scrub_stamp":"2024-09-12T00:38:57.918575+0000","last_deep_scrub":"261'566","last_deep_scrub_stamp":"2024-09-12T00:38:57.918575+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.918575+0000","objects_scrubbed":11,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:11.867915+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88538,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1530,"num_read_kb":2694,"num_write":1952,"num_write_kb":1782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500800,"num_omap_keys":1132,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.219597+0000","last_change":"2024-09-12T00:39:03.219544+0000","last_active":"2024-09-12T00:39:03.219597+0000","last_peered":"2024-09-12T00:39:03.219597+0000","last_clean":"2024-09-12T00:39:03.219597+0000","last_became_active":"2024-09-12T00:02:05.167998+0000","last_became_peered":"2024-09-12T00:02:05.167998+0000","last_unstale":"2024-09-12T00:39:03.219597+0000","last_undegraded":"2024-09-12T00:39:03.219597+0000","last_fullsized":"2024-09-12T00:39:03.219597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:03.219425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:03.219425+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.219425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.818422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'164","reported_seq":655,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.802847+0000","last_change":"2024-09-12T00:39:19.802847+0000","last_active":"2024-09-12T00:39:19.802847+0000","last_peered":"2024-09-12T00:39:19.802847+0000","last_clean":"2024-09-12T00:39:19.802847+0000","last_became_active":"2024-09-12T00:02:07.168005+0000","last_became_peered":"2024-09-12T00:02:07.168005+0000","last_unstale":"2024-09-12T00:39:19.802847+0000","last_undegraded":"2024-09-12T00:39:19.802847+0000","last_fullsized":"2024-09-12T00:39:19.802847+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'164","last_scrub_stamp":"2024-09-12T00:39:19.802748+0000","last_deep_scrub":"261'164","last_deep_scrub_stamp":"2024-09-12T00:39:19.802748+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.802748+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:04.761071+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":133,"num_write":373,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'349","reported_seq":1002,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.984748+0000","last_change":"2024-09-12T00:38:52.984694+0000","last_active":"2024-09-12T00:38:52.984748+0000","last_peered":"2024-09-12T00:38:52.984748+0000","last_clean":"2024-09-12T00:38:52.984748+0000","last_became_active":"2024-09-12T00:01:59.137020+0000","last_became_peered":"2024-09-12T00:01:59.137020+0000","last_unstale":"2024-09-12T00:38:52.984748+0000","last_undegraded":"2024-09-12T00:38:52.984748+0000","last_fullsized":"2024-09-12T00:38:52.984748+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T00:38:52.984578+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T00:38:52.984578+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.984578+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:32.899963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1524,"num_read_kb":1224,"num_write":576,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'301","reported_seq":915,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.140047+0000","last_change":"2024-09-12T00:38:45.139945+0000","last_active":"2024-09-12T00:38:45.140047+0000","last_peered":"2024-09-12T00:38:45.140047+0000","last_clean":"2024-09-12T00:38:45.140047+0000","last_became_active":"2024-09-12T00:01:57.152021+0000","last_became_peered":"2024-09-12T00:01:57.152021+0000","last_unstale":"2024-09-12T00:38:45.140047+0000","last_undegraded":"2024-09-12T00:38:45.140047+0000","last_fullsized":"2024-09-12T00:38:45.140047+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'301","last_scrub_stamp":"2024-09-12T00:38:45.139770+0000","last_deep_scrub":"261'301","last_deep_scrub_stamp":"2024-09-12T00:38:45.139770+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.139770+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:52.526654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288035,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":437,"num_read_kb":13162,"num_write":956,"num_write_kb":28256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.293031+0000","last_change":"2024-09-12T00:38:46.292979+0000","last_active":"2024-09-12T00:38:46.293031+0000","last_peered":"2024-09-12T00:38:46.293031+0000","last_clean":"2024-09-12T00:38:46.293031+0000","last_became_active":"2024-09-12T00:01:46.505315+0000","last_became_peered":"2024-09-12T00:01:46.505315+0000","last_unstale":"2024-09-12T00:38:46.293031+0000","last_undegraded":"2024-09-12T00:38:46.293031+0000","last_fullsized":"2024-09-12T00:38:46.293031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:46.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:46.292895+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:49.074578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079890600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.350411+0000","last_change":"2024-09-12T00:38:59.350339+0000","last_active":"2024-09-12T00:38:59.350411+0000","last_peered":"2024-09-12T00:38:59.350411+0000","last_clean":"2024-09-12T00:38:59.350411+0000","last_became_active":"2024-09-12T00:02:01.148650+0000","last_became_peered":"2024-09-12T00:02:01.148650+0000","last_unstale":"2024-09-12T00:38:59.350411+0000","last_undegraded":"2024-09-12T00:38:59.350411+0000","last_fullsized":"2024-09-12T00:38:59.350411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.350248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.350248+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.350248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:16.730657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'171","reported_seq":725,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.977358+0000","last_change":"2024-09-12T00:39:02.977304+0000","last_active":"2024-09-12T00:39:02.977358+0000","last_peered":"2024-09-12T00:39:02.977358+0000","last_clean":"2024-09-12T00:39:02.977358+0000","last_became_active":"2024-09-12T00:02:03.153640+0000","last_became_peered":"2024-09-12T00:02:03.153640+0000","last_unstale":"2024-09-12T00:39:02.977358+0000","last_undegraded":"2024-09-12T00:39:02.977358+0000","last_fullsized":"2024-09-12T00:39:02.977358+0000","mapping_epoch":30,"log_start":"258'100","ondisk_log_start":"258'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'171","last_scrub_stamp":"2024-09-12T00:39:02.977209+0000","last_deep_scrub":"261'171","last_deep_scrub_stamp":"2024-09-12T00:39:02.977209+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.977209+0000","objects_scrubbed":9,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:04.239995+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":206,"num_read_kb":198,"num_write":166,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'775","reported_seq":2516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.457205+0000","last_change":"2024-09-12T00:39:04.457205+0000","last_active":"2024-09-12T00:39:04.457205+0000","last_peered":"2024-09-12T00:39:04.457205+0000","last_clean":"2024-09-12T00:39:04.457205+0000","last_became_active":"2024-09-12T00:02:05.163720+0000","last_became_peered":"2024-09-12T00:02:05.163720+0000","last_unstale":"2024-09-12T00:39:04.457205+0000","last_undegraded":"2024-09-12T00:39:04.457205+0000","last_fullsized":"2024-09-12T00:39:04.457205+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'775","last_scrub_stamp":"2024-09-12T00:39:04.457118+0000","last_deep_scrub":"261'775","last_deep_scrub_stamp":"2024-09-12T00:39:04.457118+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.457118+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:32.148688+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'126","reported_seq":630,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.987695+0000","last_change":"2024-09-12T00:39:08.987695+0000","last_active":"2024-09-12T00:39:08.987695+0000","last_peered":"2024-09-12T00:39:08.987695+0000","last_clean":"2024-09-12T00:39:08.987695+0000","last_became_active":"2024-09-12T00:02:07.167797+0000","last_became_peered":"2024-09-12T00:02:07.167797+0000","last_unstale":"2024-09-12T00:39:08.987695+0000","last_undegraded":"2024-09-12T00:39:08.987695+0000","last_fullsized":"2024-09-12T00:39:08.987695+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'126","last_scrub_stamp":"2024-09-12T00:39:08.987597+0000","last_deep_scrub":"261'126","last_deep_scrub_stamp":"2024-09-12T00:39:08.987597+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.987597+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:50.893548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":159,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'140","reported_seq":733,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.505700+0000","last_change":"2024-09-12T00:38:56.505700+0000","last_active":"2024-09-12T00:38:56.505700+0000","last_peered":"2024-09-12T00:38:56.505700+0000","last_clean":"2024-09-12T00:38:56.505700+0000","last_became_active":"2024-09-12T00:01:59.155117+0000","last_became_peered":"2024-09-12T00:01:59.155117+0000","last_unstale":"2024-09-12T00:38:56.505700+0000","last_undegraded":"2024-09-12T00:38:56.505700+0000","last_fullsized":"2024-09-12T00:38:56.505700+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'140","last_scrub_stamp":"2024-09-12T00:38:56.505585+0000","last_deep_scrub":"261'140","last_deep_scrub_stamp":"2024-09-12T00:38:56.505585+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.505585+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:27.206689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":474,"num_write":223,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'363","reported_seq":1032,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.665051+0000","last_change":"2024-09-12T00:38:44.664927+0000","last_active":"2024-09-12T00:38:44.665051+0000","last_peered":"2024-09-12T00:38:44.665051+0000","last_clean":"2024-09-12T00:38:44.665051+0000","last_became_active":"2024-09-12T00:01:57.134235+0000","last_became_peered":"2024-09-12T00:01:57.134235+0000","last_unstale":"2024-09-12T00:38:44.665051+0000","last_undegraded":"2024-09-12T00:38:44.665051+0000","last_fullsized":"2024-09-12T00:38:44.665051+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'363","last_scrub_stamp":"2024-09-12T00:38:44.664703+0000","last_deep_scrub":"261'363","last_deep_scrub_stamp":"2024-09-12T00:38:44.664703+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.664703+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:21.197836+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":525,"num_read_kb":31500,"num_write":1186,"num_write_kb":36639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":522,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.616652+0000","last_change":"2024-09-12T00:38:43.616652+0000","last_active":"2024-09-12T00:38:43.616652+0000","last_peered":"2024-09-12T00:38:43.616652+0000","last_clean":"2024-09-12T00:38:43.616652+0000","last_became_active":"2024-09-12T00:01:46.508144+0000","last_became_peered":"2024-09-12T00:01:46.508144+0000","last_unstale":"2024-09-12T00:38:43.616652+0000","last_undegraded":"2024-09-12T00:38:43.616652+0000","last_fullsized":"2024-09-12T00:38:43.616652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:43.616556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:43.616556+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.616556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:21.006725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045024799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.192924+0000","last_change":"2024-09-12T00:39:04.192851+0000","last_active":"2024-09-12T00:39:04.192924+0000","last_peered":"2024-09-12T00:39:04.192924+0000","last_clean":"2024-09-12T00:39:04.192924+0000","last_became_active":"2024-09-12T00:02:01.153207+0000","last_became_peered":"2024-09-12T00:02:01.153207+0000","last_unstale":"2024-09-12T00:39:04.192924+0000","last_undegraded":"2024-09-12T00:39:04.192924+0000","last_fullsized":"2024-09-12T00:39:04.192924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:04.192765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:04.192765+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.192765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:13.276069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'113","reported_seq":646,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.218959+0000","last_change":"2024-09-12T00:39:15.218869+0000","last_active":"2024-09-12T00:39:15.218959+0000","last_peered":"2024-09-12T00:39:15.218959+0000","last_clean":"2024-09-12T00:39:15.218959+0000","last_became_active":"2024-09-12T00:02:03.151029+0000","last_became_peered":"2024-09-12T00:02:03.151029+0000","last_unstale":"2024-09-12T00:39:15.218959+0000","last_undegraded":"2024-09-12T00:39:15.218959+0000","last_fullsized":"2024-09-12T00:39:15.218959+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'113","last_scrub_stamp":"2024-09-12T00:39:15.218665+0000","last_deep_scrub":"261'113","last_deep_scrub_stamp":"2024-09-12T00:39:15.218665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.218665+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:05.358020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":125,"num_read_kb":114,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'783","reported_seq":4569,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.721640+0000","last_change":"2024-09-12T00:39:11.721571+0000","last_active":"2024-09-12T00:39:11.721640+0000","last_peered":"2024-09-12T00:39:11.721640+0000","last_clean":"2024-09-12T00:39:11.721640+0000","last_became_active":"2024-09-12T00:02:05.162687+0000","last_became_peered":"2024-09-12T00:02:05.162687+0000","last_unstale":"2024-09-12T00:39:11.721640+0000","last_undegraded":"2024-09-12T00:39:11.721640+0000","last_fullsized":"2024-09-12T00:39:11.721640+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'783","last_scrub_stamp":"2024-09-12T00:39:11.721483+0000","last_deep_scrub":"261'783","last_deep_scrub_stamp":"2024-09-12T00:39:11.721483+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.721483+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:21.670225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'160","reported_seq":670,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.839184+0000","last_change":"2024-09-12T00:39:18.839184+0000","last_active":"2024-09-12T00:39:18.839184+0000","last_peered":"2024-09-12T00:39:18.839184+0000","last_clean":"2024-09-12T00:39:18.839184+0000","last_became_active":"2024-09-12T00:02:07.166471+0000","last_became_peered":"2024-09-12T00:02:07.166471+0000","last_unstale":"2024-09-12T00:39:18.839184+0000","last_undegraded":"2024-09-12T00:39:18.839184+0000","last_fullsized":"2024-09-12T00:39:18.839184+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'160","last_scrub_stamp":"2024-09-12T00:39:18.839083+0000","last_deep_scrub":"261'160","last_deep_scrub_stamp":"2024-09-12T00:39:18.839083+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.839083+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:11.339915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":126,"num_write":337,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'82","reported_seq":648,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.050381+0000","last_change":"2024-09-12T00:38:50.050312+0000","last_active":"2024-09-12T00:38:50.050381+0000","last_peered":"2024-09-12T00:38:50.050381+0000","last_clean":"2024-09-12T00:38:50.050381+0000","last_became_active":"2024-09-12T00:01:59.157044+0000","last_became_peered":"2024-09-12T00:01:59.157044+0000","last_unstale":"2024-09-12T00:38:50.050381+0000","last_undegraded":"2024-09-12T00:38:50.050381+0000","last_fullsized":"2024-09-12T00:38:50.050381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'82","last_scrub_stamp":"2024-09-12T00:38:50.050227+0000","last_deep_scrub":"261'82","last_deep_scrub_stamp":"2024-09-12T00:38:50.050227+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.050227+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:56.828569+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":122,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'433","reported_seq":1076,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.511299+0000","last_change":"2024-09-12T00:38:51.511299+0000","last_active":"2024-09-12T00:38:51.511299+0000","last_peered":"2024-09-12T00:38:51.511299+0000","last_clean":"2024-09-12T00:38:51.511299+0000","last_became_active":"2024-09-12T00:01:57.134646+0000","last_became_peered":"2024-09-12T00:01:57.134646+0000","last_unstale":"2024-09-12T00:38:51.511299+0000","last_undegraded":"2024-09-12T00:38:51.511299+0000","last_fullsized":"2024-09-12T00:38:51.511299+0000","mapping_epoch":24,"log_start":"261'400","ondisk_log_start":"261'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-12T00:38:51.511171+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-12T00:38:51.511171+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.511171+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:11.090003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":740,"num_read_kb":1717,"num_write":1248,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.334916+0000","last_change":"2024-09-12T00:38:47.334916+0000","last_active":"2024-09-12T00:38:47.334916+0000","last_peered":"2024-09-12T00:38:47.334916+0000","last_clean":"2024-09-12T00:38:47.334916+0000","last_became_active":"2024-09-12T00:01:46.502847+0000","last_became_peered":"2024-09-12T00:01:46.502847+0000","last_unstale":"2024-09-12T00:38:47.334916+0000","last_undegraded":"2024-09-12T00:38:47.334916+0000","last_fullsized":"2024-09-12T00:38:47.334916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:47.334821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:47.334821+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.334821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:23.467970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.585235+0000","last_change":"2024-09-12T00:38:59.585235+0000","last_active":"2024-09-12T00:38:59.585235+0000","last_peered":"2024-09-12T00:38:59.585235+0000","last_clean":"2024-09-12T00:38:59.585235+0000","last_became_active":"2024-09-12T00:02:01.152467+0000","last_became_peered":"2024-09-12T00:02:01.152467+0000","last_unstale":"2024-09-12T00:38:59.585235+0000","last_undegraded":"2024-09-12T00:38:59.585235+0000","last_fullsized":"2024-09-12T00:38:59.585235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.585108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.585108+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.585108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:47.921762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'755","reported_seq":1477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.334414+0000","last_change":"2024-09-12T00:39:01.334341+0000","last_active":"2024-09-12T00:39:01.334414+0000","last_peered":"2024-09-12T00:39:01.334414+0000","last_clean":"2024-09-12T00:39:01.334414+0000","last_became_active":"2024-09-12T00:02:03.151140+0000","last_became_peered":"2024-09-12T00:02:03.151140+0000","last_unstale":"2024-09-12T00:39:01.334414+0000","last_undegraded":"2024-09-12T00:39:01.334414+0000","last_fullsized":"2024-09-12T00:39:01.334414+0000","mapping_epoch":30,"log_start":"261'700","ondisk_log_start":"261'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'755","last_scrub_stamp":"2024-09-12T00:39:01.334248+0000","last_deep_scrub":"261'755","last_deep_scrub_stamp":"2024-09-12T00:39:01.334248+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.334248+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:13.575310+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136648,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1342,"num_read_kb":3221,"num_write":1108,"num_write_kb":930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.706424+0000","last_change":"2024-09-12T00:39:14.706319+0000","last_active":"2024-09-12T00:39:14.706424+0000","last_peered":"2024-09-12T00:39:14.706424+0000","last_clean":"2024-09-12T00:39:14.706424+0000","last_became_active":"2024-09-12T00:02:05.168419+0000","last_became_peered":"2024-09-12T00:02:05.168419+0000","last_unstale":"2024-09-12T00:39:14.706424+0000","last_undegraded":"2024-09-12T00:39:14.706424+0000","last_fullsized":"2024-09-12T00:39:14.706424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:14.706224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:14.706224+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.706224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:02.583767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'143","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.153063+0000","last_change":"2024-09-12T00:39:07.153063+0000","last_active":"2024-09-12T00:39:07.153063+0000","last_peered":"2024-09-12T00:39:07.153063+0000","last_clean":"2024-09-12T00:39:07.153063+0000","last_became_active":"2024-09-12T00:02:07.169937+0000","last_became_peered":"2024-09-12T00:02:07.169937+0000","last_unstale":"2024-09-12T00:39:07.153063+0000","last_undegraded":"2024-09-12T00:39:07.153063+0000","last_fullsized":"2024-09-12T00:39:07.153063+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'143","last_scrub_stamp":"2024-09-12T00:39:07.152972+0000","last_deep_scrub":"261'143","last_deep_scrub_stamp":"2024-09-12T00:39:07.152972+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.152972+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:09.115364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":184,"num_read_kb":169,"num_write":343,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'134","reported_seq":688,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.680272+0000","last_change":"2024-09-12T00:39:19.680171+0000","last_active":"2024-09-12T00:39:19.680272+0000","last_peered":"2024-09-12T00:39:19.680272+0000","last_clean":"2024-09-12T00:39:19.680272+0000","last_became_active":"2024-09-12T00:02:07.173094+0000","last_became_peered":"2024-09-12T00:02:07.173094+0000","last_unstale":"2024-09-12T00:39:19.680272+0000","last_undegraded":"2024-09-12T00:39:19.680272+0000","last_fullsized":"2024-09-12T00:39:19.680272+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'134","last_scrub_stamp":"2024-09-12T00:39:19.680058+0000","last_deep_scrub":"261'134","last_deep_scrub_stamp":"2024-09-12T00:39:19.680058+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.680058+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:25.672209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":191,"num_read_kb":191,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'183","reported_seq":780,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.104367+0000","last_change":"2024-09-12T00:38:53.104304+0000","last_active":"2024-09-12T00:38:53.104367+0000","last_peered":"2024-09-12T00:38:53.104367+0000","last_clean":"2024-09-12T00:38:53.104367+0000","last_became_active":"2024-09-12T00:01:59.154463+0000","last_became_peered":"2024-09-12T00:01:59.154463+0000","last_unstale":"2024-09-12T00:38:53.104367+0000","last_undegraded":"2024-09-12T00:38:53.104367+0000","last_fullsized":"2024-09-12T00:38:53.104367+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'183","last_scrub_stamp":"2024-09-12T00:38:53.104215+0000","last_deep_scrub":"261'183","last_deep_scrub_stamp":"2024-09-12T00:38:53.104215+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.104215+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:44.019441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":794,"num_read_kb":651,"num_write":258,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'344","reported_seq":989,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.246016+0000","last_change":"2024-09-12T00:38:53.245956+0000","last_active":"2024-09-12T00:38:53.246016+0000","last_peered":"2024-09-12T00:38:53.246016+0000","last_clean":"2024-09-12T00:38:53.246016+0000","last_became_active":"2024-09-12T00:01:57.163847+0000","last_became_peered":"2024-09-12T00:01:57.163847+0000","last_unstale":"2024-09-12T00:38:53.246016+0000","last_undegraded":"2024-09-12T00:38:53.246016+0000","last_fullsized":"2024-09-12T00:38:53.246016+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'344","last_scrub_stamp":"2024-09-12T00:38:53.245846+0000","last_deep_scrub":"261'344","last_deep_scrub_stamp":"2024-09-12T00:38:53.245846+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.245846+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:07.900488+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291524,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":515,"num_read_kb":27216,"num_write":1109,"num_write_kb":33935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.933276+0000","last_change":"2024-09-12T00:39:00.933189+0000","last_active":"2024-09-12T00:39:00.933276+0000","last_peered":"2024-09-12T00:39:00.933276+0000","last_clean":"2024-09-12T00:39:00.933276+0000","last_became_active":"2024-09-12T00:02:01.144579+0000","last_became_peered":"2024-09-12T00:02:01.144579+0000","last_unstale":"2024-09-12T00:39:00.933276+0000","last_undegraded":"2024-09-12T00:39:00.933276+0000","last_fullsized":"2024-09-12T00:39:00.933276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:00.933071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:00.933071+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.933071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:49.735936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'301","reported_seq":870,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.984892+0000","last_change":"2024-09-12T00:39:04.984786+0000","last_active":"2024-09-12T00:39:04.984892+0000","last_peered":"2024-09-12T00:39:04.984892+0000","last_clean":"2024-09-12T00:39:04.984892+0000","last_became_active":"2024-09-12T00:02:03.154710+0000","last_became_peered":"2024-09-12T00:02:03.154710+0000","last_unstale":"2024-09-12T00:39:04.984892+0000","last_undegraded":"2024-09-12T00:39:04.984892+0000","last_fullsized":"2024-09-12T00:39:04.984892+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'301","last_scrub_stamp":"2024-09-12T00:39:04.984680+0000","last_deep_scrub":"261'301","last_deep_scrub_stamp":"2024-09-12T00:39:04.984680+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.984680+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:02.248554+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46247,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":469,"num_read_kb":1061,"num_write":388,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.953824+0000","last_change":"2024-09-12T00:39:03.953737+0000","last_active":"2024-09-12T00:39:03.953824+0000","last_peered":"2024-09-12T00:39:03.953824+0000","last_clean":"2024-09-12T00:39:03.953824+0000","last_became_active":"2024-09-12T00:02:05.163389+0000","last_became_peered":"2024-09-12T00:02:05.163389+0000","last_unstale":"2024-09-12T00:39:03.953824+0000","last_undegraded":"2024-09-12T00:39:03.953824+0000","last_fullsized":"2024-09-12T00:39:03.953824+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:03.953638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:03.953638+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.953638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:00.527480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'118","reported_seq":601,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.938839+0000","last_change":"2024-09-12T00:39:09.938839+0000","last_active":"2024-09-12T00:39:09.938839+0000","last_peered":"2024-09-12T00:39:09.938839+0000","last_clean":"2024-09-12T00:39:09.938839+0000","last_became_active":"2024-09-12T00:02:07.172360+0000","last_became_peered":"2024-09-12T00:02:07.172360+0000","last_unstale":"2024-09-12T00:39:09.938839+0000","last_undegraded":"2024-09-12T00:39:09.938839+0000","last_fullsized":"2024-09-12T00:39:09.938839+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'118","last_scrub_stamp":"2024-09-12T00:39:09.938737+0000","last_deep_scrub":"261'118","last_deep_scrub_stamp":"2024-09-12T00:39:09.938737+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.938737+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:26.730532+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'116","reported_seq":724,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.464113+0000","last_change":"2024-09-12T00:38:53.463997+0000","last_active":"2024-09-12T00:38:53.464113+0000","last_peered":"2024-09-12T00:38:53.464113+0000","last_clean":"2024-09-12T00:38:53.464113+0000","last_became_active":"2024-09-12T00:01:59.155287+0000","last_became_peered":"2024-09-12T00:01:59.155287+0000","last_unstale":"2024-09-12T00:38:53.464113+0000","last_undegraded":"2024-09-12T00:38:53.464113+0000","last_fullsized":"2024-09-12T00:38:53.464113+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'116","last_scrub_stamp":"2024-09-12T00:38:53.463870+0000","last_deep_scrub":"261'116","last_deep_scrub_stamp":"2024-09-12T00:38:53.463870+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.463870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:51.953337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":525,"num_read_kb":443,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'336","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.145933+0000","last_change":"2024-09-12T00:38:44.145933+0000","last_active":"2024-09-12T00:38:44.145933+0000","last_peered":"2024-09-12T00:38:44.145933+0000","last_clean":"2024-09-12T00:38:44.145933+0000","last_became_active":"2024-09-12T00:01:57.144743+0000","last_became_peered":"2024-09-12T00:01:57.144743+0000","last_unstale":"2024-09-12T00:38:44.145933+0000","last_undegraded":"2024-09-12T00:38:44.145933+0000","last_fullsized":"2024-09-12T00:38:44.145933+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'336","last_scrub_stamp":"2024-09-12T00:38:44.145810+0000","last_deep_scrub":"261'336","last_deep_scrub_stamp":"2024-09-12T00:38:44.145810+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.145810+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:50.608602+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":7939,"num_write":1030,"num_write_kb":13946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.613371+0000","last_change":"2024-09-12T00:39:04.613308+0000","last_active":"2024-09-12T00:39:04.613371+0000","last_peered":"2024-09-12T00:39:04.613371+0000","last_clean":"2024-09-12T00:39:04.613371+0000","last_became_active":"2024-09-12T00:02:01.150857+0000","last_became_peered":"2024-09-12T00:02:01.150857+0000","last_unstale":"2024-09-12T00:39:04.613371+0000","last_undegraded":"2024-09-12T00:39:04.613371+0000","last_fullsized":"2024-09-12T00:39:04.613371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:04.613218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:04.613218+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.613218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:32.659843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'44","reported_seq":546,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.773124+0000","last_change":"2024-09-12T00:39:08.773044+0000","last_active":"2024-09-12T00:39:08.773124+0000","last_peered":"2024-09-12T00:39:08.773124+0000","last_clean":"2024-09-12T00:39:08.773124+0000","last_became_active":"2024-09-12T00:02:03.149558+0000","last_became_peered":"2024-09-12T00:02:03.149558+0000","last_unstale":"2024-09-12T00:39:08.773124+0000","last_undegraded":"2024-09-12T00:39:08.773124+0000","last_fullsized":"2024-09-12T00:39:08.773124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'44","last_scrub_stamp":"2024-09-12T00:39:08.772942+0000","last_deep_scrub":"261'44","last_deep_scrub_stamp":"2024-09-12T00:39:08.772942+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.772942+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:11.724806+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.142589+0000","last_change":"2024-09-12T00:39:08.142463+0000","last_active":"2024-09-12T00:39:08.142589+0000","last_peered":"2024-09-12T00:39:08.142589+0000","last_clean":"2024-09-12T00:39:08.142589+0000","last_became_active":"2024-09-12T00:02:05.170836+0000","last_became_peered":"2024-09-12T00:02:05.170836+0000","last_unstale":"2024-09-12T00:39:08.142589+0000","last_undegraded":"2024-09-12T00:39:08.142589+0000","last_fullsized":"2024-09-12T00:39:08.142589+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:08.142365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:08.142365+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.142365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:14.885052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'260","reported_seq":787,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.004226+0000","last_change":"2024-09-12T00:39:13.004131+0000","last_active":"2024-09-12T00:39:13.004226+0000","last_peered":"2024-09-12T00:39:13.004226+0000","last_clean":"2024-09-12T00:39:13.004226+0000","last_became_active":"2024-09-12T00:02:07.168678+0000","last_became_peered":"2024-09-12T00:02:07.168678+0000","last_unstale":"2024-09-12T00:39:13.004226+0000","last_undegraded":"2024-09-12T00:39:13.004226+0000","last_fullsized":"2024-09-12T00:39:13.004226+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'260","last_scrub_stamp":"2024-09-12T00:39:13.004011+0000","last_deep_scrub":"261'260","last_deep_scrub_stamp":"2024-09-12T00:39:13.004011+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.004011+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:28.806126+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":392,"num_read_kb":368,"num_write":602,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'4088","reported_seq":4647,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.470038+0000","last_change":"2024-09-12T00:38:52.469941+0000","last_active":"2024-09-12T00:38:52.470038+0000","last_peered":"2024-09-12T00:38:52.470038+0000","last_clean":"2024-09-12T00:38:52.470038+0000","last_became_active":"2024-09-12T00:01:59.154260+0000","last_became_peered":"2024-09-12T00:01:59.154260+0000","last_unstale":"2024-09-12T00:38:52.470038+0000","last_undegraded":"2024-09-12T00:38:52.470038+0000","last_fullsized":"2024-09-12T00:38:52.470038+0000","mapping_epoch":26,"log_start":"261'4000","ondisk_log_start":"261'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4088","last_scrub_stamp":"2024-09-12T00:38:52.469853+0000","last_deep_scrub":"261'4088","last_deep_scrub_stamp":"2024-09-12T00:38:52.469853+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.469853+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:37.050318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16394,"num_read_kb":13744,"num_write":6133,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'298","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.977235+0000","last_change":"2024-09-12T00:38:44.977235+0000","last_active":"2024-09-12T00:38:44.977235+0000","last_peered":"2024-09-12T00:38:44.977235+0000","last_clean":"2024-09-12T00:38:44.977235+0000","last_became_active":"2024-09-12T00:01:57.158677+0000","last_became_peered":"2024-09-12T00:01:57.158677+0000","last_unstale":"2024-09-12T00:38:44.977235+0000","last_undegraded":"2024-09-12T00:38:44.977235+0000","last_fullsized":"2024-09-12T00:38:44.977235+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'298","last_scrub_stamp":"2024-09-12T00:38:44.977107+0000","last_deep_scrub":"261'298","last_deep_scrub_stamp":"2024-09-12T00:38:44.977107+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.977107+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:41.638070+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174545,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":398,"num_read_kb":56505,"num_write":935,"num_write_kb":31346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.205696+0000","last_change":"2024-09-12T00:38:58.205604+0000","last_active":"2024-09-12T00:38:58.205696+0000","last_peered":"2024-09-12T00:38:58.205696+0000","last_clean":"2024-09-12T00:38:58.205696+0000","last_became_active":"2024-09-12T00:02:01.155490+0000","last_became_peered":"2024-09-12T00:02:01.155490+0000","last_unstale":"2024-09-12T00:38:58.205696+0000","last_undegraded":"2024-09-12T00:38:58.205696+0000","last_fullsized":"2024-09-12T00:38:58.205696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:58.205501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:58.205501+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.205501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:52.049489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'288","reported_seq":864,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.896792+0000","last_change":"2024-09-12T00:39:00.896733+0000","last_active":"2024-09-12T00:39:00.896792+0000","last_peered":"2024-09-12T00:39:00.896792+0000","last_clean":"2024-09-12T00:39:00.896792+0000","last_became_active":"2024-09-12T00:02:03.148690+0000","last_became_peered":"2024-09-12T00:02:03.148690+0000","last_unstale":"2024-09-12T00:39:00.896792+0000","last_undegraded":"2024-09-12T00:39:00.896792+0000","last_fullsized":"2024-09-12T00:39:00.896792+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'288","last_scrub_stamp":"2024-09-12T00:39:00.896639+0000","last_deep_scrub":"261'288","last_deep_scrub_stamp":"2024-09-12T00:39:00.896639+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.896639+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:17.219963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45068,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1019,"num_write":374,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.367809+0000","last_change":"2024-09-12T00:39:16.367739+0000","last_active":"2024-09-12T00:39:16.367809+0000","last_peered":"2024-09-12T00:39:16.367809+0000","last_clean":"2024-09-12T00:39:16.367809+0000","last_became_active":"2024-09-12T00:02:05.168232+0000","last_became_peered":"2024-09-12T00:02:05.168232+0000","last_unstale":"2024-09-12T00:39:16.367809+0000","last_undegraded":"2024-09-12T00:39:16.367809+0000","last_fullsized":"2024-09-12T00:39:16.367809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.367631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.367631+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.367631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:41.610148+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'137","reported_seq":679,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:28.987181+0000","last_change":"2024-09-12T00:39:28.987118+0000","last_active":"2024-09-12T00:39:28.987181+0000","last_peered":"2024-09-12T00:39:28.987181+0000","last_clean":"2024-09-12T00:39:28.987181+0000","last_became_active":"2024-09-12T00:02:07.168747+0000","last_became_peered":"2024-09-12T00:02:07.168747+0000","last_unstale":"2024-09-12T00:39:28.987181+0000","last_undegraded":"2024-09-12T00:39:28.987181+0000","last_fullsized":"2024-09-12T00:39:28.987181+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'137","last_scrub_stamp":"2024-09-12T00:39:28.987021+0000","last_deep_scrub":"261'137","last_deep_scrub_stamp":"2024-09-12T00:39:28.987021+0000","last_clean_scrub_stamp":"2024-09-12T00:39:28.987021+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:31.252410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":291,"num_read_kb":255,"num_write":337,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'104","reported_seq":682,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.791782+0000","last_change":"2024-09-12T00:38:49.791694+0000","last_active":"2024-09-12T00:38:49.791782+0000","last_peered":"2024-09-12T00:38:49.791782+0000","last_clean":"2024-09-12T00:38:49.791782+0000","last_became_active":"2024-09-12T00:01:59.154848+0000","last_became_peered":"2024-09-12T00:01:59.154848+0000","last_unstale":"2024-09-12T00:38:49.791782+0000","last_undegraded":"2024-09-12T00:38:49.791782+0000","last_fullsized":"2024-09-12T00:38:49.791782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'104","last_scrub_stamp":"2024-09-12T00:38:49.791355+0000","last_deep_scrub":"261'104","last_deep_scrub_stamp":"2024-09-12T00:38:49.791355+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.791355+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:55.148174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":392,"num_write":152,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'307","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.779506+0000","last_change":"2024-09-12T00:38:45.779506+0000","last_active":"2024-09-12T00:38:45.779506+0000","last_peered":"2024-09-12T00:38:45.779506+0000","last_clean":"2024-09-12T00:38:45.779506+0000","last_became_active":"2024-09-12T00:01:57.142385+0000","last_became_peered":"2024-09-12T00:01:57.142385+0000","last_unstale":"2024-09-12T00:38:45.779506+0000","last_undegraded":"2024-09-12T00:38:45.779506+0000","last_fullsized":"2024-09-12T00:38:45.779506+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'307","last_scrub_stamp":"2024-09-12T00:38:45.779328+0000","last_deep_scrub":"261'307","last_deep_scrub_stamp":"2024-09-12T00:38:45.779328+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.779328+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:38.402035+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267376,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":608,"num_read_kb":9162,"num_write":1027,"num_write_kb":16984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.264896+0000","last_change":"2024-09-12T00:39:09.264827+0000","last_active":"2024-09-12T00:39:09.264896+0000","last_peered":"2024-09-12T00:39:09.264896+0000","last_clean":"2024-09-12T00:39:09.264896+0000","last_became_active":"2024-09-12T00:02:01.153906+0000","last_became_peered":"2024-09-12T00:02:01.153906+0000","last_unstale":"2024-09-12T00:39:09.264896+0000","last_undegraded":"2024-09-12T00:39:09.264896+0000","last_fullsized":"2024-09-12T00:39:09.264896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:09.264735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:09.264735+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.264735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:09.765221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'252","reported_seq":820,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.318052+0000","last_change":"2024-09-12T00:39:04.317979+0000","last_active":"2024-09-12T00:39:04.318052+0000","last_peered":"2024-09-12T00:39:04.318052+0000","last_clean":"2024-09-12T00:39:04.318052+0000","last_became_active":"2024-09-12T00:02:03.154896+0000","last_became_peered":"2024-09-12T00:02:03.154896+0000","last_unstale":"2024-09-12T00:39:04.318052+0000","last_undegraded":"2024-09-12T00:39:04.318052+0000","last_fullsized":"2024-09-12T00:39:04.318052+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'252","last_scrub_stamp":"2024-09-12T00:39:04.317880+0000","last_deep_scrub":"261'252","last_deep_scrub_stamp":"2024-09-12T00:39:04.317880+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.317880+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:18.759091+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":962,"num_write":334,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.944979+0000","last_change":"2024-09-12T00:39:04.944929+0000","last_active":"2024-09-12T00:39:04.944979+0000","last_peered":"2024-09-12T00:39:04.944979+0000","last_clean":"2024-09-12T00:39:04.944979+0000","last_became_active":"2024-09-12T00:02:05.162204+0000","last_became_peered":"2024-09-12T00:02:05.162204+0000","last_unstale":"2024-09-12T00:39:04.944979+0000","last_undegraded":"2024-09-12T00:39:04.944979+0000","last_fullsized":"2024-09-12T00:39:04.944979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:04.944845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:04.944845+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.944845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:13.193383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'126","reported_seq":688,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.158584+0000","last_change":"2024-09-12T00:39:00.158511+0000","last_active":"2024-09-12T00:39:00.158584+0000","last_peered":"2024-09-12T00:39:00.158584+0000","last_clean":"2024-09-12T00:39:00.158584+0000","last_became_active":"2024-09-12T00:01:59.145456+0000","last_became_peered":"2024-09-12T00:01:59.145456+0000","last_unstale":"2024-09-12T00:39:00.158584+0000","last_undegraded":"2024-09-12T00:39:00.158584+0000","last_fullsized":"2024-09-12T00:39:00.158584+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'126","last_scrub_stamp":"2024-09-12T00:39:00.158426+0000","last_deep_scrub":"261'126","last_deep_scrub_stamp":"2024-09-12T00:39:00.158426+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.158426+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:15.829990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":512,"num_read_kb":415,"num_write":196,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'379","reported_seq":1018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.785930+0000","last_change":"2024-09-12T00:38:47.785930+0000","last_active":"2024-09-12T00:38:47.785930+0000","last_peered":"2024-09-12T00:38:47.785930+0000","last_clean":"2024-09-12T00:38:47.785930+0000","last_became_active":"2024-09-12T00:01:57.143684+0000","last_became_peered":"2024-09-12T00:01:57.143684+0000","last_unstale":"2024-09-12T00:38:47.785930+0000","last_undegraded":"2024-09-12T00:38:47.785930+0000","last_fullsized":"2024-09-12T00:38:47.785930+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'379","last_scrub_stamp":"2024-09-12T00:38:47.785711+0000","last_deep_scrub":"261'379","last_deep_scrub_stamp":"2024-09-12T00:38:47.785711+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.785711+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:31.165040+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":509,"num_read_kb":22065,"num_write":1209,"num_write_kb":32922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.933001+0000","last_change":"2024-09-12T00:39:01.933001+0000","last_active":"2024-09-12T00:39:01.933001+0000","last_peered":"2024-09-12T00:39:01.933001+0000","last_clean":"2024-09-12T00:39:01.933001+0000","last_became_active":"2024-09-12T00:02:01.154541+0000","last_became_peered":"2024-09-12T00:02:01.154541+0000","last_unstale":"2024-09-12T00:39:01.933001+0000","last_undegraded":"2024-09-12T00:39:01.933001+0000","last_fullsized":"2024-09-12T00:39:01.933001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:01.932891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:01.932891+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.932891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:16.732784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'496","reported_seq":1121,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.005276+0000","last_change":"2024-09-12T00:39:07.005218+0000","last_active":"2024-09-12T00:39:07.005276+0000","last_peered":"2024-09-12T00:39:07.005276+0000","last_clean":"2024-09-12T00:39:07.005276+0000","last_became_active":"2024-09-12T00:02:03.158360+0000","last_became_peered":"2024-09-12T00:02:03.158360+0000","last_unstale":"2024-09-12T00:39:07.005276+0000","last_undegraded":"2024-09-12T00:39:07.005276+0000","last_fullsized":"2024-09-12T00:39:07.005276+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'496","last_scrub_stamp":"2024-09-12T00:39:07.005126+0000","last_deep_scrub":"261'496","last_deep_scrub_stamp":"2024-09-12T00:39:07.005126+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.005126+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:16.952892+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92045,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":891,"num_read_kb":2130,"num_write":768,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.203352+0000","last_change":"2024-09-12T00:39:05.203260+0000","last_active":"2024-09-12T00:39:05.203352+0000","last_peered":"2024-09-12T00:39:05.203352+0000","last_clean":"2024-09-12T00:39:05.203352+0000","last_became_active":"2024-09-12T00:02:05.167052+0000","last_became_peered":"2024-09-12T00:02:05.167052+0000","last_unstale":"2024-09-12T00:39:05.203352+0000","last_undegraded":"2024-09-12T00:39:05.203352+0000","last_fullsized":"2024-09-12T00:39:05.203352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:05.203162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:05.203162+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.203162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:33.095842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'208","reported_seq":715,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.815107+0000","last_change":"2024-09-12T00:39:20.814996+0000","last_active":"2024-09-12T00:39:20.815107+0000","last_peered":"2024-09-12T00:39:20.815107+0000","last_clean":"2024-09-12T00:39:20.815107+0000","last_became_active":"2024-09-12T00:02:07.167331+0000","last_became_peered":"2024-09-12T00:02:07.167331+0000","last_unstale":"2024-09-12T00:39:20.815107+0000","last_undegraded":"2024-09-12T00:39:20.815107+0000","last_fullsized":"2024-09-12T00:39:20.815107+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'208","last_scrub_stamp":"2024-09-12T00:39:20.814891+0000","last_deep_scrub":"261'208","last_deep_scrub_stamp":"2024-09-12T00:39:20.814891+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.814891+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:29.301110+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":483,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'399","reported_seq":1166,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.501525+0000","last_change":"2024-09-12T00:38:55.501525+0000","last_active":"2024-09-12T00:38:55.501525+0000","last_peered":"2024-09-12T00:38:55.501525+0000","last_clean":"2024-09-12T00:38:55.501525+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:38:55.501525+0000","last_undegraded":"2024-09-12T00:38:55.501525+0000","last_fullsized":"2024-09-12T00:38:55.501525+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'399","last_scrub_stamp":"2024-09-12T00:38:55.501439+0000","last_deep_scrub":"261'399","last_deep_scrub_stamp":"2024-09-12T00:38:55.501439+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.501439+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:17.884111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1910,"num_read_kb":1650,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25748,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'351","reported_seq":1035,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.618535+0000","last_change":"2024-09-12T00:38:45.618535+0000","last_active":"2024-09-12T00:38:45.618535+0000","last_peered":"2024-09-12T00:38:45.618535+0000","last_clean":"2024-09-12T00:38:45.618535+0000","last_became_active":"2024-09-12T00:01:57.141998+0000","last_became_peered":"2024-09-12T00:01:57.141998+0000","last_unstale":"2024-09-12T00:38:45.618535+0000","last_undegraded":"2024-09-12T00:38:45.618535+0000","last_fullsized":"2024-09-12T00:38:45.618535+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'351","last_scrub_stamp":"2024-09-12T00:38:45.618369+0000","last_deep_scrub":"261'351","last_deep_scrub_stamp":"2024-09-12T00:38:45.618369+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.618369+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:31.142149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":1840,"num_write":1203,"num_write_kb":17126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.213005+0000","last_change":"2024-09-12T00:39:00.212928+0000","last_active":"2024-09-12T00:39:00.213005+0000","last_peered":"2024-09-12T00:39:00.213005+0000","last_clean":"2024-09-12T00:39:00.213005+0000","last_became_active":"2024-09-12T00:02:01.153611+0000","last_became_peered":"2024-09-12T00:02:01.153611+0000","last_unstale":"2024-09-12T00:39:00.213005+0000","last_undegraded":"2024-09-12T00:39:00.213005+0000","last_fullsized":"2024-09-12T00:39:00.213005+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:00.212821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:00.212821+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.212821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:09.175487+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'292","reported_seq":865,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.196264+0000","last_change":"2024-09-12T00:39:16.196205+0000","last_active":"2024-09-12T00:39:16.196264+0000","last_peered":"2024-09-12T00:39:16.196264+0000","last_clean":"2024-09-12T00:39:16.196264+0000","last_became_active":"2024-09-12T00:02:03.154821+0000","last_became_peered":"2024-09-12T00:02:03.154821+0000","last_unstale":"2024-09-12T00:39:16.196264+0000","last_undegraded":"2024-09-12T00:39:16.196264+0000","last_fullsized":"2024-09-12T00:39:16.196264+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'292","last_scrub_stamp":"2024-09-12T00:39:16.196072+0000","last_deep_scrub":"261'292","last_deep_scrub_stamp":"2024-09-12T00:39:16.196072+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.196072+0000","objects_scrubbed":8,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:49.625222+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49647,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":1013,"num_write":386,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.742754+0000","last_change":"2024-09-12T00:39:14.742699+0000","last_active":"2024-09-12T00:39:14.742754+0000","last_peered":"2024-09-12T00:39:14.742754+0000","last_clean":"2024-09-12T00:39:14.742754+0000","last_became_active":"2024-09-12T00:02:05.169726+0000","last_became_peered":"2024-09-12T00:02:05.169726+0000","last_unstale":"2024-09-12T00:39:14.742754+0000","last_undegraded":"2024-09-12T00:39:14.742754+0000","last_fullsized":"2024-09-12T00:39:14.742754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:14.742597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:14.742597+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.742597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:05.171472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'198","reported_seq":1075,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:26.098436+0000","last_change":"2024-09-12T00:39:26.098343+0000","last_active":"2024-09-12T00:39:26.098436+0000","last_peered":"2024-09-12T00:39:26.098436+0000","last_clean":"2024-09-12T00:39:26.098436+0000","last_became_active":"2024-09-12T00:02:07.174910+0000","last_became_peered":"2024-09-12T00:02:07.174910+0000","last_unstale":"2024-09-12T00:39:26.098436+0000","last_undegraded":"2024-09-12T00:39:26.098436+0000","last_fullsized":"2024-09-12T00:39:26.098436+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'198","last_scrub_stamp":"2024-09-12T00:39:26.098228+0000","last_deep_scrub":"261'198","last_deep_scrub_stamp":"2024-09-12T00:39:26.098228+0000","last_clean_scrub_stamp":"2024-09-12T00:39:26.098228+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:10.302334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":668,"num_read_kb":649,"num_write":556,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'98","reported_seq":674,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.867687+0000","last_change":"2024-09-12T00:38:51.867630+0000","last_active":"2024-09-12T00:38:51.867687+0000","last_peered":"2024-09-12T00:38:51.867687+0000","last_clean":"2024-09-12T00:38:51.867687+0000","last_became_active":"2024-09-12T00:01:59.151143+0000","last_became_peered":"2024-09-12T00:01:59.151143+0000","last_unstale":"2024-09-12T00:38:51.867687+0000","last_undegraded":"2024-09-12T00:38:51.867687+0000","last_fullsized":"2024-09-12T00:38:51.867687+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'98","last_scrub_stamp":"2024-09-12T00:38:51.867545+0000","last_deep_scrub":"261'98","last_deep_scrub_stamp":"2024-09-12T00:38:51.867545+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.867545+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:31.009419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":451,"num_read_kb":380,"num_write":139,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'298","reported_seq":895,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.494823+0000","last_change":"2024-09-12T00:38:45.494768+0000","last_active":"2024-09-12T00:38:45.494823+0000","last_peered":"2024-09-12T00:38:45.494823+0000","last_clean":"2024-09-12T00:38:45.494823+0000","last_became_active":"2024-09-12T00:01:57.141789+0000","last_became_peered":"2024-09-12T00:01:57.141789+0000","last_unstale":"2024-09-12T00:38:45.494823+0000","last_undegraded":"2024-09-12T00:38:45.494823+0000","last_fullsized":"2024-09-12T00:38:45.494823+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'298","last_scrub_stamp":"2024-09-12T00:38:45.494662+0000","last_deep_scrub":"261'298","last_deep_scrub_stamp":"2024-09-12T00:38:45.494662+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.494662+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:00.002183+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":381,"num_read_kb":31078,"num_write":882,"num_write_kb":48318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.170325+0000","last_change":"2024-09-12T00:38:59.170256+0000","last_active":"2024-09-12T00:38:59.170325+0000","last_peered":"2024-09-12T00:38:59.170325+0000","last_clean":"2024-09-12T00:38:59.170325+0000","last_became_active":"2024-09-12T00:02:01.154530+0000","last_became_peered":"2024-09-12T00:02:01.154530+0000","last_unstale":"2024-09-12T00:38:59.170325+0000","last_undegraded":"2024-09-12T00:38:59.170325+0000","last_fullsized":"2024-09-12T00:38:59.170325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.170165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.170165+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.170165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:21.430019+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'294","reported_seq":865,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.000673+0000","last_change":"2024-09-12T00:39:08.000618+0000","last_active":"2024-09-12T00:39:08.000673+0000","last_peered":"2024-09-12T00:39:08.000673+0000","last_clean":"2024-09-12T00:39:08.000673+0000","last_became_active":"2024-09-12T00:02:03.156529+0000","last_became_peered":"2024-09-12T00:02:03.156529+0000","last_unstale":"2024-09-12T00:39:08.000673+0000","last_undegraded":"2024-09-12T00:39:08.000673+0000","last_fullsized":"2024-09-12T00:39:08.000673+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'294","last_scrub_stamp":"2024-09-12T00:39:08.000522+0000","last_deep_scrub":"261'294","last_deep_scrub_stamp":"2024-09-12T00:39:08.000522+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.000522+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:58.166295+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53504,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":1158,"num_write":402,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.902267+0000","last_change":"2024-09-12T00:39:05.902267+0000","last_active":"2024-09-12T00:39:05.902267+0000","last_peered":"2024-09-12T00:39:05.902267+0000","last_clean":"2024-09-12T00:39:05.902267+0000","last_became_active":"2024-09-12T00:02:05.163956+0000","last_became_peered":"2024-09-12T00:02:05.163956+0000","last_unstale":"2024-09-12T00:39:05.902267+0000","last_undegraded":"2024-09-12T00:39:05.902267+0000","last_fullsized":"2024-09-12T00:39:05.902267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:05.902175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:05.902175+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.902175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:32.967076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'131","reported_seq":616,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:27.063052+0000","last_change":"2024-09-12T00:39:27.062988+0000","last_active":"2024-09-12T00:39:27.063052+0000","last_peered":"2024-09-12T00:39:27.063052+0000","last_clean":"2024-09-12T00:39:27.063052+0000","last_became_active":"2024-09-12T00:02:07.172496+0000","last_became_peered":"2024-09-12T00:02:07.172496+0000","last_unstale":"2024-09-12T00:39:27.063052+0000","last_undegraded":"2024-09-12T00:39:27.063052+0000","last_fullsized":"2024-09-12T00:39:27.063052+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'131","last_scrub_stamp":"2024-09-12T00:39:27.062894+0000","last_deep_scrub":"261'131","last_deep_scrub_stamp":"2024-09-12T00:39:27.062894+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.062894+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:04.392517+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":307,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'198","reported_seq":837,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.530014+0000","last_change":"2024-09-12T00:38:49.529914+0000","last_active":"2024-09-12T00:38:49.530014+0000","last_peered":"2024-09-12T00:38:49.530014+0000","last_clean":"2024-09-12T00:38:49.530014+0000","last_became_active":"2024-09-12T00:01:59.148559+0000","last_became_peered":"2024-09-12T00:01:59.148559+0000","last_unstale":"2024-09-12T00:38:49.530014+0000","last_undegraded":"2024-09-12T00:38:49.530014+0000","last_fullsized":"2024-09-12T00:38:49.530014+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'198","last_scrub_stamp":"2024-09-12T00:38:49.529821+0000","last_deep_scrub":"261'198","last_deep_scrub_stamp":"2024-09-12T00:38:49.529821+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.529821+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:16.013027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":733,"num_write":278,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'382","reported_seq":1039,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.599884+0000","last_change":"2024-09-12T00:38:47.599821+0000","last_active":"2024-09-12T00:38:47.599884+0000","last_peered":"2024-09-12T00:38:47.599884+0000","last_clean":"2024-09-12T00:38:47.599884+0000","last_became_active":"2024-09-12T00:01:57.144397+0000","last_became_peered":"2024-09-12T00:01:57.144397+0000","last_unstale":"2024-09-12T00:38:47.599884+0000","last_undegraded":"2024-09-12T00:38:47.599884+0000","last_fullsized":"2024-09-12T00:38:47.599884+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'382","last_scrub_stamp":"2024-09-12T00:38:47.599641+0000","last_deep_scrub":"261'382","last_deep_scrub_stamp":"2024-09-12T00:38:47.599641+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.599641+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:34.445067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":577,"num_read_kb":18157,"num_write":1228,"num_write_kb":40983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"261'6","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.730424+0000","last_change":"2024-09-12T00:39:07.730359+0000","last_active":"2024-09-12T00:39:07.730424+0000","last_peered":"2024-09-12T00:39:07.730424+0000","last_clean":"2024-09-12T00:39:07.730424+0000","last_became_active":"2024-09-12T00:02:01.151739+0000","last_became_peered":"2024-09-12T00:02:01.151739+0000","last_unstale":"2024-09-12T00:39:07.730424+0000","last_undegraded":"2024-09-12T00:39:07.730424+0000","last_fullsized":"2024-09-12T00:39:07.730424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T00:39:07.730267+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T00:39:07.730267+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.730267+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:55.627773+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'92","reported_seq":609,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.135230+0000","last_change":"2024-09-12T00:39:20.135230+0000","last_active":"2024-09-12T00:39:20.135230+0000","last_peered":"2024-09-12T00:39:20.135230+0000","last_clean":"2024-09-12T00:39:20.135230+0000","last_became_active":"2024-09-12T00:02:03.153948+0000","last_became_peered":"2024-09-12T00:02:03.153948+0000","last_unstale":"2024-09-12T00:39:20.135230+0000","last_undegraded":"2024-09-12T00:39:20.135230+0000","last_fullsized":"2024-09-12T00:39:20.135230+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'92","last_scrub_stamp":"2024-09-12T00:39:20.135116+0000","last_deep_scrub":"261'92","last_deep_scrub_stamp":"2024-09-12T00:39:20.135116+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.135116+0000","objects_scrubbed":8,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:54.634202+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":128,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'765","reported_seq":4289,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.234419+0000","last_change":"2024-09-12T00:39:06.234365+0000","last_active":"2024-09-12T00:39:06.234419+0000","last_peered":"2024-09-12T00:39:06.234419+0000","last_clean":"2024-09-12T00:39:06.234419+0000","last_became_active":"2024-09-12T00:02:05.170399+0000","last_became_peered":"2024-09-12T00:02:05.170399+0000","last_unstale":"2024-09-12T00:39:06.234419+0000","last_undegraded":"2024-09-12T00:39:06.234419+0000","last_fullsized":"2024-09-12T00:39:06.234419+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'765","last_scrub_stamp":"2024-09-12T00:39:06.234288+0000","last_deep_scrub":"261'765","last_deep_scrub_stamp":"2024-09-12T00:39:06.234288+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.234288+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:39.555335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'118","reported_seq":613,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:28.014857+0000","last_change":"2024-09-12T00:39:28.014791+0000","last_active":"2024-09-12T00:39:28.014857+0000","last_peered":"2024-09-12T00:39:28.014857+0000","last_clean":"2024-09-12T00:39:28.014857+0000","last_became_active":"2024-09-12T00:02:07.173030+0000","last_became_peered":"2024-09-12T00:02:07.173030+0000","last_unstale":"2024-09-12T00:39:28.014857+0000","last_undegraded":"2024-09-12T00:39:28.014857+0000","last_fullsized":"2024-09-12T00:39:28.014857+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'118","last_scrub_stamp":"2024-09-12T00:39:28.014695+0000","last_deep_scrub":"261'118","last_deep_scrub_stamp":"2024-09-12T00:39:28.014695+0000","last_clean_scrub_stamp":"2024-09-12T00:39:28.014695+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:40.701990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":288,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'244","reported_seq":882,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.158778+0000","last_change":"2024-09-12T00:38:56.158718+0000","last_active":"2024-09-12T00:38:56.158778+0000","last_peered":"2024-09-12T00:38:56.158778+0000","last_clean":"2024-09-12T00:38:56.158778+0000","last_became_active":"2024-09-12T00:01:59.151743+0000","last_became_peered":"2024-09-12T00:01:59.151743+0000","last_unstale":"2024-09-12T00:38:56.158778+0000","last_undegraded":"2024-09-12T00:38:56.158778+0000","last_fullsized":"2024-09-12T00:38:56.158778+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'244","last_scrub_stamp":"2024-09-12T00:38:56.158624+0000","last_deep_scrub":"261'244","last_deep_scrub_stamp":"2024-09-12T00:38:56.158624+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.158624+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:33.327253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1082,"num_read_kb":884,"num_write":389,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'313","reported_seq":919,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.492959+0000","last_change":"2024-09-12T00:38:43.492902+0000","last_active":"2024-09-12T00:38:43.492959+0000","last_peered":"2024-09-12T00:38:43.492959+0000","last_clean":"2024-09-12T00:38:43.492959+0000","last_became_active":"2024-09-12T00:01:57.144946+0000","last_became_peered":"2024-09-12T00:01:57.144946+0000","last_unstale":"2024-09-12T00:38:43.492959+0000","last_undegraded":"2024-09-12T00:38:43.492959+0000","last_fullsized":"2024-09-12T00:38:43.492959+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'313","last_scrub_stamp":"2024-09-12T00:38:43.492802+0000","last_deep_scrub":"261'313","last_deep_scrub_stamp":"2024-09-12T00:38:43.492802+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.492802+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:17.143075+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":419,"num_read_kb":503,"num_write":968,"num_write_kb":20369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.426076+0000","last_change":"2024-09-12T00:39:00.426009+0000","last_active":"2024-09-12T00:39:00.426076+0000","last_peered":"2024-09-12T00:39:00.426076+0000","last_clean":"2024-09-12T00:39:00.426076+0000","last_became_active":"2024-09-12T00:02:01.152493+0000","last_became_peered":"2024-09-12T00:02:01.152493+0000","last_unstale":"2024-09-12T00:39:00.426076+0000","last_undegraded":"2024-09-12T00:39:00.426076+0000","last_fullsized":"2024-09-12T00:39:00.426076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:00.425924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:00.425924+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.425924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.528302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'323","reported_seq":926,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.285422+0000","last_change":"2024-09-12T00:39:05.285422+0000","last_active":"2024-09-12T00:39:05.285422+0000","last_peered":"2024-09-12T00:39:05.285422+0000","last_clean":"2024-09-12T00:39:05.285422+0000","last_became_active":"2024-09-12T00:02:03.150631+0000","last_became_peered":"2024-09-12T00:02:03.150631+0000","last_unstale":"2024-09-12T00:39:05.285422+0000","last_undegraded":"2024-09-12T00:39:05.285422+0000","last_fullsized":"2024-09-12T00:39:05.285422+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-12T00:39:05.285268+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-12T00:39:05.285268+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.285268+0000","objects_scrubbed":11,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:00.830128+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68885,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":513,"num_read_kb":1151,"num_write":412,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.697322+0000","last_change":"2024-09-12T00:39:16.697322+0000","last_active":"2024-09-12T00:39:16.697322+0000","last_peered":"2024-09-12T00:39:16.697322+0000","last_clean":"2024-09-12T00:39:16.697322+0000","last_became_active":"2024-09-12T00:02:05.167082+0000","last_became_peered":"2024-09-12T00:02:05.167082+0000","last_unstale":"2024-09-12T00:39:16.697322+0000","last_undegraded":"2024-09-12T00:39:16.697322+0000","last_fullsized":"2024-09-12T00:39:16.697322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.697225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.697225+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.697225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:31.751498+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'125","reported_seq":624,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.461692+0000","last_change":"2024-09-12T00:39:10.461692+0000","last_active":"2024-09-12T00:39:10.461692+0000","last_peered":"2024-09-12T00:39:10.461692+0000","last_clean":"2024-09-12T00:39:10.461692+0000","last_became_active":"2024-09-12T00:02:07.172810+0000","last_became_peered":"2024-09-12T00:02:07.172810+0000","last_unstale":"2024-09-12T00:39:10.461692+0000","last_undegraded":"2024-09-12T00:39:10.461692+0000","last_fullsized":"2024-09-12T00:39:10.461692+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'125","last_scrub_stamp":"2024-09-12T00:39:10.461579+0000","last_deep_scrub":"261'125","last_deep_scrub_stamp":"2024-09-12T00:39:10.461579+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.461579+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:41.729868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":135,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'223","reported_seq":850,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.135614+0000","last_change":"2024-09-12T00:38:55.135529+0000","last_active":"2024-09-12T00:38:55.135614+0000","last_peered":"2024-09-12T00:38:55.135614+0000","last_clean":"2024-09-12T00:38:55.135614+0000","last_became_active":"2024-09-12T00:01:59.147373+0000","last_became_peered":"2024-09-12T00:01:59.147373+0000","last_unstale":"2024-09-12T00:38:55.135614+0000","last_undegraded":"2024-09-12T00:38:55.135614+0000","last_fullsized":"2024-09-12T00:38:55.135614+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'223","last_scrub_stamp":"2024-09-12T00:38:55.135426+0000","last_deep_scrub":"261'223","last_deep_scrub_stamp":"2024-09-12T00:38:55.135426+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.135426+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:54.183644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1007,"num_read_kb":830,"num_write":359,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'297","reported_seq":901,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.195842+0000","last_change":"2024-09-12T00:39:07.195766+0000","last_active":"2024-09-12T00:39:07.195842+0000","last_peered":"2024-09-12T00:39:07.195842+0000","last_clean":"2024-09-12T00:39:07.195842+0000","last_became_active":"2024-09-12T00:01:57.161414+0000","last_became_peered":"2024-09-12T00:01:57.161414+0000","last_unstale":"2024-09-12T00:39:07.195842+0000","last_undegraded":"2024-09-12T00:39:07.195842+0000","last_fullsized":"2024-09-12T00:39:07.195842+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'297","last_scrub_stamp":"2024-09-12T00:39:07.195639+0000","last_deep_scrub":"261'297","last_deep_scrub_stamp":"2024-09-12T00:39:07.195639+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.195639+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:54.938996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174757,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":380,"num_read_kb":8089,"num_write":919,"num_write_kb":31185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.179628+0000","last_change":"2024-09-12T00:38:57.179570+0000","last_active":"2024-09-12T00:38:57.179628+0000","last_peered":"2024-09-12T00:38:57.179628+0000","last_clean":"2024-09-12T00:38:57.179628+0000","last_became_active":"2024-09-12T00:02:01.151760+0000","last_became_peered":"2024-09-12T00:02:01.151760+0000","last_unstale":"2024-09-12T00:38:57.179628+0000","last_undegraded":"2024-09-12T00:38:57.179628+0000","last_fullsized":"2024-09-12T00:38:57.179628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:57.179464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:57.179464+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.179464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:03.467030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'281","reported_seq":853,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.735036+0000","last_change":"2024-09-12T00:39:13.735036+0000","last_active":"2024-09-12T00:39:13.735036+0000","last_peered":"2024-09-12T00:39:13.735036+0000","last_clean":"2024-09-12T00:39:13.735036+0000","last_became_active":"2024-09-12T00:02:03.150714+0000","last_became_peered":"2024-09-12T00:02:03.150714+0000","last_unstale":"2024-09-12T00:39:13.735036+0000","last_undegraded":"2024-09-12T00:39:13.735036+0000","last_fullsized":"2024-09-12T00:39:13.735036+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'281","last_scrub_stamp":"2024-09-12T00:39:13.734932+0000","last_deep_scrub":"261'281","last_deep_scrub_stamp":"2024-09-12T00:39:13.734932+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.734932+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:14.733788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52913,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1134,"num_write":392,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:24.119460+0000","last_change":"2024-09-12T00:39:24.119460+0000","last_active":"2024-09-12T00:39:24.119460+0000","last_peered":"2024-09-12T00:39:24.119460+0000","last_clean":"2024-09-12T00:39:24.119460+0000","last_became_active":"2024-09-12T00:02:05.170973+0000","last_became_peered":"2024-09-12T00:02:05.170973+0000","last_unstale":"2024-09-12T00:39:24.119460+0000","last_undegraded":"2024-09-12T00:39:24.119460+0000","last_fullsized":"2024-09-12T00:39:24.119460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:24.119377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:24.119377+0000","last_clean_scrub_stamp":"2024-09-12T00:39:24.119377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:28.955427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'120","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.852653+0000","last_change":"2024-09-12T00:39:21.852653+0000","last_active":"2024-09-12T00:39:21.852653+0000","last_peered":"2024-09-12T00:39:21.852653+0000","last_clean":"2024-09-12T00:39:21.852653+0000","last_became_active":"2024-09-12T00:02:07.169266+0000","last_became_peered":"2024-09-12T00:02:07.169266+0000","last_unstale":"2024-09-12T00:39:21.852653+0000","last_undegraded":"2024-09-12T00:39:21.852653+0000","last_fullsized":"2024-09-12T00:39:21.852653+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'120","last_scrub_stamp":"2024-09-12T00:39:21.852565+0000","last_deep_scrub":"261'120","last_deep_scrub_stamp":"2024-09-12T00:39:21.852565+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.852565+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:55.302107+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":294,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'183","reported_seq":785,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.841083+0000","last_change":"2024-09-12T00:38:50.841083+0000","last_active":"2024-09-12T00:38:50.841083+0000","last_peered":"2024-09-12T00:38:50.841083+0000","last_clean":"2024-09-12T00:38:50.841083+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:38:50.841083+0000","last_undegraded":"2024-09-12T00:38:50.841083+0000","last_fullsized":"2024-09-12T00:38:50.841083+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'183","last_scrub_stamp":"2024-09-12T00:38:50.840994+0000","last_deep_scrub":"261'183","last_deep_scrub_stamp":"2024-09-12T00:38:50.840994+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.840994+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:07.476170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":689,"num_write":284,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'446","reported_seq":1169,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.764952+0000","last_change":"2024-09-12T00:38:48.764952+0000","last_active":"2024-09-12T00:38:48.764952+0000","last_peered":"2024-09-12T00:38:48.764952+0000","last_clean":"2024-09-12T00:38:48.764952+0000","last_became_active":"2024-09-12T00:01:57.161612+0000","last_became_peered":"2024-09-12T00:01:57.161612+0000","last_unstale":"2024-09-12T00:38:48.764952+0000","last_undegraded":"2024-09-12T00:38:48.764952+0000","last_fullsized":"2024-09-12T00:38:48.764952+0000","mapping_epoch":24,"log_start":"261'400","ondisk_log_start":"261'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'446","last_scrub_stamp":"2024-09-12T00:38:48.764718+0000","last_deep_scrub":"261'446","last_deep_scrub_stamp":"2024-09-12T00:38:48.764718+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.764718+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:21.363677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":772,"num_read_kb":15126,"num_write":1508,"num_write_kb":40840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.430557+0000","last_change":"2024-09-12T00:38:59.430557+0000","last_active":"2024-09-12T00:38:59.430557+0000","last_peered":"2024-09-12T00:38:59.430557+0000","last_clean":"2024-09-12T00:38:59.430557+0000","last_became_active":"2024-09-12T00:02:01.144558+0000","last_became_peered":"2024-09-12T00:02:01.144558+0000","last_unstale":"2024-09-12T00:38:59.430557+0000","last_undegraded":"2024-09-12T00:38:59.430557+0000","last_fullsized":"2024-09-12T00:38:59.430557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.430450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.430450+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.430450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:54.397837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'265","reported_seq":821,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.959815+0000","last_change":"2024-09-12T00:39:05.959752+0000","last_active":"2024-09-12T00:39:05.959815+0000","last_peered":"2024-09-12T00:39:05.959815+0000","last_clean":"2024-09-12T00:39:05.959815+0000","last_became_active":"2024-09-12T00:02:03.154477+0000","last_became_peered":"2024-09-12T00:02:03.154477+0000","last_unstale":"2024-09-12T00:39:05.959815+0000","last_undegraded":"2024-09-12T00:39:05.959815+0000","last_fullsized":"2024-09-12T00:39:05.959815+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'265","last_scrub_stamp":"2024-09-12T00:39:05.959667+0000","last_deep_scrub":"261'265","last_deep_scrub_stamp":"2024-09-12T00:39:05.959667+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.959667+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:09.262831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47465,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":439,"num_read_kb":1086,"num_write":366,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:25.092629+0000","last_change":"2024-09-12T00:39:25.092508+0000","last_active":"2024-09-12T00:39:25.092629+0000","last_peered":"2024-09-12T00:39:25.092629+0000","last_clean":"2024-09-12T00:39:25.092629+0000","last_became_active":"2024-09-12T00:02:05.166141+0000","last_became_peered":"2024-09-12T00:02:05.166141+0000","last_unstale":"2024-09-12T00:39:25.092629+0000","last_undegraded":"2024-09-12T00:39:25.092629+0000","last_fullsized":"2024-09-12T00:39:25.092629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.092411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.092411+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.092411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:05.290591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'190","reported_seq":1336,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:32.008900+0000","last_change":"2024-09-12T00:39:32.008900+0000","last_active":"2024-09-12T00:39:32.008900+0000","last_peered":"2024-09-12T00:39:32.008900+0000","last_clean":"2024-09-12T00:39:32.008900+0000","last_became_active":"2024-09-12T00:02:07.169812+0000","last_became_peered":"2024-09-12T00:02:07.169812+0000","last_unstale":"2024-09-12T00:39:32.008900+0000","last_undegraded":"2024-09-12T00:39:32.008900+0000","last_fullsized":"2024-09-12T00:39:32.008900+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'190","last_scrub_stamp":"2024-09-12T00:39:32.008804+0000","last_deep_scrub":"261'190","last_deep_scrub_stamp":"2024-09-12T00:39:32.008804+0000","last_clean_scrub_stamp":"2024-09-12T00:39:32.008804+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:13.569005+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1006,"num_read_kb":951,"num_write":452,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'117","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.094187+0000","last_change":"2024-09-12T00:38:54.094187+0000","last_active":"2024-09-12T00:38:54.094187+0000","last_peered":"2024-09-12T00:38:54.094187+0000","last_clean":"2024-09-12T00:38:54.094187+0000","last_became_active":"2024-09-12T00:01:59.148253+0000","last_became_peered":"2024-09-12T00:01:59.148253+0000","last_unstale":"2024-09-12T00:38:54.094187+0000","last_undegraded":"2024-09-12T00:38:54.094187+0000","last_fullsized":"2024-09-12T00:38:54.094187+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'117","last_scrub_stamp":"2024-09-12T00:38:54.094084+0000","last_deep_scrub":"261'117","last_deep_scrub_stamp":"2024-09-12T00:38:54.094084+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.094084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:55.052129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":405,"num_write":165,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'378","reported_seq":1049,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.791354+0000","last_change":"2024-09-12T00:38:49.791277+0000","last_active":"2024-09-12T00:38:49.791354+0000","last_peered":"2024-09-12T00:38:49.791354+0000","last_clean":"2024-09-12T00:38:49.791354+0000","last_became_active":"2024-09-12T00:01:57.138386+0000","last_became_peered":"2024-09-12T00:01:57.138386+0000","last_unstale":"2024-09-12T00:38:49.791354+0000","last_undegraded":"2024-09-12T00:38:49.791354+0000","last_fullsized":"2024-09-12T00:38:49.791354+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T00:38:49.791164+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T00:38:49.791164+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.791164+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:45.569391+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":660,"num_read_kb":37451,"num_write":1183,"num_write_kb":32715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"261'2","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.659936+0000","last_change":"2024-09-12T00:39:05.659936+0000","last_active":"2024-09-12T00:39:05.659936+0000","last_peered":"2024-09-12T00:39:05.659936+0000","last_clean":"2024-09-12T00:39:05.659936+0000","last_became_active":"2024-09-12T00:02:01.153306+0000","last_became_peered":"2024-09-12T00:02:01.153306+0000","last_unstale":"2024-09-12T00:39:05.659936+0000","last_undegraded":"2024-09-12T00:39:05.659936+0000","last_fullsized":"2024-09-12T00:39:05.659936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:05.659851+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:05.659851+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.659851+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:10.733284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'291","reported_seq":880,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.170663+0000","last_change":"2024-09-12T00:39:17.170584+0000","last_active":"2024-09-12T00:39:17.170663+0000","last_peered":"2024-09-12T00:39:17.170663+0000","last_clean":"2024-09-12T00:39:17.170663+0000","last_became_active":"2024-09-12T00:02:03.158379+0000","last_became_peered":"2024-09-12T00:02:03.158379+0000","last_unstale":"2024-09-12T00:39:17.170663+0000","last_undegraded":"2024-09-12T00:39:17.170663+0000","last_fullsized":"2024-09-12T00:39:17.170663+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'291","last_scrub_stamp":"2024-09-12T00:39:17.170478+0000","last_deep_scrub":"261'291","last_deep_scrub_stamp":"2024-09-12T00:39:17.170478+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.170478+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:51.871807+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53226,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":1058,"num_write":380,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.681981+0000","last_change":"2024-09-12T00:39:17.681924+0000","last_active":"2024-09-12T00:39:17.681981+0000","last_peered":"2024-09-12T00:39:17.681981+0000","last_clean":"2024-09-12T00:39:17.681981+0000","last_became_active":"2024-09-12T00:02:05.159854+0000","last_became_peered":"2024-09-12T00:02:05.159854+0000","last_unstale":"2024-09-12T00:39:17.681981+0000","last_undegraded":"2024-09-12T00:39:17.681981+0000","last_fullsized":"2024-09-12T00:39:17.681981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:17.681837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:17.681837+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.681837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:12.161647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'135","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.239563+0000","last_change":"2024-09-12T00:39:08.239477+0000","last_active":"2024-09-12T00:39:08.239563+0000","last_peered":"2024-09-12T00:39:08.239563+0000","last_clean":"2024-09-12T00:39:08.239563+0000","last_became_active":"2024-09-12T00:02:07.170727+0000","last_became_peered":"2024-09-12T00:02:07.170727+0000","last_unstale":"2024-09-12T00:39:08.239563+0000","last_undegraded":"2024-09-12T00:39:08.239563+0000","last_fullsized":"2024-09-12T00:39:08.239563+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'135","last_scrub_stamp":"2024-09-12T00:39:08.239382+0000","last_deep_scrub":"261'135","last_deep_scrub_stamp":"2024-09-12T00:39:08.239382+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.239382+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:08.116527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":129,"num_write":315,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'247","reported_seq":916,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.507541+0000","last_change":"2024-09-12T00:38:54.507541+0000","last_active":"2024-09-12T00:38:54.507541+0000","last_peered":"2024-09-12T00:38:54.507541+0000","last_clean":"2024-09-12T00:38:54.507541+0000","last_became_active":"2024-09-12T00:01:59.145502+0000","last_became_peered":"2024-09-12T00:01:59.145502+0000","last_unstale":"2024-09-12T00:38:54.507541+0000","last_undegraded":"2024-09-12T00:38:54.507541+0000","last_fullsized":"2024-09-12T00:38:54.507541+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'247","last_scrub_stamp":"2024-09-12T00:38:54.507456+0000","last_deep_scrub":"261'247","last_deep_scrub_stamp":"2024-09-12T00:38:54.507456+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.507456+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:33.111923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1128,"num_read_kb":927,"num_write":363,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'365","reported_seq":1026,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.026480+0000","last_change":"2024-09-12T00:38:46.026415+0000","last_active":"2024-09-12T00:38:46.026480+0000","last_peered":"2024-09-12T00:38:46.026480+0000","last_clean":"2024-09-12T00:38:46.026480+0000","last_became_active":"2024-09-12T00:01:57.159487+0000","last_became_peered":"2024-09-12T00:01:57.159487+0000","last_unstale":"2024-09-12T00:38:46.026480+0000","last_undegraded":"2024-09-12T00:38:46.026480+0000","last_fullsized":"2024-09-12T00:38:46.026480+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'365","last_scrub_stamp":"2024-09-12T00:38:46.026277+0000","last_deep_scrub":"261'365","last_deep_scrub_stamp":"2024-09-12T00:38:46.026277+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.026277+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:55.022589+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":54883,"num_write":1141,"num_write_kb":38301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'151","reported_seq":706,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.830942+0000","last_change":"2024-09-12T00:38:52.830942+0000","last_active":"2024-09-12T00:38:52.830942+0000","last_peered":"2024-09-12T00:38:52.830942+0000","last_clean":"2024-09-12T00:38:52.830942+0000","last_became_active":"2024-09-12T00:01:59.153340+0000","last_became_peered":"2024-09-12T00:01:59.153340+0000","last_unstale":"2024-09-12T00:38:52.830942+0000","last_undegraded":"2024-09-12T00:38:52.830942+0000","last_fullsized":"2024-09-12T00:38:52.830942+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'151","last_scrub_stamp":"2024-09-12T00:38:52.830858+0000","last_deep_scrub":"261'151","last_deep_scrub_stamp":"2024-09-12T00:38:52.830858+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.830858+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:38.477609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":542,"num_write":243,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'317","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.771239+0000","last_change":"2024-09-12T00:38:46.771139+0000","last_active":"2024-09-12T00:38:46.771239+0000","last_peered":"2024-09-12T00:38:46.771239+0000","last_clean":"2024-09-12T00:38:46.771239+0000","last_became_active":"2024-09-12T00:01:57.152522+0000","last_became_peered":"2024-09-12T00:01:57.152522+0000","last_unstale":"2024-09-12T00:38:46.771239+0000","last_undegraded":"2024-09-12T00:38:46.771239+0000","last_fullsized":"2024-09-12T00:38:46.771239+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'317","last_scrub_stamp":"2024-09-12T00:38:46.770967+0000","last_deep_scrub":"261'317","last_deep_scrub_stamp":"2024-09-12T00:38:46.770967+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.770967+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.575296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":990709,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":567,"num_read_kb":16299,"num_write":1038,"num_write_kb":36902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'218","reported_seq":851,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.208392+0000","last_change":"2024-09-12T00:39:18.208392+0000","last_active":"2024-09-12T00:39:18.208392+0000","last_peered":"2024-09-12T00:39:18.208392+0000","last_clean":"2024-09-12T00:39:18.208392+0000","last_became_active":"2024-09-12T00:01:59.145971+0000","last_became_peered":"2024-09-12T00:01:59.145971+0000","last_unstale":"2024-09-12T00:39:18.208392+0000","last_undegraded":"2024-09-12T00:39:18.208392+0000","last_fullsized":"2024-09-12T00:39:18.208392+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'218","last_scrub_stamp":"2024-09-12T00:39:18.208265+0000","last_deep_scrub":"261'218","last_deep_scrub_stamp":"2024-09-12T00:39:18.208265+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.208265+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:34.095704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":962,"num_read_kb":786,"num_write":321,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8590,"num_omap_keys":34,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'356","reported_seq":975,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.269641+0000","last_change":"2024-09-12T00:38:54.269575+0000","last_active":"2024-09-12T00:38:54.269641+0000","last_peered":"2024-09-12T00:38:54.269641+0000","last_clean":"2024-09-12T00:38:54.269641+0000","last_became_active":"2024-09-12T00:01:57.167651+0000","last_became_peered":"2024-09-12T00:01:57.167651+0000","last_unstale":"2024-09-12T00:38:54.269641+0000","last_undegraded":"2024-09-12T00:38:54.269641+0000","last_fullsized":"2024-09-12T00:38:54.269641+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'356","last_scrub_stamp":"2024-09-12T00:38:54.269448+0000","last_deep_scrub":"261'356","last_deep_scrub_stamp":"2024-09-12T00:38:54.269448+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.269448+0000","objects_scrubbed":6,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:35.410380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":490,"num_read_kb":6602,"num_write":1155,"num_write_kb":24145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'167","reported_seq":758,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.843569+0000","last_change":"2024-09-12T00:39:02.843569+0000","last_active":"2024-09-12T00:39:02.843569+0000","last_peered":"2024-09-12T00:39:02.843569+0000","last_clean":"2024-09-12T00:39:02.843569+0000","last_became_active":"2024-09-12T00:01:59.146794+0000","last_became_peered":"2024-09-12T00:01:59.146794+0000","last_unstale":"2024-09-12T00:39:02.843569+0000","last_undegraded":"2024-09-12T00:39:02.843569+0000","last_fullsized":"2024-09-12T00:39:02.843569+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'167","last_scrub_stamp":"2024-09-12T00:39:02.843486+0000","last_deep_scrub":"261'167","last_deep_scrub_stamp":"2024-09-12T00:39:02.843486+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.843486+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:31.785008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":586,"num_write":261,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'291","reported_seq":906,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.812779+0000","last_change":"2024-09-12T00:38:50.812669+0000","last_active":"2024-09-12T00:38:50.812779+0000","last_peered":"2024-09-12T00:38:50.812779+0000","last_clean":"2024-09-12T00:38:50.812779+0000","last_became_active":"2024-09-12T00:01:57.145410+0000","last_became_peered":"2024-09-12T00:01:57.145410+0000","last_unstale":"2024-09-12T00:38:50.812779+0000","last_undegraded":"2024-09-12T00:38:50.812779+0000","last_fullsized":"2024-09-12T00:38:50.812779+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'291","last_scrub_stamp":"2024-09-12T00:38:50.812479+0000","last_deep_scrub":"261'291","last_deep_scrub_stamp":"2024-09-12T00:38:50.812479+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.812479+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:54.529596+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":406,"num_read_kb":533,"num_write":954,"num_write_kb":14360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'571","reported_seq":1342,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.831940+0000","last_change":"2024-09-12T00:39:00.831886+0000","last_active":"2024-09-12T00:39:00.831940+0000","last_peered":"2024-09-12T00:39:00.831940+0000","last_clean":"2024-09-12T00:39:00.831940+0000","last_became_active":"2024-09-12T00:01:59.148605+0000","last_became_peered":"2024-09-12T00:01:59.148605+0000","last_unstale":"2024-09-12T00:39:00.831940+0000","last_undegraded":"2024-09-12T00:39:00.831940+0000","last_fullsized":"2024-09-12T00:39:00.831940+0000","mapping_epoch":26,"log_start":"261'500","ondisk_log_start":"261'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'571","last_scrub_stamp":"2024-09-12T00:39:00.831790+0000","last_deep_scrub":"261'571","last_deep_scrub_stamp":"2024-09-12T00:39:00.831790+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.831790+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:07.829005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2664,"num_read_kb":2197,"num_write":993,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'328","reported_seq":979,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.076699+0000","last_change":"2024-09-12T00:38:47.076584+0000","last_active":"2024-09-12T00:38:47.076699+0000","last_peered":"2024-09-12T00:38:47.076699+0000","last_clean":"2024-09-12T00:38:47.076699+0000","last_became_active":"2024-09-12T00:02:32.864862+0000","last_became_peered":"2024-09-12T00:02:32.864862+0000","last_unstale":"2024-09-12T00:38:47.076699+0000","last_undegraded":"2024-09-12T00:38:47.076699+0000","last_fullsized":"2024-09-12T00:38:47.076699+0000","mapping_epoch":37,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'328","last_scrub_stamp":"2024-09-12T00:38:47.076409+0000","last_deep_scrub":"261'328","last_deep_scrub_stamp":"2024-09-12T00:38:47.076409+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.076409+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:26.756457+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":496,"num_read_kb":62973,"num_write":1092,"num_write_kb":36662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7,3],"acting":[6,0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'192","reported_seq":818,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.208840+0000","last_change":"2024-09-12T00:38:54.208785+0000","last_active":"2024-09-12T00:38:54.208840+0000","last_peered":"2024-09-12T00:38:54.208840+0000","last_clean":"2024-09-12T00:38:54.208840+0000","last_became_active":"2024-09-12T00:01:59.141383+0000","last_became_peered":"2024-09-12T00:01:59.141383+0000","last_unstale":"2024-09-12T00:38:54.208840+0000","last_undegraded":"2024-09-12T00:38:54.208840+0000","last_fullsized":"2024-09-12T00:38:54.208840+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'192","last_scrub_stamp":"2024-09-12T00:38:54.208696+0000","last_deep_scrub":"261'192","last_deep_scrub_stamp":"2024-09-12T00:38:54.208696+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.208696+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:40.694440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":715,"num_write":298,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'342","reported_seq":1005,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.046217+0000","last_change":"2024-09-12T00:38:49.046108+0000","last_active":"2024-09-12T00:38:49.046217+0000","last_peered":"2024-09-12T00:38:49.046217+0000","last_clean":"2024-09-12T00:38:49.046217+0000","last_became_active":"2024-09-12T00:01:57.152097+0000","last_became_peered":"2024-09-12T00:01:57.152097+0000","last_unstale":"2024-09-12T00:38:49.046217+0000","last_undegraded":"2024-09-12T00:38:49.046217+0000","last_fullsized":"2024-09-12T00:38:49.046217+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'342","last_scrub_stamp":"2024-09-12T00:38:49.045971+0000","last_deep_scrub":"261'342","last_deep_scrub_stamp":"2024-09-12T00:38:49.045971+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.045971+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:14.819908+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399285,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":523,"num_read_kb":43886,"num_write":1080,"num_write_kb":36840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'430","reported_seq":1154,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.913542+0000","last_change":"2024-09-12T00:38:55.913482+0000","last_active":"2024-09-12T00:38:55.913542+0000","last_peered":"2024-09-12T00:38:55.913542+0000","last_clean":"2024-09-12T00:38:55.913542+0000","last_became_active":"2024-09-12T00:01:59.146117+0000","last_became_peered":"2024-09-12T00:01:59.146117+0000","last_unstale":"2024-09-12T00:38:55.913542+0000","last_undegraded":"2024-09-12T00:38:55.913542+0000","last_fullsized":"2024-09-12T00:38:55.913542+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'430","last_scrub_stamp":"2024-09-12T00:38:55.913381+0000","last_deep_scrub":"261'430","last_deep_scrub_stamp":"2024-09-12T00:38:55.913381+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.913381+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:25.825297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2179,"num_read_kb":1868,"num_write":729,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'382","reported_seq":1081,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.029173+0000","last_change":"2024-09-12T00:38:49.029107+0000","last_active":"2024-09-12T00:38:49.029173+0000","last_peered":"2024-09-12T00:38:49.029173+0000","last_clean":"2024-09-12T00:38:49.029173+0000","last_became_active":"2024-09-12T00:01:57.156002+0000","last_became_peered":"2024-09-12T00:01:57.156002+0000","last_unstale":"2024-09-12T00:38:49.029173+0000","last_undegraded":"2024-09-12T00:38:49.029173+0000","last_fullsized":"2024-09-12T00:38:49.029173+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'382","last_scrub_stamp":"2024-09-12T00:38:49.028963+0000","last_deep_scrub":"261'382","last_deep_scrub_stamp":"2024-09-12T00:38:49.028963+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.028963+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:41.518318+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":675,"num_read_kb":79699,"num_write":1346,"num_write_kb":54312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'216","reported_seq":804,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.470725+0000","last_change":"2024-09-12T00:38:47.470623+0000","last_active":"2024-09-12T00:38:47.470725+0000","last_peered":"2024-09-12T00:38:47.470725+0000","last_clean":"2024-09-12T00:38:47.470725+0000","last_became_active":"2024-09-12T00:01:59.155003+0000","last_became_peered":"2024-09-12T00:01:59.155003+0000","last_unstale":"2024-09-12T00:38:47.470725+0000","last_undegraded":"2024-09-12T00:38:47.470725+0000","last_fullsized":"2024-09-12T00:38:47.470725+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'216","last_scrub_stamp":"2024-09-12T00:38:47.470513+0000","last_deep_scrub":"261'216","last_deep_scrub_stamp":"2024-09-12T00:38:47.470513+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.470513+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:16.481869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":893,"num_read_kb":718,"num_write":326,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'362","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.779864+0000","last_change":"2024-09-12T00:38:51.779864+0000","last_active":"2024-09-12T00:38:51.779864+0000","last_peered":"2024-09-12T00:38:51.779864+0000","last_clean":"2024-09-12T00:38:51.779864+0000","last_became_active":"2024-09-12T00:01:57.145466+0000","last_became_peered":"2024-09-12T00:01:57.145466+0000","last_unstale":"2024-09-12T00:38:51.779864+0000","last_undegraded":"2024-09-12T00:38:51.779864+0000","last_fullsized":"2024-09-12T00:38:51.779864+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'362","last_scrub_stamp":"2024-09-12T00:38:51.779755+0000","last_deep_scrub":"261'362","last_deep_scrub_stamp":"2024-09-12T00:38:51.779755+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.779755+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:46.528330+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262160,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":3535,"num_write":1174,"num_write_kb":24926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'109","reported_seq":694,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.899825+0000","last_change":"2024-09-12T00:38:54.899756+0000","last_active":"2024-09-12T00:38:54.899825+0000","last_peered":"2024-09-12T00:38:54.899825+0000","last_clean":"2024-09-12T00:38:54.899825+0000","last_became_active":"2024-09-12T00:01:59.149014+0000","last_became_peered":"2024-09-12T00:01:59.149014+0000","last_unstale":"2024-09-12T00:38:54.899825+0000","last_undegraded":"2024-09-12T00:38:54.899825+0000","last_fullsized":"2024-09-12T00:38:54.899825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'109","last_scrub_stamp":"2024-09-12T00:38:54.899674+0000","last_deep_scrub":"261'109","last_deep_scrub_stamp":"2024-09-12T00:38:54.899674+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.899674+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:24.146722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":492,"num_read_kb":416,"num_write":148,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'402","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.242136+0000","last_change":"2024-09-12T00:38:56.242136+0000","last_active":"2024-09-12T00:38:56.242136+0000","last_peered":"2024-09-12T00:38:56.242136+0000","last_clean":"2024-09-12T00:38:56.242136+0000","last_became_active":"2024-09-12T00:01:57.150980+0000","last_became_peered":"2024-09-12T00:01:57.150980+0000","last_unstale":"2024-09-12T00:38:56.242136+0000","last_undegraded":"2024-09-12T00:38:56.242136+0000","last_fullsized":"2024-09-12T00:38:56.242136+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'402","last_scrub_stamp":"2024-09-12T00:38:56.241977+0000","last_deep_scrub":"261'402","last_deep_scrub_stamp":"2024-09-12T00:38:56.241977+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.241977+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:40.615576+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1303915,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":638,"num_read_kb":15523,"num_write":1286,"num_write_kb":17105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'109","reported_seq":712,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.238124+0000","last_change":"2024-09-12T00:38:55.238054+0000","last_active":"2024-09-12T00:38:55.238124+0000","last_peered":"2024-09-12T00:38:55.238124+0000","last_clean":"2024-09-12T00:38:55.238124+0000","last_became_active":"2024-09-12T00:01:59.149341+0000","last_became_peered":"2024-09-12T00:01:59.149341+0000","last_unstale":"2024-09-12T00:38:55.238124+0000","last_undegraded":"2024-09-12T00:38:55.238124+0000","last_fullsized":"2024-09-12T00:38:55.238124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'109","last_scrub_stamp":"2024-09-12T00:38:55.237937+0000","last_deep_scrub":"261'109","last_deep_scrub_stamp":"2024-09-12T00:38:55.237937+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.237937+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:39.737518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":504,"num_read_kb":434,"num_write":171,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'343","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.738562+0000","last_change":"2024-09-12T00:38:52.738562+0000","last_active":"2024-09-12T00:38:52.738562+0000","last_peered":"2024-09-12T00:38:52.738562+0000","last_clean":"2024-09-12T00:38:52.738562+0000","last_became_active":"2024-09-12T00:02:32.863077+0000","last_became_peered":"2024-09-12T00:02:32.863077+0000","last_unstale":"2024-09-12T00:38:52.738562+0000","last_undegraded":"2024-09-12T00:38:52.738562+0000","last_fullsized":"2024-09-12T00:38:52.738562+0000","mapping_epoch":37,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'343","last_scrub_stamp":"2024-09-12T00:38:52.738425+0000","last_deep_scrub":"261'343","last_deep_scrub_stamp":"2024-09-12T00:38:52.738425+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.738425+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:23.042537+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267332,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":11923,"num_write":1143,"num_write_kb":27282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,7],"acting":[5,6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'269","reported_seq":901,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.807917+0000","last_change":"2024-09-12T00:39:03.807917+0000","last_active":"2024-09-12T00:39:03.807917+0000","last_peered":"2024-09-12T00:39:03.807917+0000","last_clean":"2024-09-12T00:39:03.807917+0000","last_became_active":"2024-09-12T00:01:59.159226+0000","last_became_peered":"2024-09-12T00:01:59.159226+0000","last_unstale":"2024-09-12T00:39:03.807917+0000","last_undegraded":"2024-09-12T00:39:03.807917+0000","last_fullsized":"2024-09-12T00:39:03.807917+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'269","last_scrub_stamp":"2024-09-12T00:39:03.807792+0000","last_deep_scrub":"261'269","last_deep_scrub_stamp":"2024-09-12T00:39:03.807792+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.807792+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:26.022277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1182,"num_read_kb":958,"num_write":434,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'384","reported_seq":1052,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.429903+0000","last_change":"2024-09-12T00:38:48.429903+0000","last_active":"2024-09-12T00:38:48.429903+0000","last_peered":"2024-09-12T00:38:48.429903+0000","last_clean":"2024-09-12T00:38:48.429903+0000","last_became_active":"2024-09-12T00:01:57.148038+0000","last_became_peered":"2024-09-12T00:01:57.148038+0000","last_unstale":"2024-09-12T00:38:48.429903+0000","last_undegraded":"2024-09-12T00:38:48.429903+0000","last_fullsized":"2024-09-12T00:38:48.429903+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'384","last_scrub_stamp":"2024-09-12T00:38:48.429770+0000","last_deep_scrub":"261'384","last_deep_scrub_stamp":"2024-09-12T00:38:48.429770+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.429770+0000","objects_scrubbed":9,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:30.722756+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6690610,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":558,"num_read_kb":81305,"num_write":1164,"num_write_kb":56822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'244","reported_seq":823,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.463575+0000","last_change":"2024-09-12T00:38:46.463575+0000","last_active":"2024-09-12T00:38:46.463575+0000","last_peered":"2024-09-12T00:38:46.463575+0000","last_clean":"2024-09-12T00:38:46.463575+0000","last_became_active":"2024-09-12T00:01:59.154258+0000","last_became_peered":"2024-09-12T00:01:59.154258+0000","last_unstale":"2024-09-12T00:38:46.463575+0000","last_undegraded":"2024-09-12T00:38:46.463575+0000","last_fullsized":"2024-09-12T00:38:46.463575+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'244","last_scrub_stamp":"2024-09-12T00:38:46.463482+0000","last_deep_scrub":"261'244","last_deep_scrub_stamp":"2024-09-12T00:38:46.463482+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.463482+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:14.252384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":900,"num_write":421,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'365","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.560924+0000","last_change":"2024-09-12T00:38:50.560924+0000","last_active":"2024-09-12T00:38:50.560924+0000","last_peered":"2024-09-12T00:38:50.560924+0000","last_clean":"2024-09-12T00:38:50.560924+0000","last_became_active":"2024-09-12T00:01:57.142713+0000","last_became_peered":"2024-09-12T00:01:57.142713+0000","last_unstale":"2024-09-12T00:38:50.560924+0000","last_undegraded":"2024-09-12T00:38:50.560924+0000","last_fullsized":"2024-09-12T00:38:50.560924+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'365","last_scrub_stamp":"2024-09-12T00:38:50.560759+0000","last_deep_scrub":"261'365","last_deep_scrub_stamp":"2024-09-12T00:38:50.560759+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.560759+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:30.948385+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244498,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":36570,"num_write":1122,"num_write_kb":39253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'211","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.457433+0000","last_change":"2024-09-12T00:38:49.457433+0000","last_active":"2024-09-12T00:38:49.457433+0000","last_peered":"2024-09-12T00:38:49.457433+0000","last_clean":"2024-09-12T00:38:49.457433+0000","last_became_active":"2024-09-12T00:01:59.154931+0000","last_became_peered":"2024-09-12T00:01:59.154931+0000","last_unstale":"2024-09-12T00:38:49.457433+0000","last_undegraded":"2024-09-12T00:38:49.457433+0000","last_fullsized":"2024-09-12T00:38:49.457433+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'211","last_scrub_stamp":"2024-09-12T00:38:49.457304+0000","last_deep_scrub":"261'211","last_deep_scrub_stamp":"2024-09-12T00:38:49.457304+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.457304+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":100,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:34.654587+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":786,"num_write":317,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4003,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'344","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.223372+0000","last_change":"2024-09-12T00:38:46.223372+0000","last_active":"2024-09-12T00:38:46.223372+0000","last_peered":"2024-09-12T00:38:46.223372+0000","last_clean":"2024-09-12T00:38:46.223372+0000","last_became_active":"2024-09-12T00:01:57.142082+0000","last_became_peered":"2024-09-12T00:01:57.142082+0000","last_unstale":"2024-09-12T00:38:46.223372+0000","last_undegraded":"2024-09-12T00:38:46.223372+0000","last_fullsized":"2024-09-12T00:38:46.223372+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'344","last_scrub_stamp":"2024-09-12T00:38:46.223232+0000","last_deep_scrub":"261'344","last_deep_scrub_stamp":"2024-09-12T00:38:46.223232+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.223232+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:33.212306+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138779,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":3429,"num_write":1186,"num_write_kb":16203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'205","reported_seq":799,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.867815+0000","last_change":"2024-09-12T00:38:53.867815+0000","last_active":"2024-09-12T00:38:53.867815+0000","last_peered":"2024-09-12T00:38:53.867815+0000","last_clean":"2024-09-12T00:38:53.867815+0000","last_became_active":"2024-09-12T00:01:59.146272+0000","last_became_peered":"2024-09-12T00:01:59.146272+0000","last_unstale":"2024-09-12T00:38:53.867815+0000","last_undegraded":"2024-09-12T00:38:53.867815+0000","last_fullsized":"2024-09-12T00:38:53.867815+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'205","last_scrub_stamp":"2024-09-12T00:38:53.867730+0000","last_deep_scrub":"261'205","last_deep_scrub_stamp":"2024-09-12T00:38:53.867730+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.867730+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:40.417582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":905,"num_read_kb":736,"num_write":324,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'329","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.276744+0000","last_change":"2024-09-12T00:38:55.276744+0000","last_active":"2024-09-12T00:38:55.276744+0000","last_peered":"2024-09-12T00:38:55.276744+0000","last_clean":"2024-09-12T00:38:55.276744+0000","last_became_active":"2024-09-12T00:01:57.165139+0000","last_became_peered":"2024-09-12T00:01:57.165139+0000","last_unstale":"2024-09-12T00:38:55.276744+0000","last_undegraded":"2024-09-12T00:38:55.276744+0000","last_fullsized":"2024-09-12T00:38:55.276744+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-12T00:38:55.276619+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-12T00:38:55.276619+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.276619+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:46.561228+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174794,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":34175,"num_write":1090,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'210","reported_seq":842,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.545408+0000","last_change":"2024-09-12T00:38:57.545408+0000","last_active":"2024-09-12T00:38:57.545408+0000","last_peered":"2024-09-12T00:38:57.545408+0000","last_clean":"2024-09-12T00:38:57.545408+0000","last_became_active":"2024-09-12T00:01:59.151627+0000","last_became_peered":"2024-09-12T00:01:59.151627+0000","last_unstale":"2024-09-12T00:38:57.545408+0000","last_undegraded":"2024-09-12T00:38:57.545408+0000","last_fullsized":"2024-09-12T00:38:57.545408+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'210","last_scrub_stamp":"2024-09-12T00:38:57.545317+0000","last_deep_scrub":"261'210","last_deep_scrub_stamp":"2024-09-12T00:38:57.545317+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.545317+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:03.981223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":886,"num_read_kb":742,"num_write":315,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'378","reported_seq":1223,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.759737+0000","last_change":"2024-09-12T00:38:47.759679+0000","last_active":"2024-09-12T00:38:47.759737+0000","last_peered":"2024-09-12T00:38:47.759737+0000","last_clean":"2024-09-12T00:38:47.759737+0000","last_became_active":"2024-09-12T00:01:57.151346+0000","last_became_peered":"2024-09-12T00:01:57.151346+0000","last_unstale":"2024-09-12T00:38:47.759737+0000","last_undegraded":"2024-09-12T00:38:47.759737+0000","last_fullsized":"2024-09-12T00:38:47.759737+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T00:38:47.759548+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T00:38:47.759548+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.759548+0000","objects_scrubbed":14,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:22.136361+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":958,"num_read_kb":6741,"num_write":1200,"num_write_kb":13731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'4140","reported_seq":4720,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.378785+0000","last_change":"2024-09-12T00:38:52.378714+0000","last_active":"2024-09-12T00:38:52.378785+0000","last_peered":"2024-09-12T00:38:52.378785+0000","last_clean":"2024-09-12T00:38:52.378785+0000","last_became_active":"2024-09-12T00:01:59.157873+0000","last_became_peered":"2024-09-12T00:01:59.157873+0000","last_unstale":"2024-09-12T00:38:52.378785+0000","last_undegraded":"2024-09-12T00:38:52.378785+0000","last_fullsized":"2024-09-12T00:38:52.378785+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4140","last_scrub_stamp":"2024-09-12T00:38:52.378628+0000","last_deep_scrub":"261'4140","last_deep_scrub_stamp":"2024-09-12T00:38:52.378628+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.378628+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:17.479490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16645,"num_read_kb":13962,"num_write":6214,"num_write_kb":3111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'347","reported_seq":1038,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.198324+0000","last_change":"2024-09-12T00:38:57.198261+0000","last_active":"2024-09-12T00:38:57.198324+0000","last_peered":"2024-09-12T00:38:57.198324+0000","last_clean":"2024-09-12T00:38:57.198324+0000","last_became_active":"2024-09-12T00:01:57.165016+0000","last_became_peered":"2024-09-12T00:01:57.165016+0000","last_unstale":"2024-09-12T00:38:57.198324+0000","last_undegraded":"2024-09-12T00:38:57.198324+0000","last_fullsized":"2024-09-12T00:38:57.198324+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'347","last_scrub_stamp":"2024-09-12T00:38:57.198110+0000","last_deep_scrub":"261'347","last_deep_scrub_stamp":"2024-09-12T00:38:57.198110+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.198110+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:33.940316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568671,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":600,"num_read_kb":10239,"num_write":1109,"num_write_kb":39602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'330","reported_seq":1035,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.167988+0000","last_change":"2024-09-12T00:38:58.167887+0000","last_active":"2024-09-12T00:38:58.167988+0000","last_peered":"2024-09-12T00:38:58.167988+0000","last_clean":"2024-09-12T00:38:58.167988+0000","last_became_active":"2024-09-12T00:01:57.165046+0000","last_became_peered":"2024-09-12T00:01:57.165046+0000","last_unstale":"2024-09-12T00:38:58.167988+0000","last_undegraded":"2024-09-12T00:38:58.167988+0000","last_fullsized":"2024-09-12T00:38:58.167988+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'330","last_scrub_stamp":"2024-09-12T00:38:58.167667+0000","last_deep_scrub":"261'330","last_deep_scrub_stamp":"2024-09-12T00:38:58.167667+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.167667+0000","objects_scrubbed":15,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:49.796703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8464405,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":613,"num_read_kb":41753,"num_write":993,"num_write_kb":31467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'110","reported_seq":719,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.565416+0000","last_change":"2024-09-12T00:38:58.565416+0000","last_active":"2024-09-12T00:38:58.565416+0000","last_peered":"2024-09-12T00:38:58.565416+0000","last_clean":"2024-09-12T00:38:58.565416+0000","last_became_active":"2024-09-12T00:01:59.153454+0000","last_became_peered":"2024-09-12T00:01:59.153454+0000","last_unstale":"2024-09-12T00:38:58.565416+0000","last_undegraded":"2024-09-12T00:38:58.565416+0000","last_fullsized":"2024-09-12T00:38:58.565416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'110","last_scrub_stamp":"2024-09-12T00:38:58.565298+0000","last_deep_scrub":"261'110","last_deep_scrub_stamp":"2024-09-12T00:38:58.565298+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.565298+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:54.941401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":439,"num_write":164,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'353","reported_seq":1209,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.787677+0000","last_change":"2024-09-12T00:38:54.787595+0000","last_active":"2024-09-12T00:38:54.787677+0000","last_peered":"2024-09-12T00:38:54.787677+0000","last_clean":"2024-09-12T00:38:54.787677+0000","last_became_active":"2024-09-12T00:01:57.146320+0000","last_became_peered":"2024-09-12T00:01:57.146320+0000","last_unstale":"2024-09-12T00:38:54.787677+0000","last_undegraded":"2024-09-12T00:38:54.787677+0000","last_fullsized":"2024-09-12T00:38:54.787677+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T00:38:54.787503+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T00:38:54.787503+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.787503+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:52.554107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":988,"num_read_kb":6700,"num_write":1181,"num_write_kb":43058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'174","reported_seq":777,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.462924+0000","last_change":"2024-09-12T00:38:50.462924+0000","last_active":"2024-09-12T00:38:50.462924+0000","last_peered":"2024-09-12T00:38:50.462924+0000","last_clean":"2024-09-12T00:38:50.462924+0000","last_became_active":"2024-09-12T00:01:59.146876+0000","last_became_peered":"2024-09-12T00:01:59.146876+0000","last_unstale":"2024-09-12T00:38:50.462924+0000","last_undegraded":"2024-09-12T00:38:50.462924+0000","last_fullsized":"2024-09-12T00:38:50.462924+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'174","last_scrub_stamp":"2024-09-12T00:38:50.462833+0000","last_deep_scrub":"261'174","last_deep_scrub_stamp":"2024-09-12T00:38:50.462833+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.462833+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:16.424671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":808,"num_read_kb":667,"num_write":271,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5901,"num_read_kb":4223,"num_write":1957,"num_write_kb":855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2340,"num_omap_keys":5,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1030,"ondisk_log_size":1030,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":14998,"num_read_kb":14670,"num_write":16815,"num_write_kb":4907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2683,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1553,"ondisk_log_size":1553,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":583,"ondisk_log_size":583,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1554453,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17205,"num_read_kb":36338,"num_write":14367,"num_write_kb":11412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":680986,"num_omap_keys":1552,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2157,"ondisk_log_size":2157,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102638,"num_read_kb":85737,"num_write":37205,"num_write_kb":18751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43802,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3987,"ondisk_log_size":3987,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":86840172,"num_objects":366,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":36012,"num_read_kb":1881303,"num_write":71771,"num_write_kb":2075118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":118292480,"data_stored":118292480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3738,"ondisk_log_size":3738,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":208372,"num_write":160,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":193338,"num_write":160,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509901,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":223704,"kb_used_data":12104,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":94148136,"statfs":{"total":96636764160,"available":96407691264,"internally_reserved":0,"allocated":12394496,"data_stored":10437918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":216660426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509900,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121100,"kb_used_data":17788,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94250740,"statfs":{"total":96636764160,"available":96512757760,"internally_reserved":0,"allocated":18214912,"data_stored":16235382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509902,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256424,"kb_used_data":12824,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94115416,"statfs":{"total":96636764160,"available":96374185984,"internally_reserved":0,"allocated":13131776,"data_stored":11163018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249428421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509900,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239340,"kb_used_data":19356,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94132500,"statfs":{"total":96636764160,"available":96391680000,"internally_reserved":0,"allocated":19820544,"data_stored":17855512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":225245639},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509902,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143280,"kb_used_data":26016,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94228560,"statfs":{"total":96636764160,"available":96490045440,"internally_reserved":0,"allocated":26640384,"data_stored":24664481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509901,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136728,"kb_used_data":19528,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94235112,"statfs":{"total":96636764160,"available":96496754688,"internally_reserved":0,"allocated":19996672,"data_stored":18028066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575307,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":237916,"kb_used_data":26316,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":94133924,"statfs":{"total":96636764160,"available":96393138176,"internally_reserved":0,"allocated":26947584,"data_stored":25004229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216660421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575309,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":343556,"kb_used_data":15284,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94028284,"statfs":{"total":96636764160,"available":96284962816,"internally_reserved":0,"allocated":15650816,"data_stored":13693364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15826944,"data_stored":15826944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10903552,"data_stored":10903552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22462464,"data_stored":22462464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15654912,"data_stored":15654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22802432,"data_stored":22802432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8372224,"data_stored":8372224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14032896,"data_stored":14032896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8237056,"data_stored":8237056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:39:46.478 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:16:59.153582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:46.479 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:46.479 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:46.479 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:46.479 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:17:02.180677+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:46.481 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:27:16.542944+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=27, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=38, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:39:46.484 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:40:06.486 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:40:06.843 INFO:teuthology.orchestra.run.smithi067.stdout: 2024-09-12T00:40:06.855 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2024-09-12T00:40:06.858 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":1408,"stamp":"2024-09-12T00:40:05.666895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":89002200,"num_objects":716,"num_object_clones":0,"num_object_copies":2164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":716,"num_whiteouts":0,"num_read":179516,"num_read_kb":2426911,"num_write":142578,"num_write_kb":2382623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":730939,"num_omap_keys":1762,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13357,"ondisk_log_size":13357,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1702048,"kb_used_data":149216,"kb_used_omap":12,"kb_used_meta":1552691,"kb_avail":753272672,"statfs":{"total":773094113280,"available":771351216128,"internally_reserved":0,"allocated":152797184,"data_stored":137081970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1589956144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005045"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.282322+0000","last_change":"2024-09-12T00:39:20.282207+0000","last_active":"2024-09-12T00:39:20.282322+0000","last_peered":"2024-09-12T00:39:20.282322+0000","last_clean":"2024-09-12T00:39:20.282322+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:39:20.282322+0000","last_undegraded":"2024-09-12T00:39:20.282322+0000","last_fullsized":"2024-09-12T00:39:20.282322+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:20.282107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:20.282107+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.282107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:02.419166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"261'10","reported_seq":57,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.368874+0000","last_change":"2024-09-12T00:39:19.368762+0000","last_active":"2024-09-12T00:39:19.368874+0000","last_peered":"2024-09-12T00:39:19.368874+0000","last_clean":"2024-09-12T00:39:19.368874+0000","last_became_active":"2024-09-12T00:17:03.213906+0000","last_became_peered":"2024-09-12T00:17:03.213906+0000","last_unstale":"2024-09-12T00:39:19.368874+0000","last_undegraded":"2024-09-12T00:39:19.368874+0000","last_fullsized":"2024-09-12T00:39:19.368874+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'10","last_scrub_stamp":"2024-09-12T00:39:19.368659+0000","last_deep_scrub":"261'10","last_deep_scrub_stamp":"2024-09-12T00:39:19.368659+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.368659+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:36.783100+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":18831,"num_write":10,"num_write_kb":11989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.047417+0000","last_change":"2024-09-12T00:39:22.047359+0000","last_active":"2024-09-12T00:39:22.047417+0000","last_peered":"2024-09-12T00:39:22.047417+0000","last_clean":"2024-09-12T00:39:22.047417+0000","last_became_active":"2024-09-12T00:17:00.182510+0000","last_became_peered":"2024-09-12T00:17:00.182510+0000","last_unstale":"2024-09-12T00:39:22.047417+0000","last_undegraded":"2024-09-12T00:39:22.047417+0000","last_fullsized":"2024-09-12T00:39:22.047417+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:22.047271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:22.047271+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.047271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:40.094437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"261'18","reported_seq":99,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:24.577254+0000","last_change":"2024-09-12T00:39:24.577254+0000","last_active":"2024-09-12T00:39:24.577254+0000","last_peered":"2024-09-12T00:39:24.577254+0000","last_clean":"2024-09-12T00:39:24.577254+0000","last_became_active":"2024-09-12T00:15:34.415364+0000","last_became_peered":"2024-09-12T00:15:34.415364+0000","last_unstale":"2024-09-12T00:39:24.577254+0000","last_undegraded":"2024-09-12T00:39:24.577254+0000","last_fullsized":"2024-09-12T00:39:24.577254+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'18","last_scrub_stamp":"2024-09-12T00:39:24.577148+0000","last_deep_scrub":"261'18","last_deep_scrub_stamp":"2024-09-12T00:39:24.577148+0000","last_clean_scrub_stamp":"2024-09-12T00:39:24.577148+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:55.637554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":64,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:25.971425+0000","last_change":"2024-09-12T00:39:25.971370+0000","last_active":"2024-09-12T00:39:25.971425+0000","last_peered":"2024-09-12T00:39:25.971425+0000","last_clean":"2024-09-12T00:39:25.971425+0000","last_became_active":"2024-09-12T00:27:17.581520+0000","last_became_peered":"2024-09-12T00:27:17.581520+0000","last_unstale":"2024-09-12T00:39:25.971425+0000","last_undegraded":"2024-09-12T00:39:25.971425+0000","last_fullsized":"2024-09-12T00:39:25.971425+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.971281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.971281+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.971281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:11.187930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.103732+0000","last_change":"2024-09-12T00:39:22.103669+0000","last_active":"2024-09-12T00:39:22.103732+0000","last_peered":"2024-09-12T00:39:22.103732+0000","last_clean":"2024-09-12T00:39:22.103732+0000","last_became_active":"2024-09-12T00:17:03.206566+0000","last_became_peered":"2024-09-12T00:17:03.206566+0000","last_unstale":"2024-09-12T00:39:22.103732+0000","last_undegraded":"2024-09-12T00:39:22.103732+0000","last_fullsized":"2024-09-12T00:39:22.103732+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:22.103578+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:22.103578+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.103578+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:36.235087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"261'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:27.849035+0000","last_change":"2024-09-12T00:39:27.848945+0000","last_active":"2024-09-12T00:39:27.849035+0000","last_peered":"2024-09-12T00:39:27.849035+0000","last_clean":"2024-09-12T00:39:27.849035+0000","last_became_active":"2024-09-12T00:17:00.175196+0000","last_became_peered":"2024-09-12T00:17:00.175196+0000","last_unstale":"2024-09-12T00:39:27.849035+0000","last_undegraded":"2024-09-12T00:39:27.849035+0000","last_fullsized":"2024-09-12T00:39:27.849035+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:27.848821+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:27.848821+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.848821+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:04.930158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"261'76","reported_seq":286,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.561291+0000","last_change":"2024-09-12T00:39:23.561192+0000","last_active":"2024-09-12T00:39:23.561291+0000","last_peered":"2024-09-12T00:39:23.561291+0000","last_clean":"2024-09-12T00:39:23.561291+0000","last_became_active":"2024-09-12T00:15:34.416706+0000","last_became_peered":"2024-09-12T00:15:34.416706+0000","last_unstale":"2024-09-12T00:39:23.561291+0000","last_undegraded":"2024-09-12T00:39:23.561291+0000","last_fullsized":"2024-09-12T00:39:23.561291+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'76","last_scrub_stamp":"2024-09-12T00:39:23.561057+0000","last_deep_scrub":"261'76","last_deep_scrub_stamp":"2024-09-12T00:39:23.561057+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.561057+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:20.628848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":462,"num_read_kb":331,"num_write":93,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2340,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.430734+0000","last_change":"2024-09-12T00:39:22.430734+0000","last_active":"2024-09-12T00:39:22.430734+0000","last_peered":"2024-09-12T00:39:22.430734+0000","last_clean":"2024-09-12T00:39:22.430734+0000","last_became_active":"2024-09-12T00:27:17.572934+0000","last_became_peered":"2024-09-12T00:27:17.572934+0000","last_unstale":"2024-09-12T00:39:22.430734+0000","last_undegraded":"2024-09-12T00:39:22.430734+0000","last_fullsized":"2024-09-12T00:39:22.430734+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:22.430641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:22.430641+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.430641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:29.753060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"261'3","reported_seq":43,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:35.878213+0000","last_change":"2024-09-12T00:39:35.878152+0000","last_active":"2024-09-12T00:39:35.878213+0000","last_peered":"2024-09-12T00:39:35.878213+0000","last_clean":"2024-09-12T00:39:35.878213+0000","last_became_active":"2024-09-12T00:17:03.211755+0000","last_became_peered":"2024-09-12T00:17:03.211755+0000","last_unstale":"2024-09-12T00:39:35.878213+0000","last_undegraded":"2024-09-12T00:39:35.878213+0000","last_fullsized":"2024-09-12T00:39:35.878213+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:35.878057+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:35.878057+0000","last_clean_scrub_stamp":"2024-09-12T00:39:35.878057+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:29.247181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:25.036153+0000","last_change":"2024-09-12T00:39:25.036153+0000","last_active":"2024-09-12T00:39:25.036153+0000","last_peered":"2024-09-12T00:39:25.036153+0000","last_clean":"2024-09-12T00:39:25.036153+0000","last_became_active":"2024-09-12T00:17:00.181461+0000","last_became_peered":"2024-09-12T00:17:00.181461+0000","last_unstale":"2024-09-12T00:39:25.036153+0000","last_undegraded":"2024-09-12T00:39:25.036153+0000","last_fullsized":"2024-09-12T00:39:25.036153+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.036059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.036059+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.036059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:46.053672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"261'16","reported_seq":90,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.927488+0000","last_change":"2024-09-12T00:39:18.927488+0000","last_active":"2024-09-12T00:39:18.927488+0000","last_peered":"2024-09-12T00:39:18.927488+0000","last_clean":"2024-09-12T00:39:18.927488+0000","last_became_active":"2024-09-12T00:15:34.428023+0000","last_became_peered":"2024-09-12T00:15:34.428023+0000","last_unstale":"2024-09-12T00:39:18.927488+0000","last_undegraded":"2024-09-12T00:39:18.927488+0000","last_fullsized":"2024-09-12T00:39:18.927488+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'16","last_scrub_stamp":"2024-09-12T00:39:18.927402+0000","last_deep_scrub":"261'16","last_deep_scrub_stamp":"2024-09-12T00:39:18.927402+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.927402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:56.772211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":55,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:42.801928+0000","last_change":"2024-09-12T00:39:42.801928+0000","last_active":"2024-09-12T00:39:42.801928+0000","last_peered":"2024-09-12T00:39:42.801928+0000","last_clean":"2024-09-12T00:39:42.801928+0000","last_became_active":"2024-09-12T00:27:17.577034+0000","last_became_peered":"2024-09-12T00:27:17.577034+0000","last_unstale":"2024-09-12T00:39:42.801928+0000","last_undegraded":"2024-09-12T00:39:42.801928+0000","last_fullsized":"2024-09-12T00:39:42.801928+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:42.801808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:42.801808+0000","last_clean_scrub_stamp":"2024-09-12T00:39:42.801808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:28.280315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"261'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:34.829909+0000","last_change":"2024-09-12T00:39:34.829909+0000","last_active":"2024-09-12T00:39:34.829909+0000","last_peered":"2024-09-12T00:39:34.829909+0000","last_clean":"2024-09-12T00:39:34.829909+0000","last_became_active":"2024-09-12T00:17:03.209945+0000","last_became_peered":"2024-09-12T00:17:03.209945+0000","last_unstale":"2024-09-12T00:39:34.829909+0000","last_undegraded":"2024-09-12T00:39:34.829909+0000","last_fullsized":"2024-09-12T00:39:34.829909+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:34.829820+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:34.829820+0000","last_clean_scrub_stamp":"2024-09-12T00:39:34.829820+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:29.324698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.396089+0000","last_change":"2024-09-12T00:39:15.396026+0000","last_active":"2024-09-12T00:39:15.396089+0000","last_peered":"2024-09-12T00:39:15.396089+0000","last_clean":"2024-09-12T00:39:15.396089+0000","last_became_active":"2024-09-12T00:17:00.176151+0000","last_became_peered":"2024-09-12T00:17:00.176151+0000","last_unstale":"2024-09-12T00:39:15.396089+0000","last_undegraded":"2024-09-12T00:39:15.396089+0000","last_fullsized":"2024-09-12T00:39:15.396089+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:15.395938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:15.395938+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.395938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:59.127563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"261'69","reported_seq":237,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.973168+0000","last_change":"2024-09-12T00:39:17.973168+0000","last_active":"2024-09-12T00:39:17.973168+0000","last_peered":"2024-09-12T00:39:17.973168+0000","last_clean":"2024-09-12T00:39:17.973168+0000","last_became_active":"2024-09-12T00:15:34.422426+0000","last_became_peered":"2024-09-12T00:15:34.422426+0000","last_unstale":"2024-09-12T00:39:17.973168+0000","last_undegraded":"2024-09-12T00:39:17.973168+0000","last_fullsized":"2024-09-12T00:39:17.973168+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'69","last_scrub_stamp":"2024-09-12T00:39:17.973075+0000","last_deep_scrub":"261'69","last_deep_scrub_stamp":"2024-09-12T00:39:17.973075+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.973075+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:24.383265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":354,"num_read_kb":254,"num_write":121,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:32.963637+0000","last_change":"2024-09-12T00:39:32.963637+0000","last_active":"2024-09-12T00:39:32.963637+0000","last_peered":"2024-09-12T00:39:32.963637+0000","last_clean":"2024-09-12T00:39:32.963637+0000","last_became_active":"2024-09-12T00:27:17.579540+0000","last_became_peered":"2024-09-12T00:27:17.579540+0000","last_unstale":"2024-09-12T00:39:32.963637+0000","last_undegraded":"2024-09-12T00:39:32.963637+0000","last_fullsized":"2024-09-12T00:39:32.963637+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:32.963544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:32.963544+0000","last_clean_scrub_stamp":"2024-09-12T00:39:32.963544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:13.555712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"258'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.300900+0000","last_change":"2024-09-12T00:39:16.300900+0000","last_active":"2024-09-12T00:39:16.300900+0000","last_peered":"2024-09-12T00:39:16.300900+0000","last_clean":"2024-09-12T00:39:16.300900+0000","last_became_active":"2024-09-12T00:17:03.218684+0000","last_became_peered":"2024-09-12T00:17:03.218684+0000","last_unstale":"2024-09-12T00:39:16.300900+0000","last_undegraded":"2024-09-12T00:39:16.300900+0000","last_fullsized":"2024-09-12T00:39:16.300900+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T00:39:16.300799+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T00:39:16.300799+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.300799+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:40.707352+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"261'18","reported_seq":82,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:26.880444+0000","last_change":"2024-09-12T00:39:26.880444+0000","last_active":"2024-09-12T00:39:26.880444+0000","last_peered":"2024-09-12T00:39:26.880444+0000","last_clean":"2024-09-12T00:39:26.880444+0000","last_became_active":"2024-09-12T00:17:00.185974+0000","last_became_peered":"2024-09-12T00:17:00.185974+0000","last_unstale":"2024-09-12T00:39:26.880444+0000","last_undegraded":"2024-09-12T00:39:26.880444+0000","last_fullsized":"2024-09-12T00:39:26.880444+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'18","last_scrub_stamp":"2024-09-12T00:39:26.880313+0000","last_deep_scrub":"261'18","last_deep_scrub_stamp":"2024-09-12T00:39:26.880313+0000","last_clean_scrub_stamp":"2024-09-12T00:39:26.880313+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:29.342810+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":38916,"num_write":33,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"261'44","reported_seq":163,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.978260+0000","last_change":"2024-09-12T00:39:15.978260+0000","last_active":"2024-09-12T00:39:15.978260+0000","last_peered":"2024-09-12T00:39:15.978260+0000","last_clean":"2024-09-12T00:39:15.978260+0000","last_became_active":"2024-09-12T00:15:34.423149+0000","last_became_peered":"2024-09-12T00:15:34.423149+0000","last_unstale":"2024-09-12T00:39:15.978260+0000","last_undegraded":"2024-09-12T00:39:15.978260+0000","last_fullsized":"2024-09-12T00:39:15.978260+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'44","last_scrub_stamp":"2024-09-12T00:39:15.978169+0000","last_deep_scrub":"261'44","last_deep_scrub_stamp":"2024-09-12T00:39:15.978169+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.978169+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:01.886044+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":150,"num_write":87,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:29.487236+0000","last_change":"2024-09-12T00:39:29.487128+0000","last_active":"2024-09-12T00:39:29.487236+0000","last_peered":"2024-09-12T00:39:29.487236+0000","last_clean":"2024-09-12T00:39:29.487236+0000","last_became_active":"2024-09-12T00:27:17.575513+0000","last_became_peered":"2024-09-12T00:27:17.575513+0000","last_unstale":"2024-09-12T00:39:29.487236+0000","last_undegraded":"2024-09-12T00:39:29.487236+0000","last_fullsized":"2024-09-12T00:39:29.487236+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:29.487023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:29.487023+0000","last_clean_scrub_stamp":"2024-09-12T00:39:29.487023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:16.420719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:43.987114+0000","last_change":"2024-09-12T00:39:43.987114+0000","last_active":"2024-09-12T00:39:43.987114+0000","last_peered":"2024-09-12T00:39:43.987114+0000","last_clean":"2024-09-12T00:39:43.987114+0000","last_became_active":"2024-09-12T00:17:03.219058+0000","last_became_peered":"2024-09-12T00:17:03.219058+0000","last_unstale":"2024-09-12T00:39:43.987114+0000","last_undegraded":"2024-09-12T00:39:43.987114+0000","last_fullsized":"2024-09-12T00:39:43.987114+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:43.987017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:43.987017+0000","last_clean_scrub_stamp":"2024-09-12T00:39:43.987017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:52.568868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:47.036446+0000","last_change":"2024-09-12T00:39:47.036446+0000","last_active":"2024-09-12T00:39:47.036446+0000","last_peered":"2024-09-12T00:39:47.036446+0000","last_clean":"2024-09-12T00:39:47.036446+0000","last_became_active":"2024-09-12T00:17:00.182830+0000","last_became_peered":"2024-09-12T00:17:00.182830+0000","last_unstale":"2024-09-12T00:39:47.036446+0000","last_undegraded":"2024-09-12T00:39:47.036446+0000","last_fullsized":"2024-09-12T00:39:47.036446+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:47.036328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:47.036328+0000","last_clean_scrub_stamp":"2024-09-12T00:39:47.036328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:44.632829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"261'10","reported_seq":75,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.154400+0000","last_change":"2024-09-12T00:39:16.154400+0000","last_active":"2024-09-12T00:39:16.154400+0000","last_peered":"2024-09-12T00:39:16.154400+0000","last_clean":"2024-09-12T00:39:16.154400+0000","last_became_active":"2024-09-12T00:15:34.420841+0000","last_became_peered":"2024-09-12T00:15:34.420841+0000","last_unstale":"2024-09-12T00:39:16.154400+0000","last_undegraded":"2024-09-12T00:39:16.154400+0000","last_fullsized":"2024-09-12T00:39:16.154400+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'10","last_scrub_stamp":"2024-09-12T00:39:16.154315+0000","last_deep_scrub":"261'10","last_deep_scrub_stamp":"2024-09-12T00:39:16.154315+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.154315+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:36.510847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:24.179619+0000","last_change":"2024-09-12T00:39:24.179565+0000","last_active":"2024-09-12T00:39:24.179619+0000","last_peered":"2024-09-12T00:39:24.179619+0000","last_clean":"2024-09-12T00:39:24.179619+0000","last_became_active":"2024-09-12T00:27:17.583300+0000","last_became_peered":"2024-09-12T00:27:17.583300+0000","last_unstale":"2024-09-12T00:39:24.179619+0000","last_undegraded":"2024-09-12T00:39:24.179619+0000","last_fullsized":"2024-09-12T00:39:24.179619+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:24.179468+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:24.179468+0000","last_clean_scrub_stamp":"2024-09-12T00:39:24.179468+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:24.077004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.071425+0000","last_change":"2024-09-12T00:39:20.071341+0000","last_active":"2024-09-12T00:39:20.071425+0000","last_peered":"2024-09-12T00:39:20.071425+0000","last_clean":"2024-09-12T00:39:20.071425+0000","last_became_active":"2024-09-12T00:17:03.211869+0000","last_became_peered":"2024-09-12T00:17:03.211869+0000","last_unstale":"2024-09-12T00:39:20.071425+0000","last_undegraded":"2024-09-12T00:39:20.071425+0000","last_fullsized":"2024-09-12T00:39:20.071425+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:20.071249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:20.071249+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.071249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:22.469297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.223575+0000","last_change":"2024-09-12T00:39:12.223498+0000","last_active":"2024-09-12T00:39:12.223575+0000","last_peered":"2024-09-12T00:39:12.223575+0000","last_clean":"2024-09-12T00:39:12.223575+0000","last_became_active":"2024-09-12T00:17:00.180995+0000","last_became_peered":"2024-09-12T00:17:00.180995+0000","last_unstale":"2024-09-12T00:39:12.223575+0000","last_undegraded":"2024-09-12T00:39:12.223575+0000","last_fullsized":"2024-09-12T00:39:12.223575+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:12.223413+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:12.223413+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.223413+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:57.095258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"261'23","reported_seq":110,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.061029+0000","last_change":"2024-09-12T00:39:16.060964+0000","last_active":"2024-09-12T00:39:16.061029+0000","last_peered":"2024-09-12T00:39:16.061029+0000","last_clean":"2024-09-12T00:39:16.061029+0000","last_became_active":"2024-09-12T00:15:34.417149+0000","last_became_peered":"2024-09-12T00:15:34.417149+0000","last_unstale":"2024-09-12T00:39:16.061029+0000","last_undegraded":"2024-09-12T00:39:16.061029+0000","last_fullsized":"2024-09-12T00:39:16.061029+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'23","last_scrub_stamp":"2024-09-12T00:39:16.060880+0000","last_deep_scrub":"261'23","last_deep_scrub_stamp":"2024-09-12T00:39:16.060880+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.060880+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:52.936909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":79,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.325457+0000","last_change":"2024-09-12T00:39:22.325383+0000","last_active":"2024-09-12T00:39:22.325457+0000","last_peered":"2024-09-12T00:39:22.325457+0000","last_clean":"2024-09-12T00:39:22.325457+0000","last_became_active":"2024-09-12T00:27:17.578739+0000","last_became_peered":"2024-09-12T00:27:17.578739+0000","last_unstale":"2024-09-12T00:39:22.325457+0000","last_undegraded":"2024-09-12T00:39:22.325457+0000","last_fullsized":"2024-09-12T00:39:22.325457+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:22.325281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:22.325281+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.325281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:07.198322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"261'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:29.988391+0000","last_change":"2024-09-12T00:39:29.988335+0000","last_active":"2024-09-12T00:39:29.988391+0000","last_peered":"2024-09-12T00:39:29.988391+0000","last_clean":"2024-09-12T00:39:29.988391+0000","last_became_active":"2024-09-12T00:17:03.213071+0000","last_became_peered":"2024-09-12T00:17:03.213071+0000","last_unstale":"2024-09-12T00:39:29.988391+0000","last_undegraded":"2024-09-12T00:39:29.988391+0000","last_fullsized":"2024-09-12T00:39:29.988391+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:29.988246+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:29.988246+0000","last_clean_scrub_stamp":"2024-09-12T00:39:29.988246+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:46.255406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.949710+0000","last_change":"2024-09-12T00:39:21.949645+0000","last_active":"2024-09-12T00:39:21.949710+0000","last_peered":"2024-09-12T00:39:21.949710+0000","last_clean":"2024-09-12T00:39:21.949710+0000","last_became_active":"2024-09-12T00:17:00.178279+0000","last_became_peered":"2024-09-12T00:17:00.178279+0000","last_unstale":"2024-09-12T00:39:21.949710+0000","last_undegraded":"2024-09-12T00:39:21.949710+0000","last_fullsized":"2024-09-12T00:39:21.949710+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:21.949558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:21.949558+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.949558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:32.421262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"261'24","reported_seq":113,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.931195+0000","last_change":"2024-09-12T00:39:16.931136+0000","last_active":"2024-09-12T00:39:16.931195+0000","last_peered":"2024-09-12T00:39:16.931195+0000","last_clean":"2024-09-12T00:39:16.931195+0000","last_became_active":"2024-09-12T00:15:34.420120+0000","last_became_peered":"2024-09-12T00:15:34.420120+0000","last_unstale":"2024-09-12T00:39:16.931195+0000","last_undegraded":"2024-09-12T00:39:16.931195+0000","last_fullsized":"2024-09-12T00:39:16.931195+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'24","last_scrub_stamp":"2024-09-12T00:39:16.931040+0000","last_deep_scrub":"261'24","last_deep_scrub_stamp":"2024-09-12T00:39:16.931040+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.931040+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:15.253627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":45,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:39.834835+0000","last_change":"2024-09-12T00:39:39.834835+0000","last_active":"2024-09-12T00:39:39.834835+0000","last_peered":"2024-09-12T00:39:39.834835+0000","last_clean":"2024-09-12T00:39:39.834835+0000","last_became_active":"2024-09-12T00:27:17.577671+0000","last_became_peered":"2024-09-12T00:27:17.577671+0000","last_unstale":"2024-09-12T00:39:39.834835+0000","last_undegraded":"2024-09-12T00:39:39.834835+0000","last_fullsized":"2024-09-12T00:39:39.834835+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:39.834735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:39.834735+0000","last_clean_scrub_stamp":"2024-09-12T00:39:39.834735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:05.391219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:28.021083+0000","last_change":"2024-09-12T00:39:28.021083+0000","last_active":"2024-09-12T00:39:28.021083+0000","last_peered":"2024-09-12T00:39:28.021083+0000","last_clean":"2024-09-12T00:39:28.021083+0000","last_became_active":"2024-09-12T00:17:03.213775+0000","last_became_peered":"2024-09-12T00:17:03.213775+0000","last_unstale":"2024-09-12T00:39:28.021083+0000","last_undegraded":"2024-09-12T00:39:28.021083+0000","last_fullsized":"2024-09-12T00:39:28.021083+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:28.020979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:28.020979+0000","last_clean_scrub_stamp":"2024-09-12T00:39:28.020979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:47.649123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"261'6","reported_seq":54,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:43.007750+0000","last_change":"2024-09-12T00:39:43.007750+0000","last_active":"2024-09-12T00:39:43.007750+0000","last_peered":"2024-09-12T00:39:43.007750+0000","last_clean":"2024-09-12T00:39:43.007750+0000","last_became_active":"2024-09-12T00:17:00.182842+0000","last_became_peered":"2024-09-12T00:17:00.182842+0000","last_unstale":"2024-09-12T00:39:43.007750+0000","last_undegraded":"2024-09-12T00:39:43.007750+0000","last_fullsized":"2024-09-12T00:39:43.007750+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T00:39:43.007649+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T00:39:43.007649+0000","last_clean_scrub_stamp":"2024-09-12T00:39:43.007649+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:48.254904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"261'14","reported_seq":86,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.608806+0000","last_change":"2024-09-12T00:39:22.608728+0000","last_active":"2024-09-12T00:39:22.608806+0000","last_peered":"2024-09-12T00:39:22.608806+0000","last_clean":"2024-09-12T00:39:22.608806+0000","last_became_active":"2024-09-12T00:15:34.421585+0000","last_became_peered":"2024-09-12T00:15:34.421585+0000","last_unstale":"2024-09-12T00:39:22.608806+0000","last_undegraded":"2024-09-12T00:39:22.608806+0000","last_fullsized":"2024-09-12T00:39:22.608806+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'14","last_scrub_stamp":"2024-09-12T00:39:22.608648+0000","last_deep_scrub":"261'14","last_deep_scrub_stamp":"2024-09-12T00:39:22.608648+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.608648+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:32.898916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":46,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.952052+0000","last_change":"2024-09-12T00:39:23.952052+0000","last_active":"2024-09-12T00:39:23.952052+0000","last_peered":"2024-09-12T00:39:23.952052+0000","last_clean":"2024-09-12T00:39:23.952052+0000","last_became_active":"2024-09-12T00:27:17.572899+0000","last_became_peered":"2024-09-12T00:27:17.572899+0000","last_unstale":"2024-09-12T00:39:23.952052+0000","last_undegraded":"2024-09-12T00:39:23.952052+0000","last_fullsized":"2024-09-12T00:39:23.952052+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:23.951961+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:23.951961+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.951961+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:01.714398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:33.799368+0000","last_change":"2024-09-12T00:39:33.799368+0000","last_active":"2024-09-12T00:39:33.799368+0000","last_peered":"2024-09-12T00:39:33.799368+0000","last_clean":"2024-09-12T00:39:33.799368+0000","last_became_active":"2024-09-12T00:17:03.217052+0000","last_became_peered":"2024-09-12T00:17:03.217052+0000","last_unstale":"2024-09-12T00:39:33.799368+0000","last_undegraded":"2024-09-12T00:39:33.799368+0000","last_fullsized":"2024-09-12T00:39:33.799368+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:33.799279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:33.799279+0000","last_clean_scrub_stamp":"2024-09-12T00:39:33.799279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:57.298081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.212364+0000","last_change":"2024-09-12T00:39:11.212364+0000","last_active":"2024-09-12T00:39:11.212364+0000","last_peered":"2024-09-12T00:39:11.212364+0000","last_clean":"2024-09-12T00:39:11.212364+0000","last_became_active":"2024-09-12T00:17:00.181082+0000","last_became_peered":"2024-09-12T00:17:00.181082+0000","last_unstale":"2024-09-12T00:39:11.212364+0000","last_undegraded":"2024-09-12T00:39:11.212364+0000","last_fullsized":"2024-09-12T00:39:11.212364+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:11.212247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:11.212247+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.212247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:13.398319+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"261'32","reported_seq":136,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.610112+0000","last_change":"2024-09-12T00:39:21.610029+0000","last_active":"2024-09-12T00:39:21.610112+0000","last_peered":"2024-09-12T00:39:21.610112+0000","last_clean":"2024-09-12T00:39:21.610112+0000","last_became_active":"2024-09-12T00:15:34.413875+0000","last_became_peered":"2024-09-12T00:15:34.413875+0000","last_unstale":"2024-09-12T00:39:21.610112+0000","last_undegraded":"2024-09-12T00:39:21.610112+0000","last_fullsized":"2024-09-12T00:39:21.610112+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'32","last_scrub_stamp":"2024-09-12T00:39:21.609933+0000","last_deep_scrub":"261'32","last_deep_scrub_stamp":"2024-09-12T00:39:21.609933+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.609933+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:57.723093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":113,"num_write":63,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:27.071879+0000","last_change":"2024-09-12T00:39:27.071879+0000","last_active":"2024-09-12T00:39:27.071879+0000","last_peered":"2024-09-12T00:39:27.071879+0000","last_clean":"2024-09-12T00:39:27.071879+0000","last_became_active":"2024-09-12T00:27:17.576878+0000","last_became_peered":"2024-09-12T00:27:17.576878+0000","last_unstale":"2024-09-12T00:39:27.071879+0000","last_undegraded":"2024-09-12T00:39:27.071879+0000","last_fullsized":"2024-09-12T00:39:27.071879+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.071775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.071775+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.071775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:54.807735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:29.005220+0000","last_change":"2024-09-12T00:39:29.005220+0000","last_active":"2024-09-12T00:39:29.005220+0000","last_peered":"2024-09-12T00:39:29.005220+0000","last_clean":"2024-09-12T00:39:29.005220+0000","last_became_active":"2024-09-12T00:17:03.215625+0000","last_became_peered":"2024-09-12T00:17:03.215625+0000","last_unstale":"2024-09-12T00:39:29.005220+0000","last_undegraded":"2024-09-12T00:39:29.005220+0000","last_fullsized":"2024-09-12T00:39:29.005220+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:29.005129+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:29.005129+0000","last_clean_scrub_stamp":"2024-09-12T00:39:29.005129+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:51.430342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.057043+0000","last_change":"2024-09-12T00:39:21.057043+0000","last_active":"2024-09-12T00:39:21.057043+0000","last_peered":"2024-09-12T00:39:21.057043+0000","last_clean":"2024-09-12T00:39:21.057043+0000","last_became_active":"2024-09-12T00:17:00.182392+0000","last_became_peered":"2024-09-12T00:17:00.182392+0000","last_unstale":"2024-09-12T00:39:21.057043+0000","last_undegraded":"2024-09-12T00:39:21.057043+0000","last_fullsized":"2024-09-12T00:39:21.057043+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:21.056958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:21.056958+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.056958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.276177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"261'27","reported_seq":123,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.023977+0000","last_change":"2024-09-12T00:39:15.023909+0000","last_active":"2024-09-12T00:39:15.023977+0000","last_peered":"2024-09-12T00:39:15.023977+0000","last_clean":"2024-09-12T00:39:15.023977+0000","last_became_active":"2024-09-12T00:15:34.419377+0000","last_became_peered":"2024-09-12T00:15:34.419377+0000","last_unstale":"2024-09-12T00:39:15.023977+0000","last_undegraded":"2024-09-12T00:39:15.023977+0000","last_fullsized":"2024-09-12T00:39:15.023977+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'27","last_scrub_stamp":"2024-09-12T00:39:15.023824+0000","last_deep_scrub":"261'27","last_deep_scrub_stamp":"2024-09-12T00:39:15.023824+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.023824+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:56.671649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.301615+0000","last_change":"2024-09-12T00:39:19.301615+0000","last_active":"2024-09-12T00:39:19.301615+0000","last_peered":"2024-09-12T00:39:19.301615+0000","last_clean":"2024-09-12T00:39:19.301615+0000","last_became_active":"2024-09-12T00:27:17.580400+0000","last_became_peered":"2024-09-12T00:27:17.580400+0000","last_unstale":"2024-09-12T00:39:19.301615+0000","last_undegraded":"2024-09-12T00:39:19.301615+0000","last_fullsized":"2024-09-12T00:39:19.301615+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:19.301514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:19.301514+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.301514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:10.691672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"258'5","reported_seq":51,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.302196+0000","last_change":"2024-09-12T00:39:15.302196+0000","last_active":"2024-09-12T00:39:15.302196+0000","last_peered":"2024-09-12T00:39:15.302196+0000","last_clean":"2024-09-12T00:39:15.302196+0000","last_became_active":"2024-09-12T00:17:03.223700+0000","last_became_peered":"2024-09-12T00:17:03.223700+0000","last_unstale":"2024-09-12T00:39:15.302196+0000","last_undegraded":"2024-09-12T00:39:15.302196+0000","last_fullsized":"2024-09-12T00:39:15.302196+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'5","last_scrub_stamp":"2024-09-12T00:39:15.302095+0000","last_deep_scrub":"258'5","last_deep_scrub_stamp":"2024-09-12T00:39:15.302095+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.302095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:40.693894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:25.868555+0000","last_change":"2024-09-12T00:39:25.868555+0000","last_active":"2024-09-12T00:39:25.868555+0000","last_peered":"2024-09-12T00:39:25.868555+0000","last_clean":"2024-09-12T00:39:25.868555+0000","last_became_active":"2024-09-12T00:17:00.169797+0000","last_became_peered":"2024-09-12T00:17:00.169797+0000","last_unstale":"2024-09-12T00:39:25.868555+0000","last_undegraded":"2024-09-12T00:39:25.868555+0000","last_fullsized":"2024-09-12T00:39:25.868555+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.868460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.868460+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.868460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:44.339341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"261'40","reported_seq":160,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:36.005783+0000","last_change":"2024-09-12T00:39:36.005783+0000","last_active":"2024-09-12T00:39:36.005783+0000","last_peered":"2024-09-12T00:39:36.005783+0000","last_clean":"2024-09-12T00:39:36.005783+0000","last_became_active":"2024-09-12T00:15:34.422176+0000","last_became_peered":"2024-09-12T00:15:34.422176+0000","last_unstale":"2024-09-12T00:39:36.005783+0000","last_undegraded":"2024-09-12T00:39:36.005783+0000","last_fullsized":"2024-09-12T00:39:36.005783+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'40","last_scrub_stamp":"2024-09-12T00:39:36.005690+0000","last_deep_scrub":"261'40","last_deep_scrub_stamp":"2024-09-12T00:39:36.005690+0000","last_clean_scrub_stamp":"2024-09-12T00:39:36.005690+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:08.715897+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":149,"num_write":70,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:41.841598+0000","last_change":"2024-09-12T00:39:41.841598+0000","last_active":"2024-09-12T00:39:41.841598+0000","last_peered":"2024-09-12T00:39:41.841598+0000","last_clean":"2024-09-12T00:39:41.841598+0000","last_became_active":"2024-09-12T00:27:17.579646+0000","last_became_peered":"2024-09-12T00:27:17.579646+0000","last_unstale":"2024-09-12T00:39:41.841598+0000","last_undegraded":"2024-09-12T00:39:41.841598+0000","last_fullsized":"2024-09-12T00:39:41.841598+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:41.841502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:41.841502+0000","last_clean_scrub_stamp":"2024-09-12T00:39:41.841502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:45.365784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"261'6","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:31.809675+0000","last_change":"2024-09-12T00:39:31.809675+0000","last_active":"2024-09-12T00:39:31.809675+0000","last_peered":"2024-09-12T00:39:31.809675+0000","last_clean":"2024-09-12T00:39:31.809675+0000","last_became_active":"2024-09-12T00:17:03.211732+0000","last_became_peered":"2024-09-12T00:17:03.211732+0000","last_unstale":"2024-09-12T00:39:31.809675+0000","last_undegraded":"2024-09-12T00:39:31.809675+0000","last_fullsized":"2024-09-12T00:39:31.809675+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T00:39:31.809584+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T00:39:31.809584+0000","last_clean_scrub_stamp":"2024-09-12T00:39:31.809584+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:52.272821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"258'3","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.396472+0000","last_change":"2024-09-12T00:39:13.396472+0000","last_active":"2024-09-12T00:39:13.396472+0000","last_peered":"2024-09-12T00:39:13.396472+0000","last_clean":"2024-09-12T00:39:13.396472+0000","last_became_active":"2024-09-12T00:17:00.175460+0000","last_became_peered":"2024-09-12T00:17:00.175460+0000","last_unstale":"2024-09-12T00:39:13.396472+0000","last_undegraded":"2024-09-12T00:39:13.396472+0000","last_fullsized":"2024-09-12T00:39:13.396472+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T00:39:13.396374+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T00:39:13.396374+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.396374+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:35.156823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"261'37","reported_seq":141,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:33.966048+0000","last_change":"2024-09-12T00:39:33.966048+0000","last_active":"2024-09-12T00:39:33.966048+0000","last_peered":"2024-09-12T00:39:33.966048+0000","last_clean":"2024-09-12T00:39:33.966048+0000","last_became_active":"2024-09-12T00:15:34.423734+0000","last_became_peered":"2024-09-12T00:15:34.423734+0000","last_unstale":"2024-09-12T00:39:33.966048+0000","last_undegraded":"2024-09-12T00:39:33.966048+0000","last_fullsized":"2024-09-12T00:39:33.966048+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'37","last_scrub_stamp":"2024-09-12T00:39:33.965960+0000","last_deep_scrub":"261'37","last_deep_scrub_stamp":"2024-09-12T00:39:33.965960+0000","last_clean_scrub_stamp":"2024-09-12T00:39:33.965960+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:38.158176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":116,"num_write":72,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:26.978506+0000","last_change":"2024-09-12T00:39:26.978506+0000","last_active":"2024-09-12T00:39:26.978506+0000","last_peered":"2024-09-12T00:39:26.978506+0000","last_clean":"2024-09-12T00:39:26.978506+0000","last_became_active":"2024-09-12T00:27:17.574346+0000","last_became_peered":"2024-09-12T00:27:17.574346+0000","last_unstale":"2024-09-12T00:39:26.978506+0000","last_undegraded":"2024-09-12T00:39:26.978506+0000","last_fullsized":"2024-09-12T00:39:26.978506+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:26.978399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:26.978399+0000","last_clean_scrub_stamp":"2024-09-12T00:39:26.978399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:58.339937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:32.795428+0000","last_change":"2024-09-12T00:39:32.795428+0000","last_active":"2024-09-12T00:39:32.795428+0000","last_peered":"2024-09-12T00:39:32.795428+0000","last_clean":"2024-09-12T00:39:32.795428+0000","last_became_active":"2024-09-12T00:17:03.210439+0000","last_became_peered":"2024-09-12T00:17:03.210439+0000","last_unstale":"2024-09-12T00:39:32.795428+0000","last_undegraded":"2024-09-12T00:39:32.795428+0000","last_fullsized":"2024-09-12T00:39:32.795428+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:32.795303+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:32.795303+0000","last_clean_scrub_stamp":"2024-09-12T00:39:32.795303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:57.655220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"261'2","reported_seq":45,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:24.850342+0000","last_change":"2024-09-12T00:39:24.850342+0000","last_active":"2024-09-12T00:39:24.850342+0000","last_peered":"2024-09-12T00:39:24.850342+0000","last_clean":"2024-09-12T00:39:24.850342+0000","last_became_active":"2024-09-12T00:17:00.179337+0000","last_became_peered":"2024-09-12T00:17:00.179337+0000","last_unstale":"2024-09-12T00:39:24.850342+0000","last_undegraded":"2024-09-12T00:39:24.850342+0000","last_fullsized":"2024-09-12T00:39:24.850342+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:24.850258+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:24.850258+0000","last_clean_scrub_stamp":"2024-09-12T00:39:24.850258+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:30.990936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"261'135","reported_seq":459,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.025901+0000","last_change":"2024-09-12T00:39:14.025901+0000","last_active":"2024-09-12T00:39:14.025901+0000","last_peered":"2024-09-12T00:39:14.025901+0000","last_clean":"2024-09-12T00:39:14.025901+0000","last_became_active":"2024-09-12T00:15:34.421180+0000","last_became_peered":"2024-09-12T00:15:34.421180+0000","last_unstale":"2024-09-12T00:39:14.025901+0000","last_undegraded":"2024-09-12T00:39:14.025901+0000","last_fullsized":"2024-09-12T00:39:14.025901+0000","mapping_epoch":250,"log_start":"258'100","ondisk_log_start":"258'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'135","last_scrub_stamp":"2024-09-12T00:39:14.025808+0000","last_deep_scrub":"261'135","last_deep_scrub_stamp":"2024-09-12T00:39:14.025808+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.025808+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:28.688390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":809,"num_read_kb":617,"num_write":164,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:28.518811+0000","last_change":"2024-09-12T00:39:28.518811+0000","last_active":"2024-09-12T00:39:28.518811+0000","last_peered":"2024-09-12T00:39:28.518811+0000","last_clean":"2024-09-12T00:39:28.518811+0000","last_became_active":"2024-09-12T00:27:17.575257+0000","last_became_peered":"2024-09-12T00:27:17.575257+0000","last_unstale":"2024-09-12T00:39:28.518811+0000","last_undegraded":"2024-09-12T00:39:28.518811+0000","last_fullsized":"2024-09-12T00:39:28.518811+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:28.518720+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:28.518720+0000","last_clean_scrub_stamp":"2024-09-12T00:39:28.518720+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:52.821312+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"261'2","reported_seq":39,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:26.996209+0000","last_change":"2024-09-12T00:39:26.996209+0000","last_active":"2024-09-12T00:39:26.996209+0000","last_peered":"2024-09-12T00:39:26.996209+0000","last_clean":"2024-09-12T00:39:26.996209+0000","last_became_active":"2024-09-12T00:17:03.222110+0000","last_became_peered":"2024-09-12T00:17:03.222110+0000","last_unstale":"2024-09-12T00:39:26.996209+0000","last_undegraded":"2024-09-12T00:39:26.996209+0000","last_fullsized":"2024-09-12T00:39:26.996209+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:26.996123+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:26.996123+0000","last_clean_scrub_stamp":"2024-09-12T00:39:26.996123+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:11.241966+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.400803+0000","last_change":"2024-09-12T00:39:18.400803+0000","last_active":"2024-09-12T00:39:18.400803+0000","last_peered":"2024-09-12T00:39:18.400803+0000","last_clean":"2024-09-12T00:39:18.400803+0000","last_became_active":"2024-09-12T00:17:00.174537+0000","last_became_peered":"2024-09-12T00:17:00.174537+0000","last_unstale":"2024-09-12T00:39:18.400803+0000","last_undegraded":"2024-09-12T00:39:18.400803+0000","last_fullsized":"2024-09-12T00:39:18.400803+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:18.400703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:18.400703+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.400703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:29.217889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"258'31","reported_seq":137,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.112159+0000","last_change":"2024-09-12T00:39:15.112159+0000","last_active":"2024-09-12T00:39:15.112159+0000","last_peered":"2024-09-12T00:39:15.112159+0000","last_clean":"2024-09-12T00:39:15.112159+0000","last_became_active":"2024-09-12T00:15:34.427756+0000","last_became_peered":"2024-09-12T00:15:34.427756+0000","last_unstale":"2024-09-12T00:39:15.112159+0000","last_undegraded":"2024-09-12T00:39:15.112159+0000","last_fullsized":"2024-09-12T00:39:15.112159+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'31","last_scrub_stamp":"2024-09-12T00:39:15.112070+0000","last_deep_scrub":"258'31","last_deep_scrub_stamp":"2024-09-12T00:39:15.112070+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.112070+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:09.070217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":137,"num_write":43,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:24.946896+0000","last_change":"2024-09-12T00:39:24.946896+0000","last_active":"2024-09-12T00:39:24.946896+0000","last_peered":"2024-09-12T00:39:24.946896+0000","last_clean":"2024-09-12T00:39:24.946896+0000","last_became_active":"2024-09-12T00:27:17.577076+0000","last_became_peered":"2024-09-12T00:27:17.577076+0000","last_unstale":"2024-09-12T00:39:24.946896+0000","last_undegraded":"2024-09-12T00:39:24.946896+0000","last_fullsized":"2024-09-12T00:39:24.946896+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:24.946814+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:24.946814+0000","last_clean_scrub_stamp":"2024-09-12T00:39:24.946814+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:36.210164+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":36,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:40.973432+0000","last_change":"2024-09-12T00:39:40.973432+0000","last_active":"2024-09-12T00:39:40.973432+0000","last_peered":"2024-09-12T00:39:40.973432+0000","last_clean":"2024-09-12T00:39:40.973432+0000","last_became_active":"2024-09-12T00:17:03.217101+0000","last_became_peered":"2024-09-12T00:17:03.217101+0000","last_unstale":"2024-09-12T00:39:40.973432+0000","last_undegraded":"2024-09-12T00:39:40.973432+0000","last_fullsized":"2024-09-12T00:39:40.973432+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:40.973339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:40.973339+0000","last_clean_scrub_stamp":"2024-09-12T00:39:40.973339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:42.174021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.378101+0000","last_change":"2024-09-12T00:39:17.378101+0000","last_active":"2024-09-12T00:39:17.378101+0000","last_peered":"2024-09-12T00:39:17.378101+0000","last_clean":"2024-09-12T00:39:17.378101+0000","last_became_active":"2024-09-12T00:17:00.180475+0000","last_became_peered":"2024-09-12T00:17:00.180475+0000","last_unstale":"2024-09-12T00:39:17.378101+0000","last_undegraded":"2024-09-12T00:39:17.378101+0000","last_fullsized":"2024-09-12T00:39:17.378101+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:17.378008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:17.378008+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.378008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:33.410671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"261'61","reported_seq":216,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.016460+0000","last_change":"2024-09-12T00:39:13.016460+0000","last_active":"2024-09-12T00:39:13.016460+0000","last_peered":"2024-09-12T00:39:13.016460+0000","last_clean":"2024-09-12T00:39:13.016460+0000","last_became_active":"2024-09-12T00:15:34.418831+0000","last_became_peered":"2024-09-12T00:15:34.418831+0000","last_unstale":"2024-09-12T00:39:13.016460+0000","last_undegraded":"2024-09-12T00:39:13.016460+0000","last_fullsized":"2024-09-12T00:39:13.016460+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'61","last_scrub_stamp":"2024-09-12T00:39:13.016345+0000","last_deep_scrub":"261'61","last_deep_scrub_stamp":"2024-09-12T00:39:13.016345+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.016345+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:38.538047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":218,"num_write":105,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:38.873883+0000","last_change":"2024-09-12T00:39:38.873883+0000","last_active":"2024-09-12T00:39:38.873883+0000","last_peered":"2024-09-12T00:39:38.873883+0000","last_clean":"2024-09-12T00:39:38.873883+0000","last_became_active":"2024-09-12T00:27:17.579263+0000","last_became_peered":"2024-09-12T00:27:17.579263+0000","last_unstale":"2024-09-12T00:39:38.873883+0000","last_undegraded":"2024-09-12T00:39:38.873883+0000","last_fullsized":"2024-09-12T00:39:38.873883+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:38.873769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:38.873769+0000","last_clean_scrub_stamp":"2024-09-12T00:39:38.873769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:30.509064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"258'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:24.028597+0000","last_change":"2024-09-12T00:39:24.028543+0000","last_active":"2024-09-12T00:39:24.028597+0000","last_peered":"2024-09-12T00:39:24.028597+0000","last_clean":"2024-09-12T00:39:24.028597+0000","last_became_active":"2024-09-12T00:17:03.211582+0000","last_became_peered":"2024-09-12T00:17:03.211582+0000","last_unstale":"2024-09-12T00:39:24.028597+0000","last_undegraded":"2024-09-12T00:39:24.028597+0000","last_fullsized":"2024-09-12T00:39:24.028597+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-12T00:39:24.028459+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-12T00:39:24.028459+0000","last_clean_scrub_stamp":"2024-09-12T00:39:24.028459+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:24.840219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"261'2","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.129408+0000","last_change":"2024-09-12T00:39:18.129345+0000","last_active":"2024-09-12T00:39:18.129408+0000","last_peered":"2024-09-12T00:39:18.129408+0000","last_clean":"2024-09-12T00:39:18.129408+0000","last_became_active":"2024-09-12T00:17:00.182477+0000","last_became_peered":"2024-09-12T00:17:00.182477+0000","last_unstale":"2024-09-12T00:39:18.129408+0000","last_undegraded":"2024-09-12T00:39:18.129408+0000","last_fullsized":"2024-09-12T00:39:18.129408+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:18.129254+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:18.129254+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.129254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:36.933434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"258'27","reported_seq":122,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.977672+0000","last_change":"2024-09-12T00:39:11.977672+0000","last_active":"2024-09-12T00:39:11.977672+0000","last_peered":"2024-09-12T00:39:11.977672+0000","last_clean":"2024-09-12T00:39:11.977672+0000","last_became_active":"2024-09-12T00:15:34.419584+0000","last_became_peered":"2024-09-12T00:15:34.419584+0000","last_unstale":"2024-09-12T00:39:11.977672+0000","last_undegraded":"2024-09-12T00:39:11.977672+0000","last_fullsized":"2024-09-12T00:39:11.977672+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'27","last_scrub_stamp":"2024-09-12T00:39:11.977587+0000","last_deep_scrub":"258'27","last_deep_scrub_stamp":"2024-09-12T00:39:11.977587+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.977587+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:48.748257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":97,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.408371+0000","last_change":"2024-09-12T00:39:20.408371+0000","last_active":"2024-09-12T00:39:20.408371+0000","last_peered":"2024-09-12T00:39:20.408371+0000","last_clean":"2024-09-12T00:39:20.408371+0000","last_became_active":"2024-09-12T00:27:17.579859+0000","last_became_peered":"2024-09-12T00:27:17.579859+0000","last_unstale":"2024-09-12T00:39:20.408371+0000","last_undegraded":"2024-09-12T00:39:20.408371+0000","last_fullsized":"2024-09-12T00:39:20.408371+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:20.408277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:20.408277+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.408277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:02.264015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.035303+0000","last_change":"2024-09-12T00:39:23.035247+0000","last_active":"2024-09-12T00:39:23.035303+0000","last_peered":"2024-09-12T00:39:23.035303+0000","last_clean":"2024-09-12T00:39:23.035303+0000","last_became_active":"2024-09-12T00:17:03.216437+0000","last_became_peered":"2024-09-12T00:17:03.216437+0000","last_unstale":"2024-09-12T00:39:23.035303+0000","last_undegraded":"2024-09-12T00:39:23.035303+0000","last_fullsized":"2024-09-12T00:39:23.035303+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:23.035158+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:23.035158+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.035158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:11.091155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"258'2","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.956001+0000","last_change":"2024-09-12T00:39:19.955899+0000","last_active":"2024-09-12T00:39:19.956001+0000","last_peered":"2024-09-12T00:39:19.956001+0000","last_clean":"2024-09-12T00:39:19.956001+0000","last_became_active":"2024-09-12T00:17:00.178905+0000","last_became_peered":"2024-09-12T00:17:00.178905+0000","last_unstale":"2024-09-12T00:39:19.956001+0000","last_undegraded":"2024-09-12T00:39:19.956001+0000","last_fullsized":"2024-09-12T00:39:19.956001+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-12T00:39:19.955799+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-12T00:39:19.955799+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.955799+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:41.399375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"261'17","reported_seq":89,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:34.968417+0000","last_change":"2024-09-12T00:39:34.968417+0000","last_active":"2024-09-12T00:39:34.968417+0000","last_peered":"2024-09-12T00:39:34.968417+0000","last_clean":"2024-09-12T00:39:34.968417+0000","last_became_active":"2024-09-12T00:15:34.418859+0000","last_became_peered":"2024-09-12T00:15:34.418859+0000","last_unstale":"2024-09-12T00:39:34.968417+0000","last_undegraded":"2024-09-12T00:39:34.968417+0000","last_fullsized":"2024-09-12T00:39:34.968417+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'17","last_scrub_stamp":"2024-09-12T00:39:34.968321+0000","last_deep_scrub":"261'17","last_deep_scrub_stamp":"2024-09-12T00:39:34.968321+0000","last_clean_scrub_stamp":"2024-09-12T00:39:34.968321+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:48.109459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":48,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:48.064237+0000","last_change":"2024-09-12T00:39:48.064237+0000","last_active":"2024-09-12T00:39:48.064237+0000","last_peered":"2024-09-12T00:39:48.064237+0000","last_clean":"2024-09-12T00:39:48.064237+0000","last_became_active":"2024-09-12T00:27:17.577728+0000","last_became_peered":"2024-09-12T00:27:17.577728+0000","last_unstale":"2024-09-12T00:39:48.064237+0000","last_undegraded":"2024-09-12T00:39:48.064237+0000","last_fullsized":"2024-09-12T00:39:48.064237+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:48.064138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:48.064138+0000","last_clean_scrub_stamp":"2024-09-12T00:39:48.064138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:24.468632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"261'13","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:26.032749+0000","last_change":"2024-09-12T00:39:26.032692+0000","last_active":"2024-09-12T00:39:26.032749+0000","last_peered":"2024-09-12T00:39:26.032749+0000","last_clean":"2024-09-12T00:39:26.032749+0000","last_became_active":"2024-09-12T00:17:03.214958+0000","last_became_peered":"2024-09-12T00:17:03.214958+0000","last_unstale":"2024-09-12T00:39:26.032749+0000","last_undegraded":"2024-09-12T00:39:26.032749+0000","last_fullsized":"2024-09-12T00:39:26.032749+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'13","last_scrub_stamp":"2024-09-12T00:39:26.032607+0000","last_deep_scrub":"261'13","last_deep_scrub_stamp":"2024-09-12T00:39:26.032607+0000","last_clean_scrub_stamp":"2024-09-12T00:39:26.032607+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:40.981181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":22528,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"261'9","reported_seq":60,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.048505+0000","last_change":"2024-09-12T00:39:19.048410+0000","last_active":"2024-09-12T00:39:19.048505+0000","last_peered":"2024-09-12T00:39:19.048505+0000","last_clean":"2024-09-12T00:39:19.048505+0000","last_became_active":"2024-09-12T00:17:00.184703+0000","last_became_peered":"2024-09-12T00:17:00.184703+0000","last_unstale":"2024-09-12T00:39:19.048505+0000","last_undegraded":"2024-09-12T00:39:19.048505+0000","last_fullsized":"2024-09-12T00:39:19.048505+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'9","last_scrub_stamp":"2024-09-12T00:39:19.048321+0000","last_deep_scrub":"261'9","last_deep_scrub_stamp":"2024-09-12T00:39:19.048321+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.048321+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:13.887918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":24576,"num_write":9,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"261'12","reported_seq":82,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.417002+0000","last_change":"2024-09-12T00:39:11.417002+0000","last_active":"2024-09-12T00:39:11.417002+0000","last_peered":"2024-09-12T00:39:11.417002+0000","last_clean":"2024-09-12T00:39:11.417002+0000","last_became_active":"2024-09-12T00:15:34.424129+0000","last_became_peered":"2024-09-12T00:15:34.424129+0000","last_unstale":"2024-09-12T00:39:11.417002+0000","last_undegraded":"2024-09-12T00:39:11.417002+0000","last_fullsized":"2024-09-12T00:39:11.417002+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'12","last_scrub_stamp":"2024-09-12T00:39:11.416889+0000","last_deep_scrub":"261'12","last_deep_scrub_stamp":"2024-09-12T00:39:11.416889+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.416889+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:57.677881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":42,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.441202+0000","last_change":"2024-09-12T00:39:21.441202+0000","last_active":"2024-09-12T00:39:21.441202+0000","last_peered":"2024-09-12T00:39:21.441202+0000","last_clean":"2024-09-12T00:39:21.441202+0000","last_became_active":"2024-09-12T00:27:17.570973+0000","last_became_peered":"2024-09-12T00:27:17.570973+0000","last_unstale":"2024-09-12T00:39:21.441202+0000","last_undegraded":"2024-09-12T00:39:21.441202+0000","last_fullsized":"2024-09-12T00:39:21.441202+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:21.441114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:21.441114+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.441114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:21.220765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"258'5","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:30.831023+0000","last_change":"2024-09-12T00:39:30.830962+0000","last_active":"2024-09-12T00:39:30.831023+0000","last_peered":"2024-09-12T00:39:30.831023+0000","last_clean":"2024-09-12T00:39:30.831023+0000","last_became_active":"2024-09-12T00:17:03.220961+0000","last_became_peered":"2024-09-12T00:17:03.220961+0000","last_unstale":"2024-09-12T00:39:30.831023+0000","last_undegraded":"2024-09-12T00:39:30.831023+0000","last_fullsized":"2024-09-12T00:39:30.831023+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'5","last_scrub_stamp":"2024-09-12T00:39:30.830852+0000","last_deep_scrub":"258'5","last_deep_scrub_stamp":"2024-09-12T00:39:30.830852+0000","last_clean_scrub_stamp":"2024-09-12T00:39:30.830852+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:19.392172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"261'3","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.031567+0000","last_change":"2024-09-12T00:39:20.031501+0000","last_active":"2024-09-12T00:39:20.031567+0000","last_peered":"2024-09-12T00:39:20.031567+0000","last_clean":"2024-09-12T00:39:20.031567+0000","last_became_active":"2024-09-12T00:17:00.178572+0000","last_became_peered":"2024-09-12T00:17:00.178572+0000","last_unstale":"2024-09-12T00:39:20.031567+0000","last_undegraded":"2024-09-12T00:39:20.031567+0000","last_fullsized":"2024-09-12T00:39:20.031567+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:20.031417+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:20.031417+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.031417+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:17.968948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"261'26","reported_seq":119,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.939225+0000","last_change":"2024-09-12T00:39:14.939225+0000","last_active":"2024-09-12T00:39:14.939225+0000","last_peered":"2024-09-12T00:39:14.939225+0000","last_clean":"2024-09-12T00:39:14.939225+0000","last_became_active":"2024-09-12T00:15:34.421019+0000","last_became_peered":"2024-09-12T00:15:34.421019+0000","last_unstale":"2024-09-12T00:39:14.939225+0000","last_undegraded":"2024-09-12T00:39:14.939225+0000","last_fullsized":"2024-09-12T00:39:14.939225+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'26","last_scrub_stamp":"2024-09-12T00:39:14.939128+0000","last_deep_scrub":"261'26","last_deep_scrub_stamp":"2024-09-12T00:39:14.939128+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.939128+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:34.447686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":93,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:37.859932+0000","last_change":"2024-09-12T00:39:37.859932+0000","last_active":"2024-09-12T00:39:37.859932+0000","last_peered":"2024-09-12T00:39:37.859932+0000","last_clean":"2024-09-12T00:39:37.859932+0000","last_became_active":"2024-09-12T00:27:17.579926+0000","last_became_peered":"2024-09-12T00:27:17.579926+0000","last_unstale":"2024-09-12T00:39:37.859932+0000","last_undegraded":"2024-09-12T00:39:37.859932+0000","last_fullsized":"2024-09-12T00:39:37.859932+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:37.859838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:37.859838+0000","last_clean_scrub_stamp":"2024-09-12T00:39:37.859838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:44.772682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"261'3","reported_seq":42,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:50.063733+0000","last_change":"2024-09-12T00:39:50.063733+0000","last_active":"2024-09-12T00:39:50.063733+0000","last_peered":"2024-09-12T00:39:50.063733+0000","last_clean":"2024-09-12T00:39:50.063733+0000","last_became_active":"2024-09-12T00:17:03.219156+0000","last_became_peered":"2024-09-12T00:17:03.219156+0000","last_unstale":"2024-09-12T00:39:50.063733+0000","last_undegraded":"2024-09-12T00:39:50.063733+0000","last_fullsized":"2024-09-12T00:39:50.063733+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:50.063636+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:50.063636+0000","last_clean_scrub_stamp":"2024-09-12T00:39:50.063636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:05.029948+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"261'2","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.044818+0000","last_change":"2024-09-12T00:39:17.044818+0000","last_active":"2024-09-12T00:39:17.044818+0000","last_peered":"2024-09-12T00:39:17.044818+0000","last_clean":"2024-09-12T00:39:17.044818+0000","last_became_active":"2024-09-12T00:17:00.182424+0000","last_became_peered":"2024-09-12T00:17:00.182424+0000","last_unstale":"2024-09-12T00:39:17.044818+0000","last_undegraded":"2024-09-12T00:39:17.044818+0000","last_fullsized":"2024-09-12T00:39:17.044818+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:17.044731+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:17.044731+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.044731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:47.954689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"258'17","reported_seq":97,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.986370+0000","last_change":"2024-09-12T00:39:13.986370+0000","last_active":"2024-09-12T00:39:13.986370+0000","last_peered":"2024-09-12T00:39:13.986370+0000","last_clean":"2024-09-12T00:39:13.986370+0000","last_became_active":"2024-09-12T00:15:34.423037+0000","last_became_peered":"2024-09-12T00:15:34.423037+0000","last_unstale":"2024-09-12T00:39:13.986370+0000","last_undegraded":"2024-09-12T00:39:13.986370+0000","last_fullsized":"2024-09-12T00:39:13.986370+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'17","last_scrub_stamp":"2024-09-12T00:39:13.986286+0000","last_deep_scrub":"258'17","last_deep_scrub_stamp":"2024-09-12T00:39:13.986286+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.986286+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:20.113567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":64,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.135757+0000","last_change":"2024-09-12T00:39:23.135757+0000","last_active":"2024-09-12T00:39:23.135757+0000","last_peered":"2024-09-12T00:39:23.135757+0000","last_clean":"2024-09-12T00:39:23.135757+0000","last_became_active":"2024-09-12T00:27:17.583096+0000","last_became_peered":"2024-09-12T00:27:17.583096+0000","last_unstale":"2024-09-12T00:39:23.135757+0000","last_undegraded":"2024-09-12T00:39:23.135757+0000","last_fullsized":"2024-09-12T00:39:23.135757+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:23.135671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:23.135671+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.135671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:18.515232+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"261'5","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:26.106678+0000","last_change":"2024-09-12T00:39:26.106678+0000","last_active":"2024-09-12T00:39:26.106678+0000","last_peered":"2024-09-12T00:39:26.106678+0000","last_clean":"2024-09-12T00:39:26.106678+0000","last_became_active":"2024-09-12T00:17:03.214023+0000","last_became_peered":"2024-09-12T00:17:03.214023+0000","last_unstale":"2024-09-12T00:39:26.106678+0000","last_undegraded":"2024-09-12T00:39:26.106678+0000","last_fullsized":"2024-09-12T00:39:26.106678+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T00:39:26.106614+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T00:39:26.106614+0000","last_clean_scrub_stamp":"2024-09-12T00:39:26.106614+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:43.680728+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"261'3","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.849557+0000","last_change":"2024-09-12T00:39:23.849557+0000","last_active":"2024-09-12T00:39:23.849557+0000","last_peered":"2024-09-12T00:39:23.849557+0000","last_clean":"2024-09-12T00:39:23.849557+0000","last_became_active":"2024-09-12T00:17:00.178465+0000","last_became_peered":"2024-09-12T00:17:00.178465+0000","last_unstale":"2024-09-12T00:39:23.849557+0000","last_undegraded":"2024-09-12T00:39:23.849557+0000","last_fullsized":"2024-09-12T00:39:23.849557+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:23.849455+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:23.849455+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.849455+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:05.484492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"261'34","reported_seq":146,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.070187+0000","last_change":"2024-09-12T00:39:13.070090+0000","last_active":"2024-09-12T00:39:13.070187+0000","last_peered":"2024-09-12T00:39:13.070187+0000","last_clean":"2024-09-12T00:39:13.070187+0000","last_became_active":"2024-09-12T00:15:34.425540+0000","last_became_peered":"2024-09-12T00:15:34.425540+0000","last_unstale":"2024-09-12T00:39:13.070187+0000","last_undegraded":"2024-09-12T00:39:13.070187+0000","last_fullsized":"2024-09-12T00:39:13.070187+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'34","last_scrub_stamp":"2024-09-12T00:39:13.069969+0000","last_deep_scrub":"261'34","last_deep_scrub_stamp":"2024-09-12T00:39:13.069969+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.069969+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:02.805302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":136,"num_write":51,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.295921+0000","last_change":"2024-09-12T00:39:21.295921+0000","last_active":"2024-09-12T00:39:21.295921+0000","last_peered":"2024-09-12T00:39:21.295921+0000","last_clean":"2024-09-12T00:39:21.295921+0000","last_became_active":"2024-09-12T00:27:17.578968+0000","last_became_peered":"2024-09-12T00:27:17.578968+0000","last_unstale":"2024-09-12T00:39:21.295921+0000","last_undegraded":"2024-09-12T00:39:21.295921+0000","last_fullsized":"2024-09-12T00:39:21.295921+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:21.295829+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:21.295829+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.295829+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:44.991704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.917676+0000","last_change":"2024-09-12T00:39:22.917618+0000","last_active":"2024-09-12T00:39:22.917676+0000","last_peered":"2024-09-12T00:39:22.917676+0000","last_clean":"2024-09-12T00:39:22.917676+0000","last_became_active":"2024-09-12T00:17:03.212150+0000","last_became_peered":"2024-09-12T00:17:03.212150+0000","last_unstale":"2024-09-12T00:39:22.917676+0000","last_undegraded":"2024-09-12T00:39:22.917676+0000","last_fullsized":"2024-09-12T00:39:22.917676+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:22.917533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:22.917533+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.917533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:43.890615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"261'8","reported_seq":56,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.069399+0000","last_change":"2024-09-12T00:39:18.069399+0000","last_active":"2024-09-12T00:39:18.069399+0000","last_peered":"2024-09-12T00:39:18.069399+0000","last_clean":"2024-09-12T00:39:18.069399+0000","last_became_active":"2024-09-12T00:17:00.180944+0000","last_became_peered":"2024-09-12T00:17:00.180944+0000","last_unstale":"2024-09-12T00:39:18.069399+0000","last_undegraded":"2024-09-12T00:39:18.069399+0000","last_fullsized":"2024-09-12T00:39:18.069399+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T00:39:18.069314+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T00:39:18.069314+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.069314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:21.041688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6171,"num_write":13,"num_write_kb":11291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"261'34","reported_seq":135,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.876845+0000","last_change":"2024-09-12T00:39:22.876785+0000","last_active":"2024-09-12T00:39:22.876845+0000","last_peered":"2024-09-12T00:39:22.876845+0000","last_clean":"2024-09-12T00:39:22.876845+0000","last_became_active":"2024-09-12T00:15:34.418474+0000","last_became_peered":"2024-09-12T00:15:34.418474+0000","last_unstale":"2024-09-12T00:39:22.876845+0000","last_undegraded":"2024-09-12T00:39:22.876845+0000","last_fullsized":"2024-09-12T00:39:22.876845+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'34","last_scrub_stamp":"2024-09-12T00:39:22.876679+0000","last_deep_scrub":"261'34","last_deep_scrub_stamp":"2024-09-12T00:39:22.876679+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.876679+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:43.170752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:31.966866+0000","last_change":"2024-09-12T00:39:31.966866+0000","last_active":"2024-09-12T00:39:31.966866+0000","last_peered":"2024-09-12T00:39:31.966866+0000","last_clean":"2024-09-12T00:39:31.966866+0000","last_became_active":"2024-09-12T00:27:17.581149+0000","last_became_peered":"2024-09-12T00:27:17.581149+0000","last_unstale":"2024-09-12T00:39:31.966866+0000","last_undegraded":"2024-09-12T00:39:31.966866+0000","last_fullsized":"2024-09-12T00:39:31.966866+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:31.966754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:31.966754+0000","last_clean_scrub_stamp":"2024-09-12T00:39:31.966754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:49.625556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":37,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.300369+0000","last_change":"2024-09-12T00:39:14.300369+0000","last_active":"2024-09-12T00:39:14.300369+0000","last_peered":"2024-09-12T00:39:14.300369+0000","last_clean":"2024-09-12T00:39:14.300369+0000","last_became_active":"2024-09-12T00:17:03.220965+0000","last_became_peered":"2024-09-12T00:17:03.220965+0000","last_unstale":"2024-09-12T00:39:14.300369+0000","last_undegraded":"2024-09-12T00:39:14.300369+0000","last_fullsized":"2024-09-12T00:39:14.300369+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:14.300284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:14.300284+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.300284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:29.449310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"261'12","reported_seq":76,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:38.030781+0000","last_change":"2024-09-12T00:39:38.030781+0000","last_active":"2024-09-12T00:39:38.030781+0000","last_peered":"2024-09-12T00:39:38.030781+0000","last_clean":"2024-09-12T00:39:38.030781+0000","last_became_active":"2024-09-12T00:17:00.185600+0000","last_became_peered":"2024-09-12T00:17:00.185600+0000","last_unstale":"2024-09-12T00:39:38.030781+0000","last_undegraded":"2024-09-12T00:39:38.030781+0000","last_fullsized":"2024-09-12T00:39:38.030781+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'12","last_scrub_stamp":"2024-09-12T00:39:38.030685+0000","last_deep_scrub":"261'12","last_deep_scrub_stamp":"2024-09-12T00:39:38.030685+0000","last_clean_scrub_stamp":"2024-09-12T00:39:38.030685+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:07.642687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":41662,"num_write":17,"num_write_kb":10938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"261'54","reported_seq":195,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.206476+0000","last_change":"2024-09-12T00:39:10.206403+0000","last_active":"2024-09-12T00:39:10.206476+0000","last_peered":"2024-09-12T00:39:10.206476+0000","last_clean":"2024-09-12T00:39:10.206476+0000","last_became_active":"2024-09-12T00:15:34.417393+0000","last_became_peered":"2024-09-12T00:15:34.417393+0000","last_unstale":"2024-09-12T00:39:10.206476+0000","last_undegraded":"2024-09-12T00:39:10.206476+0000","last_fullsized":"2024-09-12T00:39:10.206476+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'54","last_scrub_stamp":"2024-09-12T00:39:10.206325+0000","last_deep_scrub":"261'54","last_deep_scrub_stamp":"2024-09-12T00:39:10.206325+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.206325+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:46.829987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":189,"num_write":107,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.344591+0000","last_change":"2024-09-12T00:39:18.344516+0000","last_active":"2024-09-12T00:39:18.344591+0000","last_peered":"2024-09-12T00:39:18.344591+0000","last_clean":"2024-09-12T00:39:18.344591+0000","last_became_active":"2024-09-12T00:27:17.578983+0000","last_became_peered":"2024-09-12T00:27:17.578983+0000","last_unstale":"2024-09-12T00:39:18.344591+0000","last_undegraded":"2024-09-12T00:39:18.344591+0000","last_fullsized":"2024-09-12T00:39:18.344591+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:18.344432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:18.344432+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.344432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:54.440611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"258'10","reported_seq":69,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:29.813618+0000","last_change":"2024-09-12T00:39:29.813546+0000","last_active":"2024-09-12T00:39:29.813618+0000","last_peered":"2024-09-12T00:39:29.813618+0000","last_clean":"2024-09-12T00:39:29.813618+0000","last_became_active":"2024-09-12T00:17:03.209874+0000","last_became_peered":"2024-09-12T00:17:03.209874+0000","last_unstale":"2024-09-12T00:39:29.813618+0000","last_undegraded":"2024-09-12T00:39:29.813618+0000","last_fullsized":"2024-09-12T00:39:29.813618+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'10","last_scrub_stamp":"2024-09-12T00:39:29.813450+0000","last_deep_scrub":"258'10","last_deep_scrub_stamp":"2024-09-12T00:39:29.813450+0000","last_clean_scrub_stamp":"2024-09-12T00:39:29.813450+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:32.346279+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":41988,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"258'2","reported_seq":48,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:39.960351+0000","last_change":"2024-09-12T00:39:39.960276+0000","last_active":"2024-09-12T00:39:39.960351+0000","last_peered":"2024-09-12T00:39:39.960351+0000","last_clean":"2024-09-12T00:39:39.960351+0000","last_became_active":"2024-09-12T00:17:00.185688+0000","last_became_peered":"2024-09-12T00:17:00.185688+0000","last_unstale":"2024-09-12T00:39:39.960351+0000","last_undegraded":"2024-09-12T00:39:39.960351+0000","last_fullsized":"2024-09-12T00:39:39.960351+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'2","last_scrub_stamp":"2024-09-12T00:39:39.960181+0000","last_deep_scrub":"258'2","last_deep_scrub_stamp":"2024-09-12T00:39:39.960181+0000","last_clean_scrub_stamp":"2024-09-12T00:39:39.960181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:57.105051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"261'42","reported_seq":166,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.651847+0000","last_change":"2024-09-12T00:39:20.651781+0000","last_active":"2024-09-12T00:39:20.651847+0000","last_peered":"2024-09-12T00:39:20.651847+0000","last_clean":"2024-09-12T00:39:20.651847+0000","last_became_active":"2024-09-12T00:15:34.411977+0000","last_became_peered":"2024-09-12T00:15:34.411977+0000","last_unstale":"2024-09-12T00:39:20.651847+0000","last_undegraded":"2024-09-12T00:39:20.651847+0000","last_fullsized":"2024-09-12T00:39:20.651847+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'42","last_scrub_stamp":"2024-09-12T00:39:20.651681+0000","last_deep_scrub":"261'42","last_deep_scrub_stamp":"2024-09-12T00:39:20.651681+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.651681+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:11.401803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":161,"num_write":73,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.315775+0000","last_change":"2024-09-12T00:39:17.315691+0000","last_active":"2024-09-12T00:39:17.315775+0000","last_peered":"2024-09-12T00:39:17.315775+0000","last_clean":"2024-09-12T00:39:17.315775+0000","last_became_active":"2024-09-12T00:27:17.578763+0000","last_became_peered":"2024-09-12T00:27:17.578763+0000","last_unstale":"2024-09-12T00:39:17.315775+0000","last_undegraded":"2024-09-12T00:39:17.315775+0000","last_fullsized":"2024-09-12T00:39:17.315775+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:17.315599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:17.315599+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.315599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:52.904813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:28.838163+0000","last_change":"2024-09-12T00:39:28.838076+0000","last_active":"2024-09-12T00:39:28.838163+0000","last_peered":"2024-09-12T00:39:28.838163+0000","last_clean":"2024-09-12T00:39:28.838163+0000","last_became_active":"2024-09-12T00:17:03.216349+0000","last_became_peered":"2024-09-12T00:17:03.216349+0000","last_unstale":"2024-09-12T00:39:28.838163+0000","last_undegraded":"2024-09-12T00:39:28.838163+0000","last_fullsized":"2024-09-12T00:39:28.838163+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:28.837972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:28.837972+0000","last_clean_scrub_stamp":"2024-09-12T00:39:28.837972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:55.788182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"261'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:26.570396+0000","last_change":"2024-09-12T00:39:26.570331+0000","last_active":"2024-09-12T00:39:26.570396+0000","last_peered":"2024-09-12T00:39:26.570396+0000","last_clean":"2024-09-12T00:39:26.570396+0000","last_became_active":"2024-09-12T00:17:00.182780+0000","last_became_peered":"2024-09-12T00:17:00.182780+0000","last_unstale":"2024-09-12T00:39:26.570396+0000","last_undegraded":"2024-09-12T00:39:26.570396+0000","last_fullsized":"2024-09-12T00:39:26.570396+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:39:26.570238+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:39:26.570238+0000","last_clean_scrub_stamp":"2024-09-12T00:39:26.570238+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:11.331834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"261'38","reported_seq":150,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:32.980602+0000","last_change":"2024-09-12T00:39:32.980602+0000","last_active":"2024-09-12T00:39:32.980602+0000","last_peered":"2024-09-12T00:39:32.980602+0000","last_clean":"2024-09-12T00:39:32.980602+0000","last_became_active":"2024-09-12T00:15:34.409622+0000","last_became_peered":"2024-09-12T00:15:34.409622+0000","last_unstale":"2024-09-12T00:39:32.980602+0000","last_undegraded":"2024-09-12T00:39:32.980602+0000","last_fullsized":"2024-09-12T00:39:32.980602+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'38","last_scrub_stamp":"2024-09-12T00:39:32.980473+0000","last_deep_scrub":"261'38","last_deep_scrub_stamp":"2024-09-12T00:39:32.980473+0000","last_clean_scrub_stamp":"2024-09-12T00:39:32.980473+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:42.538186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":134,"num_write":65,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:40.794089+0000","last_change":"2024-09-12T00:39:40.794089+0000","last_active":"2024-09-12T00:39:40.794089+0000","last_peered":"2024-09-12T00:39:40.794089+0000","last_clean":"2024-09-12T00:39:40.794089+0000","last_became_active":"2024-09-12T00:27:17.581993+0000","last_became_peered":"2024-09-12T00:27:17.581993+0000","last_unstale":"2024-09-12T00:39:40.794089+0000","last_undegraded":"2024-09-12T00:39:40.794089+0000","last_fullsized":"2024-09-12T00:39:40.794089+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:40.793978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:40.793978+0000","last_clean_scrub_stamp":"2024-09-12T00:39:40.793978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:31.151862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"261'5","reported_seq":46,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.267690+0000","last_change":"2024-09-12T00:39:13.267690+0000","last_active":"2024-09-12T00:39:13.267690+0000","last_peered":"2024-09-12T00:39:13.267690+0000","last_clean":"2024-09-12T00:39:13.267690+0000","last_became_active":"2024-09-12T00:17:03.219888+0000","last_became_peered":"2024-09-12T00:17:03.219888+0000","last_unstale":"2024-09-12T00:39:13.267690+0000","last_undegraded":"2024-09-12T00:39:13.267690+0000","last_fullsized":"2024-09-12T00:39:13.267690+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T00:39:13.267608+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T00:39:13.267608+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.267608+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:16.563967+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"258'3","reported_seq":49,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.100296+0000","last_change":"2024-09-12T00:39:19.100296+0000","last_active":"2024-09-12T00:39:19.100296+0000","last_peered":"2024-09-12T00:39:19.100296+0000","last_clean":"2024-09-12T00:39:19.100296+0000","last_became_active":"2024-09-12T00:17:00.169299+0000","last_became_peered":"2024-09-12T00:17:00.169299+0000","last_unstale":"2024-09-12T00:39:19.100296+0000","last_undegraded":"2024-09-12T00:39:19.100296+0000","last_fullsized":"2024-09-12T00:39:19.100296+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T00:39:19.100206+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T00:39:19.100206+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.100206+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:28.788232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"261'48","reported_seq":184,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.108535+0000","last_change":"2024-09-12T00:39:14.108535+0000","last_active":"2024-09-12T00:39:14.108535+0000","last_peered":"2024-09-12T00:39:14.108535+0000","last_clean":"2024-09-12T00:39:14.108535+0000","last_became_active":"2024-09-12T00:15:34.427735+0000","last_became_peered":"2024-09-12T00:15:34.427735+0000","last_unstale":"2024-09-12T00:39:14.108535+0000","last_undegraded":"2024-09-12T00:39:14.108535+0000","last_fullsized":"2024-09-12T00:39:14.108535+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'48","last_scrub_stamp":"2024-09-12T00:39:14.108432+0000","last_deep_scrub":"261'48","last_deep_scrub_stamp":"2024-09-12T00:39:14.108432+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.108432+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:05.307096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":182,"num_write":93,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:49.022561+0000","last_change":"2024-09-12T00:39:49.022472+0000","last_active":"2024-09-12T00:39:49.022561+0000","last_peered":"2024-09-12T00:39:49.022561+0000","last_clean":"2024-09-12T00:39:49.022561+0000","last_became_active":"2024-09-12T00:27:17.572817+0000","last_became_peered":"2024-09-12T00:27:17.572817+0000","last_unstale":"2024-09-12T00:39:49.022561+0000","last_undegraded":"2024-09-12T00:39:49.022561+0000","last_fullsized":"2024-09-12T00:39:49.022561+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:49.022371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:49.022371+0000","last_clean_scrub_stamp":"2024-09-12T00:39:49.022371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:09.883780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"261'6","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:46.014019+0000","last_change":"2024-09-12T00:39:46.014019+0000","last_active":"2024-09-12T00:39:46.014019+0000","last_peered":"2024-09-12T00:39:46.014019+0000","last_clean":"2024-09-12T00:39:46.014019+0000","last_became_active":"2024-09-12T00:17:03.219129+0000","last_became_peered":"2024-09-12T00:17:03.219129+0000","last_unstale":"2024-09-12T00:39:46.014019+0000","last_undegraded":"2024-09-12T00:39:46.014019+0000","last_fullsized":"2024-09-12T00:39:46.014019+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T00:39:46.013932+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T00:39:46.013932+0000","last_clean_scrub_stamp":"2024-09-12T00:39:46.013932+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:19.197426+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"261'6","reported_seq":52,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:37.018947+0000","last_change":"2024-09-12T00:39:37.018947+0000","last_active":"2024-09-12T00:39:37.018947+0000","last_peered":"2024-09-12T00:39:37.018947+0000","last_clean":"2024-09-12T00:39:37.018947+0000","last_became_active":"2024-09-12T00:17:00.182301+0000","last_became_peered":"2024-09-12T00:17:00.182301+0000","last_unstale":"2024-09-12T00:39:37.018947+0000","last_undegraded":"2024-09-12T00:39:37.018947+0000","last_fullsized":"2024-09-12T00:39:37.018947+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T00:39:37.018853+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T00:39:37.018853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:37.018853+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:51.530479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"261'23","reported_seq":110,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.943059+0000","last_change":"2024-09-12T00:39:10.943059+0000","last_active":"2024-09-12T00:39:10.943059+0000","last_peered":"2024-09-12T00:39:10.943059+0000","last_clean":"2024-09-12T00:39:10.943059+0000","last_became_active":"2024-09-12T00:15:34.428056+0000","last_became_peered":"2024-09-12T00:15:34.428056+0000","last_unstale":"2024-09-12T00:39:10.943059+0000","last_undegraded":"2024-09-12T00:39:10.943059+0000","last_fullsized":"2024-09-12T00:39:10.943059+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'23","last_scrub_stamp":"2024-09-12T00:39:10.942970+0000","last_deep_scrub":"261'23","last_deep_scrub_stamp":"2024-09-12T00:39:10.942970+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.942970+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:15.519299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":76,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"261'2","reported_seq":28,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:31.006273+0000","last_change":"2024-09-12T00:39:31.006273+0000","last_active":"2024-09-12T00:39:31.006273+0000","last_peered":"2024-09-12T00:39:31.006273+0000","last_clean":"2024-09-12T00:39:31.006273+0000","last_became_active":"2024-09-12T00:27:17.575332+0000","last_became_peered":"2024-09-12T00:27:17.575332+0000","last_unstale":"2024-09-12T00:39:31.006273+0000","last_undegraded":"2024-09-12T00:39:31.006273+0000","last_fullsized":"2024-09-12T00:39:31.006273+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:31.006184+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:31.006184+0000","last_clean_scrub_stamp":"2024-09-12T00:39:31.006184+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:48.941556+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"258'6","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:25.613061+0000","last_change":"2024-09-12T00:39:25.612999+0000","last_active":"2024-09-12T00:39:25.613061+0000","last_peered":"2024-09-12T00:39:25.613061+0000","last_clean":"2024-09-12T00:39:25.613061+0000","last_became_active":"2024-09-12T00:17:03.206580+0000","last_became_peered":"2024-09-12T00:17:03.206580+0000","last_unstale":"2024-09-12T00:39:25.613061+0000","last_undegraded":"2024-09-12T00:39:25.613061+0000","last_fullsized":"2024-09-12T00:39:25.613061+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'6","last_scrub_stamp":"2024-09-12T00:39:25.612911+0000","last_deep_scrub":"258'6","last_deep_scrub_stamp":"2024-09-12T00:39:25.612911+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.612911+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:54.268773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":47,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.139871+0000","last_change":"2024-09-12T00:39:17.139871+0000","last_active":"2024-09-12T00:39:17.139871+0000","last_peered":"2024-09-12T00:39:17.139871+0000","last_clean":"2024-09-12T00:39:17.139871+0000","last_became_active":"2024-09-12T00:17:00.169464+0000","last_became_peered":"2024-09-12T00:17:00.169464+0000","last_unstale":"2024-09-12T00:39:17.139871+0000","last_undegraded":"2024-09-12T00:39:17.139871+0000","last_fullsized":"2024-09-12T00:39:17.139871+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:17.139788+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:17.139788+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.139788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:49.246363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"261'22","reported_seq":105,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.048186+0000","last_change":"2024-09-12T00:39:12.048186+0000","last_active":"2024-09-12T00:39:12.048186+0000","last_peered":"2024-09-12T00:39:12.048186+0000","last_clean":"2024-09-12T00:39:12.048186+0000","last_became_active":"2024-09-12T00:15:34.427661+0000","last_became_peered":"2024-09-12T00:15:34.427661+0000","last_unstale":"2024-09-12T00:39:12.048186+0000","last_undegraded":"2024-09-12T00:39:12.048186+0000","last_fullsized":"2024-09-12T00:39:12.048186+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'22","last_scrub_stamp":"2024-09-12T00:39:12.048102+0000","last_deep_scrub":"261'22","last_deep_scrub_stamp":"2024-09-12T00:39:12.048102+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.048102+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:33.795502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":70,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":26,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:27.551016+0000","last_change":"2024-09-12T00:39:27.551016+0000","last_active":"2024-09-12T00:39:27.551016+0000","last_peered":"2024-09-12T00:39:27.551016+0000","last_clean":"2024-09-12T00:39:27.551016+0000","last_became_active":"2024-09-12T00:27:17.575941+0000","last_became_peered":"2024-09-12T00:27:17.575941+0000","last_unstale":"2024-09-12T00:39:27.551016+0000","last_undegraded":"2024-09-12T00:39:27.551016+0000","last_fullsized":"2024-09-12T00:39:27.551016+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.550929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.550929+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.550929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:38.045680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"261'2","reported_seq":41,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:39.006967+0000","last_change":"2024-09-12T00:39:39.006967+0000","last_active":"2024-09-12T00:39:39.006967+0000","last_peered":"2024-09-12T00:39:39.006967+0000","last_clean":"2024-09-12T00:39:39.006967+0000","last_became_active":"2024-09-12T00:17:03.217678+0000","last_became_peered":"2024-09-12T00:17:03.217678+0000","last_unstale":"2024-09-12T00:39:39.006967+0000","last_undegraded":"2024-09-12T00:39:39.006967+0000","last_fullsized":"2024-09-12T00:39:39.006967+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:39.006884+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:39.006884+0000","last_clean_scrub_stamp":"2024-09-12T00:39:39.006884+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:44.022962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"261'5","reported_seq":53,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:41.992689+0000","last_change":"2024-09-12T00:39:41.992600+0000","last_active":"2024-09-12T00:39:41.992689+0000","last_peered":"2024-09-12T00:39:41.992689+0000","last_clean":"2024-09-12T00:39:41.992689+0000","last_became_active":"2024-09-12T00:17:00.185637+0000","last_became_peered":"2024-09-12T00:17:00.185637+0000","last_unstale":"2024-09-12T00:39:41.992689+0000","last_undegraded":"2024-09-12T00:39:41.992689+0000","last_fullsized":"2024-09-12T00:39:41.992689+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-12T00:39:41.992501+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-12T00:39:41.992501+0000","last_clean_scrub_stamp":"2024-09-12T00:39:41.992501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:42.462935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"261'27","reported_seq":122,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:31.005049+0000","last_change":"2024-09-12T00:39:31.005049+0000","last_active":"2024-09-12T00:39:31.005049+0000","last_peered":"2024-09-12T00:39:31.005049+0000","last_clean":"2024-09-12T00:39:31.005049+0000","last_became_active":"2024-09-12T00:15:34.408612+0000","last_became_peered":"2024-09-12T00:15:34.408612+0000","last_unstale":"2024-09-12T00:39:31.005049+0000","last_undegraded":"2024-09-12T00:39:31.005049+0000","last_fullsized":"2024-09-12T00:39:31.005049+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'27","last_scrub_stamp":"2024-09-12T00:39:31.004924+0000","last_deep_scrub":"261'27","last_deep_scrub_stamp":"2024-09-12T00:39:31.004924+0000","last_clean_scrub_stamp":"2024-09-12T00:39:31.004924+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:00.069040+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":97,"num_write":53,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:36.907385+0000","last_change":"2024-09-12T00:39:36.907278+0000","last_active":"2024-09-12T00:39:36.907385+0000","last_peered":"2024-09-12T00:39:36.907385+0000","last_clean":"2024-09-12T00:39:36.907385+0000","last_became_active":"2024-09-12T00:27:17.579332+0000","last_became_peered":"2024-09-12T00:27:17.579332+0000","last_unstale":"2024-09-12T00:39:36.907385+0000","last_undegraded":"2024-09-12T00:39:36.907385+0000","last_fullsized":"2024-09-12T00:39:36.907385+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:36.907182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:36.907182+0000","last_clean_scrub_stamp":"2024-09-12T00:39:36.907182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:02.827220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:25.133716+0000","last_change":"2024-09-12T00:39:25.133646+0000","last_active":"2024-09-12T00:39:25.133716+0000","last_peered":"2024-09-12T00:39:25.133716+0000","last_clean":"2024-09-12T00:39:25.133716+0000","last_became_active":"2024-09-12T00:17:03.203401+0000","last_became_peered":"2024-09-12T00:17:03.203401+0000","last_unstale":"2024-09-12T00:39:25.133716+0000","last_undegraded":"2024-09-12T00:39:25.133716+0000","last_fullsized":"2024-09-12T00:39:25.133716+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.133557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.133557+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.133557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:27.542813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":44,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.976225+0000","last_change":"2024-09-12T00:39:20.976116+0000","last_active":"2024-09-12T00:39:20.976225+0000","last_peered":"2024-09-12T00:39:20.976225+0000","last_clean":"2024-09-12T00:39:20.976225+0000","last_became_active":"2024-09-12T00:17:00.181095+0000","last_became_peered":"2024-09-12T00:17:00.181095+0000","last_unstale":"2024-09-12T00:39:20.976225+0000","last_undegraded":"2024-09-12T00:39:20.976225+0000","last_fullsized":"2024-09-12T00:39:20.976225+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:20.976002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:20.976002+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.976002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:41.988221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"261'19","reported_seq":101,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:29.958283+0000","last_change":"2024-09-12T00:39:29.958283+0000","last_active":"2024-09-12T00:39:29.958283+0000","last_peered":"2024-09-12T00:39:29.958283+0000","last_clean":"2024-09-12T00:39:29.958283+0000","last_became_active":"2024-09-12T00:15:34.420583+0000","last_became_peered":"2024-09-12T00:15:34.420583+0000","last_unstale":"2024-09-12T00:39:29.958283+0000","last_undegraded":"2024-09-12T00:39:29.958283+0000","last_fullsized":"2024-09-12T00:39:29.958283+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'19","last_scrub_stamp":"2024-09-12T00:39:29.958192+0000","last_deep_scrub":"261'19","last_deep_scrub_stamp":"2024-09-12T00:39:29.958192+0000","last_clean_scrub_stamp":"2024-09-12T00:39:29.958192+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:24.388006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":68,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":27,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:45.031372+0000","last_change":"2024-09-12T00:39:45.031310+0000","last_active":"2024-09-12T00:39:45.031372+0000","last_peered":"2024-09-12T00:39:45.031372+0000","last_clean":"2024-09-12T00:39:45.031372+0000","last_became_active":"2024-09-12T00:27:17.579957+0000","last_became_peered":"2024-09-12T00:27:17.579957+0000","last_unstale":"2024-09-12T00:39:45.031372+0000","last_undegraded":"2024-09-12T00:39:45.031372+0000","last_fullsized":"2024-09-12T00:39:45.031372+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":259,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:45.031214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:45.031214+0000","last_clean_scrub_stamp":"2024-09-12T00:39:45.031214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:33.149400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":38,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.087740+0000","last_change":"2024-09-12T00:39:21.087682+0000","last_active":"2024-09-12T00:39:21.087740+0000","last_peered":"2024-09-12T00:39:21.087740+0000","last_clean":"2024-09-12T00:39:21.087740+0000","last_became_active":"2024-09-12T00:17:03.222212+0000","last_became_peered":"2024-09-12T00:17:03.222212+0000","last_unstale":"2024-09-12T00:39:21.087740+0000","last_undegraded":"2024-09-12T00:39:21.087740+0000","last_fullsized":"2024-09-12T00:39:21.087740+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:21.087582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:21.087582+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.087582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:14.366113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"258'3","reported_seq":50,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.363704+0000","last_change":"2024-09-12T00:39:14.363628+0000","last_active":"2024-09-12T00:39:14.363704+0000","last_peered":"2024-09-12T00:39:14.363704+0000","last_clean":"2024-09-12T00:39:14.363704+0000","last_became_active":"2024-09-12T00:17:00.184654+0000","last_became_peered":"2024-09-12T00:17:00.184654+0000","last_unstale":"2024-09-12T00:39:14.363704+0000","last_undegraded":"2024-09-12T00:39:14.363704+0000","last_fullsized":"2024-09-12T00:39:14.363704+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'3","last_scrub_stamp":"2024-09-12T00:39:14.363541+0000","last_deep_scrub":"258'3","last_deep_scrub_stamp":"2024-09-12T00:39:14.363541+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.363541+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:52.973589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"261'33","reported_seq":139,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.096033+0000","last_change":"2024-09-12T00:39:09.095923+0000","last_active":"2024-09-12T00:39:09.096033+0000","last_peered":"2024-09-12T00:39:09.096033+0000","last_clean":"2024-09-12T00:39:09.096033+0000","last_became_active":"2024-09-12T00:15:34.425489+0000","last_became_peered":"2024-09-12T00:15:34.425489+0000","last_unstale":"2024-09-12T00:39:09.096033+0000","last_undegraded":"2024-09-12T00:39:09.096033+0000","last_fullsized":"2024-09-12T00:39:09.096033+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'33","last_scrub_stamp":"2024-09-12T00:39:09.095823+0000","last_deep_scrub":"261'33","last_deep_scrub_stamp":"2024-09-12T00:39:09.095823+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.095823+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:36:00.657525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":114,"num_write":61,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"261'331","reported_seq":983,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.232491+0000","last_change":"2024-09-12T00:38:52.232372+0000","last_active":"2024-09-12T00:38:52.232491+0000","last_peered":"2024-09-12T00:38:52.232491+0000","last_clean":"2024-09-12T00:38:52.232491+0000","last_became_active":"2024-09-12T00:01:57.152039+0000","last_became_peered":"2024-09-12T00:01:57.152039+0000","last_unstale":"2024-09-12T00:38:52.232491+0000","last_undegraded":"2024-09-12T00:38:52.232491+0000","last_fullsized":"2024-09-12T00:38:52.232491+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'331","last_scrub_stamp":"2024-09-12T00:38:52.232200+0000","last_deep_scrub":"261'331","last_deep_scrub_stamp":"2024-09-12T00:38:52.232200+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.232200+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:40.965953+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":494,"num_read_kb":62278,"num_write":1122,"num_write_kb":40244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"261'78","reported_seq":668,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.421208+0000","last_change":"2024-09-12T00:38:58.421103+0000","last_active":"2024-09-12T00:38:58.421208+0000","last_peered":"2024-09-12T00:38:58.421208+0000","last_clean":"2024-09-12T00:38:58.421208+0000","last_became_active":"2024-09-12T00:01:59.156166+0000","last_became_peered":"2024-09-12T00:01:59.156166+0000","last_unstale":"2024-09-12T00:38:58.421208+0000","last_undegraded":"2024-09-12T00:38:58.421208+0000","last_fullsized":"2024-09-12T00:38:58.421208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'78","last_scrub_stamp":"2024-09-12T00:38:58.421001+0000","last_deep_scrub":"261'78","last_deep_scrub_stamp":"2024-09-12T00:38:58.421001+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.421001+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:08.530267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":327,"num_write":117,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"261'318","reported_seq":961,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.805829+0000","last_change":"2024-09-12T00:38:57.805750+0000","last_active":"2024-09-12T00:38:57.805829+0000","last_peered":"2024-09-12T00:38:57.805829+0000","last_clean":"2024-09-12T00:38:57.805829+0000","last_became_active":"2024-09-12T00:01:57.147519+0000","last_became_peered":"2024-09-12T00:01:57.147519+0000","last_unstale":"2024-09-12T00:38:57.805829+0000","last_undegraded":"2024-09-12T00:38:57.805829+0000","last_fullsized":"2024-09-12T00:38:57.805829+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'318","last_scrub_stamp":"2024-09-12T00:38:57.805642+0000","last_deep_scrub":"261'318","last_deep_scrub_stamp":"2024-09-12T00:38:57.805642+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.805642+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:55.449630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":64019,"num_write":1006,"num_write_kb":35322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"261'285","reported_seq":951,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.290833+0000","last_change":"2024-09-12T00:39:11.290734+0000","last_active":"2024-09-12T00:39:11.290833+0000","last_peered":"2024-09-12T00:39:11.290833+0000","last_clean":"2024-09-12T00:39:11.290833+0000","last_became_active":"2024-09-12T00:01:59.140661+0000","last_became_peered":"2024-09-12T00:01:59.140661+0000","last_unstale":"2024-09-12T00:39:11.290833+0000","last_undegraded":"2024-09-12T00:39:11.290833+0000","last_fullsized":"2024-09-12T00:39:11.290833+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'285","last_scrub_stamp":"2024-09-12T00:39:11.290598+0000","last_deep_scrub":"261'285","last_deep_scrub_stamp":"2024-09-12T00:39:11.290598+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.290598+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:27.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1344,"num_read_kb":1119,"num_write":493,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"261'353","reported_seq":986,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.803680+0000","last_change":"2024-09-12T00:38:55.803618+0000","last_active":"2024-09-12T00:38:55.803680+0000","last_peered":"2024-09-12T00:38:55.803680+0000","last_clean":"2024-09-12T00:38:55.803680+0000","last_became_active":"2024-09-12T00:01:57.140885+0000","last_became_peered":"2024-09-12T00:01:57.140885+0000","last_unstale":"2024-09-12T00:38:55.803680+0000","last_undegraded":"2024-09-12T00:38:55.803680+0000","last_fullsized":"2024-09-12T00:38:55.803680+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T00:38:55.803496+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T00:38:55.803496+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.803496+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:39.294089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":495,"num_read_kb":8973,"num_write":1119,"num_write_kb":33019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"261'357","reported_seq":1006,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.218099+0000","last_change":"2024-09-12T00:39:06.218036+0000","last_active":"2024-09-12T00:39:06.218099+0000","last_peered":"2024-09-12T00:39:06.218099+0000","last_clean":"2024-09-12T00:39:06.218099+0000","last_became_active":"2024-09-12T00:01:59.144660+0000","last_became_peered":"2024-09-12T00:01:59.144660+0000","last_unstale":"2024-09-12T00:39:06.218099+0000","last_undegraded":"2024-09-12T00:39:06.218099+0000","last_fullsized":"2024-09-12T00:39:06.218099+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'357","last_scrub_stamp":"2024-09-12T00:39:06.217962+0000","last_deep_scrub":"261'357","last_deep_scrub_stamp":"2024-09-12T00:39:06.217962+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.217962+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:12.487208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1585,"num_read_kb":1295,"num_write":589,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"261'362","reported_seq":997,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.044767+0000","last_change":"2024-09-12T00:38:48.044672+0000","last_active":"2024-09-12T00:38:48.044767+0000","last_peered":"2024-09-12T00:38:48.044767+0000","last_clean":"2024-09-12T00:38:48.044767+0000","last_became_active":"2024-09-12T00:01:57.154749+0000","last_became_peered":"2024-09-12T00:01:57.154749+0000","last_unstale":"2024-09-12T00:38:48.044767+0000","last_undegraded":"2024-09-12T00:38:48.044767+0000","last_fullsized":"2024-09-12T00:38:48.044767+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'362","last_scrub_stamp":"2024-09-12T00:38:48.044510+0000","last_deep_scrub":"261'362","last_deep_scrub_stamp":"2024-09-12T00:38:48.044510+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.044510+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:47.176239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":533,"num_read_kb":65054,"num_write":1136,"num_write_kb":38777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"261'303","reported_seq":934,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.535738+0000","last_change":"2024-09-12T00:39:00.535670+0000","last_active":"2024-09-12T00:39:00.535738+0000","last_peered":"2024-09-12T00:39:00.535738+0000","last_clean":"2024-09-12T00:39:00.535738+0000","last_became_active":"2024-09-12T00:01:59.146925+0000","last_became_peered":"2024-09-12T00:01:59.146925+0000","last_unstale":"2024-09-12T00:39:00.535738+0000","last_undegraded":"2024-09-12T00:39:00.535738+0000","last_fullsized":"2024-09-12T00:39:00.535738+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'303","last_scrub_stamp":"2024-09-12T00:39:00.535589+0000","last_deep_scrub":"261'303","last_deep_scrub_stamp":"2024-09-12T00:39:00.535589+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.535589+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:53.374654+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1201,"num_read_kb":972,"num_write":449,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"261'361","reported_seq":1106,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.196418+0000","last_change":"2024-09-12T00:38:51.196352+0000","last_active":"2024-09-12T00:38:51.196418+0000","last_peered":"2024-09-12T00:38:51.196418+0000","last_clean":"2024-09-12T00:38:51.196418+0000","last_became_active":"2024-09-12T00:01:57.151028+0000","last_became_peered":"2024-09-12T00:01:57.151028+0000","last_unstale":"2024-09-12T00:38:51.196418+0000","last_undegraded":"2024-09-12T00:38:51.196418+0000","last_fullsized":"2024-09-12T00:38:51.196418+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'361","last_scrub_stamp":"2024-09-12T00:38:51.196229+0000","last_deep_scrub":"261'361","last_deep_scrub_stamp":"2024-09-12T00:38:51.196229+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.196229+0000","objects_scrubbed":10,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:50.130757+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2337543,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":829,"num_read_kb":49842,"num_write":1146,"num_write_kb":22305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"261'253","reported_seq":917,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.297540+0000","last_change":"2024-09-12T00:38:57.297540+0000","last_active":"2024-09-12T00:38:57.297540+0000","last_peered":"2024-09-12T00:38:57.297540+0000","last_clean":"2024-09-12T00:38:57.297540+0000","last_became_active":"2024-09-12T00:01:59.149728+0000","last_became_peered":"2024-09-12T00:01:59.149728+0000","last_unstale":"2024-09-12T00:38:57.297540+0000","last_undegraded":"2024-09-12T00:38:57.297540+0000","last_fullsized":"2024-09-12T00:38:57.297540+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'253","last_scrub_stamp":"2024-09-12T00:38:57.297444+0000","last_deep_scrub":"261'253","last_deep_scrub_stamp":"2024-09-12T00:38:57.297444+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.297444+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:04.300911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1186,"num_read_kb":981,"num_write":436,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"261'351","reported_seq":1102,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.044817+0000","last_change":"2024-09-12T00:38:47.044743+0000","last_active":"2024-09-12T00:38:47.044817+0000","last_peered":"2024-09-12T00:38:47.044817+0000","last_clean":"2024-09-12T00:38:47.044817+0000","last_became_active":"2024-09-12T00:01:57.152791+0000","last_became_peered":"2024-09-12T00:01:57.152791+0000","last_unstale":"2024-09-12T00:38:47.044817+0000","last_undegraded":"2024-09-12T00:38:47.044817+0000","last_fullsized":"2024-09-12T00:38:47.044817+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'351","last_scrub_stamp":"2024-09-12T00:38:47.044625+0000","last_deep_scrub":"261'351","last_deep_scrub_stamp":"2024-09-12T00:38:47.044625+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.044625+0000","objects_scrubbed":6,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:39.302097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133707,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":815,"num_read_kb":39083,"num_write":1189,"num_write_kb":33747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"261'276","reported_seq":873,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.326031+0000","last_change":"2024-09-12T00:38:58.325938+0000","last_active":"2024-09-12T00:38:58.326031+0000","last_peered":"2024-09-12T00:38:58.326031+0000","last_clean":"2024-09-12T00:38:58.326031+0000","last_became_active":"2024-09-12T00:01:59.151168+0000","last_became_peered":"2024-09-12T00:01:59.151168+0000","last_unstale":"2024-09-12T00:38:58.326031+0000","last_undegraded":"2024-09-12T00:38:58.326031+0000","last_fullsized":"2024-09-12T00:38:58.326031+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'276","last_scrub_stamp":"2024-09-12T00:38:58.325822+0000","last_deep_scrub":"261'276","last_deep_scrub_stamp":"2024-09-12T00:38:58.325822+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.325822+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:47.632687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1184,"num_read_kb":963,"num_write":440,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"261'354","reported_seq":1025,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.192504+0000","last_change":"2024-09-12T00:38:50.192429+0000","last_active":"2024-09-12T00:38:50.192504+0000","last_peered":"2024-09-12T00:38:50.192504+0000","last_clean":"2024-09-12T00:38:50.192504+0000","last_became_active":"2024-09-12T00:01:57.146592+0000","last_became_peered":"2024-09-12T00:01:57.146592+0000","last_unstale":"2024-09-12T00:38:50.192504+0000","last_undegraded":"2024-09-12T00:38:50.192504+0000","last_fullsized":"2024-09-12T00:38:50.192504+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'354","last_scrub_stamp":"2024-09-12T00:38:50.192316+0000","last_deep_scrub":"261'354","last_deep_scrub_stamp":"2024-09-12T00:38:50.192316+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.192316+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:49.228766+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":560,"num_read_kb":36666,"num_write":1128,"num_write_kb":21178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"261'169","reported_seq":766,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.194086+0000","last_change":"2024-09-12T00:39:01.194024+0000","last_active":"2024-09-12T00:39:01.194086+0000","last_peered":"2024-09-12T00:39:01.194086+0000","last_clean":"2024-09-12T00:39:01.194086+0000","last_became_active":"2024-09-12T00:01:59.153277+0000","last_became_peered":"2024-09-12T00:01:59.153277+0000","last_unstale":"2024-09-12T00:39:01.194086+0000","last_undegraded":"2024-09-12T00:39:01.194086+0000","last_fullsized":"2024-09-12T00:39:01.194086+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'169","last_scrub_stamp":"2024-09-12T00:39:01.193932+0000","last_deep_scrub":"261'169","last_deep_scrub_stamp":"2024-09-12T00:39:01.193932+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.193932+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:25.959222+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":798,"num_read_kb":679,"num_write":291,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"261'362","reported_seq":984,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.753758+0000","last_change":"2024-09-12T00:38:53.753683+0000","last_active":"2024-09-12T00:38:53.753758+0000","last_peered":"2024-09-12T00:38:53.753758+0000","last_clean":"2024-09-12T00:38:53.753758+0000","last_became_active":"2024-09-12T00:01:57.151506+0000","last_became_peered":"2024-09-12T00:01:57.151506+0000","last_unstale":"2024-09-12T00:38:53.753758+0000","last_undegraded":"2024-09-12T00:38:53.753758+0000","last_fullsized":"2024-09-12T00:38:53.753758+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'362","last_scrub_stamp":"2024-09-12T00:38:53.753574+0000","last_deep_scrub":"261'362","last_deep_scrub_stamp":"2024-09-12T00:38:53.753574+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.753574+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:42.419681+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549580,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":524,"num_read_kb":7555,"num_write":1156,"num_write_kb":27882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"261'125","reported_seq":720,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.796487+0000","last_change":"2024-09-12T00:39:05.796381+0000","last_active":"2024-09-12T00:39:05.796487+0000","last_peered":"2024-09-12T00:39:05.796487+0000","last_clean":"2024-09-12T00:39:05.796487+0000","last_became_active":"2024-09-12T00:01:59.148098+0000","last_became_peered":"2024-09-12T00:01:59.148098+0000","last_unstale":"2024-09-12T00:39:05.796487+0000","last_undegraded":"2024-09-12T00:39:05.796487+0000","last_fullsized":"2024-09-12T00:39:05.796487+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'125","last_scrub_stamp":"2024-09-12T00:39:05.796284+0000","last_deep_scrub":"261'125","last_deep_scrub_stamp":"2024-09-12T00:39:05.796284+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.796284+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:09.512775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":522,"num_read_kb":439,"num_write":182,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"261'114","reported_seq":682,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.176239+0000","last_change":"2024-09-12T00:39:02.176174+0000","last_active":"2024-09-12T00:39:02.176239+0000","last_peered":"2024-09-12T00:39:02.176239+0000","last_clean":"2024-09-12T00:39:02.176239+0000","last_became_active":"2024-09-12T00:01:59.148017+0000","last_became_peered":"2024-09-12T00:01:59.148017+0000","last_unstale":"2024-09-12T00:39:02.176239+0000","last_undegraded":"2024-09-12T00:39:02.176239+0000","last_fullsized":"2024-09-12T00:39:02.176239+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'114","last_scrub_stamp":"2024-09-12T00:39:02.176085+0000","last_deep_scrub":"261'114","last_deep_scrub_stamp":"2024-09-12T00:39:02.176085+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.176085+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:35.656310+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":485,"num_read_kb":395,"num_write":184,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"261'329","reported_seq":1020,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.439185+0000","last_change":"2024-09-12T00:38:55.439185+0000","last_active":"2024-09-12T00:38:55.439185+0000","last_peered":"2024-09-12T00:38:55.439185+0000","last_clean":"2024-09-12T00:38:55.439185+0000","last_became_active":"2024-09-12T00:01:57.151116+0000","last_became_peered":"2024-09-12T00:01:57.151116+0000","last_unstale":"2024-09-12T00:38:55.439185+0000","last_undegraded":"2024-09-12T00:38:55.439185+0000","last_fullsized":"2024-09-12T00:38:55.439185+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-12T00:38:55.439011+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-12T00:38:55.439011+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.439011+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:22.277921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":563,"num_read_kb":78307,"num_write":1164,"num_write_kb":30055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"261'230","reported_seq":820,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.256265+0000","last_change":"2024-09-12T00:38:56.256197+0000","last_active":"2024-09-12T00:38:56.256265+0000","last_peered":"2024-09-12T00:38:56.256265+0000","last_clean":"2024-09-12T00:38:56.256265+0000","last_became_active":"2024-09-12T00:01:59.152131+0000","last_became_peered":"2024-09-12T00:01:59.152131+0000","last_unstale":"2024-09-12T00:38:56.256265+0000","last_undegraded":"2024-09-12T00:38:56.256265+0000","last_fullsized":"2024-09-12T00:38:56.256265+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'230","last_scrub_stamp":"2024-09-12T00:38:56.256111+0000","last_deep_scrub":"261'230","last_deep_scrub_stamp":"2024-09-12T00:38:56.256111+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.256111+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:30.034301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1011,"num_read_kb":807,"num_write":370,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"261'333","reported_seq":972,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.162288+0000","last_change":"2024-09-12T00:38:49.162288+0000","last_active":"2024-09-12T00:38:49.162288+0000","last_peered":"2024-09-12T00:38:49.162288+0000","last_clean":"2024-09-12T00:38:49.162288+0000","last_became_active":"2024-09-12T00:01:57.143834+0000","last_became_peered":"2024-09-12T00:01:57.143834+0000","last_unstale":"2024-09-12T00:38:49.162288+0000","last_undegraded":"2024-09-12T00:38:49.162288+0000","last_fullsized":"2024-09-12T00:38:49.162288+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'333","last_scrub_stamp":"2024-09-12T00:38:49.162133+0000","last_deep_scrub":"261'333","last_deep_scrub_stamp":"2024-09-12T00:38:49.162133+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.162133+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:54.670647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":522,"num_read_kb":1599,"num_write":1184,"num_write_kb":15734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"261'430","reported_seq":1144,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.414267+0000","last_change":"2024-09-12T00:38:51.414160+0000","last_active":"2024-09-12T00:38:51.414267+0000","last_peered":"2024-09-12T00:38:51.414267+0000","last_clean":"2024-09-12T00:38:51.414267+0000","last_became_active":"2024-09-12T00:01:59.153559+0000","last_became_peered":"2024-09-12T00:01:59.153559+0000","last_unstale":"2024-09-12T00:38:51.414267+0000","last_undegraded":"2024-09-12T00:38:51.414267+0000","last_fullsized":"2024-09-12T00:38:51.414267+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'430","last_scrub_stamp":"2024-09-12T00:38:51.414063+0000","last_deep_scrub":"261'430","last_deep_scrub_stamp":"2024-09-12T00:38:51.414063+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.414063+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:14.420551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2074,"num_read_kb":1775,"num_write":771,"num_write_kb":518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"261'321","reported_seq":938,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.159055+0000","last_change":"2024-09-12T00:38:48.159055+0000","last_active":"2024-09-12T00:38:48.159055+0000","last_peered":"2024-09-12T00:38:48.159055+0000","last_clean":"2024-09-12T00:38:48.159055+0000","last_became_active":"2024-09-12T00:01:57.150789+0000","last_became_peered":"2024-09-12T00:01:57.150789+0000","last_unstale":"2024-09-12T00:38:48.159055+0000","last_undegraded":"2024-09-12T00:38:48.159055+0000","last_fullsized":"2024-09-12T00:38:48.159055+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'321","last_scrub_stamp":"2024-09-12T00:38:48.158943+0000","last_deep_scrub":"261'321","last_deep_scrub_stamp":"2024-09-12T00:38:48.158943+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.158943+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:48.677325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2162197,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":443,"num_read_kb":13162,"num_write":967,"num_write_kb":19470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"261'149","reported_seq":780,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.946690+0000","last_change":"2024-09-12T00:38:57.946690+0000","last_active":"2024-09-12T00:38:57.946690+0000","last_peered":"2024-09-12T00:38:57.946690+0000","last_clean":"2024-09-12T00:38:57.946690+0000","last_became_active":"2024-09-12T00:01:59.149195+0000","last_became_peered":"2024-09-12T00:01:59.149195+0000","last_unstale":"2024-09-12T00:38:57.946690+0000","last_undegraded":"2024-09-12T00:38:57.946690+0000","last_fullsized":"2024-09-12T00:38:57.946690+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'149","last_scrub_stamp":"2024-09-12T00:38:57.946609+0000","last_deep_scrub":"261'149","last_deep_scrub_stamp":"2024-09-12T00:38:57.946609+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.946609+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:33.117967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":710,"num_read_kb":604,"num_write":216,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"261'359","reported_seq":1014,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.205052+0000","last_change":"2024-09-12T00:38:47.205052+0000","last_active":"2024-09-12T00:38:47.205052+0000","last_peered":"2024-09-12T00:38:47.205052+0000","last_clean":"2024-09-12T00:38:47.205052+0000","last_became_active":"2024-09-12T00:01:57.157877+0000","last_became_peered":"2024-09-12T00:01:57.157877+0000","last_unstale":"2024-09-12T00:38:47.205052+0000","last_undegraded":"2024-09-12T00:38:47.205052+0000","last_fullsized":"2024-09-12T00:38:47.205052+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'359","last_scrub_stamp":"2024-09-12T00:38:47.204901+0000","last_deep_scrub":"261'359","last_deep_scrub_stamp":"2024-09-12T00:38:47.204901+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.204901+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:27.995396+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7687320,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":26582,"num_write":1109,"num_write_kb":46689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"261'164","reported_seq":763,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.796833+0000","last_change":"2024-09-12T00:39:04.796833+0000","last_active":"2024-09-12T00:39:04.796833+0000","last_peered":"2024-09-12T00:39:04.796833+0000","last_clean":"2024-09-12T00:39:04.796833+0000","last_became_active":"2024-09-12T00:01:59.159215+0000","last_became_peered":"2024-09-12T00:01:59.159215+0000","last_unstale":"2024-09-12T00:39:04.796833+0000","last_undegraded":"2024-09-12T00:39:04.796833+0000","last_fullsized":"2024-09-12T00:39:04.796833+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'164","last_scrub_stamp":"2024-09-12T00:39:04.796746+0000","last_deep_scrub":"261'164","last_deep_scrub_stamp":"2024-09-12T00:39:04.796746+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.796746+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:07.277612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":584,"num_write":229,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"261'277","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.027690+0000","last_change":"2024-09-12T00:38:51.027690+0000","last_active":"2024-09-12T00:38:51.027690+0000","last_peered":"2024-09-12T00:38:51.027690+0000","last_clean":"2024-09-12T00:38:51.027690+0000","last_became_active":"2024-09-12T00:02:32.844466+0000","last_became_peered":"2024-09-12T00:02:32.844466+0000","last_unstale":"2024-09-12T00:38:51.027690+0000","last_undegraded":"2024-09-12T00:38:51.027690+0000","last_fullsized":"2024-09-12T00:38:51.027690+0000","mapping_epoch":37,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'277","last_scrub_stamp":"2024-09-12T00:38:51.027531+0000","last_deep_scrub":"261'277","last_deep_scrub_stamp":"2024-09-12T00:38:51.027531+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.027531+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:53.754319+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291469,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":476,"num_read_kb":38682,"num_write":1020,"num_write_kb":28786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"261'136","reported_seq":732,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.417987+0000","last_change":"2024-09-12T00:38:53.417987+0000","last_active":"2024-09-12T00:38:53.417987+0000","last_peered":"2024-09-12T00:38:53.417987+0000","last_clean":"2024-09-12T00:38:53.417987+0000","last_became_active":"2024-09-12T00:01:59.156058+0000","last_became_peered":"2024-09-12T00:01:59.156058+0000","last_unstale":"2024-09-12T00:38:53.417987+0000","last_undegraded":"2024-09-12T00:38:53.417987+0000","last_fullsized":"2024-09-12T00:38:53.417987+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'136","last_scrub_stamp":"2024-09-12T00:38:53.417890+0000","last_deep_scrub":"261'136","last_deep_scrub_stamp":"2024-09-12T00:38:53.417890+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.417890+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:53.404919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":582,"num_read_kb":485,"num_write":212,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"261'395","reported_seq":1019,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.055140+0000","last_change":"2024-09-12T00:38:50.055055+0000","last_active":"2024-09-12T00:38:50.055140+0000","last_peered":"2024-09-12T00:38:50.055140+0000","last_clean":"2024-09-12T00:38:50.055140+0000","last_became_active":"2024-09-12T00:01:57.136872+0000","last_became_peered":"2024-09-12T00:01:57.136872+0000","last_unstale":"2024-09-12T00:38:50.055140+0000","last_undegraded":"2024-09-12T00:38:50.055140+0000","last_fullsized":"2024-09-12T00:38:50.055140+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'395","last_scrub_stamp":"2024-09-12T00:38:50.054891+0000","last_deep_scrub":"261'395","last_deep_scrub_stamp":"2024-09-12T00:38:50.054891+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.054891+0000","objects_scrubbed":9,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:04.646670+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133748,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":28039,"num_write":1285,"num_write_kb":53988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"261'149","reported_seq":652,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.231078+0000","last_change":"2024-09-12T00:39:09.231078+0000","last_active":"2024-09-12T00:39:09.231078+0000","last_peered":"2024-09-12T00:39:09.231078+0000","last_clean":"2024-09-12T00:39:09.231078+0000","last_became_active":"2024-09-12T00:02:07.159308+0000","last_became_peered":"2024-09-12T00:02:07.159308+0000","last_unstale":"2024-09-12T00:39:09.231078+0000","last_undegraded":"2024-09-12T00:39:09.231078+0000","last_fullsized":"2024-09-12T00:39:09.231078+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'149","last_scrub_stamp":"2024-09-12T00:39:09.230977+0000","last_deep_scrub":"261'149","last_deep_scrub_stamp":"2024-09-12T00:39:09.230977+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.230977+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:34.505126+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":143,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"261'123","reported_seq":716,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.958244+0000","last_change":"2024-09-12T00:38:54.958150+0000","last_active":"2024-09-12T00:38:54.958244+0000","last_peered":"2024-09-12T00:38:54.958244+0000","last_clean":"2024-09-12T00:38:54.958244+0000","last_became_active":"2024-09-12T00:01:59.151773+0000","last_became_peered":"2024-09-12T00:01:59.151773+0000","last_unstale":"2024-09-12T00:38:54.958244+0000","last_undegraded":"2024-09-12T00:38:54.958244+0000","last_fullsized":"2024-09-12T00:38:54.958244+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'123","last_scrub_stamp":"2024-09-12T00:38:54.958046+0000","last_deep_scrub":"261'123","last_deep_scrub_stamp":"2024-09-12T00:38:54.958046+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.958046+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:49.574148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":478,"num_write":204,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"261'341","reported_seq":1037,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.231600+0000","last_change":"2024-09-12T00:38:52.231474+0000","last_active":"2024-09-12T00:38:52.231600+0000","last_peered":"2024-09-12T00:38:52.231600+0000","last_clean":"2024-09-12T00:38:52.231600+0000","last_became_active":"2024-09-12T00:01:57.165987+0000","last_became_peered":"2024-09-12T00:01:57.165987+0000","last_unstale":"2024-09-12T00:38:52.231600+0000","last_undegraded":"2024-09-12T00:38:52.231600+0000","last_fullsized":"2024-09-12T00:38:52.231600+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'341","last_scrub_stamp":"2024-09-12T00:38:52.231282+0000","last_deep_scrub":"261'341","last_deep_scrub_stamp":"2024-09-12T00:38:52.231282+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.231282+0000","objects_scrubbed":6,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:26.787977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":604,"num_read_kb":32539,"num_write":978,"num_write_kb":21474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.160571+0000","last_change":"2024-09-12T00:39:19.160571+0000","last_active":"2024-09-12T00:39:19.160571+0000","last_peered":"2024-09-12T00:39:19.160571+0000","last_clean":"2024-09-12T00:39:19.160571+0000","last_became_active":"2024-09-12T00:02:01.154464+0000","last_became_peered":"2024-09-12T00:02:01.154464+0000","last_unstale":"2024-09-12T00:39:19.160571+0000","last_undegraded":"2024-09-12T00:39:19.160571+0000","last_fullsized":"2024-09-12T00:39:19.160571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:19.160468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:19.160468+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.160468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:19.341255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"261'366","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.737006+0000","last_change":"2024-09-12T00:39:10.737006+0000","last_active":"2024-09-12T00:39:10.737006+0000","last_peered":"2024-09-12T00:39:10.737006+0000","last_clean":"2024-09-12T00:39:10.737006+0000","last_became_active":"2024-09-12T00:02:03.156175+0000","last_became_peered":"2024-09-12T00:02:03.156175+0000","last_unstale":"2024-09-12T00:39:10.737006+0000","last_undegraded":"2024-09-12T00:39:10.737006+0000","last_fullsized":"2024-09-12T00:39:10.737006+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'366","last_scrub_stamp":"2024-09-12T00:39:10.736881+0000","last_deep_scrub":"261'366","last_deep_scrub_stamp":"2024-09-12T00:39:10.736881+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.736881+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:27.441999+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51076,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":584,"num_read_kb":1265,"num_write":472,"num_write_kb":342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.440175+0000","last_change":"2024-09-12T00:39:07.440175+0000","last_active":"2024-09-12T00:39:07.440175+0000","last_peered":"2024-09-12T00:39:07.440175+0000","last_clean":"2024-09-12T00:39:07.440175+0000","last_became_active":"2024-09-12T00:02:05.165424+0000","last_became_peered":"2024-09-12T00:02:05.165424+0000","last_unstale":"2024-09-12T00:39:07.440175+0000","last_undegraded":"2024-09-12T00:39:07.440175+0000","last_fullsized":"2024-09-12T00:39:07.440175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:07.440077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:07.440077+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.440077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:31.618520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"261'131","reported_seq":689,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.476249+0000","last_change":"2024-09-12T00:39:09.476249+0000","last_active":"2024-09-12T00:39:09.476249+0000","last_peered":"2024-09-12T00:39:09.476249+0000","last_clean":"2024-09-12T00:39:09.476249+0000","last_became_active":"2024-09-12T00:02:07.174795+0000","last_became_peered":"2024-09-12T00:02:07.174795+0000","last_unstale":"2024-09-12T00:39:09.476249+0000","last_undegraded":"2024-09-12T00:39:09.476249+0000","last_fullsized":"2024-09-12T00:39:09.476249+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'131","last_scrub_stamp":"2024-09-12T00:39:09.476131+0000","last_deep_scrub":"261'131","last_deep_scrub_stamp":"2024-09-12T00:39:09.476131+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.476131+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:58.746588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":215,"num_read_kb":202,"num_write":239,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"261'76","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.248559+0000","last_change":"2024-09-12T00:39:10.248559+0000","last_active":"2024-09-12T00:39:10.248559+0000","last_peered":"2024-09-12T00:39:10.248559+0000","last_clean":"2024-09-12T00:39:10.248559+0000","last_became_active":"2024-09-12T00:01:59.145411+0000","last_became_peered":"2024-09-12T00:01:59.145411+0000","last_unstale":"2024-09-12T00:39:10.248559+0000","last_undegraded":"2024-09-12T00:39:10.248559+0000","last_fullsized":"2024-09-12T00:39:10.248559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'76","last_scrub_stamp":"2024-09-12T00:39:10.248448+0000","last_deep_scrub":"261'76","last_deep_scrub_stamp":"2024-09-12T00:39:10.248448+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.248448+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:06.953323+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":336,"num_read_kb":283,"num_write":104,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"261'371","reported_seq":1024,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.109970+0000","last_change":"2024-09-12T00:38:46.109874+0000","last_active":"2024-09-12T00:38:46.109970+0000","last_peered":"2024-09-12T00:38:46.109970+0000","last_clean":"2024-09-12T00:38:46.109970+0000","last_became_active":"2024-09-12T00:01:57.146952+0000","last_became_peered":"2024-09-12T00:01:57.146952+0000","last_unstale":"2024-09-12T00:38:46.109970+0000","last_undegraded":"2024-09-12T00:38:46.109970+0000","last_fullsized":"2024-09-12T00:38:46.109970+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'371","last_scrub_stamp":"2024-09-12T00:38:46.109709+0000","last_deep_scrub":"261'371","last_deep_scrub_stamp":"2024-09-12T00:38:46.109709+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.109709+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:43.843194+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":558,"num_read_kb":41499,"num_write":1262,"num_write_kb":32474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.585048+0000","last_change":"2024-09-12T00:39:02.584991+0000","last_active":"2024-09-12T00:39:02.585048+0000","last_peered":"2024-09-12T00:39:02.585048+0000","last_clean":"2024-09-12T00:39:02.585048+0000","last_became_active":"2024-09-12T00:02:01.155948+0000","last_became_peered":"2024-09-12T00:02:01.155948+0000","last_unstale":"2024-09-12T00:39:02.585048+0000","last_undegraded":"2024-09-12T00:39:02.585048+0000","last_fullsized":"2024-09-12T00:39:02.585048+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:02.584900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:02.584900+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.584900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:43.353221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"261'85","reported_seq":608,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.430510+0000","last_change":"2024-09-12T00:39:03.430510+0000","last_active":"2024-09-12T00:39:03.430510+0000","last_peered":"2024-09-12T00:39:03.430510+0000","last_clean":"2024-09-12T00:39:03.430510+0000","last_became_active":"2024-09-12T00:02:03.152708+0000","last_became_peered":"2024-09-12T00:02:03.152708+0000","last_unstale":"2024-09-12T00:39:03.430510+0000","last_undegraded":"2024-09-12T00:39:03.430510+0000","last_fullsized":"2024-09-12T00:39:03.430510+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'85","last_scrub_stamp":"2024-09-12T00:39:03.430417+0000","last_deep_scrub":"261'85","last_deep_scrub_stamp":"2024-09-12T00:39:03.430417+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.430417+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:01.332863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":89,"num_read_kb":85,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.446125+0000","last_change":"2024-09-12T00:39:06.446125+0000","last_active":"2024-09-12T00:39:06.446125+0000","last_peered":"2024-09-12T00:39:06.446125+0000","last_clean":"2024-09-12T00:39:06.446125+0000","last_became_active":"2024-09-12T00:02:05.162755+0000","last_became_peered":"2024-09-12T00:02:05.162755+0000","last_unstale":"2024-09-12T00:39:06.446125+0000","last_undegraded":"2024-09-12T00:39:06.446125+0000","last_fullsized":"2024-09-12T00:39:06.446125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:06.446044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:06.446044+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.446044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:19.043077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"261'138","reported_seq":631,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.028736+0000","last_change":"2024-09-12T00:39:10.028646+0000","last_active":"2024-09-12T00:39:10.028736+0000","last_peered":"2024-09-12T00:39:10.028736+0000","last_clean":"2024-09-12T00:39:10.028736+0000","last_became_active":"2024-09-12T00:02:07.167851+0000","last_became_peered":"2024-09-12T00:02:07.167851+0000","last_unstale":"2024-09-12T00:39:10.028736+0000","last_undegraded":"2024-09-12T00:39:10.028736+0000","last_fullsized":"2024-09-12T00:39:10.028736+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'138","last_scrub_stamp":"2024-09-12T00:39:10.028536+0000","last_deep_scrub":"261'138","last_deep_scrub_stamp":"2024-09-12T00:39:10.028536+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.028536+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:48.170223+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":141,"num_read_kb":137,"num_write":333,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"261'4129","reported_seq":4735,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.880211+0000","last_change":"2024-09-12T00:39:01.880211+0000","last_active":"2024-09-12T00:39:01.880211+0000","last_peered":"2024-09-12T00:39:01.880211+0000","last_clean":"2024-09-12T00:39:01.880211+0000","last_became_active":"2024-09-12T00:01:59.151026+0000","last_became_peered":"2024-09-12T00:01:59.151026+0000","last_unstale":"2024-09-12T00:39:01.880211+0000","last_undegraded":"2024-09-12T00:39:01.880211+0000","last_fullsized":"2024-09-12T00:39:01.880211+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4129","last_scrub_stamp":"2024-09-12T00:39:01.880122+0000","last_deep_scrub":"261'4129","last_deep_scrub_stamp":"2024-09-12T00:39:01.880122+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.880122+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":3000,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:04.626954+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16602,"num_read_kb":13937,"num_write":6188,"num_write_kb":3085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"261'296","reported_seq":1004,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.273302+0000","last_change":"2024-09-12T00:38:51.273199+0000","last_active":"2024-09-12T00:38:51.273302+0000","last_peered":"2024-09-12T00:38:51.273302+0000","last_clean":"2024-09-12T00:38:51.273302+0000","last_became_active":"2024-09-12T00:01:57.144269+0000","last_became_peered":"2024-09-12T00:01:57.144269+0000","last_unstale":"2024-09-12T00:38:51.273302+0000","last_undegraded":"2024-09-12T00:38:51.273302+0000","last_fullsized":"2024-09-12T00:38:51.273302+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'296","last_scrub_stamp":"2024-09-12T00:38:51.273042+0000","last_deep_scrub":"261'296","last_deep_scrub_stamp":"2024-09-12T00:38:51.273042+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.273042+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:27.864647+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399069,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":703,"num_read_kb":1796,"num_write":921,"num_write_kb":33986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.634681+0000","last_change":"2024-09-12T00:39:03.634681+0000","last_active":"2024-09-12T00:39:03.634681+0000","last_peered":"2024-09-12T00:39:03.634681+0000","last_clean":"2024-09-12T00:39:03.634681+0000","last_became_active":"2024-09-12T00:02:01.155425+0000","last_became_peered":"2024-09-12T00:02:01.155425+0000","last_unstale":"2024-09-12T00:39:03.634681+0000","last_undegraded":"2024-09-12T00:39:03.634681+0000","last_fullsized":"2024-09-12T00:39:03.634681+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:03.634589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:03.634589+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.634589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:12.318839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"261'110","reported_seq":652,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.739203+0000","last_change":"2024-09-12T00:39:09.739057+0000","last_active":"2024-09-12T00:39:09.739203+0000","last_peered":"2024-09-12T00:39:09.739203+0000","last_clean":"2024-09-12T00:39:09.739203+0000","last_became_active":"2024-09-12T00:02:03.151839+0000","last_became_peered":"2024-09-12T00:02:03.151839+0000","last_unstale":"2024-09-12T00:39:09.739203+0000","last_undegraded":"2024-09-12T00:39:09.739203+0000","last_fullsized":"2024-09-12T00:39:09.739203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'110","last_scrub_stamp":"2024-09-12T00:39:09.738938+0000","last_deep_scrub":"261'110","last_deep_scrub_stamp":"2024-09-12T00:39:09.738938+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.738938+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:36.714767+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":122,"num_read_kb":115,"num_write":80,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"261'759","reported_seq":2055,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:23.107685+0000","last_change":"2024-09-12T00:39:23.107685+0000","last_active":"2024-09-12T00:39:23.107685+0000","last_peered":"2024-09-12T00:39:23.107685+0000","last_clean":"2024-09-12T00:39:23.107685+0000","last_became_active":"2024-09-12T00:02:05.166985+0000","last_became_peered":"2024-09-12T00:02:05.166985+0000","last_unstale":"2024-09-12T00:39:23.107685+0000","last_undegraded":"2024-09-12T00:39:23.107685+0000","last_fullsized":"2024-09-12T00:39:23.107685+0000","mapping_epoch":32,"log_start":"261'701","ondisk_log_start":"261'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'759","last_scrub_stamp":"2024-09-12T00:39:23.107584+0000","last_deep_scrub":"261'759","last_deep_scrub_stamp":"2024-09-12T00:39:23.107584+0000","last_clean_scrub_stamp":"2024-09-12T00:39:23.107584+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":701,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:14.468840+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"261'219","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.059825+0000","last_change":"2024-09-12T00:39:10.059760+0000","last_active":"2024-09-12T00:39:10.059825+0000","last_peered":"2024-09-12T00:39:10.059825+0000","last_clean":"2024-09-12T00:39:10.059825+0000","last_became_active":"2024-09-12T00:02:07.167576+0000","last_became_peered":"2024-09-12T00:02:07.167576+0000","last_unstale":"2024-09-12T00:39:10.059825+0000","last_undegraded":"2024-09-12T00:39:10.059825+0000","last_fullsized":"2024-09-12T00:39:10.059825+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'219","last_scrub_stamp":"2024-09-12T00:39:10.059666+0000","last_deep_scrub":"261'219","last_deep_scrub_stamp":"2024-09-12T00:39:10.059666+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.059666+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:24.213624+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":605,"num_read_kb":603,"num_write":488,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"261'58","reported_seq":617,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.869456+0000","last_change":"2024-09-12T00:38:59.869456+0000","last_active":"2024-09-12T00:38:59.869456+0000","last_peered":"2024-09-12T00:38:59.869456+0000","last_clean":"2024-09-12T00:38:59.869456+0000","last_became_active":"2024-09-12T00:01:59.149087+0000","last_became_peered":"2024-09-12T00:01:59.149087+0000","last_unstale":"2024-09-12T00:38:59.869456+0000","last_undegraded":"2024-09-12T00:38:59.869456+0000","last_fullsized":"2024-09-12T00:38:59.869456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'58","last_scrub_stamp":"2024-09-12T00:38:59.869337+0000","last_deep_scrub":"261'58","last_deep_scrub_stamp":"2024-09-12T00:38:59.869337+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.869337+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:27:41.875669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":271,"num_read_kb":233,"num_write":78,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"261'349","reported_seq":1055,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.537155+0000","last_change":"2024-09-12T00:38:44.537092+0000","last_active":"2024-09-12T00:38:44.537155+0000","last_peered":"2024-09-12T00:38:44.537155+0000","last_clean":"2024-09-12T00:38:44.537155+0000","last_became_active":"2024-09-12T00:01:57.152332+0000","last_became_peered":"2024-09-12T00:01:57.152332+0000","last_unstale":"2024-09-12T00:38:44.537155+0000","last_undegraded":"2024-09-12T00:38:44.537155+0000","last_fullsized":"2024-09-12T00:38:44.537155+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T00:38:44.536985+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T00:38:44.536985+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.536985+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:37.312381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":516615,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":651,"num_read_kb":43786,"num_write":1177,"num_write_kb":39072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.332992+0000","last_change":"2024-09-12T00:39:12.332992+0000","last_active":"2024-09-12T00:39:12.332992+0000","last_peered":"2024-09-12T00:39:12.332992+0000","last_clean":"2024-09-12T00:39:12.332992+0000","last_became_active":"2024-09-12T00:02:01.154110+0000","last_became_peered":"2024-09-12T00:02:01.154110+0000","last_unstale":"2024-09-12T00:39:12.332992+0000","last_undegraded":"2024-09-12T00:39:12.332992+0000","last_fullsized":"2024-09-12T00:39:12.332992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:12.332907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:12.332907+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.332907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:30.728183+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"261'261","reported_seq":821,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.207586+0000","last_change":"2024-09-12T00:39:04.207586+0000","last_active":"2024-09-12T00:39:04.207586+0000","last_peered":"2024-09-12T00:39:04.207586+0000","last_clean":"2024-09-12T00:39:04.207586+0000","last_became_active":"2024-09-12T00:02:03.145673+0000","last_became_peered":"2024-09-12T00:02:03.145673+0000","last_unstale":"2024-09-12T00:39:04.207586+0000","last_undegraded":"2024-09-12T00:39:04.207586+0000","last_fullsized":"2024-09-12T00:39:04.207586+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'261","last_scrub_stamp":"2024-09-12T00:39:04.207480+0000","last_deep_scrub":"261'261","last_deep_scrub_stamp":"2024-09-12T00:39:04.207480+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.207480+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:22.980209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47470,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":426,"num_read_kb":957,"num_write":348,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"261'783","reported_seq":2164,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.746343+0000","last_change":"2024-09-12T00:39:15.746273+0000","last_active":"2024-09-12T00:39:15.746343+0000","last_peered":"2024-09-12T00:39:15.746343+0000","last_clean":"2024-09-12T00:39:15.746343+0000","last_became_active":"2024-09-12T00:02:05.165283+0000","last_became_peered":"2024-09-12T00:02:05.165283+0000","last_unstale":"2024-09-12T00:39:15.746343+0000","last_undegraded":"2024-09-12T00:39:15.746343+0000","last_fullsized":"2024-09-12T00:39:15.746343+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'783","last_scrub_stamp":"2024-09-12T00:39:15.746188+0000","last_deep_scrub":"261'783","last_deep_scrub_stamp":"2024-09-12T00:39:15.746188+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.746188+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:59.792273+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"261'107","reported_seq":685,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.191153+0000","last_change":"2024-09-12T00:38:59.191153+0000","last_active":"2024-09-12T00:38:59.191153+0000","last_peered":"2024-09-12T00:38:59.191153+0000","last_clean":"2024-09-12T00:38:59.191153+0000","last_became_active":"2024-09-12T00:01:59.153704+0000","last_became_peered":"2024-09-12T00:01:59.153704+0000","last_unstale":"2024-09-12T00:38:59.191153+0000","last_undegraded":"2024-09-12T00:38:59.191153+0000","last_fullsized":"2024-09-12T00:38:59.191153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'107","last_scrub_stamp":"2024-09-12T00:38:59.191064+0000","last_deep_scrub":"261'107","last_deep_scrub_stamp":"2024-09-12T00:38:59.191064+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.191064+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:10.002119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":462,"num_read_kb":389,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"261'347","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:42.111293+0000","last_change":"2024-09-12T00:38:42.111293+0000","last_active":"2024-09-12T00:38:42.111293+0000","last_peered":"2024-09-12T00:38:42.111293+0000","last_clean":"2024-09-12T00:38:42.111293+0000","last_became_active":"2024-09-12T00:01:57.154222+0000","last_became_peered":"2024-09-12T00:01:57.154222+0000","last_unstale":"2024-09-12T00:38:42.111293+0000","last_undegraded":"2024-09-12T00:38:42.111293+0000","last_fullsized":"2024-09-12T00:38:42.111293+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'347","last_scrub_stamp":"2024-09-12T00:38:42.111118+0000","last_deep_scrub":"261'347","last_deep_scrub_stamp":"2024-09-12T00:38:42.111118+0000","last_clean_scrub_stamp":"2024-09-12T00:38:42.111118+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:20.798122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589724,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":519,"num_read_kb":40360,"num_write":1158,"num_write_kb":32511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.459099+0000","last_change":"2024-09-12T00:38:57.459099+0000","last_active":"2024-09-12T00:38:57.459099+0000","last_peered":"2024-09-12T00:38:57.459099+0000","last_clean":"2024-09-12T00:38:57.459099+0000","last_became_active":"2024-09-12T00:02:01.144531+0000","last_became_peered":"2024-09-12T00:02:01.144531+0000","last_unstale":"2024-09-12T00:38:57.459099+0000","last_undegraded":"2024-09-12T00:38:57.459099+0000","last_fullsized":"2024-09-12T00:38:57.459099+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:57.459009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:57.459009+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.459009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:40.876686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"261'380","reported_seq":991,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.338811+0000","last_change":"2024-09-12T00:39:03.338712+0000","last_active":"2024-09-12T00:39:03.338811+0000","last_peered":"2024-09-12T00:39:03.338811+0000","last_clean":"2024-09-12T00:39:03.338811+0000","last_became_active":"2024-09-12T00:02:03.155293+0000","last_became_peered":"2024-09-12T00:02:03.155293+0000","last_unstale":"2024-09-12T00:39:03.338811+0000","last_undegraded":"2024-09-12T00:39:03.338811+0000","last_fullsized":"2024-09-12T00:39:03.338811+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'380","last_scrub_stamp":"2024-09-12T00:39:03.338549+0000","last_deep_scrub":"261'380","last_deep_scrub_stamp":"2024-09-12T00:39:03.338549+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.338549+0000","objects_scrubbed":10,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:48.702607+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50160,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":1260,"num_write":482,"num_write_kb":334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.976348+0000","last_change":"2024-09-12T00:39:08.976348+0000","last_active":"2024-09-12T00:39:08.976348+0000","last_peered":"2024-09-12T00:39:08.976348+0000","last_clean":"2024-09-12T00:39:08.976348+0000","last_became_active":"2024-09-12T00:02:05.167762+0000","last_became_peered":"2024-09-12T00:02:05.167762+0000","last_unstale":"2024-09-12T00:39:08.976348+0000","last_undegraded":"2024-09-12T00:39:08.976348+0000","last_fullsized":"2024-09-12T00:39:08.976348+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:08.976252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:08.976252+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.976252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:00.360348+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"261'550","reported_seq":1355,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.025702+0000","last_change":"2024-09-12T00:39:11.025639+0000","last_active":"2024-09-12T00:39:11.025702+0000","last_peered":"2024-09-12T00:39:11.025702+0000","last_clean":"2024-09-12T00:39:11.025702+0000","last_became_active":"2024-09-12T00:02:07.172005+0000","last_became_peered":"2024-09-12T00:02:07.172005+0000","last_unstale":"2024-09-12T00:39:11.025702+0000","last_undegraded":"2024-09-12T00:39:11.025702+0000","last_fullsized":"2024-09-12T00:39:11.025702+0000","mapping_epoch":34,"log_start":"261'500","ondisk_log_start":"261'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'550","last_scrub_stamp":"2024-09-12T00:39:11.025541+0000","last_deep_scrub":"261'550","last_deep_scrub_stamp":"2024-09-12T00:39:11.025541+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.025541+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:05.710518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1294,"num_read_kb":1285,"num_write":1129,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"261'119","reported_seq":697,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.449096+0000","last_change":"2024-09-12T00:38:54.449096+0000","last_active":"2024-09-12T00:38:54.449096+0000","last_peered":"2024-09-12T00:38:54.449096+0000","last_clean":"2024-09-12T00:38:54.449096+0000","last_became_active":"2024-09-12T00:01:59.151782+0000","last_became_peered":"2024-09-12T00:01:59.151782+0000","last_unstale":"2024-09-12T00:38:54.449096+0000","last_undegraded":"2024-09-12T00:38:54.449096+0000","last_fullsized":"2024-09-12T00:38:54.449096+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'119","last_scrub_stamp":"2024-09-12T00:38:54.449006+0000","last_deep_scrub":"261'119","last_deep_scrub_stamp":"2024-09-12T00:38:54.449006+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.449006+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:43.707307+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":531,"num_read_kb":439,"num_write":192,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"261'305","reported_seq":922,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:42.998047+0000","last_change":"2024-09-12T00:38:42.998047+0000","last_active":"2024-09-12T00:38:42.998047+0000","last_peered":"2024-09-12T00:38:42.998047+0000","last_clean":"2024-09-12T00:38:42.998047+0000","last_became_active":"2024-09-12T00:01:57.157370+0000","last_became_peered":"2024-09-12T00:01:57.157370+0000","last_unstale":"2024-09-12T00:38:42.998047+0000","last_undegraded":"2024-09-12T00:38:42.998047+0000","last_fullsized":"2024-09-12T00:38:42.998047+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'305","last_scrub_stamp":"2024-09-12T00:38:42.997918+0000","last_deep_scrub":"261'305","last_deep_scrub_stamp":"2024-09-12T00:38:42.997918+0000","last_clean_scrub_stamp":"2024-09-12T00:38:42.997918+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:53.007422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327243,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":441,"num_read_kb":3842,"num_write":968,"num_write_kb":16793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.950968+0000","last_change":"2024-09-12T00:38:58.950968+0000","last_active":"2024-09-12T00:38:58.950968+0000","last_peered":"2024-09-12T00:38:58.950968+0000","last_clean":"2024-09-12T00:38:58.950968+0000","last_became_active":"2024-09-12T00:02:01.151914+0000","last_became_peered":"2024-09-12T00:02:01.151914+0000","last_unstale":"2024-09-12T00:38:58.950968+0000","last_undegraded":"2024-09-12T00:38:58.950968+0000","last_fullsized":"2024-09-12T00:38:58.950968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:58.950859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:58.950859+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.950859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:32.731979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"261'281","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.703738+0000","last_change":"2024-09-12T00:39:11.703738+0000","last_active":"2024-09-12T00:39:11.703738+0000","last_peered":"2024-09-12T00:39:11.703738+0000","last_clean":"2024-09-12T00:39:11.703738+0000","last_became_active":"2024-09-12T00:02:03.154819+0000","last_became_peered":"2024-09-12T00:02:03.154819+0000","last_unstale":"2024-09-12T00:39:11.703738+0000","last_undegraded":"2024-09-12T00:39:11.703738+0000","last_fullsized":"2024-09-12T00:39:11.703738+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'281","last_scrub_stamp":"2024-09-12T00:39:11.703649+0000","last_deep_scrub":"261'281","last_deep_scrub_stamp":"2024-09-12T00:39:11.703649+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.703649+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:00.342091+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":442,"num_read_kb":1012,"num_write":362,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.663396+0000","last_change":"2024-09-12T00:39:15.663396+0000","last_active":"2024-09-12T00:39:15.663396+0000","last_peered":"2024-09-12T00:39:15.663396+0000","last_clean":"2024-09-12T00:39:15.663396+0000","last_became_active":"2024-09-12T00:02:05.168649+0000","last_became_peered":"2024-09-12T00:02:05.168649+0000","last_unstale":"2024-09-12T00:39:15.663396+0000","last_undegraded":"2024-09-12T00:39:15.663396+0000","last_fullsized":"2024-09-12T00:39:15.663396+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:15.663305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:15.663305+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.663305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:34.742904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"261'2370","reported_seq":4190,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.380832+0000","last_change":"2024-09-12T00:39:12.380760+0000","last_active":"2024-09-12T00:39:12.380832+0000","last_peered":"2024-09-12T00:39:12.380832+0000","last_clean":"2024-09-12T00:39:12.380832+0000","last_became_active":"2024-09-12T00:02:07.174769+0000","last_became_peered":"2024-09-12T00:02:07.174769+0000","last_unstale":"2024-09-12T00:39:12.380832+0000","last_undegraded":"2024-09-12T00:39:12.380832+0000","last_fullsized":"2024-09-12T00:39:12.380832+0000","mapping_epoch":34,"log_start":"261'2300","ondisk_log_start":"261'2300","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2370","last_scrub_stamp":"2024-09-12T00:39:12.380674+0000","last_deep_scrub":"261'2370","last_deep_scrub_stamp":"2024-09-12T00:39:12.380674+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.380674+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":2300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:27.782085+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5961,"num_read_kb":5964,"num_write":4767,"num_write_kb":1768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"261'190","reported_seq":821,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.093622+0000","last_change":"2024-09-12T00:38:51.093560+0000","last_active":"2024-09-12T00:38:51.093622+0000","last_peered":"2024-09-12T00:38:51.093622+0000","last_clean":"2024-09-12T00:38:51.093622+0000","last_became_active":"2024-09-12T00:01:59.156252+0000","last_became_peered":"2024-09-12T00:01:59.156252+0000","last_unstale":"2024-09-12T00:38:51.093622+0000","last_undegraded":"2024-09-12T00:38:51.093622+0000","last_fullsized":"2024-09-12T00:38:51.093622+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'190","last_scrub_stamp":"2024-09-12T00:38:51.093465+0000","last_deep_scrub":"261'190","last_deep_scrub_stamp":"2024-09-12T00:38:51.093465+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.093465+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:31.896004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":846,"num_read_kb":702,"num_write":296,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"261'368","reported_seq":1015,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.261298+0000","last_change":"2024-09-12T00:38:50.261298+0000","last_active":"2024-09-12T00:38:50.261298+0000","last_peered":"2024-09-12T00:38:50.261298+0000","last_clean":"2024-09-12T00:38:50.261298+0000","last_became_active":"2024-09-12T00:01:57.157699+0000","last_became_peered":"2024-09-12T00:01:57.157699+0000","last_unstale":"2024-09-12T00:38:50.261298+0000","last_undegraded":"2024-09-12T00:38:50.261298+0000","last_fullsized":"2024-09-12T00:38:50.261298+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'368","last_scrub_stamp":"2024-09-12T00:38:50.261168+0000","last_deep_scrub":"261'368","last_deep_scrub_stamp":"2024-09-12T00:38:50.261168+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.261168+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:19.208333+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":32954,"num_write":1221,"num_write_kb":41911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.805229+0000","last_change":"2024-09-12T00:39:06.805229+0000","last_active":"2024-09-12T00:39:06.805229+0000","last_peered":"2024-09-12T00:39:06.805229+0000","last_clean":"2024-09-12T00:39:06.805229+0000","last_became_active":"2024-09-12T00:02:01.153090+0000","last_became_peered":"2024-09-12T00:02:01.153090+0000","last_unstale":"2024-09-12T00:39:06.805229+0000","last_undegraded":"2024-09-12T00:39:06.805229+0000","last_fullsized":"2024-09-12T00:39:06.805229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:06.805116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:06.805116+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.805116+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:16.685921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"261'330","reported_seq":917,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.260723+0000","last_change":"2024-09-12T00:39:14.260723+0000","last_active":"2024-09-12T00:39:14.260723+0000","last_peered":"2024-09-12T00:39:14.260723+0000","last_clean":"2024-09-12T00:39:14.260723+0000","last_became_active":"2024-09-12T00:02:03.153386+0000","last_became_peered":"2024-09-12T00:02:03.153386+0000","last_unstale":"2024-09-12T00:39:14.260723+0000","last_undegraded":"2024-09-12T00:39:14.260723+0000","last_fullsized":"2024-09-12T00:39:14.260723+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'330","last_scrub_stamp":"2024-09-12T00:39:14.260607+0000","last_deep_scrub":"261'330","last_deep_scrub_stamp":"2024-09-12T00:39:14.260607+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.260607+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:42.018666+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50481,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":533,"num_read_kb":1216,"num_write":438,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"261'783","reported_seq":2246,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.699412+0000","last_change":"2024-09-12T00:39:13.699412+0000","last_active":"2024-09-12T00:39:13.699412+0000","last_peered":"2024-09-12T00:39:13.699412+0000","last_clean":"2024-09-12T00:39:13.699412+0000","last_became_active":"2024-09-12T00:02:05.165892+0000","last_became_peered":"2024-09-12T00:02:05.165892+0000","last_unstale":"2024-09-12T00:39:13.699412+0000","last_undegraded":"2024-09-12T00:39:13.699412+0000","last_fullsized":"2024-09-12T00:39:13.699412+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'783","last_scrub_stamp":"2024-09-12T00:39:13.699327+0000","last_deep_scrub":"261'783","last_deep_scrub_stamp":"2024-09-12T00:39:13.699327+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.699327+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:11.908777+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"261'90","reported_seq":573,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.992321+0000","last_change":"2024-09-12T00:39:11.992321+0000","last_active":"2024-09-12T00:39:11.992321+0000","last_peered":"2024-09-12T00:39:11.992321+0000","last_clean":"2024-09-12T00:39:11.992321+0000","last_became_active":"2024-09-12T00:02:07.169216+0000","last_became_peered":"2024-09-12T00:02:07.169216+0000","last_unstale":"2024-09-12T00:39:11.992321+0000","last_undegraded":"2024-09-12T00:39:11.992321+0000","last_fullsized":"2024-09-12T00:39:11.992321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'90","last_scrub_stamp":"2024-09-12T00:39:11.992219+0000","last_deep_scrub":"261'90","last_deep_scrub_stamp":"2024-09-12T00:39:11.992219+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.992219+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:31.425358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":65,"num_write":199,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"261'131","reported_seq":715,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.837599+0000","last_change":"2024-09-12T00:38:56.837599+0000","last_active":"2024-09-12T00:38:56.837599+0000","last_peered":"2024-09-12T00:38:56.837599+0000","last_clean":"2024-09-12T00:38:56.837599+0000","last_became_active":"2024-09-12T00:01:59.152836+0000","last_became_peered":"2024-09-12T00:01:59.152836+0000","last_unstale":"2024-09-12T00:38:56.837599+0000","last_undegraded":"2024-09-12T00:38:56.837599+0000","last_fullsized":"2024-09-12T00:38:56.837599+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'131","last_scrub_stamp":"2024-09-12T00:38:56.837464+0000","last_deep_scrub":"261'131","last_deep_scrub_stamp":"2024-09-12T00:38:56.837464+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.837464+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:06.526573+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":586,"num_read_kb":483,"num_write":208,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"261'320","reported_seq":965,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.128035+0000","last_change":"2024-09-12T00:38:43.128035+0000","last_active":"2024-09-12T00:38:43.128035+0000","last_peered":"2024-09-12T00:38:43.128035+0000","last_clean":"2024-09-12T00:38:43.128035+0000","last_became_active":"2024-09-12T00:01:57.143137+0000","last_became_peered":"2024-09-12T00:01:57.143137+0000","last_unstale":"2024-09-12T00:38:43.128035+0000","last_undegraded":"2024-09-12T00:38:43.128035+0000","last_fullsized":"2024-09-12T00:38:43.128035+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'320","last_scrub_stamp":"2024-09-12T00:38:43.127908+0000","last_deep_scrub":"261'320","last_deep_scrub_stamp":"2024-09-12T00:38:43.127908+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.127908+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:53.536834+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286939,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":8103,"num_write":1063,"num_write_kb":32276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.930140+0000","last_change":"2024-09-12T00:38:59.930140+0000","last_active":"2024-09-12T00:38:59.930140+0000","last_peered":"2024-09-12T00:38:59.930140+0000","last_clean":"2024-09-12T00:38:59.930140+0000","last_became_active":"2024-09-12T00:02:01.144199+0000","last_became_peered":"2024-09-12T00:02:01.144199+0000","last_unstale":"2024-09-12T00:38:59.930140+0000","last_undegraded":"2024-09-12T00:38:59.930140+0000","last_fullsized":"2024-09-12T00:38:59.930140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.930003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.930003+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.930003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:43.802037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"261'493","reported_seq":1134,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.697135+0000","last_change":"2024-09-12T00:39:06.697135+0000","last_active":"2024-09-12T00:39:06.697135+0000","last_peered":"2024-09-12T00:39:06.697135+0000","last_clean":"2024-09-12T00:39:06.697135+0000","last_became_active":"2024-09-12T00:02:03.155625+0000","last_became_peered":"2024-09-12T00:02:03.155625+0000","last_unstale":"2024-09-12T00:39:06.697135+0000","last_undegraded":"2024-09-12T00:39:06.697135+0000","last_fullsized":"2024-09-12T00:39:06.697135+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'493","last_scrub_stamp":"2024-09-12T00:39:06.697030+0000","last_deep_scrub":"261'493","last_deep_scrub_stamp":"2024-09-12T00:39:06.697030+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.697030+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:53.918945+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104418,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":868,"num_read_kb":2109,"num_write":716,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.717324+0000","last_change":"2024-09-12T00:39:12.717324+0000","last_active":"2024-09-12T00:39:12.717324+0000","last_peered":"2024-09-12T00:39:12.717324+0000","last_clean":"2024-09-12T00:39:12.717324+0000","last_became_active":"2024-09-12T00:02:05.168816+0000","last_became_peered":"2024-09-12T00:02:05.168816+0000","last_unstale":"2024-09-12T00:39:12.717324+0000","last_undegraded":"2024-09-12T00:39:12.717324+0000","last_fullsized":"2024-09-12T00:39:12.717324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:12.717233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:12.717233+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.717233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:01.788155+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"261'160","reported_seq":662,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.947174+0000","last_change":"2024-09-12T00:39:07.947174+0000","last_active":"2024-09-12T00:39:07.947174+0000","last_peered":"2024-09-12T00:39:07.947174+0000","last_clean":"2024-09-12T00:39:07.947174+0000","last_became_active":"2024-09-12T00:02:07.171762+0000","last_became_peered":"2024-09-12T00:02:07.171762+0000","last_unstale":"2024-09-12T00:39:07.947174+0000","last_undegraded":"2024-09-12T00:39:07.947174+0000","last_fullsized":"2024-09-12T00:39:07.947174+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'160","last_scrub_stamp":"2024-09-12T00:39:07.947071+0000","last_deep_scrub":"261'160","last_deep_scrub_stamp":"2024-09-12T00:39:07.947071+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.947071+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:16.042433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":181,"num_read_kb":171,"num_write":367,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"261'251","reported_seq":898,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.196650+0000","last_change":"2024-09-12T00:38:53.196650+0000","last_active":"2024-09-12T00:38:53.196650+0000","last_peered":"2024-09-12T00:38:53.196650+0000","last_clean":"2024-09-12T00:38:53.196650+0000","last_became_active":"2024-09-12T00:01:59.147762+0000","last_became_peered":"2024-09-12T00:01:59.147762+0000","last_unstale":"2024-09-12T00:38:53.196650+0000","last_undegraded":"2024-09-12T00:38:53.196650+0000","last_fullsized":"2024-09-12T00:38:53.196650+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'251","last_scrub_stamp":"2024-09-12T00:38:53.196559+0000","last_deep_scrub":"261'251","last_deep_scrub_stamp":"2024-09-12T00:38:53.196559+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.196559+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:22.688918+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1058,"num_read_kb":865,"num_write":369,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"261'311","reported_seq":919,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.806433+0000","last_change":"2024-09-12T00:38:45.806433+0000","last_active":"2024-09-12T00:38:45.806433+0000","last_peered":"2024-09-12T00:38:45.806433+0000","last_clean":"2024-09-12T00:38:45.806433+0000","last_became_active":"2024-09-12T00:01:57.139677+0000","last_became_peered":"2024-09-12T00:01:57.139677+0000","last_unstale":"2024-09-12T00:38:45.806433+0000","last_undegraded":"2024-09-12T00:38:45.806433+0000","last_fullsized":"2024-09-12T00:38:45.806433+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'311","last_scrub_stamp":"2024-09-12T00:38:45.806294+0000","last_deep_scrub":"261'311","last_deep_scrub_stamp":"2024-09-12T00:38:45.806294+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.806294+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:02.113023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":441,"num_read_kb":3669,"num_write":1056,"num_write_kb":17146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.890918+0000","last_change":"2024-09-12T00:38:58.890918+0000","last_active":"2024-09-12T00:38:58.890918+0000","last_peered":"2024-09-12T00:38:58.890918+0000","last_clean":"2024-09-12T00:38:58.890918+0000","last_became_active":"2024-09-12T00:02:01.150796+0000","last_became_peered":"2024-09-12T00:02:01.150796+0000","last_unstale":"2024-09-12T00:38:58.890918+0000","last_undegraded":"2024-09-12T00:38:58.890918+0000","last_fullsized":"2024-09-12T00:38:58.890918+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:58.890832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:58.890832+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.890832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:05.434384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"261'281","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.402828+0000","last_change":"2024-09-12T00:39:02.402828+0000","last_active":"2024-09-12T00:39:02.402828+0000","last_peered":"2024-09-12T00:39:02.402828+0000","last_clean":"2024-09-12T00:39:02.402828+0000","last_became_active":"2024-09-12T00:02:03.153447+0000","last_became_peered":"2024-09-12T00:02:03.153447+0000","last_unstale":"2024-09-12T00:39:02.402828+0000","last_undegraded":"2024-09-12T00:39:02.402828+0000","last_fullsized":"2024-09-12T00:39:02.402828+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'281","last_scrub_stamp":"2024-09-12T00:39:02.402726+0000","last_deep_scrub":"261'281","last_deep_scrub_stamp":"2024-09-12T00:39:02.402726+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.402726+0000","objects_scrubbed":7,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:26.074688+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49756,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":469,"num_read_kb":1005,"num_write":420,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.948843+0000","last_change":"2024-09-12T00:39:02.948843+0000","last_active":"2024-09-12T00:39:02.948843+0000","last_peered":"2024-09-12T00:39:02.948843+0000","last_clean":"2024-09-12T00:39:02.948843+0000","last_became_active":"2024-09-12T00:02:05.163689+0000","last_became_peered":"2024-09-12T00:02:05.163689+0000","last_unstale":"2024-09-12T00:39:02.948843+0000","last_undegraded":"2024-09-12T00:39:02.948843+0000","last_fullsized":"2024-09-12T00:39:02.948843+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:02.948756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:02.948756+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.948756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:26.562845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"261'132","reported_seq":622,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.793463+0000","last_change":"2024-09-12T00:39:17.793463+0000","last_active":"2024-09-12T00:39:17.793463+0000","last_peered":"2024-09-12T00:39:17.793463+0000","last_clean":"2024-09-12T00:39:17.793463+0000","last_became_active":"2024-09-12T00:02:07.171942+0000","last_became_peered":"2024-09-12T00:02:07.171942+0000","last_unstale":"2024-09-12T00:39:17.793463+0000","last_undegraded":"2024-09-12T00:39:17.793463+0000","last_fullsized":"2024-09-12T00:39:17.793463+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'132","last_scrub_stamp":"2024-09-12T00:39:17.793369+0000","last_deep_scrub":"261'132","last_deep_scrub_stamp":"2024-09-12T00:39:17.793369+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.793369+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:30.465139+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":319,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"261'138","reported_seq":735,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.199034+0000","last_change":"2024-09-12T00:39:05.199034+0000","last_active":"2024-09-12T00:39:05.199034+0000","last_peered":"2024-09-12T00:39:05.199034+0000","last_clean":"2024-09-12T00:39:05.199034+0000","last_became_active":"2024-09-12T00:01:59.148534+0000","last_became_peered":"2024-09-12T00:01:59.148534+0000","last_unstale":"2024-09-12T00:39:05.199034+0000","last_undegraded":"2024-09-12T00:39:05.199034+0000","last_fullsized":"2024-09-12T00:39:05.199034+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'138","last_scrub_stamp":"2024-09-12T00:39:05.198946+0000","last_deep_scrub":"261'138","last_deep_scrub_stamp":"2024-09-12T00:39:05.198946+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.198946+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:16.549918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":616,"num_read_kb":510,"num_write":211,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"261'366","reported_seq":1016,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.281853+0000","last_change":"2024-09-12T00:38:49.281790+0000","last_active":"2024-09-12T00:38:49.281853+0000","last_peered":"2024-09-12T00:38:49.281853+0000","last_clean":"2024-09-12T00:38:49.281853+0000","last_became_active":"2024-09-12T00:01:57.165226+0000","last_became_peered":"2024-09-12T00:01:57.165226+0000","last_unstale":"2024-09-12T00:38:49.281853+0000","last_undegraded":"2024-09-12T00:38:49.281853+0000","last_fullsized":"2024-09-12T00:38:49.281853+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'366","last_scrub_stamp":"2024-09-12T00:38:49.281653+0000","last_deep_scrub":"261'366","last_deep_scrub_stamp":"2024-09-12T00:38:49.281653+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.281653+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:38.107200+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436889,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":580,"num_read_kb":11178,"num_write":1222,"num_write_kb":42398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":491,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.853856+0000","last_change":"2024-09-12T00:39:07.853856+0000","last_active":"2024-09-12T00:39:07.853856+0000","last_peered":"2024-09-12T00:39:07.853856+0000","last_clean":"2024-09-12T00:39:07.853856+0000","last_became_active":"2024-09-12T00:02:01.153818+0000","last_became_peered":"2024-09-12T00:02:01.153818+0000","last_unstale":"2024-09-12T00:39:07.853856+0000","last_undegraded":"2024-09-12T00:39:07.853856+0000","last_fullsized":"2024-09-12T00:39:07.853856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:07.853730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:07.853730+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.853730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:19.668987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"261'299","reported_seq":871,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.805022+0000","last_change":"2024-09-12T00:39:09.805022+0000","last_active":"2024-09-12T00:39:09.805022+0000","last_peered":"2024-09-12T00:39:09.805022+0000","last_clean":"2024-09-12T00:39:09.805022+0000","last_became_active":"2024-09-12T00:02:03.152421+0000","last_became_peered":"2024-09-12T00:02:03.152421+0000","last_unstale":"2024-09-12T00:39:09.805022+0000","last_undegraded":"2024-09-12T00:39:09.805022+0000","last_fullsized":"2024-09-12T00:39:09.805022+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'299","last_scrub_stamp":"2024-09-12T00:39:09.804926+0000","last_deep_scrub":"261'299","last_deep_scrub_stamp":"2024-09-12T00:39:09.804926+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.804926+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:51.784383+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49051,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":1143,"num_write":402,"num_write_kb":321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"261'761","reported_seq":2126,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.915452+0000","last_change":"2024-09-12T00:39:01.915452+0000","last_active":"2024-09-12T00:39:01.915452+0000","last_peered":"2024-09-12T00:39:01.915452+0000","last_clean":"2024-09-12T00:39:01.915452+0000","last_became_active":"2024-09-12T00:02:05.164655+0000","last_became_peered":"2024-09-12T00:02:05.164655+0000","last_unstale":"2024-09-12T00:39:01.915452+0000","last_undegraded":"2024-09-12T00:39:01.915452+0000","last_fullsized":"2024-09-12T00:39:01.915452+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'761","last_scrub_stamp":"2024-09-12T00:39:01.915354+0000","last_deep_scrub":"261'761","last_deep_scrub_stamp":"2024-09-12T00:39:01.915354+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.915354+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:26.039431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"261'98","reported_seq":582,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.990011+0000","last_change":"2024-09-12T00:39:10.989947+0000","last_active":"2024-09-12T00:39:10.990011+0000","last_peered":"2024-09-12T00:39:10.990011+0000","last_clean":"2024-09-12T00:39:10.990011+0000","last_became_active":"2024-09-12T00:02:07.164754+0000","last_became_peered":"2024-09-12T00:02:07.164754+0000","last_unstale":"2024-09-12T00:39:10.990011+0000","last_undegraded":"2024-09-12T00:39:10.990011+0000","last_fullsized":"2024-09-12T00:39:10.990011+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'98","last_scrub_stamp":"2024-09-12T00:39:10.989857+0000","last_deep_scrub":"261'98","last_deep_scrub_stamp":"2024-09-12T00:39:10.989857+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.989857+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:41.380480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1243,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":86,"num_write":233,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"261'86","reported_seq":648,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.080211+0000","last_change":"2024-09-12T00:38:52.080211+0000","last_active":"2024-09-12T00:38:52.080211+0000","last_peered":"2024-09-12T00:38:52.080211+0000","last_clean":"2024-09-12T00:38:52.080211+0000","last_became_active":"2024-09-12T00:01:59.157172+0000","last_became_peered":"2024-09-12T00:01:59.157172+0000","last_unstale":"2024-09-12T00:38:52.080211+0000","last_undegraded":"2024-09-12T00:38:52.080211+0000","last_fullsized":"2024-09-12T00:38:52.080211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'86","last_scrub_stamp":"2024-09-12T00:38:52.080123+0000","last_deep_scrub":"261'86","last_deep_scrub_stamp":"2024-09-12T00:38:52.080123+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.080123+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:17.189295+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":384,"num_read_kb":356,"num_write":138,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2877,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"261'377","reported_seq":1036,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.321918+0000","last_change":"2024-09-12T00:38:48.321852+0000","last_active":"2024-09-12T00:38:48.321918+0000","last_peered":"2024-09-12T00:38:48.321918+0000","last_clean":"2024-09-12T00:38:48.321918+0000","last_became_active":"2024-09-12T00:01:57.145710+0000","last_became_peered":"2024-09-12T00:01:57.145710+0000","last_unstale":"2024-09-12T00:38:48.321918+0000","last_undegraded":"2024-09-12T00:38:48.321918+0000","last_fullsized":"2024-09-12T00:38:48.321918+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'377","last_scrub_stamp":"2024-09-12T00:38:48.321674+0000","last_deep_scrub":"261'377","last_deep_scrub_stamp":"2024-09-12T00:38:48.321674+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.321674+0000","objects_scrubbed":9,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:27.181005+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1440158,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":582,"num_read_kb":20019,"num_write":1294,"num_write_kb":22247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"261'8","reported_seq":1931,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.449113+0000","last_change":"2024-09-12T00:38:56.449113+0000","last_active":"2024-09-12T00:38:56.449113+0000","last_peered":"2024-09-12T00:38:56.449113+0000","last_clean":"2024-09-12T00:38:56.449113+0000","last_became_active":"2024-09-12T00:02:01.143823+0000","last_became_peered":"2024-09-12T00:02:01.143823+0000","last_unstale":"2024-09-12T00:38:56.449113+0000","last_undegraded":"2024-09-12T00:38:56.449113+0000","last_fullsized":"2024-09-12T00:38:56.449113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-12T00:38:56.449020+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-12T00:38:56.449020+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.449020+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:41.425744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":562,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1676,"num_read_kb":1674,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"261'70","reported_seq":576,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.957192+0000","last_change":"2024-09-12T00:39:03.957192+0000","last_active":"2024-09-12T00:39:03.957192+0000","last_peered":"2024-09-12T00:39:03.957192+0000","last_clean":"2024-09-12T00:39:03.957192+0000","last_became_active":"2024-09-12T00:02:03.156680+0000","last_became_peered":"2024-09-12T00:02:03.156680+0000","last_unstale":"2024-09-12T00:39:03.957192+0000","last_undegraded":"2024-09-12T00:39:03.957192+0000","last_fullsized":"2024-09-12T00:39:03.957192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'70","last_scrub_stamp":"2024-09-12T00:39:03.957096+0000","last_deep_scrub":"261'70","last_deep_scrub_stamp":"2024-09-12T00:39:03.957096+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.957096+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:33.811930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":63,"num_read_kb":57,"num_write":44,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"261'775","reported_seq":2297,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.492424+0000","last_change":"2024-09-12T00:39:05.492424+0000","last_active":"2024-09-12T00:39:05.492424+0000","last_peered":"2024-09-12T00:39:05.492424+0000","last_clean":"2024-09-12T00:39:05.492424+0000","last_became_active":"2024-09-12T00:02:05.163596+0000","last_became_peered":"2024-09-12T00:02:05.163596+0000","last_unstale":"2024-09-12T00:39:05.492424+0000","last_undegraded":"2024-09-12T00:39:05.492424+0000","last_fullsized":"2024-09-12T00:39:05.492424+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'775","last_scrub_stamp":"2024-09-12T00:39:05.492347+0000","last_deep_scrub":"261'775","last_deep_scrub_stamp":"2024-09-12T00:39:05.492347+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.492347+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:33.359858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"261'120","reported_seq":611,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.180752+0000","last_change":"2024-09-12T00:39:06.180688+0000","last_active":"2024-09-12T00:39:06.180752+0000","last_peered":"2024-09-12T00:39:06.180752+0000","last_clean":"2024-09-12T00:39:06.180752+0000","last_became_active":"2024-09-12T00:02:07.169160+0000","last_became_peered":"2024-09-12T00:02:07.169160+0000","last_unstale":"2024-09-12T00:39:06.180752+0000","last_undegraded":"2024-09-12T00:39:06.180752+0000","last_fullsized":"2024-09-12T00:39:06.180752+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'120","last_scrub_stamp":"2024-09-12T00:39:06.180617+0000","last_deep_scrub":"261'120","last_deep_scrub_stamp":"2024-09-12T00:39:06.180617+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.180617+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:53.593418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":119,"num_write":276,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"261'226","reported_seq":793,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.777724+0000","last_change":"2024-09-12T00:38:48.777724+0000","last_active":"2024-09-12T00:38:48.777724+0000","last_peered":"2024-09-12T00:38:48.777724+0000","last_clean":"2024-09-12T00:38:48.777724+0000","last_became_active":"2024-09-12T00:01:59.152145+0000","last_became_peered":"2024-09-12T00:01:59.152145+0000","last_unstale":"2024-09-12T00:38:48.777724+0000","last_undegraded":"2024-09-12T00:38:48.777724+0000","last_fullsized":"2024-09-12T00:38:48.777724+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'226","last_scrub_stamp":"2024-09-12T00:38:48.777643+0000","last_deep_scrub":"261'226","last_deep_scrub_stamp":"2024-09-12T00:38:48.777643+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.777643+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:12.164018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":927,"num_read_kb":744,"num_write":332,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"261'404","reported_seq":1118,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.557690+0000","last_change":"2024-09-12T00:38:48.557690+0000","last_active":"2024-09-12T00:38:48.557690+0000","last_peered":"2024-09-12T00:38:48.557690+0000","last_clean":"2024-09-12T00:38:48.557690+0000","last_became_active":"2024-09-12T00:01:57.140715+0000","last_became_peered":"2024-09-12T00:01:57.140715+0000","last_unstale":"2024-09-12T00:38:48.557690+0000","last_undegraded":"2024-09-12T00:38:48.557690+0000","last_fullsized":"2024-09-12T00:38:48.557690+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'404","last_scrub_stamp":"2024-09-12T00:38:48.557572+0000","last_deep_scrub":"261'404","last_deep_scrub_stamp":"2024-09-12T00:38:48.557572+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.557572+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:12.419290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":94303,"num_write":1279,"num_write_kb":32809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.216913+0000","last_change":"2024-09-12T00:39:08.216913+0000","last_active":"2024-09-12T00:39:08.216913+0000","last_peered":"2024-09-12T00:39:08.216913+0000","last_clean":"2024-09-12T00:39:08.216913+0000","last_became_active":"2024-09-12T00:02:01.153347+0000","last_became_peered":"2024-09-12T00:02:01.153347+0000","last_unstale":"2024-09-12T00:39:08.216913+0000","last_undegraded":"2024-09-12T00:39:08.216913+0000","last_fullsized":"2024-09-12T00:39:08.216913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:08.216830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:08.216830+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.216830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:23.658033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"261'323","reported_seq":918,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.413073+0000","last_change":"2024-09-12T00:39:01.413073+0000","last_active":"2024-09-12T00:39:01.413073+0000","last_peered":"2024-09-12T00:39:01.413073+0000","last_clean":"2024-09-12T00:39:01.413073+0000","last_became_active":"2024-09-12T00:02:03.154752+0000","last_became_peered":"2024-09-12T00:02:03.154752+0000","last_unstale":"2024-09-12T00:39:01.413073+0000","last_undegraded":"2024-09-12T00:39:01.413073+0000","last_fullsized":"2024-09-12T00:39:01.413073+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-12T00:39:01.412937+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-12T00:39:01.412937+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.412937+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:32.529380+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43947,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1120,"num_write":412,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.228503+0000","last_change":"2024-09-12T00:39:02.228503+0000","last_active":"2024-09-12T00:39:02.228503+0000","last_peered":"2024-09-12T00:39:02.228503+0000","last_clean":"2024-09-12T00:39:02.228503+0000","last_became_active":"2024-09-12T00:02:05.164108+0000","last_became_peered":"2024-09-12T00:02:05.164108+0000","last_unstale":"2024-09-12T00:39:02.228503+0000","last_undegraded":"2024-09-12T00:39:02.228503+0000","last_fullsized":"2024-09-12T00:39:02.228503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:02.228412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:02.228412+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.228412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:17.624723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"261'162","reported_seq":645,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.920278+0000","last_change":"2024-09-12T00:39:06.920217+0000","last_active":"2024-09-12T00:39:06.920278+0000","last_peered":"2024-09-12T00:39:06.920278+0000","last_clean":"2024-09-12T00:39:06.920278+0000","last_became_active":"2024-09-12T00:02:07.169351+0000","last_became_peered":"2024-09-12T00:02:07.169351+0000","last_unstale":"2024-09-12T00:39:06.920278+0000","last_undegraded":"2024-09-12T00:39:06.920278+0000","last_fullsized":"2024-09-12T00:39:06.920278+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'162","last_scrub_stamp":"2024-09-12T00:39:06.920126+0000","last_deep_scrub":"261'162","last_deep_scrub_stamp":"2024-09-12T00:39:06.920126+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.920126+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:14.572324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":164,"num_write":397,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"261'164","reported_seq":777,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.144115+0000","last_change":"2024-09-12T00:39:01.144037+0000","last_active":"2024-09-12T00:39:01.144115+0000","last_peered":"2024-09-12T00:39:01.144115+0000","last_clean":"2024-09-12T00:39:01.144115+0000","last_became_active":"2024-09-12T00:01:59.150072+0000","last_became_peered":"2024-09-12T00:01:59.150072+0000","last_unstale":"2024-09-12T00:39:01.144115+0000","last_undegraded":"2024-09-12T00:39:01.144115+0000","last_fullsized":"2024-09-12T00:39:01.144115+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'164","last_scrub_stamp":"2024-09-12T00:39:01.143943+0000","last_deep_scrub":"261'164","last_deep_scrub_stamp":"2024-09-12T00:39:01.143943+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.143943+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:32.032700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":763,"num_read_kb":636,"num_write":273,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"261'74","reported_seq":616,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:42.491460+0000","last_change":"2024-09-12T00:38:42.491365+0000","last_active":"2024-09-12T00:38:42.491460+0000","last_peered":"2024-09-12T00:38:42.491460+0000","last_clean":"2024-09-12T00:38:42.491460+0000","last_became_active":"2024-09-12T00:01:39.720425+0000","last_became_peered":"2024-09-12T00:01:39.720425+0000","last_unstale":"2024-09-12T00:38:42.491460+0000","last_undegraded":"2024-09-12T00:38:42.491460+0000","last_fullsized":"2024-09-12T00:38:42.491460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'74","last_scrub_stamp":"2024-09-12T00:38:42.491259+0000","last_deep_scrub":"261'74","last_deep_scrub_stamp":"2024-09-12T00:38:42.491259+0000","last_clean_scrub_stamp":"2024-09-12T00:38:42.491259+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:28.887567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"261'2","reported_seq":522,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.331718+0000","last_change":"2024-09-12T00:38:44.331659+0000","last_active":"2024-09-12T00:38:44.331718+0000","last_peered":"2024-09-12T00:38:44.331718+0000","last_clean":"2024-09-12T00:38:44.331718+0000","last_became_active":"2024-09-12T00:01:46.613916+0000","last_became_peered":"2024-09-12T00:01:46.613916+0000","last_unstale":"2024-09-12T00:38:44.331718+0000","last_undegraded":"2024-09-12T00:38:44.331718+0000","last_fullsized":"2024-09-12T00:38:44.331718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:38:44.331592+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:38:44.331592+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.331592+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:42.535188+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0014566500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"261'375","reported_seq":1077,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.581530+0000","last_change":"2024-09-12T00:38:46.581469+0000","last_active":"2024-09-12T00:38:46.581530+0000","last_peered":"2024-09-12T00:38:46.581530+0000","last_clean":"2024-09-12T00:38:46.581530+0000","last_became_active":"2024-09-12T00:01:57.141553+0000","last_became_peered":"2024-09-12T00:01:57.141553+0000","last_unstale":"2024-09-12T00:38:46.581530+0000","last_undegraded":"2024-09-12T00:38:46.581530+0000","last_fullsized":"2024-09-12T00:38:46.581530+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'375","last_scrub_stamp":"2024-09-12T00:38:46.581372+0000","last_deep_scrub":"261'375","last_deep_scrub_stamp":"2024-09-12T00:38:46.581372+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.581372+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:35.589907+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":706,"num_read_kb":51090,"num_write":1043,"num_write_kb":49735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":501,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.339193+0000","last_change":"2024-09-12T00:39:00.339133+0000","last_active":"2024-09-12T00:39:00.339193+0000","last_peered":"2024-09-12T00:39:00.339193+0000","last_clean":"2024-09-12T00:39:00.339193+0000","last_became_active":"2024-09-12T00:02:01.148696+0000","last_became_peered":"2024-09-12T00:02:01.148696+0000","last_unstale":"2024-09-12T00:39:00.339193+0000","last_undegraded":"2024-09-12T00:39:00.339193+0000","last_fullsized":"2024-09-12T00:39:00.339193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:00.339045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:00.339045+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.339045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:12.664460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"261'697","reported_seq":1400,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.303323+0000","last_change":"2024-09-12T00:39:13.303323+0000","last_active":"2024-09-12T00:39:13.303323+0000","last_peered":"2024-09-12T00:39:13.303323+0000","last_clean":"2024-09-12T00:39:13.303323+0000","last_became_active":"2024-09-12T00:02:03.150075+0000","last_became_peered":"2024-09-12T00:02:03.150075+0000","last_unstale":"2024-09-12T00:39:13.303323+0000","last_undegraded":"2024-09-12T00:39:13.303323+0000","last_fullsized":"2024-09-12T00:39:13.303323+0000","mapping_epoch":30,"log_start":"261'600","ondisk_log_start":"261'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'697","last_scrub_stamp":"2024-09-12T00:39:13.303195+0000","last_deep_scrub":"261'697","last_deep_scrub_stamp":"2024-09-12T00:39:13.303195+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.303195+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:50.182425+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141385,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1354,"num_read_kb":3064,"num_write":1242,"num_write_kb":1087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89192,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.761131+0000","last_change":"2024-09-12T00:39:10.761131+0000","last_active":"2024-09-12T00:39:10.761131+0000","last_peered":"2024-09-12T00:39:10.761131+0000","last_clean":"2024-09-12T00:39:10.761131+0000","last_became_active":"2024-09-12T00:02:05.162455+0000","last_became_peered":"2024-09-12T00:02:05.162455+0000","last_unstale":"2024-09-12T00:39:10.761131+0000","last_undegraded":"2024-09-12T00:39:10.761131+0000","last_fullsized":"2024-09-12T00:39:10.761131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:10.761046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:10.761046+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.761046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:28.012050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"261'261","reported_seq":971,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.193142+0000","last_change":"2024-09-12T00:39:07.193142+0000","last_active":"2024-09-12T00:39:07.193142+0000","last_peered":"2024-09-12T00:39:07.193142+0000","last_clean":"2024-09-12T00:39:07.193142+0000","last_became_active":"2024-09-12T00:02:07.167844+0000","last_became_peered":"2024-09-12T00:02:07.167844+0000","last_unstale":"2024-09-12T00:39:07.193142+0000","last_undegraded":"2024-09-12T00:39:07.193142+0000","last_fullsized":"2024-09-12T00:39:07.193142+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'261","last_scrub_stamp":"2024-09-12T00:39:07.193014+0000","last_deep_scrub":"261'261","last_deep_scrub_stamp":"2024-09-12T00:39:07.193014+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.193014+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:50.781535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":469,"num_read_kb":454,"num_write":531,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"261'172","reported_seq":770,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.825993+0000","last_change":"2024-09-12T00:38:58.825993+0000","last_active":"2024-09-12T00:38:58.825993+0000","last_peered":"2024-09-12T00:38:58.825993+0000","last_clean":"2024-09-12T00:38:58.825993+0000","last_became_active":"2024-09-12T00:01:59.149145+0000","last_became_peered":"2024-09-12T00:01:59.149145+0000","last_unstale":"2024-09-12T00:38:58.825993+0000","last_undegraded":"2024-09-12T00:38:58.825993+0000","last_fullsized":"2024-09-12T00:38:58.825993+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'172","last_scrub_stamp":"2024-09-12T00:38:58.825895+0000","last_deep_scrub":"261'172","last_deep_scrub_stamp":"2024-09-12T00:38:58.825895+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.825895+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:12.181956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":737,"num_read_kb":604,"num_write":249,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.344711+0000","last_change":"2024-09-12T00:38:43.344663+0000","last_active":"2024-09-12T00:38:43.344711+0000","last_peered":"2024-09-12T00:38:43.344711+0000","last_clean":"2024-09-12T00:38:43.344711+0000","last_became_active":"2024-09-12T00:01:46.505677+0000","last_became_peered":"2024-09-12T00:01:46.505677+0000","last_unstale":"2024-09-12T00:38:43.344711+0000","last_undegraded":"2024-09-12T00:38:43.344711+0000","last_fullsized":"2024-09-12T00:38:43.344711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:43.344592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:43.344592+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.344592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:02.518245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00075102999999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"261'327","reported_seq":954,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.034108+0000","last_change":"2024-09-12T00:38:48.034002+0000","last_active":"2024-09-12T00:38:48.034108+0000","last_peered":"2024-09-12T00:38:48.034108+0000","last_clean":"2024-09-12T00:38:48.034108+0000","last_became_active":"2024-09-12T00:01:57.152153+0000","last_became_peered":"2024-09-12T00:01:57.152153+0000","last_unstale":"2024-09-12T00:38:48.034108+0000","last_undegraded":"2024-09-12T00:38:48.034108+0000","last_fullsized":"2024-09-12T00:38:48.034108+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'327","last_scrub_stamp":"2024-09-12T00:38:48.033865+0000","last_deep_scrub":"261'327","last_deep_scrub_stamp":"2024-09-12T00:38:48.033865+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.033865+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:01.645214+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263237,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":501,"num_read_kb":31136,"num_write":994,"num_write_kb":29868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.149402+0000","last_change":"2024-09-12T00:39:03.149402+0000","last_active":"2024-09-12T00:39:03.149402+0000","last_peered":"2024-09-12T00:39:03.149402+0000","last_clean":"2024-09-12T00:39:03.149402+0000","last_became_active":"2024-09-12T00:02:01.152904+0000","last_became_peered":"2024-09-12T00:02:01.152904+0000","last_unstale":"2024-09-12T00:39:03.149402+0000","last_undegraded":"2024-09-12T00:39:03.149402+0000","last_fullsized":"2024-09-12T00:39:03.149402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:03.149318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:03.149318+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.149318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:56.022423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"261'1221","reported_seq":2589,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.930393+0000","last_change":"2024-09-12T00:38:59.930294+0000","last_active":"2024-09-12T00:38:59.930393+0000","last_peered":"2024-09-12T00:38:59.930393+0000","last_clean":"2024-09-12T00:38:59.930393+0000","last_became_active":"2024-09-12T00:02:03.153702+0000","last_became_peered":"2024-09-12T00:02:03.153702+0000","last_unstale":"2024-09-12T00:38:59.930393+0000","last_undegraded":"2024-09-12T00:38:59.930393+0000","last_fullsized":"2024-09-12T00:38:59.930393+0000","mapping_epoch":30,"log_start":"261'1200","ondisk_log_start":"261'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'1221","last_scrub_stamp":"2024-09-12T00:38:59.930107+0000","last_deep_scrub":"261'1221","last_deep_scrub_stamp":"2024-09-12T00:38:59.930107+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.930107+0000","objects_scrubbed":12,"log_size":21,"log_dups_size":1200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:26.162750+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137303,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1920,"num_read_kb":3540,"num_write":1014,"num_write_kb":851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":487,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.094948+0000","last_change":"2024-09-12T00:39:21.094888+0000","last_active":"2024-09-12T00:39:21.094948+0000","last_peered":"2024-09-12T00:39:21.094948+0000","last_clean":"2024-09-12T00:39:21.094948+0000","last_became_active":"2024-09-12T00:02:05.171787+0000","last_became_peered":"2024-09-12T00:02:05.171787+0000","last_unstale":"2024-09-12T00:39:21.094948+0000","last_undegraded":"2024-09-12T00:39:21.094948+0000","last_fullsized":"2024-09-12T00:39:21.094948+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:21.094797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:21.094797+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.094797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:30.711629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"261'220","reported_seq":749,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.768691+0000","last_change":"2024-09-12T00:39:16.768691+0000","last_active":"2024-09-12T00:39:16.768691+0000","last_peered":"2024-09-12T00:39:16.768691+0000","last_clean":"2024-09-12T00:39:16.768691+0000","last_became_active":"2024-09-12T00:02:07.169173+0000","last_became_peered":"2024-09-12T00:02:07.169173+0000","last_unstale":"2024-09-12T00:39:16.768691+0000","last_undegraded":"2024-09-12T00:39:16.768691+0000","last_fullsized":"2024-09-12T00:39:16.768691+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'220","last_scrub_stamp":"2024-09-12T00:39:16.768578+0000","last_deep_scrub":"261'220","last_deep_scrub_stamp":"2024-09-12T00:39:16.768578+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.768578+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:30.964212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":374,"num_read_kb":362,"num_write":477,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"261'89","reported_seq":649,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.951095+0000","last_change":"2024-09-12T00:38:56.951095+0000","last_active":"2024-09-12T00:38:56.951095+0000","last_peered":"2024-09-12T00:38:56.951095+0000","last_clean":"2024-09-12T00:38:56.951095+0000","last_became_active":"2024-09-12T00:01:59.138731+0000","last_became_peered":"2024-09-12T00:01:59.138731+0000","last_unstale":"2024-09-12T00:38:56.951095+0000","last_undegraded":"2024-09-12T00:38:56.951095+0000","last_fullsized":"2024-09-12T00:38:56.951095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'89","last_scrub_stamp":"2024-09-12T00:38:56.950966+0000","last_deep_scrub":"261'89","last_deep_scrub_stamp":"2024-09-12T00:38:56.950966+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.950966+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:18.408760+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":368,"num_read_kb":306,"num_write":121,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":512,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.785510+0000","last_change":"2024-09-12T00:38:44.785441+0000","last_active":"2024-09-12T00:38:44.785510+0000","last_peered":"2024-09-12T00:38:44.785510+0000","last_clean":"2024-09-12T00:38:44.785510+0000","last_became_active":"2024-09-12T00:01:46.505857+0000","last_became_peered":"2024-09-12T00:01:46.505857+0000","last_unstale":"2024-09-12T00:38:44.785510+0000","last_undegraded":"2024-09-12T00:38:44.785510+0000","last_fullsized":"2024-09-12T00:38:44.785510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:44.785356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:44.785356+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.785356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:13.579766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039331300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"261'325","reported_seq":939,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.790115+0000","last_change":"2024-09-12T00:38:46.790044+0000","last_active":"2024-09-12T00:38:46.790115+0000","last_peered":"2024-09-12T00:38:46.790115+0000","last_clean":"2024-09-12T00:38:46.790115+0000","last_became_active":"2024-09-12T00:01:57.151644+0000","last_became_peered":"2024-09-12T00:01:57.151644+0000","last_unstale":"2024-09-12T00:38:46.790115+0000","last_undegraded":"2024-09-12T00:38:46.790115+0000","last_fullsized":"2024-09-12T00:38:46.790115+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'325","last_scrub_stamp":"2024-09-12T00:38:46.789939+0000","last_deep_scrub":"261'325","last_deep_scrub_stamp":"2024-09-12T00:38:46.789939+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.789939+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:00.959710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399150,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":451,"num_read_kb":2375,"num_write":1107,"num_write_kb":41035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"261'2","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.895506+0000","last_change":"2024-09-12T00:38:56.895506+0000","last_active":"2024-09-12T00:38:56.895506+0000","last_peered":"2024-09-12T00:38:56.895506+0000","last_clean":"2024-09-12T00:38:56.895506+0000","last_became_active":"2024-09-12T00:02:01.151474+0000","last_became_peered":"2024-09-12T00:02:01.151474+0000","last_unstale":"2024-09-12T00:38:56.895506+0000","last_undegraded":"2024-09-12T00:38:56.895506+0000","last_fullsized":"2024-09-12T00:38:56.895506+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:38:56.895390+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:38:56.895390+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.895390+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:45.952295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"261'217","reported_seq":1199,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.312988+0000","last_change":"2024-09-12T00:39:02.312925+0000","last_active":"2024-09-12T00:39:02.312988+0000","last_peered":"2024-09-12T00:39:02.312988+0000","last_clean":"2024-09-12T00:39:02.312988+0000","last_became_active":"2024-09-12T00:02:03.155311+0000","last_became_peered":"2024-09-12T00:02:03.155311+0000","last_unstale":"2024-09-12T00:39:02.312988+0000","last_undegraded":"2024-09-12T00:39:02.312988+0000","last_fullsized":"2024-09-12T00:39:02.312988+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'217","last_scrub_stamp":"2024-09-12T00:39:02.312818+0000","last_deep_scrub":"261'217","last_deep_scrub_stamp":"2024-09-12T00:39:02.312818+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.312818+0000","objects_scrubbed":9,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:20.910589+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":153,"num_read_kb":144,"num_write":119,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:12.717083+0000","last_change":"2024-09-12T00:39:12.716999+0000","last_active":"2024-09-12T00:39:12.717083+0000","last_peered":"2024-09-12T00:39:12.717083+0000","last_clean":"2024-09-12T00:39:12.717083+0000","last_became_active":"2024-09-12T00:02:05.167874+0000","last_became_peered":"2024-09-12T00:02:05.167874+0000","last_unstale":"2024-09-12T00:39:12.717083+0000","last_undegraded":"2024-09-12T00:39:12.717083+0000","last_fullsized":"2024-09-12T00:39:12.717083+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:12.716899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:12.716899+0000","last_clean_scrub_stamp":"2024-09-12T00:39:12.716899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:53.352781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"261'264","reported_seq":866,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.659200+0000","last_change":"2024-09-12T00:39:18.659200+0000","last_active":"2024-09-12T00:39:18.659200+0000","last_peered":"2024-09-12T00:39:18.659200+0000","last_clean":"2024-09-12T00:39:18.659200+0000","last_became_active":"2024-09-12T00:02:07.161814+0000","last_became_peered":"2024-09-12T00:02:07.161814+0000","last_unstale":"2024-09-12T00:39:18.659200+0000","last_undegraded":"2024-09-12T00:39:18.659200+0000","last_fullsized":"2024-09-12T00:39:18.659200+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'264","last_scrub_stamp":"2024-09-12T00:39:18.659118+0000","last_deep_scrub":"261'264","last_deep_scrub_stamp":"2024-09-12T00:39:18.659118+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.659118+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:52.481023+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":499,"num_read_kb":517,"num_write":567,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"261'136","reported_seq":721,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.975764+0000","last_change":"2024-09-12T00:38:53.975704+0000","last_active":"2024-09-12T00:38:53.975764+0000","last_peered":"2024-09-12T00:38:53.975764+0000","last_clean":"2024-09-12T00:38:53.975764+0000","last_became_active":"2024-09-12T00:01:59.153542+0000","last_became_peered":"2024-09-12T00:01:59.153542+0000","last_unstale":"2024-09-12T00:38:53.975764+0000","last_undegraded":"2024-09-12T00:38:53.975764+0000","last_fullsized":"2024-09-12T00:38:53.975764+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'136","last_scrub_stamp":"2024-09-12T00:38:53.975609+0000","last_deep_scrub":"261'136","last_deep_scrub_stamp":"2024-09-12T00:38:53.975609+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.975609+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:02.481618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":619,"num_read_kb":513,"num_write":207,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":229,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"261'3","reported_seq":523,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.339780+0000","last_change":"2024-09-12T00:38:45.339714+0000","last_active":"2024-09-12T00:38:45.339780+0000","last_peered":"2024-09-12T00:38:45.339780+0000","last_clean":"2024-09-12T00:38:45.339780+0000","last_became_active":"2024-09-12T00:01:46.502428+0000","last_became_peered":"2024-09-12T00:01:46.502428+0000","last_unstale":"2024-09-12T00:38:45.339780+0000","last_undegraded":"2024-09-12T00:38:45.339780+0000","last_fullsized":"2024-09-12T00:38:45.339780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-12T00:38:45.339643+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-12T00:38:45.339643+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.339643+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:28.135971+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001414925,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"261'334","reported_seq":962,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.197811+0000","last_change":"2024-09-12T00:38:45.197753+0000","last_active":"2024-09-12T00:38:45.197811+0000","last_peered":"2024-09-12T00:38:45.197811+0000","last_clean":"2024-09-12T00:38:45.197811+0000","last_became_active":"2024-09-12T00:01:57.156172+0000","last_became_peered":"2024-09-12T00:01:57.156172+0000","last_unstale":"2024-09-12T00:38:45.197811+0000","last_undegraded":"2024-09-12T00:38:45.197811+0000","last_fullsized":"2024-09-12T00:38:45.197811+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'334","last_scrub_stamp":"2024-09-12T00:38:45.197636+0000","last_deep_scrub":"261'334","last_deep_scrub_stamp":"2024-09-12T00:38:45.197636+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.197636+0000","objects_scrubbed":10,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:41.388701+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7788939,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":443,"num_read_kb":22094,"num_write":1095,"num_write_kb":41486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.899891+0000","last_change":"2024-09-12T00:38:55.899831+0000","last_active":"2024-09-12T00:38:55.899891+0000","last_peered":"2024-09-12T00:38:55.899891+0000","last_clean":"2024-09-12T00:38:55.899891+0000","last_became_active":"2024-09-12T00:02:01.152752+0000","last_became_peered":"2024-09-12T00:02:01.152752+0000","last_unstale":"2024-09-12T00:38:55.899891+0000","last_undegraded":"2024-09-12T00:38:55.899891+0000","last_fullsized":"2024-09-12T00:38:55.899891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:55.899739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:55.899739+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.899739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:27.345544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"261'119","reported_seq":647,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.824049+0000","last_change":"2024-09-12T00:39:08.824049+0000","last_active":"2024-09-12T00:39:08.824049+0000","last_peered":"2024-09-12T00:39:08.824049+0000","last_clean":"2024-09-12T00:39:08.824049+0000","last_became_active":"2024-09-12T00:02:03.152008+0000","last_became_peered":"2024-09-12T00:02:03.152008+0000","last_unstale":"2024-09-12T00:39:08.824049+0000","last_undegraded":"2024-09-12T00:39:08.824049+0000","last_fullsized":"2024-09-12T00:39:08.824049+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'119","last_scrub_stamp":"2024-09-12T00:39:08.823956+0000","last_deep_scrub":"261'119","last_deep_scrub_stamp":"2024-09-12T00:39:08.823956+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.823956+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:46.719748+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":94,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:22.057365+0000","last_change":"2024-09-12T00:39:22.057365+0000","last_active":"2024-09-12T00:39:22.057365+0000","last_peered":"2024-09-12T00:39:22.057365+0000","last_clean":"2024-09-12T00:39:22.057365+0000","last_became_active":"2024-09-12T00:02:05.170487+0000","last_became_peered":"2024-09-12T00:02:05.170487+0000","last_unstale":"2024-09-12T00:39:22.057365+0000","last_undegraded":"2024-09-12T00:39:22.057365+0000","last_fullsized":"2024-09-12T00:39:22.057365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:22.057217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:22.057217+0000","last_clean_scrub_stamp":"2024-09-12T00:39:22.057217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:14.738952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"261'122","reported_seq":671,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.431387+0000","last_change":"2024-09-12T00:39:08.431387+0000","last_active":"2024-09-12T00:39:08.431387+0000","last_peered":"2024-09-12T00:39:08.431387+0000","last_clean":"2024-09-12T00:39:08.431387+0000","last_became_active":"2024-09-12T00:02:07.168820+0000","last_became_peered":"2024-09-12T00:02:07.168820+0000","last_unstale":"2024-09-12T00:39:08.431387+0000","last_undegraded":"2024-09-12T00:39:08.431387+0000","last_fullsized":"2024-09-12T00:39:08.431387+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'122","last_scrub_stamp":"2024-09-12T00:39:08.431306+0000","last_deep_scrub":"261'122","last_deep_scrub_stamp":"2024-09-12T00:39:08.431306+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.431306+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:45.683565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":226,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"261'300","reported_seq":893,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.984567+0000","last_change":"2024-09-12T00:38:51.984514+0000","last_active":"2024-09-12T00:38:51.984567+0000","last_peered":"2024-09-12T00:38:51.984567+0000","last_clean":"2024-09-12T00:38:51.984567+0000","last_became_active":"2024-09-12T00:01:59.145273+0000","last_became_peered":"2024-09-12T00:01:59.145273+0000","last_unstale":"2024-09-12T00:38:51.984567+0000","last_undegraded":"2024-09-12T00:38:51.984567+0000","last_fullsized":"2024-09-12T00:38:51.984567+0000","mapping_epoch":26,"log_start":"258'200","ondisk_log_start":"258'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'300","last_scrub_stamp":"2024-09-12T00:38:51.984415+0000","last_deep_scrub":"261'300","last_deep_scrub_stamp":"2024-09-12T00:38:51.984415+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.984415+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:31.222270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1356,"num_read_kb":1215,"num_write":550,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"261'372","reported_seq":1076,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.015004+0000","last_change":"2024-09-12T00:38:44.014947+0000","last_active":"2024-09-12T00:38:44.015004+0000","last_peered":"2024-09-12T00:38:44.015004+0000","last_clean":"2024-09-12T00:38:44.015004+0000","last_became_active":"2024-09-12T00:01:57.154387+0000","last_became_peered":"2024-09-12T00:01:57.154387+0000","last_unstale":"2024-09-12T00:38:44.015004+0000","last_undegraded":"2024-09-12T00:38:44.015004+0000","last_fullsized":"2024-09-12T00:38:44.015004+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'372","last_scrub_stamp":"2024-09-12T00:38:44.014836+0000","last_deep_scrub":"261'372","last_deep_scrub_stamp":"2024-09-12T00:38:44.014836+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.014836+0000","objects_scrubbed":8,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:12.072171+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6404752,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":635,"num_read_kb":122441,"num_write":1157,"num_write_kb":43815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":518,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.795449+0000","last_change":"2024-09-12T00:38:44.795387+0000","last_active":"2024-09-12T00:38:44.795449+0000","last_peered":"2024-09-12T00:38:44.795449+0000","last_clean":"2024-09-12T00:38:44.795449+0000","last_became_active":"2024-09-12T00:01:46.505954+0000","last_became_peered":"2024-09-12T00:01:46.505954+0000","last_unstale":"2024-09-12T00:38:44.795449+0000","last_undegraded":"2024-09-12T00:38:44.795449+0000","last_fullsized":"2024-09-12T00:38:44.795449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:44.795256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:44.795256+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.795256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:45.361353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050498000000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.578486+0000","last_change":"2024-09-12T00:39:01.578391+0000","last_active":"2024-09-12T00:39:01.578486+0000","last_peered":"2024-09-12T00:39:01.578486+0000","last_clean":"2024-09-12T00:39:01.578486+0000","last_became_active":"2024-09-12T00:02:01.149529+0000","last_became_peered":"2024-09-12T00:02:01.149529+0000","last_unstale":"2024-09-12T00:39:01.578486+0000","last_undegraded":"2024-09-12T00:39:01.578486+0000","last_fullsized":"2024-09-12T00:39:01.578486+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:01.578285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:01.578285+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.578285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:50.557711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"261'566","reported_seq":1225,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.918702+0000","last_change":"2024-09-12T00:38:57.918702+0000","last_active":"2024-09-12T00:38:57.918702+0000","last_peered":"2024-09-12T00:38:57.918702+0000","last_clean":"2024-09-12T00:38:57.918702+0000","last_became_active":"2024-09-12T00:02:03.152535+0000","last_became_peered":"2024-09-12T00:02:03.152535+0000","last_unstale":"2024-09-12T00:38:57.918702+0000","last_undegraded":"2024-09-12T00:38:57.918702+0000","last_fullsized":"2024-09-12T00:38:57.918702+0000","mapping_epoch":30,"log_start":"261'500","ondisk_log_start":"261'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'566","last_scrub_stamp":"2024-09-12T00:38:57.918575+0000","last_deep_scrub":"261'566","last_deep_scrub_stamp":"2024-09-12T00:38:57.918575+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.918575+0000","objects_scrubbed":11,"log_size":66,"log_dups_size":500,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:11.867915+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88538,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1530,"num_read_kb":2694,"num_write":1952,"num_write_kb":1782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":500800,"num_omap_keys":1132,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":480,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.219597+0000","last_change":"2024-09-12T00:39:03.219544+0000","last_active":"2024-09-12T00:39:03.219597+0000","last_peered":"2024-09-12T00:39:03.219597+0000","last_clean":"2024-09-12T00:39:03.219597+0000","last_became_active":"2024-09-12T00:02:05.167998+0000","last_became_peered":"2024-09-12T00:02:05.167998+0000","last_unstale":"2024-09-12T00:39:03.219597+0000","last_undegraded":"2024-09-12T00:39:03.219597+0000","last_fullsized":"2024-09-12T00:39:03.219597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:03.219425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:03.219425+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.219425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:29.818422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"261'164","reported_seq":655,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.802847+0000","last_change":"2024-09-12T00:39:19.802847+0000","last_active":"2024-09-12T00:39:19.802847+0000","last_peered":"2024-09-12T00:39:19.802847+0000","last_clean":"2024-09-12T00:39:19.802847+0000","last_became_active":"2024-09-12T00:02:07.168005+0000","last_became_peered":"2024-09-12T00:02:07.168005+0000","last_unstale":"2024-09-12T00:39:19.802847+0000","last_undegraded":"2024-09-12T00:39:19.802847+0000","last_fullsized":"2024-09-12T00:39:19.802847+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'164","last_scrub_stamp":"2024-09-12T00:39:19.802748+0000","last_deep_scrub":"261'164","last_deep_scrub_stamp":"2024-09-12T00:39:19.802748+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.802748+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:04.761071+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":711,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":136,"num_read_kb":133,"num_write":373,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"261'349","reported_seq":1002,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.984748+0000","last_change":"2024-09-12T00:38:52.984694+0000","last_active":"2024-09-12T00:38:52.984748+0000","last_peered":"2024-09-12T00:38:52.984748+0000","last_clean":"2024-09-12T00:38:52.984748+0000","last_became_active":"2024-09-12T00:01:59.137020+0000","last_became_peered":"2024-09-12T00:01:59.137020+0000","last_unstale":"2024-09-12T00:38:52.984748+0000","last_undegraded":"2024-09-12T00:38:52.984748+0000","last_fullsized":"2024-09-12T00:38:52.984748+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'349","last_scrub_stamp":"2024-09-12T00:38:52.984578+0000","last_deep_scrub":"261'349","last_deep_scrub_stamp":"2024-09-12T00:38:52.984578+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.984578+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:32.899963+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1524,"num_read_kb":1224,"num_write":576,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"261'301","reported_seq":915,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.140047+0000","last_change":"2024-09-12T00:38:45.139945+0000","last_active":"2024-09-12T00:38:45.140047+0000","last_peered":"2024-09-12T00:38:45.140047+0000","last_clean":"2024-09-12T00:38:45.140047+0000","last_became_active":"2024-09-12T00:01:57.152021+0000","last_became_peered":"2024-09-12T00:01:57.152021+0000","last_unstale":"2024-09-12T00:38:45.140047+0000","last_undegraded":"2024-09-12T00:38:45.140047+0000","last_fullsized":"2024-09-12T00:38:45.140047+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'301","last_scrub_stamp":"2024-09-12T00:38:45.139770+0000","last_deep_scrub":"261'301","last_deep_scrub_stamp":"2024-09-12T00:38:45.139770+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.139770+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:52.526654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288035,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":437,"num_read_kb":13162,"num_write":956,"num_write_kb":28256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.293031+0000","last_change":"2024-09-12T00:38:46.292979+0000","last_active":"2024-09-12T00:38:46.293031+0000","last_peered":"2024-09-12T00:38:46.293031+0000","last_clean":"2024-09-12T00:38:46.293031+0000","last_became_active":"2024-09-12T00:01:46.505315+0000","last_became_peered":"2024-09-12T00:01:46.505315+0000","last_unstale":"2024-09-12T00:38:46.293031+0000","last_undegraded":"2024-09-12T00:38:46.293031+0000","last_fullsized":"2024-09-12T00:38:46.293031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:46.292895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:46.292895+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.292895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:49.074578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079890600000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.350411+0000","last_change":"2024-09-12T00:38:59.350339+0000","last_active":"2024-09-12T00:38:59.350411+0000","last_peered":"2024-09-12T00:38:59.350411+0000","last_clean":"2024-09-12T00:38:59.350411+0000","last_became_active":"2024-09-12T00:02:01.148650+0000","last_became_peered":"2024-09-12T00:02:01.148650+0000","last_unstale":"2024-09-12T00:38:59.350411+0000","last_undegraded":"2024-09-12T00:38:59.350411+0000","last_fullsized":"2024-09-12T00:38:59.350411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.350248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.350248+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.350248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:16.730657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"261'171","reported_seq":725,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.977358+0000","last_change":"2024-09-12T00:39:02.977304+0000","last_active":"2024-09-12T00:39:02.977358+0000","last_peered":"2024-09-12T00:39:02.977358+0000","last_clean":"2024-09-12T00:39:02.977358+0000","last_became_active":"2024-09-12T00:02:03.153640+0000","last_became_peered":"2024-09-12T00:02:03.153640+0000","last_unstale":"2024-09-12T00:39:02.977358+0000","last_undegraded":"2024-09-12T00:39:02.977358+0000","last_fullsized":"2024-09-12T00:39:02.977358+0000","mapping_epoch":30,"log_start":"258'100","ondisk_log_start":"258'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'171","last_scrub_stamp":"2024-09-12T00:39:02.977209+0000","last_deep_scrub":"261'171","last_deep_scrub_stamp":"2024-09-12T00:39:02.977209+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.977209+0000","objects_scrubbed":9,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:04.239995+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":206,"num_read_kb":198,"num_write":166,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"261'775","reported_seq":2516,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.457205+0000","last_change":"2024-09-12T00:39:04.457205+0000","last_active":"2024-09-12T00:39:04.457205+0000","last_peered":"2024-09-12T00:39:04.457205+0000","last_clean":"2024-09-12T00:39:04.457205+0000","last_became_active":"2024-09-12T00:02:05.163720+0000","last_became_peered":"2024-09-12T00:02:05.163720+0000","last_unstale":"2024-09-12T00:39:04.457205+0000","last_undegraded":"2024-09-12T00:39:04.457205+0000","last_fullsized":"2024-09-12T00:39:04.457205+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'775","last_scrub_stamp":"2024-09-12T00:39:04.457118+0000","last_deep_scrub":"261'775","last_deep_scrub_stamp":"2024-09-12T00:39:04.457118+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.457118+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:32.148688+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"261'126","reported_seq":630,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.987695+0000","last_change":"2024-09-12T00:39:08.987695+0000","last_active":"2024-09-12T00:39:08.987695+0000","last_peered":"2024-09-12T00:39:08.987695+0000","last_clean":"2024-09-12T00:39:08.987695+0000","last_became_active":"2024-09-12T00:02:07.167797+0000","last_became_peered":"2024-09-12T00:02:07.167797+0000","last_unstale":"2024-09-12T00:39:08.987695+0000","last_undegraded":"2024-09-12T00:39:08.987695+0000","last_fullsized":"2024-09-12T00:39:08.987695+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'126","last_scrub_stamp":"2024-09-12T00:39:08.987597+0000","last_deep_scrub":"261'126","last_deep_scrub_stamp":"2024-09-12T00:39:08.987597+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.987597+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:50.893548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":176,"num_read_kb":159,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"261'140","reported_seq":733,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.505700+0000","last_change":"2024-09-12T00:38:56.505700+0000","last_active":"2024-09-12T00:38:56.505700+0000","last_peered":"2024-09-12T00:38:56.505700+0000","last_clean":"2024-09-12T00:38:56.505700+0000","last_became_active":"2024-09-12T00:01:59.155117+0000","last_became_peered":"2024-09-12T00:01:59.155117+0000","last_unstale":"2024-09-12T00:38:56.505700+0000","last_undegraded":"2024-09-12T00:38:56.505700+0000","last_fullsized":"2024-09-12T00:38:56.505700+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'140","last_scrub_stamp":"2024-09-12T00:38:56.505585+0000","last_deep_scrub":"261'140","last_deep_scrub_stamp":"2024-09-12T00:38:56.505585+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.505585+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:27.206689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":474,"num_write":223,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"261'363","reported_seq":1032,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.665051+0000","last_change":"2024-09-12T00:38:44.664927+0000","last_active":"2024-09-12T00:38:44.665051+0000","last_peered":"2024-09-12T00:38:44.665051+0000","last_clean":"2024-09-12T00:38:44.665051+0000","last_became_active":"2024-09-12T00:01:57.134235+0000","last_became_peered":"2024-09-12T00:01:57.134235+0000","last_unstale":"2024-09-12T00:38:44.665051+0000","last_undegraded":"2024-09-12T00:38:44.665051+0000","last_fullsized":"2024-09-12T00:38:44.665051+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'363","last_scrub_stamp":"2024-09-12T00:38:44.664703+0000","last_deep_scrub":"261'363","last_deep_scrub_stamp":"2024-09-12T00:38:44.664703+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.664703+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:21.197836+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":525,"num_read_kb":31500,"num_write":1186,"num_write_kb":36639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":522,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.616652+0000","last_change":"2024-09-12T00:38:43.616652+0000","last_active":"2024-09-12T00:38:43.616652+0000","last_peered":"2024-09-12T00:38:43.616652+0000","last_clean":"2024-09-12T00:38:43.616652+0000","last_became_active":"2024-09-12T00:01:46.508144+0000","last_became_peered":"2024-09-12T00:01:46.508144+0000","last_unstale":"2024-09-12T00:38:43.616652+0000","last_undegraded":"2024-09-12T00:38:43.616652+0000","last_fullsized":"2024-09-12T00:38:43.616652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:43.616556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:43.616556+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.616556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:21.006725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045024799999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":495,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.192924+0000","last_change":"2024-09-12T00:39:04.192851+0000","last_active":"2024-09-12T00:39:04.192924+0000","last_peered":"2024-09-12T00:39:04.192924+0000","last_clean":"2024-09-12T00:39:04.192924+0000","last_became_active":"2024-09-12T00:02:01.153207+0000","last_became_peered":"2024-09-12T00:02:01.153207+0000","last_unstale":"2024-09-12T00:39:04.192924+0000","last_undegraded":"2024-09-12T00:39:04.192924+0000","last_fullsized":"2024-09-12T00:39:04.192924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:04.192765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:04.192765+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.192765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:13.276069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"261'113","reported_seq":646,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:15.218959+0000","last_change":"2024-09-12T00:39:15.218869+0000","last_active":"2024-09-12T00:39:15.218959+0000","last_peered":"2024-09-12T00:39:15.218959+0000","last_clean":"2024-09-12T00:39:15.218959+0000","last_became_active":"2024-09-12T00:02:03.151029+0000","last_became_peered":"2024-09-12T00:02:03.151029+0000","last_unstale":"2024-09-12T00:39:15.218959+0000","last_undegraded":"2024-09-12T00:39:15.218959+0000","last_fullsized":"2024-09-12T00:39:15.218959+0000","mapping_epoch":30,"log_start":"261'100","ondisk_log_start":"261'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'113","last_scrub_stamp":"2024-09-12T00:39:15.218665+0000","last_deep_scrub":"261'113","last_deep_scrub_stamp":"2024-09-12T00:39:15.218665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:15.218665+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:05.358020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":125,"num_read_kb":114,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"261'783","reported_seq":4569,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:11.721640+0000","last_change":"2024-09-12T00:39:11.721571+0000","last_active":"2024-09-12T00:39:11.721640+0000","last_peered":"2024-09-12T00:39:11.721640+0000","last_clean":"2024-09-12T00:39:11.721640+0000","last_became_active":"2024-09-12T00:02:05.162687+0000","last_became_peered":"2024-09-12T00:02:05.162687+0000","last_unstale":"2024-09-12T00:39:11.721640+0000","last_undegraded":"2024-09-12T00:39:11.721640+0000","last_fullsized":"2024-09-12T00:39:11.721640+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'783","last_scrub_stamp":"2024-09-12T00:39:11.721483+0000","last_deep_scrub":"261'783","last_deep_scrub_stamp":"2024-09-12T00:39:11.721483+0000","last_clean_scrub_stamp":"2024-09-12T00:39:11.721483+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:21.670225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"261'160","reported_seq":670,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.839184+0000","last_change":"2024-09-12T00:39:18.839184+0000","last_active":"2024-09-12T00:39:18.839184+0000","last_peered":"2024-09-12T00:39:18.839184+0000","last_clean":"2024-09-12T00:39:18.839184+0000","last_became_active":"2024-09-12T00:02:07.166471+0000","last_became_peered":"2024-09-12T00:02:07.166471+0000","last_unstale":"2024-09-12T00:39:18.839184+0000","last_undegraded":"2024-09-12T00:39:18.839184+0000","last_fullsized":"2024-09-12T00:39:18.839184+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'160","last_scrub_stamp":"2024-09-12T00:39:18.839083+0000","last_deep_scrub":"261'160","last_deep_scrub_stamp":"2024-09-12T00:39:18.839083+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.839083+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:11.339915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":126,"num_write":337,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"261'82","reported_seq":648,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.050381+0000","last_change":"2024-09-12T00:38:50.050312+0000","last_active":"2024-09-12T00:38:50.050381+0000","last_peered":"2024-09-12T00:38:50.050381+0000","last_clean":"2024-09-12T00:38:50.050381+0000","last_became_active":"2024-09-12T00:01:59.157044+0000","last_became_peered":"2024-09-12T00:01:59.157044+0000","last_unstale":"2024-09-12T00:38:50.050381+0000","last_undegraded":"2024-09-12T00:38:50.050381+0000","last_fullsized":"2024-09-12T00:38:50.050381+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'82","last_scrub_stamp":"2024-09-12T00:38:50.050227+0000","last_deep_scrub":"261'82","last_deep_scrub_stamp":"2024-09-12T00:38:50.050227+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.050227+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:56.828569+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":326,"num_write":122,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"261'433","reported_seq":1076,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.511299+0000","last_change":"2024-09-12T00:38:51.511299+0000","last_active":"2024-09-12T00:38:51.511299+0000","last_peered":"2024-09-12T00:38:51.511299+0000","last_clean":"2024-09-12T00:38:51.511299+0000","last_became_active":"2024-09-12T00:01:57.134646+0000","last_became_peered":"2024-09-12T00:01:57.134646+0000","last_unstale":"2024-09-12T00:38:51.511299+0000","last_undegraded":"2024-09-12T00:38:51.511299+0000","last_fullsized":"2024-09-12T00:38:51.511299+0000","mapping_epoch":24,"log_start":"261'400","ondisk_log_start":"261'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'433","last_scrub_stamp":"2024-09-12T00:38:51.511171+0000","last_deep_scrub":"261'433","last_deep_scrub_stamp":"2024-09-12T00:38:51.511171+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.511171+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:11.090003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":740,"num_read_kb":1717,"num_write":1248,"num_write_kb":18271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.334916+0000","last_change":"2024-09-12T00:38:47.334916+0000","last_active":"2024-09-12T00:38:47.334916+0000","last_peered":"2024-09-12T00:38:47.334916+0000","last_clean":"2024-09-12T00:38:47.334916+0000","last_became_active":"2024-09-12T00:01:46.502847+0000","last_became_peered":"2024-09-12T00:01:46.502847+0000","last_unstale":"2024-09-12T00:38:47.334916+0000","last_undegraded":"2024-09-12T00:38:47.334916+0000","last_fullsized":"2024-09-12T00:38:47.334916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:47.334821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:47.334821+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.334821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:23.467970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00102973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.585235+0000","last_change":"2024-09-12T00:38:59.585235+0000","last_active":"2024-09-12T00:38:59.585235+0000","last_peered":"2024-09-12T00:38:59.585235+0000","last_clean":"2024-09-12T00:38:59.585235+0000","last_became_active":"2024-09-12T00:02:01.152467+0000","last_became_peered":"2024-09-12T00:02:01.152467+0000","last_unstale":"2024-09-12T00:38:59.585235+0000","last_undegraded":"2024-09-12T00:38:59.585235+0000","last_fullsized":"2024-09-12T00:38:59.585235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.585108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.585108+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.585108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:47.921762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"261'755","reported_seq":1477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.334414+0000","last_change":"2024-09-12T00:39:01.334341+0000","last_active":"2024-09-12T00:39:01.334414+0000","last_peered":"2024-09-12T00:39:01.334414+0000","last_clean":"2024-09-12T00:39:01.334414+0000","last_became_active":"2024-09-12T00:02:03.151140+0000","last_became_peered":"2024-09-12T00:02:03.151140+0000","last_unstale":"2024-09-12T00:39:01.334414+0000","last_undegraded":"2024-09-12T00:39:01.334414+0000","last_fullsized":"2024-09-12T00:39:01.334414+0000","mapping_epoch":30,"log_start":"261'700","ondisk_log_start":"261'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'755","last_scrub_stamp":"2024-09-12T00:39:01.334248+0000","last_deep_scrub":"261'755","last_deep_scrub_stamp":"2024-09-12T00:39:01.334248+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.334248+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:13.575310+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136648,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1342,"num_read_kb":3221,"num_write":1108,"num_write_kb":930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.706424+0000","last_change":"2024-09-12T00:39:14.706319+0000","last_active":"2024-09-12T00:39:14.706424+0000","last_peered":"2024-09-12T00:39:14.706424+0000","last_clean":"2024-09-12T00:39:14.706424+0000","last_became_active":"2024-09-12T00:02:05.168419+0000","last_became_peered":"2024-09-12T00:02:05.168419+0000","last_unstale":"2024-09-12T00:39:14.706424+0000","last_undegraded":"2024-09-12T00:39:14.706424+0000","last_fullsized":"2024-09-12T00:39:14.706424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:14.706224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:14.706224+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.706224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:02.583767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"261'143","reported_seq":641,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.153063+0000","last_change":"2024-09-12T00:39:07.153063+0000","last_active":"2024-09-12T00:39:07.153063+0000","last_peered":"2024-09-12T00:39:07.153063+0000","last_clean":"2024-09-12T00:39:07.153063+0000","last_became_active":"2024-09-12T00:02:07.169937+0000","last_became_peered":"2024-09-12T00:02:07.169937+0000","last_unstale":"2024-09-12T00:39:07.153063+0000","last_undegraded":"2024-09-12T00:39:07.153063+0000","last_fullsized":"2024-09-12T00:39:07.153063+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'143","last_scrub_stamp":"2024-09-12T00:39:07.152972+0000","last_deep_scrub":"261'143","last_deep_scrub_stamp":"2024-09-12T00:39:07.152972+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.152972+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:09.115364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":184,"num_read_kb":169,"num_write":343,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"261'134","reported_seq":688,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:19.680272+0000","last_change":"2024-09-12T00:39:19.680171+0000","last_active":"2024-09-12T00:39:19.680272+0000","last_peered":"2024-09-12T00:39:19.680272+0000","last_clean":"2024-09-12T00:39:19.680272+0000","last_became_active":"2024-09-12T00:02:07.173094+0000","last_became_peered":"2024-09-12T00:02:07.173094+0000","last_unstale":"2024-09-12T00:39:19.680272+0000","last_undegraded":"2024-09-12T00:39:19.680272+0000","last_fullsized":"2024-09-12T00:39:19.680272+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'134","last_scrub_stamp":"2024-09-12T00:39:19.680058+0000","last_deep_scrub":"261'134","last_deep_scrub_stamp":"2024-09-12T00:39:19.680058+0000","last_clean_scrub_stamp":"2024-09-12T00:39:19.680058+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:25.672209+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":191,"num_read_kb":191,"num_write":308,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"261'183","reported_seq":780,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.104367+0000","last_change":"2024-09-12T00:38:53.104304+0000","last_active":"2024-09-12T00:38:53.104367+0000","last_peered":"2024-09-12T00:38:53.104367+0000","last_clean":"2024-09-12T00:38:53.104367+0000","last_became_active":"2024-09-12T00:01:59.154463+0000","last_became_peered":"2024-09-12T00:01:59.154463+0000","last_unstale":"2024-09-12T00:38:53.104367+0000","last_undegraded":"2024-09-12T00:38:53.104367+0000","last_fullsized":"2024-09-12T00:38:53.104367+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'183","last_scrub_stamp":"2024-09-12T00:38:53.104215+0000","last_deep_scrub":"261'183","last_deep_scrub_stamp":"2024-09-12T00:38:53.104215+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.104215+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:44.019441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":794,"num_read_kb":651,"num_write":258,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"261'344","reported_seq":989,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.246016+0000","last_change":"2024-09-12T00:38:53.245956+0000","last_active":"2024-09-12T00:38:53.246016+0000","last_peered":"2024-09-12T00:38:53.246016+0000","last_clean":"2024-09-12T00:38:53.246016+0000","last_became_active":"2024-09-12T00:01:57.163847+0000","last_became_peered":"2024-09-12T00:01:57.163847+0000","last_unstale":"2024-09-12T00:38:53.246016+0000","last_undegraded":"2024-09-12T00:38:53.246016+0000","last_fullsized":"2024-09-12T00:38:53.246016+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'344","last_scrub_stamp":"2024-09-12T00:38:53.245846+0000","last_deep_scrub":"261'344","last_deep_scrub_stamp":"2024-09-12T00:38:53.245846+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.245846+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:07.900488+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291524,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":515,"num_read_kb":27216,"num_write":1109,"num_write_kb":33935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":490,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.933276+0000","last_change":"2024-09-12T00:39:00.933189+0000","last_active":"2024-09-12T00:39:00.933276+0000","last_peered":"2024-09-12T00:39:00.933276+0000","last_clean":"2024-09-12T00:39:00.933276+0000","last_became_active":"2024-09-12T00:02:01.144579+0000","last_became_peered":"2024-09-12T00:02:01.144579+0000","last_unstale":"2024-09-12T00:39:00.933276+0000","last_undegraded":"2024-09-12T00:39:00.933276+0000","last_fullsized":"2024-09-12T00:39:00.933276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:00.933071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:00.933071+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.933071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:49.735936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"261'301","reported_seq":870,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.984892+0000","last_change":"2024-09-12T00:39:04.984786+0000","last_active":"2024-09-12T00:39:04.984892+0000","last_peered":"2024-09-12T00:39:04.984892+0000","last_clean":"2024-09-12T00:39:04.984892+0000","last_became_active":"2024-09-12T00:02:03.154710+0000","last_became_peered":"2024-09-12T00:02:03.154710+0000","last_unstale":"2024-09-12T00:39:04.984892+0000","last_undegraded":"2024-09-12T00:39:04.984892+0000","last_fullsized":"2024-09-12T00:39:04.984892+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'301","last_scrub_stamp":"2024-09-12T00:39:04.984680+0000","last_deep_scrub":"261'301","last_deep_scrub_stamp":"2024-09-12T00:39:04.984680+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.984680+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:02.248554+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46247,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":469,"num_read_kb":1061,"num_write":388,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.953824+0000","last_change":"2024-09-12T00:39:03.953737+0000","last_active":"2024-09-12T00:39:03.953824+0000","last_peered":"2024-09-12T00:39:03.953824+0000","last_clean":"2024-09-12T00:39:03.953824+0000","last_became_active":"2024-09-12T00:02:05.163389+0000","last_became_peered":"2024-09-12T00:02:05.163389+0000","last_unstale":"2024-09-12T00:39:03.953824+0000","last_undegraded":"2024-09-12T00:39:03.953824+0000","last_fullsized":"2024-09-12T00:39:03.953824+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:03.953638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:03.953638+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.953638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:00.527480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"261'118","reported_seq":601,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.938839+0000","last_change":"2024-09-12T00:39:09.938839+0000","last_active":"2024-09-12T00:39:09.938839+0000","last_peered":"2024-09-12T00:39:09.938839+0000","last_clean":"2024-09-12T00:39:09.938839+0000","last_became_active":"2024-09-12T00:02:07.172360+0000","last_became_peered":"2024-09-12T00:02:07.172360+0000","last_unstale":"2024-09-12T00:39:09.938839+0000","last_undegraded":"2024-09-12T00:39:09.938839+0000","last_fullsized":"2024-09-12T00:39:09.938839+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'118","last_scrub_stamp":"2024-09-12T00:39:09.938737+0000","last_deep_scrub":"261'118","last_deep_scrub_stamp":"2024-09-12T00:39:09.938737+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.938737+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:26.730532+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":409,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":286,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"261'116","reported_seq":724,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.464113+0000","last_change":"2024-09-12T00:38:53.463997+0000","last_active":"2024-09-12T00:38:53.464113+0000","last_peered":"2024-09-12T00:38:53.464113+0000","last_clean":"2024-09-12T00:38:53.464113+0000","last_became_active":"2024-09-12T00:01:59.155287+0000","last_became_peered":"2024-09-12T00:01:59.155287+0000","last_unstale":"2024-09-12T00:38:53.464113+0000","last_undegraded":"2024-09-12T00:38:53.464113+0000","last_fullsized":"2024-09-12T00:38:53.464113+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'116","last_scrub_stamp":"2024-09-12T00:38:53.463870+0000","last_deep_scrub":"261'116","last_deep_scrub_stamp":"2024-09-12T00:38:53.463870+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.463870+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:51.953337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":525,"num_read_kb":443,"num_write":161,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"261'336","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.145933+0000","last_change":"2024-09-12T00:38:44.145933+0000","last_active":"2024-09-12T00:38:44.145933+0000","last_peered":"2024-09-12T00:38:44.145933+0000","last_clean":"2024-09-12T00:38:44.145933+0000","last_became_active":"2024-09-12T00:01:57.144743+0000","last_became_peered":"2024-09-12T00:01:57.144743+0000","last_unstale":"2024-09-12T00:38:44.145933+0000","last_undegraded":"2024-09-12T00:38:44.145933+0000","last_fullsized":"2024-09-12T00:38:44.145933+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'336","last_scrub_stamp":"2024-09-12T00:38:44.145810+0000","last_deep_scrub":"261'336","last_deep_scrub_stamp":"2024-09-12T00:38:44.145810+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.145810+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:50.608602+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133666,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":7939,"num_write":1030,"num_write_kb":13946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.613371+0000","last_change":"2024-09-12T00:39:04.613308+0000","last_active":"2024-09-12T00:39:04.613371+0000","last_peered":"2024-09-12T00:39:04.613371+0000","last_clean":"2024-09-12T00:39:04.613371+0000","last_became_active":"2024-09-12T00:02:01.150857+0000","last_became_peered":"2024-09-12T00:02:01.150857+0000","last_unstale":"2024-09-12T00:39:04.613371+0000","last_undegraded":"2024-09-12T00:39:04.613371+0000","last_fullsized":"2024-09-12T00:39:04.613371+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:04.613218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:04.613218+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.613218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:32.659843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"261'44","reported_seq":546,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.773124+0000","last_change":"2024-09-12T00:39:08.773044+0000","last_active":"2024-09-12T00:39:08.773124+0000","last_peered":"2024-09-12T00:39:08.773124+0000","last_clean":"2024-09-12T00:39:08.773124+0000","last_became_active":"2024-09-12T00:02:03.149558+0000","last_became_peered":"2024-09-12T00:02:03.149558+0000","last_unstale":"2024-09-12T00:39:08.773124+0000","last_undegraded":"2024-09-12T00:39:08.773124+0000","last_fullsized":"2024-09-12T00:39:08.773124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'44","last_scrub_stamp":"2024-09-12T00:39:08.772942+0000","last_deep_scrub":"261'44","last_deep_scrub_stamp":"2024-09-12T00:39:08.772942+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.772942+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:11.724806+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":24,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":478,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.142589+0000","last_change":"2024-09-12T00:39:08.142463+0000","last_active":"2024-09-12T00:39:08.142589+0000","last_peered":"2024-09-12T00:39:08.142589+0000","last_clean":"2024-09-12T00:39:08.142589+0000","last_became_active":"2024-09-12T00:02:05.170836+0000","last_became_peered":"2024-09-12T00:02:05.170836+0000","last_unstale":"2024-09-12T00:39:08.142589+0000","last_undegraded":"2024-09-12T00:39:08.142589+0000","last_fullsized":"2024-09-12T00:39:08.142589+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:08.142365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:08.142365+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.142365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:40:14.885052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"261'260","reported_seq":787,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.004226+0000","last_change":"2024-09-12T00:39:13.004131+0000","last_active":"2024-09-12T00:39:13.004226+0000","last_peered":"2024-09-12T00:39:13.004226+0000","last_clean":"2024-09-12T00:39:13.004226+0000","last_became_active":"2024-09-12T00:02:07.168678+0000","last_became_peered":"2024-09-12T00:02:07.168678+0000","last_unstale":"2024-09-12T00:39:13.004226+0000","last_undegraded":"2024-09-12T00:39:13.004226+0000","last_fullsized":"2024-09-12T00:39:13.004226+0000","mapping_epoch":34,"log_start":"261'200","ondisk_log_start":"261'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'260","last_scrub_stamp":"2024-09-12T00:39:13.004011+0000","last_deep_scrub":"261'260","last_deep_scrub_stamp":"2024-09-12T00:39:13.004011+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.004011+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:28.806126+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":392,"num_read_kb":368,"num_write":602,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"261'4088","reported_seq":4647,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.470038+0000","last_change":"2024-09-12T00:38:52.469941+0000","last_active":"2024-09-12T00:38:52.470038+0000","last_peered":"2024-09-12T00:38:52.470038+0000","last_clean":"2024-09-12T00:38:52.470038+0000","last_became_active":"2024-09-12T00:01:59.154260+0000","last_became_peered":"2024-09-12T00:01:59.154260+0000","last_unstale":"2024-09-12T00:38:52.470038+0000","last_undegraded":"2024-09-12T00:38:52.470038+0000","last_fullsized":"2024-09-12T00:38:52.470038+0000","mapping_epoch":26,"log_start":"261'4000","ondisk_log_start":"261'4000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4088","last_scrub_stamp":"2024-09-12T00:38:52.469853+0000","last_deep_scrub":"261'4088","last_deep_scrub_stamp":"2024-09-12T00:38:52.469853+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.469853+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:37.050318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16394,"num_read_kb":13744,"num_write":6133,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"261'298","reported_seq":900,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:44.977235+0000","last_change":"2024-09-12T00:38:44.977235+0000","last_active":"2024-09-12T00:38:44.977235+0000","last_peered":"2024-09-12T00:38:44.977235+0000","last_clean":"2024-09-12T00:38:44.977235+0000","last_became_active":"2024-09-12T00:01:57.158677+0000","last_became_peered":"2024-09-12T00:01:57.158677+0000","last_unstale":"2024-09-12T00:38:44.977235+0000","last_undegraded":"2024-09-12T00:38:44.977235+0000","last_fullsized":"2024-09-12T00:38:44.977235+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'298","last_scrub_stamp":"2024-09-12T00:38:44.977107+0000","last_deep_scrub":"261'298","last_deep_scrub_stamp":"2024-09-12T00:38:44.977107+0000","last_clean_scrub_stamp":"2024-09-12T00:38:44.977107+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:41.638070+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174545,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":398,"num_read_kb":56505,"num_write":935,"num_write_kb":31346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.205696+0000","last_change":"2024-09-12T00:38:58.205604+0000","last_active":"2024-09-12T00:38:58.205696+0000","last_peered":"2024-09-12T00:38:58.205696+0000","last_clean":"2024-09-12T00:38:58.205696+0000","last_became_active":"2024-09-12T00:02:01.155490+0000","last_became_peered":"2024-09-12T00:02:01.155490+0000","last_unstale":"2024-09-12T00:38:58.205696+0000","last_undegraded":"2024-09-12T00:38:58.205696+0000","last_fullsized":"2024-09-12T00:38:58.205696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:58.205501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:58.205501+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.205501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:52.049489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"261'288","reported_seq":864,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.896792+0000","last_change":"2024-09-12T00:39:00.896733+0000","last_active":"2024-09-12T00:39:00.896792+0000","last_peered":"2024-09-12T00:39:00.896792+0000","last_clean":"2024-09-12T00:39:00.896792+0000","last_became_active":"2024-09-12T00:02:03.148690+0000","last_became_peered":"2024-09-12T00:02:03.148690+0000","last_unstale":"2024-09-12T00:39:00.896792+0000","last_undegraded":"2024-09-12T00:39:00.896792+0000","last_fullsized":"2024-09-12T00:39:00.896792+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'288","last_scrub_stamp":"2024-09-12T00:39:00.896639+0000","last_deep_scrub":"261'288","last_deep_scrub_stamp":"2024-09-12T00:39:00.896639+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.896639+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:17.219963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45068,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1019,"num_write":374,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":486,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.367809+0000","last_change":"2024-09-12T00:39:16.367739+0000","last_active":"2024-09-12T00:39:16.367809+0000","last_peered":"2024-09-12T00:39:16.367809+0000","last_clean":"2024-09-12T00:39:16.367809+0000","last_became_active":"2024-09-12T00:02:05.168232+0000","last_became_peered":"2024-09-12T00:02:05.168232+0000","last_unstale":"2024-09-12T00:39:16.367809+0000","last_undegraded":"2024-09-12T00:39:16.367809+0000","last_fullsized":"2024-09-12T00:39:16.367809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.367631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.367631+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.367631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:41.610148+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"261'137","reported_seq":679,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:28.987181+0000","last_change":"2024-09-12T00:39:28.987118+0000","last_active":"2024-09-12T00:39:28.987181+0000","last_peered":"2024-09-12T00:39:28.987181+0000","last_clean":"2024-09-12T00:39:28.987181+0000","last_became_active":"2024-09-12T00:02:07.168747+0000","last_became_peered":"2024-09-12T00:02:07.168747+0000","last_unstale":"2024-09-12T00:39:28.987181+0000","last_undegraded":"2024-09-12T00:39:28.987181+0000","last_fullsized":"2024-09-12T00:39:28.987181+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'137","last_scrub_stamp":"2024-09-12T00:39:28.987021+0000","last_deep_scrub":"261'137","last_deep_scrub_stamp":"2024-09-12T00:39:28.987021+0000","last_clean_scrub_stamp":"2024-09-12T00:39:28.987021+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:31.252410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":652,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":291,"num_read_kb":255,"num_write":337,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"261'104","reported_seq":682,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.791782+0000","last_change":"2024-09-12T00:38:49.791694+0000","last_active":"2024-09-12T00:38:49.791782+0000","last_peered":"2024-09-12T00:38:49.791782+0000","last_clean":"2024-09-12T00:38:49.791782+0000","last_became_active":"2024-09-12T00:01:59.154848+0000","last_became_peered":"2024-09-12T00:01:59.154848+0000","last_unstale":"2024-09-12T00:38:49.791782+0000","last_undegraded":"2024-09-12T00:38:49.791782+0000","last_fullsized":"2024-09-12T00:38:49.791782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'104","last_scrub_stamp":"2024-09-12T00:38:49.791355+0000","last_deep_scrub":"261'104","last_deep_scrub_stamp":"2024-09-12T00:38:49.791355+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.791355+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:55.148174+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":466,"num_read_kb":392,"num_write":152,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"261'307","reported_seq":1000,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.779506+0000","last_change":"2024-09-12T00:38:45.779506+0000","last_active":"2024-09-12T00:38:45.779506+0000","last_peered":"2024-09-12T00:38:45.779506+0000","last_clean":"2024-09-12T00:38:45.779506+0000","last_became_active":"2024-09-12T00:01:57.142385+0000","last_became_peered":"2024-09-12T00:01:57.142385+0000","last_unstale":"2024-09-12T00:38:45.779506+0000","last_undegraded":"2024-09-12T00:38:45.779506+0000","last_fullsized":"2024-09-12T00:38:45.779506+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'307","last_scrub_stamp":"2024-09-12T00:38:45.779328+0000","last_deep_scrub":"261'307","last_deep_scrub_stamp":"2024-09-12T00:38:45.779328+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.779328+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:38.402035+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267376,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":608,"num_read_kb":9162,"num_write":1027,"num_write_kb":16984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:09.264896+0000","last_change":"2024-09-12T00:39:09.264827+0000","last_active":"2024-09-12T00:39:09.264896+0000","last_peered":"2024-09-12T00:39:09.264896+0000","last_clean":"2024-09-12T00:39:09.264896+0000","last_became_active":"2024-09-12T00:02:01.153906+0000","last_became_peered":"2024-09-12T00:02:01.153906+0000","last_unstale":"2024-09-12T00:39:09.264896+0000","last_undegraded":"2024-09-12T00:39:09.264896+0000","last_fullsized":"2024-09-12T00:39:09.264896+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:09.264735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:09.264735+0000","last_clean_scrub_stamp":"2024-09-12T00:39:09.264735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:09.765221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"261'252","reported_seq":820,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.318052+0000","last_change":"2024-09-12T00:39:04.317979+0000","last_active":"2024-09-12T00:39:04.318052+0000","last_peered":"2024-09-12T00:39:04.318052+0000","last_clean":"2024-09-12T00:39:04.318052+0000","last_became_active":"2024-09-12T00:02:03.154896+0000","last_became_peered":"2024-09-12T00:02:03.154896+0000","last_unstale":"2024-09-12T00:39:04.318052+0000","last_undegraded":"2024-09-12T00:39:04.318052+0000","last_fullsized":"2024-09-12T00:39:04.318052+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'252","last_scrub_stamp":"2024-09-12T00:39:04.317880+0000","last_deep_scrub":"261'252","last_deep_scrub_stamp":"2024-09-12T00:39:04.317880+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.317880+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:18.759091+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50982,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":962,"num_write":334,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":479,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:04.944979+0000","last_change":"2024-09-12T00:39:04.944929+0000","last_active":"2024-09-12T00:39:04.944979+0000","last_peered":"2024-09-12T00:39:04.944979+0000","last_clean":"2024-09-12T00:39:04.944979+0000","last_became_active":"2024-09-12T00:02:05.162204+0000","last_became_peered":"2024-09-12T00:02:05.162204+0000","last_unstale":"2024-09-12T00:39:04.944979+0000","last_undegraded":"2024-09-12T00:39:04.944979+0000","last_fullsized":"2024-09-12T00:39:04.944979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:04.944845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:04.944845+0000","last_clean_scrub_stamp":"2024-09-12T00:39:04.944845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:13.193383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"261'126","reported_seq":688,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.158584+0000","last_change":"2024-09-12T00:39:00.158511+0000","last_active":"2024-09-12T00:39:00.158584+0000","last_peered":"2024-09-12T00:39:00.158584+0000","last_clean":"2024-09-12T00:39:00.158584+0000","last_became_active":"2024-09-12T00:01:59.145456+0000","last_became_peered":"2024-09-12T00:01:59.145456+0000","last_unstale":"2024-09-12T00:39:00.158584+0000","last_undegraded":"2024-09-12T00:39:00.158584+0000","last_fullsized":"2024-09-12T00:39:00.158584+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'126","last_scrub_stamp":"2024-09-12T00:39:00.158426+0000","last_deep_scrub":"261'126","last_deep_scrub_stamp":"2024-09-12T00:39:00.158426+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.158426+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:15.829990+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":512,"num_read_kb":415,"num_write":196,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"261'379","reported_seq":1018,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.785930+0000","last_change":"2024-09-12T00:38:47.785930+0000","last_active":"2024-09-12T00:38:47.785930+0000","last_peered":"2024-09-12T00:38:47.785930+0000","last_clean":"2024-09-12T00:38:47.785930+0000","last_became_active":"2024-09-12T00:01:57.143684+0000","last_became_peered":"2024-09-12T00:01:57.143684+0000","last_unstale":"2024-09-12T00:38:47.785930+0000","last_undegraded":"2024-09-12T00:38:47.785930+0000","last_fullsized":"2024-09-12T00:38:47.785930+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'379","last_scrub_stamp":"2024-09-12T00:38:47.785711+0000","last_deep_scrub":"261'379","last_deep_scrub_stamp":"2024-09-12T00:38:47.785711+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.785711+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:31.165040+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":509,"num_read_kb":22065,"num_write":1209,"num_write_kb":32922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":492,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:01.933001+0000","last_change":"2024-09-12T00:39:01.933001+0000","last_active":"2024-09-12T00:39:01.933001+0000","last_peered":"2024-09-12T00:39:01.933001+0000","last_clean":"2024-09-12T00:39:01.933001+0000","last_became_active":"2024-09-12T00:02:01.154541+0000","last_became_peered":"2024-09-12T00:02:01.154541+0000","last_unstale":"2024-09-12T00:39:01.933001+0000","last_undegraded":"2024-09-12T00:39:01.933001+0000","last_fullsized":"2024-09-12T00:39:01.933001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:01.932891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:01.932891+0000","last_clean_scrub_stamp":"2024-09-12T00:39:01.932891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:16.732784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"261'496","reported_seq":1121,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.005276+0000","last_change":"2024-09-12T00:39:07.005218+0000","last_active":"2024-09-12T00:39:07.005276+0000","last_peered":"2024-09-12T00:39:07.005276+0000","last_clean":"2024-09-12T00:39:07.005276+0000","last_became_active":"2024-09-12T00:02:03.158360+0000","last_became_peered":"2024-09-12T00:02:03.158360+0000","last_unstale":"2024-09-12T00:39:07.005276+0000","last_undegraded":"2024-09-12T00:39:07.005276+0000","last_fullsized":"2024-09-12T00:39:07.005276+0000","mapping_epoch":30,"log_start":"261'400","ondisk_log_start":"261'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'496","last_scrub_stamp":"2024-09-12T00:39:07.005126+0000","last_deep_scrub":"261'496","last_deep_scrub_stamp":"2024-09-12T00:39:07.005126+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.005126+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:16.952892+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92045,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":891,"num_read_kb":2130,"num_write":768,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":477,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.203352+0000","last_change":"2024-09-12T00:39:05.203260+0000","last_active":"2024-09-12T00:39:05.203352+0000","last_peered":"2024-09-12T00:39:05.203352+0000","last_clean":"2024-09-12T00:39:05.203352+0000","last_became_active":"2024-09-12T00:02:05.167052+0000","last_became_peered":"2024-09-12T00:02:05.167052+0000","last_unstale":"2024-09-12T00:39:05.203352+0000","last_undegraded":"2024-09-12T00:39:05.203352+0000","last_fullsized":"2024-09-12T00:39:05.203352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:05.203162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:05.203162+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.203162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:33.095842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"261'208","reported_seq":715,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.815107+0000","last_change":"2024-09-12T00:39:20.814996+0000","last_active":"2024-09-12T00:39:20.815107+0000","last_peered":"2024-09-12T00:39:20.815107+0000","last_clean":"2024-09-12T00:39:20.815107+0000","last_became_active":"2024-09-12T00:02:07.167331+0000","last_became_peered":"2024-09-12T00:02:07.167331+0000","last_unstale":"2024-09-12T00:39:20.815107+0000","last_undegraded":"2024-09-12T00:39:20.815107+0000","last_fullsized":"2024-09-12T00:39:20.815107+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'208","last_scrub_stamp":"2024-09-12T00:39:20.814891+0000","last_deep_scrub":"261'208","last_deep_scrub_stamp":"2024-09-12T00:39:20.814891+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.814891+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:29.301110+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":286,"num_read_kb":283,"num_write":483,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"261'399","reported_seq":1166,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.501525+0000","last_change":"2024-09-12T00:38:55.501525+0000","last_active":"2024-09-12T00:38:55.501525+0000","last_peered":"2024-09-12T00:38:55.501525+0000","last_clean":"2024-09-12T00:38:55.501525+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:38:55.501525+0000","last_undegraded":"2024-09-12T00:38:55.501525+0000","last_fullsized":"2024-09-12T00:38:55.501525+0000","mapping_epoch":26,"log_start":"261'300","ondisk_log_start":"261'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'399","last_scrub_stamp":"2024-09-12T00:38:55.501439+0000","last_deep_scrub":"261'399","last_deep_scrub_stamp":"2024-09-12T00:38:55.501439+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.501439+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:17.884111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1910,"num_read_kb":1650,"num_write":597,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25748,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"261'351","reported_seq":1035,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.618535+0000","last_change":"2024-09-12T00:38:45.618535+0000","last_active":"2024-09-12T00:38:45.618535+0000","last_peered":"2024-09-12T00:38:45.618535+0000","last_clean":"2024-09-12T00:38:45.618535+0000","last_became_active":"2024-09-12T00:01:57.141998+0000","last_became_peered":"2024-09-12T00:01:57.141998+0000","last_unstale":"2024-09-12T00:38:45.618535+0000","last_undegraded":"2024-09-12T00:38:45.618535+0000","last_fullsized":"2024-09-12T00:38:45.618535+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'351","last_scrub_stamp":"2024-09-12T00:38:45.618369+0000","last_deep_scrub":"261'351","last_deep_scrub_stamp":"2024-09-12T00:38:45.618369+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.618369+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:31.142149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":1840,"num_write":1203,"num_write_kb":17126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":488,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.213005+0000","last_change":"2024-09-12T00:39:00.212928+0000","last_active":"2024-09-12T00:39:00.213005+0000","last_peered":"2024-09-12T00:39:00.213005+0000","last_clean":"2024-09-12T00:39:00.213005+0000","last_became_active":"2024-09-12T00:02:01.153611+0000","last_became_peered":"2024-09-12T00:02:01.153611+0000","last_unstale":"2024-09-12T00:39:00.213005+0000","last_undegraded":"2024-09-12T00:39:00.213005+0000","last_fullsized":"2024-09-12T00:39:00.213005+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:00.212821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:00.212821+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.212821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:09.175487+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"261'292","reported_seq":865,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.196264+0000","last_change":"2024-09-12T00:39:16.196205+0000","last_active":"2024-09-12T00:39:16.196264+0000","last_peered":"2024-09-12T00:39:16.196264+0000","last_clean":"2024-09-12T00:39:16.196264+0000","last_became_active":"2024-09-12T00:02:03.154821+0000","last_became_peered":"2024-09-12T00:02:03.154821+0000","last_unstale":"2024-09-12T00:39:16.196264+0000","last_undegraded":"2024-09-12T00:39:16.196264+0000","last_fullsized":"2024-09-12T00:39:16.196264+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'292","last_scrub_stamp":"2024-09-12T00:39:16.196072+0000","last_deep_scrub":"261'292","last_deep_scrub_stamp":"2024-09-12T00:39:16.196072+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.196072+0000","objects_scrubbed":8,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:49.625222+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49647,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":465,"num_read_kb":1013,"num_write":386,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:14.742754+0000","last_change":"2024-09-12T00:39:14.742699+0000","last_active":"2024-09-12T00:39:14.742754+0000","last_peered":"2024-09-12T00:39:14.742754+0000","last_clean":"2024-09-12T00:39:14.742754+0000","last_became_active":"2024-09-12T00:02:05.169726+0000","last_became_peered":"2024-09-12T00:02:05.169726+0000","last_unstale":"2024-09-12T00:39:14.742754+0000","last_undegraded":"2024-09-12T00:39:14.742754+0000","last_fullsized":"2024-09-12T00:39:14.742754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:14.742597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:14.742597+0000","last_clean_scrub_stamp":"2024-09-12T00:39:14.742597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:05.171472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"261'198","reported_seq":1075,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:26.098436+0000","last_change":"2024-09-12T00:39:26.098343+0000","last_active":"2024-09-12T00:39:26.098436+0000","last_peered":"2024-09-12T00:39:26.098436+0000","last_clean":"2024-09-12T00:39:26.098436+0000","last_became_active":"2024-09-12T00:02:07.174910+0000","last_became_peered":"2024-09-12T00:02:07.174910+0000","last_unstale":"2024-09-12T00:39:26.098436+0000","last_undegraded":"2024-09-12T00:39:26.098436+0000","last_fullsized":"2024-09-12T00:39:26.098436+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'198","last_scrub_stamp":"2024-09-12T00:39:26.098228+0000","last_deep_scrub":"261'198","last_deep_scrub_stamp":"2024-09-12T00:39:26.098228+0000","last_clean_scrub_stamp":"2024-09-12T00:39:26.098228+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:10.302334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":668,"num_read_kb":649,"num_write":556,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"261'98","reported_seq":674,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.867687+0000","last_change":"2024-09-12T00:38:51.867630+0000","last_active":"2024-09-12T00:38:51.867687+0000","last_peered":"2024-09-12T00:38:51.867687+0000","last_clean":"2024-09-12T00:38:51.867687+0000","last_became_active":"2024-09-12T00:01:59.151143+0000","last_became_peered":"2024-09-12T00:01:59.151143+0000","last_unstale":"2024-09-12T00:38:51.867687+0000","last_undegraded":"2024-09-12T00:38:51.867687+0000","last_fullsized":"2024-09-12T00:38:51.867687+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'98","last_scrub_stamp":"2024-09-12T00:38:51.867545+0000","last_deep_scrub":"261'98","last_deep_scrub_stamp":"2024-09-12T00:38:51.867545+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.867545+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:31.009419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":451,"num_read_kb":380,"num_write":139,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"261'298","reported_seq":895,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:45.494823+0000","last_change":"2024-09-12T00:38:45.494768+0000","last_active":"2024-09-12T00:38:45.494823+0000","last_peered":"2024-09-12T00:38:45.494823+0000","last_clean":"2024-09-12T00:38:45.494823+0000","last_became_active":"2024-09-12T00:01:57.141789+0000","last_became_peered":"2024-09-12T00:01:57.141789+0000","last_unstale":"2024-09-12T00:38:45.494823+0000","last_undegraded":"2024-09-12T00:38:45.494823+0000","last_fullsized":"2024-09-12T00:38:45.494823+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'298","last_scrub_stamp":"2024-09-12T00:38:45.494662+0000","last_deep_scrub":"261'298","last_deep_scrub_stamp":"2024-09-12T00:38:45.494662+0000","last_clean_scrub_stamp":"2024-09-12T00:38:45.494662+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:53:00.002183+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":381,"num_read_kb":31078,"num_write":882,"num_write_kb":48318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.170325+0000","last_change":"2024-09-12T00:38:59.170256+0000","last_active":"2024-09-12T00:38:59.170325+0000","last_peered":"2024-09-12T00:38:59.170325+0000","last_clean":"2024-09-12T00:38:59.170325+0000","last_became_active":"2024-09-12T00:02:01.154530+0000","last_became_peered":"2024-09-12T00:02:01.154530+0000","last_unstale":"2024-09-12T00:38:59.170325+0000","last_undegraded":"2024-09-12T00:38:59.170325+0000","last_fullsized":"2024-09-12T00:38:59.170325+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.170165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.170165+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.170165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:21.430019+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"261'294","reported_seq":865,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.000673+0000","last_change":"2024-09-12T00:39:08.000618+0000","last_active":"2024-09-12T00:39:08.000673+0000","last_peered":"2024-09-12T00:39:08.000673+0000","last_clean":"2024-09-12T00:39:08.000673+0000","last_became_active":"2024-09-12T00:02:03.156529+0000","last_became_peered":"2024-09-12T00:02:03.156529+0000","last_unstale":"2024-09-12T00:39:08.000673+0000","last_undegraded":"2024-09-12T00:39:08.000673+0000","last_fullsized":"2024-09-12T00:39:08.000673+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'294","last_scrub_stamp":"2024-09-12T00:39:08.000522+0000","last_deep_scrub":"261'294","last_deep_scrub_stamp":"2024-09-12T00:39:08.000522+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.000522+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:58.166295+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53504,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":1158,"num_write":402,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":481,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.902267+0000","last_change":"2024-09-12T00:39:05.902267+0000","last_active":"2024-09-12T00:39:05.902267+0000","last_peered":"2024-09-12T00:39:05.902267+0000","last_clean":"2024-09-12T00:39:05.902267+0000","last_became_active":"2024-09-12T00:02:05.163956+0000","last_became_peered":"2024-09-12T00:02:05.163956+0000","last_unstale":"2024-09-12T00:39:05.902267+0000","last_undegraded":"2024-09-12T00:39:05.902267+0000","last_fullsized":"2024-09-12T00:39:05.902267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:05.902175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:05.902175+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.902175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:32.967076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"261'131","reported_seq":616,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:27.063052+0000","last_change":"2024-09-12T00:39:27.062988+0000","last_active":"2024-09-12T00:39:27.063052+0000","last_peered":"2024-09-12T00:39:27.063052+0000","last_clean":"2024-09-12T00:39:27.063052+0000","last_became_active":"2024-09-12T00:02:07.172496+0000","last_became_peered":"2024-09-12T00:02:07.172496+0000","last_unstale":"2024-09-12T00:39:27.063052+0000","last_undegraded":"2024-09-12T00:39:27.063052+0000","last_fullsized":"2024-09-12T00:39:27.063052+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'131","last_scrub_stamp":"2024-09-12T00:39:27.062894+0000","last_deep_scrub":"261'131","last_deep_scrub_stamp":"2024-09-12T00:39:27.062894+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.062894+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:04.392517+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":107,"num_write":307,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"261'198","reported_seq":837,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.530014+0000","last_change":"2024-09-12T00:38:49.529914+0000","last_active":"2024-09-12T00:38:49.530014+0000","last_peered":"2024-09-12T00:38:49.530014+0000","last_clean":"2024-09-12T00:38:49.530014+0000","last_became_active":"2024-09-12T00:01:59.148559+0000","last_became_peered":"2024-09-12T00:01:59.148559+0000","last_unstale":"2024-09-12T00:38:49.530014+0000","last_undegraded":"2024-09-12T00:38:49.530014+0000","last_fullsized":"2024-09-12T00:38:49.530014+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'198","last_scrub_stamp":"2024-09-12T00:38:49.529821+0000","last_deep_scrub":"261'198","last_deep_scrub_stamp":"2024-09-12T00:38:49.529821+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.529821+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:16.013027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":875,"num_read_kb":733,"num_write":278,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"261'382","reported_seq":1039,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.599884+0000","last_change":"2024-09-12T00:38:47.599821+0000","last_active":"2024-09-12T00:38:47.599884+0000","last_peered":"2024-09-12T00:38:47.599884+0000","last_clean":"2024-09-12T00:38:47.599884+0000","last_became_active":"2024-09-12T00:01:57.144397+0000","last_became_peered":"2024-09-12T00:01:57.144397+0000","last_unstale":"2024-09-12T00:38:47.599884+0000","last_undegraded":"2024-09-12T00:38:47.599884+0000","last_fullsized":"2024-09-12T00:38:47.599884+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'382","last_scrub_stamp":"2024-09-12T00:38:47.599641+0000","last_deep_scrub":"261'382","last_deep_scrub_stamp":"2024-09-12T00:38:47.599641+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.599641+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:34.445067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":577,"num_read_kb":18157,"num_write":1228,"num_write_kb":40983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"261'6","reported_seq":978,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.730424+0000","last_change":"2024-09-12T00:39:07.730359+0000","last_active":"2024-09-12T00:39:07.730424+0000","last_peered":"2024-09-12T00:39:07.730424+0000","last_clean":"2024-09-12T00:39:07.730424+0000","last_became_active":"2024-09-12T00:02:01.151739+0000","last_became_peered":"2024-09-12T00:02:01.151739+0000","last_unstale":"2024-09-12T00:39:07.730424+0000","last_undegraded":"2024-09-12T00:39:07.730424+0000","last_fullsized":"2024-09-12T00:39:07.730424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-12T00:39:07.730267+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-12T00:39:07.730267+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.730267+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:55.627773+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"261'92","reported_seq":609,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:20.135230+0000","last_change":"2024-09-12T00:39:20.135230+0000","last_active":"2024-09-12T00:39:20.135230+0000","last_peered":"2024-09-12T00:39:20.135230+0000","last_clean":"2024-09-12T00:39:20.135230+0000","last_became_active":"2024-09-12T00:02:03.153948+0000","last_became_peered":"2024-09-12T00:02:03.153948+0000","last_unstale":"2024-09-12T00:39:20.135230+0000","last_undegraded":"2024-09-12T00:39:20.135230+0000","last_fullsized":"2024-09-12T00:39:20.135230+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'92","last_scrub_stamp":"2024-09-12T00:39:20.135116+0000","last_deep_scrub":"261'92","last_deep_scrub_stamp":"2024-09-12T00:39:20.135116+0000","last_clean_scrub_stamp":"2024-09-12T00:39:20.135116+0000","objects_scrubbed":8,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:54.634202+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":111,"num_read_kb":104,"num_write":128,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"261'765","reported_seq":4289,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:06.234419+0000","last_change":"2024-09-12T00:39:06.234365+0000","last_active":"2024-09-12T00:39:06.234419+0000","last_peered":"2024-09-12T00:39:06.234419+0000","last_clean":"2024-09-12T00:39:06.234419+0000","last_became_active":"2024-09-12T00:02:05.170399+0000","last_became_peered":"2024-09-12T00:02:05.170399+0000","last_unstale":"2024-09-12T00:39:06.234419+0000","last_undegraded":"2024-09-12T00:39:06.234419+0000","last_fullsized":"2024-09-12T00:39:06.234419+0000","mapping_epoch":32,"log_start":"261'700","ondisk_log_start":"261'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'765","last_scrub_stamp":"2024-09-12T00:39:06.234288+0000","last_deep_scrub":"261'765","last_deep_scrub_stamp":"2024-09-12T00:39:06.234288+0000","last_clean_scrub_stamp":"2024-09-12T00:39:06.234288+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:39.555335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"261'118","reported_seq":613,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:28.014857+0000","last_change":"2024-09-12T00:39:28.014791+0000","last_active":"2024-09-12T00:39:28.014857+0000","last_peered":"2024-09-12T00:39:28.014857+0000","last_clean":"2024-09-12T00:39:28.014857+0000","last_became_active":"2024-09-12T00:02:07.173030+0000","last_became_peered":"2024-09-12T00:02:07.173030+0000","last_unstale":"2024-09-12T00:39:28.014857+0000","last_undegraded":"2024-09-12T00:39:28.014857+0000","last_fullsized":"2024-09-12T00:39:28.014857+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'118","last_scrub_stamp":"2024-09-12T00:39:28.014695+0000","last_deep_scrub":"261'118","last_deep_scrub_stamp":"2024-09-12T00:39:28.014695+0000","last_clean_scrub_stamp":"2024-09-12T00:39:28.014695+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:40.701990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":288,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"261'244","reported_seq":882,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.158778+0000","last_change":"2024-09-12T00:38:56.158718+0000","last_active":"2024-09-12T00:38:56.158778+0000","last_peered":"2024-09-12T00:38:56.158778+0000","last_clean":"2024-09-12T00:38:56.158778+0000","last_became_active":"2024-09-12T00:01:59.151743+0000","last_became_peered":"2024-09-12T00:01:59.151743+0000","last_unstale":"2024-09-12T00:38:56.158778+0000","last_undegraded":"2024-09-12T00:38:56.158778+0000","last_fullsized":"2024-09-12T00:38:56.158778+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'244","last_scrub_stamp":"2024-09-12T00:38:56.158624+0000","last_deep_scrub":"261'244","last_deep_scrub_stamp":"2024-09-12T00:38:56.158624+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.158624+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:33.327253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1082,"num_read_kb":884,"num_write":389,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"261'313","reported_seq":919,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:43.492959+0000","last_change":"2024-09-12T00:38:43.492902+0000","last_active":"2024-09-12T00:38:43.492959+0000","last_peered":"2024-09-12T00:38:43.492959+0000","last_clean":"2024-09-12T00:38:43.492959+0000","last_became_active":"2024-09-12T00:01:57.144946+0000","last_became_peered":"2024-09-12T00:01:57.144946+0000","last_unstale":"2024-09-12T00:38:43.492959+0000","last_undegraded":"2024-09-12T00:38:43.492959+0000","last_fullsized":"2024-09-12T00:38:43.492959+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'313","last_scrub_stamp":"2024-09-12T00:38:43.492802+0000","last_deep_scrub":"261'313","last_deep_scrub_stamp":"2024-09-12T00:38:43.492802+0000","last_clean_scrub_stamp":"2024-09-12T00:38:43.492802+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:17.143075+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":419,"num_read_kb":503,"num_write":968,"num_write_kb":20369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.426076+0000","last_change":"2024-09-12T00:39:00.426009+0000","last_active":"2024-09-12T00:39:00.426076+0000","last_peered":"2024-09-12T00:39:00.426076+0000","last_clean":"2024-09-12T00:39:00.426076+0000","last_became_active":"2024-09-12T00:02:01.152493+0000","last_became_peered":"2024-09-12T00:02:01.152493+0000","last_unstale":"2024-09-12T00:39:00.426076+0000","last_undegraded":"2024-09-12T00:39:00.426076+0000","last_fullsized":"2024-09-12T00:39:00.426076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:00.425924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:00.425924+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.425924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.528302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"261'323","reported_seq":926,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.285422+0000","last_change":"2024-09-12T00:39:05.285422+0000","last_active":"2024-09-12T00:39:05.285422+0000","last_peered":"2024-09-12T00:39:05.285422+0000","last_clean":"2024-09-12T00:39:05.285422+0000","last_became_active":"2024-09-12T00:02:03.150631+0000","last_became_peered":"2024-09-12T00:02:03.150631+0000","last_unstale":"2024-09-12T00:39:05.285422+0000","last_undegraded":"2024-09-12T00:39:05.285422+0000","last_fullsized":"2024-09-12T00:39:05.285422+0000","mapping_epoch":30,"log_start":"261'300","ondisk_log_start":"261'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'323","last_scrub_stamp":"2024-09-12T00:39:05.285268+0000","last_deep_scrub":"261'323","last_deep_scrub_stamp":"2024-09-12T00:39:05.285268+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.285268+0000","objects_scrubbed":11,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:00.830128+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68885,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":513,"num_read_kb":1151,"num_write":412,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:16.697322+0000","last_change":"2024-09-12T00:39:16.697322+0000","last_active":"2024-09-12T00:39:16.697322+0000","last_peered":"2024-09-12T00:39:16.697322+0000","last_clean":"2024-09-12T00:39:16.697322+0000","last_became_active":"2024-09-12T00:02:05.167082+0000","last_became_peered":"2024-09-12T00:02:05.167082+0000","last_unstale":"2024-09-12T00:39:16.697322+0000","last_undegraded":"2024-09-12T00:39:16.697322+0000","last_fullsized":"2024-09-12T00:39:16.697322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.697225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.697225+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.697225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:31.751498+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"261'125","reported_seq":624,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:10.461692+0000","last_change":"2024-09-12T00:39:10.461692+0000","last_active":"2024-09-12T00:39:10.461692+0000","last_peered":"2024-09-12T00:39:10.461692+0000","last_clean":"2024-09-12T00:39:10.461692+0000","last_became_active":"2024-09-12T00:02:07.172810+0000","last_became_peered":"2024-09-12T00:02:07.172810+0000","last_unstale":"2024-09-12T00:39:10.461692+0000","last_undegraded":"2024-09-12T00:39:10.461692+0000","last_fullsized":"2024-09-12T00:39:10.461692+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'125","last_scrub_stamp":"2024-09-12T00:39:10.461579+0000","last_deep_scrub":"261'125","last_deep_scrub_stamp":"2024-09-12T00:39:10.461579+0000","last_clean_scrub_stamp":"2024-09-12T00:39:10.461579+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:41.729868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":135,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"261'223","reported_seq":850,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.135614+0000","last_change":"2024-09-12T00:38:55.135529+0000","last_active":"2024-09-12T00:38:55.135614+0000","last_peered":"2024-09-12T00:38:55.135614+0000","last_clean":"2024-09-12T00:38:55.135614+0000","last_became_active":"2024-09-12T00:01:59.147373+0000","last_became_peered":"2024-09-12T00:01:59.147373+0000","last_unstale":"2024-09-12T00:38:55.135614+0000","last_undegraded":"2024-09-12T00:38:55.135614+0000","last_fullsized":"2024-09-12T00:38:55.135614+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'223","last_scrub_stamp":"2024-09-12T00:38:55.135426+0000","last_deep_scrub":"261'223","last_deep_scrub_stamp":"2024-09-12T00:38:55.135426+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.135426+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:54.183644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1007,"num_read_kb":830,"num_write":359,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"261'297","reported_seq":901,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:07.195842+0000","last_change":"2024-09-12T00:39:07.195766+0000","last_active":"2024-09-12T00:39:07.195842+0000","last_peered":"2024-09-12T00:39:07.195842+0000","last_clean":"2024-09-12T00:39:07.195842+0000","last_became_active":"2024-09-12T00:01:57.161414+0000","last_became_peered":"2024-09-12T00:01:57.161414+0000","last_unstale":"2024-09-12T00:39:07.195842+0000","last_undegraded":"2024-09-12T00:39:07.195842+0000","last_fullsized":"2024-09-12T00:39:07.195842+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'297","last_scrub_stamp":"2024-09-12T00:39:07.195639+0000","last_deep_scrub":"261'297","last_deep_scrub_stamp":"2024-09-12T00:39:07.195639+0000","last_clean_scrub_stamp":"2024-09-12T00:39:07.195639+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:54.938996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174757,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":380,"num_read_kb":8089,"num_write":919,"num_write_kb":31185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":485,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.179628+0000","last_change":"2024-09-12T00:38:57.179570+0000","last_active":"2024-09-12T00:38:57.179628+0000","last_peered":"2024-09-12T00:38:57.179628+0000","last_clean":"2024-09-12T00:38:57.179628+0000","last_became_active":"2024-09-12T00:02:01.151760+0000","last_became_peered":"2024-09-12T00:02:01.151760+0000","last_unstale":"2024-09-12T00:38:57.179628+0000","last_undegraded":"2024-09-12T00:38:57.179628+0000","last_fullsized":"2024-09-12T00:38:57.179628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:57.179464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:57.179464+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.179464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:03.467030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"261'281","reported_seq":853,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:13.735036+0000","last_change":"2024-09-12T00:39:13.735036+0000","last_active":"2024-09-12T00:39:13.735036+0000","last_peered":"2024-09-12T00:39:13.735036+0000","last_clean":"2024-09-12T00:39:13.735036+0000","last_became_active":"2024-09-12T00:02:03.150714+0000","last_became_peered":"2024-09-12T00:02:03.150714+0000","last_unstale":"2024-09-12T00:39:13.735036+0000","last_undegraded":"2024-09-12T00:39:13.735036+0000","last_fullsized":"2024-09-12T00:39:13.735036+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'281","last_scrub_stamp":"2024-09-12T00:39:13.734932+0000","last_deep_scrub":"261'281","last_deep_scrub_stamp":"2024-09-12T00:39:13.734932+0000","last_clean_scrub_stamp":"2024-09-12T00:39:13.734932+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:14.733788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52913,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":1134,"num_write":392,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:24.119460+0000","last_change":"2024-09-12T00:39:24.119460+0000","last_active":"2024-09-12T00:39:24.119460+0000","last_peered":"2024-09-12T00:39:24.119460+0000","last_clean":"2024-09-12T00:39:24.119460+0000","last_became_active":"2024-09-12T00:02:05.170973+0000","last_became_peered":"2024-09-12T00:02:05.170973+0000","last_unstale":"2024-09-12T00:39:24.119460+0000","last_undegraded":"2024-09-12T00:39:24.119460+0000","last_fullsized":"2024-09-12T00:39:24.119460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:24.119377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:24.119377+0000","last_clean_scrub_stamp":"2024-09-12T00:39:24.119377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:28.955427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"261'120","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:21.852653+0000","last_change":"2024-09-12T00:39:21.852653+0000","last_active":"2024-09-12T00:39:21.852653+0000","last_peered":"2024-09-12T00:39:21.852653+0000","last_clean":"2024-09-12T00:39:21.852653+0000","last_became_active":"2024-09-12T00:02:07.169266+0000","last_became_peered":"2024-09-12T00:02:07.169266+0000","last_unstale":"2024-09-12T00:39:21.852653+0000","last_undegraded":"2024-09-12T00:39:21.852653+0000","last_fullsized":"2024-09-12T00:39:21.852653+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'120","last_scrub_stamp":"2024-09-12T00:39:21.852565+0000","last_deep_scrub":"261'120","last_deep_scrub_stamp":"2024-09-12T00:39:21.852565+0000","last_clean_scrub_stamp":"2024-09-12T00:39:21.852565+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:55.302107+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":181,"num_read_kb":173,"num_write":294,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"261'183","reported_seq":785,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.841083+0000","last_change":"2024-09-12T00:38:50.841083+0000","last_active":"2024-09-12T00:38:50.841083+0000","last_peered":"2024-09-12T00:38:50.841083+0000","last_clean":"2024-09-12T00:38:50.841083+0000","last_became_active":"2024-09-12T00:01:59.149904+0000","last_became_peered":"2024-09-12T00:01:59.149904+0000","last_unstale":"2024-09-12T00:38:50.841083+0000","last_undegraded":"2024-09-12T00:38:50.841083+0000","last_fullsized":"2024-09-12T00:38:50.841083+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'183","last_scrub_stamp":"2024-09-12T00:38:50.840994+0000","last_deep_scrub":"261'183","last_deep_scrub_stamp":"2024-09-12T00:38:50.840994+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.840994+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:07.476170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":826,"num_read_kb":689,"num_write":284,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"261'446","reported_seq":1170,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.765017+0000","last_change":"2024-09-12T00:38:48.764952+0000","last_active":"2024-09-12T00:38:48.765017+0000","last_peered":"2024-09-12T00:38:48.765017+0000","last_clean":"2024-09-12T00:38:48.765017+0000","last_became_active":"2024-09-12T00:01:57.161612+0000","last_became_peered":"2024-09-12T00:01:57.161612+0000","last_unstale":"2024-09-12T00:38:48.765017+0000","last_undegraded":"2024-09-12T00:38:48.765017+0000","last_fullsized":"2024-09-12T00:38:48.765017+0000","mapping_epoch":24,"log_start":"261'400","ondisk_log_start":"261'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'446","last_scrub_stamp":"2024-09-12T00:38:48.764718+0000","last_deep_scrub":"261'446","last_deep_scrub_stamp":"2024-09-12T00:38:48.764718+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.764718+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:21.363677+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":772,"num_read_kb":15126,"num_write":1508,"num_write_kb":40840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":493,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:59.430557+0000","last_change":"2024-09-12T00:38:59.430557+0000","last_active":"2024-09-12T00:38:59.430557+0000","last_peered":"2024-09-12T00:38:59.430557+0000","last_clean":"2024-09-12T00:38:59.430557+0000","last_became_active":"2024-09-12T00:02:01.144558+0000","last_became_peered":"2024-09-12T00:02:01.144558+0000","last_unstale":"2024-09-12T00:38:59.430557+0000","last_undegraded":"2024-09-12T00:38:59.430557+0000","last_fullsized":"2024-09-12T00:38:59.430557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:38:59.430450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:38:59.430450+0000","last_clean_scrub_stamp":"2024-09-12T00:38:59.430450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:54.397837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"261'265","reported_seq":821,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.959815+0000","last_change":"2024-09-12T00:39:05.959752+0000","last_active":"2024-09-12T00:39:05.959815+0000","last_peered":"2024-09-12T00:39:05.959815+0000","last_clean":"2024-09-12T00:39:05.959815+0000","last_became_active":"2024-09-12T00:02:03.154477+0000","last_became_peered":"2024-09-12T00:02:03.154477+0000","last_unstale":"2024-09-12T00:39:05.959815+0000","last_undegraded":"2024-09-12T00:39:05.959815+0000","last_fullsized":"2024-09-12T00:39:05.959815+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'265","last_scrub_stamp":"2024-09-12T00:39:05.959667+0000","last_deep_scrub":"261'265","last_deep_scrub_stamp":"2024-09-12T00:39:05.959667+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.959667+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:09.262831+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47465,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":439,"num_read_kb":1086,"num_write":366,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":484,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:25.092629+0000","last_change":"2024-09-12T00:39:25.092508+0000","last_active":"2024-09-12T00:39:25.092629+0000","last_peered":"2024-09-12T00:39:25.092629+0000","last_clean":"2024-09-12T00:39:25.092629+0000","last_became_active":"2024-09-12T00:02:05.166141+0000","last_became_peered":"2024-09-12T00:02:05.166141+0000","last_unstale":"2024-09-12T00:39:25.092629+0000","last_undegraded":"2024-09-12T00:39:25.092629+0000","last_fullsized":"2024-09-12T00:39:25.092629+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:25.092411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:25.092411+0000","last_clean_scrub_stamp":"2024-09-12T00:39:25.092411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:05.290591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"261'190","reported_seq":1336,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:32.008900+0000","last_change":"2024-09-12T00:39:32.008900+0000","last_active":"2024-09-12T00:39:32.008900+0000","last_peered":"2024-09-12T00:39:32.008900+0000","last_clean":"2024-09-12T00:39:32.008900+0000","last_became_active":"2024-09-12T00:02:07.169812+0000","last_became_peered":"2024-09-12T00:02:07.169812+0000","last_unstale":"2024-09-12T00:39:32.008900+0000","last_undegraded":"2024-09-12T00:39:32.008900+0000","last_fullsized":"2024-09-12T00:39:32.008900+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'190","last_scrub_stamp":"2024-09-12T00:39:32.008804+0000","last_deep_scrub":"261'190","last_deep_scrub_stamp":"2024-09-12T00:39:32.008804+0000","last_clean_scrub_stamp":"2024-09-12T00:39:32.008804+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:13.569005+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1006,"num_read_kb":951,"num_write":452,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"261'117","reported_seq":673,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.094187+0000","last_change":"2024-09-12T00:38:54.094187+0000","last_active":"2024-09-12T00:38:54.094187+0000","last_peered":"2024-09-12T00:38:54.094187+0000","last_clean":"2024-09-12T00:38:54.094187+0000","last_became_active":"2024-09-12T00:01:59.148253+0000","last_became_peered":"2024-09-12T00:01:59.148253+0000","last_unstale":"2024-09-12T00:38:54.094187+0000","last_undegraded":"2024-09-12T00:38:54.094187+0000","last_fullsized":"2024-09-12T00:38:54.094187+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'117","last_scrub_stamp":"2024-09-12T00:38:54.094084+0000","last_deep_scrub":"261'117","last_deep_scrub_stamp":"2024-09-12T00:38:54.094084+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.094084+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:55.052129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":493,"num_read_kb":405,"num_write":165,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"261'378","reported_seq":1049,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.791354+0000","last_change":"2024-09-12T00:38:49.791277+0000","last_active":"2024-09-12T00:38:49.791354+0000","last_peered":"2024-09-12T00:38:49.791354+0000","last_clean":"2024-09-12T00:38:49.791354+0000","last_became_active":"2024-09-12T00:01:57.138386+0000","last_became_peered":"2024-09-12T00:01:57.138386+0000","last_unstale":"2024-09-12T00:38:49.791354+0000","last_undegraded":"2024-09-12T00:38:49.791354+0000","last_fullsized":"2024-09-12T00:38:49.791354+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T00:38:49.791164+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T00:38:49.791164+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.791164+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:45.569391+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":660,"num_read_kb":37451,"num_write":1183,"num_write_kb":32715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"261'2","reported_seq":499,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:05.659936+0000","last_change":"2024-09-12T00:39:05.659936+0000","last_active":"2024-09-12T00:39:05.659936+0000","last_peered":"2024-09-12T00:39:05.659936+0000","last_clean":"2024-09-12T00:39:05.659936+0000","last_became_active":"2024-09-12T00:02:01.153306+0000","last_became_peered":"2024-09-12T00:02:01.153306+0000","last_unstale":"2024-09-12T00:39:05.659936+0000","last_undegraded":"2024-09-12T00:39:05.659936+0000","last_fullsized":"2024-09-12T00:39:05.659936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-12T00:39:05.659851+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-12T00:39:05.659851+0000","last_clean_scrub_stamp":"2024-09-12T00:39:05.659851+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:10.733284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"261'291","reported_seq":880,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.170663+0000","last_change":"2024-09-12T00:39:17.170584+0000","last_active":"2024-09-12T00:39:17.170663+0000","last_peered":"2024-09-12T00:39:17.170663+0000","last_clean":"2024-09-12T00:39:17.170663+0000","last_became_active":"2024-09-12T00:02:03.158379+0000","last_became_peered":"2024-09-12T00:02:03.158379+0000","last_unstale":"2024-09-12T00:39:17.170663+0000","last_undegraded":"2024-09-12T00:39:17.170663+0000","last_fullsized":"2024-09-12T00:39:17.170663+0000","mapping_epoch":30,"log_start":"261'200","ondisk_log_start":"261'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'291","last_scrub_stamp":"2024-09-12T00:39:17.170478+0000","last_deep_scrub":"261'291","last_deep_scrub_stamp":"2024-09-12T00:39:17.170478+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.170478+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:51.871807+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53226,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":480,"num_read_kb":1058,"num_write":380,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:17.681981+0000","last_change":"2024-09-12T00:39:17.681924+0000","last_active":"2024-09-12T00:39:17.681981+0000","last_peered":"2024-09-12T00:39:17.681981+0000","last_clean":"2024-09-12T00:39:17.681981+0000","last_became_active":"2024-09-12T00:02:05.159854+0000","last_became_peered":"2024-09-12T00:02:05.159854+0000","last_unstale":"2024-09-12T00:39:17.681981+0000","last_undegraded":"2024-09-12T00:39:17.681981+0000","last_fullsized":"2024-09-12T00:39:17.681981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:17.681837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:17.681837+0000","last_clean_scrub_stamp":"2024-09-12T00:39:17.681837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:12.161647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"261'135","reported_seq":634,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:08.239563+0000","last_change":"2024-09-12T00:39:08.239477+0000","last_active":"2024-09-12T00:39:08.239563+0000","last_peered":"2024-09-12T00:39:08.239563+0000","last_clean":"2024-09-12T00:39:08.239563+0000","last_became_active":"2024-09-12T00:02:07.170727+0000","last_became_peered":"2024-09-12T00:02:07.170727+0000","last_unstale":"2024-09-12T00:39:08.239563+0000","last_undegraded":"2024-09-12T00:39:08.239563+0000","last_fullsized":"2024-09-12T00:39:08.239563+0000","mapping_epoch":34,"log_start":"261'100","ondisk_log_start":"261'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'135","last_scrub_stamp":"2024-09-12T00:39:08.239382+0000","last_deep_scrub":"261'135","last_deep_scrub_stamp":"2024-09-12T00:39:08.239382+0000","last_clean_scrub_stamp":"2024-09-12T00:39:08.239382+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:08.116527+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":145,"num_read_kb":129,"num_write":315,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"261'247","reported_seq":916,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.507541+0000","last_change":"2024-09-12T00:38:54.507541+0000","last_active":"2024-09-12T00:38:54.507541+0000","last_peered":"2024-09-12T00:38:54.507541+0000","last_clean":"2024-09-12T00:38:54.507541+0000","last_became_active":"2024-09-12T00:01:59.145502+0000","last_became_peered":"2024-09-12T00:01:59.145502+0000","last_unstale":"2024-09-12T00:38:54.507541+0000","last_undegraded":"2024-09-12T00:38:54.507541+0000","last_fullsized":"2024-09-12T00:38:54.507541+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'247","last_scrub_stamp":"2024-09-12T00:38:54.507456+0000","last_deep_scrub":"261'247","last_deep_scrub_stamp":"2024-09-12T00:38:54.507456+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.507456+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:42:33.111923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1128,"num_read_kb":927,"num_write":363,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"261'365","reported_seq":1026,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.026480+0000","last_change":"2024-09-12T00:38:46.026415+0000","last_active":"2024-09-12T00:38:46.026480+0000","last_peered":"2024-09-12T00:38:46.026480+0000","last_clean":"2024-09-12T00:38:46.026480+0000","last_became_active":"2024-09-12T00:01:57.159487+0000","last_became_peered":"2024-09-12T00:01:57.159487+0000","last_unstale":"2024-09-12T00:38:46.026480+0000","last_undegraded":"2024-09-12T00:38:46.026480+0000","last_fullsized":"2024-09-12T00:38:46.026480+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'365","last_scrub_stamp":"2024-09-12T00:38:46.026277+0000","last_deep_scrub":"261'365","last_deep_scrub_stamp":"2024-09-12T00:38:46.026277+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.026277+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:55.022589+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":54883,"num_write":1141,"num_write_kb":38301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"261'151","reported_seq":706,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.830942+0000","last_change":"2024-09-12T00:38:52.830942+0000","last_active":"2024-09-12T00:38:52.830942+0000","last_peered":"2024-09-12T00:38:52.830942+0000","last_clean":"2024-09-12T00:38:52.830942+0000","last_became_active":"2024-09-12T00:01:59.153340+0000","last_became_peered":"2024-09-12T00:01:59.153340+0000","last_unstale":"2024-09-12T00:38:52.830942+0000","last_undegraded":"2024-09-12T00:38:52.830942+0000","last_fullsized":"2024-09-12T00:38:52.830942+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'151","last_scrub_stamp":"2024-09-12T00:38:52.830858+0000","last_deep_scrub":"261'151","last_deep_scrub_stamp":"2024-09-12T00:38:52.830858+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.830858+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:38.477609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":667,"num_read_kb":542,"num_write":243,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"261'317","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.771239+0000","last_change":"2024-09-12T00:38:46.771139+0000","last_active":"2024-09-12T00:38:46.771239+0000","last_peered":"2024-09-12T00:38:46.771239+0000","last_clean":"2024-09-12T00:38:46.771239+0000","last_became_active":"2024-09-12T00:01:57.152522+0000","last_became_peered":"2024-09-12T00:01:57.152522+0000","last_unstale":"2024-09-12T00:38:46.771239+0000","last_undegraded":"2024-09-12T00:38:46.771239+0000","last_fullsized":"2024-09-12T00:38:46.771239+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'317","last_scrub_stamp":"2024-09-12T00:38:46.770967+0000","last_deep_scrub":"261'317","last_deep_scrub_stamp":"2024-09-12T00:38:46.770967+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.770967+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:00.575296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":990709,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":567,"num_read_kb":16299,"num_write":1038,"num_write_kb":36902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"261'218","reported_seq":851,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:18.208392+0000","last_change":"2024-09-12T00:39:18.208392+0000","last_active":"2024-09-12T00:39:18.208392+0000","last_peered":"2024-09-12T00:39:18.208392+0000","last_clean":"2024-09-12T00:39:18.208392+0000","last_became_active":"2024-09-12T00:01:59.145971+0000","last_became_peered":"2024-09-12T00:01:59.145971+0000","last_unstale":"2024-09-12T00:39:18.208392+0000","last_undegraded":"2024-09-12T00:39:18.208392+0000","last_fullsized":"2024-09-12T00:39:18.208392+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'218","last_scrub_stamp":"2024-09-12T00:39:18.208265+0000","last_deep_scrub":"261'218","last_deep_scrub_stamp":"2024-09-12T00:39:18.208265+0000","last_clean_scrub_stamp":"2024-09-12T00:39:18.208265+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:34.095704+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":962,"num_read_kb":786,"num_write":321,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8590,"num_omap_keys":34,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"261'356","reported_seq":975,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.269641+0000","last_change":"2024-09-12T00:38:54.269575+0000","last_active":"2024-09-12T00:38:54.269641+0000","last_peered":"2024-09-12T00:38:54.269641+0000","last_clean":"2024-09-12T00:38:54.269641+0000","last_became_active":"2024-09-12T00:01:57.167651+0000","last_became_peered":"2024-09-12T00:01:57.167651+0000","last_unstale":"2024-09-12T00:38:54.269641+0000","last_undegraded":"2024-09-12T00:38:54.269641+0000","last_fullsized":"2024-09-12T00:38:54.269641+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'356","last_scrub_stamp":"2024-09-12T00:38:54.269448+0000","last_deep_scrub":"261'356","last_deep_scrub_stamp":"2024-09-12T00:38:54.269448+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.269448+0000","objects_scrubbed":6,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:35.410380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":490,"num_read_kb":6602,"num_write":1155,"num_write_kb":24145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"261'167","reported_seq":758,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:02.843569+0000","last_change":"2024-09-12T00:39:02.843569+0000","last_active":"2024-09-12T00:39:02.843569+0000","last_peered":"2024-09-12T00:39:02.843569+0000","last_clean":"2024-09-12T00:39:02.843569+0000","last_became_active":"2024-09-12T00:01:59.146794+0000","last_became_peered":"2024-09-12T00:01:59.146794+0000","last_unstale":"2024-09-12T00:39:02.843569+0000","last_undegraded":"2024-09-12T00:39:02.843569+0000","last_fullsized":"2024-09-12T00:39:02.843569+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'167","last_scrub_stamp":"2024-09-12T00:39:02.843486+0000","last_deep_scrub":"261'167","last_deep_scrub_stamp":"2024-09-12T00:39:02.843486+0000","last_clean_scrub_stamp":"2024-09-12T00:39:02.843486+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:31.785008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":716,"num_read_kb":586,"num_write":261,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"261'291","reported_seq":906,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.812779+0000","last_change":"2024-09-12T00:38:50.812669+0000","last_active":"2024-09-12T00:38:50.812779+0000","last_peered":"2024-09-12T00:38:50.812779+0000","last_clean":"2024-09-12T00:38:50.812779+0000","last_became_active":"2024-09-12T00:01:57.145410+0000","last_became_peered":"2024-09-12T00:01:57.145410+0000","last_unstale":"2024-09-12T00:38:50.812779+0000","last_undegraded":"2024-09-12T00:38:50.812779+0000","last_fullsized":"2024-09-12T00:38:50.812779+0000","mapping_epoch":24,"log_start":"261'200","ondisk_log_start":"261'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'291","last_scrub_stamp":"2024-09-12T00:38:50.812479+0000","last_deep_scrub":"261'291","last_deep_scrub_stamp":"2024-09-12T00:38:50.812479+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.812479+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:54.529596+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":406,"num_read_kb":533,"num_write":954,"num_write_kb":14360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"261'571","reported_seq":1342,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:00.831940+0000","last_change":"2024-09-12T00:39:00.831886+0000","last_active":"2024-09-12T00:39:00.831940+0000","last_peered":"2024-09-12T00:39:00.831940+0000","last_clean":"2024-09-12T00:39:00.831940+0000","last_became_active":"2024-09-12T00:01:59.148605+0000","last_became_peered":"2024-09-12T00:01:59.148605+0000","last_unstale":"2024-09-12T00:39:00.831940+0000","last_undegraded":"2024-09-12T00:39:00.831940+0000","last_fullsized":"2024-09-12T00:39:00.831940+0000","mapping_epoch":26,"log_start":"261'500","ondisk_log_start":"261'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'571","last_scrub_stamp":"2024-09-12T00:39:00.831790+0000","last_deep_scrub":"261'571","last_deep_scrub_stamp":"2024-09-12T00:39:00.831790+0000","last_clean_scrub_stamp":"2024-09-12T00:39:00.831790+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:07.829005+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2664,"num_read_kb":2197,"num_write":993,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"261'328","reported_seq":979,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.076699+0000","last_change":"2024-09-12T00:38:47.076584+0000","last_active":"2024-09-12T00:38:47.076699+0000","last_peered":"2024-09-12T00:38:47.076699+0000","last_clean":"2024-09-12T00:38:47.076699+0000","last_became_active":"2024-09-12T00:02:32.864862+0000","last_became_peered":"2024-09-12T00:02:32.864862+0000","last_unstale":"2024-09-12T00:38:47.076699+0000","last_undegraded":"2024-09-12T00:38:47.076699+0000","last_fullsized":"2024-09-12T00:38:47.076699+0000","mapping_epoch":37,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'328","last_scrub_stamp":"2024-09-12T00:38:47.076409+0000","last_deep_scrub":"261'328","last_deep_scrub_stamp":"2024-09-12T00:38:47.076409+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.076409+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:26.756457+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":496,"num_read_kb":62973,"num_write":1092,"num_write_kb":36662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7,3],"acting":[6,0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"261'192","reported_seq":818,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.208840+0000","last_change":"2024-09-12T00:38:54.208785+0000","last_active":"2024-09-12T00:38:54.208840+0000","last_peered":"2024-09-12T00:38:54.208840+0000","last_clean":"2024-09-12T00:38:54.208840+0000","last_became_active":"2024-09-12T00:01:59.141383+0000","last_became_peered":"2024-09-12T00:01:59.141383+0000","last_unstale":"2024-09-12T00:38:54.208840+0000","last_undegraded":"2024-09-12T00:38:54.208840+0000","last_fullsized":"2024-09-12T00:38:54.208840+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'192","last_scrub_stamp":"2024-09-12T00:38:54.208696+0000","last_deep_scrub":"261'192","last_deep_scrub_stamp":"2024-09-12T00:38:54.208696+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.208696+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:40.694440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":873,"num_read_kb":715,"num_write":298,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"261'342","reported_seq":1005,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.046217+0000","last_change":"2024-09-12T00:38:49.046108+0000","last_active":"2024-09-12T00:38:49.046217+0000","last_peered":"2024-09-12T00:38:49.046217+0000","last_clean":"2024-09-12T00:38:49.046217+0000","last_became_active":"2024-09-12T00:01:57.152097+0000","last_became_peered":"2024-09-12T00:01:57.152097+0000","last_unstale":"2024-09-12T00:38:49.046217+0000","last_undegraded":"2024-09-12T00:38:49.046217+0000","last_fullsized":"2024-09-12T00:38:49.046217+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'342","last_scrub_stamp":"2024-09-12T00:38:49.045971+0000","last_deep_scrub":"261'342","last_deep_scrub_stamp":"2024-09-12T00:38:49.045971+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.045971+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:14.819908+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399285,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":523,"num_read_kb":43886,"num_write":1080,"num_write_kb":36840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"261'430","reported_seq":1154,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.913542+0000","last_change":"2024-09-12T00:38:55.913482+0000","last_active":"2024-09-12T00:38:55.913542+0000","last_peered":"2024-09-12T00:38:55.913542+0000","last_clean":"2024-09-12T00:38:55.913542+0000","last_became_active":"2024-09-12T00:01:59.146117+0000","last_became_peered":"2024-09-12T00:01:59.146117+0000","last_unstale":"2024-09-12T00:38:55.913542+0000","last_undegraded":"2024-09-12T00:38:55.913542+0000","last_fullsized":"2024-09-12T00:38:55.913542+0000","mapping_epoch":26,"log_start":"261'400","ondisk_log_start":"261'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'430","last_scrub_stamp":"2024-09-12T00:38:55.913381+0000","last_deep_scrub":"261'430","last_deep_scrub_stamp":"2024-09-12T00:38:55.913381+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.913381+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:25.825297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2179,"num_read_kb":1868,"num_write":729,"num_write_kb":374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"261'382","reported_seq":1081,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.029173+0000","last_change":"2024-09-12T00:38:49.029107+0000","last_active":"2024-09-12T00:38:49.029173+0000","last_peered":"2024-09-12T00:38:49.029173+0000","last_clean":"2024-09-12T00:38:49.029173+0000","last_became_active":"2024-09-12T00:01:57.156002+0000","last_became_peered":"2024-09-12T00:01:57.156002+0000","last_unstale":"2024-09-12T00:38:49.029173+0000","last_undegraded":"2024-09-12T00:38:49.029173+0000","last_fullsized":"2024-09-12T00:38:49.029173+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'382","last_scrub_stamp":"2024-09-12T00:38:49.028963+0000","last_deep_scrub":"261'382","last_deep_scrub_stamp":"2024-09-12T00:38:49.028963+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.028963+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:41.518318+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":675,"num_read_kb":79699,"num_write":1346,"num_write_kb":54312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"261'216","reported_seq":804,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.470725+0000","last_change":"2024-09-12T00:38:47.470623+0000","last_active":"2024-09-12T00:38:47.470725+0000","last_peered":"2024-09-12T00:38:47.470725+0000","last_clean":"2024-09-12T00:38:47.470725+0000","last_became_active":"2024-09-12T00:01:59.155003+0000","last_became_peered":"2024-09-12T00:01:59.155003+0000","last_unstale":"2024-09-12T00:38:47.470725+0000","last_undegraded":"2024-09-12T00:38:47.470725+0000","last_fullsized":"2024-09-12T00:38:47.470725+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'216","last_scrub_stamp":"2024-09-12T00:38:47.470513+0000","last_deep_scrub":"261'216","last_deep_scrub_stamp":"2024-09-12T00:38:47.470513+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.470513+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:16.481869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":893,"num_read_kb":718,"num_write":326,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"261'362","reported_seq":974,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:51.779864+0000","last_change":"2024-09-12T00:38:51.779864+0000","last_active":"2024-09-12T00:38:51.779864+0000","last_peered":"2024-09-12T00:38:51.779864+0000","last_clean":"2024-09-12T00:38:51.779864+0000","last_became_active":"2024-09-12T00:01:57.145466+0000","last_became_peered":"2024-09-12T00:01:57.145466+0000","last_unstale":"2024-09-12T00:38:51.779864+0000","last_undegraded":"2024-09-12T00:38:51.779864+0000","last_fullsized":"2024-09-12T00:38:51.779864+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'362","last_scrub_stamp":"2024-09-12T00:38:51.779755+0000","last_deep_scrub":"261'362","last_deep_scrub_stamp":"2024-09-12T00:38:51.779755+0000","last_clean_scrub_stamp":"2024-09-12T00:38:51.779755+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:46.528330+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262160,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":3535,"num_write":1174,"num_write_kb":24926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"261'109","reported_seq":694,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.899825+0000","last_change":"2024-09-12T00:38:54.899756+0000","last_active":"2024-09-12T00:38:54.899825+0000","last_peered":"2024-09-12T00:38:54.899825+0000","last_clean":"2024-09-12T00:38:54.899825+0000","last_became_active":"2024-09-12T00:01:59.149014+0000","last_became_peered":"2024-09-12T00:01:59.149014+0000","last_unstale":"2024-09-12T00:38:54.899825+0000","last_undegraded":"2024-09-12T00:38:54.899825+0000","last_fullsized":"2024-09-12T00:38:54.899825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'109","last_scrub_stamp":"2024-09-12T00:38:54.899674+0000","last_deep_scrub":"261'109","last_deep_scrub_stamp":"2024-09-12T00:38:54.899674+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.899674+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:24.146722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":492,"num_read_kb":416,"num_write":148,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"261'402","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:56.242136+0000","last_change":"2024-09-12T00:38:56.242136+0000","last_active":"2024-09-12T00:38:56.242136+0000","last_peered":"2024-09-12T00:38:56.242136+0000","last_clean":"2024-09-12T00:38:56.242136+0000","last_became_active":"2024-09-12T00:01:57.150980+0000","last_became_peered":"2024-09-12T00:01:57.150980+0000","last_unstale":"2024-09-12T00:38:56.242136+0000","last_undegraded":"2024-09-12T00:38:56.242136+0000","last_fullsized":"2024-09-12T00:38:56.242136+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'402","last_scrub_stamp":"2024-09-12T00:38:56.241977+0000","last_deep_scrub":"261'402","last_deep_scrub_stamp":"2024-09-12T00:38:56.241977+0000","last_clean_scrub_stamp":"2024-09-12T00:38:56.241977+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:40.615576+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1303915,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":638,"num_read_kb":15523,"num_write":1286,"num_write_kb":17105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"261'109","reported_seq":712,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.238124+0000","last_change":"2024-09-12T00:38:55.238054+0000","last_active":"2024-09-12T00:38:55.238124+0000","last_peered":"2024-09-12T00:38:55.238124+0000","last_clean":"2024-09-12T00:38:55.238124+0000","last_became_active":"2024-09-12T00:01:59.149341+0000","last_became_peered":"2024-09-12T00:01:59.149341+0000","last_unstale":"2024-09-12T00:38:55.238124+0000","last_undegraded":"2024-09-12T00:38:55.238124+0000","last_fullsized":"2024-09-12T00:38:55.238124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'109","last_scrub_stamp":"2024-09-12T00:38:55.237937+0000","last_deep_scrub":"261'109","last_deep_scrub_stamp":"2024-09-12T00:38:55.237937+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.237937+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:39.737518+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":504,"num_read_kb":434,"num_write":171,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"261'343","reported_seq":994,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.738562+0000","last_change":"2024-09-12T00:38:52.738562+0000","last_active":"2024-09-12T00:38:52.738562+0000","last_peered":"2024-09-12T00:38:52.738562+0000","last_clean":"2024-09-12T00:38:52.738562+0000","last_became_active":"2024-09-12T00:02:32.863077+0000","last_became_peered":"2024-09-12T00:02:32.863077+0000","last_unstale":"2024-09-12T00:38:52.738562+0000","last_undegraded":"2024-09-12T00:38:52.738562+0000","last_fullsized":"2024-09-12T00:38:52.738562+0000","mapping_epoch":37,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'343","last_scrub_stamp":"2024-09-12T00:38:52.738425+0000","last_deep_scrub":"261'343","last_deep_scrub_stamp":"2024-09-12T00:38:52.738425+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.738425+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:23.042537+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267332,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":11923,"num_write":1143,"num_write_kb":27282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,7],"acting":[5,6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"261'269","reported_seq":901,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:39:03.807917+0000","last_change":"2024-09-12T00:39:03.807917+0000","last_active":"2024-09-12T00:39:03.807917+0000","last_peered":"2024-09-12T00:39:03.807917+0000","last_clean":"2024-09-12T00:39:03.807917+0000","last_became_active":"2024-09-12T00:01:59.159226+0000","last_became_peered":"2024-09-12T00:01:59.159226+0000","last_unstale":"2024-09-12T00:39:03.807917+0000","last_undegraded":"2024-09-12T00:39:03.807917+0000","last_fullsized":"2024-09-12T00:39:03.807917+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'269","last_scrub_stamp":"2024-09-12T00:39:03.807792+0000","last_deep_scrub":"261'269","last_deep_scrub_stamp":"2024-09-12T00:39:03.807792+0000","last_clean_scrub_stamp":"2024-09-12T00:39:03.807792+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:26.022277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1182,"num_read_kb":958,"num_write":434,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"261'384","reported_seq":1052,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:48.429903+0000","last_change":"2024-09-12T00:38:48.429903+0000","last_active":"2024-09-12T00:38:48.429903+0000","last_peered":"2024-09-12T00:38:48.429903+0000","last_clean":"2024-09-12T00:38:48.429903+0000","last_became_active":"2024-09-12T00:01:57.148038+0000","last_became_peered":"2024-09-12T00:01:57.148038+0000","last_unstale":"2024-09-12T00:38:48.429903+0000","last_undegraded":"2024-09-12T00:38:48.429903+0000","last_fullsized":"2024-09-12T00:38:48.429903+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'384","last_scrub_stamp":"2024-09-12T00:38:48.429770+0000","last_deep_scrub":"261'384","last_deep_scrub_stamp":"2024-09-12T00:38:48.429770+0000","last_clean_scrub_stamp":"2024-09-12T00:38:48.429770+0000","objects_scrubbed":9,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:30.722756+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6690610,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":558,"num_read_kb":81305,"num_write":1164,"num_write_kb":56822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"261'244","reported_seq":823,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.463575+0000","last_change":"2024-09-12T00:38:46.463575+0000","last_active":"2024-09-12T00:38:46.463575+0000","last_peered":"2024-09-12T00:38:46.463575+0000","last_clean":"2024-09-12T00:38:46.463575+0000","last_became_active":"2024-09-12T00:01:59.154258+0000","last_became_peered":"2024-09-12T00:01:59.154258+0000","last_unstale":"2024-09-12T00:38:46.463575+0000","last_undegraded":"2024-09-12T00:38:46.463575+0000","last_fullsized":"2024-09-12T00:38:46.463575+0000","mapping_epoch":26,"log_start":"261'200","ondisk_log_start":"261'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'244","last_scrub_stamp":"2024-09-12T00:38:46.463482+0000","last_deep_scrub":"261'244","last_deep_scrub_stamp":"2024-09-12T00:38:46.463482+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.463482+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:14.252384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":900,"num_write":421,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"261'365","reported_seq":1027,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.560924+0000","last_change":"2024-09-12T00:38:50.560924+0000","last_active":"2024-09-12T00:38:50.560924+0000","last_peered":"2024-09-12T00:38:50.560924+0000","last_clean":"2024-09-12T00:38:50.560924+0000","last_became_active":"2024-09-12T00:01:57.142713+0000","last_became_peered":"2024-09-12T00:01:57.142713+0000","last_unstale":"2024-09-12T00:38:50.560924+0000","last_undegraded":"2024-09-12T00:38:50.560924+0000","last_fullsized":"2024-09-12T00:38:50.560924+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'365","last_scrub_stamp":"2024-09-12T00:38:50.560759+0000","last_deep_scrub":"261'365","last_deep_scrub_stamp":"2024-09-12T00:38:50.560759+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.560759+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:30.948385+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244498,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":515,"num_read_kb":36570,"num_write":1122,"num_write_kb":39253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"261'211","reported_seq":854,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:49.457433+0000","last_change":"2024-09-12T00:38:49.457433+0000","last_active":"2024-09-12T00:38:49.457433+0000","last_peered":"2024-09-12T00:38:49.457433+0000","last_clean":"2024-09-12T00:38:49.457433+0000","last_became_active":"2024-09-12T00:01:59.154931+0000","last_became_peered":"2024-09-12T00:01:59.154931+0000","last_unstale":"2024-09-12T00:38:49.457433+0000","last_undegraded":"2024-09-12T00:38:49.457433+0000","last_fullsized":"2024-09-12T00:38:49.457433+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'211","last_scrub_stamp":"2024-09-12T00:38:49.457304+0000","last_deep_scrub":"261'211","last_deep_scrub_stamp":"2024-09-12T00:38:49.457304+0000","last_clean_scrub_stamp":"2024-09-12T00:38:49.457304+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":100,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:34.654587+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":956,"num_read_kb":786,"num_write":317,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4003,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"261'344","reported_seq":1047,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:46.223372+0000","last_change":"2024-09-12T00:38:46.223372+0000","last_active":"2024-09-12T00:38:46.223372+0000","last_peered":"2024-09-12T00:38:46.223372+0000","last_clean":"2024-09-12T00:38:46.223372+0000","last_became_active":"2024-09-12T00:01:57.142082+0000","last_became_peered":"2024-09-12T00:01:57.142082+0000","last_unstale":"2024-09-12T00:38:46.223372+0000","last_undegraded":"2024-09-12T00:38:46.223372+0000","last_fullsized":"2024-09-12T00:38:46.223372+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'344","last_scrub_stamp":"2024-09-12T00:38:46.223232+0000","last_deep_scrub":"261'344","last_deep_scrub_stamp":"2024-09-12T00:38:46.223232+0000","last_clean_scrub_stamp":"2024-09-12T00:38:46.223232+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:33.212306+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138779,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":609,"num_read_kb":3429,"num_write":1186,"num_write_kb":16203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"261'205","reported_seq":799,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:53.867815+0000","last_change":"2024-09-12T00:38:53.867815+0000","last_active":"2024-09-12T00:38:53.867815+0000","last_peered":"2024-09-12T00:38:53.867815+0000","last_clean":"2024-09-12T00:38:53.867815+0000","last_became_active":"2024-09-12T00:01:59.146272+0000","last_became_peered":"2024-09-12T00:01:59.146272+0000","last_unstale":"2024-09-12T00:38:53.867815+0000","last_undegraded":"2024-09-12T00:38:53.867815+0000","last_fullsized":"2024-09-12T00:38:53.867815+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'205","last_scrub_stamp":"2024-09-12T00:38:53.867730+0000","last_deep_scrub":"261'205","last_deep_scrub_stamp":"2024-09-12T00:38:53.867730+0000","last_clean_scrub_stamp":"2024-09-12T00:38:53.867730+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:40.417582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":905,"num_read_kb":736,"num_write":324,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"261'329","reported_seq":958,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:55.276744+0000","last_change":"2024-09-12T00:38:55.276744+0000","last_active":"2024-09-12T00:38:55.276744+0000","last_peered":"2024-09-12T00:38:55.276744+0000","last_clean":"2024-09-12T00:38:55.276744+0000","last_became_active":"2024-09-12T00:01:57.165139+0000","last_became_peered":"2024-09-12T00:01:57.165139+0000","last_unstale":"2024-09-12T00:38:55.276744+0000","last_undegraded":"2024-09-12T00:38:55.276744+0000","last_fullsized":"2024-09-12T00:38:55.276744+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'329","last_scrub_stamp":"2024-09-12T00:38:55.276619+0000","last_deep_scrub":"261'329","last_deep_scrub_stamp":"2024-09-12T00:38:55.276619+0000","last_clean_scrub_stamp":"2024-09-12T00:38:55.276619+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:46.561228+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174794,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":453,"num_read_kb":34175,"num_write":1090,"num_write_kb":62080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"261'210","reported_seq":842,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.545408+0000","last_change":"2024-09-12T00:38:57.545408+0000","last_active":"2024-09-12T00:38:57.545408+0000","last_peered":"2024-09-12T00:38:57.545408+0000","last_clean":"2024-09-12T00:38:57.545408+0000","last_became_active":"2024-09-12T00:01:59.151627+0000","last_became_peered":"2024-09-12T00:01:59.151627+0000","last_unstale":"2024-09-12T00:38:57.545408+0000","last_undegraded":"2024-09-12T00:38:57.545408+0000","last_fullsized":"2024-09-12T00:38:57.545408+0000","mapping_epoch":26,"log_start":"258'100","ondisk_log_start":"258'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'210","last_scrub_stamp":"2024-09-12T00:38:57.545317+0000","last_deep_scrub":"261'210","last_deep_scrub_stamp":"2024-09-12T00:38:57.545317+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.545317+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:03.981223+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":886,"num_read_kb":742,"num_write":315,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"261'378","reported_seq":1223,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:47.759737+0000","last_change":"2024-09-12T00:38:47.759679+0000","last_active":"2024-09-12T00:38:47.759737+0000","last_peered":"2024-09-12T00:38:47.759737+0000","last_clean":"2024-09-12T00:38:47.759737+0000","last_became_active":"2024-09-12T00:01:57.151346+0000","last_became_peered":"2024-09-12T00:01:57.151346+0000","last_unstale":"2024-09-12T00:38:47.759737+0000","last_undegraded":"2024-09-12T00:38:47.759737+0000","last_fullsized":"2024-09-12T00:38:47.759737+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'378","last_scrub_stamp":"2024-09-12T00:38:47.759548+0000","last_deep_scrub":"261'378","last_deep_scrub_stamp":"2024-09-12T00:38:47.759548+0000","last_clean_scrub_stamp":"2024-09-12T00:38:47.759548+0000","objects_scrubbed":14,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:22.136361+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":228,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":958,"num_read_kb":6741,"num_write":1200,"num_write_kb":13731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"261'4140","reported_seq":4720,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:52.378785+0000","last_change":"2024-09-12T00:38:52.378714+0000","last_active":"2024-09-12T00:38:52.378785+0000","last_peered":"2024-09-12T00:38:52.378785+0000","last_clean":"2024-09-12T00:38:52.378785+0000","last_became_active":"2024-09-12T00:01:59.157873+0000","last_became_peered":"2024-09-12T00:01:59.157873+0000","last_unstale":"2024-09-12T00:38:52.378785+0000","last_undegraded":"2024-09-12T00:38:52.378785+0000","last_fullsized":"2024-09-12T00:38:52.378785+0000","mapping_epoch":26,"log_start":"261'4100","ondisk_log_start":"261'4100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'4140","last_scrub_stamp":"2024-09-12T00:38:52.378628+0000","last_deep_scrub":"261'4140","last_deep_scrub_stamp":"2024-09-12T00:38:52.378628+0000","last_clean_scrub_stamp":"2024-09-12T00:38:52.378628+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":3000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:17.479490+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16645,"num_read_kb":13962,"num_write":6214,"num_write_kb":3111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"261'347","reported_seq":1038,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:57.198324+0000","last_change":"2024-09-12T00:38:57.198261+0000","last_active":"2024-09-12T00:38:57.198324+0000","last_peered":"2024-09-12T00:38:57.198324+0000","last_clean":"2024-09-12T00:38:57.198324+0000","last_became_active":"2024-09-12T00:01:57.165016+0000","last_became_peered":"2024-09-12T00:01:57.165016+0000","last_unstale":"2024-09-12T00:38:57.198324+0000","last_undegraded":"2024-09-12T00:38:57.198324+0000","last_fullsized":"2024-09-12T00:38:57.198324+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'347","last_scrub_stamp":"2024-09-12T00:38:57.198110+0000","last_deep_scrub":"261'347","last_deep_scrub_stamp":"2024-09-12T00:38:57.198110+0000","last_clean_scrub_stamp":"2024-09-12T00:38:57.198110+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:33.940316+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568671,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":600,"num_read_kb":10239,"num_write":1109,"num_write_kb":39602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"261'330","reported_seq":1035,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.167988+0000","last_change":"2024-09-12T00:38:58.167887+0000","last_active":"2024-09-12T00:38:58.167988+0000","last_peered":"2024-09-12T00:38:58.167988+0000","last_clean":"2024-09-12T00:38:58.167988+0000","last_became_active":"2024-09-12T00:01:57.165046+0000","last_became_peered":"2024-09-12T00:01:57.165046+0000","last_unstale":"2024-09-12T00:38:58.167988+0000","last_undegraded":"2024-09-12T00:38:58.167988+0000","last_fullsized":"2024-09-12T00:38:58.167988+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'330","last_scrub_stamp":"2024-09-12T00:38:58.167667+0000","last_deep_scrub":"261'330","last_deep_scrub_stamp":"2024-09-12T00:38:58.167667+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.167667+0000","objects_scrubbed":15,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:49.796703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8464405,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":613,"num_read_kb":41753,"num_write":993,"num_write_kb":31467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"261'110","reported_seq":719,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:58.565416+0000","last_change":"2024-09-12T00:38:58.565416+0000","last_active":"2024-09-12T00:38:58.565416+0000","last_peered":"2024-09-12T00:38:58.565416+0000","last_clean":"2024-09-12T00:38:58.565416+0000","last_became_active":"2024-09-12T00:01:59.153454+0000","last_became_peered":"2024-09-12T00:01:59.153454+0000","last_unstale":"2024-09-12T00:38:58.565416+0000","last_undegraded":"2024-09-12T00:38:58.565416+0000","last_fullsized":"2024-09-12T00:38:58.565416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'110","last_scrub_stamp":"2024-09-12T00:38:58.565298+0000","last_deep_scrub":"261'110","last_deep_scrub_stamp":"2024-09-12T00:38:58.565298+0000","last_clean_scrub_stamp":"2024-09-12T00:38:58.565298+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:43:54.941401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":516,"num_read_kb":439,"num_write":164,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"261'353","reported_seq":1209,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:54.787677+0000","last_change":"2024-09-12T00:38:54.787595+0000","last_active":"2024-09-12T00:38:54.787677+0000","last_peered":"2024-09-12T00:38:54.787677+0000","last_clean":"2024-09-12T00:38:54.787677+0000","last_became_active":"2024-09-12T00:01:57.146320+0000","last_became_peered":"2024-09-12T00:01:57.146320+0000","last_unstale":"2024-09-12T00:38:54.787677+0000","last_undegraded":"2024-09-12T00:38:54.787677+0000","last_fullsized":"2024-09-12T00:38:54.787677+0000","mapping_epoch":24,"log_start":"261'300","ondisk_log_start":"261'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'353","last_scrub_stamp":"2024-09-12T00:38:54.787503+0000","last_deep_scrub":"261'353","last_deep_scrub_stamp":"2024-09-12T00:38:54.787503+0000","last_clean_scrub_stamp":"2024-09-12T00:38:54.787503+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:52.554107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":988,"num_read_kb":6700,"num_write":1181,"num_write_kb":43058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"261'174","reported_seq":777,"reported_epoch":261,"state":"active+clean","last_fresh":"2024-09-12T00:38:50.462924+0000","last_change":"2024-09-12T00:38:50.462924+0000","last_active":"2024-09-12T00:38:50.462924+0000","last_peered":"2024-09-12T00:38:50.462924+0000","last_clean":"2024-09-12T00:38:50.462924+0000","last_became_active":"2024-09-12T00:01:59.146876+0000","last_became_peered":"2024-09-12T00:01:59.146876+0000","last_unstale":"2024-09-12T00:38:50.462924+0000","last_undegraded":"2024-09-12T00:38:50.462924+0000","last_fullsized":"2024-09-12T00:38:50.462924+0000","mapping_epoch":26,"log_start":"261'100","ondisk_log_start":"261'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'174","last_scrub_stamp":"2024-09-12T00:38:50.462833+0000","last_deep_scrub":"261'174","last_deep_scrub_stamp":"2024-09-12T00:38:50.462833+0000","last_clean_scrub_stamp":"2024-09-12T00:38:50.462833+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:16.424671+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":808,"num_read_kb":667,"num_write":271,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5901,"num_read_kb":4223,"num_write":1957,"num_write_kb":855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2340,"num_omap_keys":5,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1030,"ondisk_log_size":1030,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15395,"num_objects":89,"num_object_clones":0,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":0,"num_read":14998,"num_read_kb":14670,"num_write":16815,"num_write_kb":4907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2683,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1553,"ondisk_log_size":1553,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":583,"ondisk_log_size":583,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1554453,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17205,"num_read_kb":36338,"num_write":14367,"num_write_kb":11412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":680986,"num_omap_keys":1552,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2157,"ondisk_log_size":2157,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102638,"num_read_kb":85737,"num_write":37205,"num_write_kb":18751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43802,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3987,"ondisk_log_size":3987,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":86840172,"num_objects":366,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":366,"num_whiteouts":0,"num_read":36012,"num_read_kb":1881303,"num_write":71771,"num_write_kb":2075118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":118292480,"data_stored":118292480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3738,"ondisk_log_size":3738,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":208372,"num_write":160,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":193338,"num_write":160,"num_write_kb":134962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509905,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":223704,"kb_used_data":12104,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":94148136,"statfs":{"total":96636764160,"available":96407691264,"internally_reserved":0,"allocated":12394496,"data_stored":10437918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":216660426},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509904,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121100,"kb_used_data":17788,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94250740,"statfs":{"total":96636764160,"available":96512757760,"internally_reserved":0,"allocated":18214912,"data_stored":16235382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":105773510},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509906,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":256424,"kb_used_data":12824,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94115416,"statfs":{"total":96636764160,"available":96374185984,"internally_reserved":0,"allocated":13131776,"data_stored":11163018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":249428421},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509904,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239340,"kb_used_data":19356,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94132500,"statfs":{"total":96636764160,"available":96391680000,"internally_reserved":0,"allocated":19820544,"data_stored":17855512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":225245639},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509906,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143280,"kb_used_data":26016,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94228560,"statfs":{"total":96636764160,"available":96490045440,"internally_reserved":0,"allocated":26640384,"data_stored":24664481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509905,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136728,"kb_used_data":19528,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94235112,"statfs":{"total":96636764160,"available":96496754688,"internally_reserved":0,"allocated":19996672,"data_stored":18028066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575311,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":237916,"kb_used_data":26316,"kb_used_omap":1,"kb_used_meta":211582,"kb_avail":94133924,"statfs":{"total":96636764160,"available":96393138176,"internally_reserved":0,"allocated":26947584,"data_stored":25004229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216660421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575313,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":343556,"kb_used_data":15284,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94028284,"statfs":{"total":96636764160,"available":96284962816,"internally_reserved":0,"allocated":15650816,"data_stored":13693364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":15826944,"data_stored":15826944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10903552,"data_stored":10903552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22462464,"data_stored":22462464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15654912,"data_stored":15654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22802432,"data_stored":22802432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8372224,"data_stored":8372224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14032896,"data_stored":14032896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8237056,"data_stored":8237056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":5820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:40:06.880 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T00:40:07.221 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T00:40:07.221 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T00:40:07.221 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T00:40:07.221 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:40:07.267 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T00:40:07.267 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T00:40:07.267 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:40:07.314 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T00:40:07.314 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T00:40:07.314 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:40:07.358 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T00:40:07.358 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T00:40:07.359 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:40:07.402 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T00:40:07.402 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T00:40:07.403 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:40:07.452 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T00:40:07.452 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T00:40:07.452 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:40:07.505 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T00:40:07.505 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T00:40:07.506 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:40:07.553 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T00:40:07.554 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T00:40:07.554 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:40:07.601 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T00:40:07.601 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T00:40:07.601 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T00:40:07.601 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:40:07.629 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T00:40:07.630 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T00:40:07.630 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:40:07.656 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T00:40:07.656 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T00:40:07.656 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T00:40:07.657 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:40:07.685 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T00:40:07.685 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T00:40:07.685 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:40:07.737 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T00:40:07.737 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T00:40:07.738 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:40:07.749 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T00:40:07.750 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T00:40:07.750 DEBUG:teuthology.orchestra.run.smithi067:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T00:40:07.820 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T00:40:07.821 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T00:40:08.120 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T00:40:08.120 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T00:40:08.224 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T00:40:08.225 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T00:40:08.309 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T00:40:08.310 DEBUG:teuthology.orchestra.run.smithi067:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T00:40:08.397 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T00:40:08.397 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T00:40:08.588 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T00:40:08.588 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T00:40:08.676 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T00:40:08.677 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T00:40:08.749 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T00:40:08.749 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T00:40:08.838 INFO:tasks.ceph:Archiving mon data... 2024-09-12T00:40:08.839 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901823/data/mon.a.tgz 2024-09-12T00:40:08.839 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-09-12T00:40:08.871 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.uPYsHlT5t9 2024-09-12T00:40:08.871 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.uPYsHlT5t9 2024-09-12T00:40:09.082 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.uPYsHlT5t9 2024-09-12T00:40:09.196 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.uPYsHlT5t9 is 518KB 2024-09-12T00:40:09.292 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.uPYsHlT5t9 2024-09-12T00:40:09.321 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901823/data/mon.c.tgz 2024-09-12T00:40:09.321 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2024-09-12T00:40:09.391 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.Bb0qmv941U 2024-09-12T00:40:09.391 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Bb0qmv941U 2024-09-12T00:40:09.598 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.Bb0qmv941U 2024-09-12T00:40:09.711 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.Bb0qmv941U is 541KB 2024-09-12T00:40:09.795 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.Bb0qmv941U 2024-09-12T00:40:09.825 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901823/data/mon.b.tgz 2024-09-12T00:40:09.825 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2024-09-12T00:40:09.860 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.OmtYZ1ROGD 2024-09-12T00:40:09.860 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.OmtYZ1ROGD 2024-09-12T00:40:10.090 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.OmtYZ1ROGD 2024-09-12T00:40:10.201 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.OmtYZ1ROGD is 541KB 2024-09-12T00:40:10.284 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.OmtYZ1ROGD 2024-09-12T00:40:10.313 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T00:40:10.313 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T00:40:10.315 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T00:40:10.427 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T00:40:10.461 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T00:40:10.461 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T00:40:10.463 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901823/remote/smithi067/crash 2024-09-12T00:40:10.464 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T00:40:10.508 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901823/remote/smithi170/crash 2024-09-12T00:40:10.509 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T00:40:10.548 INFO:tasks.ceph:Compressing logs... 2024-09-12T00:40:10.548 DEBUG:teuthology.orchestra.run.smithi067:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:40:10.553 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:40:10.658 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32781.log 2024-09-12T00:40:10.658 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32924.log 2024-09-12T00:40:10.659 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.32781.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T00:40:10.659 INFO:teuthology.orchestra.run.smithi170.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32781.log.gz 2024-09-12T00:40:10.659 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.32924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32693.log 2024-09-12T00:40:10.659 INFO:teuthology.orchestra.run.smithi170.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32924.log.gz 2024-09-12T00:40:10.659 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T00:40:10.659 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.32693.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T00:40:10.660 INFO:teuthology.orchestra.run.smithi170.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32693.log.gz 2024-09-12T00:40:10.660 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32605.log 2024-09-12T00:40:10.660 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32869.log 2024-09-12T00:40:10.660 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.32605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32605.log.gz 2024-09-12T00:40:10.660 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T00:40:10.660 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32649.log 2024-09-12T00:40:10.661 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.32869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32869.log.gz 2024-09-12T00:40:10.661 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T00:40:10.661 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.32649.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T00:40:10.661 INFO:teuthology.orchestra.run.smithi170.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32649.log.gz 2024-09-12T00:40:10.661 INFO:teuthology.orchestra.run.smithi170.stderr: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T00:40:10.661 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T00:40:10.661 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T00:40:10.661 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32737.log 2024-09-12T00:40:10.661 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32825.log 2024-09-12T00:40:10.662 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.32737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32737.log.gz 2024-09-12T00:40:10.662 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.32825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32825.log.gz 2024-09-12T00:40:10.662 INFO:teuthology.orchestra.run.smithi170.stderr: 87.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T00:40:10.662 INFO:teuthology.orchestra.run.smithi170.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T00:40:10.739 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T00:40:10.739 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56295.log 2024-09-12T00:40:10.740 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175519.log 2024-09-12T00:40:10.740 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81069.log 2024-09-12T00:40:10.740 INFO:teuthology.orchestra.run.smithi067.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.56295.log.gz 2024-09-12T00:40:10.740 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.175519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86959.log 2024-09-12T00:40:10.740 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69198.log 2024-09-12T00:40:10.740 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81069.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.175519.log.gz 2024-09-12T00:40:10.740 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72782.log 2024-09-12T00:40:10.740 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81069.log.gz 2024-09-12T00:40:10.740 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.69198.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.86959.log.gz 2024-09-12T00:40:10.740 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129959.log 2024-09-12T00:40:10.740 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.72782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73371.log 2024-09-12T00:40:10.740 INFO:teuthology.orchestra.run.smithi067.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.72782.log.gz 2024-09-12T00:40:10.740 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.129959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40083.log 2024-09-12T00:40:10.741 INFO:teuthology.orchestra.run.smithi067.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.129959.log.gz 2024-09-12T00:40:10.741 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.73371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79891.log 2024-09-12T00:40:10.741 INFO:teuthology.orchestra.run.smithi067.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.73371.log.gz 2024-09-12T00:40:10.741 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40083.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.69198.log.gz 2024-09-12T00:40:10.741 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40083.log.gz 2024-09-12T00:40:10.741 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135851.log 2024-09-12T00:40:10.741 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148809.log 2024-09-12T00:40:10.741 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.79891.log: /var/log/ceph/ceph-client.admin.135851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39414.log 2024-09-12T00:40:10.741 INFO:teuthology.orchestra.run.smithi067.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.79891.log.gz 2024-09-12T00:40:10.741 INFO:teuthology.orchestra.run.smithi067.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.135851.log.gz 2024-09-12T00:40:10.741 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39832.log 2024-09-12T00:40:10.741 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.148809.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.148809.log.gz 2024-09-12T00:40:10.741 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190777.log 2024-09-12T00:40:10.742 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39414.log.gz 2024-09-12T00:40:10.742 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39832.log.gz 2024-09-12T00:40:10.742 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77878.log 2024-09-12T00:40:10.742 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38703.log 2024-09-12T00:40:10.742 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190777.log.gz 2024-09-12T00:40:10.742 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.77878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144097.log 2024-09-12T00:40:10.742 INFO:teuthology.orchestra.run.smithi067.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.77878.log.gz 2024-09-12T00:40:10.742 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169629.log 2024-09-12T00:40:10.742 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38703.log.gz 2024-09-12T00:40:10.742 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.144097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94028.log 2024-09-12T00:40:10.742 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.169629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156470.log 2024-09-12T00:40:10.742 INFO:teuthology.orchestra.run.smithi067.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.144097.log.gz 2024-09-12T00:40:10.742 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.94028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63651.log 2024-09-12T00:40:10.742 INFO:teuthology.orchestra.run.smithi067.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.94028.log.gz 2024-09-12T00:40:10.743 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.156470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99918.log 2024-09-12T00:40:10.743 INFO:teuthology.orchestra.run.smithi067.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.156470.log.gz 2024-09-12T00:40:10.743 INFO:teuthology.orchestra.run.smithi067.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.169629.log.gz 2024-09-12T00:40:10.743 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.63651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174033.log 2024-09-12T00:40:10.743 INFO:teuthology.orchestra.run.smithi067.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.63651.log.gz 2024-09-12T00:40:10.743 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.99918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177987.log 2024-09-12T00:40:10.743 INFO:teuthology.orchestra.run.smithi067.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.99918.log.gz 2024-09-12T00:40:10.743 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.174033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43974.log 2024-09-12T00:40:10.743 INFO:teuthology.orchestra.run.smithi067.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.174033.log.gz 2024-09-12T00:40:10.743 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.177987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134082.log 2024-09-12T00:40:10.743 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.43974.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.177987.log.gz 2024-09-12T00:40:10.743 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152345.log 2024-09-12T00:40:10.743 INFO:teuthology.orchestra.run.smithi067.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.43974.log.gz 2024-09-12T00:40:10.743 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.134082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187642.log 2024-09-12T00:40:10.743 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.152345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105808.log 2024-09-12T00:40:10.744 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.187642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187642.log.gz 2024-09-12T00:40:10.744 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146453.log 2024-09-12T00:40:10.744 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155291.log 2024-09-12T00:40:10.744 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.105808.log: /var/log/ceph/ceph-client.admin.146453.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.105808.log.gz 2024-09-12T00:40:10.744 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38619.log 2024-09-12T00:40:10.744 INFO:teuthology.orchestra.run.smithi067.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.134082.log.gz 2024-09-12T00:40:10.744 INFO:teuthology.orchestra.run.smithi067.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.152345.log.gz 2024-09-12T00:40:10.744 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.155291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161794.log 2024-09-12T00:40:10.744 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38619.log: 82.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.155291.log.gz -5 2024-09-12T00:40:10.744 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39717.log 2024-09-12T00:40:10.744 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38619.log.gz 2024-09-12T00:40:10.744 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.161794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40037.log 2024-09-12T00:40:10.744 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.161794.log.gz 2024-09-12T00:40:10.745 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39717.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.146453.log.gz 2024-09-12T00:40:10.745 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39717.log.gz 2024-09-12T00:40:10.745 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125247.log 2024-09-12T00:40:10.745 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38555.log 2024-09-12T00:40:10.745 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40037.log.gz 2024-09-12T00:40:10.745 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.125247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71056.log 2024-09-12T00:40:10.745 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.125247.log.gz 2024-09-12T00:40:10.745 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158237.log 2024-09-12T00:40:10.745 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38555.log.gz 2024-09-12T00:40:10.745 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.71056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101685.log 2024-09-12T00:40:10.745 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.158237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190500.log 2024-09-12T00:40:10.745 INFO:teuthology.orchestra.run.smithi067.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.158237.log.gz 2024-09-12T00:40:10.745 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.101685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39044.log 2024-09-12T00:40:10.745 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.101685.log.gz 2024-09-12T00:40:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190500.log.gz 2024-09-12T00:40:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149987.log 2024-09-12T00:40:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50357.log 2024-09-12T00:40:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39044.log.gz 2024-09-12T00:40:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.149987.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T00:40:10.746 INFO:teuthology.orchestra.run.smithi067.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.149987.log.gz 2024-09-12T00:40:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160006.log 2024-09-12T00:40:10.746 INFO:teuthology.orchestra.run.smithi067.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.50357.log.gz 2024-09-12T00:40:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149398.log 2024-09-12T00:40:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T00:40:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.160006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160006.log.gz 2024-09-12T00:40:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.149398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141152.log 2024-09-12T00:40:10.746 INFO:teuthology.orchestra.run.smithi067.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.149398.log.gz 2024-09-12T00:40:10.746 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51535.log 2024-09-12T00:40:10.746 INFO:teuthology.orchestra.run.smithi067.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.71056.log.gz 2024-09-12T00:40:10.747 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70437.log 2024-09-12T00:40:10.747 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.141152.log: /var/log/ceph/ceph-client.admin.51535.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26673.log 2024-09-12T00:40:10.747 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.141152.log.gz 2024-09-12T00:40:10.747 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51535.log.gz 2024-09-12T00:40:10.747 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.70437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190408.log 2024-09-12T00:40:10.747 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.tmp-client.admin.26673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191283.log 2024-09-12T00:40:10.747 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26673.log.gz 2024-09-12T00:40:10.747 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179205.log 2024-09-12T00:40:10.747 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190408.log.gz 2024-09-12T00:40:10.747 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98151.log 2024-09-12T00:40:10.747 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191283.log.gz 2024-09-12T00:40:10.747 INFO:teuthology.orchestra.run.smithi067.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70437.log.gz 2024-09-12T00:40:10.747 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.179205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176158.log 2024-09-12T00:40:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39053.log 2024-09-12T00:40:10.748 INFO:teuthology.orchestra.run.smithi067.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.179205.log.gz 2024-09-12T00:40:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.98151.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.98151.log.gz 2024-09-12T00:40:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.176158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47953.log 2024-09-12T00:40:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64859.log 2024-09-12T00:40:10.748 INFO:teuthology.orchestra.run.smithi067.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.176158.log.gz 2024-09-12T00:40:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39053.log.gz 2024-09-12T00:40:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136440.log 2024-09-12T00:40:10.748 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.47953.log.gz 2024-09-12T00:40:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117001.log 2024-09-12T00:40:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.64859.log: /var/log/ceph/ceph-client.admin.136440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162996.log 2024-09-12T00:40:10.748 INFO:teuthology.orchestra.run.smithi067.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.136440.log.gz 2024-09-12T00:40:10.748 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151754.log 2024-09-12T00:40:10.748 INFO:teuthology.orchestra.run.smithi067.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.64859.log.gz 2024-09-12T00:40:10.749 INFO:teuthology.orchestra.run.smithi067.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.117001.log.gz 2024-09-12T00:40:10.749 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.162996.log: /var/log/ceph/ceph-client.admin.107575.log 2024-09-12T00:40:10.749 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162996.log.gz 2024-09-12T00:40:10.749 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141741.log 2024-09-12T00:40:10.749 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.151754.log: /var/log/ceph/ceph-client.admin.107575.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.151754.log.gz 2024-09-12T00:40:10.749 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173425.log 2024-09-12T00:40:10.749 INFO:teuthology.orchestra.run.smithi067.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.107575.log.gz 2024-09-12T00:40:10.749 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.141741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191053.log 2024-09-12T00:40:10.749 INFO:teuthology.orchestra.run.smithi067.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.141741.log.gz 2024-09-12T00:40:10.749 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.173425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43371.log 2024-09-12T00:40:10.749 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67957.log 2024-09-12T00:40:10.749 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191053.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.173425.log.gz 2024-09-12T00:40:10.749 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191053.log.gz 2024-09-12T00:40:10.749 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.43371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39991.log 2024-09-12T00:40:10.750 INFO:teuthology.orchestra.run.smithi067.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.43371.log.gz 2024-09-12T00:40:10.750 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122302.log 2024-09-12T00:40:10.750 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.67957.log: /var/log/ceph/ceph-client.admin.39991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106397.log 2024-09-12T00:40:10.750 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39991.log.gz 2024-09-12T00:40:10.750 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.122302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41550.log 2024-09-12T00:40:10.750 INFO:teuthology.orchestra.run.smithi067.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.122302.log.gz 2024-09-12T00:40:10.750 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.106397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49179.log 2024-09-12T00:40:10.750 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.106397.log.gz 2024-09-12T00:40:10.750 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.41550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123480.log 2024-09-12T00:40:10.750 INFO:teuthology.orchestra.run.smithi067.stderr: 89.3% 80.5% -- replaced with /var/log/ceph/ceph-client.0.41550.log.gz -- replaced with /var/log/ceph/ceph-client.admin.67957.log.gz 2024-09-12T00:40:10.750 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T00:40:10.750 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.49179.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.130548.log 2024-09-12T00:40:10.750 INFO:teuthology.orchestra.run.smithi067.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.49179.log.gz 2024-09-12T00:40:10.750 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.123480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57473.log 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.123480.log.gz 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.130548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118179.log 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.130548.log.gz 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182250.log 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57473.log.gz 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.118179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75735.log 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.182250.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.118179.log.gzgzip 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.85192.log 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.0.182250.log.gz 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190823.log 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr: 25.2% -- replaced with /var/log/ceph/ceph-client.admin.75735.log.gz 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.85192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96973.log 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.85192.log.gz 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178596.log 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190823.log.gz 2024-09-12T00:40:10.751 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.96973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59901.log 2024-09-12T00:40:10.752 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.178596.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.96973.log.gz 2024-09-12T00:40:10.752 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71720.log 2024-09-12T00:40:10.752 INFO:teuthology.orchestra.run.smithi067.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.178596.log.gz 2024-09-12T00:40:10.752 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98740.log 2024-09-12T00:40:10.752 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59901.log.gz 2024-09-12T00:40:10.752 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.71720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57521.log 2024-09-12T00:40:10.752 INFO:teuthology.orchestra.run.smithi067.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.71720.log.gz 2024-09-12T00:40:10.752 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.98740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66100.log 2024-09-12T00:40:10.752 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163020.log 2024-09-12T00:40:10.752 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57521.log: /var/log/ceph/ceph-client.admin.66100.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.57521.log.gz 2024-09-12T00:40:10.752 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38795.log 2024-09-12T00:40:10.752 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.163020.log: gzip -5 --verbose -- 82.0% -- replaced with /var/log/ceph/ceph-client.admin.163020.log.gz 2024-09-12T00:40:10.752 INFO:teuthology.orchestra.run.smithi067.stderr: /var/log/ceph/ceph-client.admin.38749.log 86.1% -- replaced with /var/log/ceph/ceph-client.admin.98740.log.gz 2024-09-12T00:40:10.752 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T00:40:10.753 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38795.log.gz 2024-09-12T00:40:10.753 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87548.log 2024-09-12T00:40:10.753 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174911.log 2024-09-12T00:40:10.753 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38749.log.gz 2024-09-12T00:40:10.753 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.87548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58699.log 2024-09-12T00:40:10.753 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.87548.log.gz 2024-09-12T00:40:10.753 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.174911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62758.log 2024-09-12T00:40:10.753 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.58699.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.95795.log 2024-09-12T00:40:10.753 INFO:teuthology.orchestra.run.smithi067.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.58699.log.gz 2024-09-12T00:40:10.753 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.62758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191468.log 2024-09-12T00:40:10.753 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.95795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102863.log 81.6% 2024-09-12T00:40:10.753 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95795.log.gz 2024-09-12T00:40:10.754 INFO:teuthology.orchestra.run.smithi067.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.174911.log.gz 2024-09-12T00:40:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155881.log 2024-09-12T00:40:10.754 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191468.log.gz 2024-09-12T00:40:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39419.log 2024-09-12T00:40:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.102863.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.102863.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89904.log 2024-09-12T00:40:10.754 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T00:40:10.754 INFO:teuthology.orchestra.run.smithi067.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.66100.log.gz 2024-09-12T00:40:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.155881.log: /var/log/ceph/ceph-client.admin.39419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39419.log.gz 2024-09-12T00:40:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52172.log 2024-09-12T00:40:10.754 INFO:teuthology.orchestra.run.smithi067.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.155881.log.gz 2024-09-12T00:40:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38376.log 2024-09-12T00:40:10.754 INFO:teuthology.orchestra.run.smithi067.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.89904.log.gz 2024-09-12T00:40:10.754 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191099.log 2024-09-12T00:40:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.38376.log: -5 --verbose 85.4% -- replaced with /var/log/ceph/ceph-client.admin.52172.log.gz 2024-09-12T00:40:10.755 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38376.log.gz 2024-09-12T00:40:10.755 INFO:teuthology.orchestra.run.smithi067.stderr: -- /var/log/ceph/ceph-client.admin.60514.log 2024-09-12T00:40:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191099.log.gz 2024-09-12T00:40:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166013.log 2024-09-12T00:40:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139974.log 2024-09-12T00:40:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.60514.log: /var/log/ceph/ceph-client.admin.166013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133493.log 2024-09-12T00:40:10.755 INFO:teuthology.orchestra.run.smithi067.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.60514.log.gz 2024-09-12T00:40:10.755 INFO:teuthology.orchestra.run.smithi067.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.166013.log.gz 2024-09-12T00:40:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.139974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62256.log 2024-09-12T00:40:10.755 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.139974.log.gz 2024-09-12T00:40:10.755 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.133493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99329.log 2024-09-12T00:40:10.755 INFO:teuthology.orchestra.run.smithi067.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.133493.log.gz 2024-09-12T00:40:10.756 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.62256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114054.log 2024-09-12T00:40:10.756 INFO:teuthology.orchestra.run.smithi067.stderr: 55.2% -- replaced with /var/log/ceph/ceph-client.admin.62256.log.gz 2024-09-12T00:40:10.756 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.99329.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54528.log 2024-09-12T00:40:10.756 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.99329.log.gz 2024-09-12T00:40:10.756 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.114054.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.114054.log.gz 2024-09-12T00:40:10.756 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62600.log 2024-09-12T00:40:10.756 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132904.log 2024-09-12T00:40:10.756 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.54528.log: /var/log/ceph/ceph-client.admin.62600.log: 81.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105219.log 2024-09-12T00:40:10.756 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54528.log.gz 2024-09-12T00:40:10.756 INFO:teuthology.orchestra.run.smithi067.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62600.log.gz 2024-09-12T00:40:10.756 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.132904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148220.log 2024-09-12T00:40:10.756 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.132904.log.gz 2024-09-12T00:40:10.756 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.105219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167442.log 2024-09-12T00:40:10.757 INFO:teuthology.orchestra.run.smithi067.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.105219.log.gz 2024-09-12T00:40:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.148220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171453.log 2024-09-12T00:40:10.757 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.148220.log.gz 2024-09-12T00:40:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.0.167442.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.190685.log 2024-09-12T00:40:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.171453.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.167442.log.gz 2024-09-12T00:40:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91082.log 2024-09-12T00:40:10.757 INFO:teuthology.orchestra.run.smithi067.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.171453.log.gz 2024-09-12T00:40:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109931.log 2024-09-12T00:40:10.757 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190685.log.gz 2024-09-12T00:40:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165424.log 2024-09-12T00:40:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.91082.log: /var/log/ceph/ceph-client.admin.109931.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.91082.log.gz 2024-09-12T00:40:10.757 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172817.log 2024-09-12T00:40:10.757 INFO:teuthology.orchestra.run.smithi067.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.109931.log.gz 2024-09-12T00:40:10.758 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.165424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122891.log 2024-09-12T00:40:10.758 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5/var/log/ceph/ceph-client.admin.172817.log: --verbose -- 86.7% -- replaced with /var/log/ceph/ceph-client.admin.165424.log.gz 2024-09-12T00:40:10.758 INFO:teuthology.orchestra.run.smithi067.stderr: /var/log/ceph/ceph.audit.log 2024-09-12T00:40:10.758 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.122891.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.172817.log.gz 2024-09-12T00:40:10.758 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187618.log 2024-09-12T00:40:10.758 INFO:teuthology.orchestra.run.smithi067.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122891.log.gz 2024-09-12T00:40:10.758 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164198.log 2024-09-12T00:40:10.758 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.187618.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187618.log.gz 2024-09-12T00:40:10.759 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.114643.log 2024-09-12T00:40:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.164198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188351.log 2024-09-12T00:40:10.759 INFO:teuthology.orchestra.run.smithi067.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.164198.log.gz 2024-09-12T00:40:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.114643.log: gzip 80.3% -- replaced with /var/log/ceph/ceph-client.admin.114643.log.gz 2024-09-12T00:40:10.759 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39055.log 2024-09-12T00:40:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.188351.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181032.log 2024-09-12T00:40:10.759 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.188351.log.gz 2024-09-12T00:40:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39760.log 2024-09-12T00:40:10.759 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39055.log.gz 2024-09-12T00:40:10.759 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191145.log 2024-09-12T00:40:10.760 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.181032.log: /var/log/ceph/ceph-client.admin.39760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137029.log 2024-09-12T00:40:10.760 INFO:teuthology.orchestra.run.smithi067.stderr: 94.5% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39760.log.gz 2024-09-12T00:40:10.760 INFO:teuthology.orchestra.run.smithi067.stderr: 80.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T00:40:10.760 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.0.181032.log.gz 2024-09-12T00:40:10.760 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191145.log.gz 2024-09-12T00:40:10.760 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42159.log 2024-09-12T00:40:10.760 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66719.log 2024-09-12T00:40:10.760 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.137029.log: /var/log/ceph/ceph-client.0.42159.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.137029.log.gz 2024-09-12T00:40:10.760 INFO:teuthology.orchestra.run.smithi067.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62758.log.gz 2024-09-12T00:40:10.761 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128192.log 2024-09-12T00:40:10.761 INFO:teuthology.orchestra.run.smithi067.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.42159.log.gz 2024-09-12T00:40:10.761 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.66719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111698.log 2024-09-12T00:40:10.761 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.128192.log: gzip -5 --verbose -- 81.8% -- replaced with /var/log/ceph/ceph-client.admin.128192.log.gz 2024-09-12T00:40:10.761 INFO:teuthology.orchestra.run.smithi067.stderr: /var/log/ceph/ceph-client.admin.145275.log 2024-09-12T00:40:10.761 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168092.log 2024-09-12T00:40:10.761 INFO:teuthology.orchestra.run.smithi067.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.111698.log.gz 2024-09-12T00:40:10.761 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.145275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191422.log 2024-09-12T00:40:10.762 INFO:teuthology.orchestra.run.smithi067.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.145275.log.gz 2024-09-12T00:40:10.762 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.168092.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.108164.log 2024-09-12T00:40:10.762 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191422.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191422.log.gz 2024-09-12T00:40:10.762 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.157648.log 2024-09-12T00:40:10.762 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.108164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94617.log 2024-09-12T00:40:10.762 INFO:teuthology.orchestra.run.smithi067.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.108164.log.gz 2024-09-12T00:40:10.762 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.157648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184077.log 2024-09-12T00:40:10.762 INFO:teuthology.orchestra.run.smithi067.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.157648.log.gz 2024-09-12T00:40:10.762 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80480.log 2024-09-12T00:40:10.762 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.94617.log: /var/log/ceph/ceph-client.0.184077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84603.log 2024-09-12T00:40:10.763 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.94617.log.gz 2024-09-12T00:40:10.763 INFO:teuthology.orchestra.run.smithi067.stderr: 83.8%/var/log/ceph/ceph-client.admin.80480.log: -- replaced with /var/log/ceph/ceph-client.0.184077.log.gz 2024-09-12T00:40:10.763 INFO:teuthology.orchestra.run.smithi067.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.80480.log.gz 2024-09-12T00:40:10.763 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143508.log 2024-09-12T00:40:10.763 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45180.log 2024-09-12T00:40:10.763 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8%/var/log/ceph/ceph-client.admin.143508.log: -- replaced with /var/log/ceph/ceph-client.admin.84603.log.gz 2024-09-12T00:40:10.763 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129370.log 81.2% -- replaced with /var/log/ceph/ceph-client.admin.143508.log.gz 2024-09-12T00:40:10.763 INFO:teuthology.orchestra.run.smithi067.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.66719.log.gz 2024-09-12T00:40:10.763 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T00:40:10.764 INFO:teuthology.orchestra.run.smithi067.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.168092.log.gz 2024-09-12T00:40:10.764 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.45180.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.45180.log.gz 2024-09-12T00:40:10.764 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T00:40:10.764 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.129370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180423.log 2024-09-12T00:40:10.764 INFO:teuthology.orchestra.run.smithi067.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.129370.log.gz 2024-09-12T00:40:10.764 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113465.log 2024-09-12T00:40:10.764 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.180423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83425.log 2024-09-12T00:40:10.764 INFO:teuthology.orchestra.run.smithi067.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.180423.log.gz 2024-09-12T00:40:10.764 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.113465.log: -5 --verbose -- /var/log/ceph/ceph-client.0.76501.log 2024-09-12T00:40:10.765 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.83425.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.83425.log.gz 2024-09-12T00:40:10.765 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47364.log 2024-09-12T00:40:10.765 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85781.log/var/log/ceph/ceph-client.0.76501.log: 2024-09-12T00:40:10.765 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.47364.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.76501.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132315.log 2024-09-12T00:40:10.765 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T00:40:10.765 INFO:teuthology.orchestra.run.smithi067.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.47364.log.gz 2024-09-12T00:40:10.765 INFO:teuthology.orchestra.run.smithi067.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.113465.log.gz 2024-09-12T00:40:10.765 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.85781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181641.log 2024-09-12T00:40:10.765 INFO:teuthology.orchestra.run.smithi067.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.85781.log.gz 2024-09-12T00:40:10.765 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.132315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92261.log 2024-09-12T00:40:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.181641.log: gzip -5 87.3% -- replaced with /var/log/ceph/ceph-client.admin.132315.log.gz 2024-09-12T00:40:10.766 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.admin.125836.log 2024-09-12T00:40:10.766 INFO:teuthology.orchestra.run.smithi067.stderr: 80.4%/var/log/ceph/ceph-client.admin.92261.log: -- replaced with /var/log/ceph/ceph-client.0.181641.log.gz 2024-09-12T00:40:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69817.log 2024-09-12T00:40:10.766 INFO:teuthology.orchestra.run.smithi067.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.92261.log.gz 2024-09-12T00:40:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.125836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57497.log 2024-09-12T00:40:10.766 INFO:teuthology.orchestra.run.smithi067.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T00:40:10.766 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.69817.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52761.log 2024-09-12T00:40:10.766 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.125836.log.gz 2024-09-12T00:40:10.767 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.57497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39051.log 2024-09-12T00:40:10.767 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57497.log.gz 2024-09-12T00:40:10.767 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.52761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191007.log 2024-09-12T00:40:10.767 INFO:teuthology.orchestra.run.smithi067.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.52761.log.gz 2024-09-12T00:40:10.767 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39051.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39051.log.gz 2024-09-12T00:40:10.767 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63537.log 2024-09-12T00:40:10.767 INFO:teuthology.orchestra.run.smithi067.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69817.log.gz 2024-09-12T00:40:10.767 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191007.log.gz 2024-09-12T00:40:10.767 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108753.log 2024-09-12T00:40:10.768 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.63537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128781.log 2024-09-12T00:40:10.768 INFO:teuthology.orchestra.run.smithi067.stderr: 22.0% -- replaced with /var/log/ceph/ceph-client.admin.63537.log.gz 2024-09-12T00:40:10.768 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.108753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104041.log 2024-09-12T00:40:10.768 INFO:teuthology.orchestra.run.smithi067.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.108753.log.gz 2024-09-12T00:40:10.768 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.128781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119357.log 2024-09-12T00:40:10.768 INFO:teuthology.orchestra.run.smithi067.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.128781.log.gz 2024-09-12T00:40:10.768 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84014.log 2024-09-12T00:40:10.768 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.104041.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.104041.log.gz 2024-09-12T00:40:10.768 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62824.log 2024-09-12T00:40:10.769 INFO:teuthology.orchestra.run.smithi067.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.119357.log.gz 2024-09-12T00:40:10.769 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118768.log 2024-09-12T00:40:10.769 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.84014.log: /var/log/ceph/ceph-client.admin.62824.log: gzip -5 --verbose 87.8% -- /var/log/ceph/ceph-client.admin.188375.log -- replaced with /var/log/ceph/ceph-client.admin.84014.log.gz 2024-09-12T00:40:10.769 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T00:40:10.769 INFO:teuthology.orchestra.run.smithi067.stderr: 54.9% -- replaced with /var/log/ceph/ceph-client.admin.62824.log.gz 2024-09-12T00:40:10.769 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.118768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55117.log 2024-09-12T00:40:10.769 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.118768.log.gz 2024-09-12T00:40:10.769 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.188375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39416.log 2024-09-12T00:40:10.770 INFO:teuthology.orchestra.run.smithi067.stderr: 81.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.188375.log.gz 2024-09-12T00:40:10.770 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T00:40:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55117.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.55117.log.gz 2024-09-12T00:40:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79302.log 2024-09-12T00:40:10.770 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39416.log.gz 2024-09-12T00:40:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68579.log 2024-09-12T00:40:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.79302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62374.log 2024-09-12T00:40:10.770 INFO:teuthology.orchestra.run.smithi067.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.79302.log.gz 2024-09-12T00:40:10.770 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.68579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151165.log 2024-09-12T00:40:10.771 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.admin.62374.log: -5 --verbose -- /var/log/ceph/ceph-client.0.75890.log 2024-09-12T00:40:10.771 INFO:teuthology.orchestra.run.smithi067.stderr: 49.9% -- replaced with /var/log/ceph/ceph-client.admin.62374.log.gz 2024-09-12T00:40:10.771 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.151165.log: 82.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39802.log 2024-09-12T00:40:10.771 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.151165.log.gz 2024-09-12T00:40:10.771 INFO:teuthology.orchestra.run.smithi067.stderr:gzip/var/log/ceph/ceph-client.0.75890.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.95206.log 2024-09-12T00:40:10.771 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39802.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.75890.log.gz 2024-09-12T00:40:10.771 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39802.log.gz 2024-09-12T00:40:10.771 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161205.log 2024-09-12T00:40:10.771 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.95206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96384.log 2024-09-12T00:40:10.772 INFO:teuthology.orchestra.run.smithi067.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95206.log.gz 2024-09-12T00:40:10.772 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170845.log 2024-09-12T00:40:10.772 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.96384.log: /var/log/ceph/ceph-client.admin.161205.log: gzip -5 81.5% -- replaced with /var/log/ceph/ceph-client.admin.96384.log.gz 2024-09-12T00:40:10.772 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.admin.190593.log 2024-09-12T00:40:10.772 INFO:teuthology.orchestra.run.smithi067.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.161205.log.gz 2024-09-12T00:40:10.772 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.170845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185295.log 2024-09-12T00:40:10.772 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39047.log 2024-09-12T00:40:10.772 INFO:teuthology.orchestra.run.smithi067.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.170845.log.gz 2024-09-12T00:40:10.773 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190593.log: 0.0%/var/log/ceph/ceph-client.0.185295.log: -- replaced with /var/log/ceph/ceph-client.admin.190593.log.gz 2024-09-12T00:40:10.773 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 79.6% -- replaced with /var/log/ceph/ceph-client.0.185295.log.gz 2024-09-12T00:40:10.773 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-client.admin.152934.log 2024-09-12T00:40:10.773 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39047.log.gz 2024-09-12T00:40:10.773 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62694.log 2024-09-12T00:40:10.773 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5/var/log/ceph/ceph-client.admin.152934.log: --verbose -- /var/log/ceph/ceph-client.admin.154113.log 2024-09-12T00:40:10.773 INFO:teuthology.orchestra.run.smithi067.stderr: 82.5%/var/log/ceph/ceph-client.admin.62694.log: -- replaced with /var/log/ceph/ceph-client.admin.152934.log.gz 2024-09-12T00:40:10.773 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62694.log.gz 2024-09-12T00:40:10.773 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39627.log 2024-09-12T00:40:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.154113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116412.log 2024-09-12T00:40:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49768.log 2024-09-12T00:40:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39627.log.gz 2024-09-12T00:40:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.116412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39052.log 2024-09-12T00:40:10.774 INFO:teuthology.orchestra.run.smithi067.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.116412.log.gz 2024-09-12T00:40:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49768.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.154113.log.gz 2024-09-12T00:40:10.774 INFO:teuthology.orchestra.run.smithi067.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.49768.log.gz 2024-09-12T00:40:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121124.log 2024-09-12T00:40:10.774 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190454.log 2024-09-12T00:40:10.774 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39052.log.gz 2024-09-12T00:40:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40330.log 2024-09-12T00:40:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.121124.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.121124.log.gzgzip 2024-09-12T00:40:10.775 INFO:teuthology.orchestra.run.smithi067.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.109342.log 2024-09-12T00:40:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190454.log: /var/log/ceph/ceph-client.0.40330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190454.log.gz 2024-09-12T00:40:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111109.log 2024-09-12T00:40:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.109342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82247.log 2024-09-12T00:40:10.775 INFO:teuthology.orchestra.run.smithi067.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.109342.log.gz 2024-09-12T00:40:10.775 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.111109.log: 81.5% 95.8% -- replaced with /var/log/ceph/ceph-client.0.40330.log.gz 2024-09-12T00:40:10.776 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147042.log 2024-09-12T00:40:10.776 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.111109.log.gz 2024-09-12T00:40:10.776 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5/var/log/ceph/ceph-client.admin.82247.log: --verbose -- /var/log/ceph/ceph-client.admin.39421.log 2024-09-12T00:40:10.776 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8%/var/log/ceph/ceph-client.admin.147042.log: -- replaced with /var/log/ceph/ceph-client.admin.82247.log.gz 2024-09-12T00:40:10.776 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190869.log 2024-09-12T00:40:10.776 INFO:teuthology.orchestra.run.smithi067.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.147042.log.gz 2024-09-12T00:40:10.776 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168700.log 2024-09-12T00:40:10.776 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39421.log: /var/log/ceph/ceph-client.admin.190869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162972.log 2024-09-12T00:40:10.776 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39421.log.gz 2024-09-12T00:40:10.777 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.190869.log.gz 2024-09-12T00:40:10.777 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.168700.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.168700.log.gz 2024-09-12T00:40:10.777 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154702.log 2024-09-12T00:40:10.777 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.162972.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162972.log.gz 2024-09-12T00:40:10.777 INFO:teuthology.orchestra.run.smithi067.stderr: --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T00:40:10.777 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.154702.log: gzip -5 --verbose 81.6% -- replaced with /var/log/ceph/ceph-client.admin.154702.log.gz 2024-09-12T00:40:10.777 INFO:teuthology.orchestra.run.smithi067.stderr: -- /var/log/ceph/ceph-client.admin.38841.log 2024-09-12T00:40:10.777 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40127.log 2024-09-12T00:40:10.777 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38841.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49155.log 2024-09-12T00:40:10.777 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38841.log.gz 2024-09-12T00:40:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145864.log 2024-09-12T00:40:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40127.log: /var/log/ceph/ceph-client.admin.49155.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40127.log.gz 2024-09-12T00:40:10.778 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49155.log.gz 2024-09-12T00:40:10.778 INFO:teuthology.orchestra.run.smithi067.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.68579.log.gz 2024-09-12T00:40:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159416.log 2024-09-12T00:40:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.145864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64240.log 2024-09-12T00:40:10.778 INFO:teuthology.orchestra.run.smithi067.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.145864.log.gz 2024-09-12T00:40:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.159416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191191.log 2024-09-12T00:40:10.778 INFO:teuthology.orchestra.run.smithi067.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.159416.log.gz 2024-09-12T00:40:10.778 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177376.log 2024-09-12T00:40:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.64240.log: gzip/var/log/ceph/ceph-client.admin.191191.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191191.log.gz 2024-09-12T00:40:10.779 INFO:teuthology.orchestra.run.smithi067.stderr: /var/log/ceph/ceph-client.0.176767.log 2024-09-12T00:40:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.177376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92850.log 2024-09-12T00:40:10.779 INFO:teuthology.orchestra.run.smithi067.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.177376.log.gz 2024-09-12T00:40:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.176767.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.176767.log.gz 2024-09-12T00:40:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33206.log 2024-09-12T00:40:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.92850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184686.log 2024-09-12T00:40:10.779 INFO:teuthology.orchestra.run.smithi067.stderr: 81.5%/var/log/ceph/ceph-client.admin.33206.log: -- replaced with /var/log/ceph/ceph-client.admin.92850.log.gz 2024-09-12T00:40:10.779 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33206.log.gz 2024-09-12T00:40:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48542.log 2024-09-12T00:40:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.184686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189775.log 2024-09-12T00:40:10.779 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.48542.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.184686.log.gz 2024-09-12T00:40:10.779 INFO:teuthology.orchestra.run.smithi067.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.48542.log.gz 2024-09-12T00:40:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164811.log 2024-09-12T00:40:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.189775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160616.log 2024-09-12T00:40:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.164811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164811.log.gz 2024-09-12T00:40:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33118.log 2024-09-12T00:40:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.160616.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.160616.log.gz 2024-09-12T00:40:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39255.log 2024-09-12T00:40:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.33118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33118.log.gz 2024-09-12T00:40:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115823.log 2024-09-12T00:40:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39255.log.gz 2024-09-12T00:40:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T00:40:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115823.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.115823.log.gz 2024-09-12T00:40:10.780 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190547.log 2024-09-12T00:40:10.781 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.2.log: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.64240.log.gz 2024-09-12T00:40:10.781 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164835.log 2024-09-12T00:40:10.781 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190547.log.gz 2024-09-12T00:40:10.781 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40217.log 2024-09-12T00:40:10.781 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.164835.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.164835.log.gz 2024-09-12T00:40:10.781 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77269.log 2024-09-12T00:40:10.781 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40217.log.gz 2024-09-12T00:40:10.781 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121713.log 2024-09-12T00:40:10.781 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.77269.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.77269.log.gz 2024-09-12T00:40:10.781 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183468.log 2024-09-12T00:40:10.782 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.121713.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.121713.log.gz 2024-09-12T00:40:10.782 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190915.log 2024-09-12T00:40:10.782 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.183468.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.183468.log.gz 2024-09-12T00:40:10.782 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39648.log 2024-09-12T00:40:10.782 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190915.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190915.log.gz 2024-09-12T00:40:10.782 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139385.log 2024-09-12T00:40:10.782 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39648.log.gz 2024-09-12T00:40:10.782 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187666.log 2024-09-12T00:40:10.782 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.139385.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.139385.log.gz 2024-09-12T00:40:10.782 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39721.log 2024-09-12T00:40:10.782 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.187666.log: 86.8% -- replaced with /var/log/ceph/ceph-client.0.189775.log.gz 2024-09-12T00:40:10.783 INFO:teuthology.orchestra.run.smithi067.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.187666.log.gz 2024-09-12T00:40:10.783 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T00:40:10.783 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39721.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73963.log 2024-09-12T00:40:10.783 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39721.log.gz 2024-09-12T00:40:10.783 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86370.log 2024-09-12T00:40:10.783 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.73963.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73963.log.gz 2024-09-12T00:40:10.783 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104630.log 2024-09-12T00:40:10.783 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.86370.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.86370.log.gz 2024-09-12T00:40:10.783 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42762.log 2024-09-12T00:40:10.783 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.104630.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.104630.log.gz 2024-09-12T00:40:10.784 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120535.log 2024-09-12T00:40:10.784 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.42762.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.42762.log.gz 2024-09-12T00:40:10.784 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188278.log 2024-09-12T00:40:10.784 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.120535.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.120535.log.gz 2024-09-12T00:40:10.784 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39422.log 2024-09-12T00:40:10.784 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.188278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188278.log.gz 2024-09-12T00:40:10.784 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82836.log 2024-09-12T00:40:10.784 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39422.log.gz 2024-09-12T00:40:10.784 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T00:40:10.784 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.82836.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.82836.log.gz 2024-09-12T00:40:10.784 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110520.log 2024-09-12T00:40:10.784 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph.log: 94.7% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T00:40:10.785 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138796.log 2024-09-12T00:40:10.785 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.110520.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.110520.log.gz 2024-09-12T00:40:10.785 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75144.log 2024-09-12T00:40:10.785 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.138796.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.138796.log.gz 2024-09-12T00:40:10.785 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144686.log 2024-09-12T00:40:10.785 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.75144.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.75144.log.gz 2024-09-12T00:40:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150576.log 2024-09-12T00:40:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.144686.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.144686.log.gz 2024-09-12T00:40:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51583.log 2024-09-12T00:40:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.150576.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.150576.log.gz 2024-09-12T00:40:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49131.log 2024-09-12T00:40:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51583.log: 93.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T00:40:10.865 INFO:teuthology.orchestra.run.smithi067.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.51583.log.gz 2024-09-12T00:40:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126425.log 2024-09-12T00:40:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46775.log 2024-09-12T00:40:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.49131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49131.log.gz 2024-09-12T00:40:10.865 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.126425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191376.log 2024-09-12T00:40:10.866 INFO:teuthology.orchestra.run.smithi067.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.126425.log.gz 2024-09-12T00:40:10.866 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.46775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77213.log 2024-09-12T00:40:10.866 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191376.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.46775.log.gz 2024-09-12T00:40:10.866 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191376.log.gz 2024-09-12T00:40:10.866 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127603.log 2024-09-12T00:40:10.866 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40947.log 2024-09-12T00:40:10.866 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.77213.log: 50.5% -- replaced with /var/log/ceph/ceph-client.admin.77213.log.gz 2024-09-12T00:40:10.866 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.127603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172209.log 2024-09-12T00:40:10.866 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.40947.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.40947.log.gz 2024-09-12T00:40:10.866 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117590.log 2024-09-12T00:40:10.866 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.172209.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.127603.log.gz 2024-09-12T00:40:10.866 INFO:teuthology.orchestra.run.smithi067.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.172209.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187596.log 2024-09-12T00:40:10.866 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T00:40:10.867 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.117590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189071.log 2024-09-12T00:40:10.867 INFO:teuthology.orchestra.run.smithi067.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.117590.log.gz 2024-09-12T00:40:10.867 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.187596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140563.log 2024-09-12T00:40:10.867 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.189071.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.187596.log.gz 2024-09-12T00:40:10.867 INFO:teuthology.orchestra.run.smithi067.stderr: 80.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162383.log 2024-09-12T00:40:10.867 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.0.189071.log.gz 2024-09-12T00:40:10.867 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115234.log 2024-09-12T00:40:10.867 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.140563.log: /var/log/ceph/ceph-client.admin.162383.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.140563.log.gz 2024-09-12T00:40:10.867 INFO:teuthology.orchestra.run.smithi067.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.162383.log.gz 2024-09-12T00:40:10.867 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53350.log 2024-09-12T00:40:10.867 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137618.log 2024-09-12T00:40:10.867 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.115234.log: /var/log/ceph/ceph-client.admin.53350.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.115234.log.gz 2024-09-12T00:40:10.868 INFO:teuthology.orchestra.run.smithi067.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.53350.log.gz 2024-09-12T00:40:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153524.log 2024-09-12T00:40:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.137618.log: /var/log/ceph/ceph-client.admin.112876.log 2024-09-12T00:40:10.868 INFO:teuthology.orchestra.run.smithi067.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.137618.log.gz/var/log/ceph/ceph-client.admin.153524.log: 2024-09-12T00:40:10.868 INFO:teuthology.orchestra.run.smithi067.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.153524.log.gz 2024-09-12T00:40:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88726.log 2024-09-12T00:40:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39048.log 2024-09-12T00:40:10.868 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.112876.log.gz 2024-09-12T00:40:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142330.log 2024-09-12T00:40:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39048.log.gz 2024-09-12T00:40:10.868 INFO:teuthology.orchestra.run.smithi067.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.88726.log.gz 2024-09-12T00:40:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89315.log 2024-09-12T00:40:10.868 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.142330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67338.log 2024-09-12T00:40:10.869 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.89315.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.89315.log.gz 2024-09-12T00:40:10.869 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56884.log 2024-09-12T00:40:10.869 INFO:teuthology.orchestra.run.smithi067.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.142330.log.gz 2024-09-12T00:40:10.869 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.67338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102274.log 2024-09-12T00:40:10.869 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.56884.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.56884.log.gz 2024-09-12T00:40:10.869 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131726.log 2024-09-12T00:40:10.869 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.102274.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.102274.log.gz 2024-09-12T00:40:10.869 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124069.log 2024-09-12T00:40:10.869 INFO:teuthology.orchestra.run.smithi067.stderr: 89.8%/var/log/ceph/ceph-client.admin.131726.log: -- replaced with /var/log/ceph/ceph-client.admin.67338.log.gz 2024-09-12T00:40:10.869 INFO:teuthology.orchestra.run.smithi067.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.131726.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191237.log 2024-09-12T00:40:10.869 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T00:40:10.869 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32780.log 2024-09-12T00:40:10.869 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.124069.log: /var/log/ceph/ceph-client.admin.191237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191237.log.gz 2024-09-12T00:40:10.870 INFO:teuthology.orchestra.run.smithi067.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.124069.log.gz 2024-09-12T00:40:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39054.log 2024-09-12T00:40:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.32780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135260.log 2024-09-12T00:40:10.870 INFO:teuthology.orchestra.run.smithi067.stderr: 29.1% -- replaced with /var/log/ceph/ceph-client.admin.32780.log.gz 2024-09-12T00:40:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188256.log 2024-09-12T00:40:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.135260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39054.log.gz 2024-09-12T00:40:10.870 INFO:teuthology.orchestra.run.smithi067.stderr: 81.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179814.log 2024-09-12T00:40:10.870 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.135260.log.gz 2024-09-12T00:40:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74553.log 2024-09-12T00:40:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.188256.log: /var/log/ceph/ceph-client.0.179814.log: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.188256.log.gz 2024-09-12T00:40:10.870 INFO:teuthology.orchestra.run.smithi067.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.179814.log.gz 2024-09-12T00:40:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39423.log 2024-09-12T00:40:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81658.log 2024-09-12T00:40:10.870 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39423.log: /var/log/ceph/ceph-client.admin.74553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39423.log.gz 2024-09-12T00:40:10.871 INFO:teuthology.orchestra.run.smithi067.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.74553.log.gz 2024-09-12T00:40:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138207.log 2024-09-12T00:40:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.81658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112287.log 2024-09-12T00:40:10.871 INFO:teuthology.orchestra.run.smithi067.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.81658.log.gz 2024-09-12T00:40:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.138207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106986.log 2024-09-12T00:40:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.112287.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.138207.log.gz 2024-09-12T00:40:10.871 INFO:teuthology.orchestra.run.smithi067.stderr: 81.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53939.log 2024-09-12T00:40:10.871 INFO:teuthology.orchestra.run.smithi067.stderr: -- replaced with /var/log/ceph/ceph-client.admin.112287.log.gz 2024-09-12T00:40:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187006.log 2024-09-12T00:40:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.106986.log: /var/log/ceph/ceph-client.admin.53939.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.53939.log.gz 2024-09-12T00:40:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65479.log 2024-09-12T00:40:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.187006.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.187006.log.gz 2024-09-12T00:40:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T00:40:10.871 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.65479.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.106986.log.gz 2024-09-12T00:40:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142919.log 2024-09-12T00:40:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/rgw.ceph.client.0.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.65479.log.gz 2024-09-12T00:40:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63471.log 2024-09-12T00:40:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.142919.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.142919.log.gz 2024-09-12T00:40:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103452.log 2024-09-12T00:40:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.63471.log: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.63471.log.gz 2024-09-12T00:40:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61982.log 2024-09-12T00:40:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.103452.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103452.log.gz 2024-09-12T00:40:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51559.log 2024-09-12T00:40:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.61982.log: 59.1% -- replaced with /var/log/ceph/ceph-client.admin.61982.log.gz 2024-09-12T00:40:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186417.log 2024-09-12T00:40:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.51559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51559.log.gz 2024-09-12T00:40:10.872 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191515.log 2024-09-12T00:40:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.186417.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.186417.log.gz 2024-09-12T00:40:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91671.log 2024-09-12T00:40:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191515.log.gz 2024-09-12T00:40:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101096.log 2024-09-12T00:40:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.91671.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.91671.log.gz 2024-09-12T00:40:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78713.log 2024-09-12T00:40:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.101096.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.101096.log.gz 2024-09-12T00:40:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188302.log 2024-09-12T00:40:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.78713.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.78713.log.gz 2024-09-12T00:40:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160027.log 2024-09-12T00:40:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.188302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188302.log.gz 2024-09-12T00:40:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119946.log 2024-09-12T00:40:10.873 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.160027.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.160027.log.gz 2024-09-12T00:40:10.874 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100507.log 2024-09-12T00:40:10.874 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.119946.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119946.log.gz 2024-09-12T00:40:10.874 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59925.log 2024-09-12T00:40:10.874 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.100507.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100507.log.gz 2024-09-12T00:40:10.874 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38644.log 2024-09-12T00:40:10.874 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59925.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.59925.log.gz 2024-09-12T00:40:10.874 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61103.log 2024-09-12T00:40:10.874 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.38644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38644.log.gz 2024-09-12T00:40:10.874 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50946.log 2024-09-12T00:40:10.874 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.61103.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.61103.log.gz 2024-09-12T00:40:10.874 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157059.log 2024-09-12T00:40:10.874 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.50946.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.50946.log.gz 2024-09-12T00:40:10.874 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39420.log 2024-09-12T00:40:10.874 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.157059.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.157059.log.gz 2024-09-12T00:40:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134671.log 2024-09-12T00:40:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39420.log.gz 2024-09-12T00:40:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127014.log 2024-09-12T00:40:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.134671.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.134671.log.gz 2024-09-12T00:40:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40261.log 2024-09-12T00:40:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.127014.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.127014.log.gz 2024-09-12T00:40:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131137.log 2024-09-12T00:40:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40261.log.gz 2024-09-12T00:40:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182859.log 2024-09-12T00:40:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.131137.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.131137.log.gz 2024-09-12T00:40:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93439.log 2024-09-12T00:40:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.182859.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.182859.log.gz 2024-09-12T00:40:10.875 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190639.log 2024-09-12T00:40:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.93439.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.93439.log.gz 2024-09-12T00:40:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55706.log 2024-09-12T00:40:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190639.log.gz 2024-09-12T00:40:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191559.log 2024-09-12T00:40:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.55706.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.55706.log.gz 2024-09-12T00:40:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190961.log 2024-09-12T00:40:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191559.log.gz 2024-09-12T00:40:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40307.log 2024-09-12T00:40:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190961.log.gz 2024-09-12T00:40:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44577.log 2024-09-12T00:40:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40307.log.gz 2024-09-12T00:40:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59877.log 2024-09-12T00:40:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.0.44577.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.44577.log.gz 2024-09-12T00:40:10.876 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124658.log 2024-09-12T00:40:10.877 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59877.log.gz 2024-09-12T00:40:10.877 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188326.log 2024-09-12T00:40:10.877 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.124658.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.124658.log.gz 2024-09-12T00:40:10.877 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T00:40:10.877 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.188326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188326.log.gz 2024-09-12T00:40:10.877 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58110.log 2024-09-12T00:40:10.877 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190731.log 2024-09-12T00:40:10.877 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.58110.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.58110.log.gz 2024-09-12T00:40:10.877 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40171.log 2024-09-12T00:40:10.877 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.190731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190731.log.gz 2024-09-12T00:40:10.877 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59288.log 2024-09-12T00:40:10.877 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.40171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40171.log.gz 2024-09-12T00:40:10.878 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62888.log 2024-09-12T00:40:10.879 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.59288.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.59288.log.gz 2024-09-12T00:40:10.882 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39801.log 2024-09-12T00:40:10.882 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.62888.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.62888.log.gz 2024-09-12T00:40:10.893 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90493.log 2024-09-12T00:40:10.894 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.39801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39801.log.gz 2024-09-12T00:40:10.906 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163609.log 2024-09-12T00:40:10.908 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.90493.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.90493.log.gz 2024-09-12T00:40:10.922 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158827.log 2024-09-12T00:40:10.923 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.163609.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.163609.log.gz 2024-09-12T00:40:10.935 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147631.log 2024-09-12T00:40:10.936 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.158827.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.158827.log.gz 2024-09-12T00:40:10.944 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88137.log 2024-09-12T00:40:10.957 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.147631.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.147631.log.gz 2024-09-12T00:40:10.959 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97562.log 2024-09-12T00:40:10.960 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.88137.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.88137.log.gz 2024-09-12T00:40:10.968 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170237.log 2024-09-12T00:40:10.977 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.97562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191329.log 2024-09-12T00:40:10.981 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.170237.log: 92.3% 81.9% -- replaced with /var/log/ceph/ceph-client.admin.97562.log.gz 2024-09-12T00:40:10.986 INFO:teuthology.orchestra.run.smithi067.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164787.log 2024-09-12T00:40:10.991 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.191329.log: -- replaced with /var/log/ceph/ceph-client.admin.170237.log.gz 2024-09-12T00:40:10.999 INFO:teuthology.orchestra.run.smithi067.stderr:/var/log/ceph/ceph-client.admin.164787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191329.log.gz 2024-09-12T00:40:11.008 INFO:teuthology.orchestra.run.smithi067.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164787.log.gz 2024-09-12T00:40:11.121 INFO:teuthology.orchestra.run.smithi067.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T00:40:11.153 INFO:teuthology.orchestra.run.smithi170.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T00:40:11.664 INFO:teuthology.orchestra.run.smithi067.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T00:40:12.777 INFO:teuthology.orchestra.run.smithi067.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T00:40:13.887 INFO:teuthology.orchestra.run.smithi067.stderr: 93.4% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T00:40:18.508 INFO:teuthology.orchestra.run.smithi170.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T00:40:19.628 INFO:teuthology.orchestra.run.smithi170.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T00:40:20.029 INFO:teuthology.orchestra.run.smithi067.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T00:40:20.128 INFO:teuthology.orchestra.run.smithi067.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T00:40:23.501 INFO:teuthology.orchestra.run.smithi067.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T00:40:23.901 INFO:teuthology.orchestra.run.smithi170.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T00:40:30.739 INFO:teuthology.orchestra.run.smithi170.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T00:40:30.741 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-09-12T00:40:30.741 INFO:teuthology.orchestra.run.smithi170.stderr:real 0m20.119s 2024-09-12T00:40:30.741 INFO:teuthology.orchestra.run.smithi170.stderr:user 0m48.808s 2024-09-12T00:40:30.741 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m1.788s 2024-09-12T00:40:31.502 INFO:teuthology.orchestra.run.smithi067.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T00:40:31.504 INFO:teuthology.orchestra.run.smithi067.stderr: 2024-09-12T00:40:31.504 INFO:teuthology.orchestra.run.smithi067.stderr:real 0m20.924s 2024-09-12T00:40:31.504 INFO:teuthology.orchestra.run.smithi067.stderr:user 0m57.502s 2024-09-12T00:40:31.504 INFO:teuthology.orchestra.run.smithi067.stderr:sys 0m2.071s 2024-09-12T00:40:31.505 INFO:tasks.ceph:Archiving logs... 2024-09-12T00:40:31.505 DEBUG:teuthology.misc:Transferring archived files from smithi067:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901823/remote/smithi067/log 2024-09-12T00:40:31.506 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:40:38.960 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901823/remote/smithi170/log 2024-09-12T00:40:38.961 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:40:45.775 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T00:40:45.785 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T00:40:45.785 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:40:45.788 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:40:45.905 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T00:40:45.914 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T00:40:45.915 DEBUG:teuthology.orchestra.run.smithi067:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:40:45.917 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:40:45.947 INFO:teuthology.orchestra.run.smithi067.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:40:45.948 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:40:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:40:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2024-09-12T00:40:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:^* hv01.front.sepia.ceph.com 3 6 377 13 +780us[ +802us] +/- 73ms 2024-09-12T00:40:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 -955us[ -955us] +/- 69ms 2024-09-12T00:40:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +307us[ +307us] +/- 85ms 2024-09-12T00:40:45.952 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:40:45.954 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:40:45.954 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-09-12T00:40:45.954 INFO:teuthology.orchestra.run.smithi170.stdout:^* hv01.front.sepia.ceph.com 3 6 377 11 +682us[ +786us] +/- 45ms 2024-09-12T00:40:45.954 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 12 -1051us[ -947us] +/- 69ms 2024-09-12T00:40:45.954 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +201us[ +305us] +/- 85ms 2024-09-12T00:40:45.954 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:40:45.954 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T00:40:45.964 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T00:40:45.965 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T00:40:45.974 DEBUG:teuthology.orchestra.run.smithi067:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T00:40:46.078 DEBUG:teuthology.orchestra.run.smithi170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T00:40:46.155 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T00:40:46.199 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:40:46.200 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T00:40:46.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:40:46.242 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T00:40:46.253 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T00:40:46.279 INFO:teuthology.task.internal:Duration was 2773.326020 seconds 2024-09-12T00:40:46.280 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T00:40:46.302 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T00:40:46.303 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:40:46.305 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:40:46.357 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:40:46.358 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:40:46.694 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T00:40:46.694 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi067.front.sepia.ceph.com 2024-09-12T00:40:46.695 DEBUG:teuthology.orchestra.run.smithi067:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:40:46.729 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2024-09-12T00:40:46.729 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:40:46.762 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T00:40:46.762 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:40:46.771 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:40:46.843 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T00:40:46.843 DEBUG:teuthology.orchestra.run.smithi067:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:40:46.853 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:40:46.996 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T00:40:47.008 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T00:40:47.008 DEBUG:teuthology.orchestra.run.smithi067:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:40:47.047 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:40:47.086 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T00:40:47.097 DEBUG:teuthology.orchestra.run.smithi067:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:40:47.100 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:40:47.135 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = core 2024-09-12T00:40:47.164 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2024-09-12T00:40:47.267 DEBUG:teuthology.orchestra.run.smithi067:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:40:47.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:40:47.296 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:40:47.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:40:47.336 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T00:40:47.348 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T00:40:47.348 DEBUG:teuthology.misc:Transferring archived files from smithi067:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901823/remote/smithi067 2024-09-12T00:40:47.349 DEBUG:teuthology.orchestra.run.smithi067:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:40:47.400 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901823/remote/smithi170 2024-09-12T00:40:47.400 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:40:47.449 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T00:40:47.450 DEBUG:teuthology.orchestra.run.smithi067:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:40:47.452 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:40:47.513 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T00:40:47.525 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T00:40:47.525 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T00:40:47.536 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T00:40:47.536 DEBUG:teuthology.orchestra.run.smithi067:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:40:47.539 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:40:47.566 INFO:teuthology.orchestra.run.smithi067.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:40 /home/ubuntu/cephtest 2024-09-12T00:40:47.582 INFO:teuthology.orchestra.run.smithi170.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:40 /home/ubuntu/cephtest 2024-09-12T00:40:47.583 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T00:40:47.595 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T00:40:47.621 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 2773.3260197639465 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T00:40:47.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:40:47.714 INFO:teuthology.run:pass